2024-01-25T14:41:39.618 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-25T14:41:39.619 DEBUG:teuthology.run:Teuthology command: teuthology --name vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478 --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} --owner scheduled_vshankar@teuthology --verbose -- /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478/orig.config.yaml 2024-01-25T14:41:39.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T14:41:39.763 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478 branch: wip-vshankar-testing-20240125.044502 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} email: vshankar@redhat.com first_in_suite: false job_id: '7531478' kernel: client: sha1: distro flavor: default kdb: true sha1: cd42140e628558a450ba1d39a9d0835a2fa62cda ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240125.044502 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 661946e7044723130c03627323f6a879a9848cb5 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 661946e7044723130c03627323f6a879a9848cb5 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240125.044502 sha1: 661946e7044723130c03627323f6a879a9848cb5 owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 9619 sha1: 661946e7044723130c03627323f6a879a9848cb5 sleep_before_teardown: 0 subset: 293/1024 suite: fs suite_branch: wip-vshankar-testing-20240125.044502 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 661946e7044723130c03627323f6a879a9848cb5 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLgeh40enNcoRxcbQVe70Az2yvPF61rqI1k0qai7XZ06nIYSHLbPTvxv06/um59EPEzmqYeyVNXRl2FjiQfMe48= smithi186.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLASKxRgHg/eQx3Hs33fm+Uc9kXA9L474Kw+66JzbQisud44CcqlcAPMfBZRwCPtLaQtKivXckgt8G/OUJ8YEHs= smithi191.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyu91bXCYsgoj4F65X6IvyknQhf/t9Q1uulA8gF9DRRnFOscW5OmwyLGNtnKgr7fvM/Klo76sa+FDbo+Nq2ZJs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: c856e0f9244dd29a50697123b480d63f16a4ed81 timestamp: 2024-01-25_13:52:19 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-25T14:41:39.764 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa; will attempt to use it 2024-01-25T14:41:39.764 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks 2024-01-25T14:41:39.765 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-25T14:41:39.766 INFO:teuthology.task.internal:Checking packages... 2024-01-25T14:41:39.788 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '661946e7044723130c03627323f6a879a9848cb5' 2024-01-25T14:41:39.788 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-25T14:41:39.788 INFO:teuthology.packaging:ref: None 2024-01-25T14:41:39.788 INFO:teuthology.packaging:tag: None 2024-01-25T14:41:39.788 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240125.044502 2024-01-25T14:41:39.788 INFO:teuthology.packaging:sha1: 661946e7044723130c03627323f6a879a9848cb5 2024-01-25T14:41:39.788 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240125.044502 2024-01-25T14:41:39.931 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-885.g661946e7 2024-01-25T14:41:39.933 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-25T14:41:39.940 INFO:teuthology.task.internal:no buildpackages task found 2024-01-25T14:41:39.940 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-25T14:41:39.973 INFO:teuthology.task.internal:Saving configuration 2024-01-25T14:41:39.995 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-25T14:41:40.001 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-25T14:41:40.024 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 14:36:24.992793', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLgeh40enNcoRxcbQVe70Az2yvPF61rqI1k0qai7XZ06nIYSHLbPTvxv06/um59EPEzmqYeyVNXRl2FjiQfMe48='} 2024-01-25T14:41:40.045 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 14:36:24.994165', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLASKxRgHg/eQx3Hs33fm+Uc9kXA9L474Kw+66JzbQisud44CcqlcAPMfBZRwCPtLaQtKivXckgt8G/OUJ8YEHs='} 2024-01-25T14:41:40.068 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 14:36:24.995408', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyu91bXCYsgoj4F65X6IvyknQhf/t9Q1uulA8gF9DRRnFOscW5OmwyLGNtnKgr7fvM/Klo76sa+FDbo+Nq2ZJs='} 2024-01-25T14:41:40.068 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-25T14:41:40.075 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-01-25T14:41:40.075 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-01-25T14:41:40.075 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-01-25T14:41:40.075 INFO:teuthology.run_tasks:Running task console_log... 2024-01-25T14:41:40.171 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbb21c63160>, signals=[15]) 2024-01-25T14:41:40.172 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-25T14:41:40.182 INFO:teuthology.task.internal:Opening connections... 2024-01-25T14:41:40.182 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2024-01-25T14:41:40.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:41:40.275 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi186.front.sepia.ceph.com 2024-01-25T14:41:40.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:41:40.363 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2024-01-25T14:41:40.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:41:40.449 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-25T14:41:40.455 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-01-25T14:41:40.472 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-01-25T14:41:40.472 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-01-25T14:41:40.528 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-01-25T14:41:40.529 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-01-25T14:41:40.529 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-01-25T14:41:40.529 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-01-25T14:41:40.529 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-01-25T14:41:40.529 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-01-25T14:41:40.529 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-25T14:41:40.529 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-01-25T14:41:40.529 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-01-25T14:41:40.529 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-25T14:41:40.529 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-01-25T14:41:40.529 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T14:41:40.529 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-25T14:41:40.529 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-25T14:41:40.530 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-01-25T14:41:40.550 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2024-01-25T14:41:40.568 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2024-01-25T14:41:40.568 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2024-01-25T14:41:40.624 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2024-01-25T14:41:40.625 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="9" 2024-01-25T14:41:40.625 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2024-01-25T14:41:40.625 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2024-01-25T14:41:40.625 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="9" 2024-01-25T14:41:40.625 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el9" 2024-01-25T14:41:40.625 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-25T14:41:40.625 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2024-01-25T14:41:40.625 INFO:teuthology.orchestra.run.smithi186.stdout:LOGO="fedora-logo-icon" 2024-01-25T14:41:40.625 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-25T14:41:40.625 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2024-01-25T14:41:40.625 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T14:41:40.626 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-25T14:41:40.626 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-25T14:41:40.626 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2024-01-25T14:41:40.641 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-01-25T14:41:40.658 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-01-25T14:41:40.659 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-01-25T14:41:40.715 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-01-25T14:41:40.715 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-01-25T14:41:40.715 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-01-25T14:41:40.715 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-01-25T14:41:40.715 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-01-25T14:41:40.715 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-01-25T14:41:40.716 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-25T14:41:40.716 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-01-25T14:41:40.716 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-01-25T14:41:40.716 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-25T14:41:40.716 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-01-25T14:41:40.716 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-25T14:41:40.716 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-25T14:41:40.716 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-25T14:41:40.716 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-01-25T14:41:40.741 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-25T14:41:40.752 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-25T14:41:40.757 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-25T14:41:40.758 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2024-01-25T14:41:40.760 DEBUG:teuthology.orchestra.run.smithi186:> test '!' -e /home/ubuntu/cephtest 2024-01-25T14:41:40.763 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2024-01-25T14:41:40.778 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-25T14:41:40.783 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-25T14:41:40.783 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2024-01-25T14:41:40.816 DEBUG:teuthology.orchestra.run.smithi186:> test -z $(ls -A /var/lib/ceph) 2024-01-25T14:41:40.819 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2024-01-25T14:41:40.925 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-25T14:41:41.033 INFO:teuthology.run_tasks:Running task kernel... 2024-01-25T14:41:41.050 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd42140e628558a450ba1d39a9d0835a2fa62cda'} 2024-01-25T14:41:41.050 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-01-25T14:41:41.050 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-01-25T14:41:41.050 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-25T14:41:41.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T14:41:41.067 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-01-25T14:41:41.124 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-361.el9.x86_64 2024-01-25T14:41:41.124 INFO:teuthology.task.kernel:Running kernel on smithi170: 5.14.0-361.el9.x86_64 2024-01-25T14:41:41.124 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum install -y kernel 2024-01-25T14:41:43.333 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2024-01-25T14:41:44.675 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - BaseOS 6.8 MB/s | 2.0 MB 00:00 2024-01-25T14:41:47.007 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.0 MB 00:02 2024-01-25T14:41:49.783 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-01-25T14:41:54.442 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 5.9 MB 00:01 2024-01-25T14:41:55.893 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 15 kB 00:00 2024-01-25T14:41:57.447 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2024-01-25T14:42:02.394 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-01-25T14:42:04.609 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-01-25T14:42:04.609 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-01-25T14:42:04.698 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-01-25T14:42:04.706 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-01-25T14:42:04.706 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-01-25T14:42:04.706 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-01-25T14:42:04.707 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-01-25T14:42:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-411.el9 CentOS-BaseOS 6.0 M 2024-01-25T14:42:04.707 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-01-25T14:42:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core x86_64 5.14.0-411.el9 CentOS-BaseOS 21 M 2024-01-25T14:42:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules x86_64 5.14.0-411.el9 CentOS-BaseOS 39 M 2024-01-25T14:42:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core x86_64 5.14.0-411.el9 CentOS-BaseOS 33 M 2024-01-25T14:42:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:42:04.707 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-01-25T14:42:04.707 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-01-25T14:42:04.707 INFO:teuthology.orchestra.run.smithi170.stdout:Install 4 Packages 2024-01-25T14:42:04.707 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:42:04.708 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 99 M 2024-01-25T14:42:04.708 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 122 M 2024-01-25T14:42:04.708 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-01-25T14:42:05.162 INFO:teuthology.orchestra.run.smithi170.stdout:(1/4): kernel-5.14.0-411.el9.x86_64.rpm 13 MB/s | 6.0 MB 00:00 2024-01-25T14:42:05.637 INFO:teuthology.orchestra.run.smithi170.stdout:(2/4): kernel-core-5.14.0-411.el9.x86_64.rpm 22 MB/s | 21 MB 00:00 2024-01-25T14:42:06.271 INFO:teuthology.orchestra.run.smithi170.stdout:(3/4): kernel-modules-5.14.0-411.el9.x86_64.rpm 25 MB/s | 39 MB 00:01 2024-01-25T14:42:06.696 INFO:teuthology.orchestra.run.smithi170.stdout:(4/4): kernel-modules-core-5.14.0-411.el9.x86_6 22 MB/s | 33 MB 00:01 2024-01-25T14:42:06.700 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-01-25T14:42:06.700 INFO:teuthology.orchestra.run.smithi170.stdout:Total 50 MB/s | 99 MB 00:01 2024-01-25T14:42:06.700 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-01-25T14:42:07.057 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-01-25T14:42:07.057 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-01-25T14:42:08.095 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-01-25T14:42:08.095 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-01-25T14:42:10.524 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-01-25T14:42:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-core-5.14.0-411.el9.x86_64 1/4 2024-01-25T14:42:11.330 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-25T14:42:14.085 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-25T14:42:14.268 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-25T14:42:18.984 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-25T14:42:19.105 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : kernel-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:42:23.797 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-core-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:42:53.038 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-core-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:42:53.039 INFO:teuthology.orchestra.run.smithi170.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-25T14:42:53.039 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:42:53.112 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-modules-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:42:53.498 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:42:53.498 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-411.el9.x86_64 1/4 2024-01-25T14:42:53.498 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-core-5.14.0-411.el9.x86_64 2/4 2024-01-25T14:42:53.498 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-5.14.0-411.el9.x86_64 3/4 2024-01-25T14:42:53.935 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-modules-core-5.14.0-411.el9.x86_64 4/4 2024-01-25T14:42:53.935 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:42:53.935 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-01-25T14:42:53.935 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-5.14.0-411.el9.x86_64 2024-01-25T14:42:53.935 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-core-5.14.0-411.el9.x86_64 2024-01-25T14:42:53.935 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-5.14.0-411.el9.x86_64 2024-01-25T14:42:53.935 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-modules-core-5.14.0-411.el9.x86_64 2024-01-25T14:42:53.935 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:42:53.936 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-01-25T14:42:54.436 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-01-25T14:42:54.561 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-411.el9.x86_64 2024-01-25T14:42:54.562 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-411.el9.x86_64 2024-01-25T14:42:54.562 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-411.el9.x86_64 2024-01-25T14:42:54.562 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-01-25T14:42:54.562 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-01-25T14:42:54.562 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-01-25T14:42:54.562 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi170.front.sepia.ceph.com, path=None, version=distro) 2024-01-25T14:42:54.562 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-01-25T14:42:54.669 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-411.el9.x86_64 2024-01-25T14:42:54.669 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-411.el9.x86_64 2024-01-25T14:42:54.670 DEBUG:teuthology.orchestra.run.smithi170:> sudo rpm -qi grub2-tools 2024-01-25T14:42:54.703 INFO:teuthology.orchestra.run.smithi170.stdout:Name : grub2-tools 2024-01-25T14:42:54.704 INFO:teuthology.orchestra.run.smithi170.stdout:Epoch : 1 2024-01-25T14:42:54.704 INFO:teuthology.orchestra.run.smithi170.stdout:Version : 2.06 2024-01-25T14:42:54.704 INFO:teuthology.orchestra.run.smithi170.stdout:Release : 68.el9 2024-01-25T14:42:54.704 INFO:teuthology.orchestra.run.smithi170.stdout:Architecture: x86_64 2024-01-25T14:42:54.704 INFO:teuthology.orchestra.run.smithi170.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-25T14:42:54.704 INFO:teuthology.orchestra.run.smithi170.stdout:Group : Unspecified 2024-01-25T14:42:54.704 INFO:teuthology.orchestra.run.smithi170.stdout:Size : 8264254 2024-01-25T14:42:54.704 INFO:teuthology.orchestra.run.smithi170.stdout:License : GPLv3+ 2024-01-25T14:42:54.704 INFO:teuthology.orchestra.run.smithi170.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-25T14:42:54.704 INFO:teuthology.orchestra.run.smithi170.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-25T14:42:54.704 INFO:teuthology.orchestra.run.smithi170.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-25T14:42:54.704 INFO:teuthology.orchestra.run.smithi170.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-25T14:42:54.705 INFO:teuthology.orchestra.run.smithi170.stdout:Packager : builder@centos.org 2024-01-25T14:42:54.705 INFO:teuthology.orchestra.run.smithi170.stdout:Vendor : CentOS 2024-01-25T14:42:54.705 INFO:teuthology.orchestra.run.smithi170.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-25T14:42:54.705 INFO:teuthology.orchestra.run.smithi170.stdout:Summary : Support tools for GRUB. 2024-01-25T14:42:54.705 INFO:teuthology.orchestra.run.smithi170.stdout:Description : 2024-01-25T14:42:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:42:54.705 INFO:teuthology.orchestra.run.smithi170.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-25T14:42:54.705 INFO:teuthology.orchestra.run.smithi170.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-25T14:42:54.705 INFO:teuthology.orchestra.run.smithi170.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-25T14:42:54.705 INFO:teuthology.orchestra.run.smithi170.stdout:hardware devices. 2024-01-25T14:42:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:42:54.705 INFO:teuthology.orchestra.run.smithi170.stdout:This subpackage provides tools for support of all platforms. 2024-01-25T14:42:54.706 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-25T14:42:54.706 INFO:teuthology.task.kernel:Updating grub on smithi170 to boot 5.14.0-411.el9.x86_64 2024-01-25T14:42:54.706 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-25T14:42:55.335 INFO:teuthology.orchestra.run.smithi170.stderr:Generating grub configuration file ... 2024-01-25T14:42:56.786 INFO:teuthology.orchestra.run.smithi170.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-25T14:42:56.839 INFO:teuthology.orchestra.run.smithi170.stderr:done 2024-01-25T14:42:56.840 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2024-01-25T14:42:56.855 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.6GkRGkA20l 2024-01-25T14:42:56.855 DEBUG:teuthology.orchestra.run.smithi170:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.6GkRGkA20l 2024-01-25T14:42:56.928 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.6GkRGkA20l 2024-01-25T14:42:57.068 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.6GkRGkA20l is 6KB 2024-01-25T14:42:57.116 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.6GkRGkA20l 2024-01-25T14:42:57.131 DEBUG:teuthology.orchestra.run.smithi170:> sudo /bin/ls /boot/loader/entries || true 2024-01-25T14:42:57.195 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-25T14:42:57.195 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-25T14:42:57.195 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-25T14:42:57.195 INFO:teuthology.orchestra.run.smithi170.stdout:15949e3c88704300882482eddfd7baae-5.14.0-411.el9.x86_64.conf 2024-01-25T14:42:57.196 DEBUG:teuthology.orchestra.run.smithi170:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-411.el9.x86_64 2024-01-25T14:42:57.358 DEBUG:teuthology.orchestra.run.smithi170:> sudo shutdown -r now 2024-01-25T14:43:27.361 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-01-25T14:43:27.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-01-25T14:43:27.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:44:27.365 DEBUG:teuthology.orchestra.remote:timed out 2024-01-25T14:44:36.366 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-01-25T14:44:36.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:44:36.804 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-01-25T14:44:37.200 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-01-25T14:44:37.201 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-411.el9.x86_64"... 2024-01-25T14:44:37.201 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-01-25T14:44:37.215 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-411.el9.x86_64 2024-01-25T14:44:37.215 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-411.el9.x86_64 vs 5.14.0-411.el9.x86_64 2024-01-25T14:44:37.215 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-25T14:44:37.215 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-25T14:44:38.216 DEBUG:teuthology.parallel:result is None 2024-01-25T14:44:38.217 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-25T14:44:38.224 INFO:teuthology.task.internal:Creating test directory... 2024-01-25T14:44:38.224 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-25T14:44:38.226 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-25T14:44:38.229 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-25T14:44:38.246 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-25T14:44:38.255 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-25T14:44:38.266 INFO:teuthology.task.internal:Creating archive directory... 2024-01-25T14:44:38.266 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-25T14:44:38.281 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-25T14:44:38.287 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-25T14:44:38.597 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-25T14:44:38.604 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-25T14:44:38.604 DEBUG:teuthology.orchestra.run.smithi186:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-25T14:44:38.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T14:44:38.621 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-25T14:44:38.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T14:44:38.638 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-25T14:44:38.640 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-25T14:44:38.664 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-25T14:44:38.710 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-25T14:44:38.716 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-25T14:44:38.737 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-25T14:44:38.758 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-25T14:44:38.769 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-25T14:44:38.808 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-25T14:44:38.809 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-25T14:44:38.817 INFO:teuthology.task.internal:Configuring sudo... 2024-01-25T14:44:38.817 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-25T14:44:38.819 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-25T14:44:38.821 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-25T14:44:38.852 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-25T14:44:38.861 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-25T14:44:38.861 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-25T14:44:38.890 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-25T14:44:38.893 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-25T14:44:38.909 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-25T14:44:38.989 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-25T14:44:39.049 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-25T14:44:39.132 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-25T14:44:39.179 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T14:44:39.179 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-25T14:44:39.258 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-25T14:44:39.299 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-25T14:44:39.361 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-25T14:44:39.445 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-25T14:44:39.489 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-01-25T14:44:39.489 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-25T14:44:39.558 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-25T14:44:39.604 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-25T14:44:39.662 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-25T14:44:39.705 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-25T14:44:39.748 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-01-25T14:44:39.749 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-25T14:44:39.817 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2024-01-25T14:44:39.819 DEBUG:teuthology.orchestra.run.smithi186:> sudo service rsyslog restart 2024-01-25T14:44:39.822 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2024-01-25T14:44:39.861 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-25T14:44:39.866 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-25T14:44:39.900 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-25T14:44:40.167 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-25T14:44:40.175 INFO:teuthology.task.internal:Starting timer... 2024-01-25T14:44:40.175 INFO:teuthology.run_tasks:Running task pcp... 2024-01-25T14:44:40.185 INFO:teuthology.run_tasks:Running task selinux... 2024-01-25T14:44:40.192 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-01-25T14:44:40.193 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2024-01-25T14:44:40.255 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2024-01-25T14:44:40.257 DEBUG:teuthology.orchestra.run.smithi186:> sudo service auditd rotate 2024-01-25T14:44:40.319 INFO:teuthology.orchestra.run.smithi186.stdout:Rotating logs: 2024-01-25T14:44:40.321 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2024-01-25T14:44:40.390 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2024-01-25T14:44:40.392 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-25T14:44:40.392 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2024-01-25T14:44:40.414 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2024-01-25T14:44:40.414 DEBUG:teuthology.orchestra.run.smithi186:> /usr/sbin/getenforce 2024-01-25T14:44:40.437 INFO:teuthology.orchestra.run.smithi186.stdout:Permissive 2024-01-25T14:44:40.438 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2024-01-25T14:44:40.466 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2024-01-25T14:44:40.466 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi170.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi186.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2024-01-25T14:44:40.467 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-25T14:44:40.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T14:44:40.494 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-25T14:44:40.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T14:44:40.523 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-25T14:44:40.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T14:44:40.551 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-25T14:44:40.552 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2024-01-25T14:44:40.616 DEBUG:teuthology.orchestra.run.smithi186:> sudo /usr/sbin/setenforce permissive 2024-01-25T14:44:40.649 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2024-01-25T14:44:40.683 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-25T14:44:40.693 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-25T14:44:40.711 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-25T14:44:40.713 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi170.front.sepia.ceph.com,smithi186.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-25T14:49:10.394 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi170.front.sepia.ceph.com'), Remote(name='ubuntu@smithi186.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2024-01-25T14:49:10.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-01-25T14:49:10.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:49:10.488 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-01-25T14:49:10.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-01-25T14:49:10.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-01-25T14:49:10.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:49:10.652 DEBUG:teuthology.orchestra.run.smithi186:> true 2024-01-25T14:49:10.723 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-01-25T14:49:10.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-01-25T14:49:10.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-25T14:49:10.811 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-01-25T14:49:10.883 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-01-25T14:49:10.883 INFO:teuthology.run_tasks:Running task clock... 2024-01-25T14:49:10.894 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-25T14:49:10.894 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-25T14:49:10.895 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-25T14:49:10.897 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-25T14:49:10.897 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-25T14:49:10.899 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-25T14:49:10.900 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-25T14:49:10.927 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-25T14:49:10.929 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-25T14:49:10.945 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-25T14:49:10.946 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-25T14:49:10.954 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-25T14:49:10.971 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-25T14:49:10.975 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: ntpd: command not found 2024-01-25T14:49:10.976 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2024-01-25T14:49:10.989 INFO:teuthology.orchestra.run.smithi186.stdout:506 Cannot talk to daemon 2024-01-25T14:49:10.989 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2024-01-25T14:49:11.000 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2024-01-25T14:49:11.006 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-25T14:49:11.006 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-25T14:49:11.013 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2024-01-25T14:49:11.022 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-25T14:49:11.023 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-25T14:49:11.029 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-25T14:49:11.045 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-25T14:49:11.065 INFO:teuthology.orchestra.run.smithi186.stderr:bash: line 1: ntpq: command not found 2024-01-25T14:49:11.069 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-25T14:49:11.069 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-01-25T14:49:11.069 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T14:49:11.069 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T14:49:11.069 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T14:49:11.069 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T14:49:11.077 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-01-25T14:49:11.081 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-25T14:49:11.081 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-01-25T14:49:11.081 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T14:49:11.081 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T14:49:11.081 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T14:49:11.081 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T14:49:11.089 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-01-25T14:49:11.092 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-25T14:49:11.092 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-01-25T14:49:11.092 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T14:49:11.092 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T14:49:11.092 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T14:49:11.093 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T14:49:11.093 INFO:teuthology.run_tasks:Running task install... 2024-01-25T14:49:11.101 DEBUG:teuthology.task.install:project ceph 2024-01-25T14:49:11.101 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'}} 2024-01-25T14:49:11.102 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '661946e7044723130c03627323f6a879a9848cb5'} 2024-01-25T14:49:11.102 INFO:teuthology.task.install:Using flavor: default 2024-01-25T14:49:11.109 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-25T14:49:11.110 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-01-25T14:49:11.110 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'tag': None, 'wait_for_package': False} 2024-01-25T14:49:11.110 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-25T14:49:11.113 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'tag': None, 'wait_for_package': False} 2024-01-25T14:49:11.113 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-25T14:49:11.114 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'tag': None, 'wait_for_package': False} 2024-01-25T14:49:11.114 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-25T14:49:11.252 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/ 2024-01-25T14:49:11.252 INFO:teuthology.task.install.rpm:Package version is 19.0.0-885.g661946e7 2024-01-25T14:49:11.263 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/ 2024-01-25T14:49:11.263 INFO:teuthology.task.install.rpm:Package version is 19.0.0-885.g661946e7 2024-01-25T14:49:11.333 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/ 2024-01-25T14:49:11.333 INFO:teuthology.task.install.rpm:Package version is 19.0.0-885.g661946e7 2024-01-25T14:49:11.373 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-25T14:49:11.373 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-01-25T14:49:11.373 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-25T14:49:11.401 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-25T14:49:11.401 DEBUG:teuthology.orchestra.run.smithi191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/661946e7044723130c03627323f6a879a9848cb5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-25T14:49:11.433 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-25T14:49:11.434 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T14:49:11.434 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-25T14:49:11.438 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-25T14:49:11.438 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-01-25T14:49:11.438 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-25T14:49:11.461 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-25T14:49:11.462 DEBUG:teuthology.orchestra.run.smithi170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/661946e7044723130c03627323f6a879a9848cb5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-25T14:49:11.466 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-25T14:49:11.466 DEBUG:teuthology.orchestra.run.smithi186:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/661946e7044723130c03627323f6a879a9848cb5/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-25T14:49:11.467 DEBUG:teuthology.orchestra.run.smithi191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-25T14:49:11.529 DEBUG:teuthology.orchestra.run.smithi170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-25T14:49:11.533 DEBUG:teuthology.orchestra.run.smithi186:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-25T14:49:11.547 DEBUG:teuthology.orchestra.run.smithi191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-25T14:49:11.609 DEBUG:teuthology.orchestra.run.smithi170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-25T14:49:11.613 DEBUG:teuthology.orchestra.run.smithi186:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-25T14:49:11.613 INFO:teuthology.orchestra.run.smithi191.stdout:check_obsoletes = 1 2024-01-25T14:49:11.615 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum clean all 2024-01-25T14:49:11.676 INFO:teuthology.orchestra.run.smithi170.stdout:check_obsoletes = 1 2024-01-25T14:49:11.678 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum clean all 2024-01-25T14:49:11.678 INFO:teuthology.orchestra.run.smithi186.stdout:check_obsoletes = 1 2024-01-25T14:49:11.680 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum clean all 2024-01-25T14:49:11.850 INFO:teuthology.orchestra.run.smithi191.stdout:74 files removed 2024-01-25T14:49:11.877 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-25T14:49:11.914 INFO:teuthology.orchestra.run.smithi186.stdout:74 files removed 2024-01-25T14:49:11.925 INFO:teuthology.orchestra.run.smithi170.stdout:74 files removed 2024-01-25T14:49:11.941 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-25T14:49:11.952 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-25T14:49:12.583 INFO:teuthology.orchestra.run.smithi191.stdout:ceph packages for x86_64 193 kB/s | 80 kB 00:00 2024-01-25T14:49:12.682 INFO:teuthology.orchestra.run.smithi170.stdout:ceph packages for x86_64 194 kB/s | 80 kB 00:00 2024-01-25T14:49:12.697 INFO:teuthology.orchestra.run.smithi186.stdout:ceph packages for x86_64 173 kB/s | 80 kB 00:00 2024-01-25T14:49:12.992 INFO:teuthology.orchestra.run.smithi191.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2024-01-25T14:49:13.058 INFO:teuthology.orchestra.run.smithi170.stdout:ceph noarch packages 29 kB/s | 9.5 kB 00:00 2024-01-25T14:49:13.114 INFO:teuthology.orchestra.run.smithi186.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2024-01-25T14:49:13.384 INFO:teuthology.orchestra.run.smithi191.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-01-25T14:49:13.456 INFO:teuthology.orchestra.run.smithi186.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2024-01-25T14:49:13.475 INFO:teuthology.orchestra.run.smithi170.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-01-25T14:49:13.829 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2024-01-25T14:49:13.998 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2024-01-25T14:49:14.134 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS-9 - AppStream 9.8 MB/s | 6.4 MB 00:00 2024-01-25T14:49:15.188 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-9 - BaseOS 6.7 MB/s | 2.0 MB 00:00 2024-01-25T14:49:15.353 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS-9 - BaseOS 6.7 MB/s | 2.0 MB 00:00 2024-01-25T14:49:15.476 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.0 MB 00:00 2024-01-25T14:49:16.712 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - BaseOS 6.7 MB/s | 8.0 MB 00:01 2024-01-25T14:49:17.443 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.0 MB 00:01 2024-01-25T14:49:17.800 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.0 MB 00:01 2024-01-25T14:49:19.610 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-01-25T14:49:24.152 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 3.3 MB/s | 19 MB 00:05 2024-01-25T14:49:24.360 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - CRB 4.8 MB/s | 5.9 MB 00:01 2024-01-25T14:49:25.736 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 15 kB 00:00 2024-01-25T14:49:28.423 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 7.9 MB/s | 20 MB 00:02 2024-01-25T14:49:30.504 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - AppStream 1.5 MB/s | 19 MB 00:12 2024-01-25T14:49:31.194 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 1.7 MB/s | 5.9 MB 00:03 2024-01-25T14:49:32.587 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 15 kB 00:00 2024-01-25T14:49:33.320 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-01-25T14:49:33.930 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2024-01-25T14:49:34.748 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 5.9 MB 00:00 2024-01-25T14:49:35.907 INFO:teuthology.orchestra.run.smithi186.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-25T14:49:35.907 INFO:teuthology.orchestra.run.smithi186.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-25T14:49:35.921 INFO:teuthology.orchestra.run.smithi186.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-25T14:49:35.922 INFO:teuthology.orchestra.run.smithi186.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-25T14:49:35.923 INFO:teuthology.orchestra.run.smithi186.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-25T14:49:35.924 INFO:teuthology.orchestra.run.smithi186.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-25T14:49:35.926 INFO:teuthology.orchestra.run.smithi186.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-25T14:49:35.929 INFO:teuthology.orchestra.run.smithi186.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-25T14:49:35.930 INFO:teuthology.orchestra.run.smithi186.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-25T14:49:36.004 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-01-25T14:49:36.023 INFO:teuthology.orchestra.run.smithi186.stdout:=========================================================================================== 2024-01-25T14:49:36.023 INFO:teuthology.orchestra.run.smithi186.stdout: Package Arch Version Repository Size 2024-01-25T14:49:36.023 INFO:teuthology.orchestra.run.smithi186.stdout:=========================================================================================== 2024-01-25T14:49:36.023 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-01-25T14:49:36.023 INFO:teuthology.orchestra.run.smithi186.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-25T14:49:36.024 INFO:teuthology.orchestra.run.smithi186.stdout: ceph x86_64 2:19.0.0-885.g661946e7.el9 ceph 6.5 k 2024-01-25T14:49:36.024 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base x86_64 2:19.0.0-885.g661946e7.el9 ceph 5.1 M 2024-01-25T14:49:36.024 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 886 k 2024-01-25T14:49:36.024 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-885.g661946e7.el9 ceph 145 k 2024-01-25T14:49:36.024 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr x86_64 2:19.0.0-885.g661946e7.el9 ceph 1.5 M 2024-01-25T14:49:36.024 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 133 k 2024-01-25T14:49:36.024 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 1.7 M 2024-01-25T14:49:36.024 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 7.4 M 2024-01-25T14:49:36.024 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 51 k 2024-01-25T14:49:36.024 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 8.7 M 2024-01-25T14:49:36.024 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test x86_64 2:19.0.0-885.g661946e7.el9 ceph 46 M 2024-01-25T14:49:36.024 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 262 k 2024-01-25T14:49:36.025 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 742 k 2024-01-25T14:49:36.025 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 217 k 2024-01-25T14:49:36.025 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-shell x86_64 2:19.0.0-885.g661946e7.el9 ceph 27 k 2024-01-25T14:49:36.025 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-top noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 18 k 2024-01-25T14:49:36.025 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-25T14:49:36.025 INFO:teuthology.orchestra.run.smithi186.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-25T14:49:36.025 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-25T14:49:36.025 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 31 k 2024-01-25T14:49:36.025 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 743 k 2024-01-25T14:49:36.025 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 127 k 2024-01-25T14:49:36.025 INFO:teuthology.orchestra.run.smithi186.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-25T14:49:36.025 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-25T14:49:36.025 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-25T14:49:36.025 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-25T14:49:36.026 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-25T14:49:36.026 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-25T14:49:36.026 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs x86_64 2:19.0.0-885.g661946e7.el9 ceph 162 k 2024-01-25T14:49:36.026 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados x86_64 2:19.0.0-885.g661946e7.el9 ceph 321 k 2024-01-25T14:49:36.026 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 298 k 2024-01-25T14:49:36.026 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 99 k 2024-01-25T14:49:36.026 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 85 k 2024-01-25T14:49:36.026 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-25T14:49:36.026 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 170 k 2024-01-25T14:49:36.026 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-25T14:49:36.026 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrading: 2024-01-25T14:49:36.026 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-25T14:49:36.026 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-25T14:49:36.026 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-25T14:49:36.026 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-25T14:49:36.027 INFO:teuthology.orchestra.run.smithi186.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-25T14:49:36.027 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-25T14:49:36.027 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-25T14:49:36.027 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-25T14:49:36.027 INFO:teuthology.orchestra.run.smithi186.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-25T14:49:36.027 INFO:teuthology.orchestra.run.smithi186.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-25T14:49:36.027 INFO:teuthology.orchestra.run.smithi186.stdout: librados2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.4 M 2024-01-25T14:49:36.027 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-25T14:49:36.027 INFO:teuthology.orchestra.run.smithi186.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-25T14:49:36.027 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-25T14:49:36.027 INFO:teuthology.orchestra.run.smithi186.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-25T14:49:36.027 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-25T14:49:36.027 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2024-01-25T14:49:36.028 INFO:teuthology.orchestra.run.smithi186.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-25T14:49:36.028 INFO:teuthology.orchestra.run.smithi186.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-25T14:49:36.028 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 19 M 2024-01-25T14:49:36.028 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 28 k 2024-01-25T14:49:36.028 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds x86_64 2:19.0.0-885.g661946e7.el9 ceph 2.1 M 2024-01-25T14:49:36.028 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 245 k 2024-01-25T14:49:36.028 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.7 M 2024-01-25T14:49:36.028 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd x86_64 2:19.0.0-885.g661946e7.el9 ceph 17 M 2024-01-25T14:49:36.028 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 15 k 2024-01-25T14:49:36.028 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux x86_64 2:19.0.0-885.g661946e7.el9 ceph 25 k 2024-01-25T14:49:36.028 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-25T14:49:36.028 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-25T14:49:36.028 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-25T14:49:36.029 INFO:teuthology.orchestra.run.smithi186.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-25T14:49:36.029 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-25T14:49:36.029 INFO:teuthology.orchestra.run.smithi186.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-25T14:49:36.029 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-25T14:49:36.029 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-25T14:49:36.029 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite x86_64 2:19.0.0-885.g661946e7.el9 ceph 163 k 2024-01-25T14:49:36.029 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-25T14:49:36.029 INFO:teuthology.orchestra.run.smithi186.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-25T14:49:36.029 INFO:teuthology.orchestra.run.smithi186.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-25T14:49:36.029 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-25T14:49:36.029 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-25T14:49:36.029 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 499 k 2024-01-25T14:49:36.029 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-25T14:49:36.029 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.8 M 2024-01-25T14:49:36.030 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-25T14:49:36.030 INFO:teuthology.orchestra.run.smithi186.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-25T14:49:36.030 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-25T14:49:36.030 INFO:teuthology.orchestra.run.smithi186.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-25T14:49:36.030 INFO:teuthology.orchestra.run.smithi186.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-25T14:49:36.030 INFO:teuthology.orchestra.run.smithi186.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-25T14:49:36.030 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-25T14:49:36.030 INFO:teuthology.orchestra.run.smithi186.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-25T14:49:36.030 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-25T14:49:36.030 INFO:teuthology.orchestra.run.smithi186.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-25T14:49:36.030 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-25T14:49:36.030 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-25T14:49:36.030 INFO:teuthology.orchestra.run.smithi186.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-01-25T14:49:36.030 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-25T14:49:36.031 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-25T14:49:36.031 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-25T14:49:36.031 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse x86_64 2:19.0.0-885.g661946e7.el9 ceph 45 k 2024-01-25T14:49:36.031 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 130 k 2024-01-25T14:49:36.031 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-25T14:49:36.031 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-25T14:49:36.031 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-25T14:49:36.031 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-25T14:49:36.031 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-25T14:49:36.031 INFO:teuthology.orchestra.run.smithi186.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-25T14:49:36.031 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-25T14:49:36.031 INFO:teuthology.orchestra.run.smithi186.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-25T14:49:36.031 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-25T14:49:36.031 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-25T14:49:36.032 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-25T14:49:36.032 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-25T14:49:36.032 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-25T14:49:36.032 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-25T14:49:36.032 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-25T14:49:36.032 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-25T14:49:36.032 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-25T14:49:36.032 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-25T14:49:36.032 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-25T14:49:36.032 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-25T14:49:36.032 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-25T14:49:36.032 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-25T14:49:36.032 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-25T14:49:36.032 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-25T14:49:36.033 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-25T14:49:36.033 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-25T14:49:36.033 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-25T14:49:36.033 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-25T14:49:36.033 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-25T14:49:36.033 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-25T14:49:36.033 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-25T14:49:36.033 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-25T14:49:36.033 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-25T14:49:36.033 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-25T14:49:36.033 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-25T14:49:36.033 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-25T14:49:36.033 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-25T14:49:36.033 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-25T14:49:36.034 INFO:teuthology.orchestra.run.smithi186.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-25T14:49:36.035 INFO:teuthology.orchestra.run.smithi186.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-25T14:49:36.035 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-25T14:49:36.035 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-25T14:49:36.035 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-01-25T14:49:36.035 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-01-25T14:49:36.035 INFO:teuthology.orchestra.run.smithi186.stdout:=========================================================================================== 2024-01-25T14:49:36.035 INFO:teuthology.orchestra.run.smithi186.stdout:Install 139 Packages 2024-01-25T14:49:36.035 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrade 16 Packages 2024-01-25T14:49:36.035 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-01-25T14:49:36.035 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 209 M 2024-01-25T14:49:36.036 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-01-25T14:49:36.132 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 15 kB 00:00 2024-01-25T14:49:36.396 INFO:teuthology.orchestra.run.smithi186.stdout:(1/155): ceph-19.0.0-885.g661946e7.el9.x86_64.r 40 kB/s | 6.5 kB 00:00 2024-01-25T14:49:36.672 INFO:teuthology.orchestra.run.smithi186.stdout:(2/155): ceph-fuse-19.0.0-885.g661946e7.el9.x86 3.1 MB/s | 886 kB 00:00 2024-01-25T14:49:36.747 INFO:teuthology.orchestra.run.smithi186.stdout:(3/155): ceph-immutable-object-cache-19.0.0-885 1.9 MB/s | 145 kB 00:00 2024-01-25T14:49:36.867 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 34 MB/s | 20 MB 00:00 2024-01-25T14:49:37.131 INFO:teuthology.orchestra.run.smithi186.stdout:(4/155): ceph-mds-19.0.0-885.g661946e7.el9.x86_ 5.5 MB/s | 2.1 MB 00:00 2024-01-25T14:49:37.423 INFO:teuthology.orchestra.run.smithi186.stdout:(5/155): ceph-base-19.0.0-885.g661946e7.el9.x86 4.3 MB/s | 5.1 MB 00:01 2024-01-25T14:49:37.465 INFO:teuthology.orchestra.run.smithi186.stdout:(6/155): ceph-mgr-19.0.0-885.g661946e7.el9.x86_ 4.5 MB/s | 1.5 MB 00:00 2024-01-25T14:49:37.999 INFO:teuthology.orchestra.run.smithi186.stdout:(7/155): ceph-common-19.0.0-885.g661946e7.el9.x 11 MB/s | 19 MB 00:01 2024-01-25T14:49:38.132 INFO:teuthology.orchestra.run.smithi186.stdout:(8/155): ceph-mon-19.0.0-885.g661946e7.el9.x86_ 6.6 MB/s | 4.7 MB 00:00 2024-01-25T14:49:38.240 INFO:teuthology.orchestra.run.smithi186.stdout:(9/155): ceph-selinux-19.0.0-885.g661946e7.el9. 232 kB/s | 25 kB 00:00 2024-01-25T14:49:38.599 INFO:teuthology.orchestra.run.smithi186.stdout:(10/155): ceph-radosgw-19.0.0-885.g661946e7.el9 14 MB/s | 8.7 MB 00:00 2024-01-25T14:49:38.666 INFO:teuthology.orchestra.run.smithi186.stdout:(11/155): cephfs-mirror-19.0.0-885.g661946e7.el 3.2 MB/s | 217 kB 00:00 2024-01-25T14:49:38.716 INFO:teuthology.orchestra.run.smithi186.stdout:(12/155): cephfs-shell-19.0.0-885.g661946e7.el9 543 kB/s | 27 kB 00:00 2024-01-25T14:49:38.758 INFO:teuthology.orchestra.run.smithi186.stdout:(13/155): libcephfs-devel-19.0.0-885.g661946e7. 752 kB/s | 31 kB 00:00 2024-01-25T14:49:38.788 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-01-25T14:49:38.833 INFO:teuthology.orchestra.run.smithi186.stdout:(14/155): libcephfs2-19.0.0-885.g661946e7.el9.x 9.7 MB/s | 743 kB 00:00 2024-01-25T14:49:38.892 INFO:teuthology.orchestra.run.smithi186.stdout:(15/155): libcephsqlite-19.0.0-885.g661946e7.el 2.7 MB/s | 163 kB 00:00 2024-01-25T14:49:38.959 INFO:teuthology.orchestra.run.smithi186.stdout:(16/155): librados-devel-19.0.0-885.g661946e7.e 1.9 MB/s | 127 kB 00:00 2024-01-25T14:49:39.042 INFO:teuthology.orchestra.run.smithi186.stdout:(17/155): libradosstriper1-19.0.0-885.g661946e7 5.9 MB/s | 499 kB 00:00 2024-01-25T14:49:39.484 INFO:teuthology.orchestra.run.smithi186.stdout:(18/155): ceph-osd-19.0.0-885.g661946e7.el9.x86 8.3 MB/s | 17 MB 00:02 2024-01-25T14:49:39.560 INFO:teuthology.orchestra.run.smithi186.stdout:(19/155): librgw2-19.0.0-885.g661946e7.el9.x86_ 9.3 MB/s | 4.8 MB 00:00 2024-01-25T14:49:39.585 INFO:teuthology.orchestra.run.smithi186.stdout:(20/155): python3-ceph-argparse-19.0.0-885.g661 451 kB/s | 45 kB 00:00 2024-01-25T14:49:39.610 INFO:teuthology.orchestra.run.smithi186.stdout:(21/155): python3-ceph-common-19.0.0-885.g66194 2.5 MB/s | 130 kB 00:00 2024-01-25T14:49:39.644 INFO:teuthology.orchestra.run.smithi186.stdout:(22/155): python3-cephfs-19.0.0-885.g661946e7.e 2.7 MB/s | 162 kB 00:00 2024-01-25T14:49:39.669 INFO:teuthology.orchestra.run.smithi186.stdout:(23/155): python3-rados-19.0.0-885.g661946e7.el 5.4 MB/s | 321 kB 00:00 2024-01-25T14:49:39.711 INFO:teuthology.orchestra.run.smithi186.stdout:(24/155): python3-rbd-19.0.0-885.g661946e7.el9. 4.4 MB/s | 298 kB 00:00 2024-01-25T14:49:39.736 INFO:teuthology.orchestra.run.smithi186.stdout:(25/155): python3-rgw-19.0.0-885.g661946e7.el9. 1.4 MB/s | 99 kB 00:00 2024-01-25T14:49:39.761 INFO:teuthology.orchestra.run.smithi186.stdout:(26/155): rbd-fuse-19.0.0-885.g661946e7.el9.x86 1.7 MB/s | 85 kB 00:00 2024-01-25T14:49:39.837 INFO:teuthology.orchestra.run.smithi186.stdout:(27/155): rbd-nbd-19.0.0-885.g661946e7.el9.x86_ 2.2 MB/s | 170 kB 00:00 2024-01-25T14:49:39.904 INFO:teuthology.orchestra.run.smithi186.stdout:(28/155): ceph-grafana-dashboards-19.0.0-885.g6 427 kB/s | 28 kB 00:00 2024-01-25T14:49:39.962 INFO:teuthology.orchestra.run.smithi186.stdout:(29/155): rbd-mirror-19.0.0-885.g661946e7.el9.x 14 MB/s | 3.1 MB 00:00 2024-01-25T14:49:39.988 INFO:teuthology.orchestra.run.smithi186.stdout:(30/155): ceph-mgr-cephadm-19.0.0-885.g661946e7 1.6 MB/s | 133 kB 00:00 2024-01-25T14:49:40.105 INFO:teuthology.orchestra.run.smithi186.stdout:(31/155): ceph-mgr-dashboard-19.0.0-885.g661946 12 MB/s | 1.7 MB 00:00 2024-01-25T14:49:40.180 INFO:teuthology.orchestra.run.smithi186.stdout:(32/155): ceph-mgr-modules-core-19.0.0-885.g661 3.2 MB/s | 245 kB 00:00 2024-01-25T14:49:40.239 INFO:teuthology.orchestra.run.smithi186.stdout:(33/155): ceph-mgr-rook-19.0.0-885.g661946e7.el 872 kB/s | 51 kB 00:00 2024-01-25T14:49:40.305 INFO:teuthology.orchestra.run.smithi186.stdout:(34/155): ceph-prometheus-alerts-19.0.0-885.g66 227 kB/s | 15 kB 00:00 2024-01-25T14:49:40.372 INFO:teuthology.orchestra.run.smithi186.stdout:(35/155): ceph-volume-19.0.0-885.g661946e7.el9. 3.9 MB/s | 262 kB 00:00 2024-01-25T14:49:40.464 INFO:teuthology.orchestra.run.smithi186.stdout:(36/155): cephadm-19.0.0-885.g661946e7.el9.noar 7.9 MB/s | 742 kB 00:00 2024-01-25T14:49:40.523 INFO:teuthology.orchestra.run.smithi186.stdout:(37/155): cephfs-top-19.0.0-885.g661946e7.el9.n 313 kB/s | 18 kB 00:00 2024-01-25T14:49:40.682 INFO:teuthology.orchestra.run.smithi186.stdout:(38/155): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-01-25T14:49:40.757 INFO:teuthology.orchestra.run.smithi186.stdout:(39/155): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 662 kB 00:00 2024-01-25T14:49:40.790 INFO:teuthology.orchestra.run.smithi186.stdout:(40/155): bison-3.7.4-5.el9.x86_64.rpm 8.3 MB/s | 920 kB 00:00 2024-01-25T14:49:40.816 INFO:teuthology.orchestra.run.smithi186.stdout:(41/155): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-01-25T14:49:40.841 INFO:teuthology.orchestra.run.smithi186.stdout:(42/155): elfutils-libelf-devel-0.190-2.el9.x86 408 kB/s | 20 kB 00:00 2024-01-25T14:49:40.875 INFO:teuthology.orchestra.run.smithi186.stdout:(43/155): flex-2.6.4-9.el9.x86_64.rpm 5.1 MB/s | 307 kB 00:00 2024-01-25T14:49:40.892 INFO:teuthology.orchestra.run.smithi186.stdout:(44/155): flexiblas-3.0.4-8.el9.x86_64.rpm 638 kB/s | 32 kB 00:00 2024-01-25T14:49:40.984 INFO:teuthology.orchestra.run.smithi186.stdout:(45/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-01-25T14:49:41.000 INFO:teuthology.orchestra.run.smithi186.stdout:(46/155): flexiblas-openblas-openmp-3.0.4-8.el9 159 kB/s | 17 kB 00:00 2024-01-25T14:49:41.026 INFO:teuthology.orchestra.run.smithi186.stdout:(47/155): libaio-devel-0.3.111-13.el9.x86_64.rp 241 kB/s | 10 kB 00:00 2024-01-25T14:49:41.051 INFO:teuthology.orchestra.run.smithi186.stdout:(48/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-01-25T14:49:41.076 INFO:teuthology.orchestra.run.smithi186.stdout:(49/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2024-01-25T14:49:41.102 INFO:teuthology.orchestra.run.smithi186.stdout:(50/155): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-01-25T14:49:41.127 INFO:teuthology.orchestra.run.smithi186.stdout:(51/155): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-01-25T14:49:41.152 INFO:teuthology.orchestra.run.smithi186.stdout:(52/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 495 kB/s | 24 kB 00:00 2024-01-25T14:49:41.178 INFO:teuthology.orchestra.run.smithi186.stdout:(53/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 925 kB/s | 46 kB 00:00 2024-01-25T14:49:41.211 INFO:teuthology.orchestra.run.smithi186.stdout:(54/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2024-01-25T14:49:41.245 INFO:teuthology.orchestra.run.smithi186.stdout:(55/155): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2024-01-25T14:49:41.271 INFO:teuthology.orchestra.run.smithi186.stdout:(56/155): openblas-0.3.21-2.el9.x86_64.rpm 587 kB/s | 34 kB 00:00 2024-01-25T14:49:41.396 INFO:teuthology.orchestra.run.smithi186.stdout:(57/155): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2024-01-25T14:49:41.409 INFO:teuthology.orchestra.run.smithi170.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-25T14:49:41.410 INFO:teuthology.orchestra.run.smithi170.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-25T14:49:41.422 INFO:teuthology.orchestra.run.smithi170.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-25T14:49:41.423 INFO:teuthology.orchestra.run.smithi170.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-25T14:49:41.424 INFO:teuthology.orchestra.run.smithi170.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-25T14:49:41.425 INFO:teuthology.orchestra.run.smithi170.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-25T14:49:41.426 INFO:teuthology.orchestra.run.smithi170.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-25T14:49:41.429 INFO:teuthology.orchestra.run.smithi170.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-25T14:49:41.430 INFO:teuthology.orchestra.run.smithi170.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-25T14:49:41.454 INFO:teuthology.orchestra.run.smithi186.stdout:(58/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 17 MB/s | 3.0 MB 00:00 2024-01-25T14:49:41.496 INFO:teuthology.orchestra.run.smithi186.stdout:(59/155): postgresql-13.11-1.el9.x86_64.rpm 16 MB/s | 1.5 MB 00:00 2024-01-25T14:49:41.505 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-01-25T14:49:41.527 INFO:teuthology.orchestra.run.smithi170.stdout:=========================================================================================== 2024-01-25T14:49:41.527 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-01-25T14:49:41.527 INFO:teuthology.orchestra.run.smithi170.stdout:=========================================================================================== 2024-01-25T14:49:41.527 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-01-25T14:49:41.527 INFO:teuthology.orchestra.run.smithi170.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-25T14:49:41.527 INFO:teuthology.orchestra.run.smithi170.stdout: ceph x86_64 2:19.0.0-885.g661946e7.el9 ceph 6.5 k 2024-01-25T14:49:41.527 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base x86_64 2:19.0.0-885.g661946e7.el9 ceph 5.1 M 2024-01-25T14:49:41.527 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 886 k 2024-01-25T14:49:41.527 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-885.g661946e7.el9 ceph 145 k 2024-01-25T14:49:41.528 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr x86_64 2:19.0.0-885.g661946e7.el9 ceph 1.5 M 2024-01-25T14:49:41.528 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 133 k 2024-01-25T14:49:41.528 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 1.7 M 2024-01-25T14:49:41.528 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 7.4 M 2024-01-25T14:49:41.528 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 51 k 2024-01-25T14:49:41.528 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 8.7 M 2024-01-25T14:49:41.528 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test x86_64 2:19.0.0-885.g661946e7.el9 ceph 46 M 2024-01-25T14:49:41.528 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 262 k 2024-01-25T14:49:41.528 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 742 k 2024-01-25T14:49:41.528 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 217 k 2024-01-25T14:49:41.528 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-shell x86_64 2:19.0.0-885.g661946e7.el9 ceph 27 k 2024-01-25T14:49:41.528 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-top noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 18 k 2024-01-25T14:49:41.528 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-25T14:49:41.529 INFO:teuthology.orchestra.run.smithi170.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-25T14:49:41.529 INFO:teuthology.orchestra.run.smithi170.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-25T14:49:41.529 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 31 k 2024-01-25T14:49:41.529 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 743 k 2024-01-25T14:49:41.529 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 127 k 2024-01-25T14:49:41.529 INFO:teuthology.orchestra.run.smithi170.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-25T14:49:41.529 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-25T14:49:41.529 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-25T14:49:41.529 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-25T14:49:41.529 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-25T14:49:41.530 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-25T14:49:41.530 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs x86_64 2:19.0.0-885.g661946e7.el9 ceph 162 k 2024-01-25T14:49:41.530 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados x86_64 2:19.0.0-885.g661946e7.el9 ceph 321 k 2024-01-25T14:49:41.530 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 298 k 2024-01-25T14:49:41.530 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 99 k 2024-01-25T14:49:41.530 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 85 k 2024-01-25T14:49:41.530 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-25T14:49:41.530 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 170 k 2024-01-25T14:49:41.530 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-25T14:49:41.530 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrading: 2024-01-25T14:49:41.530 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-25T14:49:41.530 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-25T14:49:41.530 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-25T14:49:41.530 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-25T14:49:41.531 INFO:teuthology.orchestra.run.smithi170.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-25T14:49:41.531 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-25T14:49:41.531 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-25T14:49:41.531 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-25T14:49:41.531 INFO:teuthology.orchestra.run.smithi170.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-25T14:49:41.531 INFO:teuthology.orchestra.run.smithi170.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-25T14:49:41.531 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.4 M 2024-01-25T14:49:41.531 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-25T14:49:41.531 INFO:teuthology.orchestra.run.smithi170.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-25T14:49:41.531 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-25T14:49:41.531 INFO:teuthology.orchestra.run.smithi170.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-25T14:49:41.531 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-25T14:49:41.531 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-01-25T14:49:41.531 INFO:teuthology.orchestra.run.smithi170.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-25T14:49:41.532 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-25T14:49:41.532 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 19 M 2024-01-25T14:49:41.532 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 28 k 2024-01-25T14:49:41.532 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds x86_64 2:19.0.0-885.g661946e7.el9 ceph 2.1 M 2024-01-25T14:49:41.532 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 245 k 2024-01-25T14:49:41.532 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.7 M 2024-01-25T14:49:41.532 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd x86_64 2:19.0.0-885.g661946e7.el9 ceph 17 M 2024-01-25T14:49:41.532 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 15 k 2024-01-25T14:49:41.532 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux x86_64 2:19.0.0-885.g661946e7.el9 ceph 25 k 2024-01-25T14:49:41.532 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-25T14:49:41.532 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-25T14:49:41.532 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-25T14:49:41.532 INFO:teuthology.orchestra.run.smithi170.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-25T14:49:41.533 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-25T14:49:41.533 INFO:teuthology.orchestra.run.smithi170.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-25T14:49:41.533 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-25T14:49:41.533 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-25T14:49:41.533 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite x86_64 2:19.0.0-885.g661946e7.el9 ceph 163 k 2024-01-25T14:49:41.533 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-25T14:49:41.533 INFO:teuthology.orchestra.run.smithi170.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-25T14:49:41.533 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-25T14:49:41.533 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-25T14:49:41.533 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-25T14:49:41.533 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 499 k 2024-01-25T14:49:41.533 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-25T14:49:41.534 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.8 M 2024-01-25T14:49:41.534 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-25T14:49:41.534 INFO:teuthology.orchestra.run.smithi170.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-25T14:49:41.534 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-25T14:49:41.534 INFO:teuthology.orchestra.run.smithi170.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-25T14:49:41.534 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-25T14:49:41.534 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-25T14:49:41.534 INFO:teuthology.orchestra.run.smithi170.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-25T14:49:41.534 INFO:teuthology.orchestra.run.smithi170.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-25T14:49:41.534 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-25T14:49:41.534 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-25T14:49:41.535 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-25T14:49:41.535 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-25T14:49:41.535 INFO:teuthology.orchestra.run.smithi170.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-01-25T14:49:41.535 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-25T14:49:41.535 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-25T14:49:41.535 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-25T14:49:41.535 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse x86_64 2:19.0.0-885.g661946e7.el9 ceph 45 k 2024-01-25T14:49:41.535 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 130 k 2024-01-25T14:49:41.535 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-25T14:49:41.535 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-25T14:49:41.535 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-25T14:49:41.535 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-25T14:49:41.535 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-25T14:49:41.535 INFO:teuthology.orchestra.run.smithi170.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-25T14:49:41.536 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-25T14:49:41.536 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-25T14:49:41.536 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-25T14:49:41.536 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-25T14:49:41.536 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-25T14:49:41.536 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-25T14:49:41.536 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-25T14:49:41.536 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-25T14:49:41.536 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-25T14:49:41.536 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-25T14:49:41.536 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-25T14:49:41.536 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-25T14:49:41.537 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-25T14:49:41.537 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-25T14:49:41.537 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-25T14:49:41.537 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-25T14:49:41.537 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-25T14:49:41.537 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-25T14:49:41.537 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-25T14:49:41.537 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-25T14:49:41.537 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-25T14:49:41.537 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-25T14:49:41.537 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-25T14:49:41.537 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-25T14:49:41.537 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-25T14:49:41.538 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-25T14:49:41.538 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-25T14:49:41.538 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-25T14:49:41.538 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-25T14:49:41.538 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-25T14:49:41.538 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-25T14:49:41.538 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-25T14:49:41.538 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-25T14:49:41.538 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-25T14:49:41.538 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-25T14:49:41.538 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-25T14:49:41.538 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-25T14:49:41.538 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-25T14:49:41.539 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-25T14:49:41.539 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-25T14:49:41.539 INFO:teuthology.orchestra.run.smithi170.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-01-25T14:49:41.539 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-25T14:49:41.539 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-25T14:49:41.539 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-25T14:49:41.539 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-25T14:49:41.539 INFO:teuthology.orchestra.run.smithi170.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-25T14:49:41.539 INFO:teuthology.orchestra.run.smithi170.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-25T14:49:41.539 INFO:teuthology.orchestra.run.smithi170.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-25T14:49:41.539 INFO:teuthology.orchestra.run.smithi170.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-25T14:49:41.539 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-25T14:49:41.540 INFO:teuthology.orchestra.run.smithi170.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-25T14:49:41.540 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:49:41.540 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-01-25T14:49:41.540 INFO:teuthology.orchestra.run.smithi170.stdout:=========================================================================================== 2024-01-25T14:49:41.540 INFO:teuthology.orchestra.run.smithi170.stdout:Install 139 Packages 2024-01-25T14:49:41.540 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrade 16 Packages 2024-01-25T14:49:41.540 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:49:41.541 INFO:teuthology.orchestra.run.smithi186.stdout:(60/155): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2024-01-25T14:49:41.541 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 209 M 2024-01-25T14:49:41.541 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-01-25T14:49:41.555 INFO:teuthology.orchestra.run.smithi186.stdout:(61/155): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-01-25T14:49:41.705 INFO:teuthology.orchestra.run.smithi186.stdout:(62/155): postgresql-server-13.11-1.el9.x86_64. 32 MB/s | 5.7 MB 00:00 2024-01-25T14:49:41.731 INFO:teuthology.orchestra.run.smithi186.stdout:(63/155): python3-attrs-20.3.0-7.el9.noarch.rpm 446 kB/s | 78 kB 00:00 2024-01-25T14:49:41.759 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-01-25T14:49:41.881 INFO:teuthology.orchestra.run.smithi186.stdout:(64/155): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 5.8 MB 00:00 2024-01-25T14:49:41.906 INFO:teuthology.orchestra.run.smithi186.stdout:(65/155): python3-jinja2-2.11.3-4.el9.noarch.rp 1.3 MB/s | 228 kB 00:00 2024-01-25T14:49:41.931 INFO:teuthology.orchestra.run.smithi186.stdout:(66/155): python3-jsonpatch-1.21-16.el9.noarch. 490 kB/s | 24 kB 00:00 2024-01-25T14:49:41.957 INFO:teuthology.orchestra.run.smithi186.stdout:(67/155): python3-jsonpointer-2.0-4.el9.noarch. 362 kB/s | 18 kB 00:00 2024-01-25T14:49:41.982 INFO:teuthology.orchestra.run.smithi186.stdout:(68/155): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-01-25T14:49:42.007 INFO:teuthology.orchestra.run.smithi186.stdout:(69/155): python3-markupsafe-1.1.1-12.el9.x86_6 631 kB/s | 32 kB 00:00 2024-01-25T14:49:42.133 INFO:teuthology.orchestra.run.smithi186.stdout:(70/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-01-25T14:49:42.158 INFO:teuthology.orchestra.run.smithi186.stdout:(71/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-01-25T14:49:42.183 INFO:teuthology.orchestra.run.smithi186.stdout:(72/155): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2024-01-25T14:49:42.209 INFO:teuthology.orchestra.run.smithi186.stdout:(73/155): python3-prettytable-0.7.2-27.el9.noar 826 kB/s | 41 kB 00:00 2024-01-25T14:49:42.234 INFO:teuthology.orchestra.run.smithi186.stdout:(74/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-01-25T14:49:42.259 INFO:teuthology.orchestra.run.smithi186.stdout:(75/155): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2024-01-25T14:49:42.273 INFO:teuthology.orchestra.run.smithi170.stdout:(1/155): ceph-19.0.0-885.g661946e7.el9.x86_64.r 39 kB/s | 6.5 kB 00:00 2024-01-25T14:49:42.276 INFO:teuthology.orchestra.run.smithi186.stdout:(76/155): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-01-25T14:49:42.293 INFO:teuthology.orchestra.run.smithi186.stdout:(77/155): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2024-01-25T14:49:42.435 INFO:teuthology.orchestra.run.smithi186.stdout:(78/155): python3-toml-0.10.2-6.el9.noarch.rpm 274 kB/s | 39 kB 00:00 2024-01-25T14:49:42.490 INFO:teuthology.orchestra.run.smithi170.stdout:(2/155): ceph-fuse-19.0.0-885.g661946e7.el9.x86 4.0 MB/s | 886 kB 00:00 2024-01-25T14:49:42.548 INFO:teuthology.orchestra.run.smithi170.stdout:(3/155): ceph-immutable-object-cache-19.0.0-885 2.4 MB/s | 145 kB 00:00 2024-01-25T14:49:42.702 INFO:teuthology.orchestra.run.smithi186.stdout:(79/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-01-25T14:49:42.719 INFO:teuthology.orchestra.run.smithi186.stdout:(80/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 145 kB/s | 41 kB 00:00 2024-01-25T14:49:42.744 INFO:teuthology.orchestra.run.smithi186.stdout:(81/155): socat-1.7.4.1-5.el9.x86_64.rpm 7.1 MB/s | 300 kB 00:00 2024-01-25T14:49:42.769 INFO:teuthology.orchestra.run.smithi186.stdout:(82/155): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-01-25T14:49:42.795 INFO:teuthology.orchestra.run.smithi186.stdout:(83/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-01-25T14:49:42.798 INFO:teuthology.orchestra.run.smithi170.stdout:(4/155): ceph-mds-19.0.0-885.g661946e7.el9.x86_ 8.5 MB/s | 2.1 MB 00:00 2024-01-25T14:49:42.820 INFO:teuthology.orchestra.run.smithi186.stdout:(84/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-01-25T14:49:42.845 INFO:teuthology.orchestra.run.smithi186.stdout:(85/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 880 kB/s | 44 kB 00:00 2024-01-25T14:49:42.871 INFO:teuthology.orchestra.run.smithi186.stdout:(86/155): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-01-25T14:49:42.896 INFO:teuthology.orchestra.run.smithi186.stdout:(87/155): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-01-25T14:49:42.921 INFO:teuthology.orchestra.run.smithi186.stdout:(88/155): libgfortran-11.4.1-3.el9.x86_64.rpm 16 MB/s | 802 kB 00:00 2024-01-25T14:49:42.947 INFO:teuthology.orchestra.run.smithi186.stdout:(89/155): libquadmath-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 194 kB 00:00 2024-01-25T14:49:42.948 INFO:teuthology.orchestra.run.smithi170.stdout:(5/155): ceph-mgr-19.0.0-885.g661946e7.el9.x86_ 9.9 MB/s | 1.5 MB 00:00 2024-01-25T14:49:42.964 INFO:teuthology.orchestra.run.smithi186.stdout:(90/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2024-01-25T14:49:42.989 INFO:teuthology.orchestra.run.smithi186.stdout:(91/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.7 MB/s | 241 kB 00:00 2024-01-25T14:49:43.031 INFO:teuthology.orchestra.run.smithi186.stdout:(92/155): python3-cryptography-36.0.1-4.el9.x86 17 MB/s | 1.1 MB 00:00 2024-01-25T14:49:43.056 INFO:teuthology.orchestra.run.smithi186.stdout:(93/155): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2024-01-25T14:49:43.081 INFO:teuthology.orchestra.run.smithi186.stdout:(94/155): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-01-25T14:49:43.107 INFO:teuthology.orchestra.run.smithi186.stdout:(95/155): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2024-01-25T14:49:43.132 INFO:teuthology.orchestra.run.smithi186.stdout:(96/155): python3-urllib3-1.26.5-5.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2024-01-25T14:49:43.274 INFO:teuthology.orchestra.run.smithi170.stdout:(6/155): ceph-mon-19.0.0-885.g661946e7.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-01-25T14:49:43.583 INFO:teuthology.orchestra.run.smithi186.stdout:(97/155): ceph-test-19.0.0-885.g661946e7.el9.x8 8.6 MB/s | 46 MB 00:05 2024-01-25T14:49:43.608 INFO:teuthology.orchestra.run.smithi186.stdout:(98/155): lua-devel-5.4.4-4.el9.x86_64.rpm 47 kB/s | 22 kB 00:00 2024-01-25T14:49:43.758 INFO:teuthology.orchestra.run.smithi186.stdout:(99/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.7 MB/s | 309 kB 00:00 2024-01-25T14:49:43.808 INFO:teuthology.orchestra.run.smithi186.stdout:(100/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-01-25T14:49:43.859 INFO:teuthology.orchestra.run.smithi186.stdout:(101/155): liboath-2.6.7-2.el9.x86_64.rpm 974 kB/s | 49 kB 00:00 2024-01-25T14:49:43.917 INFO:teuthology.orchestra.run.smithi186.stdout:(102/155): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-01-25T14:49:43.966 INFO:teuthology.orchestra.run.smithi170.stdout:(7/155): ceph-base-19.0.0-885.g661946e7.el9.x86 2.7 MB/s | 5.1 MB 00:01 2024-01-25T14:49:43.967 INFO:teuthology.orchestra.run.smithi186.stdout:(103/155): luarocks-3.9.2-1.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-01-25T14:49:44.109 INFO:teuthology.orchestra.run.smithi186.stdout:(104/155): python3-devel-3.9.17-2.el9.x86_64.rp 245 kB/s | 245 kB 00:01 2024-01-25T14:49:44.135 INFO:teuthology.orchestra.run.smithi186.stdout:(105/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.9 MB/s | 838 kB 00:00 2024-01-25T14:49:44.185 INFO:teuthology.orchestra.run.smithi186.stdout:(106/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 868 kB/s | 43 kB 00:00 2024-01-25T14:49:44.233 INFO:teuthology.orchestra.run.smithi170.stdout:(8/155): ceph-osd-19.0.0-885.g661946e7.el9.x86_ 17 MB/s | 17 MB 00:00 2024-01-25T14:49:44.244 INFO:teuthology.orchestra.run.smithi186.stdout:(107/155): python3-cachetools-4.2.4-1.el9.noarc 552 kB/s | 32 kB 00:00 2024-01-25T14:49:44.283 INFO:teuthology.orchestra.run.smithi170.stdout:(9/155): ceph-selinux-19.0.0-885.g661946e7.el9. 506 kB/s | 25 kB 00:00 2024-01-25T14:49:44.294 INFO:teuthology.orchestra.run.smithi186.stdout:(108/155): python3-certifi-2021.10.8-2.el9.noar 300 kB/s | 15 kB 00:00 2024-01-25T14:49:44.318 INFO:teuthology.orchestra.run.smithi191.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-25T14:49:44.319 INFO:teuthology.orchestra.run.smithi191.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-25T14:49:44.334 INFO:teuthology.orchestra.run.smithi191.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-25T14:49:44.335 INFO:teuthology.orchestra.run.smithi191.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-25T14:49:44.336 INFO:teuthology.orchestra.run.smithi191.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-25T14:49:44.337 INFO:teuthology.orchestra.run.smithi191.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-25T14:49:44.339 INFO:teuthology.orchestra.run.smithi191.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-25T14:49:44.344 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-25T14:49:44.344 INFO:teuthology.orchestra.run.smithi191.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-25T14:49:44.361 INFO:teuthology.orchestra.run.smithi186.stdout:(109/155): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-01-25T14:49:44.419 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2024-01-25T14:49:44.428 INFO:teuthology.orchestra.run.smithi186.stdout:(110/155): python3-cherrypy-18.6.1-2.el9.noarch 5.3 MB/s | 358 kB 00:00 2024-01-25T14:49:44.429 INFO:teuthology.orchestra.run.smithi191.stdout:=========================================================================================== 2024-01-25T14:49:44.429 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2024-01-25T14:49:44.430 INFO:teuthology.orchestra.run.smithi191.stdout:=========================================================================================== 2024-01-25T14:49:44.430 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2024-01-25T14:49:44.430 INFO:teuthology.orchestra.run.smithi191.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-25T14:49:44.430 INFO:teuthology.orchestra.run.smithi191.stdout: ceph x86_64 2:19.0.0-885.g661946e7.el9 ceph 6.5 k 2024-01-25T14:49:44.430 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base x86_64 2:19.0.0-885.g661946e7.el9 ceph 5.1 M 2024-01-25T14:49:44.430 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 886 k 2024-01-25T14:49:44.430 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-885.g661946e7.el9 ceph 145 k 2024-01-25T14:49:44.430 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr x86_64 2:19.0.0-885.g661946e7.el9 ceph 1.5 M 2024-01-25T14:49:44.430 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 133 k 2024-01-25T14:49:44.430 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 1.7 M 2024-01-25T14:49:44.431 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 7.4 M 2024-01-25T14:49:44.431 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 51 k 2024-01-25T14:49:44.431 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 8.7 M 2024-01-25T14:49:44.431 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test x86_64 2:19.0.0-885.g661946e7.el9 ceph 46 M 2024-01-25T14:49:44.431 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 262 k 2024-01-25T14:49:44.431 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 742 k 2024-01-25T14:49:44.431 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 217 k 2024-01-25T14:49:44.431 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-shell x86_64 2:19.0.0-885.g661946e7.el9 ceph 27 k 2024-01-25T14:49:44.431 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 18 k 2024-01-25T14:49:44.431 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-25T14:49:44.431 INFO:teuthology.orchestra.run.smithi191.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-25T14:49:44.431 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-25T14:49:44.431 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 31 k 2024-01-25T14:49:44.431 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 743 k 2024-01-25T14:49:44.432 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel x86_64 2:19.0.0-885.g661946e7.el9 ceph 127 k 2024-01-25T14:49:44.432 INFO:teuthology.orchestra.run.smithi191.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-25T14:49:44.432 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-25T14:49:44.432 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-25T14:49:44.432 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-25T14:49:44.432 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-25T14:49:44.432 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-25T14:49:44.432 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs x86_64 2:19.0.0-885.g661946e7.el9 ceph 162 k 2024-01-25T14:49:44.432 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados x86_64 2:19.0.0-885.g661946e7.el9 ceph 321 k 2024-01-25T14:49:44.432 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 298 k 2024-01-25T14:49:44.432 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw x86_64 2:19.0.0-885.g661946e7.el9 ceph 99 k 2024-01-25T14:49:44.432 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse x86_64 2:19.0.0-885.g661946e7.el9 ceph 85 k 2024-01-25T14:49:44.433 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-25T14:49:44.433 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd x86_64 2:19.0.0-885.g661946e7.el9 ceph 170 k 2024-01-25T14:49:44.433 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-25T14:49:44.433 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2024-01-25T14:49:44.433 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-25T14:49:44.433 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-25T14:49:44.433 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-25T14:49:44.433 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-25T14:49:44.433 INFO:teuthology.orchestra.run.smithi191.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-25T14:49:44.433 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-25T14:49:44.433 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-25T14:49:44.433 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-25T14:49:44.433 INFO:teuthology.orchestra.run.smithi191.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-25T14:49:44.433 INFO:teuthology.orchestra.run.smithi191.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-25T14:49:44.434 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.4 M 2024-01-25T14:49:44.434 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 3.1 M 2024-01-25T14:49:44.434 INFO:teuthology.orchestra.run.smithi191.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-25T14:49:44.434 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-25T14:49:44.434 INFO:teuthology.orchestra.run.smithi191.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-25T14:49:44.434 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-25T14:49:44.434 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2024-01-25T14:49:44.434 INFO:teuthology.orchestra.run.smithi191.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-25T14:49:44.434 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-25T14:49:44.434 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 19 M 2024-01-25T14:49:44.434 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 28 k 2024-01-25T14:49:44.434 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds x86_64 2:19.0.0-885.g661946e7.el9 ceph 2.1 M 2024-01-25T14:49:44.435 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 245 k 2024-01-25T14:49:44.435 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.7 M 2024-01-25T14:49:44.435 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd x86_64 2:19.0.0-885.g661946e7.el9 ceph 17 M 2024-01-25T14:49:44.435 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts noarch 2:19.0.0-885.g661946e7.el9 ceph-noarch 15 k 2024-01-25T14:49:44.435 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux x86_64 2:19.0.0-885.g661946e7.el9 ceph 25 k 2024-01-25T14:49:44.435 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-25T14:49:44.435 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-25T14:49:44.435 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-25T14:49:44.435 INFO:teuthology.orchestra.run.smithi191.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-25T14:49:44.435 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-25T14:49:44.435 INFO:teuthology.orchestra.run.smithi191.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-25T14:49:44.435 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-25T14:49:44.436 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-25T14:49:44.436 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite x86_64 2:19.0.0-885.g661946e7.el9 ceph 163 k 2024-01-25T14:49:44.436 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-25T14:49:44.436 INFO:teuthology.orchestra.run.smithi191.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-25T14:49:44.436 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-25T14:49:44.436 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-25T14:49:44.436 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-25T14:49:44.436 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 x86_64 2:19.0.0-885.g661946e7.el9 ceph 499 k 2024-01-25T14:49:44.436 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-25T14:49:44.436 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2 x86_64 2:19.0.0-885.g661946e7.el9 ceph 4.8 M 2024-01-25T14:49:44.436 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-25T14:49:44.436 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-25T14:49:44.436 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-25T14:49:44.437 INFO:teuthology.orchestra.run.smithi191.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-25T14:49:44.437 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-25T14:49:44.437 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-25T14:49:44.437 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-25T14:49:44.437 INFO:teuthology.orchestra.run.smithi191.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-25T14:49:44.437 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-25T14:49:44.437 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-25T14:49:44.437 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-25T14:49:44.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-25T14:49:44.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-01-25T14:49:44.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-25T14:49:44.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-25T14:49:44.437 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-25T14:49:44.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse x86_64 2:19.0.0-885.g661946e7.el9 ceph 45 k 2024-01-25T14:49:44.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common x86_64 2:19.0.0-885.g661946e7.el9 ceph 130 k 2024-01-25T14:49:44.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-25T14:49:44.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-25T14:49:44.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-25T14:49:44.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-25T14:49:44.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-25T14:49:44.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-25T14:49:44.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-25T14:49:44.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-25T14:49:44.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth noarch 1:2.26.2-1.el9 epel 202 k 2024-01-25T14:49:44.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-25T14:49:44.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-25T14:49:44.438 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-25T14:49:44.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-25T14:49:44.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-25T14:49:44.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-25T14:49:44.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-25T14:49:44.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-25T14:49:44.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-25T14:49:44.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-25T14:49:44.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-25T14:49:44.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-25T14:49:44.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-25T14:49:44.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-25T14:49:44.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-25T14:49:44.439 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-25T14:49:44.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-25T14:49:44.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-25T14:49:44.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-25T14:49:44.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-25T14:49:44.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-25T14:49:44.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-25T14:49:44.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-25T14:49:44.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-25T14:49:44.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-25T14:49:44.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-25T14:49:44.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-25T14:49:44.440 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-25T14:49:44.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-25T14:49:44.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-25T14:49:44.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-25T14:49:44.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-25T14:49:44.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-25T14:49:44.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-25T14:49:44.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-25T14:49:44.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-25T14:49:44.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-25T14:49:44.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-01-25T14:49:44.441 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-25T14:49:44.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-25T14:49:44.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-25T14:49:44.442 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-25T14:49:44.442 INFO:teuthology.orchestra.run.smithi191.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-25T14:49:44.442 INFO:teuthology.orchestra.run.smithi191.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-25T14:49:44.442 INFO:teuthology.orchestra.run.smithi191.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-25T14:49:44.442 INFO:teuthology.orchestra.run.smithi191.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-25T14:49:44.442 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-25T14:49:44.442 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-25T14:49:44.442 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:49:44.442 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2024-01-25T14:49:44.442 INFO:teuthology.orchestra.run.smithi191.stdout:=========================================================================================== 2024-01-25T14:49:44.442 INFO:teuthology.orchestra.run.smithi191.stdout:Install 139 Packages 2024-01-25T14:49:44.443 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 16 Packages 2024-01-25T14:49:44.443 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:49:44.443 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 209 M 2024-01-25T14:49:44.443 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2024-01-25T14:49:44.462 INFO:teuthology.orchestra.run.smithi186.stdout:(111/155): python3-asyncssh-2.13.2-3.el9.noarch 1.5 MB/s | 548 kB 00:00 2024-01-25T14:49:44.504 INFO:teuthology.orchestra.run.smithi186.stdout:(112/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-01-25T14:49:44.521 INFO:teuthology.orchestra.run.smithi186.stdout:(113/155): python3-colorama-0.4.4-12.el9.noarch 604 kB/s | 35 kB 00:00 2024-01-25T14:49:44.562 INFO:teuthology.orchestra.run.smithi186.stdout:(114/155): python3-google-auth-2.26.2-1.el9.noa 3.4 MB/s | 202 kB 00:00 2024-01-25T14:49:44.579 INFO:teuthology.orchestra.run.smithi186.stdout:(115/155): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-01-25T14:49:44.596 INFO:teuthology.orchestra.run.smithi186.stdout:(116/155): python3-jaraco-classes-3.2.1-5.el9.n 528 kB/s | 18 kB 00:00 2024-01-25T14:49:44.622 INFO:teuthology.orchestra.run.smithi186.stdout:(117/155): python3-jaraco-collections-3.0.0-8.e 554 kB/s | 23 kB 00:00 2024-01-25T14:49:44.647 INFO:teuthology.orchestra.run.smithi186.stdout:(118/155): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-01-25T14:49:44.672 INFO:teuthology.orchestra.run.smithi186.stdout:(119/155): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-01-25T14:49:44.722 INFO:teuthology.orchestra.run.smithi186.stdout:(120/155): python3-logutils-0.3.5-21.el9.noarch 928 kB/s | 46 kB 00:00 2024-01-25T14:49:44.781 INFO:teuthology.orchestra.run.smithi186.stdout:(121/155): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-01-25T14:49:44.815 INFO:teuthology.orchestra.run.smithi186.stdout:(122/155): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-01-25T14:49:44.848 INFO:teuthology.orchestra.run.smithi186.stdout:(123/155): python3-natsort-7.1.1-5.el9.noarch.r 862 kB/s | 58 kB 00:00 2024-01-25T14:49:44.890 INFO:teuthology.orchestra.run.smithi186.stdout:(124/155): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-01-25T14:49:44.915 INFO:teuthology.orchestra.run.smithi186.stdout:(125/155): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-01-25T14:49:44.941 INFO:teuthology.orchestra.run.smithi186.stdout:(126/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-01-25T14:49:45.000 INFO:teuthology.orchestra.run.smithi186.stdout:(127/155): libarrow-9.0.0-10.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-01-25T14:49:45.016 INFO:teuthology.orchestra.run.smithi186.stdout:(128/155): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2024-01-25T14:49:45.033 INFO:teuthology.orchestra.run.smithi186.stdout:(129/155): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-01-25T14:49:45.084 INFO:teuthology.orchestra.run.smithi186.stdout:(130/155): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-01-25T14:49:45.101 INFO:teuthology.orchestra.run.smithi186.stdout:(131/155): python3-tempora-5.0.0-2.el9.noarch.r 535 kB/s | 36 kB 00:00 2024-01-25T14:49:45.126 INFO:teuthology.orchestra.run.smithi186.stdout:(132/155): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-01-25T14:49:45.143 INFO:teuthology.orchestra.run.smithi186.stdout:(133/155): python3-typing-extensions-4.4.0-2.el 867 kB/s | 51 kB 00:00 2024-01-25T14:49:45.185 INFO:teuthology.orchestra.run.smithi186.stdout:(134/155): python3-websocket-client-1.2.3-2.el9 1.5 MB/s | 90 kB 00:00 2024-01-25T14:49:45.218 INFO:teuthology.orchestra.run.smithi186.stdout:(135/155): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-01-25T14:49:45.243 INFO:teuthology.orchestra.run.smithi186.stdout:(136/155): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-01-25T14:49:45.294 INFO:teuthology.orchestra.run.smithi186.stdout:(137/155): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-01-25T14:49:45.344 INFO:teuthology.orchestra.run.smithi186.stdout:(138/155): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-01-25T14:49:45.625 INFO:teuthology.orchestra.run.smithi170.stdout:(10/155): ceph-radosgw-19.0.0-885.g661946e7.el9 5.2 MB/s | 8.7 MB 00:01 2024-01-25T14:49:45.719 INFO:teuthology.orchestra.run.smithi186.stdout:(139/155): thrift-0.15.0-2.el9.x86_64.rpm 3.3 MB/s | 1.6 MB 00:00 2024-01-25T14:49:45.759 INFO:teuthology.orchestra.run.smithi170.stdout:(11/155): cephfs-mirror-19.0.0-885.g661946e7.el 1.6 MB/s | 217 kB 00:00 2024-01-25T14:49:45.786 INFO:teuthology.orchestra.run.smithi186.stdout:(140/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 68 kB 00:00 2024-01-25T14:49:45.817 INFO:teuthology.orchestra.run.smithi191.stdout:(1/155): ceph-19.0.0-885.g661946e7.el9.x86_64.r 10 kB/s | 6.5 kB 00:00 2024-01-25T14:49:45.884 INFO:teuthology.orchestra.run.smithi170.stdout:(12/155): cephfs-shell-19.0.0-885.g661946e7.el9 216 kB/s | 27 kB 00:00 2024-01-25T14:49:45.903 INFO:teuthology.orchestra.run.smithi186.stdout:(141/155): NetworkManager-1.45.10-1.el9.x86_64. 19 MB/s | 2.2 MB 00:00 2024-01-25T14:49:46.001 INFO:teuthology.orchestra.run.smithi170.stdout:(13/155): libcephfs-devel-19.0.0-885.g661946e7. 267 kB/s | 31 kB 00:00 2024-01-25T14:49:46.012 INFO:teuthology.orchestra.run.smithi186.stdout:(142/155): NetworkManager-libnm-1.45.10-1.el9.x 17 MB/s | 1.8 MB 00:00 2024-01-25T14:49:46.087 INFO:teuthology.orchestra.run.smithi186.stdout:(143/155): NetworkManager-team-1.45.10-1.el9.x8 563 kB/s | 42 kB 00:00 2024-01-25T14:49:46.118 INFO:teuthology.orchestra.run.smithi170.stdout:(14/155): libcephfs2-19.0.0-885.g661946e7.el9.x 6.2 MB/s | 743 kB 00:00 2024-01-25T14:49:46.129 INFO:teuthology.orchestra.run.smithi186.stdout:(144/155): NetworkManager-tui-1.45.10-1.el9.x86 5.8 MB/s | 246 kB 00:00 2024-01-25T14:49:46.163 INFO:teuthology.orchestra.run.smithi186.stdout:(145/155): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2024-01-25T14:49:46.205 INFO:teuthology.orchestra.run.smithi186.stdout:(146/155): elfutils-debuginfod-client-0.190-2.e 850 kB/s | 35 kB 00:00 2024-01-25T14:49:46.218 INFO:teuthology.orchestra.run.smithi170.stdout:(15/155): libcephsqlite-19.0.0-885.g661946e7.el 1.6 MB/s | 163 kB 00:00 2024-01-25T14:49:46.272 INFO:teuthology.orchestra.run.smithi186.stdout:(147/155): librados2-19.0.0-885.g661946e7.el9.x 3.4 MB/s | 3.4 MB 00:00 2024-01-25T14:49:46.297 INFO:teuthology.orchestra.run.smithi186.stdout:(148/155): elfutils-libelf-0.190-2.el9.x86_64.r 2.0 MB/s | 191 kB 00:00 2024-01-25T14:49:46.302 INFO:teuthology.orchestra.run.smithi170.stdout:(16/155): librados-devel-19.0.0-885.g661946e7.e 1.5 MB/s | 127 kB 00:00 2024-01-25T14:49:46.322 INFO:teuthology.orchestra.run.smithi186.stdout:(149/155): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-01-25T14:49:46.347 INFO:teuthology.orchestra.run.smithi186.stdout:(150/155): libacl-2.3.1-4.el9.x86_64.rpm 441 kB/s | 22 kB 00:00 2024-01-25T14:49:46.398 INFO:teuthology.orchestra.run.smithi186.stdout:(151/155): openssl-3.0.7-25.el9.x86_64.rpm 15 MB/s | 1.2 MB 00:00 2024-01-25T14:49:46.419 INFO:teuthology.orchestra.run.smithi170.stdout:(17/155): libradosstriper1-19.0.0-885.g661946e7 4.2 MB/s | 499 kB 00:00 2024-01-25T14:49:46.440 INFO:teuthology.orchestra.run.smithi186.stdout:(152/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 24 MB/s | 2.1 MB 00:00 2024-01-25T14:49:46.465 INFO:teuthology.orchestra.run.smithi186.stdout:(153/155): xfsdump-3.1.12-4.el9.x86_64.rpm 4.9 MB/s | 321 kB 00:00 2024-01-25T14:49:46.507 INFO:teuthology.orchestra.run.smithi186.stdout:(154/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-01-25T14:49:47.111 INFO:teuthology.orchestra.run.smithi170.stdout:(18/155): librgw2-19.0.0-885.g661946e7.el9.x86_ 6.9 MB/s | 4.8 MB 00:00 2024-01-25T14:49:47.115 INFO:teuthology.orchestra.run.smithi186.stdout:(155/155): librbd1-19.0.0-885.g661946e7.el9.x86 1.8 MB/s | 3.1 MB 00:01 2024-01-25T14:49:47.119 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-01-25T14:49:47.119 INFO:teuthology.orchestra.run.smithi186.stdout:Total 19 MB/s | 209 MB 00:11 2024-01-25T14:49:47.153 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-01-25T14:49:47.405 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-01-25T14:49:47.405 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-01-25T14:49:47.431 INFO:teuthology.orchestra.run.smithi191.stdout:(2/155): ceph-base-19.0.0-885.g661946e7.el9.x86 2.3 MB/s | 5.1 MB 00:02 2024-01-25T14:49:47.461 INFO:teuthology.orchestra.run.smithi191.stdout:(3/155): ceph-fuse-19.0.0-885.g661946e7.el9.x86 539 kB/s | 886 kB 00:01 2024-01-25T14:49:47.504 INFO:teuthology.orchestra.run.smithi191.stdout:(4/155): ceph-immutable-object-cache-19.0.0-885 2.0 MB/s | 145 kB 00:00 2024-01-25T14:49:47.676 INFO:teuthology.orchestra.run.smithi170.stdout:(19/155): ceph-test-19.0.0-885.g661946e7.el9.x8 14 MB/s | 46 MB 00:03 2024-01-25T14:49:47.711 INFO:teuthology.orchestra.run.smithi170.stdout:(20/155): python3-ceph-argparse-19.0.0-885.g661 75 kB/s | 45 kB 00:00 2024-01-25T14:49:47.729 INFO:teuthology.orchestra.run.smithi191.stdout:(5/155): ceph-mgr-19.0.0-885.g661946e7.el9.x86_ 6.6 MB/s | 1.5 MB 00:00 2024-01-25T14:49:47.737 INFO:teuthology.orchestra.run.smithi170.stdout:(21/155): python3-ceph-common-19.0.0-885.g66194 2.1 MB/s | 130 kB 00:00 2024-01-25T14:49:47.929 INFO:teuthology.orchestra.run.smithi170.stdout:(22/155): ceph-common-19.0.0-885.g661946e7.el9. 3.3 MB/s | 19 MB 00:05 2024-01-25T14:49:47.954 INFO:teuthology.orchestra.run.smithi170.stdout:(23/155): python3-cephfs-19.0.0-885.g661946e7.e 668 kB/s | 162 kB 00:00 2024-01-25T14:49:47.980 INFO:teuthology.orchestra.run.smithi170.stdout:(24/155): python3-rados-19.0.0-885.g661946e7.el 1.3 MB/s | 321 kB 00:00 2024-01-25T14:49:48.013 INFO:teuthology.orchestra.run.smithi170.stdout:(25/155): python3-rgw-19.0.0-885.g661946e7.el9. 1.7 MB/s | 99 kB 00:00 2024-01-25T14:49:48.038 INFO:teuthology.orchestra.run.smithi170.stdout:(26/155): rbd-fuse-19.0.0-885.g661946e7.el9.x86 1.4 MB/s | 85 kB 00:00 2024-01-25T14:49:48.063 INFO:teuthology.orchestra.run.smithi170.stdout:(27/155): python3-rbd-19.0.0-885.g661946e7.el9. 2.2 MB/s | 298 kB 00:00 2024-01-25T14:49:48.089 INFO:teuthology.orchestra.run.smithi170.stdout:(28/155): rbd-nbd-19.0.0-885.g661946e7.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-01-25T14:49:48.139 INFO:teuthology.orchestra.run.smithi170.stdout:(29/155): ceph-mgr-cephadm-19.0.0-885.g661946e7 2.6 MB/s | 133 kB 00:00 2024-01-25T14:49:48.164 INFO:teuthology.orchestra.run.smithi170.stdout:(30/155): ceph-grafana-dashboards-19.0.0-885.g6 282 kB/s | 28 kB 00:00 2024-01-25T14:49:48.348 INFO:teuthology.orchestra.run.smithi170.stdout:(31/155): ceph-mgr-dashboard-19.0.0-885.g661946 8.3 MB/s | 1.7 MB 00:00 2024-01-25T14:49:48.423 INFO:teuthology.orchestra.run.smithi170.stdout:(32/155): rbd-mirror-19.0.0-885.g661946e7.el9.x 7.5 MB/s | 3.1 MB 00:00 2024-01-25T14:49:48.448 INFO:teuthology.orchestra.run.smithi170.stdout:(33/155): ceph-mgr-modules-core-19.0.0-885.g661 2.4 MB/s | 245 kB 00:00 2024-01-25T14:49:48.490 INFO:teuthology.orchestra.run.smithi170.stdout:(34/155): ceph-mgr-rook-19.0.0-885.g661946e7.el 762 kB/s | 51 kB 00:00 2024-01-25T14:49:48.496 INFO:teuthology.orchestra.run.smithi191.stdout:(6/155): ceph-mon-19.0.0-885.g661946e7.el9.x86_ 6.1 MB/s | 4.7 MB 00:00 2024-01-25T14:49:48.516 INFO:teuthology.orchestra.run.smithi170.stdout:(35/155): ceph-prometheus-alerts-19.0.0-885.g66 226 kB/s | 15 kB 00:00 2024-01-25T14:49:48.541 INFO:teuthology.orchestra.run.smithi170.stdout:(36/155): ceph-volume-19.0.0-885.g661946e7.el9. 5.1 MB/s | 262 kB 00:00 2024-01-25T14:49:48.608 INFO:teuthology.orchestra.run.smithi170.stdout:(37/155): cephfs-top-19.0.0-885.g661946e7.el9.n 274 kB/s | 18 kB 00:00 2024-01-25T14:49:48.658 INFO:teuthology.orchestra.run.smithi170.stdout:(38/155): cephadm-19.0.0-885.g661946e7.el9.noar 5.1 MB/s | 742 kB 00:00 2024-01-25T14:49:48.957 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-01-25T14:49:48.957 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-01-25T14:49:49.017 INFO:teuthology.orchestra.run.smithi170.stdout:(39/155): automake-1.16.2-8.el9.noarch.rpm 1.6 MB/s | 662 kB 00:00 2024-01-25T14:49:49.029 INFO:teuthology.orchestra.run.smithi191.stdout:(7/155): ceph-mds-19.0.0-885.g661946e7.el9.x86_ 1.4 MB/s | 2.1 MB 00:01 2024-01-25T14:49:49.084 INFO:teuthology.orchestra.run.smithi170.stdout:(40/155): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2024-01-25T14:49:49.118 INFO:teuthology.orchestra.run.smithi170.stdout:(41/155): bison-3.7.4-5.el9.x86_64.rpm 2.1 MB/s | 920 kB 00:00 2024-01-25T14:49:49.159 INFO:teuthology.orchestra.run.smithi170.stdout:(42/155): elfutils-libelf-devel-0.190-2.el9.x86 272 kB/s | 20 kB 00:00 2024-01-25T14:49:49.210 INFO:teuthology.orchestra.run.smithi170.stdout:(43/155): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 307 kB 00:00 2024-01-25T14:49:49.302 INFO:teuthology.orchestra.run.smithi170.stdout:(44/155): flexiblas-3.0.4-8.el9.x86_64.rpm 222 kB/s | 32 kB 00:00 2024-01-25T14:49:49.444 INFO:teuthology.orchestra.run.smithi170.stdout:(45/155): flexiblas-openblas-openmp-3.0.4-8.el9 121 kB/s | 17 kB 00:00 2024-01-25T14:49:49.494 INFO:teuthology.orchestra.run.smithi170.stdout:(46/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-01-25T14:49:49.519 INFO:teuthology.orchestra.run.smithi170.stdout:(47/155): libaio-devel-0.3.111-13.el9.x86_64.rp 134 kB/s | 10 kB 00:00 2024-01-25T14:49:49.553 INFO:teuthology.orchestra.run.smithi170.stdout:(48/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-01-25T14:49:49.578 INFO:teuthology.orchestra.run.smithi170.stdout:(49/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 752 kB/s | 44 kB 00:00 2024-01-25T14:49:49.637 INFO:teuthology.orchestra.run.smithi170.stdout:(50/155): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 661 kB 00:00 2024-01-25T14:49:49.663 INFO:teuthology.orchestra.run.smithi170.stdout:(51/155): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 578 kB 00:00 2024-01-25T14:49:49.688 INFO:teuthology.orchestra.run.smithi170.stdout:(52/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 498 kB/s | 24 kB 00:00 2024-01-25T14:49:49.713 INFO:teuthology.orchestra.run.smithi170.stdout:(53/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 921 kB/s | 46 kB 00:00 2024-01-25T14:49:49.747 INFO:teuthology.orchestra.run.smithi170.stdout:(54/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2024-01-25T14:49:49.772 INFO:teuthology.orchestra.run.smithi170.stdout:(55/155): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2024-01-25T14:49:49.864 INFO:teuthology.orchestra.run.smithi170.stdout:(56/155): ceph-mgr-diskprediction-local-19.0.0- 4.3 MB/s | 7.4 MB 00:01 2024-01-25T14:49:49.881 INFO:teuthology.orchestra.run.smithi170.stdout:(57/155): openblas-0.3.21-2.el9.x86_64.rpm 256 kB/s | 34 kB 00:00 2024-01-25T14:49:49.989 INFO:teuthology.orchestra.run.smithi170.stdout:(58/155): openblas-openmp-0.3.21-2.el9.x86_64.r 22 MB/s | 4.7 MB 00:00 2024-01-25T14:49:50.048 INFO:teuthology.orchestra.run.smithi170.stdout:(59/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2024-01-25T14:49:50.090 INFO:teuthology.orchestra.run.smithi170.stdout:(60/155): postgresql-13.11-1.el9.x86_64.rpm 7.4 MB/s | 1.5 MB 00:00 2024-01-25T14:49:50.123 INFO:teuthology.orchestra.run.smithi170.stdout:(61/155): postgresql-contrib-13.11-1.el9.x86_64 6.1 MB/s | 811 kB 00:00 2024-01-25T14:49:50.149 INFO:teuthology.orchestra.run.smithi170.stdout:(62/155): postgresql-private-libs-13.11-1.el9.x 1.3 MB/s | 134 kB 00:00 2024-01-25T14:49:50.174 INFO:teuthology.orchestra.run.smithi170.stdout:(63/155): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 78 kB 00:00 2024-01-25T14:49:50.272 INFO:teuthology.orchestra.run.smithi191.stdout:(8/155): ceph-common-19.0.0-885.g661946e7.el9.x 3.8 MB/s | 19 MB 00:05 2024-01-25T14:49:50.324 INFO:teuthology.orchestra.run.smithi170.stdout:(64/155): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 5.8 MB 00:00 2024-01-25T14:49:50.347 INFO:teuthology.orchestra.run.smithi191.stdout:(9/155): ceph-selinux-19.0.0-885.g661946e7.el9. 336 kB/s | 25 kB 00:00 2024-01-25T14:49:50.358 INFO:teuthology.orchestra.run.smithi170.stdout:(65/155): python3-jinja2-2.11.3-4.el9.noarch.rp 1.2 MB/s | 228 kB 00:00 2024-01-25T14:49:50.457 INFO:teuthology.orchestra.run.smithi170.stdout:(66/155): postgresql-server-13.11-1.el9.x86_64. 17 MB/s | 5.7 MB 00:00 2024-01-25T14:49:50.484 INFO:teuthology.orchestra.run.smithi170.stdout:(67/155): python3-jsonpatch-1.21-16.el9.noarch. 156 kB/s | 24 kB 00:00 2024-01-25T14:49:50.509 INFO:teuthology.orchestra.run.smithi170.stdout:(68/155): python3-jsonpointer-2.0-4.el9.noarch. 123 kB/s | 18 kB 00:00 2024-01-25T14:49:50.534 INFO:teuthology.orchestra.run.smithi170.stdout:(69/155): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 144 kB 00:00 2024-01-25T14:49:50.559 INFO:teuthology.orchestra.run.smithi170.stdout:(70/155): python3-markupsafe-1.1.1-12.el9.x86_6 632 kB/s | 32 kB 00:00 2024-01-25T14:49:50.589 INFO:teuthology.orchestra.run.smithi191.stdout:(10/155): ceph-osd-19.0.0-885.g661946e7.el9.x86 8.0 MB/s | 17 MB 00:02 2024-01-25T14:49:50.639 INFO:teuthology.orchestra.run.smithi191.stdout:(11/155): cephfs-mirror-19.0.0-885.g661946e7.el 4.3 MB/s | 217 kB 00:00 2024-01-25T14:49:50.693 INFO:teuthology.orchestra.run.smithi170.stdout:(71/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2024-01-25T14:49:50.698 INFO:teuthology.orchestra.run.smithi191.stdout:(12/155): cephfs-shell-19.0.0-885.g661946e7.el9 462 kB/s | 27 kB 00:00 2024-01-25T14:49:50.718 INFO:teuthology.orchestra.run.smithi170.stdout:(72/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-01-25T14:49:50.744 INFO:teuthology.orchestra.run.smithi170.stdout:(73/155): python3-oauthlib-3.1.1-5.el9.noarch.r 963 kB/s | 174 kB 00:00 2024-01-25T14:49:50.748 INFO:teuthology.orchestra.run.smithi191.stdout:(13/155): libcephfs-devel-19.0.0-885.g661946e7. 627 kB/s | 31 kB 00:00 2024-01-25T14:49:50.769 INFO:teuthology.orchestra.run.smithi170.stdout:(74/155): python3-prettytable-0.7.2-27.el9.noar 553 kB/s | 41 kB 00:00 2024-01-25T14:49:50.794 INFO:teuthology.orchestra.run.smithi170.stdout:(75/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-01-25T14:49:50.819 INFO:teuthology.orchestra.run.smithi170.stdout:(76/155): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-01-25T14:49:50.845 INFO:teuthology.orchestra.run.smithi170.stdout:(77/155): python3-pytz-2021.1-5.el9.noarch.rpm 628 kB/s | 47 kB 00:00 2024-01-25T14:49:50.865 INFO:teuthology.orchestra.run.smithi191.stdout:(14/155): libcephfs2-19.0.0-885.g661946e7.el9.x 6.2 MB/s | 743 kB 00:00 2024-01-25T14:49:50.870 INFO:teuthology.orchestra.run.smithi170.stdout:(78/155): python3-requests-oauthlib-1.3.0-12.el 569 kB/s | 43 kB 00:00 2024-01-25T14:49:50.924 INFO:teuthology.orchestra.run.smithi191.stdout:(15/155): libcephsqlite-19.0.0-885.g661946e7.el 2.7 MB/s | 163 kB 00:00 2024-01-25T14:49:50.966 INFO:teuthology.orchestra.run.smithi191.stdout:(16/155): librados-devel-19.0.0-885.g661946e7.e 3.0 MB/s | 127 kB 00:00 2024-01-25T14:49:51.066 INFO:teuthology.orchestra.run.smithi191.stdout:(17/155): libradosstriper1-19.0.0-885.g661946e7 4.9 MB/s | 499 kB 00:00 2024-01-25T14:49:51.095 INFO:teuthology.orchestra.run.smithi170.stdout:(79/155): python3-toml-0.10.2-6.el9.noarch.rpm 155 kB/s | 39 kB 00:00 2024-01-25T14:49:51.312 INFO:teuthology.orchestra.run.smithi170.stdout:(80/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-01-25T14:49:51.338 INFO:teuthology.orchestra.run.smithi170.stdout:(81/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 88 kB/s | 41 kB 00:00 2024-01-25T14:49:51.362 INFO:teuthology.orchestra.run.smithi170.stdout:(82/155): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 300 kB 00:00 2024-01-25T14:49:51.388 INFO:teuthology.orchestra.run.smithi170.stdout:(83/155): uuid-1.6.2-55.el9.x86_64.rpm 757 kB/s | 56 kB 00:00 2024-01-25T14:49:51.413 INFO:teuthology.orchestra.run.smithi170.stdout:(84/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-01-25T14:49:51.438 INFO:teuthology.orchestra.run.smithi170.stdout:(85/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 834 kB/s | 63 kB 00:00 2024-01-25T14:49:51.463 INFO:teuthology.orchestra.run.smithi170.stdout:(86/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 587 kB/s | 44 kB 00:00 2024-01-25T14:49:51.489 INFO:teuthology.orchestra.run.smithi170.stdout:(87/155): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-01-25T14:49:51.514 INFO:teuthology.orchestra.run.smithi170.stdout:(88/155): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 186 kB 00:00 2024-01-25T14:49:51.540 INFO:teuthology.orchestra.run.smithi170.stdout:(89/155): libgfortran-11.4.1-3.el9.x86_64.rpm 10 MB/s | 802 kB 00:00 2024-01-25T14:49:51.542 INFO:teuthology.orchestra.run.smithi191.stdout:(18/155): librgw2-19.0.0-885.g661946e7.el9.x86_ 10 MB/s | 4.8 MB 00:00 2024-01-25T14:49:51.565 INFO:teuthology.orchestra.run.smithi170.stdout:(90/155): libquadmath-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 194 kB 00:00 2024-01-25T14:49:51.590 INFO:teuthology.orchestra.run.smithi170.stdout:(91/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.9 MB/s | 217 kB 00:00 2024-01-25T14:49:51.592 INFO:teuthology.orchestra.run.smithi191.stdout:(19/155): python3-ceph-argparse-19.0.0-885.g661 902 kB/s | 45 kB 00:00 2024-01-25T14:49:51.615 INFO:teuthology.orchestra.run.smithi170.stdout:(92/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-01-25T14:49:51.642 INFO:teuthology.orchestra.run.smithi191.stdout:(20/155): python3-ceph-common-19.0.0-885.g66194 2.5 MB/s | 130 kB 00:00 2024-01-25T14:49:51.657 INFO:teuthology.orchestra.run.smithi170.stdout:(93/155): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2024-01-25T14:49:51.683 INFO:teuthology.orchestra.run.smithi170.stdout:(94/155): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2024-01-25T14:49:51.693 INFO:teuthology.orchestra.run.smithi191.stdout:(21/155): python3-cephfs-19.0.0-885.g661946e7.e 3.2 MB/s | 162 kB 00:00 2024-01-25T14:49:51.708 INFO:teuthology.orchestra.run.smithi170.stdout:(95/155): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2024-01-25T14:49:51.733 INFO:teuthology.orchestra.run.smithi170.stdout:(96/155): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2024-01-25T14:49:51.760 INFO:teuthology.orchestra.run.smithi191.stdout:(22/155): python3-rados-19.0.0-885.g661946e7.el 4.7 MB/s | 321 kB 00:00 2024-01-25T14:49:51.760 INFO:teuthology.orchestra.run.smithi170.stdout:(97/155): python3-urllib3-1.26.5-5.el9.noarch.r 3.5 MB/s | 187 kB 00:00 2024-01-25T14:49:51.827 INFO:teuthology.orchestra.run.smithi191.stdout:(23/155): python3-rbd-19.0.0-885.g661946e7.el9. 4.4 MB/s | 298 kB 00:00 2024-01-25T14:49:51.828 INFO:teuthology.orchestra.run.smithi170.stdout:(98/155): python3-devel-3.9.17-2.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-01-25T14:49:51.878 INFO:teuthology.orchestra.run.smithi191.stdout:(24/155): python3-rgw-19.0.0-885.g661946e7.el9. 1.9 MB/s | 99 kB 00:00 2024-01-25T14:49:51.928 INFO:teuthology.orchestra.run.smithi191.stdout:(25/155): rbd-fuse-19.0.0-885.g661946e7.el9.x86 1.7 MB/s | 85 kB 00:00 2024-01-25T14:49:51.986 INFO:teuthology.orchestra.run.smithi170.stdout:(99/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.3 MB/s | 309 kB 00:00 2024-01-25T14:49:52.020 INFO:teuthology.orchestra.run.smithi170.stdout:(100/155): lua-devel-5.4.4-4.el9.x86_64.rpm 78 kB/s | 22 kB 00:00 2024-01-25T14:49:52.062 INFO:teuthology.orchestra.run.smithi170.stdout:(101/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 345 kB/s | 26 kB 00:00 2024-01-25T14:49:52.145 INFO:teuthology.orchestra.run.smithi170.stdout:(102/155): libunwind-1.6.2-1.el9.x86_64.rpm 808 kB/s | 67 kB 00:00 2024-01-25T14:49:52.237 INFO:teuthology.orchestra.run.smithi170.stdout:(103/155): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-01-25T14:49:52.253 INFO:teuthology.orchestra.run.smithi191.stdout:(26/155): rbd-mirror-19.0.0-885.g661946e7.el9.x 9.5 MB/s | 3.1 MB 00:00 2024-01-25T14:49:52.262 INFO:teuthology.orchestra.run.smithi170.stdout:(104/155): liboath-2.6.7-2.el9.x86_64.rpm 200 kB/s | 49 kB 00:00 2024-01-25T14:49:52.295 INFO:teuthology.orchestra.run.smithi191.stdout:(27/155): rbd-nbd-19.0.0-885.g661946e7.el9.x86_ 4.0 MB/s | 170 kB 00:00 2024-01-25T14:49:52.337 INFO:teuthology.orchestra.run.smithi191.stdout:(28/155): ceph-grafana-dashboards-19.0.0-885.g6 680 kB/s | 28 kB 00:00 2024-01-25T14:49:52.446 INFO:teuthology.orchestra.run.smithi191.stdout:(29/155): ceph-mgr-cephadm-19.0.0-885.g661946e7 1.2 MB/s | 133 kB 00:00 2024-01-25T14:49:52.471 INFO:teuthology.orchestra.run.smithi170.stdout:(105/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.5 MB/s | 838 kB 00:00 2024-01-25T14:49:52.538 INFO:teuthology.orchestra.run.smithi170.stdout:(106/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 653 kB/s | 43 kB 00:00 2024-01-25T14:49:52.605 INFO:teuthology.orchestra.run.smithi170.stdout:(107/155): python3-cachetools-4.2.4-1.el9.noarc 483 kB/s | 32 kB 00:00 2024-01-25T14:49:52.630 INFO:teuthology.orchestra.run.smithi191.stdout:(30/155): ceph-mgr-dashboard-19.0.0-885.g661946 9.5 MB/s | 1.7 MB 00:00 2024-01-25T14:49:52.630 INFO:teuthology.orchestra.run.smithi170.stdout:(108/155): python3-asyncssh-2.13.2-3.el9.noarch 1.5 MB/s | 548 kB 00:00 2024-01-25T14:49:52.672 INFO:teuthology.orchestra.run.smithi170.stdout:(109/155): python3-certifi-2021.10.8-2.el9.noar 224 kB/s | 15 kB 00:00 2024-01-25T14:49:52.764 INFO:teuthology.orchestra.run.smithi170.stdout:(110/155): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-01-25T14:49:52.814 INFO:teuthology.orchestra.run.smithi170.stdout:(111/155): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-01-25T14:49:52.890 INFO:teuthology.orchestra.run.smithi170.stdout:(112/155): python3-colorama-0.4.4-12.el9.noarch 470 kB/s | 35 kB 00:00 2024-01-25T14:49:52.923 INFO:teuthology.orchestra.run.smithi170.stdout:(113/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.9 MB/s | 303 kB 00:00 2024-01-25T14:49:52.965 INFO:teuthology.orchestra.run.smithi170.stdout:(114/155): python3-google-auth-2.26.2-1.el9.noa 2.6 MB/s | 202 kB 00:00 2024-01-25T14:49:52.999 INFO:teuthology.orchestra.run.smithi170.stdout:(115/155): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-01-25T14:49:53.041 INFO:teuthology.orchestra.run.smithi170.stdout:(116/155): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-01-25T14:49:53.066 INFO:teuthology.orchestra.run.smithi170.stdout:(117/155): python3-jaraco-collections-3.0.0-8.e 346 kB/s | 23 kB 00:00 2024-01-25T14:49:53.117 INFO:teuthology.orchestra.run.smithi170.stdout:(118/155): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-01-25T14:49:53.142 INFO:teuthology.orchestra.run.smithi170.stdout:(119/155): python3-jaraco-text-3.2.0-6.el9.noar 262 kB/s | 20 kB 00:00 2024-01-25T14:49:53.209 INFO:teuthology.orchestra.run.smithi170.stdout:(120/155): python3-logutils-0.3.5-21.el9.noarch 694 kB/s | 46 kB 00:00 2024-01-25T14:49:53.272 INFO:teuthology.orchestra.run.smithi191.stdout:(31/155): ceph-mgr-diskprediction-local-19.0.0- 12 MB/s | 7.4 MB 00:00 2024-01-25T14:49:53.276 INFO:teuthology.orchestra.run.smithi170.stdout:(121/155): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-01-25T14:49:53.322 INFO:teuthology.orchestra.run.smithi191.stdout:(32/155): ceph-mgr-modules-core-19.0.0-885.g661 4.8 MB/s | 245 kB 00:00 2024-01-25T14:49:53.352 INFO:teuthology.orchestra.run.smithi170.stdout:(122/155): python3-natsort-7.1.1-5.el9.noarch.r 772 kB/s | 58 kB 00:00 2024-01-25T14:49:53.373 INFO:teuthology.orchestra.run.smithi191.stdout:(33/155): ceph-mgr-rook-19.0.0-885.g661946e7.el 1.0 MB/s | 51 kB 00:00 2024-01-25T14:49:53.385 INFO:teuthology.orchestra.run.smithi170.stdout:(123/155): python3-kubernetes-26.1.0-2.el9.noar 3.8 MB/s | 1.0 MB 00:00 2024-01-25T14:49:53.423 INFO:teuthology.orchestra.run.smithi191.stdout:(34/155): ceph-prometheus-alerts-19.0.0-885.g66 303 kB/s | 15 kB 00:00 2024-01-25T14:49:53.443 INFO:teuthology.orchestra.run.smithi170.stdout:(124/155): libarrow-9.0.0-10.el9.x86_64.rpm 2.7 MB/s | 4.4 MB 00:01 2024-01-25T14:49:53.460 INFO:teuthology.orchestra.run.smithi170.stdout:(125/155): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-01-25T14:49:53.482 INFO:teuthology.orchestra.run.smithi191.stdout:(35/155): ceph-volume-19.0.0-885.g661946e7.el9. 4.4 MB/s | 262 kB 00:00 2024-01-25T14:49:53.486 INFO:teuthology.orchestra.run.smithi170.stdout:(126/155): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-01-25T14:49:53.503 INFO:teuthology.orchestra.run.smithi170.stdout:(127/155): python3-pyperclip-1.8.2-2.el9.noarch 674 kB/s | 28 kB 00:00 2024-01-25T14:49:53.528 INFO:teuthology.orchestra.run.smithi170.stdout:(128/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-01-25T14:49:53.545 INFO:teuthology.orchestra.run.smithi170.stdout:(129/155): python3-repoze-lru-0.7-16.el9.noarch 523 kB/s | 31 kB 00:00 2024-01-25T14:49:53.570 INFO:teuthology.orchestra.run.smithi170.stdout:(130/155): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-01-25T14:49:53.587 INFO:teuthology.orchestra.run.smithi170.stdout:(131/155): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-01-25T14:49:53.604 INFO:teuthology.orchestra.run.smithi170.stdout:(132/155): python3-tempora-5.0.0-2.el9.noarch.r 610 kB/s | 36 kB 00:00 2024-01-25T14:49:53.615 INFO:teuthology.orchestra.run.smithi191.stdout:(36/155): cephadm-19.0.0-885.g661946e7.el9.noar 5.4 MB/s | 742 kB 00:00 2024-01-25T14:49:53.621 INFO:teuthology.orchestra.run.smithi170.stdout:(133/155): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-01-25T14:49:53.646 INFO:teuthology.orchestra.run.smithi170.stdout:(134/155): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-01-25T14:49:53.657 INFO:teuthology.orchestra.run.smithi191.stdout:(37/155): cephfs-top-19.0.0-885.g661946e7.el9.n 437 kB/s | 18 kB 00:00 2024-01-25T14:49:53.672 INFO:teuthology.orchestra.run.smithi170.stdout:(135/155): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-01-25T14:49:53.697 INFO:teuthology.orchestra.run.smithi170.stdout:(136/155): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-01-25T14:49:53.722 INFO:teuthology.orchestra.run.smithi170.stdout:(137/155): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-01-25T14:49:53.773 INFO:teuthology.orchestra.run.smithi170.stdout:(138/155): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-01-25T14:49:53.891 INFO:teuthology.orchestra.run.smithi191.stdout:(38/155): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 662 kB 00:00 2024-01-25T14:49:53.923 INFO:teuthology.orchestra.run.smithi170.stdout:(139/155): thrift-0.15.0-2.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2024-01-25T14:49:53.981 INFO:teuthology.orchestra.run.smithi170.stdout:(140/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 68 kB 00:00 2024-01-25T14:49:53.991 INFO:teuthology.orchestra.run.smithi191.stdout:(39/155): bison-3.7.4-5.el9.x86_64.rpm 9.0 MB/s | 920 kB 00:00 2024-01-25T14:49:54.050 INFO:teuthology.orchestra.run.smithi191.stdout:(40/155): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-01-25T14:49:54.057 INFO:teuthology.orchestra.run.smithi170.stdout:(141/155): librados2-19.0.0-885.g661946e7.el9.x 10 MB/s | 3.4 MB 00:00 2024-01-25T14:49:54.117 INFO:teuthology.orchestra.run.smithi191.stdout:(41/155): elfutils-libelf-devel-0.190-2.el9.x86 306 kB/s | 20 kB 00:00 2024-01-25T14:49:54.132 INFO:teuthology.orchestra.run.smithi170.stdout:(142/155): NetworkManager-1.45.10-1.el9.x86_64. 15 MB/s | 2.2 MB 00:00 2024-01-25T14:49:54.174 INFO:teuthology.orchestra.run.smithi170.stdout:(143/155): NetworkManager-libnm-1.45.10-1.el9.x 16 MB/s | 1.8 MB 00:00 2024-01-25T14:49:54.184 INFO:teuthology.orchestra.run.smithi191.stdout:(42/155): flex-2.6.4-9.el9.x86_64.rpm 4.5 MB/s | 307 kB 00:00 2024-01-25T14:49:54.191 INFO:teuthology.orchestra.run.smithi170.stdout:(144/155): NetworkManager-team-1.45.10-1.el9.x8 758 kB/s | 42 kB 00:00 2024-01-25T14:49:54.241 INFO:teuthology.orchestra.run.smithi170.stdout:(145/155): NetworkManager-tui-1.45.10-1.el9.x86 3.6 MB/s | 246 kB 00:00 2024-01-25T14:49:54.243 INFO:teuthology.orchestra.run.smithi191.stdout:(43/155): flexiblas-3.0.4-8.el9.x86_64.rpm 540 kB/s | 32 kB 00:00 2024-01-25T14:49:54.266 INFO:teuthology.orchestra.run.smithi170.stdout:(146/155): acl-2.3.1-4.el9.x86_64.rpm 915 kB/s | 69 kB 00:00 2024-01-25T14:49:54.300 INFO:teuthology.orchestra.run.smithi170.stdout:(147/155): elfutils-debuginfod-client-0.190-2.e 607 kB/s | 35 kB 00:00 2024-01-25T14:49:54.333 INFO:teuthology.orchestra.run.smithi170.stdout:(148/155): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 191 kB 00:00 2024-01-25T14:49:54.375 INFO:teuthology.orchestra.run.smithi170.stdout:(149/155): elfutils-libs-0.190-2.el9.x86_64.rpm 3.3 MB/s | 254 kB 00:00 2024-01-25T14:49:54.401 INFO:teuthology.orchestra.run.smithi170.stdout:(150/155): libacl-2.3.1-4.el9.x86_64.rpm 328 kB/s | 22 kB 00:00 2024-01-25T14:49:54.427 INFO:teuthology.orchestra.run.smithi191.stdout:(44/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-01-25T14:49:54.468 INFO:teuthology.orchestra.run.smithi170.stdout:(151/155): openssl-3.0.7-25.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2024-01-25T14:49:54.494 INFO:teuthology.orchestra.run.smithi191.stdout:(45/155): flexiblas-openblas-openmp-3.0.4-8.el9 258 kB/s | 17 kB 00:00 2024-01-25T14:49:54.518 INFO:teuthology.orchestra.run.smithi170.stdout:(152/155): librbd1-19.0.0-885.g661946e7.el9.x86 4.2 MB/s | 3.1 MB 00:00 2024-01-25T14:49:54.553 INFO:teuthology.orchestra.run.smithi191.stdout:(46/155): libaio-devel-0.3.111-13.el9.x86_64.rp 172 kB/s | 10 kB 00:00 2024-01-25T14:49:54.560 INFO:teuthology.orchestra.run.smithi170.stdout:(153/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 14 MB/s | 2.1 MB 00:00 2024-01-25T14:49:54.585 INFO:teuthology.orchestra.run.smithi170.stdout:(154/155): xfsdump-3.1.12-4.el9.x86_64.rpm 2.8 MB/s | 321 kB 00:00 2024-01-25T14:49:54.619 INFO:teuthology.orchestra.run.smithi170.stdout:(155/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-01-25T14:49:54.624 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-01-25T14:49:54.624 INFO:teuthology.orchestra.run.smithi170.stdout:Total 16 MB/s | 209 MB 00:13 2024-01-25T14:49:54.628 INFO:teuthology.orchestra.run.smithi191.stdout:(47/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2024-01-25T14:49:54.655 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-01-25T14:49:54.695 INFO:teuthology.orchestra.run.smithi191.stdout:(48/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 664 kB/s | 44 kB 00:00 2024-01-25T14:49:54.771 INFO:teuthology.orchestra.run.smithi191.stdout:(49/155): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-01-25T14:49:54.838 INFO:teuthology.orchestra.run.smithi191.stdout:(50/155): libtool-2.4.6-45.el9.x86_64.rpm 8.5 MB/s | 578 kB 00:00 2024-01-25T14:49:54.896 INFO:teuthology.orchestra.run.smithi191.stdout:(51/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-01-25T14:49:54.932 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-01-25T14:49:54.932 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-01-25T14:49:54.955 INFO:teuthology.orchestra.run.smithi191.stdout:(52/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 795 kB/s | 46 kB 00:00 2024-01-25T14:49:55.039 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-01-25T14:49:55.064 INFO:teuthology.orchestra.run.smithi191.stdout:(53/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.5 MB/s | 282 kB 00:00 2024-01-25T14:49:55.114 INFO:teuthology.orchestra.run.smithi191.stdout:(54/155): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-01-25T14:49:55.160 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2024-01-25T14:49:55.165 INFO:teuthology.orchestra.run.smithi191.stdout:(55/155): openblas-0.3.21-2.el9.x86_64.rpm 681 kB/s | 34 kB 00:00 2024-01-25T14:49:55.199 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/171 2024-01-25T14:49:55.260 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/171 2024-01-25T14:49:55.294 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/171 2024-01-25T14:49:55.320 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2024-01-25T14:49:55.332 INFO:teuthology.orchestra.run.smithi191.stdout:(56/155): ceph-radosgw-19.0.0-885.g661946e7.el9 1.4 MB/s | 8.7 MB 00:06 2024-01-25T14:49:55.363 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2024-01-25T14:49:55.407 INFO:teuthology.orchestra.run.smithi191.stdout:(57/155): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-01-25T14:49:55.499 INFO:teuthology.orchestra.run.smithi191.stdout:(58/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 18 MB/s | 3.0 MB 00:00 2024-01-25T14:49:55.541 INFO:teuthology.orchestra.run.smithi191.stdout:(59/155): postgresql-13.11-1.el9.x86_64.rpm 12 MB/s | 1.5 MB 00:00 2024-01-25T14:49:55.575 INFO:teuthology.orchestra.run.smithi191.stdout:(60/155): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2024-01-25T14:49:55.600 INFO:teuthology.orchestra.run.smithi191.stdout:(61/155): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-01-25T14:49:55.684 INFO:teuthology.orchestra.run.smithi191.stdout:(62/155): python3-attrs-20.3.0-7.el9.noarch.rpm 934 kB/s | 78 kB 00:00 2024-01-25T14:49:55.686 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2024-01-25T14:49:55.785 INFO:teuthology.orchestra.run.smithi191.stdout:(63/155): postgresql-server-13.11-1.el9.x86_64. 27 MB/s | 5.7 MB 00:00 2024-01-25T14:49:55.815 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-25T14:49:55.944 INFO:teuthology.orchestra.run.smithi191.stdout:(64/155): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 5.8 MB 00:00 2024-01-25T14:49:55.969 INFO:teuthology.orchestra.run.smithi191.stdout:(65/155): python3-jinja2-2.11.3-4.el9.noarch.rp 1.2 MB/s | 228 kB 00:00 2024-01-25T14:49:55.986 INFO:teuthology.orchestra.run.smithi191.stdout:(66/155): python3-jsonpatch-1.21-16.el9.noarch. 588 kB/s | 24 kB 00:00 2024-01-25T14:49:56.020 INFO:teuthology.orchestra.run.smithi191.stdout:(67/155): python3-jsonpointer-2.0-4.el9.noarch. 359 kB/s | 18 kB 00:00 2024-01-25T14:49:56.045 INFO:teuthology.orchestra.run.smithi191.stdout:(68/155): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2024-01-25T14:49:56.070 INFO:teuthology.orchestra.run.smithi191.stdout:(69/155): python3-markupsafe-1.1.1-12.el9.x86_6 628 kB/s | 32 kB 00:00 2024-01-25T14:49:56.076 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-25T14:49:56.106 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-25T14:49:56.198 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-25T14:49:56.252 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-25T14:49:56.333 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2024-01-25T14:49:56.420 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2024-01-25T14:49:56.538 INFO:teuthology.orchestra.run.smithi191.stdout:(70/155): ceph-test-19.0.0-885.g661946e7.el9.x8 7.4 MB/s | 46 MB 00:06 2024-01-25T14:49:56.586 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2024-01-25T14:49:56.613 INFO:teuthology.orchestra.run.smithi191.stdout:(71/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.4 MB/s | 4.8 MB 00:00 2024-01-25T14:49:56.638 INFO:teuthology.orchestra.run.smithi191.stdout:(72/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 383 kB/s | 217 kB 00:00 2024-01-25T14:49:56.643 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2024-01-25T14:49:56.664 INFO:teuthology.orchestra.run.smithi191.stdout:(73/155): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 174 kB 00:00 2024-01-25T14:49:56.672 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-25T14:49:56.689 INFO:teuthology.orchestra.run.smithi191.stdout:(74/155): python3-prettytable-0.7.2-27.el9.noar 826 kB/s | 41 kB 00:00 2024-01-25T14:49:56.714 INFO:teuthology.orchestra.run.smithi191.stdout:(75/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-01-25T14:49:56.731 INFO:teuthology.orchestra.run.smithi191.stdout:(76/155): python3-pyasn1-modules-0.4.8-6.el9.no 3.1 MB/s | 211 kB 00:00 2024-01-25T14:49:56.757 INFO:teuthology.orchestra.run.smithi191.stdout:(77/155): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-01-25T14:49:56.776 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-25T14:49:56.782 INFO:teuthology.orchestra.run.smithi191.stdout:(78/155): python3-requests-oauthlib-1.3.0-12.el 640 kB/s | 43 kB 00:00 2024-01-25T14:49:56.783 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-01-25T14:49:56.784 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-01-25T14:49:56.797 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-25T14:49:56.859 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-25T14:49:56.959 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2024-01-25T14:49:57.057 INFO:teuthology.orchestra.run.smithi191.stdout:(79/155): python3-toml-0.10.2-6.el9.noarch.rpm 128 kB/s | 39 kB 00:00 2024-01-25T14:49:57.067 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-25T14:49:57.127 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-25T14:49:57.133 INFO:teuthology.orchestra.run.smithi191.stdout:(80/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 117 kB/s | 41 kB 00:00 2024-01-25T14:49:57.202 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-25T14:49:57.254 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-25T14:49:57.316 INFO:teuthology.orchestra.run.smithi191.stdout:(81/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-01-25T14:49:57.342 INFO:teuthology.orchestra.run.smithi191.stdout:(82/155): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 300 kB 00:00 2024-01-25T14:49:57.367 INFO:teuthology.orchestra.run.smithi191.stdout:(83/155): uuid-1.6.2-55.el9.x86_64.rpm 242 kB/s | 56 kB 00:00 2024-01-25T14:49:57.392 INFO:teuthology.orchestra.run.smithi191.stdout:(84/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-01-25T14:49:57.409 INFO:teuthology.orchestra.run.smithi191.stdout:(85/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 934 kB/s | 63 kB 00:00 2024-01-25T14:49:57.426 INFO:teuthology.orchestra.run.smithi191.stdout:(86/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 749 kB/s | 44 kB 00:00 2024-01-25T14:49:57.443 INFO:teuthology.orchestra.run.smithi191.stdout:(87/155): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-01-25T14:49:57.486 INFO:teuthology.orchestra.run.smithi191.stdout:(88/155): jq-1.6-16.el9.x86_64.rpm 3.1 MB/s | 186 kB 00:00 2024-01-25T14:49:57.528 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-25T14:49:57.544 INFO:teuthology.orchestra.run.smithi191.stdout:(89/155): libgfortran-11.4.1-3.el9.x86_64.rpm 6.7 MB/s | 802 kB 00:00 2024-01-25T14:49:57.557 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2024-01-25T14:49:57.569 INFO:teuthology.orchestra.run.smithi191.stdout:(90/155): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 194 kB 00:00 2024-01-25T14:49:57.595 INFO:teuthology.orchestra.run.smithi191.stdout:(91/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.0 MB/s | 217 kB 00:00 2024-01-25T14:49:57.625 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2024-01-25T14:49:57.628 INFO:teuthology.orchestra.run.smithi191.stdout:(92/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-01-25T14:49:57.671 INFO:teuthology.orchestra.run.smithi191.stdout:(93/155): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-01-25T14:49:57.680 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2024-01-25T14:49:57.696 INFO:teuthology.orchestra.run.smithi191.stdout:(94/155): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 103 kB 00:00 2024-01-25T14:49:57.711 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2024-01-25T14:49:57.721 INFO:teuthology.orchestra.run.smithi191.stdout:(95/155): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2024-01-25T14:49:57.746 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/171 2024-01-25T14:49:57.746 INFO:teuthology.orchestra.run.smithi191.stdout:(96/155): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2024-01-25T14:49:57.780 INFO:teuthology.orchestra.run.smithi191.stdout:(97/155): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 187 kB 00:00 2024-01-25T14:49:57.786 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/171 2024-01-25T14:49:57.850 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2024-01-25T14:49:57.890 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2024-01-25T14:49:57.927 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2024-01-25T14:49:57.947 INFO:teuthology.orchestra.run.smithi191.stdout:(98/155): lua-devel-5.4.4-4.el9.x86_64.rpm 111 kB/s | 22 kB 00:00 2024-01-25T14:49:57.956 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/171 2024-01-25T14:49:58.024 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/171 2024-01-25T14:49:58.062 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 31/171 2024-01-25T14:49:58.105 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 32/171 2024-01-25T14:49:58.135 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 33/171 2024-01-25T14:49:58.202 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/171 2024-01-25T14:49:58.280 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/171 2024-01-25T14:49:58.331 INFO:teuthology.orchestra.run.smithi191.stdout:(99/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 561 kB/s | 309 kB 00:00 2024-01-25T14:49:58.415 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/171 2024-01-25T14:49:58.423 INFO:teuthology.orchestra.run.smithi191.stdout:(100/155): python3-devel-3.9.17-2.el9.x86_64.rp 350 kB/s | 245 kB 00:00 2024-01-25T14:49:58.448 INFO:teuthology.orchestra.run.smithi191.stdout:(101/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 222 kB/s | 26 kB 00:00 2024-01-25T14:49:58.476 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/171 2024-01-25T14:49:58.574 INFO:teuthology.orchestra.run.smithi191.stdout:(102/155): libunwind-1.6.2-1.el9.x86_64.rpm 538 kB/s | 67 kB 00:00 2024-01-25T14:49:58.716 INFO:teuthology.orchestra.run.smithi191.stdout:(103/155): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-01-25T14:49:58.783 INFO:teuthology.orchestra.run.smithi191.stdout:(104/155): liboath-2.6.7-2.el9.x86_64.rpm 135 kB/s | 49 kB 00:00 2024-01-25T14:49:58.883 INFO:teuthology.orchestra.run.smithi191.stdout:(105/155): libarrow-9.0.0-10.el9.x86_64.rpm 4.7 MB/s | 4.4 MB 00:00 2024-01-25T14:49:58.925 INFO:teuthology.orchestra.run.smithi191.stdout:(106/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.9 MB/s | 838 kB 00:00 2024-01-25T14:49:58.984 INFO:teuthology.orchestra.run.smithi191.stdout:(107/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 432 kB/s | 43 kB 00:00 2024-01-25T14:49:59.026 INFO:teuthology.orchestra.run.smithi191.stdout:(108/155): python3-cachetools-4.2.4-1.el9.noarc 320 kB/s | 32 kB 00:00 2024-01-25T14:49:59.028 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/171 2024-01-25T14:49:59.113 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/171 2024-01-25T14:49:59.127 INFO:teuthology.orchestra.run.smithi191.stdout:(109/155): python3-certifi-2021.10.8-2.el9.noar 105 kB/s | 15 kB 00:00 2024-01-25T14:49:59.152 INFO:teuthology.orchestra.run.smithi191.stdout:(110/155): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-01-25T14:49:59.154 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/171 2024-01-25T14:49:59.194 INFO:teuthology.orchestra.run.smithi191.stdout:(111/155): python3-asyncssh-2.13.2-3.el9.noarch 1.3 MB/s | 548 kB 00:00 2024-01-25T14:49:59.202 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 41/171 2024-01-25T14:49:59.236 INFO:teuthology.orchestra.run.smithi191.stdout:(112/155): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-01-25T14:49:59.240 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 42/171 2024-01-25T14:49:59.282 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/171 2024-01-25T14:49:59.295 INFO:teuthology.orchestra.run.smithi191.stdout:(113/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-01-25T14:49:59.312 INFO:teuthology.orchestra.run.smithi191.stdout:(114/155): python3-colorama-0.4.4-12.el9.noarch 300 kB/s | 35 kB 00:00 2024-01-25T14:49:59.371 INFO:teuthology.orchestra.run.smithi191.stdout:(115/155): python3-google-auth-2.26.2-1.el9.noa 1.5 MB/s | 202 kB 00:00 2024-01-25T14:49:59.387 INFO:teuthology.orchestra.run.smithi191.stdout:(116/155): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-01-25T14:49:59.404 INFO:teuthology.orchestra.run.smithi191.stdout:(117/155): python3-jaraco-classes-3.2.1-5.el9.n 191 kB/s | 18 kB 00:00 2024-01-25T14:49:59.411 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/171 2024-01-25T14:49:59.458 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/171 2024-01-25T14:49:59.463 INFO:teuthology.orchestra.run.smithi191.stdout:(118/155): python3-jaraco-collections-3.0.0-8.e 250 kB/s | 23 kB 00:00 2024-01-25T14:49:59.481 INFO:teuthology.orchestra.run.smithi191.stdout:(119/155): python3-jaraco-functools-3.5.0-2.el9 210 kB/s | 19 kB 00:00 2024-01-25T14:49:59.497 INFO:teuthology.orchestra.run.smithi191.stdout:(120/155): python3-jaraco-text-3.2.0-6.el9.noar 212 kB/s | 20 kB 00:00 2024-01-25T14:49:59.564 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/171 2024-01-25T14:49:59.581 INFO:teuthology.orchestra.run.smithi191.stdout:(121/155): python3-logutils-0.3.5-21.el9.noarch 460 kB/s | 46 kB 00:00 2024-01-25T14:49:59.603 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 47/171 2024-01-25T14:49:59.606 INFO:teuthology.orchestra.run.smithi191.stdout:(122/155): python3-more-itertools-8.12.0-2.el9. 725 kB/s | 79 kB 00:00 2024-01-25T14:49:59.674 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/171 2024-01-25T14:49:59.682 INFO:teuthology.orchestra.run.smithi191.stdout:(123/155): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-01-25T14:49:59.707 INFO:teuthology.orchestra.run.smithi191.stdout:(124/155): python3-natsort-7.1.1-5.el9.noarch.r 459 kB/s | 58 kB 00:00 2024-01-25T14:49:59.733 INFO:teuthology.orchestra.run.smithi191.stdout:(125/155): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-01-25T14:49:59.747 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/171 2024-01-25T14:49:59.778 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/171 2024-01-25T14:49:59.783 INFO:teuthology.orchestra.run.smithi191.stdout:(126/155): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-01-25T14:49:59.808 INFO:teuthology.orchestra.run.smithi191.stdout:(127/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 892 kB/s | 90 kB 00:00 2024-01-25T14:49:59.814 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/171 2024-01-25T14:49:59.834 INFO:teuthology.orchestra.run.smithi191.stdout:(128/155): python3-pyperclip-1.8.2-2.el9.noarch 280 kB/s | 28 kB 00:00 2024-01-25T14:49:59.861 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/171 2024-01-25T14:49:59.892 INFO:teuthology.orchestra.run.smithi191.stdout:(129/155): python3-repoze-lru-0.7-16.el9.noarch 282 kB/s | 31 kB 00:00 2024-01-25T14:49:59.899 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/171 2024-01-25T14:49:59.941 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/171 2024-01-25T14:49:59.943 INFO:teuthology.orchestra.run.smithi191.stdout:(130/155): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-01-25T14:49:59.968 INFO:teuthology.orchestra.run.smithi191.stdout:(131/155): python3-rsa-4.9-2.el9.noarch.rpm 439 kB/s | 59 kB 00:00 2024-01-25T14:49:59.983 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/171 2024-01-25T14:50:00.010 INFO:teuthology.orchestra.run.smithi191.stdout:(132/155): python3-tempora-5.0.0-2.el9.noarch.r 303 kB/s | 36 kB 00:00 2024-01-25T14:50:00.044 INFO:teuthology.orchestra.run.smithi191.stdout:(133/155): python3-typing-extensions-4.4.0-2.el 504 kB/s | 51 kB 00:00 2024-01-25T14:50:00.086 INFO:teuthology.orchestra.run.smithi191.stdout:(134/155): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-01-25T14:50:00.116 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/171 2024-01-25T14:50:00.120 INFO:teuthology.orchestra.run.smithi191.stdout:(135/155): python3-websocket-client-1.2.3-2.el9 821 kB/s | 90 kB 00:00 2024-01-25T14:50:00.154 INFO:teuthology.orchestra.run.smithi191.stdout:(136/155): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-01-25T14:50:00.163 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/171 2024-01-25T14:50:00.188 INFO:teuthology.orchestra.run.smithi191.stdout:(137/155): python3-zc-lockfile-2.0-10.el9.noarc 198 kB/s | 20 kB 00:00 2024-01-25T14:50:00.193 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/171 2024-01-25T14:50:00.235 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/171 2024-01-25T14:50:00.296 INFO:teuthology.orchestra.run.smithi191.stdout:(138/155): re2-20211101-3.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-01-25T14:50:00.329 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/171 2024-01-25T14:50:00.360 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 61/171 2024-01-25T14:50:00.400 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/171 2024-01-25T14:50:00.426 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/171 2024-01-25T14:50:00.472 INFO:teuthology.orchestra.run.smithi191.stdout:(139/155): thrift-0.15.0-2.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2024-01-25T14:50:00.505 INFO:teuthology.orchestra.run.smithi191.stdout:(140/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2024-01-25T14:50:00.519 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 64/171 2024-01-25T14:50:00.563 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 65/171 2024-01-25T14:50:00.612 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ply-3.11-14.el9.noarch 66/171 2024-01-25T14:50:00.639 INFO:teuthology.orchestra.run.smithi191.stdout:(141/155): NetworkManager-1.45.10-1.el9.x86_64. 17 MB/s | 2.2 MB 00:00 2024-01-25T14:50:00.667 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 67/171 2024-01-25T14:50:00.706 INFO:teuthology.orchestra.run.smithi191.stdout:(142/155): librbd1-19.0.0-885.g661946e7.el9.x86 7.6 MB/s | 3.1 MB 00:00 2024-01-25T14:50:00.773 INFO:teuthology.orchestra.run.smithi191.stdout:(143/155): NetworkManager-libnm-1.45.10-1.el9.x 13 MB/s | 1.8 MB 00:00 2024-01-25T14:50:00.790 INFO:teuthology.orchestra.run.smithi191.stdout:(144/155): NetworkManager-team-1.45.10-1.el9.x8 518 kB/s | 42 kB 00:00 2024-01-25T14:50:00.824 INFO:teuthology.orchestra.run.smithi191.stdout:(145/155): NetworkManager-tui-1.45.10-1.el9.x86 4.8 MB/s | 246 kB 00:00 2024-01-25T14:50:00.849 INFO:teuthology.orchestra.run.smithi191.stdout:(146/155): acl-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 69 kB 00:00 2024-01-25T14:50:00.853 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 68/171 2024-01-25T14:50:00.866 INFO:teuthology.orchestra.run.smithi191.stdout:(147/155): elfutils-debuginfod-client-0.190-2.e 844 kB/s | 35 kB 00:00 2024-01-25T14:50:00.900 INFO:teuthology.orchestra.run.smithi191.stdout:(148/155): elfutils-libelf-0.190-2.el9.x86_64.r 3.7 MB/s | 191 kB 00:00 2024-01-25T14:50:00.901 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 69/171 2024-01-25T14:50:00.927 INFO:teuthology.orchestra.run.smithi191.stdout:(149/155): elfutils-libs-0.190-2.el9.x86_64.rpm 4.2 MB/s | 254 kB 00:00 2024-01-25T14:50:00.942 INFO:teuthology.orchestra.run.smithi191.stdout:(150/155): libacl-2.3.1-4.el9.x86_64.rpm 527 kB/s | 22 kB 00:00 2024-01-25T14:50:01.009 INFO:teuthology.orchestra.run.smithi191.stdout:(151/155): openssl-3.0.7-25.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2024-01-25T14:50:01.032 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 70/171 2024-01-25T14:50:01.066 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 71/171 2024-01-25T14:50:01.085 INFO:teuthology.orchestra.run.smithi191.stdout:(152/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 15 MB/s | 2.1 MB 00:00 2024-01-25T14:50:01.099 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2024-01-25T14:50:01.111 INFO:teuthology.orchestra.run.smithi191.stdout:(153/155): xfsdump-3.1.12-4.el9.x86_64.rpm 3.2 MB/s | 321 kB 00:00 2024-01-25T14:50:01.132 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2024-01-25T14:50:01.157 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2024-01-25T14:50:01.169 INFO:teuthology.orchestra.run.smithi191.stdout:(154/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-01-25T14:50:01.197 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2024-01-25T14:50:01.225 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2024-01-25T14:50:01.259 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2024-01-25T14:50:01.357 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2024-01-25T14:50:01.397 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2024-01-25T14:50:01.427 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-25T14:50:01.504 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2024-01-25T14:50:01.537 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2024-01-25T14:50:01.571 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2024-01-25T14:50:01.612 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2024-01-25T14:50:01.647 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2024-01-25T14:50:01.719 INFO:teuthology.orchestra.run.smithi191.stdout:(155/155): librados2-19.0.0-885.g661946e7.el9.x 2.2 MB/s | 3.4 MB 00:01 2024-01-25T14:50:01.723 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2024-01-25T14:50:01.723 INFO:teuthology.orchestra.run.smithi191.stdout:Total 12 MB/s | 209 MB 00:17 2024-01-25T14:50:01.735 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2024-01-25T14:50:01.758 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2024-01-25T14:50:01.774 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2024-01-25T14:50:01.877 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2024-01-25T14:50:01.942 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2024-01-25T14:50:02.013 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2024-01-25T14:50:02.013 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2024-01-25T14:50:02.669 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2024-01-25T14:50:02.722 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2024-01-25T14:50:02.756 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2024-01-25T14:50:02.804 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2024-01-25T14:50:02.900 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2024-01-25T14:50:02.932 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2024-01-25T14:50:03.056 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-01-25T14:50:03.109 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2024-01-25T14:50:03.140 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2024-01-25T14:50:03.147 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2024-01-25T14:50:03.186 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/171 2024-01-25T14:50:03.224 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2024-01-25T14:50:03.241 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/171 2024-01-25T14:50:03.281 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/171 2024-01-25T14:50:03.307 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2024-01-25T14:50:03.355 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2024-01-25T14:50:03.565 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2024-01-25T14:50:03.567 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2024-01-25T14:50:03.696 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2024-01-25T14:50:03.758 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-25T14:50:03.864 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-25T14:50:03.869 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2024-01-25T14:50:03.909 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-25T14:50:03.977 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2024-01-25T14:50:03.984 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-25T14:50:04.020 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-25T14:50:04.123 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2024-01-25T14:50:04.241 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2024-01-25T14:50:04.416 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2024-01-25T14:50:04.471 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2024-01-25T14:50:04.499 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-25T14:50:04.602 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-25T14:50:04.625 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-25T14:50:04.687 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-25T14:50:04.863 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2024-01-25T14:50:05.005 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-25T14:50:05.081 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-25T14:50:05.192 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-25T14:50:05.207 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2024-01-25T14:50:05.249 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-25T14:50:05.284 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2024-01-25T14:50:05.312 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2024-01-25T14:50:05.345 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2024-01-25T14:50:05.528 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-25T14:50:05.570 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2024-01-25T14:50:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2024-01-25T14:50:05.651 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2024-01-25T14:50:05.683 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-25T14:50:05.699 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2024-01-25T14:50:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2024-01-25T14:50:05.774 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-25T14:50:05.805 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 107/171 2024-01-25T14:50:05.809 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/171 2024-01-25T14:50:05.844 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2024-01-25T14:50:05.848 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/171 2024-01-25T14:50:05.913 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2024-01-25T14:50:05.956 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2024-01-25T14:50:05.989 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2024-01-25T14:50:06.018 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/171 2024-01-25T14:50:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/171 2024-01-25T14:50:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 31/171 2024-01-25T14:50:06.170 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 32/171 2024-01-25T14:50:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 33/171 2024-01-25T14:50:06.266 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2024-01-25T14:50:06.272 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/171 2024-01-25T14:50:06.303 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 110/171 2024-01-25T14:50:06.349 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/171 2024-01-25T14:50:06.374 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 110/171 2024-01-25T14:50:06.464 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 111/171 2024-01-25T14:50:06.488 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/171 2024-01-25T14:50:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/171 2024-01-25T14:50:07.057 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/171 2024-01-25T14:50:07.130 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/171 2024-01-25T14:50:07.164 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/171 2024-01-25T14:50:07.220 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 41/171 2024-01-25T14:50:07.258 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 42/171 2024-01-25T14:50:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/171 2024-01-25T14:50:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/171 2024-01-25T14:50:07.501 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/171 2024-01-25T14:50:07.607 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/171 2024-01-25T14:50:07.645 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 47/171 2024-01-25T14:50:07.699 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/171 2024-01-25T14:50:07.765 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/171 2024-01-25T14:50:07.796 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/171 2024-01-25T14:50:07.832 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/171 2024-01-25T14:50:07.879 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/171 2024-01-25T14:50:07.915 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/171 2024-01-25T14:50:07.958 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/171 2024-01-25T14:50:08.005 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/171 2024-01-25T14:50:08.138 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/171 2024-01-25T14:50:08.186 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/171 2024-01-25T14:50:08.216 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/171 2024-01-25T14:50:08.257 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/171 2024-01-25T14:50:08.360 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/171 2024-01-25T14:50:08.408 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 61/171 2024-01-25T14:50:08.448 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/171 2024-01-25T14:50:08.473 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/171 2024-01-25T14:50:08.567 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 64/171 2024-01-25T14:50:08.609 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 65/171 2024-01-25T14:50:08.657 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ply-3.11-14.el9.noarch 66/171 2024-01-25T14:50:08.689 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 112/171 2024-01-25T14:50:08.742 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 67/171 2024-01-25T14:50:08.877 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 112/171 2024-01-25T14:50:08.941 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 68/171 2024-01-25T14:50:08.989 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 69/171 2024-01-25T14:50:09.123 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 70/171 2024-01-25T14:50:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 71/171 2024-01-25T14:50:09.395 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 112/171 2024-01-25T14:50:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2024-01-25T14:50:09.443 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 113/171 2024-01-25T14:50:09.495 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2024-01-25T14:50:09.524 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 113/171 2024-01-25T14:50:09.524 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-25T14:50:09.524 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-25T14:50:09.524 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-01-25T14:50:09.531 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2024-01-25T14:50:09.552 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 114/171 2024-01-25T14:50:09.561 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2024-01-25T14:50:09.589 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2024-01-25T14:50:09.634 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2024-01-25T14:50:09.672 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2024-01-25T14:50:09.682 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2024-01-25T14:50:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2024-01-25T14:50:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-25T14:50:09.798 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2024-01-25T14:50:09.823 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2024-01-25T14:50:09.836 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/171 2024-01-25T14:50:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2024-01-25T14:50:09.898 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/171 2024-01-25T14:50:09.901 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2024-01-25T14:50:09.933 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/171 2024-01-25T14:50:09.951 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2024-01-25T14:50:09.958 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2024-01-25T14:50:09.985 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2024-01-25T14:50:10.001 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2024-01-25T14:50:10.077 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2024-01-25T14:50:10.112 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2024-01-25T14:50:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2024-01-25T14:50:10.271 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2024-01-25T14:50:10.329 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2024-01-25T14:50:10.461 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-25T14:50:10.793 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-25T14:50:10.821 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-25T14:50:10.913 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-25T14:50:10.942 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-25T14:50:10.989 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2024-01-25T14:50:11.015 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2024-01-25T14:50:11.035 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2024-01-25T14:50:11.069 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2024-01-25T14:50:11.103 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2024-01-25T14:50:11.119 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2024-01-25T14:50:11.269 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2024-01-25T14:50:11.320 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2024-01-25T14:50:11.348 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-25T14:50:11.349 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2024-01-25T14:50:11.460 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 15/171 2024-01-25T14:50:11.482 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-25T14:50:11.535 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 16/171 2024-01-25T14:50:11.537 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2024-01-25T14:50:11.638 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2024-01-25T14:50:11.714 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2024-01-25T14:50:11.738 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-25T14:50:11.743 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2024-01-25T14:50:11.782 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-25T14:50:11.821 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2024-01-25T14:50:11.852 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-25T14:50:11.902 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-25T14:50:12.183 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-25T14:50:12.222 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2024-01-25T14:50:12.290 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2024-01-25T14:50:12.345 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2024-01-25T14:50:12.384 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2024-01-25T14:50:12.418 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/171 2024-01-25T14:50:12.458 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/171 2024-01-25T14:50:12.486 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2024-01-25T14:50:12.530 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2024-01-25T14:50:12.566 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2024-01-25T14:50:12.597 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2024-01-25T14:50:12.604 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2024-01-25T14:50:12.628 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/171 2024-01-25T14:50:12.696 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/171 2024-01-25T14:50:12.733 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 31/171 2024-01-25T14:50:12.776 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 32/171 2024-01-25T14:50:12.805 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 33/171 2024-01-25T14:50:12.882 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/171 2024-01-25T14:50:12.959 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/171 2024-01-25T14:50:13.102 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/171 2024-01-25T14:50:13.180 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/171 2024-01-25T14:50:13.692 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/171 2024-01-25T14:50:13.767 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/171 2024-01-25T14:50:13.799 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/171 2024-01-25T14:50:13.825 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2024-01-25T14:50:13.839 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 41/171 2024-01-25T14:50:13.877 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 42/171 2024-01-25T14:50:13.898 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2024-01-25T14:50:13.919 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/171 2024-01-25T14:50:13.926 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2024-01-25T14:50:13.960 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2024-01-25T14:50:14.061 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/171 2024-01-25T14:50:14.103 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/171 2024-01-25T14:50:14.209 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/171 2024-01-25T14:50:14.248 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 47/171 2024-01-25T14:50:14.266 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2024-01-25T14:50:14.289 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-25T14:50:14.303 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/171 2024-01-25T14:50:14.372 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-25T14:50:14.375 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/171 2024-01-25T14:50:14.402 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 107/171 2024-01-25T14:50:14.416 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/171 2024-01-25T14:50:14.448 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2024-01-25T14:50:14.460 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/171 2024-01-25T14:50:14.507 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/171 2024-01-25T14:50:14.543 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/171 2024-01-25T14:50:14.586 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/171 2024-01-25T14:50:14.627 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/171 2024-01-25T14:50:14.761 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/171 2024-01-25T14:50:14.808 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/171 2024-01-25T14:50:14.838 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/171 2024-01-25T14:50:14.880 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/171 2024-01-25T14:50:14.883 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2024-01-25T14:50:14.917 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 110/171 2024-01-25T14:50:14.979 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/171 2024-01-25T14:50:14.988 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 110/171 2024-01-25T14:50:15.011 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 111/171 2024-01-25T14:50:15.030 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-google-auth-1:2.26.2-1.el9.noarch 61/171 2024-01-25T14:50:15.070 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/171 2024-01-25T14:50:15.096 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/171 2024-01-25T14:50:15.188 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 64/171 2024-01-25T14:50:15.232 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 65/171 2024-01-25T14:50:15.280 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ply-3.11-14.el9.noarch 66/171 2024-01-25T14:50:15.336 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 67/171 2024-01-25T14:50:15.526 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 68/171 2024-01-25T14:50:15.577 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 69/171 2024-01-25T14:50:15.712 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 70/171 2024-01-25T14:50:15.750 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 71/171 2024-01-25T14:50:15.783 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2024-01-25T14:50:15.815 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2024-01-25T14:50:15.850 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2024-01-25T14:50:15.881 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2024-01-25T14:50:15.909 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2024-01-25T14:50:16.044 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2024-01-25T14:50:16.091 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2024-01-25T14:50:16.123 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2024-01-25T14:50:16.152 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-25T14:50:16.228 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2024-01-25T14:50:16.263 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2024-01-25T14:50:16.296 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2024-01-25T14:50:16.337 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2024-01-25T14:50:16.372 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2024-01-25T14:50:16.460 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2024-01-25T14:50:16.491 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2024-01-25T14:50:16.592 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2024-01-25T14:50:16.642 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2024-01-25T14:50:17.146 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 112/171 2024-01-25T14:50:17.183 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 112/171 2024-01-25T14:50:17.357 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2024-01-25T14:50:17.405 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2024-01-25T14:50:17.431 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2024-01-25T14:50:17.478 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2024-01-25T14:50:17.556 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2024-01-25T14:50:17.607 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2024-01-25T14:50:17.698 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 112/171 2024-01-25T14:50:17.737 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 113/171 2024-01-25T14:50:17.783 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2024-01-25T14:50:17.813 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2024-01-25T14:50:17.828 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 113/171 2024-01-25T14:50:17.829 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-25T14:50:17.829 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-25T14:50:17.829 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:50:17.863 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 114/171 2024-01-25T14:50:17.890 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2024-01-25T14:50:18.510 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2024-01-25T14:50:18.626 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2024-01-25T14:50:19.814 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2024-01-25T14:50:19.900 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2024-01-25T14:50:19.928 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2024-01-25T14:50:19.961 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2024-01-25T14:50:20.267 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2024-01-25T14:50:20.291 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-25T14:50:20.379 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 106/171 2024-01-25T14:50:20.411 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 107/171 2024-01-25T14:50:20.447 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2024-01-25T14:50:20.874 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2024-01-25T14:50:20.902 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 110/171 2024-01-25T14:50:20.942 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 114/171 2024-01-25T14:50:20.942 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /sys 2024-01-25T14:50:20.942 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /proc 2024-01-25T14:50:20.942 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /mnt 2024-01-25T14:50:20.942 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /var/tmp 2024-01-25T14:50:20.942 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /home 2024-01-25T14:50:20.942 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /root 2024-01-25T14:50:20.942 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /tmp 2024-01-25T14:50:20.942 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-01-25T14:50:20.980 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 110/171 2024-01-25T14:50:21.003 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 111/171 2024-01-25T14:50:21.099 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 115/171 2024-01-25T14:50:21.114 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 115/171 2024-01-25T14:50:21.114 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:21.114 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-25T14:50:21.114 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-01-25T14:50:22.559 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 116/171 2024-01-25T14:50:22.585 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 116/171 2024-01-25T14:50:22.585 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:22.585 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-25T14:50:22.585 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-25T14:50:22.585 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-25T14:50:22.586 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-01-25T14:50:22.794 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 117/171 2024-01-25T14:50:22.817 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 117/171 2024-01-25T14:50:22.818 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:22.818 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-25T14:50:22.818 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-25T14:50:22.818 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-25T14:50:22.818 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-01-25T14:50:23.045 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 112/171 2024-01-25T14:50:23.075 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 112/171 2024-01-25T14:50:23.271 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 118/171 2024-01-25T14:50:23.294 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 118/171 2024-01-25T14:50:23.295 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:23.295 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-25T14:50:23.295 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-25T14:50:23.295 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-25T14:50:23.295 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-01-25T14:50:23.390 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2024-01-25T14:50:23.590 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 112/171 2024-01-25T14:50:23.628 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 113/171 2024-01-25T14:50:23.693 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 113/171 2024-01-25T14:50:23.693 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-25T14:50:23.693 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-25T14:50:23.693 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:50:23.721 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 114/171 2024-01-25T14:50:23.820 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-25T14:50:23.846 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-25T14:50:23.876 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 121/171 2024-01-25T14:50:23.930 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 122/171 2024-01-25T14:50:23.953 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-25T14:50:24.177 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-25T14:50:24.221 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-25T14:50:25.186 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-25T14:50:25.213 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-25T14:50:25.316 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-25T14:50:25.475 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 126/171 2024-01-25T14:50:25.498 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-25T14:50:25.522 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-25T14:50:25.522 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:25.522 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-25T14:50:25.522 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-25T14:50:25.522 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-25T14:50:25.522 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-01-25T14:50:25.566 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-25T14:50:25.577 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-25T14:50:25.621 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-2:19.0.0-885.g661946e7.el9.x86_64 129/171 2024-01-25T14:50:26.396 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2024-01-25T14:50:26.434 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 131/171 2024-01-25T14:50:26.457 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 131/171 2024-01-25T14:50:26.457 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:26.457 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-25T14:50:26.457 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-25T14:50:26.458 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-25T14:50:26.458 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-01-25T14:50:26.502 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-885.g661946 132/171 2024-01-25T14:50:26.524 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-885.g661946 132/171 2024-01-25T14:50:26.524 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:26.524 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-25T14:50:26.524 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-01-25T14:50:26.578 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-25T14:50:26.600 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-25T14:50:26.600 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:26.600 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-25T14:50:26.600 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-25T14:50:26.601 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-25T14:50:26.601 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-01-25T14:50:26.903 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 134/171 2024-01-25T14:50:26.926 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 134/171 2024-01-25T14:50:26.926 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:26.926 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-25T14:50:26.927 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-25T14:50:26.927 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-25T14:50:26.927 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-01-25T14:50:29.353 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 114/171 2024-01-25T14:50:29.353 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /sys 2024-01-25T14:50:29.353 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /proc 2024-01-25T14:50:29.353 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /mnt 2024-01-25T14:50:29.353 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /var/tmp 2024-01-25T14:50:29.353 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /home 2024-01-25T14:50:29.353 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /root 2024-01-25T14:50:29.354 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /tmp 2024-01-25T14:50:29.354 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:50:29.521 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 115/171 2024-01-25T14:50:29.536 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 115/171 2024-01-25T14:50:29.536 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:29.536 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-25T14:50:29.536 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:50:31.007 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 116/171 2024-01-25T14:50:31.032 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 116/171 2024-01-25T14:50:31.033 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:31.033 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-25T14:50:31.033 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-25T14:50:31.033 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-25T14:50:31.033 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:50:31.223 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 135/171 2024-01-25T14:50:31.250 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 117/171 2024-01-25T14:50:31.264 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 136/171 2024-01-25T14:50:31.272 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 117/171 2024-01-25T14:50:31.272 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:31.272 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-25T14:50:31.272 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-25T14:50:31.273 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-25T14:50:31.273 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:50:31.306 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 137/171 2024-01-25T14:50:31.338 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2024-01-25T14:50:31.356 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2024-01-25T14:50:31.540 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 140/171 2024-01-25T14:50:31.648 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2024-01-25T14:50:31.679 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 142/171 2024-01-25T14:50:31.711 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 143/171 2024-01-25T14:50:31.717 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 118/171 2024-01-25T14:50:31.739 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 118/171 2024-01-25T14:50:31.739 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:31.739 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-25T14:50:31.739 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-25T14:50:31.739 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-25T14:50:31.739 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:50:31.743 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2024-01-25T14:50:31.773 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 145/171 2024-01-25T14:50:31.828 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 146/171 2024-01-25T14:50:31.835 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2024-01-25T14:50:31.870 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2024-01-25T14:50:31.905 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2024-01-25T14:50:32.214 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-25T14:50:32.242 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-25T14:50:32.272 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 121/171 2024-01-25T14:50:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 122/171 2024-01-25T14:50:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-25T14:50:32.436 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-25T14:50:32.471 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-25T14:50:32.498 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-25T14:50:32.560 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2024-01-25T14:50:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-25T14:50:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-25T14:50:33.423 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 151/171 2024-01-25T14:50:33.492 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2024-01-25T14:50:33.533 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2024-01-25T14:50:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-25T14:50:33.608 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-25T14:50:33.614 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2024-01-25T14:50:33.646 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2024-01-25T14:50:33.671 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2024-01-25T14:50:33.705 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-25T14:50:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-25T14:50:33.731 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2024-01-25T14:50:33.731 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-25T14:50:33.841 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-25T14:50:33.869 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2024-01-25T14:50:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 126/171 2024-01-25T14:50:33.899 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2024-01-25T14:50:33.902 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-25T14:50:33.925 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2024-01-25T14:50:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-25T14:50:33.925 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:33.925 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-25T14:50:33.925 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-25T14:50:33.925 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-25T14:50:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:50:33.950 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2024-01-25T14:50:33.950 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-25T14:50:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-25T14:50:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-25T14:50:34.018 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-25T14:50:34.029 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-2:19.0.0-885.g661946e7.el9.x86_64 129/171 2024-01-25T14:50:34.042 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2024-01-25T14:50:34.049 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-25T14:50:34.049 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-25T14:50:34.229 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-25T14:50:34.229 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-25T14:50:34.321 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-25T14:50:34.345 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2024-01-25T14:50:34.372 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2024-01-25T14:50:34.405 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2024-01-25T14:50:34.469 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-25T14:50:34.804 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2024-01-25T14:50:34.830 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 131/171 2024-01-25T14:50:34.853 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 131/171 2024-01-25T14:50:34.853 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:34.854 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-25T14:50:34.854 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-25T14:50:34.854 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-25T14:50:34.854 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:50:34.897 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-885.g661946 132/171 2024-01-25T14:50:34.919 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-885.g661946 132/171 2024-01-25T14:50:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-25T14:50:34.920 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:50:34.973 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-25T14:50:34.995 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-25T14:50:34.995 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:34.995 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-25T14:50:34.995 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-25T14:50:34.995 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-25T14:50:34.996 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:50:35.225 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 114/171 2024-01-25T14:50:35.225 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /sys 2024-01-25T14:50:35.225 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /proc 2024-01-25T14:50:35.225 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /mnt 2024-01-25T14:50:35.225 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /var/tmp 2024-01-25T14:50:35.225 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /home 2024-01-25T14:50:35.225 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /root 2024-01-25T14:50:35.225 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /tmp 2024-01-25T14:50:35.225 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:50:35.307 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 134/171 2024-01-25T14:50:35.329 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 134/171 2024-01-25T14:50:35.329 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:35.329 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-25T14:50:35.330 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-25T14:50:35.330 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-25T14:50:35.330 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:50:35.392 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 115/171 2024-01-25T14:50:35.408 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 115/171 2024-01-25T14:50:35.408 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:35.408 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-25T14:50:35.408 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:50:36.845 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 116/171 2024-01-25T14:50:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 116/171 2024-01-25T14:50:36.871 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:36.871 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-25T14:50:36.871 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-25T14:50:36.871 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-25T14:50:36.871 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:50:37.079 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 117/171 2024-01-25T14:50:37.101 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 117/171 2024-01-25T14:50:37.102 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:37.102 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-25T14:50:37.102 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-25T14:50:37.102 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-25T14:50:37.102 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:50:37.546 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 118/171 2024-01-25T14:50:37.569 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 118/171 2024-01-25T14:50:37.569 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:37.569 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-25T14:50:37.569 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-25T14:50:37.569 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-25T14:50:37.570 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:50:37.656 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2024-01-25T14:50:37.985 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-25T14:50:38.013 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephadm-2:19.0.0-885.g661946e7.el9.noarch 120/171 2024-01-25T14:50:38.042 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 121/171 2024-01-25T14:50:38.103 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 122/171 2024-01-25T14:50:38.128 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-25T14:50:38.351 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 123/171 2024-01-25T14:50:38.378 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-25T14:50:39.282 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-25T14:50:39.282 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-2:19.0.0-885.g661946e7.el9.x86_64 1/171 2024-01-25T14:50:39.282 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2/171 2024-01-25T14:50:39.282 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 3/171 2024-01-25T14:50:39.282 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 4/171 2024-01-25T14:50:39.282 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-885.g661946 5/171 2024-01-25T14:50:39.282 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 6/171 2024-01-25T14:50:39.282 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 7/171 2024-01-25T14:50:39.283 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-25T14:50:39.283 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-25T14:50:39.283 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-25T14:50:39.283 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 11/171 2024-01-25T14:50:39.283 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 12/171 2024-01-25T14:50:39.283 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 13/171 2024-01-25T14:50:39.283 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 14/171 2024-01-25T14:50:39.283 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 15/171 2024-01-25T14:50:39.283 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 16/171 2024-01-25T14:50:39.283 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 17/171 2024-01-25T14:50:39.283 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 18/171 2024-01-25T14:50:39.283 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 19/171 2024-01-25T14:50:39.283 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 20/171 2024-01-25T14:50:39.284 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 21/171 2024-01-25T14:50:39.284 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 22/171 2024-01-25T14:50:39.284 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 23/171 2024-01-25T14:50:39.284 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 24/171 2024-01-25T14:50:39.284 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 25/171 2024-01-25T14:50:39.284 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 26/171 2024-01-25T14:50:39.284 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 27/171 2024-01-25T14:50:39.284 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 28/171 2024-01-25T14:50:39.284 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 29/171 2024-01-25T14:50:39.298 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 30/171 2024-01-25T14:50:39.298 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 31/171 2024-01-25T14:50:39.298 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 32/171 2024-01-25T14:50:39.298 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 33/171 2024-01-25T14:50:39.298 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 34/171 2024-01-25T14:50:39.298 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 35/171 2024-01-25T14:50:39.298 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 36/171 2024-01-25T14:50:39.298 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 37/171 2024-01-25T14:50:39.298 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephadm-2:19.0.0-885.g661946e7.el9.noarch 38/171 2024-01-25T14:50:39.298 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 39/171 2024-01-25T14:50:39.298 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2024-01-25T14:50:39.298 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2024-01-25T14:50:39.299 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2024-01-25T14:50:39.299 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2024-01-25T14:50:39.299 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2024-01-25T14:50:39.299 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2024-01-25T14:50:39.299 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2024-01-25T14:50:39.299 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2024-01-25T14:50:39.299 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2024-01-25T14:50:39.299 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2024-01-25T14:50:39.299 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2024-01-25T14:50:39.299 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2024-01-25T14:50:39.299 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2024-01-25T14:50:39.299 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2024-01-25T14:50:39.299 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2024-01-25T14:50:39.299 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2024-01-25T14:50:39.300 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/171 2024-01-25T14:50:39.300 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/171 2024-01-25T14:50:39.300 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/171 2024-01-25T14:50:39.300 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/171 2024-01-25T14:50:39.300 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/171 2024-01-25T14:50:39.300 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/171 2024-01-25T14:50:39.300 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/171 2024-01-25T14:50:39.300 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/171 2024-01-25T14:50:39.300 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/171 2024-01-25T14:50:39.300 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/171 2024-01-25T14:50:39.300 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/171 2024-01-25T14:50:39.301 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/171 2024-01-25T14:50:39.301 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/171 2024-01-25T14:50:39.301 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/171 2024-01-25T14:50:39.301 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/171 2024-01-25T14:50:39.301 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/171 2024-01-25T14:50:39.301 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/171 2024-01-25T14:50:39.301 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/171 2024-01-25T14:50:39.301 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/171 2024-01-25T14:50:39.301 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/171 2024-01-25T14:50:39.301 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/171 2024-01-25T14:50:39.301 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/171 2024-01-25T14:50:39.301 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/171 2024-01-25T14:50:39.301 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/171 2024-01-25T14:50:39.301 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-25T14:50:39.302 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/171 2024-01-25T14:50:39.302 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/171 2024-01-25T14:50:39.302 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/171 2024-01-25T14:50:39.302 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/171 2024-01-25T14:50:39.302 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/171 2024-01-25T14:50:39.302 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/171 2024-01-25T14:50:39.302 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/171 2024-01-25T14:50:39.302 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : jq-1.6-16.el9.x86_64 88/171 2024-01-25T14:50:39.302 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/171 2024-01-25T14:50:39.302 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/171 2024-01-25T14:50:39.302 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 91/171 2024-01-25T14:50:39.302 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 92/171 2024-01-25T14:50:39.302 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 93/171 2024-01-25T14:50:39.302 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ply-3.11-14.el9.noarch 94/171 2024-01-25T14:50:39.303 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 95/171 2024-01-25T14:50:39.303 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 96/171 2024-01-25T14:50:39.303 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 97/171 2024-01-25T14:50:39.303 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 98/171 2024-01-25T14:50:39.303 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 99/171 2024-01-25T14:50:39.303 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 100/171 2024-01-25T14:50:39.303 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 101/171 2024-01-25T14:50:39.304 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 102/171 2024-01-25T14:50:39.304 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 103/171 2024-01-25T14:50:39.304 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 104/171 2024-01-25T14:50:39.304 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 105/171 2024-01-25T14:50:39.304 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 106/171 2024-01-25T14:50:39.304 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 107/171 2024-01-25T14:50:39.304 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 108/171 2024-01-25T14:50:39.304 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 109/171 2024-01-25T14:50:39.304 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 110/171 2024-01-25T14:50:39.304 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 111/171 2024-01-25T14:50:39.304 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 112/171 2024-01-25T14:50:39.304 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 113/171 2024-01-25T14:50:39.305 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 114/171 2024-01-25T14:50:39.305 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 115/171 2024-01-25T14:50:39.305 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 116/171 2024-01-25T14:50:39.305 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 117/171 2024-01-25T14:50:39.305 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 118/171 2024-01-25T14:50:39.305 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 119/171 2024-01-25T14:50:39.305 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 120/171 2024-01-25T14:50:39.305 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2024-01-25T14:50:39.305 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2024-01-25T14:50:39.305 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2024-01-25T14:50:39.305 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2024-01-25T14:50:39.305 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2024-01-25T14:50:39.305 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2024-01-25T14:50:39.305 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2024-01-25T14:50:39.306 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2024-01-25T14:50:39.306 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2024-01-25T14:50:39.306 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2024-01-25T14:50:39.306 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2024-01-25T14:50:39.306 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2024-01-25T14:50:39.306 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2024-01-25T14:50:39.306 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2024-01-25T14:50:39.306 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2024-01-25T14:50:39.306 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2024-01-25T14:50:39.306 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2024-01-25T14:50:39.306 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2024-01-25T14:50:39.306 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2024-01-25T14:50:39.306 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:19.0.0-885.g661946e7.el9.x86_64 140/171 2024-01-25T14:50:39.306 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2024-01-25T14:50:39.307 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 142/171 2024-01-25T14:50:39.307 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2024-01-25T14:50:39.307 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2024-01-25T14:50:39.307 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2024-01-25T14:50:39.307 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 146/171 2024-01-25T14:50:39.307 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2024-01-25T14:50:39.307 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 148/171 2024-01-25T14:50:39.307 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2024-01-25T14:50:39.307 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 150/171 2024-01-25T14:50:39.307 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2024-01-25T14:50:39.307 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 152/171 2024-01-25T14:50:39.307 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2024-01-25T14:50:39.307 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2024-01-25T14:50:39.307 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2024-01-25T14:50:39.308 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2024-01-25T14:50:39.308 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-25T14:50:39.308 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2024-01-25T14:50:39.308 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2024-01-25T14:50:39.308 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2024-01-25T14:50:39.308 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2024-01-25T14:50:39.308 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2024-01-25T14:50:39.308 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2024-01-25T14:50:39.308 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2024-01-25T14:50:39.308 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2024-01-25T14:50:39.308 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2024-01-25T14:50:39.308 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2024-01-25T14:50:39.308 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2024-01-25T14:50:39.308 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2024-01-25T14:50:39.309 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2024-01-25T14:50:39.341 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 124/171 2024-01-25T14:50:39.362 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-25T14:50:39.461 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 125/171 2024-01-25T14:50:39.625 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 126/171 2024-01-25T14:50:39.661 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 135/171 2024-01-25T14:50:39.689 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-25T14:50:39.713 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 127/171 2024-01-25T14:50:39.713 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:39.713 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-25T14:50:39.713 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-25T14:50:39.713 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-25T14:50:39.713 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:50:39.718 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 136/171 2024-01-25T14:50:39.756 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-25T14:50:39.760 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 137/171 2024-01-25T14:50:39.768 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 128/171 2024-01-25T14:50:39.791 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2024-01-25T14:50:39.813 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-2:19.0.0-885.g661946e7.el9.x86_64 129/171 2024-01-25T14:50:39.819 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2024-01-25T14:50:40.015 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 140/171 2024-01-25T14:50:40.135 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2024-01-25T14:50:40.166 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 142/171 2024-01-25T14:50:40.190 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 143/171 2024-01-25T14:50:40.239 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2024-01-25T14:50:40.269 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 145/171 2024-01-25T14:50:40.344 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 146/171 2024-01-25T14:50:40.409 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2024-01-25T14:50:40.443 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2024-01-25T14:50:40.594 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2024-01-25T14:50:40.625 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 131/171 2024-01-25T14:50:40.648 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 131/171 2024-01-25T14:50:40.648 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:40.648 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-25T14:50:40.648 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-25T14:50:40.648 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-25T14:50:40.649 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:50:40.692 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-885.g661946 132/171 2024-01-25T14:50:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-885.g661946 132/171 2024-01-25T14:50:40.715 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:40.715 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-25T14:50:40.715 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:50:40.762 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-25T14:50:40.784 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 133/171 2024-01-25T14:50:40.785 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:40.785 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-25T14:50:40.785 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-25T14:50:40.785 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-25T14:50:40.785 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:50:41.024 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-25T14:50:41.066 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-25T14:50:41.087 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 134/171 2024-01-25T14:50:41.105 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-25T14:50:41.110 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 134/171 2024-01-25T14:50:41.110 INFO:teuthology.orchestra.run.smithi191.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-25T14:50:41.110 INFO:teuthology.orchestra.run.smithi191.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-25T14:50:41.111 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-25T14:50:41.111 INFO:teuthology.orchestra.run.smithi191.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-25T14:50:41.111 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:50:41.180 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2024-01-25T14:50:41.954 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2024-01-25T14:50:41.954 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-01-25T14:50:41.954 INFO:teuthology.orchestra.run.smithi186.stdout:Upgraded: 2024-01-25T14:50:41.954 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-25T14:50:41.954 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-25T14:50:41.954 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-25T14:50:41.955 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-25T14:50:41.955 INFO:teuthology.orchestra.run.smithi186.stdout: acl-2.3.1-4.el9.x86_64 2024-01-25T14:50:41.955 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-25T14:50:41.955 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-25T14:50:41.955 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-25T14:50:41.955 INFO:teuthology.orchestra.run.smithi186.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-25T14:50:41.955 INFO:teuthology.orchestra.run.smithi186.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-25T14:50:41.955 INFO:teuthology.orchestra.run.smithi186.stdout: librados2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.955 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.955 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-25T14:50:41.955 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-25T14:50:41.955 INFO:teuthology.orchestra.run.smithi186.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-25T14:50:41.955 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-25T14:50:41.955 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-01-25T14:50:41.956 INFO:teuthology.orchestra.run.smithi186.stdout: automake-1.16.2-8.el9.noarch 2024-01-25T14:50:41.956 INFO:teuthology.orchestra.run.smithi186.stdout: bison-3.7.4-5.el9.x86_64 2024-01-25T14:50:41.956 INFO:teuthology.orchestra.run.smithi186.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-25T14:50:41.956 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.956 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.956 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.956 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.956 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:41.956 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.956 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.956 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.956 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:41.956 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:41.957 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:41.957 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:41.957 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:41.957 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.957 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.957 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:41.957 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.957 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.957 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.957 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:41.957 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:41.957 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.957 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.957 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:41.957 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-25T14:50:41.958 INFO:teuthology.orchestra.run.smithi186.stdout: flex-2.6.4-9.el9.x86_64 2024-01-25T14:50:41.958 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-25T14:50:41.958 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-25T14:50:41.958 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-25T14:50:41.958 INFO:teuthology.orchestra.run.smithi186.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-25T14:50:41.958 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-25T14:50:41.958 INFO:teuthology.orchestra.run.smithi186.stdout: jq-1.6-16.el9.x86_64 2024-01-25T14:50:41.958 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-25T14:50:41.958 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-25T14:50:41.958 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-25T14:50:41.958 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.958 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.958 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.958 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-25T14:50:41.958 INFO:teuthology.orchestra.run.smithi186.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-25T14:50:41.959 INFO:teuthology.orchestra.run.smithi186.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-25T14:50:41.959 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-25T14:50:41.959 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-25T14:50:41.959 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.959 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.959 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-25T14:50:41.959 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.959 INFO:teuthology.orchestra.run.smithi186.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-25T14:50:41.959 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-25T14:50:41.959 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-25T14:50:41.959 INFO:teuthology.orchestra.run.smithi186.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-25T14:50:41.959 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-25T14:50:41.959 INFO:teuthology.orchestra.run.smithi186.stdout: lua-5.4.4-4.el9.x86_64 2024-01-25T14:50:41.959 INFO:teuthology.orchestra.run.smithi186.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-25T14:50:41.960 INFO:teuthology.orchestra.run.smithi186.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-25T14:50:41.960 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-25T14:50:41.960 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-25T14:50:41.960 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-25T14:50:41.960 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-25T14:50:41.960 INFO:teuthology.orchestra.run.smithi186.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-25T14:50:41.960 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-13.11-1.el9.x86_64 2024-01-25T14:50:41.960 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-25T14:50:41.960 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-25T14:50:41.960 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-25T14:50:41.960 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-25T14:50:41.960 INFO:teuthology.orchestra.run.smithi186.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-25T14:50:41.960 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-25T14:50:41.960 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-25T14:50:41.961 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-25T14:50:41.961 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.961 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.961 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.961 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-25T14:50:41.961 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-25T14:50:41.961 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-25T14:50:41.961 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-25T14:50:41.961 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-25T14:50:41.962 INFO:teuthology.orchestra.run.smithi186.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-25T14:50:41.962 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-25T14:50:41.962 INFO:teuthology.orchestra.run.smithi186.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-25T14:50:41.962 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-25T14:50:41.962 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-25T14:50:41.962 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-25T14:50:41.962 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-25T14:50:41.962 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-25T14:50:41.962 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-25T14:50:41.962 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-25T14:50:41.962 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-25T14:50:41.962 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-25T14:50:41.962 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-25T14:50:41.962 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-25T14:50:41.963 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-25T14:50:41.963 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-25T14:50:41.963 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-25T14:50:41.963 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-25T14:50:41.963 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-25T14:50:41.963 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-25T14:50:41.963 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-25T14:50:41.963 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-25T14:50:41.963 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ply-3.11-14.el9.noarch 2024-01-25T14:50:41.963 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-25T14:50:41.963 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-25T14:50:41.963 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-25T14:50:41.963 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-25T14:50:41.963 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-25T14:50:41.963 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-25T14:50:41.964 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-25T14:50:41.964 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-25T14:50:41.964 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.964 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.964 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-25T14:50:41.964 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-25T14:50:41.964 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-25T14:50:41.964 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.964 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-25T14:50:41.964 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-25T14:50:41.964 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-25T14:50:41.964 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-25T14:50:41.965 INFO:teuthology.orchestra.run.smithi186.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-25T14:50:41.965 INFO:teuthology.orchestra.run.smithi186.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-25T14:50:41.965 INFO:teuthology.orchestra.run.smithi186.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-25T14:50:41.965 INFO:teuthology.orchestra.run.smithi186.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-25T14:50:41.965 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-25T14:50:41.965 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-25T14:50:41.965 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-25T14:50:41.965 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-25T14:50:41.965 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.965 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.965 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:41.965 INFO:teuthology.orchestra.run.smithi186.stdout: re2-1:20211101-3.el9.x86_64 2024-01-25T14:50:41.965 INFO:teuthology.orchestra.run.smithi186.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-25T14:50:41.965 INFO:teuthology.orchestra.run.smithi186.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-25T14:50:41.965 INFO:teuthology.orchestra.run.smithi186.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-25T14:50:41.966 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-25T14:50:41.966 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-25T14:50:41.966 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-25T14:50:41.966 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-01-25T14:50:41.966 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-01-25T14:50:42.000 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 151/171 2024-01-25T14:50:42.079 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2024-01-25T14:50:42.129 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2024-01-25T14:50:42.221 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2024-01-25T14:50:42.250 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2024-01-25T14:50:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2024-01-25T14:50:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-25T14:50:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2024-01-25T14:50:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-25T14:50:42.420 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-25T14:50:42.448 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2024-01-25T14:50:42.487 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2024-01-25T14:50:42.512 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2024-01-25T14:50:42.522 DEBUG:teuthology.parallel:result is None 2024-01-25T14:50:42.537 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2024-01-25T14:50:42.538 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-25T14:50:42.622 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-25T14:50:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2024-01-25T14:50:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-25T14:50:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-25T14:50:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-25T14:50:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-25T14:50:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-25T14:50:42.958 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2024-01-25T14:50:42.984 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2024-01-25T14:50:43.009 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2024-01-25T14:50:43.075 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-25T14:50:45.382 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 135/171 2024-01-25T14:50:45.423 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 136/171 2024-01-25T14:50:45.464 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 137/171 2024-01-25T14:50:45.496 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2024-01-25T14:50:45.524 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2024-01-25T14:50:45.702 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 140/171 2024-01-25T14:50:45.822 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2024-01-25T14:50:45.854 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 142/171 2024-01-25T14:50:45.886 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 143/171 2024-01-25T14:50:45.927 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2024-01-25T14:50:45.956 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 145/171 2024-01-25T14:50:46.014 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 146/171 2024-01-25T14:50:46.062 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2024-01-25T14:50:46.097 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2024-01-25T14:50:46.716 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-25T14:50:46.754 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-25T14:50:46.780 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-25T14:50:46.835 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2024-01-25T14:50:47.647 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 151/171 2024-01-25T14:50:47.716 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2024-01-25T14:50:47.748 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2024-01-25T14:50:47.828 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2024-01-25T14:50:47.878 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2024-01-25T14:50:47.903 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2024-01-25T14:50:47.928 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-25T14:50:47.955 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2024-01-25T14:50:47.955 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-25T14:50:48.039 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-25T14:50:48.067 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2024-01-25T14:50:48.097 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2024-01-25T14:50:48.131 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2024-01-25T14:50:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2024-01-25T14:50:48.157 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-25T14:50:48.165 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-25T14:50:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-2:19.0.0-885.g661946e7.el9.x86_64 1/171 2024-01-25T14:50:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2/171 2024-01-25T14:50:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 3/171 2024-01-25T14:50:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 4/171 2024-01-25T14:50:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-885.g661946 5/171 2024-01-25T14:50:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 6/171 2024-01-25T14:50:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 7/171 2024-01-25T14:50:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-25T14:50:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-25T14:50:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-25T14:50:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 11/171 2024-01-25T14:50:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 12/171 2024-01-25T14:50:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 13/171 2024-01-25T14:50:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 14/171 2024-01-25T14:50:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 15/171 2024-01-25T14:50:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 16/171 2024-01-25T14:50:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 17/171 2024-01-25T14:50:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 18/171 2024-01-25T14:50:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 19/171 2024-01-25T14:50:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 20/171 2024-01-25T14:50:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 21/171 2024-01-25T14:50:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 22/171 2024-01-25T14:50:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 23/171 2024-01-25T14:50:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 24/171 2024-01-25T14:50:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 25/171 2024-01-25T14:50:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 26/171 2024-01-25T14:50:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 27/171 2024-01-25T14:50:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 28/171 2024-01-25T14:50:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 29/171 2024-01-25T14:50:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 30/171 2024-01-25T14:50:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 31/171 2024-01-25T14:50:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 32/171 2024-01-25T14:50:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 33/171 2024-01-25T14:50:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 34/171 2024-01-25T14:50:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 35/171 2024-01-25T14:50:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 36/171 2024-01-25T14:50:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 37/171 2024-01-25T14:50:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephadm-2:19.0.0-885.g661946e7.el9.noarch 38/171 2024-01-25T14:50:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 39/171 2024-01-25T14:50:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2024-01-25T14:50:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2024-01-25T14:50:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2024-01-25T14:50:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2024-01-25T14:50:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2024-01-25T14:50:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2024-01-25T14:50:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2024-01-25T14:50:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2024-01-25T14:50:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2024-01-25T14:50:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2024-01-25T14:50:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2024-01-25T14:50:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2024-01-25T14:50:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2024-01-25T14:50:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2024-01-25T14:50:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2024-01-25T14:50:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2024-01-25T14:50:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/171 2024-01-25T14:50:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/171 2024-01-25T14:50:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/171 2024-01-25T14:50:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/171 2024-01-25T14:50:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/171 2024-01-25T14:50:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/171 2024-01-25T14:50:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/171 2024-01-25T14:50:48.184 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/171 2024-01-25T14:50:48.184 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/171 2024-01-25T14:50:48.184 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/171 2024-01-25T14:50:48.184 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/171 2024-01-25T14:50:48.184 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/171 2024-01-25T14:50:48.184 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/171 2024-01-25T14:50:48.184 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/171 2024-01-25T14:50:48.184 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/171 2024-01-25T14:50:48.184 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/171 2024-01-25T14:50:48.184 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/171 2024-01-25T14:50:48.184 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/171 2024-01-25T14:50:48.184 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/171 2024-01-25T14:50:48.184 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/171 2024-01-25T14:50:48.184 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/171 2024-01-25T14:50:48.185 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/171 2024-01-25T14:50:48.185 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/171 2024-01-25T14:50:48.185 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/171 2024-01-25T14:50:48.185 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-25T14:50:48.185 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/171 2024-01-25T14:50:48.185 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/171 2024-01-25T14:50:48.185 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/171 2024-01-25T14:50:48.185 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/171 2024-01-25T14:50:48.185 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/171 2024-01-25T14:50:48.185 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/171 2024-01-25T14:50:48.185 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/171 2024-01-25T14:50:48.185 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : jq-1.6-16.el9.x86_64 88/171 2024-01-25T14:50:48.185 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/171 2024-01-25T14:50:48.185 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/171 2024-01-25T14:50:48.186 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 91/171 2024-01-25T14:50:48.186 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 92/171 2024-01-25T14:50:48.186 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 93/171 2024-01-25T14:50:48.186 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ply-3.11-14.el9.noarch 94/171 2024-01-25T14:50:48.186 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 95/171 2024-01-25T14:50:48.186 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 96/171 2024-01-25T14:50:48.186 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 97/171 2024-01-25T14:50:48.186 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 98/171 2024-01-25T14:50:48.186 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 99/171 2024-01-25T14:50:48.186 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 100/171 2024-01-25T14:50:48.186 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 101/171 2024-01-25T14:50:48.186 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 102/171 2024-01-25T14:50:48.186 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 103/171 2024-01-25T14:50:48.186 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 104/171 2024-01-25T14:50:48.186 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 105/171 2024-01-25T14:50:48.187 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 106/171 2024-01-25T14:50:48.187 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 107/171 2024-01-25T14:50:48.187 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 108/171 2024-01-25T14:50:48.187 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 109/171 2024-01-25T14:50:48.187 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 110/171 2024-01-25T14:50:48.187 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 111/171 2024-01-25T14:50:48.187 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 112/171 2024-01-25T14:50:48.187 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 113/171 2024-01-25T14:50:48.187 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 114/171 2024-01-25T14:50:48.187 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 115/171 2024-01-25T14:50:48.187 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 116/171 2024-01-25T14:50:48.187 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 117/171 2024-01-25T14:50:48.187 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 118/171 2024-01-25T14:50:48.187 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 119/171 2024-01-25T14:50:48.188 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 120/171 2024-01-25T14:50:48.188 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2024-01-25T14:50:48.188 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2024-01-25T14:50:48.188 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2024-01-25T14:50:48.188 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2024-01-25T14:50:48.188 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2024-01-25T14:50:48.188 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2024-01-25T14:50:48.188 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2024-01-25T14:50:48.188 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2024-01-25T14:50:48.188 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2024-01-25T14:50:48.188 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2024-01-25T14:50:48.188 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2024-01-25T14:50:48.188 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2024-01-25T14:50:48.188 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2024-01-25T14:50:48.189 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2024-01-25T14:50:48.189 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2024-01-25T14:50:48.189 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2024-01-25T14:50:48.189 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2024-01-25T14:50:48.189 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2024-01-25T14:50:48.189 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2024-01-25T14:50:48.189 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:19.0.0-885.g661946e7.el9.x86_64 140/171 2024-01-25T14:50:48.189 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2024-01-25T14:50:48.189 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 142/171 2024-01-25T14:50:48.189 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2024-01-25T14:50:48.189 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2024-01-25T14:50:48.189 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2024-01-25T14:50:48.189 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 146/171 2024-01-25T14:50:48.189 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2024-01-25T14:50:48.190 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 148/171 2024-01-25T14:50:48.190 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2024-01-25T14:50:48.190 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 150/171 2024-01-25T14:50:48.190 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2024-01-25T14:50:48.190 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 152/171 2024-01-25T14:50:48.190 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2024-01-25T14:50:48.190 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2024-01-25T14:50:48.190 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2024-01-25T14:50:48.190 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2024-01-25T14:50:48.190 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-25T14:50:48.190 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2024-01-25T14:50:48.190 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2024-01-25T14:50:48.190 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2024-01-25T14:50:48.190 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2024-01-25T14:50:48.191 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2024-01-25T14:50:48.191 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2024-01-25T14:50:48.191 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2024-01-25T14:50:48.191 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2024-01-25T14:50:48.191 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2024-01-25T14:50:48.191 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2024-01-25T14:50:48.191 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2024-01-25T14:50:48.191 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2024-01-25T14:50:48.191 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2024-01-25T14:50:48.241 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-25T14:50:48.266 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2024-01-25T14:50:48.272 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-25T14:50:48.272 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-25T14:50:48.452 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-25T14:50:48.452 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-25T14:50:48.536 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-25T14:50:48.560 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2024-01-25T14:50:48.587 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2024-01-25T14:50:48.619 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2024-01-25T14:50:48.685 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-25T14:50:50.910 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2024-01-25T14:50:50.910 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:50:50.910 INFO:teuthology.orchestra.run.smithi170.stdout:Upgraded: 2024-01-25T14:50:50.910 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-25T14:50:50.910 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-25T14:50:50.910 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-25T14:50:50.910 INFO:teuthology.orchestra.run.smithi170.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-25T14:50:50.910 INFO:teuthology.orchestra.run.smithi170.stdout: acl-2.3.1-4.el9.x86_64 2024-01-25T14:50:50.910 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout: librados2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout: automake-1.16.2-8.el9.noarch 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout: bison-3.7.4-5.el9.x86_64 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.911 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.912 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.912 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.912 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:50.912 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.912 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.912 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.912 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:50.912 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:50.912 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:50.912 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:50.912 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:50.912 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.912 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.912 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:50.913 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.913 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.913 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.913 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:50.913 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:50.913 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.913 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.913 INFO:teuthology.orchestra.run.smithi170.stdout: cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:50.913 INFO:teuthology.orchestra.run.smithi170.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-25T14:50:50.913 INFO:teuthology.orchestra.run.smithi170.stdout: flex-2.6.4-9.el9.x86_64 2024-01-25T14:50:50.913 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-25T14:50:50.913 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-25T14:50:50.913 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-25T14:50:50.913 INFO:teuthology.orchestra.run.smithi170.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: jq-1.6-16.el9.x86_64 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.914 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-25T14:50:50.915 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.915 INFO:teuthology.orchestra.run.smithi170.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-25T14:50:50.915 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-25T14:50:50.915 INFO:teuthology.orchestra.run.smithi170.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-25T14:50:50.915 INFO:teuthology.orchestra.run.smithi170.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-25T14:50:50.915 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-25T14:50:50.915 INFO:teuthology.orchestra.run.smithi170.stdout: lua-5.4.4-4.el9.x86_64 2024-01-25T14:50:50.915 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-25T14:50:50.915 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-25T14:50:50.915 INFO:teuthology.orchestra.run.smithi170.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-25T14:50:50.915 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-25T14:50:50.915 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-25T14:50:50.915 INFO:teuthology.orchestra.run.smithi170.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-25T14:50:50.915 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-25T14:50:50.915 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-13.11-1.el9.x86_64 2024-01-25T14:50:50.916 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-25T14:50:50.916 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-25T14:50:50.916 INFO:teuthology.orchestra.run.smithi170.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-25T14:50:50.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-25T14:50:50.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-25T14:50:50.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-25T14:50:50.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-25T14:50:50.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-25T14:50:50.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-25T14:50:50.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-25T14:50:50.916 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-25T14:50:50.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-25T14:50:50.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-25T14:50:50.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-25T14:50:50.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-25T14:50:50.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-25T14:50:50.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-25T14:50:50.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-25T14:50:50.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-25T14:50:50.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-25T14:50:50.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-25T14:50:50.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-25T14:50:50.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-25T14:50:50.917 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-25T14:50:50.918 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-25T14:50:50.918 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-25T14:50:50.918 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-25T14:50:50.918 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-25T14:50:50.918 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-25T14:50:50.918 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-25T14:50:50.918 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-25T14:50:50.918 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-25T14:50:50.918 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-25T14:50:50.918 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-25T14:50:50.918 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-25T14:50:50.918 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply-3.11-14.el9.noarch 2024-01-25T14:50:50.918 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-25T14:50:50.918 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-25T14:50:50.918 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-25T14:50:50.919 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-25T14:50:50.919 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-25T14:50:50.919 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-25T14:50:50.919 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-25T14:50:50.919 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-25T14:50:50.919 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.919 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.919 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-25T14:50:50.919 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-25T14:50:50.919 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-25T14:50:50.919 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.919 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-25T14:50:50.919 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-25T14:50:50.919 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-25T14:50:50.919 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: re2-1:20211101-3.el9.x86_64 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-25T14:50:50.920 INFO:teuthology.orchestra.run.smithi170.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-25T14:50:50.921 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-25T14:50:50.921 INFO:teuthology.orchestra.run.smithi170.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-25T14:50:50.921 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:50:50.921 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-01-25T14:50:51.559 DEBUG:teuthology.parallel:result is None 2024-01-25T14:50:53.523 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-25T14:50:53.523 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-2:19.0.0-885.g661946e7.el9.x86_64 1/171 2024-01-25T14:50:53.523 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2/171 2024-01-25T14:50:53.523 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 3/171 2024-01-25T14:50:53.523 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 4/171 2024-01-25T14:50:53.524 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-885.g661946 5/171 2024-01-25T14:50:53.524 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 6/171 2024-01-25T14:50:53.524 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 7/171 2024-01-25T14:50:53.524 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 8/171 2024-01-25T14:50:53.524 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 9/171 2024-01-25T14:50:53.524 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 10/171 2024-01-25T14:50:53.524 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 11/171 2024-01-25T14:50:53.524 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 12/171 2024-01-25T14:50:53.524 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 13/171 2024-01-25T14:50:53.524 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 14/171 2024-01-25T14:50:53.524 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_6 15/171 2024-01-25T14:50:53.524 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 16/171 2024-01-25T14:50:53.524 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 17/171 2024-01-25T14:50:53.524 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 18/171 2024-01-25T14:50:53.525 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_ 19/171 2024-01-25T14:50:53.525 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librgw2-2:19.0.0-885.g661946e7.el9.x86_64 20/171 2024-01-25T14:50:53.525 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-argparse-2:19.0.0-885.g661946e7.el9 21/171 2024-01-25T14:50:53.525 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-common-2:19.0.0-885.g661946e7.el9.x 22/171 2024-01-25T14:50:53.525 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 23/171 2024-01-25T14:50:53.525 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 24/171 2024-01-25T14:50:53.525 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 25/171 2024-01-25T14:50:53.538 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 26/171 2024-01-25T14:50:53.538 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 27/171 2024-01-25T14:50:53.538 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 28/171 2024-01-25T14:50:53.538 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 29/171 2024-01-25T14:50:53.538 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-885.g661946e7.e 30/171 2024-01-25T14:50:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noar 31/171 2024-01-25T14:50:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.no 32/171 2024-01-25T14:50:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-885.g6619 33/171 2024-01-25T14:50:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9 34/171 2024-01-25T14:50:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 35/171 2024-01-25T14:50:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el 36/171 2024-01-25T14:50:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 37/171 2024-01-25T14:50:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephadm-2:19.0.0-885.g661946e7.el9.noarch 38/171 2024-01-25T14:50:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 39/171 2024-01-25T14:50:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2024-01-25T14:50:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2024-01-25T14:50:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2024-01-25T14:50:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2024-01-25T14:50:53.539 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2024-01-25T14:50:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2024-01-25T14:50:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2024-01-25T14:50:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2024-01-25T14:50:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2024-01-25T14:50:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2024-01-25T14:50:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2024-01-25T14:50:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2024-01-25T14:50:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2024-01-25T14:50:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2024-01-25T14:50:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2024-01-25T14:50:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2024-01-25T14:50:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/171 2024-01-25T14:50:53.540 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/171 2024-01-25T14:50:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/171 2024-01-25T14:50:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/171 2024-01-25T14:50:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/171 2024-01-25T14:50:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/171 2024-01-25T14:50:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/171 2024-01-25T14:50:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/171 2024-01-25T14:50:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/171 2024-01-25T14:50:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/171 2024-01-25T14:50:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/171 2024-01-25T14:50:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/171 2024-01-25T14:50:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/171 2024-01-25T14:50:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/171 2024-01-25T14:50:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/171 2024-01-25T14:50:53.541 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/171 2024-01-25T14:50:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/171 2024-01-25T14:50:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/171 2024-01-25T14:50:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/171 2024-01-25T14:50:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/171 2024-01-25T14:50:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/171 2024-01-25T14:50:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/171 2024-01-25T14:50:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/171 2024-01-25T14:50:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/171 2024-01-25T14:50:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-25T14:50:53.542 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/171 2024-01-25T14:50:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/171 2024-01-25T14:50:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/171 2024-01-25T14:50:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/171 2024-01-25T14:50:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/171 2024-01-25T14:50:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/171 2024-01-25T14:50:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/171 2024-01-25T14:50:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : jq-1.6-16.el9.x86_64 88/171 2024-01-25T14:50:53.543 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/171 2024-01-25T14:50:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/171 2024-01-25T14:50:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 91/171 2024-01-25T14:50:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 92/171 2024-01-25T14:50:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 93/171 2024-01-25T14:50:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ply-3.11-14.el9.noarch 94/171 2024-01-25T14:50:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 95/171 2024-01-25T14:50:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 96/171 2024-01-25T14:50:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 97/171 2024-01-25T14:50:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 98/171 2024-01-25T14:50:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 99/171 2024-01-25T14:50:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 100/171 2024-01-25T14:50:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 101/171 2024-01-25T14:50:53.544 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 102/171 2024-01-25T14:50:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 103/171 2024-01-25T14:50:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 104/171 2024-01-25T14:50:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 105/171 2024-01-25T14:50:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 106/171 2024-01-25T14:50:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 107/171 2024-01-25T14:50:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 108/171 2024-01-25T14:50:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 109/171 2024-01-25T14:50:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 110/171 2024-01-25T14:50:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 111/171 2024-01-25T14:50:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 112/171 2024-01-25T14:50:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 113/171 2024-01-25T14:50:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 114/171 2024-01-25T14:50:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-google-auth-1:2.26.2-1.el9.noarch 115/171 2024-01-25T14:50:53.545 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 116/171 2024-01-25T14:50:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 117/171 2024-01-25T14:50:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 118/171 2024-01-25T14:50:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 119/171 2024-01-25T14:50:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 120/171 2024-01-25T14:50:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2024-01-25T14:50:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2024-01-25T14:50:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2024-01-25T14:50:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2024-01-25T14:50:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2024-01-25T14:50:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2024-01-25T14:50:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2024-01-25T14:50:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2024-01-25T14:50:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2024-01-25T14:50:53.546 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2024-01-25T14:50:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2024-01-25T14:50:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2024-01-25T14:50:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2024-01-25T14:50:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2024-01-25T14:50:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2024-01-25T14:50:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2024-01-25T14:50:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2024-01-25T14:50:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2024-01-25T14:50:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2024-01-25T14:50:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:19.0.0-885.g661946e7.el9.x86_64 140/171 2024-01-25T14:50:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2024-01-25T14:50:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:19.0.0-885.g661946e7.el9.x86_64 142/171 2024-01-25T14:50:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2024-01-25T14:50:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2024-01-25T14:50:53.547 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2024-01-25T14:50:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 146/171 2024-01-25T14:50:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2024-01-25T14:50:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 148/171 2024-01-25T14:50:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2024-01-25T14:50:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 150/171 2024-01-25T14:50:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2024-01-25T14:50:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 152/171 2024-01-25T14:50:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2024-01-25T14:50:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2024-01-25T14:50:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2024-01-25T14:50:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2024-01-25T14:50:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-25T14:50:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2024-01-25T14:50:53.548 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2024-01-25T14:50:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2024-01-25T14:50:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2024-01-25T14:50:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2024-01-25T14:50:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2024-01-25T14:50:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2024-01-25T14:50:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2024-01-25T14:50:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2024-01-25T14:50:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2024-01-25T14:50:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2024-01-25T14:50:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2024-01-25T14:50:53.549 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2024-01-25T14:50:56.143 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2024-01-25T14:50:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:50:56.144 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2024-01-25T14:50:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-25T14:50:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-25T14:50:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-25T14:50:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-25T14:50:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: acl-2.3.1-4.el9.x86_64 2024-01-25T14:50:56.144 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-25T14:50:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-25T14:50:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-25T14:50:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-25T14:50:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-25T14:50:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: librados2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-25T14:50:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-25T14:50:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-25T14:50:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-25T14:50:56.145 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2024-01-25T14:50:56.145 INFO:teuthology.orchestra.run.smithi191.stdout: automake-1.16.2-8.el9.noarch 2024-01-25T14:50:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: bison-3.7.4-5.el9.x86_64 2024-01-25T14:50:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-25T14:50:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.146 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.147 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-shell-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: cephfs-top-2:19.0.0-885.g661946e7.el9.noarch 2024-01-25T14:50:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-25T14:50:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: flex-2.6.4-9.el9.x86_64 2024-01-25T14:50:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-25T14:50:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-25T14:50:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-25T14:50:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-25T14:50:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-25T14:50:56.148 INFO:teuthology.orchestra.run.smithi191.stdout: jq-1.6-16.el9.x86_64 2024-01-25T14:50:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-25T14:50:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-25T14:50:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-25T14:50:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-25T14:50:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-25T14:50:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-25T14:50:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-25T14:50:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-25T14:50:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.149 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-25T14:50:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-25T14:50:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-25T14:50:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-25T14:50:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-25T14:50:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-25T14:50:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: lua-5.4.4-4.el9.x86_64 2024-01-25T14:50:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-25T14:50:56.150 INFO:teuthology.orchestra.run.smithi191.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-25T14:50:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-25T14:50:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-25T14:50:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-25T14:50:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-25T14:50:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-25T14:50:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-13.11-1.el9.x86_64 2024-01-25T14:50:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-25T14:50:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-25T14:50:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-25T14:50:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-25T14:50:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-25T14:50:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-25T14:50:56.151 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-25T14:50:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-25T14:50:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-25T14:50:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-25T14:50:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-25T14:50:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-25T14:50:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-25T14:50:56.152 INFO:teuthology.orchestra.run.smithi191.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-25T14:50:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-25T14:50:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-25T14:50:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth-1:2.26.2-1.el9.noarch 2024-01-25T14:50:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-25T14:50:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-25T14:50:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-25T14:50:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-25T14:50:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-25T14:50:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-25T14:50:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-25T14:50:56.153 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-25T14:50:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-25T14:50:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-25T14:50:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-25T14:50:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-25T14:50:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-25T14:50:56.154 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-25T14:50:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-25T14:50:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-25T14:50:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-25T14:50:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-25T14:50:56.155 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ply-3.11-14.el9.noarch 2024-01-25T14:50:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-25T14:50:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-25T14:50:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-25T14:50:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-25T14:50:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-25T14:50:56.156 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-25T14:50:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-25T14:50:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-25T14:50:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-25T14:50:56.157 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-25T14:50:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-25T14:50:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-25T14:50:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-25T14:50:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-25T14:50:56.158 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-25T14:50:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-25T14:50:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-25T14:50:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-25T14:50:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-25T14:50:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-25T14:50:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-25T14:50:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-25T14:50:56.159 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-25T14:50:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd-2:19.0.0-885.g661946e7.el9.x86_64 2024-01-25T14:50:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: re2-1:20211101-3.el9.x86_64 2024-01-25T14:50:56.160 INFO:teuthology.orchestra.run.smithi191.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-25T14:50:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-25T14:50:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-25T14:50:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-25T14:50:56.161 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-25T14:50:56.162 INFO:teuthology.orchestra.run.smithi191.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-25T14:50:56.162 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:50:56.162 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2024-01-25T14:50:56.705 DEBUG:teuthology.parallel:result is None 2024-01-25T14:50:56.705 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-25T14:50:56.933 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-25T14:50:56.959 INFO:teuthology.orchestra.run.smithi170.stdout:19.0.0-885.g661946e7.el9 2024-01-25T14:50:56.959 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-885.g661946e7.el9 2024-01-25T14:50:56.959 INFO:teuthology.task.install:The correct ceph version 19.0.0-885.g661946e7 is installed. 2024-01-25T14:50:56.961 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-25T14:50:57.102 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-25T14:50:57.128 INFO:teuthology.orchestra.run.smithi186.stdout:19.0.0-885.g661946e7.el9 2024-01-25T14:50:57.128 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-885.g661946e7.el9 2024-01-25T14:50:57.128 INFO:teuthology.task.install:The correct ceph version 19.0.0-885.g661946e7 is installed. 2024-01-25T14:50:57.130 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-25T14:50:57.346 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-25T14:50:57.371 INFO:teuthology.orchestra.run.smithi191.stdout:19.0.0-885.g661946e7.el9 2024-01-25T14:50:57.372 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-885.g661946e7.el9 2024-01-25T14:50:57.372 INFO:teuthology.task.install:The correct ceph version 19.0.0-885.g661946e7 is installed. 2024-01-25T14:50:57.374 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-25T14:50:57.374 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T14:50:57.374 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-25T14:50:57.409 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-01-25T14:50:57.410 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-25T14:50:57.444 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-01-25T14:50:57.444 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-25T14:50:57.478 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-25T14:50:57.478 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T14:50:57.479 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2024-01-25T14:50:57.509 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-25T14:50:57.577 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-01-25T14:50:57.577 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/daemon-helper 2024-01-25T14:50:57.609 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-25T14:50:57.681 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-01-25T14:50:57.681 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2024-01-25T14:50:57.712 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-25T14:50:57.782 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-25T14:50:57.783 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T14:50:57.783 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-25T14:50:57.813 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-25T14:50:57.881 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-01-25T14:50:57.882 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-25T14:50:57.911 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-25T14:50:57.979 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-01-25T14:50:57.979 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-25T14:50:58.010 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-25T14:50:58.080 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-25T14:50:58.080 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T14:50:58.080 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2024-01-25T14:50:58.108 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-25T14:50:58.176 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-01-25T14:50:58.176 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/stdin-killer 2024-01-25T14:50:58.204 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-25T14:50:58.271 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-01-25T14:50:58.272 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/stdin-killer 2024-01-25T14:50:58.302 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-25T14:50:58.371 INFO:teuthology.run_tasks:Running task cephadm... 2024-01-25T14:50:58.471 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'subvols': {'create': 2}} 2024-01-25T14:50:58.472 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 2024-01-25T14:50:58.472 INFO:tasks.cephadm:Cluster fsid is 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:50:58.472 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-01-25T14:50:58.473 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.170', 'mon.b': '172.21.15.186', 'mon.c': '172.21.15.191'} 2024-01-25T14:50:58.473 INFO:tasks.cephadm:First mon is mon.a on smithi170 2024-01-25T14:50:58.473 INFO:tasks.cephadm:First mgr is x 2024-01-25T14:50:58.473 INFO:tasks.cephadm:Normalizing hostnames... 2024-01-25T14:50:58.473 DEBUG:teuthology.orchestra.run.smithi170:> sudo hostname $(hostname -s) 2024-01-25T14:50:58.501 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname $(hostname -s) 2024-01-25T14:50:58.528 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname $(hostname -s) 2024-01-25T14:50:58.559 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-01-25T14:50:58.559 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-25T14:50:58.697 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '661946e7044723130c03627323f6a879a9848cb5', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/76233/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-885-g661946e7', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-885.g661946e7'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-01-25 07:26:33.077331', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240125.044502', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-01-25T14:50:58.837 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-vshankar-testing-20240125.044502, sha1 661946e7044723130c03627323f6a879a9848cb5 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=661946e7044723130c03627323f6a879a9848cb5 2024-01-25T14:50:58.838 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/x86_64/flavors/default/cephadm 2024-01-25T14:50:58.839 DEBUG:teuthology.orchestra.run.smithi170:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-01-25T14:50:59.370 INFO:teuthology.orchestra.run.smithi170.stdout:-rw-r--r--. 1 ubuntu ubuntu 760779 Jan 25 14:50 /home/ubuntu/cephtest/cephadm 2024-01-25T14:50:59.371 DEBUG:teuthology.orchestra.run.smithi186:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-01-25T14:50:59.888 INFO:teuthology.orchestra.run.smithi186.stdout:-rw-r--r--. 1 ubuntu ubuntu 760779 Jan 25 14:50 /home/ubuntu/cephtest/cephadm 2024-01-25T14:50:59.889 DEBUG:teuthology.orchestra.run.smithi191:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240125.044502/661946e7044723130c03627323f6a879a9848cb5/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-01-25T14:51:00.398 INFO:teuthology.orchestra.run.smithi191.stdout:-rw-r--r--. 1 ubuntu ubuntu 760779 Jan 25 14:51 /home/ubuntu/cephtest/cephadm 2024-01-25T14:51:00.399 DEBUG:teuthology.orchestra.run.smithi170:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-01-25T14:51:00.417 DEBUG:teuthology.orchestra.run.smithi186:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-01-25T14:51:00.435 DEBUG:teuthology.orchestra.run.smithi191:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-01-25T14:51:00.468 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 on all hosts... 2024-01-25T14:51:00.469 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 pull 2024-01-25T14:51:00.471 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 pull 2024-01-25T14:51:00.477 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 pull 2024-01-25T14:51:01.367 INFO:teuthology.orchestra.run.smithi186.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5... 2024-01-25T14:51:01.374 INFO:teuthology.orchestra.run.smithi191.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5... 2024-01-25T14:51:01.390 INFO:teuthology.orchestra.run.smithi170.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5... 2024-01-25T14:51:30.626 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T14:51:30.627 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_version": "ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev)", 2024-01-25T14:51:30.627 INFO:teuthology.orchestra.run.smithi170.stdout: "image_id": "0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775", 2024-01-25T14:51:30.627 INFO:teuthology.orchestra.run.smithi170.stdout: "repo_digests": [ 2024-01-25T14:51:30.627 INFO:teuthology.orchestra.run.smithi170.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06" 2024-01-25T14:51:30.627 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-01-25T14:51:30.627 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T14:51:41.104 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-01-25T14:51:41.105 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_version": "ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev)", 2024-01-25T14:51:41.105 INFO:teuthology.orchestra.run.smithi191.stdout: "image_id": "0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775", 2024-01-25T14:51:41.105 INFO:teuthology.orchestra.run.smithi191.stdout: "repo_digests": [ 2024-01-25T14:51:41.105 INFO:teuthology.orchestra.run.smithi191.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06" 2024-01-25T14:51:41.105 INFO:teuthology.orchestra.run.smithi191.stdout: ] 2024-01-25T14:51:41.105 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-01-25T14:51:44.378 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-01-25T14:51:44.378 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_version": "ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev)", 2024-01-25T14:51:44.378 INFO:teuthology.orchestra.run.smithi186.stdout: "image_id": "0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775", 2024-01-25T14:51:44.378 INFO:teuthology.orchestra.run.smithi186.stdout: "repo_digests": [ 2024-01-25T14:51:44.378 INFO:teuthology.orchestra.run.smithi186.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06" 2024-01-25T14:51:44.378 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-01-25T14:51:44.378 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-01-25T14:51:44.401 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph 2024-01-25T14:51:44.436 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /etc/ceph 2024-01-25T14:51:44.466 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph 2024-01-25T14:51:44.501 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /etc/ceph 2024-01-25T14:51:44.530 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 777 /etc/ceph 2024-01-25T14:51:44.557 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /etc/ceph 2024-01-25T14:51:44.585 INFO:tasks.cephadm:Writing seed config... 2024-01-25T14:51:44.586 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-01-25T14:51:44.586 INFO:tasks.cephadm: override: [client] debug client = 20 2024-01-25T14:51:44.586 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-01-25T14:51:44.586 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-01-25T14:51:44.586 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-01-25T14:51:44.587 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-01-25T14:51:44.588 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-01-25T14:51:44.588 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-01-25T14:51:44.588 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-01-25T14:51:44.588 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-01-25T14:51:44.588 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-01-25T14:51:44.588 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-01-25T14:51:44.588 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-01-25T14:51:44.588 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-01-25T14:51:44.588 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-01-25T14:51:44.588 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-01-25T14:51:44.588 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-01-25T14:51:44.588 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-01-25T14:51:44.588 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-01-25T14:51:44.589 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-01-25T14:51:44.589 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-01-25T14:51:44.589 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-01-25T14:51:44.589 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-01-25T14:51:44.589 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-01-25T14:51:44.589 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-01-25T14:51:44.589 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-01-25T14:51:44.589 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-01-25T14:51:44.589 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-01-25T14:51:44.589 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-01-25T14:51:44.589 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-01-25T14:51:44.589 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-01-25T14:51:44.590 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T14:51:44.590 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-01-25T14:51:44.606 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 267213a8-bb91-11ee-95b2-87774f69a715 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-01-25T14:51:44.607 DEBUG:teuthology.orchestra.run.smithi170:mon.a> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mon.a.service 2024-01-25T14:51:44.649 DEBUG:teuthology.orchestra.run.smithi170:mgr.x> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mgr.x.service 2024-01-25T14:51:44.692 INFO:tasks.cephadm:Bootstrapping... 2024-01-25T14:51:44.693 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 -v bootstrap --fsid 267213a8-bb91-11ee-95b2-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.170 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-01-25T14:51:44.889 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-01-25T14:51:44.889 INFO:teuthology.orchestra.run.smithi170.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5', '-v', 'bootstrap', '--fsid', '267213a8-bb91-11ee-95b2-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.170', '--skip-admin-label'] 2024-01-25T14:51:44.916 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stdout 4.8.1 2024-01-25T14:51:44.916 INFO:teuthology.orchestra.run.smithi170.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-01-25T14:51:44.917 INFO:teuthology.orchestra.run.smithi170.stdout:Verifying podman|docker is present... 2024-01-25T14:51:44.940 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stdout 4.8.1 2024-01-25T14:51:44.941 INFO:teuthology.orchestra.run.smithi170.stdout:Verifying lvm2 is present... 2024-01-25T14:51:44.941 INFO:teuthology.orchestra.run.smithi170.stdout:Verifying time synchronization is in place... 2024-01-25T14:51:44.948 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-01-25T14:51:44.948 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-01-25T14:51:44.954 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-01-25T14:51:44.954 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout inactive 2024-01-25T14:51:44.963 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout enabled 2024-01-25T14:51:44.968 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout active 2024-01-25T14:51:44.968 INFO:teuthology.orchestra.run.smithi170.stdout:Unit chronyd.service is enabled and running 2024-01-25T14:51:44.968 INFO:teuthology.orchestra.run.smithi170.stdout:Repeating the final host check... 2024-01-25T14:51:44.993 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stdout 4.8.1 2024-01-25T14:51:44.993 INFO:teuthology.orchestra.run.smithi170.stdout:podman (/bin/podman) version 4.8.1 is present 2024-01-25T14:51:44.993 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl is present 2024-01-25T14:51:44.994 INFO:teuthology.orchestra.run.smithi170.stdout:lvcreate is present 2024-01-25T14:51:45.000 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-01-25T14:51:45.000 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-01-25T14:51:45.007 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-01-25T14:51:45.007 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout inactive 2024-01-25T14:51:45.014 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout enabled 2024-01-25T14:51:45.020 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout active 2024-01-25T14:51:45.021 INFO:teuthology.orchestra.run.smithi170.stdout:Unit chronyd.service is enabled and running 2024-01-25T14:51:45.021 INFO:teuthology.orchestra.run.smithi170.stdout:Host looks OK 2024-01-25T14:51:45.021 INFO:teuthology.orchestra.run.smithi170.stdout:Cluster fsid: 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:51:45.021 INFO:teuthology.orchestra.run.smithi170.stdout:Acquiring lock 139874222921952 on /run/cephadm/267213a8-bb91-11ee-95b2-87774f69a715.lock 2024-01-25T14:51:45.021 INFO:teuthology.orchestra.run.smithi170.stdout:Lock 139874222921952 acquired on /run/cephadm/267213a8-bb91-11ee-95b2-87774f69a715.lock 2024-01-25T14:51:45.021 INFO:teuthology.orchestra.run.smithi170.stdout:Verifying IP 172.21.15.170 port 3300 ... 2024-01-25T14:51:45.021 INFO:teuthology.orchestra.run.smithi170.stdout:Verifying IP 172.21.15.170 port 6789 ... 2024-01-25T14:51:45.021 INFO:teuthology.orchestra.run.smithi170.stdout:Base mon IP(s) is [172.21.15.170:3300, 172.21.15.170:6789], mon addrv is [v2:172.21.15.170:3300,v1:172.21.15.170:6789] 2024-01-25T14:51:45.025 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.170 metric 100 2024-01-25T14:51:45.025 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.170 metric 100 2024-01-25T14:51:45.027 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-01-25T14:51:45.027 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-01-25T14:51:45.027 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1798sec hoplimit 64 pref medium 2024-01-25T14:51:45.030 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-01-25T14:51:45.030 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-01-25T14:51:45.030 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-01-25T14:51:45.030 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-01-25T14:51:45.030 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7255/64 scope link 2024-01-25T14:51:45.030 INFO:teuthology.orchestra.run.smithi170.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-01-25T14:51:45.031 INFO:teuthology.orchestra.run.smithi170.stdout:Mon IP `172.21.15.170` is in CIDR network `172.21.0.0/20` 2024-01-25T14:51:45.031 INFO:teuthology.orchestra.run.smithi170.stdout:Mon IP `172.21.15.170` is in CIDR network `172.21.0.0/20` 2024-01-25T14:51:45.031 INFO:teuthology.orchestra.run.smithi170.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-01-25T14:51:45.031 INFO:teuthology.orchestra.run.smithi170.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-01-25T14:51:45.032 INFO:teuthology.orchestra.run.smithi170.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5... 2024-01-25T14:51:45.496 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stdout 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 2024-01-25T14:51:45.496 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5... 2024-01-25T14:51:45.496 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stderr Getting image source signatures 2024-01-25T14:51:45.496 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stderr Copying blob sha256:ea3366b8a90265ae3f6d3736cb0de4b52da4ffec919b46c6cb5bc5be1372efe8 2024-01-25T14:51:45.496 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stderr Copying blob sha256:7526f7e228dfc90a8cd9a697e920af939ccb44066789c4e5461c5efe2a22fe5d 2024-01-25T14:51:45.496 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stderr Copying config sha256:0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 2024-01-25T14:51:45.496 INFO:teuthology.orchestra.run.smithi170.stdout:/bin/podman: stderr Writing manifest to image destination 2024-01-25T14:51:46.391 INFO:teuthology.orchestra.run.smithi170.stdout:ceph: stdout ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev) 2024-01-25T14:51:46.392 INFO:teuthology.orchestra.run.smithi170.stdout:Ceph version: ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev) 2024-01-25T14:51:46.392 INFO:teuthology.orchestra.run.smithi170.stdout:Extracting ceph user uid/gid from container image... 2024-01-25T14:51:47.297 INFO:teuthology.orchestra.run.smithi170.stdout:stat: stdout 167 167 2024-01-25T14:51:47.297 INFO:teuthology.orchestra.run.smithi170.stdout:Creating initial keys... 2024-01-25T14:51:48.152 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph-authtool: stdout AQCDdbJlnWGiJRAAu4EZT9/RrBV3MxChsRfn5g== 2024-01-25T14:51:49.042 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph-authtool: stdout AQCEdbJlBBuUGhAA9xCqAalr5O6o1tMFjYgzlw== 2024-01-25T14:51:50.015 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph-authtool: stdout AQCFdbJljuHgFRAAXmwqSPaeDbpy7QJPz4ZEvQ== 2024-01-25T14:51:50.016 INFO:teuthology.orchestra.run.smithi170.stdout:Creating initial monmap... 2024-01-25T14:51:50.954 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-01-25T14:51:50.954 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-01-25T14:51:50.954 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:51:50.954 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-01-25T14:51:50.955 INFO:teuthology.orchestra.run.smithi170.stdout:monmaptool for a [v2:172.21.15.170:3300,v1:172.21.15.170:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-01-25T14:51:50.955 INFO:teuthology.orchestra.run.smithi170.stdout:setting min_mon_release = quincy 2024-01-25T14:51:50.955 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/monmaptool: set fsid to 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:51:50.955 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-01-25T14:51:50.955 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:51:50.955 INFO:teuthology.orchestra.run.smithi170.stdout:Creating mon... 2024-01-25T14:51:51.943 INFO:teuthology.orchestra.run.smithi170.stdout:create mon.a on 2024-01-25T14:51:52.151 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-01-25T14:51:52.292 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-01-25T14:51:52.457 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-267213a8-bb91-11ee-95b2-87774f69a715.target → /etc/systemd/system/ceph-267213a8-bb91-11ee-95b2-87774f69a715.target. 2024-01-25T14:51:52.457 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-267213a8-bb91-11ee-95b2-87774f69a715.target → /etc/systemd/system/ceph-267213a8-bb91-11ee-95b2-87774f69a715.target. 2024-01-25T14:51:52.705 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-267213a8-bb91-11ee-95b2-87774f69a715@mon.a 2024-01-25T14:51:52.705 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Failed to reset failed state of unit ceph-267213a8-bb91-11ee-95b2-87774f69a715@mon.a.service: Unit ceph-267213a8-bb91-11ee-95b2-87774f69a715@mon.a.service not loaded. 2024-01-25T14:51:52.869 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-267213a8-bb91-11ee-95b2-87774f69a715.target.wants/ceph-267213a8-bb91-11ee-95b2-87774f69a715@mon.a.service → /etc/systemd/system/ceph-267213a8-bb91-11ee-95b2-87774f69a715@.service. 2024-01-25T14:51:53.351 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-25T14:51:53.352 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout disabled 2024-01-25T14:51:53.358 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-25T14:51:53.358 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout inactive 2024-01-25T14:51:53.358 INFO:teuthology.orchestra.run.smithi170.stdout:firewalld.service is not enabled 2024-01-25T14:51:53.358 INFO:teuthology.orchestra.run.smithi170.stdout:Not possible to enable service . firewalld.service is not available 2024-01-25T14:51:53.359 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for mon to start... 2024-01-25T14:51:53.359 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for mon... 2024-01-25T14:51:54.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:51:54 smithi170 ceph-mon[31529]: from='client.? 172.21.15.170:0/1245696857' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-01-25T14:51:58.027 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout cluster: 2024-01-25T14:51:58.027 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout id: 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:51:58.027 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-01-25T14:51:58.027 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-01-25T14:51:58.028 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout services: 2024-01-25T14:51:58.028 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.502695s) 2024-01-25T14:51:58.028 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-01-25T14:51:58.028 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-01-25T14:51:58.028 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-01-25T14:51:58.028 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout data: 2024-01-25T14:51:58.028 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-01-25T14:51:58.028 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-01-25T14:51:58.028 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-01-25T14:51:58.028 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout pgs: 2024-01-25T14:51:58.028 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-01-25T14:51:58.028 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.760+0000 7f176826f700 1 Processor -- start 2024-01-25T14:51:58.028 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.761+0000 7f176826f700 1 -- start start 2024-01-25T14:51:58.029 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.761+0000 7f176826f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176007cd90 0x7f176007b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:51:58.029 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.761+0000 7f176826f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176007d1b0 con 0x7f176007cd90 2024-01-25T14:51:58.029 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.761+0000 7f176600b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176007cd90 0x7f176007b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:51:58.029 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.761+0000 7f176600b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176007cd90 0x7f176007b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53724/0 (socket says 172.21.15.170:53724) 2024-01-25T14:51:58.029 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.761+0000 7f176600b700 1 -- 172.21.15.170:0/798383163 learned_addr learned my addr 172.21.15.170:0/798383163 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:51:58.029 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.762+0000 7f176600b700 1 -- 172.21.15.170:0/798383163 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176007b840 con 0x7f176007cd90 2024-01-25T14:51:58.029 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.762+0000 7f176600b700 1 --2- 172.21.15.170:0/798383163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176007cd90 0x7f176007b300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1758009e80 tx=0x7f175800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f45af29b2fb909 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:51:58.029 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.762+0000 7f1765009700 1 -- 172.21.15.170:0/798383163 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f175800e070 con 0x7f176007cd90 2024-01-25T14:51:58.029 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.762+0000 7f1765009700 1 -- 172.21.15.170:0/798383163 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1758003a20 con 0x7f176007cd90 2024-01-25T14:51:58.029 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.762+0000 7f1765009700 1 -- 172.21.15.170:0/798383163 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1758003ce0 con 0x7f176007cd90 2024-01-25T14:51:58.029 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.762+0000 7f176826f700 1 -- 172.21.15.170:0/798383163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176007cd90 msgr2=0x7f176007b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:51:58.029 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.762+0000 7f176826f700 1 --2- 172.21.15.170:0/798383163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176007cd90 0x7f176007b300 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1758009e80 tx=0x7f175800b330 comp rx=0 tx=0).stop 2024-01-25T14:51:58.029 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.762+0000 7f176826f700 1 -- 172.21.15.170:0/798383163 shutdown_connections 2024-01-25T14:51:58.030 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.762+0000 7f176826f700 1 --2- 172.21.15.170:0/798383163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176007cd90 0x7f176007b300 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:51:58.030 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.762+0000 7f176826f700 1 -- 172.21.15.170:0/798383163 >> 172.21.15.170:0/798383163 conn(0x7f17601027b0 msgr2=0x7f1760104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:51:58.030 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.763+0000 7f176826f700 1 -- 172.21.15.170:0/798383163 shutdown_connections 2024-01-25T14:51:58.030 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.763+0000 7f176826f700 1 -- 172.21.15.170:0/798383163 wait complete. 2024-01-25T14:51:58.030 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.763+0000 7f176826f700 1 Processor -- start 2024-01-25T14:51:58.030 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.763+0000 7f176826f700 1 -- start start 2024-01-25T14:51:58.030 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.763+0000 7f176826f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176007cd90 0x7f176019c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:51:58.030 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.763+0000 7f176826f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176019cd00 con 0x7f176007cd90 2024-01-25T14:51:58.030 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.763+0000 7f176600b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176007cd90 0x7f176019c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:51:58.030 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.763+0000 7f176600b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176007cd90 0x7f176019c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53732/0 (socket says 172.21.15.170:53732) 2024-01-25T14:51:58.030 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.763+0000 7f176600b700 1 -- 172.21.15.170:0/1245696857 learned_addr learned my addr 172.21.15.170:0/1245696857 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:51:58.030 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.764+0000 7f176600b700 1 -- 172.21.15.170:0/1245696857 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1758009b30 con 0x7f176007cd90 2024-01-25T14:51:58.031 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.764+0000 7f176600b700 1 --2- 172.21.15.170:0/1245696857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176007cd90 0x7f176019c7c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f176007c3d0 tx=0x7f1758004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:51:58.031 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.764+0000 7f175f7fe700 1 -- 172.21.15.170:0/1245696857 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1758004370 con 0x7f176007cd90 2024-01-25T14:51:58.031 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.764+0000 7f175f7fe700 1 -- 172.21.15.170:0/1245696857 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1758004510 con 0x7f176007cd90 2024-01-25T14:51:58.031 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.764+0000 7f176826f700 1 -- 172.21.15.170:0/1245696857 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176019cf00 con 0x7f176007cd90 2024-01-25T14:51:58.031 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.764+0000 7f175f7fe700 1 -- 172.21.15.170:0/1245696857 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f17580047f0 con 0x7f176007cd90 2024-01-25T14:51:58.031 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.764+0000 7f176826f700 1 -- 172.21.15.170:0/1245696857 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176019d3a0 con 0x7f176007cd90 2024-01-25T14:51:58.031 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.764+0000 7f175f7fe700 1 -- 172.21.15.170:0/1245696857 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f17580127c0 con 0x7f176007cd90 2024-01-25T14:51:58.031 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.764+0000 7f175f7fe700 1 -- 172.21.15.170:0/1245696857 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f175801dbf0 con 0x7f176007cd90 2024-01-25T14:51:58.031 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.765+0000 7f176826f700 1 -- 172.21.15.170:0/1245696857 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1760196530 con 0x7f176007cd90 2024-01-25T14:51:58.031 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.767+0000 7f175f7fe700 1 -- 172.21.15.170:0/1245696857 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f175802b060 con 0x7f176007cd90 2024-01-25T14:51:58.031 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.835+0000 7f176826f700 1 -- 172.21.15.170:0/1245696857 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f176007bd60 con 0x7f176007cd90 2024-01-25T14:51:58.031 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.836+0000 7f175f7fe700 1 -- 172.21.15.170:0/1245696857 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f1758021030 con 0x7f176007cd90 2024-01-25T14:51:58.031 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.836+0000 7f176826f700 1 -- 172.21.15.170:0/1245696857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176007cd90 msgr2=0x7f176019c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:51:58.031 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.836+0000 7f176826f700 1 --2- 172.21.15.170:0/1245696857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176007cd90 0x7f176019c7c0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f176007c3d0 tx=0x7f1758004ad0 comp rx=0 tx=0).stop 2024-01-25T14:51:58.032 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.836+0000 7f176826f700 1 -- 172.21.15.170:0/1245696857 shutdown_connections 2024-01-25T14:51:58.032 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.836+0000 7f176826f700 1 --2- 172.21.15.170:0/1245696857 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f176007cd90 0x7f176019c7c0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:51:58.032 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.836+0000 7f176826f700 1 -- 172.21.15.170:0/1245696857 >> 172.21.15.170:0/1245696857 conn(0x7f17601027b0 msgr2=0x7f1760104b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:51:58.032 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.836+0000 7f176826f700 1 -- 172.21.15.170:0/1245696857 shutdown_connections 2024-01-25T14:51:58.032 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:51:53.836+0000 7f176826f700 1 -- 172.21.15.170:0/1245696857 wait complete. 2024-01-25T14:51:58.032 INFO:teuthology.orchestra.run.smithi170.stdout:mon is available 2024-01-25T14:51:58.032 INFO:teuthology.orchestra.run.smithi170.stdout:Assimilating anything we can from ceph.conf... 2024-01-25T14:52:01.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:01 smithi170 ceph-mon[31529]: from='client.? 172.21.15.170:0/3041223845' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-01-25T14:52:01.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:01 smithi170 ceph-mon[31529]: from='client.? 172.21.15.170:0/3041223845' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-01-25T14:52:05.297 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-01-25T14:52:05.297 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout [global] 2024-01-25T14:52:05.297 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout fsid = 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:52:05.298 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.170:3300,v1:172.21.15.170:6789] 2024-01-25T14:52:05.298 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-01-25T14:52:05.298 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-01-25T14:52:05.298 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-01-25T14:52:05.298 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-01-25T14:52:05.298 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-01-25T14:52:05.298 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout [mgr] 2024-01-25T14:52:05.298 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-01-25T14:52:05.298 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-01-25T14:52:05.298 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout [osd] 2024-01-25T14:52:05.298 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-01-25T14:52:05.298 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-01-25T14:52:05.299 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-01-25T14:52:05.299 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-01-25T14:52:05.299 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-01-25T14:52:05.299 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.521+0000 7fe60081f700 1 Processor -- start 2024-01-25T14:52:05.299 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.521+0000 7fe60081f700 1 -- start start 2024-01-25T14:52:05.299 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.521+0000 7fe60081f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc107bd0 0x7fe5fc109fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:05.299 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.521+0000 7fe60081f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc07adf0 con 0x7fe5fc107bd0 2024-01-25T14:52:05.299 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.522+0000 7fe5fa59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc107bd0 0x7fe5fc109fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:05.299 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.522+0000 7fe5fa59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc107bd0 0x7fe5fc109fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:40842/0 (socket says 172.21.15.170:40842) 2024-01-25T14:52:05.299 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.522+0000 7fe5fa59c700 1 -- 172.21.15.170:0/590448076 learned_addr learned my addr 172.21.15.170:0/590448076 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:05.299 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.522+0000 7fe5fa59c700 1 -- 172.21.15.170:0/590448076 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc07af30 con 0x7fe5fc107bd0 2024-01-25T14:52:05.299 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.522+0000 7fe5fa59c700 1 --2- 172.21.15.170:0/590448076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc107bd0 0x7fe5fc109fc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0098a0 tx=0x7fe5ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f75f4f11495c21 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:05.299 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.522+0000 7fe5f959a700 1 -- 172.21.15.170:0/590448076 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5ec004160 con 0x7fe5fc107bd0 2024-01-25T14:52:05.300 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.522+0000 7fe5f959a700 1 -- 172.21.15.170:0/590448076 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec0042c0 con 0x7fe5fc107bd0 2024-01-25T14:52:05.300 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.522+0000 7fe5f959a700 1 -- 172.21.15.170:0/590448076 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5ec0045a0 con 0x7fe5fc107bd0 2024-01-25T14:52:05.300 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.523+0000 7fe60081f700 1 -- 172.21.15.170:0/590448076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc107bd0 msgr2=0x7fe5fc109fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:05.300 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.523+0000 7fe60081f700 1 --2- 172.21.15.170:0/590448076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc107bd0 0x7fe5fc109fc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0098a0 tx=0x7fe5ec009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:05.300 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.523+0000 7fe60081f700 1 -- 172.21.15.170:0/590448076 shutdown_connections 2024-01-25T14:52:05.300 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.523+0000 7fe60081f700 1 --2- 172.21.15.170:0/590448076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc107bd0 0x7fe5fc109fc0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:05.300 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.523+0000 7fe60081f700 1 -- 172.21.15.170:0/590448076 >> 172.21.15.170:0/590448076 conn(0x7fe5fc101580 msgr2=0x7fe5fc1039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:05.300 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.523+0000 7fe60081f700 1 -- 172.21.15.170:0/590448076 shutdown_connections 2024-01-25T14:52:05.300 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.523+0000 7fe60081f700 1 -- 172.21.15.170:0/590448076 wait complete. 2024-01-25T14:52:05.300 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.524+0000 7fe60081f700 1 Processor -- start 2024-01-25T14:52:05.300 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.524+0000 7fe60081f700 1 -- start start 2024-01-25T14:52:05.300 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.524+0000 7fe60081f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc107bd0 0x7fe5fc107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:05.300 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.524+0000 7fe60081f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc107990 con 0x7fe5fc107bd0 2024-01-25T14:52:05.301 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.524+0000 7fe5fa59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc107bd0 0x7fe5fc107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:05.301 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.524+0000 7fe5fa59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc107bd0 0x7fe5fc107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:40844/0 (socket says 172.21.15.170:40844) 2024-01-25T14:52:05.301 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.524+0000 7fe5fa59c700 1 -- 172.21.15.170:0/3041223845 learned_addr learned my addr 172.21.15.170:0/3041223845 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:05.301 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.524+0000 7fe5fa59c700 1 -- 172.21.15.170:0/3041223845 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec009550 con 0x7fe5fc107bd0 2024-01-25T14:52:05.301 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.524+0000 7fe5fa59c700 1 --2- 172.21.15.170:0/3041223845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc107bd0 0x7fe5fc107450 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc07a230 tx=0x7fe5ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:05.301 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.525+0000 7fe5eb7fe700 1 -- 172.21.15.170:0/3041223845 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5ec011630 con 0x7fe5fc107bd0 2024-01-25T14:52:05.301 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.525+0000 7fe5eb7fe700 1 -- 172.21.15.170:0/3041223845 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec011790 con 0x7fe5fc107bd0 2024-01-25T14:52:05.301 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.525+0000 7fe60081f700 1 -- 172.21.15.170:0/3041223845 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc105b80 con 0x7fe5fc107bd0 2024-01-25T14:52:05.301 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.525+0000 7fe5eb7fe700 1 -- 172.21.15.170:0/3041223845 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5ec011a30 con 0x7fe5fc107bd0 2024-01-25T14:52:05.301 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.525+0000 7fe60081f700 1 -- 172.21.15.170:0/3041223845 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc106020 con 0x7fe5fc107bd0 2024-01-25T14:52:05.301 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.525+0000 7fe5eb7fe700 1 -- 172.21.15.170:0/3041223845 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe5ec022070 con 0x7fe5fc107bd0 2024-01-25T14:52:05.301 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.525+0000 7fe5eb7fe700 1 -- 172.21.15.170:0/3041223845 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe5ec01c450 con 0x7fe5fc107bd0 2024-01-25T14:52:05.301 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.526+0000 7fe60081f700 1 -- 172.21.15.170:0/3041223845 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc106a30 con 0x7fe5fc107bd0 2024-01-25T14:52:05.302 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.528+0000 7fe5eb7fe700 1 -- 172.21.15.170:0/3041223845 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7fe5ec011b90 con 0x7fe5fc107bd0 2024-01-25T14:52:05.302 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.595+0000 7fe60081f700 1 -- 172.21.15.170:0/3041223845 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fe5fc10a6e0 con 0x7fe5fc107bd0 2024-01-25T14:52:05.302 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.599+0000 7fe5eb7fe700 1 -- 172.21.15.170:0/3041223845 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7fe5ec011d30 con 0x7fe5fc107bd0 2024-01-25T14:52:05.302 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.600+0000 7fe5eb7fe700 1 -- 172.21.15.170:0/3041223845 <== mon.0 v2:172.21.15.170:3300/0 8 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe5ec036590 con 0x7fe5fc107bd0 2024-01-25T14:52:05.302 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.600+0000 7fe60081f700 1 -- 172.21.15.170:0/3041223845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc107bd0 msgr2=0x7fe5fc107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:05.302 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.600+0000 7fe60081f700 1 --2- 172.21.15.170:0/3041223845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc107bd0 0x7fe5fc107450 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc07a230 tx=0x7fe5ec004750 comp rx=0 tx=0).stop 2024-01-25T14:52:05.302 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.600+0000 7fe60081f700 1 -- 172.21.15.170:0/3041223845 shutdown_connections 2024-01-25T14:52:05.302 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.600+0000 7fe60081f700 1 --2- 172.21.15.170:0/3041223845 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5fc107bd0 0x7fe5fc107450 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:05.302 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.600+0000 7fe60081f700 1 -- 172.21.15.170:0/3041223845 >> 172.21.15.170:0/3041223845 conn(0x7fe5fc101580 msgr2=0x7fe5fc103880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:05.302 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.601+0000 7fe60081f700 1 -- 172.21.15.170:0/3041223845 shutdown_connections 2024-01-25T14:52:05.302 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:01.601+0000 7fe60081f700 1 -- 172.21.15.170:0/3041223845 wait complete. 2024-01-25T14:52:05.302 INFO:teuthology.orchestra.run.smithi170.stdout:Generating new minimal ceph.conf... 2024-01-25T14:52:06.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:05 smithi170 ceph-mon[31529]: from='client.? 172.21.15.170:0/3179913306' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:52:06.335 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.727+0000 7f0d9640c700 1 Processor -- start 2024-01-25T14:52:06.335 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.727+0000 7f0d9640c700 1 -- start start 2024-01-25T14:52:06.335 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.727+0000 7f0d9640c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d901070f0 0x7f0d90107510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:06.335 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.727+0000 7f0d9640c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d90107a50 con 0x7f0d901070f0 2024-01-25T14:52:06.335 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.727+0000 7f0d8ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d901070f0 0x7f0d90107510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:06.335 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.727+0000 7f0d8ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d901070f0 0x7f0d90107510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54934/0 (socket says 172.21.15.170:54934) 2024-01-25T14:52:06.335 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.727+0000 7f0d8ffff700 1 -- 172.21.15.170:0/18234275 learned_addr learned my addr 172.21.15.170:0/18234275 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:06.336 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.727+0000 7f0d8ffff700 1 -- 172.21.15.170:0/18234275 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d90107b90 con 0x7f0d901070f0 2024-01-25T14:52:06.336 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.728+0000 7f0d8ffff700 1 --2- 172.21.15.170:0/18234275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d901070f0 0x7f0d90107510 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0d800098a0 tx=0x7f0d80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1f040e2a0babc0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:06.336 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.728+0000 7f0d8effd700 1 -- 172.21.15.170:0/18234275 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d80004160 con 0x7f0d901070f0 2024-01-25T14:52:06.336 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.728+0000 7f0d8effd700 1 -- 172.21.15.170:0/18234275 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0d800042c0 con 0x7f0d901070f0 2024-01-25T14:52:06.336 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.728+0000 7f0d8effd700 1 -- 172.21.15.170:0/18234275 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d80011a00 con 0x7f0d901070f0 2024-01-25T14:52:06.336 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.728+0000 7f0d9640c700 1 -- 172.21.15.170:0/18234275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d901070f0 msgr2=0x7f0d90107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:06.336 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.728+0000 7f0d9640c700 1 --2- 172.21.15.170:0/18234275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d901070f0 0x7f0d90107510 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0d800098a0 tx=0x7f0d80009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:06.336 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.728+0000 7f0d9640c700 1 -- 172.21.15.170:0/18234275 shutdown_connections 2024-01-25T14:52:06.336 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.728+0000 7f0d9640c700 1 --2- 172.21.15.170:0/18234275 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d901070f0 0x7f0d90107510 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:06.336 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.728+0000 7f0d9640c700 1 -- 172.21.15.170:0/18234275 >> 172.21.15.170:0/18234275 conn(0x7f0d90102790 msgr2=0x7f0d90104bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:06.336 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.729+0000 7f0d9640c700 1 -- 172.21.15.170:0/18234275 shutdown_connections 2024-01-25T14:52:06.336 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.729+0000 7f0d9640c700 1 -- 172.21.15.170:0/18234275 wait complete. 2024-01-25T14:52:06.336 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.729+0000 7f0d9640c700 1 Processor -- start 2024-01-25T14:52:06.337 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.729+0000 7f0d9640c700 1 -- start start 2024-01-25T14:52:06.337 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.729+0000 7f0d9640c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d901070f0 0x7f0d9019ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:06.337 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.729+0000 7f0d9640c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9019b350 con 0x7f0d901070f0 2024-01-25T14:52:06.337 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.730+0000 7f0d8ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d901070f0 0x7f0d9019ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:06.337 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.730+0000 7f0d8ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d901070f0 0x7f0d9019ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54948/0 (socket says 172.21.15.170:54948) 2024-01-25T14:52:06.337 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.730+0000 7f0d8ffff700 1 -- 172.21.15.170:0/3179913306 learned_addr learned my addr 172.21.15.170:0/3179913306 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:06.337 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.730+0000 7f0d8ffff700 1 -- 172.21.15.170:0/3179913306 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d80009550 con 0x7f0d901070f0 2024-01-25T14:52:06.337 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.730+0000 7f0d8ffff700 1 --2- 172.21.15.170:0/3179913306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d901070f0 0x7f0d9019ae10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009fb0 tx=0x7f0d80011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:06.337 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.730+0000 7f0d8d7fa700 1 -- 172.21.15.170:0/3179913306 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d80003a40 con 0x7f0d901070f0 2024-01-25T14:52:06.337 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.730+0000 7f0d8d7fa700 1 -- 172.21.15.170:0/3179913306 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0d80003ba0 con 0x7f0d901070f0 2024-01-25T14:52:06.337 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.730+0000 7f0d9640c700 1 -- 172.21.15.170:0/3179913306 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9019b550 con 0x7f0d901070f0 2024-01-25T14:52:06.337 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.730+0000 7f0d8d7fa700 1 -- 172.21.15.170:0/3179913306 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d8001a750 con 0x7f0d901070f0 2024-01-25T14:52:06.337 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.730+0000 7f0d9640c700 1 -- 172.21.15.170:0/3179913306 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9019b9f0 con 0x7f0d901070f0 2024-01-25T14:52:06.337 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.730+0000 7f0d8d7fa700 1 -- 172.21.15.170:0/3179913306 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0d8002d3f0 con 0x7f0d901070f0 2024-01-25T14:52:06.338 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.730+0000 7f0d8d7fa700 1 -- 172.21.15.170:0/3179913306 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0d800195f0 con 0x7f0d901070f0 2024-01-25T14:52:06.338 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.731+0000 7f0d9640c700 1 -- 172.21.15.170:0/3179913306 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d90062e10 con 0x7f0d901070f0 2024-01-25T14:52:06.338 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.733+0000 7f0d8d7fa700 1 -- 172.21.15.170:0/3179913306 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f0d8001ad60 con 0x7f0d901070f0 2024-01-25T14:52:06.338 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.801+0000 7f0d9640c700 1 -- 172.21.15.170:0/3179913306 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f0d9019e520 con 0x7f0d901070f0 2024-01-25T14:52:06.338 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.801+0000 7f0d8d7fa700 1 -- 172.21.15.170:0/3179913306 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f0d80024b60 con 0x7f0d901070f0 2024-01-25T14:52:06.338 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.802+0000 7f0d9640c700 1 -- 172.21.15.170:0/3179913306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d901070f0 msgr2=0x7f0d9019ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:06.338 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.802+0000 7f0d9640c700 1 --2- 172.21.15.170:0/3179913306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d901070f0 0x7f0d9019ae10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009fb0 tx=0x7f0d80011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:06.338 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.802+0000 7f0d9640c700 1 -- 172.21.15.170:0/3179913306 shutdown_connections 2024-01-25T14:52:06.338 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.802+0000 7f0d9640c700 1 --2- 172.21.15.170:0/3179913306 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0d901070f0 0x7f0d9019ae10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:06.338 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.802+0000 7f0d9640c700 1 -- 172.21.15.170:0/3179913306 >> 172.21.15.170:0/3179913306 conn(0x7f0d90102790 msgr2=0x7f0d90103260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:06.338 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.802+0000 7f0d9640c700 1 -- 172.21.15.170:0/3179913306 shutdown_connections 2024-01-25T14:52:06.338 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:05.802+0000 7f0d9640c700 1 -- 172.21.15.170:0/3179913306 wait complete. 2024-01-25T14:52:06.338 INFO:teuthology.orchestra.run.smithi170.stdout:Restarting the monitor... 2024-01-25T14:52:06.590 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:06 smithi170 systemd[1]: Stopping Ceph mon.a for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T14:52:06.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:06 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a[31525]: 2024-01-25T14:52:06.588+0000 7fb5447e9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T14:52:06.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:06 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a[31525]: 2024-01-25T14:52:06.588+0000 7fb5447e9700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-01-25T14:52:06.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:06 smithi170 podman[31773]: 2024-01-25 14:52:06.732269537 +0000 UTC m=+0.238689087 container stop 80854690834cdb181ffb6bbe340fd386809b1ba7a19284589cd1205b8d811958 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T14:52:06.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:06 smithi170 podman[31773]: 2024-01-25 14:52:06.760097236 +0000 UTC m=+0.266516787 container died 80854690834cdb181ffb6bbe340fd386809b1ba7a19284589cd1205b8d811958 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=) 2024-01-25T14:52:07.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 podman[31773]: 2024-01-25 14:52:07.113716738 +0000 UTC m=+0.620136337 container cleanup 80854690834cdb181ffb6bbe340fd386809b1ba7a19284589cd1205b8d811958 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.31.3, GIT_BRANCH=HEAD) 2024-01-25T14:52:07.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 bash[31773]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a 2024-01-25T14:52:07.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 podman[31788]: 2024-01-25 14:52:07.272911706 +0000 UTC m=+0.531545628 container remove 80854690834cdb181ffb6bbe340fd386809b1ba7a19284589cd1205b8d811958 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, ceph=True) 2024-01-25T14:52:07.792 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 systemd[1]: ceph-267213a8-bb91-11ee-95b2-87774f69a715@mon.a.service: Deactivated successfully. 2024-01-25T14:52:07.792 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 systemd[1]: Stopped Ceph mon.a for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:52:07.792 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 systemd[1]: Starting Ceph mon.a for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T14:52:07.792 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 podman[31881]: 2024-01-25 14:52:07.690306854 +0000 UTC m=+0.106448916 container create a97f19dae568adbb1350344f267d9d7d47d72bb8b94335571e4f4ec6cae9eb90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T14:52:07.792 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 podman[31881]: 2024-01-25 14:52:07.601391113 +0000 UTC m=+0.017533184 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 2024-01-25T14:52:07.972 INFO:teuthology.orchestra.run.smithi170.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-01-25T14:52:08.086 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 podman[31881]: 2024-01-25 14:52:07.884724077 +0000 UTC m=+0.300866148 container init a97f19dae568adbb1350344f267d9d7d47d72bb8b94335571e4f4ec6cae9eb90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-01-25T14:52:08.086 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 podman[31881]: 2024-01-25 14:52:07.887721984 +0000 UTC m=+0.303864049 container start a97f19dae568adbb1350344f267d9d7d47d72bb8b94335571e4f4ec6cae9eb90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD) 2024-01-25T14:52:08.086 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: set uid:gid to 167:167 (ceph:ceph) 2024-01-25T14:52:08.086 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev), process ceph-mon, pid 2 2024-01-25T14:52:08.086 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: pidfile_write: ignore empty --pid-file 2024-01-25T14:52:08.086 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: load: jerasure load: lrc 2024-01-25T14:52:08.086 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: RocksDB version: 7.9.2 2024-01-25T14:52:08.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Git sha 0 2024-01-25T14:52:08.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Compile date 2024-01-25 05:03:27 2024-01-25T14:52:08.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: DB SUMMARY 2024-01-25T14:52:08.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: DB Session ID: DYWNKRH4PVWTV6E5YJ6D 2024-01-25T14:52:08.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: CURRENT file: CURRENT 2024-01-25T14:52:08.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: IDENTITY file: IDENTITY 2024-01-25T14:52:08.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-01-25T14:52:08.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-01-25T14:52:08.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 101196 ; 2024-01-25T14:52:08.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.error_if_exists: 0 2024-01-25T14:52:08.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.create_if_missing: 0 2024-01-25T14:52:08.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.paranoid_checks: 1 2024-01-25T14:52:08.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.flush_verify_memtable_count: 1 2024-01-25T14:52:08.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-01-25T14:52:08.087 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-01-25T14:52:08.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.env: 0x55f3b9c49ae0 2024-01-25T14:52:08.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.fs: PosixFileSystem 2024-01-25T14:52:08.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.info_log: 0x55f3bb04b780 2024-01-25T14:52:08.088 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_file_opening_threads: 16 2024-01-25T14:52:08.089 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.statistics: (nil) 2024-01-25T14:52:08.089 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.use_fsync: 0 2024-01-25T14:52:08.089 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_log_file_size: 0 2024-01-25T14:52:08.090 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-25T14:52:08.090 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.log_file_time_to_roll: 0 2024-01-25T14:52:08.090 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.keep_log_file_num: 1000 2024-01-25T14:52:08.090 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.recycle_log_file_num: 0 2024-01-25T14:52:08.090 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.allow_fallocate: 1 2024-01-25T14:52:08.090 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.allow_mmap_reads: 0 2024-01-25T14:52:08.090 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.allow_mmap_writes: 0 2024-01-25T14:52:08.090 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.use_direct_reads: 0 2024-01-25T14:52:08.090 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-25T14:52:08.090 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.create_missing_column_families: 0 2024-01-25T14:52:08.090 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.db_log_dir: 2024-01-25T14:52:08.090 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.wal_dir: 2024-01-25T14:52:08.090 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.table_cache_numshardbits: 6 2024-01-25T14:52:08.090 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.WAL_ttl_seconds: 0 2024-01-25T14:52:08.091 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.WAL_size_limit_MB: 0 2024-01-25T14:52:08.091 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-01-25T14:52:08.091 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-25T14:52:08.091 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.is_fd_close_on_exec: 1 2024-01-25T14:52:08.091 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.advise_random_on_open: 1 2024-01-25T14:52:08.091 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.db_write_buffer_size: 0 2024-01-25T14:52:08.091 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.write_buffer_manager: 0x55f3bb01f400 2024-01-25T14:52:08.091 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-25T14:52:08.091 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-25T14:52:08.091 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.use_adaptive_mutex: 0 2024-01-25T14:52:08.091 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.rate_limiter: (nil) 2024-01-25T14:52:08.091 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-25T14:52:08.092 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.wal_recovery_mode: 2 2024-01-25T14:52:08.092 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.enable_thread_tracking: 0 2024-01-25T14:52:08.092 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.enable_pipelined_write: 0 2024-01-25T14:52:08.092 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.unordered_write: 0 2024-01-25T14:52:08.092 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-25T14:52:08.092 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-25T14:52:08.092 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-25T14:52:08.092 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-25T14:52:08.092 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.row_cache: None 2024-01-25T14:52:08.092 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.wal_filter: None 2024-01-25T14:52:08.093 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-25T14:52:08.093 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.allow_ingest_behind: 0 2024-01-25T14:52:08.093 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.two_write_queues: 0 2024-01-25T14:52:08.093 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.manual_wal_flush: 0 2024-01-25T14:52:08.093 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.wal_compression: 0 2024-01-25T14:52:08.093 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.atomic_flush: 0 2024-01-25T14:52:08.093 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-25T14:52:08.093 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.persist_stats_to_disk: 0 2024-01-25T14:52:08.093 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.write_dbid_to_manifest: 0 2024-01-25T14:52:08.094 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.log_readahead_size: 0 2024-01-25T14:52:08.094 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-01-25T14:52:08.094 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.best_efforts_recovery: 0 2024-01-25T14:52:08.094 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-01-25T14:52:08.094 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-01-25T14:52:08.094 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.allow_data_in_errors: 0 2024-01-25T14:52:08.094 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.db_host_id: __hostname__ 2024-01-25T14:52:08.094 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.enforce_single_del_contracts: true 2024-01-25T14:52:08.094 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_background_jobs: 2 2024-01-25T14:52:08.094 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_background_compactions: -1 2024-01-25T14:52:08.094 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_subcompactions: 1 2024-01-25T14:52:08.094 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-25T14:52:08.094 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-25T14:52:08.095 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.delayed_write_rate : 16777216 2024-01-25T14:52:08.095 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_total_wal_size: 0 2024-01-25T14:52:08.095 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-25T14:52:08.095 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.stats_dump_period_sec: 600 2024-01-25T14:52:08.095 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.stats_persist_period_sec: 600 2024-01-25T14:52:08.095 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-25T14:52:08.095 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_open_files: -1 2024-01-25T14:52:08.095 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.bytes_per_sync: 0 2024-01-25T14:52:08.095 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.wal_bytes_per_sync: 0 2024-01-25T14:52:08.095 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.strict_bytes_per_sync: 0 2024-01-25T14:52:08.095 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compaction_readahead_size: 0 2024-01-25T14:52:08.095 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_background_flushes: -1 2024-01-25T14:52:08.095 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Compression algorithms supported: 2024-01-25T14:52:08.095 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-25T14:52:08.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: kZSTD supported: 0 2024-01-25T14:52:08.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: kXpressCompression supported: 0 2024-01-25T14:52:08.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: kLZ4HCCompression supported: 1 2024-01-25T14:52:08.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: kZlibCompression supported: 1 2024-01-25T14:52:08.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: kSnappyCompression supported: 1 2024-01-25T14:52:08.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: kLZ4Compression supported: 1 2024-01-25T14:52:08.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: kBZip2Compression supported: 0 2024-01-25T14:52:08.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Fast CRC32 supported: Supported on x86 2024-01-25T14:52:08.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: DMutex implementation: pthread_mutex_t 2024-01-25T14:52:08.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-01-25T14:52:08.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-01-25T14:52:08.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-25T14:52:08.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.merge_operator: 2024-01-25T14:52:08.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compaction_filter: None 2024-01-25T14:52:08.097 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compaction_filter_factory: None 2024-01-25T14:52:08.097 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.sst_partitioner_factory: None 2024-01-25T14:52:08.097 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.memtable_factory: SkipListFactory 2024-01-25T14:52:08.097 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.table_factory: BlockBasedTable 2024-01-25T14:52:08.097 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f3bb04b8a0) 2024-01-25T14:52:08.097 INFO:journalctl@ceph.mon.a.smithi170.stdout: cache_index_and_filter_blocks: 1 2024-01-25T14:52:08.097 INFO:journalctl@ceph.mon.a.smithi170.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-01-25T14:52:08.097 INFO:journalctl@ceph.mon.a.smithi170.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-25T14:52:08.097 INFO:journalctl@ceph.mon.a.smithi170.stdout: pin_top_level_index_and_filter: 1 2024-01-25T14:52:08.097 INFO:journalctl@ceph.mon.a.smithi170.stdout: index_type: 0 2024-01-25T14:52:08.097 INFO:journalctl@ceph.mon.a.smithi170.stdout: data_block_index_type: 0 2024-01-25T14:52:08.097 INFO:journalctl@ceph.mon.a.smithi170.stdout: index_shortening: 1 2024-01-25T14:52:08.097 INFO:journalctl@ceph.mon.a.smithi170.stdout: data_block_hash_table_util_ratio: 0.750000 2024-01-25T14:52:08.097 INFO:journalctl@ceph.mon.a.smithi170.stdout: checksum: 4 2024-01-25T14:52:08.098 INFO:journalctl@ceph.mon.a.smithi170.stdout: no_block_cache: 0 2024-01-25T14:52:08.098 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache: 0x55f3bb04f090 2024-01-25T14:52:08.098 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache_name: BinnedLRUCache 2024-01-25T14:52:08.098 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache_options: 2024-01-25T14:52:08.098 INFO:journalctl@ceph.mon.a.smithi170.stdout: capacity : 536870912 2024-01-25T14:52:08.098 INFO:journalctl@ceph.mon.a.smithi170.stdout: num_shard_bits : 4 2024-01-25T14:52:08.098 INFO:journalctl@ceph.mon.a.smithi170.stdout: strict_capacity_limit : 0 2024-01-25T14:52:08.098 INFO:journalctl@ceph.mon.a.smithi170.stdout: high_pri_pool_ratio: 0.000 2024-01-25T14:52:08.098 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_cache_compressed: (nil) 2024-01-25T14:52:08.098 INFO:journalctl@ceph.mon.a.smithi170.stdout: persistent_cache: (nil) 2024-01-25T14:52:08.098 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_size: 4096 2024-01-25T14:52:08.098 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_size_deviation: 10 2024-01-25T14:52:08.098 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_restart_interval: 16 2024-01-25T14:52:08.098 INFO:journalctl@ceph.mon.a.smithi170.stdout: index_block_restart_interval: 1 2024-01-25T14:52:08.098 INFO:journalctl@ceph.mon.a.smithi170.stdout: metadata_block_size: 4096 2024-01-25T14:52:08.099 INFO:journalctl@ceph.mon.a.smithi170.stdout: partition_filters: 0 2024-01-25T14:52:08.099 INFO:journalctl@ceph.mon.a.smithi170.stdout: use_delta_encoding: 1 2024-01-25T14:52:08.099 INFO:journalctl@ceph.mon.a.smithi170.stdout: filter_policy: bloomfilter 2024-01-25T14:52:08.099 INFO:journalctl@ceph.mon.a.smithi170.stdout: whole_key_filtering: 1 2024-01-25T14:52:08.099 INFO:journalctl@ceph.mon.a.smithi170.stdout: verify_compression: 0 2024-01-25T14:52:08.099 INFO:journalctl@ceph.mon.a.smithi170.stdout: read_amp_bytes_per_bit: 0 2024-01-25T14:52:08.099 INFO:journalctl@ceph.mon.a.smithi170.stdout: format_version: 5 2024-01-25T14:52:08.099 INFO:journalctl@ceph.mon.a.smithi170.stdout: enable_index_compression: 1 2024-01-25T14:52:08.099 INFO:journalctl@ceph.mon.a.smithi170.stdout: block_align: 0 2024-01-25T14:52:08.099 INFO:journalctl@ceph.mon.a.smithi170.stdout: max_auto_readahead_size: 262144 2024-01-25T14:52:08.099 INFO:journalctl@ceph.mon.a.smithi170.stdout: prepopulate_block_cache: 0 2024-01-25T14:52:08.099 INFO:journalctl@ceph.mon.a.smithi170.stdout: initial_auto_readahead_size: 8192 2024-01-25T14:52:08.099 INFO:journalctl@ceph.mon.a.smithi170.stdout: num_file_reads_for_auto_readahead: 2 2024-01-25T14:52:08.099 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.write_buffer_size: 33554432 2024-01-25T14:52:08.100 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_write_buffer_number: 2 2024-01-25T14:52:08.100 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compression: NoCompression 2024-01-25T14:52:08.100 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.bottommost_compression: Disabled 2024-01-25T14:52:08.100 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.prefix_extractor: nullptr 2024-01-25T14:52:08.100 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-25T14:52:08.100 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.num_levels: 7 2024-01-25T14:52:08.100 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-25T14:52:08.100 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-25T14:52:08.100 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-01-25T14:52:08.100 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-25T14:52:08.100 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-25T14:52:08.100 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-25T14:52:08.100 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-25T14:52:08.100 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-25T14:52:08.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-01-25T14:52:08.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-25T14:52:08.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-01-25T14:52:08.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-01-25T14:52:08.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compression_opts.window_bits: -14 2024-01-25T14:52:08.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compression_opts.level: 32767 2024-01-25T14:52:08.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compression_opts.strategy: 0 2024-01-25T14:52:08.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-25T14:52:08.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-25T14:52:08.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-01-25T14:52:08.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-01-25T14:52:08.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compression_opts.enabled: false 2024-01-25T14:52:08.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-01-25T14:52:08.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-25T14:52:08.101 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-25T14:52:08.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-25T14:52:08.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.target_file_size_base: 67108864 2024-01-25T14:52:08.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.target_file_size_multiplier: 1 2024-01-25T14:52:08.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-25T14:52:08.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-25T14:52:08.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-25T14:52:08.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-25T14:52:08.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-25T14:52:08.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-25T14:52:08.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-25T14:52:08.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-25T14:52:08.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-25T14:52:08.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-25T14:52:08.102 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-25T14:52:08.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-25T14:52:08.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-01-25T14:52:08.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.arena_block_size: 1048576 2024-01-25T14:52:08.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-25T14:52:08.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-25T14:52:08.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.disable_auto_compactions: 0 2024-01-25T14:52:08.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-25T14:52:08.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-25T14:52:08.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-25T14:52:08.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-25T14:52:08.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-25T14:52:08.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-25T14:52:08.103 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-25T14:52:08.104 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-25T14:52:08.104 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-25T14:52:08.104 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-25T14:52:08.104 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.table_properties_collectors: 2024-01-25T14:52:08.104 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.inplace_update_support: 0 2024-01-25T14:52:08.104 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.inplace_update_num_locks: 10000 2024-01-25T14:52:08.104 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-25T14:52:08.104 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-25T14:52:08.104 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.memtable_huge_page_size: 0 2024-01-25T14:52:08.104 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.bloom_locality: 0 2024-01-25T14:52:08.104 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.max_successive_merges: 0 2024-01-25T14:52:08.104 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.optimize_filters_for_hits: 0 2024-01-25T14:52:08.104 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.paranoid_file_checks: 0 2024-01-25T14:52:08.105 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.force_consistency_checks: 1 2024-01-25T14:52:08.105 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.report_bg_io_stats: 0 2024-01-25T14:52:08.105 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.ttl: 2592000 2024-01-25T14:52:08.105 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.periodic_compaction_seconds: 0 2024-01-25T14:52:08.105 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-01-25T14:52:08.105 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-01-25T14:52:08.105 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.enable_blob_files: false 2024-01-25T14:52:08.105 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.min_blob_size: 0 2024-01-25T14:52:08.105 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.blob_file_size: 268435456 2024-01-25T14:52:08.105 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.blob_compression_type: NoCompression 2024-01-25T14:52:08.105 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.enable_blob_garbage_collection: false 2024-01-25T14:52:08.105 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-01-25T14:52:08.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-01-25T14:52:08.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-01-25T14:52:08.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.blob_file_starting_level: 0 2024-01-25T14:52:08.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-01-25T14:52:08.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-01-25T14:52:08.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-01-25T14:52:08.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 12c65588-bb07-4727-9658-bac9d261248a 2024-01-25T14:52:08.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706194327916580, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-01-25T14:52:08.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-01-25T14:52:08.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706194327917632, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 95857, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 336, "table_properties": {"data_size": 93847, "index_size": 292, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13920, "raw_average_key_size": 49, "raw_value_size": 86265, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 279, "num_filter_entries": 279, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1706194327, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "12c65588-bb07-4727-9658-bac9d261248a", "db_session_id": "DYWNKRH4PVWTV6E5YJ6D", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-01-25T14:52:08.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706194327917712, "job": 1, "event": "recovery_finished"} 2024-01-25T14:52:08.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-01-25T14:52:08.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-01-25T14:52:08.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f3bb13c000 2024-01-25T14:52:08.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: DB pointer 0x55f3bb12a000 2024-01-25T14:52:08.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-01-25T14:52:08.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-01-25T14:52:08.107 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** DB Stats ** 2024-01-25T14:52:08.107 INFO:journalctl@ceph.mon.a.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-25T14:52:08.107 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-25T14:52:08.107 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-25T14:52:08.107 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-25T14:52:08.107 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-25T14:52:08.107 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-25T14:52:08.108 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-25T14:52:08.108 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-01-25T14:52:08.108 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** Compaction Stats [default] ** 2024-01-25T14:52:08.108 INFO:journalctl@ceph.mon.a.smithi170.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-25T14:52:08.108 INFO:journalctl@ceph.mon.a.smithi170.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-01-25T14:52:08.108 INFO:journalctl@ceph.mon.a.smithi170.stdout: L0 2/0 95.45 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-25T14:52:08.108 INFO:journalctl@ceph.mon.a.smithi170.stdout: Sum 2/0 95.45 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-25T14:52:08.108 INFO:journalctl@ceph.mon.a.smithi170.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 135.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-25T14:52:08.108 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-01-25T14:52:08.108 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** Compaction Stats [default] ** 2024-01-25T14:52:08.108 INFO:journalctl@ceph.mon.a.smithi170.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-25T14:52:08.108 INFO:journalctl@ceph.mon.a.smithi170.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-25T14:52:08.108 INFO:journalctl@ceph.mon.a.smithi170.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 135.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-25T14:52:08.109 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-01-25T14:52:08.109 INFO:journalctl@ceph.mon.a.smithi170.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-01-25T14:52:08.109 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-01-25T14:52:08.109 INFO:journalctl@ceph.mon.a.smithi170.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-25T14:52:08.109 INFO:journalctl@ceph.mon.a.smithi170.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-01-25T14:52:08.109 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-25T14:52:08.109 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-01-25T14:52:08.109 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-01-25T14:52:08.109 INFO:journalctl@ceph.mon.a.smithi170.stdout: AddFile(Keys): cumulative 0, interval 0 2024-01-25T14:52:08.109 INFO:journalctl@ceph.mon.a.smithi170.stdout: Cumulative compaction: 0.00 GB write, 30.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-25T14:52:08.109 INFO:journalctl@ceph.mon.a.smithi170.stdout: Interval compaction: 0.00 GB write, 30.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-25T14:52:08.109 INFO:journalctl@ceph.mon.a.smithi170.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-25T14:52:08.109 INFO:journalctl@ceph.mon.a.smithi170.stdout: Block cache BinnedLRUCache@0x55f3bb04f090#2 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-01-25T14:52:08.110 INFO:journalctl@ceph.mon.a.smithi170.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-01-25T14:52:08.110 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-01-25T14:52:08.110 INFO:journalctl@ceph.mon.a.smithi170.stdout: ** File Read Latency Histogram By Level [default] ** 2024-01-25T14:52:08.110 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: starting mon.a rank 0 at public addrs [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] at bind addrs [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:52:08.110 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: mon.a@-1(???) e1 preinit fsid 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:52:08.110 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: mon.a@-1(???).mds e1 new map 2024-01-25T14:52:08.110 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: mon.a@-1(???).mds e1 print_map 2024-01-25T14:52:08.110 INFO:journalctl@ceph.mon.a.smithi170.stdout: e1 2024-01-25T14:52:08.110 INFO:journalctl@ceph.mon.a.smithi170.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-01-25T14:52:08.110 INFO:journalctl@ceph.mon.a.smithi170.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-01-25T14:52:08.111 INFO:journalctl@ceph.mon.a.smithi170.stdout: legacy client fscid: -1 2024-01-25T14:52:08.111 INFO:journalctl@ceph.mon.a.smithi170.stdout: 2024-01-25T14:52:08.111 INFO:journalctl@ceph.mon.a.smithi170.stdout: No filesystems configured 2024-01-25T14:52:08.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-01-25T14:52:08.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-01-25T14:52:08.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-01-25T14:52:08.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-01-25T14:52:08.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-01-25T14:52:08.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 bash[31881]: a97f19dae568adbb1350344f267d9d7d47d72bb8b94335571e4f4ec6cae9eb90 2024-01-25T14:52:08.111 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 systemd[1]: Started Ceph mon.a for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:52:08.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: mon.a is new leader, mons a in quorum (ranks 0) 2024-01-25T14:52:08.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: monmap e1: 1 mons at {a=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-25T14:52:08.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: fsmap 2024-01-25T14:52:08.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: osdmap e1: 0 total, 0 up, 0 in 2024-01-25T14:52:08.112 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:07 smithi170 ceph-mon[31899]: mgrmap e1: no daemons active 2024-01-25T14:52:09.073 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.439+0000 7f85370d9700 1 Processor -- start 2024-01-25T14:52:09.073 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.439+0000 7f85370d9700 1 -- start start 2024-01-25T14:52:09.073 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.439+0000 7f85370d9700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85301070f0 0x7f8530107510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:09.073 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.439+0000 7f85370d9700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8530107a50 con 0x7f85301070f0 2024-01-25T14:52:09.073 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.439+0000 7f8534e75700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85301070f0 0x7f8530107510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:09.073 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.439+0000 7f8534e75700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85301070f0 0x7f8530107510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54952/0 (socket says 172.21.15.170:54952) 2024-01-25T14:52:09.073 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.440+0000 7f8534e75700 1 -- 172.21.15.170:0/1218249267 learned_addr learned my addr 172.21.15.170:0/1218249267 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:09.073 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.440+0000 7f8534e75700 1 -- 172.21.15.170:0/1218249267 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8530107b90 con 0x7f85301070f0 2024-01-25T14:52:09.074 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.440+0000 7f8534e75700 1 --2- 172.21.15.170:0/1218249267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85301070f0 0x7f8530107510 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f85240098a0 tx=0x7f8524009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee1d7af9eaaee66 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:09.074 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.440+0000 7f852f7fe700 1 -- 172.21.15.170:0/1218249267 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8524004160 con 0x7f85301070f0 2024-01-25T14:52:09.074 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.440+0000 7f852f7fe700 1 -- 172.21.15.170:0/1218249267 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85240042c0 con 0x7f85301070f0 2024-01-25T14:52:09.074 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.440+0000 7f852f7fe700 1 -- 172.21.15.170:0/1218249267 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8524011a00 con 0x7f85301070f0 2024-01-25T14:52:09.074 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.441+0000 7f85370d9700 1 -- 172.21.15.170:0/1218249267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85301070f0 msgr2=0x7f8530107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:09.074 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.441+0000 7f85370d9700 1 --2- 172.21.15.170:0/1218249267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85301070f0 0x7f8530107510 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f85240098a0 tx=0x7f8524009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:09.074 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.441+0000 7f85370d9700 1 -- 172.21.15.170:0/1218249267 shutdown_connections 2024-01-25T14:52:09.074 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.441+0000 7f85370d9700 1 --2- 172.21.15.170:0/1218249267 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85301070f0 0x7f8530107510 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:09.074 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.441+0000 7f85370d9700 1 -- 172.21.15.170:0/1218249267 >> 172.21.15.170:0/1218249267 conn(0x7f8530102790 msgr2=0x7f8530104bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:09.074 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.441+0000 7f85370d9700 1 -- 172.21.15.170:0/1218249267 shutdown_connections 2024-01-25T14:52:09.074 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.441+0000 7f85370d9700 1 -- 172.21.15.170:0/1218249267 wait complete. 2024-01-25T14:52:09.074 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.441+0000 7f85370d9700 1 Processor -- start 2024-01-25T14:52:09.074 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.441+0000 7f85370d9700 1 -- start start 2024-01-25T14:52:09.075 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.442+0000 7f85370d9700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85301070f0 0x7f853019adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:09.075 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.442+0000 7f85370d9700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853019b330 con 0x7f85301070f0 2024-01-25T14:52:09.075 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.442+0000 7f8534e75700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85301070f0 0x7f853019adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:09.075 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.442+0000 7f8534e75700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85301070f0 0x7f853019adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54958/0 (socket says 172.21.15.170:54958) 2024-01-25T14:52:09.075 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.442+0000 7f8534e75700 1 -- 172.21.15.170:0/3292126887 learned_addr learned my addr 172.21.15.170:0/3292126887 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:09.075 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.442+0000 7f8534e75700 1 -- 172.21.15.170:0/3292126887 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8524009550 con 0x7f85301070f0 2024-01-25T14:52:09.075 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.442+0000 7f8534e75700 1 --2- 172.21.15.170:0/3292126887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85301070f0 0x7f853019adf0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8524009130 tx=0x7f8524011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:09.075 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.442+0000 7f852dffb700 1 -- 172.21.15.170:0/3292126887 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8524003b70 con 0x7f85301070f0 2024-01-25T14:52:09.075 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.442+0000 7f852dffb700 1 -- 172.21.15.170:0/3292126887 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8524003cd0 con 0x7f85301070f0 2024-01-25T14:52:09.075 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.442+0000 7f852dffb700 1 -- 172.21.15.170:0/3292126887 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85240197d0 con 0x7f85301070f0 2024-01-25T14:52:09.075 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.442+0000 7f85370d9700 1 -- 172.21.15.170:0/3292126887 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853019b530 con 0x7f85301070f0 2024-01-25T14:52:09.075 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.442+0000 7f85370d9700 1 -- 172.21.15.170:0/3292126887 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853019b9d0 con 0x7f85301070f0 2024-01-25T14:52:09.075 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.443+0000 7f852dffb700 1 -- 172.21.15.170:0/3292126887 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f85240199c0 con 0x7f85301070f0 2024-01-25T14:52:09.075 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.443+0000 7f852dffb700 1 -- 172.21.15.170:0/3292126887 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f852400b760 con 0x7f85301070f0 2024-01-25T14:52:09.076 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.443+0000 7f85370d9700 1 -- 172.21.15.170:0/3292126887 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8530062e10 con 0x7f85301070f0 2024-01-25T14:52:09.076 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.446+0000 7f852dffb700 1 -- 172.21.15.170:0/3292126887 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f852402a060 con 0x7f85301070f0 2024-01-25T14:52:09.076 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.512+0000 7f85370d9700 1 -- 172.21.15.170:0/3292126887 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f8530108f10 con 0x7f85301070f0 2024-01-25T14:52:09.076 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.514+0000 7f852dffb700 1 -- 172.21.15.170:0/3292126887 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8524019e00 con 0x7f85301070f0 2024-01-25T14:52:09.076 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.514+0000 7f85370d9700 1 -- 172.21.15.170:0/3292126887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85301070f0 msgr2=0x7f853019adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:09.076 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.514+0000 7f85370d9700 1 --2- 172.21.15.170:0/3292126887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85301070f0 0x7f853019adf0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f8524009130 tx=0x7f8524011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:09.076 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.514+0000 7f85370d9700 1 -- 172.21.15.170:0/3292126887 shutdown_connections 2024-01-25T14:52:09.076 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.514+0000 7f85370d9700 1 --2- 172.21.15.170:0/3292126887 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f85301070f0 0x7f853019adf0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:09.076 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.514+0000 7f85370d9700 1 -- 172.21.15.170:0/3292126887 >> 172.21.15.170:0/3292126887 conn(0x7f8530102790 msgr2=0x7f85301032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:09.076 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.514+0000 7f85370d9700 1 -- 172.21.15.170:0/3292126887 shutdown_connections 2024-01-25T14:52:09.076 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:08.514+0000 7f85370d9700 1 -- 172.21.15.170:0/3292126887 wait complete. 2024-01-25T14:52:09.076 INFO:teuthology.orchestra.run.smithi170.stdout:Wrote config to /etc/ceph/ceph.conf 2024-01-25T14:52:09.090 INFO:teuthology.orchestra.run.smithi170.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-01-25T14:52:09.091 INFO:teuthology.orchestra.run.smithi170.stdout:Creating mgr... 2024-01-25T14:52:09.091 INFO:teuthology.orchestra.run.smithi170.stdout:Verifying port 0.0.0.0:9283 ... 2024-01-25T14:52:09.091 INFO:teuthology.orchestra.run.smithi170.stdout:Verifying port 0.0.0.0:8765 ... 2024-01-25T14:52:09.329 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-267213a8-bb91-11ee-95b2-87774f69a715@mgr.x 2024-01-25T14:52:09.329 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Failed to reset failed state of unit ceph-267213a8-bb91-11ee-95b2-87774f69a715@mgr.x.service: Unit ceph-267213a8-bb91-11ee-95b2-87774f69a715@mgr.x.service not loaded. 2024-01-25T14:52:09.484 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-267213a8-bb91-11ee-95b2-87774f69a715.target.wants/ceph-267213a8-bb91-11ee-95b2-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-267213a8-bb91-11ee-95b2-87774f69a715@.service. 2024-01-25T14:52:09.831 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:09 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3292126887' entity='client.admin' 2024-01-25T14:52:10.010 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-25T14:52:10.010 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout disabled 2024-01-25T14:52:10.018 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-25T14:52:10.018 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout inactive 2024-01-25T14:52:10.018 INFO:teuthology.orchestra.run.smithi170.stdout:firewalld.service is not enabled 2024-01-25T14:52:10.018 INFO:teuthology.orchestra.run.smithi170.stdout:Not possible to enable service . firewalld.service is not available 2024-01-25T14:52:10.027 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-25T14:52:10.027 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout disabled 2024-01-25T14:52:10.034 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-25T14:52:10.034 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout inactive 2024-01-25T14:52:10.034 INFO:teuthology.orchestra.run.smithi170.stdout:firewalld.service is not enabled 2024-01-25T14:52:10.034 INFO:teuthology.orchestra.run.smithi170.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-01-25T14:52:10.035 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for mgr to start... 2024-01-25T14:52:10.035 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for mgr... 2024-01-25T14:52:10.124 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:09 smithi170 systemd[1]: Started Ceph mgr.x for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:52:10.804 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:10 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/48697158' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-25T14:52:10.804 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:10 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:10.498+0000 7fd33cc9d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-25T14:52:10.804 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:10 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:10.601+0000 7fd33cc9d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-25T14:52:11.084 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-01-25T14:52:11.085 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout { 2024-01-25T14:52:11.085 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "fsid": "267213a8-bb91-11ee-95b2-87774f69a715", 2024-01-25T14:52:11.085 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "health": { 2024-01-25T14:52:11.085 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-01-25T14:52:11.085 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-01-25T14:52:11.085 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-01-25T14:52:11.085 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:11.085 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-01-25T14:52:11.085 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-01-25T14:52:11.085 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 0 2024-01-25T14:52:11.085 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-01-25T14:52:11.086 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-01-25T14:52:11.086 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "a" 2024-01-25T14:52:11.086 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-01-25T14:52:11.086 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-01-25T14:52:11.086 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "monmap": { 2024-01-25T14:52:11.086 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:11.086 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-01-25T14:52:11.086 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-01-25T14:52:11.086 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:11.086 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-01-25T14:52:11.086 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:11.086 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-01-25T14:52:11.086 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-01-25T14:52:11.086 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-01-25T14:52:11.094 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-01-25T14:52:11.094 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-01-25T14:52:11.095 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-01-25T14:52:11.095 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:11.095 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-01-25T14:52:11.095 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-01-25T14:52:11.095 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-01-25T14:52:11.095 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-01-25T14:52:11.095 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-01-25T14:52:11.095 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-01-25T14:52:11.095 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-01-25T14:52:11.096 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-01-25T14:52:11.096 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-01-25T14:52:11.096 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:11.096 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-01-25T14:52:11.096 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:11.096 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-01-25T14:52:11.096 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-01-25T14:52:11.096 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:11.096 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-01-25T14:52:11.096 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "available": false, 2024-01-25T14:52:11.096 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-01-25T14:52:11.096 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "modules": [ 2024-01-25T14:52:11.096 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "iostat", 2024-01-25T14:52:11.097 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "nfs", 2024-01-25T14:52:11.097 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "restful" 2024-01-25T14:52:11.097 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-01-25T14:52:11.097 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-25T14:52:11.097 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:11.097 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-01-25T14:52:11.097 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:11.097 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "modified": "2024-01-25T14:51:53.335654+0000", 2024-01-25T14:52:11.097 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-25T14:52:11.097 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:11.097 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-01-25T14:52:11.097 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout } 2024-01-25T14:52:11.097 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.416+0000 7f376ef9e700 1 Processor -- start 2024-01-25T14:52:11.097 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.416+0000 7f376ef9e700 1 -- start start 2024-01-25T14:52:11.097 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.416+0000 7f376ef9e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3768105820 0x7f3768105c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:11.098 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.416+0000 7f376ef9e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376807ade0 con 0x7f3768105820 2024-01-25T14:52:11.098 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.416+0000 7f376df9c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3768105820 0x7f3768105c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:11.098 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.416+0000 7f376df9c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3768105820 0x7f3768105c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54984/0 (socket says 172.21.15.170:54984) 2024-01-25T14:52:11.098 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.416+0000 7f376df9c700 1 -- 172.21.15.170:0/3147022499 learned_addr learned my addr 172.21.15.170:0/3147022499 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:11.098 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.417+0000 7f376df9c700 1 -- 172.21.15.170:0/3147022499 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376807af20 con 0x7f3768105820 2024-01-25T14:52:11.098 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.417+0000 7f376df9c700 1 --2- 172.21.15.170:0/3147022499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3768105820 0x7f3768105c40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f37640098a0 tx=0x7f3764009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c26069d58883da server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:11.098 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.417+0000 7f376cf9a700 1 -- 172.21.15.170:0/3147022499 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3764004160 con 0x7f3768105820 2024-01-25T14:52:11.098 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.417+0000 7f376cf9a700 1 -- 172.21.15.170:0/3147022499 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f37640042c0 con 0x7f3768105820 2024-01-25T14:52:11.098 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.417+0000 7f376cf9a700 1 -- 172.21.15.170:0/3147022499 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3764011a00 con 0x7f3768105820 2024-01-25T14:52:11.098 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.418+0000 7f376ef9e700 1 -- 172.21.15.170:0/3147022499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3768105820 msgr2=0x7f3768105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:11.098 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.418+0000 7f376ef9e700 1 --2- 172.21.15.170:0/3147022499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3768105820 0x7f3768105c40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f37640098a0 tx=0x7f3764009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:11.098 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.418+0000 7f376ef9e700 1 -- 172.21.15.170:0/3147022499 shutdown_connections 2024-01-25T14:52:11.098 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.418+0000 7f376ef9e700 1 --2- 172.21.15.170:0/3147022499 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3768105820 0x7f3768105c40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:11.099 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.418+0000 7f376ef9e700 1 -- 172.21.15.170:0/3147022499 >> 172.21.15.170:0/3147022499 conn(0x7f3768101400 msgr2=0x7f3768103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:11.099 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.418+0000 7f376ef9e700 1 -- 172.21.15.170:0/3147022499 shutdown_connections 2024-01-25T14:52:11.099 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.418+0000 7f376ef9e700 1 -- 172.21.15.170:0/3147022499 wait complete. 2024-01-25T14:52:11.099 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.419+0000 7f376ef9e700 1 Processor -- start 2024-01-25T14:52:11.099 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.419+0000 7f376ef9e700 1 -- start start 2024-01-25T14:52:11.099 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.419+0000 7f376ef9e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3768105820 0x7f376819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:11.099 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.419+0000 7f376ef9e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376819d370 con 0x7f3768105820 2024-01-25T14:52:11.099 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.419+0000 7f376df9c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3768105820 0x7f376819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:11.099 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.419+0000 7f376df9c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3768105820 0x7f376819ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54986/0 (socket says 172.21.15.170:54986) 2024-01-25T14:52:11.099 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.419+0000 7f376df9c700 1 -- 172.21.15.170:0/48697158 learned_addr learned my addr 172.21.15.170:0/48697158 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:11.099 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.420+0000 7f376df9c700 1 -- 172.21.15.170:0/48697158 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764009550 con 0x7f3768105820 2024-01-25T14:52:11.099 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.420+0000 7f376df9c700 1 --2- 172.21.15.170:0/48697158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3768105820 0x7f376819ce30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3764009fb0 tx=0x7f3764011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:11.099 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.420+0000 7f375effd700 1 -- 172.21.15.170:0/48697158 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3764003a40 con 0x7f3768105820 2024-01-25T14:52:11.099 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.420+0000 7f376ef9e700 1 -- 172.21.15.170:0/48697158 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376819d570 con 0x7f3768105820 2024-01-25T14:52:11.099 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.420+0000 7f376ef9e700 1 -- 172.21.15.170:0/48697158 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376819da10 con 0x7f3768105820 2024-01-25T14:52:11.100 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.420+0000 7f375effd700 1 -- 172.21.15.170:0/48697158 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3764003ba0 con 0x7f3768105820 2024-01-25T14:52:11.100 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.420+0000 7f375effd700 1 -- 172.21.15.170:0/48697158 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f376401a750 con 0x7f3768105820 2024-01-25T14:52:11.100 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.420+0000 7f375effd700 1 -- 172.21.15.170:0/48697158 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f376401ad10 con 0x7f3768105820 2024-01-25T14:52:11.100 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.420+0000 7f375effd700 1 -- 172.21.15.170:0/48697158 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3764019640 con 0x7f3768105820 2024-01-25T14:52:11.100 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.421+0000 7f376ef9e700 1 -- 172.21.15.170:0/48697158 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374c005360 con 0x7f3768105820 2024-01-25T14:52:11.100 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.423+0000 7f375effd700 1 -- 172.21.15.170:0/48697158 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f3764024b60 con 0x7f3768105820 2024-01-25T14:52:11.100 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.495+0000 7f376ef9e700 1 -- 172.21.15.170:0/48697158 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f374c0058e0 con 0x7f3768105820 2024-01-25T14:52:11.100 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.496+0000 7f375effd700 1 -- 172.21.15.170:0/48697158 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f3764024d00 con 0x7f3768105820 2024-01-25T14:52:11.100 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.497+0000 7f376ef9e700 1 -- 172.21.15.170:0/48697158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3768105820 msgr2=0x7f376819ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:11.100 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.497+0000 7f376ef9e700 1 --2- 172.21.15.170:0/48697158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3768105820 0x7f376819ce30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3764009fb0 tx=0x7f3764011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:11.100 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.497+0000 7f376ef9e700 1 -- 172.21.15.170:0/48697158 shutdown_connections 2024-01-25T14:52:11.100 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.497+0000 7f376ef9e700 1 --2- 172.21.15.170:0/48697158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3768105820 0x7f376819ce30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:11.100 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.497+0000 7f376ef9e700 1 -- 172.21.15.170:0/48697158 >> 172.21.15.170:0/48697158 conn(0x7f3768101400 msgr2=0x7f3768193c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:11.101 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.497+0000 7f376ef9e700 1 -- 172.21.15.170:0/48697158 shutdown_connections 2024-01-25T14:52:11.101 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:10.497+0000 7f376ef9e700 1 -- 172.21.15.170:0/48697158 wait complete. 2024-01-25T14:52:11.101 INFO:teuthology.orchestra.run.smithi170.stdout:mgr not available, waiting (1/15)... 2024-01-25T14:52:11.338 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:11 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:11.246+0000 7fd33cc9d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-25T14:52:11.338 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:11 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:11.337+0000 7fd33cc9d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-25T14:52:11.624 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:11 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:11.422+0000 7fd33cc9d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-25T14:52:11.624 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:11 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:11.574+0000 7fd33cc9d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-25T14:52:12.012 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:11 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:11.655+0000 7fd33cc9d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-25T14:52:12.012 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:11 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:11.830+0000 7fd33cc9d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-25T14:52:12.012 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:12 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:12.010+0000 7fd33cc9d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-25T14:52:12.279 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:12 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:12.097+0000 7fd33cc9d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-25T14:52:12.279 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:12 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:12.191+0000 7fd33cc9d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-25T14:52:12.279 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:12 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:12.278+0000 7fd33cc9d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-25T14:52:13.481 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:13 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:13.346+0000 7fd33cc9d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-25T14:52:13.481 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:13 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:13.480+0000 7fd33cc9d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-25T14:52:13.874 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:13 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:13.683+0000 7fd33cc9d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-25T14:52:14.219 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:13 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3813833693' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-25T14:52:14.220 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:13 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:13.919+0000 7fd33cc9d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-25T14:52:14.220 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:14 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:14.100+0000 7fd33cc9d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-25T14:52:14.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-01-25T14:52:14.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout { 2024-01-25T14:52:14.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "fsid": "267213a8-bb91-11ee-95b2-87774f69a715", 2024-01-25T14:52:14.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "health": { 2024-01-25T14:52:14.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-01-25T14:52:14.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-01-25T14:52:14.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-01-25T14:52:14.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:14.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-01-25T14:52:14.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-01-25T14:52:14.233 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 0 2024-01-25T14:52:14.234 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-01-25T14:52:14.234 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-01-25T14:52:14.234 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "a" 2024-01-25T14:52:14.234 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-01-25T14:52:14.234 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-01-25T14:52:14.234 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "monmap": { 2024-01-25T14:52:14.234 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:14.234 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-01-25T14:52:14.234 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-01-25T14:52:14.234 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:14.234 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-01-25T14:52:14.234 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:14.234 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-01-25T14:52:14.235 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-01-25T14:52:14.235 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-01-25T14:52:14.235 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-01-25T14:52:14.235 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-01-25T14:52:14.235 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-01-25T14:52:14.235 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:14.235 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-01-25T14:52:14.235 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-01-25T14:52:14.235 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-01-25T14:52:14.235 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-01-25T14:52:14.235 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-01-25T14:52:14.235 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-01-25T14:52:14.235 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-01-25T14:52:14.235 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-01-25T14:52:14.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-01-25T14:52:14.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:14.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-01-25T14:52:14.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:14.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-01-25T14:52:14.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-01-25T14:52:14.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:14.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-01-25T14:52:14.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "available": false, 2024-01-25T14:52:14.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-01-25T14:52:14.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "modules": [ 2024-01-25T14:52:14.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "iostat", 2024-01-25T14:52:14.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "nfs", 2024-01-25T14:52:14.236 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "restful" 2024-01-25T14:52:14.237 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-01-25T14:52:14.237 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-25T14:52:14.237 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:14.237 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-01-25T14:52:14.237 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:14.237 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "modified": "2024-01-25T14:51:53.335654+0000", 2024-01-25T14:52:14.237 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-25T14:52:14.237 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:14.237 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-01-25T14:52:14.237 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout } 2024-01-25T14:52:14.237 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.547+0000 7febc9592700 1 Processor -- start 2024-01-25T14:52:14.237 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.547+0000 7febc9592700 1 -- start start 2024-01-25T14:52:14.237 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.547+0000 7febc9592700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febc4107b60 0x7febc4109f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:14.237 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.547+0000 7febc9592700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc407aed0 con 0x7febc4107b60 2024-01-25T14:52:14.237 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.547+0000 7febc2ffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febc4107b60 0x7febc4109f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:14.238 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.547+0000 7febc2ffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febc4107b60 0x7febc4109f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54996/0 (socket says 172.21.15.170:54996) 2024-01-25T14:52:14.238 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.547+0000 7febc2ffd700 1 -- 172.21.15.170:0/2283728344 learned_addr learned my addr 172.21.15.170:0/2283728344 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:14.238 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.548+0000 7febc2ffd700 1 -- 172.21.15.170:0/2283728344 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc410a490 con 0x7febc4107b60 2024-01-25T14:52:14.238 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.548+0000 7febc2ffd700 1 --2- 172.21.15.170:0/2283728344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febc4107b60 0x7febc4109f50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7febbc009e80 tx=0x7febbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff66a4a559f3b79 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:14.238 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.548+0000 7febc1ffb700 1 -- 172.21.15.170:0/2283728344 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febbc00e070 con 0x7febc4107b60 2024-01-25T14:52:14.238 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.548+0000 7febc1ffb700 1 -- 172.21.15.170:0/2283728344 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7febbc00b8c0 con 0x7febc4107b60 2024-01-25T14:52:14.238 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.548+0000 7febc1ffb700 1 -- 172.21.15.170:0/2283728344 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febbc0044c0 con 0x7febc4107b60 2024-01-25T14:52:14.238 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.549+0000 7febc9592700 1 -- 172.21.15.170:0/2283728344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febc4107b60 msgr2=0x7febc4109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:14.238 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.549+0000 7febc9592700 1 --2- 172.21.15.170:0/2283728344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febc4107b60 0x7febc4109f50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7febbc009e80 tx=0x7febbc00b330 comp rx=0 tx=0).stop 2024-01-25T14:52:14.238 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.549+0000 7febc9592700 1 -- 172.21.15.170:0/2283728344 shutdown_connections 2024-01-25T14:52:14.238 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.549+0000 7febc9592700 1 --2- 172.21.15.170:0/2283728344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febc4107b60 0x7febc4109f50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:14.238 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.549+0000 7febc9592700 1 -- 172.21.15.170:0/2283728344 >> 172.21.15.170:0/2283728344 conn(0x7febc41015b0 msgr2=0x7febc41039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:14.238 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.549+0000 7febc9592700 1 -- 172.21.15.170:0/2283728344 shutdown_connections 2024-01-25T14:52:14.238 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.549+0000 7febc9592700 1 -- 172.21.15.170:0/2283728344 wait complete. 2024-01-25T14:52:14.239 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.550+0000 7febc9592700 1 Processor -- start 2024-01-25T14:52:14.239 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.550+0000 7febc9592700 1 -- start start 2024-01-25T14:52:14.239 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.550+0000 7febc9592700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febc4107b60 0x7febc419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:14.239 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.550+0000 7febc9592700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc419b350 con 0x7febc4107b60 2024-01-25T14:52:14.239 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.550+0000 7febc2ffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febc4107b60 0x7febc419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:14.239 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.550+0000 7febc2ffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febc4107b60 0x7febc419ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55004/0 (socket says 172.21.15.170:55004) 2024-01-25T14:52:14.239 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.550+0000 7febc2ffd700 1 -- 172.21.15.170:0/3813833693 learned_addr learned my addr 172.21.15.170:0/3813833693 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:14.239 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.550+0000 7febc2ffd700 1 -- 172.21.15.170:0/3813833693 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc009b30 con 0x7febc4107b60 2024-01-25T14:52:14.239 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.550+0000 7febc2ffd700 1 --2- 172.21.15.170:0/3813833693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febc4107b60 0x7febc419ae10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7febbc004110 tx=0x7febbc004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:14.239 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.551+0000 7febabfff700 1 -- 172.21.15.170:0/3813833693 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febbc00e040 con 0x7febc4107b60 2024-01-25T14:52:14.239 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.551+0000 7febc9592700 1 -- 172.21.15.170:0/3813833693 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc419b550 con 0x7febc4107b60 2024-01-25T14:52:14.239 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.551+0000 7febabfff700 1 -- 172.21.15.170:0/3813833693 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7febbc00bd70 con 0x7febc4107b60 2024-01-25T14:52:14.239 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.551+0000 7febabfff700 1 -- 172.21.15.170:0/3813833693 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7febbc01c670 con 0x7febc4107b60 2024-01-25T14:52:14.239 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.551+0000 7febc9592700 1 -- 172.21.15.170:0/3813833693 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc419ba50 con 0x7febc4107b60 2024-01-25T14:52:14.240 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.551+0000 7febabfff700 1 -- 172.21.15.170:0/3813833693 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7febbc01c8b0 con 0x7febc4107b60 2024-01-25T14:52:14.240 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.551+0000 7febabfff700 1 -- 172.21.15.170:0/3813833693 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7febbc01b6e0 con 0x7febc4107b60 2024-01-25T14:52:14.240 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.552+0000 7febc9592700 1 -- 172.21.15.170:0/3813833693 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc410b290 con 0x7febc4107b60 2024-01-25T14:52:14.240 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.554+0000 7febabfff700 1 -- 172.21.15.170:0/3813833693 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7febbc02a060 con 0x7febc4107b60 2024-01-25T14:52:14.240 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.624+0000 7febc9592700 1 -- 172.21.15.170:0/3813833693 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7febc419e670 con 0x7febc4107b60 2024-01-25T14:52:14.240 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.625+0000 7febabfff700 1 -- 172.21.15.170:0/3813833693 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7febbc020070 con 0x7febc4107b60 2024-01-25T14:52:14.240 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.626+0000 7febc9592700 1 -- 172.21.15.170:0/3813833693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febc4107b60 msgr2=0x7febc419ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:14.240 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.626+0000 7febc9592700 1 --2- 172.21.15.170:0/3813833693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febc4107b60 0x7febc419ae10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7febbc004110 tx=0x7febbc004610 comp rx=0 tx=0).stop 2024-01-25T14:52:14.240 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.626+0000 7febc9592700 1 -- 172.21.15.170:0/3813833693 shutdown_connections 2024-01-25T14:52:14.240 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.626+0000 7febc9592700 1 --2- 172.21.15.170:0/3813833693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febc4107b60 0x7febc419ae10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:14.240 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.626+0000 7febc9592700 1 -- 172.21.15.170:0/3813833693 >> 172.21.15.170:0/3813833693 conn(0x7febc41015b0 msgr2=0x7febc4102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:14.240 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.626+0000 7febc9592700 1 -- 172.21.15.170:0/3813833693 shutdown_connections 2024-01-25T14:52:14.240 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:13.627+0000 7febc9592700 1 -- 172.21.15.170:0/3813833693 wait complete. 2024-01-25T14:52:14.240 INFO:teuthology.orchestra.run.smithi170.stdout:mgr not available, waiting (2/15)... 2024-01-25T14:52:14.556 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:14 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:14.287+0000 7fd33cc9d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-25T14:52:14.874 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:14 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:14.555+0000 7fd33cc9d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-25T14:52:14.874 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:14 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:14.643+0000 7fd33cc9d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-25T14:52:15.374 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:15 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:15.039+0000 7fd33cc9d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-25T14:52:16.124 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:15 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:15.859+0000 7fd33cc9d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-25T14:52:16.624 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:16 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:16.453+0000 7fd33cc9d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-25T14:52:16.624 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:16 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:16.553+0000 7fd33cc9d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-25T14:52:17.050 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:16 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:16.763+0000 7fd33cc9d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-25T14:52:17.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:16 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3184742859' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-25T14:52:17.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:16 smithi170 ceph-mon[31899]: Activating manager daemon x 2024-01-25T14:52:17.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:16 smithi170 ceph-mon[31899]: mgrmap e2: x(active, starting, since 0.00385377s) 2024-01-25T14:52:17.050 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:16 smithi170 ceph-mon[31899]: from='mgr.14100 172.21.15.170:0/2830818458' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-25T14:52:17.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:16 smithi170 ceph-mon[31899]: from='mgr.14100 172.21.15.170:0/2830818458' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-25T14:52:17.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:16 smithi170 ceph-mon[31899]: from='mgr.14100 172.21.15.170:0/2830818458' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-25T14:52:17.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:16 smithi170 ceph-mon[31899]: from='mgr.14100 172.21.15.170:0/2830818458' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:52:17.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:16 smithi170 ceph-mon[31899]: from='mgr.14100 172.21.15.170:0/2830818458' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-25T14:52:17.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:16 smithi170 ceph-mon[31899]: Manager daemon x is now available 2024-01-25T14:52:17.348 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-01-25T14:52:17.348 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout { 2024-01-25T14:52:17.348 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "fsid": "267213a8-bb91-11ee-95b2-87774f69a715", 2024-01-25T14:52:17.348 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "health": { 2024-01-25T14:52:17.348 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-01-25T14:52:17.349 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-01-25T14:52:17.349 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-01-25T14:52:17.349 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:17.349 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-01-25T14:52:17.349 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-01-25T14:52:17.349 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 0 2024-01-25T14:52:17.349 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-01-25T14:52:17.349 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-01-25T14:52:17.349 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "a" 2024-01-25T14:52:17.349 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-01-25T14:52:17.349 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-01-25T14:52:17.349 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "monmap": { 2024-01-25T14:52:17.349 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:17.349 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-01-25T14:52:17.349 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-01-25T14:52:17.350 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:17.350 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-01-25T14:52:17.350 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:17.350 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-01-25T14:52:17.350 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-01-25T14:52:17.350 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-01-25T14:52:17.358 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-01-25T14:52:17.359 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-01-25T14:52:17.359 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-01-25T14:52:17.359 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:17.359 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-01-25T14:52:17.359 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-01-25T14:52:17.359 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-01-25T14:52:17.359 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-01-25T14:52:17.359 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-01-25T14:52:17.359 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-01-25T14:52:17.359 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-01-25T14:52:17.359 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-01-25T14:52:17.359 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-01-25T14:52:17.359 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:17.359 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-01-25T14:52:17.360 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:17.360 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-01-25T14:52:17.360 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-01-25T14:52:17.360 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:17.360 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-01-25T14:52:17.360 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "available": false, 2024-01-25T14:52:17.360 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-01-25T14:52:17.360 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "modules": [ 2024-01-25T14:52:17.360 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "iostat", 2024-01-25T14:52:17.360 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "nfs", 2024-01-25T14:52:17.360 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "restful" 2024-01-25T14:52:17.360 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-01-25T14:52:17.360 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-25T14:52:17.361 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:17.361 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-01-25T14:52:17.361 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:17.361 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "modified": "2024-01-25T14:51:53.335654+0000", 2024-01-25T14:52:17.361 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-25T14:52:17.361 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:17.361 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-01-25T14:52:17.361 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout } 2024-01-25T14:52:17.361 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.670+0000 7f0a96537700 1 Processor -- start 2024-01-25T14:52:17.361 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.670+0000 7f0a96537700 1 -- start start 2024-01-25T14:52:17.361 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.670+0000 7f0a96537700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a90105fe0 0x7f0a90106400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:17.361 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.670+0000 7f0a96537700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a901069d0 con 0x7f0a90105fe0 2024-01-25T14:52:17.361 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.671+0000 7f0a8ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a90105fe0 0x7f0a90106400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:17.362 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.671+0000 7f0a8ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a90105fe0 0x7f0a90106400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59554/0 (socket says 172.21.15.170:59554) 2024-01-25T14:52:17.362 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.671+0000 7f0a8ffff700 1 -- 172.21.15.170:0/4254762648 learned_addr learned my addr 172.21.15.170:0/4254762648 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:17.362 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.671+0000 7f0a8ffff700 1 -- 172.21.15.170:0/4254762648 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a901071e0 con 0x7f0a90105fe0 2024-01-25T14:52:17.362 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.671+0000 7f0a8ffff700 1 --2- 172.21.15.170:0/4254762648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a90105fe0 0x7f0a90106400 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0a800098a0 tx=0x7f0a80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7121534741416575 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:17.362 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.671+0000 7f0a8effd700 1 -- 172.21.15.170:0/4254762648 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a80004160 con 0x7f0a90105fe0 2024-01-25T14:52:17.362 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.671+0000 7f0a8effd700 1 -- 172.21.15.170:0/4254762648 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a800042c0 con 0x7f0a90105fe0 2024-01-25T14:52:17.362 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.671+0000 7f0a8effd700 1 -- 172.21.15.170:0/4254762648 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a80011a00 con 0x7f0a90105fe0 2024-01-25T14:52:17.362 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.672+0000 7f0a96537700 1 -- 172.21.15.170:0/4254762648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a90105fe0 msgr2=0x7f0a90106400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:17.362 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.672+0000 7f0a96537700 1 --2- 172.21.15.170:0/4254762648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a90105fe0 0x7f0a90106400 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0a800098a0 tx=0x7f0a80009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:17.362 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.672+0000 7f0a96537700 1 -- 172.21.15.170:0/4254762648 shutdown_connections 2024-01-25T14:52:17.362 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.672+0000 7f0a96537700 1 --2- 172.21.15.170:0/4254762648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a90105fe0 0x7f0a90106400 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:17.362 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.672+0000 7f0a96537700 1 -- 172.21.15.170:0/4254762648 >> 172.21.15.170:0/4254762648 conn(0x7f0a901015c0 msgr2=0x7f0a901039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:17.362 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.672+0000 7f0a96537700 1 -- 172.21.15.170:0/4254762648 shutdown_connections 2024-01-25T14:52:17.363 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.672+0000 7f0a96537700 1 -- 172.21.15.170:0/4254762648 wait complete. 2024-01-25T14:52:17.363 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.673+0000 7f0a96537700 1 Processor -- start 2024-01-25T14:52:17.363 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.673+0000 7f0a96537700 1 -- start start 2024-01-25T14:52:17.363 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.673+0000 7f0a96537700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a90105fe0 0x7f0a90199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:17.363 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.673+0000 7f0a96537700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9019a300 con 0x7f0a90105fe0 2024-01-25T14:52:17.363 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.673+0000 7f0a8ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a90105fe0 0x7f0a90199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:17.363 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.673+0000 7f0a8ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a90105fe0 0x7f0a90199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59564/0 (socket says 172.21.15.170:59564) 2024-01-25T14:52:17.363 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.673+0000 7f0a8ffff700 1 -- 172.21.15.170:0/3184742859 learned_addr learned my addr 172.21.15.170:0/3184742859 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:17.363 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.674+0000 7f0a8ffff700 1 -- 172.21.15.170:0/3184742859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a80009550 con 0x7f0a90105fe0 2024-01-25T14:52:17.363 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.674+0000 7f0a8ffff700 1 --2- 172.21.15.170:0/3184742859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a90105fe0 0x7f0a90199dc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009130 tx=0x7f0a80011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:17.363 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.674+0000 7f0a8d7fa700 1 -- 172.21.15.170:0/3184742859 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a800038b0 con 0x7f0a90105fe0 2024-01-25T14:52:17.363 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.674+0000 7f0a8d7fa700 1 -- 172.21.15.170:0/3184742859 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0a80003a10 con 0x7f0a90105fe0 2024-01-25T14:52:17.363 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.674+0000 7f0a96537700 1 -- 172.21.15.170:0/3184742859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9019a500 con 0x7f0a90105fe0 2024-01-25T14:52:17.363 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.674+0000 7f0a8d7fa700 1 -- 172.21.15.170:0/3184742859 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a80019550 con 0x7f0a90105fe0 2024-01-25T14:52:17.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.674+0000 7f0a96537700 1 -- 172.21.15.170:0/3184742859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9019a9a0 con 0x7f0a90105fe0 2024-01-25T14:52:17.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.674+0000 7f0a8d7fa700 1 -- 172.21.15.170:0/3184742859 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f0a80019c20 con 0x7f0a90105fe0 2024-01-25T14:52:17.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.674+0000 7f0a8d7fa700 1 -- 172.21.15.170:0/3184742859 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0a80024660 con 0x7f0a90105fe0 2024-01-25T14:52:17.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.675+0000 7f0a96537700 1 -- 172.21.15.170:0/3184742859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a90062e10 con 0x7f0a90105fe0 2024-01-25T14:52:17.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.677+0000 7f0a8d7fa700 1 -- 172.21.15.170:0/3184742859 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73119 (secure 0 0 0) 0x7f0a80003b80 con 0x7f0a90105fe0 2024-01-25T14:52:17.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.750+0000 7f0a96537700 1 -- 172.21.15.170:0/3184742859 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f0a9019d520 con 0x7f0a90105fe0 2024-01-25T14:52:17.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.751+0000 7f0a8d7fa700 1 -- 172.21.15.170:0/3184742859 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f0a8001a960 con 0x7f0a90105fe0 2024-01-25T14:52:17.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.752+0000 7f0a96537700 1 -- 172.21.15.170:0/3184742859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a90105fe0 msgr2=0x7f0a90199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:17.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.752+0000 7f0a96537700 1 --2- 172.21.15.170:0/3184742859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a90105fe0 0x7f0a90199dc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009130 tx=0x7f0a80011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:17.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.752+0000 7f0a96537700 1 -- 172.21.15.170:0/3184742859 shutdown_connections 2024-01-25T14:52:17.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.752+0000 7f0a96537700 1 --2- 172.21.15.170:0/3184742859 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0a90105fe0 0x7f0a90199dc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:17.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.752+0000 7f0a96537700 1 -- 172.21.15.170:0/3184742859 >> 172.21.15.170:0/3184742859 conn(0x7f0a901015c0 msgr2=0x7f0a90102150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:17.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.752+0000 7f0a96537700 1 -- 172.21.15.170:0/3184742859 shutdown_connections 2024-01-25T14:52:17.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:16.752+0000 7f0a96537700 1 -- 172.21.15.170:0/3184742859 wait complete. 2024-01-25T14:52:17.365 INFO:teuthology.orchestra.run.smithi170.stdout:mgr not available, waiting (3/15)... 2024-01-25T14:52:18.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:17 smithi170 ceph-mon[31899]: from='mgr.14100 172.21.15.170:0/2830818458' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-25T14:52:18.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:17 smithi170 ceph-mon[31899]: from='mgr.14100 172.21.15.170:0/2830818458' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-25T14:52:18.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:17 smithi170 ceph-mon[31899]: from='mgr.14100 172.21.15.170:0/2830818458' entity='mgr.x' 2024-01-25T14:52:18.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:17 smithi170 ceph-mon[31899]: from='mgr.14100 172.21.15.170:0/2830818458' entity='mgr.x' 2024-01-25T14:52:18.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:17 smithi170 ceph-mon[31899]: from='mgr.14100 172.21.15.170:0/2830818458' entity='mgr.x' 2024-01-25T14:52:18.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:17 smithi170 ceph-mon[31899]: mgrmap e3: x(active, since 1.00773s) 2024-01-25T14:52:20.060 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:19 smithi170 ceph-mon[31899]: mgrmap e4: x(active, since 2s) 2024-01-25T14:52:20.629 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-01-25T14:52:20.629 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout { 2024-01-25T14:52:20.629 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "fsid": "267213a8-bb91-11ee-95b2-87774f69a715", 2024-01-25T14:52:20.629 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "health": { 2024-01-25T14:52:20.629 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-01-25T14:52:20.629 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-01-25T14:52:20.629 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-01-25T14:52:20.629 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:20.629 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-01-25T14:52:20.629 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-01-25T14:52:20.629 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 0 2024-01-25T14:52:20.629 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-01-25T14:52:20.630 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-01-25T14:52:20.630 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "a" 2024-01-25T14:52:20.630 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-01-25T14:52:20.630 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-01-25T14:52:20.630 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "monmap": { 2024-01-25T14:52:20.630 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:20.630 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-01-25T14:52:20.630 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-01-25T14:52:20.630 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:20.630 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-01-25T14:52:20.630 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:20.630 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-01-25T14:52:20.630 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-01-25T14:52:20.630 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-01-25T14:52:20.639 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-01-25T14:52:20.639 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-01-25T14:52:20.639 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-01-25T14:52:20.639 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:20.640 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-01-25T14:52:20.640 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-01-25T14:52:20.640 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-01-25T14:52:20.640 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-01-25T14:52:20.640 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-01-25T14:52:20.640 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-01-25T14:52:20.640 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-01-25T14:52:20.640 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-01-25T14:52:20.640 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-01-25T14:52:20.640 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:20.640 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-01-25T14:52:20.640 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:20.640 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-01-25T14:52:20.640 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-01-25T14:52:20.641 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:20.641 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-01-25T14:52:20.641 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "available": true, 2024-01-25T14:52:20.641 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-01-25T14:52:20.641 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "modules": [ 2024-01-25T14:52:20.641 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "iostat", 2024-01-25T14:52:20.641 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "nfs", 2024-01-25T14:52:20.641 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "restful" 2024-01-25T14:52:20.641 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ], 2024-01-25T14:52:20.641 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-25T14:52:20.641 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:20.641 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-01-25T14:52:20.641 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-01-25T14:52:20.641 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "modified": "2024-01-25T14:51:53.335654+0000", 2024-01-25T14:52:20.642 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "services": {} 2024-01-25T14:52:20.642 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout }, 2024-01-25T14:52:20.642 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-01-25T14:52:20.642 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout } 2024-01-25T14:52:20.642 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.781+0000 7fe3a8505700 1 Processor -- start 2024-01-25T14:52:20.642 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.782+0000 7fe3a8505700 1 -- start start 2024-01-25T14:52:20.642 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.782+0000 7fe3a8505700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a0105fe0 0x7fe3a0106400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:20.642 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.782+0000 7fe3a8505700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a01069d0 con 0x7fe3a0105fe0 2024-01-25T14:52:20.642 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.782+0000 7fe3a62a1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a0105fe0 0x7fe3a0106400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:20.642 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.782+0000 7fe3a62a1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a0105fe0 0x7fe3a0106400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59648/0 (socket says 172.21.15.170:59648) 2024-01-25T14:52:20.642 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.782+0000 7fe3a62a1700 1 -- 172.21.15.170:0/1352104545 learned_addr learned my addr 172.21.15.170:0/1352104545 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:20.642 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.782+0000 7fe3a62a1700 1 -- 172.21.15.170:0/1352104545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a01071e0 con 0x7fe3a0105fe0 2024-01-25T14:52:20.642 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.783+0000 7fe3a62a1700 1 --2- 172.21.15.170:0/1352104545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a0105fe0 0x7fe3a0106400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0098a0 tx=0x7fe39c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccf687b366c27e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:20.643 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.783+0000 7fe3a529f700 1 -- 172.21.15.170:0/1352104545 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe39c004160 con 0x7fe3a0105fe0 2024-01-25T14:52:20.643 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.783+0000 7fe3a529f700 1 -- 172.21.15.170:0/1352104545 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe39c0042c0 con 0x7fe3a0105fe0 2024-01-25T14:52:20.643 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.783+0000 7fe3a529f700 1 -- 172.21.15.170:0/1352104545 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe39c011a00 con 0x7fe3a0105fe0 2024-01-25T14:52:20.643 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.783+0000 7fe3a8505700 1 -- 172.21.15.170:0/1352104545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a0105fe0 msgr2=0x7fe3a0106400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:20.643 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.783+0000 7fe3a8505700 1 --2- 172.21.15.170:0/1352104545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a0105fe0 0x7fe3a0106400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe39c0098a0 tx=0x7fe39c009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:20.643 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.783+0000 7fe3a8505700 1 -- 172.21.15.170:0/1352104545 shutdown_connections 2024-01-25T14:52:20.643 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.783+0000 7fe3a8505700 1 --2- 172.21.15.170:0/1352104545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a0105fe0 0x7fe3a0106400 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:20.643 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.783+0000 7fe3a8505700 1 -- 172.21.15.170:0/1352104545 >> 172.21.15.170:0/1352104545 conn(0x7fe3a01015e0 msgr2=0x7fe3a0103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:20.643 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.783+0000 7fe3a8505700 1 -- 172.21.15.170:0/1352104545 shutdown_connections 2024-01-25T14:52:20.643 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.783+0000 7fe3a8505700 1 -- 172.21.15.170:0/1352104545 wait complete. 2024-01-25T14:52:20.643 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.784+0000 7fe3a8505700 1 Processor -- start 2024-01-25T14:52:20.643 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.784+0000 7fe3a8505700 1 -- start start 2024-01-25T14:52:20.643 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.784+0000 7fe3a8505700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a0105fe0 0x7fe3a019ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:20.643 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.784+0000 7fe3a8505700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a019b3c0 con 0x7fe3a0105fe0 2024-01-25T14:52:20.643 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.784+0000 7fe3a62a1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a0105fe0 0x7fe3a019ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:20.644 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.784+0000 7fe3a62a1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a0105fe0 0x7fe3a019ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59660/0 (socket says 172.21.15.170:59660) 2024-01-25T14:52:20.644 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.784+0000 7fe3a62a1700 1 -- 172.21.15.170:0/2216233127 learned_addr learned my addr 172.21.15.170:0/2216233127 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:20.644 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.785+0000 7fe3a62a1700 1 -- 172.21.15.170:0/2216233127 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c009550 con 0x7fe3a0105fe0 2024-01-25T14:52:20.644 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.785+0000 7fe3a62a1700 1 --2- 172.21.15.170:0/2216233127 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a0105fe0 0x7fe3a019ae80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009fb0 tx=0x7fe39c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:20.644 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.785+0000 7fe3977fe700 1 -- 172.21.15.170:0/2216233127 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe39c003a40 con 0x7fe3a0105fe0 2024-01-25T14:52:20.644 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.785+0000 7fe3977fe700 1 -- 172.21.15.170:0/2216233127 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe39c003ba0 con 0x7fe3a0105fe0 2024-01-25T14:52:20.644 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.785+0000 7fe3a8505700 1 -- 172.21.15.170:0/2216233127 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a019b5c0 con 0x7fe3a0105fe0 2024-01-25T14:52:20.644 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.785+0000 7fe3977fe700 1 -- 172.21.15.170:0/2216233127 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe39c01a750 con 0x7fe3a0105fe0 2024-01-25T14:52:20.644 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.785+0000 7fe3a8505700 1 -- 172.21.15.170:0/2216233127 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a019ba60 con 0x7fe3a0105fe0 2024-01-25T14:52:20.644 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.786+0000 7fe3977fe700 1 -- 172.21.15.170:0/2216233127 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 4) v1 ==== 45630+0+0 (secure 0 0 0) 0x7fe39c01a980 con 0x7fe3a0105fe0 2024-01-25T14:52:20.644 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.786+0000 7fe3977fe700 1 --2- 172.21.15.170:0/2216233127 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7fe38c0389f0 0x7fe38c03aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:20.644 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.786+0000 7fe3a8505700 1 -- 172.21.15.170:0/2216233127 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a010a410 con 0x7fe3a0105fe0 2024-01-25T14:52:20.644 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.786+0000 7fe3977fe700 1 -- 172.21.15.170:0/2216233127 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe39c04c850 con 0x7fe3a0105fe0 2024-01-25T14:52:20.645 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.786+0000 7fe3a5aa0700 1 --2- 172.21.15.170:0/2216233127 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7fe38c0389f0 0x7fe38c03aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:20.645 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.786+0000 7fe3a5aa0700 1 --2- 172.21.15.170:0/2216233127 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7fe38c0389f0 0x7fe38c03aeb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe390006fd0 tx=0x7fe390006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:20.645 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:19.791+0000 7fe3977fe700 1 -- 172.21.15.170:0/2216233127 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fe39c01ac30 con 0x7fe3a0105fe0 2024-01-25T14:52:20.645 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:20.058+0000 7fe3a8505700 1 -- 172.21.15.170:0/2216233127 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe3a019e340 con 0x7fe3a0105fe0 2024-01-25T14:52:20.645 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:20.059+0000 7fe3977fe700 1 -- 172.21.15.170:0/2216233127 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7fe39c018350 con 0x7fe3a0105fe0 2024-01-25T14:52:20.645 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:20.062+0000 7fe3a8505700 1 -- 172.21.15.170:0/2216233127 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7fe38c0389f0 msgr2=0x7fe38c03aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:20.645 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:20.062+0000 7fe3a8505700 1 --2- 172.21.15.170:0/2216233127 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7fe38c0389f0 0x7fe38c03aeb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe390006fd0 tx=0x7fe390006e40 comp rx=0 tx=0).stop 2024-01-25T14:52:20.645 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:20.062+0000 7fe3a8505700 1 -- 172.21.15.170:0/2216233127 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a0105fe0 msgr2=0x7fe3a019ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:20.645 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:20.062+0000 7fe3a8505700 1 --2- 172.21.15.170:0/2216233127 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a0105fe0 0x7fe3a019ae80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009fb0 tx=0x7fe39c011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:20.645 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:20.062+0000 7fe3a8505700 1 -- 172.21.15.170:0/2216233127 shutdown_connections 2024-01-25T14:52:20.645 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:20.062+0000 7fe3a8505700 1 --2- 172.21.15.170:0/2216233127 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7fe38c0389f0 0x7fe38c03aeb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:20.645 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:20.062+0000 7fe3a8505700 1 --2- 172.21.15.170:0/2216233127 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3a0105fe0 0x7fe3a019ae80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:20.645 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:20.062+0000 7fe3a8505700 1 -- 172.21.15.170:0/2216233127 >> 172.21.15.170:0/2216233127 conn(0x7fe3a01015e0 msgr2=0x7fe3a01021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:20.645 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:20.062+0000 7fe3a8505700 1 -- 172.21.15.170:0/2216233127 shutdown_connections 2024-01-25T14:52:20.646 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:20.062+0000 7fe3a8505700 1 -- 172.21.15.170:0/2216233127 wait complete. 2024-01-25T14:52:20.646 INFO:teuthology.orchestra.run.smithi170.stdout:mgr is available 2024-01-25T14:52:21.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:20 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2216233127' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-01-25T14:52:21.806 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-01-25T14:52:21.806 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout [global] 2024-01-25T14:52:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout fsid = 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:52:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-01-25T14:52:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-01-25T14:52:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-01-25T14:52:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-01-25T14:52:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-01-25T14:52:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout [mgr] 2024-01-25T14:52:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-01-25T14:52:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 2024-01-25T14:52:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout [osd] 2024-01-25T14:52:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-01-25T14:52:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-01-25T14:52:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-01-25T14:52:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-01-25T14:52:21.807 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-01-25T14:52:21.808 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.031+0000 7f856498e700 1 Processor -- start 2024-01-25T14:52:21.808 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.031+0000 7f856498e700 1 -- start start 2024-01-25T14:52:21.808 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.032+0000 7f856498e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8560107b50 0x7f8560109f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:21.808 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.032+0000 7f856498e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856007ae70 con 0x7f8560107b50 2024-01-25T14:52:21.808 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.032+0000 7f855e59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8560107b50 0x7f8560109f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:21.808 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.032+0000 7f855e59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8560107b50 0x7f8560109f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59672/0 (socket says 172.21.15.170:59672) 2024-01-25T14:52:21.808 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.032+0000 7f855e59c700 1 -- 172.21.15.170:0/3851659557 learned_addr learned my addr 172.21.15.170:0/3851659557 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:21.808 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.032+0000 7f855e59c700 1 -- 172.21.15.170:0/3851659557 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856010a480 con 0x7f8560107b50 2024-01-25T14:52:21.808 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.032+0000 7f855e59c700 1 --2- 172.21.15.170:0/3851659557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8560107b50 0x7f8560109f40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f85500098a0 tx=0x7f8550009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d0ce5e3bf65ce6 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:21.808 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.032+0000 7f855d59a700 1 -- 172.21.15.170:0/3851659557 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8550004160 con 0x7f8560107b50 2024-01-25T14:52:21.808 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.032+0000 7f855d59a700 1 -- 172.21.15.170:0/3851659557 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f85500042c0 con 0x7f8560107b50 2024-01-25T14:52:21.808 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.032+0000 7f855d59a700 1 -- 172.21.15.170:0/3851659557 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8550011a00 con 0x7f8560107b50 2024-01-25T14:52:21.808 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.033+0000 7f856498e700 1 -- 172.21.15.170:0/3851659557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8560107b50 msgr2=0x7f8560109f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:21.809 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.033+0000 7f856498e700 1 --2- 172.21.15.170:0/3851659557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8560107b50 0x7f8560109f40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f85500098a0 tx=0x7f8550009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:21.809 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.033+0000 7f856498e700 1 -- 172.21.15.170:0/3851659557 shutdown_connections 2024-01-25T14:52:21.809 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.033+0000 7f856498e700 1 --2- 172.21.15.170:0/3851659557 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8560107b50 0x7f8560109f40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:21.809 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.033+0000 7f856498e700 1 -- 172.21.15.170:0/3851659557 >> 172.21.15.170:0/3851659557 conn(0x7f8560101580 msgr2=0x7f85601039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:21.809 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.033+0000 7f856498e700 1 -- 172.21.15.170:0/3851659557 shutdown_connections 2024-01-25T14:52:21.809 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.033+0000 7f856498e700 1 -- 172.21.15.170:0/3851659557 wait complete. 2024-01-25T14:52:21.809 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.034+0000 7f856498e700 1 Processor -- start 2024-01-25T14:52:21.809 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.034+0000 7f856498e700 1 -- start start 2024-01-25T14:52:21.809 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.034+0000 7f856498e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8560107b50 0x7f85601073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:21.809 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.034+0000 7f856498e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8560107910 con 0x7f8560107b50 2024-01-25T14:52:21.809 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.034+0000 7f855e59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8560107b50 0x7f85601073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:21.809 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.034+0000 7f855e59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8560107b50 0x7f85601073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59676/0 (socket says 172.21.15.170:59676) 2024-01-25T14:52:21.809 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.034+0000 7f855e59c700 1 -- 172.21.15.170:0/2236289196 learned_addr learned my addr 172.21.15.170:0/2236289196 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:21.809 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.034+0000 7f855e59c700 1 -- 172.21.15.170:0/2236289196 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8550009550 con 0x7f8560107b50 2024-01-25T14:52:21.810 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.035+0000 7f855e59c700 1 --2- 172.21.15.170:0/2236289196 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8560107b50 0x7f85601073d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8550009130 tx=0x7f8550011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:21.810 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.035+0000 7f854f7fe700 1 -- 172.21.15.170:0/2236289196 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8550003b70 con 0x7f8560107b50 2024-01-25T14:52:21.810 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.035+0000 7f854f7fe700 1 -- 172.21.15.170:0/2236289196 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8550003cd0 con 0x7f8560107b50 2024-01-25T14:52:21.810 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.035+0000 7f856498e700 1 -- 172.21.15.170:0/2236289196 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8560105b00 con 0x7f8560107b50 2024-01-25T14:52:21.810 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.035+0000 7f854f7fe700 1 -- 172.21.15.170:0/2236289196 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85500197d0 con 0x7f8560107b50 2024-01-25T14:52:21.810 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.035+0000 7f856498e700 1 -- 172.21.15.170:0/2236289196 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8560105fa0 con 0x7f8560107b50 2024-01-25T14:52:21.810 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.035+0000 7f854f7fe700 1 -- 172.21.15.170:0/2236289196 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 4) v1 ==== 45630+0+0 (secure 0 0 0) 0x7f85500199c0 con 0x7f8560107b50 2024-01-25T14:52:21.810 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.036+0000 7f854f7fe700 1 --2- 172.21.15.170:0/2236289196 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f8548038a40 0x7f854803af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:21.810 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.036+0000 7f854f7fe700 1 -- 172.21.15.170:0/2236289196 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f855004cbf0 con 0x7f8560107b50 2024-01-25T14:52:21.810 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.036+0000 7f855dd9b700 1 --2- 172.21.15.170:0/2236289196 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f8548038a40 0x7f854803af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:21.810 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.036+0000 7f856498e700 1 -- 172.21.15.170:0/2236289196 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856010b220 con 0x7f8560107b50 2024-01-25T14:52:21.810 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.036+0000 7f855dd9b700 1 --2- 172.21.15.170:0/2236289196 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f8548038a40 0x7f854803af00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8554006fd0 tx=0x7f8554006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:21.810 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.041+0000 7f854f7fe700 1 -- 172.21.15.170:0/2236289196 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f8550018db0 con 0x7f8560107b50 2024-01-25T14:52:21.811 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.235+0000 7f856498e700 1 -- 172.21.15.170:0/2236289196 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f856010b3b0 con 0x7f8560107b50 2024-01-25T14:52:21.811 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.236+0000 7f854f7fe700 1 -- 172.21.15.170:0/2236289196 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f8550018350 con 0x7f8560107b50 2024-01-25T14:52:21.811 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.238+0000 7f856498e700 1 -- 172.21.15.170:0/2236289196 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f8548038a40 msgr2=0x7f854803af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:21.811 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.238+0000 7f856498e700 1 --2- 172.21.15.170:0/2236289196 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f8548038a40 0x7f854803af00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8554006fd0 tx=0x7f8554006e40 comp rx=0 tx=0).stop 2024-01-25T14:52:21.811 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.238+0000 7f856498e700 1 -- 172.21.15.170:0/2236289196 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8560107b50 msgr2=0x7f85601073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:21.811 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.238+0000 7f856498e700 1 --2- 172.21.15.170:0/2236289196 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8560107b50 0x7f85601073d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8550009130 tx=0x7f8550011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:21.811 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.238+0000 7f856498e700 1 -- 172.21.15.170:0/2236289196 shutdown_connections 2024-01-25T14:52:21.811 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.238+0000 7f856498e700 1 --2- 172.21.15.170:0/2236289196 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f8548038a40 0x7f854803af00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:21.811 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.238+0000 7f856498e700 1 --2- 172.21.15.170:0/2236289196 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8560107b50 0x7f85601073d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:21.811 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.238+0000 7f856498e700 1 -- 172.21.15.170:0/2236289196 >> 172.21.15.170:0/2236289196 conn(0x7f8560101580 msgr2=0x7f8560102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:21.811 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.238+0000 7f856498e700 1 -- 172.21.15.170:0/2236289196 shutdown_connections 2024-01-25T14:52:21.811 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:21.238+0000 7f856498e700 1 -- 172.21.15.170:0/2236289196 wait complete. 2024-01-25T14:52:21.811 INFO:teuthology.orchestra.run.smithi170.stdout:Enabling cephadm module... 2024-01-25T14:52:22.208 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:21 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2236289196' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-01-25T14:52:23.228 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:22 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2208512740' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-01-25T14:52:23.228 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:22 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: ignoring --setuser ceph since I am not root 2024-01-25T14:52:23.228 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:22 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: ignoring --setgroup ceph since I am not root 2024-01-25T14:52:23.478 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:23.468+0000 7f7989a22200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-25T14:52:23.486 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.223+0000 7f5ebb31a700 1 Processor -- start 2024-01-25T14:52:23.486 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.223+0000 7f5ebb31a700 1 -- start start 2024-01-25T14:52:23.486 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.223+0000 7f5ebb31a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb4105720 0x7f5eb4105b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:23.486 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.223+0000 7f5ebb31a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb4106110 con 0x7f5eb4105720 2024-01-25T14:52:23.486 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.223+0000 7f5eb90b6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb4105720 0x7f5eb4105b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:23.486 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.223+0000 7f5eb90b6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb4105720 0x7f5eb4105b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59690/0 (socket says 172.21.15.170:59690) 2024-01-25T14:52:23.486 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.223+0000 7f5eb90b6700 1 -- 172.21.15.170:0/346234755 learned_addr learned my addr 172.21.15.170:0/346234755 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:23.487 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.223+0000 7f5eb90b6700 1 -- 172.21.15.170:0/346234755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb4106920 con 0x7f5eb4105720 2024-01-25T14:52:23.487 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.223+0000 7f5eb90b6700 1 --2- 172.21.15.170:0/346234755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb4105720 0x7f5eb4105b40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40098a0 tx=0x7f5ea4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e47e6db6c19c8a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:23.487 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.224+0000 7f5eabfff700 1 -- 172.21.15.170:0/346234755 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ea4004160 con 0x7f5eb4105720 2024-01-25T14:52:23.487 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.224+0000 7f5eabfff700 1 -- 172.21.15.170:0/346234755 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5ea40042c0 con 0x7f5eb4105720 2024-01-25T14:52:23.487 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.224+0000 7f5eabfff700 1 -- 172.21.15.170:0/346234755 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ea4011a00 con 0x7f5eb4105720 2024-01-25T14:52:23.487 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.224+0000 7f5ebb31a700 1 -- 172.21.15.170:0/346234755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb4105720 msgr2=0x7f5eb4105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:23.487 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.224+0000 7f5ebb31a700 1 --2- 172.21.15.170:0/346234755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb4105720 0x7f5eb4105b40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40098a0 tx=0x7f5ea4009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:23.487 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.224+0000 7f5ebb31a700 1 -- 172.21.15.170:0/346234755 shutdown_connections 2024-01-25T14:52:23.487 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.224+0000 7f5ebb31a700 1 --2- 172.21.15.170:0/346234755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb4105720 0x7f5eb4105b40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:23.487 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.224+0000 7f5ebb31a700 1 -- 172.21.15.170:0/346234755 >> 172.21.15.170:0/346234755 conn(0x7f5eb4100da0 msgr2=0x7f5eb41031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:23.487 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.224+0000 7f5ebb31a700 1 -- 172.21.15.170:0/346234755 shutdown_connections 2024-01-25T14:52:23.487 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.224+0000 7f5ebb31a700 1 -- 172.21.15.170:0/346234755 wait complete. 2024-01-25T14:52:23.487 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.225+0000 7f5ebb31a700 1 Processor -- start 2024-01-25T14:52:23.488 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.225+0000 7f5ebb31a700 1 -- start start 2024-01-25T14:52:23.488 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.225+0000 7f5ebb31a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb4105720 0x7f5eb41907d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:23.488 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.225+0000 7f5ebb31a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb4190d10 con 0x7f5eb4105720 2024-01-25T14:52:23.488 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.225+0000 7f5eb90b6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb4105720 0x7f5eb41907d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:23.488 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.225+0000 7f5eb90b6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb4105720 0x7f5eb41907d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59700/0 (socket says 172.21.15.170:59700) 2024-01-25T14:52:23.488 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.225+0000 7f5eb90b6700 1 -- 172.21.15.170:0/2208512740 learned_addr learned my addr 172.21.15.170:0/2208512740 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:23.488 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.225+0000 7f5eb90b6700 1 -- 172.21.15.170:0/2208512740 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea4009550 con 0x7f5eb4105720 2024-01-25T14:52:23.488 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.225+0000 7f5eb90b6700 1 --2- 172.21.15.170:0/2208512740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb4105720 0x7f5eb41907d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009fb0 tx=0x7f5ea4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:23.488 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.226+0000 7f5eaa7fc700 1 -- 172.21.15.170:0/2208512740 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ea4003a40 con 0x7f5eb4105720 2024-01-25T14:52:23.488 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.226+0000 7f5eaa7fc700 1 -- 172.21.15.170:0/2208512740 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5ea4003ba0 con 0x7f5eb4105720 2024-01-25T14:52:23.488 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.226+0000 7f5ebb31a700 1 -- 172.21.15.170:0/2208512740 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb418ef00 con 0x7f5eb4105720 2024-01-25T14:52:23.488 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.226+0000 7f5eaa7fc700 1 -- 172.21.15.170:0/2208512740 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5ea401a750 con 0x7f5eb4105720 2024-01-25T14:52:23.489 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.226+0000 7f5ebb31a700 1 -- 172.21.15.170:0/2208512740 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb418f3a0 con 0x7f5eb4105720 2024-01-25T14:52:23.489 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.226+0000 7f5eaa7fc700 1 -- 172.21.15.170:0/2208512740 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 4) v1 ==== 45630+0+0 (secure 0 0 0) 0x7f5ea401a9d0 con 0x7f5eb4105720 2024-01-25T14:52:23.489 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.227+0000 7f5eaa7fc700 1 --2- 172.21.15.170:0/2208512740 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f5ea00389a0 0x7f5ea003ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:23.489 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.227+0000 7f5eaa7fc700 1 -- 172.21.15.170:0/2208512740 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5ea404c800 con 0x7f5eb4105720 2024-01-25T14:52:23.489 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.227+0000 7f5eb88b5700 1 --2- 172.21.15.170:0/2208512740 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f5ea00389a0 0x7f5ea003ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:23.489 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.227+0000 7f5ebb31a700 1 -- 172.21.15.170:0/2208512740 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb4062e10 con 0x7f5eb4105720 2024-01-25T14:52:23.489 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.227+0000 7f5eb88b5700 1 --2- 172.21.15.170:0/2208512740 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f5ea00389a0 0x7f5ea003ae60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0006fd0 tx=0x7f5eb0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:23.489 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.232+0000 7f5eaa7fc700 1 -- 172.21.15.170:0/2208512740 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f5ea4018db0 con 0x7f5eb4105720 2024-01-25T14:52:23.489 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.477+0000 7f5ebb31a700 1 -- 172.21.15.170:0/2208512740 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f5eb4194180 con 0x7f5eb4105720 2024-01-25T14:52:23.489 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.929+0000 7f5eaa7fc700 1 -- 172.21.15.170:0/2208512740 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f5ea4018350 con 0x7f5eb4105720 2024-01-25T14:52:23.489 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.930+0000 7f5eaa7fc700 1 -- 172.21.15.170:0/2208512740 <== mon.0 v2:172.21.15.170:3300/0 8 ==== mgrmap(e 5) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f5ea402d910 con 0x7f5eb4105720 2024-01-25T14:52:23.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.931+0000 7f5ebb31a700 1 -- 172.21.15.170:0/2208512740 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f5ea00389a0 msgr2=0x7f5ea003ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:23.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.931+0000 7f5ebb31a700 1 --2- 172.21.15.170:0/2208512740 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f5ea00389a0 0x7f5ea003ae60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0006fd0 tx=0x7f5eb0006e40 comp rx=0 tx=0).stop 2024-01-25T14:52:23.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.931+0000 7f5ebb31a700 1 -- 172.21.15.170:0/2208512740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb4105720 msgr2=0x7f5eb41907d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:23.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.931+0000 7f5ebb31a700 1 --2- 172.21.15.170:0/2208512740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb4105720 0x7f5eb41907d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009fb0 tx=0x7f5ea4011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:23.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.931+0000 7f5ebb31a700 1 -- 172.21.15.170:0/2208512740 shutdown_connections 2024-01-25T14:52:23.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.931+0000 7f5ebb31a700 1 --2- 172.21.15.170:0/2208512740 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f5ea00389a0 0x7f5ea003ae60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:23.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.931+0000 7f5ebb31a700 1 --2- 172.21.15.170:0/2208512740 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5eb4105720 0x7f5eb41907d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:23.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.931+0000 7f5ebb31a700 1 -- 172.21.15.170:0/2208512740 >> 172.21.15.170:0/2208512740 conn(0x7f5eb4100da0 msgr2=0x7f5eb4102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:23.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.932+0000 7f5ebb31a700 1 -- 172.21.15.170:0/2208512740 shutdown_connections 2024-01-25T14:52:23.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:22.932+0000 7f5ebb31a700 1 -- 172.21.15.170:0/2208512740 wait complete. 2024-01-25T14:52:23.747 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:23.573+0000 7f7989a22200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-25T14:52:24.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:23 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2208512740' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-01-25T14:52:24.051 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:23 smithi170 ceph-mon[31899]: mgrmap e5: x(active, since 6s) 2024-01-25T14:52:24.316 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:24 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:24.225+0000 7f7989a22200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-25T14:52:24.316 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:24 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:24.315+0000 7f7989a22200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-25T14:52:24.581 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:24 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:24.402+0000 7f7989a22200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-25T14:52:24.581 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:24 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:24.553+0000 7f7989a22200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-25T14:52:24.702 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout { 2024-01-25T14:52:24.702 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-01-25T14:52:24.702 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "available": true, 2024-01-25T14:52:24.702 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-01-25T14:52:24.702 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-01-25T14:52:24.702 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout } 2024-01-25T14:52:24.703 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.844+0000 7f54f0839700 1 Processor -- start 2024-01-25T14:52:24.703 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.844+0000 7f54f0839700 1 -- start start 2024-01-25T14:52:24.703 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.845+0000 7f54f0839700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54ec107ba0 0x7f54ec109f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:24.703 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.845+0000 7f54f0839700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec07af90 con 0x7f54ec107ba0 2024-01-25T14:52:24.703 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.845+0000 7f54ea59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54ec107ba0 0x7f54ec109f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:24.703 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.845+0000 7f54ea59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54ec107ba0 0x7f54ec109f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59730/0 (socket says 172.21.15.170:59730) 2024-01-25T14:52:24.703 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.845+0000 7f54ea59c700 1 -- 172.21.15.170:0/3612536665 learned_addr learned my addr 172.21.15.170:0/3612536665 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:24.703 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.845+0000 7f54ea59c700 1 -- 172.21.15.170:0/3612536665 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec10a4d0 con 0x7f54ec107ba0 2024-01-25T14:52:24.703 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.845+0000 7f54ea59c700 1 --2- 172.21.15.170:0/3612536665 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54ec107ba0 0x7f54ec109f90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0098a0 tx=0x7f54dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4644f7bf9eafac server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:24.703 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.846+0000 7f54e959a700 1 -- 172.21.15.170:0/3612536665 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54dc004160 con 0x7f54ec107ba0 2024-01-25T14:52:24.703 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.846+0000 7f54e959a700 1 -- 172.21.15.170:0/3612536665 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54dc0042c0 con 0x7f54ec107ba0 2024-01-25T14:52:24.703 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.846+0000 7f54e959a700 1 -- 172.21.15.170:0/3612536665 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54dc011a00 con 0x7f54ec107ba0 2024-01-25T14:52:24.703 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.846+0000 7f54f0839700 1 -- 172.21.15.170:0/3612536665 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54ec107ba0 msgr2=0x7f54ec109f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:24.704 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.846+0000 7f54f0839700 1 --2- 172.21.15.170:0/3612536665 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54ec107ba0 0x7f54ec109f90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0098a0 tx=0x7f54dc009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:24.704 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.846+0000 7f54f0839700 1 -- 172.21.15.170:0/3612536665 shutdown_connections 2024-01-25T14:52:24.704 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.846+0000 7f54f0839700 1 --2- 172.21.15.170:0/3612536665 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54ec107ba0 0x7f54ec109f90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:24.704 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.846+0000 7f54f0839700 1 -- 172.21.15.170:0/3612536665 >> 172.21.15.170:0/3612536665 conn(0x7f54ec1015b0 msgr2=0x7f54ec1039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:24.704 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.846+0000 7f54f0839700 1 -- 172.21.15.170:0/3612536665 shutdown_connections 2024-01-25T14:52:24.704 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.846+0000 7f54f0839700 1 -- 172.21.15.170:0/3612536665 wait complete. 2024-01-25T14:52:24.704 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.847+0000 7f54f0839700 1 Processor -- start 2024-01-25T14:52:24.704 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.847+0000 7f54f0839700 1 -- start start 2024-01-25T14:52:24.704 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.847+0000 7f54f0839700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54ec107ba0 0x7f54ec19af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:24.704 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.847+0000 7f54f0839700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec19b4d0 con 0x7f54ec107ba0 2024-01-25T14:52:24.704 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.847+0000 7f54ea59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54ec107ba0 0x7f54ec19af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:24.704 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.847+0000 7f54ea59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54ec107ba0 0x7f54ec19af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59740/0 (socket says 172.21.15.170:59740) 2024-01-25T14:52:24.704 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.847+0000 7f54ea59c700 1 -- 172.21.15.170:0/3551622788 learned_addr learned my addr 172.21.15.170:0/3551622788 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:24.704 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.848+0000 7f54ea59c700 1 -- 172.21.15.170:0/3551622788 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc009550 con 0x7f54ec107ba0 2024-01-25T14:52:24.705 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.848+0000 7f54ea59c700 1 --2- 172.21.15.170:0/3551622788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54ec107ba0 0x7f54ec19af90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009130 tx=0x7f54dc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:24.705 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.848+0000 7f54db7fe700 1 -- 172.21.15.170:0/3551622788 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54dc0038b0 con 0x7f54ec107ba0 2024-01-25T14:52:24.705 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.848+0000 7f54db7fe700 1 -- 172.21.15.170:0/3551622788 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f54dc003a10 con 0x7f54ec107ba0 2024-01-25T14:52:24.705 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.848+0000 7f54f0839700 1 -- 172.21.15.170:0/3551622788 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ec19b6d0 con 0x7f54ec107ba0 2024-01-25T14:52:24.705 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.848+0000 7f54db7fe700 1 -- 172.21.15.170:0/3551622788 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f54dc019550 con 0x7f54ec107ba0 2024-01-25T14:52:24.705 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.848+0000 7f54f0839700 1 -- 172.21.15.170:0/3551622788 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ec19bb70 con 0x7f54ec107ba0 2024-01-25T14:52:24.705 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.849+0000 7f54db7fe700 1 -- 172.21.15.170:0/3551622788 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f54dc019830 con 0x7f54ec107ba0 2024-01-25T14:52:24.705 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.849+0000 7f54db7fe700 1 --2- 172.21.15.170:0/3551622788 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f54d40389f0 0x7f54d403aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:24.705 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.849+0000 7f54f0839700 1 -- 172.21.15.170:0/3551622788 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ec10b390 con 0x7f54ec107ba0 2024-01-25T14:52:24.705 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.849+0000 7f54e9d9b700 1 -- 172.21.15.170:0/3551622788 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f54d40389f0 msgr2=0x7f54d403aeb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.170:6800/622367049 2024-01-25T14:52:24.705 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.849+0000 7f54db7fe700 1 -- 172.21.15.170:0/3551622788 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f54dc04c970 con 0x7f54ec107ba0 2024-01-25T14:52:24.705 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.849+0000 7f54e9d9b700 1 --2- 172.21.15.170:0/3551622788 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f54d40389f0 0x7f54d403aeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-25T14:52:24.706 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:23.854+0000 7f54db7fe700 1 -- 172.21.15.170:0/3551622788 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f54dc018530 con 0x7f54ec107ba0 2024-01-25T14:52:24.706 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:24.050+0000 7f54e9d9b700 1 -- 172.21.15.170:0/3551622788 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f54d40389f0 msgr2=0x7f54d403aeb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.170:6800/622367049 2024-01-25T14:52:24.706 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:24.050+0000 7f54e9d9b700 1 --2- 172.21.15.170:0/3551622788 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f54d40389f0 0x7f54d403aeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-25T14:52:24.706 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:24.103+0000 7f54f0839700 1 -- 172.21.15.170:0/3551622788 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f54ec105c50 con 0x7f54ec107ba0 2024-01-25T14:52:24.706 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:24.103+0000 7f54db7fe700 1 -- 172.21.15.170:0/3551622788 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f54dc018350 con 0x7f54ec107ba0 2024-01-25T14:52:24.706 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:24.105+0000 7f54f0839700 1 -- 172.21.15.170:0/3551622788 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f54d40389f0 msgr2=0x7f54d403aeb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-25T14:52:24.706 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:24.105+0000 7f54f0839700 1 --2- 172.21.15.170:0/3551622788 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f54d40389f0 0x7f54d403aeb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:24.706 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:24.105+0000 7f54f0839700 1 -- 172.21.15.170:0/3551622788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54ec107ba0 msgr2=0x7f54ec19af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:24.706 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:24.105+0000 7f54f0839700 1 --2- 172.21.15.170:0/3551622788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54ec107ba0 0x7f54ec19af90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009130 tx=0x7f54dc011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:24.706 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:24.105+0000 7f54f0839700 1 -- 172.21.15.170:0/3551622788 shutdown_connections 2024-01-25T14:52:24.706 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:24.105+0000 7f54f0839700 1 --2- 172.21.15.170:0/3551622788 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f54d40389f0 0x7f54d403aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:24.706 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:24.105+0000 7f54f0839700 1 --2- 172.21.15.170:0/3551622788 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f54ec107ba0 0x7f54ec19af90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:24.706 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:24.105+0000 7f54f0839700 1 -- 172.21.15.170:0/3551622788 >> 172.21.15.170:0/3551622788 conn(0x7f54ec1015b0 msgr2=0x7f54ec102140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:24.706 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:24.106+0000 7f54f0839700 1 -- 172.21.15.170:0/3551622788 shutdown_connections 2024-01-25T14:52:24.706 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:24.106+0000 7f54f0839700 1 -- 172.21.15.170:0/3551622788 wait complete. 2024-01-25T14:52:24.707 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for the mgr to restart... 2024-01-25T14:52:24.707 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for mgr epoch 5... 2024-01-25T14:52:24.874 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:24 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:24.637+0000 7f7989a22200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-25T14:52:24.874 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:24 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:24.821+0000 7f7989a22200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-25T14:52:25.193 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:24 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3551622788' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-01-25T14:52:25.193 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:25 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:25.006+0000 7f7989a22200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-25T14:52:25.194 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:25 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:25.094+0000 7f7989a22200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-25T14:52:25.194 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:25 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:25.192+0000 7f7989a22200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-25T14:52:25.624 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:25 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:25.280+0000 7f7989a22200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-25T14:52:26.624 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:26 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:26.316+0000 7f7989a22200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-25T14:52:26.624 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:26 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:26.444+0000 7f7989a22200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-25T14:52:27.049 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:26 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:26.643+0000 7f7989a22200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-25T14:52:27.049 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:26 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:26.870+0000 7f7989a22200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-25T14:52:27.049 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:27 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:27.048+0000 7f7989a22200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-25T14:52:27.374 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:27 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:27.230+0000 7f7989a22200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-25T14:52:27.874 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:27 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:27.492+0000 7f7989a22200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-25T14:52:27.874 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:27 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:27.578+0000 7f7989a22200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-25T14:52:28.374 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:27 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:27.968+0000 7f7989a22200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-25T14:52:29.124 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:28 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:28.746+0000 7f7989a22200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-25T14:52:29.600 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:29.307+0000 7f7989a22200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-25T14:52:29.600 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:29.403+0000 7f7989a22200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-25T14:52:29.600 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:29.599+0000 7f7989a22200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-25T14:52:29.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-mon[31899]: Active manager daemon x restarted 2024-01-25T14:52:29.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-mon[31899]: Activating manager daemon x 2024-01-25T14:52:29.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-mon[31899]: osdmap e2: 0 total, 0 up, 0 in 2024-01-25T14:52:29.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-mon[31899]: mgrmap e6: x(active, starting, since 0.00333221s) 2024-01-25T14:52:29.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:52:29.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-25T14:52:29.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-25T14:52:29.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-25T14:52:29.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-25T14:52:29.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-mon[31899]: Manager daemon x is now available 2024-01-25T14:52:29.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' 2024-01-25T14:52:29.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' 2024-01-25T14:52:29.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:52:29.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:29 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:52:30.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:30 smithi170 ceph-mon[31899]: Found migration_current of "None". Setting to last migration. 2024-01-25T14:52:30.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:30 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:52:30.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:30 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-25T14:52:30.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:30 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-25T14:52:30.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:30 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' 2024-01-25T14:52:30.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:30 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' 2024-01-25T14:52:30.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:30 smithi170 ceph-mon[31899]: mgrmap e7: x(active, since 1.0052s) 2024-01-25T14:52:31.101 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout { 2024-01-25T14:52:31.102 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-01-25T14:52:31.102 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "initialized": true 2024-01-25T14:52:31.102 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout } 2024-01-25T14:52:31.102 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.145+0000 7f2cced9d700 1 Processor -- start 2024-01-25T14:52:31.102 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.145+0000 7f2cced9d700 1 -- start start 2024-01-25T14:52:31.102 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.146+0000 7f2cced9d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cc81057e0 0x7f2cc8105c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:31.102 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.146+0000 7f2cced9d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc807ae20 con 0x7f2cc81057e0 2024-01-25T14:52:31.102 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.146+0000 7f2ccdd9b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cc81057e0 0x7f2cc8105c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:31.102 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.146+0000 7f2ccdd9b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cc81057e0 0x7f2cc8105c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59744/0 (socket says 172.21.15.170:59744) 2024-01-25T14:52:31.102 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.146+0000 7f2ccdd9b700 1 -- 172.21.15.170:0/4145271544 learned_addr learned my addr 172.21.15.170:0/4145271544 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:31.102 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.146+0000 7f2ccdd9b700 1 -- 172.21.15.170:0/4145271544 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc807af60 con 0x7f2cc81057e0 2024-01-25T14:52:31.103 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.146+0000 7f2ccdd9b700 1 --2- 172.21.15.170:0/4145271544 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cc81057e0 0x7f2cc8105c00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40098a0 tx=0x7f2cc4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42203dc59cef3604 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:31.103 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.147+0000 7f2cccd99700 1 -- 172.21.15.170:0/4145271544 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cc4004160 con 0x7f2cc81057e0 2024-01-25T14:52:31.103 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.147+0000 7f2cccd99700 1 -- 172.21.15.170:0/4145271544 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2cc40042c0 con 0x7f2cc81057e0 2024-01-25T14:52:31.103 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.147+0000 7f2cccd99700 1 -- 172.21.15.170:0/4145271544 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cc4011a00 con 0x7f2cc81057e0 2024-01-25T14:52:31.103 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.147+0000 7f2cced9d700 1 -- 172.21.15.170:0/4145271544 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cc81057e0 msgr2=0x7f2cc8105c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:31.103 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.147+0000 7f2cced9d700 1 --2- 172.21.15.170:0/4145271544 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cc81057e0 0x7f2cc8105c00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40098a0 tx=0x7f2cc4009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:31.103 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.147+0000 7f2cced9d700 1 -- 172.21.15.170:0/4145271544 shutdown_connections 2024-01-25T14:52:31.103 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.147+0000 7f2cced9d700 1 --2- 172.21.15.170:0/4145271544 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cc81057e0 0x7f2cc8105c00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:31.103 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.147+0000 7f2cced9d700 1 -- 172.21.15.170:0/4145271544 >> 172.21.15.170:0/4145271544 conn(0x7f2cc8101400 msgr2=0x7f2cc8103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:31.103 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.147+0000 7f2cced9d700 1 -- 172.21.15.170:0/4145271544 shutdown_connections 2024-01-25T14:52:31.103 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.147+0000 7f2cced9d700 1 -- 172.21.15.170:0/4145271544 wait complete. 2024-01-25T14:52:31.104 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.148+0000 7f2cced9d700 1 Processor -- start 2024-01-25T14:52:31.104 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.148+0000 7f2cced9d700 1 -- start start 2024-01-25T14:52:31.104 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.148+0000 7f2cced9d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cc81057e0 0x7f2cc819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:31.104 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.148+0000 7f2cced9d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc819d370 con 0x7f2cc81057e0 2024-01-25T14:52:31.104 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.148+0000 7f2ccdd9b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cc81057e0 0x7f2cc819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:31.104 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.148+0000 7f2ccdd9b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cc81057e0 0x7f2cc819ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59756/0 (socket says 172.21.15.170:59756) 2024-01-25T14:52:31.104 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.148+0000 7f2ccdd9b700 1 -- 172.21.15.170:0/597782815 learned_addr learned my addr 172.21.15.170:0/597782815 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:31.104 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.149+0000 7f2ccdd9b700 1 -- 172.21.15.170:0/597782815 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4009550 con 0x7f2cc81057e0 2024-01-25T14:52:31.104 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.149+0000 7f2ccdd9b700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cc81057e0 0x7f2cc819ce30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009fb0 tx=0x7f2cc4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:31.104 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.149+0000 7f2cbeffd700 1 -- 172.21.15.170:0/597782815 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cc4003a40 con 0x7f2cc81057e0 2024-01-25T14:52:31.104 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.149+0000 7f2cbeffd700 1 -- 172.21.15.170:0/597782815 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2cc4003ba0 con 0x7f2cc81057e0 2024-01-25T14:52:31.104 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.149+0000 7f2cbeffd700 1 -- 172.21.15.170:0/597782815 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2cc401a750 con 0x7f2cc81057e0 2024-01-25T14:52:31.105 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.149+0000 7f2cced9d700 1 -- 172.21.15.170:0/597782815 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc819d570 con 0x7f2cc81057e0 2024-01-25T14:52:31.105 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.149+0000 7f2cced9d700 1 -- 172.21.15.170:0/597782815 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc819da10 con 0x7f2cc81057e0 2024-01-25T14:52:31.105 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.150+0000 7f2cbeffd700 1 -- 172.21.15.170:0/597782815 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 5) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f2cc4024430 con 0x7f2cc81057e0 2024-01-25T14:52:31.105 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.150+0000 7f2cbeffd700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f2cb4038a40 0x7f2cb403af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:31.105 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.150+0000 7f2cbeffd700 1 -- 172.21.15.170:0/597782815 --> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2cb403b610 con 0x7f2cb4038a40 2024-01-25T14:52:31.105 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.150+0000 7f2cbeffd700 1 -- 172.21.15.170:0/597782815 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2cc404c550 con 0x7f2cc81057e0 2024-01-25T14:52:31.105 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.150+0000 7f2ccd59a700 1 -- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f2cb4038a40 msgr2=0x7f2cb403af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.170:6800/622367049 2024-01-25T14:52:31.105 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.150+0000 7f2ccd59a700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f2cb4038a40 0x7f2cb403af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-25T14:52:31.105 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.351+0000 7f2ccd59a700 1 -- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f2cb4038a40 msgr2=0x7f2cb403af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.170:6800/622367049 2024-01-25T14:52:31.105 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.351+0000 7f2ccd59a700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f2cb4038a40 0x7f2cb403af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-25T14:52:31.105 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.752+0000 7f2ccd59a700 1 -- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f2cb4038a40 msgr2=0x7f2cb403af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.170:6800/622367049 2024-01-25T14:52:31.106 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:25.752+0000 7f2ccd59a700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f2cb4038a40 0x7f2cb403af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-25T14:52:31.106 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:26.553+0000 7f2ccd59a700 1 -- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f2cb4038a40 msgr2=0x7f2cb403af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.170:6800/622367049 2024-01-25T14:52:31.106 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:26.553+0000 7f2ccd59a700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f2cb4038a40 0x7f2cb403af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-25T14:52:31.106 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:28.154+0000 7f2ccd59a700 1 -- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f2cb4038a40 msgr2=0x7f2cb403af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.170:6800/622367049 2024-01-25T14:52:31.106 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:28.154+0000 7f2ccd59a700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f2cb4038a40 0x7f2cb403af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-01-25T14:52:31.106 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:29.614+0000 7f2cbeffd700 1 -- 172.21.15.170:0/597782815 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mgrmap(e 6) v1 ==== 45408+0+0 (secure 0 0 0) 0x7f2cc40246e0 con 0x7f2cc81057e0 2024-01-25T14:52:31.106 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:29.614+0000 7f2cbeffd700 1 -- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f2cb4038a40 msgr2=0x7f2cb403af00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-25T14:52:31.106 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:29.614+0000 7f2cbeffd700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f2cb4038a40 0x7f2cb403af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:31.106 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.615+0000 7f2cbeffd700 1 -- 172.21.15.170:0/597782815 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mgrmap(e 7) v1 ==== 45535+0+0 (secure 0 0 0) 0x7f2cc404e000 con 0x7f2cc81057e0 2024-01-25T14:52:31.106 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.615+0000 7f2cbeffd700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f2cb403c440 0x7f2cb403e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:31.106 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.615+0000 7f2cbeffd700 1 -- 172.21.15.170:0/597782815 --> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2cb403b610 con 0x7f2cb403c440 2024-01-25T14:52:31.106 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.615+0000 7f2ccd59a700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f2cb403c440 0x7f2cb403e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:31.106 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.616+0000 7f2ccd59a700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f2cb403c440 0x7f2cb403e830 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8003a10 tx=0x7f2cb80092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:31.107 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.617+0000 7f2cbeffd700 1 -- 172.21.15.170:0/597782815 <== mgr.14120 v2:172.21.15.170:6800/358194066 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f2cb403b610 con 0x7f2cb403c440 2024-01-25T14:52:31.107 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.623+0000 7f2cced9d700 1 -- 172.21.15.170:0/597782815 --> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f2cc807af60 con 0x7f2cb403c440 2024-01-25T14:52:31.107 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.623+0000 7f2cbeffd700 1 -- 172.21.15.170:0/597782815 <== mgr.14120 v2:172.21.15.170:6800/358194066 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f2cc807af60 con 0x7f2cb403c440 2024-01-25T14:52:31.107 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.623+0000 7f2cced9d700 1 -- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f2cb403c440 msgr2=0x7f2cb403e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:31.107 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.623+0000 7f2cced9d700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f2cb403c440 0x7f2cb403e830 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f2cb8003a10 tx=0x7f2cb80092b0 comp rx=0 tx=0).stop 2024-01-25T14:52:31.107 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.623+0000 7f2cced9d700 1 -- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cc81057e0 msgr2=0x7f2cc819ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:31.107 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.623+0000 7f2cced9d700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cc81057e0 0x7f2cc819ce30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009fb0 tx=0x7f2cc4011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:31.107 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.623+0000 7f2cced9d700 1 -- 172.21.15.170:0/597782815 shutdown_connections 2024-01-25T14:52:31.107 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.623+0000 7f2cced9d700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f2cb403c440 0x7f2cb403e830 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:31.107 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.623+0000 7f2cced9d700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2cc81057e0 0x7f2cc819ce30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:31.107 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.623+0000 7f2cced9d700 1 --2- 172.21.15.170:0/597782815 >> [v2:172.21.15.170:6800/622367049,v1:172.21.15.170:6801/622367049] conn(0x7f2cb4038a40 0x7f2cb403af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:31.108 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.623+0000 7f2cced9d700 1 -- 172.21.15.170:0/597782815 >> 172.21.15.170:0/597782815 conn(0x7f2cc8101400 msgr2=0x7f2cc8193c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:31.108 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.624+0000 7f2cced9d700 1 -- 172.21.15.170:0/597782815 shutdown_connections 2024-01-25T14:52:31.108 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:30.624+0000 7f2cced9d700 1 -- 172.21.15.170:0/597782815 wait complete. 2024-01-25T14:52:31.108 INFO:teuthology.orchestra.run.smithi170.stdout:mgr epoch 5 is available 2024-01-25T14:52:31.108 INFO:teuthology.orchestra.run.smithi170.stdout:Setting orchestrator backend to cephadm... 2024-01-25T14:52:31.778 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:31 smithi170 ceph-mon[31899]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-01-25T14:52:31.778 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:31 smithi170 ceph-mon[31899]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-01-25T14:52:31.778 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:31 smithi170 ceph-mon[31899]: [25/Jan/2024:14:52:30] ENGINE Bus STARTING 2024-01-25T14:52:31.778 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:31 smithi170 ceph-mon[31899]: [25/Jan/2024:14:52:30] ENGINE Serving on https://172.21.15.170:7150 2024-01-25T14:52:31.778 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:31 smithi170 ceph-mon[31899]: [25/Jan/2024:14:52:30] ENGINE Serving on http://172.21.15.170:8765 2024-01-25T14:52:31.778 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:31 smithi170 ceph-mon[31899]: [25/Jan/2024:14:52:30] ENGINE Bus STARTED 2024-01-25T14:52:31.778 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:31 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:52:32.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.543+0000 7f88c0f58700 1 Processor -- start 2024-01-25T14:52:32.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.543+0000 7f88c0f58700 1 -- start start 2024-01-25T14:52:32.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.543+0000 7f88c0f58700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88bc1086c0 0x7f88bc108ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:32.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.543+0000 7f88c0f58700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc1090b0 con 0x7f88bc1086c0 2024-01-25T14:52:32.364 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.543+0000 7f88ba59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88bc1086c0 0x7f88bc108ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:32.365 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.543+0000 7f88ba59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88bc1086c0 0x7f88bc108ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60038/0 (socket says 172.21.15.170:60038) 2024-01-25T14:52:32.365 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.543+0000 7f88ba59c700 1 -- 172.21.15.170:0/3460680482 learned_addr learned my addr 172.21.15.170:0/3460680482 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:32.365 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.543+0000 7f88ba59c700 1 -- 172.21.15.170:0/3460680482 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88bc1091f0 con 0x7f88bc1086c0 2024-01-25T14:52:32.365 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.544+0000 7f88ba59c700 1 --2- 172.21.15.170:0/3460680482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88bc1086c0 0x7f88bc108ae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0098a0 tx=0x7f88ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfae7e0832f199c4 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:32.365 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.544+0000 7f88b959a700 1 -- 172.21.15.170:0/3460680482 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88ac004160 con 0x7f88bc1086c0 2024-01-25T14:52:32.365 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.544+0000 7f88b959a700 1 -- 172.21.15.170:0/3460680482 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f88ac0042c0 con 0x7f88bc1086c0 2024-01-25T14:52:32.365 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.544+0000 7f88b959a700 1 -- 172.21.15.170:0/3460680482 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88ac011a00 con 0x7f88bc1086c0 2024-01-25T14:52:32.365 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.544+0000 7f88c0f58700 1 -- 172.21.15.170:0/3460680482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88bc1086c0 msgr2=0x7f88bc108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:32.365 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.544+0000 7f88c0f58700 1 --2- 172.21.15.170:0/3460680482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88bc1086c0 0x7f88bc108ae0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f88ac0098a0 tx=0x7f88ac009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:32.365 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.544+0000 7f88c0f58700 1 -- 172.21.15.170:0/3460680482 shutdown_connections 2024-01-25T14:52:32.365 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.544+0000 7f88c0f58700 1 --2- 172.21.15.170:0/3460680482 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88bc1086c0 0x7f88bc108ae0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:32.365 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.544+0000 7f88c0f58700 1 -- 172.21.15.170:0/3460680482 >> 172.21.15.170:0/3460680482 conn(0x7f88bc100da0 msgr2=0x7f88bc1031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:32.366 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.544+0000 7f88c0f58700 1 -- 172.21.15.170:0/3460680482 shutdown_connections 2024-01-25T14:52:32.366 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.544+0000 7f88c0f58700 1 -- 172.21.15.170:0/3460680482 wait complete. 2024-01-25T14:52:32.366 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.545+0000 7f88c0f58700 1 Processor -- start 2024-01-25T14:52:32.366 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.545+0000 7f88c0f58700 1 -- start start 2024-01-25T14:52:32.366 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.545+0000 7f88c0f58700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88bc1086c0 0x7f88bc19ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:32.366 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.545+0000 7f88c0f58700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc19b320 con 0x7f88bc1086c0 2024-01-25T14:52:32.366 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.545+0000 7f88ba59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88bc1086c0 0x7f88bc19ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:32.366 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.545+0000 7f88ba59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88bc1086c0 0x7f88bc19ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60040/0 (socket says 172.21.15.170:60040) 2024-01-25T14:52:32.366 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.545+0000 7f88ba59c700 1 -- 172.21.15.170:0/2275515913 learned_addr learned my addr 172.21.15.170:0/2275515913 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:32.366 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.546+0000 7f88ba59c700 1 -- 172.21.15.170:0/2275515913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac009550 con 0x7f88bc1086c0 2024-01-25T14:52:32.366 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.546+0000 7f88ba59c700 1 --2- 172.21.15.170:0/2275515913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88bc1086c0 0x7f88bc19ade0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009130 tx=0x7f88ac011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:32.366 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.546+0000 7f88ab7fe700 1 -- 172.21.15.170:0/2275515913 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88ac003ab0 con 0x7f88bc1086c0 2024-01-25T14:52:32.366 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.546+0000 7f88ab7fe700 1 -- 172.21.15.170:0/2275515913 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f88ac003c10 con 0x7f88bc1086c0 2024-01-25T14:52:32.366 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.546+0000 7f88c0f58700 1 -- 172.21.15.170:0/2275515913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88bc19b520 con 0x7f88bc1086c0 2024-01-25T14:52:32.367 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.546+0000 7f88ab7fe700 1 -- 172.21.15.170:0/2275515913 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88ac0247d0 con 0x7f88bc1086c0 2024-01-25T14:52:32.367 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.546+0000 7f88c0f58700 1 -- 172.21.15.170:0/2275515913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88bc19b9c0 con 0x7f88bc1086c0 2024-01-25T14:52:32.367 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.547+0000 7f88ab7fe700 1 -- 172.21.15.170:0/2275515913 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 7) v1 ==== 45535+0+0 (secure 0 0 0) 0x7f88ac02d3f0 con 0x7f88bc1086c0 2024-01-25T14:52:32.367 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.547+0000 7f88c0f58700 1 -- 172.21.15.170:0/2275515913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88bc105d60 con 0x7f88bc1086c0 2024-01-25T14:52:32.367 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.547+0000 7f88ab7fe700 1 --2- 172.21.15.170:0/2275515913 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f88a4038970 0x7f88a403ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:32.367 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.547+0000 7f88ab7fe700 1 -- 172.21.15.170:0/2275515913 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f88ac04cbe0 con 0x7f88bc1086c0 2024-01-25T14:52:32.367 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.547+0000 7f88b9d9b700 1 --2- 172.21.15.170:0/2275515913 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f88a4038970 0x7f88a403ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:32.367 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.548+0000 7f88b9d9b700 1 --2- 172.21.15.170:0/2275515913 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f88a4038970 0x7f88a403ae30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f88b0006fd0 tx=0x7f88b0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:32.367 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.552+0000 7f88ab7fe700 1 -- 172.21.15.170:0/2275515913 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f88ac010970 con 0x7f88bc1086c0 2024-01-25T14:52:32.367 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.666+0000 7f88ab7fe700 1 -- 172.21.15.170:0/2275515913 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f88ac019460 con 0x7f88bc1086c0 2024-01-25T14:52:32.367 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.758+0000 7f88c0f58700 1 -- 172.21.15.170:0/2275515913 --> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f88bc101fc0 con 0x7f88a4038970 2024-01-25T14:52:32.367 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.763+0000 7f88ab7fe700 1 -- 172.21.15.170:0/2275515913 <== mgr.14120 v2:172.21.15.170:6800/358194066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f88bc101fc0 con 0x7f88a4038970 2024-01-25T14:52:32.367 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.765+0000 7f88c0f58700 1 -- 172.21.15.170:0/2275515913 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f88a4038970 msgr2=0x7f88a403ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:32.368 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.765+0000 7f88c0f58700 1 --2- 172.21.15.170:0/2275515913 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f88a4038970 0x7f88a403ae30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f88b0006fd0 tx=0x7f88b0006e40 comp rx=0 tx=0).stop 2024-01-25T14:52:32.368 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.765+0000 7f88c0f58700 1 -- 172.21.15.170:0/2275515913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88bc1086c0 msgr2=0x7f88bc19ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:32.368 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.765+0000 7f88c0f58700 1 --2- 172.21.15.170:0/2275515913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88bc1086c0 0x7f88bc19ade0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009130 tx=0x7f88ac011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:32.368 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.765+0000 7f88c0f58700 1 -- 172.21.15.170:0/2275515913 shutdown_connections 2024-01-25T14:52:32.368 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.765+0000 7f88c0f58700 1 --2- 172.21.15.170:0/2275515913 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f88a4038970 0x7f88a403ae30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:32.368 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.765+0000 7f88c0f58700 1 --2- 172.21.15.170:0/2275515913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88bc1086c0 0x7f88bc19ade0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:32.368 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.765+0000 7f88c0f58700 1 -- 172.21.15.170:0/2275515913 >> 172.21.15.170:0/2275515913 conn(0x7f88bc100da0 msgr2=0x7f88bc1018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:32.368 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.765+0000 7f88c0f58700 1 -- 172.21.15.170:0/2275515913 shutdown_connections 2024-01-25T14:52:32.368 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:31.765+0000 7f88c0f58700 1 -- 172.21.15.170:0/2275515913 wait complete. 2024-01-25T14:52:32.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:32 smithi170 ceph-mon[31899]: mgrmap e8: x(active, since 2s) 2024-01-25T14:52:32.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:32 smithi170 ceph-mon[31899]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:52:32.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:32 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' 2024-01-25T14:52:32.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:32 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:52:33.569 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout value unchanged 2024-01-25T14:52:33.569 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.815+0000 7f3ea519e700 1 Processor -- start 2024-01-25T14:52:33.569 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.815+0000 7f3ea519e700 1 -- start start 2024-01-25T14:52:33.569 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.815+0000 7f3ea519e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea007cd70 0x7f3ea007b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.815+0000 7f3ea519e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea007d190 con 0x7f3ea007cd70 2024-01-25T14:52:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.815+0000 7f3e9ed9d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea007cd70 0x7f3ea007b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.815+0000 7f3e9ed9d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea007cd70 0x7f3ea007b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60052/0 (socket says 172.21.15.170:60052) 2024-01-25T14:52:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.815+0000 7f3e9ed9d700 1 -- 172.21.15.170:0/2255624629 learned_addr learned my addr 172.21.15.170:0/2255624629 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.815+0000 7f3e9ed9d700 1 -- 172.21.15.170:0/2255624629 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea007b820 con 0x7f3ea007cd70 2024-01-25T14:52:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.816+0000 7f3e9ed9d700 1 --2- 172.21.15.170:0/2255624629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea007cd70 0x7f3ea007b2e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e900098a0 tx=0x7f3e90009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f1cf121edcccdc server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.816+0000 7f3e9dd9b700 1 -- 172.21.15.170:0/2255624629 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e90004160 con 0x7f3ea007cd70 2024-01-25T14:52:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.816+0000 7f3e9dd9b700 1 -- 172.21.15.170:0/2255624629 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3e900042c0 con 0x7f3ea007cd70 2024-01-25T14:52:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.816+0000 7f3e9dd9b700 1 -- 172.21.15.170:0/2255624629 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e90011a00 con 0x7f3ea007cd70 2024-01-25T14:52:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.816+0000 7f3ea519e700 1 -- 172.21.15.170:0/2255624629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea007cd70 msgr2=0x7f3ea007b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.816+0000 7f3ea519e700 1 --2- 172.21.15.170:0/2255624629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea007cd70 0x7f3ea007b2e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e900098a0 tx=0x7f3e90009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.816+0000 7f3ea519e700 1 -- 172.21.15.170:0/2255624629 shutdown_connections 2024-01-25T14:52:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.816+0000 7f3ea519e700 1 --2- 172.21.15.170:0/2255624629 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea007cd70 0x7f3ea007b2e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.816+0000 7f3ea519e700 1 -- 172.21.15.170:0/2255624629 >> 172.21.15.170:0/2255624629 conn(0x7f3ea0102790 msgr2=0x7f3ea0104bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:33.571 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.816+0000 7f3ea519e700 1 -- 172.21.15.170:0/2255624629 shutdown_connections 2024-01-25T14:52:33.571 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.816+0000 7f3ea519e700 1 -- 172.21.15.170:0/2255624629 wait complete. 2024-01-25T14:52:33.571 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.817+0000 7f3ea519e700 1 Processor -- start 2024-01-25T14:52:33.571 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.817+0000 7f3ea519e700 1 -- start start 2024-01-25T14:52:33.571 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.817+0000 7f3ea519e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea007cd70 0x7f3ea019cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:33.571 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.817+0000 7f3ea519e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea019d510 con 0x7f3ea007cd70 2024-01-25T14:52:33.571 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.818+0000 7f3e9ed9d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea007cd70 0x7f3ea019cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:33.571 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.818+0000 7f3e9ed9d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea007cd70 0x7f3ea019cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60062/0 (socket says 172.21.15.170:60062) 2024-01-25T14:52:33.571 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.818+0000 7f3e9ed9d700 1 -- 172.21.15.170:0/552676473 learned_addr learned my addr 172.21.15.170:0/552676473 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:33.571 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.818+0000 7f3e9ed9d700 1 -- 172.21.15.170:0/552676473 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e90009550 con 0x7f3ea007cd70 2024-01-25T14:52:33.571 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.818+0000 7f3e9ed9d700 1 --2- 172.21.15.170:0/552676473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea007cd70 0x7f3ea019cfd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009130 tx=0x7f3e90011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:33.571 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.818+0000 7f3e87fff700 1 -- 172.21.15.170:0/552676473 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e90003b70 con 0x7f3ea007cd70 2024-01-25T14:52:33.571 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.818+0000 7f3e87fff700 1 -- 172.21.15.170:0/552676473 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3e90003cd0 con 0x7f3ea007cd70 2024-01-25T14:52:33.571 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.818+0000 7f3e87fff700 1 -- 172.21.15.170:0/552676473 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3e900197d0 con 0x7f3ea007cd70 2024-01-25T14:52:33.572 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.818+0000 7f3ea519e700 1 -- 172.21.15.170:0/552676473 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea019d710 con 0x7f3ea007cd70 2024-01-25T14:52:33.572 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.818+0000 7f3ea519e700 1 -- 172.21.15.170:0/552676473 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea019dbb0 con 0x7f3ea007cd70 2024-01-25T14:52:33.572 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.819+0000 7f3e87fff700 1 -- 172.21.15.170:0/552676473 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f3e90019a10 con 0x7f3ea007cd70 2024-01-25T14:52:33.572 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.819+0000 7f3ea519e700 1 -- 172.21.15.170:0/552676473 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea010d3b0 con 0x7f3ea007cd70 2024-01-25T14:52:33.572 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.819+0000 7f3e87fff700 1 --2- 172.21.15.170:0/552676473 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f3e88038a40 0x7f3e8803af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:33.572 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.819+0000 7f3e87fff700 1 -- 172.21.15.170:0/552676473 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3e9004cdb0 con 0x7f3ea007cd70 2024-01-25T14:52:33.572 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.819+0000 7f3e9e59c700 1 --2- 172.21.15.170:0/552676473 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f3e88038a40 0x7f3e8803af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:33.572 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.820+0000 7f3e9e59c700 1 --2- 172.21.15.170:0/552676473 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f3e88038a40 0x7f3e8803af00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3e94006fd0 tx=0x7f3e94006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:33.572 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:32.824+0000 7f3e87fff700 1 -- 172.21.15.170:0/552676473 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f3e90018db0 con 0x7f3ea007cd70 2024-01-25T14:52:33.572 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.019+0000 7f3ea519e700 1 -- 172.21.15.170:0/552676473 --> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ea0103aa0 con 0x7f3e88038a40 2024-01-25T14:52:33.572 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.019+0000 7f3e87fff700 1 -- 172.21.15.170:0/552676473 <== mgr.14120 v2:172.21.15.170:6800/358194066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f3ea0103aa0 con 0x7f3e88038a40 2024-01-25T14:52:33.572 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.022+0000 7f3ea519e700 1 -- 172.21.15.170:0/552676473 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f3e88038a40 msgr2=0x7f3e8803af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:33.573 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.022+0000 7f3ea519e700 1 --2- 172.21.15.170:0/552676473 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f3e88038a40 0x7f3e8803af00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3e94006fd0 tx=0x7f3e94006e40 comp rx=0 tx=0).stop 2024-01-25T14:52:33.573 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.022+0000 7f3ea519e700 1 -- 172.21.15.170:0/552676473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea007cd70 msgr2=0x7f3ea019cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:33.573 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.022+0000 7f3ea519e700 1 --2- 172.21.15.170:0/552676473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea007cd70 0x7f3ea019cfd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009130 tx=0x7f3e90011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:33.573 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.022+0000 7f3ea519e700 1 -- 172.21.15.170:0/552676473 shutdown_connections 2024-01-25T14:52:33.573 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.022+0000 7f3ea519e700 1 --2- 172.21.15.170:0/552676473 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f3e88038a40 0x7f3e8803af00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:33.573 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.022+0000 7f3ea519e700 1 --2- 172.21.15.170:0/552676473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ea007cd70 0x7f3ea019cfd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:33.573 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.022+0000 7f3ea519e700 1 -- 172.21.15.170:0/552676473 >> 172.21.15.170:0/552676473 conn(0x7f3ea0102790 msgr2=0x7f3ea0103390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:33.573 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.022+0000 7f3ea519e700 1 -- 172.21.15.170:0/552676473 shutdown_connections 2024-01-25T14:52:33.573 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.022+0000 7f3ea519e700 1 -- 172.21.15.170:0/552676473 wait complete. 2024-01-25T14:52:33.573 INFO:teuthology.orchestra.run.smithi170.stdout:Generating ssh key... 2024-01-25T14:52:34.179 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-mon[31899]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:52:34.624 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: Generating public/private rsa key pair. 2024-01-25T14:52:34.624 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: Your identification has been saved in /tmp/tmpllonbkk1/key. 2024-01-25T14:52:34.625 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: Your public key has been saved in /tmp/tmpllonbkk1/key.pub. 2024-01-25T14:52:34.625 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: The key fingerprint is: 2024-01-25T14:52:34.625 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: SHA256:W/oNWCiK3xTaM+ovsyOTzqKvjme9q4xR3hMlV9kHGu0 ceph-267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:52:34.625 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: The key's randomart image is: 2024-01-25T14:52:34.625 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: +---[RSA 3072]----+ 2024-01-25T14:52:34.625 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: | o+.. | 2024-01-25T14:52:34.625 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: | ..oo . | 2024-01-25T14:52:34.625 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: | . o .. . | 2024-01-25T14:52:34.625 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: | + .E | 2024-01-25T14:52:34.625 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: | . . o S o | 2024-01-25T14:52:34.625 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: | o o = o * | 2024-01-25T14:52:34.625 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: |. oo= = + . | 2024-01-25T14:52:34.625 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: |o=*.== o . o | 2024-01-25T14:52:34.625 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: |BO*=BOo . . | 2024-01-25T14:52:34.626 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: +----[SHA256]-----+ 2024-01-25T14:52:34.917 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.977+0000 7f8632933700 1 Processor -- start 2024-01-25T14:52:34.917 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.977+0000 7f8632933700 1 -- start start 2024-01-25T14:52:34.917 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.977+0000 7f8632933700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f862c1075b0 0x7f862c1079d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.977+0000 7f8632933700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c107fa0 con 0x7f862c1075b0 2024-01-25T14:52:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.978+0000 7f862bfff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f862c1075b0 0x7f862c1079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.978+0000 7f862bfff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f862c1075b0 0x7f862c1079d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60074/0 (socket says 172.21.15.170:60074) 2024-01-25T14:52:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.978+0000 7f862bfff700 1 -- 172.21.15.170:0/3207330937 learned_addr learned my addr 172.21.15.170:0/3207330937 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.978+0000 7f862bfff700 1 -- 172.21.15.170:0/3207330937 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c106210 con 0x7f862c1075b0 2024-01-25T14:52:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.978+0000 7f862bfff700 1 --2- 172.21.15.170:0/3207330937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f862c1075b0 0x7f862c1079d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f861c0098a0 tx=0x7f861c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81b4794ad86ba1c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.978+0000 7f862affd700 1 -- 172.21.15.170:0/3207330937 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f861c004160 con 0x7f862c1075b0 2024-01-25T14:52:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.978+0000 7f862affd700 1 -- 172.21.15.170:0/3207330937 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f861c0042c0 con 0x7f862c1075b0 2024-01-25T14:52:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.978+0000 7f862affd700 1 -- 172.21.15.170:0/3207330937 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f861c011a00 con 0x7f862c1075b0 2024-01-25T14:52:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.979+0000 7f8632933700 1 -- 172.21.15.170:0/3207330937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f862c1075b0 msgr2=0x7f862c1079d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.979+0000 7f8632933700 1 --2- 172.21.15.170:0/3207330937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f862c1075b0 0x7f862c1079d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f861c0098a0 tx=0x7f861c009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.979+0000 7f8632933700 1 -- 172.21.15.170:0/3207330937 shutdown_connections 2024-01-25T14:52:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.979+0000 7f8632933700 1 --2- 172.21.15.170:0/3207330937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f862c1075b0 0x7f862c1079d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.979+0000 7f8632933700 1 -- 172.21.15.170:0/3207330937 >> 172.21.15.170:0/3207330937 conn(0x7f862c100da0 msgr2=0x7f862c1031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:34.918 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.979+0000 7f8632933700 1 -- 172.21.15.170:0/3207330937 shutdown_connections 2024-01-25T14:52:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.979+0000 7f8632933700 1 -- 172.21.15.170:0/3207330937 wait complete. 2024-01-25T14:52:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.979+0000 7f8632933700 1 Processor -- start 2024-01-25T14:52:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.979+0000 7f8632933700 1 -- start start 2024-01-25T14:52:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.980+0000 7f8632933700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f862c1075b0 0x7f862c105b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.980+0000 7f8632933700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c1060c0 con 0x7f862c1075b0 2024-01-25T14:52:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.980+0000 7f862bfff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f862c1075b0 0x7f862c105b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.980+0000 7f862bfff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f862c1075b0 0x7f862c105b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60082/0 (socket says 172.21.15.170:60082) 2024-01-25T14:52:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.980+0000 7f862bfff700 1 -- 172.21.15.170:0/3659103811 learned_addr learned my addr 172.21.15.170:0/3659103811 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.980+0000 7f862bfff700 1 -- 172.21.15.170:0/3659103811 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c009550 con 0x7f862c1075b0 2024-01-25T14:52:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.980+0000 7f862bfff700 1 --2- 172.21.15.170:0/3659103811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f862c1075b0 0x7f862c105b80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f861c011710 tx=0x7f861c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.980+0000 7f86297fa700 1 -- 172.21.15.170:0/3659103811 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f861c003aa0 con 0x7f862c1075b0 2024-01-25T14:52:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.980+0000 7f86297fa700 1 -- 172.21.15.170:0/3659103811 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f861c003c00 con 0x7f862c1075b0 2024-01-25T14:52:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.980+0000 7f86297fa700 1 -- 172.21.15.170:0/3659103811 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f861c024800 con 0x7f862c1075b0 2024-01-25T14:52:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.980+0000 7f8632933700 1 -- 172.21.15.170:0/3659103811 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862c19dbb0 con 0x7f862c1075b0 2024-01-25T14:52:34.919 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.980+0000 7f8632933700 1 -- 172.21.15.170:0/3659103811 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862c19e050 con 0x7f862c1075b0 2024-01-25T14:52:34.920 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.981+0000 7f86297fa700 1 -- 172.21.15.170:0/3659103811 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f861c024960 con 0x7f862c1075b0 2024-01-25T14:52:34.920 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.981+0000 7f8632933700 1 -- 172.21.15.170:0/3659103811 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862c10a450 con 0x7f862c1075b0 2024-01-25T14:52:34.920 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.981+0000 7f86297fa700 1 --2- 172.21.15.170:0/3659103811 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f8614038a90 0x7f861403af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:34.920 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.981+0000 7f86297fa700 1 -- 172.21.15.170:0/3659103811 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f861c04cb10 con 0x7f862c1075b0 2024-01-25T14:52:34.920 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.982+0000 7f862b7fe700 1 --2- 172.21.15.170:0/3659103811 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f8614038a90 0x7f861403af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:34.920 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.982+0000 7f862b7fe700 1 --2- 172.21.15.170:0/3659103811 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f8614038a90 0x7f861403af50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8620006fd0 tx=0x7f8620006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:34.920 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:33.986+0000 7f86297fa700 1 -- 172.21.15.170:0/3659103811 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f861c018b80 con 0x7f862c1075b0 2024-01-25T14:52:34.920 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:34.178+0000 7f8632933700 1 -- 172.21.15.170:0/3659103811 --> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f862c102000 con 0x7f8614038a90 2024-01-25T14:52:34.920 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:34.360+0000 7f86297fa700 1 -- 172.21.15.170:0/3659103811 <== mgr.14120 v2:172.21.15.170:6800/358194066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f862c102000 con 0x7f8614038a90 2024-01-25T14:52:34.920 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:34.363+0000 7f8632933700 1 -- 172.21.15.170:0/3659103811 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f8614038a90 msgr2=0x7f861403af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:34.920 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:34.363+0000 7f8632933700 1 --2- 172.21.15.170:0/3659103811 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f8614038a90 0x7f861403af50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8620006fd0 tx=0x7f8620006e40 comp rx=0 tx=0).stop 2024-01-25T14:52:34.920 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:34.363+0000 7f8632933700 1 -- 172.21.15.170:0/3659103811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f862c1075b0 msgr2=0x7f862c105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:34.920 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:34.363+0000 7f8632933700 1 --2- 172.21.15.170:0/3659103811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f862c1075b0 0x7f862c105b80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f861c011710 tx=0x7f861c011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:34.921 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:34.363+0000 7f8632933700 1 -- 172.21.15.170:0/3659103811 shutdown_connections 2024-01-25T14:52:34.921 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:34.363+0000 7f8632933700 1 --2- 172.21.15.170:0/3659103811 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f8614038a90 0x7f861403af50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:34.921 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:34.363+0000 7f8632933700 1 --2- 172.21.15.170:0/3659103811 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f862c1075b0 0x7f862c105b80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:34.921 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:34.363+0000 7f8632933700 1 -- 172.21.15.170:0/3659103811 >> 172.21.15.170:0/3659103811 conn(0x7f862c100da0 msgr2=0x7f862c1018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:34.921 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:34.363+0000 7f8632933700 1 -- 172.21.15.170:0/3659103811 shutdown_connections 2024-01-25T14:52:34.921 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:34.363+0000 7f8632933700 1 -- 172.21.15.170:0/3659103811 wait complete. 2024-01-25T14:52:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:35 smithi170 ceph-mon[31899]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:52:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:35 smithi170 ceph-mon[31899]: Generating ssh key... 2024-01-25T14:52:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:35 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' 2024-01-25T14:52:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:35 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' 2024-01-25T14:52:36.149 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCebEpdG2lmbPjFj/B39BEtlGfx+kOrAmCI3gixEIpbO5dZBdmTxZREQO56+YjDGWzC+WE3Z7a1HOM+nV9hwGPPUBoHiTyGnSaNCpBVMPyChVDTGcGKxDJWfRW5wo1tFhT6Eo4DWxrvJa/YzB1OezcPUsQcZzK3o2Trz4gXpjtmpfndQAFK1B+74lHB2WqNaNtSNx4gTq9FPnJRE0nHc0lduR79PJ1CesOBpjRuXhnUAB8xFaabdUycNsr2QEOTWo8I+KCp7KpmUGJr6KlfsM85krNsOLn5PHurpLkMtSeDHZFQNdQln1QLW/WvXWJoX/sJnDRcbvypJry7heQsCKKV+FwZgLLuD278PVOH9xACfz8wBH5Gw6z+HkQo9rYq7YufbSd2Gv60/qlnruyJEhWnRTQw8bUeWetWSlDo0UltUMHjpGpKJWKK5w2OWSeslL2czr/4Bix4Njt4rswAj8ik0WOquvgv7sTDQNqCotVq2xu5J1T0Uqv/r8U2qBt/baE= ceph-267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:52:36.149 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.320+0000 7f43b0be4700 1 Processor -- start 2024-01-25T14:52:36.149 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.320+0000 7f43b0be4700 1 -- start start 2024-01-25T14:52:36.149 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.320+0000 7f43b0be4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43ac105720 0x7f43ac105b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:36.149 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.320+0000 7f43b0be4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac106110 con 0x7f43ac105720 2024-01-25T14:52:36.149 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.320+0000 7f43aa59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43ac105720 0x7f43ac105b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:36.149 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.320+0000 7f43aa59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43ac105720 0x7f43ac105b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60088/0 (socket says 172.21.15.170:60088) 2024-01-25T14:52:36.149 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.320+0000 7f43aa59c700 1 -- 172.21.15.170:0/3618053336 learned_addr learned my addr 172.21.15.170:0/3618053336 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:36.149 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.320+0000 7f43aa59c700 1 -- 172.21.15.170:0/3618053336 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac106920 con 0x7f43ac105720 2024-01-25T14:52:36.149 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.321+0000 7f43aa59c700 1 --2- 172.21.15.170:0/3618053336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43ac105720 0x7f43ac105b40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f43a00098a0 tx=0x7f43a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5964fa38833ca020 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:36.150 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.321+0000 7f43a959a700 1 -- 172.21.15.170:0/3618053336 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43a0004160 con 0x7f43ac105720 2024-01-25T14:52:36.150 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.321+0000 7f43a959a700 1 -- 172.21.15.170:0/3618053336 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f43a00042c0 con 0x7f43ac105720 2024-01-25T14:52:36.150 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.321+0000 7f43a959a700 1 -- 172.21.15.170:0/3618053336 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43a0011a00 con 0x7f43ac105720 2024-01-25T14:52:36.150 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.321+0000 7f43b0be4700 1 -- 172.21.15.170:0/3618053336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43ac105720 msgr2=0x7f43ac105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:36.150 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.321+0000 7f43b0be4700 1 --2- 172.21.15.170:0/3618053336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43ac105720 0x7f43ac105b40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f43a00098a0 tx=0x7f43a0009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:36.150 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.321+0000 7f43b0be4700 1 -- 172.21.15.170:0/3618053336 shutdown_connections 2024-01-25T14:52:36.150 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.321+0000 7f43b0be4700 1 --2- 172.21.15.170:0/3618053336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43ac105720 0x7f43ac105b40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:36.150 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.321+0000 7f43b0be4700 1 -- 172.21.15.170:0/3618053336 >> 172.21.15.170:0/3618053336 conn(0x7f43ac100da0 msgr2=0x7f43ac1031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:36.150 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.321+0000 7f43b0be4700 1 -- 172.21.15.170:0/3618053336 shutdown_connections 2024-01-25T14:52:36.150 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.321+0000 7f43b0be4700 1 -- 172.21.15.170:0/3618053336 wait complete. 2024-01-25T14:52:36.150 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.322+0000 7f43b0be4700 1 Processor -- start 2024-01-25T14:52:36.150 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.322+0000 7f43b0be4700 1 -- start start 2024-01-25T14:52:36.150 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.322+0000 7f43b0be4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43ac105720 0x7f43ac19ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.322+0000 7f43b0be4700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac19b360 con 0x7f43ac105720 2024-01-25T14:52:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.322+0000 7f43aa59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43ac105720 0x7f43ac19ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.322+0000 7f43aa59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43ac105720 0x7f43ac19ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60098/0 (socket says 172.21.15.170:60098) 2024-01-25T14:52:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.322+0000 7f43aa59c700 1 -- 172.21.15.170:0/1935381412 learned_addr learned my addr 172.21.15.170:0/1935381412 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.323+0000 7f43aa59c700 1 -- 172.21.15.170:0/1935381412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a0009550 con 0x7f43ac105720 2024-01-25T14:52:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.323+0000 7f43aa59c700 1 --2- 172.21.15.170:0/1935381412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43ac105720 0x7f43ac19ae20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f43a0003eb0 tx=0x7f43a0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.323+0000 7f439b7fe700 1 -- 172.21.15.170:0/1935381412 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43a00039e0 con 0x7f43ac105720 2024-01-25T14:52:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.323+0000 7f43b0be4700 1 -- 172.21.15.170:0/1935381412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac19b560 con 0x7f43ac105720 2024-01-25T14:52:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.323+0000 7f439b7fe700 1 -- 172.21.15.170:0/1935381412 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f43a0003b40 con 0x7f43ac105720 2024-01-25T14:52:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.323+0000 7f439b7fe700 1 -- 172.21.15.170:0/1935381412 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43a00196b0 con 0x7f43ac105720 2024-01-25T14:52:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.323+0000 7f43b0be4700 1 -- 172.21.15.170:0/1935381412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac19ba00 con 0x7f43ac105720 2024-01-25T14:52:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.324+0000 7f439b7fe700 1 -- 172.21.15.170:0/1935381412 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f43a00199a0 con 0x7f43ac105720 2024-01-25T14:52:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.324+0000 7f43b0be4700 1 -- 172.21.15.170:0/1935381412 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ac192850 con 0x7f43ac105720 2024-01-25T14:52:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.324+0000 7f439b7fe700 1 --2- 172.21.15.170:0/1935381412 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f4394038a40 0x7f439403af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:36.152 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.324+0000 7f439b7fe700 1 -- 172.21.15.170:0/1935381412 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f43a004cc70 con 0x7f43ac105720 2024-01-25T14:52:36.153 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.324+0000 7f43a9d9b700 1 --2- 172.21.15.170:0/1935381412 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f4394038a40 0x7f439403af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:36.153 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.324+0000 7f43a9d9b700 1 --2- 172.21.15.170:0/1935381412 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f4394038a40 0x7f439403af00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f439c006fd0 tx=0x7f439c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:36.153 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.329+0000 7f439b7fe700 1 -- 172.21.15.170:0/1935381412 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f43a0023370 con 0x7f43ac105720 2024-01-25T14:52:36.153 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.520+0000 7f43b0be4700 1 -- 172.21.15.170:0/1935381412 --> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f43ac02d700 con 0x7f4394038a40 2024-01-25T14:52:36.153 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.521+0000 7f439b7fe700 1 -- 172.21.15.170:0/1935381412 <== mgr.14120 v2:172.21.15.170:6800/358194066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f43ac02d700 con 0x7f4394038a40 2024-01-25T14:52:36.153 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.523+0000 7f43b0be4700 1 -- 172.21.15.170:0/1935381412 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f4394038a40 msgr2=0x7f439403af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:36.153 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.523+0000 7f43b0be4700 1 --2- 172.21.15.170:0/1935381412 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f4394038a40 0x7f439403af00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f439c006fd0 tx=0x7f439c006e40 comp rx=0 tx=0).stop 2024-01-25T14:52:36.153 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.523+0000 7f43b0be4700 1 -- 172.21.15.170:0/1935381412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43ac105720 msgr2=0x7f43ac19ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:36.153 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.523+0000 7f43b0be4700 1 --2- 172.21.15.170:0/1935381412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43ac105720 0x7f43ac19ae20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f43a0003eb0 tx=0x7f43a0011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:36.154 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.523+0000 7f43b0be4700 1 -- 172.21.15.170:0/1935381412 shutdown_connections 2024-01-25T14:52:36.154 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.523+0000 7f43b0be4700 1 --2- 172.21.15.170:0/1935381412 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f4394038a40 0x7f439403af00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:36.154 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.523+0000 7f43b0be4700 1 --2- 172.21.15.170:0/1935381412 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43ac105720 0x7f43ac19ae20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:36.154 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.523+0000 7f43b0be4700 1 -- 172.21.15.170:0/1935381412 >> 172.21.15.170:0/1935381412 conn(0x7f43ac100da0 msgr2=0x7f43ac18f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:36.154 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.523+0000 7f43b0be4700 1 -- 172.21.15.170:0/1935381412 shutdown_connections 2024-01-25T14:52:36.154 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:35.523+0000 7f43b0be4700 1 -- 172.21.15.170:0/1935381412 wait complete. 2024-01-25T14:52:36.154 INFO:teuthology.orchestra.run.smithi170.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-01-25T14:52:36.154 INFO:teuthology.orchestra.run.smithi170.stdout:Adding key to root@localhost authorized_keys... 2024-01-25T14:52:36.154 INFO:teuthology.orchestra.run.smithi170.stdout:Adding host smithi170... 2024-01-25T14:52:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:36 smithi170 ceph-mon[31899]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:52:37.612 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:37 smithi170 ceph-mon[31899]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi170", "addr": "172.21.15.170", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:52:39.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:38 smithi170 ceph-mon[31899]: Deploying cephadm binary to smithi170 2024-01-25T14:52:41.489 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout Added host 'smithi170' with addr '172.21.15.170' 2024-01-25T14:52:41.489 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.534+0000 7fc22010e700 1 Processor -- start 2024-01-25T14:52:41.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.534+0000 7fc22010e700 1 -- start start 2024-01-25T14:52:41.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.534+0000 7fc22010e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc218107110 0x7fc218107530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:41.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.534+0000 7fc22010e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc218107a70 con 0x7fc218107110 2024-01-25T14:52:41.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.534+0000 7fc21deaa700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc218107110 0x7fc218107530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:41.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.534+0000 7fc21deaa700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc218107110 0x7fc218107530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51412/0 (socket says 172.21.15.170:51412) 2024-01-25T14:52:41.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.534+0000 7fc21deaa700 1 -- 172.21.15.170:0/3074817260 learned_addr learned my addr 172.21.15.170:0/3074817260 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:41.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.535+0000 7fc21deaa700 1 -- 172.21.15.170:0/3074817260 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc218107bb0 con 0x7fc218107110 2024-01-25T14:52:41.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.535+0000 7fc21deaa700 1 --2- 172.21.15.170:0/3074817260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc218107110 0x7fc218107530 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc2140098a0 tx=0x7fc214009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cbab9231ac4847 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:41.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.535+0000 7fc21cea8700 1 -- 172.21.15.170:0/3074817260 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc214004160 con 0x7fc218107110 2024-01-25T14:52:41.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.535+0000 7fc21cea8700 1 -- 172.21.15.170:0/3074817260 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc2140042c0 con 0x7fc218107110 2024-01-25T14:52:41.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.535+0000 7fc21cea8700 1 -- 172.21.15.170:0/3074817260 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc214011a00 con 0x7fc218107110 2024-01-25T14:52:41.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.535+0000 7fc22010e700 1 -- 172.21.15.170:0/3074817260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc218107110 msgr2=0x7fc218107530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:41.490 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.535+0000 7fc22010e700 1 --2- 172.21.15.170:0/3074817260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc218107110 0x7fc218107530 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc2140098a0 tx=0x7fc214009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:41.491 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.535+0000 7fc22010e700 1 -- 172.21.15.170:0/3074817260 shutdown_connections 2024-01-25T14:52:41.491 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.535+0000 7fc22010e700 1 --2- 172.21.15.170:0/3074817260 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc218107110 0x7fc218107530 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:41.491 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.535+0000 7fc22010e700 1 -- 172.21.15.170:0/3074817260 >> 172.21.15.170:0/3074817260 conn(0x7fc2181027b0 msgr2=0x7fc218104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:41.491 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.536+0000 7fc22010e700 1 -- 172.21.15.170:0/3074817260 shutdown_connections 2024-01-25T14:52:41.491 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.536+0000 7fc22010e700 1 -- 172.21.15.170:0/3074817260 wait complete. 2024-01-25T14:52:41.491 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.536+0000 7fc22010e700 1 Processor -- start 2024-01-25T14:52:41.491 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.536+0000 7fc22010e700 1 -- start start 2024-01-25T14:52:41.491 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.536+0000 7fc22010e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc218107110 0x7fc21819ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:41.491 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.536+0000 7fc22010e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21819b3a0 con 0x7fc218107110 2024-01-25T14:52:41.491 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.536+0000 7fc21deaa700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc218107110 0x7fc21819ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:41.491 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.536+0000 7fc21deaa700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc218107110 0x7fc21819ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51424/0 (socket says 172.21.15.170:51424) 2024-01-25T14:52:41.491 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.536+0000 7fc21deaa700 1 -- 172.21.15.170:0/737583548 learned_addr learned my addr 172.21.15.170:0/737583548 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:41.491 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.537+0000 7fc21deaa700 1 -- 172.21.15.170:0/737583548 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc214009550 con 0x7fc218107110 2024-01-25T14:52:41.491 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.537+0000 7fc21deaa700 1 --2- 172.21.15.170:0/737583548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc218107110 0x7fc21819ae60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc214009130 tx=0x7fc214011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:41.492 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.537+0000 7fc20effd700 1 -- 172.21.15.170:0/737583548 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2140038b0 con 0x7fc218107110 2024-01-25T14:52:41.492 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.537+0000 7fc22010e700 1 -- 172.21.15.170:0/737583548 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21819b5a0 con 0x7fc218107110 2024-01-25T14:52:41.492 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.537+0000 7fc20effd700 1 -- 172.21.15.170:0/737583548 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc214003a10 con 0x7fc218107110 2024-01-25T14:52:41.492 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.537+0000 7fc20effd700 1 -- 172.21.15.170:0/737583548 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc214019550 con 0x7fc218107110 2024-01-25T14:52:41.492 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.537+0000 7fc22010e700 1 -- 172.21.15.170:0/737583548 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21819ba40 con 0x7fc218107110 2024-01-25T14:52:41.492 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.538+0000 7fc20effd700 1 -- 172.21.15.170:0/737583548 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7fc214019810 con 0x7fc218107110 2024-01-25T14:52:41.492 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.538+0000 7fc20effd700 1 --2- 172.21.15.170:0/737583548 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7fc2040389f0 0x7fc20403aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:41.492 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.538+0000 7fc20effd700 1 -- 172.21.15.170:0/737583548 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc21404cd30 con 0x7fc218107110 2024-01-25T14:52:41.492 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.538+0000 7fc22010e700 1 -- 172.21.15.170:0/737583548 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc218062e10 con 0x7fc218107110 2024-01-25T14:52:41.492 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.538+0000 7fc21d6a9700 1 --2- 172.21.15.170:0/737583548 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7fc2040389f0 0x7fc20403aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:41.492 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.538+0000 7fc21d6a9700 1 --2- 172.21.15.170:0/737583548 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7fc2040389f0 0x7fc20403aeb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc208006fd0 tx=0x7fc208006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:41.492 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.543+0000 7fc20effd700 1 -- 172.21.15.170:0/737583548 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fc214019b10 con 0x7fc218107110 2024-01-25T14:52:41.492 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:36.739+0000 7fc22010e700 1 -- 172.21.15.170:0/737583548 --> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi170", "addr": "172.21.15.170", "target": ["mon-mgr", ""]}) v1 -- 0x7fc218103a20 con 0x7fc2040389f0 2024-01-25T14:52:41.493 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:40.898+0000 7fc20effd700 1 -- 172.21.15.170:0/737583548 <== mgr.14120 v2:172.21.15.170:6800/358194066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fc218103a20 con 0x7fc2040389f0 2024-01-25T14:52:41.493 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:40.901+0000 7fc22010e700 1 -- 172.21.15.170:0/737583548 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7fc2040389f0 msgr2=0x7fc20403aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:41.493 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:40.901+0000 7fc22010e700 1 --2- 172.21.15.170:0/737583548 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7fc2040389f0 0x7fc20403aeb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc208006fd0 tx=0x7fc208006e40 comp rx=0 tx=0).stop 2024-01-25T14:52:41.493 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:40.901+0000 7fc22010e700 1 -- 172.21.15.170:0/737583548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc218107110 msgr2=0x7fc21819ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:41.493 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:40.901+0000 7fc22010e700 1 --2- 172.21.15.170:0/737583548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc218107110 0x7fc21819ae60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc214009130 tx=0x7fc214011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:41.493 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:40.901+0000 7fc22010e700 1 -- 172.21.15.170:0/737583548 shutdown_connections 2024-01-25T14:52:41.493 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:40.901+0000 7fc22010e700 1 --2- 172.21.15.170:0/737583548 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7fc2040389f0 0x7fc20403aeb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:41.493 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:40.901+0000 7fc22010e700 1 --2- 172.21.15.170:0/737583548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc218107110 0x7fc21819ae60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:41.493 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:40.901+0000 7fc22010e700 1 -- 172.21.15.170:0/737583548 >> 172.21.15.170:0/737583548 conn(0x7fc2181027b0 msgr2=0x7fc218103310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:41.493 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:40.901+0000 7fc22010e700 1 -- 172.21.15.170:0/737583548 shutdown_connections 2024-01-25T14:52:41.493 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:40.901+0000 7fc22010e700 1 -- 172.21.15.170:0/737583548 wait complete. 2024-01-25T14:52:41.493 INFO:teuthology.orchestra.run.smithi170.stdout:Deploying unmanaged mon service... 2024-01-25T14:52:42.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:41 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' 2024-01-25T14:52:42.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:41 smithi170 ceph-mon[31899]: Added host smithi170 2024-01-25T14:52:42.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:41 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:52:42.881 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-01-25T14:52:42.881 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.921+0000 7f720f157700 1 Processor -- start 2024-01-25T14:52:42.881 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.921+0000 7f720f157700 1 -- start start 2024-01-25T14:52:42.881 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.921+0000 7f720f157700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72081070d0 0x7f72081074f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:42.881 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.921+0000 7f720f157700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7208107a30 con 0x7f72081070d0 2024-01-25T14:52:42.881 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.921+0000 7f720cef3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72081070d0 0x7f72081074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:42.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.922+0000 7f720cef3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72081070d0 0x7f72081074f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51430/0 (socket says 172.21.15.170:51430) 2024-01-25T14:52:42.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.922+0000 7f720cef3700 1 -- 172.21.15.170:0/1719611379 learned_addr learned my addr 172.21.15.170:0/1719611379 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:42.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.922+0000 7f720cef3700 1 -- 172.21.15.170:0/1719611379 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7208107b70 con 0x7f72081070d0 2024-01-25T14:52:42.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.922+0000 7f720cef3700 1 --2- 172.21.15.170:0/1719611379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72081070d0 0x7f72081074f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0098a0 tx=0x7f71fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6cefcf0c3592cd server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:42.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.922+0000 7f72077fe700 1 -- 172.21.15.170:0/1719611379 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71fc004160 con 0x7f72081070d0 2024-01-25T14:52:42.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.922+0000 7f72077fe700 1 -- 172.21.15.170:0/1719611379 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f71fc0042c0 con 0x7f72081070d0 2024-01-25T14:52:42.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.922+0000 7f72077fe700 1 -- 172.21.15.170:0/1719611379 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71fc011a00 con 0x7f72081070d0 2024-01-25T14:52:42.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.923+0000 7f720f157700 1 -- 172.21.15.170:0/1719611379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72081070d0 msgr2=0x7f72081074f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:42.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.923+0000 7f720f157700 1 --2- 172.21.15.170:0/1719611379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72081070d0 0x7f72081074f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f71fc0098a0 tx=0x7f71fc009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:42.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.923+0000 7f720f157700 1 -- 172.21.15.170:0/1719611379 shutdown_connections 2024-01-25T14:52:42.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.923+0000 7f720f157700 1 --2- 172.21.15.170:0/1719611379 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72081070d0 0x7f72081074f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:42.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.923+0000 7f720f157700 1 -- 172.21.15.170:0/1719611379 >> 172.21.15.170:0/1719611379 conn(0x7f7208102790 msgr2=0x7f7208104bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:42.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.923+0000 7f720f157700 1 -- 172.21.15.170:0/1719611379 shutdown_connections 2024-01-25T14:52:42.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.923+0000 7f720f157700 1 -- 172.21.15.170:0/1719611379 wait complete. 2024-01-25T14:52:42.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.923+0000 7f720f157700 1 Processor -- start 2024-01-25T14:52:42.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.923+0000 7f720f157700 1 -- start start 2024-01-25T14:52:42.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.923+0000 7f720f157700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72081070d0 0x7f720807cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:42.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.923+0000 7f720f157700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f720807d0d0 con 0x7f72081070d0 2024-01-25T14:52:42.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.923+0000 7f720cef3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72081070d0 0x7f720807cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:42.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.924+0000 7f720cef3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72081070d0 0x7f720807cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51442/0 (socket says 172.21.15.170:51442) 2024-01-25T14:52:42.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.924+0000 7f720cef3700 1 -- 172.21.15.170:0/3367962507 learned_addr learned my addr 172.21.15.170:0/3367962507 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:42.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.924+0000 7f720cef3700 1 -- 172.21.15.170:0/3367962507 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc009550 con 0x7f72081070d0 2024-01-25T14:52:42.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.924+0000 7f720cef3700 1 --2- 172.21.15.170:0/3367962507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72081070d0 0x7f720807cb90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009fb0 tx=0x7f71fc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:42.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.924+0000 7f7205ffb700 1 -- 172.21.15.170:0/3367962507 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71fc003a40 con 0x7f72081070d0 2024-01-25T14:52:42.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.924+0000 7f7205ffb700 1 -- 172.21.15.170:0/3367962507 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f71fc003ba0 con 0x7f72081070d0 2024-01-25T14:52:42.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.924+0000 7f720f157700 1 -- 172.21.15.170:0/3367962507 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f720807b2c0 con 0x7f72081070d0 2024-01-25T14:52:42.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.924+0000 7f7205ffb700 1 -- 172.21.15.170:0/3367962507 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71fc01a750 con 0x7f72081070d0 2024-01-25T14:52:42.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.924+0000 7f720f157700 1 -- 172.21.15.170:0/3367962507 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f720807b760 con 0x7f72081070d0 2024-01-25T14:52:42.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.925+0000 7f7205ffb700 1 -- 172.21.15.170:0/3367962507 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f71fc01a980 con 0x7f72081070d0 2024-01-25T14:52:42.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.925+0000 7f720f157700 1 -- 172.21.15.170:0/3367962507 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7208062e10 con 0x7f72081070d0 2024-01-25T14:52:42.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.925+0000 7f7205ffb700 1 --2- 172.21.15.170:0/3367962507 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f71f8038a40 0x7f71f803af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:42.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.925+0000 7f7205ffb700 1 -- 172.21.15.170:0/3367962507 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f71fc04cad0 con 0x7f72081070d0 2024-01-25T14:52:42.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.925+0000 7f7207fff700 1 --2- 172.21.15.170:0/3367962507 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f71f8038a40 0x7f71f803af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:42.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.926+0000 7f7207fff700 1 --2- 172.21.15.170:0/3367962507 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f71f8038a40 0x7f71f803af00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f71f4006fd0 tx=0x7f71f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:42.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:41.930+0000 7f7205ffb700 1 -- 172.21.15.170:0/3367962507 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f71fc01ac30 con 0x7f72081070d0 2024-01-25T14:52:42.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:42.144+0000 7f720f157700 1 -- 172.21.15.170:0/3367962507 --> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f720807be50 con 0x7f71f8038a40 2024-01-25T14:52:42.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:42.148+0000 7f7205ffb700 1 -- 172.21.15.170:0/3367962507 <== mgr.14120 v2:172.21.15.170:6800/358194066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f720807be50 con 0x7f71f8038a40 2024-01-25T14:52:42.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:42.150+0000 7f720f157700 1 -- 172.21.15.170:0/3367962507 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f71f8038a40 msgr2=0x7f71f803af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:42.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:42.150+0000 7f720f157700 1 --2- 172.21.15.170:0/3367962507 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f71f8038a40 0x7f71f803af00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f71f4006fd0 tx=0x7f71f4006e40 comp rx=0 tx=0).stop 2024-01-25T14:52:42.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:42.150+0000 7f720f157700 1 -- 172.21.15.170:0/3367962507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72081070d0 msgr2=0x7f720807cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:42.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:42.150+0000 7f720f157700 1 --2- 172.21.15.170:0/3367962507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72081070d0 0x7f720807cb90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f71fc009fb0 tx=0x7f71fc011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:42.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:42.151+0000 7f720f157700 1 -- 172.21.15.170:0/3367962507 shutdown_connections 2024-01-25T14:52:42.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:42.151+0000 7f720f157700 1 --2- 172.21.15.170:0/3367962507 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f71f8038a40 0x7f71f803af00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:42.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:42.151+0000 7f720f157700 1 --2- 172.21.15.170:0/3367962507 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72081070d0 0x7f720807cb90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:42.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:42.151+0000 7f720f157700 1 -- 172.21.15.170:0/3367962507 >> 172.21.15.170:0/3367962507 conn(0x7f7208102790 msgr2=0x7f7208103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:42.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:42.151+0000 7f720f157700 1 -- 172.21.15.170:0/3367962507 shutdown_connections 2024-01-25T14:52:42.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:42.151+0000 7f720f157700 1 -- 172.21.15.170:0/3367962507 wait complete. 2024-01-25T14:52:42.885 INFO:teuthology.orchestra.run.smithi170.stdout:Deploying unmanaged mgr service... 2024-01-25T14:52:43.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:43 smithi170 ceph-mon[31899]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:52:43.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:43 smithi170 ceph-mon[31899]: Saving service mon spec with placement count:5 2024-01-25T14:52:43.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:43 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' 2024-01-25T14:52:44.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:44 smithi170 ceph-mon[31899]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:52:44.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:44 smithi170 ceph-mon[31899]: Saving service mgr spec with placement count:2 2024-01-25T14:52:44.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:44 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' 2024-01-25T14:52:44.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:44 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' 2024-01-25T14:52:44.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-01-25T14:52:44.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.317+0000 7f4d7c945700 1 Processor -- start 2024-01-25T14:52:44.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.317+0000 7f4d7c945700 1 -- start start 2024-01-25T14:52:44.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.318+0000 7f4d7c945700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d781070f0 0x7f4d78107510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:44.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.318+0000 7f4d7c945700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d78107a50 con 0x7f4d781070f0 2024-01-25T14:52:44.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.318+0000 7f4d7659c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d781070f0 0x7f4d78107510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:44.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.318+0000 7f4d7659c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d781070f0 0x7f4d78107510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51450/0 (socket says 172.21.15.170:51450) 2024-01-25T14:52:44.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.318+0000 7f4d7659c700 1 -- 172.21.15.170:0/584528723 learned_addr learned my addr 172.21.15.170:0/584528723 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:44.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.318+0000 7f4d7659c700 1 -- 172.21.15.170:0/584528723 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d78107b90 con 0x7f4d781070f0 2024-01-25T14:52:44.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.318+0000 7f4d7659c700 1 --2- 172.21.15.170:0/584528723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d781070f0 0x7f4d78107510 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0098a0 tx=0x7f4d6c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d33c9e87185f32 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:44.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.318+0000 7f4d7559a700 1 -- 172.21.15.170:0/584528723 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d6c004160 con 0x7f4d781070f0 2024-01-25T14:52:44.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.318+0000 7f4d7559a700 1 -- 172.21.15.170:0/584528723 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4d6c0042c0 con 0x7f4d781070f0 2024-01-25T14:52:44.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.318+0000 7f4d7559a700 1 -- 172.21.15.170:0/584528723 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d6c011a00 con 0x7f4d781070f0 2024-01-25T14:52:44.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.319+0000 7f4d7c945700 1 -- 172.21.15.170:0/584528723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d781070f0 msgr2=0x7f4d78107510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:44.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.319+0000 7f4d7c945700 1 --2- 172.21.15.170:0/584528723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d781070f0 0x7f4d78107510 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0098a0 tx=0x7f4d6c009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:44.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.319+0000 7f4d7c945700 1 -- 172.21.15.170:0/584528723 shutdown_connections 2024-01-25T14:52:44.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.319+0000 7f4d7c945700 1 --2- 172.21.15.170:0/584528723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d781070f0 0x7f4d78107510 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:44.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.319+0000 7f4d7c945700 1 -- 172.21.15.170:0/584528723 >> 172.21.15.170:0/584528723 conn(0x7f4d78102790 msgr2=0x7f4d78104bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:44.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.319+0000 7f4d7c945700 1 -- 172.21.15.170:0/584528723 shutdown_connections 2024-01-25T14:52:44.887 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.319+0000 7f4d7c945700 1 -- 172.21.15.170:0/584528723 wait complete. 2024-01-25T14:52:44.887 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.320+0000 7f4d7c945700 1 Processor -- start 2024-01-25T14:52:44.887 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.320+0000 7f4d7c945700 1 -- start start 2024-01-25T14:52:44.887 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.320+0000 7f4d7c945700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d781070f0 0x7f4d7807cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:44.887 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.320+0000 7f4d7c945700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7807d0d0 con 0x7f4d781070f0 2024-01-25T14:52:44.887 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.320+0000 7f4d7659c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d781070f0 0x7f4d7807cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:44.887 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.320+0000 7f4d7659c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d781070f0 0x7f4d7807cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51454/0 (socket says 172.21.15.170:51454) 2024-01-25T14:52:44.887 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.320+0000 7f4d7659c700 1 -- 172.21.15.170:0/1210011875 learned_addr learned my addr 172.21.15.170:0/1210011875 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:44.887 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.320+0000 7f4d7659c700 1 -- 172.21.15.170:0/1210011875 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c009550 con 0x7f4d781070f0 2024-01-25T14:52:44.887 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.320+0000 7f4d7659c700 1 --2- 172.21.15.170:0/1210011875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d781070f0 0x7f4d7807cb90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009130 tx=0x7f4d6c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:44.887 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.321+0000 7f4d677fe700 1 -- 172.21.15.170:0/1210011875 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d6c003b70 con 0x7f4d781070f0 2024-01-25T14:52:44.887 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.321+0000 7f4d677fe700 1 -- 172.21.15.170:0/1210011875 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4d6c003cd0 con 0x7f4d781070f0 2024-01-25T14:52:44.887 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.321+0000 7f4d7c945700 1 -- 172.21.15.170:0/1210011875 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7807b2c0 con 0x7f4d781070f0 2024-01-25T14:52:44.887 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.321+0000 7f4d677fe700 1 -- 172.21.15.170:0/1210011875 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4d6c0197d0 con 0x7f4d781070f0 2024-01-25T14:52:44.888 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.321+0000 7f4d7c945700 1 -- 172.21.15.170:0/1210011875 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7807b760 con 0x7f4d781070f0 2024-01-25T14:52:44.888 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.321+0000 7f4d677fe700 1 -- 172.21.15.170:0/1210011875 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f4d6c019a10 con 0x7f4d781070f0 2024-01-25T14:52:44.888 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.322+0000 7f4d677fe700 1 --2- 172.21.15.170:0/1210011875 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f4d60038a40 0x7f4d6003af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:44.888 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.322+0000 7f4d677fe700 1 -- 172.21.15.170:0/1210011875 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4d6c04cca0 con 0x7f4d781070f0 2024-01-25T14:52:44.888 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.322+0000 7f4d75d9b700 1 --2- 172.21.15.170:0/1210011875 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f4d60038a40 0x7f4d6003af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:44.888 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.322+0000 7f4d7c945700 1 -- 172.21.15.170:0/1210011875 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d78062e10 con 0x7f4d781070f0 2024-01-25T14:52:44.888 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.322+0000 7f4d75d9b700 1 --2- 172.21.15.170:0/1210011875 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f4d60038a40 0x7f4d6003af00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4d68006fd0 tx=0x7f4d68006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:44.888 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.327+0000 7f4d677fe700 1 -- 172.21.15.170:0/1210011875 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f4d6c018db0 con 0x7f4d781070f0 2024-01-25T14:52:44.888 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.534+0000 7f4d7c945700 1 -- 172.21.15.170:0/1210011875 --> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4d7807bc40 con 0x7f4d60038a40 2024-01-25T14:52:44.888 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.538+0000 7f4d677fe700 1 -- 172.21.15.170:0/1210011875 <== mgr.14120 v2:172.21.15.170:6800/358194066 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4d7807bc40 con 0x7f4d60038a40 2024-01-25T14:52:44.888 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.540+0000 7f4d7c945700 1 -- 172.21.15.170:0/1210011875 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f4d60038a40 msgr2=0x7f4d6003af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:44.888 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.540+0000 7f4d7c945700 1 --2- 172.21.15.170:0/1210011875 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f4d60038a40 0x7f4d6003af00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4d68006fd0 tx=0x7f4d68006e40 comp rx=0 tx=0).stop 2024-01-25T14:52:44.889 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.540+0000 7f4d7c945700 1 -- 172.21.15.170:0/1210011875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d781070f0 msgr2=0x7f4d7807cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:44.889 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.540+0000 7f4d7c945700 1 --2- 172.21.15.170:0/1210011875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d781070f0 0x7f4d7807cb90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009130 tx=0x7f4d6c011ad0 comp rx=0 tx=0).stop 2024-01-25T14:52:44.889 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.540+0000 7f4d7c945700 1 -- 172.21.15.170:0/1210011875 shutdown_connections 2024-01-25T14:52:44.889 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.540+0000 7f4d7c945700 1 --2- 172.21.15.170:0/1210011875 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f4d60038a40 0x7f4d6003af00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:44.889 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.540+0000 7f4d7c945700 1 --2- 172.21.15.170:0/1210011875 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d781070f0 0x7f4d7807cb90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:44.889 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.541+0000 7f4d7c945700 1 -- 172.21.15.170:0/1210011875 >> 172.21.15.170:0/1210011875 conn(0x7f4d78102790 msgr2=0x7f4d781032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:44.889 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.541+0000 7f4d7c945700 1 -- 172.21.15.170:0/1210011875 shutdown_connections 2024-01-25T14:52:44.889 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:43.541+0000 7f4d7c945700 1 -- 172.21.15.170:0/1210011875 wait complete. 2024-01-25T14:52:46.067 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:45 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' 2024-01-25T14:52:46.068 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:45 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1931481953' entity='client.admin' 2024-01-25T14:52:46.712 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.348+0000 7fb814484700 1 Processor -- start 2024-01-25T14:52:46.712 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.348+0000 7fb814484700 1 -- start start 2024-01-25T14:52:46.713 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.348+0000 7fb814484700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb80c105380 0x7fb80c1057a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:46.713 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.348+0000 7fb814484700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c105d70 con 0x7fb80c105380 2024-01-25T14:52:46.713 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.348+0000 7fb812220700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb80c105380 0x7fb80c1057a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:46.713 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.348+0000 7fb812220700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb80c105380 0x7fb80c1057a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51460/0 (socket says 172.21.15.170:51460) 2024-01-25T14:52:46.713 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.348+0000 7fb812220700 1 -- 172.21.15.170:0/1523928274 learned_addr learned my addr 172.21.15.170:0/1523928274 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:46.713 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.348+0000 7fb812220700 1 -- 172.21.15.170:0/1523928274 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c105eb0 con 0x7fb80c105380 2024-01-25T14:52:46.713 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.349+0000 7fb812220700 1 --2- 172.21.15.170:0/1523928274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb80c105380 0x7fb80c1057a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb8080098a0 tx=0x7fb808009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7166012cfa181a92 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:46.713 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.349+0000 7fb81121e700 1 -- 172.21.15.170:0/1523928274 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb808004160 con 0x7fb80c105380 2024-01-25T14:52:46.713 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.349+0000 7fb81121e700 1 -- 172.21.15.170:0/1523928274 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8080042c0 con 0x7fb80c105380 2024-01-25T14:52:46.713 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.349+0000 7fb81121e700 1 -- 172.21.15.170:0/1523928274 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8080119b0 con 0x7fb80c105380 2024-01-25T14:52:46.713 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.349+0000 7fb814484700 1 -- 172.21.15.170:0/1523928274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb80c105380 msgr2=0x7fb80c1057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:46.713 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.349+0000 7fb814484700 1 --2- 172.21.15.170:0/1523928274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb80c105380 0x7fb80c1057a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb8080098a0 tx=0x7fb808009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:46.714 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.350+0000 7fb814484700 1 -- 172.21.15.170:0/1523928274 shutdown_connections 2024-01-25T14:52:46.714 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.350+0000 7fb814484700 1 --2- 172.21.15.170:0/1523928274 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb80c105380 0x7fb80c1057a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:46.714 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.350+0000 7fb814484700 1 -- 172.21.15.170:0/1523928274 >> 172.21.15.170:0/1523928274 conn(0x7fb80c100da0 msgr2=0x7fb80c1031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:46.714 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.350+0000 7fb814484700 1 -- 172.21.15.170:0/1523928274 shutdown_connections 2024-01-25T14:52:46.714 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.350+0000 7fb814484700 1 -- 172.21.15.170:0/1523928274 wait complete. 2024-01-25T14:52:46.714 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.350+0000 7fb814484700 1 Processor -- start 2024-01-25T14:52:46.714 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.350+0000 7fb814484700 1 -- start start 2024-01-25T14:52:46.714 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.350+0000 7fb814484700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb80c105380 0x7fb80c107be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:46.714 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.351+0000 7fb814484700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c108120 con 0x7fb80c105380 2024-01-25T14:52:46.714 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.351+0000 7fb812220700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb80c105380 0x7fb80c107be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:46.714 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.351+0000 7fb812220700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb80c105380 0x7fb80c107be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51476/0 (socket says 172.21.15.170:51476) 2024-01-25T14:52:46.714 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.351+0000 7fb812220700 1 -- 172.21.15.170:0/1931481953 learned_addr learned my addr 172.21.15.170:0/1931481953 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:46.714 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.351+0000 7fb812220700 1 -- 172.21.15.170:0/1931481953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb808009550 con 0x7fb80c105380 2024-01-25T14:52:46.714 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.351+0000 7fb812220700 1 --2- 172.21.15.170:0/1931481953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb80c105380 0x7fb80c107be0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb808011670 tx=0x7fb808011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:46.715 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.351+0000 7fb8037fe700 1 -- 172.21.15.170:0/1931481953 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb808003af0 con 0x7fb80c105380 2024-01-25T14:52:46.715 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.351+0000 7fb8037fe700 1 -- 172.21.15.170:0/1931481953 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb808003c50 con 0x7fb80c105380 2024-01-25T14:52:46.715 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.351+0000 7fb814484700 1 -- 172.21.15.170:0/1931481953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80c106310 con 0x7fb80c105380 2024-01-25T14:52:46.715 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.351+0000 7fb8037fe700 1 -- 172.21.15.170:0/1931481953 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb808024820 con 0x7fb80c105380 2024-01-25T14:52:46.715 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.351+0000 7fb814484700 1 -- 172.21.15.170:0/1931481953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80c1067b0 con 0x7fb80c105380 2024-01-25T14:52:46.715 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.352+0000 7fb8037fe700 1 -- 172.21.15.170:0/1931481953 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7fb808024aa0 con 0x7fb80c105380 2024-01-25T14:52:46.715 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.352+0000 7fb8037fe700 1 --2- 172.21.15.170:0/1931481953 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7fb7f8038a40 0x7fb7f803af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:46.715 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.352+0000 7fb8037fe700 1 -- 172.21.15.170:0/1931481953 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb80804d960 con 0x7fb80c105380 2024-01-25T14:52:46.715 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.352+0000 7fb811a1f700 1 --2- 172.21.15.170:0/1931481953 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7fb7f8038a40 0x7fb7f803af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:46.715 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.352+0000 7fb814484700 1 -- 172.21.15.170:0/1931481953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80c105eb0 con 0x7fb80c105380 2024-01-25T14:52:46.715 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.353+0000 7fb811a1f700 1 --2- 172.21.15.170:0/1931481953 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7fb7f8038a40 0x7fb7f803af00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc006fd0 tx=0x7fb7fc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:46.715 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.357+0000 7fb8037fe700 1 -- 172.21.15.170:0/1931481953 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb80c105eb0 con 0x7fb80c105380 2024-01-25T14:52:46.715 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.582+0000 7fb814484700 1 -- 172.21.15.170:0/1931481953 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fb80c105eb0 con 0x7fb80c105380 2024-01-25T14:52:46.716 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.585+0000 7fb8037fe700 1 -- 172.21.15.170:0/1931481953 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fb80c105eb0 con 0x7fb80c105380 2024-01-25T14:52:46.716 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.587+0000 7fb814484700 1 -- 172.21.15.170:0/1931481953 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7fb7f8038a40 msgr2=0x7fb7f803af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:46.716 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.587+0000 7fb814484700 1 --2- 172.21.15.170:0/1931481953 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7fb7f8038a40 0x7fb7f803af00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc006fd0 tx=0x7fb7fc006e40 comp rx=0 tx=0).stop 2024-01-25T14:52:46.716 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.588+0000 7fb814484700 1 -- 172.21.15.170:0/1931481953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb80c105380 msgr2=0x7fb80c107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:46.716 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.588+0000 7fb814484700 1 --2- 172.21.15.170:0/1931481953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb80c105380 0x7fb80c107be0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb808011670 tx=0x7fb808011a30 comp rx=0 tx=0).stop 2024-01-25T14:52:46.716 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.588+0000 7fb814484700 1 -- 172.21.15.170:0/1931481953 shutdown_connections 2024-01-25T14:52:46.716 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.588+0000 7fb814484700 1 --2- 172.21.15.170:0/1931481953 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7fb7f8038a40 0x7fb7f803af00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:46.716 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.588+0000 7fb814484700 1 --2- 172.21.15.170:0/1931481953 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb80c105380 0x7fb80c107be0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:46.716 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.588+0000 7fb814484700 1 -- 172.21.15.170:0/1931481953 >> 172.21.15.170:0/1931481953 conn(0x7fb80c100da0 msgr2=0x7fb80c1019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:46.716 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.588+0000 7fb814484700 1 -- 172.21.15.170:0/1931481953 shutdown_connections 2024-01-25T14:52:46.716 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:45.588+0000 7fb814484700 1 -- 172.21.15.170:0/1931481953 wait complete. 2024-01-25T14:52:47.993 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.160+0000 7f0e54552700 1 Processor -- start 2024-01-25T14:52:47.994 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.160+0000 7f0e54552700 1 -- start start 2024-01-25T14:52:47.994 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.160+0000 7f0e54552700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e4c1070d0 0x7f0e4c1074f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:47.994 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.160+0000 7f0e54552700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c107a30 con 0x7f0e4c1070d0 2024-01-25T14:52:47.994 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.160+0000 7f0e522ee700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e4c1070d0 0x7f0e4c1074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:47.994 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.160+0000 7f0e522ee700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e4c1070d0 0x7f0e4c1074f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44390/0 (socket says 172.21.15.170:44390) 2024-01-25T14:52:47.994 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.160+0000 7f0e522ee700 1 -- 172.21.15.170:0/3238129437 learned_addr learned my addr 172.21.15.170:0/3238129437 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:47.994 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.161+0000 7f0e522ee700 1 -- 172.21.15.170:0/3238129437 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c107b70 con 0x7f0e4c1070d0 2024-01-25T14:52:47.994 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.161+0000 7f0e522ee700 1 --2- 172.21.15.170:0/3238129437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e4c1070d0 0x7f0e4c1074f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0098a0 tx=0x7f0e3c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1510813d891a6eb server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:47.994 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.161+0000 7f0e512ec700 1 -- 172.21.15.170:0/3238129437 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e3c004160 con 0x7f0e4c1070d0 2024-01-25T14:52:47.994 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.161+0000 7f0e512ec700 1 -- 172.21.15.170:0/3238129437 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e3c0042c0 con 0x7f0e4c1070d0 2024-01-25T14:52:47.994 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.161+0000 7f0e512ec700 1 -- 172.21.15.170:0/3238129437 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e3c0119b0 con 0x7f0e4c1070d0 2024-01-25T14:52:47.994 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.161+0000 7f0e54552700 1 -- 172.21.15.170:0/3238129437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e4c1070d0 msgr2=0x7f0e4c1074f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:47.995 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.161+0000 7f0e54552700 1 --2- 172.21.15.170:0/3238129437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e4c1070d0 0x7f0e4c1074f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0098a0 tx=0x7f0e3c009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:47.995 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.162+0000 7f0e54552700 1 -- 172.21.15.170:0/3238129437 shutdown_connections 2024-01-25T14:52:47.995 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.162+0000 7f0e54552700 1 --2- 172.21.15.170:0/3238129437 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e4c1070d0 0x7f0e4c1074f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:47.995 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.162+0000 7f0e54552700 1 -- 172.21.15.170:0/3238129437 >> 172.21.15.170:0/3238129437 conn(0x7f0e4c102790 msgr2=0x7f0e4c104bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:47.995 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.162+0000 7f0e54552700 1 -- 172.21.15.170:0/3238129437 shutdown_connections 2024-01-25T14:52:47.995 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.162+0000 7f0e54552700 1 -- 172.21.15.170:0/3238129437 wait complete. 2024-01-25T14:52:47.995 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.162+0000 7f0e54552700 1 Processor -- start 2024-01-25T14:52:47.995 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.162+0000 7f0e54552700 1 -- start start 2024-01-25T14:52:47.995 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.162+0000 7f0e54552700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e4c1070d0 0x7f0e4c07cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:47.995 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.162+0000 7f0e54552700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c07d0d0 con 0x7f0e4c1070d0 2024-01-25T14:52:47.995 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.162+0000 7f0e522ee700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e4c1070d0 0x7f0e4c07cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:47.995 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.162+0000 7f0e522ee700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e4c1070d0 0x7f0e4c07cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44394/0 (socket says 172.21.15.170:44394) 2024-01-25T14:52:47.995 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.162+0000 7f0e522ee700 1 -- 172.21.15.170:0/2461121214 learned_addr learned my addr 172.21.15.170:0/2461121214 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:47.995 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.163+0000 7f0e522ee700 1 -- 172.21.15.170:0/2461121214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c009550 con 0x7f0e4c1070d0 2024-01-25T14:52:47.996 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.163+0000 7f0e522ee700 1 --2- 172.21.15.170:0/2461121214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e4c1070d0 0x7f0e4c07cb90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c011670 tx=0x7f0e3c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:47.996 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.163+0000 7f0e437fe700 1 -- 172.21.15.170:0/2461121214 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e3c003b20 con 0x7f0e4c1070d0 2024-01-25T14:52:47.996 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.163+0000 7f0e437fe700 1 -- 172.21.15.170:0/2461121214 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e3c003c80 con 0x7f0e4c1070d0 2024-01-25T14:52:47.996 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.163+0000 7f0e437fe700 1 -- 172.21.15.170:0/2461121214 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e3c019770 con 0x7f0e4c1070d0 2024-01-25T14:52:47.996 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.163+0000 7f0e54552700 1 -- 172.21.15.170:0/2461121214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c07b2c0 con 0x7f0e4c1070d0 2024-01-25T14:52:47.996 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.163+0000 7f0e54552700 1 -- 172.21.15.170:0/2461121214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4c07b760 con 0x7f0e4c1070d0 2024-01-25T14:52:47.996 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.164+0000 7f0e437fe700 1 -- 172.21.15.170:0/2461121214 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f0e3c01ab60 con 0x7f0e4c1070d0 2024-01-25T14:52:47.996 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.164+0000 7f0e54552700 1 -- 172.21.15.170:0/2461121214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4c062e10 con 0x7f0e4c1070d0 2024-01-25T14:52:47.996 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.164+0000 7f0e437fe700 1 --2- 172.21.15.170:0/2461121214 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f0e38038a90 0x7f0e3803af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:47.996 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.164+0000 7f0e437fe700 1 -- 172.21.15.170:0/2461121214 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f0e3c04cca0 con 0x7f0e4c1070d0 2024-01-25T14:52:47.996 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.164+0000 7f0e51aed700 1 --2- 172.21.15.170:0/2461121214 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f0e38038a90 0x7f0e3803af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:47.996 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.164+0000 7f0e51aed700 1 --2- 172.21.15.170:0/2461121214 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f0e38038a90 0x7f0e3803af50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0e48006fd0 tx=0x7f0e48006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:47.997 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.169+0000 7f0e437fe700 1 -- 172.21.15.170:0/2461121214 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f0e3c01a430 con 0x7f0e4c1070d0 2024-01-25T14:52:47.997 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.374+0000 7f0e54552700 1 -- 172.21.15.170:0/2461121214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f0e4c108f30 con 0x7f0e4c1070d0 2024-01-25T14:52:47.997 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.376+0000 7f0e437fe700 1 -- 172.21.15.170:0/2461121214 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f0e3c02db40 con 0x7f0e4c1070d0 2024-01-25T14:52:47.997 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.378+0000 7f0e54552700 1 -- 172.21.15.170:0/2461121214 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f0e38038a90 msgr2=0x7f0e3803af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:47.997 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.378+0000 7f0e54552700 1 --2- 172.21.15.170:0/2461121214 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f0e38038a90 0x7f0e3803af50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0e48006fd0 tx=0x7f0e48006e40 comp rx=0 tx=0).stop 2024-01-25T14:52:47.997 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.378+0000 7f0e54552700 1 -- 172.21.15.170:0/2461121214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e4c1070d0 msgr2=0x7f0e4c07cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:47.997 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.378+0000 7f0e54552700 1 --2- 172.21.15.170:0/2461121214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e4c1070d0 0x7f0e4c07cb90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c011670 tx=0x7f0e3c011a30 comp rx=0 tx=0).stop 2024-01-25T14:52:47.997 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.379+0000 7f0e54552700 1 -- 172.21.15.170:0/2461121214 shutdown_connections 2024-01-25T14:52:47.997 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.379+0000 7f0e54552700 1 --2- 172.21.15.170:0/2461121214 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f0e38038a90 0x7f0e3803af50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:47.997 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.379+0000 7f0e54552700 1 --2- 172.21.15.170:0/2461121214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0e4c1070d0 0x7f0e4c07cb90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:47.997 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.379+0000 7f0e54552700 1 -- 172.21.15.170:0/2461121214 >> 172.21.15.170:0/2461121214 conn(0x7f0e4c102790 msgr2=0x7f0e4c103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:47.997 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.379+0000 7f0e54552700 1 -- 172.21.15.170:0/2461121214 shutdown_connections 2024-01-25T14:52:47.997 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:47.379+0000 7f0e54552700 1 -- 172.21.15.170:0/2461121214 wait complete. 2024-01-25T14:52:47.998 INFO:teuthology.orchestra.run.smithi170.stdout:Enabling the dashboard module... 2024-01-25T14:52:48.314 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:48 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' 2024-01-25T14:52:48.314 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:48 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2461121214' entity='client.admin' 2024-01-25T14:52:49.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:49 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2807722787' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-01-25T14:52:49.559 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:49 smithi170 ceph-mon[31899]: from='mgr.14120 172.21.15.170:0/3275567436' entity='mgr.x' 2024-01-25T14:52:49.559 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:49 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: ignoring --setuser ceph since I am not root 2024-01-25T14:52:49.559 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:49 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: ignoring --setgroup ceph since I am not root 2024-01-25T14:52:49.874 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:49 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:49.785+0000 7f6600e5b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-25T14:52:49.911 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.418+0000 7f43e1340700 1 Processor -- start 2024-01-25T14:52:49.911 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.418+0000 7f43e1340700 1 -- start start 2024-01-25T14:52:49.911 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.418+0000 7f43e1340700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43dc07ce40 0x7f43dc07b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:49.911 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.418+0000 7f43e1340700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc07b880 con 0x7f43dc07ce40 2024-01-25T14:52:49.912 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.418+0000 7f43daffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43dc07ce40 0x7f43dc07b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:49.912 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.418+0000 7f43daffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43dc07ce40 0x7f43dc07b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44398/0 (socket says 172.21.15.170:44398) 2024-01-25T14:52:49.912 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.418+0000 7f43daffd700 1 -- 172.21.15.170:0/1995963970 learned_addr learned my addr 172.21.15.170:0/1995963970 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:49.912 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.418+0000 7f43daffd700 1 -- 172.21.15.170:0/1995963970 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc07b9c0 con 0x7f43dc07ce40 2024-01-25T14:52:49.912 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.418+0000 7f43daffd700 1 --2- 172.21.15.170:0/1995963970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43dc07ce40 0x7f43dc07b340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0098a0 tx=0x7f43cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea5d192de2cf93d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:49.912 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.419+0000 7f43d9ffb700 1 -- 172.21.15.170:0/1995963970 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43cc004160 con 0x7f43dc07ce40 2024-01-25T14:52:49.912 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.419+0000 7f43d9ffb700 1 -- 172.21.15.170:0/1995963970 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43cc0042c0 con 0x7f43dc07ce40 2024-01-25T14:52:49.912 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.419+0000 7f43d9ffb700 1 -- 172.21.15.170:0/1995963970 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43cc0119b0 con 0x7f43dc07ce40 2024-01-25T14:52:49.912 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.419+0000 7f43e1340700 1 -- 172.21.15.170:0/1995963970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43dc07ce40 msgr2=0x7f43dc07b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:49.912 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.419+0000 7f43e1340700 1 --2- 172.21.15.170:0/1995963970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43dc07ce40 0x7f43dc07b340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f43cc0098a0 tx=0x7f43cc009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:49.912 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.419+0000 7f43e1340700 1 -- 172.21.15.170:0/1995963970 shutdown_connections 2024-01-25T14:52:49.912 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.419+0000 7f43e1340700 1 --2- 172.21.15.170:0/1995963970 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43dc07ce40 0x7f43dc07b340 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:49.913 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.419+0000 7f43e1340700 1 -- 172.21.15.170:0/1995963970 >> 172.21.15.170:0/1995963970 conn(0x7f43dc1027c0 msgr2=0x7f43dc104be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:49.913 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.419+0000 7f43e1340700 1 -- 172.21.15.170:0/1995963970 shutdown_connections 2024-01-25T14:52:49.913 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.419+0000 7f43e1340700 1 -- 172.21.15.170:0/1995963970 wait complete. 2024-01-25T14:52:49.913 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.420+0000 7f43e1340700 1 Processor -- start 2024-01-25T14:52:49.913 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.420+0000 7f43e1340700 1 -- start start 2024-01-25T14:52:49.913 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.421+0000 7f43e1340700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43dc07ce40 0x7f43dc19d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:49.913 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.421+0000 7f43e1340700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc19d590 con 0x7f43dc07ce40 2024-01-25T14:52:49.913 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.421+0000 7f43daffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43dc07ce40 0x7f43dc19d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:49.913 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.421+0000 7f43daffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43dc07ce40 0x7f43dc19d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44412/0 (socket says 172.21.15.170:44412) 2024-01-25T14:52:49.913 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.421+0000 7f43daffd700 1 -- 172.21.15.170:0/2807722787 learned_addr learned my addr 172.21.15.170:0/2807722787 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:49.913 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.421+0000 7f43daffd700 1 -- 172.21.15.170:0/2807722787 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc009550 con 0x7f43dc07ce40 2024-01-25T14:52:49.913 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.421+0000 7f43daffd700 1 --2- 172.21.15.170:0/2807722787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43dc07ce40 0x7f43dc19d050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f43cc003e60 tx=0x7f43cc011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:49.914 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.421+0000 7f43c3fff700 1 -- 172.21.15.170:0/2807722787 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43cc0038b0 con 0x7f43dc07ce40 2024-01-25T14:52:49.914 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.421+0000 7f43c3fff700 1 -- 172.21.15.170:0/2807722787 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43cc003a10 con 0x7f43dc07ce40 2024-01-25T14:52:49.914 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.421+0000 7f43c3fff700 1 -- 172.21.15.170:0/2807722787 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43cc019530 con 0x7f43dc07ce40 2024-01-25T14:52:49.914 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.421+0000 7f43e1340700 1 -- 172.21.15.170:0/2807722787 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc19d790 con 0x7f43dc07ce40 2024-01-25T14:52:49.914 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.421+0000 7f43e1340700 1 -- 172.21.15.170:0/2807722787 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc19dc30 con 0x7f43dc07ce40 2024-01-25T14:52:49.914 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.422+0000 7f43c3fff700 1 -- 172.21.15.170:0/2807722787 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 8) v1 ==== 45641+0+0 (secure 0 0 0) 0x7f43cc0197f0 con 0x7f43dc07ce40 2024-01-25T14:52:49.914 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.422+0000 7f43e1340700 1 -- 172.21.15.170:0/2807722787 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43dc10d4e0 con 0x7f43dc07ce40 2024-01-25T14:52:49.914 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.423+0000 7f43c3fff700 1 --2- 172.21.15.170:0/2807722787 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f43c40389f0 0x7f43c403aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:49.914 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.423+0000 7f43c3fff700 1 -- 172.21.15.170:0/2807722787 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f43cc04cbd0 con 0x7f43dc07ce40 2024-01-25T14:52:49.914 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.423+0000 7f43da7fc700 1 --2- 172.21.15.170:0/2807722787 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f43c40389f0 0x7f43c403aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:49.914 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.423+0000 7f43da7fc700 1 --2- 172.21.15.170:0/2807722787 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f43c40389f0 0x7f43c403aeb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f43d0006fd0 tx=0x7f43d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:49.914 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.427+0000 7f43c3fff700 1 -- 172.21.15.170:0/2807722787 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f43cc02b340 con 0x7f43dc07ce40 2024-01-25T14:52:49.915 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:48.678+0000 7f43e1340700 1 -- 172.21.15.170:0/2807722787 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f43dc1a0510 con 0x7f43dc07ce40 2024-01-25T14:52:49.915 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:49.229+0000 7f43c3fff700 1 -- 172.21.15.170:0/2807722787 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f43cc04c540 con 0x7f43dc07ce40 2024-01-25T14:52:49.915 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:49.231+0000 7f43c3fff700 1 -- 172.21.15.170:0/2807722787 <== mon.0 v2:172.21.15.170:3300/0 8 ==== mgrmap(e 9) v1 ==== 45654+0+0 (secure 0 0 0) 0x7f43cc016d60 con 0x7f43dc07ce40 2024-01-25T14:52:49.915 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:49.233+0000 7f43e1340700 1 -- 172.21.15.170:0/2807722787 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f43c40389f0 msgr2=0x7f43c403aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:49.915 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:49.233+0000 7f43e1340700 1 --2- 172.21.15.170:0/2807722787 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f43c40389f0 0x7f43c403aeb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f43d0006fd0 tx=0x7f43d0006e40 comp rx=0 tx=0).stop 2024-01-25T14:52:49.915 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:49.233+0000 7f43e1340700 1 -- 172.21.15.170:0/2807722787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43dc07ce40 msgr2=0x7f43dc19d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:49.915 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:49.233+0000 7f43e1340700 1 --2- 172.21.15.170:0/2807722787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43dc07ce40 0x7f43dc19d050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f43cc003e60 tx=0x7f43cc011a30 comp rx=0 tx=0).stop 2024-01-25T14:52:49.915 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:49.233+0000 7f43e1340700 1 -- 172.21.15.170:0/2807722787 shutdown_connections 2024-01-25T14:52:49.915 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:49.233+0000 7f43e1340700 1 --2- 172.21.15.170:0/2807722787 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f43c40389f0 0x7f43c403aeb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:49.915 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:49.233+0000 7f43e1340700 1 --2- 172.21.15.170:0/2807722787 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f43dc07ce40 0x7f43dc19d050 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:49.915 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:49.233+0000 7f43e1340700 1 -- 172.21.15.170:0/2807722787 >> 172.21.15.170:0/2807722787 conn(0x7f43dc1027c0 msgr2=0x7f43dc103330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:49.915 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:49.233+0000 7f43e1340700 1 -- 172.21.15.170:0/2807722787 shutdown_connections 2024-01-25T14:52:49.915 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:49.233+0000 7f43e1340700 1 -- 172.21.15.170:0/2807722787 wait complete. 2024-01-25T14:52:50.133 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:49 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:49.878+0000 7f6600e5b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-25T14:52:50.464 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:50 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2807722787' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-01-25T14:52:50.464 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:50 smithi170 ceph-mon[31899]: mgrmap e9: x(active, since 19s) 2024-01-25T14:52:50.718 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:50.530+0000 7f6600e5b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-25T14:52:50.718 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:50.624+0000 7f6600e5b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-25T14:52:50.718 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:50.716+0000 7f6600e5b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-25T14:52:51.060 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:50.873+0000 7f6600e5b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-25T14:52:51.060 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:50.959+0000 7f6600e5b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-25T14:52:51.326 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:51 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/4104309945' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-01-25T14:52:51.327 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:51 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:51.141+0000 7f6600e5b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-25T14:52:51.598 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:51 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:51.325+0000 7f6600e5b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-25T14:52:51.598 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:51 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:51.414+0000 7f6600e5b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-25T14:52:51.598 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:51 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:51.508+0000 7f6600e5b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-25T14:52:51.873 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:51 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:51.597+0000 7f6600e5b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-25T14:52:51.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout { 2024-01-25T14:52:51.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-01-25T14:52:51.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "available": true, 2024-01-25T14:52:51.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-01-25T14:52:51.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-01-25T14:52:51.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout } 2024-01-25T14:52:51.882 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.673+0000 7f1acf50b700 1 Processor -- start 2024-01-25T14:52:51.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.673+0000 7f1acf50b700 1 -- start start 2024-01-25T14:52:51.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.673+0000 7f1acf50b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8107bb0 0x7f1ac8109fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:51.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.673+0000 7f1acf50b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac807ae70 con 0x7f1ac8107bb0 2024-01-25T14:52:51.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.674+0000 7f1acd2a7700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8107bb0 0x7f1ac8109fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:51.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.674+0000 7f1acd2a7700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8107bb0 0x7f1ac8109fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44450/0 (socket says 172.21.15.170:44450) 2024-01-25T14:52:51.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.674+0000 7f1acd2a7700 1 -- 172.21.15.170:0/1451069344 learned_addr learned my addr 172.21.15.170:0/1451069344 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:51.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.674+0000 7f1acd2a7700 1 -- 172.21.15.170:0/1451069344 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac810a4e0 con 0x7f1ac8107bb0 2024-01-25T14:52:51.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.674+0000 7f1acd2a7700 1 --2- 172.21.15.170:0/1451069344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8107bb0 0x7f1ac8109fa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40098a0 tx=0x7f1ac4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5deeaed6ca77f619 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:51.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.674+0000 7f1abffff700 1 -- 172.21.15.170:0/1451069344 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac4004160 con 0x7f1ac8107bb0 2024-01-25T14:52:51.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.674+0000 7f1abffff700 1 -- 172.21.15.170:0/1451069344 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ac40042c0 con 0x7f1ac8107bb0 2024-01-25T14:52:51.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.674+0000 7f1abffff700 1 -- 172.21.15.170:0/1451069344 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac40119b0 con 0x7f1ac8107bb0 2024-01-25T14:52:51.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.675+0000 7f1acf50b700 1 -- 172.21.15.170:0/1451069344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8107bb0 msgr2=0x7f1ac8109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:51.883 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.675+0000 7f1acf50b700 1 --2- 172.21.15.170:0/1451069344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8107bb0 0x7f1ac8109fa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ac40098a0 tx=0x7f1ac4009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:51.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.675+0000 7f1acf50b700 1 -- 172.21.15.170:0/1451069344 shutdown_connections 2024-01-25T14:52:51.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.675+0000 7f1acf50b700 1 --2- 172.21.15.170:0/1451069344 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8107bb0 0x7f1ac8109fa0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:51.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.675+0000 7f1acf50b700 1 -- 172.21.15.170:0/1451069344 >> 172.21.15.170:0/1451069344 conn(0x7f1ac81015e0 msgr2=0x7f1ac8103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:51.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.675+0000 7f1acf50b700 1 -- 172.21.15.170:0/1451069344 shutdown_connections 2024-01-25T14:52:51.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.675+0000 7f1acf50b700 1 -- 172.21.15.170:0/1451069344 wait complete. 2024-01-25T14:52:51.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.676+0000 7f1acf50b700 1 Processor -- start 2024-01-25T14:52:51.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.676+0000 7f1acf50b700 1 -- start start 2024-01-25T14:52:51.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.676+0000 7f1acf50b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8107bb0 0x7f1ac819ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:51.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.676+0000 7f1acf50b700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac819b3a0 con 0x7f1ac8107bb0 2024-01-25T14:52:51.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.676+0000 7f1acd2a7700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8107bb0 0x7f1ac819ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:51.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.676+0000 7f1acd2a7700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8107bb0 0x7f1ac819ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44464/0 (socket says 172.21.15.170:44464) 2024-01-25T14:52:51.884 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.676+0000 7f1acd2a7700 1 -- 172.21.15.170:0/4104309945 learned_addr learned my addr 172.21.15.170:0/4104309945 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:51.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.677+0000 7f1acd2a7700 1 -- 172.21.15.170:0/4104309945 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac4009550 con 0x7f1ac8107bb0 2024-01-25T14:52:51.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.677+0000 7f1acd2a7700 1 --2- 172.21.15.170:0/4104309945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8107bb0 0x7f1ac819ae60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4006af0 tx=0x7f1ac4011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:51.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.677+0000 7f1abe7fc700 1 -- 172.21.15.170:0/4104309945 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac4003a40 con 0x7f1ac8107bb0 2024-01-25T14:52:51.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.677+0000 7f1abe7fc700 1 -- 172.21.15.170:0/4104309945 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ac4003ba0 con 0x7f1ac8107bb0 2024-01-25T14:52:51.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.677+0000 7f1acf50b700 1 -- 172.21.15.170:0/4104309945 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac819b5a0 con 0x7f1ac8107bb0 2024-01-25T14:52:51.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.677+0000 7f1abe7fc700 1 -- 172.21.15.170:0/4104309945 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac40196c0 con 0x7f1ac8107bb0 2024-01-25T14:52:51.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.677+0000 7f1acf50b700 1 -- 172.21.15.170:0/4104309945 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac819ba40 con 0x7f1ac8107bb0 2024-01-25T14:52:51.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.678+0000 7f1acf50b700 1 -- 172.21.15.170:0/4104309945 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac810b2c0 con 0x7f1ac8107bb0 2024-01-25T14:52:51.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.678+0000 7f1abe7fc700 1 -- 172.21.15.170:0/4104309945 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 9) v1 ==== 45654+0+0 (secure 0 0 0) 0x7f1ac401aa80 con 0x7f1ac8107bb0 2024-01-25T14:52:51.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.678+0000 7f1abe7fc700 1 --2- 172.21.15.170:0/4104309945 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f1ab4038aa0 0x7f1ab403af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:51.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.678+0000 7f1abe7fc700 1 -- 172.21.15.170:0/4104309945 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1ac404ca30 con 0x7f1ac8107bb0 2024-01-25T14:52:51.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.678+0000 7f1accaa6700 1 -- 172.21.15.170:0/4104309945 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f1ab4038aa0 msgr2=0x7f1ab403af60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.170:6800/358194066 2024-01-25T14:52:51.885 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.678+0000 7f1accaa6700 1 --2- 172.21.15.170:0/4104309945 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f1ab4038aa0 0x7f1ab403af60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-25T14:52:51.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.683+0000 7f1abe7fc700 1 -- 172.21.15.170:0/4104309945 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1ac401a430 con 0x7f1ac8107bb0 2024-01-25T14:52:51.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.879+0000 7f1accaa6700 1 -- 172.21.15.170:0/4104309945 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f1ab4038aa0 msgr2=0x7f1ab403af60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.170:6800/358194066 2024-01-25T14:52:51.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.879+0000 7f1accaa6700 1 --2- 172.21.15.170:0/4104309945 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f1ab4038aa0 0x7f1ab403af60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-25T14:52:51.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.941+0000 7f1acf50b700 1 -- 172.21.15.170:0/4104309945 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f1ac819e2d0 con 0x7f1ac8107bb0 2024-01-25T14:52:51.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.942+0000 7f1abe7fc700 1 -- 172.21.15.170:0/4104309945 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f1ac400b3e0 con 0x7f1ac8107bb0 2024-01-25T14:52:51.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.944+0000 7f1acf50b700 1 -- 172.21.15.170:0/4104309945 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f1ab4038aa0 msgr2=0x7f1ab403af60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-25T14:52:51.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.944+0000 7f1acf50b700 1 --2- 172.21.15.170:0/4104309945 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f1ab4038aa0 0x7f1ab403af60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:51.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.944+0000 7f1acf50b700 1 -- 172.21.15.170:0/4104309945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8107bb0 msgr2=0x7f1ac819ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:51.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.944+0000 7f1acf50b700 1 --2- 172.21.15.170:0/4104309945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8107bb0 0x7f1ac819ae60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4006af0 tx=0x7f1ac4011a10 comp rx=0 tx=0).stop 2024-01-25T14:52:51.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.944+0000 7f1acf50b700 1 -- 172.21.15.170:0/4104309945 shutdown_connections 2024-01-25T14:52:51.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.944+0000 7f1acf50b700 1 --2- 172.21.15.170:0/4104309945 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f1ab4038aa0 0x7f1ab403af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:51.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.944+0000 7f1acf50b700 1 --2- 172.21.15.170:0/4104309945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1ac8107bb0 0x7f1ac819ae60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:51.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.944+0000 7f1acf50b700 1 -- 172.21.15.170:0/4104309945 >> 172.21.15.170:0/4104309945 conn(0x7f1ac81015e0 msgr2=0x7f1ac8102170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:51.886 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.944+0000 7f1acf50b700 1 -- 172.21.15.170:0/4104309945 shutdown_connections 2024-01-25T14:52:51.887 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:50.944+0000 7f1acf50b700 1 -- 172.21.15.170:0/4104309945 wait complete. 2024-01-25T14:52:51.887 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for the mgr to restart... 2024-01-25T14:52:51.887 INFO:teuthology.orchestra.run.smithi170.stdout:Waiting for mgr epoch 9... 2024-01-25T14:52:52.801 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:52 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:52.669+0000 7f6600e5b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-25T14:52:52.801 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:52 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:52.800+0000 7f6600e5b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-25T14:52:53.124 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:52 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:52.996+0000 7f6600e5b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-25T14:52:53.612 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:53 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:53.238+0000 7f6600e5b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-25T14:52:53.613 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:53 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:53.423+0000 7f6600e5b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-25T14:52:53.613 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:53 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:53.611+0000 7f6600e5b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-25T14:52:54.374 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:53 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:53.886+0000 7f6600e5b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-25T14:52:54.374 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:53 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:53.973+0000 7f6600e5b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-25T14:52:54.874 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:54 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:54.398+0000 7f6600e5b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-25T14:52:55.624 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:55 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:55.189+0000 7f6600e5b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-25T14:52:56.079 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:55 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:55.773+0000 7f6600e5b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-25T14:52:56.080 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:55 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:55.875+0000 7f6600e5b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-25T14:52:56.080 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:52:56 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:52:56.078+0000 7f6600e5b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-25T14:52:56.370 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:56 smithi170 ceph-mon[31899]: Active manager daemon x restarted 2024-01-25T14:52:56.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:56 smithi170 ceph-mon[31899]: Activating manager daemon x 2024-01-25T14:52:56.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:56 smithi170 ceph-mon[31899]: osdmap e3: 0 total, 0 up, 0 in 2024-01-25T14:52:56.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:56 smithi170 ceph-mon[31899]: mgrmap e10: x(active, starting, since 0.00323083s) 2024-01-25T14:52:56.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:52:56.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-01-25T14:52:56.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-01-25T14:52:56.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-01-25T14:52:56.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-01-25T14:52:56.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:56 smithi170 ceph-mon[31899]: Manager daemon x is now available 2024-01-25T14:52:56.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:52:56.371 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:52:57.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:57 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-01-25T14:52:57.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:57 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-01-25T14:52:57.317 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:57 smithi170 ceph-mon[31899]: mgrmap e11: x(active, since 1.00662s) 2024-01-25T14:52:58.048 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout { 2024-01-25T14:52:58.048 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-01-25T14:52:58.048 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout "initialized": true 2024-01-25T14:52:58.048 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout } 2024-01-25T14:52:58.049 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.312+0000 7f1516a37700 1 Processor -- start 2024-01-25T14:52:58.049 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.312+0000 7f1516a37700 1 -- start start 2024-01-25T14:52:58.049 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.313+0000 7f1516a37700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1510107580 0x7f15101079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:58.049 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.313+0000 7f1516a37700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1510107f70 con 0x7f1510107580 2024-01-25T14:52:58.049 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.313+0000 7f150ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1510107580 0x7f15101079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:58.049 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.313+0000 7f150ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1510107580 0x7f15101079a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44474/0 (socket says 172.21.15.170:44474) 2024-01-25T14:52:58.049 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.313+0000 7f150ffff700 1 -- 172.21.15.170:0/3101587078 learned_addr learned my addr 172.21.15.170:0/3101587078 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:58.049 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.313+0000 7f150ffff700 1 -- 172.21.15.170:0/3101587078 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1510106190 con 0x7f1510107580 2024-01-25T14:52:58.049 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.313+0000 7f150ffff700 1 --2- 172.21.15.170:0/3101587078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1510107580 0x7f15101079a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f14f80098a0 tx=0x7f14f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c12b8d8b21c489 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:58.049 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.313+0000 7f150effd700 1 -- 172.21.15.170:0/3101587078 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14f8004160 con 0x7f1510107580 2024-01-25T14:52:58.049 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.313+0000 7f150effd700 1 -- 172.21.15.170:0/3101587078 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14f80042c0 con 0x7f1510107580 2024-01-25T14:52:58.049 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.313+0000 7f150effd700 1 -- 172.21.15.170:0/3101587078 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14f80119b0 con 0x7f1510107580 2024-01-25T14:52:58.049 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.314+0000 7f1516a37700 1 -- 172.21.15.170:0/3101587078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1510107580 msgr2=0x7f15101079a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:58.050 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.314+0000 7f1516a37700 1 --2- 172.21.15.170:0/3101587078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1510107580 0x7f15101079a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f14f80098a0 tx=0x7f14f8009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:58.050 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.314+0000 7f1516a37700 1 -- 172.21.15.170:0/3101587078 shutdown_connections 2024-01-25T14:52:58.050 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.314+0000 7f1516a37700 1 --2- 172.21.15.170:0/3101587078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1510107580 0x7f15101079a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:58.050 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.314+0000 7f1516a37700 1 -- 172.21.15.170:0/3101587078 >> 172.21.15.170:0/3101587078 conn(0x7f1510100da0 msgr2=0x7f15101031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:58.050 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.314+0000 7f1516a37700 1 -- 172.21.15.170:0/3101587078 shutdown_connections 2024-01-25T14:52:58.050 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.314+0000 7f1516a37700 1 -- 172.21.15.170:0/3101587078 wait complete. 2024-01-25T14:52:58.050 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.315+0000 7f1516a37700 1 Processor -- start 2024-01-25T14:52:58.050 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.315+0000 7f1516a37700 1 -- start start 2024-01-25T14:52:58.050 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.315+0000 7f1516a37700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1510107580 0x7f1510105b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:58.050 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.315+0000 7f1516a37700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1510106040 con 0x7f1510107580 2024-01-25T14:52:58.050 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.315+0000 7f150ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1510107580 0x7f1510105b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:58.050 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.315+0000 7f150ffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1510107580 0x7f1510105b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44490/0 (socket says 172.21.15.170:44490) 2024-01-25T14:52:58.050 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.315+0000 7f150ffff700 1 -- 172.21.15.170:0/116096876 learned_addr learned my addr 172.21.15.170:0/116096876 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:58.051 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.315+0000 7f150ffff700 1 -- 172.21.15.170:0/116096876 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f8009550 con 0x7f1510107580 2024-01-25T14:52:58.051 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.316+0000 7f150ffff700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1510107580 0x7f1510105b00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f14f8003e60 tx=0x7f14f8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:58.051 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.316+0000 7f150d7fa700 1 -- 172.21.15.170:0/116096876 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14f80038b0 con 0x7f1510107580 2024-01-25T14:52:58.051 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.316+0000 7f150d7fa700 1 -- 172.21.15.170:0/116096876 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14f8003a10 con 0x7f1510107580 2024-01-25T14:52:58.051 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.316+0000 7f1516a37700 1 -- 172.21.15.170:0/116096876 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151019dbe0 con 0x7f1510107580 2024-01-25T14:52:58.051 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.316+0000 7f150d7fa700 1 -- 172.21.15.170:0/116096876 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14f8019530 con 0x7f1510107580 2024-01-25T14:52:58.051 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.316+0000 7f1516a37700 1 -- 172.21.15.170:0/116096876 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151019e080 con 0x7f1510107580 2024-01-25T14:52:58.051 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.317+0000 7f150d7fa700 1 -- 172.21.15.170:0/116096876 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 9) v1 ==== 45654+0+0 (secure 0 0 0) 0x7f14f801a980 con 0x7f1510107580 2024-01-25T14:52:58.051 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.317+0000 7f150d7fa700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f14fc038a40 0x7f14fc03af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:58.051 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.317+0000 7f150d7fa700 1 -- 172.21.15.170:0/116096876 --> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14fc03b610 con 0x7f14fc038a40 2024-01-25T14:52:58.051 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.317+0000 7f150d7fa700 1 -- 172.21.15.170:0/116096876 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f14f804cbc0 con 0x7f1510107580 2024-01-25T14:52:58.051 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.317+0000 7f150f7fe700 1 -- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f14fc038a40 msgr2=0x7f14fc03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.170:6800/358194066 2024-01-25T14:52:58.051 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.317+0000 7f150f7fe700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f14fc038a40 0x7f14fc03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-25T14:52:58.051 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.518+0000 7f150f7fe700 1 -- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f14fc038a40 msgr2=0x7f14fc03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.170:6800/358194066 2024-01-25T14:52:58.052 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.518+0000 7f150f7fe700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f14fc038a40 0x7f14fc03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-01-25T14:52:58.052 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.919+0000 7f150f7fe700 1 -- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f14fc038a40 msgr2=0x7f14fc03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.170:6800/358194066 2024-01-25T14:52:58.052 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:52.919+0000 7f150f7fe700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f14fc038a40 0x7f14fc03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-01-25T14:52:58.052 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:53.720+0000 7f150f7fe700 1 -- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f14fc038a40 msgr2=0x7f14fc03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.170:6800/358194066 2024-01-25T14:52:58.052 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:53.720+0000 7f150f7fe700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f14fc038a40 0x7f14fc03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-01-25T14:52:58.052 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:55.321+0000 7f150f7fe700 1 -- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f14fc038a40 msgr2=0x7f14fc03af00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.170:6800/358194066 2024-01-25T14:52:58.052 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:55.321+0000 7f150f7fe700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f14fc038a40 0x7f14fc03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-01-25T14:52:58.052 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:56.094+0000 7f150d7fa700 1 -- 172.21.15.170:0/116096876 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mgrmap(e 10) v1 ==== 45421+0+0 (secure 0 0 0) 0x7f14f801a430 con 0x7f1510107580 2024-01-25T14:52:58.052 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:56.094+0000 7f150d7fa700 1 -- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f14fc038a40 msgr2=0x7f14fc03af00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-25T14:52:58.052 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:56.094+0000 7f150d7fa700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f14fc038a40 0x7f14fc03af00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:58.052 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.096+0000 7f150d7fa700 1 -- 172.21.15.170:0/116096876 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mgrmap(e 11) v1 ==== 45548+0+0 (secure 0 0 0) 0x7f14f800ed40 con 0x7f1510107580 2024-01-25T14:52:58.052 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.096+0000 7f150d7fa700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f14fc03c4b0 0x7f14fc03e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:58.052 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.096+0000 7f150d7fa700 1 -- 172.21.15.170:0/116096876 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14fc03b610 con 0x7f14fc03c4b0 2024-01-25T14:52:58.052 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.096+0000 7f150f7fe700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f14fc03c4b0 0x7f14fc03e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:58.053 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.097+0000 7f150f7fe700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f14fc03c4b0 0x7f14fc03e8a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1500003a10 tx=0x7f15000092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:58.053 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.098+0000 7f150d7fa700 1 -- 172.21.15.170:0/116096876 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f14fc03b610 con 0x7f14fc03c4b0 2024-01-25T14:52:58.053 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.104+0000 7f1516a37700 1 -- 172.21.15.170:0/116096876 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f151010a3d0 con 0x7f14fc03c4b0 2024-01-25T14:52:58.053 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.105+0000 7f150d7fa700 1 -- 172.21.15.170:0/116096876 <== mgr.14152 v2:172.21.15.170:6800/3767785684 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f151010a3d0 con 0x7f14fc03c4b0 2024-01-25T14:52:58.053 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.105+0000 7f1516a37700 1 -- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f14fc03c4b0 msgr2=0x7f14fc03e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:58.053 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.105+0000 7f1516a37700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f14fc03c4b0 0x7f14fc03e8a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1500003a10 tx=0x7f15000092b0 comp rx=0 tx=0).stop 2024-01-25T14:52:58.053 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.105+0000 7f1516a37700 1 -- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1510107580 msgr2=0x7f1510105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:58.053 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.105+0000 7f1516a37700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1510107580 0x7f1510105b00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f14f8003e60 tx=0x7f14f8011a30 comp rx=0 tx=0).stop 2024-01-25T14:52:58.053 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.105+0000 7f1516a37700 1 -- 172.21.15.170:0/116096876 shutdown_connections 2024-01-25T14:52:58.053 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.105+0000 7f1516a37700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f14fc03c4b0 0x7f14fc03e8a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:58.053 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.105+0000 7f1516a37700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1510107580 0x7f1510105b00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:58.053 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.105+0000 7f1516a37700 1 --2- 172.21.15.170:0/116096876 >> [v2:172.21.15.170:6800/358194066,v1:172.21.15.170:6801/358194066] conn(0x7f14fc038a40 0x7f14fc03af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:58.053 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.105+0000 7f1516a37700 1 -- 172.21.15.170:0/116096876 >> 172.21.15.170:0/116096876 conn(0x7f1510100da0 msgr2=0x7f1510101930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:58.053 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.105+0000 7f1516a37700 1 -- 172.21.15.170:0/116096876 shutdown_connections 2024-01-25T14:52:58.054 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:57.105+0000 7f1516a37700 1 -- 172.21.15.170:0/116096876 wait complete. 2024-01-25T14:52:58.054 INFO:teuthology.orchestra.run.smithi170.stdout:mgr epoch 9 is available 2024-01-25T14:52:58.054 INFO:teuthology.orchestra.run.smithi170.stdout:Generating a dashboard self-signed certificate... 2024-01-25T14:52:58.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:58 smithi170 ceph-mon[31899]: [25/Jan/2024:14:52:56] ENGINE Bus STARTING 2024-01-25T14:52:58.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:58 smithi170 ceph-mon[31899]: [25/Jan/2024:14:52:56] ENGINE Serving on https://172.21.15.170:7150 2024-01-25T14:52:58.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:58 smithi170 ceph-mon[31899]: [25/Jan/2024:14:52:56] ENGINE Serving on http://172.21.15.170:8765 2024-01-25T14:52:58.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:58 smithi170 ceph-mon[31899]: [25/Jan/2024:14:52:56] ENGINE Bus STARTED 2024-01-25T14:52:58.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:58 smithi170 ceph-mon[31899]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-01-25T14:52:58.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:58 smithi170 ceph-mon[31899]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-01-25T14:52:58.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:52:59.422 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-01-25T14:52:59.422 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.477+0000 7f81d9e93700 1 Processor -- start 2024-01-25T14:52:59.422 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.477+0000 7f81d9e93700 1 -- start start 2024-01-25T14:52:59.422 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.478+0000 7f81d9e93700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d41070c0 0x7f81d41074e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:59.422 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.478+0000 7f81d9e93700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d4107a20 con 0x7f81d41070c0 2024-01-25T14:52:59.422 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.478+0000 7f81d37fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d41070c0 0x7f81d41074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:59.423 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.478+0000 7f81d37fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d41070c0 0x7f81d41074e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51506/0 (socket says 172.21.15.170:51506) 2024-01-25T14:52:59.423 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.478+0000 7f81d37fe700 1 -- 172.21.15.170:0/36614800 learned_addr learned my addr 172.21.15.170:0/36614800 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:59.423 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.478+0000 7f81d37fe700 1 -- 172.21.15.170:0/36614800 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d4107b60 con 0x7f81d41070c0 2024-01-25T14:52:59.423 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.478+0000 7f81d37fe700 1 --2- 172.21.15.170:0/36614800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d41070c0 0x7f81d41074e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f81c40098a0 tx=0x7f81c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482b60a40eff2c08 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:59.423 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.478+0000 7f81d27fc700 1 -- 172.21.15.170:0/36614800 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81c4004160 con 0x7f81d41070c0 2024-01-25T14:52:59.423 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.479+0000 7f81d27fc700 1 -- 172.21.15.170:0/36614800 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81c40042c0 con 0x7f81d41070c0 2024-01-25T14:52:59.423 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.479+0000 7f81d27fc700 1 -- 172.21.15.170:0/36614800 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81c40119b0 con 0x7f81d41070c0 2024-01-25T14:52:59.423 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.479+0000 7f81d9e93700 1 -- 172.21.15.170:0/36614800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d41070c0 msgr2=0x7f81d41074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:59.423 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.479+0000 7f81d9e93700 1 --2- 172.21.15.170:0/36614800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d41070c0 0x7f81d41074e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f81c40098a0 tx=0x7f81c4009bb0 comp rx=0 tx=0).stop 2024-01-25T14:52:59.423 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.479+0000 7f81d9e93700 1 -- 172.21.15.170:0/36614800 shutdown_connections 2024-01-25T14:52:59.423 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.479+0000 7f81d9e93700 1 --2- 172.21.15.170:0/36614800 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d41070c0 0x7f81d41074e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:59.423 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.479+0000 7f81d9e93700 1 -- 172.21.15.170:0/36614800 >> 172.21.15.170:0/36614800 conn(0x7f81d4102760 msgr2=0x7f81d4104b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:59.423 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.479+0000 7f81d9e93700 1 -- 172.21.15.170:0/36614800 shutdown_connections 2024-01-25T14:52:59.424 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.479+0000 7f81d9e93700 1 -- 172.21.15.170:0/36614800 wait complete. 2024-01-25T14:52:59.424 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.480+0000 7f81d9e93700 1 Processor -- start 2024-01-25T14:52:59.424 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.480+0000 7f81d9e93700 1 -- start start 2024-01-25T14:52:59.424 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.480+0000 7f81d9e93700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d41070c0 0x7f81d419ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:59.424 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.480+0000 7f81d9e93700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d419b2e0 con 0x7f81d41070c0 2024-01-25T14:52:59.424 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.480+0000 7f81d37fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d41070c0 0x7f81d419ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:59.424 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.480+0000 7f81d37fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d41070c0 0x7f81d419ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51522/0 (socket says 172.21.15.170:51522) 2024-01-25T14:52:59.424 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.480+0000 7f81d37fe700 1 -- 172.21.15.170:0/1972302698 learned_addr learned my addr 172.21.15.170:0/1972302698 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:52:59.424 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.481+0000 7f81d37fe700 1 -- 172.21.15.170:0/1972302698 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4009550 con 0x7f81d41070c0 2024-01-25T14:52:59.424 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.481+0000 7f81d37fe700 1 --2- 172.21.15.170:0/1972302698 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d41070c0 0x7f81d419ada0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f81c4006af0 tx=0x7f81c4011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:59.424 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.481+0000 7f81d0ff9700 1 -- 172.21.15.170:0/1972302698 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81c4003a40 con 0x7f81d41070c0 2024-01-25T14:52:59.424 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.481+0000 7f81d0ff9700 1 -- 172.21.15.170:0/1972302698 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81c4003ba0 con 0x7f81d41070c0 2024-01-25T14:52:59.425 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.481+0000 7f81d9e93700 1 -- 172.21.15.170:0/1972302698 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d419b4e0 con 0x7f81d41070c0 2024-01-25T14:52:59.425 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.481+0000 7f81d0ff9700 1 -- 172.21.15.170:0/1972302698 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81c40196c0 con 0x7f81d41070c0 2024-01-25T14:52:59.425 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.481+0000 7f81d9e93700 1 -- 172.21.15.170:0/1972302698 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d419b980 con 0x7f81d41070c0 2024-01-25T14:52:59.425 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.482+0000 7f81d0ff9700 1 -- 172.21.15.170:0/1972302698 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 11) v1 ==== 45548+0+0 (secure 0 0 0) 0x7f81c4019980 con 0x7f81d41070c0 2024-01-25T14:52:59.425 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.482+0000 7f81d0ff9700 1 --2- 172.21.15.170:0/1972302698 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f81bc038930 0x7f81bc03adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:52:59.425 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.482+0000 7f81d0ff9700 1 -- 172.21.15.170:0/1972302698 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f81c404cd10 con 0x7f81d41070c0 2024-01-25T14:52:59.425 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.482+0000 7f81d9e93700 1 -- 172.21.15.170:0/1972302698 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d4108f20 con 0x7f81d41070c0 2024-01-25T14:52:59.425 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.482+0000 7f81d2ffd700 1 --2- 172.21.15.170:0/1972302698 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f81bc038930 0x7f81bc03adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:52:59.425 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.483+0000 7f81d2ffd700 1 --2- 172.21.15.170:0/1972302698 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f81bc038930 0x7f81bc03adf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f81c8006fd0 tx=0x7f81c8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:52:59.425 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.487+0000 7f81d0ff9700 1 -- 172.21.15.170:0/1972302698 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f81c40243f0 con 0x7f81d41070c0 2024-01-25T14:52:59.425 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.690+0000 7f81d9e93700 1 -- 172.21.15.170:0/1972302698 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f81d419e260 con 0x7f81bc038930 2024-01-25T14:52:59.425 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.820+0000 7f81d0ff9700 1 -- 172.21.15.170:0/1972302698 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f81d419e260 con 0x7f81bc038930 2024-01-25T14:52:59.426 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.822+0000 7f81d9e93700 1 -- 172.21.15.170:0/1972302698 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f81bc038930 msgr2=0x7f81bc03adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:59.426 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.822+0000 7f81d9e93700 1 --2- 172.21.15.170:0/1972302698 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f81bc038930 0x7f81bc03adf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f81c8006fd0 tx=0x7f81c8006e40 comp rx=0 tx=0).stop 2024-01-25T14:52:59.426 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.822+0000 7f81d9e93700 1 -- 172.21.15.170:0/1972302698 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d41070c0 msgr2=0x7f81d419ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:52:59.426 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.822+0000 7f81d9e93700 1 --2- 172.21.15.170:0/1972302698 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d41070c0 0x7f81d419ada0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f81c4006af0 tx=0x7f81c4011a10 comp rx=0 tx=0).stop 2024-01-25T14:52:59.426 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.822+0000 7f81d9e93700 1 -- 172.21.15.170:0/1972302698 shutdown_connections 2024-01-25T14:52:59.426 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.822+0000 7f81d9e93700 1 --2- 172.21.15.170:0/1972302698 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f81bc038930 0x7f81bc03adf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:59.426 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.822+0000 7f81d9e93700 1 --2- 172.21.15.170:0/1972302698 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f81d41070c0 0x7f81d419ada0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:52:59.426 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.822+0000 7f81d9e93700 1 -- 172.21.15.170:0/1972302698 >> 172.21.15.170:0/1972302698 conn(0x7f81d4102760 msgr2=0x7f81d4103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:52:59.426 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.822+0000 7f81d9e93700 1 -- 172.21.15.170:0/1972302698 shutdown_connections 2024-01-25T14:52:59.426 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:58.823+0000 7f81d9e93700 1 -- 172.21.15.170:0/1972302698 wait complete. 2024-01-25T14:52:59.426 INFO:teuthology.orchestra.run.smithi170.stdout:Creating initial admin user... 2024-01-25T14:52:59.816 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:59 smithi170 ceph-mon[31899]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:52:59.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:52:59.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:52:59.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:52:59.817 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:52:59 smithi170 ceph-mon[31899]: mgrmap e12: x(active, since 2s) 2024-01-25T14:53:01.106 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:00 smithi170 ceph-mon[31899]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:53:01.107 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:00 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:01.559 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$E2f4.3v9bBUImbv5AeUCc.iAZOqZEO.ig1dlKjqdf.Wki9HrCVxru", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1706194380, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-01-25T14:53:01.559 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.836+0000 7f4b4f49a700 1 Processor -- start 2024-01-25T14:53:01.559 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.836+0000 7f4b4f49a700 1 -- start start 2024-01-25T14:53:01.559 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.837+0000 7f4b4f49a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48107b30 0x7f4b48109f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:01.559 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.837+0000 7f4b4f49a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4807ae90 con 0x7f4b48107b30 2024-01-25T14:53:01.559 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.837+0000 7f4b4d236700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48107b30 0x7f4b48109f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:01.559 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.837+0000 7f4b4d236700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48107b30 0x7f4b48109f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51538/0 (socket says 172.21.15.170:51538) 2024-01-25T14:53:01.559 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.837+0000 7f4b4d236700 1 -- 172.21.15.170:0/343670244 learned_addr learned my addr 172.21.15.170:0/343670244 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:01.559 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.837+0000 7f4b4d236700 1 -- 172.21.15.170:0/343670244 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4810a460 con 0x7f4b48107b30 2024-01-25T14:53:01.560 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.837+0000 7f4b4d236700 1 --2- 172.21.15.170:0/343670244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48107b30 0x7f4b48109f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4b440098a0 tx=0x7f4b44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829a7e37cf41340d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:01.560 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.837+0000 7f4b3ffff700 1 -- 172.21.15.170:0/343670244 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b44004160 con 0x7f4b48107b30 2024-01-25T14:53:01.560 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.837+0000 7f4b3ffff700 1 -- 172.21.15.170:0/343670244 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b440042c0 con 0x7f4b48107b30 2024-01-25T14:53:01.560 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.837+0000 7f4b3ffff700 1 -- 172.21.15.170:0/343670244 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b440119b0 con 0x7f4b48107b30 2024-01-25T14:53:01.560 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.838+0000 7f4b4f49a700 1 -- 172.21.15.170:0/343670244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48107b30 msgr2=0x7f4b48109f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:01.560 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.838+0000 7f4b4f49a700 1 --2- 172.21.15.170:0/343670244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48107b30 0x7f4b48109f20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4b440098a0 tx=0x7f4b44009bb0 comp rx=0 tx=0).stop 2024-01-25T14:53:01.560 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.838+0000 7f4b4f49a700 1 -- 172.21.15.170:0/343670244 shutdown_connections 2024-01-25T14:53:01.560 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.838+0000 7f4b4f49a700 1 --2- 172.21.15.170:0/343670244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48107b30 0x7f4b48109f20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:01.560 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.838+0000 7f4b4f49a700 1 -- 172.21.15.170:0/343670244 >> 172.21.15.170:0/343670244 conn(0x7f4b48101580 msgr2=0x7f4b481039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:01.560 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.838+0000 7f4b4f49a700 1 -- 172.21.15.170:0/343670244 shutdown_connections 2024-01-25T14:53:01.560 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.838+0000 7f4b4f49a700 1 -- 172.21.15.170:0/343670244 wait complete. 2024-01-25T14:53:01.560 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.839+0000 7f4b4f49a700 1 Processor -- start 2024-01-25T14:53:01.560 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.839+0000 7f4b4f49a700 1 -- start start 2024-01-25T14:53:01.560 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.839+0000 7f4b4f49a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48107b30 0x7f4b4819ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:01.561 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.839+0000 7f4b4f49a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4819b370 con 0x7f4b48107b30 2024-01-25T14:53:01.561 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.839+0000 7f4b4d236700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48107b30 0x7f4b4819ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:01.561 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.839+0000 7f4b4d236700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48107b30 0x7f4b4819ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51550/0 (socket says 172.21.15.170:51550) 2024-01-25T14:53:01.561 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.839+0000 7f4b4d236700 1 -- 172.21.15.170:0/3486646932 learned_addr learned my addr 172.21.15.170:0/3486646932 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:01.561 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.839+0000 7f4b4d236700 1 -- 172.21.15.170:0/3486646932 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b44009550 con 0x7f4b48107b30 2024-01-25T14:53:01.561 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.839+0000 7f4b4d236700 1 --2- 172.21.15.170:0/3486646932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48107b30 0x7f4b4819ae30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b44006af0 tx=0x7f4b44011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:01.561 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.839+0000 7f4b3e7fc700 1 -- 172.21.15.170:0/3486646932 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b44003a40 con 0x7f4b48107b30 2024-01-25T14:53:01.561 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.839+0000 7f4b3e7fc700 1 -- 172.21.15.170:0/3486646932 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4b44003ba0 con 0x7f4b48107b30 2024-01-25T14:53:01.561 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.840+0000 7f4b4f49a700 1 -- 172.21.15.170:0/3486646932 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4819b570 con 0x7f4b48107b30 2024-01-25T14:53:01.561 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.840+0000 7f4b3e7fc700 1 -- 172.21.15.170:0/3486646932 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b440196c0 con 0x7f4b48107b30 2024-01-25T14:53:01.561 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.840+0000 7f4b4f49a700 1 -- 172.21.15.170:0/3486646932 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4819ba10 con 0x7f4b48107b30 2024-01-25T14:53:01.561 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.840+0000 7f4b3e7fc700 1 -- 172.21.15.170:0/3486646932 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 12) v1 ==== 45654+0+0 (secure 0 0 0) 0x7f4b44019930 con 0x7f4b48107b30 2024-01-25T14:53:01.561 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.840+0000 7f4b4f49a700 1 -- 172.21.15.170:0/3486646932 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4810b240 con 0x7f4b48107b30 2024-01-25T14:53:01.561 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.841+0000 7f4b3e7fc700 1 --2- 172.21.15.170:0/3486646932 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4b34038aa0 0x7f4b3403af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:01.562 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.841+0000 7f4b3e7fc700 1 -- 172.21.15.170:0/3486646932 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4b4404cf20 con 0x7f4b48107b30 2024-01-25T14:53:01.562 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.841+0000 7f4b4ca35700 1 --2- 172.21.15.170:0/3486646932 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4b34038aa0 0x7f4b3403af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:01.562 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.841+0000 7f4b4ca35700 1 --2- 172.21.15.170:0/3486646932 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4b34038aa0 0x7f4b3403af60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4b38006fd0 tx=0x7f4b38006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:01.562 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:52:59.845+0000 7f4b3e7fc700 1 -- 172.21.15.170:0/3486646932 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f4b4402b340 con 0x7f4b48107b30 2024-01-25T14:53:01.562 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:00.074+0000 7f4b4f49a700 1 -- 172.21.15.170:0/3486646932 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4b48062c30 con 0x7f4b34038aa0 2024-01-25T14:53:01.562 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:00.298+0000 7f4b3e7fc700 1 -- 172.21.15.170:0/3486646932 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f4b48062c30 con 0x7f4b34038aa0 2024-01-25T14:53:01.562 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:00.301+0000 7f4b4f49a700 1 -- 172.21.15.170:0/3486646932 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4b34038aa0 msgr2=0x7f4b3403af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:01.562 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:00.301+0000 7f4b4f49a700 1 --2- 172.21.15.170:0/3486646932 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4b34038aa0 0x7f4b3403af60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4b38006fd0 tx=0x7f4b38006e40 comp rx=0 tx=0).stop 2024-01-25T14:53:01.562 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:00.301+0000 7f4b4f49a700 1 -- 172.21.15.170:0/3486646932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48107b30 msgr2=0x7f4b4819ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:01.562 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:00.301+0000 7f4b4f49a700 1 --2- 172.21.15.170:0/3486646932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48107b30 0x7f4b4819ae30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b44006af0 tx=0x7f4b44011a10 comp rx=0 tx=0).stop 2024-01-25T14:53:01.562 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:00.301+0000 7f4b4f49a700 1 -- 172.21.15.170:0/3486646932 shutdown_connections 2024-01-25T14:53:01.562 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:00.301+0000 7f4b4f49a700 1 --2- 172.21.15.170:0/3486646932 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4b34038aa0 0x7f4b3403af60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:01.562 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:00.301+0000 7f4b4f49a700 1 --2- 172.21.15.170:0/3486646932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4b48107b30 0x7f4b4819ae30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:01.562 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:00.301+0000 7f4b4f49a700 1 -- 172.21.15.170:0/3486646932 >> 172.21.15.170:0/3486646932 conn(0x7f4b48101580 msgr2=0x7f4b48102050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:01.562 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:00.301+0000 7f4b4f49a700 1 -- 172.21.15.170:0/3486646932 shutdown_connections 2024-01-25T14:53:01.563 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:00.301+0000 7f4b4f49a700 1 -- 172.21.15.170:0/3486646932 wait complete. 2024-01-25T14:53:01.563 INFO:teuthology.orchestra.run.smithi170.stdout:Fetching dashboard port number... 2024-01-25T14:53:02.473 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:02 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2178275734' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-01-25T14:53:02.473 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:02 smithi170 ceph-mon[31899]: mgrmap e13: x(active, since 6s) 2024-01-25T14:53:02.749 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stdout 8443 2024-01-25T14:53:02.750 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.961+0000 7f41b4886700 1 Processor -- start 2024-01-25T14:53:02.750 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.961+0000 7f41b4886700 1 -- start start 2024-01-25T14:53:02.750 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.961+0000 7f41b4886700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41b01070c0 0x7f41b01074e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:02.750 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.962+0000 7f41b4886700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b0107a20 con 0x7f41b01070c0 2024-01-25T14:53:02.750 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.962+0000 7f41ae59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41b01070c0 0x7f41b01074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:02.750 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.962+0000 7f41ae59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41b01070c0 0x7f41b01074e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51560/0 (socket says 172.21.15.170:51560) 2024-01-25T14:53:02.750 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.962+0000 7f41ae59c700 1 -- 172.21.15.170:0/2513804298 learned_addr learned my addr 172.21.15.170:0/2513804298 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:02.750 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.962+0000 7f41ae59c700 1 -- 172.21.15.170:0/2513804298 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b0107b60 con 0x7f41b01070c0 2024-01-25T14:53:02.750 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.962+0000 7f41ae59c700 1 --2- 172.21.15.170:0/2513804298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41b01070c0 0x7f41b01074e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f41a00098a0 tx=0x7f41a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dce5e1737cfa6b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:02.750 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.962+0000 7f41ad59a700 1 -- 172.21.15.170:0/2513804298 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a0004160 con 0x7f41b01070c0 2024-01-25T14:53:02.751 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.962+0000 7f41ad59a700 1 -- 172.21.15.170:0/2513804298 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f41a00042c0 con 0x7f41b01070c0 2024-01-25T14:53:02.751 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.962+0000 7f41ad59a700 1 -- 172.21.15.170:0/2513804298 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a00119b0 con 0x7f41b01070c0 2024-01-25T14:53:02.751 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.963+0000 7f41b4886700 1 -- 172.21.15.170:0/2513804298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41b01070c0 msgr2=0x7f41b01074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:02.751 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.963+0000 7f41b4886700 1 --2- 172.21.15.170:0/2513804298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41b01070c0 0x7f41b01074e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f41a00098a0 tx=0x7f41a0009bb0 comp rx=0 tx=0).stop 2024-01-25T14:53:02.751 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.963+0000 7f41b4886700 1 -- 172.21.15.170:0/2513804298 shutdown_connections 2024-01-25T14:53:02.751 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.963+0000 7f41b4886700 1 --2- 172.21.15.170:0/2513804298 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41b01070c0 0x7f41b01074e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:02.751 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.963+0000 7f41b4886700 1 -- 172.21.15.170:0/2513804298 >> 172.21.15.170:0/2513804298 conn(0x7f41b0102760 msgr2=0x7f41b0104b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:02.751 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.963+0000 7f41b4886700 1 -- 172.21.15.170:0/2513804298 shutdown_connections 2024-01-25T14:53:02.751 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.963+0000 7f41b4886700 1 -- 172.21.15.170:0/2513804298 wait complete. 2024-01-25T14:53:02.751 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.964+0000 7f41b4886700 1 Processor -- start 2024-01-25T14:53:02.751 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.964+0000 7f41b4886700 1 -- start start 2024-01-25T14:53:02.752 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.964+0000 7f41b4886700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41b01070c0 0x7f41b007cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:02.752 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.964+0000 7f41b4886700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b007d0d0 con 0x7f41b01070c0 2024-01-25T14:53:02.752 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.964+0000 7f41ae59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41b01070c0 0x7f41b007cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:02.752 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.964+0000 7f41ae59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41b01070c0 0x7f41b007cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51568/0 (socket says 172.21.15.170:51568) 2024-01-25T14:53:02.752 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.964+0000 7f41ae59c700 1 -- 172.21.15.170:0/2178275734 learned_addr learned my addr 172.21.15.170:0/2178275734 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:02.752 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.964+0000 7f41ae59c700 1 -- 172.21.15.170:0/2178275734 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a0009550 con 0x7f41b01070c0 2024-01-25T14:53:02.752 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.965+0000 7f41ae59c700 1 --2- 172.21.15.170:0/2178275734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41b01070c0 0x7f41b007cb90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f41a0006af0 tx=0x7f41a0011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:02.752 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.965+0000 7f419f7fe700 1 -- 172.21.15.170:0/2178275734 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a0003a40 con 0x7f41b01070c0 2024-01-25T14:53:02.752 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.965+0000 7f419f7fe700 1 -- 172.21.15.170:0/2178275734 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f41a0003ba0 con 0x7f41b01070c0 2024-01-25T14:53:02.752 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.965+0000 7f41b4886700 1 -- 172.21.15.170:0/2178275734 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b007b2c0 con 0x7f41b01070c0 2024-01-25T14:53:02.752 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.965+0000 7f419f7fe700 1 -- 172.21.15.170:0/2178275734 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f41a00196c0 con 0x7f41b01070c0 2024-01-25T14:53:02.753 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.965+0000 7f41b4886700 1 -- 172.21.15.170:0/2178275734 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b007b760 con 0x7f41b01070c0 2024-01-25T14:53:02.753 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.966+0000 7f419f7fe700 1 -- 172.21.15.170:0/2178275734 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 12) v1 ==== 45654+0+0 (secure 0 0 0) 0x7f41a0019980 con 0x7f41b01070c0 2024-01-25T14:53:02.753 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.966+0000 7f41b4886700 1 -- 172.21.15.170:0/2178275734 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b0062e10 con 0x7f41b01070c0 2024-01-25T14:53:02.753 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.966+0000 7f419f7fe700 1 --2- 172.21.15.170:0/2178275734 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4198038a40 0x7f419803af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:02.753 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.966+0000 7f419f7fe700 1 -- 172.21.15.170:0/2178275734 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f41a004ce70 con 0x7f41b01070c0 2024-01-25T14:53:02.753 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.966+0000 7f41add9b700 1 --2- 172.21.15.170:0/2178275734 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4198038a40 0x7f419803af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:02.753 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.966+0000 7f41add9b700 1 --2- 172.21.15.170:0/2178275734 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4198038a40 0x7f419803af00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f41a4006fd0 tx=0x7f41a4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:02.753 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:01.971+0000 7f419f7fe700 1 -- 172.21.15.170:0/2178275734 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f41a0018760 con 0x7f41b01070c0 2024-01-25T14:53:02.753 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:02.168+0000 7f41b4886700 1 -- 172.21.15.170:0/2178275734 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f41b0108f20 con 0x7f41b01070c0 2024-01-25T14:53:02.754 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:02.168+0000 7f419f7fe700 1 -- 172.21.15.170:0/2178275734 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f41a0023390 con 0x7f41b01070c0 2024-01-25T14:53:02.754 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:02.170+0000 7f41b4886700 1 -- 172.21.15.170:0/2178275734 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4198038a40 msgr2=0x7f419803af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:02.754 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:02.170+0000 7f41b4886700 1 --2- 172.21.15.170:0/2178275734 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4198038a40 0x7f419803af00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f41a4006fd0 tx=0x7f41a4006e40 comp rx=0 tx=0).stop 2024-01-25T14:53:02.754 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:02.170+0000 7f41b4886700 1 -- 172.21.15.170:0/2178275734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41b01070c0 msgr2=0x7f41b007cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:02.754 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:02.170+0000 7f41b4886700 1 --2- 172.21.15.170:0/2178275734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41b01070c0 0x7f41b007cb90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f41a0006af0 tx=0x7f41a0011a10 comp rx=0 tx=0).stop 2024-01-25T14:53:02.754 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:02.170+0000 7f41b4886700 1 -- 172.21.15.170:0/2178275734 shutdown_connections 2024-01-25T14:53:02.754 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:02.170+0000 7f41b4886700 1 --2- 172.21.15.170:0/2178275734 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4198038a40 0x7f419803af00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:02.754 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:02.170+0000 7f41b4886700 1 --2- 172.21.15.170:0/2178275734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41b01070c0 0x7f41b007cb90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:02.754 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:02.170+0000 7f41b4886700 1 -- 172.21.15.170:0/2178275734 >> 172.21.15.170:0/2178275734 conn(0x7f41b0102760 msgr2=0x7f41b01032f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:02.755 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:02.171+0000 7f41b4886700 1 -- 172.21.15.170:0/2178275734 shutdown_connections 2024-01-25T14:53:02.755 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:02.171+0000 7f41b4886700 1 -- 172.21.15.170:0/2178275734 wait complete. 2024-01-25T14:53:02.755 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-01-25T14:53:02.755 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout disabled 2024-01-25T14:53:02.762 INFO:teuthology.orchestra.run.smithi170.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-01-25T14:53:02.762 INFO:teuthology.orchestra.run.smithi170.stdout:systemctl: stdout inactive 2024-01-25T14:53:02.762 INFO:teuthology.orchestra.run.smithi170.stdout:firewalld.service is not enabled 2024-01-25T14:53:02.762 INFO:teuthology.orchestra.run.smithi170.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-01-25T14:53:02.763 INFO:teuthology.orchestra.run.smithi170.stdout:Ceph Dashboard is now available at: 2024-01-25T14:53:02.764 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:53:02.764 INFO:teuthology.orchestra.run.smithi170.stdout: URL: https://smithi170.front.sepia.ceph.com:8443/ 2024-01-25T14:53:02.764 INFO:teuthology.orchestra.run.smithi170.stdout: User: admin 2024-01-25T14:53:02.764 INFO:teuthology.orchestra.run.smithi170.stdout: Password: 2kx5kq18er 2024-01-25T14:53:02.764 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:53:02.764 INFO:teuthology.orchestra.run.smithi170.stdout:Saving cluster configuration to /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config directory 2024-01-25T14:53:02.764 INFO:teuthology.orchestra.run.smithi170.stdout:Enabling autotune for osd_memory_target 2024-01-25T14:53:03.974 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.177+0000 7feaada45700 1 Processor -- start 2024-01-25T14:53:03.974 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.177+0000 7feaada45700 1 -- start start 2024-01-25T14:53:03.974 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.178+0000 7feaada45700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa8107590 0x7feaa81079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:03.974 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.178+0000 7feaada45700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa8107f80 con 0x7feaa8107590 2024-01-25T14:53:03.974 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.178+0000 7feaa6ffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa8107590 0x7feaa81079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:03.974 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.178+0000 7feaa6ffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa8107590 0x7feaa81079b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51584/0 (socket says 172.21.15.170:51584) 2024-01-25T14:53:03.974 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.178+0000 7feaa6ffd700 1 -- 172.21.15.170:0/4100799431 learned_addr learned my addr 172.21.15.170:0/4100799431 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:03.974 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.178+0000 7feaa6ffd700 1 -- 172.21.15.170:0/4100799431 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa81080c0 con 0x7feaa8107590 2024-01-25T14:53:03.974 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.178+0000 7feaa6ffd700 1 --2- 172.21.15.170:0/4100799431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa8107590 0x7feaa81079b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fea980098a0 tx=0x7fea98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeff4993b8747fd4 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:03.974 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.178+0000 7feaa5ffb700 1 -- 172.21.15.170:0/4100799431 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea98004160 con 0x7feaa8107590 2024-01-25T14:53:03.975 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.178+0000 7feaa5ffb700 1 -- 172.21.15.170:0/4100799431 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea980042c0 con 0x7feaa8107590 2024-01-25T14:53:03.975 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.178+0000 7feaa5ffb700 1 -- 172.21.15.170:0/4100799431 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea980119b0 con 0x7feaa8107590 2024-01-25T14:53:03.975 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.179+0000 7feaada45700 1 -- 172.21.15.170:0/4100799431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa8107590 msgr2=0x7feaa81079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:03.975 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.179+0000 7feaada45700 1 --2- 172.21.15.170:0/4100799431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa8107590 0x7feaa81079b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fea980098a0 tx=0x7fea98009bb0 comp rx=0 tx=0).stop 2024-01-25T14:53:03.975 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.179+0000 7feaada45700 1 -- 172.21.15.170:0/4100799431 shutdown_connections 2024-01-25T14:53:03.975 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.179+0000 7feaada45700 1 --2- 172.21.15.170:0/4100799431 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa8107590 0x7feaa81079b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:03.975 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.179+0000 7feaada45700 1 -- 172.21.15.170:0/4100799431 >> 172.21.15.170:0/4100799431 conn(0x7feaa8100d70 msgr2=0x7feaa8103190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:03.975 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.179+0000 7feaada45700 1 -- 172.21.15.170:0/4100799431 shutdown_connections 2024-01-25T14:53:03.975 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.179+0000 7feaada45700 1 -- 172.21.15.170:0/4100799431 wait complete. 2024-01-25T14:53:03.975 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.180+0000 7feaada45700 1 Processor -- start 2024-01-25T14:53:03.975 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.180+0000 7feaada45700 1 -- start start 2024-01-25T14:53:03.975 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.180+0000 7feaada45700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa8107590 0x7feaa8105bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:03.975 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.180+0000 7feaada45700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa819db20 con 0x7feaa8107590 2024-01-25T14:53:03.975 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.180+0000 7feaa6ffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa8107590 0x7feaa8105bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.180+0000 7feaa6ffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa8107590 0x7feaa8105bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51588/0 (socket says 172.21.15.170:51588) 2024-01-25T14:53:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.180+0000 7feaa6ffd700 1 -- 172.21.15.170:0/1732489493 learned_addr learned my addr 172.21.15.170:0/1732489493 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.180+0000 7feaa6ffd700 1 -- 172.21.15.170:0/1732489493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea98009550 con 0x7feaa8107590 2024-01-25T14:53:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.180+0000 7feaa6ffd700 1 --2- 172.21.15.170:0/1732489493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa8107590 0x7feaa8105bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea98003e60 tx=0x7fea98011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.180+0000 7feaaca43700 1 -- 172.21.15.170:0/1732489493 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea98003a60 con 0x7feaa8107590 2024-01-25T14:53:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.181+0000 7feaaca43700 1 -- 172.21.15.170:0/1732489493 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea98003bc0 con 0x7feaa8107590 2024-01-25T14:53:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.181+0000 7feaada45700 1 -- 172.21.15.170:0/1732489493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa819dc60 con 0x7feaa8107590 2024-01-25T14:53:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.181+0000 7feaaca43700 1 -- 172.21.15.170:0/1732489493 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea980196c0 con 0x7feaa8107590 2024-01-25T14:53:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.181+0000 7feaada45700 1 -- 172.21.15.170:0/1732489493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa819e040 con 0x7feaa8107590 2024-01-25T14:53:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.181+0000 7feaaca43700 1 -- 172.21.15.170:0/1732489493 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7fea98019930 con 0x7feaa8107590 2024-01-25T14:53:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.181+0000 7feaada45700 1 -- 172.21.15.170:0/1732489493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa8106f50 con 0x7feaa8107590 2024-01-25T14:53:03.977 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.182+0000 7feaaca43700 1 --2- 172.21.15.170:0/1732489493 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fea90038b80 0x7fea9003b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:03.977 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.182+0000 7feaaca43700 1 -- 172.21.15.170:0/1732489493 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fea9804ce10 con 0x7feaa8107590 2024-01-25T14:53:03.977 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.182+0000 7feaa67fc700 1 --2- 172.21.15.170:0/1732489493 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fea90038b80 0x7fea9003b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:03.977 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.182+0000 7feaa67fc700 1 --2- 172.21.15.170:0/1732489493 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fea90038b80 0x7fea9003b040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fea9c006fd0 tx=0x7fea9c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:03.977 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.187+0000 7feaaca43700 1 -- 172.21.15.170:0/1732489493 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fea98010560 con 0x7feaa8107590 2024-01-25T14:53:03.977 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.379+0000 7feaada45700 1 -- 172.21.15.170:0/1732489493 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7feaa819e230 con 0x7feaa8107590 2024-01-25T14:53:03.977 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.380+0000 7feaaca43700 1 -- 172.21.15.170:0/1732489493 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fea98010380 con 0x7feaa8107590 2024-01-25T14:53:03.977 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.382+0000 7feaada45700 1 -- 172.21.15.170:0/1732489493 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fea90038b80 msgr2=0x7fea9003b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:03.977 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.382+0000 7feaada45700 1 --2- 172.21.15.170:0/1732489493 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fea90038b80 0x7fea9003b040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fea9c006fd0 tx=0x7fea9c006e40 comp rx=0 tx=0).stop 2024-01-25T14:53:03.977 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.382+0000 7feaada45700 1 -- 172.21.15.170:0/1732489493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa8107590 msgr2=0x7feaa8105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:03.977 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.382+0000 7feaada45700 1 --2- 172.21.15.170:0/1732489493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa8107590 0x7feaa8105bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fea98003e60 tx=0x7fea98011a30 comp rx=0 tx=0).stop 2024-01-25T14:53:03.977 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.382+0000 7feaada45700 1 -- 172.21.15.170:0/1732489493 shutdown_connections 2024-01-25T14:53:03.977 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.382+0000 7feaada45700 1 --2- 172.21.15.170:0/1732489493 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fea90038b80 0x7fea9003b040 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:03.978 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.382+0000 7feaada45700 1 --2- 172.21.15.170:0/1732489493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feaa8107590 0x7feaa8105bd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:03.978 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.382+0000 7feaada45700 1 -- 172.21.15.170:0/1732489493 >> 172.21.15.170:0/1732489493 conn(0x7feaa8100d70 msgr2=0x7feaa8101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:03.978 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.382+0000 7feaada45700 1 -- 172.21.15.170:0/1732489493 shutdown_connections 2024-01-25T14:53:03.978 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:03.382+0000 7feaada45700 1 -- 172.21.15.170:0/1732489493 wait complete. 2024-01-25T14:53:05.429 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.546+0000 7fd2db291700 1 Processor -- start 2024-01-25T14:53:05.429 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.546+0000 7fd2db291700 1 -- start start 2024-01-25T14:53:05.429 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.546+0000 7fd2db291700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2d41071a0 0x7fd2d41075c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:05.429 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.546+0000 7fd2db291700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d4107b90 con 0x7fd2d41071a0 2024-01-25T14:53:05.429 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.547+0000 7fd2d902d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2d41071a0 0x7fd2d41075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:05.429 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.547+0000 7fd2d902d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2d41071a0 0x7fd2d41075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51600/0 (socket says 172.21.15.170:51600) 2024-01-25T14:53:05.429 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.547+0000 7fd2d902d700 1 -- 172.21.15.170:0/2759304061 learned_addr learned my addr 172.21.15.170:0/2759304061 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:05.429 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.547+0000 7fd2d902d700 1 -- 172.21.15.170:0/2759304061 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d4108300 con 0x7fd2d41071a0 2024-01-25T14:53:05.429 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.547+0000 7fd2d902d700 1 --2- 172.21.15.170:0/2759304061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2d41071a0 0x7fd2d41075c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009e80 tx=0x7fd2d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9183f6ae9762fabf server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:05.429 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.547+0000 7fd2cbfff700 1 -- 172.21.15.170:0/2759304061 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2d000e070 con 0x7fd2d41071a0 2024-01-25T14:53:05.429 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.547+0000 7fd2cbfff700 1 -- 172.21.15.170:0/2759304061 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2d000b8c0 con 0x7fd2d41071a0 2024-01-25T14:53:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.547+0000 7fd2cbfff700 1 -- 172.21.15.170:0/2759304061 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2d00043e0 con 0x7fd2d41071a0 2024-01-25T14:53:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.548+0000 7fd2db291700 1 -- 172.21.15.170:0/2759304061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2d41071a0 msgr2=0x7fd2d41075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.548+0000 7fd2db291700 1 --2- 172.21.15.170:0/2759304061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2d41071a0 0x7fd2d41075c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009e80 tx=0x7fd2d000b330 comp rx=0 tx=0).stop 2024-01-25T14:53:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.548+0000 7fd2db291700 1 -- 172.21.15.170:0/2759304061 shutdown_connections 2024-01-25T14:53:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.548+0000 7fd2db291700 1 --2- 172.21.15.170:0/2759304061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2d41071a0 0x7fd2d41075c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.548+0000 7fd2db291700 1 -- 172.21.15.170:0/2759304061 >> 172.21.15.170:0/2759304061 conn(0x7fd2d41027c0 msgr2=0x7fd2d4104be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.548+0000 7fd2db291700 1 -- 172.21.15.170:0/2759304061 shutdown_connections 2024-01-25T14:53:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.548+0000 7fd2db291700 1 -- 172.21.15.170:0/2759304061 wait complete. 2024-01-25T14:53:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.549+0000 7fd2db291700 1 Processor -- start 2024-01-25T14:53:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.549+0000 7fd2db291700 1 -- start start 2024-01-25T14:53:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.549+0000 7fd2db291700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2d41071a0 0x7fd2d419adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.549+0000 7fd2db291700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d419b300 con 0x7fd2d41071a0 2024-01-25T14:53:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.549+0000 7fd2d902d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2d41071a0 0x7fd2d419adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.549+0000 7fd2d902d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2d41071a0 0x7fd2d419adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:51606/0 (socket says 172.21.15.170:51606) 2024-01-25T14:53:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.549+0000 7fd2d902d700 1 -- 172.21.15.170:0/1576918878 learned_addr learned my addr 172.21.15.170:0/1576918878 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.549+0000 7fd2d902d700 1 -- 172.21.15.170:0/1576918878 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0009b30 con 0x7fd2d41071a0 2024-01-25T14:53:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.549+0000 7fd2d902d700 1 --2- 172.21.15.170:0/1576918878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2d41071a0 0x7fd2d419adc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009e50 tx=0x7fd2d0003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.549+0000 7fd2ca7fc700 1 -- 172.21.15.170:0/1576918878 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2d000e040 con 0x7fd2d41071a0 2024-01-25T14:53:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.549+0000 7fd2ca7fc700 1 -- 172.21.15.170:0/1576918878 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2d000bd70 con 0x7fd2d41071a0 2024-01-25T14:53:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.549+0000 7fd2db291700 1 -- 172.21.15.170:0/1576918878 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d419b500 con 0x7fd2d41071a0 2024-01-25T14:53:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.549+0000 7fd2ca7fc700 1 -- 172.21.15.170:0/1576918878 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd2d001c6b0 con 0x7fd2d41071a0 2024-01-25T14:53:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.550+0000 7fd2db291700 1 -- 172.21.15.170:0/1576918878 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d419ba00 con 0x7fd2d41071a0 2024-01-25T14:53:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.550+0000 7fd2ca7fc700 1 -- 172.21.15.170:0/1576918878 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7fd2d0012430 con 0x7fd2d41071a0 2024-01-25T14:53:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.551+0000 7fd2ca7fc700 1 --2- 172.21.15.170:0/1576918878 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd2c0038b40 0x7fd2c003b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.550+0000 7fd2db291700 1 -- 172.21.15.170:0/1576918878 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d410b530 con 0x7fd2d41071a0 2024-01-25T14:53:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.551+0000 7fd2ca7fc700 1 -- 172.21.15.170:0/1576918878 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd2d004cae0 con 0x7fd2d41071a0 2024-01-25T14:53:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.551+0000 7fd2d882c700 1 --2- 172.21.15.170:0/1576918878 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd2c0038b40 0x7fd2c003b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.551+0000 7fd2d882c700 1 --2- 172.21.15.170:0/1576918878 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd2c0038b40 0x7fd2c003b000 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4006fd0 tx=0x7fd2c4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:05.432 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.556+0000 7fd2ca7fc700 1 -- 172.21.15.170:0/1576918878 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fd2d0011390 con 0x7fd2d41071a0 2024-01-25T14:53:05.432 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.858+0000 7fd2db291700 1 -- 172.21.15.170:0/1576918878 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fd2d419e280 con 0x7fd2d41071a0 2024-01-25T14:53:05.432 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.861+0000 7fd2ca7fc700 1 -- 172.21.15.170:0/1576918878 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7fd2d00170c0 con 0x7fd2d41071a0 2024-01-25T14:53:05.432 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.863+0000 7fd2db291700 1 -- 172.21.15.170:0/1576918878 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd2c0038b40 msgr2=0x7fd2c003b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:05.432 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.863+0000 7fd2db291700 1 --2- 172.21.15.170:0/1576918878 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd2c0038b40 0x7fd2c003b000 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4006fd0 tx=0x7fd2c4006e40 comp rx=0 tx=0).stop 2024-01-25T14:53:05.432 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.863+0000 7fd2db291700 1 -- 172.21.15.170:0/1576918878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2d41071a0 msgr2=0x7fd2d419adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:05.432 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.863+0000 7fd2db291700 1 --2- 172.21.15.170:0/1576918878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2d41071a0 0x7fd2d419adc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009e50 tx=0x7fd2d0003d00 comp rx=0 tx=0).stop 2024-01-25T14:53:05.432 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.863+0000 7fd2db291700 1 -- 172.21.15.170:0/1576918878 shutdown_connections 2024-01-25T14:53:05.432 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.863+0000 7fd2db291700 1 --2- 172.21.15.170:0/1576918878 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd2c0038b40 0x7fd2c003b000 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:05.432 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.863+0000 7fd2db291700 1 --2- 172.21.15.170:0/1576918878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd2d41071a0 0x7fd2d419adc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:05.432 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.863+0000 7fd2db291700 1 -- 172.21.15.170:0/1576918878 >> 172.21.15.170:0/1576918878 conn(0x7fd2d41027c0 msgr2=0x7fd2d4103200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:05.432 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.863+0000 7fd2db291700 1 -- 172.21.15.170:0/1576918878 shutdown_connections 2024-01-25T14:53:05.432 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr 2024-01-25T14:53:04.863+0000 7fd2db291700 1 -- 172.21.15.170:0/1576918878 wait complete. 2024-01-25T14:53:05.433 INFO:teuthology.orchestra.run.smithi170.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-01-25T14:53:05.433 INFO:teuthology.orchestra.run.smithi170.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-01-25T14:53:05.433 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:53:05.433 INFO:teuthology.orchestra.run.smithi170.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-01-25T14:53:05.433 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:53:05.433 INFO:teuthology.orchestra.run.smithi170.stdout:Or, if you are only running a single cluster on this host: 2024-01-25T14:53:05.433 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:53:05.433 INFO:teuthology.orchestra.run.smithi170.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-01-25T14:53:05.433 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:53:05.433 INFO:teuthology.orchestra.run.smithi170.stdout:Please consider enabling telemetry to help improve Ceph: 2024-01-25T14:53:05.433 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:53:05.433 INFO:teuthology.orchestra.run.smithi170.stdout: ceph telemetry on 2024-01-25T14:53:05.433 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:53:05.433 INFO:teuthology.orchestra.run.smithi170.stdout:For more information see: 2024-01-25T14:53:05.433 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:53:05.434 INFO:teuthology.orchestra.run.smithi170.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-01-25T14:53:05.434 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:53:05.434 INFO:teuthology.orchestra.run.smithi170.stdout:Bootstrap complete. 2024-01-25T14:53:05.468 INFO:tasks.cephadm:Fetching config... 2024-01-25T14:53:05.468 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T14:53:05.468 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-01-25T14:53:05.484 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-01-25T14:53:05.484 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T14:53:05.484 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-01-25T14:53:05.539 INFO:tasks.cephadm:Fetching mon keyring... 2024-01-25T14:53:05.539 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T14:53:05.539 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/keyring of=/dev/stdout 2024-01-25T14:53:05.606 INFO:tasks.cephadm:Fetching pub ssh key... 2024-01-25T14:53:05.607 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T14:53:05.607 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-01-25T14:53:05.661 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-01-25T14:53:05.662 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCebEpdG2lmbPjFj/B39BEtlGfx+kOrAmCI3gixEIpbO5dZBdmTxZREQO56+YjDGWzC+WE3Z7a1HOM+nV9hwGPPUBoHiTyGnSaNCpBVMPyChVDTGcGKxDJWfRW5wo1tFhT6Eo4DWxrvJa/YzB1OezcPUsQcZzK3o2Trz4gXpjtmpfndQAFK1B+74lHB2WqNaNtSNx4gTq9FPnJRE0nHc0lduR79PJ1CesOBpjRuXhnUAB8xFaabdUycNsr2QEOTWo8I+KCp7KpmUGJr6KlfsM85krNsOLn5PHurpLkMtSeDHZFQNdQln1QLW/WvXWJoX/sJnDRcbvypJry7heQsCKKV+FwZgLLuD278PVOH9xACfz8wBH5Gw6z+HkQo9rYq7YufbSd2Gv60/qlnruyJEhWnRTQw8bUeWetWSlDo0UltUMHjpGpKJWKK5w2OWSeslL2czr/4Bix4Njt4rswAj8ik0WOquvgv7sTDQNqCotVq2xu5J1T0Uqv/r8U2qBt/baE= ceph-267213a8-bb91-11ee-95b2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-01-25T14:53:05.742 INFO:teuthology.orchestra.run.smithi170.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCebEpdG2lmbPjFj/B39BEtlGfx+kOrAmCI3gixEIpbO5dZBdmTxZREQO56+YjDGWzC+WE3Z7a1HOM+nV9hwGPPUBoHiTyGnSaNCpBVMPyChVDTGcGKxDJWfRW5wo1tFhT6Eo4DWxrvJa/YzB1OezcPUsQcZzK3o2Trz4gXpjtmpfndQAFK1B+74lHB2WqNaNtSNx4gTq9FPnJRE0nHc0lduR79PJ1CesOBpjRuXhnUAB8xFaabdUycNsr2QEOTWo8I+KCp7KpmUGJr6KlfsM85krNsOLn5PHurpLkMtSeDHZFQNdQln1QLW/WvXWJoX/sJnDRcbvypJry7heQsCKKV+FwZgLLuD278PVOH9xACfz8wBH5Gw6z+HkQo9rYq7YufbSd2Gv60/qlnruyJEhWnRTQw8bUeWetWSlDo0UltUMHjpGpKJWKK5w2OWSeslL2czr/4Bix4Njt4rswAj8ik0WOquvgv7sTDQNqCotVq2xu5J1T0Uqv/r8U2qBt/baE= ceph-267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:53:05.759 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCebEpdG2lmbPjFj/B39BEtlGfx+kOrAmCI3gixEIpbO5dZBdmTxZREQO56+YjDGWzC+WE3Z7a1HOM+nV9hwGPPUBoHiTyGnSaNCpBVMPyChVDTGcGKxDJWfRW5wo1tFhT6Eo4DWxrvJa/YzB1OezcPUsQcZzK3o2Trz4gXpjtmpfndQAFK1B+74lHB2WqNaNtSNx4gTq9FPnJRE0nHc0lduR79PJ1CesOBpjRuXhnUAB8xFaabdUycNsr2QEOTWo8I+KCp7KpmUGJr6KlfsM85krNsOLn5PHurpLkMtSeDHZFQNdQln1QLW/WvXWJoX/sJnDRcbvypJry7heQsCKKV+FwZgLLuD278PVOH9xACfz8wBH5Gw6z+HkQo9rYq7YufbSd2Gv60/qlnruyJEhWnRTQw8bUeWetWSlDo0UltUMHjpGpKJWKK5w2OWSeslL2czr/4Bix4Njt4rswAj8ik0WOquvgv7sTDQNqCotVq2xu5J1T0Uqv/r8U2qBt/baE= ceph-267213a8-bb91-11ee-95b2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-01-25T14:53:05.806 INFO:teuthology.orchestra.run.smithi186.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCebEpdG2lmbPjFj/B39BEtlGfx+kOrAmCI3gixEIpbO5dZBdmTxZREQO56+YjDGWzC+WE3Z7a1HOM+nV9hwGPPUBoHiTyGnSaNCpBVMPyChVDTGcGKxDJWfRW5wo1tFhT6Eo4DWxrvJa/YzB1OezcPUsQcZzK3o2Trz4gXpjtmpfndQAFK1B+74lHB2WqNaNtSNx4gTq9FPnJRE0nHc0lduR79PJ1CesOBpjRuXhnUAB8xFaabdUycNsr2QEOTWo8I+KCp7KpmUGJr6KlfsM85krNsOLn5PHurpLkMtSeDHZFQNdQln1QLW/WvXWJoX/sJnDRcbvypJry7heQsCKKV+FwZgLLuD278PVOH9xACfz8wBH5Gw6z+HkQo9rYq7YufbSd2Gv60/qlnruyJEhWnRTQw8bUeWetWSlDo0UltUMHjpGpKJWKK5w2OWSeslL2czr/4Bix4Njt4rswAj8ik0WOquvgv7sTDQNqCotVq2xu5J1T0Uqv/r8U2qBt/baE= ceph-267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:53:05.821 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCebEpdG2lmbPjFj/B39BEtlGfx+kOrAmCI3gixEIpbO5dZBdmTxZREQO56+YjDGWzC+WE3Z7a1HOM+nV9hwGPPUBoHiTyGnSaNCpBVMPyChVDTGcGKxDJWfRW5wo1tFhT6Eo4DWxrvJa/YzB1OezcPUsQcZzK3o2Trz4gXpjtmpfndQAFK1B+74lHB2WqNaNtSNx4gTq9FPnJRE0nHc0lduR79PJ1CesOBpjRuXhnUAB8xFaabdUycNsr2QEOTWo8I+KCp7KpmUGJr6KlfsM85krNsOLn5PHurpLkMtSeDHZFQNdQln1QLW/WvXWJoX/sJnDRcbvypJry7heQsCKKV+FwZgLLuD278PVOH9xACfz8wBH5Gw6z+HkQo9rYq7YufbSd2Gv60/qlnruyJEhWnRTQw8bUeWetWSlDo0UltUMHjpGpKJWKK5w2OWSeslL2czr/4Bix4Njt4rswAj8ik0WOquvgv7sTDQNqCotVq2xu5J1T0Uqv/r8U2qBt/baE= ceph-267213a8-bb91-11ee-95b2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-01-25T14:53:05.867 INFO:teuthology.orchestra.run.smithi191.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCebEpdG2lmbPjFj/B39BEtlGfx+kOrAmCI3gixEIpbO5dZBdmTxZREQO56+YjDGWzC+WE3Z7a1HOM+nV9hwGPPUBoHiTyGnSaNCpBVMPyChVDTGcGKxDJWfRW5wo1tFhT6Eo4DWxrvJa/YzB1OezcPUsQcZzK3o2Trz4gXpjtmpfndQAFK1B+74lHB2WqNaNtSNx4gTq9FPnJRE0nHc0lduR79PJ1CesOBpjRuXhnUAB8xFaabdUycNsr2QEOTWo8I+KCp7KpmUGJr6KlfsM85krNsOLn5PHurpLkMtSeDHZFQNdQln1QLW/WvXWJoX/sJnDRcbvypJry7heQsCKKV+FwZgLLuD278PVOH9xACfz8wBH5Gw6z+HkQo9rYq7YufbSd2Gv60/qlnruyJEhWnRTQw8bUeWetWSlDo0UltUMHjpGpKJWKK5w2OWSeslL2czr/4Bix4Njt4rswAj8ik0WOquvgv7sTDQNqCotVq2xu5J1T0Uqv/r8U2qBt/baE= ceph-267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:53:05.882 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-01-25T14:53:06.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:05 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1576918878' entity='client.admin' 2024-01-25T14:53:06.125 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:53:08.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.415+0000 7fb7ed2ec700 1 -- 172.21.15.170:0/2193549636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7e8101200 msgr2=0x7fb7e8101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:08.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.415+0000 7fb7ed2ec700 1 --2- 172.21.15.170:0/2193549636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7e8101200 0x7fb7e8101620 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000b0a0 tx=0x7fb7e000b3b0 comp rx=0 tx=0).stop 2024-01-25T14:53:08.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.415+0000 7fb7ed2ec700 1 -- 172.21.15.170:0/2193549636 shutdown_connections 2024-01-25T14:53:08.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.415+0000 7fb7ed2ec700 1 --2- 172.21.15.170:0/2193549636 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7e8101200 0x7fb7e8101620 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:08.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.415+0000 7fb7ed2ec700 1 -- 172.21.15.170:0/2193549636 >> 172.21.15.170:0/2193549636 conn(0x7fb7e80fc7a0 msgr2=0x7fb7e80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:08.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.415+0000 7fb7ed2ec700 1 -- 172.21.15.170:0/2193549636 shutdown_connections 2024-01-25T14:53:08.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.415+0000 7fb7ed2ec700 1 -- 172.21.15.170:0/2193549636 wait complete. 2024-01-25T14:53:08.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.415+0000 7fb7ed2ec700 1 Processor -- start 2024-01-25T14:53:08.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.416+0000 7fb7ed2ec700 1 -- start start 2024-01-25T14:53:08.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.416+0000 7fb7ed2ec700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7e8101200 0x7fb7e80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:08.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.416+0000 7fb7ed2ec700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e80759e0 con 0x7fb7e8101200 2024-01-25T14:53:08.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.416+0000 7fb7e6ffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7e8101200 0x7fb7e80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:08.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.416+0000 7fb7e6ffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7e8101200 0x7fb7e80754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47732/0 (socket says 172.21.15.170:47732) 2024-01-25T14:53:08.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.416+0000 7fb7e6ffd700 1 -- 172.21.15.170:0/1990601227 learned_addr learned my addr 172.21.15.170:0/1990601227 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:08.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.416+0000 7fb7e6ffd700 1 -- 172.21.15.170:0/1990601227 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e0009d00 con 0x7fb7e8101200 2024-01-25T14:53:08.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.416+0000 7fb7e6ffd700 1 --2- 172.21.15.170:0/1990601227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7e8101200 0x7fb7e80754a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000b830 tx=0x7fb7e000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:08.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.416+0000 7fb7cffff700 1 -- 172.21.15.170:0/1990601227 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7e000e040 con 0x7fb7e8101200 2024-01-25T14:53:08.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.416+0000 7fb7ed2ec700 1 -- 172.21.15.170:0/1990601227 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e8073bd0 con 0x7fb7e8101200 2024-01-25T14:53:08.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.416+0000 7fb7cffff700 1 -- 172.21.15.170:0/1990601227 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb7e0003d40 con 0x7fb7e8101200 2024-01-25T14:53:08.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.416+0000 7fb7cffff700 1 -- 172.21.15.170:0/1990601227 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7e001d600 con 0x7fb7e8101200 2024-01-25T14:53:08.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.416+0000 7fb7ed2ec700 1 -- 172.21.15.170:0/1990601227 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e8074070 con 0x7fb7e8101200 2024-01-25T14:53:08.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.417+0000 7fb7cffff700 1 -- 172.21.15.170:0/1990601227 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7fb7e0019070 con 0x7fb7e8101200 2024-01-25T14:53:08.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.417+0000 7fb7ed2ec700 1 -- 172.21.15.170:0/1990601227 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e8062e10 con 0x7fb7e8101200 2024-01-25T14:53:08.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.418+0000 7fb7cffff700 1 --2- 172.21.15.170:0/1990601227 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7d0038b80 0x7fb7d003b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:08.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.418+0000 7fb7cffff700 1 -- 172.21.15.170:0/1990601227 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb7e004ca90 con 0x7fb7e8101200 2024-01-25T14:53:08.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.418+0000 7fb7e67fc700 1 --2- 172.21.15.170:0/1990601227 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7d0038b80 0x7fb7d003b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:08.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.418+0000 7fb7e67fc700 1 --2- 172.21.15.170:0/1990601227 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7d0038b80 0x7fb7d003b040 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc006fd0 tx=0x7fb7dc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:08.424 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.423+0000 7fb7cffff700 1 -- 172.21.15.170:0/1990601227 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb7e0026990 con 0x7fb7e8101200 2024-01-25T14:53:08.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.621+0000 7fb7ed2ec700 1 -- 172.21.15.170:0/1990601227 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fb7e8106f50 con 0x7fb7e8101200 2024-01-25T14:53:08.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.623+0000 7fb7cffff700 1 -- 172.21.15.170:0/1990601227 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fb7e0017020 con 0x7fb7e8101200 2024-01-25T14:53:08.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.626+0000 7fb7ed2ec700 1 -- 172.21.15.170:0/1990601227 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7d0038b80 msgr2=0x7fb7d003b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:08.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.626+0000 7fb7ed2ec700 1 --2- 172.21.15.170:0/1990601227 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7d0038b80 0x7fb7d003b040 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc006fd0 tx=0x7fb7dc006e40 comp rx=0 tx=0).stop 2024-01-25T14:53:08.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.626+0000 7fb7ed2ec700 1 -- 172.21.15.170:0/1990601227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7e8101200 msgr2=0x7fb7e80754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:08.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.626+0000 7fb7ed2ec700 1 --2- 172.21.15.170:0/1990601227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7e8101200 0x7fb7e80754a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000b830 tx=0x7fb7e000bd40 comp rx=0 tx=0).stop 2024-01-25T14:53:08.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.626+0000 7fb7ed2ec700 1 -- 172.21.15.170:0/1990601227 shutdown_connections 2024-01-25T14:53:08.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.626+0000 7fb7ed2ec700 1 --2- 172.21.15.170:0/1990601227 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7d0038b80 0x7fb7d003b040 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:08.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.626+0000 7fb7ed2ec700 1 --2- 172.21.15.170:0/1990601227 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7e8101200 0x7fb7e80754a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:08.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.626+0000 7fb7ed2ec700 1 -- 172.21.15.170:0/1990601227 >> 172.21.15.170:0/1990601227 conn(0x7fb7e80fc7a0 msgr2=0x7fb7e80fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:08.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.626+0000 7fb7ed2ec700 1 -- 172.21.15.170:0/1990601227 shutdown_connections 2024-01-25T14:53:08.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:08.626+0000 7fb7ed2ec700 1 -- 172.21.15.170:0/1990601227 wait complete. 2024-01-25T14:53:09.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:09 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:09.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:09 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:09.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:09 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi170", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:53:09.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:09 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:09.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:09 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:53:09.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:09 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:09.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:09 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1990601227' entity='client.admin' 2024-01-25T14:53:09.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:09 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:53:09.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:09 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:09.471 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-01-25T14:53:09.472 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-01-25T14:53:10.227 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:53:11.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.787+0000 7f8aa1243700 1 -- 172.21.15.170:0/3949201226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c101cb0 msgr2=0x7f8a9c1040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:11.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.787+0000 7f8aa1243700 1 --2- 172.21.15.170:0/3949201226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c101cb0 0x7f8a9c1040a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c009910 tx=0x7f8a8c009c20 comp rx=0 tx=0).stop 2024-01-25T14:53:11.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.787+0000 7f8aa1243700 1 -- 172.21.15.170:0/3949201226 shutdown_connections 2024-01-25T14:53:11.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.787+0000 7f8aa1243700 1 --2- 172.21.15.170:0/3949201226 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c101cb0 0x7f8a9c1040a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:11.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.787+0000 7f8aa1243700 1 -- 172.21.15.170:0/3949201226 >> 172.21.15.170:0/3949201226 conn(0x7f8a9c0fb6e0 msgr2=0x7f8a9c0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:11.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.787+0000 7f8aa1243700 1 -- 172.21.15.170:0/3949201226 shutdown_connections 2024-01-25T14:53:11.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.787+0000 7f8aa1243700 1 -- 172.21.15.170:0/3949201226 wait complete. 2024-01-25T14:53:11.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.787+0000 7f8aa1243700 1 Processor -- start 2024-01-25T14:53:11.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.788+0000 7f8aa1243700 1 -- start start 2024-01-25T14:53:11.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.788+0000 7f8aa1243700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c101cb0 0x7f8a9c101530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:11.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.788+0000 7f8aa1243700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9c101a70 con 0x7f8a9c101cb0 2024-01-25T14:53:11.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.788+0000 7f8a9ad9d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c101cb0 0x7f8a9c101530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:11.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.788+0000 7f8a9ad9d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c101cb0 0x7f8a9c101530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47756/0 (socket says 172.21.15.170:47756) 2024-01-25T14:53:11.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.788+0000 7f8a9ad9d700 1 -- 172.21.15.170:0/1492640888 learned_addr learned my addr 172.21.15.170:0/1492640888 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:11.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.788+0000 7f8a9ad9d700 1 -- 172.21.15.170:0/1492640888 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c0095f0 con 0x7f8a9c101cb0 2024-01-25T14:53:11.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.788+0000 7f8a9ad9d700 1 --2- 172.21.15.170:0/1492640888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c101cb0 0x7f8a9c101530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00b5c0 tx=0x7f8a8c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:11.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.788+0000 7f8a98d99700 1 -- 172.21.15.170:0/1492640888 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a8c01d070 con 0x7f8a9c101cb0 2024-01-25T14:53:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.788+0000 7f8a98d99700 1 -- 172.21.15.170:0/1492640888 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a8c00be20 con 0x7f8a9c101cb0 2024-01-25T14:53:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.788+0000 7f8a98d99700 1 -- 172.21.15.170:0/1492640888 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a8c022d00 con 0x7f8a9c101cb0 2024-01-25T14:53:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.788+0000 7f8aa1243700 1 -- 172.21.15.170:0/1492640888 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c0ffc60 con 0x7f8a9c101cb0 2024-01-25T14:53:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.789+0000 7f8aa1243700 1 -- 172.21.15.170:0/1492640888 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c100100 con 0x7f8a9c101cb0 2024-01-25T14:53:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.789+0000 7f8a98d99700 1 -- 172.21.15.170:0/1492640888 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7f8a8c00f460 con 0x7f8a9c101cb0 2024-01-25T14:53:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.789+0000 7f8a98d99700 1 --2- 172.21.15.170:0/1492640888 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8a88038ae0 0x7f8a8803afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.790+0000 7f8a98d99700 1 -- 172.21.15.170:0/1492640888 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8a8c00b960 con 0x7f8a9c101cb0 2024-01-25T14:53:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.790+0000 7f8a9259c700 1 --2- 172.21.15.170:0/1492640888 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8a88038ae0 0x7f8a8803afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.790+0000 7f8aa1243700 1 -- 172.21.15.170:0/1492640888 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9c100b10 con 0x7f8a9c101cb0 2024-01-25T14:53:11.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.790+0000 7f8a9259c700 1 --2- 172.21.15.170:0/1492640888 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8a88038ae0 0x7f8a8803afa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8a84006fd0 tx=0x7f8a84006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:11.795 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.795+0000 7f8a98d99700 1 -- 172.21.15.170:0/1492640888 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f8a8c027020 con 0x7f8a9c101cb0 2024-01-25T14:53:11.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.990+0000 7f8aa1243700 1 -- 172.21.15.170:0/1492640888 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a9c1071d0 con 0x7f8a88038ae0 2024-01-25T14:53:11.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.994+0000 7f8a98d99700 1 -- 172.21.15.170:0/1492640888 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8a9c1071d0 con 0x7f8a88038ae0 2024-01-25T14:53:11.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.996+0000 7f8aa1243700 1 -- 172.21.15.170:0/1492640888 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8a88038ae0 msgr2=0x7f8a8803afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:11.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.996+0000 7f8aa1243700 1 --2- 172.21.15.170:0/1492640888 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8a88038ae0 0x7f8a8803afa0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8a84006fd0 tx=0x7f8a84006e40 comp rx=0 tx=0).stop 2024-01-25T14:53:11.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.996+0000 7f8aa1243700 1 -- 172.21.15.170:0/1492640888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c101cb0 msgr2=0x7f8a9c101530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:11.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.996+0000 7f8aa1243700 1 --2- 172.21.15.170:0/1492640888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c101cb0 0x7f8a9c101530 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00b5c0 tx=0x7f8a8c004ff0 comp rx=0 tx=0).stop 2024-01-25T14:53:11.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.996+0000 7f8aa1243700 1 -- 172.21.15.170:0/1492640888 shutdown_connections 2024-01-25T14:53:11.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.996+0000 7f8aa1243700 1 --2- 172.21.15.170:0/1492640888 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8a88038ae0 0x7f8a8803afa0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:11.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.996+0000 7f8aa1243700 1 --2- 172.21.15.170:0/1492640888 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8a9c101cb0 0x7f8a9c101530 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:11.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.996+0000 7f8aa1243700 1 -- 172.21.15.170:0/1492640888 >> 172.21.15.170:0/1492640888 conn(0x7f8a9c0fb6e0 msgr2=0x7f8a9c0fc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:11.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.996+0000 7f8aa1243700 1 -- 172.21.15.170:0/1492640888 shutdown_connections 2024-01-25T14:53:11.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:11.996+0000 7f8aa1243700 1 -- 172.21.15.170:0/1492640888 wait complete. 2024-01-25T14:53:12.738 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi186 2024-01-25T14:53:12.738 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-01-25T14:53:12.738 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/etc/ceph/ceph.conf 2024-01-25T14:53:12.757 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-01-25T14:53:12.758 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-25T14:53:12.815 INFO:tasks.cephadm:Adding host smithi186 to orchestrator... 2024-01-25T14:53:12.816 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch host add smithi186 2024-01-25T14:53:13.053 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:53:13.268 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:12 smithi170 ceph-mon[31899]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:53:13.268 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:13.268 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:53:13.268 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:13.268 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:53:13.268 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:12 smithi170 ceph-mon[31899]: Updating smithi170:/etc/ceph/ceph.conf 2024-01-25T14:53:13.268 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:12 smithi170 ceph-mon[31899]: Updating smithi170:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:13.269 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:13.269 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:13.269 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:14.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:13 smithi170 ceph-mon[31899]: Updating smithi170:/etc/ceph/ceph.client.admin.keyring 2024-01-25T14:53:14.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:13 smithi170 ceph-mon[31899]: Updating smithi170:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.client.admin.keyring 2024-01-25T14:53:14.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.548+0000 7f1b74ed3700 1 -- 172.21.15.170:0/2140582452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b70105850 msgr2=0x7f1b70105c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:14.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.548+0000 7f1b74ed3700 1 --2- 172.21.15.170:0/2140582452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b70105850 0x7f1b70105c30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800aa20 tx=0x7f1b5800ad30 comp rx=0 tx=0).stop 2024-01-25T14:53:14.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.549+0000 7f1b74ed3700 1 -- 172.21.15.170:0/2140582452 shutdown_connections 2024-01-25T14:53:14.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.549+0000 7f1b74ed3700 1 --2- 172.21.15.170:0/2140582452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b70105850 0x7f1b70105c30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:14.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.549+0000 7f1b74ed3700 1 -- 172.21.15.170:0/2140582452 >> 172.21.15.170:0/2140582452 conn(0x7f1b70077800 msgr2=0x7f1b70077c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:14.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.549+0000 7f1b74ed3700 1 -- 172.21.15.170:0/2140582452 shutdown_connections 2024-01-25T14:53:14.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.549+0000 7f1b74ed3700 1 -- 172.21.15.170:0/2140582452 wait complete. 2024-01-25T14:53:14.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.549+0000 7f1b74ed3700 1 Processor -- start 2024-01-25T14:53:14.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.549+0000 7f1b74ed3700 1 -- start start 2024-01-25T14:53:14.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.550+0000 7f1b74ed3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b70105850 0x7f1b7019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:14.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.550+0000 7f1b74ed3700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7019cbf0 con 0x7f1b70105850 2024-01-25T14:53:14.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.550+0000 7f1b6e59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b70105850 0x7f1b7019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:14.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.550+0000 7f1b6e59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b70105850 0x7f1b7019c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:47772/0 (socket says 172.21.15.170:47772) 2024-01-25T14:53:14.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.550+0000 7f1b6e59c700 1 -- 172.21.15.170:0/3806288133 learned_addr learned my addr 172.21.15.170:0/3806288133 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:14.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.550+0000 7f1b6e59c700 1 -- 172.21.15.170:0/3806288133 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5800a700 con 0x7f1b70105850 2024-01-25T14:53:14.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.550+0000 7f1b6e59c700 1 --2- 172.21.15.170:0/3806288133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b70105850 0x7f1b7019c6b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b58006010 tx=0x7f1b58004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:14.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.550+0000 7f1b677fe700 1 -- 172.21.15.170:0/3806288133 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b5801d070 con 0x7f1b70105850 2024-01-25T14:53:14.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.550+0000 7f1b677fe700 1 -- 172.21.15.170:0/3806288133 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b58005710 con 0x7f1b70105850 2024-01-25T14:53:14.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.550+0000 7f1b74ed3700 1 -- 172.21.15.170:0/3806288133 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7019cdf0 con 0x7f1b70105850 2024-01-25T14:53:14.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.550+0000 7f1b677fe700 1 -- 172.21.15.170:0/3806288133 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1b5800e450 con 0x7f1b70105850 2024-01-25T14:53:14.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.550+0000 7f1b74ed3700 1 -- 172.21.15.170:0/3806288133 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7019d270 con 0x7f1b70105850 2024-01-25T14:53:14.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.551+0000 7f1b677fe700 1 -- 172.21.15.170:0/3806288133 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7f1b5800e640 con 0x7f1b70105850 2024-01-25T14:53:14.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.551+0000 7f1b74ed3700 1 -- 172.21.15.170:0/3806288133 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b70100f90 con 0x7f1b70105850 2024-01-25T14:53:14.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.551+0000 7f1b677fe700 1 --2- 172.21.15.170:0/3806288133 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1b5c038b40 0x7f1b5c03b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:14.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.551+0000 7f1b677fe700 1 -- 172.21.15.170:0/3806288133 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1b58012070 con 0x7f1b70105850 2024-01-25T14:53:14.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.552+0000 7f1b6dd9b700 1 --2- 172.21.15.170:0/3806288133 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1b5c038b40 0x7f1b5c03b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:14.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.552+0000 7f1b6dd9b700 1 --2- 172.21.15.170:0/3806288133 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1b5c038b40 0x7f1b5c03b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1b60006fd0 tx=0x7f1b60006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:14.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.556+0000 7f1b677fe700 1 -- 172.21.15.170:0/3806288133 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1b58014b60 con 0x7f1b70105850 2024-01-25T14:53:14.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:14.748+0000 7f1b74ed3700 1 -- 172.21.15.170:0/3806288133 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b701093a0 con 0x7f1b5c038b40 2024-01-25T14:53:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:15 smithi170 ceph-mon[31899]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:53:17.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:17 smithi170 ceph-mon[31899]: Deploying cephadm binary to smithi186 2024-01-25T14:53:17.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:17 smithi170 ceph-mon[31899]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:18.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:18.948+0000 7f1b677fe700 1 -- 172.21.15.170:0/3806288133 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1b701093a0 con 0x7f1b5c038b40 2024-01-25T14:53:18.950 INFO:teuthology.orchestra.run.smithi170.stdout:Added host 'smithi186' with addr '172.21.15.186' 2024-01-25T14:53:18.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:18.951+0000 7f1b74ed3700 1 -- 172.21.15.170:0/3806288133 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1b5c038b40 msgr2=0x7f1b5c03b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:18.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:18.951+0000 7f1b74ed3700 1 --2- 172.21.15.170:0/3806288133 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1b5c038b40 0x7f1b5c03b000 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1b60006fd0 tx=0x7f1b60006e40 comp rx=0 tx=0).stop 2024-01-25T14:53:18.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:18.951+0000 7f1b74ed3700 1 -- 172.21.15.170:0/3806288133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b70105850 msgr2=0x7f1b7019c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:18.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:18.951+0000 7f1b74ed3700 1 --2- 172.21.15.170:0/3806288133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b70105850 0x7f1b7019c6b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b58006010 tx=0x7f1b58004d30 comp rx=0 tx=0).stop 2024-01-25T14:53:18.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:18.951+0000 7f1b74ed3700 1 -- 172.21.15.170:0/3806288133 shutdown_connections 2024-01-25T14:53:18.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:18.951+0000 7f1b74ed3700 1 --2- 172.21.15.170:0/3806288133 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1b5c038b40 0x7f1b5c03b000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:18.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:18.951+0000 7f1b74ed3700 1 --2- 172.21.15.170:0/3806288133 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1b70105850 0x7f1b7019c6b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:18.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:18.951+0000 7f1b74ed3700 1 -- 172.21.15.170:0/3806288133 >> 172.21.15.170:0/3806288133 conn(0x7f1b70077800 msgr2=0x7f1b70101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:18.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:18.951+0000 7f1b74ed3700 1 -- 172.21.15.170:0/3806288133 shutdown_connections 2024-01-25T14:53:18.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:18.951+0000 7f1b74ed3700 1 -- 172.21.15.170:0/3806288133 wait complete. 2024-01-25T14:53:19.300 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:18 smithi170 ceph-mon[31899]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:19.549 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch host ls --format=json 2024-01-25T14:53:19.784 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:53:20.203 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:20.203 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:19 smithi170 ceph-mon[31899]: Added host smithi186 2024-01-25T14:53:20.203 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:53:20.203 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:21.223 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:20 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:21.223 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:20 smithi170 ceph-mon[31899]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:21.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.319+0000 7f2837d01700 1 -- 172.21.15.170:0/4080542134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2830100320 msgr2=0x7f2830100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:21.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.319+0000 7f2837d01700 1 --2- 172.21.15.170:0/4080542134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2830100320 0x7f2830100700 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2820009910 tx=0x7f2820009c20 comp rx=0 tx=0).stop 2024-01-25T14:53:21.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.319+0000 7f2837d01700 1 -- 172.21.15.170:0/4080542134 shutdown_connections 2024-01-25T14:53:21.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.319+0000 7f2837d01700 1 --2- 172.21.15.170:0/4080542134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2830100320 0x7f2830100700 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:21.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.319+0000 7f2837d01700 1 -- 172.21.15.170:0/4080542134 >> 172.21.15.170:0/4080542134 conn(0x7f28300fbbf0 msgr2=0x7f28300fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:21.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.319+0000 7f2837d01700 1 -- 172.21.15.170:0/4080542134 shutdown_connections 2024-01-25T14:53:21.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.319+0000 7f2837d01700 1 -- 172.21.15.170:0/4080542134 wait complete. 2024-01-25T14:53:21.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.320+0000 7f2837d01700 1 Processor -- start 2024-01-25T14:53:21.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.320+0000 7f2837d01700 1 -- start start 2024-01-25T14:53:21.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.320+0000 7f2837d01700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2830100320 0x7f283019b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:21.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.320+0000 7f2837d01700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283019bb50 con 0x7f2830100320 2024-01-25T14:53:21.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.320+0000 7f2835a9d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2830100320 0x7f283019b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:21.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.320+0000 7f2835a9d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2830100320 0x7f283019b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43086/0 (socket says 172.21.15.170:43086) 2024-01-25T14:53:21.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.320+0000 7f2835a9d700 1 -- 172.21.15.170:0/3488936116 learned_addr learned my addr 172.21.15.170:0/3488936116 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:21.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.321+0000 7f2835a9d700 1 -- 172.21.15.170:0/3488936116 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28200095f0 con 0x7f2830100320 2024-01-25T14:53:21.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.321+0000 7f2835a9d700 1 --2- 172.21.15.170:0/3488936116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2830100320 0x7f283019b610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2820006010 tx=0x7f2820004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:21.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.321+0000 7f2826ffd700 1 -- 172.21.15.170:0/3488936116 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f282001d070 con 0x7f2830100320 2024-01-25T14:53:21.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.321+0000 7f2826ffd700 1 -- 172.21.15.170:0/3488936116 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f282000bc10 con 0x7f2830100320 2024-01-25T14:53:21.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.321+0000 7f2826ffd700 1 -- 172.21.15.170:0/3488936116 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f28200038a0 con 0x7f2830100320 2024-01-25T14:53:21.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.321+0000 7f2837d01700 1 -- 172.21.15.170:0/3488936116 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283019bd50 con 0x7f2830100320 2024-01-25T14:53:21.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.321+0000 7f2837d01700 1 -- 172.21.15.170:0/3488936116 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283019c170 con 0x7f2830100320 2024-01-25T14:53:21.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.322+0000 7f2826ffd700 1 -- 172.21.15.170:0/3488936116 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7f282000b6f0 con 0x7f2830100320 2024-01-25T14:53:21.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.322+0000 7f2837d01700 1 -- 172.21.15.170:0/3488936116 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2830101800 con 0x7f2830100320 2024-01-25T14:53:21.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.322+0000 7f2826ffd700 1 --2- 172.21.15.170:0/3488936116 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f281c038ae0 0x7f281c03afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:21.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.322+0000 7f2826ffd700 1 -- 172.21.15.170:0/3488936116 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f282004c720 con 0x7f2830100320 2024-01-25T14:53:21.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.322+0000 7f283529c700 1 --2- 172.21.15.170:0/3488936116 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f281c038ae0 0x7f281c03afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:21.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.322+0000 7f283529c700 1 --2- 172.21.15.170:0/3488936116 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f281c038ae0 0x7f281c03afa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f282c006fd0 tx=0x7f282c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:21.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.327+0000 7f2826ffd700 1 -- 172.21.15.170:0/3488936116 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f2820003ad0 con 0x7f2830100320 2024-01-25T14:53:21.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.520+0000 7f2837d01700 1 -- 172.21.15.170:0/3488936116 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f283010a4f0 con 0x7f281c038ae0 2024-01-25T14:53:21.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.521+0000 7f2826ffd700 1 -- 172.21.15.170:0/3488936116 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f283010a4f0 con 0x7f281c038ae0 2024-01-25T14:53:21.522 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:53:21.522 INFO:teuthology.orchestra.run.smithi170.stdout:[{"addr": "172.21.15.170", "hostname": "smithi170", "labels": [], "status": ""}, {"addr": "172.21.15.186", "hostname": "smithi186", "labels": [], "status": ""}] 2024-01-25T14:53:21.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.523+0000 7f2837d01700 1 -- 172.21.15.170:0/3488936116 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f281c038ae0 msgr2=0x7f281c03afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:21.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.523+0000 7f2837d01700 1 --2- 172.21.15.170:0/3488936116 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f281c038ae0 0x7f281c03afa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f282c006fd0 tx=0x7f282c006e40 comp rx=0 tx=0).stop 2024-01-25T14:53:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.523+0000 7f2837d01700 1 -- 172.21.15.170:0/3488936116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2830100320 msgr2=0x7f283019b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.523+0000 7f2837d01700 1 --2- 172.21.15.170:0/3488936116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2830100320 0x7f283019b610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2820006010 tx=0x7f2820004ff0 comp rx=0 tx=0).stop 2024-01-25T14:53:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.523+0000 7f2837d01700 1 -- 172.21.15.170:0/3488936116 shutdown_connections 2024-01-25T14:53:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.523+0000 7f2837d01700 1 --2- 172.21.15.170:0/3488936116 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f281c038ae0 0x7f281c03afa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.523+0000 7f2837d01700 1 --2- 172.21.15.170:0/3488936116 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2830100320 0x7f283019b610 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.523+0000 7f2837d01700 1 -- 172.21.15.170:0/3488936116 >> 172.21.15.170:0/3488936116 conn(0x7f28300fbbf0 msgr2=0x7f2830101cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.523+0000 7f2837d01700 1 -- 172.21.15.170:0/3488936116 shutdown_connections 2024-01-25T14:53:21.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:21.523+0000 7f2837d01700 1 -- 172.21.15.170:0/3488936116 wait complete. 2024-01-25T14:53:22.154 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:21 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:22.183 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi191 2024-01-25T14:53:22.183 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-01-25T14:53:22.183 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.conf 2024-01-25T14:53:22.202 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-01-25T14:53:22.202 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-25T14:53:22.260 INFO:tasks.cephadm:Adding host smithi191 to orchestrator... 2024-01-25T14:53:22.260 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch host add smithi191 2024-01-25T14:53:22.493 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:53:23.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:22 smithi170 ceph-mon[31899]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T14:53:23.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:22 smithi170 ceph-mon[31899]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:23.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.966+0000 7f4482178700 1 -- 172.21.15.170:0/2290588409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447c1013f0 msgr2=0x7f447c1017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:23.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.966+0000 7f4482178700 1 --2- 172.21.15.170:0/2290588409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447c1013f0 0x7f447c1017d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f447400b0a0 tx=0x7f447400b3b0 comp rx=0 tx=0).stop 2024-01-25T14:53:23.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.966+0000 7f4482178700 1 -- 172.21.15.170:0/2290588409 shutdown_connections 2024-01-25T14:53:23.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.966+0000 7f4482178700 1 --2- 172.21.15.170:0/2290588409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447c1013f0 0x7f447c1017d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:23.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.966+0000 7f4482178700 1 -- 172.21.15.170:0/2290588409 >> 172.21.15.170:0/2290588409 conn(0x7f447c0fccc0 msgr2=0x7f447c0ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:23.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.966+0000 7f4482178700 1 -- 172.21.15.170:0/2290588409 shutdown_connections 2024-01-25T14:53:23.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.966+0000 7f4482178700 1 -- 172.21.15.170:0/2290588409 wait complete. 2024-01-25T14:53:23.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.967+0000 7f4482178700 1 Processor -- start 2024-01-25T14:53:23.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.967+0000 7f4482178700 1 -- start start 2024-01-25T14:53:23.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.967+0000 7f4482178700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447c1013f0 0x7f447c19c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:23.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.967+0000 7f4482178700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c19cc00 con 0x7f447c1013f0 2024-01-25T14:53:23.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.967+0000 7f447b7fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447c1013f0 0x7f447c19c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:23.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.967+0000 7f447b7fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447c1013f0 0x7f447c19c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:43114/0 (socket says 172.21.15.170:43114) 2024-01-25T14:53:23.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.967+0000 7f447b7fe700 1 -- 172.21.15.170:0/617278947 learned_addr learned my addr 172.21.15.170:0/617278947 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:23.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.968+0000 7f447b7fe700 1 -- 172.21.15.170:0/617278947 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4474009d00 con 0x7f447c1013f0 2024-01-25T14:53:23.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.968+0000 7f447b7fe700 1 --2- 172.21.15.170:0/617278947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447c1013f0 0x7f447c19c6c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f44740062a0 tx=0x7f447400bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:23.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.968+0000 7f4478ff9700 1 -- 172.21.15.170:0/617278947 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f447400e040 con 0x7f447c1013f0 2024-01-25T14:53:23.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.968+0000 7f4482178700 1 -- 172.21.15.170:0/617278947 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447c19ce00 con 0x7f447c1013f0 2024-01-25T14:53:23.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.968+0000 7f4478ff9700 1 -- 172.21.15.170:0/617278947 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4474003c10 con 0x7f447c1013f0 2024-01-25T14:53:23.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.968+0000 7f4478ff9700 1 -- 172.21.15.170:0/617278947 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f447401d470 con 0x7f447c1013f0 2024-01-25T14:53:23.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.968+0000 7f4482178700 1 -- 172.21.15.170:0/617278947 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447c19d220 con 0x7f447c1013f0 2024-01-25T14:53:23.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.969+0000 7f4478ff9700 1 -- 172.21.15.170:0/617278947 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7f4474019070 con 0x7f447c1013f0 2024-01-25T14:53:23.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.969+0000 7f4482178700 1 -- 172.21.15.170:0/617278947 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447c062e10 con 0x7f447c1013f0 2024-01-25T14:53:23.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.969+0000 7f4478ff9700 1 --2- 172.21.15.170:0/617278947 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4464038b30 0x7f446403aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:23.971 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.969+0000 7f4478ff9700 1 -- 172.21.15.170:0/617278947 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f447404cb10 con 0x7f447c1013f0 2024-01-25T14:53:23.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.969+0000 7f447affd700 1 --2- 172.21.15.170:0/617278947 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4464038b30 0x7f446403aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:23.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.970+0000 7f447affd700 1 --2- 172.21.15.170:0/617278947 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4464038b30 0x7f446403aff0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4470006fd0 tx=0x7f4470006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:23.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:23.974+0000 7f4478ff9700 1 -- 172.21.15.170:0/617278947 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f4474026990 con 0x7f447c1013f0 2024-01-25T14:53:24.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:24.180+0000 7f4482178700 1 -- 172.21.15.170:0/617278947 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}) v1 -- 0x7f447c10b5f0 con 0x7f4464038b30 2024-01-25T14:53:25.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:25.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:25.356 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:25.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:25.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:53:25.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:25.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:53:25.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:25 smithi170 ceph-mon[31899]: Updating smithi186:/etc/ceph/ceph.conf 2024-01-25T14:53:25.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:25 smithi170 ceph-mon[31899]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:25.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:25 smithi170 ceph-mon[31899]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:53:25.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:25 smithi170 ceph-mon[31899]: Updating smithi186:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:25.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:25.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:25.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:26.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:26 smithi170 ceph-mon[31899]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-01-25T14:53:26.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:26 smithi170 ceph-mon[31899]: Updating smithi186:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.client.admin.keyring 2024-01-25T14:53:26.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:26 smithi170 ceph-mon[31899]: Deploying cephadm binary to smithi191 2024-01-25T14:53:27.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:27 smithi170 ceph-mon[31899]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:28.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:28.268+0000 7f4478ff9700 1 -- 172.21.15.170:0/617278947 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f447c10b5f0 con 0x7f4464038b30 2024-01-25T14:53:28.269 INFO:teuthology.orchestra.run.smithi170.stdout:Added host 'smithi191' with addr '172.21.15.191' 2024-01-25T14:53:28.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:28.271+0000 7f4482178700 1 -- 172.21.15.170:0/617278947 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4464038b30 msgr2=0x7f446403aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:28.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:28.271+0000 7f4482178700 1 --2- 172.21.15.170:0/617278947 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4464038b30 0x7f446403aff0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4470006fd0 tx=0x7f4470006e40 comp rx=0 tx=0).stop 2024-01-25T14:53:28.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:28.271+0000 7f4482178700 1 -- 172.21.15.170:0/617278947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447c1013f0 msgr2=0x7f447c19c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:28.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:28.271+0000 7f4482178700 1 --2- 172.21.15.170:0/617278947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447c1013f0 0x7f447c19c6c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f44740062a0 tx=0x7f447400bd40 comp rx=0 tx=0).stop 2024-01-25T14:53:28.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:28.271+0000 7f4482178700 1 -- 172.21.15.170:0/617278947 shutdown_connections 2024-01-25T14:53:28.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:28.271+0000 7f4482178700 1 --2- 172.21.15.170:0/617278947 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4464038b30 0x7f446403aff0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:28.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:28.271+0000 7f4482178700 1 --2- 172.21.15.170:0/617278947 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f447c1013f0 0x7f447c19c6c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:28.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:28.271+0000 7f4482178700 1 -- 172.21.15.170:0/617278947 >> 172.21.15.170:0/617278947 conn(0x7f447c0fccc0 msgr2=0x7f447c102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:28.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:28.271+0000 7f4482178700 1 -- 172.21.15.170:0/617278947 shutdown_connections 2024-01-25T14:53:28.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:28.271+0000 7f4482178700 1 -- 172.21.15.170:0/617278947 wait complete. 2024-01-25T14:53:28.888 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch host ls --format=json 2024-01-25T14:53:29.126 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:53:29.530 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:29 smithi170 ceph-mon[31899]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:29.530 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:29 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:29.530 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:29 smithi170 ceph-mon[31899]: Added host smithi191 2024-01-25T14:53:29.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:29 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:53:29.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:29 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:29.531 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:29 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:30.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.671+0000 7f3eca4f1700 1 -- 172.21.15.170:0/1088253768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec4100300 msgr2=0x7f3ec41006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:30.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.671+0000 7f3eca4f1700 1 --2- 172.21.15.170:0/1088253768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec4100300 0x7f3ec41006e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009910 tx=0x7f3eb4009c20 comp rx=0 tx=0).stop 2024-01-25T14:53:30.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.672+0000 7f3eca4f1700 1 -- 172.21.15.170:0/1088253768 shutdown_connections 2024-01-25T14:53:30.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.672+0000 7f3eca4f1700 1 --2- 172.21.15.170:0/1088253768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec4100300 0x7f3ec41006e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:30.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.672+0000 7f3eca4f1700 1 -- 172.21.15.170:0/1088253768 >> 172.21.15.170:0/1088253768 conn(0x7f3ec40fbb90 msgr2=0x7f3ec40fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:30.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.672+0000 7f3eca4f1700 1 -- 172.21.15.170:0/1088253768 shutdown_connections 2024-01-25T14:53:30.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.672+0000 7f3eca4f1700 1 -- 172.21.15.170:0/1088253768 wait complete. 2024-01-25T14:53:30.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.672+0000 7f3eca4f1700 1 Processor -- start 2024-01-25T14:53:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.672+0000 7f3eca4f1700 1 -- start start 2024-01-25T14:53:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.673+0000 7f3eca4f1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec4100300 0x7f3ec4101da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.673+0000 7f3eca4f1700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4103c90 con 0x7f3ec4100300 2024-01-25T14:53:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.673+0000 7f3ec3fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec4100300 0x7f3ec4101da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.673+0000 7f3ec3fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec4100300 0x7f3ec4101da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:34796/0 (socket says 172.21.15.170:34796) 2024-01-25T14:53:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.673+0000 7f3ec3fff700 1 -- 172.21.15.170:0/1048805886 learned_addr learned my addr 172.21.15.170:0/1048805886 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.673+0000 7f3ec3fff700 1 -- 172.21.15.170:0/1048805886 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb40095f0 con 0x7f3ec4100300 2024-01-25T14:53:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.673+0000 7f3ec3fff700 1 --2- 172.21.15.170:0/1048805886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec4100300 0x7f3ec4101da0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4004f40 tx=0x7f3eb4005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.673+0000 7f3ec17fa700 1 -- 172.21.15.170:0/1048805886 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3eb401d070 con 0x7f3ec4100300 2024-01-25T14:53:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.673+0000 7f3ec17fa700 1 -- 172.21.15.170:0/1048805886 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3eb400bc10 con 0x7f3ec4100300 2024-01-25T14:53:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.673+0000 7f3eca4f1700 1 -- 172.21.15.170:0/1048805886 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec41022e0 con 0x7f3ec4100300 2024-01-25T14:53:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.673+0000 7f3ec17fa700 1 -- 172.21.15.170:0/1048805886 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3eb40037d0 con 0x7f3ec4100300 2024-01-25T14:53:30.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.673+0000 7f3eca4f1700 1 -- 172.21.15.170:0/1048805886 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec4102700 con 0x7f3ec4100300 2024-01-25T14:53:30.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.674+0000 7f3ec17fa700 1 -- 172.21.15.170:0/1048805886 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7f3eb400b6f0 con 0x7f3ec4100300 2024-01-25T14:53:30.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.674+0000 7f3ec17fa700 1 --2- 172.21.15.170:0/1048805886 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3eac038b40 0x7f3eac03b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:30.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.674+0000 7f3eca4f1700 1 -- 172.21.15.170:0/1048805886 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec4062e10 con 0x7f3ec4100300 2024-01-25T14:53:30.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.675+0000 7f3ec17fa700 1 -- 172.21.15.170:0/1048805886 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3eb404c760 con 0x7f3ec4100300 2024-01-25T14:53:30.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.675+0000 7f3ec37fe700 1 --2- 172.21.15.170:0/1048805886 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3eac038b40 0x7f3eac03b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:30.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.675+0000 7f3ec37fe700 1 --2- 172.21.15.170:0/1048805886 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3eac038b40 0x7f3eac03b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8006fd0 tx=0x7f3eb8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:30.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.679+0000 7f3ec17fa700 1 -- 172.21.15.170:0/1048805886 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f3eb4029360 con 0x7f3ec4100300 2024-01-25T14:53:30.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.878+0000 7f3eca4f1700 1 -- 172.21.15.170:0/1048805886 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ec410a500 con 0x7f3eac038b40 2024-01-25T14:53:30.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.879+0000 7f3ec17fa700 1 -- 172.21.15.170:0/1048805886 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+241 (secure 0 0 0) 0x7f3ec410a500 con 0x7f3eac038b40 2024-01-25T14:53:30.879 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:53:30.880 INFO:teuthology.orchestra.run.smithi170.stdout:[{"addr": "172.21.15.170", "hostname": "smithi170", "labels": [], "status": ""}, {"addr": "172.21.15.186", "hostname": "smithi186", "labels": [], "status": ""}, {"addr": "172.21.15.191", "hostname": "smithi191", "labels": [], "status": ""}] 2024-01-25T14:53:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.881+0000 7f3eca4f1700 1 -- 172.21.15.170:0/1048805886 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3eac038b40 msgr2=0x7f3eac03b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.881+0000 7f3eca4f1700 1 --2- 172.21.15.170:0/1048805886 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3eac038b40 0x7f3eac03b000 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8006fd0 tx=0x7f3eb8006e40 comp rx=0 tx=0).stop 2024-01-25T14:53:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.881+0000 7f3eca4f1700 1 -- 172.21.15.170:0/1048805886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec4100300 msgr2=0x7f3ec4101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.881+0000 7f3eca4f1700 1 --2- 172.21.15.170:0/1048805886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec4100300 0x7f3ec4101da0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4004f40 tx=0x7f3eb4005020 comp rx=0 tx=0).stop 2024-01-25T14:53:30.882 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.881+0000 7f3eca4f1700 1 -- 172.21.15.170:0/1048805886 shutdown_connections 2024-01-25T14:53:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.881+0000 7f3eca4f1700 1 --2- 172.21.15.170:0/1048805886 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3eac038b40 0x7f3eac03b000 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.881+0000 7f3eca4f1700 1 --2- 172.21.15.170:0/1048805886 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ec4100300 0x7f3ec4101da0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.881+0000 7f3eca4f1700 1 -- 172.21.15.170:0/1048805886 >> 172.21.15.170:0/1048805886 conn(0x7f3ec40fbb90 msgr2=0x7f3ec4069650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.881+0000 7f3eca4f1700 1 -- 172.21.15.170:0/1048805886 shutdown_connections 2024-01-25T14:53:30.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:30.881+0000 7f3eca4f1700 1 -- 172.21.15.170:0/1048805886 wait complete. 2024-01-25T14:53:31.469 INFO:tasks.cephadm:Setting crush tunables to default 2024-01-25T14:53:31.470 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd crush tunables default 2024-01-25T14:53:31.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:31 smithi170 ceph-mon[31899]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:31.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:31 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:31.704 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:53:32.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:32 smithi170 ceph-mon[31899]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T14:53:33.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.275+0000 7f05e7a42700 1 -- 172.21.15.170:0/3355199799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0101400 msgr2=0x7f05e01017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:33.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.275+0000 7f05e7a42700 1 --2- 172.21.15.170:0/3355199799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0101400 0x7f05e01017e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f05d0009910 tx=0x7f05d0009c20 comp rx=0 tx=0).stop 2024-01-25T14:53:33.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.275+0000 7f05e7a42700 1 -- 172.21.15.170:0/3355199799 shutdown_connections 2024-01-25T14:53:33.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.275+0000 7f05e7a42700 1 --2- 172.21.15.170:0/3355199799 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0101400 0x7f05e01017e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:33.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.275+0000 7f05e7a42700 1 -- 172.21.15.170:0/3355199799 >> 172.21.15.170:0/3355199799 conn(0x7f05e00fccb0 msgr2=0x7f05e00ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:33.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.275+0000 7f05e7a42700 1 -- 172.21.15.170:0/3355199799 shutdown_connections 2024-01-25T14:53:33.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.275+0000 7f05e7a42700 1 -- 172.21.15.170:0/3355199799 wait complete. 2024-01-25T14:53:33.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.276+0000 7f05e7a42700 1 Processor -- start 2024-01-25T14:53:33.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.276+0000 7f05e7a42700 1 -- start start 2024-01-25T14:53:33.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.276+0000 7f05e7a42700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0101400 0x7f05e019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:33.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.276+0000 7f05e7a42700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e019cc10 con 0x7f05e0101400 2024-01-25T14:53:33.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.276+0000 7f05e57de700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0101400 0x7f05e019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:33.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.276+0000 7f05e57de700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0101400 0x7f05e019c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:34814/0 (socket says 172.21.15.170:34814) 2024-01-25T14:53:33.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.276+0000 7f05e57de700 1 -- 172.21.15.170:0/1756697236 learned_addr learned my addr 172.21.15.170:0/1756697236 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:33.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.276+0000 7f05e57de700 1 -- 172.21.15.170:0/1756697236 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d00095f0 con 0x7f05e0101400 2024-01-25T14:53:33.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.276+0000 7f05e57de700 1 --2- 172.21.15.170:0/1756697236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0101400 0x7f05e019c6d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f05d0006010 tx=0x7f05d0004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:33.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.277+0000 7f05d67fc700 1 -- 172.21.15.170:0/1756697236 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05d001d070 con 0x7f05e0101400 2024-01-25T14:53:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.277+0000 7f05d67fc700 1 -- 172.21.15.170:0/1756697236 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05d000bc10 con 0x7f05e0101400 2024-01-25T14:53:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.277+0000 7f05e7a42700 1 -- 172.21.15.170:0/1756697236 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e019ce10 con 0x7f05e0101400 2024-01-25T14:53:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.277+0000 7f05d67fc700 1 -- 172.21.15.170:0/1756697236 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05d00038a0 con 0x7f05e0101400 2024-01-25T14:53:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.277+0000 7f05e7a42700 1 -- 172.21.15.170:0/1756697236 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e019d230 con 0x7f05e0101400 2024-01-25T14:53:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.277+0000 7f05d67fc700 1 -- 172.21.15.170:0/1756697236 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7f05d0003ad0 con 0x7f05e0101400 2024-01-25T14:53:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.278+0000 7f05d67fc700 1 --2- 172.21.15.170:0/1756697236 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f05cc038ae0 0x7f05cc03afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.278+0000 7f05d67fc700 1 -- 172.21.15.170:0/1756697236 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f05d004c860 con 0x7f05e0101400 2024-01-25T14:53:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.278+0000 7f05e7a42700 1 -- 172.21.15.170:0/1756697236 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e0062e10 con 0x7f05e0101400 2024-01-25T14:53:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.278+0000 7f05e4fdd700 1 --2- 172.21.15.170:0/1756697236 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f05cc038ae0 0x7f05cc03afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:33.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.278+0000 7f05e4fdd700 1 --2- 172.21.15.170:0/1756697236 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f05cc038ae0 0x7f05cc03afa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f05dc006fd0 tx=0x7f05dc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:33.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.283+0000 7f05d67fc700 1 -- 172.21.15.170:0/1756697236 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f05d0026080 con 0x7f05e0101400 2024-01-25T14:53:33.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:33 smithi170 ceph-mon[31899]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:33.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:33.480+0000 7f05e7a42700 1 -- 172.21.15.170:0/1756697236 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f05e010b4f0 con 0x7f05e0101400 2024-01-25T14:53:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:34.273+0000 7f05d67fc700 1 -- 172.21.15.170:0/1756697236 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f05d002b440 con 0x7f05e0101400 2024-01-25T14:53:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:34.276+0000 7f05e7a42700 1 -- 172.21.15.170:0/1756697236 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f05cc038ae0 msgr2=0x7f05cc03afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:34.276+0000 7f05e7a42700 1 --2- 172.21.15.170:0/1756697236 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f05cc038ae0 0x7f05cc03afa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f05dc006fd0 tx=0x7f05dc006e40 comp rx=0 tx=0).stop 2024-01-25T14:53:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:34.276+0000 7f05e7a42700 1 -- 172.21.15.170:0/1756697236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0101400 msgr2=0x7f05e019c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:34.276+0000 7f05e7a42700 1 --2- 172.21.15.170:0/1756697236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0101400 0x7f05e019c6d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f05d0006010 tx=0x7f05d0004ff0 comp rx=0 tx=0).stop 2024-01-25T14:53:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:34.276+0000 7f05e7a42700 1 -- 172.21.15.170:0/1756697236 shutdown_connections 2024-01-25T14:53:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:34.276+0000 7f05e7a42700 1 --2- 172.21.15.170:0/1756697236 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f05cc038ae0 0x7f05cc03afa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:34.276+0000 7f05e7a42700 1 --2- 172.21.15.170:0/1756697236 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05e0101400 0x7f05e019c6d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:34.276+0000 7f05e7a42700 1 -- 172.21.15.170:0/1756697236 >> 172.21.15.170:0/1756697236 conn(0x7f05e00fccb0 msgr2=0x7f05e0102dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:34.276+0000 7f05e7a42700 1 -- 172.21.15.170:0/1756697236 shutdown_connections 2024-01-25T14:53:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:34.276+0000 7f05e7a42700 1 -- 172.21.15.170:0/1756697236 wait complete. 2024-01-25T14:53:34.278 INFO:teuthology.orchestra.run.smithi170.stderr:adjusted tunables profile to default 2024-01-25T14:53:34.603 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:34 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1756697236' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-01-25T14:53:34.603 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:34.603 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:34.603 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:34.603 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:34.603 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:53:34.603 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:34.603 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:53:34.991 INFO:tasks.cephadm:Adding mon.a on smithi170 2024-01-25T14:53:34.991 INFO:tasks.cephadm:Adding mon.b on smithi186 2024-01-25T14:53:34.991 INFO:tasks.cephadm:Adding mon.c on smithi191 2024-01-25T14:53:34.992 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch apply mon '3;smithi170:172.21.15.170=a;smithi186:172.21.15.186=b;smithi191:172.21.15.191=c' 2024-01-25T14:53:35.219 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:35 smithi170 ceph-mon[31899]: Updating smithi191:/etc/ceph/ceph.conf 2024-01-25T14:53:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:35 smithi170 ceph-mon[31899]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:35 smithi170 ceph-mon[31899]: Updating smithi191:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:35 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1756697236' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-01-25T14:53:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:35 smithi170 ceph-mon[31899]: osdmap e4: 0 total, 0 up, 0 in 2024-01-25T14:53:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:36.495 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.493+0000 7f4ee2a6f700 1 -- 172.21.15.191:0/3585834563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4edc100300 msgr2=0x7f4edc1006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:36.495 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.493+0000 7f4ee2a6f700 1 --2- 172.21.15.191:0/3585834563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4edc100300 0x7f4edc1006e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0009910 tx=0x7f4ed0009c20 comp rx=0 tx=0).stop 2024-01-25T14:53:36.495 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.493+0000 7f4ee2a6f700 1 -- 172.21.15.191:0/3585834563 shutdown_connections 2024-01-25T14:53:36.495 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.493+0000 7f4ee2a6f700 1 --2- 172.21.15.191:0/3585834563 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4edc100300 0x7f4edc1006e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:36.495 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.493+0000 7f4ee2a6f700 1 -- 172.21.15.191:0/3585834563 >> 172.21.15.191:0/3585834563 conn(0x7f4edc0fbb90 msgr2=0x7f4edc0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:36.495 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.493+0000 7f4ee2a6f700 1 -- 172.21.15.191:0/3585834563 shutdown_connections 2024-01-25T14:53:36.495 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.493+0000 7f4ee2a6f700 1 -- 172.21.15.191:0/3585834563 wait complete. 2024-01-25T14:53:36.495 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.494+0000 7f4ee2a6f700 1 Processor -- start 2024-01-25T14:53:36.495 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.494+0000 7f4ee2a6f700 1 -- start start 2024-01-25T14:53:36.495 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.494+0000 7f4ee2a6f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4edc100300 0x7f4edc101da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:36.495 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.494+0000 7f4ee2a6f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc103c40 con 0x7f4edc100300 2024-01-25T14:53:36.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.494+0000 7f4ee080b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4edc100300 0x7f4edc101da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:36.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.494+0000 7f4ee080b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4edc100300 0x7f4edc101da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.191:51356/0 (socket says 172.21.15.191:51356) 2024-01-25T14:53:36.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.494+0000 7f4ee080b700 1 -- 172.21.15.191:0/2332475326 learned_addr learned my addr 172.21.15.191:0/2332475326 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-01-25T14:53:36.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.495+0000 7f4ee080b700 1 -- 172.21.15.191:0/2332475326 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed00095f0 con 0x7f4edc100300 2024-01-25T14:53:36.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.495+0000 7f4ee080b700 1 --2- 172.21.15.191:0/2332475326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4edc100300 0x7f4edc101da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0004f40 tx=0x7f4ed0005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:36.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.495+0000 7f4ed9ffb700 1 -- 172.21.15.191:0/2332475326 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ed001d070 con 0x7f4edc100300 2024-01-25T14:53:36.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.495+0000 7f4ee2a6f700 1 -- 172.21.15.191:0/2332475326 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc1022e0 con 0x7f4edc100300 2024-01-25T14:53:36.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.495+0000 7f4ed9ffb700 1 -- 172.21.15.191:0/2332475326 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ed000bc10 con 0x7f4edc100300 2024-01-25T14:53:36.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.495+0000 7f4ed9ffb700 1 -- 172.21.15.191:0/2332475326 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ed00037d0 con 0x7f4edc100300 2024-01-25T14:53:36.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.495+0000 7f4ee2a6f700 1 -- 172.21.15.191:0/2332475326 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4edc102700 con 0x7f4edc100300 2024-01-25T14:53:36.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.496+0000 7f4ee2a6f700 1 -- 172.21.15.191:0/2332475326 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4edc062e10 con 0x7f4edc100300 2024-01-25T14:53:36.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.496+0000 7f4ed9ffb700 1 -- 172.21.15.191:0/2332475326 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7f4ed000b6f0 con 0x7f4edc100300 2024-01-25T14:53:36.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.496+0000 7f4ed9ffb700 1 --2- 172.21.15.191:0/2332475326 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4ecc038b40 0x7f4ecc03b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:36.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.496+0000 7f4ed9ffb700 1 -- 172.21.15.191:0/2332475326 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4ed004c7e0 con 0x7f4edc100300 2024-01-25T14:53:36.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.497+0000 7f4edbfff700 1 --2- 172.21.15.191:0/2332475326 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4ecc038b40 0x7f4ecc03b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:36.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.497+0000 7f4edbfff700 1 --2- 172.21.15.191:0/2332475326 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4ecc038b40 0x7f4ecc03b000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8006fd0 tx=0x7f4ec8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:36.502 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.502+0000 7f4ed9ffb700 1 -- 172.21.15.191:0/2332475326 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f4ed0004440 con 0x7f4edc100300 2024-01-25T14:53:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:36 smithi170 ceph-mon[31899]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-01-25T14:53:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:36 smithi170 ceph-mon[31899]: Updating smithi191:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.client.admin.keyring 2024-01-25T14:53:36.704 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.703+0000 7f4ee2a6f700 1 -- 172.21.15.191:0/2332475326 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi170:172.21.15.170=a;smithi186:172.21.15.186=b;smithi191:172.21.15.191=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f4edc10a500 con 0x7f4ecc038b40 2024-01-25T14:53:36.710 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.709+0000 7f4ed9ffb700 1 -- 172.21.15.191:0/2332475326 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4edc10a500 con 0x7f4ecc038b40 2024-01-25T14:53:36.710 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mon update... 2024-01-25T14:53:36.712 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.711+0000 7f4ee2a6f700 1 -- 172.21.15.191:0/2332475326 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4ecc038b40 msgr2=0x7f4ecc03b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:36.712 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.711+0000 7f4ee2a6f700 1 --2- 172.21.15.191:0/2332475326 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4ecc038b40 0x7f4ecc03b000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8006fd0 tx=0x7f4ec8006e40 comp rx=0 tx=0).stop 2024-01-25T14:53:36.712 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.711+0000 7f4ee2a6f700 1 -- 172.21.15.191:0/2332475326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4edc100300 msgr2=0x7f4edc101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:36.713 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.711+0000 7f4ee2a6f700 1 --2- 172.21.15.191:0/2332475326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4edc100300 0x7f4edc101da0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0004f40 tx=0x7f4ed0005020 comp rx=0 tx=0).stop 2024-01-25T14:53:36.713 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.711+0000 7f4ee2a6f700 1 -- 172.21.15.191:0/2332475326 shutdown_connections 2024-01-25T14:53:36.713 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.711+0000 7f4ee2a6f700 1 --2- 172.21.15.191:0/2332475326 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4ecc038b40 0x7f4ecc03b000 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:36.713 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.711+0000 7f4ee2a6f700 1 --2- 172.21.15.191:0/2332475326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4edc100300 0x7f4edc101da0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:36.713 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.711+0000 7f4ee2a6f700 1 -- 172.21.15.191:0/2332475326 >> 172.21.15.191:0/2332475326 conn(0x7f4edc0fbb90 msgr2=0x7f4edc069610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:36.713 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.712+0000 7f4ee2a6f700 1 -- 172.21.15.191:0/2332475326 shutdown_connections 2024-01-25T14:53:36.713 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:36.712+0000 7f4ee2a6f700 1 -- 172.21.15.191:0/2332475326 wait complete. 2024-01-25T14:53:37.292 DEBUG:teuthology.orchestra.run.smithi186:mon.b> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mon.b.service 2024-01-25T14:53:37.295 DEBUG:teuthology.orchestra.run.smithi191:mon.c> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mon.c.service 2024-01-25T14:53:37.297 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-01-25T14:53:37.298 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph mon dump -f json 2024-01-25T14:53:37.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:37 smithi170 ceph-mon[31899]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:37.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:37 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:37.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:37 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:53:37.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:37 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:37.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:37 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:53:37.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:37 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:37.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:37 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-25T14:53:37.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:37 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:38.089 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:38.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:38 smithi170 ceph-mon[31899]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi170:172.21.15.170=a;smithi186:172.21.15.186=b;smithi191:172.21.15.191=c", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:53:38.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:38 smithi170 ceph-mon[31899]: Saving service mon spec with placement smithi170:172.21.15.170=a;smithi186:172.21.15.186=b;smithi191:172.21.15.191=c;count:3 2024-01-25T14:53:38.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:38 smithi170 ceph-mon[31899]: Deploying daemon mon.c on smithi191 2024-01-25T14:53:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:39 smithi170 ceph-mon[31899]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:40.923 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.921+0000 7f6714b22700 1 -- 172.21.15.191:0/3055822159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6710100300 msgr2=0x7f67101006e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:40.924 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.921+0000 7f6714b22700 1 --2- 172.21.15.191:0/3055822159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6710100300 0x7f67101006e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6700009910 tx=0x7f6700009c20 comp rx=0 tx=0).stop 2024-01-25T14:53:40.924 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.921+0000 7f6714b22700 1 -- 172.21.15.191:0/3055822159 shutdown_connections 2024-01-25T14:53:40.924 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.921+0000 7f6714b22700 1 --2- 172.21.15.191:0/3055822159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6710100300 0x7f67101006e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:40.924 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.921+0000 7f6714b22700 1 -- 172.21.15.191:0/3055822159 >> 172.21.15.191:0/3055822159 conn(0x7f67100fbbd0 msgr2=0x7f67100fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:40.924 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.922+0000 7f6714b22700 1 -- 172.21.15.191:0/3055822159 shutdown_connections 2024-01-25T14:53:40.924 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.922+0000 7f6714b22700 1 -- 172.21.15.191:0/3055822159 wait complete. 2024-01-25T14:53:40.925 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.923+0000 7f6714b22700 1 Processor -- start 2024-01-25T14:53:40.925 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.923+0000 7f6714b22700 1 -- start start 2024-01-25T14:53:40.925 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.924+0000 7f6714b22700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6710100300 0x7f671019b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:40.925 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.924+0000 7f6714b22700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671019bbe0 con 0x7f6710100300 2024-01-25T14:53:40.926 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.924+0000 7f670e59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6710100300 0x7f671019b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:40.926 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.924+0000 7f670e59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6710100300 0x7f671019b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.191:51376/0 (socket says 172.21.15.191:51376) 2024-01-25T14:53:40.927 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.924+0000 7f670e59c700 1 -- 172.21.15.191:0/2001952775 learned_addr learned my addr 172.21.15.191:0/2001952775 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-01-25T14:53:40.927 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.925+0000 7f670e59c700 1 -- 172.21.15.191:0/2001952775 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67000095f0 con 0x7f6710100300 2024-01-25T14:53:40.927 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.925+0000 7f670e59c700 1 --2- 172.21.15.191:0/2001952775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6710100300 0x7f671019b6a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6700006010 tx=0x7f6700004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:40.928 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.928+0000 7f66ff7fe700 1 -- 172.21.15.191:0/2001952775 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f670001d070 con 0x7f6710100300 2024-01-25T14:53:40.928 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.928+0000 7f66ff7fe700 1 -- 172.21.15.191:0/2001952775 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f670000bc10 con 0x7f6710100300 2024-01-25T14:53:40.928 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.928+0000 7f66ff7fe700 1 -- 172.21.15.191:0/2001952775 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f67000038a0 con 0x7f6710100300 2024-01-25T14:53:40.930 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.930+0000 7f6714b22700 1 -- 172.21.15.191:0/2001952775 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671019bde0 con 0x7f6710100300 2024-01-25T14:53:40.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.930+0000 7f6714b22700 1 -- 172.21.15.191:0/2001952775 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67101957c0 con 0x7f6710100300 2024-01-25T14:53:40.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.931+0000 7f6714b22700 1 -- 172.21.15.191:0/2001952775 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671019c200 con 0x7f6710100300 2024-01-25T14:53:40.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.931+0000 7f66ff7fe700 1 -- 172.21.15.191:0/2001952775 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7f670000bd80 con 0x7f6710100300 2024-01-25T14:53:40.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.931+0000 7f66ff7fe700 1 --2- 172.21.15.191:0/2001952775 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f66f8038b90 0x7f66f803b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:40.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.931+0000 7f66ff7fe700 1 -- 172.21.15.191:0/2001952775 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f670004c3f0 con 0x7f6710100300 2024-01-25T14:53:40.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.932+0000 7f670dd9b700 1 --2- 172.21.15.191:0/2001952775 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f66f8038b90 0x7f66f803b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:40.933 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.932+0000 7f670dd9b700 1 --2- 172.21.15.191:0/2001952775 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f66f8038b90 0x7f66f803b050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6704006fd0 tx=0x7f6704006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:40.938 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:40.937+0000 7f66ff7fe700 1 -- 172.21.15.191:0/2001952775 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f670000ba70 con 0x7f6710100300 2024-01-25T14:53:41.240 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:41.239+0000 7f6714b22700 1 -- 172.21.15.191:0/2001952775 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f67101017e0 con 0x7f6710100300 2024-01-25T14:53:41.240 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:41.239+0000 7f66ff7fe700 1 -- 172.21.15.191:0/2001952775 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+749 (secure 0 0 0) 0x7f670000ed30 con 0x7f6710100300 2024-01-25T14:53:41.241 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:53:41.241 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","modified":"2024-01-25T14:51:50.337926Z","created":"2024-01-25T14:51:50.337926Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-01-25T14:53:41.243 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:41.242+0000 7f6714b22700 1 -- 172.21.15.191:0/2001952775 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f66f8038b90 msgr2=0x7f66f803b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:41.243 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:41.242+0000 7f6714b22700 1 --2- 172.21.15.191:0/2001952775 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f66f8038b90 0x7f66f803b050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6704006fd0 tx=0x7f6704006e40 comp rx=0 tx=0).stop 2024-01-25T14:53:41.243 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:41.242+0000 7f6714b22700 1 -- 172.21.15.191:0/2001952775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6710100300 msgr2=0x7f671019b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:41.243 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:41.242+0000 7f6714b22700 1 --2- 172.21.15.191:0/2001952775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6710100300 0x7f671019b6a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6700006010 tx=0x7f6700004ff0 comp rx=0 tx=0).stop 2024-01-25T14:53:41.243 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:41.242+0000 7f6714b22700 1 -- 172.21.15.191:0/2001952775 shutdown_connections 2024-01-25T14:53:41.243 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:41.242+0000 7f6714b22700 1 --2- 172.21.15.191:0/2001952775 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f66f8038b90 0x7f66f803b050 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:41.243 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:41.242+0000 7f6714b22700 1 --2- 172.21.15.191:0/2001952775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6710100300 0x7f671019b6a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:41.243 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:41.242+0000 7f6714b22700 1 -- 172.21.15.191:0/2001952775 >> 172.21.15.191:0/2001952775 conn(0x7f67100fbbd0 msgr2=0x7f6710101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:41.244 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:41.242+0000 7f6714b22700 1 -- 172.21.15.191:0/2001952775 shutdown_connections 2024-01-25T14:53:41.244 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:41.242+0000 7f6714b22700 1 -- 172.21.15.191:0/2001952775 wait complete. 2024-01-25T14:53:41.244 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2024-01-25T14:53:41.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:41 smithi170 ceph-mon[31899]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:41.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:41 smithi170 ceph-mon[31899]: from='client.? 172.21.15.191:0/2001952775' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-25T14:53:41.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:41 smithi191 systemd[1]: Starting Ceph mon.c for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T14:53:42.308 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 podman[36329]: 2024-01-25 14:53:42.098778244 +0000 UTC m=+0.017251927 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T14:53:42.308 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 podman[36329]: 2024-01-25 14:53:42.202375474 +0000 UTC m=+0.120849132 container create 64aefc2b8f6c2bda8ab34db7de3294a51e23f46482be24d9d20d7e35d7c58499 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.31.3) 2024-01-25T14:53:42.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 podman[36329]: 2024-01-25 14:53:42.413595351 +0000 UTC m=+0.332069014 container init 64aefc2b8f6c2bda8ab34db7de3294a51e23f46482be24d9d20d7e35d7c58499 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-c, GIT_CLEAN=True, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T14:53:42.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 podman[36329]: 2024-01-25 14:53:42.41650616 +0000 UTC m=+0.334979818 container start 64aefc2b8f6c2bda8ab34db7de3294a51e23f46482be24d9d20d7e35d7c58499 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-c, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-25T14:53:42.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: set uid:gid to 167:167 (ceph:ceph) 2024-01-25T14:53:42.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: ceph version 19.0.0-885-g661946e7 (661946e7044723130c03627323f6a879a9848cb5) squid (dev), process ceph-mon, pid 2 2024-01-25T14:53:42.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: pidfile_write: ignore empty --pid-file 2024-01-25T14:53:42.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: load: jerasure load: lrc 2024-01-25T14:53:42.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: RocksDB version: 7.9.2 2024-01-25T14:53:42.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Git sha 0 2024-01-25T14:53:42.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Compile date 2024-01-25 05:03:27 2024-01-25T14:53:42.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: DB SUMMARY 2024-01-25T14:53:42.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: DB Session ID: N6A7B6N3OOJUHIMO6ET7 2024-01-25T14:53:42.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: CURRENT file: CURRENT 2024-01-25T14:53:42.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: IDENTITY file: IDENTITY 2024-01-25T14:53:42.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-01-25T14:53:42.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-01-25T14:53:42.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-01-25T14:53:42.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.error_if_exists: 0 2024-01-25T14:53:42.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.create_if_missing: 0 2024-01-25T14:53:42.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.paranoid_checks: 1 2024-01-25T14:53:42.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.flush_verify_memtable_count: 1 2024-01-25T14:53:42.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-01-25T14:53:42.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-01-25T14:53:42.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.env: 0x55af1a4aeae0 2024-01-25T14:53:42.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.fs: PosixFileSystem 2024-01-25T14:53:42.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.info_log: 0x55af1c41b780 2024-01-25T14:53:42.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_file_opening_threads: 16 2024-01-25T14:53:42.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.statistics: (nil) 2024-01-25T14:53:42.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.use_fsync: 0 2024-01-25T14:53:42.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_log_file_size: 0 2024-01-25T14:53:42.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-01-25T14:53:42.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.log_file_time_to_roll: 0 2024-01-25T14:53:42.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.keep_log_file_num: 1000 2024-01-25T14:53:42.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.recycle_log_file_num: 0 2024-01-25T14:53:42.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.allow_fallocate: 1 2024-01-25T14:53:42.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.allow_mmap_reads: 0 2024-01-25T14:53:42.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.allow_mmap_writes: 0 2024-01-25T14:53:42.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.use_direct_reads: 0 2024-01-25T14:53:42.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-01-25T14:53:42.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.create_missing_column_families: 0 2024-01-25T14:53:42.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.db_log_dir: 2024-01-25T14:53:42.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.wal_dir: 2024-01-25T14:53:42.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.table_cache_numshardbits: 6 2024-01-25T14:53:42.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.WAL_ttl_seconds: 0 2024-01-25T14:53:42.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.WAL_size_limit_MB: 0 2024-01-25T14:53:42.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-01-25T14:53:42.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-01-25T14:53:42.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.is_fd_close_on_exec: 1 2024-01-25T14:53:42.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.advise_random_on_open: 1 2024-01-25T14:53:42.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.db_write_buffer_size: 0 2024-01-25T14:53:42.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.write_buffer_manager: 0x55af1c3ef400 2024-01-25T14:53:42.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-01-25T14:53:42.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-01-25T14:53:42.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.use_adaptive_mutex: 0 2024-01-25T14:53:42.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.rate_limiter: (nil) 2024-01-25T14:53:42.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-01-25T14:53:42.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.wal_recovery_mode: 2 2024-01-25T14:53:42.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.enable_thread_tracking: 0 2024-01-25T14:53:42.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.enable_pipelined_write: 0 2024-01-25T14:53:42.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.unordered_write: 0 2024-01-25T14:53:42.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-01-25T14:53:42.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-01-25T14:53:42.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-01-25T14:53:42.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-01-25T14:53:42.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.row_cache: None 2024-01-25T14:53:42.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.wal_filter: None 2024-01-25T14:53:42.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-01-25T14:53:42.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.allow_ingest_behind: 0 2024-01-25T14:53:42.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.two_write_queues: 0 2024-01-25T14:53:42.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.manual_wal_flush: 0 2024-01-25T14:53:42.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.wal_compression: 0 2024-01-25T14:53:42.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.atomic_flush: 0 2024-01-25T14:53:42.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-01-25T14:53:42.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.persist_stats_to_disk: 0 2024-01-25T14:53:42.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.write_dbid_to_manifest: 0 2024-01-25T14:53:42.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.log_readahead_size: 0 2024-01-25T14:53:42.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-01-25T14:53:42.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.best_efforts_recovery: 0 2024-01-25T14:53:42.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-01-25T14:53:42.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-01-25T14:53:42.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.allow_data_in_errors: 0 2024-01-25T14:53:42.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.db_host_id: __hostname__ 2024-01-25T14:53:42.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.enforce_single_del_contracts: true 2024-01-25T14:53:42.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_background_jobs: 2 2024-01-25T14:53:42.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_background_compactions: -1 2024-01-25T14:53:42.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_subcompactions: 1 2024-01-25T14:53:42.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-01-25T14:53:42.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-01-25T14:53:42.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.delayed_write_rate : 16777216 2024-01-25T14:53:42.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_total_wal_size: 0 2024-01-25T14:53:42.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-01-25T14:53:42.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.stats_dump_period_sec: 600 2024-01-25T14:53:42.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.stats_persist_period_sec: 600 2024-01-25T14:53:42.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-01-25T14:53:42.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_open_files: -1 2024-01-25T14:53:42.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.bytes_per_sync: 0 2024-01-25T14:53:42.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.wal_bytes_per_sync: 0 2024-01-25T14:53:42.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.strict_bytes_per_sync: 0 2024-01-25T14:53:42.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compaction_readahead_size: 0 2024-01-25T14:53:42.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_background_flushes: -1 2024-01-25T14:53:42.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Compression algorithms supported: 2024-01-25T14:53:42.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-01-25T14:53:42.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: kZSTD supported: 0 2024-01-25T14:53:42.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: kXpressCompression supported: 0 2024-01-25T14:53:42.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: kLZ4HCCompression supported: 1 2024-01-25T14:53:42.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: kZlibCompression supported: 1 2024-01-25T14:53:42.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: kSnappyCompression supported: 1 2024-01-25T14:53:42.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: kLZ4Compression supported: 1 2024-01-25T14:53:42.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: kBZip2Compression supported: 0 2024-01-25T14:53:42.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Fast CRC32 supported: Supported on x86 2024-01-25T14:53:42.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: DMutex implementation: pthread_mutex_t 2024-01-25T14:53:42.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-01-25T14:53:42.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-01-25T14:53:42.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-01-25T14:53:42.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.merge_operator: 2024-01-25T14:53:42.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compaction_filter: None 2024-01-25T14:53:42.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compaction_filter_factory: None 2024-01-25T14:53:42.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.sst_partitioner_factory: None 2024-01-25T14:53:42.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.memtable_factory: SkipListFactory 2024-01-25T14:53:42.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.table_factory: BlockBasedTable 2024-01-25T14:53:42.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55af1c41b8a0) 2024-01-25T14:53:42.745 INFO:journalctl@ceph.mon.c.smithi191.stdout: cache_index_and_filter_blocks: 1 2024-01-25T14:53:42.745 INFO:journalctl@ceph.mon.c.smithi191.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-01-25T14:53:42.745 INFO:journalctl@ceph.mon.c.smithi191.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-01-25T14:53:42.745 INFO:journalctl@ceph.mon.c.smithi191.stdout: pin_top_level_index_and_filter: 1 2024-01-25T14:53:42.745 INFO:journalctl@ceph.mon.c.smithi191.stdout: index_type: 0 2024-01-25T14:53:42.745 INFO:journalctl@ceph.mon.c.smithi191.stdout: data_block_index_type: 0 2024-01-25T14:53:42.745 INFO:journalctl@ceph.mon.c.smithi191.stdout: index_shortening: 1 2024-01-25T14:53:42.745 INFO:journalctl@ceph.mon.c.smithi191.stdout: data_block_hash_table_util_ratio: 0.750000 2024-01-25T14:53:42.745 INFO:journalctl@ceph.mon.c.smithi191.stdout: checksum: 4 2024-01-25T14:53:42.745 INFO:journalctl@ceph.mon.c.smithi191.stdout: no_block_cache: 0 2024-01-25T14:53:42.745 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_cache: 0x55af1c41f090 2024-01-25T14:53:42.745 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_cache_name: BinnedLRUCache 2024-01-25T14:53:42.745 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_cache_options: 2024-01-25T14:53:42.745 INFO:journalctl@ceph.mon.c.smithi191.stdout: capacity : 536870912 2024-01-25T14:53:42.745 INFO:journalctl@ceph.mon.c.smithi191.stdout: num_shard_bits : 4 2024-01-25T14:53:42.746 INFO:journalctl@ceph.mon.c.smithi191.stdout: strict_capacity_limit : 0 2024-01-25T14:53:42.746 INFO:journalctl@ceph.mon.c.smithi191.stdout: high_pri_pool_ratio: 0.000 2024-01-25T14:53:42.746 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_cache_compressed: (nil) 2024-01-25T14:53:42.746 INFO:journalctl@ceph.mon.c.smithi191.stdout: persistent_cache: (nil) 2024-01-25T14:53:42.746 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_size: 4096 2024-01-25T14:53:42.746 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_size_deviation: 10 2024-01-25T14:53:42.746 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_restart_interval: 16 2024-01-25T14:53:42.746 INFO:journalctl@ceph.mon.c.smithi191.stdout: index_block_restart_interval: 1 2024-01-25T14:53:42.746 INFO:journalctl@ceph.mon.c.smithi191.stdout: metadata_block_size: 4096 2024-01-25T14:53:42.746 INFO:journalctl@ceph.mon.c.smithi191.stdout: partition_filters: 0 2024-01-25T14:53:42.746 INFO:journalctl@ceph.mon.c.smithi191.stdout: use_delta_encoding: 1 2024-01-25T14:53:42.746 INFO:journalctl@ceph.mon.c.smithi191.stdout: filter_policy: bloomfilter 2024-01-25T14:53:42.746 INFO:journalctl@ceph.mon.c.smithi191.stdout: whole_key_filtering: 1 2024-01-25T14:53:42.746 INFO:journalctl@ceph.mon.c.smithi191.stdout: verify_compression: 0 2024-01-25T14:53:42.746 INFO:journalctl@ceph.mon.c.smithi191.stdout: read_amp_bytes_per_bit: 0 2024-01-25T14:53:42.747 INFO:journalctl@ceph.mon.c.smithi191.stdout: format_version: 5 2024-01-25T14:53:42.747 INFO:journalctl@ceph.mon.c.smithi191.stdout: enable_index_compression: 1 2024-01-25T14:53:42.747 INFO:journalctl@ceph.mon.c.smithi191.stdout: block_align: 0 2024-01-25T14:53:42.747 INFO:journalctl@ceph.mon.c.smithi191.stdout: max_auto_readahead_size: 262144 2024-01-25T14:53:42.747 INFO:journalctl@ceph.mon.c.smithi191.stdout: prepopulate_block_cache: 0 2024-01-25T14:53:42.747 INFO:journalctl@ceph.mon.c.smithi191.stdout: initial_auto_readahead_size: 8192 2024-01-25T14:53:42.747 INFO:journalctl@ceph.mon.c.smithi191.stdout: num_file_reads_for_auto_readahead: 2 2024-01-25T14:53:42.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.write_buffer_size: 33554432 2024-01-25T14:53:42.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_write_buffer_number: 2 2024-01-25T14:53:42.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compression: NoCompression 2024-01-25T14:53:42.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.bottommost_compression: Disabled 2024-01-25T14:53:42.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.prefix_extractor: nullptr 2024-01-25T14:53:42.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-01-25T14:53:42.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.num_levels: 7 2024-01-25T14:53:42.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-01-25T14:53:42.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-01-25T14:53:42.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-01-25T14:53:42.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-01-25T14:53:42.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-01-25T14:53:42.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-01-25T14:53:42.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-01-25T14:53:42.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-01-25T14:53:42.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-01-25T14:53:42.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-01-25T14:53:42.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-01-25T14:53:42.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-01-25T14:53:42.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compression_opts.window_bits: -14 2024-01-25T14:53:42.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compression_opts.level: 32767 2024-01-25T14:53:42.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compression_opts.strategy: 0 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compression_opts.enabled: false 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.target_file_size_base: 67108864 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.target_file_size_multiplier: 1 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-01-25T14:53:42.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-01-25T14:53:42.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-01-25T14:53:42.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-01-25T14:53:42.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-01-25T14:53:42.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-01-25T14:53:42.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-01-25T14:53:42.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-01-25T14:53:42.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-01-25T14:53:42.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-01-25T14:53:42.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.arena_block_size: 1048576 2024-01-25T14:53:42.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-01-25T14:53:42.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-01-25T14:53:42.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.disable_auto_compactions: 0 2024-01-25T14:53:42.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-01-25T14:53:42.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-01-25T14:53:42.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-01-25T14:53:42.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-01-25T14:53:42.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-01-25T14:53:42.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-01-25T14:53:42.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-01-25T14:53:42.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-01-25T14:53:42.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-01-25T14:53:42.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-01-25T14:53:42.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.table_properties_collectors: 2024-01-25T14:53:42.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.inplace_update_support: 0 2024-01-25T14:53:42.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.inplace_update_num_locks: 10000 2024-01-25T14:53:42.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-01-25T14:53:42.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-01-25T14:53:42.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.memtable_huge_page_size: 0 2024-01-25T14:53:42.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.bloom_locality: 0 2024-01-25T14:53:42.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.max_successive_merges: 0 2024-01-25T14:53:42.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.optimize_filters_for_hits: 0 2024-01-25T14:53:42.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.paranoid_file_checks: 0 2024-01-25T14:53:42.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.force_consistency_checks: 1 2024-01-25T14:53:42.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.report_bg_io_stats: 0 2024-01-25T14:53:42.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.ttl: 2592000 2024-01-25T14:53:42.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.periodic_compaction_seconds: 0 2024-01-25T14:53:42.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-01-25T14:53:42.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-01-25T14:53:42.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.enable_blob_files: false 2024-01-25T14:53:42.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.min_blob_size: 0 2024-01-25T14:53:42.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.blob_file_size: 268435456 2024-01-25T14:53:42.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.blob_compression_type: NoCompression 2024-01-25T14:53:42.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.enable_blob_garbage_collection: false 2024-01-25T14:53:42.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-01-25T14:53:42.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-01-25T14:53:42.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-01-25T14:53:42.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.blob_file_starting_level: 0 2024-01-25T14:53:42.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-01-25T14:53:42.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-01-25T14:53:42.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-01-25T14:53:42.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 859d5516-8e53-45cf-9ba3-290fd7c393f8 2024-01-25T14:53:42.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706194422446260, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-01-25T14:53:42.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-01-25T14:53:42.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706194422446842, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1706194422, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "859d5516-8e53-45cf-9ba3-290fd7c393f8", "db_session_id": "N6A7B6N3OOJUHIMO6ET7", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-01-25T14:53:42.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: EVENT_LOG_v1 {"time_micros": 1706194422446963, "job": 1, "event": "recovery_finished"} 2024-01-25T14:53:42.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-01-25T14:53:42.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-01-25T14:53:42.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55af1c50c000 2024-01-25T14:53:42.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: DB pointer 0x55af1c4fa000 2024-01-25T14:53:42.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-01-25T14:53:42.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-01-25T14:53:42.754 INFO:journalctl@ceph.mon.c.smithi191.stdout: ** DB Stats ** 2024-01-25T14:53:42.754 INFO:journalctl@ceph.mon.c.smithi191.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-25T14:53:42.754 INFO:journalctl@ceph.mon.c.smithi191.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-01-25T14:53:42.754 INFO:journalctl@ceph.mon.c.smithi191.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-25T14:53:42.754 INFO:journalctl@ceph.mon.c.smithi191.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-25T14:53:42.754 INFO:journalctl@ceph.mon.c.smithi191.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-01-25T14:53:42.754 INFO:journalctl@ceph.mon.c.smithi191.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-01-25T14:53:42.754 INFO:journalctl@ceph.mon.c.smithi191.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-01-25T14:53:42.754 INFO:journalctl@ceph.mon.c.smithi191.stdout: 2024-01-25T14:53:42.755 INFO:journalctl@ceph.mon.c.smithi191.stdout: ** Compaction Stats [default] ** 2024-01-25T14:53:42.755 INFO:journalctl@ceph.mon.c.smithi191.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-25T14:53:42.755 INFO:journalctl@ceph.mon.c.smithi191.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-01-25T14:53:42.755 INFO:journalctl@ceph.mon.c.smithi191.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-25T14:53:42.755 INFO:journalctl@ceph.mon.c.smithi191.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-25T14:53:42.755 INFO:journalctl@ceph.mon.c.smithi191.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-25T14:53:42.755 INFO:journalctl@ceph.mon.c.smithi191.stdout: 2024-01-25T14:53:42.755 INFO:journalctl@ceph.mon.c.smithi191.stdout: ** Compaction Stats [default] ** 2024-01-25T14:53:42.755 INFO:journalctl@ceph.mon.c.smithi191.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-01-25T14:53:42.755 INFO:journalctl@ceph.mon.c.smithi191.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-01-25T14:53:42.755 INFO:journalctl@ceph.mon.c.smithi191.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-01-25T14:53:42.755 INFO:journalctl@ceph.mon.c.smithi191.stdout: 2024-01-25T14:53:42.755 INFO:journalctl@ceph.mon.c.smithi191.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-01-25T14:53:42.755 INFO:journalctl@ceph.mon.c.smithi191.stdout: 2024-01-25T14:53:42.756 INFO:journalctl@ceph.mon.c.smithi191.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-01-25T14:53:42.756 INFO:journalctl@ceph.mon.c.smithi191.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-01-25T14:53:42.756 INFO:journalctl@ceph.mon.c.smithi191.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-01-25T14:53:42.756 INFO:journalctl@ceph.mon.c.smithi191.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-01-25T14:53:42.756 INFO:journalctl@ceph.mon.c.smithi191.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-01-25T14:53:42.756 INFO:journalctl@ceph.mon.c.smithi191.stdout: AddFile(Keys): cumulative 0, interval 0 2024-01-25T14:53:42.756 INFO:journalctl@ceph.mon.c.smithi191.stdout: Cumulative compaction: 0.00 GB write, 0.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-25T14:53:42.756 INFO:journalctl@ceph.mon.c.smithi191.stdout: Interval compaction: 0.00 GB write, 0.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-01-25T14:53:42.756 INFO:journalctl@ceph.mon.c.smithi191.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-01-25T14:53:42.756 INFO:journalctl@ceph.mon.c.smithi191.stdout: Block cache BinnedLRUCache@0x55af1c41f090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-01-25T14:53:42.756 INFO:journalctl@ceph.mon.c.smithi191.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-01-25T14:53:42.756 INFO:journalctl@ceph.mon.c.smithi191.stdout: 2024-01-25T14:53:42.756 INFO:journalctl@ceph.mon.c.smithi191.stdout: ** File Read Latency Histogram By Level [default] ** 2024-01-25T14:53:42.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-01-25T14:53:42.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: using public_addr v2:172.21.15.191:0/0 -> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] 2024-01-25T14:53:42.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: starting mon.c rank -1 at public addrs [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] at bind addrs [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:53:42.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: mon.c@-1(???) e0 preinit fsid 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:53:42.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: mon.c@-1(synchronizing).mds e1 new map 2024-01-25T14:53:42.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: mon.c@-1(synchronizing).mds e1 print_map 2024-01-25T14:53:42.757 INFO:journalctl@ceph.mon.c.smithi191.stdout: e1 2024-01-25T14:53:42.757 INFO:journalctl@ceph.mon.c.smithi191.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-01-25T14:53:42.757 INFO:journalctl@ceph.mon.c.smithi191.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-01-25T14:53:42.757 INFO:journalctl@ceph.mon.c.smithi191.stdout: legacy client fscid: -1 2024-01-25T14:53:42.757 INFO:journalctl@ceph.mon.c.smithi191.stdout: 2024-01-25T14:53:42.757 INFO:journalctl@ceph.mon.c.smithi191.stdout: No filesystems configured 2024-01-25T14:53:42.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-01-25T14:53:42.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-01-25T14:53:42.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-01-25T14:53:42.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-01-25T14:53:42.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-01-25T14:53:42.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-01-25T14:53:42.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-01-25T14:53:42.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-01-25T14:53:42.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-01-25T14:53:42.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-01-25T14:53:42.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:53:42.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:42.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:53:42.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: Updating smithi186:/etc/ceph/ceph.conf 2024-01-25T14:53:42.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:42.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:53:42.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: Updating smithi186:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:42.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2024-01-25T14:53:42.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: Updating smithi186:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.client.admin.keyring 2024-01-25T14:53:42.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: Deploying cephadm binary to smithi191 2024-01-25T14:53:42.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:42.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:42.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: Added host smithi191 2024-01-25T14:53:42.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:53:42.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:42.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T14:53:42.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:42.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1756697236' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-01-25T14:53:42.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:53:42.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:42.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:53:42.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: Updating smithi191:/etc/ceph/ceph.conf 2024-01-25T14:53:42.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:42.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: Updating smithi191:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:42.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1756697236' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-01-25T14:53:42.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: osdmap e4: 0 total, 0 up, 0 in 2024-01-25T14:53:42.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2024-01-25T14:53:42.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: Updating smithi191:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.client.admin.keyring 2024-01-25T14:53:42.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:42.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:53:42.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:42.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:53:42.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:42.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-25T14:53:42.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:42.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi170:172.21.15.170=a;smithi186:172.21.15.186=b;smithi191:172.21.15.191=c", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:53:42.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: Saving service mon spec with placement smithi170:172.21.15.170=a;smithi186:172.21.15.186=b;smithi191:172.21.15.191=c;count:3 2024-01-25T14:53:42.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: Deploying daemon mon.c on smithi191 2024-01-25T14:53:42.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:42.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:42.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: from='client.? 172.21.15.191:0/2001952775' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-25T14:53:42.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 ceph-mon[36347]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-01-25T14:53:42.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 bash[36329]: 64aefc2b8f6c2bda8ab34db7de3294a51e23f46482be24d9d20d7e35d7c58499 2024-01-25T14:53:42.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:42 smithi191 systemd[1]: Started Ceph mon.c for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:53:43.034 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-01-25T14:53:43.035 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph mon dump -f json 2024-01-25T14:53:43.265 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T14:53:47.786 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.784+0000 7f1425826700 1 -- 172.21.15.191:0/3297273440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f140c0035c0 msgr2=0x7f140c005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:47.786 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.784+0000 7f1425826700 1 --2- 172.21.15.191:0/3297273440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f140c0035c0 0x7f140c005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f14201000e0 tx=0x7f141000feb0 comp rx=0 tx=0).stop 2024-01-25T14:53:47.786 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.784+0000 7f1425826700 1 -- 172.21.15.191:0/3297273440 shutdown_connections 2024-01-25T14:53:47.786 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.784+0000 7f1425826700 1 --2- 172.21.15.191:0/3297273440 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f140c0035c0 0x7f140c005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:47.786 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.784+0000 7f1425826700 1 -- 172.21.15.191:0/3297273440 >> 172.21.15.191:0/3297273440 conn(0x7f14200fbc80 msgr2=0x7f14200fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:47.786 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.784+0000 7f1425826700 1 -- 172.21.15.191:0/3297273440 shutdown_connections 2024-01-25T14:53:47.786 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.784+0000 7f1425826700 1 -- 172.21.15.191:0/3297273440 wait complete. 2024-01-25T14:53:47.787 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.785+0000 7f1425826700 1 Processor -- start 2024-01-25T14:53:47.787 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.785+0000 7f1425826700 1 -- start start 2024-01-25T14:53:47.789 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.786+0000 7f1425826700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f140c0035c0 0x7f142019b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:47.789 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.786+0000 7f1425826700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f142019bc50 0x7f14201958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:47.790 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.786+0000 7f1425826700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142019c1e0 con 0x7f140c0035c0 2024-01-25T14:53:47.790 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.786+0000 7f1425826700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142019c350 con 0x7f142019bc50 2024-01-25T14:53:47.790 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.786+0000 7f14167fc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f142019bc50 0x7f14201958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:47.790 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.786+0000 7f14167fc700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f142019bc50 0x7f14201958d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:35860/0 (socket says 172.21.15.191:35860) 2024-01-25T14:53:47.790 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.786+0000 7f14167fc700 1 -- 172.21.15.191:0/3569645524 learned_addr learned my addr 172.21.15.191:0/3569645524 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-01-25T14:53:47.790 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.786+0000 7f141effd700 1 --2- 172.21.15.191:0/3569645524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f140c0035c0 0x7f142019b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:47.790 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.786+0000 7f14167fc700 1 -- 172.21.15.191:0/3569645524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f142019bc50 msgr2=0x7f14201958d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-01-25T14:53:47.790 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.786+0000 7f14167fc700 1 -- 172.21.15.191:0/3569645524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f142019bc50 msgr2=0x7f14201958d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-01-25T14:53:47.790 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.786+0000 7f14167fc700 1 --2- 172.21.15.191:0/3569645524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f142019bc50 0x7f14201958d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-25T14:53:47.790 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.786+0000 7f14167fc700 1 --2- 172.21.15.191:0/3569645524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f142019bc50 0x7f14201958d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-25T14:53:47.790 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.786+0000 7f141effd700 1 -- 172.21.15.191:0/3569645524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f142019bc50 msgr2=0x7f14201958d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-25T14:53:47.791 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.786+0000 7f141effd700 1 --2- 172.21.15.191:0/3569645524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f142019bc50 0x7f14201958d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:47.791 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.786+0000 7f141effd700 1 -- 172.21.15.191:0/3569645524 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141000f900 con 0x7f140c0035c0 2024-01-25T14:53:47.791 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.787+0000 7f141effd700 1 --2- 172.21.15.191:0/3569645524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f140c0035c0 0x7f142019b710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f141000f800 tx=0x7f1410004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:47.791 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.787+0000 7f1424824700 1 -- 172.21.15.191:0/3569645524 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f1410013960 con 0x7f140c0035c0 2024-01-25T14:53:47.791 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.787+0000 7f1425826700 1 -- 172.21.15.191:0/3569645524 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1420195ed0 con 0x7f140c0035c0 2024-01-25T14:53:47.791 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.787+0000 7f1424824700 1 -- 172.21.15.191:0/3569645524 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1410004030 con 0x7f140c0035c0 2024-01-25T14:53:47.791 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.787+0000 7f1424824700 1 -- 172.21.15.191:0/3569645524 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f1410003ac0 con 0x7f140c0035c0 2024-01-25T14:53:47.791 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.787+0000 7f1425826700 1 -- 172.21.15.191:0/3569645524 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1420196420 con 0x7f140c0035c0 2024-01-25T14:53:47.791 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.788+0000 7f1424824700 1 -- 172.21.15.191:0/3569645524 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7f1410011540 con 0x7f140c0035c0 2024-01-25T14:53:47.791 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.788+0000 7f1424824700 1 --2- 172.21.15.191:0/3569645524 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1400038880 0x7f140003ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:47.791 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.788+0000 7f1425826700 1 -- 172.21.15.191:0/3569645524 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142018f870 con 0x7f140c0035c0 2024-01-25T14:53:47.791 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.788+0000 7f1424824700 1 -- 172.21.15.191:0/3569645524 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1410000e40 con 0x7f140c0035c0 2024-01-25T14:53:47.792 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.789+0000 7f14167fc700 1 --2- 172.21.15.191:0/3569645524 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1400038880 0x7f140003ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:47.792 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.789+0000 7f14167fc700 1 --2- 172.21.15.191:0/3569645524 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1400038880 0x7f140003ad40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1408009180 tx=0x7f1408008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:47.794 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:47.794+0000 7f1424824700 1 -- 172.21.15.191:0/3569645524 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1410003d80 con 0x7f140c0035c0 2024-01-25T14:53:47.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:53:47.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: mon.a calling monitor election 2024-01-25T14:53:47.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:47.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:47.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:47.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:47.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: mon.c calling monitor election 2024-01-25T14:53:47.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:47.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:47.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:47.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:47.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-25T14:53:47.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: monmap e2: 2 mons at {a=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],c=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-25T14:53:47.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: fsmap 2024-01-25T14:53:47.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: osdmap e4: 0 total, 0 up, 0 in 2024-01-25T14:53:47.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: mgrmap e13: x(active, since 51s) 2024-01-25T14:53:47.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: overall HEALTH_OK 2024-01-25T14:53:47.876 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:47.876 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:47.876 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:47.876 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-25T14:53:47.876 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:47 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:47.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:53:47.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: mon.a calling monitor election 2024-01-25T14:53:47.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:47.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:47.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:47.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:47.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: mon.c calling monitor election 2024-01-25T14:53:47.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:47.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:47.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:47.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:47.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-01-25T14:53:47.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: monmap e2: 2 mons at {a=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],c=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-25T14:53:47.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: fsmap 2024-01-25T14:53:47.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: osdmap e4: 0 total, 0 up, 0 in 2024-01-25T14:53:47.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: mgrmap e13: x(active, since 51s) 2024-01-25T14:53:47.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: overall HEALTH_OK 2024-01-25T14:53:47.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:47.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:47.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:47.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-25T14:53:47.986 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:47 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:48.072 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:48.072+0000 7f1425826700 1 -- 172.21.15.191:0/3569645524 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1420196e00 con 0x7f140c0035c0 2024-01-25T14:53:48.073 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:48.072+0000 7f1424824700 1 -- 172.21.15.191:0/3569645524 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1019 (secure 0 0 0) 0x7f141001a390 con 0x7f140c0035c0 2024-01-25T14:53:48.073 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:53:48.073 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":2,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","modified":"2024-01-25T14:53:42.471216Z","created":"2024-01-25T14:51:50.337926Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-01-25T14:53:48.075 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:48.074+0000 7f1425826700 1 -- 172.21.15.191:0/3569645524 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1400038880 msgr2=0x7f140003ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:48.075 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:48.074+0000 7f1425826700 1 --2- 172.21.15.191:0/3569645524 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1400038880 0x7f140003ad40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1408009180 tx=0x7f1408008040 comp rx=0 tx=0).stop 2024-01-25T14:53:48.075 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:48.074+0000 7f1425826700 1 -- 172.21.15.191:0/3569645524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f140c0035c0 msgr2=0x7f142019b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:48.075 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:48.074+0000 7f1425826700 1 --2- 172.21.15.191:0/3569645524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f140c0035c0 0x7f142019b710 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f141000f800 tx=0x7f1410004f80 comp rx=0 tx=0).stop 2024-01-25T14:53:48.076 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:48.074+0000 7f1425826700 1 -- 172.21.15.191:0/3569645524 shutdown_connections 2024-01-25T14:53:48.076 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:48.074+0000 7f1425826700 1 --2- 172.21.15.191:0/3569645524 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1400038880 0x7f140003ad40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:48.076 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:48.074+0000 7f1425826700 1 --2- 172.21.15.191:0/3569645524 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f140c0035c0 0x7f142019b710 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:48.076 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:48.074+0000 7f1425826700 1 --2- 172.21.15.191:0/3569645524 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f142019bc50 0x7f14201958d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:48.076 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:48.074+0000 7f1425826700 1 -- 172.21.15.191:0/3569645524 >> 172.21.15.191:0/3569645524 conn(0x7f14200fbc80 msgr2=0x7f14200fcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:48.076 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:48.074+0000 7f1425826700 1 -- 172.21.15.191:0/3569645524 shutdown_connections 2024-01-25T14:53:48.076 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:48.074+0000 7f1425826700 1 -- 172.21.15.191:0/3569645524 wait complete. 2024-01-25T14:53:48.076 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 2 2024-01-25T14:53:49.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:48 smithi191 ceph-mon[36347]: Deploying daemon mon.b on smithi186 2024-01-25T14:53:49.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:48 smithi191 ceph-mon[36347]: from='client.? 172.21.15.191:0/3569645524' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-25T14:53:49.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:48 smithi191 ceph-mon[36347]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:49.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:48 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:48 smithi170 ceph-mon[31899]: Deploying daemon mon.b on smithi186 2024-01-25T14:53:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:48 smithi170 ceph-mon[31899]: from='client.? 172.21.15.191:0/3569645524' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-25T14:53:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:48 smithi170 ceph-mon[31899]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:48 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:49.690 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-01-25T14:53:49.690 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph mon dump -f json 2024-01-25T14:53:49.925 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T14:53:51.188 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:51 smithi191 ceph-mon[36347]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:51.377 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.374+0000 7f72e7817700 1 -- 172.21.15.191:0/1286499112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e0100410 msgr2=0x7f72e01007f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:51.377 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.374+0000 7f72e7817700 1 --2- 172.21.15.191:0/1286499112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e0100410 0x7f72e01007f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009910 tx=0x7f72d0009c20 comp rx=0 tx=0).stop 2024-01-25T14:53:51.377 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.374+0000 7f72e7817700 1 -- 172.21.15.191:0/1286499112 shutdown_connections 2024-01-25T14:53:51.377 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.374+0000 7f72e7817700 1 --2- 172.21.15.191:0/1286499112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e0100410 0x7f72e01007f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:51.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.374+0000 7f72e7817700 1 -- 172.21.15.191:0/1286499112 >> 172.21.15.191:0/1286499112 conn(0x7f72e00fbc80 msgr2=0x7f72e00fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:51.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.375+0000 7f72e7817700 1 -- 172.21.15.191:0/1286499112 shutdown_connections 2024-01-25T14:53:51.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.375+0000 7f72e7817700 1 -- 172.21.15.191:0/1286499112 wait complete. 2024-01-25T14:53:51.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.375+0000 7f72e7817700 1 Processor -- start 2024-01-25T14:53:51.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.375+0000 7f72e7817700 1 -- start start 2024-01-25T14:53:51.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.375+0000 7f72e7817700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e0100410 0x7f72e0197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:51.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.375+0000 7f72e7817700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e0198050 0x7f72e01984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:51.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.375+0000 7f72e7817700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e006a990 con 0x7f72e0100410 2024-01-25T14:53:51.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.375+0000 7f72e7817700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e01a0b80 con 0x7f72e0198050 2024-01-25T14:53:51.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72e4db2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e0198050 0x7f72e01984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:51.378 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72e55b3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e0100410 0x7f72e0197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:51.379 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72e55b3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e0100410 0x7f72e0197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.191:54770/0 (socket says 172.21.15.191:54770) 2024-01-25T14:53:51.379 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72e4db2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e0198050 0x7f72e01984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:35866/0 (socket says 172.21.15.191:35866) 2024-01-25T14:53:51.379 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72e55b3700 1 -- 172.21.15.191:0/3634195831 learned_addr learned my addr 172.21.15.191:0/3634195831 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-01-25T14:53:51.379 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72e4db2700 1 -- 172.21.15.191:0/3634195831 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e0198050 msgr2=0x7f72e01984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-01-25T14:53:51.379 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72e4db2700 1 -- 172.21.15.191:0/3634195831 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e0198050 msgr2=0x7f72e01984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-01-25T14:53:51.379 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72e4db2700 1 --2- 172.21.15.191:0/3634195831 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e0198050 0x7f72e01984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-25T14:53:51.379 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72e4db2700 1 --2- 172.21.15.191:0/3634195831 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e0198050 0x7f72e01984d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-25T14:53:51.379 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72e55b3700 1 -- 172.21.15.191:0/3634195831 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e0198050 msgr2=0x7f72e01984d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-25T14:53:51.379 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72e55b3700 1 --2- 172.21.15.191:0/3634195831 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e0198050 0x7f72e01984d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:51.379 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72e55b3700 1 -- 172.21.15.191:0/3634195831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d00095f0 con 0x7f72e0100410 2024-01-25T14:53:51.379 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72e55b3700 1 --2- 172.21.15.191:0/3634195831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e0100410 0x7f72e0197b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f72d0006010 tx=0x7f72d0004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:51.379 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72d67fc700 1 -- 172.21.15.191:0/3634195831 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f72d001d070 con 0x7f72e0100410 2024-01-25T14:53:51.379 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72e7817700 1 -- 172.21.15.191:0/3634195831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e01a0db0 con 0x7f72e0100410 2024-01-25T14:53:51.380 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72d67fc700 1 -- 172.21.15.191:0/3634195831 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72d0005dc0 con 0x7f72e0100410 2024-01-25T14:53:51.380 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72d67fc700 1 -- 172.21.15.191:0/3634195831 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f72d0022c90 con 0x7f72e0100410 2024-01-25T14:53:51.380 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.376+0000 7f72e7817700 1 -- 172.21.15.191:0/3634195831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e01a1240 con 0x7f72e0100410 2024-01-25T14:53:51.381 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.377+0000 7f72e7817700 1 -- 172.21.15.191:0/3634195831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e0062e10 con 0x7f72e0100410 2024-01-25T14:53:51.381 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.377+0000 7f72d67fc700 1 -- 172.21.15.191:0/3634195831 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7f72d0022470 con 0x7f72e0100410 2024-01-25T14:53:51.381 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.377+0000 7f72d67fc700 1 --2- 172.21.15.191:0/3634195831 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f72cc038880 0x7f72cc03ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:51.381 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.377+0000 7f72d67fc700 1 -- 172.21.15.191:0/3634195831 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f72d004ce20 con 0x7f72e0100410 2024-01-25T14:53:51.381 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.378+0000 7f72e4db2700 1 --2- 172.21.15.191:0/3634195831 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f72cc038880 0x7f72cc03ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:51.381 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.378+0000 7f72e4db2700 1 --2- 172.21.15.191:0/3634195831 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f72cc038880 0x7f72cc03ad40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f72dc009850 tx=0x7f72dc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:51.383 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.383+0000 7f72d67fc700 1 -- 172.21.15.191:0/3634195831 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f72d002bba0 con 0x7f72e0100410 2024-01-25T14:53:51.494 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.493+0000 7f72d67fc700 1 -- 172.21.15.191:0/3634195831 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d002bba0 con 0x7f72e0100410 2024-01-25T14:53:51.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:51 smithi186 systemd[1]: Started Ceph mon.b for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:53:51.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:51 smithi170 ceph-mon[31899]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:51.658 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:51.657+0000 7f72e7817700 1 -- 172.21.15.191:0/3634195831 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f72e0069fd0 con 0x7f72e0100410 2024-01-25T14:53:56.542 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:56.539+0000 7f72d67fc700 1 -- 172.21.15.191:0/3634195831 <== mon.0 v2:172.21.15.170:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1289 (secure 0 0 0) 0x7f72d0005c00 con 0x7f72e0100410 2024-01-25T14:53:56.542 INFO:teuthology.orchestra.run.smithi191.stdout: 2024-01-25T14:53:56.543 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":3,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","modified":"2024-01-25T14:53:51.493636Z","created":"2024-01-25T14:51:50.337926Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:3300","nonce":0},{"type":"v1","addr":"172.21.15.170:6789","nonce":0}]},"addr":"172.21.15.170:6789/0","public_addr":"172.21.15.170:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3300","nonce":0},{"type":"v1","addr":"172.21.15.186:6789","nonce":0}]},"addr":"172.21.15.186:6789/0","public_addr":"172.21.15.186:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-01-25T14:53:56.545 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:56.543+0000 7f72e7817700 1 -- 172.21.15.191:0/3634195831 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f72cc038880 msgr2=0x7f72cc03ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:56.545 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:56.543+0000 7f72e7817700 1 --2- 172.21.15.191:0/3634195831 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f72cc038880 0x7f72cc03ad40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f72dc009850 tx=0x7f72dc008040 comp rx=0 tx=0).stop 2024-01-25T14:53:56.545 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:56.543+0000 7f72e7817700 1 -- 172.21.15.191:0/3634195831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e0100410 msgr2=0x7f72e0197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:56.545 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:56.543+0000 7f72e7817700 1 --2- 172.21.15.191:0/3634195831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e0100410 0x7f72e0197b10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f72d0006010 tx=0x7f72d0004ff0 comp rx=0 tx=0).stop 2024-01-25T14:53:56.545 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:56.543+0000 7f72e7817700 1 -- 172.21.15.191:0/3634195831 shutdown_connections 2024-01-25T14:53:56.545 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:56.543+0000 7f72e7817700 1 --2- 172.21.15.191:0/3634195831 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f72cc038880 0x7f72cc03ad40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:56.545 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:56.543+0000 7f72e7817700 1 --2- 172.21.15.191:0/3634195831 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f72e0100410 0x7f72e0197b10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:56.546 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:56.543+0000 7f72e7817700 1 --2- 172.21.15.191:0/3634195831 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f72e0198050 0x7f72e01984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:56.546 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:56.543+0000 7f72e7817700 1 -- 172.21.15.191:0/3634195831 >> 172.21.15.191:0/3634195831 conn(0x7f72e00fbc80 msgr2=0x7f72e0101de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:56.546 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:56.543+0000 7f72e7817700 1 -- 172.21.15.191:0/3634195831 shutdown_connections 2024-01-25T14:53:56.546 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:53:56.543+0000 7f72e7817700 1 -- 172.21.15.191:0/3634195831 wait complete. 2024-01-25T14:53:56.546 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 3 2024-01-25T14:53:56.805 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:53:56.806 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: mon.a calling monitor election 2024-01-25T14:53:56.806 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: mon.c calling monitor election 2024-01-25T14:53:56.806 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.806 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:56.806 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: from='client.? 172.21.15.191:0/3634195831' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-25T14:53:56.806 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:56.806 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.806 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.806 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: mon.b calling monitor election 2024-01-25T14:53:56.807 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:56.807 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.807 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.807 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:56.807 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.807 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-25T14:53:56.807 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: monmap e3: 3 mons at {a=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],b=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0],c=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-25T14:53:56.807 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: fsmap 2024-01-25T14:53:56.807 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: osdmap e4: 0 total, 0 up, 0 in 2024-01-25T14:53:56.807 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: mgrmap e13: x(active, since 60s) 2024-01-25T14:53:56.807 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: overall HEALTH_OK 2024-01-25T14:53:56.807 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:56.807 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:56.808 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:56.808 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:56.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:53:56.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: mon.a calling monitor election 2024-01-25T14:53:56.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: mon.c calling monitor election 2024-01-25T14:53:56.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:56.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: from='client.? 172.21.15.191:0/3634195831' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-25T14:53:56.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:56.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: mon.b calling monitor election 2024-01-25T14:53:56.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:56.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:56.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-25T14:53:56.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: monmap e3: 3 mons at {a=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],b=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0],c=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-25T14:53:56.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: fsmap 2024-01-25T14:53:56.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: osdmap e4: 0 total, 0 up, 0 in 2024-01-25T14:53:56.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: mgrmap e13: x(active, since 60s) 2024-01-25T14:53:56.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: overall HEALTH_OK 2024-01-25T14:53:56.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:56.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:56.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:56.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:56.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:53:56.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: mon.a calling monitor election 2024-01-25T14:53:56.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: mon.c calling monitor election 2024-01-25T14:53:56.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:53:56.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: from='client.? 172.21.15.191:0/3634195831' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-01-25T14:53:56.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:56.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.876 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.876 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: mon.b calling monitor election 2024-01-25T14:53:56.876 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:56.876 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.876 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.876 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:56.876 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:56.877 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-01-25T14:53:56.877 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: monmap e3: 3 mons at {a=[v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0],b=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0],c=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-01-25T14:53:56.877 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: fsmap 2024-01-25T14:53:56.877 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: osdmap e4: 0 total, 0 up, 0 in 2024-01-25T14:53:56.877 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: mgrmap e13: x(active, since 60s) 2024-01-25T14:53:56.877 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: overall HEALTH_OK 2024-01-25T14:53:56.877 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:56.877 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:56.878 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:56.878 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:57.118 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-01-25T14:53:57.118 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph config generate-minimal-conf 2024-01-25T14:53:57.364 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:53:57.797 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:57 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:53:57.797 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:57 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:57.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:57 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:53:57.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:57 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:57.983 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:57 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:53:57.983 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:57 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:53:59.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:59.165 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:53:59.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: Updating smithi170:/etc/ceph/ceph.conf 2024-01-25T14:53:59.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: Updating smithi186:/etc/ceph/ceph.conf 2024-01-25T14:53:59.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: Updating smithi191:/etc/ceph/ceph.conf 2024-01-25T14:53:59.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:59.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: Updating smithi170:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:59.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: Updating smithi191:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:59.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: Updating smithi186:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:59.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.166 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-25T14:53:59.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-25T14:53:59.167 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:59.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.168+0000 7fbac8344700 1 -- 172.21.15.170:0/3678839494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbac0102360 msgr2=0x7fbac0102740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:59.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.168+0000 7fbac8344700 1 --2- 172.21.15.170:0/3678839494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbac0102360 0x7fbac0102740 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbabc009910 tx=0x7fbabc009c20 comp rx=0 tx=0).stop 2024-01-25T14:53:59.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.168+0000 7fbac8344700 1 -- 172.21.15.170:0/3678839494 shutdown_connections 2024-01-25T14:53:59.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.168+0000 7fbac8344700 1 --2- 172.21.15.170:0/3678839494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbac0102360 0x7fbac0102740 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:59.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.168+0000 7fbac8344700 1 -- 172.21.15.170:0/3678839494 >> 172.21.15.170:0/3678839494 conn(0x7fbac00fbbd0 msgr2=0x7fbac00fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:59.169 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.168+0000 7fbac8344700 1 -- 172.21.15.170:0/3678839494 shutdown_connections 2024-01-25T14:53:59.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.168+0000 7fbac8344700 1 -- 172.21.15.170:0/3678839494 wait complete. 2024-01-25T14:53:59.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.168+0000 7fbac8344700 1 Processor -- start 2024-01-25T14:53:59.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.168+0000 7fbac8344700 1 -- start start 2024-01-25T14:53:59.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac8344700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbac0102360 0x7fbac00fffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:59.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac8344700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbac0100500 0x7fbac0100980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:59.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac8344700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbac01a2ef0 0x7fbac01a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:59.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac8344700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac01a58e0 con 0x7fbac0102360 2024-01-25T14:53:59.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac8344700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac01a5a50 con 0x7fbac01a2ef0 2024-01-25T14:53:59.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac8344700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac01a5c10 con 0x7fbac0100500 2024-01-25T14:53:59.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac60e0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbac0102360 0x7fbac00fffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:59.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac60e0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbac0102360 0x7fbac00fffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:60230/0 (socket says 172.21.15.170:60230) 2024-01-25T14:53:59.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac60e0700 1 -- 172.21.15.170:0/798416866 learned_addr learned my addr 172.21.15.170:0/798416866 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:53:59.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac68e1700 1 --2- 172.21.15.170:0/798416866 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbac01a2ef0 0x7fbac01a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:59.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac58df700 1 --2- 172.21.15.170:0/798416866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbac0100500 0x7fbac0100980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac60e0700 1 -- 172.21.15.170:0/798416866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbac0100500 msgr2=0x7fbac0100980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac60e0700 1 --2- 172.21.15.170:0/798416866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbac0100500 0x7fbac0100980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac60e0700 1 -- 172.21.15.170:0/798416866 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbac01a2ef0 msgr2=0x7fbac01a52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac60e0700 1 --2- 172.21.15.170:0/798416866 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbac01a2ef0 0x7fbac01a52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac60e0700 1 -- 172.21.15.170:0/798416866 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc0095f0 con 0x7fbac0102360 2024-01-25T14:53:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac58df700 1 --2- 172.21.15.170:0/798416866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbac0100500 0x7fbac0100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T14:53:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac60e0700 1 --2- 172.21.15.170:0/798416866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbac0102360 0x7fbac00fffc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbabc004c40 tx=0x7fbabc004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbab77fe700 1 -- 172.21.15.170:0/798416866 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc01d070 con 0x7fbac0102360 2024-01-25T14:53:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbab77fe700 1 -- 172.21.15.170:0/798416866 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbabc00be20 con 0x7fbac0102360 2024-01-25T14:53:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.169+0000 7fbac8344700 1 -- 172.21.15.170:0/798416866 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac01a5e90 con 0x7fbac0102360 2024-01-25T14:53:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.170+0000 7fbab77fe700 1 -- 172.21.15.170:0/798416866 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc022e50 con 0x7fbac0102360 2024-01-25T14:53:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.170+0000 7fbac8344700 1 -- 172.21.15.170:0/798416866 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac01a62a0 con 0x7fbac0102360 2024-01-25T14:53:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.171+0000 7fbab77fe700 1 -- 172.21.15.170:0/798416866 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7fbabc00f460 con 0x7fbac0102360 2024-01-25T14:53:59.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.171+0000 7fbac8344700 1 -- 172.21.15.170:0/798416866 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac0062e10 con 0x7fbac0102360 2024-01-25T14:53:59.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.171+0000 7fbab77fe700 1 --2- 172.21.15.170:0/798416866 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fbaac038f70 0x7fbaac03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:53:59.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.171+0000 7fbab77fe700 1 -- 172.21.15.170:0/798416866 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbabc04ca00 con 0x7fbac0102360 2024-01-25T14:53:59.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.171+0000 7fbac58df700 1 --2- 172.21.15.170:0/798416866 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fbaac038f70 0x7fbaac03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:53:59.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.171+0000 7fbac58df700 1 --2- 172.21.15.170:0/798416866 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fbaac038f70 0x7fbaac03b430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbab00079b0 tx=0x7fbab0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:53:59.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.178+0000 7fbab77fe700 1 -- 172.21.15.170:0/798416866 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fbabc02c440 con 0x7fbac0102360 2024-01-25T14:53:59.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:59.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:53:59.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: Updating smithi170:/etc/ceph/ceph.conf 2024-01-25T14:53:59.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: Updating smithi186:/etc/ceph/ceph.conf 2024-01-25T14:53:59.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: Updating smithi191:/etc/ceph/ceph.conf 2024-01-25T14:53:59.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:59.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: Updating smithi170:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:59.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: Updating smithi191:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:59.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: Updating smithi186:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:59.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.236 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.236 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.236 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.236 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-25T14:53:59.236 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-25T14:53:59.236 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:59.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:59.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:53:59.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: Updating smithi170:/etc/ceph/ceph.conf 2024-01-25T14:53:59.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: Updating smithi186:/etc/ceph/ceph.conf 2024-01-25T14:53:59.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: Updating smithi191:/etc/ceph/ceph.conf 2024-01-25T14:53:59.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:53:59.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: Updating smithi170:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:59.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: Updating smithi191:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:59.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: Updating smithi186:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/config/ceph.conf 2024-01-25T14:53:59.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.357 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:53:59.357 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-25T14:53:59.357 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-25T14:53:59.357 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:53:59.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.382+0000 7fbac8344700 1 -- 172.21.15.170:0/798416866 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fbac010b500 con 0x7fbac0102360 2024-01-25T14:53:59.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.382+0000 7fbab77fe700 1 -- 172.21.15.170:0/798416866 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+277 (secure 0 0 0) 0x7fbabc027070 con 0x7fbac0102360 2024-01-25T14:53:59.383 INFO:teuthology.orchestra.run.smithi170.stdout:# minimal ceph.conf for 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:53:59.383 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-01-25T14:53:59.384 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T14:53:59.384 INFO:teuthology.orchestra.run.smithi170.stdout: mon_host = [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] 2024-01-25T14:53:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.385+0000 7fbac8344700 1 -- 172.21.15.170:0/798416866 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fbaac038f70 msgr2=0x7fbaac03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.385+0000 7fbac8344700 1 --2- 172.21.15.170:0/798416866 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fbaac038f70 0x7fbaac03b430 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbab00079b0 tx=0x7fbab0008040 comp rx=0 tx=0).stop 2024-01-25T14:53:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.385+0000 7fbac8344700 1 -- 172.21.15.170:0/798416866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbac0102360 msgr2=0x7fbac00fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:53:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.385+0000 7fbac8344700 1 --2- 172.21.15.170:0/798416866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbac0102360 0x7fbac00fffc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbabc004c40 tx=0x7fbabc004d20 comp rx=0 tx=0).stop 2024-01-25T14:53:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.385+0000 7fbac8344700 1 -- 172.21.15.170:0/798416866 shutdown_connections 2024-01-25T14:53:59.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.385+0000 7fbac8344700 1 --2- 172.21.15.170:0/798416866 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fbaac038f70 0x7fbaac03b430 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.385+0000 7fbac8344700 1 --2- 172.21.15.170:0/798416866 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbac01a2ef0 0x7fbac01a52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.385+0000 7fbac8344700 1 --2- 172.21.15.170:0/798416866 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbac0102360 0x7fbac00fffc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.385+0000 7fbac8344700 1 --2- 172.21.15.170:0/798416866 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbac0100500 0x7fbac0100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:53:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.385+0000 7fbac8344700 1 -- 172.21.15.170:0/798416866 >> 172.21.15.170:0/798416866 conn(0x7fbac00fbbd0 msgr2=0x7fbac0103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:53:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.385+0000 7fbac8344700 1 -- 172.21.15.170:0/798416866 shutdown_connections 2024-01-25T14:53:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:53:59.385+0000 7fbac8344700 1 -- 172.21.15.170:0/798416866 wait complete. 2024-01-25T14:54:00.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:59 smithi191 ceph-mon[36347]: Reconfiguring mon.a (unknown last config time)... 2024-01-25T14:54:00.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:59 smithi191 ceph-mon[36347]: Reconfiguring daemon mon.a on smithi170 2024-01-25T14:54:00.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:53:59 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/798416866' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:00.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:59 smithi186 ceph-mon[35697]: Reconfiguring mon.a (unknown last config time)... 2024-01-25T14:54:00.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:59 smithi186 ceph-mon[35697]: Reconfiguring daemon mon.a on smithi170 2024-01-25T14:54:00.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:53:59 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/798416866' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:00.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:59 smithi170 ceph-mon[31899]: Reconfiguring mon.a (unknown last config time)... 2024-01-25T14:54:00.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:59 smithi170 ceph-mon[31899]: Reconfiguring daemon mon.a on smithi170 2024-01-25T14:54:00.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:53:59 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/798416866' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:00.441 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-01-25T14:54:00.441 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T14:54:00.441 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.conf 2024-01-25T14:54:00.471 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T14:54:00.471 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-25T14:54:00.538 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-01-25T14:54:00.538 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.conf 2024-01-25T14:54:00.574 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-01-25T14:54:00.574 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-25T14:54:00.645 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-01-25T14:54:00.645 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.conf 2024-01-25T14:54:00.679 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-01-25T14:54:00.680 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-01-25T14:54:00.750 INFO:tasks.cephadm:Adding mgr.x on smithi170 2024-01-25T14:54:00.750 INFO:tasks.cephadm:Adding mgr.y on smithi186 2024-01-25T14:54:00.750 INFO:tasks.cephadm:Adding mgr.z on smithi191 2024-01-25T14:54:00.750 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch apply mgr '3;smithi170=x;smithi186=y;smithi191=z' 2024-01-25T14:54:01.021 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T14:54:01.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:00 smithi170 ceph-mon[31899]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:01.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:00 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:01.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:00 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:01.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:00 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-25T14:54:01.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:00 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-25T14:54:01.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:00 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:01.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:00 smithi191 ceph-mon[36347]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:01.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:00 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:01.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:00 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:01.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:00 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-25T14:54:01.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:00 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-25T14:54:01.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:00 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:01.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:00 smithi186 ceph-mon[35697]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:01.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:00 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:01.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:00 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:01.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:00 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-25T14:54:01.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:00 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-25T14:54:01.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:00 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:02.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:02 smithi191 ceph-mon[36347]: Reconfiguring mon.b (monmap changed)... 2024-01-25T14:54:02.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:02 smithi191 ceph-mon[36347]: Reconfiguring daemon mon.b on smithi186 2024-01-25T14:54:02.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:02 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:02.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:02 smithi186 ceph-mon[35697]: Reconfiguring mon.b (monmap changed)... 2024-01-25T14:54:02.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:02 smithi186 ceph-mon[35697]: Reconfiguring daemon mon.b on smithi186 2024-01-25T14:54:02.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:02 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:02.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.495+0000 7fd1f68bd700 1 -- 172.21.15.191:0/3725050595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0101dd0 msgr2=0x7fd1f01041c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:02.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.495+0000 7fd1f68bd700 1 --2- 172.21.15.191:0/3725050595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0101dd0 0x7fd1f01041c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4009910 tx=0x7fd1e4009c20 comp rx=0 tx=0).stop 2024-01-25T14:54:02.498 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.495+0000 7fd1f68bd700 1 -- 172.21.15.191:0/3725050595 shutdown_connections 2024-01-25T14:54:02.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.495+0000 7fd1f68bd700 1 --2- 172.21.15.191:0/3725050595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0101dd0 0x7fd1f01041c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:02.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.495+0000 7fd1f68bd700 1 -- 172.21.15.191:0/3725050595 >> 172.21.15.191:0/3725050595 conn(0x7fd1f00fb7e0 msgr2=0x7fd1f00fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:54:02.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.495+0000 7fd1f68bd700 1 -- 172.21.15.191:0/3725050595 shutdown_connections 2024-01-25T14:54:02.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.495+0000 7fd1f68bd700 1 -- 172.21.15.191:0/3725050595 wait complete. 2024-01-25T14:54:02.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.496+0000 7fd1f68bd700 1 Processor -- start 2024-01-25T14:54:02.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.496+0000 7fd1f68bd700 1 -- start start 2024-01-25T14:54:02.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.496+0000 7fd1f68bd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1f0101dd0 0x7fd1f0196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:02.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.496+0000 7fd1f68bd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0196d90 0x7fd1f019be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:02.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.496+0000 7fd1f68bd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1f0197210 0x7fd1f019e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:02.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.496+0000 7fd1f68bd700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f019eb30 con 0x7fd1f0196d90 2024-01-25T14:54:02.499 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.496+0000 7fd1f68bd700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f019eca0 con 0x7fd1f0101dd0 2024-01-25T14:54:02.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.496+0000 7fd1f68bd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f019ee60 con 0x7fd1f0197210 2024-01-25T14:54:02.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.496+0000 7fd1f4e5a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1f0197210 0x7fd1f019e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:02.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.496+0000 7fd1f4e5a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1f0197210 0x7fd1f019e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:43718/0 (socket says 172.21.15.191:43718) 2024-01-25T14:54:02.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.496+0000 7fd1f4e5a700 1 -- 172.21.15.191:0/2062682450 learned_addr learned my addr 172.21.15.191:0/2062682450 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-01-25T14:54:02.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.497+0000 7fd1effff700 1 --2- 172.21.15.191:0/2062682450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1f0101dd0 0x7fd1f0196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:02.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.497+0000 7fd1ef7fe700 1 --2- 172.21.15.191:0/2062682450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0196d90 0x7fd1f019be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:02.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.497+0000 7fd1f4e5a700 1 -- 172.21.15.191:0/2062682450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1f0101dd0 msgr2=0x7fd1f0196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:02.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.497+0000 7fd1f4e5a700 1 --2- 172.21.15.191:0/2062682450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1f0101dd0 0x7fd1f0196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:02.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.497+0000 7fd1f4e5a700 1 -- 172.21.15.191:0/2062682450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0196d90 msgr2=0x7fd1f019be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:02.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.497+0000 7fd1f4e5a700 1 --2- 172.21.15.191:0/2062682450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0196d90 0x7fd1f019be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:02.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.497+0000 7fd1f4e5a700 1 -- 172.21.15.191:0/2062682450 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e40095f0 con 0x7fd1f0197210 2024-01-25T14:54:02.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.497+0000 7fd1f4e5a700 1 --2- 172.21.15.191:0/2062682450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1f0197210 0x7fd1f019e390 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800ba50 tx=0x7fd1e800bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:54:02.500 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.497+0000 7fd1ed7fa700 1 -- 172.21.15.191:0/2062682450 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e800c930 con 0x7fd1f0197210 2024-01-25T14:54:02.501 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.497+0000 7fd1ed7fa700 1 -- 172.21.15.191:0/2062682450 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1e8014440 con 0x7fd1f0197210 2024-01-25T14:54:02.501 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.497+0000 7fd1ed7fa700 1 -- 172.21.15.191:0/2062682450 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e80075b0 con 0x7fd1f0197210 2024-01-25T14:54:02.501 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.497+0000 7fd1f68bd700 1 -- 172.21.15.191:0/2062682450 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f019f140 con 0x7fd1f0197210 2024-01-25T14:54:02.501 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.497+0000 7fd1f68bd700 1 -- 172.21.15.191:0/2062682450 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f019f5f0 con 0x7fd1f0197210 2024-01-25T14:54:02.502 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.498+0000 7fd1ed7fa700 1 -- 172.21.15.191:0/2062682450 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7fd1e8007710 con 0x7fd1f0197210 2024-01-25T14:54:02.502 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.498+0000 7fd1ed7fa700 1 --2- 172.21.15.191:0/2062682450 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd1d8038f70 0x7fd1d803b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:02.502 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.498+0000 7fd1ed7fa700 1 -- 172.21.15.191:0/2062682450 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd1e804ace0 con 0x7fd1f0197210 2024-01-25T14:54:02.502 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.499+0000 7fd1effff700 1 --2- 172.21.15.191:0/2062682450 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd1d8038f70 0x7fd1d803b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:02.502 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.499+0000 7fd1f68bd700 1 -- 172.21.15.191:0/2062682450 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f0190010 con 0x7fd1f0197210 2024-01-25T14:54:02.502 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.499+0000 7fd1effff700 1 --2- 172.21.15.191:0/2062682450 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd1d8038f70 0x7fd1d803b430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4005130 tx=0x7fd1e4005200 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:54:02.504 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.504+0000 7fd1ed7fa700 1 -- 172.21.15.191:0/2062682450 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fd1e801b8b0 con 0x7fd1f0197210 2024-01-25T14:54:02.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:02 smithi170 ceph-mon[31899]: Reconfiguring mon.b (monmap changed)... 2024-01-25T14:54:02.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:02 smithi170 ceph-mon[31899]: Reconfiguring daemon mon.b on smithi186 2024-01-25T14:54:02.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:02 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:02.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.746+0000 7fd1f68bd700 1 -- 172.21.15.191:0/2062682450 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi170=x;smithi186=y;smithi191=z", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1f0061c20 con 0x7fd1d8038f70 2024-01-25T14:54:02.753 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.753+0000 7fd1ed7fa700 1 -- 172.21.15.191:0/2062682450 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd1f0061c20 con 0x7fd1d8038f70 2024-01-25T14:54:02.754 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mgr update... 2024-01-25T14:54:02.756 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.755+0000 7fd1f68bd700 1 -- 172.21.15.191:0/2062682450 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd1d8038f70 msgr2=0x7fd1d803b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:02.756 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.755+0000 7fd1f68bd700 1 --2- 172.21.15.191:0/2062682450 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd1d8038f70 0x7fd1d803b430 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4005130 tx=0x7fd1e4005200 comp rx=0 tx=0).stop 2024-01-25T14:54:02.756 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.755+0000 7fd1f68bd700 1 -- 172.21.15.191:0/2062682450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1f0197210 msgr2=0x7fd1f019e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:02.756 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.755+0000 7fd1f68bd700 1 --2- 172.21.15.191:0/2062682450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1f0197210 0x7fd1f019e390 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800ba50 tx=0x7fd1e800bd60 comp rx=0 tx=0).stop 2024-01-25T14:54:02.756 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.755+0000 7fd1f68bd700 1 -- 172.21.15.191:0/2062682450 shutdown_connections 2024-01-25T14:54:02.756 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.755+0000 7fd1f68bd700 1 --2- 172.21.15.191:0/2062682450 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd1d8038f70 0x7fd1d803b430 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:02.757 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.755+0000 7fd1f68bd700 1 --2- 172.21.15.191:0/2062682450 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd1f0197210 0x7fd1f019e390 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:02.757 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.755+0000 7fd1f68bd700 1 --2- 172.21.15.191:0/2062682450 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd1f0101dd0 0x7fd1f0196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:02.757 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.755+0000 7fd1f68bd700 1 --2- 172.21.15.191:0/2062682450 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd1f0196d90 0x7fd1f019be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:02.757 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.755+0000 7fd1f68bd700 1 -- 172.21.15.191:0/2062682450 >> 172.21.15.191:0/2062682450 conn(0x7fd1f00fb7e0 msgr2=0x7fd1f00fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:54:02.757 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.755+0000 7fd1f68bd700 1 -- 172.21.15.191:0/2062682450 shutdown_connections 2024-01-25T14:54:02.757 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:02.755+0000 7fd1f68bd700 1 -- 172.21.15.191:0/2062682450 wait complete. 2024-01-25T14:54:03.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:03 smithi191 ceph-mon[36347]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:03.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:03.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:03.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:03 smithi191 ceph-mon[36347]: Reconfiguring mon.c (monmap changed)... 2024-01-25T14:54:03.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-25T14:54:03.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-25T14:54:03.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:03.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:03 smithi191 ceph-mon[36347]: Reconfiguring daemon mon.c on smithi191 2024-01-25T14:54:03.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:03.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:03 smithi186 ceph-mon[35697]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:03 smithi186 ceph-mon[35697]: Reconfiguring mon.c (monmap changed)... 2024-01-25T14:54:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-25T14:54:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-25T14:54:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:03 smithi186 ceph-mon[35697]: Reconfiguring daemon mon.c on smithi191 2024-01-25T14:54:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:03 smithi170 ceph-mon[31899]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:03 smithi170 ceph-mon[31899]: Reconfiguring mon.c (monmap changed)... 2024-01-25T14:54:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-01-25T14:54:03.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-01-25T14:54:03.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:03.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:03 smithi170 ceph-mon[31899]: Reconfiguring daemon mon.c on smithi191 2024-01-25T14:54:03.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:03.893 DEBUG:teuthology.orchestra.run.smithi186:mgr.y> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mgr.y.service 2024-01-25T14:54:03.896 DEBUG:teuthology.orchestra.run.smithi191:mgr.z> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mgr.z.service 2024-01-25T14:54:03.899 INFO:tasks.cephadm:Deploying OSDs... 2024-01-25T14:54:03.899 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T14:54:03.899 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2024-01-25T14:54:03.918 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-25T14:54:03.918 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2024-01-25T14:54:03.975 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-25T14:54:03.976 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T14:54:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-01-25T14:54:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T14:54:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T14:54:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-01-25 14:53:09.424918247 +0000 2024-01-25T14:54:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-01-25 14:48:21.364597244 +0000 2024-01-25T14:54:03.976 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-01-25 14:48:21.364597244 +0000 2024-01-25T14:54:03.976 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-01-25 14:48:21.364597244 +0000 2024-01-25T14:54:03.976 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-25T14:54:04.045 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-01-25T14:54:04.045 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-01-25T14:54:04.045 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000127982 s, 4.0 MB/s 2024-01-25T14:54:04.047 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-25T14:54:04.104 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2024-01-25T14:54:04.161 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-25T14:54:04.162 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T14:54:04.162 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-01-25T14:54:04.162 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T14:54:04.162 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T14:54:04.162 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-01-25 14:53:09.451917608 +0000 2024-01-25T14:54:04.162 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-01-25 14:48:21.704589150 +0000 2024-01-25T14:54:04.162 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-01-25 14:48:21.704589150 +0000 2024-01-25T14:54:04.162 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-01-25 14:48:21.704589150 +0000 2024-01-25T14:54:04.162 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-25T14:54:04.230 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-01-25T14:54:04.231 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-01-25T14:54:04.231 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000105292 s, 4.9 MB/s 2024-01-25T14:54:04.232 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-25T14:54:04.289 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2024-01-25T14:54:04.346 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-25T14:54:04.346 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T14:54:04.346 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-01-25T14:54:04.346 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T14:54:04.346 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T14:54:04.346 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-01-25 14:53:09.477916994 +0000 2024-01-25T14:54:04.346 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-01-25 14:48:22.035581270 +0000 2024-01-25T14:54:04.346 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-01-25 14:48:22.035581270 +0000 2024-01-25T14:54:04.346 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-01-25 14:48:22.035581270 +0000 2024-01-25T14:54:04.347 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-25T14:54:04.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:04 smithi170 ceph-mon[31899]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi170=x;smithi186=y;smithi191=z", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:54:04.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:04 smithi170 ceph-mon[31899]: Saving service mgr spec with placement smithi170=x;smithi186=y;smithi191=z;count:3 2024-01-25T14:54:04.401 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-01-25T14:54:04.402 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-01-25T14:54:04.402 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 9.8985e-05 s, 5.2 MB/s 2024-01-25T14:54:04.403 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-25T14:54:04.459 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2024-01-25T14:54:04.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:04 smithi191 ceph-mon[36347]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi170=x;smithi186=y;smithi191=z", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:54:04.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:04 smithi191 ceph-mon[36347]: Saving service mgr spec with placement smithi170=x;smithi186=y;smithi191=z;count:3 2024-01-25T14:54:04.515 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-25T14:54:04.515 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T14:54:04.515 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-01-25T14:54:04.515 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T14:54:04.515 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T14:54:04.516 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-01-25 14:53:09.503916379 +0000 2024-01-25T14:54:04.516 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-01-25 14:48:22.363573462 +0000 2024-01-25T14:54:04.516 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-01-25 14:48:22.363573462 +0000 2024-01-25T14:54:04.516 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-01-25 14:48:22.363573462 +0000 2024-01-25T14:54:04.516 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-25T14:54:04.582 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-01-25T14:54:04.583 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-01-25T14:54:04.583 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 9.1432e-05 s, 5.6 MB/s 2024-01-25T14:54:04.584 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-25T14:54:04.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:04 smithi186 ceph-mon[35697]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi170=x;smithi186=y;smithi191=z", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:54:04.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:04 smithi186 ceph-mon[35697]: Saving service mgr spec with placement smithi170=x;smithi186=y;smithi191=z;count:3 2024-01-25T14:54:04.640 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-01-25T14:54:04.640 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/scratch_devs of=/dev/stdout 2024-01-25T14:54:04.660 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-25T14:54:04.660 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_1 2024-01-25T14:54:04.717 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-25T14:54:04.717 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T14:54:04.717 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-01-25T14:54:04.717 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T14:54:04.717 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T14:54:04.718 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-01-25 14:53:50.925574961 +0000 2024-01-25T14:54:04.718 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-01-25 14:48:48.870277064 +0000 2024-01-25T14:54:04.718 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-01-25 14:48:48.870277064 +0000 2024-01-25T14:54:04.718 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-01-25 14:48:48.870277064 +0000 2024-01-25T14:54:04.718 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-25T14:54:04.788 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-01-25T14:54:04.788 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-01-25T14:54:04.788 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000387657 s, 1.3 MB/s 2024-01-25T14:54:04.789 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-25T14:54:04.848 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_2 2024-01-25T14:54:04.905 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-25T14:54:04.905 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T14:54:04.906 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 681 Links: 1 2024-01-25T14:54:04.906 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T14:54:04.906 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T14:54:04.906 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-01-25 14:53:50.925574961 +0000 2024-01-25T14:54:04.906 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-01-25 14:48:49.212271091 +0000 2024-01-25T14:54:04.906 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-01-25 14:48:49.212271091 +0000 2024-01-25T14:54:04.906 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-01-25 14:48:49.212271091 +0000 2024-01-25T14:54:04.906 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-25T14:54:04.974 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-01-25T14:54:04.974 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-01-25T14:54:04.974 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000252741 s, 2.0 MB/s 2024-01-25T14:54:04.975 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-25T14:54:05.033 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_3 2024-01-25T14:54:05.090 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-25T14:54:05.090 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T14:54:05.090 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 700 Links: 1 2024-01-25T14:54:05.090 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T14:54:05.090 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T14:54:05.090 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-01-25 14:53:50.925574961 +0000 2024-01-25T14:54:05.090 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-01-25 14:48:49.560265014 +0000 2024-01-25T14:54:05.090 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-01-25 14:48:49.560265014 +0000 2024-01-25T14:54:05.090 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-01-25 14:48:49.560265014 +0000 2024-01-25T14:54:05.090 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-25T14:54:05.157 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-01-25T14:54:05.157 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-01-25T14:54:05.157 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000228082 s, 2.2 MB/s 2024-01-25T14:54:05.158 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-25T14:54:05.215 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_4 2024-01-25T14:54:05.271 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-25T14:54:05.271 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T14:54:05.271 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-01-25T14:54:05.271 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T14:54:05.272 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T14:54:05.272 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-01-25 14:53:50.926574943 +0000 2024-01-25T14:54:05.272 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-01-25 14:48:49.879259443 +0000 2024-01-25T14:54:05.272 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-01-25 14:48:49.879259443 +0000 2024-01-25T14:54:05.272 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-01-25 14:48:49.879259443 +0000 2024-01-25T14:54:05.272 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-25T14:54:05.337 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-01-25T14:54:05.338 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-01-25T14:54:05.338 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000279338 s, 1.8 MB/s 2024-01-25T14:54:05.339 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-25T14:54:05.395 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2024-01-25T14:54:05.395 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2024-01-25T14:54:05.411 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-25T14:54:05.411 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2024-01-25T14:54:05.465 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-25T14:54:05.465 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T14:54:05.466 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-01-25T14:54:05.466 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T14:54:05.466 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T14:54:05.466 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-01-25 14:53:41.726183697 +0000 2024-01-25T14:54:05.466 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-01-25 14:48:38.159881049 +0000 2024-01-25T14:54:05.466 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-01-25 14:48:38.159881049 +0000 2024-01-25T14:54:05.466 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-01-25 14:48:38.159881049 +0000 2024-01-25T14:54:05.466 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-25T14:54:05.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:05 smithi191 ceph-mon[36347]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:05.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:05 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:05.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:05 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:05.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:05 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:05.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:05 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:05.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:05 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:05.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:05 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:05.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:05 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-25T14:54:05.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:05 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-25T14:54:05.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:05 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-25T14:54:05.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:05 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:05.509 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-01-25T14:54:05.509 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-01-25T14:54:05.509 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000274812 s, 1.9 MB/s 2024-01-25T14:54:05.510 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-25T14:54:05.566 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2024-01-25T14:54:05.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:05 smithi186 ceph-mon[35697]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:05.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:05 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:05.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:05 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:05.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:05 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:05.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:05 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:05.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:05 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:05.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:05 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:05.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:05 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-25T14:54:05.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:05 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-25T14:54:05.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:05 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-25T14:54:05.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:05 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:05.620 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-25T14:54:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T14:54:05.621 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 680 Links: 1 2024-01-25T14:54:05.621 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T14:54:05.621 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T14:54:05.621 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-01-25 14:53:41.726183697 +0000 2024-01-25T14:54:05.621 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-01-25 14:48:38.492875084 +0000 2024-01-25T14:54:05.621 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-01-25 14:48:38.492875084 +0000 2024-01-25T14:54:05.621 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-01-25 14:48:38.492875084 +0000 2024-01-25T14:54:05.622 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-25T14:54:05.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:05 smithi170 ceph-mon[31899]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:05.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:05 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:05.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:05 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:05.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:05 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:05.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:05 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:05.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:05 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:05.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:05 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:05.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:05 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-25T14:54:05.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:05 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-25T14:54:05.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:05 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-25T14:54:05.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:05 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:05.687 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-01-25T14:54:05.687 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-01-25T14:54:05.687 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000202608 s, 2.5 MB/s 2024-01-25T14:54:05.689 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-25T14:54:05.744 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2024-01-25T14:54:05.798 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-25T14:54:05.798 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T14:54:05.798 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-01-25T14:54:05.798 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T14:54:05.798 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T14:54:05.799 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-01-25 14:53:41.727183680 +0000 2024-01-25T14:54:05.799 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-01-25 14:48:38.826869099 +0000 2024-01-25T14:54:05.799 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-01-25 14:48:38.826869099 +0000 2024-01-25T14:54:05.799 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-01-25 14:48:38.826869099 +0000 2024-01-25T14:54:05.799 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-25T14:54:05.864 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-01-25T14:54:05.865 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-01-25T14:54:05.865 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000250048 s, 2.0 MB/s 2024-01-25T14:54:05.866 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-25T14:54:05.922 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2024-01-25T14:54:05.977 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-25T14:54:05.977 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-25T14:54:05.977 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 5h/5d Inode: 719 Links: 1 2024-01-25T14:54:05.977 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T14:54:05.977 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2024-01-25T14:54:05.977 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2024-01-25 14:53:41.727183680 +0000 2024-01-25T14:54:05.977 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2024-01-25 14:48:39.159863134 +0000 2024-01-25T14:54:05.978 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2024-01-25 14:48:39.159863134 +0000 2024-01-25T14:54:05.978 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: 2024-01-25 14:48:39.159863134 +0000 2024-01-25T14:54:05.978 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-25T14:54:06.042 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2024-01-25T14:54:06.043 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2024-01-25T14:54:06.043 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000232698 s, 2.2 MB/s 2024-01-25T14:54:06.044 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-25T14:54:06.100 INFO:tasks.cephadm:Deploying osd.0 on smithi170 with /dev/vg_nvme/lv_4... 2024-01-25T14:54:06.100 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-01-25T14:54:06.345 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:54:06.459 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:06 smithi170 ceph-mon[31899]: Deploying daemon mgr.z on smithi191 2024-01-25T14:54:06.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:06 smithi191 ceph-mon[36347]: Deploying daemon mgr.z on smithi191 2024-01-25T14:54:06.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:06 smithi186 ceph-mon[35697]: Deploying daemon mgr.z on smithi191 2024-01-25T14:54:07.172 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:06 smithi191 systemd[1]: Starting Ceph mgr.z for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T14:54:07.454 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:07 smithi191 ceph-mon[36347]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:07.454 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:07 smithi191 podman[38189]: 2024-01-25 14:54:07.074228845 +0000 UTC m=+0.017199753 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T14:54:07.454 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:07 smithi191 podman[38189]: 2024-01-25 14:54:07.184074122 +0000 UTC m=+0.127045011 container create d0dadc34146bbe7a19b6b1cb58dabd2f21b8a52b956712bb732052459497cc4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, GIT_CLEAN=True) 2024-01-25T14:54:07.454 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:07 smithi191 podman[38189]: 2024-01-25 14:54:07.387120679 +0000 UTC m=+0.330091585 container init d0dadc34146bbe7a19b6b1cb58dabd2f21b8a52b956712bb732052459497cc4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-01-25T14:54:07.454 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:07 smithi191 podman[38189]: 2024-01-25 14:54:07.389970039 +0000 UTC m=+0.332940928 container start d0dadc34146bbe7a19b6b1cb58dabd2f21b8a52b956712bb732052459497cc4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS) 2024-01-25T14:54:07.454 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:07 smithi191 ceph-mgr[38210]: -- 172.21.15.191:0/2647517761 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b051097520 con 0x55b05106c800 2024-01-25T14:54:07.454 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:07 smithi191 bash[38189]: d0dadc34146bbe7a19b6b1cb58dabd2f21b8a52b956712bb732052459497cc4d 2024-01-25T14:54:07.506 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:07 smithi186 ceph-mon[35697]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:07.582 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:07 smithi170 ceph-mon[31899]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:07.714 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:07 smithi191 systemd[1]: Started Ceph mgr.z for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:54:07.984 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:07 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:07.939+0000 7fa85f4bd200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-25T14:54:08.272 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-01-25T14:54:08.272 INFO:teuthology.orchestra.run.smithi170.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-01-25T14:54:08.272 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10+0 records in 2024-01-25T14:54:08.272 INFO:teuthology.orchestra.run.smithi170.stderr:10+0 records out 2024-01-25T14:54:08.272 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00849309 s, 1.2 GB/s 2024-01-25T14:54:08.272 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping successful for: 2024-01-25T14:54:08.483 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:08 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:08.034+0000 7fa85f4bd200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-25T14:54:08.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:08 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:08.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:08 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:08.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:08 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:08.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:08 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-25T14:54:08.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:08 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-25T14:54:08.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:08 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-25T14:54:08.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:08 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:08.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:08 smithi191 ceph-mon[36347]: Deploying daemon mgr.y on smithi186 2024-01-25T14:54:08.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:08 smithi191 ceph-mon[36347]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:08.773 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:08 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:08.680+0000 7fa85f4bd200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-25T14:54:08.773 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:08 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:08.771+0000 7fa85f4bd200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-25T14:54:08.822 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:08 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:08.822 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:08 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:08.822 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:08 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:08.822 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:08 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-25T14:54:08.822 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:08 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-25T14:54:08.822 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:08 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-25T14:54:08.822 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:08 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:08.822 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:08 smithi186 ceph-mon[35697]: Deploying daemon mgr.y on smithi186 2024-01-25T14:54:08.822 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:08 smithi186 ceph-mon[35697]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:08.838 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:08 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:08.839 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:08 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:08.839 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:08 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:08.839 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:08 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-25T14:54:08.839 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:08 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-01-25T14:54:08.839 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:08 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-25T14:54:08.839 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:08 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:08.839 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:08 smithi170 ceph-mon[31899]: Deploying daemon mgr.y on smithi186 2024-01-25T14:54:08.839 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:08 smithi170 ceph-mon[31899]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:08.867 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch daemon add osd smithi170:vg_nvme/lv_4 2024-01-25T14:54:09.086 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:08 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:08.854+0000 7fa85f4bd200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-25T14:54:09.086 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:09 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:09.005+0000 7fa85f4bd200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-25T14:54:09.086 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:09 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:09.085+0000 7fa85f4bd200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-25T14:54:09.102 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:54:09.438 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:09 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:09.258+0000 7fa85f4bd200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-25T14:54:09.438 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:09 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:09.437+0000 7fa85f4bd200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-25T14:54:09.701 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:09 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:09.522+0000 7fa85f4bd200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-25T14:54:09.702 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:09 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:09.614+0000 7fa85f4bd200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-25T14:54:09.702 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:09 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:09.700+0000 7fa85f4bd200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-25T14:54:10.104 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:09 smithi186 systemd[1]: Started Ceph mgr.y for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:54:10.577 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.576+0000 7fade668a700 1 -- 172.21.15.170:0/3383572556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade0101d90 msgr2=0x7fade01021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.576+0000 7fade668a700 1 --2- 172.21.15.170:0/3383572556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade0101d90 0x7fade01021b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009990 tx=0x7fadd0009ca0 comp rx=0 tx=0).stop 2024-01-25T14:54:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.576+0000 7fade668a700 1 -- 172.21.15.170:0/3383572556 shutdown_connections 2024-01-25T14:54:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.576+0000 7fade668a700 1 --2- 172.21.15.170:0/3383572556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade0101320 0x7fade0108bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.576+0000 7fade668a700 1 --2- 172.21.15.170:0/3383572556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade0101d90 0x7fade01021b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.576+0000 7fade668a700 1 --2- 172.21.15.170:0/3383572556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fade0100960 0x7fade0100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.576+0000 7fade668a700 1 -- 172.21.15.170:0/3383572556 >> 172.21.15.170:0/3383572556 conn(0x7fade00fb450 msgr2=0x7fade00fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:54:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.576+0000 7fade668a700 1 -- 172.21.15.170:0/3383572556 shutdown_connections 2024-01-25T14:54:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.576+0000 7fade668a700 1 -- 172.21.15.170:0/3383572556 wait complete. 2024-01-25T14:54:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.576+0000 7fade668a700 1 Processor -- start 2024-01-25T14:54:10.578 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7fade668a700 1 -- start start 2024-01-25T14:54:10.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7fade668a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade0100960 0x7fade0104700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:10.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7fade668a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fade0101320 0x7fade0102d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:10.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7fade668a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade0101d90 0x7fade0103290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:10.580 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7fade668a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade0103a10 con 0x7fade0101d90 2024-01-25T14:54:10.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7fade668a700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade0103b80 con 0x7fade0101320 2024-01-25T14:54:10.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7fade668a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade01a1790 con 0x7fade0100960 2024-01-25T14:54:10.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7fade4c27700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade0101d90 0x7fade0103290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:10.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7fade4c27700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade0101d90 0x7fade0103290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:40042/0 (socket says 172.21.15.170:40042) 2024-01-25T14:54:10.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7fade4c27700 1 -- 172.21.15.170:0/2795614683 learned_addr learned my addr 172.21.15.170:0/2795614683 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:54:10.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7faddffff700 1 --2- 172.21.15.170:0/2795614683 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade0100960 0x7fade0104700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:10.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7faddf7fe700 1 --2- 172.21.15.170:0/2795614683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fade0101320 0x7fade0102d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:10.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7fade4c27700 1 -- 172.21.15.170:0/2795614683 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade0100960 msgr2=0x7fade0104700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:10.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7fade4c27700 1 --2- 172.21.15.170:0/2795614683 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade0100960 0x7fade0104700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:10.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7fade4c27700 1 -- 172.21.15.170:0/2795614683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fade0101320 msgr2=0x7fade0102d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:10.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7fade4c27700 1 --2- 172.21.15.170:0/2795614683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fade0101320 0x7fade0102d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:10.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7fade4c27700 1 -- 172.21.15.170:0/2795614683 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd00095f0 con 0x7fade0101d90 2024-01-25T14:54:10.581 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.577+0000 7faddffff700 1 --2- 172.21.15.170:0/2795614683 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade0100960 0x7fade0104700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T14:54:10.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.578+0000 7fade4c27700 1 --2- 172.21.15.170:0/2795614683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade0101d90 0x7fade0103290 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fadd8007ee0 tx=0x7fadd800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:54:10.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.578+0000 7faddd7fa700 1 -- 172.21.15.170:0/2795614683 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd800dd20 con 0x7fade0101d90 2024-01-25T14:54:10.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.578+0000 7faddd7fa700 1 -- 172.21.15.170:0/2795614683 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadd800f040 con 0x7fade0101d90 2024-01-25T14:54:10.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.578+0000 7fade668a700 1 -- 172.21.15.170:0/2795614683 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade01a1a70 con 0x7fade0101d90 2024-01-25T14:54:10.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.578+0000 7faddd7fa700 1 -- 172.21.15.170:0/2795614683 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd80048a0 con 0x7fade0101d90 2024-01-25T14:54:10.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.578+0000 7fade668a700 1 -- 172.21.15.170:0/2795614683 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade01a1f20 con 0x7fade0101d90 2024-01-25T14:54:10.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.579+0000 7faddd7fa700 1 -- 172.21.15.170:0/2795614683 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 13) v1 ==== 45698+0+0 (secure 0 0 0) 0x7fadd8015400 con 0x7fade0101d90 2024-01-25T14:54:10.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.579+0000 7faddd7fa700 1 --2- 172.21.15.170:0/2795614683 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fadc8038d20 0x7fadc803b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:10.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.579+0000 7faddd7fa700 1 -- 172.21.15.170:0/2795614683 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fadd804aeb0 con 0x7fade0101d90 2024-01-25T14:54:10.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.579+0000 7faddffff700 1 --2- 172.21.15.170:0/2795614683 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fadc8038d20 0x7fadc803b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:10.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.579+0000 7fade668a700 1 -- 172.21.15.170:0/2795614683 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade00684a0 con 0x7fade0101d90 2024-01-25T14:54:10.582 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.579+0000 7faddffff700 1 --2- 172.21.15.170:0/2795614683 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fadc8038d20 0x7fadc803b1e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fadd000b2e0 tx=0x7fadd0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:54:10.585 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.584+0000 7faddd7fa700 1 -- 172.21.15.170:0/2795614683 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fadd80138f0 con 0x7fade0101d90 2024-01-25T14:54:10.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:10.790+0000 7fade668a700 1 -- 172.21.15.170:0/2795614683 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fade00fd620 con 0x7fadc8038d20 2024-01-25T14:54:10.854 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:10 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:10.390+0000 7fac9639f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-25T14:54:10.855 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:10 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:10.484+0000 7fac9639f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-25T14:54:11.052 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:10 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:10.789+0000 7fa85f4bd200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-25T14:54:11.052 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:10 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:10.924+0000 7fa85f4bd200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-25T14:54:11.052 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:11.052 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:11.052 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:11.052 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:11.052 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:10 smithi191 ceph-mon[36347]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:11.052 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:11.052 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:54:11.053 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:54:11.053 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:11.254 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:11 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:11.154+0000 7fac9639f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-25T14:54:11.254 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:11 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:11.253+0000 7fac9639f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-25T14:54:11.254 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:11.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:11.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:11.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:11.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:10 smithi186 ceph-mon[35697]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:11.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:11.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:54:11.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:54:11.255 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:11.357 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:11 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:11.120+0000 7fa85f4bd200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-25T14:54:11.358 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:11 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:11.356+0000 7fa85f4bd200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-25T14:54:11.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:11.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:11.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:11.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:11.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:10 smithi170 ceph-mon[31899]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:11.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:11.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:54:11.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:54:11.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:11.584 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:11 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:11.339+0000 7fac9639f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-25T14:54:11.584 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:11 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:11.494+0000 7fac9639f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-25T14:54:11.584 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:11 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:11.583+0000 7fac9639f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-25T14:54:11.732 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:11 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:11.543+0000 7fa85f4bd200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-25T14:54:11.732 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:11 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:11.731+0000 7fa85f4bd200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-25T14:54:11.854 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:11 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:11.761+0000 7fac9639f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-25T14:54:12.208 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:11 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:11.942+0000 7fac9639f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-25T14:54:12.208 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:12 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:12.027+0000 7fac9639f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-25T14:54:12.209 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:12 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:12.119+0000 7fac9639f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-25T14:54:12.209 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:12 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:12.207+0000 7fac9639f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-25T14:54:12.209 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:12 smithi186 ceph-mon[35697]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:54:12.209 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.209 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.209 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.209 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.209 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.209 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:12.209 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:12.209 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.209 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-25T14:54:12.210 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-25T14:54:12.210 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:12.280 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:12 smithi170 ceph-mon[31899]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:54:12.280 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.280 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.280 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.280 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.280 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.280 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:12.280 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:12.280 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.280 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-25T14:54:12.281 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-25T14:54:12.281 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:12.475 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:11 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:11.994+0000 7fa85f4bd200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-25T14:54:12.476 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:12 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:12.080+0000 7fa85f4bd200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-25T14:54:12.476 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:12 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:12.474+0000 7fa85f4bd200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-25T14:54:12.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:12 smithi191 ceph-mon[36347]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:54:12.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:12.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:12.476 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:12.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-01-25T14:54:12.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-01-25T14:54:12.477 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:13.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:13 smithi191 ceph-mon[36347]: Reconfiguring mgr.x (unknown last config time)... 2024-01-25T14:54:13.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:13 smithi191 ceph-mon[36347]: Reconfiguring daemon mgr.x on smithi170 2024-01-25T14:54:13.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:13 smithi191 ceph-mon[36347]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:13.484 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:13 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:13.259+0000 7fa85f4bd200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-25T14:54:13.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:13 smithi186 ceph-mon[35697]: Reconfiguring mgr.x (unknown last config time)... 2024-01-25T14:54:13.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:13 smithi186 ceph-mon[35697]: Reconfiguring daemon mgr.x on smithi170 2024-01-25T14:54:13.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:13 smithi186 ceph-mon[35697]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:13.584 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:13 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:13.264+0000 7fac9639f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-25T14:54:13.585 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:13 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:13.393+0000 7fac9639f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-25T14:54:13.585 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:13 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:13.583+0000 7fac9639f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-25T14:54:13.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:13 smithi170 ceph-mon[31899]: Reconfiguring mgr.x (unknown last config time)... 2024-01-25T14:54:13.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:13 smithi170 ceph-mon[31899]: Reconfiguring daemon mgr.x on smithi170 2024-01-25T14:54:13.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:13 smithi170 ceph-mon[31899]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:13.854 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:13 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:13.813+0000 7fac9639f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-25T14:54:14.119 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:13 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:13.827+0000 7fa85f4bd200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-25T14:54:14.119 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:13 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:13.923+0000 7fa85f4bd200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-25T14:54:14.119 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 14:54:14 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z[38205]: 2024-01-25T14:54:14.118+0000 7fa85f4bd200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-25T14:54:14.354 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:13 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:13.989+0000 7fac9639f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-25T14:54:14.354 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:14 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:14.169+0000 7fac9639f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-25T14:54:14.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:14 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3779762052' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b3a88cc-9c73-40fc-8c14-5e146fe81c0d"}]: dispatch 2024-01-25T14:54:14.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:14 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3779762052' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b3a88cc-9c73-40fc-8c14-5e146fe81c0d"}]': finished 2024-01-25T14:54:14.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:14 smithi186 ceph-mon[35697]: osdmap e5: 1 total, 0 up, 1 in 2024-01-25T14:54:14.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:14.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:14 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3989691856' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:54:14.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:14 smithi186 ceph-mon[35697]: Standby manager daemon z started 2024-01-25T14:54:14.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:14 smithi186 ceph-mon[35697]: from='mgr.? 172.21.15.191:0/2660739681' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-01-25T14:54:14.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:14 smithi186 ceph-mon[35697]: from='mgr.? 172.21.15.191:0/2660739681' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-25T14:54:14.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:14 smithi186 ceph-mon[35697]: from='mgr.? 172.21.15.191:0/2660739681' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-01-25T14:54:14.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:14 smithi186 ceph-mon[35697]: from='mgr.? 172.21.15.191:0/2660739681' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-25T14:54:14.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:14.385+0000 7faddd7fa700 1 -- 172.21.15.170:0/2795614683 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mgrmap(e 14) v1 ==== 90769+0+0 (secure 0 0 0) 0x7fadd80143a0 con 0x7fade0101d90 2024-01-25T14:54:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:14 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3779762052' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b3a88cc-9c73-40fc-8c14-5e146fe81c0d"}]: dispatch 2024-01-25T14:54:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:14 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3779762052' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b3a88cc-9c73-40fc-8c14-5e146fe81c0d"}]': finished 2024-01-25T14:54:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:14 smithi191 ceph-mon[36347]: osdmap e5: 1 total, 0 up, 1 in 2024-01-25T14:54:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:14 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3989691856' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:54:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:14 smithi191 ceph-mon[36347]: Standby manager daemon z started 2024-01-25T14:54:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:14 smithi191 ceph-mon[36347]: from='mgr.? 172.21.15.191:0/2660739681' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-01-25T14:54:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:14 smithi191 ceph-mon[36347]: from='mgr.? 172.21.15.191:0/2660739681' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-25T14:54:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:14 smithi191 ceph-mon[36347]: from='mgr.? 172.21.15.191:0/2660739681' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-01-25T14:54:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:14 smithi191 ceph-mon[36347]: from='mgr.? 172.21.15.191:0/2660739681' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-25T14:54:14.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:14 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3779762052' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b3a88cc-9c73-40fc-8c14-5e146fe81c0d"}]: dispatch 2024-01-25T14:54:14.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:14 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3779762052' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b3a88cc-9c73-40fc-8c14-5e146fe81c0d"}]': finished 2024-01-25T14:54:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:14 smithi170 ceph-mon[31899]: osdmap e5: 1 total, 0 up, 1 in 2024-01-25T14:54:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:14 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3989691856' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:54:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:14 smithi170 ceph-mon[31899]: Standby manager daemon z started 2024-01-25T14:54:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:14 smithi170 ceph-mon[31899]: from='mgr.? 172.21.15.191:0/2660739681' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-01-25T14:54:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:14 smithi170 ceph-mon[31899]: from='mgr.? 172.21.15.191:0/2660739681' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-25T14:54:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:14 smithi170 ceph-mon[31899]: from='mgr.? 172.21.15.191:0/2660739681' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-01-25T14:54:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:14 smithi170 ceph-mon[31899]: from='mgr.? 172.21.15.191:0/2660739681' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-25T14:54:14.854 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:14 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:14.432+0000 7fac9639f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-25T14:54:14.854 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:14 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:14.516+0000 7fac9639f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-25T14:54:15.171 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:14 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:14.908+0000 7fac9639f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-25T14:54:15.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:15 smithi191 ceph-mon[36347]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:15.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:15 smithi191 ceph-mon[36347]: mgrmap e14: x(active, since 78s), standbys: z 2024-01-25T14:54:15.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-01-25T14:54:15.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:15 smithi186 ceph-mon[35697]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:15.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:15 smithi186 ceph-mon[35697]: mgrmap e14: x(active, since 78s), standbys: z 2024-01-25T14:54:15.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-01-25T14:54:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:15 smithi170 ceph-mon[31899]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:15 smithi170 ceph-mon[31899]: mgrmap e14: x(active, since 78s), standbys: z 2024-01-25T14:54:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-01-25T14:54:16.104 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:15 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:15.683+0000 7fac9639f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-25T14:54:16.534 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:16 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:16.246+0000 7fac9639f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-25T14:54:16.651 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:16 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:16.340+0000 7fac9639f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-25T14:54:16.651 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 14:54:16 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y[37102]: 2024-01-25T14:54:16.533+0000 7fac9639f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-25T14:54:17.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:17.183+0000 7faddd7fa700 1 -- 172.21.15.170:0/2795614683 <== mon.0 v2:172.21.15.170:3300/0 8 ==== mgrmap(e 15) v1 ==== 135840+0+0 (secure 0 0 0) 0x7fadd800e140 con 0x7fade0101d90 2024-01-25T14:54:17.313 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:17 smithi170 ceph-mon[31899]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:17.313 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:17 smithi170 ceph-mon[31899]: Standby manager daemon y started 2024-01-25T14:54:17.313 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:17 smithi170 ceph-mon[31899]: from='mgr.? 172.21.15.186:0/3013771054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-25T14:54:17.313 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:17 smithi170 ceph-mon[31899]: from='mgr.? 172.21.15.186:0/3013771054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-25T14:54:17.313 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:17 smithi170 ceph-mon[31899]: from='mgr.? 172.21.15.186:0/3013771054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-25T14:54:17.313 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:17 smithi170 ceph-mon[31899]: from='mgr.? 172.21.15.186:0/3013771054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-25T14:54:17.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:17 smithi191 ceph-mon[36347]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:17.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:17 smithi191 ceph-mon[36347]: Standby manager daemon y started 2024-01-25T14:54:17.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:17 smithi191 ceph-mon[36347]: from='mgr.? 172.21.15.186:0/3013771054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-25T14:54:17.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:17 smithi191 ceph-mon[36347]: from='mgr.? 172.21.15.186:0/3013771054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-25T14:54:17.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:17 smithi191 ceph-mon[36347]: from='mgr.? 172.21.15.186:0/3013771054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-25T14:54:17.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:17 smithi191 ceph-mon[36347]: from='mgr.? 172.21.15.186:0/3013771054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-25T14:54:17.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:17 smithi186 ceph-mon[35697]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:17.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:17 smithi186 ceph-mon[35697]: Standby manager daemon y started 2024-01-25T14:54:17.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:17 smithi186 ceph-mon[35697]: from='mgr.? 172.21.15.186:0/3013771054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-01-25T14:54:17.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:17 smithi186 ceph-mon[35697]: from='mgr.? 172.21.15.186:0/3013771054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-01-25T14:54:17.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:17 smithi186 ceph-mon[35697]: from='mgr.? 172.21.15.186:0/3013771054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-01-25T14:54:17.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:17 smithi186 ceph-mon[35697]: from='mgr.? 172.21.15.186:0/3013771054' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-01-25T14:54:18.462 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:18 smithi170 ceph-mon[31899]: mgrmap e15: x(active, since 81s), standbys: z, y 2024-01-25T14:54:18.462 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:18 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-25T14:54:18.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:18 smithi191 ceph-mon[36347]: mgrmap e15: x(active, since 81s), standbys: z, y 2024-01-25T14:54:18.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:18 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-25T14:54:18.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:18 smithi186 ceph-mon[35697]: mgrmap e15: x(active, since 81s), standbys: z, y 2024-01-25T14:54:18.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:18 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-01-25T14:54:19.439 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:19 smithi170 ceph-mon[31899]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:19.439 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:19.439 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:19.439 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:19.439 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:19.439 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:19.439 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:19.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:19 smithi191 ceph-mon[36347]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:19 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:19 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:19 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:19 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:19 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:19 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:19.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:19 smithi186 ceph-mon[35697]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:19.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:19 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:19.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:19 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:19.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:19 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:19.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:19 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:19.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:19 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:19.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:19 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:21.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:21 smithi191 ceph-mon[36347]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:21.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:21 smithi186 ceph-mon[35697]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:21.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:21 smithi170 ceph-mon[31899]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:22.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:22 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-25T14:54:22.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:22 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:22.589 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:22 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-25T14:54:22.589 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:22 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:22.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:22 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-01-25T14:54:22.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:22 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:23.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:23 smithi170 ceph-mon[31899]: Deploying daemon osd.0 on smithi170 2024-01-25T14:54:23.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:23 smithi170 ceph-mon[31899]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:23.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:23 smithi191 ceph-mon[36347]: Deploying daemon osd.0 on smithi170 2024-01-25T14:54:23.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:23 smithi191 ceph-mon[36347]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:23.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:23 smithi186 ceph-mon[35697]: Deploying daemon osd.0 on smithi170 2024-01-25T14:54:23.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:23 smithi186 ceph-mon[35697]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:25.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:25 smithi191 ceph-mon[36347]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:25.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:25 smithi186 ceph-mon[35697]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:25 smithi170 ceph-mon[31899]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:27.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:27 smithi170 ceph-mon[31899]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:27.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:27.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:27.478 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:27.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:27 smithi191 ceph-mon[36347]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:27.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:27.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:27 smithi186 ceph-mon[35697]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:27.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:27.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:27.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:29.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:28 smithi170 ceph-mon[31899]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:29.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:28 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:29.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:28 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:29.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:28 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:29.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:28 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:29.047 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:28 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:29.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:28 smithi191 ceph-mon[36347]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:29.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:28 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:29.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:28 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:29.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:28 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:29.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:28 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:29.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:28 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:29.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:28 smithi186 ceph-mon[35697]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:29.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:28 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:29.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:28 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:29.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:28 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:29.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:28 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:29.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:28 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:30.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:30.199+0000 7faddd7fa700 1 -- 172.21.15.170:0/2795614683 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fade00fd620 con 0x7fadc8038d20 2024-01-25T14:54:30.199 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 0 on host 'smithi170' 2024-01-25T14:54:30.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:30.201+0000 7fade668a700 1 -- 172.21.15.170:0/2795614683 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fadc8038d20 msgr2=0x7fadc803b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:30.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:30.201+0000 7fade668a700 1 --2- 172.21.15.170:0/2795614683 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fadc8038d20 0x7fadc803b1e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fadd000b2e0 tx=0x7fadd0005fd0 comp rx=0 tx=0).stop 2024-01-25T14:54:30.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:30.201+0000 7fade668a700 1 -- 172.21.15.170:0/2795614683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade0101d90 msgr2=0x7fade0103290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:30.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:30.201+0000 7fade668a700 1 --2- 172.21.15.170:0/2795614683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade0101d90 0x7fade0103290 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fadd8007ee0 tx=0x7fadd800d3b0 comp rx=0 tx=0).stop 2024-01-25T14:54:30.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:30.201+0000 7fade668a700 1 -- 172.21.15.170:0/2795614683 shutdown_connections 2024-01-25T14:54:30.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:30.201+0000 7fade668a700 1 --2- 172.21.15.170:0/2795614683 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fadc8038d20 0x7fadc803b1e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:30.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:30.201+0000 7fade668a700 1 --2- 172.21.15.170:0/2795614683 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fade0100960 0x7fade0104700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:30.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:30.201+0000 7fade668a700 1 --2- 172.21.15.170:0/2795614683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fade0101d90 0x7fade0103290 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:30.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:30.201+0000 7fade668a700 1 --2- 172.21.15.170:0/2795614683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fade0101320 0x7fade0102d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:30.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:30.201+0000 7fade668a700 1 -- 172.21.15.170:0/2795614683 >> 172.21.15.170:0/2795614683 conn(0x7fade00fb450 msgr2=0x7fade00fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:54:30.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:30.201+0000 7fade668a700 1 -- 172.21.15.170:0/2795614683 shutdown_connections 2024-01-25T14:54:30.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:54:30.201+0000 7fade668a700 1 -- 172.21.15.170:0/2795614683 wait complete. 2024-01-25T14:54:30.846 DEBUG:teuthology.orchestra.run.smithi170:osd.0> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.0.service 2024-01-25T14:54:30.849 INFO:tasks.cephadm:Deploying osd.1 on smithi186 with /dev/vg_nvme/lv_4... 2024-01-25T14:54:30.849 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-01-25T14:54:31.090 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.b/config 2024-01-25T14:54:31.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:31 smithi170 ceph-mon[31899]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:31.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:31 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:31.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:31 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:31.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:31 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:31.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:31 smithi170 ceph-mon[31899]: from='osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-25T14:54:31.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:31 smithi186 ceph-mon[35697]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:31.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:31 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:31.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:31 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:31.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:31 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:31.436 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:31 smithi186 ceph-mon[35697]: from='osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-25T14:54:31.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:31 smithi191 ceph-mon[36347]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:31.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:31 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:31.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:31 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:31.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:31 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:31.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:31 smithi191 ceph-mon[36347]: from='osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-01-25T14:54:32.404 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:32 smithi186 ceph-mon[35697]: from='osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-25T14:54:32.404 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:32 smithi186 ceph-mon[35697]: osdmap e6: 1 total, 0 up, 1 in 2024-01-25T14:54:32.404 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:32 smithi186 ceph-mon[35697]: from='osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-01-25T14:54:32.404 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:32 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:32.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:32 smithi191 ceph-mon[36347]: from='osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-25T14:54:32.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:32 smithi191 ceph-mon[36347]: osdmap e6: 1 total, 0 up, 1 in 2024-01-25T14:54:32.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:32 smithi191 ceph-mon[36347]: from='osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-01-25T14:54:32.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:32 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:32.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:32 smithi170 ceph-mon[31899]: from='osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-01-25T14:54:32.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:32 smithi170 ceph-mon[31899]: osdmap e6: 1 total, 0 up, 1 in 2024-01-25T14:54:32.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:32 smithi170 ceph-mon[31899]: from='osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-01-25T14:54:32.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:32 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:32.958 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-01-25T14:54:32.958 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-01-25T14:54:32.959 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-01-25T14:54:32.959 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-01-25T14:54:32.959 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0132505 s, 791 MB/s 2024-01-25T14:54:32.959 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-01-25T14:54:33.194 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 14:54:32 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-0[46420]: 2024-01-25T14:54:32.885+0000 7f3306f6b700 -1 osd.0 0 waiting for initial osdmap 2024-01-25T14:54:33.194 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 14:54:32 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-0[46420]: 2024-01-25T14:54:32.888+0000 7f32ff55e700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T14:54:33.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:33 smithi191 ceph-mon[36347]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:33.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:33 smithi191 ceph-mon[36347]: from='osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-01-25T14:54:33.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:33 smithi191 ceph-mon[36347]: osdmap e7: 1 total, 0 up, 1 in 2024-01-25T14:54:33.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:33 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:33.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:33 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:33.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:33 smithi191 ceph-mon[36347]: from='osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675]' entity='osd.0' 2024-01-25T14:54:33.592 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:33 smithi186 ceph-mon[35697]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:33.593 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:33 smithi186 ceph-mon[35697]: from='osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-01-25T14:54:33.593 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:33 smithi186 ceph-mon[35697]: osdmap e7: 1 total, 0 up, 1 in 2024-01-25T14:54:33.593 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:33 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:33.593 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:33 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:33.593 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:33 smithi186 ceph-mon[35697]: from='osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675]' entity='osd.0' 2024-01-25T14:54:33.620 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch daemon add osd smithi186:vg_nvme/lv_4 2024-01-25T14:54:33.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:33 smithi170 ceph-mon[31899]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:33.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:33 smithi170 ceph-mon[31899]: from='osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-01-25T14:54:33.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:33 smithi170 ceph-mon[31899]: osdmap e7: 1 total, 0 up, 1 in 2024-01-25T14:54:33.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:33 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:33.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:33 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:33.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:33 smithi170 ceph-mon[31899]: from='osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675]' entity='osd.0' 2024-01-25T14:54:33.867 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.b/config 2024-01-25T14:54:34.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:34 smithi186 ceph-mon[35697]: purged_snaps scrub starts 2024-01-25T14:54:34.242 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:34 smithi186 ceph-mon[35697]: purged_snaps scrub ok 2024-01-25T14:54:34.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:34.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:34.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:34.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:54:34.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:34.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:34.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:34.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:34.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:34 smithi186 ceph-mon[35697]: osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675] boot 2024-01-25T14:54:34.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:34 smithi186 ceph-mon[35697]: osdmap e8: 1 total, 1 up, 1 in 2024-01-25T14:54:34.243 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:34.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:34 smithi191 ceph-mon[36347]: purged_snaps scrub starts 2024-01-25T14:54:34.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:34 smithi191 ceph-mon[36347]: purged_snaps scrub ok 2024-01-25T14:54:34.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:34.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:34.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:34.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:54:34.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:34.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:34.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:34.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:34.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:34 smithi191 ceph-mon[36347]: osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675] boot 2024-01-25T14:54:34.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:34 smithi191 ceph-mon[36347]: osdmap e8: 1 total, 1 up, 1 in 2024-01-25T14:54:34.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:34.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:34 smithi170 ceph-mon[31899]: purged_snaps scrub starts 2024-01-25T14:54:34.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:34 smithi170 ceph-mon[31899]: purged_snaps scrub ok 2024-01-25T14:54:34.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:34.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:34.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:34.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:54:34.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:34.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:34.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:34.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:34.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:34 smithi170 ceph-mon[31899]: osd.0 [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675] boot 2024-01-25T14:54:34.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:34 smithi170 ceph-mon[31899]: osdmap e8: 1 total, 1 up, 1 in 2024-01-25T14:54:34.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-01-25T14:54:35.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:35 smithi186 ceph-mon[35697]: Detected new or changed devices on smithi170 2024-01-25T14:54:35.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:35 smithi186 ceph-mon[35697]: Adjusting osd_memory_target on smithi170 to 17088M 2024-01-25T14:54:35.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:35 smithi186 ceph-mon[35697]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:35.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:35 smithi191 ceph-mon[36347]: Detected new or changed devices on smithi170 2024-01-25T14:54:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:35 smithi191 ceph-mon[36347]: Adjusting osd_memory_target on smithi170 to 17088M 2024-01-25T14:54:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:35 smithi191 ceph-mon[36347]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:35.503 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.502+0000 7f0c1a38e700 1 -- 172.21.15.186:0/1028875883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c14100740 msgr2=0x7f0c14100b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:35.504 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.502+0000 7f0c1a38e700 1 --2- 172.21.15.186:0/1028875883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c14100740 0x7f0c14100b60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0c080099c0 tx=0x7f0c08009cd0 comp rx=0 tx=0).stop 2024-01-25T14:54:35.504 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.502+0000 7f0c1a38e700 1 -- 172.21.15.186:0/1028875883 shutdown_connections 2024-01-25T14:54:35.504 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.502+0000 7f0c1a38e700 1 --2- 172.21.15.186:0/1028875883 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c141022e0 0x7f0c14108b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:35.504 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.502+0000 7f0c1a38e700 1 --2- 172.21.15.186:0/1028875883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c14100740 0x7f0c14100b60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:35.504 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.502+0000 7f0c1a38e700 1 --2- 172.21.15.186:0/1028875883 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c14101940 0x7f0c14101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:35.504 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.502+0000 7f0c1a38e700 1 -- 172.21.15.186:0/1028875883 >> 172.21.15.186:0/1028875883 conn(0x7f0c140fbd00 msgr2=0x7f0c140fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:54:35.504 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.502+0000 7f0c1a38e700 1 -- 172.21.15.186:0/1028875883 shutdown_connections 2024-01-25T14:54:35.504 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.502+0000 7f0c1a38e700 1 -- 172.21.15.186:0/1028875883 wait complete. 2024-01-25T14:54:35.504 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.503+0000 7f0c1a38e700 1 Processor -- start 2024-01-25T14:54:35.504 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.503+0000 7f0c1a38e700 1 -- start start 2024-01-25T14:54:35.506 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.503+0000 7f0c1a38e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c14100740 0x7f0c14196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:35.507 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.503+0000 7f0c1a38e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c14101940 0x7f0c14196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:35.507 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.503+0000 7f0c1a38e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c141022e0 0x7f0c1419db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:35.507 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.503+0000 7f0c1a38e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1419e0f0 con 0x7f0c141022e0 2024-01-25T14:54:35.507 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.503+0000 7f0c1a38e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1419e230 con 0x7f0c14101940 2024-01-25T14:54:35.507 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.503+0000 7f0c1a38e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c14069fa0 con 0x7f0c14100740 2024-01-25T14:54:35.507 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.503+0000 7f0c137fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c14101940 0x7f0c14196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:35.507 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.503+0000 7f0c137fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c14101940 0x7f0c14196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:40450/0 (socket says 172.21.15.186:40450) 2024-01-25T14:54:35.507 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.503+0000 7f0c137fe700 1 -- 172.21.15.186:0/681415872 learned_addr learned my addr 172.21.15.186:0/681415872 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-01-25T14:54:35.507 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.503+0000 7f0c13fff700 1 --2- 172.21.15.186:0/681415872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c14100740 0x7f0c14196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:35.507 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.503+0000 7f0c1892b700 1 --2- 172.21.15.186:0/681415872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c141022e0 0x7f0c1419db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:35.507 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.504+0000 7f0c137fe700 1 -- 172.21.15.186:0/681415872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c14100740 msgr2=0x7f0c14196560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:35.507 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.504+0000 7f0c137fe700 1 --2- 172.21.15.186:0/681415872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c14100740 0x7f0c14196560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:35.507 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.504+0000 7f0c137fe700 1 -- 172.21.15.186:0/681415872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c141022e0 msgr2=0x7f0c1419db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:35.508 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.504+0000 7f0c137fe700 1 --2- 172.21.15.186:0/681415872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c141022e0 0x7f0c1419db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:35.508 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.504+0000 7f0c137fe700 1 -- 172.21.15.186:0/681415872 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c080095f0 con 0x7f0c14101940 2024-01-25T14:54:35.508 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.504+0000 7f0c137fe700 1 --2- 172.21.15.186:0/681415872 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c14101940 0x7f0c14196aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400c9b0 tx=0x7f0c0400cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:54:35.508 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.504+0000 7f0c117fa700 1 -- 172.21.15.186:0/681415872 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04007b00 con 0x7f0c14101940 2024-01-25T14:54:35.508 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.504+0000 7f0c1a38e700 1 -- 172.21.15.186:0/681415872 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c1406a280 con 0x7f0c14101940 2024-01-25T14:54:35.508 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.504+0000 7f0c117fa700 1 -- 172.21.15.186:0/681415872 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c04007c60 con 0x7f0c14101940 2024-01-25T14:54:35.508 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.504+0000 7f0c117fa700 1 -- 172.21.15.186:0/681415872 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04018660 con 0x7f0c14101940 2024-01-25T14:54:35.508 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.504+0000 7f0c1a38e700 1 -- 172.21.15.186:0/681415872 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c1406a780 con 0x7f0c14101940 2024-01-25T14:54:35.508 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.505+0000 7f0c1a38e700 1 -- 172.21.15.186:0/681415872 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c14107b00 con 0x7f0c14101940 2024-01-25T14:54:35.508 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.506+0000 7f0c117fa700 1 -- 172.21.15.186:0/681415872 <== mon.2 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 15) v1 ==== 135840+0+0 (secure 0 0 0) 0x7f0c04018880 con 0x7f0c14101940 2024-01-25T14:54:35.509 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.506+0000 7f0c117fa700 1 --2- 172.21.15.186:0/681415872 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0bfc0a12e0 0x7f0bfc0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:35.509 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.507+0000 7f0c117fa700 1 -- 172.21.15.186:0/681415872 <== mon.2 v2:172.21.15.186:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f0c040cb0f0 con 0x7f0c14101940 2024-01-25T14:54:35.509 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.507+0000 7f0c13fff700 1 --2- 172.21.15.186:0/681415872 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0bfc0a12e0 0x7f0bfc0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:35.509 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.507+0000 7f0c13fff700 1 --2- 172.21.15.186:0/681415872 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0bfc0a12e0 0x7f0bfc0a37a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0c080036f0 tx=0x7f0c08005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:54:35.512 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.511+0000 7f0c117fa700 1 -- 172.21.15.186:0/681415872 <== mon.2 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f0c04095fe0 con 0x7f0c14101940 2024-01-25T14:54:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:35 smithi170 ceph-mon[31899]: Detected new or changed devices on smithi170 2024-01-25T14:54:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:35 smithi170 ceph-mon[31899]: Adjusting osd_memory_target on smithi170 to 17088M 2024-01-25T14:54:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:35 smithi170 ceph-mon[31899]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-01-25T14:54:35.712 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:35.711+0000 7f0c1a38e700 1 -- 172.21.15.186:0/681415872 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c1402d540 con 0x7f0bfc0a12e0 2024-01-25T14:54:36.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:36 smithi191 ceph-mon[36347]: osdmap e9: 1 total, 1 up, 1 in 2024-01-25T14:54:36.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:36 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:54:36.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:36 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:54:36.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:36 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:36.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:36 smithi186 ceph-mon[35697]: osdmap e9: 1 total, 1 up, 1 in 2024-01-25T14:54:36.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:36 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:54:36.563 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:36 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:54:36.563 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:36 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:36 smithi170 ceph-mon[31899]: osdmap e9: 1 total, 1 up, 1 in 2024-01-25T14:54:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:36 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:54:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:36 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:54:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:36 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:37.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:37 smithi186 ceph-mon[35697]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:54:37.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:37 smithi186 ceph-mon[35697]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:37.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:37 smithi191 ceph-mon[36347]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:54:37.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:37 smithi191 ceph-mon[36347]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:37.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:37 smithi170 ceph-mon[31899]: from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:54:37.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:37 smithi170 ceph-mon[31899]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:39.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:38 smithi191 ceph-mon[36347]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:39.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:38 smithi191 ceph-mon[36347]: from='client.? 172.21.15.186:0/267136716' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98a73f57-0d6f-4c4a-a576-bb8de76c7350"}]: dispatch 2024-01-25T14:54:39.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:38 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98a73f57-0d6f-4c4a-a576-bb8de76c7350"}]: dispatch 2024-01-25T14:54:39.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:38 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98a73f57-0d6f-4c4a-a576-bb8de76c7350"}]': finished 2024-01-25T14:54:39.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:38 smithi191 ceph-mon[36347]: osdmap e10: 2 total, 1 up, 2 in 2024-01-25T14:54:39.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:38 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:39.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:38 smithi186 ceph-mon[35697]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:39.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:38 smithi186 ceph-mon[35697]: from='client.? 172.21.15.186:0/267136716' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98a73f57-0d6f-4c4a-a576-bb8de76c7350"}]: dispatch 2024-01-25T14:54:39.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:38 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98a73f57-0d6f-4c4a-a576-bb8de76c7350"}]: dispatch 2024-01-25T14:54:39.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:38 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98a73f57-0d6f-4c4a-a576-bb8de76c7350"}]': finished 2024-01-25T14:54:39.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:38 smithi186 ceph-mon[35697]: osdmap e10: 2 total, 1 up, 2 in 2024-01-25T14:54:39.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:38 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:39.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:38 smithi170 ceph-mon[31899]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:39.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:38 smithi170 ceph-mon[31899]: from='client.? 172.21.15.186:0/267136716' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98a73f57-0d6f-4c4a-a576-bb8de76c7350"}]: dispatch 2024-01-25T14:54:39.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:38 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "98a73f57-0d6f-4c4a-a576-bb8de76c7350"}]: dispatch 2024-01-25T14:54:39.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:38 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "98a73f57-0d6f-4c4a-a576-bb8de76c7350"}]': finished 2024-01-25T14:54:39.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:38 smithi170 ceph-mon[31899]: osdmap e10: 2 total, 1 up, 2 in 2024-01-25T14:54:39.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:38 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:40.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:39 smithi191 ceph-mon[36347]: from='client.? 172.21.15.186:0/4254662243' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:54:40.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:39 smithi186 ceph-mon[35697]: from='client.? 172.21.15.186:0/4254662243' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:54:40.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:39 smithi170 ceph-mon[31899]: from='client.? 172.21.15.186:0/4254662243' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:54:41.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:40 smithi191 ceph-mon[36347]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:41.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:40 smithi186 ceph-mon[35697]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:41.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:40 smithi170 ceph-mon[31899]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:43.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:43 smithi191 ceph-mon[36347]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:43.487 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:43 smithi186 ceph-mon[35697]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:43.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:43 smithi170 ceph-mon[31899]: pgmap v53: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:45.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:45 smithi191 ceph-mon[36347]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:45.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:45 smithi186 ceph-mon[35697]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:45.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:45 smithi170 ceph-mon[31899]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:46.473 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-25T14:54:46.473 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:46.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-25T14:54:46.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:46.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-01-25T14:54:46.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:47.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:47 smithi186 ceph-mon[35697]: Deploying daemon osd.1 on smithi186 2024-01-25T14:54:47.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:47 smithi186 ceph-mon[35697]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:47.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:47 smithi191 ceph-mon[36347]: Deploying daemon osd.1 on smithi186 2024-01-25T14:54:47.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:47 smithi191 ceph-mon[36347]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:47.525 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:47 smithi170 ceph-mon[31899]: Deploying daemon osd.1 on smithi186 2024-01-25T14:54:47.525 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:47 smithi170 ceph-mon[31899]: pgmap v55: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:49.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:48 smithi170 ceph-mon[31899]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:49.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:48 smithi191 ceph-mon[36347]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:49.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:48 smithi186 ceph-mon[35697]: pgmap v56: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:51.448 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:51 smithi186 ceph-mon[35697]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:51.448 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:51.448 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:51.448 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:51 smithi191 ceph-mon[36347]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:51.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:51 smithi170 ceph-mon[31899]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:51.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:51.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:51.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:53.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:53 smithi191 ceph-mon[36347]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:53 smithi186 ceph-mon[35697]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:53 smithi170 ceph-mon[31899]: pgmap v58: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:54.375 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:54.374+0000 7f0c117fa700 1 -- 172.21.15.186:0/681415872 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0c1402d540 con 0x7f0bfc0a12e0 2024-01-25T14:54:54.375 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 1 on host 'smithi186' 2024-01-25T14:54:54.377 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:54.376+0000 7f0c1a38e700 1 -- 172.21.15.186:0/681415872 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0bfc0a12e0 msgr2=0x7f0bfc0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:54.377 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:54.376+0000 7f0c1a38e700 1 --2- 172.21.15.186:0/681415872 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0bfc0a12e0 0x7f0bfc0a37a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0c080036f0 tx=0x7f0c08005fb0 comp rx=0 tx=0).stop 2024-01-25T14:54:54.377 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:54.376+0000 7f0c1a38e700 1 -- 172.21.15.186:0/681415872 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c14101940 msgr2=0x7f0c14196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:54.377 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:54.376+0000 7f0c1a38e700 1 --2- 172.21.15.186:0/681415872 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c14101940 0x7f0c14196aa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400c9b0 tx=0x7f0c0400cd70 comp rx=0 tx=0).stop 2024-01-25T14:54:54.377 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:54.376+0000 7f0c1a38e700 1 -- 172.21.15.186:0/681415872 shutdown_connections 2024-01-25T14:54:54.377 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:54.376+0000 7f0c1a38e700 1 --2- 172.21.15.186:0/681415872 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0bfc0a12e0 0x7f0bfc0a37a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:54.377 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:54.376+0000 7f0c1a38e700 1 --2- 172.21.15.186:0/681415872 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0c14100740 0x7f0c14196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:54.377 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:54.376+0000 7f0c1a38e700 1 --2- 172.21.15.186:0/681415872 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0c141022e0 0x7f0c1419db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:54.377 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:54.376+0000 7f0c1a38e700 1 --2- 172.21.15.186:0/681415872 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0c14101940 0x7f0c14196aa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:54.377 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:54.376+0000 7f0c1a38e700 1 -- 172.21.15.186:0/681415872 >> 172.21.15.186:0/681415872 conn(0x7f0c140fbd00 msgr2=0x7f0c14104c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:54:54.378 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:54.376+0000 7f0c1a38e700 1 -- 172.21.15.186:0/681415872 shutdown_connections 2024-01-25T14:54:54.378 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:54:54.376+0000 7f0c1a38e700 1 -- 172.21.15.186:0/681415872 wait complete. 2024-01-25T14:54:54.989 DEBUG:teuthology.orchestra.run.smithi186:osd.1> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.1.service 2024-01-25T14:54:54.991 INFO:tasks.cephadm:Deploying osd.2 on smithi191 with /dev/vg_nvme/lv_4... 2024-01-25T14:54:54.992 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-01-25T14:54:55.233 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T14:54:55.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:55 smithi186 ceph-mon[35697]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:55.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:55 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:55.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:55 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:55.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:55 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:55.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:55 smithi186 ceph-mon[35697]: from='osd.1 [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-25T14:54:55.274 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:55 smithi186 ceph-mon[35697]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-25T14:54:55.354 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:55 smithi191 ceph-mon[36347]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:55.355 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:55 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:55.355 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:55 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:55.355 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:55 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:55.355 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:55 smithi191 ceph-mon[36347]: from='osd.1 [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-25T14:54:55.355 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:55 smithi191 ceph-mon[36347]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-25T14:54:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:55 smithi170 ceph-mon[31899]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:55 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:55 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:55 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:54:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:55 smithi170 ceph-mon[31899]: from='osd.1 [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-25T14:54:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:55 smithi170 ceph-mon[31899]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-01-25T14:54:56.592 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:56 smithi191 ceph-mon[36347]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-25T14:54:56.593 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:56 smithi191 ceph-mon[36347]: osdmap e11: 2 total, 1 up, 2 in 2024-01-25T14:54:56.593 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:56.593 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:56 smithi191 ceph-mon[36347]: from='osd.1 [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:54:56.593 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:56 smithi191 ceph-mon[36347]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:54:56.593 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:56 smithi191 ceph-mon[36347]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:56.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:56 smithi186 ceph-mon[35697]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-25T14:54:56.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:56 smithi186 ceph-mon[35697]: osdmap e11: 2 total, 1 up, 2 in 2024-01-25T14:54:56.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:56.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:56 smithi186 ceph-mon[35697]: from='osd.1 [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:54:56.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:56 smithi186 ceph-mon[35697]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:54:56.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:56 smithi186 ceph-mon[35697]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:56.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:56 smithi170 ceph-mon[31899]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-01-25T14:54:56.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:56 smithi170 ceph-mon[31899]: osdmap e11: 2 total, 1 up, 2 in 2024-01-25T14:54:56.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:56.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:56 smithi170 ceph-mon[31899]: from='osd.1 [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:54:56.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:56 smithi170 ceph-mon[31899]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:54:56.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:56 smithi170 ceph-mon[31899]: pgmap v61: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:56.938 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-01-25T14:54:56.938 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-01-25T14:54:56.938 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2024-01-25T14:54:56.938 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2024-01-25T14:54:56.938 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112154 s, 935 MB/s 2024-01-25T14:54:56.938 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2024-01-25T14:54:57.534 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch daemon add osd smithi191:vg_nvme/lv_4 2024-01-25T14:54:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:57 smithi186 ceph-mon[35697]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-01-25T14:54:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:57 smithi186 ceph-mon[35697]: osdmap e12: 2 total, 1 up, 2 in 2024-01-25T14:54:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:57 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:57 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:57 smithi186 ceph-mon[35697]: from='osd.1 ' entity='osd.1' 2024-01-25T14:54:57.605 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 14:54:57 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-1[40320]: 2024-01-25T14:54:57.216+0000 7fc37e468700 -1 osd.1 0 waiting for initial osdmap 2024-01-25T14:54:57.605 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 14:54:57 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-1[40320]: 2024-01-25T14:54:57.223+0000 7fc376a5b700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T14:54:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:57 smithi191 ceph-mon[36347]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-01-25T14:54:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:57 smithi191 ceph-mon[36347]: osdmap e12: 2 total, 1 up, 2 in 2024-01-25T14:54:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:57 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:57 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:57 smithi191 ceph-mon[36347]: from='osd.1 ' entity='osd.1' 2024-01-25T14:54:57.766 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T14:54:57.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:57 smithi170 ceph-mon[31899]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-01-25T14:54:57.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:57 smithi170 ceph-mon[31899]: osdmap e12: 2 total, 1 up, 2 in 2024-01-25T14:54:57.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:57 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:57.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:57 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:57.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:57 smithi170 ceph-mon[31899]: from='osd.1 ' entity='osd.1' 2024-01-25T14:54:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: purged_snaps scrub starts 2024-01-25T14:54:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: purged_snaps scrub ok 2024-01-25T14:54:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: Detected new or changed devices on smithi186 2024-01-25T14:54:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:58.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:54:58.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: Adjusting osd_memory_target on smithi186 to 17080M 2024-01-25T14:54:58.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:58.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:58.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:58.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:58.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:58.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: osd.1 [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632] boot 2024-01-25T14:54:58.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: osdmap e13: 2 total, 2 up, 2 in 2024-01-25T14:54:58.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:54:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:58.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: purged_snaps scrub starts 2024-01-25T14:54:58.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: purged_snaps scrub ok 2024-01-25T14:54:58.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:58.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: Detected new or changed devices on smithi186 2024-01-25T14:54:58.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:58.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:58.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:54:58.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: Adjusting osd_memory_target on smithi186 to 17080M 2024-01-25T14:54:58.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:58.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:58.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:58.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:58.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:58.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: osd.1 [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632] boot 2024-01-25T14:54:58.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: osdmap e13: 2 total, 2 up, 2 in 2024-01-25T14:54:58.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:54:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:58.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: purged_snaps scrub starts 2024-01-25T14:54:58.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: purged_snaps scrub ok 2024-01-25T14:54:58.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:58.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: Detected new or changed devices on smithi186 2024-01-25T14:54:58.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:58.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:58.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:54:58.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: Adjusting osd_memory_target on smithi186 to 17080M 2024-01-25T14:54:58.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:58.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:54:58.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:54:58.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:54:58.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-01-25T14:54:58.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: osd.1 [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632] boot 2024-01-25T14:54:58.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: osdmap e13: 2 total, 2 up, 2 in 2024-01-25T14:54:58.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:54:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-01-25T14:54:59.288 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.285+0000 7f36db9cd700 1 -- 172.21.15.191:0/3025926040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4101910 msgr2=0x7f36d4101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:59.288 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.285+0000 7f36db9cd700 1 --2- 172.21.15.191:0/3025926040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4101910 0x7f36d4101d70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f36c4009990 tx=0x7f36c4009ca0 comp rx=0 tx=0).stop 2024-01-25T14:54:59.288 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.285+0000 7f36db9cd700 1 -- 172.21.15.191:0/3025926040 shutdown_connections 2024-01-25T14:54:59.288 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.285+0000 7f36db9cd700 1 --2- 172.21.15.191:0/3025926040 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36d41022b0 0x7f36d4108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:59.289 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.285+0000 7f36db9cd700 1 --2- 172.21.15.191:0/3025926040 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36d4100710 0x7f36d4100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:59.289 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.285+0000 7f36db9cd700 1 --2- 172.21.15.191:0/3025926040 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4101910 0x7f36d4101d70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:59.289 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.285+0000 7f36db9cd700 1 -- 172.21.15.191:0/3025926040 >> 172.21.15.191:0/3025926040 conn(0x7f36d40fbcb0 msgr2=0x7f36d40fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:54:59.289 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.285+0000 7f36db9cd700 1 -- 172.21.15.191:0/3025926040 shutdown_connections 2024-01-25T14:54:59.289 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.285+0000 7f36db9cd700 1 -- 172.21.15.191:0/3025926040 wait complete. 2024-01-25T14:54:59.289 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.286+0000 7f36db9cd700 1 Processor -- start 2024-01-25T14:54:59.289 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.286+0000 7f36db9cd700 1 -- start start 2024-01-25T14:54:59.289 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.286+0000 7f36db9cd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4100710 0x7f36d4069ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:59.289 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.286+0000 7f36db9cd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36d4101910 0x7f36d419c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:59.289 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.286+0000 7f36db9cd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36d41022b0 0x7f36d419eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:59.289 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.286+0000 7f36db9cd700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d419f2c0 con 0x7f36d4101910 2024-01-25T14:54:59.289 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.286+0000 7f36db9cd700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d419f430 con 0x7f36d41022b0 2024-01-25T14:54:59.289 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.286+0000 7f36db9cd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d419f5f0 con 0x7f36d4100710 2024-01-25T14:54:59.290 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.286+0000 7f36d9769700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4100710 0x7f36d4069ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:59.290 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.286+0000 7f36d9769700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4100710 0x7f36d4069ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:36776/0 (socket says 172.21.15.191:36776) 2024-01-25T14:54:59.290 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.286+0000 7f36d9769700 1 -- 172.21.15.191:0/2321177402 learned_addr learned my addr 172.21.15.191:0/2321177402 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-01-25T14:54:59.290 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.286+0000 7f36d9f6a700 1 --2- 172.21.15.191:0/2321177402 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36d41022b0 0x7f36d419eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:59.290 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.286+0000 7f36d8f68700 1 --2- 172.21.15.191:0/2321177402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36d4101910 0x7f36d419c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:59.290 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.287+0000 7f36d9769700 1 -- 172.21.15.191:0/2321177402 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36d41022b0 msgr2=0x7f36d419eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:59.290 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.287+0000 7f36d9769700 1 --2- 172.21.15.191:0/2321177402 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36d41022b0 0x7f36d419eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:59.290 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.287+0000 7f36d9769700 1 -- 172.21.15.191:0/2321177402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36d4101910 msgr2=0x7f36d419c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:54:59.290 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.287+0000 7f36d9769700 1 --2- 172.21.15.191:0/2321177402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36d4101910 0x7f36d419c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:54:59.290 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.287+0000 7f36d9769700 1 -- 172.21.15.191:0/2321177402 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c40095f0 con 0x7f36d4100710 2024-01-25T14:54:59.290 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.287+0000 7f36d9769700 1 --2- 172.21.15.191:0/2321177402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4100710 0x7f36d4069ff0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f36d000b500 tx=0x7f36d000b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:54:59.290 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.287+0000 7f36ca7fc700 1 -- 172.21.15.191:0/2321177402 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d0011830 con 0x7f36d4100710 2024-01-25T14:54:59.290 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.287+0000 7f36db9cd700 1 -- 172.21.15.191:0/2321177402 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d41963d0 con 0x7f36d4100710 2024-01-25T14:54:59.291 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.287+0000 7f36ca7fc700 1 -- 172.21.15.191:0/2321177402 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36d0011e50 con 0x7f36d4100710 2024-01-25T14:54:59.291 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.287+0000 7f36ca7fc700 1 -- 172.21.15.191:0/2321177402 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36d0010dc0 con 0x7f36d4100710 2024-01-25T14:54:59.291 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.287+0000 7f36db9cd700 1 -- 172.21.15.191:0/2321177402 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d4196950 con 0x7f36d4100710 2024-01-25T14:54:59.292 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.288+0000 7f36db9cd700 1 -- 172.21.15.191:0/2321177402 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d40684a0 con 0x7f36d4100710 2024-01-25T14:54:59.292 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.289+0000 7f36ca7fc700 1 -- 172.21.15.191:0/2321177402 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 15) v1 ==== 135840+0+0 (secure 0 0 0) 0x7f36d0010380 con 0x7f36d4100710 2024-01-25T14:54:59.292 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.290+0000 7f36ca7fc700 1 --2- 172.21.15.191:0/2321177402 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f36c00a12e0 0x7f36c00a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:54:59.292 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.290+0000 7f36d8f68700 1 --2- 172.21.15.191:0/2321177402 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f36c00a12e0 0x7f36c00a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:54:59.292 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.290+0000 7f36ca7fc700 1 -- 172.21.15.191:0/2321177402 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f36d00caca0 con 0x7f36d4100710 2024-01-25T14:54:59.292 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.290+0000 7f36d8f68700 1 --2- 172.21.15.191:0/2321177402 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f36c00a12e0 0x7f36c00a37a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f36d406a570 tx=0x7f36c4003860 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:54:59.295 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.295+0000 7f36ca7fc700 1 -- 172.21.15.191:0/2321177402 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f36d0095970 con 0x7f36d4100710 2024-01-25T14:54:59.497 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:54:59.497+0000 7f36db9cd700 1 -- 172.21.15.191:0/2321177402 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f36d402d510 con 0x7f36c00a12e0 2024-01-25T14:55:00.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:00 smithi191 ceph-mon[36347]: osdmap e14: 2 total, 2 up, 2 in 2024-01-25T14:55:00.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:00 smithi191 ceph-mon[36347]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:55:00.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:00 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:55:00.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:00 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:55:00.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:00 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:00.727 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:00 smithi191 ceph-mon[36347]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:00.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:00 smithi186 ceph-mon[35697]: osdmap e14: 2 total, 2 up, 2 in 2024-01-25T14:55:00.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:00 smithi186 ceph-mon[35697]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:55:00.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:00 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:55:00.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:00 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:55:00.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:00 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:00.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:00 smithi186 ceph-mon[35697]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:00.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:00 smithi170 ceph-mon[31899]: osdmap e14: 2 total, 2 up, 2 in 2024-01-25T14:55:00.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:00 smithi170 ceph-mon[31899]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:55:00.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:00 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:55:00.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:00 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:55:00.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:00 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:00.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:00 smithi170 ceph-mon[31899]: pgmap v66: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:02.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:02 smithi191 ceph-mon[36347]: from='client.? 172.21.15.191:0/137075613' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0379e70c-8d2d-4014-b174-f5f39f243368"}]: dispatch 2024-01-25T14:55:02.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:02 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0379e70c-8d2d-4014-b174-f5f39f243368"}]: dispatch 2024-01-25T14:55:02.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:02 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0379e70c-8d2d-4014-b174-f5f39f243368"}]': finished 2024-01-25T14:55:02.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:02 smithi191 ceph-mon[36347]: osdmap e15: 3 total, 2 up, 3 in 2024-01-25T14:55:02.337 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:02 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:02.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:02 smithi186 ceph-mon[35697]: from='client.? 172.21.15.191:0/137075613' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0379e70c-8d2d-4014-b174-f5f39f243368"}]: dispatch 2024-01-25T14:55:02.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:02 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0379e70c-8d2d-4014-b174-f5f39f243368"}]: dispatch 2024-01-25T14:55:02.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:02 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0379e70c-8d2d-4014-b174-f5f39f243368"}]': finished 2024-01-25T14:55:02.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:02 smithi186 ceph-mon[35697]: osdmap e15: 3 total, 2 up, 3 in 2024-01-25T14:55:02.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:02 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:02.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:02 smithi170 ceph-mon[31899]: from='client.? 172.21.15.191:0/137075613' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0379e70c-8d2d-4014-b174-f5f39f243368"}]: dispatch 2024-01-25T14:55:02.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:02 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0379e70c-8d2d-4014-b174-f5f39f243368"}]: dispatch 2024-01-25T14:55:02.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:02 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0379e70c-8d2d-4014-b174-f5f39f243368"}]': finished 2024-01-25T14:55:02.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:02 smithi170 ceph-mon[31899]: osdmap e15: 3 total, 2 up, 3 in 2024-01-25T14:55:02.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:02 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:03.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:03 smithi186 ceph-mon[35697]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:03.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:03 smithi186 ceph-mon[35697]: from='client.? 172.21.15.191:0/2654727599' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:55:03.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:03 smithi170 ceph-mon[31899]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:03.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:03 smithi170 ceph-mon[31899]: from='client.? 172.21.15.191:0/2654727599' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:55:03.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:03 smithi191 ceph-mon[36347]: pgmap v68: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:03.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:03 smithi191 ceph-mon[36347]: from='client.? 172.21.15.191:0/2654727599' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:55:05.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:05 smithi191 ceph-mon[36347]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:05.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:05 smithi186 ceph-mon[35697]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:05.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:05 smithi170 ceph-mon[31899]: pgmap v69: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:07.469 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:07 smithi191 ceph-mon[36347]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:07.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:07 smithi186 ceph-mon[35697]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:07.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:07 smithi170 ceph-mon[31899]: pgmap v70: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:09.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:08 smithi191 ceph-mon[36347]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:09.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:08 smithi186 ceph-mon[35697]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:09.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:08 smithi170 ceph-mon[31899]: pgmap v71: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:10.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:09 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-25T14:55:10.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:09 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:10.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:09 smithi191 ceph-mon[36347]: Deploying daemon osd.2 on smithi191 2024-01-25T14:55:10.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:09 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-25T14:55:10.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:09 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:10.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:09 smithi186 ceph-mon[35697]: Deploying daemon osd.2 on smithi191 2024-01-25T14:55:10.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:09 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-01-25T14:55:10.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:09 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:10.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:09 smithi170 ceph-mon[31899]: Deploying daemon osd.2 on smithi191 2024-01-25T14:55:11.061 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:10 smithi191 ceph-mon[36347]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:11.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:10 smithi186 ceph-mon[35697]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:11.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:10 smithi170 ceph-mon[31899]: pgmap v72: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:13.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:13 smithi191 ceph-mon[36347]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:13.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:13 smithi186 ceph-mon[35697]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:13.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:13 smithi170 ceph-mon[31899]: pgmap v73: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:15.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:15 smithi186 ceph-mon[35697]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:55:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:15 smithi170 ceph-mon[31899]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:55:15.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:15 smithi191 ceph-mon[36347]: pgmap v74: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:15.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:15.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:15.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:55:16.436 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:16 smithi191 ceph-mon[36347]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:16.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:16 smithi186 ceph-mon[35697]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:16.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:16 smithi170 ceph-mon[31899]: pgmap v75: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:17.761 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:55:17.759+0000 7f36ca7fc700 1 -- 172.21.15.191:0/2321177402 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f36d402d510 con 0x7f36c00a12e0 2024-01-25T14:55:17.761 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 2 on host 'smithi191' 2024-01-25T14:55:17.763 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:55:17.762+0000 7f36db9cd700 1 -- 172.21.15.191:0/2321177402 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f36c00a12e0 msgr2=0x7f36c00a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:55:17.763 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:55:17.762+0000 7f36db9cd700 1 --2- 172.21.15.191:0/2321177402 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f36c00a12e0 0x7f36c00a37a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f36d406a570 tx=0x7f36c4003860 comp rx=0 tx=0).stop 2024-01-25T14:55:17.764 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:55:17.762+0000 7f36db9cd700 1 -- 172.21.15.191:0/2321177402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4100710 msgr2=0x7f36d4069ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:55:17.764 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:55:17.762+0000 7f36db9cd700 1 --2- 172.21.15.191:0/2321177402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4100710 0x7f36d4069ff0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f36d000b500 tx=0x7f36d000b810 comp rx=0 tx=0).stop 2024-01-25T14:55:17.764 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:55:17.762+0000 7f36db9cd700 1 -- 172.21.15.191:0/2321177402 shutdown_connections 2024-01-25T14:55:17.764 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:55:17.762+0000 7f36db9cd700 1 --2- 172.21.15.191:0/2321177402 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f36c00a12e0 0x7f36c00a37a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:17.764 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:55:17.762+0000 7f36db9cd700 1 --2- 172.21.15.191:0/2321177402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f36d4100710 0x7f36d4069ff0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:17.764 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:55:17.762+0000 7f36db9cd700 1 --2- 172.21.15.191:0/2321177402 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36d41022b0 0x7f36d419eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:17.764 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:55:17.762+0000 7f36db9cd700 1 --2- 172.21.15.191:0/2321177402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f36d4101910 0x7f36d419c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:17.764 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:55:17.762+0000 7f36db9cd700 1 -- 172.21.15.191:0/2321177402 >> 172.21.15.191:0/2321177402 conn(0x7f36d40fbcb0 msgr2=0x7f36d4104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:55:17.764 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:55:17.762+0000 7f36db9cd700 1 -- 172.21.15.191:0/2321177402 shutdown_connections 2024-01-25T14:55:17.764 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:55:17.762+0000 7f36db9cd700 1 -- 172.21.15.191:0/2321177402 wait complete. 2024-01-25T14:55:17.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:17 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:17.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:17 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:17.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:17 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:17.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:17 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:55:17.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:17 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:17.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:17 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:17.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:17 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:17.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:17 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:55:18.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:17 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:18.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:17 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:18.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:17 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:18.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:17 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:55:18.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:17 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:18.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:17 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:18.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:17 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:18.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:17 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:55:18.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:17 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:18.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:17 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:18.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:17 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:18.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:17 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:55:18.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:17 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:18.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:17 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:18.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:17 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:18.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:17 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:55:18.397 DEBUG:teuthology.orchestra.run.smithi191:osd.2> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.2.service 2024-01-25T14:55:18.400 INFO:tasks.cephadm:Deploying osd.3 on smithi170 with /dev/vg_nvme/lv_3... 2024-01-25T14:55:18.400 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-01-25T14:55:18.648 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:55:19.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:18 smithi170 ceph-mon[31899]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:19.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:18 smithi170 ceph-mon[31899]: from='osd.2 [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-25T14:55:19.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:18 smithi170 ceph-mon[31899]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-25T14:55:19.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:18 smithi191 ceph-mon[36347]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:19.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:18 smithi191 ceph-mon[36347]: from='osd.2 [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-25T14:55:19.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:18 smithi191 ceph-mon[36347]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-25T14:55:19.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:18 smithi186 ceph-mon[35697]: pgmap v76: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:19.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:18 smithi186 ceph-mon[35697]: from='osd.2 [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-25T14:55:19.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:18 smithi186 ceph-mon[35697]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-01-25T14:55:20.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:19 smithi170 ceph-mon[31899]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-25T14:55:20.072 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:19 smithi170 ceph-mon[31899]: osdmap e16: 3 total, 2 up, 3 in 2024-01-25T14:55:20.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:19 smithi170 ceph-mon[31899]: from='osd.2 [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:55:20.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:20.073 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:19 smithi170 ceph-mon[31899]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:55:20.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:19 smithi191 ceph-mon[36347]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-25T14:55:20.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:19 smithi191 ceph-mon[36347]: osdmap e16: 3 total, 2 up, 3 in 2024-01-25T14:55:20.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:19 smithi191 ceph-mon[36347]: from='osd.2 [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:55:20.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:19 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:20.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:19 smithi191 ceph-mon[36347]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:55:20.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:19 smithi186 ceph-mon[35697]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-01-25T14:55:20.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:19 smithi186 ceph-mon[35697]: osdmap e16: 3 total, 2 up, 3 in 2024-01-25T14:55:20.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:19 smithi186 ceph-mon[35697]: from='osd.2 [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:55:20.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:19 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:20.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:19 smithi186 ceph-mon[35697]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:55:20.622 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-01-25T14:55:20.622 INFO:teuthology.orchestra.run.smithi170.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-01-25T14:55:20.622 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10+0 records in 2024-01-25T14:55:20.622 INFO:teuthology.orchestra.run.smithi170.stderr:10+0 records out 2024-01-25T14:55:20.622 INFO:teuthology.orchestra.run.smithi170.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00853116 s, 1.2 GB/s 2024-01-25T14:55:20.622 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping successful for: 2024-01-25T14:55:21.058 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:20 smithi191 ceph-mon[36347]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-01-25T14:55:21.058 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:20 smithi191 ceph-mon[36347]: osdmap e17: 3 total, 2 up, 3 in 2024-01-25T14:55:21.058 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:20 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:21.058 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:20 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:21.058 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:20 smithi191 ceph-mon[36347]: pgmap v79: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:21.058 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:20 smithi191 ceph-mon[36347]: from='osd.2 ' entity='osd.2' 2024-01-25T14:55:21.059 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 14:55:20 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-2[41508]: 2024-01-25T14:55:20.823+0000 7f3965eb7700 -1 osd.2 0 waiting for initial osdmap 2024-01-25T14:55:21.059 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 14:55:20 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-2[41508]: 2024-01-25T14:55:20.831+0000 7f395e4aa700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T14:55:21.220 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:20 smithi170 ceph-mon[31899]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-01-25T14:55:21.220 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:20 smithi170 ceph-mon[31899]: osdmap e17: 3 total, 2 up, 3 in 2024-01-25T14:55:21.220 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:20 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:21.220 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:20 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:21.220 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:20 smithi170 ceph-mon[31899]: pgmap v79: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:21.220 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:20 smithi170 ceph-mon[31899]: from='osd.2 ' entity='osd.2' 2024-01-25T14:55:21.246 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch daemon add osd smithi170:vg_nvme/lv_3 2024-01-25T14:55:21.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:20 smithi186 ceph-mon[35697]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-01-25T14:55:21.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:20 smithi186 ceph-mon[35697]: osdmap e17: 3 total, 2 up, 3 in 2024-01-25T14:55:21.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:20 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:21.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:20 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:21.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:20 smithi186 ceph-mon[35697]: pgmap v79: 0 pgs: ; 0 B data, 65 MiB used, 179 GiB / 179 GiB avail 2024-01-25T14:55:21.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:20 smithi186 ceph-mon[35697]: from='osd.2 ' entity='osd.2' 2024-01-25T14:55:21.487 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:55:22.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:21 smithi191 ceph-mon[36347]: purged_snaps scrub starts 2024-01-25T14:55:22.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:21 smithi191 ceph-mon[36347]: purged_snaps scrub ok 2024-01-25T14:55:22.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:21 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:22.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:21 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:22.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:21 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:22.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:21 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:55:22.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:21 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:22.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:21 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:22.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:21 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:55:22.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:21 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:22.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:21 smithi191 ceph-mon[36347]: osd.2 [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441] boot 2024-01-25T14:55:22.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:21 smithi191 ceph-mon[36347]: osdmap e18: 3 total, 3 up, 3 in 2024-01-25T14:55:22.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:21 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:22.292 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:21 smithi170 ceph-mon[31899]: purged_snaps scrub starts 2024-01-25T14:55:22.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:21 smithi170 ceph-mon[31899]: purged_snaps scrub ok 2024-01-25T14:55:22.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:21 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:22.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:21 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:22.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:21 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:22.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:21 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:55:22.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:21 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:22.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:21 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:22.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:21 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:55:22.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:21 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:22.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:21 smithi170 ceph-mon[31899]: osd.2 [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441] boot 2024-01-25T14:55:22.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:21 smithi170 ceph-mon[31899]: osdmap e18: 3 total, 3 up, 3 in 2024-01-25T14:55:22.293 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:21 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:22.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:21 smithi186 ceph-mon[35697]: purged_snaps scrub starts 2024-01-25T14:55:22.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:21 smithi186 ceph-mon[35697]: purged_snaps scrub ok 2024-01-25T14:55:22.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:21 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:22.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:21 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:22.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:21 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:22.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:21 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:55:22.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:21 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:22.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:21 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:22.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:21 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:55:22.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:21 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:22.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:21 smithi186 ceph-mon[35697]: osd.2 [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441] boot 2024-01-25T14:55:22.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:21 smithi186 ceph-mon[35697]: osdmap e18: 3 total, 3 up, 3 in 2024-01-25T14:55:22.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:21 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-01-25T14:55:23.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:22 smithi170 ceph-mon[31899]: Detected new or changed devices on smithi191 2024-01-25T14:55:23.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:22 smithi170 ceph-mon[31899]: Adjusting osd_memory_target on smithi191 to 17080M 2024-01-25T14:55:23.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:22 smithi170 ceph-mon[31899]: pgmap v81: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:23.071 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:22 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-01-25T14:55:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.075+0000 7f5ae6883700 1 -- 172.21.15.170:0/2108051083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ae0101950 msgr2=0x7f5ae0101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:55:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.075+0000 7f5ae6883700 1 --2- 172.21.15.170:0/2108051083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ae0101950 0x7f5ae0101db0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00099c0 tx=0x7f5ad0009cd0 comp rx=0 tx=0).stop 2024-01-25T14:55:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.075+0000 7f5ae6883700 1 -- 172.21.15.170:0/2108051083 shutdown_connections 2024-01-25T14:55:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.075+0000 7f5ae6883700 1 --2- 172.21.15.170:0/2108051083 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ae01022f0 0x7f5ae0108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.075+0000 7f5ae6883700 1 --2- 172.21.15.170:0/2108051083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ae0100750 0x7f5ae0100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:23.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.075+0000 7f5ae6883700 1 --2- 172.21.15.170:0/2108051083 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ae0101950 0x7f5ae0101db0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:23.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.075+0000 7f5ae6883700 1 -- 172.21.15.170:0/2108051083 >> 172.21.15.170:0/2108051083 conn(0x7f5ae00fbcd0 msgr2=0x7f5ae00fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:55:23.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.075+0000 7f5ae6883700 1 -- 172.21.15.170:0/2108051083 shutdown_connections 2024-01-25T14:55:23.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.075+0000 7f5ae6883700 1 -- 172.21.15.170:0/2108051083 wait complete. 2024-01-25T14:55:23.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.075+0000 7f5ae6883700 1 Processor -- start 2024-01-25T14:55:23.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.075+0000 7f5ae6883700 1 -- start start 2024-01-25T14:55:23.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae6883700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ae0100750 0x7f5ae006aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:55:23.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae6883700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ae0101950 0x7f5ae019a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:55:23.081 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae6883700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ae01022f0 0x7f5ae019a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:55:23.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae6883700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae019af90 con 0x7f5ae01022f0 2024-01-25T14:55:23.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae6883700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae019b100 con 0x7f5ae0100750 2024-01-25T14:55:23.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae6883700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae019b2c0 con 0x7f5ae0101950 2024-01-25T14:55:23.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae4e20700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ae01022f0 0x7f5ae019a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:55:23.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae4e20700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ae01022f0 0x7f5ae019a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44408/0 (socket says 172.21.15.170:44408) 2024-01-25T14:55:23.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae4e20700 1 -- 172.21.15.170:0/3236231593 learned_addr learned my addr 172.21.15.170:0/3236231593 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:55:23.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5adffff700 1 --2- 172.21.15.170:0/3236231593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ae0100750 0x7f5ae006aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:55:23.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5adf7fe700 1 --2- 172.21.15.170:0/3236231593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ae0101950 0x7f5ae019a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:55:23.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae4e20700 1 -- 172.21.15.170:0/3236231593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ae0101950 msgr2=0x7f5ae019a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:55:23.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae4e20700 1 --2- 172.21.15.170:0/3236231593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ae0101950 0x7f5ae019a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:23.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae4e20700 1 -- 172.21.15.170:0/3236231593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ae0100750 msgr2=0x7f5ae006aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:55:23.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae4e20700 1 --2- 172.21.15.170:0/3236231593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ae0100750 0x7f5ae006aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:23.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae4e20700 1 -- 172.21.15.170:0/3236231593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad00095f0 con 0x7f5ae01022f0 2024-01-25T14:55:23.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae4e20700 1 --2- 172.21.15.170:0/3236231593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ae01022f0 0x7f5ae019a7f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800ef30 tx=0x7f5ad800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:55:23.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5add7fa700 1 -- 172.21.15.170:0/3236231593 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8018070 con 0x7f5ae01022f0 2024-01-25T14:55:23.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5add7fa700 1 -- 172.21.15.170:0/3236231593 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ad800f040 con 0x7f5ae01022f0 2024-01-25T14:55:23.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae6883700 1 -- 172.21.15.170:0/3236231593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae019b540 con 0x7f5ae01022f0 2024-01-25T14:55:23.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5add7fa700 1 -- 172.21.15.170:0/3236231593 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8003dc0 con 0x7f5ae01022f0 2024-01-25T14:55:23.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.076+0000 7f5ae6883700 1 -- 172.21.15.170:0/3236231593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae019b9f0 con 0x7f5ae01022f0 2024-01-25T14:55:23.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.077+0000 7f5ae6883700 1 -- 172.21.15.170:0/3236231593 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae00684a0 con 0x7f5ae01022f0 2024-01-25T14:55:23.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.079+0000 7f5add7fa700 1 -- 172.21.15.170:0/3236231593 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 15) v1 ==== 135840+0+0 (secure 0 0 0) 0x7f5ad800caa0 con 0x7f5ae01022f0 2024-01-25T14:55:23.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.080+0000 7f5add7fa700 1 --2- 172.21.15.170:0/3236231593 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5ac80a12e0 0x7f5ac80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:55:23.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.080+0000 7f5adffff700 1 --2- 172.21.15.170:0/3236231593 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5ac80a12e0 0x7f5ac80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:55:23.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.080+0000 7f5add7fa700 1 -- 172.21.15.170:0/3236231593 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3226+0+0 (secure 0 0 0) 0x7f5ad80cbce0 con 0x7f5ae01022f0 2024-01-25T14:55:23.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.080+0000 7f5adffff700 1 --2- 172.21.15.170:0/3236231593 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5ac80a12e0 0x7f5ac80a37a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4005950 tx=0x7f5ad40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:55:23.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.083+0000 7f5add7fa700 1 -- 172.21.15.170:0/3236231593 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f5ad80966b0 con 0x7f5ae01022f0 2024-01-25T14:55:23.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:22 smithi191 ceph-mon[36347]: Detected new or changed devices on smithi191 2024-01-25T14:55:23.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:22 smithi191 ceph-mon[36347]: Adjusting osd_memory_target on smithi191 to 17080M 2024-01-25T14:55:23.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:22 smithi191 ceph-mon[36347]: pgmap v81: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:23.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:22 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-01-25T14:55:23.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:23.286+0000 7f5ae6883700 1 -- 172.21.15.170:0/3236231593 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ae019bc10 con 0x7f5ac80a12e0 2024-01-25T14:55:23.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:22 smithi186 ceph-mon[35697]: Detected new or changed devices on smithi191 2024-01-25T14:55:23.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:22 smithi186 ceph-mon[35697]: Adjusting osd_memory_target on smithi191 to 17080M 2024-01-25T14:55:23.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:22 smithi186 ceph-mon[35697]: pgmap v81: 0 pgs: ; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:23.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:22 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-01-25T14:55:24.133 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:23 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-01-25T14:55:24.133 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:23 smithi170 ceph-mon[31899]: osdmap e19: 3 total, 3 up, 3 in 2024-01-25T14:55:24.133 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:23 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-01-25T14:55:24.133 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:23 smithi170 ceph-mon[31899]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:55:24.133 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:23 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:55:24.133 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:23 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:55:24.134 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:23 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:24.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:23 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-01-25T14:55:24.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:23 smithi191 ceph-mon[36347]: osdmap e19: 3 total, 3 up, 3 in 2024-01-25T14:55:24.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:23 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-01-25T14:55:24.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:23 smithi191 ceph-mon[36347]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:55:24.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:23 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:55:24.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:23 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:55:24.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:23 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:24.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:23 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-01-25T14:55:24.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:23 smithi186 ceph-mon[35697]: osdmap e19: 3 total, 3 up, 3 in 2024-01-25T14:55:24.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:23 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-01-25T14:55:24.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:23 smithi186 ceph-mon[35697]: from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:55:24.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:23 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:55:24.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:23 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:55:24.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:23 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:24.577 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 14:55:24 smithi170 sudo[51268]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-25T14:55:24.577 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 14:55:24 smithi170 sudo[51268]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-25T14:55:24.577 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 14:55:24 smithi170 sudo[51268]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-25T14:55:24.577 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 14:55:24 smithi170 sudo[51268]: pam_unix(sudo:session): session closed for user root 2024-01-25T14:55:24.874 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 14:55:24 smithi170 sudo[51274]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-25T14:55:24.874 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 14:55:24 smithi170 sudo[51274]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-25T14:55:24.874 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 14:55:24 smithi170 sudo[51274]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-25T14:55:24.874 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 14:55:24 smithi170 sudo[51274]: pam_unix(sudo:session): session closed for user root 2024-01-25T14:55:25.104 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 14:55:24 smithi186 sudo[44501]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-25T14:55:25.104 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 14:55:24 smithi186 sudo[44501]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-25T14:55:25.105 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 14:55:24 smithi186 sudo[44501]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-25T14:55:25.105 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 14:55:24 smithi186 sudo[44501]: pam_unix(sudo:session): session closed for user root 2024-01-25T14:55:25.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-01-25T14:55:25.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:24 smithi186 ceph-mon[35697]: osdmap e20: 3 total, 3 up, 3 in 2024-01-25T14:55:25.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:24 smithi186 ceph-mon[35697]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:25.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:25.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-01-25T14:55:25.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:24 smithi170 ceph-mon[31899]: osdmap e20: 3 total, 3 up, 3 in 2024-01-25T14:55:25.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:24 smithi170 ceph-mon[31899]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:25.298 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:25.381 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-01-25T14:55:25.381 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:24 smithi191 ceph-mon[36347]: osdmap e20: 3 total, 3 up, 3 in 2024-01-25T14:55:25.381 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:24 smithi191 ceph-mon[36347]: pgmap v84: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:25.381 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:25.604 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 14:55:25 smithi186 sudo[44504]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-25T14:55:25.605 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 14:55:25 smithi186 sudo[44504]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-25T14:55:25.605 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 14:55:25 smithi186 sudo[44504]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-25T14:55:25.605 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 14:55:25 smithi186 sudo[44504]: pam_unix(sudo:session): session closed for user root 2024-01-25T14:55:25.633 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 14:55:25 smithi191 sudo[45302]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-25T14:55:25.633 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 14:55:25 smithi191 sudo[45302]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-25T14:55:25.633 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 14:55:25 smithi191 sudo[45302]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-25T14:55:25.633 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 14:55:25 smithi191 sudo[45302]: pam_unix(sudo:session): session closed for user root 2024-01-25T14:55:25.983 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 14:55:25 smithi191 sudo[45305]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-25T14:55:25.984 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 14:55:25 smithi191 sudo[45305]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-25T14:55:25.984 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 14:55:25 smithi191 sudo[45305]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-25T14:55:25.984 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 14:55:25 smithi191 sudo[45305]: pam_unix(sudo:session): session closed for user root 2024-01-25T14:55:26.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:25 smithi170 sudo[51345]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-25T14:55:26.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:25 smithi170 sudo[51345]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-25T14:55:26.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:25 smithi170 sudo[51345]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-25T14:55:26.160 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:25 smithi170 sudo[51345]: pam_unix(sudo:session): session closed for user root 2024-01-25T14:55:26.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:26.175+0000 7f5add7fa700 1 -- 172.21.15.170:0/3236231593 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f5ad8096a80 con 0x7f5ae01022f0 2024-01-25T14:55:26.420 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:26 smithi191 ceph-mon[36347]: osdmap e21: 3 total, 3 up, 3 in 2024-01-25T14:55:26.420 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:26 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:26.420 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:26 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:26.420 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:26 smithi191 sudo[45308]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-25T14:55:26.420 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:26 smithi191 sudo[45308]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-25T14:55:26.420 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:26 smithi191 sudo[45308]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-25T14:55:26.420 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:26 smithi191 sudo[45308]: pam_unix(sudo:session): session closed for user root 2024-01-25T14:55:26.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:26 smithi186 ceph-mon[35697]: osdmap e21: 3 total, 3 up, 3 in 2024-01-25T14:55:26.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:26 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:26.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:26 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:26 smithi170 sudo[51348]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-25T14:55:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:26 smithi170 sudo[51348]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-25T14:55:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:26 smithi170 sudo[51348]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-25T14:55:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:26 smithi170 sudo[51348]: pam_unix(sudo:session): session closed for user root 2024-01-25T14:55:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:26 smithi170 ceph-mon[31899]: osdmap e21: 3 total, 3 up, 3 in 2024-01-25T14:55:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:26 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:26 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:26.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:26 smithi191 sudo[45311]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-25T14:55:26.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:26 smithi191 sudo[45311]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-25T14:55:26.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:26 smithi191 sudo[45311]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-25T14:55:26.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:26 smithi191 sudo[45311]: pam_unix(sudo:session): session closed for user root 2024-01-25T14:55:27.150 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:26 smithi186 sudo[44507]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-01-25T14:55:27.150 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:26 smithi186 sudo[44507]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-25T14:55:27.150 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:26 smithi186 sudo[44507]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-25T14:55:27.150 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:26 smithi186 sudo[44507]: pam_unix(sudo:session): session closed for user root 2024-01-25T14:55:27.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-25T14:55:27.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:27.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-25T14:55:27.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:55:27.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:55:27.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:55:27.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-25T14:55:27.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-01-25T14:55:27.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:55:27.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:55:27.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:55:27.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1439063739' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2faea223-522c-4369-a25c-bdca49890e1b"}]: dispatch 2024-01-25T14:55:27.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-25T14:55:27.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-25T14:55:27.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:55:27.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:55:27.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:55:27.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1439063739' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2faea223-522c-4369-a25c-bdca49890e1b"}]': finished 2024-01-25T14:55:27.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: osdmap e22: 4 total, 3 up, 4 in 2024-01-25T14:55:27.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-25T14:55:27.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:27 smithi170 ceph-mon[31899]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-25T14:55:27.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-25T14:55:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-25T14:55:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:55:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:55:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:55:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-25T14:55:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-01-25T14:55:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:55:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:55:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:55:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1439063739' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2faea223-522c-4369-a25c-bdca49890e1b"}]: dispatch 2024-01-25T14:55:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-25T14:55:27.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-25T14:55:27.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:55:27.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:55:27.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:55:27.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1439063739' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2faea223-522c-4369-a25c-bdca49890e1b"}]': finished 2024-01-25T14:55:27.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: osdmap e22: 4 total, 3 up, 4 in 2024-01-25T14:55:27.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-25T14:55:27.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:27 smithi191 ceph-mon[36347]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-25T14:55:27.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 sudo[44510]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-01-25T14:55:27.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 sudo[44510]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-01-25T14:55:27.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 sudo[44510]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-01-25T14:55:27.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 sudo[44510]: pam_unix(sudo:session): session closed for user root 2024-01-25T14:55:27.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-25T14:55:27.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: pgmap v86: 1 pgs: 1 creating+peering; 0 B data, 96 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:27.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-25T14:55:27.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:55:27.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:55:27.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:55:27.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-25T14:55:27.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-01-25T14:55:27.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:55:27.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:55:27.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:55:27.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1439063739' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2faea223-522c-4369-a25c-bdca49890e1b"}]: dispatch 2024-01-25T14:55:27.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-25T14:55:27.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-01-25T14:55:27.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-01-25T14:55:27.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-01-25T14:55:27.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-01-25T14:55:27.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1439063739' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2faea223-522c-4369-a25c-bdca49890e1b"}]': finished 2024-01-25T14:55:27.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: osdmap e22: 4 total, 3 up, 4 in 2024-01-25T14:55:27.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-25T14:55:27.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:27 smithi186 ceph-mon[35697]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-01-25T14:55:28.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:28 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/4258593478' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:55:28.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:28 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/4258593478' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:55:28.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:28 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/4258593478' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:55:29.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:29 smithi191 ceph-mon[36347]: pgmap v88: 1 pgs: 1 creating+peering; 0 B data, 97 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:29.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:29 smithi186 ceph-mon[35697]: pgmap v88: 1 pgs: 1 creating+peering; 0 B data, 97 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:29.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:29 smithi170 ceph-mon[31899]: pgmap v88: 1 pgs: 1 creating+peering; 0 B data, 97 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:31.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:31 smithi191 ceph-mon[36347]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:31.535 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:31 smithi170 ceph-mon[31899]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:31.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:31 smithi186 ceph-mon[35697]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 103 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:33.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:33 smithi191 ceph-mon[36347]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:33.540 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:33 smithi170 ceph-mon[31899]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:33.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:33 smithi186 ceph-mon[35697]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:34.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-25T14:55:34.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:34.525 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-25T14:55:34.525 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:34.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-01-25T14:55:34.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:35 smithi170 ceph-mon[31899]: Deploying daemon osd.3 on smithi170 2024-01-25T14:55:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:35 smithi170 ceph-mon[31899]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:35.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:35 smithi191 ceph-mon[36347]: Deploying daemon osd.3 on smithi170 2024-01-25T14:55:35.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:35 smithi191 ceph-mon[36347]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:35.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:35 smithi186 ceph-mon[35697]: Deploying daemon osd.3 on smithi170 2024-01-25T14:55:35.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:35 smithi186 ceph-mon[35697]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:37.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:37 smithi170 ceph-mon[31899]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:37.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:37 smithi191 ceph-mon[36347]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:37.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:37 smithi186 ceph-mon[35697]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:39.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:38 smithi191 ceph-mon[36347]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:39.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:38 smithi186 ceph-mon[35697]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:39.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:38 smithi170 ceph-mon[31899]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:40.473 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:40 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:40.474 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:40 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:40.474 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:40 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:55:40.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:40 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:40.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:40 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:40.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:40 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:55:40.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:40 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:40.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:40 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:40.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:40 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:55:41.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:41 smithi170 ceph-mon[31899]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:41.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:41 smithi191 ceph-mon[36347]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:41.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:41 smithi186 ceph-mon[35697]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:42.594 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:42.592+0000 7f5add7fa700 1 -- 172.21.15.170:0/3236231593 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5ae019bc10 con 0x7f5ac80a12e0 2024-01-25T14:55:42.595 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 3 on host 'smithi170' 2024-01-25T14:55:42.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:42.595+0000 7f5ae6883700 1 -- 172.21.15.170:0/3236231593 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5ac80a12e0 msgr2=0x7f5ac80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:55:42.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:42.595+0000 7f5ae6883700 1 --2- 172.21.15.170:0/3236231593 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5ac80a12e0 0x7f5ac80a37a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4005950 tx=0x7f5ad40058e0 comp rx=0 tx=0).stop 2024-01-25T14:55:42.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:42.595+0000 7f5ae6883700 1 -- 172.21.15.170:0/3236231593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ae01022f0 msgr2=0x7f5ae019a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:55:42.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:42.595+0000 7f5ae6883700 1 --2- 172.21.15.170:0/3236231593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ae01022f0 0x7f5ae019a7f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ad800ef30 tx=0x7f5ad800c450 comp rx=0 tx=0).stop 2024-01-25T14:55:42.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:42.595+0000 7f5ae6883700 1 -- 172.21.15.170:0/3236231593 shutdown_connections 2024-01-25T14:55:42.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:42.595+0000 7f5ae6883700 1 --2- 172.21.15.170:0/3236231593 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5ac80a12e0 0x7f5ac80a37a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:42.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:42.595+0000 7f5ae6883700 1 --2- 172.21.15.170:0/3236231593 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ae01022f0 0x7f5ae019a7f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:42.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:42.595+0000 7f5ae6883700 1 --2- 172.21.15.170:0/3236231593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ae0100750 0x7f5ae006aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:42.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:42.595+0000 7f5ae6883700 1 --2- 172.21.15.170:0/3236231593 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ae0101950 0x7f5ae019a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:42.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:42.595+0000 7f5ae6883700 1 -- 172.21.15.170:0/3236231593 >> 172.21.15.170:0/3236231593 conn(0x7f5ae00fbcd0 msgr2=0x7f5ae0104d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:55:42.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:42.595+0000 7f5ae6883700 1 -- 172.21.15.170:0/3236231593 shutdown_connections 2024-01-25T14:55:42.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:55:42.595+0000 7f5ae6883700 1 -- 172.21.15.170:0/3236231593 wait complete. 2024-01-25T14:55:43.188 DEBUG:teuthology.orchestra.run.smithi170:osd.3> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.3.service 2024-01-25T14:55:43.190 INFO:tasks.cephadm:Deploying osd.4 on smithi186 with /dev/vg_nvme/lv_3... 2024-01-25T14:55:43.190 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-01-25T14:55:43.433 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.b/config 2024-01-25T14:55:43.450 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:43 smithi170 ceph-mon[31899]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:43.450 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:43 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:43.450 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:43 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:43.450 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:43 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:43.450 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:43 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:43.450 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:43 smithi170 ceph-mon[31899]: from='osd.3 [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-25T14:55:43.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:43 smithi191 ceph-mon[36347]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:43.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:43 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:43.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:43 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:43.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:43 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:43.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:43 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:43.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:43 smithi191 ceph-mon[36347]: from='osd.3 [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-25T14:55:43.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:43 smithi186 ceph-mon[35697]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:43.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:43 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:43.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:43 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:43.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:43 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:43.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:43 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:43.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:43 smithi186 ceph-mon[35697]: from='osd.3 [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-01-25T14:55:45.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:44 smithi186 ceph-mon[35697]: from='osd.3 [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-25T14:55:45.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:44 smithi186 ceph-mon[35697]: osdmap e23: 4 total, 3 up, 4 in 2024-01-25T14:55:45.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:44 smithi186 ceph-mon[35697]: from='osd.3 [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-01-25T14:55:45.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:44 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-25T14:55:45.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:44 smithi186 ceph-mon[35697]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:45.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:44 smithi191 ceph-mon[36347]: from='osd.3 [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-25T14:55:45.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:44 smithi191 ceph-mon[36347]: osdmap e23: 4 total, 3 up, 4 in 2024-01-25T14:55:45.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:44 smithi191 ceph-mon[36347]: from='osd.3 [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-01-25T14:55:45.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:44 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-25T14:55:45.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:44 smithi191 ceph-mon[36347]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:45.320 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:44 smithi170 ceph-mon[31899]: from='osd.3 [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-01-25T14:55:45.321 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:44 smithi170 ceph-mon[31899]: osdmap e23: 4 total, 3 up, 4 in 2024-01-25T14:55:45.321 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:44 smithi170 ceph-mon[31899]: from='osd.3 [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-01-25T14:55:45.321 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:44 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-25T14:55:45.321 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:44 smithi170 ceph-mon[31899]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 104 MiB used, 268 GiB / 268 GiB avail 2024-01-25T14:55:45.321 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 14:55:44 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-3[53398]: 2024-01-25T14:55:44.973+0000 7f512f140700 -1 osd.3 0 waiting for initial osdmap 2024-01-25T14:55:45.321 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 14:55:44 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-3[53398]: 2024-01-25T14:55:44.978+0000 7f512b73b700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T14:55:45.324 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-01-25T14:55:45.324 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-01-25T14:55:45.324 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-01-25T14:55:45.324 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-01-25T14:55:45.325 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114418 s, 916 MB/s 2024-01-25T14:55:45.325 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-01-25T14:55:45.923 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch daemon add osd smithi186:vg_nvme/lv_3 2024-01-25T14:55:46.165 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.b/config 2024-01-25T14:55:46.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:45 smithi191 ceph-mon[36347]: from='osd.3 [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-01-25T14:55:46.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:45 smithi191 ceph-mon[36347]: osdmap e24: 4 total, 3 up, 4 in 2024-01-25T14:55:46.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:45 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-25T14:55:46.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:45 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-25T14:55:46.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:45 smithi186 ceph-mon[35697]: from='osd.3 [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-01-25T14:55:46.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:45 smithi186 ceph-mon[35697]: osdmap e24: 4 total, 3 up, 4 in 2024-01-25T14:55:46.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:45 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-25T14:55:46.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:45 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-25T14:55:46.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:45 smithi170 ceph-mon[31899]: from='osd.3 [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-01-25T14:55:46.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:45 smithi170 ceph-mon[31899]: osdmap e24: 4 total, 3 up, 4 in 2024-01-25T14:55:46.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:45 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-25T14:55:46.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:45 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-25T14:55:47.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: purged_snaps scrub starts 2024-01-25T14:55:47.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: purged_snaps scrub ok 2024-01-25T14:55:47.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: osd.3 [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188] boot 2024-01-25T14:55:47.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: osdmap e25: 4 total, 4 up, 4 in 2024-01-25T14:55:47.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-25T14:55:47.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: Detected new or changed devices on smithi170 2024-01-25T14:55:47.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:47.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:47.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:55:47.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:55:47.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: Adjusting osd_memory_target on smithi170 to 8544M 2024-01-25T14:55:47.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:47.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:47.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:55:47.236 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:47.236 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 130 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:55:47.236 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:55:47.236 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:47.236 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:55:47.236 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:47.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: purged_snaps scrub starts 2024-01-25T14:55:47.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: purged_snaps scrub ok 2024-01-25T14:55:47.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: osd.3 [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188] boot 2024-01-25T14:55:47.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: osdmap e25: 4 total, 4 up, 4 in 2024-01-25T14:55:47.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-25T14:55:47.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: Detected new or changed devices on smithi170 2024-01-25T14:55:47.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:47.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:47.287 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:55:47.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:55:47.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: Adjusting osd_memory_target on smithi170 to 8544M 2024-01-25T14:55:47.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:47.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:47.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:55:47.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:47.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 130 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:55:47.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:55:47.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:47.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:55:47.288 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:47.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: purged_snaps scrub starts 2024-01-25T14:55:47.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: purged_snaps scrub ok 2024-01-25T14:55:47.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: osd.3 [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188] boot 2024-01-25T14:55:47.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: osdmap e25: 4 total, 4 up, 4 in 2024-01-25T14:55:47.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-01-25T14:55:47.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: Detected new or changed devices on smithi170 2024-01-25T14:55:47.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:47.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:47.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:55:47.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:55:47.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: Adjusting osd_memory_target on smithi170 to 8544M 2024-01-25T14:55:47.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:47.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:47.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:55:47.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:47.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 130 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:55:47.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:55:47.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:47.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:55:47.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:55:47.785 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.784+0000 7fb168392700 1 -- 172.21.15.186:0/2519972651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb160102320 msgr2=0x7fb160108bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:55:47.785 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.784+0000 7fb168392700 1 --2- 172.21.15.186:0/2519972651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb160102320 0x7fb160108bd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb15800b0d0 tx=0x7fb15800b3e0 comp rx=0 tx=0).stop 2024-01-25T14:55:47.785 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.784+0000 7fb168392700 1 -- 172.21.15.186:0/2519972651 shutdown_connections 2024-01-25T14:55:47.785 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.784+0000 7fb168392700 1 --2- 172.21.15.186:0/2519972651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb160102320 0x7fb160108bd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:47.786 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.784+0000 7fb168392700 1 --2- 172.21.15.186:0/2519972651 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb160100780 0x7fb160100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:47.786 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.784+0000 7fb168392700 1 --2- 172.21.15.186:0/2519972651 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb160101980 0x7fb160101de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:47.786 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.784+0000 7fb168392700 1 -- 172.21.15.186:0/2519972651 >> 172.21.15.186:0/2519972651 conn(0x7fb1600fbd40 msgr2=0x7fb1600fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:55:47.786 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.784+0000 7fb168392700 1 -- 172.21.15.186:0/2519972651 shutdown_connections 2024-01-25T14:55:47.786 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.784+0000 7fb168392700 1 -- 172.21.15.186:0/2519972651 wait complete. 2024-01-25T14:55:47.788 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.785+0000 7fb168392700 1 Processor -- start 2024-01-25T14:55:47.788 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.785+0000 7fb168392700 1 -- start start 2024-01-25T14:55:47.788 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.785+0000 7fb168392700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb160100780 0x7fb16006aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:55:47.788 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.785+0000 7fb168392700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb160101980 0x7fb16019c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:55:47.788 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.785+0000 7fb168392700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb160102320 0x7fb16019ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:55:47.788 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.785+0000 7fb168392700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16019f360 con 0x7fb160100780 2024-01-25T14:55:47.788 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.785+0000 7fb168392700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16019f4d0 con 0x7fb160102320 2024-01-25T14:55:47.788 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.785+0000 7fb168392700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16019f690 con 0x7fb160101980 2024-01-25T14:55:47.788 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.785+0000 7fb16692f700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb160102320 0x7fb16019ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:55:47.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.785+0000 7fb16692f700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb160102320 0x7fb16019ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:37446/0 (socket says 172.21.15.186:37446) 2024-01-25T14:55:47.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.785+0000 7fb16692f700 1 -- 172.21.15.186:0/3354274930 learned_addr learned my addr 172.21.15.186:0/3354274930 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-01-25T14:55:47.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.786+0000 7fb16612e700 1 --2- 172.21.15.186:0/3354274930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb160100780 0x7fb16006aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:55:47.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.786+0000 7fb16592d700 1 --2- 172.21.15.186:0/3354274930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb160101980 0x7fb16019c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:55:47.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.786+0000 7fb16692f700 1 -- 172.21.15.186:0/3354274930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb160101980 msgr2=0x7fb16019c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:55:47.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.786+0000 7fb16692f700 1 --2- 172.21.15.186:0/3354274930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb160101980 0x7fb16019c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:47.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.786+0000 7fb16692f700 1 -- 172.21.15.186:0/3354274930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb160100780 msgr2=0x7fb16006aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:55:47.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.786+0000 7fb16692f700 1 --2- 172.21.15.186:0/3354274930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb160100780 0x7fb16006aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:55:47.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.786+0000 7fb16692f700 1 -- 172.21.15.186:0/3354274930 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb158009d00 con 0x7fb160102320 2024-01-25T14:55:47.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.786+0000 7fb16612e700 1 --2- 172.21.15.186:0/3354274930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb160100780 0x7fb16006aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T14:55:47.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.786+0000 7fb16692f700 1 --2- 172.21.15.186:0/3354274930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb160102320 0x7fb16019ebc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb158007bd0 tx=0x7fb1580094f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:55:47.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.786+0000 7fb1577fe700 1 -- 172.21.15.186:0/3354274930 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15800e040 con 0x7fb160102320 2024-01-25T14:55:47.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.786+0000 7fb168392700 1 -- 172.21.15.186:0/3354274930 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16019f910 con 0x7fb160102320 2024-01-25T14:55:47.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.786+0000 7fb1577fe700 1 -- 172.21.15.186:0/3354274930 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb158012dc0 con 0x7fb160102320 2024-01-25T14:55:47.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.786+0000 7fb1577fe700 1 -- 172.21.15.186:0/3354274930 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15801b450 con 0x7fb160102320 2024-01-25T14:55:47.790 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.786+0000 7fb168392700 1 -- 172.21.15.186:0/3354274930 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16019fe00 con 0x7fb160102320 2024-01-25T14:55:47.790 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.787+0000 7fb168392700 1 -- 172.21.15.186:0/3354274930 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb160107b40 con 0x7fb160102320 2024-01-25T14:55:47.790 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.788+0000 7fb1577fe700 1 -- 172.21.15.186:0/3354274930 <== mon.2 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fb15801d610 con 0x7fb160102320 2024-01-25T14:55:47.791 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.789+0000 7fb1577fe700 1 --2- 172.21.15.186:0/3354274930 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb14c0a1370 0x7fb14c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:55:47.791 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.789+0000 7fb1577fe700 1 -- 172.21.15.186:0/3354274930 <== mon.2 v2:172.21.15.186:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3698+0+0 (secure 0 0 0) 0x7fb1580cdf80 con 0x7fb160102320 2024-01-25T14:55:47.791 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.789+0000 7fb16612e700 1 --2- 172.21.15.186:0/3354274930 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb14c0a1370 0x7fb14c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:55:47.791 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.790+0000 7fb16612e700 1 --2- 172.21.15.186:0/3354274930 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb14c0a1370 0x7fb14c0a3830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb15c005fd0 tx=0x7fb15c005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:55:47.793 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.793+0000 7fb1577fe700 1 -- 172.21.15.186:0/3354274930 <== mon.2 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb158098670 con 0x7fb160102320 2024-01-25T14:55:47.997 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:55:47.996+0000 7fb168392700 1 -- 172.21.15.186:0/3354274930 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb16002d5a0 con 0x7fb14c0a1370 2024-01-25T14:55:48.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:47 smithi191 ceph-mon[36347]: osdmap e26: 4 total, 4 up, 4 in 2024-01-25T14:55:48.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:47 smithi191 ceph-mon[36347]: osdmap e27: 4 total, 4 up, 4 in 2024-01-25T14:55:48.275 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:47 smithi170 ceph-mon[31899]: osdmap e26: 4 total, 4 up, 4 in 2024-01-25T14:55:48.275 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:47 smithi170 ceph-mon[31899]: osdmap e27: 4 total, 4 up, 4 in 2024-01-25T14:55:48.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:47 smithi186 ceph-mon[35697]: osdmap e26: 4 total, 4 up, 4 in 2024-01-25T14:55:48.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:47 smithi186 ceph-mon[35697]: osdmap e27: 4 total, 4 up, 4 in 2024-01-25T14:55:49.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:48 smithi186 ceph-mon[35697]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:55:49.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:48 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:55:49.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:48 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:55:49.357 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:48 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:49.357 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:48 smithi186 ceph-mon[35697]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 130 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:55:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:48 smithi170 ceph-mon[31899]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:55:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:48 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:55:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:48 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:55:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:48 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:49.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:48 smithi170 ceph-mon[31899]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 130 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:55:49.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:48 smithi191 ceph-mon[36347]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:55:49.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:48 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:55:49.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:48 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:55:49.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:48 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:49.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:48 smithi191 ceph-mon[36347]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 130 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:55:50.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:49 smithi186 ceph-mon[35697]: osdmap e28: 4 total, 4 up, 4 in 2024-01-25T14:55:50.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:49 smithi170 ceph-mon[31899]: osdmap e28: 4 total, 4 up, 4 in 2024-01-25T14:55:50.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:49 smithi191 ceph-mon[36347]: osdmap e28: 4 total, 4 up, 4 in 2024-01-25T14:55:51.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:50 smithi186 ceph-mon[35697]: osdmap e29: 4 total, 4 up, 4 in 2024-01-25T14:55:51.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:50 smithi186 ceph-mon[35697]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-01-25T14:55:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:50 smithi186 ceph-mon[35697]: from='client.? 172.21.15.186:0/2981436451' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60e47fb9-7166-4be7-8e9f-0881b771b116"}]: dispatch 2024-01-25T14:55:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:50 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60e47fb9-7166-4be7-8e9f-0881b771b116"}]: dispatch 2024-01-25T14:55:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:50 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60e47fb9-7166-4be7-8e9f-0881b771b116"}]': finished 2024-01-25T14:55:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:50 smithi186 ceph-mon[35697]: osdmap e30: 5 total, 4 up, 5 in 2024-01-25T14:55:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:50 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:55:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:50 smithi170 ceph-mon[31899]: osdmap e29: 4 total, 4 up, 4 in 2024-01-25T14:55:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:50 smithi170 ceph-mon[31899]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-01-25T14:55:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:50 smithi170 ceph-mon[31899]: from='client.? 172.21.15.186:0/2981436451' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60e47fb9-7166-4be7-8e9f-0881b771b116"}]: dispatch 2024-01-25T14:55:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:50 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60e47fb9-7166-4be7-8e9f-0881b771b116"}]: dispatch 2024-01-25T14:55:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:50 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60e47fb9-7166-4be7-8e9f-0881b771b116"}]': finished 2024-01-25T14:55:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:50 smithi170 ceph-mon[31899]: osdmap e30: 5 total, 4 up, 5 in 2024-01-25T14:55:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:50 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:55:51.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:50 smithi191 ceph-mon[36347]: osdmap e29: 4 total, 4 up, 4 in 2024-01-25T14:55:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:50 smithi191 ceph-mon[36347]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-01-25T14:55:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:50 smithi191 ceph-mon[36347]: from='client.? 172.21.15.186:0/2981436451' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60e47fb9-7166-4be7-8e9f-0881b771b116"}]: dispatch 2024-01-25T14:55:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:50 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "60e47fb9-7166-4be7-8e9f-0881b771b116"}]: dispatch 2024-01-25T14:55:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:50 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "60e47fb9-7166-4be7-8e9f-0881b771b116"}]': finished 2024-01-25T14:55:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:50 smithi191 ceph-mon[36347]: osdmap e30: 5 total, 4 up, 5 in 2024-01-25T14:55:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:50 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:55:52.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:51 smithi186 ceph-mon[35697]: from='client.? 172.21.15.186:0/115357586' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:55:52.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:51 smithi170 ceph-mon[31899]: from='client.? 172.21.15.186:0/115357586' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:55:52.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:51 smithi191 ceph-mon[36347]: from='client.? 172.21.15.186:0/115357586' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:55:53.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:53 smithi186 ceph-mon[35697]: pgmap v108: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-01-25T14:55:53.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:53 smithi170 ceph-mon[31899]: pgmap v108: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-01-25T14:55:53.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:53 smithi191 ceph-mon[36347]: pgmap v108: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-01-25T14:55:55.238 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:55 smithi186 ceph-mon[35697]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-25T14:55:55.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:55 smithi191 ceph-mon[36347]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-25T14:55:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:55 smithi170 ceph-mon[31899]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-25T14:55:57.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:57 smithi191 ceph-mon[36347]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:55:57.520 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:57 smithi186 ceph-mon[35697]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:55:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:57 smithi170 ceph-mon[31899]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:55:59.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-25T14:55:59.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:59.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:58 smithi191 ceph-mon[36347]: Deploying daemon osd.4 on smithi186 2024-01-25T14:55:59.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:55:58 smithi191 ceph-mon[36347]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:55:59.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-25T14:55:59.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:59.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:58 smithi186 ceph-mon[35697]: Deploying daemon osd.4 on smithi186 2024-01-25T14:55:59.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:55:58 smithi186 ceph-mon[35697]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:55:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-01-25T14:55:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:55:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:58 smithi170 ceph-mon[31899]: Deploying daemon osd.4 on smithi186 2024-01-25T14:55:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:55:58 smithi170 ceph-mon[31899]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:01.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:01 smithi191 ceph-mon[36347]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:01.491 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:01 smithi186 ceph-mon[35697]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:01.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:01 smithi170 ceph-mon[31899]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:03.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:03 smithi191 ceph-mon[36347]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:03.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:03 smithi186 ceph-mon[35697]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:03 smithi170 ceph-mon[31899]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:04.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:04 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:04.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:04 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:04.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:04 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:04.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:04 smithi191 ceph-mon[36347]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:04.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:04 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:04.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:04 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:04.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:04 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:04.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:04 smithi186 ceph-mon[35697]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:04.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:04 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:04.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:04 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:04.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:04 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:04.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:04 smithi170 ceph-mon[31899]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:06.711 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 4 on host 'smithi186' 2024-01-25T14:56:06.711 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:56:06.710+0000 7fb1577fe700 1 -- 172.21.15.186:0/3354274930 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb16002d5a0 con 0x7fb14c0a1370 2024-01-25T14:56:06.713 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:56:06.712+0000 7fb168392700 1 -- 172.21.15.186:0/3354274930 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb14c0a1370 msgr2=0x7fb14c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:56:06.713 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:56:06.712+0000 7fb168392700 1 --2- 172.21.15.186:0/3354274930 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb14c0a1370 0x7fb14c0a3830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb15c005fd0 tx=0x7fb15c005f00 comp rx=0 tx=0).stop 2024-01-25T14:56:06.713 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:56:06.712+0000 7fb168392700 1 -- 172.21.15.186:0/3354274930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb160102320 msgr2=0x7fb16019ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:56:06.713 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:56:06.712+0000 7fb168392700 1 --2- 172.21.15.186:0/3354274930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb160102320 0x7fb16019ebc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb158007bd0 tx=0x7fb1580094f0 comp rx=0 tx=0).stop 2024-01-25T14:56:06.713 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:56:06.712+0000 7fb168392700 1 -- 172.21.15.186:0/3354274930 shutdown_connections 2024-01-25T14:56:06.713 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:56:06.712+0000 7fb168392700 1 --2- 172.21.15.186:0/3354274930 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb14c0a1370 0x7fb14c0a3830 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:06.714 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:56:06.712+0000 7fb168392700 1 --2- 172.21.15.186:0/3354274930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb160102320 0x7fb16019ebc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:06.714 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:56:06.712+0000 7fb168392700 1 --2- 172.21.15.186:0/3354274930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb160100780 0x7fb16006aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:06.714 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:56:06.712+0000 7fb168392700 1 --2- 172.21.15.186:0/3354274930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb160101980 0x7fb16019c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:06.714 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:56:06.712+0000 7fb168392700 1 -- 172.21.15.186:0/3354274930 >> 172.21.15.186:0/3354274930 conn(0x7fb1600fbd40 msgr2=0x7fb160104c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:56:06.714 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:56:06.712+0000 7fb168392700 1 -- 172.21.15.186:0/3354274930 shutdown_connections 2024-01-25T14:56:06.714 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:56:06.712+0000 7fb168392700 1 -- 172.21.15.186:0/3354274930 wait complete. 2024-01-25T14:56:07.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:07 smithi186 ceph-mon[35697]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:07.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:07 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:07.271 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:07 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:07.312 DEBUG:teuthology.orchestra.run.smithi186:osd.4> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.4.service 2024-01-25T14:56:07.314 INFO:tasks.cephadm:Deploying osd.5 on smithi191 with /dev/vg_nvme/lv_3... 2024-01-25T14:56:07.314 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-01-25T14:56:07.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:07 smithi191 ceph-mon[36347]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:07.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:07 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:07.437 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:07 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:07.561 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T14:56:07.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:07 smithi170 ceph-mon[31899]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:07.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:07 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:07.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:07 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:08.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:08 smithi186 ceph-mon[35697]: from='osd.4 [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-25T14:56:08.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:08 smithi186 ceph-mon[35697]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-25T14:56:08.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:08 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:08.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:08 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:08.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:08 smithi191 ceph-mon[36347]: from='osd.4 [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-25T14:56:08.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:08 smithi191 ceph-mon[36347]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-25T14:56:08.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:08 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:08.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:08 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:08.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:08 smithi170 ceph-mon[31899]: from='osd.4 [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-25T14:56:08.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:08 smithi170 ceph-mon[31899]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-01-25T14:56:08.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:08 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:08.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:08 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:09.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:09 smithi186 ceph-mon[35697]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:09.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:09 smithi186 ceph-mon[35697]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-25T14:56:09.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:09 smithi186 ceph-mon[35697]: osdmap e31: 5 total, 4 up, 5 in 2024-01-25T14:56:09.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:09 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:56:09.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:09 smithi186 ceph-mon[35697]: from='osd.4 [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:56:09.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:09 smithi186 ceph-mon[35697]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:56:09.355 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 14:56:09 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4[47323]: 2024-01-25T14:56:09.204+0000 7f7a798ee700 -1 osd.4 0 waiting for initial osdmap 2024-01-25T14:56:09.355 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 14:56:09 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4[47323]: 2024-01-25T14:56:09.214+0000 7f7a75ee9700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T14:56:09.357 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:09 smithi191 ceph-mon[36347]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:09.357 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:09 smithi191 ceph-mon[36347]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-25T14:56:09.358 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:09 smithi191 ceph-mon[36347]: osdmap e31: 5 total, 4 up, 5 in 2024-01-25T14:56:09.358 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:09 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:56:09.358 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:09 smithi191 ceph-mon[36347]: from='osd.4 [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:56:09.358 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:09 smithi191 ceph-mon[36347]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:56:09.503 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-01-25T14:56:09.503 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-01-25T14:56:09.503 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2024-01-25T14:56:09.503 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2024-01-25T14:56:09.503 INFO:teuthology.orchestra.run.smithi191.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0152189 s, 689 MB/s 2024-01-25T14:56:09.503 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2024-01-25T14:56:09.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:09 smithi170 ceph-mon[31899]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:09.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:09 smithi170 ceph-mon[31899]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-01-25T14:56:09.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:09 smithi170 ceph-mon[31899]: osdmap e31: 5 total, 4 up, 5 in 2024-01-25T14:56:09.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:09 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:56:09.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:09 smithi170 ceph-mon[31899]: from='osd.4 [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:56:09.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:09 smithi170 ceph-mon[31899]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:56:10.062 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch daemon add osd smithi191:vg_nvme/lv_3 2024-01-25T14:56:10.300 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T14:56:10.310 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:10 smithi191 ceph-mon[36347]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-01-25T14:56:10.310 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:10 smithi191 ceph-mon[36347]: osdmap e32: 5 total, 4 up, 5 in 2024-01-25T14:56:10.310 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:56:10.310 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:56:10.534 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:10 smithi186 ceph-mon[35697]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-01-25T14:56:10.534 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:10 smithi186 ceph-mon[35697]: osdmap e32: 5 total, 4 up, 5 in 2024-01-25T14:56:10.534 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:56:10.534 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:56:10.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:10 smithi170 ceph-mon[31899]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-01-25T14:56:10.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:10 smithi170 ceph-mon[31899]: osdmap e32: 5 total, 4 up, 5 in 2024-01-25T14:56:10.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:56:10.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:56:11.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: purged_snaps scrub starts 2024-01-25T14:56:11.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: purged_snaps scrub ok 2024-01-25T14:56:11.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:11.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:56:11.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: osd.4 [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883] boot 2024-01-25T14:56:11.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: osdmap e33: 5 total, 5 up, 5 in 2024-01-25T14:56:11.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:56:11.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:11.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:11.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:11.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:11.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:11.343 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:11.343 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:11.343 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:11.343 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:11.343 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:11.343 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:11.343 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:11.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: purged_snaps scrub starts 2024-01-25T14:56:11.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: purged_snaps scrub ok 2024-01-25T14:56:11.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:11.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:56:11.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: osd.4 [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883] boot 2024-01-25T14:56:11.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: osdmap e33: 5 total, 5 up, 5 in 2024-01-25T14:56:11.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:56:11.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:11.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:11.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:11.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:11.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:11.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:11.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:11.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:11.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:11.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:11.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:11.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:11.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: purged_snaps scrub starts 2024-01-25T14:56:11.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: purged_snaps scrub ok 2024-01-25T14:56:11.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-01-25T14:56:11.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:56:11.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: osd.4 [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883] boot 2024-01-25T14:56:11.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: osdmap e33: 5 total, 5 up, 5 in 2024-01-25T14:56:11.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-01-25T14:56:11.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:11.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:11.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:11.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:11.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:11.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:11.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:11.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:11.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:11.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:11.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:11.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:11.833 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.830+0000 7f2b6e395700 1 -- 172.21.15.191:0/2700134712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b68102340 msgr2=0x7f2b68104730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:56:11.833 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.830+0000 7f2b6e395700 1 --2- 172.21.15.191:0/2700134712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b68102340 0x7f2b68104730 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009990 tx=0x7f2b58009ca0 comp rx=0 tx=0).stop 2024-01-25T14:56:11.833 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.830+0000 7f2b6e395700 1 -- 172.21.15.191:0/2700134712 shutdown_connections 2024-01-25T14:56:11.833 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.830+0000 7f2b6e395700 1 --2- 172.21.15.191:0/2700134712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b68102340 0x7f2b68104730 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:11.833 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.830+0000 7f2b6e395700 1 --2- 172.21.15.191:0/2700134712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b681075a0 0x7f2b68109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:11.833 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.830+0000 7f2b6e395700 1 --2- 172.21.15.191:0/2700134712 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b68104c70 0x7f2b68107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:11.833 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.830+0000 7f2b6e395700 1 -- 172.21.15.191:0/2700134712 >> 172.21.15.191:0/2700134712 conn(0x7f2b680fbd70 msgr2=0x7f2b680fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:56:11.834 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.830+0000 7f2b6e395700 1 -- 172.21.15.191:0/2700134712 shutdown_connections 2024-01-25T14:56:11.834 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.830+0000 7f2b6e395700 1 -- 172.21.15.191:0/2700134712 wait complete. 2024-01-25T14:56:11.834 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.831+0000 7f2b6e395700 1 Processor -- start 2024-01-25T14:56:11.834 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.831+0000 7f2b6e395700 1 -- start start 2024-01-25T14:56:11.834 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.831+0000 7f2b6e395700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b68102340 0x7f2b68101ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:56:11.834 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.831+0000 7f2b6e395700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b68104c70 0x7f2b681002f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:56:11.834 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.831+0000 7f2b6e395700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b681075a0 0x7f2b68100830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:56:11.834 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.831+0000 7f2b6e395700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b68100fb0 con 0x7f2b68104c70 2024-01-25T14:56:11.834 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.831+0000 7f2b6e395700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b68101120 con 0x7f2b681075a0 2024-01-25T14:56:11.834 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.831+0000 7f2b6e395700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b681a1710 con 0x7f2b68102340 2024-01-25T14:56:11.834 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.831+0000 7f2b67fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b68102340 0x7f2b68101ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:56:11.834 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.831+0000 7f2b67fff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b68102340 0x7f2b68101ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:57760/0 (socket says 172.21.15.191:57760) 2024-01-25T14:56:11.834 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.831+0000 7f2b67fff700 1 -- 172.21.15.191:0/3788026483 learned_addr learned my addr 172.21.15.191:0/3788026483 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-01-25T14:56:11.835 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.831+0000 7f2b677fe700 1 --2- 172.21.15.191:0/3788026483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b68104c70 0x7f2b681002f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:56:11.835 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.832+0000 7f2b6c932700 1 --2- 172.21.15.191:0/3788026483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b681075a0 0x7f2b68100830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:56:11.835 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.832+0000 7f2b67fff700 1 -- 172.21.15.191:0/3788026483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b681075a0 msgr2=0x7f2b68100830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:56:11.835 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.832+0000 7f2b67fff700 1 --2- 172.21.15.191:0/3788026483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b681075a0 0x7f2b68100830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:11.835 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.832+0000 7f2b67fff700 1 -- 172.21.15.191:0/3788026483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b68104c70 msgr2=0x7f2b681002f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:56:11.835 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.832+0000 7f2b67fff700 1 --2- 172.21.15.191:0/3788026483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b68104c70 0x7f2b681002f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:11.835 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.832+0000 7f2b67fff700 1 -- 172.21.15.191:0/3788026483 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b580095f0 con 0x7f2b68102340 2024-01-25T14:56:11.835 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.832+0000 7f2b67fff700 1 --2- 172.21.15.191:0/3788026483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b68102340 0x7f2b68101ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2b580095c0 tx=0x7f2b5800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:56:11.835 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.832+0000 7f2b657fa700 1 -- 172.21.15.191:0/3788026483 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5801d070 con 0x7f2b68102340 2024-01-25T14:56:11.835 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.832+0000 7f2b6e395700 1 -- 172.21.15.191:0/3788026483 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b681a1990 con 0x7f2b68102340 2024-01-25T14:56:11.835 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.832+0000 7f2b657fa700 1 -- 172.21.15.191:0/3788026483 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b58005030 con 0x7f2b68102340 2024-01-25T14:56:11.835 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.832+0000 7f2b657fa700 1 -- 172.21.15.191:0/3788026483 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b58004b00 con 0x7f2b68102340 2024-01-25T14:56:11.835 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.832+0000 7f2b6e395700 1 -- 172.21.15.191:0/3788026483 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b681a1db0 con 0x7f2b68102340 2024-01-25T14:56:11.836 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.833+0000 7f2b6e395700 1 -- 172.21.15.191:0/3788026483 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b680fd8f0 con 0x7f2b68102340 2024-01-25T14:56:11.836 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.834+0000 7f2b657fa700 1 -- 172.21.15.191:0/3788026483 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f2b58005410 con 0x7f2b68102340 2024-01-25T14:56:11.836 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.835+0000 7f2b657fa700 1 --2- 172.21.15.191:0/3788026483 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b500a1370 0x7f2b500a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:56:11.837 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.835+0000 7f2b657fa700 1 -- 172.21.15.191:0/3788026483 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f2b580cca50 con 0x7f2b68102340 2024-01-25T14:56:11.837 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.835+0000 7f2b677fe700 1 --2- 172.21.15.191:0/3788026483 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b500a1370 0x7f2b500a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:56:11.837 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.835+0000 7f2b677fe700 1 --2- 172.21.15.191:0/3788026483 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b500a1370 0x7f2b500a3830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c005950 tx=0x7f2b5c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:56:11.840 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:11.839+0000 7f2b657fa700 1 -- 172.21.15.191:0/3788026483 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f2b58096f30 con 0x7f2b68102340 2024-01-25T14:56:12.039 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:12.038+0000 7f2b6e395700 1 -- 172.21.15.191:0/3788026483 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b6802d540 con 0x7f2b500a1370 2024-01-25T14:56:12.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:12 smithi191 ceph-mon[36347]: Detected new or changed devices on smithi186 2024-01-25T14:56:12.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:12 smithi191 ceph-mon[36347]: Adjusting osd_memory_target on smithi186 to 8540M 2024-01-25T14:56:12.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:12 smithi191 ceph-mon[36347]: osdmap e34: 5 total, 5 up, 5 in 2024-01-25T14:56:12.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:56:12.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:56:12.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:12.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:12 smithi186 ceph-mon[35697]: Detected new or changed devices on smithi186 2024-01-25T14:56:12.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:12 smithi186 ceph-mon[35697]: Adjusting osd_memory_target on smithi186 to 8540M 2024-01-25T14:56:12.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:12 smithi186 ceph-mon[35697]: osdmap e34: 5 total, 5 up, 5 in 2024-01-25T14:56:12.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:56:12.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:56:12.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:12.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:12 smithi170 ceph-mon[31899]: Detected new or changed devices on smithi186 2024-01-25T14:56:12.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:12 smithi170 ceph-mon[31899]: Adjusting osd_memory_target on smithi186 to 8540M 2024-01-25T14:56:12.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:12 smithi170 ceph-mon[31899]: osdmap e34: 5 total, 5 up, 5 in 2024-01-25T14:56:12.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:56:12.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:56:12.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:13.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:13 smithi191 ceph-mon[36347]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:56:13.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:13 smithi191 ceph-mon[36347]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:13.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:13 smithi186 ceph-mon[35697]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:56:13.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:13 smithi186 ceph-mon[35697]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:13.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:13 smithi170 ceph-mon[31899]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:56:13.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:13 smithi170 ceph-mon[31899]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:15.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:15 smithi191 ceph-mon[36347]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:15.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:15 smithi191 ceph-mon[36347]: from='client.? 172.21.15.191:0/1731211404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "945d8742-1594-45a5-8130-7aaa94abeaad"}]: dispatch 2024-01-25T14:56:15.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:15 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "945d8742-1594-45a5-8130-7aaa94abeaad"}]: dispatch 2024-01-25T14:56:15.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:15 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "945d8742-1594-45a5-8130-7aaa94abeaad"}]': finished 2024-01-25T14:56:15.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:15 smithi191 ceph-mon[36347]: osdmap e35: 6 total, 5 up, 6 in 2024-01-25T14:56:15.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-25T14:56:15.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:15 smithi186 ceph-mon[35697]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:15.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:15 smithi186 ceph-mon[35697]: from='client.? 172.21.15.191:0/1731211404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "945d8742-1594-45a5-8130-7aaa94abeaad"}]: dispatch 2024-01-25T14:56:15.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:15 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "945d8742-1594-45a5-8130-7aaa94abeaad"}]: dispatch 2024-01-25T14:56:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:15 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "945d8742-1594-45a5-8130-7aaa94abeaad"}]': finished 2024-01-25T14:56:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:15 smithi186 ceph-mon[35697]: osdmap e35: 6 total, 5 up, 6 in 2024-01-25T14:56:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-25T14:56:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:15 smithi170 ceph-mon[31899]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:15 smithi170 ceph-mon[31899]: from='client.? 172.21.15.191:0/1731211404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "945d8742-1594-45a5-8130-7aaa94abeaad"}]: dispatch 2024-01-25T14:56:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:15 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "945d8742-1594-45a5-8130-7aaa94abeaad"}]: dispatch 2024-01-25T14:56:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:15 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "945d8742-1594-45a5-8130-7aaa94abeaad"}]': finished 2024-01-25T14:56:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:15 smithi170 ceph-mon[31899]: osdmap e35: 6 total, 5 up, 6 in 2024-01-25T14:56:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-25T14:56:16.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:16 smithi191 ceph-mon[36347]: from='client.? 172.21.15.191:0/1133170488' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:56:16.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:16 smithi186 ceph-mon[35697]: from='client.? 172.21.15.191:0/1133170488' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:56:16.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:16 smithi170 ceph-mon[31899]: from='client.? 172.21.15.191:0/1133170488' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:56:17.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:17 smithi191 ceph-mon[36347]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:17.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:17 smithi186 ceph-mon[35697]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:17.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:17 smithi170 ceph-mon[31899]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:19.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:18 smithi191 ceph-mon[36347]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:19.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:18 smithi186 ceph-mon[35697]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:19.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:18 smithi170 ceph-mon[31899]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:21.458 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:21 smithi191 ceph-mon[36347]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:21.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:21 smithi186 ceph-mon[35697]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:21.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:21 smithi170 ceph-mon[31899]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:22.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:22 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-25T14:56:22.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:22 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:22.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:22 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-25T14:56:22.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:22 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:22.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:22 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-01-25T14:56:22.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:22 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:23.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:23 smithi191 ceph-mon[36347]: Deploying daemon osd.5 on smithi191 2024-01-25T14:56:23.470 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:23 smithi191 ceph-mon[36347]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:23.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:23 smithi186 ceph-mon[35697]: Deploying daemon osd.5 on smithi191 2024-01-25T14:56:23.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:23 smithi186 ceph-mon[35697]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:23.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:23 smithi170 ceph-mon[31899]: Deploying daemon osd.5 on smithi191 2024-01-25T14:56:23.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:23 smithi170 ceph-mon[31899]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:25.388 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:25 smithi191 ceph-mon[36347]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:25.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:25 smithi186 ceph-mon[35697]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:25 smithi170 ceph-mon[31899]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:27.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:27 smithi191 ceph-mon[36347]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:27.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:27.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:27 smithi186 ceph-mon[35697]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:27.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:27.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:27.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:27 smithi170 ceph-mon[31899]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:29.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:28 smithi191 ceph-mon[36347]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:29.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:28 smithi186 ceph-mon[35697]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:29.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:28 smithi170 ceph-mon[31899]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:30.003 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:30.001+0000 7f2b657fa700 1 -- 172.21.15.191:0/3788026483 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2b6802d540 con 0x7f2b500a1370 2024-01-25T14:56:30.003 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 5 on host 'smithi191' 2024-01-25T14:56:30.004 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:30.004+0000 7f2b6e395700 1 -- 172.21.15.191:0/3788026483 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b500a1370 msgr2=0x7f2b500a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:56:30.005 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:30.004+0000 7f2b6e395700 1 --2- 172.21.15.191:0/3788026483 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b500a1370 0x7f2b500a3830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c005950 tx=0x7f2b5c00b410 comp rx=0 tx=0).stop 2024-01-25T14:56:30.005 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:30.004+0000 7f2b6e395700 1 -- 172.21.15.191:0/3788026483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b68102340 msgr2=0x7f2b68101ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:56:30.005 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:30.004+0000 7f2b6e395700 1 --2- 172.21.15.191:0/3788026483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b68102340 0x7f2b68101ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2b580095c0 tx=0x7f2b5800f690 comp rx=0 tx=0).stop 2024-01-25T14:56:30.005 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:30.004+0000 7f2b6e395700 1 -- 172.21.15.191:0/3788026483 shutdown_connections 2024-01-25T14:56:30.005 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:30.004+0000 7f2b6e395700 1 --2- 172.21.15.191:0/3788026483 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b500a1370 0x7f2b500a3830 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:30.005 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:30.004+0000 7f2b6e395700 1 --2- 172.21.15.191:0/3788026483 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b68102340 0x7f2b68101ca0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:30.005 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:30.004+0000 7f2b6e395700 1 --2- 172.21.15.191:0/3788026483 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b681075a0 0x7f2b68100830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:30.005 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:30.004+0000 7f2b6e395700 1 --2- 172.21.15.191:0/3788026483 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b68104c70 0x7f2b681002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:30.005 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:30.004+0000 7f2b6e395700 1 -- 172.21.15.191:0/3788026483 >> 172.21.15.191:0/3788026483 conn(0x7f2b680fbd70 msgr2=0x7f2b68102dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:56:30.005 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:30.004+0000 7f2b6e395700 1 -- 172.21.15.191:0/3788026483 shutdown_connections 2024-01-25T14:56:30.005 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:56:30.004+0000 7f2b6e395700 1 -- 172.21.15.191:0/3788026483 wait complete. 2024-01-25T14:56:30.929 DEBUG:teuthology.orchestra.run.smithi191:osd.5> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.5.service 2024-01-25T14:56:30.932 INFO:tasks.cephadm:Deploying osd.6 on smithi170 with /dev/vg_nvme/lv_2... 2024-01-25T14:56:30.932 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-01-25T14:56:31.173 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:56:31.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:30 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:31.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:30 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:31.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:30 smithi191 ceph-mon[36347]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:31.234 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 14:56:31 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T14:56:31.059+0000 7fefc61a17c0 -1 osd.5 0 log_to_monitors true 2024-01-25T14:56:31.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:30 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:31.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:30 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:31.294 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:30 smithi170 ceph-mon[31899]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:31.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:30 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:31.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:30 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:31.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:30 smithi186 ceph-mon[35697]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:32.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:32 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:32.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:32 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:32.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:32 smithi191 ceph-mon[36347]: from='osd.5 [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-25T14:56:32.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:32 smithi191 ceph-mon[36347]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-25T14:56:32.291 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:32 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:32.291 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:32 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:32.291 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:32 smithi170 ceph-mon[31899]: from='osd.5 [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-25T14:56:32.292 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:32 smithi170 ceph-mon[31899]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-25T14:56:32.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:32 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:32.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:32 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:32.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:32 smithi186 ceph-mon[35697]: from='osd.5 [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-25T14:56:32.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:32 smithi186 ceph-mon[35697]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-01-25T14:56:33.133 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-01-25T14:56:33.133 INFO:teuthology.orchestra.run.smithi170.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-01-25T14:56:33.133 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10+0 records in 2024-01-25T14:56:33.133 INFO:teuthology.orchestra.run.smithi170.stderr:10+0 records out 2024-01-25T14:56:33.133 INFO:teuthology.orchestra.run.smithi170.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00883709 s, 1.2 GB/s 2024-01-25T14:56:33.133 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 2024-01-25T14:56:33.133 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping successful for: 2024-01-25T14:56:33.134 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:33 smithi170 ceph-mon[31899]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-25T14:56:33.134 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:33 smithi170 ceph-mon[31899]: osdmap e36: 6 total, 5 up, 6 in 2024-01-25T14:56:33.134 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:33 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-25T14:56:33.134 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:33 smithi170 ceph-mon[31899]: from='osd.5 [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:56:33.134 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:33 smithi170 ceph-mon[31899]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:56:33.134 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:33 smithi170 ceph-mon[31899]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:33.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:33 smithi186 ceph-mon[35697]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-25T14:56:33.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:33 smithi186 ceph-mon[35697]: osdmap e36: 6 total, 5 up, 6 in 2024-01-25T14:56:33.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:33 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-25T14:56:33.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:33 smithi186 ceph-mon[35697]: from='osd.5 [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:56:33.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:33 smithi186 ceph-mon[35697]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:56:33.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:33 smithi186 ceph-mon[35697]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:33.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:33 smithi191 ceph-mon[36347]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-01-25T14:56:33.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:33 smithi191 ceph-mon[36347]: osdmap e36: 6 total, 5 up, 6 in 2024-01-25T14:56:33.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:33 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-25T14:56:33.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:33 smithi191 ceph-mon[36347]: from='osd.5 [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:56:33.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:33 smithi191 ceph-mon[36347]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:56:33.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:33 smithi191 ceph-mon[36347]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-01-25T14:56:33.753 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch daemon add osd smithi170:vg_nvme/lv_2 2024-01-25T14:56:34.003 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:56:34.199 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 14:56:33 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T14:56:33.900+0000 7fefbb006700 -1 osd.5 0 waiting for initial osdmap 2024-01-25T14:56:34.199 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 14:56:33 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T14:56:33.908+0000 7fefb35f9700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T14:56:34.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:34 smithi191 ceph-mon[36347]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-01-25T14:56:34.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:34 smithi191 ceph-mon[36347]: osdmap e37: 6 total, 5 up, 6 in 2024-01-25T14:56:34.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-25T14:56:34.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-25T14:56:34.199 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:34 smithi191 ceph-mon[36347]: from='osd.5 ' entity='osd.5' 2024-01-25T14:56:34.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:34 smithi186 ceph-mon[35697]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-01-25T14:56:34.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:34 smithi186 ceph-mon[35697]: osdmap e37: 6 total, 5 up, 6 in 2024-01-25T14:56:34.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-25T14:56:34.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-25T14:56:34.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:34 smithi186 ceph-mon[35697]: from='osd.5 ' entity='osd.5' 2024-01-25T14:56:34.360 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:34 smithi170 ceph-mon[31899]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-01-25T14:56:34.361 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:34 smithi170 ceph-mon[31899]: osdmap e37: 6 total, 5 up, 6 in 2024-01-25T14:56:34.361 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-25T14:56:34.361 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-25T14:56:34.361 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:34 smithi170 ceph-mon[31899]: from='osd.5 ' entity='osd.5' 2024-01-25T14:56:35.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: purged_snaps scrub starts 2024-01-25T14:56:35.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: purged_snaps scrub ok 2024-01-25T14:56:35.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: osd.5 [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213] boot 2024-01-25T14:56:35.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: osdmap e38: 6 total, 6 up, 6 in 2024-01-25T14:56:35.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-25T14:56:35.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:35.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: Detected new or changed devices on smithi191 2024-01-25T14:56:35.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:35.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:35.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:35.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:35.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: Adjusting osd_memory_target on smithi191 to 8540M 2024-01-25T14:56:35.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:35.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:35.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:35.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:35.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:35.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:35.126 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:35.126 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: purged_snaps scrub starts 2024-01-25T14:56:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: purged_snaps scrub ok 2024-01-25T14:56:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: osd.5 [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213] boot 2024-01-25T14:56:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: osdmap e38: 6 total, 6 up, 6 in 2024-01-25T14:56:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-25T14:56:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: Detected new or changed devices on smithi191 2024-01-25T14:56:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:35.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: Adjusting osd_memory_target on smithi191 to 8540M 2024-01-25T14:56:35.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:35.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:35.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:35.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:35.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:35.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:35.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:35.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: purged_snaps scrub starts 2024-01-25T14:56:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: purged_snaps scrub ok 2024-01-25T14:56:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: osd.5 [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213] boot 2024-01-25T14:56:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: osdmap e38: 6 total, 6 up, 6 in 2024-01-25T14:56:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-01-25T14:56:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: pgmap v137: 1 pgs: 1 peering; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: Detected new or changed devices on smithi191 2024-01-25T14:56:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:35.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: Adjusting osd_memory_target on smithi191 to 8540M 2024-01-25T14:56:35.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:35.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:35.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:35.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:35.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:35.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:35.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:35.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:35.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.536+0000 7f46bd0e8700 1 -- 172.21.15.170:0/193356241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b8100750 msgr2=0x7f46b8100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:56:35.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.536+0000 7f46bd0e8700 1 --2- 172.21.15.170:0/193356241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b8100750 0x7f46b8100b70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f46a80099c0 tx=0x7f46a8009cd0 comp rx=0 tx=0).stop 2024-01-25T14:56:35.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.536+0000 7f46bd0e8700 1 -- 172.21.15.170:0/193356241 shutdown_connections 2024-01-25T14:56:35.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.536+0000 7f46bd0e8700 1 --2- 172.21.15.170:0/193356241 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46b81022f0 0x7f46b8108ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:35.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.536+0000 7f46bd0e8700 1 --2- 172.21.15.170:0/193356241 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b8100750 0x7f46b8100b70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:35.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.536+0000 7f46bd0e8700 1 --2- 172.21.15.170:0/193356241 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b8101950 0x7f46b8101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:35.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.536+0000 7f46bd0e8700 1 -- 172.21.15.170:0/193356241 >> 172.21.15.170:0/193356241 conn(0x7f46b80fbcd0 msgr2=0x7f46b80fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:56:35.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.536+0000 7f46bd0e8700 1 -- 172.21.15.170:0/193356241 shutdown_connections 2024-01-25T14:56:35.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.536+0000 7f46bd0e8700 1 -- 172.21.15.170:0/193356241 wait complete. 2024-01-25T14:56:35.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.537+0000 7f46bd0e8700 1 Processor -- start 2024-01-25T14:56:35.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.537+0000 7f46bd0e8700 1 -- start start 2024-01-25T14:56:35.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.537+0000 7f46bd0e8700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46b8100750 0x7f46b81046e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:56:35.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.537+0000 7f46bd0e8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b8101950 0x7f46b8102d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:56:35.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46bd0e8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b81022f0 0x7f46b8103270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:56:35.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46bd0e8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b81039f0 con 0x7f46b8101950 2024-01-25T14:56:35.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46bd0e8700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8103b60 con 0x7f46b8100750 2024-01-25T14:56:35.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46bd0e8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b81a18c0 con 0x7f46b81022f0 2024-01-25T14:56:35.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46b659c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b8101950 0x7f46b8102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:56:35.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46b659c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b8101950 0x7f46b8102d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:59784/0 (socket says 172.21.15.170:59784) 2024-01-25T14:56:35.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46b659c700 1 -- 172.21.15.170:0/2674891813 learned_addr learned my addr 172.21.15.170:0/2674891813 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:56:35.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46b759e700 1 --2- 172.21.15.170:0/2674891813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b81022f0 0x7f46b8103270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:56:35.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46b6d9d700 1 --2- 172.21.15.170:0/2674891813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46b8100750 0x7f46b81046e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:56:35.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46b659c700 1 -- 172.21.15.170:0/2674891813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b81022f0 msgr2=0x7f46b8103270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:56:35.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46b659c700 1 --2- 172.21.15.170:0/2674891813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b81022f0 0x7f46b8103270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:35.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46b659c700 1 -- 172.21.15.170:0/2674891813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46b8100750 msgr2=0x7f46b81046e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:56:35.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46b659c700 1 --2- 172.21.15.170:0/2674891813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46b8100750 0x7f46b81046e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:35.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46b659c700 1 -- 172.21.15.170:0/2674891813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a80095f0 con 0x7f46b8101950 2024-01-25T14:56:35.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46b759e700 1 --2- 172.21.15.170:0/2674891813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b81022f0 0x7f46b8103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T14:56:35.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46b659c700 1 --2- 172.21.15.170:0/2674891813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b8101950 0x7f46b8102d30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00b530 tx=0x7f46ac00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:56:35.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f469ffff700 1 -- 172.21.15.170:0/2674891813 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac011830 con 0x7f46b8101950 2024-01-25T14:56:35.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46bd0e8700 1 -- 172.21.15.170:0/2674891813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b81a1ba0 con 0x7f46b8101950 2024-01-25T14:56:35.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f469ffff700 1 -- 172.21.15.170:0/2674891813 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46ac011e50 con 0x7f46b8101950 2024-01-25T14:56:35.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f46bd0e8700 1 -- 172.21.15.170:0/2674891813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b81a20f0 con 0x7f46b8101950 2024-01-25T14:56:35.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.538+0000 7f469ffff700 1 -- 172.21.15.170:0/2674891813 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac00f2e0 con 0x7f46b8101950 2024-01-25T14:56:35.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.539+0000 7f46bd0e8700 1 -- 172.21.15.170:0/2674891813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b80684a0 con 0x7f46b8101950 2024-01-25T14:56:35.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.541+0000 7f469ffff700 1 -- 172.21.15.170:0/2674891813 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f46ac010580 con 0x7f46b8101950 2024-01-25T14:56:35.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.541+0000 7f469ffff700 1 --2- 172.21.15.170:0/2674891813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f46a00a1370 0x7f46a00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:56:35.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.541+0000 7f46b6d9d700 1 --2- 172.21.15.170:0/2674891813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f46a00a1370 0x7f46a00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:56:35.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.541+0000 7f469ffff700 1 -- 172.21.15.170:0/2674891813 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4562+0+0 (secure 0 0 0) 0x7f46ac0cbcf0 con 0x7f46b8101950 2024-01-25T14:56:35.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.542+0000 7f46b6d9d700 1 --2- 172.21.15.170:0/2674891813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f46a00a1370 0x7f46a00a3830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f46a800b580 tx=0x7f46a8005040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:56:35.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.545+0000 7f469ffff700 1 -- 172.21.15.170:0/2674891813 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f46ac096010 con 0x7f46b8101950 2024-01-25T14:56:35.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:35.744+0000 7f46bd0e8700 1 -- 172.21.15.170:0/2674891813 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f46b80fdeb0 con 0x7f46a00a1370 2024-01-25T14:56:36.347 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:36 smithi170 ceph-mon[31899]: osdmap e39: 6 total, 6 up, 6 in 2024-01-25T14:56:36.348 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:36 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:56:36.348 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:36 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:56:36.348 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:36 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:36.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:36 smithi186 ceph-mon[35697]: osdmap e39: 6 total, 6 up, 6 in 2024-01-25T14:56:36.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:36 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:56:36.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:36 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:56:36.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:36 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:36.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:36 smithi191 ceph-mon[36347]: osdmap e39: 6 total, 6 up, 6 in 2024-01-25T14:56:36.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:36 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:56:36.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:36 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:56:36.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:36 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:37.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:37 smithi186 ceph-mon[35697]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:56:37.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:37 smithi186 ceph-mon[35697]: osdmap e40: 6 total, 6 up, 6 in 2024-01-25T14:56:37.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:37 smithi186 ceph-mon[35697]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:37.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:37 smithi170 ceph-mon[31899]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:56:37.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:37 smithi170 ceph-mon[31899]: osdmap e40: 6 total, 6 up, 6 in 2024-01-25T14:56:37.355 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:37 smithi170 ceph-mon[31899]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:37.385 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:37 smithi191 ceph-mon[36347]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:56:37.385 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:37 smithi191 ceph-mon[36347]: osdmap e40: 6 total, 6 up, 6 in 2024-01-25T14:56:37.385 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:37 smithi191 ceph-mon[36347]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:38.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:38 smithi186 ceph-mon[35697]: osdmap e41: 6 total, 6 up, 6 in 2024-01-25T14:56:38.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:38 smithi170 ceph-mon[31899]: osdmap e41: 6 total, 6 up, 6 in 2024-01-25T14:56:38.398 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:38 smithi191 ceph-mon[36347]: osdmap e41: 6 total, 6 up, 6 in 2024-01-25T14:56:39.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:39 smithi186 ceph-mon[35697]: osdmap e42: 6 total, 6 up, 6 in 2024-01-25T14:56:39.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:39 smithi186 ceph-mon[35697]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:39.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:39 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/989627587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1e8e90e-5bac-4ba8-a44b-3a96beaf0525"}]: dispatch 2024-01-25T14:56:39.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:39 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/989627587' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a1e8e90e-5bac-4ba8-a44b-3a96beaf0525"}]': finished 2024-01-25T14:56:39.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:39 smithi186 ceph-mon[35697]: osdmap e43: 7 total, 6 up, 7 in 2024-01-25T14:56:39.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:39 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:39.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:39 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3972679773' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:56:39.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:39 smithi170 ceph-mon[31899]: osdmap e42: 6 total, 6 up, 6 in 2024-01-25T14:56:39.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:39 smithi170 ceph-mon[31899]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:39.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:39 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/989627587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1e8e90e-5bac-4ba8-a44b-3a96beaf0525"}]: dispatch 2024-01-25T14:56:39.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:39 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/989627587' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a1e8e90e-5bac-4ba8-a44b-3a96beaf0525"}]': finished 2024-01-25T14:56:39.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:39 smithi170 ceph-mon[31899]: osdmap e43: 7 total, 6 up, 7 in 2024-01-25T14:56:39.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:39 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:39.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:39 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3972679773' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:56:39.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:39 smithi191 ceph-mon[36347]: osdmap e42: 6 total, 6 up, 6 in 2024-01-25T14:56:39.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:39 smithi191 ceph-mon[36347]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 586 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:39.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:39 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/989627587' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1e8e90e-5bac-4ba8-a44b-3a96beaf0525"}]: dispatch 2024-01-25T14:56:39.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:39 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/989627587' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a1e8e90e-5bac-4ba8-a44b-3a96beaf0525"}]': finished 2024-01-25T14:56:39.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:39 smithi191 ceph-mon[36347]: osdmap e43: 7 total, 6 up, 7 in 2024-01-25T14:56:39.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:39 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:39.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:39 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3972679773' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:56:41.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:41 smithi191 ceph-mon[36347]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-01-25T14:56:41.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:41 smithi186 ceph-mon[35697]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-01-25T14:56:41.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:41 smithi170 ceph-mon[31899]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-01-25T14:56:43.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:43 smithi191 ceph-mon[36347]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-25T14:56:43.503 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:43 smithi170 ceph-mon[31899]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-25T14:56:43.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:43 smithi186 ceph-mon[35697]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-01-25T14:56:45.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:45 smithi170 ceph-mon[31899]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-01-25T14:56:45.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:45 smithi191 ceph-mon[36347]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-01-25T14:56:45.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:45 smithi186 ceph-mon[35697]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-01-25T14:56:46.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-25T14:56:46.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:46.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-25T14:56:46.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:46.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-01-25T14:56:46.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:47.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:47 smithi170 ceph-mon[31899]: Deploying daemon osd.6 on smithi170 2024-01-25T14:56:47.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:47 smithi170 ceph-mon[31899]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-25T14:56:47.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:47 smithi191 ceph-mon[36347]: Deploying daemon osd.6 on smithi170 2024-01-25T14:56:47.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:47 smithi191 ceph-mon[36347]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-25T14:56:47.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:47 smithi186 ceph-mon[35697]: Deploying daemon osd.6 on smithi170 2024-01-25T14:56:47.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:47 smithi186 ceph-mon[35697]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-01-25T14:56:49.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:48 smithi170 ceph-mon[31899]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-25T14:56:49.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:48 smithi186 ceph-mon[35697]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-25T14:56:49.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:48 smithi191 ceph-mon[36347]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-01-25T14:56:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:51 smithi170 ceph-mon[31899]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:51 smithi191 ceph-mon[36347]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:51.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:51 smithi186 ceph-mon[35697]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:51.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:51.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:51.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:53.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:53 smithi191 ceph-mon[36347]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:53.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:53 smithi186 ceph-mon[35697]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:53 smithi170 ceph-mon[31899]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:55.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:55.217+0000 7f469ffff700 1 -- 172.21.15.170:0/2674891813 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f46b80fdeb0 con 0x7f46a00a1370 2024-01-25T14:56:55.219 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 6 on host 'smithi170' 2024-01-25T14:56:55.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:55.220+0000 7f46bd0e8700 1 -- 172.21.15.170:0/2674891813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f46a00a1370 msgr2=0x7f46a00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:56:55.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:55.220+0000 7f46bd0e8700 1 --2- 172.21.15.170:0/2674891813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f46a00a1370 0x7f46a00a3830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f46a800b580 tx=0x7f46a8005040 comp rx=0 tx=0).stop 2024-01-25T14:56:55.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:55.220+0000 7f46bd0e8700 1 -- 172.21.15.170:0/2674891813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b8101950 msgr2=0x7f46b8102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:56:55.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:55.220+0000 7f46bd0e8700 1 --2- 172.21.15.170:0/2674891813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b8101950 0x7f46b8102d30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00b530 tx=0x7f46ac00b8f0 comp rx=0 tx=0).stop 2024-01-25T14:56:55.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:55.220+0000 7f46bd0e8700 1 -- 172.21.15.170:0/2674891813 shutdown_connections 2024-01-25T14:56:55.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:55.220+0000 7f46bd0e8700 1 --2- 172.21.15.170:0/2674891813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f46a00a1370 0x7f46a00a3830 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:55.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:55.220+0000 7f46bd0e8700 1 --2- 172.21.15.170:0/2674891813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f46b81022f0 0x7f46b8103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:55.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:55.220+0000 7f46bd0e8700 1 --2- 172.21.15.170:0/2674891813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f46b8100750 0x7f46b81046e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:55.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:55.220+0000 7f46bd0e8700 1 --2- 172.21.15.170:0/2674891813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f46b8101950 0x7f46b8102d30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:56:55.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:55.220+0000 7f46bd0e8700 1 -- 172.21.15.170:0/2674891813 >> 172.21.15.170:0/2674891813 conn(0x7f46b80fbcd0 msgr2=0x7f46b80fd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:56:55.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:55.220+0000 7f46bd0e8700 1 -- 172.21.15.170:0/2674891813 shutdown_connections 2024-01-25T14:56:55.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:56:55.220+0000 7f46bd0e8700 1 -- 172.21.15.170:0/2674891813 wait complete. 2024-01-25T14:56:55.514 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:55 smithi170 ceph-mon[31899]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:55.514 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:55 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:55.514 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:55 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:55.514 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:55 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:55.514 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:55 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:55.514 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:55 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:55.514 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:55 smithi170 ceph-mon[31899]: from='osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-25T14:56:55.514 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:55 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:55.514 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:55 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:55.514 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:55 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:55.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:55 smithi186 ceph-mon[35697]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:55.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:55 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:55.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:55 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:55.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:55 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:55.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:55 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:55 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:55 smithi186 ceph-mon[35697]: from='osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-25T14:56:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:55 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:55 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:55 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:55.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:55 smithi191 ceph-mon[36347]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:55.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:55 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:55.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:55 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:55.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:55 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:55.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:55 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:55.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:55 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:55.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:55 smithi191 ceph-mon[36347]: from='osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-01-25T14:56:55.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:55 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:55.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:55 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:55.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:55 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:56:55.815 DEBUG:teuthology.orchestra.run.smithi170:osd.6> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.6.service 2024-01-25T14:56:55.817 INFO:tasks.cephadm:Deploying osd.7 on smithi186 with /dev/vg_nvme/lv_2... 2024-01-25T14:56:55.817 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-01-25T14:56:56.062 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.b/config 2024-01-25T14:56:56.509 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:56 smithi186 ceph-mon[35697]: from='osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-25T14:56:56.509 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:56 smithi186 ceph-mon[35697]: osdmap e44: 7 total, 6 up, 7 in 2024-01-25T14:56:56.509 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:56 smithi186 ceph-mon[35697]: from='osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-01-25T14:56:56.509 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:56.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:56 smithi170 ceph-mon[31899]: from='osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-25T14:56:56.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:56 smithi170 ceph-mon[31899]: osdmap e44: 7 total, 6 up, 7 in 2024-01-25T14:56:56.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:56 smithi170 ceph-mon[31899]: from='osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-01-25T14:56:56.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:56.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:56 smithi191 ceph-mon[36347]: from='osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-01-25T14:56:56.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:56 smithi191 ceph-mon[36347]: osdmap e44: 7 total, 6 up, 7 in 2024-01-25T14:56:56.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:56 smithi191 ceph-mon[36347]: from='osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-01-25T14:56:56.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:57.290 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 14:56:57 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T14:56:57.018+0000 7fb92055b700 -1 osd.6 0 waiting for initial osdmap 2024-01-25T14:56:57.290 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 14:56:57 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T14:56:57.029+0000 7fb918b4e700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T14:56:57.518 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:57 smithi186 ceph-mon[35697]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:57.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:57 smithi186 ceph-mon[35697]: from='osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-01-25T14:56:57.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:57 smithi186 ceph-mon[35697]: osdmap e45: 7 total, 6 up, 7 in 2024-01-25T14:56:57.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:57 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:57.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:57 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:57.519 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:57 smithi186 ceph-mon[35697]: from='osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876]' entity='osd.6' 2024-01-25T14:56:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:57 smithi170 ceph-mon[31899]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:57 smithi170 ceph-mon[31899]: from='osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-01-25T14:56:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:57 smithi170 ceph-mon[31899]: osdmap e45: 7 total, 6 up, 7 in 2024-01-25T14:56:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:57 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:57 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:57 smithi170 ceph-mon[31899]: from='osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876]' entity='osd.6' 2024-01-25T14:56:57.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:57 smithi191 ceph-mon[36347]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:57 smithi191 ceph-mon[36347]: from='osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-01-25T14:56:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:57 smithi191 ceph-mon[36347]: osdmap e45: 7 total, 6 up, 7 in 2024-01-25T14:56:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:57 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:57 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:57 smithi191 ceph-mon[36347]: from='osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876]' entity='osd.6' 2024-01-25T14:56:58.069 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-01-25T14:56:58.070 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-01-25T14:56:58.070 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-01-25T14:56:58.070 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-01-25T14:56:58.070 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114575 s, 915 MB/s 2024-01-25T14:56:58.070 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-01-25T14:56:58.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:58 smithi170 ceph-mon[31899]: purged_snaps scrub starts 2024-01-25T14:56:58.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:58 smithi170 ceph-mon[31899]: purged_snaps scrub ok 2024-01-25T14:56:58.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:58.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:58 smithi170 ceph-mon[31899]: osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876] boot 2024-01-25T14:56:58.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:58 smithi170 ceph-mon[31899]: osdmap e46: 7 total, 7 up, 7 in 2024-01-25T14:56:58.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:58 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:58.376 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:58 smithi186 ceph-mon[35697]: purged_snaps scrub starts 2024-01-25T14:56:58.376 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:58 smithi186 ceph-mon[35697]: purged_snaps scrub ok 2024-01-25T14:56:58.376 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:58.376 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:58 smithi186 ceph-mon[35697]: osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876] boot 2024-01-25T14:56:58.376 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:58 smithi186 ceph-mon[35697]: osdmap e46: 7 total, 7 up, 7 in 2024-01-25T14:56:58.376 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:58 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:58.706 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch daemon add osd smithi186:vg_nvme/lv_2 2024-01-25T14:56:58.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:58 smithi191 ceph-mon[36347]: purged_snaps scrub starts 2024-01-25T14:56:58.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:58 smithi191 ceph-mon[36347]: purged_snaps scrub ok 2024-01-25T14:56:58.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:58.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:58 smithi191 ceph-mon[36347]: osd.6 [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876] boot 2024-01-25T14:56:58.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:58 smithi191 ceph-mon[36347]: osdmap e46: 7 total, 7 up, 7 in 2024-01-25T14:56:58.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:58 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-01-25T14:56:58.952 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.b/config 2024-01-25T14:56:59.342 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:59 smithi186 ceph-mon[35697]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:59.342 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:59 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:59.342 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:59 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:59.342 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:59 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:59.342 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:59 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:59.343 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:59 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:59.343 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:59 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:59.343 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:59 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:59.343 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:59 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:59.343 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:56:59 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:59.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:59 smithi170 ceph-mon[31899]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:59.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:59.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:59.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:59.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:59.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:59.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:59.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:59.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:59.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:56:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:59.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:59 smithi191 ceph-mon[36347]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 536 GiB / 536 GiB avail 2024-01-25T14:56:59.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:59 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:59.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:59 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:59.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:59 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:59.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:59 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:59.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:59 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:56:59.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:59 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:56:59.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:59 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:56:59.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:59 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:56:59.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:56:59 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:00.468 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.465+0000 7fb68b7bd700 1 -- 172.21.15.186:0/1765640451 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6840ff450 msgr2=0x7fb6840ff850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:57:00.468 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.465+0000 7fb68b7bd700 1 --2- 172.21.15.186:0/1765640451 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6840ff450 0x7fb6840ff850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb680009990 tx=0x7fb680009ca0 comp rx=0 tx=0).stop 2024-01-25T14:57:00.468 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.465+0000 7fb68b7bd700 1 -- 172.21.15.186:0/1765640451 shutdown_connections 2024-01-25T14:57:00.468 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.465+0000 7fb68b7bd700 1 --2- 172.21.15.186:0/1765640451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6841074d0 0x7fb684109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:00.468 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.465+0000 7fb68b7bd700 1 --2- 172.21.15.186:0/1765640451 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6840ff450 0x7fb6840ff850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:00.469 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.465+0000 7fb68b7bd700 1 --2- 172.21.15.186:0/1765640451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6840ffe20 0x7fb684106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:00.469 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.465+0000 7fb68b7bd700 1 -- 172.21.15.186:0/1765640451 >> 172.21.15.186:0/1765640451 conn(0x7fb6840fafe0 msgr2=0x7fb6840fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:57:00.469 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.465+0000 7fb68b7bd700 1 -- 172.21.15.186:0/1765640451 shutdown_connections 2024-01-25T14:57:00.469 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.465+0000 7fb68b7bd700 1 -- 172.21.15.186:0/1765640451 wait complete. 2024-01-25T14:57:00.469 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.465+0000 7fb68b7bd700 1 Processor -- start 2024-01-25T14:57:00.469 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.465+0000 7fb68b7bd700 1 -- start start 2024-01-25T14:57:00.469 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.465+0000 7fb68b7bd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6840ff450 0x7fb6841976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:57:00.469 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.465+0000 7fb68b7bd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6840ffe20 0x7fb684197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:57:00.469 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb68b7bd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6841074d0 0x7fb68419eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:57:00.469 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb68b7bd700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68419f270 con 0x7fb6840ffe20 2024-01-25T14:57:00.469 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb68b7bd700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68419f3b0 con 0x7fb6841074d0 2024-01-25T14:57:00.469 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb68b7bd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68419f540 con 0x7fb6840ff450 2024-01-25T14:57:00.469 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb689d5a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6841074d0 0x7fb68419eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:57:00.470 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb689d5a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6841074d0 0x7fb68419eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:44570/0 (socket says 172.21.15.186:44570) 2024-01-25T14:57:00.470 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb689d5a700 1 -- 172.21.15.186:0/2320167466 learned_addr learned my addr 172.21.15.186:0/2320167466 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-01-25T14:57:00.470 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb689559700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6840ff450 0x7fb6841976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:57:00.470 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb688d58700 1 --2- 172.21.15.186:0/2320167466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6840ffe20 0x7fb684197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:57:00.470 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb689d5a700 1 -- 172.21.15.186:0/2320167466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6840ff450 msgr2=0x7fb6841976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:57:00.470 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb689d5a700 1 --2- 172.21.15.186:0/2320167466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6840ff450 0x7fb6841976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:00.470 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb689d5a700 1 -- 172.21.15.186:0/2320167466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6840ffe20 msgr2=0x7fb684197c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:57:00.470 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb689d5a700 1 --2- 172.21.15.186:0/2320167466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6840ffe20 0x7fb684197c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:00.470 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb689d5a700 1 -- 172.21.15.186:0/2320167466 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6800095f0 con 0x7fb6841074d0 2024-01-25T14:57:00.470 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb689d5a700 1 --2- 172.21.15.186:0/2320167466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6841074d0 0x7fb68419eca0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb67c007d70 tx=0x7fb67c00a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:57:00.470 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb67a7fc700 1 -- 172.21.15.186:0/2320167466 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00ad40 con 0x7fb6841074d0 2024-01-25T14:57:00.470 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb67a7fc700 1 -- 172.21.15.186:0/2320167466 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb67c0128e0 con 0x7fb6841074d0 2024-01-25T14:57:00.470 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb68b7bd700 1 -- 172.21.15.186:0/2320167466 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68419f820 con 0x7fb6841074d0 2024-01-25T14:57:00.470 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb67a7fc700 1 -- 172.21.15.186:0/2320167466 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c0116b0 con 0x7fb6841074d0 2024-01-25T14:57:00.471 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.466+0000 7fb68b7bd700 1 -- 172.21.15.186:0/2320167466 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb68419fcd0 con 0x7fb6841074d0 2024-01-25T14:57:00.471 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.467+0000 7fb68b7bd700 1 -- 172.21.15.186:0/2320167466 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb684106720 con 0x7fb6841074d0 2024-01-25T14:57:00.471 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.468+0000 7fb67a7fc700 1 -- 172.21.15.186:0/2320167466 <== mon.2 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fb67c012a50 con 0x7fb6841074d0 2024-01-25T14:57:00.471 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.469+0000 7fb67a7fc700 1 --2- 172.21.15.186:0/2320167466 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb6700a1370 0x7fb6700a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:57:00.472 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.469+0000 7fb67a7fc700 1 -- 172.21.15.186:0/2320167466 <== mon.2 v2:172.21.15.186:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4965+0+0 (secure 0 0 0) 0x7fb67c0cc090 con 0x7fb6841074d0 2024-01-25T14:57:00.472 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.469+0000 7fb689559700 1 --2- 172.21.15.186:0/2320167466 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb6700a1370 0x7fb6700a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:57:00.472 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.470+0000 7fb689559700 1 --2- 172.21.15.186:0/2320167466 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb6700a1370 0x7fb6700a3830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb68000b5c0 tx=0x7fb680003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:57:00.474 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.473+0000 7fb67a7fc700 1 -- 172.21.15.186:0/2320167466 <== mon.2 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb67c096220 con 0x7fb6841074d0 2024-01-25T14:57:00.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:00 smithi186 ceph-mon[35697]: Detected new or changed devices on smithi170 2024-01-25T14:57:00.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:00 smithi186 ceph-mon[35697]: Adjusting osd_memory_target on smithi170 to 5696M 2024-01-25T14:57:00.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:00 smithi186 ceph-mon[35697]: osdmap e47: 7 total, 7 up, 7 in 2024-01-25T14:57:00.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:00 smithi170 ceph-mon[31899]: Detected new or changed devices on smithi170 2024-01-25T14:57:00.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:00 smithi170 ceph-mon[31899]: Adjusting osd_memory_target on smithi170 to 5696M 2024-01-25T14:57:00.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:00 smithi170 ceph-mon[31899]: osdmap e47: 7 total, 7 up, 7 in 2024-01-25T14:57:00.671 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:00.670+0000 7fb68b7bd700 1 -- 172.21.15.186:0/2320167466 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb68402d540 con 0x7fb6700a1370 2024-01-25T14:57:00.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:00 smithi191 ceph-mon[36347]: Detected new or changed devices on smithi170 2024-01-25T14:57:00.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:00 smithi191 ceph-mon[36347]: Adjusting osd_memory_target on smithi170 to 5696M 2024-01-25T14:57:00.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:00 smithi191 ceph-mon[36347]: osdmap e47: 7 total, 7 up, 7 in 2024-01-25T14:57:01.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:01 smithi186 ceph-mon[35697]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:01.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:01 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:57:01.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:01 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:57:01.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:01 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:01.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:01 smithi170 ceph-mon[31899]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:01.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:01 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:57:01.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:01 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:57:01.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:01 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:01.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:01 smithi191 ceph-mon[36347]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:01.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:01 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:57:01.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:01 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:57:01.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:01 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:02.465 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:02 smithi186 ceph-mon[35697]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:57:02.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:02 smithi170 ceph-mon[31899]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:57:02.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:02 smithi191 ceph-mon[36347]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:57:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:03 smithi186 ceph-mon[35697]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:03 smithi186 ceph-mon[35697]: from='client.? 172.21.15.186:0/1547194589' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3cc3b25d-83d5-46e4-a365-3fd8bebd6587"}]: dispatch 2024-01-25T14:57:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:03 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3cc3b25d-83d5-46e4-a365-3fd8bebd6587"}]: dispatch 2024-01-25T14:57:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:03 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3cc3b25d-83d5-46e4-a365-3fd8bebd6587"}]': finished 2024-01-25T14:57:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:03 smithi186 ceph-mon[35697]: osdmap e48: 8 total, 7 up, 8 in 2024-01-25T14:57:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:03 smithi170 ceph-mon[31899]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:03 smithi170 ceph-mon[31899]: from='client.? 172.21.15.186:0/1547194589' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3cc3b25d-83d5-46e4-a365-3fd8bebd6587"}]: dispatch 2024-01-25T14:57:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:03 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3cc3b25d-83d5-46e4-a365-3fd8bebd6587"}]: dispatch 2024-01-25T14:57:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:03 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3cc3b25d-83d5-46e4-a365-3fd8bebd6587"}]': finished 2024-01-25T14:57:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:03 smithi170 ceph-mon[31899]: osdmap e48: 8 total, 7 up, 8 in 2024-01-25T14:57:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:03.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:03 smithi191 ceph-mon[36347]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:03.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:03 smithi191 ceph-mon[36347]: from='client.? 172.21.15.186:0/1547194589' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3cc3b25d-83d5-46e4-a365-3fd8bebd6587"}]: dispatch 2024-01-25T14:57:03.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:03 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3cc3b25d-83d5-46e4-a365-3fd8bebd6587"}]: dispatch 2024-01-25T14:57:03.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:03 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3cc3b25d-83d5-46e4-a365-3fd8bebd6587"}]': finished 2024-01-25T14:57:03.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:03 smithi191 ceph-mon[36347]: osdmap e48: 8 total, 7 up, 8 in 2024-01-25T14:57:03.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:04.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:04 smithi170 ceph-mon[31899]: from='client.? 172.21.15.186:0/3656079927' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:57:04.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:04 smithi170 ceph-mon[31899]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:04.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:04 smithi191 ceph-mon[36347]: from='client.? 172.21.15.186:0/3656079927' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:57:04.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:04 smithi191 ceph-mon[36347]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:04.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:04 smithi186 ceph-mon[35697]: from='client.? 172.21.15.186:0/3656079927' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:57:04.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:04 smithi186 ceph-mon[35697]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:07.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:07 smithi191 ceph-mon[36347]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:07.557 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:07 smithi186 ceph-mon[35697]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:07.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:07 smithi170 ceph-mon[31899]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:09.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:08 smithi186 ceph-mon[35697]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:09.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:08 smithi170 ceph-mon[31899]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:09.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:08 smithi191 ceph-mon[36347]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:11.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:11 smithi191 ceph-mon[36347]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:11.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-25T14:57:11.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:11.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:11 smithi186 ceph-mon[35697]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:11.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-25T14:57:11.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:11.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:11 smithi170 ceph-mon[31899]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:11.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-01-25T14:57:11.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:12.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:12 smithi191 ceph-mon[36347]: Deploying daemon osd.7 on smithi186 2024-01-25T14:57:12.523 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:12 smithi186 ceph-mon[35697]: Deploying daemon osd.7 on smithi186 2024-01-25T14:57:12.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:12 smithi170 ceph-mon[31899]: Deploying daemon osd.7 on smithi186 2024-01-25T14:57:13.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:13 smithi191 ceph-mon[36347]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:13.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:13 smithi186 ceph-mon[35697]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:13.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:13 smithi170 ceph-mon[31899]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:15.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:15 smithi191 ceph-mon[36347]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:15.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:15 smithi186 ceph-mon[35697]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:15 smithi170 ceph-mon[31899]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:17.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:17 smithi191 ceph-mon[36347]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:17.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:17 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:17.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:17 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:17.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:17 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:57:17.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:17 smithi186 ceph-mon[35697]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:17.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:17 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:17.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:17 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:17.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:17 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:57:17.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:17 smithi170 ceph-mon[31899]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:17.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:17 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:17.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:17 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:17.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:17 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:57:19.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:18 smithi186 ceph-mon[35697]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:19.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:18 smithi170 ceph-mon[31899]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:19.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:18 smithi191 ceph-mon[36347]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:20.144 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:20.143+0000 7fb67a7fc700 1 -- 172.21.15.186:0/2320167466 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb68402d540 con 0x7fb6700a1370 2024-01-25T14:57:20.145 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 7 on host 'smithi186' 2024-01-25T14:57:20.146 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:20.145+0000 7fb68b7bd700 1 -- 172.21.15.186:0/2320167466 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb6700a1370 msgr2=0x7fb6700a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:57:20.146 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:20.145+0000 7fb68b7bd700 1 --2- 172.21.15.186:0/2320167466 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb6700a1370 0x7fb6700a3830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb68000b5c0 tx=0x7fb680003790 comp rx=0 tx=0).stop 2024-01-25T14:57:20.147 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:20.145+0000 7fb68b7bd700 1 -- 172.21.15.186:0/2320167466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6841074d0 msgr2=0x7fb68419eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:57:20.147 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:20.145+0000 7fb68b7bd700 1 --2- 172.21.15.186:0/2320167466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6841074d0 0x7fb68419eca0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb67c007d70 tx=0x7fb67c00a340 comp rx=0 tx=0).stop 2024-01-25T14:57:20.147 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:20.145+0000 7fb68b7bd700 1 -- 172.21.15.186:0/2320167466 shutdown_connections 2024-01-25T14:57:20.147 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:20.145+0000 7fb68b7bd700 1 --2- 172.21.15.186:0/2320167466 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb6700a1370 0x7fb6700a3830 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:20.147 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:20.145+0000 7fb68b7bd700 1 --2- 172.21.15.186:0/2320167466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb6840ff450 0x7fb6841976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:20.147 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:20.145+0000 7fb68b7bd700 1 --2- 172.21.15.186:0/2320167466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb6841074d0 0x7fb68419eca0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:20.147 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:20.145+0000 7fb68b7bd700 1 --2- 172.21.15.186:0/2320167466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb6840ffe20 0x7fb684197c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:20.147 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:20.145+0000 7fb68b7bd700 1 -- 172.21.15.186:0/2320167466 >> 172.21.15.186:0/2320167466 conn(0x7fb6840fafe0 msgr2=0x7fb6840fbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:57:20.147 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:20.146+0000 7fb68b7bd700 1 -- 172.21.15.186:0/2320167466 shutdown_connections 2024-01-25T14:57:20.147 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:57:20.146+0000 7fb68b7bd700 1 -- 172.21.15.186:0/2320167466 wait complete. 2024-01-25T14:57:20.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:20 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:20.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:20 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:20.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:20 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:20.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:20 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:57:20.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:20 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:20.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:20 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:57:20.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:20 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:20.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:20 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:20.580 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:20 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:20.580 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:20 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:20.580 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:20 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:20.580 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:20 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:57:20.580 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:20 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:20.580 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:20 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:57:20.580 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:20 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:20.580 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:20 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:20.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:20 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:20.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:20 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:20.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:20 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:20.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:20 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:57:20.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:20 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:20.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:20 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:57:20.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:20 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:20.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:20 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:20.802 DEBUG:teuthology.orchestra.run.smithi186:osd.7> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.7.service 2024-01-25T14:57:20.805 INFO:tasks.cephadm:Deploying osd.8 on smithi191 with /dev/vg_nvme/lv_2... 2024-01-25T14:57:20.805 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-01-25T14:57:21.049 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T14:57:21.313 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:21 smithi186 ceph-mon[35697]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:21.313 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:21 smithi186 ceph-mon[35697]: from='osd.7 [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-25T14:57:21.313 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:21 smithi186 ceph-mon[35697]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-25T14:57:21.481 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:21 smithi191 ceph-mon[36347]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:21.481 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:21 smithi191 ceph-mon[36347]: from='osd.7 [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-25T14:57:21.481 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:21 smithi191 ceph-mon[36347]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-25T14:57:21.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:21 smithi170 ceph-mon[31899]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:21.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:21 smithi170 ceph-mon[31899]: from='osd.7 [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-25T14:57:21.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:21 smithi170 ceph-mon[31899]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-01-25T14:57:22.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:22 smithi191 ceph-mon[36347]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-25T14:57:22.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:22 smithi191 ceph-mon[36347]: osdmap e49: 8 total, 7 up, 8 in 2024-01-25T14:57:22.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:22 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:22.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:22 smithi191 ceph-mon[36347]: from='osd.7 [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:57:22.473 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:22 smithi191 ceph-mon[36347]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:57:22.494 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:22 smithi186 ceph-mon[35697]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-25T14:57:22.494 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:22 smithi186 ceph-mon[35697]: osdmap e49: 8 total, 7 up, 8 in 2024-01-25T14:57:22.494 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:22 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:22.495 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:22 smithi186 ceph-mon[35697]: from='osd.7 [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:57:22.495 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:22 smithi186 ceph-mon[35697]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:57:22.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:22 smithi170 ceph-mon[31899]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-01-25T14:57:22.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:22 smithi170 ceph-mon[31899]: osdmap e49: 8 total, 7 up, 8 in 2024-01-25T14:57:22.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:22 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:22.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:22 smithi170 ceph-mon[31899]: from='osd.7 [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:57:22.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:22 smithi170 ceph-mon[31899]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:57:23.018 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-01-25T14:57:23.018 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-01-25T14:57:23.018 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2024-01-25T14:57:23.018 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2024-01-25T14:57:23.019 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.013058 s, 803 MB/s 2024-01-25T14:57:23.019 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2024-01-25T14:57:23.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:23 smithi186 ceph-mon[35697]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:23.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:23 smithi186 ceph-mon[35697]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-01-25T14:57:23.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:23 smithi186 ceph-mon[35697]: osdmap e50: 8 total, 7 up, 8 in 2024-01-25T14:57:23.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:23 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:23.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:23 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:23.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:23 smithi186 ceph-mon[35697]: osdmap e51: 8 total, 7 up, 8 in 2024-01-25T14:57:23.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:23 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:23.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:23 smithi186 ceph-mon[35697]: from='osd.7 ' entity='osd.7' 2024-01-25T14:57:23.605 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 14:57:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T14:57:23.117+0000 7f5375cee700 -1 osd.7 0 waiting for initial osdmap 2024-01-25T14:57:23.605 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 14:57:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T14:57:23.132+0000 7f536e2e1700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T14:57:23.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:23 smithi170 ceph-mon[31899]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:23.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:23 smithi170 ceph-mon[31899]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-01-25T14:57:23.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:23 smithi170 ceph-mon[31899]: osdmap e50: 8 total, 7 up, 8 in 2024-01-25T14:57:23.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:23 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:23.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:23 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:23.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:23 smithi170 ceph-mon[31899]: osdmap e51: 8 total, 7 up, 8 in 2024-01-25T14:57:23.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:23 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:23.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:23 smithi170 ceph-mon[31899]: from='osd.7 ' entity='osd.7' 2024-01-25T14:57:23.651 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:23 smithi191 ceph-mon[36347]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:23.651 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:23 smithi191 ceph-mon[36347]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-01-25T14:57:23.651 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:23 smithi191 ceph-mon[36347]: osdmap e50: 8 total, 7 up, 8 in 2024-01-25T14:57:23.651 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:23 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:23.652 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:23 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:23.652 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:23 smithi191 ceph-mon[36347]: osdmap e51: 8 total, 7 up, 8 in 2024-01-25T14:57:23.652 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:23 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:23.652 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:23 smithi191 ceph-mon[36347]: from='osd.7 ' entity='osd.7' 2024-01-25T14:57:23.678 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch daemon add osd smithi191:vg_nvme/lv_2 2024-01-25T14:57:23.918 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T14:57:24.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:24 smithi191 ceph-mon[36347]: purged_snaps scrub starts 2024-01-25T14:57:24.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:24 smithi191 ceph-mon[36347]: purged_snaps scrub ok 2024-01-25T14:57:24.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:24.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:24.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:24 smithi191 ceph-mon[36347]: osd.7 [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638] boot 2024-01-25T14:57:24.599 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:24 smithi191 ceph-mon[36347]: osdmap e52: 8 total, 8 up, 8 in 2024-01-25T14:57:24.600 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:24.600 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:24.600 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:24.600 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:24.600 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:24.600 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:24.600 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:24.600 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:57:24.600 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:24.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:24 smithi186 ceph-mon[35697]: purged_snaps scrub starts 2024-01-25T14:57:24.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:24 smithi186 ceph-mon[35697]: purged_snaps scrub ok 2024-01-25T14:57:24.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:24.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:24.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:24 smithi186 ceph-mon[35697]: osd.7 [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638] boot 2024-01-25T14:57:24.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:24 smithi186 ceph-mon[35697]: osdmap e52: 8 total, 8 up, 8 in 2024-01-25T14:57:24.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:24.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:24.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:24.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:24.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:24.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:24.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:24.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:57:24.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:24.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:24 smithi170 ceph-mon[31899]: purged_snaps scrub starts 2024-01-25T14:57:24.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:24 smithi170 ceph-mon[31899]: purged_snaps scrub ok 2024-01-25T14:57:24.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:24.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:24.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:24 smithi170 ceph-mon[31899]: osd.7 [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638] boot 2024-01-25T14:57:24.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:24 smithi170 ceph-mon[31899]: osdmap e52: 8 total, 8 up, 8 in 2024-01-25T14:57:24.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-01-25T14:57:24.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:24.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:24.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:24.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:24.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:24.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:24.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:57:24.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:25.342 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.340+0000 7f4943e07700 1 -- 172.21.15.191:0/2097229167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f493c101810 msgr2=0x7f493c101c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:57:25.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.340+0000 7f4943e07700 1 --2- 172.21.15.191:0/2097229167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f493c101810 0x7f493c101c30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f493400b0a0 tx=0x7f493400b3b0 comp rx=0 tx=0).stop 2024-01-25T14:57:25.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.340+0000 7f4943e07700 1 -- 172.21.15.191:0/2097229167 shutdown_connections 2024-01-25T14:57:25.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.340+0000 7f4943e07700 1 --2- 172.21.15.191:0/2097229167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f493c101810 0x7f493c101c30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:25.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.340+0000 7f4943e07700 1 --2- 172.21.15.191:0/2097229167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f493c1033b0 0x7f493c109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:25.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.340+0000 7f4943e07700 1 --2- 172.21.15.191:0/2097229167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f493c102a10 0x7f493c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:25.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.340+0000 7f4943e07700 1 -- 172.21.15.191:0/2097229167 >> 172.21.15.191:0/2097229167 conn(0x7f493c0fcdf0 msgr2=0x7f493c0ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:57:25.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.340+0000 7f4943e07700 1 -- 172.21.15.191:0/2097229167 shutdown_connections 2024-01-25T14:57:25.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.340+0000 7f4943e07700 1 -- 172.21.15.191:0/2097229167 wait complete. 2024-01-25T14:57:25.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.340+0000 7f4943e07700 1 Processor -- start 2024-01-25T14:57:25.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.340+0000 7f4943e07700 1 -- start start 2024-01-25T14:57:25.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f4943e07700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f493c101810 0x7f493c1977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:57:25.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f4943e07700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f493c102a10 0x7f493c197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:57:25.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f4943e07700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f493c1033b0 0x7f493c19ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:57:25.343 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f4943e07700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c19f360 con 0x7f493c101810 2024-01-25T14:57:25.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f4943e07700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c19f4a0 con 0x7f493c1033b0 2024-01-25T14:57:25.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f4943e07700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c19f630 con 0x7f493c102a10 2024-01-25T14:57:25.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f49413a2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f493c102a10 0x7f493c197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:57:25.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f49413a2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f493c102a10 0x7f493c197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:43940/0 (socket says 172.21.15.191:43940) 2024-01-25T14:57:25.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f49413a2700 1 -- 172.21.15.191:0/1728499441 learned_addr learned my addr 172.21.15.191:0/1728499441 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-01-25T14:57:25.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f49423a4700 1 --2- 172.21.15.191:0/1728499441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f493c1033b0 0x7f493c19ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:57:25.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f4941ba3700 1 --2- 172.21.15.191:0/1728499441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f493c101810 0x7f493c1977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:57:25.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f49413a2700 1 -- 172.21.15.191:0/1728499441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f493c1033b0 msgr2=0x7f493c19ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:57:25.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f49413a2700 1 --2- 172.21.15.191:0/1728499441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f493c1033b0 0x7f493c19ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:25.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f49413a2700 1 -- 172.21.15.191:0/1728499441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f493c101810 msgr2=0x7f493c1977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:57:25.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f49413a2700 1 --2- 172.21.15.191:0/1728499441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f493c101810 0x7f493c1977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:25.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f49413a2700 1 -- 172.21.15.191:0/1728499441 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4934009d00 con 0x7f493c102a10 2024-01-25T14:57:25.344 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f49413a2700 1 --2- 172.21.15.191:0/1728499441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f493c102a10 0x7f493c197d10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f492c00c9e0 tx=0x7f492c00cda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:57:25.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f4932ffd700 1 -- 172.21.15.191:0/1728499441 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c007ac0 con 0x7f493c102a10 2024-01-25T14:57:25.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f4943e07700 1 -- 172.21.15.191:0/1728499441 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c19f910 con 0x7f493c102a10 2024-01-25T14:57:25.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f4932ffd700 1 -- 172.21.15.191:0/1728499441 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f492c007c20 con 0x7f493c102a10 2024-01-25T14:57:25.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f4932ffd700 1 -- 172.21.15.191:0/1728499441 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c018660 con 0x7f493c102a10 2024-01-25T14:57:25.345 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.341+0000 7f4943e07700 1 -- 172.21.15.191:0/1728499441 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c19fe60 con 0x7f493c102a10 2024-01-25T14:57:25.346 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.342+0000 7f4943e07700 1 -- 172.21.15.191:0/1728499441 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493c108ca0 con 0x7f493c102a10 2024-01-25T14:57:25.346 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.343+0000 7f4932ffd700 1 -- 172.21.15.191:0/1728499441 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f492c00f450 con 0x7f493c102a10 2024-01-25T14:57:25.346 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.344+0000 7f4932ffd700 1 --2- 172.21.15.191:0/1728499441 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f49280a1370 0x7f49280a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:57:25.346 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.344+0000 7f4932ffd700 1 -- 172.21.15.191:0/1728499441 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f492c0cc230 con 0x7f493c102a10 2024-01-25T14:57:25.346 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.344+0000 7f4941ba3700 1 --2- 172.21.15.191:0/1728499441 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f49280a1370 0x7f49280a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:57:25.346 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.345+0000 7f4941ba3700 1 --2- 172.21.15.191:0/1728499441 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f49280a1370 0x7f49280a3830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4934009fd0 tx=0x7f49340061f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:57:25.348 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.348+0000 7f4932ffd700 1 -- 172.21.15.191:0/1728499441 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f492c096280 con 0x7f493c102a10 2024-01-25T14:57:25.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:25 smithi191 ceph-mon[36347]: Detected new or changed devices on smithi186 2024-01-25T14:57:25.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:25 smithi191 ceph-mon[36347]: Adjusting osd_memory_target on smithi186 to 5693M 2024-01-25T14:57:25.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:25 smithi191 ceph-mon[36347]: pgmap v176: 1 pgs: 1 remapped; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:25.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:25 smithi191 ceph-mon[36347]: osdmap e53: 8 total, 8 up, 8 in 2024-01-25T14:57:25.546 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:25.545+0000 7f4943e07700 1 -- 172.21.15.191:0/1728499441 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f493c0684a0 con 0x7f49280a1370 2024-01-25T14:57:25.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:25 smithi186 ceph-mon[35697]: Detected new or changed devices on smithi186 2024-01-25T14:57:25.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:25 smithi186 ceph-mon[35697]: Adjusting osd_memory_target on smithi186 to 5693M 2024-01-25T14:57:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:25 smithi186 ceph-mon[35697]: pgmap v176: 1 pgs: 1 remapped; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:25 smithi186 ceph-mon[35697]: osdmap e53: 8 total, 8 up, 8 in 2024-01-25T14:57:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:25 smithi170 ceph-mon[31899]: Detected new or changed devices on smithi186 2024-01-25T14:57:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:25 smithi170 ceph-mon[31899]: Adjusting osd_memory_target on smithi186 to 5693M 2024-01-25T14:57:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:25 smithi170 ceph-mon[31899]: pgmap v176: 1 pgs: 1 remapped; 577 KiB data, 222 MiB used, 626 GiB / 626 GiB avail 2024-01-25T14:57:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:25 smithi170 ceph-mon[31899]: osdmap e53: 8 total, 8 up, 8 in 2024-01-25T14:57:26.372 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:26 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:57:26.372 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:26 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:57:26.372 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:26 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:26.373 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:26 smithi191 ceph-mon[36347]: osdmap e54: 8 total, 8 up, 8 in 2024-01-25T14:57:26.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:26 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:57:26.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:26 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:57:26.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:26 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:26.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:26 smithi186 ceph-mon[35697]: osdmap e54: 8 total, 8 up, 8 in 2024-01-25T14:57:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:26 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:57:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:26 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:57:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:26 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:26 smithi170 ceph-mon[31899]: osdmap e54: 8 total, 8 up, 8 in 2024-01-25T14:57:27.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:27 smithi191 ceph-mon[36347]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:57:27.441 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:27 smithi191 ceph-mon[36347]: pgmap v179: 1 pgs: 1 remapped; 577 KiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:27.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:27 smithi186 ceph-mon[35697]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:57:27.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:27 smithi186 ceph-mon[35697]: pgmap v179: 1 pgs: 1 remapped; 577 KiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:27 smithi170 ceph-mon[31899]: from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:57:27.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:27 smithi170 ceph-mon[31899]: pgmap v179: 1 pgs: 1 remapped; 577 KiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:28.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:28 smithi186 ceph-mon[35697]: osdmap e55: 8 total, 8 up, 8 in 2024-01-25T14:57:28.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:28 smithi186 ceph-mon[35697]: from='client.? 172.21.15.191:0/2067285912' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8100e99a-c2d3-4222-abb0-5c6840703cc6"}]: dispatch 2024-01-25T14:57:28.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:28 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8100e99a-c2d3-4222-abb0-5c6840703cc6"}]: dispatch 2024-01-25T14:57:28.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:28 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8100e99a-c2d3-4222-abb0-5c6840703cc6"}]': finished 2024-01-25T14:57:28.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:28 smithi186 ceph-mon[35697]: osdmap e56: 9 total, 8 up, 9 in 2024-01-25T14:57:28.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:28 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-25T14:57:28.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:28 smithi170 ceph-mon[31899]: osdmap e55: 8 total, 8 up, 8 in 2024-01-25T14:57:28.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:28 smithi170 ceph-mon[31899]: from='client.? 172.21.15.191:0/2067285912' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8100e99a-c2d3-4222-abb0-5c6840703cc6"}]: dispatch 2024-01-25T14:57:28.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:28 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8100e99a-c2d3-4222-abb0-5c6840703cc6"}]: dispatch 2024-01-25T14:57:28.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:28 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8100e99a-c2d3-4222-abb0-5c6840703cc6"}]': finished 2024-01-25T14:57:28.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:28 smithi170 ceph-mon[31899]: osdmap e56: 9 total, 8 up, 9 in 2024-01-25T14:57:28.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:28 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-25T14:57:28.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:28 smithi191 ceph-mon[36347]: osdmap e55: 8 total, 8 up, 8 in 2024-01-25T14:57:28.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:28 smithi191 ceph-mon[36347]: from='client.? 172.21.15.191:0/2067285912' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8100e99a-c2d3-4222-abb0-5c6840703cc6"}]: dispatch 2024-01-25T14:57:28.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:28 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8100e99a-c2d3-4222-abb0-5c6840703cc6"}]: dispatch 2024-01-25T14:57:28.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:28 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8100e99a-c2d3-4222-abb0-5c6840703cc6"}]': finished 2024-01-25T14:57:28.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:28 smithi191 ceph-mon[36347]: osdmap e56: 9 total, 8 up, 9 in 2024-01-25T14:57:28.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:28 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-25T14:57:29.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:29 smithi186 ceph-mon[35697]: pgmap v182: 1 pgs: 1 remapped; 577 KiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:29.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:29 smithi186 ceph-mon[35697]: from='client.? 172.21.15.191:0/3726335828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:57:29.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:29 smithi170 ceph-mon[31899]: pgmap v182: 1 pgs: 1 remapped; 577 KiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:29.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:29 smithi170 ceph-mon[31899]: from='client.? 172.21.15.191:0/3726335828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:57:29.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:29 smithi191 ceph-mon[36347]: pgmap v182: 1 pgs: 1 remapped; 577 KiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:29.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:29 smithi191 ceph-mon[36347]: from='client.? 172.21.15.191:0/3726335828' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:57:31.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:31 smithi186 ceph-mon[35697]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:31.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:31 smithi170 ceph-mon[31899]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:31.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:31 smithi191 ceph-mon[36347]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:33.429 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:33 smithi191 ceph-mon[36347]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:33.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:33 smithi186 ceph-mon[35697]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:33.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:33 smithi170 ceph-mon[31899]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:35.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:35 smithi186 ceph-mon[35697]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:35 smithi170 ceph-mon[31899]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:35.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:35 smithi191 ceph-mon[36347]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:36.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:36 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-01-25T14:57:36.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:36 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:36 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-01-25T14:57:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:36 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:36.671 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:36 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-01-25T14:57:36.671 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:36 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:37.433 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:37 smithi191 ceph-mon[36347]: Deploying daemon osd.8 on smithi191 2024-01-25T14:57:37.434 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:37 smithi191 ceph-mon[36347]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:37.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:37 smithi186 ceph-mon[35697]: Deploying daemon osd.8 on smithi191 2024-01-25T14:57:37.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:37 smithi186 ceph-mon[35697]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:37.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:37 smithi170 ceph-mon[31899]: Deploying daemon osd.8 on smithi191 2024-01-25T14:57:37.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:37 smithi170 ceph-mon[31899]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:39.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:38 smithi186 ceph-mon[35697]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:39.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:38 smithi170 ceph-mon[31899]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:39.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:38 smithi191 ceph-mon[36347]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:41.316 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:41 smithi191 ceph-mon[36347]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:41.317 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:41 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:41.317 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:41 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:41.317 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:41 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:57:41.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:41 smithi186 ceph-mon[35697]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:41.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:41 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:41.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:41 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:41.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:41 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:57:41.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:41 smithi170 ceph-mon[31899]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:41.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:41 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:41.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:41 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:41.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:41 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:57:43.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:43 smithi191 ceph-mon[36347]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:43.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:43 smithi186 ceph-mon[35697]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:43.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:43 smithi170 ceph-mon[31899]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:44.212 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 8 on host 'smithi191' 2024-01-25T14:57:44.213 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:44.210+0000 7f4932ffd700 1 -- 172.21.15.191:0/1728499441 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f493c0684a0 con 0x7f49280a1370 2024-01-25T14:57:44.214 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:44.212+0000 7f4943e07700 1 -- 172.21.15.191:0/1728499441 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f49280a1370 msgr2=0x7f49280a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:57:44.214 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:44.212+0000 7f4943e07700 1 --2- 172.21.15.191:0/1728499441 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f49280a1370 0x7f49280a3830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4934009fd0 tx=0x7f49340061f0 comp rx=0 tx=0).stop 2024-01-25T14:57:44.214 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:44.212+0000 7f4943e07700 1 -- 172.21.15.191:0/1728499441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f493c102a10 msgr2=0x7f493c197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:57:44.214 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:44.212+0000 7f4943e07700 1 --2- 172.21.15.191:0/1728499441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f493c102a10 0x7f493c197d10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f492c00c9e0 tx=0x7f492c00cda0 comp rx=0 tx=0).stop 2024-01-25T14:57:44.214 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:44.212+0000 7f4943e07700 1 -- 172.21.15.191:0/1728499441 shutdown_connections 2024-01-25T14:57:44.215 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:44.212+0000 7f4943e07700 1 --2- 172.21.15.191:0/1728499441 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f49280a1370 0x7f49280a3830 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:44.215 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:44.212+0000 7f4943e07700 1 --2- 172.21.15.191:0/1728499441 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f493c1033b0 0x7f493c19ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:44.215 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:44.212+0000 7f4943e07700 1 --2- 172.21.15.191:0/1728499441 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f493c101810 0x7f493c1977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:44.215 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:44.212+0000 7f4943e07700 1 --2- 172.21.15.191:0/1728499441 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f493c102a10 0x7f493c197d10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:44.215 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:44.212+0000 7f4943e07700 1 -- 172.21.15.191:0/1728499441 >> 172.21.15.191:0/1728499441 conn(0x7f493c0fcdf0 msgr2=0x7f493c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:57:44.215 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:44.213+0000 7f4943e07700 1 -- 172.21.15.191:0/1728499441 shutdown_connections 2024-01-25T14:57:44.215 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:57:44.213+0000 7f4943e07700 1 -- 172.21.15.191:0/1728499441 wait complete. 2024-01-25T14:57:44.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:44 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:44.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:44 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:44.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:44 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:44.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:44 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:57:44.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:44 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:44.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:44 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:44.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:44 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:44.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:44 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:57:44.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:44 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:44.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:44 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:44.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:44 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:44.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:44 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:57:44.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:44 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:44.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:44 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:44.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:44 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:44.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:44 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:57:44.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:44 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:44.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:44 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:44.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:44 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:44.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:44 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:57:44.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:44 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:44.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:44 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:44.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:44 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:44.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:44 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:57:44.804 DEBUG:teuthology.orchestra.run.smithi191:osd.8> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.8.service 2024-01-25T14:57:44.806 INFO:tasks.cephadm:Deploying osd.9 on smithi170 with /dev/vg_nvme/lv_1... 2024-01-25T14:57:44.806 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-01-25T14:57:45.054 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:57:45.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:45 smithi170 ceph-mon[31899]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:45.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:45 smithi170 ceph-mon[31899]: from='osd.8 [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-01-25T14:57:45.446 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:45 smithi170 ceph-mon[31899]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-01-25T14:57:45.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:45 smithi191 ceph-mon[36347]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:45.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:45 smithi191 ceph-mon[36347]: from='osd.8 [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-01-25T14:57:45.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:45 smithi191 ceph-mon[36347]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-01-25T14:57:45.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:45 smithi186 ceph-mon[35697]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:45.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:45 smithi186 ceph-mon[35697]: from='osd.8 [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-01-25T14:57:45.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:45 smithi186 ceph-mon[35697]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-01-25T14:57:46.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:46 smithi191 ceph-mon[36347]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-01-25T14:57:46.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:46 smithi191 ceph-mon[36347]: osdmap e57: 9 total, 8 up, 9 in 2024-01-25T14:57:46.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-25T14:57:46.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:46 smithi191 ceph-mon[36347]: from='osd.8 [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:57:46.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:46 smithi191 ceph-mon[36347]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:57:46.564 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:46 smithi170 ceph-mon[31899]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-01-25T14:57:46.564 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:46 smithi170 ceph-mon[31899]: osdmap e57: 9 total, 8 up, 9 in 2024-01-25T14:57:46.564 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-25T14:57:46.564 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:46 smithi170 ceph-mon[31899]: from='osd.8 [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:57:46.564 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:46 smithi170 ceph-mon[31899]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:57:46.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:46 smithi186 ceph-mon[35697]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-01-25T14:57:46.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:46 smithi186 ceph-mon[35697]: osdmap e57: 9 total, 8 up, 9 in 2024-01-25T14:57:46.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-25T14:57:46.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:46 smithi186 ceph-mon[35697]: from='osd.8 [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:57:46.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:46 smithi186 ceph-mon[35697]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:57:47.127 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-01-25T14:57:47.128 INFO:teuthology.orchestra.run.smithi170.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-01-25T14:57:47.128 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10+0 records in 2024-01-25T14:57:47.128 INFO:teuthology.orchestra.run.smithi170.stderr:10+0 records out 2024-01-25T14:57:47.128 INFO:teuthology.orchestra.run.smithi170.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00816339 s, 1.3 GB/s 2024-01-25T14:57:47.128 INFO:teuthology.orchestra.run.smithi170.stderr:--> Zapping successful for: 2024-01-25T14:57:47.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:47 smithi170 ceph-mon[31899]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:47.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:47 smithi170 ceph-mon[31899]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-01-25T14:57:47.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:47 smithi170 ceph-mon[31899]: osdmap e58: 9 total, 8 up, 9 in 2024-01-25T14:57:47.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:47 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-25T14:57:47.428 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:47 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-25T14:57:47.429 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:47 smithi170 ceph-mon[31899]: from='osd.8 ' entity='osd.8' 2024-01-25T14:57:47.429 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:47 smithi170 ceph-mon[31899]: osd.8 [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286] boot 2024-01-25T14:57:47.429 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:47 smithi170 ceph-mon[31899]: osdmap e59: 9 total, 9 up, 9 in 2024-01-25T14:57:47.429 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:47 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-25T14:57:47.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:47 smithi191 ceph-mon[36347]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:47.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:47 smithi191 ceph-mon[36347]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-01-25T14:57:47.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:47 smithi191 ceph-mon[36347]: osdmap e58: 9 total, 8 up, 9 in 2024-01-25T14:57:47.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:47 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-25T14:57:47.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:47 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-25T14:57:47.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:47 smithi191 ceph-mon[36347]: from='osd.8 ' entity='osd.8' 2024-01-25T14:57:47.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:47 smithi191 ceph-mon[36347]: osd.8 [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286] boot 2024-01-25T14:57:47.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:47 smithi191 ceph-mon[36347]: osdmap e59: 9 total, 9 up, 9 in 2024-01-25T14:57:47.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:47 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-25T14:57:47.485 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 14:57:47 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T14:57:47.119+0000 7f5b6dfe2700 -1 osd.8 0 waiting for initial osdmap 2024-01-25T14:57:47.485 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 14:57:47 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T14:57:47.134+0000 7f5b665d5700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T14:57:47.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:47 smithi186 ceph-mon[35697]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 254 MiB used, 715 GiB / 715 GiB avail 2024-01-25T14:57:47.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:47 smithi186 ceph-mon[35697]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-01-25T14:57:47.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:47 smithi186 ceph-mon[35697]: osdmap e58: 9 total, 8 up, 9 in 2024-01-25T14:57:47.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:47 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-25T14:57:47.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:47 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-25T14:57:47.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:47 smithi186 ceph-mon[35697]: from='osd.8 ' entity='osd.8' 2024-01-25T14:57:47.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:47 smithi186 ceph-mon[35697]: osd.8 [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286] boot 2024-01-25T14:57:47.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:47 smithi186 ceph-mon[35697]: osdmap e59: 9 total, 9 up, 9 in 2024-01-25T14:57:47.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:47 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-01-25T14:57:47.889 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch daemon add osd smithi170:vg_nvme/lv_1 2024-01-25T14:57:48.138 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:57:48.578 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:48 smithi170 ceph-mon[31899]: purged_snaps scrub starts 2024-01-25T14:57:48.578 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:48 smithi170 ceph-mon[31899]: purged_snaps scrub ok 2024-01-25T14:57:48.578 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:48 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:48.578 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:48 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:48.578 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:48 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:48.578 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:48 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:48.578 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:48 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:48.578 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:48 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:48.578 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:48 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:48.578 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:48 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:57:48.578 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:48 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:48.579 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:48 smithi170 ceph-mon[31899]: osdmap e60: 9 total, 9 up, 9 in 2024-01-25T14:57:48.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:48 smithi186 ceph-mon[35697]: purged_snaps scrub starts 2024-01-25T14:57:48.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:48 smithi186 ceph-mon[35697]: purged_snaps scrub ok 2024-01-25T14:57:48.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:48 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:48.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:48 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:48.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:48 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:48.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:48 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:48.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:48 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:48.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:48 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:48.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:48 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:48.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:48 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:57:48.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:48 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:48.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:48 smithi186 ceph-mon[35697]: osdmap e60: 9 total, 9 up, 9 in 2024-01-25T14:57:48.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:48 smithi191 ceph-mon[36347]: purged_snaps scrub starts 2024-01-25T14:57:48.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:48 smithi191 ceph-mon[36347]: purged_snaps scrub ok 2024-01-25T14:57:48.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:48 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:48.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:48 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:48.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:48 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:48.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:48 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:48.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:48 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:57:48.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:48 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:48.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:48 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:48.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:48 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:57:48.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:48 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:57:48.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:48 smithi191 ceph-mon[36347]: osdmap e60: 9 total, 9 up, 9 in 2024-01-25T14:57:49.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:49 smithi191 ceph-mon[36347]: Detected new or changed devices on smithi191 2024-01-25T14:57:49.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:49 smithi191 ceph-mon[36347]: Adjusting osd_memory_target on smithi191 to 5693M 2024-01-25T14:57:49.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:49 smithi191 ceph-mon[36347]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 612 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:57:49.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:49 smithi191 ceph-mon[36347]: osdmap e61: 9 total, 9 up, 9 in 2024-01-25T14:57:49.604 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:49 smithi170 ceph-mon[31899]: Detected new or changed devices on smithi191 2024-01-25T14:57:49.604 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:49 smithi170 ceph-mon[31899]: Adjusting osd_memory_target on smithi191 to 5693M 2024-01-25T14:57:49.604 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:49 smithi170 ceph-mon[31899]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 612 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:57:49.604 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:49 smithi170 ceph-mon[31899]: osdmap e61: 9 total, 9 up, 9 in 2024-01-25T14:57:49.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:49 smithi186 ceph-mon[35697]: Detected new or changed devices on smithi191 2024-01-25T14:57:49.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:49 smithi186 ceph-mon[35697]: Adjusting osd_memory_target on smithi191 to 5693M 2024-01-25T14:57:49.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:49 smithi186 ceph-mon[35697]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 612 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:57:49.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:49 smithi186 ceph-mon[35697]: osdmap e61: 9 total, 9 up, 9 in 2024-01-25T14:57:49.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.812+0000 7ff6836f6700 1 -- 172.21.15.170:0/2368676318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff67c101d10 msgr2=0x7ff67c102130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:57:49.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.812+0000 7ff6836f6700 1 --2- 172.21.15.170:0/2368676318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff67c101d10 0x7ff67c102130 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0099c0 tx=0x7ff66c009cd0 comp rx=0 tx=0).stop 2024-01-25T14:57:49.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.812+0000 7ff6836f6700 1 -- 172.21.15.170:0/2368676318 shutdown_connections 2024-01-25T14:57:49.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.812+0000 7ff6836f6700 1 --2- 172.21.15.170:0/2368676318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff67c101380 0x7ff67c108c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:49.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.812+0000 7ff6836f6700 1 --2- 172.21.15.170:0/2368676318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff67c101d10 0x7ff67c102130 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:49.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.812+0000 7ff6836f6700 1 --2- 172.21.15.170:0/2368676318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff67c1009c0 0x7ff67c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:49.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.812+0000 7ff6836f6700 1 -- 172.21.15.170:0/2368676318 >> 172.21.15.170:0/2368676318 conn(0x7ff67c0fb450 msgr2=0x7ff67c0fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:57:49.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.812+0000 7ff6836f6700 1 -- 172.21.15.170:0/2368676318 shutdown_connections 2024-01-25T14:57:49.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.812+0000 7ff6836f6700 1 -- 172.21.15.170:0/2368676318 wait complete. 2024-01-25T14:57:49.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff6836f6700 1 Processor -- start 2024-01-25T14:57:49.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff6836f6700 1 -- start start 2024-01-25T14:57:49.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff6836f6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff67c1009c0 0x7ff67c1048a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:57:49.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff6836f6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff67c101380 0x7ff67c102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:57:49.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff6836f6700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff67c101d10 0x7ff67c103430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:57:49.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff6836f6700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c19b530 con 0x7ff67c101380 2024-01-25T14:57:49.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff6836f6700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c103970 con 0x7ff67c101d10 2024-01-25T14:57:49.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff6836f6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c103b30 con 0x7ff67c1009c0 2024-01-25T14:57:49.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff680c91700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff67c101380 0x7ff67c102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:57:49.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff680c91700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff67c101380 0x7ff67c102ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48464/0 (socket says 172.21.15.170:48464) 2024-01-25T14:57:49.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff680c91700 1 -- 172.21.15.170:0/4138038521 learned_addr learned my addr 172.21.15.170:0/4138038521 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:57:49.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff681c93700 1 --2- 172.21.15.170:0/4138038521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff67c101d10 0x7ff67c103430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:57:49.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff681492700 1 --2- 172.21.15.170:0/4138038521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff67c1009c0 0x7ff67c1048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:57:49.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff680c91700 1 -- 172.21.15.170:0/4138038521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff67c1009c0 msgr2=0x7ff67c1048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:57:49.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff680c91700 1 --2- 172.21.15.170:0/4138038521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff67c1009c0 0x7ff67c1048a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:49.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff680c91700 1 -- 172.21.15.170:0/4138038521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff67c101d10 msgr2=0x7ff67c103430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:57:49.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff680c91700 1 --2- 172.21.15.170:0/4138038521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff67c101d10 0x7ff67c103430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:57:49.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.813+0000 7ff680c91700 1 -- 172.21.15.170:0/4138038521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c0095f0 con 0x7ff67c101380 2024-01-25T14:57:49.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.814+0000 7ff680c91700 1 --2- 172.21.15.170:0/4138038521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff67c101380 0x7ff67c102ef0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff67800d980 tx=0x7ff67800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:57:49.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.814+0000 7ff6727fc700 1 -- 172.21.15.170:0/4138038521 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678004020 con 0x7ff67c101380 2024-01-25T14:57:49.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.814+0000 7ff6836f6700 1 -- 172.21.15.170:0/4138038521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67c1a5f00 con 0x7ff67c101380 2024-01-25T14:57:49.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.814+0000 7ff6727fc700 1 -- 172.21.15.170:0/4138038521 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff678009730 con 0x7ff67c101380 2024-01-25T14:57:49.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.814+0000 7ff6727fc700 1 -- 172.21.15.170:0/4138038521 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678003a30 con 0x7ff67c101380 2024-01-25T14:57:49.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.814+0000 7ff6836f6700 1 -- 172.21.15.170:0/4138038521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67c1a62b0 con 0x7ff67c101380 2024-01-25T14:57:49.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.815+0000 7ff6836f6700 1 -- 172.21.15.170:0/4138038521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67c0684a0 con 0x7ff67c101380 2024-01-25T14:57:49.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.816+0000 7ff6727fc700 1 -- 172.21.15.170:0/4138038521 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7ff6780098a0 con 0x7ff67c101380 2024-01-25T14:57:49.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.817+0000 7ff6727fc700 1 --2- 172.21.15.170:0/4138038521 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6680a1370 0x7ff6680a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:57:49.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.817+0000 7ff681492700 1 --2- 172.21.15.170:0/4138038521 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6680a1370 0x7ff6680a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:57:49.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.817+0000 7ff6727fc700 1 -- 172.21.15.170:0/4138038521 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5858+0+0 (secure 0 0 0) 0x7ff6780cc1b0 con 0x7ff67c101380 2024-01-25T14:57:49.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.817+0000 7ff681492700 1 --2- 172.21.15.170:0/4138038521 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6680a1370 0x7ff6680a3830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00b580 tx=0x7ff66c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:57:49.821 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:49.820+0000 7ff6727fc700 1 -- 172.21.15.170:0/4138038521 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ff678095fc0 con 0x7ff67c101380 2024-01-25T14:57:50.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:57:50.021+0000 7ff6836f6700 1 -- 172.21.15.170:0/4138038521 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff67c0fffc0 con 0x7ff6680a1370 2024-01-25T14:57:51.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:51 smithi186 ceph-mon[35697]: osdmap e62: 9 total, 9 up, 9 in 2024-01-25T14:57:51.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:51 smithi186 ceph-mon[35697]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:57:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:57:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:57:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:51 smithi186 ceph-mon[35697]: pgmap v199: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 612 MiB used, 804 GiB / 805 GiB avail; 149 KiB/s, 0 objects/s recovering 2024-01-25T14:57:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:51 smithi170 ceph-mon[31899]: osdmap e62: 9 total, 9 up, 9 in 2024-01-25T14:57:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:51 smithi170 ceph-mon[31899]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:57:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:57:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:57:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:51 smithi170 ceph-mon[31899]: pgmap v199: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 612 MiB used, 804 GiB / 805 GiB avail; 149 KiB/s, 0 objects/s recovering 2024-01-25T14:57:51.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:51 smithi191 ceph-mon[36347]: osdmap e62: 9 total, 9 up, 9 in 2024-01-25T14:57:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:51 smithi191 ceph-mon[36347]: from='client.14409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi170:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:57:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:57:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:57:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:57:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:51 smithi191 ceph-mon[36347]: pgmap v199: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 612 MiB used, 804 GiB / 805 GiB avail; 149 KiB/s, 0 objects/s recovering 2024-01-25T14:57:52.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:52 smithi186 ceph-mon[35697]: osdmap e63: 9 total, 9 up, 9 in 2024-01-25T14:57:52.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:52 smithi170 ceph-mon[31899]: osdmap e63: 9 total, 9 up, 9 in 2024-01-25T14:57:52.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:52 smithi191 ceph-mon[36347]: osdmap e63: 9 total, 9 up, 9 in 2024-01-25T14:57:53.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:53 smithi186 ceph-mon[35697]: pgmap v201: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 612 MiB used, 804 GiB / 805 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-01-25T14:57:53.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:53 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1641799852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d335ab7-8f9d-4636-a436-724f2be1e20b"}]: dispatch 2024-01-25T14:57:53.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:53 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1641799852' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d335ab7-8f9d-4636-a436-724f2be1e20b"}]': finished 2024-01-25T14:57:53.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:53 smithi186 ceph-mon[35697]: osdmap e64: 10 total, 9 up, 10 in 2024-01-25T14:57:53.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-25T14:57:53.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:53 smithi170 ceph-mon[31899]: pgmap v201: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 612 MiB used, 804 GiB / 805 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-01-25T14:57:53.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:53 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1641799852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d335ab7-8f9d-4636-a436-724f2be1e20b"}]: dispatch 2024-01-25T14:57:53.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:53 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1641799852' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d335ab7-8f9d-4636-a436-724f2be1e20b"}]': finished 2024-01-25T14:57:53.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:53 smithi170 ceph-mon[31899]: osdmap e64: 10 total, 9 up, 10 in 2024-01-25T14:57:53.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-25T14:57:53.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:53 smithi191 ceph-mon[36347]: pgmap v201: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 612 MiB used, 804 GiB / 805 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-01-25T14:57:53.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:53 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1641799852' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d335ab7-8f9d-4636-a436-724f2be1e20b"}]: dispatch 2024-01-25T14:57:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:53 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1641799852' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d335ab7-8f9d-4636-a436-724f2be1e20b"}]': finished 2024-01-25T14:57:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:53 smithi191 ceph-mon[36347]: osdmap e64: 10 total, 9 up, 10 in 2024-01-25T14:57:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-25T14:57:54.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:54 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3858902122' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:57:54.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:54 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3858902122' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:57:54.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:54 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3858902122' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:57:55.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:55 smithi186 ceph-mon[35697]: pgmap v203: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-01-25T14:57:55.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:55 smithi170 ceph-mon[31899]: pgmap v203: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-01-25T14:57:55.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:55 smithi191 ceph-mon[36347]: pgmap v203: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-01-25T14:57:56.468 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:57:56 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:57:56.125+0000 7f6590e10700 -1 calc_pg_upmaps abort due to max <= 0 2024-01-25T14:57:57.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:57 smithi191 ceph-mon[36347]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:57:57.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:57 smithi186 ceph-mon[35697]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:57:57.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:57 smithi170 ceph-mon[31899]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:57:59.120 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:57:59 smithi170 ceph-mon[31899]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:57:59.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:57:59 smithi186 ceph-mon[35697]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:57:59.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:57:59 smithi191 ceph-mon[36347]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:01.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:01 smithi191 ceph-mon[36347]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:01.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:01 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-01-25T14:58:01.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:01 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:01.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:01 smithi191 ceph-mon[36347]: Deploying daemon osd.9 on smithi170 2024-01-25T14:58:01.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:01 smithi186 ceph-mon[35697]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:01.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:01 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-01-25T14:58:01.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:01 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:01.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:01 smithi186 ceph-mon[35697]: Deploying daemon osd.9 on smithi170 2024-01-25T14:58:01.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:01 smithi170 ceph-mon[31899]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:01.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:01 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-01-25T14:58:01.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:01 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:01.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:01 smithi170 ceph-mon[31899]: Deploying daemon osd.9 on smithi170 2024-01-25T14:58:03.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:03 smithi191 ceph-mon[36347]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:03.495 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:03 smithi170 ceph-mon[31899]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:03.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:03 smithi186 ceph-mon[35697]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:05.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:05 smithi191 ceph-mon[36347]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:05.567 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:05 smithi170 ceph-mon[31899]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:05.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:05 smithi186 ceph-mon[35697]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:07.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:06 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:07.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:06 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:58:07.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:06 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:07.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:06 smithi186 ceph-mon[35697]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:07.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:06 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:07.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:06 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:58:07.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:06 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:07.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:06 smithi170 ceph-mon[31899]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:07.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:06 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:07.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:06 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:58:07.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:06 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:07.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:06 smithi191 ceph-mon[36347]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:09.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:58:09.145+0000 7ff6727fc700 1 -- 172.21.15.170:0/4138038521 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff67c0fffc0 con 0x7ff6680a1370 2024-01-25T14:58:09.146 INFO:teuthology.orchestra.run.smithi170.stdout:Created osd(s) 9 on host 'smithi170' 2024-01-25T14:58:09.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:58:09.147+0000 7ff6836f6700 1 -- 172.21.15.170:0/4138038521 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6680a1370 msgr2=0x7ff6680a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:58:09.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:58:09.147+0000 7ff6836f6700 1 --2- 172.21.15.170:0/4138038521 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6680a1370 0x7ff6680a3830 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00b580 tx=0x7ff66c005fb0 comp rx=0 tx=0).stop 2024-01-25T14:58:09.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:58:09.147+0000 7ff6836f6700 1 -- 172.21.15.170:0/4138038521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff67c101380 msgr2=0x7ff67c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:58:09.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:58:09.147+0000 7ff6836f6700 1 --2- 172.21.15.170:0/4138038521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff67c101380 0x7ff67c102ef0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff67800d980 tx=0x7ff67800dc90 comp rx=0 tx=0).stop 2024-01-25T14:58:09.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:58:09.147+0000 7ff6836f6700 1 -- 172.21.15.170:0/4138038521 shutdown_connections 2024-01-25T14:58:09.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:58:09.147+0000 7ff6836f6700 1 --2- 172.21.15.170:0/4138038521 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6680a1370 0x7ff6680a3830 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:09.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:58:09.147+0000 7ff6836f6700 1 --2- 172.21.15.170:0/4138038521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff67c1009c0 0x7ff67c1048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:09.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:58:09.147+0000 7ff6836f6700 1 --2- 172.21.15.170:0/4138038521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff67c101d10 0x7ff67c103430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:09.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:58:09.147+0000 7ff6836f6700 1 --2- 172.21.15.170:0/4138038521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff67c101380 0x7ff67c102ef0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:09.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:58:09.147+0000 7ff6836f6700 1 -- 172.21.15.170:0/4138038521 >> 172.21.15.170:0/4138038521 conn(0x7ff67c0fb450 msgr2=0x7ff67c0ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:58:09.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:58:09.147+0000 7ff6836f6700 1 -- 172.21.15.170:0/4138038521 shutdown_connections 2024-01-25T14:58:09.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:58:09.147+0000 7ff6836f6700 1 -- 172.21.15.170:0/4138038521 wait complete. 2024-01-25T14:58:09.265 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:09 smithi170 ceph-mon[31899]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:09.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:09 smithi186 ceph-mon[35697]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:09.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:09 smithi191 ceph-mon[36347]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:10.247 DEBUG:teuthology.orchestra.run.smithi170:osd.9> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.9.service 2024-01-25T14:58:10.250 INFO:tasks.cephadm:Deploying osd.10 on smithi186 with /dev/vg_nvme/lv_1... 2024-01-25T14:58:10.250 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-01-25T14:58:10.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:10.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:10.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:10 smithi191 ceph-mon[36347]: from='osd.9 [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-01-25T14:58:10.497 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.b/config 2024-01-25T14:58:10.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:10.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:10.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:10 smithi186 ceph-mon[35697]: from='osd.9 [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-01-25T14:58:10.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:10.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:10.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:10 smithi170 ceph-mon[31899]: from='osd.9 [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-01-25T14:58:11.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:11 smithi186 ceph-mon[35697]: from='osd.9 [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-01-25T14:58:11.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:11 smithi186 ceph-mon[35697]: osdmap e65: 10 total, 9 up, 10 in 2024-01-25T14:58:11.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:11 smithi186 ceph-mon[35697]: from='osd.9 [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-01-25T14:58:11.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-25T14:58:11.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:11 smithi186 ceph-mon[35697]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:11.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:11.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:11 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:11.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:11 smithi170 ceph-mon[31899]: from='osd.9 [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-01-25T14:58:11.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:11 smithi170 ceph-mon[31899]: osdmap e65: 10 total, 9 up, 10 in 2024-01-25T14:58:11.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:11 smithi170 ceph-mon[31899]: from='osd.9 [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-01-25T14:58:11.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-25T14:58:11.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:11 smithi170 ceph-mon[31899]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:11.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:11.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:11 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:11.366 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 14:58:11 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T14:58:11.141+0000 7f4e342dc700 -1 osd.9 0 waiting for initial osdmap 2024-01-25T14:58:11.366 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 14:58:11 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T14:58:11.156+0000 7f4e308d7700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T14:58:11.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:11 smithi191 ceph-mon[36347]: from='osd.9 [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-01-25T14:58:11.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:11 smithi191 ceph-mon[36347]: osdmap e65: 10 total, 9 up, 10 in 2024-01-25T14:58:11.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:11 smithi191 ceph-mon[36347]: from='osd.9 [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]: dispatch 2024-01-25T14:58:11.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-25T14:58:11.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:11 smithi191 ceph-mon[36347]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 289 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:11.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:11.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:11 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:12.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:12 smithi170 ceph-mon[31899]: from='osd.9 [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-01-25T14:58:12.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:12 smithi170 ceph-mon[31899]: osdmap e66: 10 total, 9 up, 10 in 2024-01-25T14:58:12.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-25T14:58:12.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-25T14:58:12.390 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:12 smithi186 ceph-mon[35697]: from='osd.9 [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-01-25T14:58:12.390 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:12 smithi186 ceph-mon[35697]: osdmap e66: 10 total, 9 up, 10 in 2024-01-25T14:58:12.390 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-25T14:58:12.390 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-25T14:58:12.394 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-01-25T14:58:12.394 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-01-25T14:58:12.394 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2024-01-25T14:58:12.394 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2024-01-25T14:58:12.394 INFO:teuthology.orchestra.run.smithi186.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113998 s, 920 MB/s 2024-01-25T14:58:12.394 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 2024-01-25T14:58:12.394 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2024-01-25T14:58:12.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:12 smithi191 ceph-mon[36347]: from='osd.9 [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi170", "root=default"]}]': finished 2024-01-25T14:58:12.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:12 smithi191 ceph-mon[36347]: osdmap e66: 10 total, 9 up, 10 in 2024-01-25T14:58:12.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-25T14:58:12.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-25T14:58:13.077 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch daemon add osd smithi186:vg_nvme/lv_1 2024-01-25T14:58:13.319 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.b/config 2024-01-25T14:58:13.335 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:13 smithi186 ceph-mon[35697]: purged_snaps scrub starts 2024-01-25T14:58:13.335 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:13 smithi186 ceph-mon[35697]: purged_snaps scrub ok 2024-01-25T14:58:13.335 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:13 smithi186 ceph-mon[35697]: osd.9 [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083] boot 2024-01-25T14:58:13.335 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:13 smithi186 ceph-mon[35697]: osdmap e67: 10 total, 10 up, 10 in 2024-01-25T14:58:13.336 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:13 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-25T14:58:13.336 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:13 smithi186 ceph-mon[35697]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:13.460 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:13 smithi170 ceph-mon[31899]: purged_snaps scrub starts 2024-01-25T14:58:13.460 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:13 smithi170 ceph-mon[31899]: purged_snaps scrub ok 2024-01-25T14:58:13.460 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:13 smithi170 ceph-mon[31899]: osd.9 [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083] boot 2024-01-25T14:58:13.460 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:13 smithi170 ceph-mon[31899]: osdmap e67: 10 total, 10 up, 10 in 2024-01-25T14:58:13.460 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:13 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-25T14:58:13.460 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:13 smithi170 ceph-mon[31899]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:13.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:13 smithi191 ceph-mon[36347]: purged_snaps scrub starts 2024-01-25T14:58:13.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:13 smithi191 ceph-mon[36347]: purged_snaps scrub ok 2024-01-25T14:58:13.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:13 smithi191 ceph-mon[36347]: osd.9 [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083] boot 2024-01-25T14:58:13.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:13 smithi191 ceph-mon[36347]: osdmap e67: 10 total, 10 up, 10 in 2024-01-25T14:58:13.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:13 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-01-25T14:58:13.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:13 smithi191 ceph-mon[36347]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 290 MiB used, 804 GiB / 805 GiB avail 2024-01-25T14:58:14.423 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:14 smithi186 ceph-mon[35697]: osdmap e68: 10 total, 10 up, 10 in 2024-01-25T14:58:14.423 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:14.423 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:14.424 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:14.424 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:14.424 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:14.424 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:14.424 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:14.424 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:14.424 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:58:14.424 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:14.424 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:58:14.424 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:14.424 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:58:14.424 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:14 smithi191 ceph-mon[36347]: osdmap e68: 10 total, 10 up, 10 in 2024-01-25T14:58:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:14.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:58:14.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:14.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:58:14.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:14.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:58:14.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:14.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:14 smithi170 ceph-mon[31899]: osdmap e68: 10 total, 10 up, 10 in 2024-01-25T14:58:14.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:14.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:58:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:58:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:58:14.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:14.924 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.921+0000 7fe821f73700 1 -- 172.21.15.186:0/4070115559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe81c1022a0 msgr2=0x7fe81c108b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:58:14.924 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.921+0000 7fe821f73700 1 --2- 172.21.15.186:0/4070115559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe81c1022a0 0x7fe81c108b50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe8140099c0 tx=0x7fe814009cd0 comp rx=0 tx=0).stop 2024-01-25T14:58:14.924 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.921+0000 7fe821f73700 1 -- 172.21.15.186:0/4070115559 shutdown_connections 2024-01-25T14:58:14.924 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.921+0000 7fe821f73700 1 --2- 172.21.15.186:0/4070115559 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe81c1022a0 0x7fe81c108b50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:14.924 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.921+0000 7fe821f73700 1 --2- 172.21.15.186:0/4070115559 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe81c100700 0x7fe81c100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:14.925 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.921+0000 7fe821f73700 1 --2- 172.21.15.186:0/4070115559 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe81c101900 0x7fe81c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:14.925 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.921+0000 7fe821f73700 1 -- 172.21.15.186:0/4070115559 >> 172.21.15.186:0/4070115559 conn(0x7fe81c0fbca0 msgr2=0x7fe81c0fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:58:14.925 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.921+0000 7fe821f73700 1 -- 172.21.15.186:0/4070115559 shutdown_connections 2024-01-25T14:58:14.925 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.921+0000 7fe821f73700 1 -- 172.21.15.186:0/4070115559 wait complete. 2024-01-25T14:58:14.925 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.922+0000 7fe821f73700 1 Processor -- start 2024-01-25T14:58:14.925 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.922+0000 7fe821f73700 1 -- start start 2024-01-25T14:58:14.925 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.922+0000 7fe821f73700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe81c100700 0x7fe81c1975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:58:14.925 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.922+0000 7fe821f73700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe81c101900 0x7fe81c197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:58:14.925 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.922+0000 7fe821f73700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe81c1022a0 0x7fe81c19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:58:14.925 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.922+0000 7fe821f73700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c19f150 con 0x7fe81c101900 2024-01-25T14:58:14.925 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.922+0000 7fe821f73700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c19f290 con 0x7fe81c100700 2024-01-25T14:58:14.925 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.922+0000 7fe821f73700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c19f420 con 0x7fe81c1022a0 2024-01-25T14:58:14.926 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.922+0000 7fe81b7fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe81c100700 0x7fe81c1975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:58:14.926 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.922+0000 7fe81b7fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe81c100700 0x7fe81c1975c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:58510/0 (socket says 172.21.15.186:58510) 2024-01-25T14:58:14.926 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.922+0000 7fe81b7fe700 1 -- 172.21.15.186:0/562530998 learned_addr learned my addr 172.21.15.186:0/562530998 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-01-25T14:58:14.926 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.922+0000 7fe81bfff700 1 --2- 172.21.15.186:0/562530998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe81c1022a0 0x7fe81c19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:58:14.926 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.923+0000 7fe81affd700 1 --2- 172.21.15.186:0/562530998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe81c101900 0x7fe81c197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:58:14.926 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.923+0000 7fe81b7fe700 1 -- 172.21.15.186:0/562530998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe81c1022a0 msgr2=0x7fe81c19eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:58:14.926 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.923+0000 7fe81b7fe700 1 --2- 172.21.15.186:0/562530998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe81c1022a0 0x7fe81c19eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:14.926 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.923+0000 7fe81b7fe700 1 -- 172.21.15.186:0/562530998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe81c101900 msgr2=0x7fe81c197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:58:14.926 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.923+0000 7fe81b7fe700 1 --2- 172.21.15.186:0/562530998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe81c101900 0x7fe81c197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:14.926 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.923+0000 7fe81b7fe700 1 -- 172.21.15.186:0/562530998 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8140095f0 con 0x7fe81c100700 2024-01-25T14:58:14.926 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.923+0000 7fe81b7fe700 1 --2- 172.21.15.186:0/562530998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe81c100700 0x7fe81c1975c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe80c007e00 tx=0x7fe80c00a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:58:14.926 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.923+0000 7fe818ff9700 1 -- 172.21.15.186:0/562530998 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c00ad40 con 0x7fe81c100700 2024-01-25T14:58:14.926 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.923+0000 7fe818ff9700 1 -- 172.21.15.186:0/562530998 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe80c0128e0 con 0x7fe81c100700 2024-01-25T14:58:14.926 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.923+0000 7fe821f73700 1 -- 172.21.15.186:0/562530998 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c19f700 con 0x7fe81c100700 2024-01-25T14:58:14.927 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.923+0000 7fe818ff9700 1 -- 172.21.15.186:0/562530998 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0117a0 con 0x7fe81c100700 2024-01-25T14:58:14.927 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.923+0000 7fe821f73700 1 -- 172.21.15.186:0/562530998 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c19fc50 con 0x7fe81c100700 2024-01-25T14:58:14.928 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.924+0000 7fe821f73700 1 -- 172.21.15.186:0/562530998 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c0684a0 con 0x7fe81c100700 2024-01-25T14:58:14.928 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.925+0000 7fe818ff9700 1 -- 172.21.15.186:0/562530998 <== mon.2 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fe80c012a50 con 0x7fe81c100700 2024-01-25T14:58:14.928 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.926+0000 7fe818ff9700 1 --2- 172.21.15.186:0/562530998 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe8040a13f0 0x7fe8040a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:58:14.928 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.926+0000 7fe818ff9700 1 -- 172.21.15.186:0/562530998 <== mon.2 v2:172.21.15.186:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fe80c0cc2b0 con 0x7fe81c100700 2024-01-25T14:58:14.928 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.926+0000 7fe81affd700 1 --2- 172.21.15.186:0/562530998 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe8040a13f0 0x7fe8040a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:58:14.928 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.926+0000 7fe81affd700 1 --2- 172.21.15.186:0/562530998 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe8040a13f0 0x7fe8040a38b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe810005950 tx=0x7fe8100058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:58:14.931 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:14.930+0000 7fe818ff9700 1 -- 172.21.15.186:0/562530998 <== mon.2 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fe80c095f30 con 0x7fe81c100700 2024-01-25T14:58:15.133 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:15.132+0000 7fe821f73700 1 -- 172.21.15.186:0/562530998 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe81c0fdda0 con 0x7fe8040a13f0 2024-01-25T14:58:15.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:15 smithi186 ceph-mon[35697]: Detected new or changed devices on smithi170 2024-01-25T14:58:15.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:15 smithi186 ceph-mon[35697]: Adjusting osd_memory_target on smithi170 to 4272M 2024-01-25T14:58:15.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:15 smithi186 ceph-mon[35697]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:15.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:58:15.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:58:15.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:15.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:15 smithi191 ceph-mon[36347]: Detected new or changed devices on smithi170 2024-01-25T14:58:15.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:15 smithi191 ceph-mon[36347]: Adjusting osd_memory_target on smithi170 to 4272M 2024-01-25T14:58:15.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:15 smithi191 ceph-mon[36347]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:15.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:58:15.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:58:15.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:15 smithi170 ceph-mon[31899]: Detected new or changed devices on smithi170 2024-01-25T14:58:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:15 smithi170 ceph-mon[31899]: Adjusting osd_memory_target on smithi170 to 4272M 2024-01-25T14:58:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:15 smithi170 ceph-mon[31899]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:58:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:58:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:16.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:16 smithi186 ceph-mon[35697]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:58:16.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:16 smithi191 ceph-mon[36347]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:58:16.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:16 smithi170 ceph-mon[31899]: from='client.24332 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:58:17.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:17 smithi186 ceph-mon[35697]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:17.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:17 smithi191 ceph-mon[36347]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:17.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:17 smithi170 ceph-mon[31899]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:18.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:18 smithi191 ceph-mon[36347]: from='client.? 172.21.15.186:0/2965690546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d831d49-5068-4086-8d30-0a572d252432"}]: dispatch 2024-01-25T14:58:18.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:18 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d831d49-5068-4086-8d30-0a572d252432"}]: dispatch 2024-01-25T14:58:18.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:18 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d831d49-5068-4086-8d30-0a572d252432"}]': finished 2024-01-25T14:58:18.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:18 smithi191 ceph-mon[36347]: osdmap e69: 11 total, 10 up, 11 in 2024-01-25T14:58:18.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:18 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:18.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:18 smithi186 ceph-mon[35697]: from='client.? 172.21.15.186:0/2965690546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d831d49-5068-4086-8d30-0a572d252432"}]: dispatch 2024-01-25T14:58:18.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:18 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d831d49-5068-4086-8d30-0a572d252432"}]: dispatch 2024-01-25T14:58:18.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:18 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d831d49-5068-4086-8d30-0a572d252432"}]': finished 2024-01-25T14:58:18.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:18 smithi186 ceph-mon[35697]: osdmap e69: 11 total, 10 up, 11 in 2024-01-25T14:58:18.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:18 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:18.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:18 smithi170 ceph-mon[31899]: from='client.? 172.21.15.186:0/2965690546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d831d49-5068-4086-8d30-0a572d252432"}]: dispatch 2024-01-25T14:58:18.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:18 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d831d49-5068-4086-8d30-0a572d252432"}]: dispatch 2024-01-25T14:58:18.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:18 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d831d49-5068-4086-8d30-0a572d252432"}]': finished 2024-01-25T14:58:18.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:18 smithi170 ceph-mon[31899]: osdmap e69: 11 total, 10 up, 11 in 2024-01-25T14:58:18.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:18 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:19.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:19 smithi191 ceph-mon[36347]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:19 smithi191 ceph-mon[36347]: from='client.? 172.21.15.186:0/123027899' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:58:19.525 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:19 smithi170 ceph-mon[31899]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:19.525 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:19 smithi170 ceph-mon[31899]: from='client.? 172.21.15.186:0/123027899' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:58:19.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:19 smithi186 ceph-mon[35697]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:19.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:19 smithi186 ceph-mon[35697]: from='client.? 172.21.15.186:0/123027899' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:58:21.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:21 smithi191 ceph-mon[36347]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:21.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:21 smithi186 ceph-mon[35697]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:21.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:21 smithi170 ceph-mon[31899]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:23.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:23 smithi186 ceph-mon[35697]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:23.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:23 smithi191 ceph-mon[36347]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:23.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:23 smithi170 ceph-mon[31899]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:25.395 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:25 smithi186 ceph-mon[35697]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:25.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:25 smithi191 ceph-mon[36347]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:25 smithi170 ceph-mon[31899]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:26.323 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:26 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-01-25T14:58:26.323 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:26 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:26 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-01-25T14:58:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:26 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:26.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:26 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-01-25T14:58:26.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:26 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:27.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:27 smithi186 ceph-mon[35697]: Deploying daemon osd.10 on smithi186 2024-01-25T14:58:27.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:27 smithi186 ceph-mon[35697]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:27 smithi170 ceph-mon[31899]: Deploying daemon osd.10 on smithi186 2024-01-25T14:58:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:27 smithi170 ceph-mon[31899]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:27.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:27 smithi191 ceph-mon[36347]: Deploying daemon osd.10 on smithi186 2024-01-25T14:58:27.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:27 smithi191 ceph-mon[36347]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:29.212 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:29 smithi186 ceph-mon[35697]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:29.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:29 smithi170 ceph-mon[31899]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:29.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:29 smithi191 ceph-mon[36347]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:31.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:31 smithi191 ceph-mon[36347]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:31.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:31 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:31.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:31 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:31.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:31 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:58:31.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:31 smithi186 ceph-mon[35697]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:31.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:31 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:31.502 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:31 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:31.503 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:31 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:58:31.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:31 smithi170 ceph-mon[31899]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:31.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:31 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:31.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:31 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:31.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:31 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:58:33.437 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:33 smithi186 ceph-mon[35697]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:33.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:33 smithi191 ceph-mon[36347]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:33.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:33 smithi170 ceph-mon[31899]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:34.003 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 10 on host 'smithi186' 2024-01-25T14:58:34.003 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:34.001+0000 7fe818ff9700 1 -- 172.21.15.186:0/562530998 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fe81c0fdda0 con 0x7fe8040a13f0 2024-01-25T14:58:34.004 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:34.003+0000 7fe821f73700 1 -- 172.21.15.186:0/562530998 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe8040a13f0 msgr2=0x7fe8040a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:58:34.004 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:34.003+0000 7fe821f73700 1 --2- 172.21.15.186:0/562530998 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe8040a13f0 0x7fe8040a38b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe810005950 tx=0x7fe8100058e0 comp rx=0 tx=0).stop 2024-01-25T14:58:34.005 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:34.003+0000 7fe821f73700 1 -- 172.21.15.186:0/562530998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe81c100700 msgr2=0x7fe81c1975c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:58:34.005 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:34.003+0000 7fe821f73700 1 --2- 172.21.15.186:0/562530998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe81c100700 0x7fe81c1975c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe80c007e00 tx=0x7fe80c00a340 comp rx=0 tx=0).stop 2024-01-25T14:58:34.005 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:34.004+0000 7fe821f73700 1 -- 172.21.15.186:0/562530998 shutdown_connections 2024-01-25T14:58:34.005 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:34.004+0000 7fe821f73700 1 --2- 172.21.15.186:0/562530998 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe8040a13f0 0x7fe8040a38b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:34.005 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:34.004+0000 7fe821f73700 1 --2- 172.21.15.186:0/562530998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe81c1022a0 0x7fe81c19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:34.005 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:34.004+0000 7fe821f73700 1 --2- 172.21.15.186:0/562530998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe81c100700 0x7fe81c1975c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:34.005 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:34.004+0000 7fe821f73700 1 --2- 172.21.15.186:0/562530998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe81c101900 0x7fe81c197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:34.005 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:34.004+0000 7fe821f73700 1 -- 172.21.15.186:0/562530998 >> 172.21.15.186:0/562530998 conn(0x7fe81c0fbca0 msgr2=0x7fe81c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:58:34.005 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:34.004+0000 7fe821f73700 1 -- 172.21.15.186:0/562530998 shutdown_connections 2024-01-25T14:58:34.005 INFO:teuthology.orchestra.run.smithi186.stderr:2024-01-25T14:58:34.004+0000 7fe821f73700 1 -- 172.21.15.186:0/562530998 wait complete. 2024-01-25T14:58:34.676 DEBUG:teuthology.orchestra.run.smithi186:osd.10> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.10.service 2024-01-25T14:58:34.679 INFO:tasks.cephadm:Deploying osd.11 on smithi191 with /dev/vg_nvme/lv_1... 2024-01-25T14:58:34.679 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-01-25T14:58:34.925 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T14:58:34.992 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 14:58:34 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T14:58:34.726+0000 7fa2ba5e87c0 -1 osd.10 0 log_to_monitors true 2024-01-25T14:58:35.322 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:35.323 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:35.323 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:34 smithi191 ceph-mon[36347]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:35.323 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:34 smithi191 ceph-mon[36347]: from='osd.10 [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-25T14:58:35.323 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:34 smithi191 ceph-mon[36347]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-25T14:58:35.323 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:35.323 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:34 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:35.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:35.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:35.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:34 smithi186 ceph-mon[35697]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:35.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:34 smithi186 ceph-mon[35697]: from='osd.10 [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-25T14:58:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:34 smithi186 ceph-mon[35697]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-25T14:58:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:34 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:34 smithi170 ceph-mon[31899]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:34 smithi170 ceph-mon[31899]: from='osd.10 [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-25T14:58:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:34 smithi170 ceph-mon[31899]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-01-25T14:58:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:34 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:36.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:36 smithi186 ceph-mon[35697]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-01-25T14:58:36.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:36 smithi186 ceph-mon[35697]: osdmap e70: 11 total, 10 up, 11 in 2024-01-25T14:58:36.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:36 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:36.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:36 smithi186 ceph-mon[35697]: from='osd.10 [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:58:36.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:36 smithi186 ceph-mon[35697]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:58:36.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 14:58:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T14:58:36.011+0000 7fa2af44d700 -1 osd.10 0 waiting for initial osdmap 2024-01-25T14:58:36.106 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 14:58:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T14:58:36.024+0000 7fa2aba48700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T14:58:36.326 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:36 smithi191 ceph-mon[36347]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-01-25T14:58:36.326 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:36 smithi191 ceph-mon[36347]: osdmap e70: 11 total, 10 up, 11 in 2024-01-25T14:58:36.326 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:36 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:36.326 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:36 smithi191 ceph-mon[36347]: from='osd.10 [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:58:36.326 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:36 smithi191 ceph-mon[36347]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:58:36.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:36 smithi170 ceph-mon[31899]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-01-25T14:58:36.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:36 smithi170 ceph-mon[31899]: osdmap e70: 11 total, 10 up, 11 in 2024-01-25T14:58:36.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:36 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:36.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:36 smithi170 ceph-mon[31899]: from='osd.10 [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:58:36.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:36 smithi170 ceph-mon[31899]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2024-01-25T14:58:37.184 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-01-25T14:58:37.184 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-01-25T14:58:37.185 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2024-01-25T14:58:37.185 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2024-01-25T14:58:37.185 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115144 s, 911 MB/s 2024-01-25T14:58:37.185 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2024-01-25T14:58:37.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:37 smithi186 ceph-mon[35697]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-01-25T14:58:37.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:37 smithi186 ceph-mon[35697]: osdmap e71: 11 total, 10 up, 11 in 2024-01-25T14:58:37.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:37 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:37.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:37 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:37.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:37 smithi186 ceph-mon[35697]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:37.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:37 smithi170 ceph-mon[31899]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-01-25T14:58:37.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:37 smithi170 ceph-mon[31899]: osdmap e71: 11 total, 10 up, 11 in 2024-01-25T14:58:37.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:37 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:37.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:37 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:37.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:37 smithi170 ceph-mon[31899]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:37.482 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:37 smithi191 ceph-mon[36347]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2024-01-25T14:58:37.482 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:37 smithi191 ceph-mon[36347]: osdmap e71: 11 total, 10 up, 11 in 2024-01-25T14:58:37.482 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:37 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:37.482 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:37 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:37.482 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:37 smithi191 ceph-mon[36347]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 317 MiB used, 894 GiB / 894 GiB avail 2024-01-25T14:58:37.873 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch daemon add osd smithi191:vg_nvme/lv_1 2024-01-25T14:58:38.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:38 smithi186 ceph-mon[35697]: purged_snaps scrub starts 2024-01-25T14:58:38.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:38 smithi186 ceph-mon[35697]: purged_snaps scrub ok 2024-01-25T14:58:38.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:38 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:38.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:38 smithi186 ceph-mon[35697]: osd.10 [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767] boot 2024-01-25T14:58:38.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:38 smithi186 ceph-mon[35697]: osdmap e72: 11 total, 11 up, 11 in 2024-01-25T14:58:38.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:38 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:38.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:38 smithi186 ceph-mon[35697]: osdmap e73: 11 total, 11 up, 11 in 2024-01-25T14:58:38.118 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T14:58:38.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:38 smithi191 ceph-mon[36347]: purged_snaps scrub starts 2024-01-25T14:58:38.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:38 smithi191 ceph-mon[36347]: purged_snaps scrub ok 2024-01-25T14:58:38.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:38 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:38.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:38 smithi191 ceph-mon[36347]: osd.10 [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767] boot 2024-01-25T14:58:38.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:38 smithi191 ceph-mon[36347]: osdmap e72: 11 total, 11 up, 11 in 2024-01-25T14:58:38.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:38 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:38.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:38 smithi191 ceph-mon[36347]: osdmap e73: 11 total, 11 up, 11 in 2024-01-25T14:58:38.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:38 smithi170 ceph-mon[31899]: purged_snaps scrub starts 2024-01-25T14:58:38.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:38 smithi170 ceph-mon[31899]: purged_snaps scrub ok 2024-01-25T14:58:38.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:38 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:38.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:38 smithi170 ceph-mon[31899]: osd.10 [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767] boot 2024-01-25T14:58:38.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:38 smithi170 ceph-mon[31899]: osdmap e72: 11 total, 11 up, 11 in 2024-01-25T14:58:38.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:38 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-01-25T14:58:38.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:38 smithi170 ceph-mon[31899]: osdmap e73: 11 total, 11 up, 11 in 2024-01-25T14:58:39.557 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:39.557 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: Detected new or changed devices on smithi186 2024-01-25T14:58:39.557 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:39.557 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:39.557 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:39.557 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:39.557 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:39.558 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:39.558 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: Adjusting osd_memory_target on smithi186 to 4270M 2024-01-25T14:58:39.558 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:39.558 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:39.558 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:58:39.558 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:39.558 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:58:39.558 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:39.558 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:58:39.558 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:39.558 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:39 smithi191 ceph-mon[36347]: osdmap e74: 11 total, 11 up, 11 in 2024-01-25T14:58:39.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:39.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: Detected new or changed devices on smithi186 2024-01-25T14:58:39.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:39.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:39.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:39.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:39.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:39.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:39.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: Adjusting osd_memory_target on smithi186 to 4270M 2024-01-25T14:58:39.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:39.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:39.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:58:39.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:39.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:58:39.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:39.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:58:39.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:39.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:39 smithi186 ceph-mon[35697]: osdmap e74: 11 total, 11 up, 11 in 2024-01-25T14:58:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 344 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: Detected new or changed devices on smithi186 2024-01-25T14:58:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:58:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: Adjusting osd_memory_target on smithi186 to 4270M 2024-01-25T14:58:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:39.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:39.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:58:39.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:39.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:58:39.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:39.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:58:39.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:39.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:39 smithi170 ceph-mon[31899]: osdmap e74: 11 total, 11 up, 11 in 2024-01-25T14:58:39.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.768+0000 7ff6e9084700 1 -- 172.21.15.191:0/979925747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e4102a10 msgr2=0x7ff6e4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:58:39.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.768+0000 7ff6e9084700 1 --2- 172.21.15.191:0/979925747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e4102a10 0x7ff6e4102e70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009990 tx=0x7ff6cc009ca0 comp rx=0 tx=0).stop 2024-01-25T14:58:39.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.768+0000 7ff6e9084700 1 -- 172.21.15.191:0/979925747 shutdown_connections 2024-01-25T14:58:39.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.768+0000 7ff6e9084700 1 --2- 172.21.15.191:0/979925747 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6e41033b0 0x7ff6e4109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:39.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.768+0000 7ff6e9084700 1 --2- 172.21.15.191:0/979925747 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6e4101810 0x7ff6e4101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:39.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.768+0000 7ff6e9084700 1 --2- 172.21.15.191:0/979925747 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e4102a10 0x7ff6e4102e70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:39.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.768+0000 7ff6e9084700 1 -- 172.21.15.191:0/979925747 >> 172.21.15.191:0/979925747 conn(0x7ff6e40fcdf0 msgr2=0x7ff6e40ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:58:39.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.768+0000 7ff6e9084700 1 -- 172.21.15.191:0/979925747 shutdown_connections 2024-01-25T14:58:39.771 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.768+0000 7ff6e9084700 1 -- 172.21.15.191:0/979925747 wait complete. 2024-01-25T14:58:39.772 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.768+0000 7ff6e9084700 1 Processor -- start 2024-01-25T14:58:39.772 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e9084700 1 -- start start 2024-01-25T14:58:39.772 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e9084700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6e4101810 0x7ff6e41976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:58:39.772 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e9084700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e4102a10 0x7ff6e4197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:58:39.772 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e9084700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6e41033b0 0x7ff6e419ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:58:39.772 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e9084700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e419f240 con 0x7ff6e4101810 2024-01-25T14:58:39.772 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e9084700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e419f380 con 0x7ff6e41033b0 2024-01-25T14:58:39.772 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e9084700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e419f510 con 0x7ff6e4102a10 2024-01-25T14:58:39.772 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e259c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e4102a10 0x7ff6e4197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:58:39.772 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e259c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e4102a10 0x7ff6e4197bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:47380/0 (socket says 172.21.15.191:47380) 2024-01-25T14:58:39.772 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e259c700 1 -- 172.21.15.191:0/2219506589 learned_addr learned my addr 172.21.15.191:0/2219506589 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-01-25T14:58:39.773 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e2d9d700 1 --2- 172.21.15.191:0/2219506589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6e4101810 0x7ff6e41976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:58:39.773 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e359e700 1 --2- 172.21.15.191:0/2219506589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6e41033b0 0x7ff6e419ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:58:39.773 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e259c700 1 -- 172.21.15.191:0/2219506589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6e41033b0 msgr2=0x7ff6e419ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:58:39.773 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e259c700 1 --2- 172.21.15.191:0/2219506589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6e41033b0 0x7ff6e419ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:39.773 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e259c700 1 -- 172.21.15.191:0/2219506589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6e4101810 msgr2=0x7ff6e41976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:58:39.773 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e259c700 1 --2- 172.21.15.191:0/2219506589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6e4101810 0x7ff6e41976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:39.773 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e259c700 1 -- 172.21.15.191:0/2219506589 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc0095f0 con 0x7ff6e4102a10 2024-01-25T14:58:39.773 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.769+0000 7ff6e259c700 1 --2- 172.21.15.191:0/2219506589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e4102a10 0x7ff6e4197bf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0036f0 tx=0x7ff6cc003b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:58:39.773 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.770+0000 7ff6dbfff700 1 -- 172.21.15.191:0/2219506589 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc01d070 con 0x7ff6e4102a10 2024-01-25T14:58:39.773 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.770+0000 7ff6e9084700 1 -- 172.21.15.191:0/2219506589 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e419f790 con 0x7ff6e4102a10 2024-01-25T14:58:39.773 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.770+0000 7ff6dbfff700 1 -- 172.21.15.191:0/2219506589 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6cc003e10 con 0x7ff6e4102a10 2024-01-25T14:58:39.773 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.770+0000 7ff6dbfff700 1 -- 172.21.15.191:0/2219506589 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc00fe00 con 0x7ff6e4102a10 2024-01-25T14:58:39.773 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.770+0000 7ff6e9084700 1 -- 172.21.15.191:0/2219506589 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e419fc00 con 0x7ff6e4102a10 2024-01-25T14:58:39.774 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.771+0000 7ff6e9084700 1 -- 172.21.15.191:0/2219506589 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e4108ca0 con 0x7ff6e4102a10 2024-01-25T14:58:39.774 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.772+0000 7ff6dbfff700 1 -- 172.21.15.191:0/2219506589 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7ff6cc00f4f0 con 0x7ff6e4102a10 2024-01-25T14:58:39.775 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.772+0000 7ff6dbfff700 1 --2- 172.21.15.191:0/2219506589 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6d00a1370 0x7ff6d00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:58:39.775 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.772+0000 7ff6dbfff700 1 -- 172.21.15.191:0/2219506589 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6723+0+0 (secure 0 0 0) 0x7ff6cc0cd850 con 0x7ff6e4102a10 2024-01-25T14:58:39.775 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.773+0000 7ff6e2d9d700 1 --2- 172.21.15.191:0/2219506589 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6d00a1370 0x7ff6d00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:58:39.775 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.773+0000 7ff6e2d9d700 1 --2- 172.21.15.191:0/2219506589 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6d00a1370 0x7ff6d00a3830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4102870 tx=0x7ff6d400c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:58:39.776 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.776+0000 7ff6dbfff700 1 -- 172.21.15.191:0/2219506589 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ff6cc097390 con 0x7ff6e4102a10 2024-01-25T14:58:39.974 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:39.973+0000 7ff6e9084700 1 -- 172.21.15.191:0/2219506589 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6e402d540 con 0x7ff6d00a1370 2024-01-25T14:58:40.567 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:40 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:58:40.567 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:40 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:58:40.567 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:40 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:40.567 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:40 smithi191 ceph-mon[36347]: osdmap e75: 11 total, 11 up, 11 in 2024-01-25T14:58:40.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:40 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:58:40.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:40 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:58:40.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:40 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:40.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:40 smithi186 ceph-mon[35697]: osdmap e75: 11 total, 11 up, 11 in 2024-01-25T14:58:40.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:40 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-01-25T14:58:40.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:40 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-01-25T14:58:40.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:40 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:40.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:40 smithi170 ceph-mon[31899]: osdmap e75: 11 total, 11 up, 11 in 2024-01-25T14:58:41.570 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:41 smithi191 ceph-mon[36347]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:58:41.570 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:41 smithi191 ceph-mon[36347]: pgmap v237: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-01-25T14:58:41.570 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:41 smithi191 ceph-mon[36347]: osdmap e76: 11 total, 11 up, 11 in 2024-01-25T14:58:41.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:41 smithi186 ceph-mon[35697]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:58:41.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:41 smithi186 ceph-mon[35697]: pgmap v237: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-01-25T14:58:41.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:41 smithi186 ceph-mon[35697]: osdmap e76: 11 total, 11 up, 11 in 2024-01-25T14:58:41.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:41 smithi170 ceph-mon[31899]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:58:41.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:41 smithi170 ceph-mon[31899]: pgmap v237: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-01-25T14:58:41.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:41 smithi170 ceph-mon[31899]: osdmap e76: 11 total, 11 up, 11 in 2024-01-25T14:58:43.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:43 smithi191 ceph-mon[36347]: pgmap v239: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-01-25T14:58:43.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:43 smithi191 ceph-mon[36347]: from='client.? 172.21.15.191:0/3069265808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "228841f5-d3d2-4481-a47c-c6c86c90925c"}]: dispatch 2024-01-25T14:58:43.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:43 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "228841f5-d3d2-4481-a47c-c6c86c90925c"}]: dispatch 2024-01-25T14:58:43.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:43 smithi191 ceph-mon[36347]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "228841f5-d3d2-4481-a47c-c6c86c90925c"}]': finished 2024-01-25T14:58:43.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:43 smithi191 ceph-mon[36347]: osdmap e77: 12 total, 11 up, 12 in 2024-01-25T14:58:43.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:43 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:58:43.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:43 smithi186 ceph-mon[35697]: pgmap v239: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-01-25T14:58:43.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:43 smithi186 ceph-mon[35697]: from='client.? 172.21.15.191:0/3069265808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "228841f5-d3d2-4481-a47c-c6c86c90925c"}]: dispatch 2024-01-25T14:58:43.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:43 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "228841f5-d3d2-4481-a47c-c6c86c90925c"}]: dispatch 2024-01-25T14:58:43.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:43 smithi186 ceph-mon[35697]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "228841f5-d3d2-4481-a47c-c6c86c90925c"}]': finished 2024-01-25T14:58:43.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:43 smithi186 ceph-mon[35697]: osdmap e77: 12 total, 11 up, 12 in 2024-01-25T14:58:43.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:43 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:58:43.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:43 smithi170 ceph-mon[31899]: pgmap v239: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 138 KiB/s, 0 objects/s recovering 2024-01-25T14:58:43.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:43 smithi170 ceph-mon[31899]: from='client.? 172.21.15.191:0/3069265808' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "228841f5-d3d2-4481-a47c-c6c86c90925c"}]: dispatch 2024-01-25T14:58:43.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:43 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "228841f5-d3d2-4481-a47c-c6c86c90925c"}]: dispatch 2024-01-25T14:58:43.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:43 smithi170 ceph-mon[31899]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "228841f5-d3d2-4481-a47c-c6c86c90925c"}]': finished 2024-01-25T14:58:43.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:43 smithi170 ceph-mon[31899]: osdmap e77: 12 total, 11 up, 12 in 2024-01-25T14:58:43.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:43 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:58:44.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:44 smithi186 ceph-mon[35697]: from='client.? 172.21.15.191:0/511309907' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:58:44.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:44 smithi170 ceph-mon[31899]: from='client.? 172.21.15.191:0/511309907' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:58:44.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:44 smithi191 ceph-mon[36347]: from='client.? 172.21.15.191:0/511309907' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-01-25T14:58:45.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:45 smithi186 ceph-mon[35697]: pgmap v241: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-01-25T14:58:45.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:45 smithi170 ceph-mon[31899]: pgmap v241: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-01-25T14:58:45.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:45 smithi191 ceph-mon[36347]: pgmap v241: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail; 112 KiB/s, 0 objects/s recovering 2024-01-25T14:58:47.448 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:47 smithi191 ceph-mon[36347]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:47.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:47 smithi186 ceph-mon[35697]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:47.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:47 smithi170 ceph-mon[31899]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:49.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:49 smithi186 ceph-mon[35697]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:49.342 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:49 smithi191 ceph-mon[36347]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:49 smithi170 ceph-mon[31899]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:51.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:51 smithi191 ceph-mon[36347]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-01-25T14:58:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:51.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:51 smithi186 ceph-mon[35697]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:51.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-01-25T14:58:51.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:51.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:51 smithi170 ceph-mon[31899]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:51.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-01-25T14:58:51.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:52.382 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:52 smithi191 ceph-mon[36347]: Deploying daemon osd.11 on smithi191 2024-01-25T14:58:52.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:52 smithi186 ceph-mon[35697]: Deploying daemon osd.11 on smithi191 2024-01-25T14:58:52.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:52 smithi170 ceph-mon[31899]: Deploying daemon osd.11 on smithi191 2024-01-25T14:58:53.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:53 smithi191 ceph-mon[36347]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:53.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:53 smithi186 ceph-mon[35697]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:53 smithi170 ceph-mon[31899]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:55.405 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:55 smithi191 ceph-mon[36347]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:55.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:55 smithi186 ceph-mon[35697]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:55 smithi170 ceph-mon[31899]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:57.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:57.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:57.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:58:57.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:56 smithi191 ceph-mon[36347]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:57.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:57.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:57.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:58:57.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:56 smithi186 ceph-mon[35697]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:57.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:57.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:57.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:58:57.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:56 smithi170 ceph-mon[31899]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:59.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:59 smithi191 ceph-mon[36347]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:59.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:59 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:59.071 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:59 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:59.072 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:59 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:59.072 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:59 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:58:59.072 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:58:59 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:59.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:59 smithi186 ceph-mon[35697]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:59.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:59 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:59.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:59 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:59.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:59 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:59.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:59 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:58:59.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:58:59 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:59 smithi170 ceph-mon[31899]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:58:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:58:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:58:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:58:59 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:58:59.744 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:59.743+0000 7ff6dbfff700 1 -- 172.21.15.191:0/2219506589 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7ff6e402d540 con 0x7ff6d00a1370 2024-01-25T14:58:59.744 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 11 on host 'smithi191' 2024-01-25T14:58:59.746 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:59.745+0000 7ff6e9084700 1 -- 172.21.15.191:0/2219506589 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6d00a1370 msgr2=0x7ff6d00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:58:59.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:59.745+0000 7ff6e9084700 1 --2- 172.21.15.191:0/2219506589 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6d00a1370 0x7ff6d00a3830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4102870 tx=0x7ff6d400c040 comp rx=0 tx=0).stop 2024-01-25T14:58:59.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:59.745+0000 7ff6e9084700 1 -- 172.21.15.191:0/2219506589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e4102a10 msgr2=0x7ff6e4197bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:58:59.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:59.745+0000 7ff6e9084700 1 --2- 172.21.15.191:0/2219506589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e4102a10 0x7ff6e4197bf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0036f0 tx=0x7ff6cc003b70 comp rx=0 tx=0).stop 2024-01-25T14:58:59.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:59.745+0000 7ff6e9084700 1 -- 172.21.15.191:0/2219506589 shutdown_connections 2024-01-25T14:58:59.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:59.745+0000 7ff6e9084700 1 --2- 172.21.15.191:0/2219506589 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6d00a1370 0x7ff6d00a3830 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:59.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:59.745+0000 7ff6e9084700 1 --2- 172.21.15.191:0/2219506589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6e41033b0 0x7ff6e419ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:59.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:59.745+0000 7ff6e9084700 1 --2- 172.21.15.191:0/2219506589 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6e4101810 0x7ff6e41976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:59.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:59.745+0000 7ff6e9084700 1 --2- 172.21.15.191:0/2219506589 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6e4102a10 0x7ff6e4197bf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:58:59.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:59.745+0000 7ff6e9084700 1 -- 172.21.15.191:0/2219506589 >> 172.21.15.191:0/2219506589 conn(0x7ff6e40fcdf0 msgr2=0x7ff6e4105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:58:59.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:59.746+0000 7ff6e9084700 1 -- 172.21.15.191:0/2219506589 shutdown_connections 2024-01-25T14:58:59.747 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:58:59.746+0000 7ff6e9084700 1 -- 172.21.15.191:0/2219506589 wait complete. 2024-01-25T14:59:00.323 DEBUG:teuthology.orchestra.run.smithi191:osd.11> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.11.service 2024-01-25T14:59:00.326 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-01-25T14:59:00.326 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd stat -f json 2024-01-25T14:59:00.576 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:59:00.978 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:00 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:00.978 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:00 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:00.978 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:00 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:59:00.978 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:00 smithi170 ceph-mon[31899]: from='osd.11 [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-25T14:59:00.978 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:00 smithi170 ceph-mon[31899]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-25T14:59:00.978 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:00 smithi170 ceph-mon[31899]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:59:00.983 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:00 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:00.983 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:00 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:00.983 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:00 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:59:00.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:00 smithi191 ceph-mon[36347]: from='osd.11 [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-25T14:59:00.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:00 smithi191 ceph-mon[36347]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-25T14:59:00.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:00 smithi191 ceph-mon[36347]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:59:01.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:00 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:01.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:00 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:01.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:00 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:59:01.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:00 smithi186 ceph-mon[35697]: from='osd.11 [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-25T14:59:01.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:00 smithi186 ceph-mon[35697]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-01-25T14:59:01.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:00 smithi186 ceph-mon[35697]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:59:01.859 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:01 smithi191 ceph-mon[36347]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-01-25T14:59:01.859 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:01 smithi191 ceph-mon[36347]: osdmap e78: 12 total, 11 up, 12 in 2024-01-25T14:59:01.859 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:01 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:59:01.859 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:01 smithi191 ceph-mon[36347]: from='osd.11 [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:59:01.860 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:01 smithi191 ceph-mon[36347]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:59:02.059 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:01 smithi170 ceph-mon[31899]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-01-25T14:59:02.059 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:01 smithi170 ceph-mon[31899]: osdmap e78: 12 total, 11 up, 12 in 2024-01-25T14:59:02.059 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:01 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:59:02.059 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:01 smithi170 ceph-mon[31899]: from='osd.11 [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:59:02.059 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:01 smithi170 ceph-mon[31899]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:59:02.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:01 smithi186 ceph-mon[35697]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-01-25T14:59:02.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:01 smithi186 ceph-mon[35697]: osdmap e78: 12 total, 11 up, 12 in 2024-01-25T14:59:02.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:01 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:59:02.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:01 smithi186 ceph-mon[35697]: from='osd.11 [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:59:02.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:01 smithi186 ceph-mon[35697]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2024-01-25T14:59:02.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.457+0000 7f2c5bbea700 1 -- 172.21.15.170:0/772882247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c54102a30 msgr2=0x7f2c54102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:02.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.457+0000 7f2c5bbea700 1 --2- 172.21.15.170:0/772882247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c54102a30 0x7f2c54102e90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2c440099c0 tx=0x7f2c44009cd0 comp rx=0 tx=0).stop 2024-01-25T14:59:02.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.457+0000 7f2c5bbea700 1 -- 172.21.15.170:0/772882247 shutdown_connections 2024-01-25T14:59:02.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.457+0000 7f2c5bbea700 1 --2- 172.21.15.170:0/772882247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c54101830 0x7f2c54101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:02.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.457+0000 7f2c5bbea700 1 --2- 172.21.15.170:0/772882247 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2c541033d0 0x7f2c54109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:02.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.457+0000 7f2c5bbea700 1 --2- 172.21.15.170:0/772882247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c54102a30 0x7f2c54102e90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:02.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.457+0000 7f2c5bbea700 1 -- 172.21.15.170:0/772882247 >> 172.21.15.170:0/772882247 conn(0x7f2c540fcdf0 msgr2=0x7f2c540ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:02.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.457+0000 7f2c5bbea700 1 -- 172.21.15.170:0/772882247 shutdown_connections 2024-01-25T14:59:02.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.457+0000 7f2c5bbea700 1 -- 172.21.15.170:0/772882247 wait complete. 2024-01-25T14:59:02.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c5bbea700 1 Processor -- start 2024-01-25T14:59:02.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c5bbea700 1 -- start start 2024-01-25T14:59:02.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c5bbea700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c54101830 0x7f2c54075580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:02.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c5bbea700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c54102a30 0x7f2c54073bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:02.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c5bbea700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2c541033d0 0x7f2c54074110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:02.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c5bbea700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c54074890 con 0x7f2c54102a30 2024-01-25T14:59:02.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c5bbea700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c54074a00 con 0x7f2c541033d0 2024-01-25T14:59:02.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c5bbea700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c541a1670 con 0x7f2c54101830 2024-01-25T14:59:02.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c59185700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c54102a30 0x7f2c54073bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:02.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c59986700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c54101830 0x7f2c54075580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c59185700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c54102a30 0x7f2c54073bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44762/0 (socket says 172.21.15.170:44762) 2024-01-25T14:59:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c59185700 1 -- 172.21.15.170:0/3714339958 learned_addr learned my addr 172.21.15.170:0/3714339958 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c5a187700 1 --2- 172.21.15.170:0/3714339958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2c541033d0 0x7f2c54074110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c59185700 1 -- 172.21.15.170:0/3714339958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c54101830 msgr2=0x7f2c54075580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c59185700 1 --2- 172.21.15.170:0/3714339958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c54101830 0x7f2c54075580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c59185700 1 -- 172.21.15.170:0/3714339958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2c541033d0 msgr2=0x7f2c54074110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c59185700 1 --2- 172.21.15.170:0/3714339958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2c541033d0 0x7f2c54074110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c59185700 1 -- 172.21.15.170:0/3714339958 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c440095f0 con 0x7f2c54102a30 2024-01-25T14:59:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.458+0000 7f2c5a187700 1 --2- 172.21.15.170:0/3714339958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2c541033d0 0x7f2c54074110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T14:59:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.459+0000 7f2c59185700 1 --2- 172.21.15.170:0/3714339958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c54102a30 0x7f2c54073bd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400b580 tx=0x7f2c44009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.459+0000 7f2c4affd700 1 -- 172.21.15.170:0/3714339958 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4401d070 con 0x7f2c54102a30 2024-01-25T14:59:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.459+0000 7f2c4affd700 1 -- 172.21.15.170:0/3714339958 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c44004010 con 0x7f2c54102a30 2024-01-25T14:59:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.459+0000 7f2c5bbea700 1 -- 172.21.15.170:0/3714339958 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c541a18f0 con 0x7f2c54102a30 2024-01-25T14:59:02.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.459+0000 7f2c4affd700 1 -- 172.21.15.170:0/3714339958 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44022d10 con 0x7f2c54102a30 2024-01-25T14:59:02.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.459+0000 7f2c5bbea700 1 -- 172.21.15.170:0/3714339958 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c541a1d90 con 0x7f2c54102a30 2024-01-25T14:59:02.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.460+0000 7f2c5bbea700 1 -- 172.21.15.170:0/3714339958 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c54108c70 con 0x7f2c54102a30 2024-01-25T14:59:02.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.462+0000 7f2c4affd700 1 -- 172.21.15.170:0/3714339958 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f2c44022470 con 0x7f2c54102a30 2024-01-25T14:59:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.462+0000 7f2c4affd700 1 --2- 172.21.15.170:0/3714339958 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2c400a1370 0x7f2c400a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.462+0000 7f2c59986700 1 --2- 172.21.15.170:0/3714339958 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2c400a1370 0x7f2c400a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.462+0000 7f2c4affd700 1 -- 172.21.15.170:0/3714339958 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f2c440ce140 con 0x7f2c54102a30 2024-01-25T14:59:02.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.463+0000 7f2c59986700 1 --2- 172.21.15.170:0/3714339958 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2c400a1370 0x7f2c400a3830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2c54102890 tx=0x7f2c50007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:02.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.465+0000 7f2c4affd700 1 -- 172.21.15.170:0/3714339958 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f2c44097c10 con 0x7f2c54102a30 2024-01-25T14:59:02.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.664+0000 7f2c5bbea700 1 -- 172.21.15.170:0/3714339958 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f2c5410d030 con 0x7f2c54102a30 2024-01-25T14:59:02.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.665+0000 7f2c4affd700 1 -- 172.21.15.170:0/3714339958 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) v1 ==== 74+0+133 (secure 0 0 0) 0x7f2c4409b230 con 0x7f2c54102a30 2024-01-25T14:59:02.666 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:02.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.667+0000 7f2c5bbea700 1 -- 172.21.15.170:0/3714339958 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2c400a1370 msgr2=0x7f2c400a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:02.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.667+0000 7f2c5bbea700 1 --2- 172.21.15.170:0/3714339958 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2c400a1370 0x7f2c400a3830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2c54102890 tx=0x7f2c50007400 comp rx=0 tx=0).stop 2024-01-25T14:59:02.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.667+0000 7f2c5bbea700 1 -- 172.21.15.170:0/3714339958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c54102a30 msgr2=0x7f2c54073bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:02.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.667+0000 7f2c5bbea700 1 --2- 172.21.15.170:0/3714339958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c54102a30 0x7f2c54073bd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400b580 tx=0x7f2c44009580 comp rx=0 tx=0).stop 2024-01-25T14:59:02.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.667+0000 7f2c5bbea700 1 -- 172.21.15.170:0/3714339958 shutdown_connections 2024-01-25T14:59:02.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.667+0000 7f2c5bbea700 1 --2- 172.21.15.170:0/3714339958 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2c400a1370 0x7f2c400a3830 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:02.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.667+0000 7f2c5bbea700 1 --2- 172.21.15.170:0/3714339958 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2c54101830 0x7f2c54075580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:02.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.667+0000 7f2c5bbea700 1 --2- 172.21.15.170:0/3714339958 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2c541033d0 0x7f2c54074110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:02.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.667+0000 7f2c5bbea700 1 --2- 172.21.15.170:0/3714339958 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2c54102a30 0x7f2c54073bd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:02.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.667+0000 7f2c5bbea700 1 -- 172.21.15.170:0/3714339958 >> 172.21.15.170:0/3714339958 conn(0x7f2c540fcdf0 msgr2=0x7f2c54105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:02.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.667+0000 7f2c5bbea700 1 -- 172.21.15.170:0/3714339958 shutdown_connections 2024-01-25T14:59:02.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:02.667+0000 7f2c5bbea700 1 -- 172.21.15.170:0/3714339958 wait complete. 2024-01-25T14:59:02.983 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:02 smithi191 ceph-mon[36347]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-01-25T14:59:02.983 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:02 smithi191 ceph-mon[36347]: osdmap e79: 12 total, 11 up, 12 in 2024-01-25T14:59:02.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:02 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:59:02.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:02 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:59:02.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:02 smithi191 ceph-mon[36347]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:59:02.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:02 smithi191 ceph-mon[36347]: from='osd.11 ' entity='osd.11' 2024-01-25T14:59:02.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:02 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3714339958' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-25T14:59:02.984 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 14:59:02 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T14:59:02.594+0000 7fa52d299700 -1 osd.11 0 waiting for initial osdmap 2024-01-25T14:59:02.984 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 14:59:02 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T14:59:02.614+0000 7fa524089700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-25T14:59:02.989 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:02 smithi170 ceph-mon[31899]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-01-25T14:59:02.989 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:02 smithi170 ceph-mon[31899]: osdmap e79: 12 total, 11 up, 12 in 2024-01-25T14:59:02.989 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:02 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:59:02.990 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:02 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:59:02.990 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:02 smithi170 ceph-mon[31899]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:59:02.990 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:02 smithi170 ceph-mon[31899]: from='osd.11 ' entity='osd.11' 2024-01-25T14:59:02.990 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:02 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3714339958' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-25T14:59:03.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:02 smithi186 ceph-mon[35697]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2024-01-25T14:59:03.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:02 smithi186 ceph-mon[35697]: osdmap e79: 12 total, 11 up, 12 in 2024-01-25T14:59:03.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:02 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:59:03.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:02 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:59:03.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:02 smithi186 ceph-mon[35697]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 345 MiB used, 983 GiB / 983 GiB avail 2024-01-25T14:59:03.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:02 smithi186 ceph-mon[35697]: from='osd.11 ' entity='osd.11' 2024-01-25T14:59:03.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:02 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3714339958' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-25T14:59:03.308 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":79,"num_osds":12,"num_up_osds":11,"osd_up_since":1706194717,"num_in_osds":12,"osd_in_since":1706194722,"num_remapped_pgs":0} 2024-01-25T14:59:03.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: purged_snaps scrub starts 2024-01-25T14:59:03.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: purged_snaps scrub ok 2024-01-25T14:59:03.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:59:03.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:03.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:03.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:59:03.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:59:03.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:59:03.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:59:03.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:03.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:03.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:59:03.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:03.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: osd.11 [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135] boot 2024-01-25T14:59:03.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: osdmap e80: 12 total, 12 up, 12 in 2024-01-25T14:59:03.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:03 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:59:03.983 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: purged_snaps scrub starts 2024-01-25T14:59:03.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: purged_snaps scrub ok 2024-01-25T14:59:03.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:59:03.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:03.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:03.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:59:03.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:59:03.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:59:03.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:59:03.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:03.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:03.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:59:03.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:03.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: osd.11 [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135] boot 2024-01-25T14:59:03.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: osdmap e80: 12 total, 12 up, 12 in 2024-01-25T14:59:03.985 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:03 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:59:04.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: purged_snaps scrub starts 2024-01-25T14:59:04.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: purged_snaps scrub ok 2024-01-25T14:59:04.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:59:04.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:04.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:04.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:59:04.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:59:04.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:59:04.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-01-25T14:59:04.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:04.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:04.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:59:04.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:04.106 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: osd.11 [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135] boot 2024-01-25T14:59:04.106 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: osdmap e80: 12 total, 12 up, 12 in 2024-01-25T14:59:04.106 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:03 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-01-25T14:59:04.309 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd stat -f json 2024-01-25T14:59:04.559 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:59:04.984 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:04 smithi191 ceph-mon[36347]: Detected new or changed devices on smithi191 2024-01-25T14:59:05.004 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:04 smithi191 ceph-mon[36347]: Adjusting osd_memory_target on smithi191 to 4270M 2024-01-25T14:59:05.004 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:04 smithi191 ceph-mon[36347]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:05.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:04 smithi170 ceph-mon[31899]: Detected new or changed devices on smithi191 2024-01-25T14:59:05.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:04 smithi170 ceph-mon[31899]: Adjusting osd_memory_target on smithi191 to 4270M 2024-01-25T14:59:05.010 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:04 smithi170 ceph-mon[31899]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:05.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:04 smithi186 ceph-mon[35697]: Detected new or changed devices on smithi191 2024-01-25T14:59:05.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:04 smithi186 ceph-mon[35697]: Adjusting osd_memory_target on smithi191 to 4270M 2024-01-25T14:59:05.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:04 smithi186 ceph-mon[35697]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:05.954 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:05 smithi170 ceph-mon[31899]: osdmap e81: 12 total, 12 up, 12 in 2024-01-25T14:59:05.983 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:05 smithi191 ceph-mon[36347]: osdmap e81: 12 total, 12 up, 12 in 2024-01-25T14:59:06.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:05 smithi186 ceph-mon[35697]: osdmap e81: 12 total, 12 up, 12 in 2024-01-25T14:59:06.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 -- 172.21.15.170:0/3073135604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0781033d0 msgr2=0x7ff078109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:06.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 --2- 172.21.15.170:0/3073135604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0781033d0 0x7ff078109c80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff07000b0d0 tx=0x7ff07000b3e0 comp rx=0 tx=0).stop 2024-01-25T14:59:06.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 -- 172.21.15.170:0/3073135604 shutdown_connections 2024-01-25T14:59:06.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 --2- 172.21.15.170:0/3073135604 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0781033d0 0x7ff078109c80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:06.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 --2- 172.21.15.170:0/3073135604 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff078101830 0x7ff078101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:06.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 --2- 172.21.15.170:0/3073135604 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff078102a30 0x7ff078102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:06.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 -- 172.21.15.170:0/3073135604 >> 172.21.15.170:0/3073135604 conn(0x7ff0780fcdf0 msgr2=0x7ff0780ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:06.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 -- 172.21.15.170:0/3073135604 shutdown_connections 2024-01-25T14:59:06.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 -- 172.21.15.170:0/3073135604 wait complete. 2024-01-25T14:59:06.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 Processor -- start 2024-01-25T14:59:06.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 -- start start 2024-01-25T14:59:06.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff078101830 0x7ff078197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:06.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff078102a30 0x7ff078197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:06.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0781033d0 0x7ff07819edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:06.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07819f390 con 0x7ff0781033d0 2024-01-25T14:59:06.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07819f4d0 con 0x7ff078101830 2024-01-25T14:59:06.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.183+0000 7ff07eaa0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07819f660 con 0x7ff078102a30 2024-01-25T14:59:06.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.184+0000 7ff07d03d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0781033d0 0x7ff07819edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:06.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.184+0000 7ff07d03d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0781033d0 0x7ff07819edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58446/0 (socket says 172.21.15.170:58446) 2024-01-25T14:59:06.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.184+0000 7ff07d03d700 1 -- 172.21.15.170:0/1499453397 learned_addr learned my addr 172.21.15.170:0/1499453397 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:06.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.184+0000 7ff077fff700 1 --2- 172.21.15.170:0/1499453397 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff078102a30 0x7ff078197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:06.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.184+0000 7ff07c83c700 1 --2- 172.21.15.170:0/1499453397 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff078101830 0x7ff078197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:06.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.184+0000 7ff07d03d700 1 -- 172.21.15.170:0/1499453397 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff078102a30 msgr2=0x7ff078197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:06.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.184+0000 7ff07d03d700 1 --2- 172.21.15.170:0/1499453397 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff078102a30 0x7ff078197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:06.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.184+0000 7ff07d03d700 1 -- 172.21.15.170:0/1499453397 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff078101830 msgr2=0x7ff078197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:06.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.184+0000 7ff07d03d700 1 --2- 172.21.15.170:0/1499453397 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff078101830 0x7ff078197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:06.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.184+0000 7ff07d03d700 1 -- 172.21.15.170:0/1499453397 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff070009d00 con 0x7ff0781033d0 2024-01-25T14:59:06.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.184+0000 7ff07d03d700 1 --2- 172.21.15.170:0/1499453397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0781033d0 0x7ff07819edc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff070007a00 tx=0x7ff070009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:06.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.184+0000 7ff075ffb700 1 -- 172.21.15.170:0/1499453397 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07000e040 con 0x7ff0781033d0 2024-01-25T14:59:06.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.184+0000 7ff075ffb700 1 -- 172.21.15.170:0/1499453397 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff07001dd50 con 0x7ff0781033d0 2024-01-25T14:59:06.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.184+0000 7ff075ffb700 1 -- 172.21.15.170:0/1499453397 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0700123f0 con 0x7ff0781033d0 2024-01-25T14:59:06.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.184+0000 7ff07eaa0700 1 -- 172.21.15.170:0/1499453397 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07819f8e0 con 0x7ff0781033d0 2024-01-25T14:59:06.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.185+0000 7ff07eaa0700 1 -- 172.21.15.170:0/1499453397 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07819fd80 con 0x7ff0781033d0 2024-01-25T14:59:06.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.185+0000 7ff07eaa0700 1 -- 172.21.15.170:0/1499453397 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff078108bf0 con 0x7ff0781033d0 2024-01-25T14:59:06.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.187+0000 7ff075ffb700 1 -- 172.21.15.170:0/1499453397 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7ff07001d890 con 0x7ff0781033d0 2024-01-25T14:59:06.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.187+0000 7ff075ffb700 1 --2- 172.21.15.170:0/1499453397 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff0680a13f0 0x7ff0680a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:06.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.187+0000 7ff07c83c700 1 --2- 172.21.15.170:0/1499453397 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff0680a13f0 0x7ff0680a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:06.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.187+0000 7ff075ffb700 1 -- 172.21.15.170:0/1499453397 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff0700ce9c0 con 0x7ff0781033d0 2024-01-25T14:59:06.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.188+0000 7ff07c83c700 1 --2- 172.21.15.170:0/1499453397 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff0680a13f0 0x7ff0680a38b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff078102890 tx=0x7ff06c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:06.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.191+0000 7ff075ffb700 1 -- 172.21.15.170:0/1499453397 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ff070098370 con 0x7ff0781033d0 2024-01-25T14:59:06.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.385+0000 7ff07eaa0700 1 -- 172.21.15.170:0/1499453397 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff07810d0d0 con 0x7ff0781033d0 2024-01-25T14:59:06.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.386+0000 7ff075ffb700 1 -- 172.21.15.170:0/1499453397 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) v1 ==== 74+0+133 (secure 0 0 0) 0x7ff07009b990 con 0x7ff0781033d0 2024-01-25T14:59:06.387 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:06.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.388+0000 7ff07eaa0700 1 -- 172.21.15.170:0/1499453397 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff0680a13f0 msgr2=0x7ff0680a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:06.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.388+0000 7ff07eaa0700 1 --2- 172.21.15.170:0/1499453397 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff0680a13f0 0x7ff0680a38b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff078102890 tx=0x7ff06c009190 comp rx=0 tx=0).stop 2024-01-25T14:59:06.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.388+0000 7ff07eaa0700 1 -- 172.21.15.170:0/1499453397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0781033d0 msgr2=0x7ff07819edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:06.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.388+0000 7ff07eaa0700 1 --2- 172.21.15.170:0/1499453397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0781033d0 0x7ff07819edc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff070007a00 tx=0x7ff070009440 comp rx=0 tx=0).stop 2024-01-25T14:59:06.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.388+0000 7ff07eaa0700 1 -- 172.21.15.170:0/1499453397 shutdown_connections 2024-01-25T14:59:06.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.388+0000 7ff07eaa0700 1 --2- 172.21.15.170:0/1499453397 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff0680a13f0 0x7ff0680a38b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:06.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.388+0000 7ff07eaa0700 1 --2- 172.21.15.170:0/1499453397 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff0781033d0 0x7ff07819edc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:06.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.388+0000 7ff07eaa0700 1 --2- 172.21.15.170:0/1499453397 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff078101830 0x7ff078197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:06.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.388+0000 7ff07eaa0700 1 --2- 172.21.15.170:0/1499453397 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff078102a30 0x7ff078197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:06.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.388+0000 7ff07eaa0700 1 -- 172.21.15.170:0/1499453397 >> 172.21.15.170:0/1499453397 conn(0x7ff0780fcdf0 msgr2=0x7ff078105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:06.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.388+0000 7ff07eaa0700 1 -- 172.21.15.170:0/1499453397 shutdown_connections 2024-01-25T14:59:06.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:06.388+0000 7ff07eaa0700 1 -- 172.21.15.170:0/1499453397 wait complete. 2024-01-25T14:59:07.006 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:06 smithi186 ceph-mon[35697]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:07.006 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:06 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1499453397' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-25T14:59:07.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:06 smithi170 ceph-mon[31899]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:07.096 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:06 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1499453397' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-25T14:59:07.126 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1706194743,"num_in_osds":12,"osd_in_since":1706194722,"num_remapped_pgs":0} 2024-01-25T14:59:07.127 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd dump --format=json 2024-01-25T14:59:07.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:06 smithi191 ceph-mon[36347]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:07.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:06 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1499453397' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-01-25T14:59:07.366 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:59:09.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.171+0000 7f205dfeb700 1 -- 172.21.15.170:0/1010039538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20581077c0 msgr2=0x7f2058107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:09.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.171+0000 7f205dfeb700 1 --2- 172.21.15.170:0/1010039538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20581077c0 0x7f2058107ba0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f20480099c0 tx=0x7f2048009cd0 comp rx=0 tx=0).stop 2024-01-25T14:59:09.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.171+0000 7f205dfeb700 1 -- 172.21.15.170:0/1010039538 shutdown_connections 2024-01-25T14:59:09.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.171+0000 7f205dfeb700 1 --2- 172.21.15.170:0/1010039538 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f205806a8a0 0x7f205810e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:09.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.171+0000 7f205dfeb700 1 --2- 172.21.15.170:0/1010039538 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f20581077c0 0x7f2058107ba0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:09.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.171+0000 7f205dfeb700 1 --2- 172.21.15.170:0/1010039538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2058069ee0 0x7f205806a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:09.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.171+0000 7f205dfeb700 1 -- 172.21.15.170:0/1010039538 >> 172.21.15.170:0/1010039538 conn(0x7f2058076730 msgr2=0x7f2058076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:09.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.171+0000 7f205dfeb700 1 -- 172.21.15.170:0/1010039538 shutdown_connections 2024-01-25T14:59:09.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.171+0000 7f205dfeb700 1 -- 172.21.15.170:0/1010039538 wait complete. 2024-01-25T14:59:09.174 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:09 smithi170 ceph-mon[31899]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:09.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.172+0000 7f205dfeb700 1 Processor -- start 2024-01-25T14:59:09.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.172+0000 7f205dfeb700 1 -- start start 2024-01-25T14:59:09.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f205dfeb700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2058069ee0 0x7f205819d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:09.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f205dfeb700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f205806a8a0 0x7f205819dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:09.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f205dfeb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20581077c0 0x7f2058197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:09.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f205dfeb700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2058197ff0 con 0x7f2058069ee0 2024-01-25T14:59:09.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f205dfeb700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2058198130 con 0x7f205806a8a0 2024-01-25T14:59:09.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f205dfeb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20581982f0 con 0x7f20581077c0 2024-01-25T14:59:09.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f20577fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2058069ee0 0x7f205819d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:09.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f20577fe700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2058069ee0 0x7f205819d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58456/0 (socket says 172.21.15.170:58456) 2024-01-25T14:59:09.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f20577fe700 1 -- 172.21.15.170:0/2890116049 learned_addr learned my addr 172.21.15.170:0/2890116049 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:09.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f2056ffd700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f205806a8a0 0x7f205819dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:09.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f2057fff700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20581077c0 0x7f2058197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:09.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f2056ffd700 1 -- 172.21.15.170:0/2890116049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20581077c0 msgr2=0x7f2058197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:09.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f2056ffd700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20581077c0 0x7f2058197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:09.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f2056ffd700 1 -- 172.21.15.170:0/2890116049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2058069ee0 msgr2=0x7f205819d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:09.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f2056ffd700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2058069ee0 0x7f205819d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:09.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f2056ffd700 1 -- 172.21.15.170:0/2890116049 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480095f0 con 0x7f205806a8a0 2024-01-25T14:59:09.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f2057fff700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20581077c0 0x7f2058197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T14:59:09.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f20577fe700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2058069ee0 0x7f205819d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T14:59:09.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.173+0000 7f2056ffd700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f205806a8a0 0x7f205819dd10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f204c00e9f0 tx=0x7f204c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:09.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.174+0000 7f2054ff9700 1 -- 172.21.15.170:0/2890116049 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c00eee0 con 0x7f205806a8a0 2024-01-25T14:59:09.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.174+0000 7f2054ff9700 1 -- 172.21.15.170:0/2890116049 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f204c00cbd0 con 0x7f205806a8a0 2024-01-25T14:59:09.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.174+0000 7f205dfeb700 1 -- 172.21.15.170:0/2890116049 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20581985d0 con 0x7f205806a8a0 2024-01-25T14:59:09.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.174+0000 7f2054ff9700 1 -- 172.21.15.170:0/2890116049 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c018680 con 0x7f205806a8a0 2024-01-25T14:59:09.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.174+0000 7f205dfeb700 1 -- 172.21.15.170:0/2890116049 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20581a4870 con 0x7f205806a8a0 2024-01-25T14:59:09.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.175+0000 7f205dfeb700 1 -- 172.21.15.170:0/2890116049 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2058109d50 con 0x7f205806a8a0 2024-01-25T14:59:09.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.176+0000 7f2054ff9700 1 -- 172.21.15.170:0/2890116049 <== mon.2 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f204c00cd40 con 0x7f205806a8a0 2024-01-25T14:59:09.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.176+0000 7f2054ff9700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f20400a13f0 0x7f20400a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:09.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.176+0000 7f20577fe700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f20400a13f0 0x7f20400a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:09.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.176+0000 7f2054ff9700 1 -- 172.21.15.170:0/2890116049 <== mon.2 v2:172.21.15.186:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f204c014070 con 0x7f205806a8a0 2024-01-25T14:59:09.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.176+0000 7f20577fe700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f20400a13f0 0x7f20400a38b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2048009fd0 tx=0x7f2048005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:09.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.181+0000 7f2054ff9700 1 -- 172.21.15.170:0/2890116049 <== mon.2 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f204c096120 con 0x7f205806a8a0 2024-01-25T14:59:09.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:09 smithi186 ceph-mon[35697]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:09.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.373+0000 7f205dfeb700 1 -- 172.21.15.170:0/2890116049 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20580684a0 con 0x7f205806a8a0 2024-01-25T14:59:09.375 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.374+0000 7f2054ff9700 1 -- 172.21.15.170:0/2890116049 <== mon.2 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18466 (secure 0 0 0) 0x7f204c099740 con 0x7f205806a8a0 2024-01-25T14:59:09.375 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:09.376 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":81,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T14:59:04.723615+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T14:59:09.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.376+0000 7f205dfeb700 1 -- 172.21.15.170:0/2890116049 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f20400a13f0 msgr2=0x7f20400a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:09.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.376+0000 7f205dfeb700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f20400a13f0 0x7f20400a38b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2048009fd0 tx=0x7f2048005960 comp rx=0 tx=0).stop 2024-01-25T14:59:09.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.376+0000 7f205dfeb700 1 -- 172.21.15.170:0/2890116049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f205806a8a0 msgr2=0x7f205819dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:09.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.376+0000 7f205dfeb700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f205806a8a0 0x7f205819dd10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f204c00e9f0 tx=0x7f204c00ed00 comp rx=0 tx=0).stop 2024-01-25T14:59:09.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.376+0000 7f205dfeb700 1 -- 172.21.15.170:0/2890116049 shutdown_connections 2024-01-25T14:59:09.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.376+0000 7f205dfeb700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f20400a13f0 0x7f20400a38b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:09.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.376+0000 7f205dfeb700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f20581077c0 0x7f2058197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:09.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.376+0000 7f205dfeb700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2058069ee0 0x7f205819d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:09.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.376+0000 7f205dfeb700 1 --2- 172.21.15.170:0/2890116049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f205806a8a0 0x7f205819dd10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:09.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.376+0000 7f205dfeb700 1 -- 172.21.15.170:0/2890116049 >> 172.21.15.170:0/2890116049 conn(0x7f2058076730 msgr2=0x7f20580ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:09.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.376+0000 7f205dfeb700 1 -- 172.21.15.170:0/2890116049 shutdown_connections 2024-01-25T14:59:09.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:09.377+0000 7f205dfeb700 1 -- 172.21.15.170:0/2890116049 wait complete. 2024-01-25T14:59:09.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:09 smithi191 ceph-mon[36347]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:10.117 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T14:55:22.432727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T14:59:10.118 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-01-25T14:59:10.315 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:10 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2890116049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T14:59:10.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:10 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2890116049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T14:59:10.357 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T14:59:10.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:10 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2890116049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T14:59:11.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:11 smithi170 ceph-mon[31899]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:11.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:11 smithi186 ceph-mon[35697]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:11.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:11 smithi191 ceph-mon[36347]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.955+0000 7fb2a3799700 1 -- 172.21.15.170:0/292108293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb29c069f80 msgr2=0x7fb29c06a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.955+0000 7fb2a3799700 1 --2- 172.21.15.170:0/292108293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb29c069f80 0x7fb29c06a400 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb28c009990 tx=0x7fb28c009ca0 comp rx=0 tx=0).stop 2024-01-25T14:59:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.955+0000 7fb2a3799700 1 -- 172.21.15.170:0/292108293 shutdown_connections 2024-01-25T14:59:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.955+0000 7fb2a3799700 1 --2- 172.21.15.170:0/292108293 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb29c06a940 0x7fb29c10e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:11.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.955+0000 7fb2a3799700 1 --2- 172.21.15.170:0/292108293 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb29c1078a0 0x7fb29c107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.955+0000 7fb2a3799700 1 --2- 172.21.15.170:0/292108293 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb29c069f80 0x7fb29c06a400 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.955+0000 7fb2a3799700 1 -- 172.21.15.170:0/292108293 >> 172.21.15.170:0/292108293 conn(0x7fb29c0777b0 msgr2=0x7fb29c077bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.955+0000 7fb2a3799700 1 -- 172.21.15.170:0/292108293 shutdown_connections 2024-01-25T14:59:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.955+0000 7fb2a3799700 1 -- 172.21.15.170:0/292108293 wait complete. 2024-01-25T14:59:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.955+0000 7fb2a3799700 1 Processor -- start 2024-01-25T14:59:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.955+0000 7fb2a3799700 1 -- start start 2024-01-25T14:59:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.955+0000 7fb2a3799700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb29c069f80 0x7fb29c100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a3799700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb29c06a940 0x7fb29c100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a3799700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb29c1078a0 0x7fb29c101190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a3799700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c1a6010 con 0x7fb29c1078a0 2024-01-25T14:59:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a3799700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c1a6180 con 0x7fb29c06a940 2024-01-25T14:59:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a3799700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c1a6340 con 0x7fb29c069f80 2024-01-25T14:59:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a1d36700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb29c1078a0 0x7fb29c101190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a1d36700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb29c1078a0 0x7fb29c101190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:58472/0 (socket says 172.21.15.170:58472) 2024-01-25T14:59:11.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a1d36700 1 -- 172.21.15.170:0/102345367 learned_addr learned my addr 172.21.15.170:0/102345367 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:11.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a0d34700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb29c06a940 0x7fb29c100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:11.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a1535700 1 --2- 172.21.15.170:0/102345367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb29c069f80 0x7fb29c100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:11.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a1d36700 1 -- 172.21.15.170:0/102345367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb29c069f80 msgr2=0x7fb29c100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:11.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a1d36700 1 --2- 172.21.15.170:0/102345367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb29c069f80 0x7fb29c100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:11.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a1d36700 1 -- 172.21.15.170:0/102345367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb29c06a940 msgr2=0x7fb29c100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:11.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a1d36700 1 --2- 172.21.15.170:0/102345367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb29c06a940 0x7fb29c100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:11.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a1d36700 1 -- 172.21.15.170:0/102345367 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c0095f0 con 0x7fb29c1078a0 2024-01-25T14:59:11.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a1d36700 1 --2- 172.21.15.170:0/102345367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb29c1078a0 0x7fb29c101190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb29400ada0 tx=0x7fb29400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:11.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2927fc700 1 -- 172.21.15.170:0/102345367 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29400f070 con 0x7fb29c1078a0 2024-01-25T14:59:11.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2927fc700 1 -- 172.21.15.170:0/102345367 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb294007b30 con 0x7fb29c1078a0 2024-01-25T14:59:11.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2927fc700 1 -- 172.21.15.170:0/102345367 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294005280 con 0x7fb29c1078a0 2024-01-25T14:59:11.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a3799700 1 -- 172.21.15.170:0/102345367 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29c1a6620 con 0x7fb29c1078a0 2024-01-25T14:59:11.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.956+0000 7fb2a3799700 1 -- 172.21.15.170:0/102345367 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29c1a6aa0 con 0x7fb29c1078a0 2024-01-25T14:59:11.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.957+0000 7fb2a3799700 1 -- 172.21.15.170:0/102345367 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29c109e10 con 0x7fb29c1078a0 2024-01-25T14:59:11.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.958+0000 7fb2927fc700 1 -- 172.21.15.170:0/102345367 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fb29400c8d0 con 0x7fb29c1078a0 2024-01-25T14:59:11.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.959+0000 7fb2927fc700 1 --2- 172.21.15.170:0/102345367 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb2880a1370 0x7fb2880a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:11.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.959+0000 7fb2a1535700 1 --2- 172.21.15.170:0/102345367 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb2880a1370 0x7fb2880a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:11.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.959+0000 7fb2927fc700 1 -- 172.21.15.170:0/102345367 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb2940cbbb0 con 0x7fb29c1078a0 2024-01-25T14:59:11.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.959+0000 7fb2a1535700 1 --2- 172.21.15.170:0/102345367 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb2880a1370 0x7fb2880a3830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb298005950 tx=0x7fb29800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:11.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:11.963+0000 7fb2927fc700 1 -- 172.21.15.170:0/102345367 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb294098ff0 con 0x7fb29c1078a0 2024-01-25T14:59:12.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:12.158+0000 7fb2a3799700 1 -- 172.21.15.170:0/102345367 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb29c111740 con 0x7fb29c1078a0 2024-01-25T14:59:12.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:12.158+0000 7fb2927fc700 1 -- 172.21.15.170:0/102345367 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb294098b80 con 0x7fb29c1078a0 2024-01-25T14:59:12.159 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 1 2024-01-25T14:59:12.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:12.160+0000 7fb2a3799700 1 -- 172.21.15.170:0/102345367 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb2880a1370 msgr2=0x7fb2880a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:12.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:12.160+0000 7fb2a3799700 1 --2- 172.21.15.170:0/102345367 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb2880a1370 0x7fb2880a3830 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb298005950 tx=0x7fb29800b410 comp rx=0 tx=0).stop 2024-01-25T14:59:12.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:12.160+0000 7fb2a3799700 1 -- 172.21.15.170:0/102345367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb29c1078a0 msgr2=0x7fb29c101190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:12.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:12.160+0000 7fb2a3799700 1 --2- 172.21.15.170:0/102345367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb29c1078a0 0x7fb29c101190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb29400ada0 tx=0x7fb29400c330 comp rx=0 tx=0).stop 2024-01-25T14:59:12.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:12.160+0000 7fb2a3799700 1 -- 172.21.15.170:0/102345367 shutdown_connections 2024-01-25T14:59:12.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:12.160+0000 7fb2a3799700 1 --2- 172.21.15.170:0/102345367 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb2880a1370 0x7fb2880a3830 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:12.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:12.160+0000 7fb2a3799700 1 --2- 172.21.15.170:0/102345367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb29c069f80 0x7fb29c100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:12.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:12.160+0000 7fb2a3799700 1 --2- 172.21.15.170:0/102345367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb29c1078a0 0x7fb29c101190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:12.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:12.160+0000 7fb2a3799700 1 --2- 172.21.15.170:0/102345367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb29c06a940 0x7fb29c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:12.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:12.160+0000 7fb2a3799700 1 -- 172.21.15.170:0/102345367 >> 172.21.15.170:0/102345367 conn(0x7fb29c0777b0 msgr2=0x7fb29c0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:12.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:12.160+0000 7fb2a3799700 1 -- 172.21.15.170:0/102345367 shutdown_connections 2024-01-25T14:59:12.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:12.160+0000 7fb2a3799700 1 -- 172.21.15.170:0/102345367 wait complete. 2024-01-25T14:59:12.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:12 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/102345367' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T14:59:12.533 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:12 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/102345367' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T14:59:12.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:12 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/102345367' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T14:59:12.884 INFO:tasks.cephadm:Adding mds.a on smithi170 2024-01-25T14:59:12.884 INFO:tasks.cephadm:Adding mds.d on smithi170 2024-01-25T14:59:12.884 INFO:tasks.cephadm:Adding mds.g on smithi170 2024-01-25T14:59:12.884 INFO:tasks.cephadm:Adding mds.j on smithi170 2024-01-25T14:59:12.884 INFO:tasks.cephadm:Adding mds.b on smithi186 2024-01-25T14:59:12.884 INFO:tasks.cephadm:Adding mds.e on smithi186 2024-01-25T14:59:12.884 INFO:tasks.cephadm:Adding mds.h on smithi186 2024-01-25T14:59:12.884 INFO:tasks.cephadm:Adding mds.k on smithi186 2024-01-25T14:59:12.884 INFO:tasks.cephadm:Adding mds.c on smithi191 2024-01-25T14:59:12.884 INFO:tasks.cephadm:Adding mds.f on smithi191 2024-01-25T14:59:12.884 INFO:tasks.cephadm:Adding mds.i on smithi191 2024-01-25T14:59:12.884 INFO:tasks.cephadm:Adding mds.l on smithi191 2024-01-25T14:59:12.885 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph orch apply mds all '12;smithi170=a;smithi170=d;smithi170=g;smithi170=j;smithi186=b;smithi186=e;smithi186=h;smithi186=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l' 2024-01-25T14:59:13.136 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T14:59:13.488 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:13 smithi191 ceph-mon[36347]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:13.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:13 smithi186 ceph-mon[35697]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:13.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:13 smithi170 ceph-mon[31899]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:14.732 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.729+0000 7fed13238700 1 -- 172.21.15.191:0/1908255670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed0c1034a0 msgr2=0x7fed0c109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:14.732 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.729+0000 7fed13238700 1 --2- 172.21.15.191:0/1908255670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed0c1034a0 0x7fed0c109d50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fed0400b0a0 tx=0x7fed0400b3b0 comp rx=0 tx=0).stop 2024-01-25T14:59:14.732 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.729+0000 7fed13238700 1 -- 172.21.15.191:0/1908255670 shutdown_connections 2024-01-25T14:59:14.732 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.729+0000 7fed13238700 1 --2- 172.21.15.191:0/1908255670 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed0c1034a0 0x7fed0c109d50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:14.732 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.729+0000 7fed13238700 1 --2- 172.21.15.191:0/1908255670 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed0c0ffb20 0x7fed0c0fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:14.732 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.729+0000 7fed13238700 1 --2- 172.21.15.191:0/1908255670 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed0c102b00 0x7fed0c102f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:14.733 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.729+0000 7fed13238700 1 -- 172.21.15.191:0/1908255670 >> 172.21.15.191:0/1908255670 conn(0x7fed0c0fb480 msgr2=0x7fed0c0fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:14.733 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.729+0000 7fed13238700 1 -- 172.21.15.191:0/1908255670 shutdown_connections 2024-01-25T14:59:14.733 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.729+0000 7fed13238700 1 -- 172.21.15.191:0/1908255670 wait complete. 2024-01-25T14:59:14.733 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.730+0000 7fed13238700 1 Processor -- start 2024-01-25T14:59:14.733 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.730+0000 7fed13238700 1 -- start start 2024-01-25T14:59:14.733 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.730+0000 7fed13238700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed0c0ffb20 0x7fed0c197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:14.733 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.730+0000 7fed13238700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed0c102b00 0x7fed0c197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:14.733 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.730+0000 7fed13238700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed0c1034a0 0x7fed0c19ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:14.733 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.730+0000 7fed13238700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c19f400 con 0x7fed0c1034a0 2024-01-25T14:59:14.733 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.730+0000 7fed13238700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c19f540 con 0x7fed0c0ffb20 2024-01-25T14:59:14.733 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.730+0000 7fed13238700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c19f6d0 con 0x7fed0c102b00 2024-01-25T14:59:14.733 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.730+0000 7fed0bfff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed0c102b00 0x7fed0c197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:14.733 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.730+0000 7fed0bfff700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed0c102b00 0x7fed0c197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.191:44220/0 (socket says 172.21.15.191:44220) 2024-01-25T14:59:14.733 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.730+0000 7fed0bfff700 1 -- 172.21.15.191:0/201934410 learned_addr learned my addr 172.21.15.191:0/201934410 (peer_addr_for_me v2:172.21.15.191:0/0) 2024-01-25T14:59:14.734 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.731+0000 7fed117d5700 1 --2- 172.21.15.191:0/201934410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed0c1034a0 0x7fed0c19ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:14.734 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.731+0000 7fed10fd4700 1 --2- 172.21.15.191:0/201934410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed0c0ffb20 0x7fed0c197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:14.734 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.731+0000 7fed0bfff700 1 -- 172.21.15.191:0/201934410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed0c0ffb20 msgr2=0x7fed0c197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:14.734 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.731+0000 7fed0bfff700 1 --2- 172.21.15.191:0/201934410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed0c0ffb20 0x7fed0c197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:14.734 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.731+0000 7fed0bfff700 1 -- 172.21.15.191:0/201934410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed0c1034a0 msgr2=0x7fed0c19ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:14.734 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.731+0000 7fed0bfff700 1 --2- 172.21.15.191:0/201934410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed0c1034a0 0x7fed0c19ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:14.734 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.731+0000 7fed0bfff700 1 -- 172.21.15.191:0/201934410 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed04009d00 con 0x7fed0c102b00 2024-01-25T14:59:14.734 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.731+0000 7fed0bfff700 1 --2- 172.21.15.191:0/201934410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed0c102b00 0x7fed0c197db0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fecf800b560 tx=0x7fecf800b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:14.734 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.731+0000 7fed09ffb700 1 -- 172.21.15.191:0/201934410 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf8011830 con 0x7fed0c102b00 2024-01-25T14:59:14.734 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.731+0000 7fed09ffb700 1 -- 172.21.15.191:0/201934410 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecf8011e50 con 0x7fed0c102b00 2024-01-25T14:59:14.734 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.731+0000 7fed13238700 1 -- 172.21.15.191:0/201934410 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0c19f9b0 con 0x7fed0c102b00 2024-01-25T14:59:14.734 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.731+0000 7fed09ffb700 1 -- 172.21.15.191:0/201934410 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf8010e50 con 0x7fed0c102b00 2024-01-25T14:59:14.734 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.731+0000 7fed13238700 1 -- 172.21.15.191:0/201934410 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0c19ff80 con 0x7fed0c102b00 2024-01-25T14:59:14.735 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.732+0000 7fed13238700 1 -- 172.21.15.191:0/201934410 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0c108c60 con 0x7fed0c102b00 2024-01-25T14:59:14.735 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.733+0000 7fed09ffb700 1 -- 172.21.15.191:0/201934410 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fecf80104f0 con 0x7fed0c102b00 2024-01-25T14:59:14.736 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.734+0000 7fed09ffb700 1 --2- 172.21.15.191:0/201934410 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecfc0a13f0 0x7fecfc0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:14.736 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.734+0000 7fed09ffb700 1 -- 172.21.15.191:0/201934410 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fecf80cc000 con 0x7fed0c102b00 2024-01-25T14:59:14.736 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.734+0000 7fed10fd4700 1 --2- 172.21.15.191:0/201934410 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecfc0a13f0 0x7fecfc0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:14.736 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.735+0000 7fed10fd4700 1 --2- 172.21.15.191:0/201934410 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecfc0a13f0 0x7fecfc0a38b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed0c069cc0 tx=0x7fed0000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:14.739 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.738+0000 7fed09ffb700 1 -- 172.21.15.191:0/201934410 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fecf8095920 con 0x7fed0c102b00 2024-01-25T14:59:14.937 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.937+0000 7fed13238700 1 -- 172.21.15.191:0/201934410 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi170=a;smithi170=d;smithi170=g;smithi170=j;smithi186=b;smithi186=e;smithi186=h;smithi186=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fed0c02d6b0 con 0x7fecfc0a13f0 2024-01-25T14:59:14.945 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.945+0000 7fed09ffb700 1 -- 172.21.15.191:0/201934410 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fed0c02d6b0 con 0x7fecfc0a13f0 2024-01-25T14:59:14.945 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mds.all update... 2024-01-25T14:59:14.947 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.947+0000 7fed13238700 1 -- 172.21.15.191:0/201934410 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecfc0a13f0 msgr2=0x7fecfc0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:14.948 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.947+0000 7fed13238700 1 --2- 172.21.15.191:0/201934410 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecfc0a13f0 0x7fecfc0a38b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fed0c069cc0 tx=0x7fed0000b410 comp rx=0 tx=0).stop 2024-01-25T14:59:14.948 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.947+0000 7fed13238700 1 -- 172.21.15.191:0/201934410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed0c102b00 msgr2=0x7fed0c197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:14.948 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.947+0000 7fed13238700 1 --2- 172.21.15.191:0/201934410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed0c102b00 0x7fed0c197db0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fecf800b560 tx=0x7fecf800b870 comp rx=0 tx=0).stop 2024-01-25T14:59:14.948 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.947+0000 7fed13238700 1 -- 172.21.15.191:0/201934410 shutdown_connections 2024-01-25T14:59:14.948 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.947+0000 7fed13238700 1 --2- 172.21.15.191:0/201934410 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecfc0a13f0 0x7fecfc0a38b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:14.948 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.947+0000 7fed13238700 1 --2- 172.21.15.191:0/201934410 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fed0c1034a0 0x7fed0c19ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:14.948 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.947+0000 7fed13238700 1 --2- 172.21.15.191:0/201934410 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed0c0ffb20 0x7fed0c197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:14.948 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.947+0000 7fed13238700 1 --2- 172.21.15.191:0/201934410 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fed0c102b00 0x7fed0c197db0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:14.948 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.947+0000 7fed13238700 1 -- 172.21.15.191:0/201934410 >> 172.21.15.191:0/201934410 conn(0x7fed0c0fb480 msgr2=0x7fed0c105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:14.948 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.947+0000 7fed13238700 1 -- 172.21.15.191:0/201934410 shutdown_connections 2024-01-25T14:59:14.948 INFO:teuthology.orchestra.run.smithi191.stderr:2024-01-25T14:59:14.947+0000 7fed13238700 1 -- 172.21.15.191:0/201934410 wait complete. 2024-01-25T14:59:15.511 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:15 smithi191 ceph-mon[36347]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:15.512 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:15.512 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:59:15.514 DEBUG:teuthology.orchestra.run.smithi170:mds.a> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.a.service 2024-01-25T14:59:15.518 DEBUG:teuthology.orchestra.run.smithi170:mds.d> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.d.service 2024-01-25T14:59:15.545 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:15 smithi170 ceph-mon[31899]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:15.546 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:15.546 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:59:15.547 DEBUG:teuthology.orchestra.run.smithi170:mds.g> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.g.service 2024-01-25T14:59:15.594 DEBUG:teuthology.orchestra.run.smithi170:mds.j> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.j.service 2024-01-25T14:59:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:15 smithi186 ceph-mon[35697]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:59:15.639 DEBUG:teuthology.orchestra.run.smithi186:mds.b> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.b.service 2024-01-25T14:59:15.642 DEBUG:teuthology.orchestra.run.smithi186:mds.e> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.e.service 2024-01-25T14:59:15.692 DEBUG:teuthology.orchestra.run.smithi186:mds.h> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.h.service 2024-01-25T14:59:15.741 DEBUG:teuthology.orchestra.run.smithi186:mds.k> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.k.service 2024-01-25T14:59:15.791 DEBUG:teuthology.orchestra.run.smithi191:mds.c> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.c.service 2024-01-25T14:59:15.797 DEBUG:teuthology.orchestra.run.smithi191:mds.f> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.f.service 2024-01-25T14:59:15.846 DEBUG:teuthology.orchestra.run.smithi191:mds.i> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.i.service 2024-01-25T14:59:15.891 DEBUG:teuthology.orchestra.run.smithi191:mds.l> sudo journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.l.service 2024-01-25T14:59:15.939 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-01-25T14:59:15.939 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T14:59:16.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.053+0000 7fe34a2da640 1 -- 172.21.15.170:0/3421225493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe344100e00 msgr2=0x7fe344101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:16.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.053+0000 7fe34a2da640 1 --2- 172.21.15.170:0/3421225493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe344100e00 0x7fe344101280 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe338009900 tx=0x7fe33802bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:16.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.053+0000 7fe34a2da640 1 -- 172.21.15.170:0/3421225493 shutdown_connections 2024-01-25T14:59:16.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.053+0000 7fe34a2da640 1 --2- 172.21.15.170:0/3421225493 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3441017c0 0x7fe344108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.053+0000 7fe34a2da640 1 --2- 172.21.15.170:0/3421225493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe344100e00 0x7fe344101280 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.053+0000 7fe34a2da640 1 --2- 172.21.15.170:0/3421225493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe3440ffc10 0x7fe344100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.053+0000 7fe34a2da640 1 -- 172.21.15.170:0/3421225493 >> 172.21.15.170:0/3421225493 conn(0x7fe3440fb180 msgr2=0x7fe3440fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:16.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.053+0000 7fe34a2da640 1 -- 172.21.15.170:0/3421225493 shutdown_connections 2024-01-25T14:59:16.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.053+0000 7fe34a2da640 1 -- 172.21.15.170:0/3421225493 wait complete. 2024-01-25T14:59:16.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.053+0000 7fe34a2da640 1 Processor -- start 2024-01-25T14:59:16.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.053+0000 7fe34a2da640 1 -- start start 2024-01-25T14:59:16.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe34a2da640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3440ffc10 0x7fe3440689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:16.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe34a2da640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe344100e00 0x7fe34419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:16.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe34a2da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3441017c0 0x7fe34419e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:16.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe34a2da640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34419e800 con 0x7fe3441017c0 2024-01-25T14:59:16.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe34a2da640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34419e970 con 0x7fe3440ffc10 2024-01-25T14:59:16.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe34a2da640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34419eb30 con 0x7fe344100e00 2024-01-25T14:59:16.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe348877640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3441017c0 0x7fe34419e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:16.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe348877640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3441017c0 0x7fe34419e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57088/0 (socket says 172.21.15.170:57088) 2024-01-25T14:59:16.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe348877640 1 -- 172.21.15.170:0/3455853255 learned_addr learned my addr 172.21.15.170:0/3455853255 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:16.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe3437fe640 1 --2- 172.21.15.170:0/3455853255 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe344100e00 0x7fe34419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:16.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe343fff640 1 --2- 172.21.15.170:0/3455853255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3440ffc10 0x7fe3440689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:16.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe348877640 1 -- 172.21.15.170:0/3455853255 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe344100e00 msgr2=0x7fe34419ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:16.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe348877640 1 --2- 172.21.15.170:0/3455853255 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe344100e00 0x7fe34419ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe348877640 1 -- 172.21.15.170:0/3455853255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3440ffc10 msgr2=0x7fe3440689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:16.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe348877640 1 --2- 172.21.15.170:0/3455853255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3440ffc10 0x7fe3440689c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe348877640 1 -- 172.21.15.170:0/3455853255 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe338009560 con 0x7fe3441017c0 2024-01-25T14:59:16.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe348877640 1 --2- 172.21.15.170:0/3455853255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3441017c0 0x7fe34419e020 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00cce0 tx=0x7fe33c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:16.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe3417fa640 1 -- 172.21.15.170:0/3455853255 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c00f450 con 0x7fe3441017c0 2024-01-25T14:59:16.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe3417fa640 1 -- 172.21.15.170:0/3455853255 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe33c00fa70 con 0x7fe3441017c0 2024-01-25T14:59:16.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.054+0000 7fe34a2da640 1 -- 172.21.15.170:0/3455853255 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34419edb0 con 0x7fe3441017c0 2024-01-25T14:59:16.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.055+0000 7fe3417fa640 1 -- 172.21.15.170:0/3455853255 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c018b40 con 0x7fe3441017c0 2024-01-25T14:59:16.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.055+0000 7fe34a2da640 1 -- 172.21.15.170:0/3455853255 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34419f1e0 con 0x7fe3441017c0 2024-01-25T14:59:16.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.056+0000 7fe34a2da640 1 -- 172.21.15.170:0/3455853255 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe344106f30 con 0x7fe3441017c0 2024-01-25T14:59:16.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.056+0000 7fe3417fa640 1 -- 172.21.15.170:0/3455853255 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fe33c00fbe0 con 0x7fe3441017c0 2024-01-25T14:59:16.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.057+0000 7fe3417fa640 1 --2- 172.21.15.170:0/3455853255 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe32c0a12e0 0x7fe32c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:16.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.057+0000 7fe343fff640 1 --2- 172.21.15.170:0/3455853255 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe32c0a12e0 0x7fe32c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:16.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.057+0000 7fe3417fa640 1 -- 172.21.15.170:0/3455853255 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe33c0ccf00 con 0x7fe3441017c0 2024-01-25T14:59:16.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.058+0000 7fe343fff640 1 --2- 172.21.15.170:0/3455853255 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe32c0a12e0 0x7fe32c0a37a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe344100c60 tx=0x7fe334005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:16.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.062+0000 7fe3417fa640 1 -- 172.21.15.170:0/3455853255 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fe33c096820 con 0x7fe3441017c0 2024-01-25T14:59:16.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.235+0000 7fe34a2da640 1 -- 172.21.15.170:0/3455853255 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe34410b720 con 0x7fe3441017c0 2024-01-25T14:59:16.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.236+0000 7fe3417fa640 1 -- 172.21.15.170:0/3455853255 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18466 (secure 0 0 0) 0x7fe33c099e40 con 0x7fe3441017c0 2024-01-25T14:59:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:16.237 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":81,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T14:59:04.723615+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T14:59:16.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.238+0000 7fe34a2da640 1 -- 172.21.15.170:0/3455853255 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe32c0a12e0 msgr2=0x7fe32c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:16.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.238+0000 7fe34a2da640 1 --2- 172.21.15.170:0/3455853255 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe32c0a12e0 0x7fe32c0a37a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe344100c60 tx=0x7fe334005f90 comp rx=0 tx=0).stop 2024-01-25T14:59:16.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.238+0000 7fe34a2da640 1 -- 172.21.15.170:0/3455853255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3441017c0 msgr2=0x7fe34419e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:16.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.238+0000 7fe34a2da640 1 --2- 172.21.15.170:0/3455853255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3441017c0 0x7fe34419e020 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00cce0 tx=0x7fe33c00a620 comp rx=0 tx=0).stop 2024-01-25T14:59:16.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.238+0000 7fe34a2da640 1 -- 172.21.15.170:0/3455853255 shutdown_connections 2024-01-25T14:59:16.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.238+0000 7fe34a2da640 1 --2- 172.21.15.170:0/3455853255 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe32c0a12e0 0x7fe32c0a37a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.238+0000 7fe34a2da640 1 --2- 172.21.15.170:0/3455853255 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe3441017c0 0x7fe34419e020 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.238+0000 7fe34a2da640 1 --2- 172.21.15.170:0/3455853255 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe344100e00 0x7fe34419ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.238+0000 7fe34a2da640 1 --2- 172.21.15.170:0/3455853255 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe3440ffc10 0x7fe3440689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.238+0000 7fe34a2da640 1 -- 172.21.15.170:0/3455853255 >> 172.21.15.170:0/3455853255 conn(0x7fe3440fb180 msgr2=0x7fe344104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:16.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.238+0000 7fe34a2da640 1 -- 172.21.15.170:0/3455853255 shutdown_connections 2024-01-25T14:59:16.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.238+0000 7fe34a2da640 1 -- 172.21.15.170:0/3455853255 wait complete. 2024-01-25T14:59:16.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T14:55:22.432727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T14:59:16.252 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T14:59:16.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.355+0000 7f6b8bf89640 1 -- 172.21.15.170:0/338463610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b840ff5e0 msgr2=0x7f6b840ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:16.358 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.355+0000 7f6b8bf89640 1 --2- 172.21.15.170:0/338463610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b840ff5e0 0x7f6b840ffa00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6b80009ca0 tx=0x7f6b8002c180 comp rx=0 tx=0).stop 2024-01-25T14:59:16.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.355+0000 7f6b8bf89640 1 -- 172.21.15.170:0/338463610 shutdown_connections 2024-01-25T14:59:16.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.355+0000 7f6b8bf89640 1 --2- 172.21.15.170:0/338463610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b841008e0 0x7f6b84100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.355+0000 7f6b8bf89640 1 --2- 172.21.15.170:0/338463610 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b840fff40 0x7f6b841003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.355+0000 7f6b8bf89640 1 --2- 172.21.15.170:0/338463610 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b840ff5e0 0x7f6b840ffa00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.355+0000 7f6b8bf89640 1 -- 172.21.15.170:0/338463610 >> 172.21.15.170:0/338463610 conn(0x7f6b840fb180 msgr2=0x7f6b840fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:16.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.356+0000 7f6b8bf89640 1 -- 172.21.15.170:0/338463610 shutdown_connections 2024-01-25T14:59:16.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.356+0000 7f6b8bf89640 1 -- 172.21.15.170:0/338463610 wait complete. 2024-01-25T14:59:16.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.356+0000 7f6b8bf89640 1 Processor -- start 2024-01-25T14:59:16.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.356+0000 7f6b8bf89640 1 -- start start 2024-01-25T14:59:16.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.356+0000 7f6b8bf89640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b840ff5e0 0x7f6b84198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:16.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.356+0000 7f6b8bf89640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b840fff40 0x7f6b84199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:16.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.356+0000 7f6b8bf89640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b841008e0 0x7f6b841a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:16.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.356+0000 7f6b8bf89640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b841a0a10 con 0x7f6b840fff40 2024-01-25T14:59:16.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.356+0000 7f6b8bf89640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b841a0b80 con 0x7f6b840ff5e0 2024-01-25T14:59:16.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.356+0000 7f6b8bf89640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b841a0d40 con 0x7f6b841008e0 2024-01-25T14:59:16.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.356+0000 7f6b89524640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b840fff40 0x7f6b84199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:16.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.356+0000 7f6b89524640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b840fff40 0x7f6b84199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57102/0 (socket says 172.21.15.170:57102) 2024-01-25T14:59:16.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.356+0000 7f6b89524640 1 -- 172.21.15.170:0/1136643448 learned_addr learned my addr 172.21.15.170:0/1136643448 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:16.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.356+0000 7f6b8a526640 1 --2- 172.21.15.170:0/1136643448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b841008e0 0x7f6b841a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:16.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.357+0000 7f6b89524640 1 -- 172.21.15.170:0/1136643448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b841008e0 msgr2=0x7f6b841a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:16.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.357+0000 7f6b89524640 1 --2- 172.21.15.170:0/1136643448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b841008e0 0x7f6b841a04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.357+0000 7f6b89524640 1 -- 172.21.15.170:0/1136643448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b840ff5e0 msgr2=0x7f6b84198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:16.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.357+0000 7f6b89524640 1 --2- 172.21.15.170:0/1136643448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b840ff5e0 0x7f6b84198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.357+0000 7f6b89524640 1 -- 172.21.15.170:0/1136643448 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b80009900 con 0x7f6b840fff40 2024-01-25T14:59:16.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.357+0000 7f6b89524640 1 --2- 172.21.15.170:0/1136643448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b840fff40 0x7f6b84199460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400d770 tx=0x7f6b7400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:16.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.357+0000 7f6b7affd640 1 -- 172.21.15.170:0/1136643448 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74009c30 con 0x7f6b840fff40 2024-01-25T14:59:16.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.357+0000 7f6b7affd640 1 -- 172.21.15.170:0/1136643448 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b7400de80 con 0x7f6b840fff40 2024-01-25T14:59:16.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.357+0000 7f6b8bf89640 1 -- 172.21.15.170:0/1136643448 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b841a0fc0 con 0x7f6b840fff40 2024-01-25T14:59:16.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.357+0000 7f6b7affd640 1 -- 172.21.15.170:0/1136643448 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74004de0 con 0x7f6b840fff40 2024-01-25T14:59:16.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.357+0000 7f6b8bf89640 1 -- 172.21.15.170:0/1136643448 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b841a1450 con 0x7f6b840fff40 2024-01-25T14:59:16.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.358+0000 7f6b8bf89640 1 -- 172.21.15.170:0/1136643448 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8410a650 con 0x7f6b840fff40 2024-01-25T14:59:16.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.359+0000 7f6b7affd640 1 -- 172.21.15.170:0/1136643448 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f6b74004f40 con 0x7f6b840fff40 2024-01-25T14:59:16.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.359+0000 7f6b7affd640 1 --2- 172.21.15.170:0/1136643448 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6b700a12e0 0x7f6b700a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:16.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.359+0000 7f6b89d25640 1 --2- 172.21.15.170:0/1136643448 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6b700a12e0 0x7f6b700a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:16.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.360+0000 7f6b7affd640 1 -- 172.21.15.170:0/1136643448 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6b740cc140 con 0x7f6b840fff40 2024-01-25T14:59:16.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.360+0000 7f6b89d25640 1 --2- 172.21.15.170:0/1136643448 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6b700a12e0 0x7f6b700a37a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6b800098d0 tx=0x7f6b800326b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:16.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.364+0000 7f6b7affd640 1 -- 172.21.15.170:0/1136643448 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f6b74095a60 con 0x7f6b840fff40 2024-01-25T14:59:16.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:16 smithi191 ceph-mon[36347]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi170=a;smithi170=d;smithi170=g;smithi170=j;smithi186=b;smithi186=e;smithi186=h;smithi186=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:59:16.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:16 smithi191 ceph-mon[36347]: Saving service mds.all spec with placement smithi170=a;smithi170=d;smithi170=g;smithi170=j;smithi186=b;smithi186=e;smithi186=h;smithi186=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-01-25T14:59:16.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:16 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:16.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:16 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:59:16.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:16 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:16.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:16 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:16.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:16 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:16.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:16 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:16.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:16 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3455853255' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T14:59:16.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.535+0000 7f6b8bf89640 1 -- 172.21.15.170:0/1136643448 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b8402cb10 con 0x7f6b840fff40 2024-01-25T14:59:16.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.536+0000 7f6b7affd640 1 -- 172.21.15.170:0/1136643448 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b74099080 con 0x7f6b840fff40 2024-01-25T14:59:16.537 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 1 2024-01-25T14:59:16.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.538+0000 7f6b8bf89640 1 -- 172.21.15.170:0/1136643448 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6b700a12e0 msgr2=0x7f6b700a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:16.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.538+0000 7f6b8bf89640 1 --2- 172.21.15.170:0/1136643448 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6b700a12e0 0x7f6b700a37a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6b800098d0 tx=0x7f6b800326b0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.538+0000 7f6b8bf89640 1 -- 172.21.15.170:0/1136643448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b840fff40 msgr2=0x7f6b84199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:16.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.538+0000 7f6b8bf89640 1 --2- 172.21.15.170:0/1136643448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b840fff40 0x7f6b84199460 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400d770 tx=0x7f6b7400dc30 comp rx=0 tx=0).stop 2024-01-25T14:59:16.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.538+0000 7f6b8bf89640 1 -- 172.21.15.170:0/1136643448 shutdown_connections 2024-01-25T14:59:16.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.538+0000 7f6b8bf89640 1 --2- 172.21.15.170:0/1136643448 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6b700a12e0 0x7f6b700a37a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.538+0000 7f6b8bf89640 1 --2- 172.21.15.170:0/1136643448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6b841008e0 0x7f6b841a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.538+0000 7f6b8bf89640 1 --2- 172.21.15.170:0/1136643448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6b840fff40 0x7f6b84199460 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.538+0000 7f6b8bf89640 1 --2- 172.21.15.170:0/1136643448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b840ff5e0 0x7f6b84198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.538+0000 7f6b8bf89640 1 -- 172.21.15.170:0/1136643448 >> 172.21.15.170:0/1136643448 conn(0x7f6b840fb180 msgr2=0x7f6b840fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:16.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.538+0000 7f6b8bf89640 1 -- 172.21.15.170:0/1136643448 shutdown_connections 2024-01-25T14:59:16.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.538+0000 7f6b8bf89640 1 -- 172.21.15.170:0/1136643448 wait complete. 2024-01-25T14:59:16.549 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:16 smithi170 ceph-mon[31899]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi170=a;smithi170=d;smithi170=g;smithi170=j;smithi186=b;smithi186=e;smithi186=h;smithi186=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:59:16.549 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:16 smithi170 ceph-mon[31899]: Saving service mds.all spec with placement smithi170=a;smithi170=d;smithi170=g;smithi170=j;smithi186=b;smithi186=e;smithi186=h;smithi186=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-01-25T14:59:16.549 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:16 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:16.549 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:16 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:59:16.549 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:16 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:16.549 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:16 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:16.549 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:16 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:16.549 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:16 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:16.549 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:16 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3455853255' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T14:59:16.550 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T14:59:16.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:16 smithi186 ceph-mon[35697]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi170=a;smithi170=d;smithi170=g;smithi170=j;smithi186=b;smithi186=e;smithi186=h;smithi186=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T14:59:16.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:16 smithi186 ceph-mon[35697]: Saving service mds.all spec with placement smithi170=a;smithi170=d;smithi170=g;smithi170=j;smithi186=b;smithi186=e;smithi186=h;smithi186=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-01-25T14:59:16.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:16 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:16.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:16 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:59:16.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:16 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:16.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:16 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:16.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:16 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:16.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:16 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:16.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:16 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3455853255' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T14:59:16.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.652+0000 7f9280831640 1 -- 172.21.15.170:0/4184295466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f927c100590 msgr2=0x7f927c100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:16.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.653+0000 7f9280831640 1 --2- 172.21.15.170:0/4184295466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f927c100590 0x7f927c100a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f926c00aa10 tx=0x7f926c02cf70 comp rx=0 tx=0).stop 2024-01-25T14:59:16.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.653+0000 7f9280831640 1 -- 172.21.15.170:0/4184295466 shutdown_connections 2024-01-25T14:59:16.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.653+0000 7f9280831640 1 --2- 172.21.15.170:0/4184295466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f927c100f50 0x7f927c1077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.653+0000 7f9280831640 1 --2- 172.21.15.170:0/4184295466 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f927c100590 0x7f927c100a10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.653+0000 7f9280831640 1 --2- 172.21.15.170:0/4184295466 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f927c0ff3a0 0x7f927c0ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.653+0000 7f9280831640 1 -- 172.21.15.170:0/4184295466 >> 172.21.15.170:0/4184295466 conn(0x7f927c0fa910 msgr2=0x7f927c0fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:16.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.653+0000 7f9280831640 1 -- 172.21.15.170:0/4184295466 shutdown_connections 2024-01-25T14:59:16.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.653+0000 7f9280831640 1 -- 172.21.15.170:0/4184295466 wait complete. 2024-01-25T14:59:16.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.653+0000 7f9280831640 1 Processor -- start 2024-01-25T14:59:16.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.653+0000 7f9280831640 1 -- start start 2024-01-25T14:59:16.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f9280831640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f927c0ff3a0 0x7f927c196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:16.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f9280831640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f927c100590 0x7f927c197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:16.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f9280831640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f927c100f50 0x7f927c19e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:16.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f9280831640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c19e940 con 0x7f927c100f50 2024-01-25T14:59:16.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f9280831640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c19eab0 con 0x7f927c100590 2024-01-25T14:59:16.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f9280831640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c19ec70 con 0x7f927c0ff3a0 2024-01-25T14:59:16.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f927ad9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f927c100f50 0x7f927c19e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:16.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f927ad9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f927c100f50 0x7f927c19e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57108/0 (socket says 172.21.15.170:57108) 2024-01-25T14:59:16.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f927ad9d640 1 -- 172.21.15.170:0/3701672135 learned_addr learned my addr 172.21.15.170:0/3701672135 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:16.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f927a59c640 1 --2- 172.21.15.170:0/3701672135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f927c0ff3a0 0x7f927c196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:16.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f9279d9b640 1 --2- 172.21.15.170:0/3701672135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f927c100590 0x7f927c197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:16.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f927ad9d640 1 -- 172.21.15.170:0/3701672135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f927c0ff3a0 msgr2=0x7f927c196e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:16.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f927ad9d640 1 --2- 172.21.15.170:0/3701672135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f927c0ff3a0 0x7f927c196e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f927ad9d640 1 -- 172.21.15.170:0/3701672135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f927c100590 msgr2=0x7f927c197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:16.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f927ad9d640 1 --2- 172.21.15.170:0/3701672135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f927c100590 0x7f927c197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f927ad9d640 1 -- 172.21.15.170:0/3701672135 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c00a670 con 0x7f927c100f50 2024-01-25T14:59:16.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f9279d9b640 1 --2- 172.21.15.170:0/3701672135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f927c100590 0x7f927c197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T14:59:16.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f927ad9d640 1 --2- 172.21.15.170:0/3701672135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f927c100f50 0x7f927c19e400 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f927400cad0 tx=0x7f927400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:16.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f92737fe640 1 -- 172.21.15.170:0/3701672135 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927400ae20 con 0x7f927c100f50 2024-01-25T14:59:16.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f92737fe640 1 -- 172.21.15.170:0/3701672135 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9274005020 con 0x7f927c100f50 2024-01-25T14:59:16.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f9280831640 1 -- 172.21.15.170:0/3701672135 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927c19ef50 con 0x7f927c100f50 2024-01-25T14:59:16.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f92737fe640 1 -- 172.21.15.170:0/3701672135 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927400f6b0 con 0x7f927c100f50 2024-01-25T14:59:16.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.654+0000 7f9280831640 1 -- 172.21.15.170:0/3701672135 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c19f380 con 0x7f927c100f50 2024-01-25T14:59:16.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.655+0000 7f9280831640 1 -- 172.21.15.170:0/3701672135 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927c106760 con 0x7f927c100f50 2024-01-25T14:59:16.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.657+0000 7f92737fe640 1 -- 172.21.15.170:0/3701672135 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f9274005190 con 0x7f927c100f50 2024-01-25T14:59:16.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.657+0000 7f92737fe640 1 --2- 172.21.15.170:0/3701672135 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f92680a12e0 0x7f92680a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:16.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.657+0000 7f927a59c640 1 --2- 172.21.15.170:0/3701672135 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f92680a12e0 0x7f92680a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:16.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.657+0000 7f92737fe640 1 -- 172.21.15.170:0/3701672135 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f92740cc770 con 0x7f927c100f50 2024-01-25T14:59:16.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.658+0000 7f927a59c640 1 --2- 172.21.15.170:0/3701672135 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f92680a12e0 0x7f92680a37a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9264005fd0 tx=0x7f926400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:16.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.662+0000 7f92737fe640 1 -- 172.21.15.170:0/3701672135 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f9274096090 con 0x7f927c100f50 2024-01-25T14:59:16.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.868+0000 7f9280831640 1 -- 172.21.15.170:0/3701672135 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f927c02cad0 con 0x7f927c100f50 2024-01-25T14:59:16.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.869+0000 7f92737fe640 1 -- 172.21.15.170:0/3701672135 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f92740996b0 con 0x7f927c100f50 2024-01-25T14:59:16.870 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:16.870 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-01-25T14:59:16.870 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 1 2024-01-25T14:59:16.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.870+0000 7f9280831640 1 -- 172.21.15.170:0/3701672135 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f92680a12e0 msgr2=0x7f92680a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:16.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.870+0000 7f9280831640 1 --2- 172.21.15.170:0/3701672135 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f92680a12e0 0x7f92680a37a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9264005fd0 tx=0x7f926400b390 comp rx=0 tx=0).stop 2024-01-25T14:59:16.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.870+0000 7f9280831640 1 -- 172.21.15.170:0/3701672135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f927c100f50 msgr2=0x7f927c19e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:16.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.870+0000 7f9280831640 1 --2- 172.21.15.170:0/3701672135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f927c100f50 0x7f927c19e400 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f927400cad0 tx=0x7f927400cf90 comp rx=0 tx=0).stop 2024-01-25T14:59:16.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.871+0000 7f9280831640 1 -- 172.21.15.170:0/3701672135 shutdown_connections 2024-01-25T14:59:16.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.871+0000 7f9280831640 1 --2- 172.21.15.170:0/3701672135 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f92680a12e0 0x7f92680a37a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.871+0000 7f9280831640 1 --2- 172.21.15.170:0/3701672135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f927c100590 0x7f927c197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.871+0000 7f9280831640 1 --2- 172.21.15.170:0/3701672135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f927c100f50 0x7f927c19e400 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.871+0000 7f9280831640 1 --2- 172.21.15.170:0/3701672135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f927c0ff3a0 0x7f927c196e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:16.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.871+0000 7f9280831640 1 -- 172.21.15.170:0/3701672135 >> 172.21.15.170:0/3701672135 conn(0x7f927c0fa910 msgr2=0x7f927c103930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:16.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.871+0000 7f9280831640 1 -- 172.21.15.170:0/3701672135 shutdown_connections 2024-01-25T14:59:16.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:16.871+0000 7f9280831640 1 -- 172.21.15.170:0/3701672135 wait complete. 2024-01-25T14:59:17.400 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:17 smithi191 ceph-mon[36347]: Deploying daemon mds.l on smithi191 2024-01-25T14:59:17.400 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:17 smithi191 ceph-mon[36347]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:17.400 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:17 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1136643448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T14:59:17.400 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:17 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3701672135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:17.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:17 smithi186 ceph-mon[35697]: Deploying daemon mds.l on smithi191 2024-01-25T14:59:17.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:17 smithi186 ceph-mon[35697]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:17.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:17 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1136643448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T14:59:17.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:17 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3701672135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:17.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:17 smithi170 ceph-mon[31899]: Deploying daemon mds.l on smithi191 2024-01-25T14:59:17.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:17 smithi170 ceph-mon[31899]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:17.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:17 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1136643448' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T14:59:17.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:17 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3701672135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:17.984 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 14:59:17 smithi191 podman[66879]: 2024-01-25 14:59:17.870258565 +0000 UTC m=+0.117550470 container create 1375f367e3b29396c02971de5091d6a3fc6a7c0034bee65d0a8cc6304d039132 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-01-25T14:59:18.483 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 14:59:18 smithi191 podman[66879]: 2024-01-25 14:59:18.114808566 +0000 UTC m=+0.362100477 container init 1375f367e3b29396c02971de5091d6a3fc6a7c0034bee65d0a8cc6304d039132 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-01-25T14:59:18.484 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 14:59:18 smithi191 podman[66879]: 2024-01-25 14:59:18.117469653 +0000 UTC m=+0.364761565 container start 1375f367e3b29396c02971de5091d6a3fc6a7c0034bee65d0a8cc6304d039132 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-01-25T14:59:18.484 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 14:59:18 smithi191 ceph-mds[66897]: -- 172.21.15.191:0/3712425866 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5612712ff520 con 0x5612712d5000 2024-01-25T14:59:18.484 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 14:59:18 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: starting mds.l at 2024-01-25T14:59:18.484 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 14:59:18 smithi191 bash[66879]: 1375f367e3b29396c02971de5091d6a3fc6a7c0034bee65d0a8cc6304d039132 2024-01-25T14:59:18.484 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 14:59:18 smithi191 systemd[1]: Started Ceph mds.l for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:59:18.883 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T14:59:18.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.996+0000 7f0bc7c9b640 1 -- 172.21.15.170:0/3470953212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bc0101fd0 msgr2=0x7f0bc0102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:18.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.996+0000 7f0bc7c9b640 1 --2- 172.21.15.170:0/3470953212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bc0101fd0 0x7f0bc0102450 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009900 tx=0x7f0bb402bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:18.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.996+0000 7f0bc7c9b640 1 -- 172.21.15.170:0/3470953212 shutdown_connections 2024-01-25T14:59:18.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.996+0000 7f0bc7c9b640 1 --2- 172.21.15.170:0/3470953212 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0bc0102990 0x7f0bc0109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:19.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.996+0000 7f0bc7c9b640 1 --2- 172.21.15.170:0/3470953212 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bc0101fd0 0x7f0bc0102450 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:19.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.996+0000 7f0bc7c9b640 1 --2- 172.21.15.170:0/3470953212 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00ff000 0x7f0bc00ff420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:19.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.996+0000 7f0bc7c9b640 1 -- 172.21.15.170:0/3470953212 >> 172.21.15.170:0/3470953212 conn(0x7f0bc00fa930 msgr2=0x7f0bc00fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:19.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.996+0000 7f0bc7c9b640 1 -- 172.21.15.170:0/3470953212 shutdown_connections 2024-01-25T14:59:19.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.996+0000 7f0bc7c9b640 1 -- 172.21.15.170:0/3470953212 wait complete. 2024-01-25T14:59:19.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc7c9b640 1 Processor -- start 2024-01-25T14:59:19.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc7c9b640 1 -- start start 2024-01-25T14:59:19.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc7c9b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00ff000 0x7f0bc0101940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:19.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc7c9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0bc0101fd0 0x7f0bc00fff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:19.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc7c9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bc0102990 0x7f0bc01004c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:19.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc7c9b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc0100c20 con 0x7f0bc0102990 2024-01-25T14:59:19.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc7c9b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc0100d90 con 0x7f0bc00ff000 2024-01-25T14:59:19.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc7c9b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc01a0d10 con 0x7f0bc0101fd0 2024-01-25T14:59:19.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc6238640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bc0102990 0x7f0bc01004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:19.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc6238640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bc0102990 0x7f0bc01004c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57122/0 (socket says 172.21.15.170:57122) 2024-01-25T14:59:19.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc6238640 1 -- 172.21.15.170:0/3791354315 learned_addr learned my addr 172.21.15.170:0/3791354315 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:19.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc5236640 1 --2- 172.21.15.170:0/3791354315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0bc0101fd0 0x7f0bc00fff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:19.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc5a37640 1 --2- 172.21.15.170:0/3791354315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00ff000 0x7f0bc0101940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:19.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc6238640 1 -- 172.21.15.170:0/3791354315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0bc0101fd0 msgr2=0x7f0bc00fff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:19.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc6238640 1 --2- 172.21.15.170:0/3791354315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0bc0101fd0 0x7f0bc00fff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:19.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc6238640 1 -- 172.21.15.170:0/3791354315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00ff000 msgr2=0x7f0bc0101940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:19.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc6238640 1 --2- 172.21.15.170:0/3791354315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00ff000 0x7f0bc0101940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:19.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.997+0000 7f0bc6238640 1 -- 172.21.15.170:0/3791354315 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb4009560 con 0x7f0bc0102990 2024-01-25T14:59:19.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.998+0000 7f0bc6238640 1 --2- 172.21.15.170:0/3791354315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bc0102990 0x7f0bc01004c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000d780 tx=0x7f0bb000dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:19.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.998+0000 7f0bbeffd640 1 -- 172.21.15.170:0/3791354315 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0009bd0 con 0x7f0bc0102990 2024-01-25T14:59:19.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.998+0000 7f0bbeffd640 1 -- 172.21.15.170:0/3791354315 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bb000de90 con 0x7f0bc0102990 2024-01-25T14:59:19.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.998+0000 7f0bc7c9b640 1 -- 172.21.15.170:0/3791354315 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc01a0fc0 con 0x7f0bc0102990 2024-01-25T14:59:19.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.998+0000 7f0bbeffd640 1 -- 172.21.15.170:0/3791354315 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0004e00 con 0x7f0bc0102990 2024-01-25T14:59:19.002 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.998+0000 7f0bc7c9b640 1 -- 172.21.15.170:0/3791354315 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc01a1440 con 0x7f0bc0102990 2024-01-25T14:59:19.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:18.999+0000 7f0bc7c9b640 1 -- 172.21.15.170:0/3791354315 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc0108180 con 0x7f0bc0102990 2024-01-25T14:59:19.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.000+0000 7f0bbeffd640 1 -- 172.21.15.170:0/3791354315 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f0bb0004f60 con 0x7f0bc0102990 2024-01-25T14:59:19.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.001+0000 7f0bbeffd640 1 --2- 172.21.15.170:0/3791354315 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0ba80a1360 0x7f0ba80a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:19.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.001+0000 7f0bc5a37640 1 --2- 172.21.15.170:0/3791354315 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0ba80a1360 0x7f0ba80a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:19.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.001+0000 7f0bbeffd640 1 -- 172.21.15.170:0/3791354315 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0bb00cc420 con 0x7f0bc0102990 2024-01-25T14:59:19.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.001+0000 7f0bc5a37640 1 --2- 172.21.15.170:0/3791354315 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0ba80a1360 0x7f0ba80a3820 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0069160 tx=0x7f0bb8009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:19.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.004+0000 7f0bbeffd640 1 -- 172.21.15.170:0/3791354315 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f0bb0095d50 con 0x7f0bc0102990 2024-01-25T14:59:19.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.215+0000 7f0bc7c9b640 1 -- 172.21.15.170:0/3791354315 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bc010c7d0 con 0x7f0bc0102990 2024-01-25T14:59:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.215+0000 7f0bbeffd640 1 -- 172.21.15.170:0/3791354315 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1325 (secure 0 0 0) 0x7f0bb0020540 con 0x7f0bc0102990 2024-01-25T14:59:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:19.216 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-25T14:59:19.216 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 2 2024-01-25T14:59:19.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.217+0000 7f0bc7c9b640 1 -- 172.21.15.170:0/3791354315 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0ba80a1360 msgr2=0x7f0ba80a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.217+0000 7f0bc7c9b640 1 --2- 172.21.15.170:0/3791354315 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0ba80a1360 0x7f0ba80a3820 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0069160 tx=0x7f0bb8009500 comp rx=0 tx=0).stop 2024-01-25T14:59:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.217+0000 7f0bc7c9b640 1 -- 172.21.15.170:0/3791354315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bc0102990 msgr2=0x7f0bc01004c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.217+0000 7f0bc7c9b640 1 --2- 172.21.15.170:0/3791354315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bc0102990 0x7f0bc01004c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000d780 tx=0x7f0bb000dc40 comp rx=0 tx=0).stop 2024-01-25T14:59:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.218+0000 7f0bc7c9b640 1 -- 172.21.15.170:0/3791354315 shutdown_connections 2024-01-25T14:59:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.218+0000 7f0bc7c9b640 1 --2- 172.21.15.170:0/3791354315 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0ba80a1360 0x7f0ba80a3820 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.218+0000 7f0bc7c9b640 1 --2- 172.21.15.170:0/3791354315 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0bc0102990 0x7f0bc01004c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.218+0000 7f0bc7c9b640 1 --2- 172.21.15.170:0/3791354315 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0bc0101fd0 0x7f0bc00fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.218+0000 7f0bc7c9b640 1 --2- 172.21.15.170:0/3791354315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0bc00ff000 0x7f0bc0101940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.218+0000 7f0bc7c9b640 1 -- 172.21.15.170:0/3791354315 >> 172.21.15.170:0/3791354315 conn(0x7f0bc00fa930 msgr2=0x7f0bc0105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.218+0000 7f0bc7c9b640 1 -- 172.21.15.170:0/3791354315 shutdown_connections 2024-01-25T14:59:19.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:19.218+0000 7f0bc7c9b640 1 -- 172.21.15.170:0/3791354315 wait complete. 2024-01-25T14:59:19.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:19 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] up:boot 2024-01-25T14:59:19.272 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:19 smithi186 ceph-mon[35697]: fsmap 1 up:standby 2024-01-25T14:59:19.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:19 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-01-25T14:59:19.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:19 smithi186 ceph-mon[35697]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:19.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:19 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:19.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:19 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:19.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:19 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:19.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:19 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:19.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:19 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:19.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:19 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:19.273 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:19 smithi186 ceph-mon[35697]: Deploying daemon mds.k on smithi186 2024-01-25T14:59:19.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:19 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] up:boot 2024-01-25T14:59:19.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:19 smithi170 ceph-mon[31899]: fsmap 1 up:standby 2024-01-25T14:59:19.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-01-25T14:59:19.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:19 smithi170 ceph-mon[31899]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:19.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:19.430 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:19.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:19.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:19.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:19.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:19 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:19.431 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:19 smithi170 ceph-mon[31899]: Deploying daemon mds.k on smithi186 2024-01-25T14:59:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:19 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] up:boot 2024-01-25T14:59:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:19 smithi191 ceph-mon[36347]: fsmap 1 up:standby 2024-01-25T14:59:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:19 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-01-25T14:59:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:19 smithi191 ceph-mon[36347]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:19 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:19 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:19 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:19 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:19.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:19 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:19.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:19 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:19.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:19 smithi191 ceph-mon[36347]: Deploying daemon mds.k on smithi186 2024-01-25T14:59:20.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:20 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3791354315' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:20.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:20 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3791354315' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:20.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:20 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3791354315' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:21.171 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 14:59:21 smithi186 systemd[1]: Started Ceph mds.k for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:59:21.232 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T14:59:21.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.345+0000 7f4d235ce640 1 -- 172.21.15.170:0/1028585352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1c1040c0 msgr2=0x7f4d1c1064b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:21.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.345+0000 7f4d235ce640 1 --2- 172.21.15.170:0/1028585352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1c1040c0 0x7f4d1c1064b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009900 tx=0x7f4d0c02bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:21.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.345+0000 7f4d235ce640 1 -- 172.21.15.170:0/1028585352 shutdown_connections 2024-01-25T14:59:21.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.345+0000 7f4d235ce640 1 --2- 172.21.15.170:0/1028585352 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d1c1069f0 0x7f4d1c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:21.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.345+0000 7f4d235ce640 1 --2- 172.21.15.170:0/1028585352 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1c1040c0 0x7f4d1c1064b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:21.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.345+0000 7f4d235ce640 1 --2- 172.21.15.170:0/1028585352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d1c101790 0x7f4d1c103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:21.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.345+0000 7f4d235ce640 1 -- 172.21.15.170:0/1028585352 >> 172.21.15.170:0/1028585352 conn(0x7f4d1c0fb180 msgr2=0x7f4d1c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:21.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.345+0000 7f4d235ce640 1 -- 172.21.15.170:0/1028585352 shutdown_connections 2024-01-25T14:59:21.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.345+0000 7f4d235ce640 1 -- 172.21.15.170:0/1028585352 wait complete. 2024-01-25T14:59:21.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d235ce640 1 Processor -- start 2024-01-25T14:59:21.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d235ce640 1 -- start start 2024-01-25T14:59:21.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d235ce640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d1c101790 0x7f4d1c196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:21.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d235ce640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d1c1040c0 0x7f4d1c197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:21.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d235ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1c1069f0 0x7f4d1c19e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:21.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d235ce640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c19e7f0 con 0x7f4d1c1069f0 2024-01-25T14:59:21.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d235ce640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c19e960 con 0x7f4d1c1040c0 2024-01-25T14:59:21.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d235ce640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c19eb20 con 0x7f4d1c101790 2024-01-25T14:59:21.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d21b6b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1c1069f0 0x7f4d1c19e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:21.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d21b6b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1c1069f0 0x7f4d1c19e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57150/0 (socket says 172.21.15.170:57150) 2024-01-25T14:59:21.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d21b6b640 1 -- 172.21.15.170:0/4228334813 learned_addr learned my addr 172.21.15.170:0/4228334813 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:21.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d2136a640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d1c101790 0x7f4d1c196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:21.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d20b69640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d1c1040c0 0x7f4d1c197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:21.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d21b6b640 1 -- 172.21.15.170:0/4228334813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d1c101790 msgr2=0x7f4d1c196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:21.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d21b6b640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d1c101790 0x7f4d1c196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:21.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d21b6b640 1 -- 172.21.15.170:0/4228334813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d1c1040c0 msgr2=0x7f4d1c197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:21.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d21b6b640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d1c1040c0 0x7f4d1c197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:21.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d21b6b640 1 -- 172.21.15.170:0/4228334813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c009560 con 0x7f4d1c1069f0 2024-01-25T14:59:21.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d2136a640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d1c101790 0x7f4d1c196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T14:59:21.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d20b69640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d1c1040c0 0x7f4d1c197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T14:59:21.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d21b6b640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1c1069f0 0x7f4d1c19e280 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400eb10 tx=0x7f4d1400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:21.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d127fc640 1 -- 172.21.15.170:0/4228334813 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d14004b20 con 0x7f4d1c1069f0 2024-01-25T14:59:21.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d127fc640 1 -- 172.21.15.170:0/4228334813 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d14004c80 con 0x7f4d1c1069f0 2024-01-25T14:59:21.351 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d235ce640 1 -- 172.21.15.170:0/4228334813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1c19ee00 con 0x7f4d1c1069f0 2024-01-25T14:59:21.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.346+0000 7f4d127fc640 1 -- 172.21.15.170:0/4228334813 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d14010690 con 0x7f4d1c1069f0 2024-01-25T14:59:21.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.347+0000 7f4d235ce640 1 -- 172.21.15.170:0/4228334813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1c19f280 con 0x7f4d1c1069f0 2024-01-25T14:59:21.352 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.347+0000 7f4d235ce640 1 -- 172.21.15.170:0/4228334813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1c0fcc70 con 0x7f4d1c1069f0 2024-01-25T14:59:21.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.349+0000 7f4d127fc640 1 -- 172.21.15.170:0/4228334813 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f4d14004fd0 con 0x7f4d1c1069f0 2024-01-25T14:59:21.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.349+0000 7f4d127fc640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d080a12e0 0x7f4d080a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:21.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.349+0000 7f4d127fc640 1 -- 172.21.15.170:0/4228334813 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4d14014070 con 0x7f4d1c1069f0 2024-01-25T14:59:21.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.349+0000 7f4d2136a640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d080a12e0 0x7f4d080a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:21.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.350+0000 7f4d2136a640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d080a12e0 0x7f4d080a37a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4d18005fd0 tx=0x7f4d18005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:21.354 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.353+0000 7f4d127fc640 1 -- 172.21.15.170:0/4228334813 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f4d14096850 con 0x7f4d1c1069f0 2024-01-25T14:59:21.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:21 smithi191 ceph-mon[36347]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:21.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.568+0000 7f4d235ce640 1 -- 172.21.15.170:0/4228334813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d1c10c5d0 con 0x7f4d1c1069f0 2024-01-25T14:59:21.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.569+0000 7f4d127fc640 1 -- 172.21.15.170:0/4228334813 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2119 (secure 0 0 0) 0x7f4d14098780 con 0x7f4d1c1069f0 2024-01-25T14:59:21.570 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:21.570 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-25T14:59:21.570 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 3 2024-01-25T14:59:21.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.571+0000 7f4d235ce640 1 -- 172.21.15.170:0/4228334813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d080a12e0 msgr2=0x7f4d080a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:21.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.571+0000 7f4d235ce640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d080a12e0 0x7f4d080a37a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4d18005fd0 tx=0x7f4d18005850 comp rx=0 tx=0).stop 2024-01-25T14:59:21.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.571+0000 7f4d235ce640 1 -- 172.21.15.170:0/4228334813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1c1069f0 msgr2=0x7f4d1c19e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:21.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.571+0000 7f4d235ce640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1c1069f0 0x7f4d1c19e280 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400eb10 tx=0x7f4d1400c2d0 comp rx=0 tx=0).stop 2024-01-25T14:59:21.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.571+0000 7f4d235ce640 1 -- 172.21.15.170:0/4228334813 shutdown_connections 2024-01-25T14:59:21.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.571+0000 7f4d235ce640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d080a12e0 0x7f4d080a37a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:21.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.571+0000 7f4d235ce640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d1c1040c0 0x7f4d1c197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:21.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.571+0000 7f4d235ce640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d1c1069f0 0x7f4d1c19e280 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:21.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.571+0000 7f4d235ce640 1 --2- 172.21.15.170:0/4228334813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d1c101790 0x7f4d1c196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:21.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.571+0000 7f4d235ce640 1 -- 172.21.15.170:0/4228334813 >> 172.21.15.170:0/4228334813 conn(0x7f4d1c0fb180 msgr2=0x7f4d1c102210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:21.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.571+0000 7f4d235ce640 1 -- 172.21.15.170:0/4228334813 shutdown_connections 2024-01-25T14:59:21.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:21.571+0000 7f4d235ce640 1 -- 172.21.15.170:0/4228334813 wait complete. 2024-01-25T14:59:21.582 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:21 smithi170 ceph-mon[31899]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:21.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:21 smithi186 ceph-mon[35697]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:22.438 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:22 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] up:boot 2024-01-25T14:59:22.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:22 smithi186 ceph-mon[35697]: fsmap 2 up:standby 2024-01-25T14:59:22.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:22 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-01-25T14:59:22.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:22 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:22.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:22 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:22.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:22 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:22.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:22 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:22.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:22 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:22.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:22 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:22.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:22 smithi186 ceph-mon[35697]: Deploying daemon mds.j on smithi170 2024-01-25T14:59:22.439 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:22 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/4228334813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:22.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:22 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] up:boot 2024-01-25T14:59:22.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:22 smithi191 ceph-mon[36347]: fsmap 2 up:standby 2024-01-25T14:59:22.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:22 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-01-25T14:59:22.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:22 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:22.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:22 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:22.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:22 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:22.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:22 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:22.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:22 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:22.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:22 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:22.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:22 smithi191 ceph-mon[36347]: Deploying daemon mds.j on smithi170 2024-01-25T14:59:22.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:22 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/4228334813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:22.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:22 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] up:boot 2024-01-25T14:59:22.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:22 smithi170 ceph-mon[31899]: fsmap 2 up:standby 2024-01-25T14:59:22.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:22 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-01-25T14:59:22.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:22 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:22.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:22 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:22.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:22 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:22.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:22 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:22.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:22 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:22.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:22 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:22.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:22 smithi170 ceph-mon[31899]: Deploying daemon mds.j on smithi170 2024-01-25T14:59:22.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:22 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/4228334813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:23.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:23 smithi191 ceph-mon[36347]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:23.555 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:23 smithi170 ceph-mon[31899]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:23.556 INFO:journalctl@ceph.mds.j.smithi170.stdout:Jan 25 14:59:23 smithi170 systemd[1]: Starting Ceph mds.j for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T14:59:23.584 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T14:59:23.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:23 smithi186 ceph-mon[35697]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:23.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 -- 172.21.15.170:0/3545692219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d9c1017e0 msgr2=0x7f8d9c108070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:23.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 --2- 172.21.15.170:0/3545692219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d9c1017e0 0x7f8d9c108070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8d94009ca0 tx=0x7f8d9402c0f0 comp rx=0 tx=0).stop 2024-01-25T14:59:23.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 -- 172.21.15.170:0/3545692219 shutdown_connections 2024-01-25T14:59:23.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 --2- 172.21.15.170:0/3545692219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d9c100e20 0x7f8d9c1012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:23.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 --2- 172.21.15.170:0/3545692219 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d9c1017e0 0x7f8d9c108070 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:23.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 --2- 172.21.15.170:0/3545692219 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d9c0ffc30 0x7f8d9c100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:23.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 -- 172.21.15.170:0/3545692219 >> 172.21.15.170:0/3545692219 conn(0x7f8d9c0fb1a0 msgr2=0x7f8d9c0fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:23.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 -- 172.21.15.170:0/3545692219 shutdown_connections 2024-01-25T14:59:23.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 -- 172.21.15.170:0/3545692219 wait complete. 2024-01-25T14:59:23.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 Processor -- start 2024-01-25T14:59:23.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 -- start start 2024-01-25T14:59:23.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d9c0ffc30 0x7f8d9c069c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:23.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d9c100e20 0x7f8d9c19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:23.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d9c1017e0 0x7f8d9c19e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:23.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c19e7d0 con 0x7f8d9c1017e0 2024-01-25T14:59:23.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c19e940 con 0x7f8d9c0ffc30 2024-01-25T14:59:23.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.692+0000 7f8da2b01640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c19eb00 con 0x7f8d9c100e20 2024-01-25T14:59:23.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8da109e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d9c1017e0 0x7f8d9c19e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:23.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8da109e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d9c1017e0 0x7f8d9c19e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:57174/0 (socket says 172.21.15.170:57174) 2024-01-25T14:59:23.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8da109e640 1 -- 172.21.15.170:0/3166794167 learned_addr learned my addr 172.21.15.170:0/3166794167 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:23.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8da089d640 1 --2- 172.21.15.170:0/3166794167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d9c0ffc30 0x7f8d9c069c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:23.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8da109e640 1 -- 172.21.15.170:0/3166794167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d9c100e20 msgr2=0x7f8d9c19ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:23.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8d93fff640 1 --2- 172.21.15.170:0/3166794167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d9c100e20 0x7f8d9c19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:23.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8da109e640 1 --2- 172.21.15.170:0/3166794167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d9c100e20 0x7f8d9c19ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:23.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8da109e640 1 -- 172.21.15.170:0/3166794167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d9c0ffc30 msgr2=0x7f8d9c069c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:23.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8da109e640 1 --2- 172.21.15.170:0/3166794167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d9c0ffc30 0x7f8d9c069c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:23.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8da109e640 1 -- 172.21.15.170:0/3166794167 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d94009900 con 0x7f8d9c1017e0 2024-01-25T14:59:23.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8da089d640 1 --2- 172.21.15.170:0/3166794167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d9c0ffc30 0x7f8d9c069c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T14:59:23.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8da109e640 1 --2- 172.21.15.170:0/3166794167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d9c1017e0 0x7f8d9c19e040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8d94005cc0 tx=0x7f8d940329c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:23.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8d91ffb640 1 -- 172.21.15.170:0/3166794167 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d94034e80 con 0x7f8d9c1017e0 2024-01-25T14:59:23.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8d91ffb640 1 -- 172.21.15.170:0/3166794167 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d94032e90 con 0x7f8d9c1017e0 2024-01-25T14:59:23.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8d91ffb640 1 -- 172.21.15.170:0/3166794167 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d940047a0 con 0x7f8d9c1017e0 2024-01-25T14:59:23.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8da2b01640 1 -- 172.21.15.170:0/3166794167 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9c19ed80 con 0x7f8d9c1017e0 2024-01-25T14:59:23.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.693+0000 7f8da2b01640 1 -- 172.21.15.170:0/3166794167 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9c19f250 con 0x7f8d9c1017e0 2024-01-25T14:59:23.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.694+0000 7f8da2b01640 1 -- 172.21.15.170:0/3166794167 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9c106fc0 con 0x7f8d9c1017e0 2024-01-25T14:59:23.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.695+0000 7f8d91ffb640 1 -- 172.21.15.170:0/3166794167 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f8d9403b040 con 0x7f8d9c1017e0 2024-01-25T14:59:23.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.696+0000 7f8d91ffb640 1 --2- 172.21.15.170:0/3166794167 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8d840a1360 0x7f8d840a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:23.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.696+0000 7f8da089d640 1 --2- 172.21.15.170:0/3166794167 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8d840a1360 0x7f8d840a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:23.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.696+0000 7f8d91ffb640 1 -- 172.21.15.170:0/3166794167 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8d940eed20 con 0x7f8d9c1017e0 2024-01-25T14:59:23.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.696+0000 7f8da089d640 1 --2- 172.21.15.170:0/3166794167 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8d840a1360 0x7f8d840a3820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c100c80 tx=0x7f8d9800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:23.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.701+0000 7f8d91ffb640 1 -- 172.21.15.170:0/3166794167 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f8d940b8640 con 0x7f8d9c1017e0 2024-01-25T14:59:23.813 INFO:journalctl@ceph.mds.j.smithi170.stdout:Jan 25 14:59:23 smithi170 podman[72286]: 2024-01-25 14:59:23.457529044 +0000 UTC m=+0.017721186 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T14:59:23.813 INFO:journalctl@ceph.mds.j.smithi170.stdout:Jan 25 14:59:23 smithi170 podman[72286]: 2024-01-25 14:59:23.592310677 +0000 UTC m=+0.152502823 container create 2becd56945cc8004f0d7f94adb88916a3a21e097445b7728d37f18c798f59c18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-j, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-01-25T14:59:23.813 INFO:journalctl@ceph.mds.j.smithi170.stdout:Jan 25 14:59:23 smithi170 podman[72286]: 2024-01-25 14:59:23.8129267 +0000 UTC m=+0.373118843 container init 2becd56945cc8004f0d7f94adb88916a3a21e097445b7728d37f18c798f59c18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-j, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3) 2024-01-25T14:59:23.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.951+0000 7f8da2b01640 1 -- 172.21.15.170:0/3166794167 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d9c10b4d0 con 0x7f8d9c1017e0 2024-01-25T14:59:23.952 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.952+0000 7f8d91ffb640 1 -- 172.21.15.170:0/3166794167 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2119 (secure 0 0 0) 0x7f8d940bbc60 con 0x7f8d9c1017e0 2024-01-25T14:59:23.953 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:23.953 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-25T14:59:23.953 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 3 2024-01-25T14:59:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.954+0000 7f8da2b01640 1 -- 172.21.15.170:0/3166794167 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8d840a1360 msgr2=0x7f8d840a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.954+0000 7f8da2b01640 1 --2- 172.21.15.170:0/3166794167 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8d840a1360 0x7f8d840a3820 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c100c80 tx=0x7f8d9800a2d0 comp rx=0 tx=0).stop 2024-01-25T14:59:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.954+0000 7f8da2b01640 1 -- 172.21.15.170:0/3166794167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d9c1017e0 msgr2=0x7f8d9c19e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.954+0000 7f8da2b01640 1 --2- 172.21.15.170:0/3166794167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d9c1017e0 0x7f8d9c19e040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8d94005cc0 tx=0x7f8d940329c0 comp rx=0 tx=0).stop 2024-01-25T14:59:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.954+0000 7f8da2b01640 1 -- 172.21.15.170:0/3166794167 shutdown_connections 2024-01-25T14:59:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.954+0000 7f8da2b01640 1 --2- 172.21.15.170:0/3166794167 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8d840a1360 0x7f8d840a3820 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.954+0000 7f8da2b01640 1 --2- 172.21.15.170:0/3166794167 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8d9c1017e0 0x7f8d9c19e040 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.954+0000 7f8da2b01640 1 --2- 172.21.15.170:0/3166794167 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8d9c100e20 0x7f8d9c19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.954+0000 7f8da2b01640 1 --2- 172.21.15.170:0/3166794167 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8d9c0ffc30 0x7f8d9c069c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.954+0000 7f8da2b01640 1 -- 172.21.15.170:0/3166794167 >> 172.21.15.170:0/3166794167 conn(0x7f8d9c0fb1a0 msgr2=0x7f8d9c104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:23.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.954+0000 7f8da2b01640 1 -- 172.21.15.170:0/3166794167 shutdown_connections 2024-01-25T14:59:23.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:23.954+0000 7f8da2b01640 1 -- 172.21.15.170:0/3166794167 wait complete. 2024-01-25T14:59:24.124 INFO:journalctl@ceph.mds.j.smithi170.stdout:Jan 25 14:59:23 smithi170 podman[72286]: 2024-01-25 14:59:23.815968978 +0000 UTC m=+0.376161126 container start 2becd56945cc8004f0d7f94adb88916a3a21e097445b7728d37f18c798f59c18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T14:59:24.124 INFO:journalctl@ceph.mds.j.smithi170.stdout:Jan 25 14:59:23 smithi170 ceph-mds[72344]: -- 172.21.15.170:0/3397802692 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561d3db21520 con 0x561d3daf6c00 2024-01-25T14:59:24.124 INFO:journalctl@ceph.mds.j.smithi170.stdout:Jan 25 14:59:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-j[72340]: starting mds.j at 2024-01-25T14:59:24.124 INFO:journalctl@ceph.mds.j.smithi170.stdout:Jan 25 14:59:23 smithi170 bash[72286]: 2becd56945cc8004f0d7f94adb88916a3a21e097445b7728d37f18c798f59c18 2024-01-25T14:59:24.124 INFO:journalctl@ceph.mds.j.smithi170.stdout:Jan 25 14:59:23 smithi170 systemd[1]: Started Ceph mds.j for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:59:25.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:25.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:25.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:25.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:25.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:25.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:25.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:24 smithi170 ceph-mon[31899]: Deploying daemon mds.d on smithi170 2024-01-25T14:59:25.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:24 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3166794167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:25.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:24 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.170:6834/1911625476,v1:172.21.15.170:6835/1911625476] up:boot 2024-01-25T14:59:25.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:24 smithi170 ceph-mon[31899]: fsmap 3 up:standby 2024-01-25T14:59:25.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:24 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-01-25T14:59:25.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:24 smithi170 ceph-mon[31899]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:25.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:25.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:25.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:25.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:25.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:25.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:25.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:24 smithi191 ceph-mon[36347]: Deploying daemon mds.d on smithi170 2024-01-25T14:59:25.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:24 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3166794167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:25.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:24 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.170:6834/1911625476,v1:172.21.15.170:6835/1911625476] up:boot 2024-01-25T14:59:25.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:24 smithi191 ceph-mon[36347]: fsmap 3 up:standby 2024-01-25T14:59:25.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:24 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-01-25T14:59:25.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:24 smithi191 ceph-mon[36347]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:25.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:25.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:25.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:25.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:25.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:25.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:25.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:24 smithi186 ceph-mon[35697]: Deploying daemon mds.d on smithi170 2024-01-25T14:59:25.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:24 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3166794167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:25.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:24 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.170:6834/1911625476,v1:172.21.15.170:6835/1911625476] up:boot 2024-01-25T14:59:25.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:24 smithi186 ceph-mon[35697]: fsmap 3 up:standby 2024-01-25T14:59:25.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:24 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-01-25T14:59:25.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:24 smithi186 ceph-mon[35697]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:25.968 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T14:59:26.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.104+0000 7fc2b0cb2640 1 -- 172.21.15.170:0/3941550716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2ac0ffec0 msgr2=0x7fc2ac100340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:26.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.104+0000 7fc2b0cb2640 1 --2- 172.21.15.170:0/3941550716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2ac0ffec0 0x7fc2ac100340 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc294009900 tx=0x7fc29402bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:26.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.104+0000 7fc2b0cb2640 1 -- 172.21.15.170:0/3941550716 shutdown_connections 2024-01-25T14:59:26.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.104+0000 7fc2b0cb2640 1 --2- 172.21.15.170:0/3941550716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2ac100880 0x7fc2ac108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:26.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.104+0000 7fc2b0cb2640 1 --2- 172.21.15.170:0/3941550716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2ac0ffec0 0x7fc2ac100340 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:26.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.104+0000 7fc2b0cb2640 1 --2- 172.21.15.170:0/3941550716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2ac101220 0x7fc2ac101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:26.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.104+0000 7fc2b0cb2640 1 -- 172.21.15.170:0/3941550716 >> 172.21.15.170:0/3941550716 conn(0x7fc2ac0fa910 msgr2=0x7fc2ac0fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:26.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.104+0000 7fc2b0cb2640 1 -- 172.21.15.170:0/3941550716 shutdown_connections 2024-01-25T14:59:26.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.104+0000 7fc2b0cb2640 1 -- 172.21.15.170:0/3941550716 wait complete. 2024-01-25T14:59:26.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.104+0000 7fc2b0cb2640 1 Processor -- start 2024-01-25T14:59:26.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2b0cb2640 1 -- start start 2024-01-25T14:59:26.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2b0cb2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2ac0ffec0 0x7fc2ac196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:26.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2b0cb2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2ac100880 0x7fc2ac1971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:26.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2b0cb2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2ac101220 0x7fc2ac19e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:26.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2b0cb2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac19e790 con 0x7fc2ac100880 2024-01-25T14:59:26.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2b0cb2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac19e900 con 0x7fc2ac101220 2024-01-25T14:59:26.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2b0cb2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac19eac0 con 0x7fc2ac0ffec0 2024-01-25T14:59:26.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2a3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2ac100880 0x7fc2ac1971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:26.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2a3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2ac100880 0x7fc2ac1971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:32994/0 (socket says 172.21.15.170:32994) 2024-01-25T14:59:26.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2a3fff640 1 -- 172.21.15.170:0/906252400 learned_addr learned my addr 172.21.15.170:0/906252400 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:26.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2aad9d640 1 --2- 172.21.15.170:0/906252400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2ac101220 0x7fc2ac19e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:26.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2aa59c640 1 --2- 172.21.15.170:0/906252400 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2ac0ffec0 0x7fc2ac196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:26.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2a3fff640 1 -- 172.21.15.170:0/906252400 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2ac0ffec0 msgr2=0x7fc2ac196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:26.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2a3fff640 1 --2- 172.21.15.170:0/906252400 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2ac0ffec0 0x7fc2ac196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:26.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2a3fff640 1 -- 172.21.15.170:0/906252400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2ac101220 msgr2=0x7fc2ac19e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:26.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2a3fff640 1 --2- 172.21.15.170:0/906252400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2ac101220 0x7fc2ac19e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:26.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2a3fff640 1 -- 172.21.15.170:0/906252400 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc294009560 con 0x7fc2ac100880 2024-01-25T14:59:26.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2a3fff640 1 --2- 172.21.15.170:0/906252400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2ac100880 0x7fc2ac1971c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc29402c610 tx=0x7fc294004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:26.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2a37fe640 1 -- 172.21.15.170:0/906252400 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2940042d0 con 0x7fc2ac100880 2024-01-25T14:59:26.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.105+0000 7fc2b0cb2640 1 -- 172.21.15.170:0/906252400 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ac1020f0 con 0x7fc2ac100880 2024-01-25T14:59:26.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.106+0000 7fc2b0cb2640 1 -- 172.21.15.170:0/906252400 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ac102650 con 0x7fc2ac100880 2024-01-25T14:59:26.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.106+0000 7fc2a37fe640 1 -- 172.21.15.170:0/906252400 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc294042070 con 0x7fc2ac100880 2024-01-25T14:59:26.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.106+0000 7fc2a37fe640 1 -- 172.21.15.170:0/906252400 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29403ec20 con 0x7fc2ac100880 2024-01-25T14:59:26.110 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.106+0000 7fc2b0cb2640 1 -- 172.21.15.170:0/906252400 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ac10b4c0 con 0x7fc2ac100880 2024-01-25T14:59:26.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.108+0000 7fc2a37fe640 1 -- 172.21.15.170:0/906252400 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fc294005000 con 0x7fc2ac100880 2024-01-25T14:59:26.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.108+0000 7fc2a37fe640 1 --2- 172.21.15.170:0/906252400 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc2980a12e0 0x7fc2980a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:26.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.108+0000 7fc2aa59c640 1 --2- 172.21.15.170:0/906252400 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc2980a12e0 0x7fc2980a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:26.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.109+0000 7fc2a37fe640 1 -- 172.21.15.170:0/906252400 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc294044070 con 0x7fc2ac100880 2024-01-25T14:59:26.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.109+0000 7fc2aa59c640 1 --2- 172.21.15.170:0/906252400 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc2980a12e0 0x7fc2980a37a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac197b50 tx=0x7fc29c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:26.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.114+0000 7fc2a37fe640 1 -- 172.21.15.170:0/906252400 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fc2940bc2a0 con 0x7fc2ac100880 2024-01-25T14:59:26.124 INFO:journalctl@ceph.mds.d.smithi170.stdout:Jan 25 14:59:26 smithi170 systemd[1]: Starting Ceph mds.d for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T14:59:26.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.336+0000 7fc2b0cb2640 1 -- 172.21.15.170:0/906252400 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2ac102a90 con 0x7fc2ac100880 2024-01-25T14:59:26.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.337+0000 7fc2a37fe640 1 -- 172.21.15.170:0/906252400 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2913 (secure 0 0 0) 0x7fc2940bf8c0 con 0x7fc2ac100880 2024-01-25T14:59:26.338 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:26.338 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-25T14:59:26.338 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 4 2024-01-25T14:59:26.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.339+0000 7fc2b0cb2640 1 -- 172.21.15.170:0/906252400 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc2980a12e0 msgr2=0x7fc2980a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:26.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.339+0000 7fc2b0cb2640 1 --2- 172.21.15.170:0/906252400 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc2980a12e0 0x7fc2980a37a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac197b50 tx=0x7fc29c005f90 comp rx=0 tx=0).stop 2024-01-25T14:59:26.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.339+0000 7fc2b0cb2640 1 -- 172.21.15.170:0/906252400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2ac100880 msgr2=0x7fc2ac1971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:26.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.339+0000 7fc2b0cb2640 1 --2- 172.21.15.170:0/906252400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2ac100880 0x7fc2ac1971c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc29402c610 tx=0x7fc294004dd0 comp rx=0 tx=0).stop 2024-01-25T14:59:26.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.339+0000 7fc2b0cb2640 1 -- 172.21.15.170:0/906252400 shutdown_connections 2024-01-25T14:59:26.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.339+0000 7fc2b0cb2640 1 --2- 172.21.15.170:0/906252400 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc2980a12e0 0x7fc2980a37a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:26.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.339+0000 7fc2b0cb2640 1 --2- 172.21.15.170:0/906252400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2ac101220 0x7fc2ac19e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:26.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.339+0000 7fc2b0cb2640 1 --2- 172.21.15.170:0/906252400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2ac100880 0x7fc2ac1971c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:26.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.339+0000 7fc2b0cb2640 1 --2- 172.21.15.170:0/906252400 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2ac0ffec0 0x7fc2ac196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:26.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.339+0000 7fc2b0cb2640 1 -- 172.21.15.170:0/906252400 >> 172.21.15.170:0/906252400 conn(0x7fc2ac0fa910 msgr2=0x7fc2ac0fc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:26.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.339+0000 7fc2b0cb2640 1 -- 172.21.15.170:0/906252400 shutdown_connections 2024-01-25T14:59:26.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:26.339+0000 7fc2b0cb2640 1 -- 172.21.15.170:0/906252400 wait complete. 2024-01-25T14:59:26.512 INFO:journalctl@ceph.mds.d.smithi170.stdout:Jan 25 14:59:26 smithi170 podman[72672]: 2024-01-25 14:59:26.164785523 +0000 UTC m=+0.020236209 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T14:59:26.512 INFO:journalctl@ceph.mds.d.smithi170.stdout:Jan 25 14:59:26 smithi170 podman[72672]: 2024-01-25 14:59:26.272221011 +0000 UTC m=+0.127671679 container create 2305340b89c446f531d1e5a44cfc6d3e8972790bf62059bd3545ecae048b5553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-d, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-01-25T14:59:26.512 INFO:journalctl@ceph.mds.d.smithi170.stdout:Jan 25 14:59:26 smithi170 podman[72672]: 2024-01-25 14:59:26.5089868 +0000 UTC m=+0.364437482 container init 2305340b89c446f531d1e5a44cfc6d3e8972790bf62059bd3545ecae048b5553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-d, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-01-25T14:59:26.512 INFO:journalctl@ceph.mds.d.smithi170.stdout:Jan 25 14:59:26 smithi170 podman[72672]: 2024-01-25 14:59:26.511743074 +0000 UTC m=+0.367193751 container start 2305340b89c446f531d1e5a44cfc6d3e8972790bf62059bd3545ecae048b5553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-d, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-01-25T14:59:26.874 INFO:journalctl@ceph.mds.d.smithi170.stdout:Jan 25 14:59:26 smithi170 ceph-mds[72693]: -- 172.21.15.170:0/2433890197 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561a43caf520 con 0x561a43c84c00 2024-01-25T14:59:26.874 INFO:journalctl@ceph.mds.d.smithi170.stdout:Jan 25 14:59:26 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-d[72689]: starting mds.d at 2024-01-25T14:59:26.874 INFO:journalctl@ceph.mds.d.smithi170.stdout:Jan 25 14:59:26 smithi170 bash[72672]: 2305340b89c446f531d1e5a44cfc6d3e8972790bf62059bd3545ecae048b5553 2024-01-25T14:59:26.874 INFO:journalctl@ceph.mds.d.smithi170.stdout:Jan 25 14:59:26 smithi170 systemd[1]: Started Ceph mds.d for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:59:27.599 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:27 smithi186 ceph-mon[35697]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:27.599 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:27 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/906252400' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:27.599 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:27.599 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:27.599 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:27.599 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:27.599 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:27.599 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:27 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:27 smithi170 ceph-mon[31899]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:27 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/906252400' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:27 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:27.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:27 smithi191 ceph-mon[36347]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:27.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:27 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/906252400' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:27.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:27.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:27.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:27.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:27.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:27.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:27 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:28.355 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T14:59:28.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:28 smithi186 ceph-mon[35697]: Deploying daemon mds.e on smithi186 2024-01-25T14:59:28.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:28 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.170:6836/4204528099,v1:172.21.15.170:6837/4204528099] up:boot 2024-01-25T14:59:28.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:28 smithi186 ceph-mon[35697]: fsmap 4 up:standby 2024-01-25T14:59:28.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:28 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-01-25T14:59:28.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 -- 172.21.15.170:0/737228130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c01017c0 msgr2=0x7f12c0108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:28.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 --2- 172.21.15.170:0/737228130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c01017c0 0x7f12c0108050 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f12b8009ca0 tx=0x7f12b802c0f0 comp rx=0 tx=0).stop 2024-01-25T14:59:28.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 -- 172.21.15.170:0/737228130 shutdown_connections 2024-01-25T14:59:28.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 --2- 172.21.15.170:0/737228130 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12c0100e00 0x7f12c0101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:28.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 --2- 172.21.15.170:0/737228130 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c01017c0 0x7f12c0108050 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:28.473 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 --2- 172.21.15.170:0/737228130 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12c00ffc10 0x7f12c0100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:28.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 -- 172.21.15.170:0/737228130 >> 172.21.15.170:0/737228130 conn(0x7f12c00fb180 msgr2=0x7f12c00fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:28.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 -- 172.21.15.170:0/737228130 shutdown_connections 2024-01-25T14:59:28.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 -- 172.21.15.170:0/737228130 wait complete. 2024-01-25T14:59:28.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 Processor -- start 2024-01-25T14:59:28.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 -- start start 2024-01-25T14:59:28.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12c00ffc10 0x7f12c00689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:28.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0100e00 0x7f12c019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:28.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12c01017c0 0x7f12c019dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:28.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c019e750 con 0x7f12c0100e00 2024-01-25T14:59:28.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c019e8c0 con 0x7f12c01017c0 2024-01-25T14:59:28.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.470+0000 7f12c86e7640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c019ea80 con 0x7f12c00ffc10 2024-01-25T14:59:28.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12c5c82640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0100e00 0x7f12c019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:28.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12c5c82640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0100e00 0x7f12c019b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33028/0 (socket says 172.21.15.170:33028) 2024-01-25T14:59:28.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12c5c82640 1 -- 172.21.15.170:0/4127174169 learned_addr learned my addr 172.21.15.170:0/4127174169 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:28.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12c6c84640 1 --2- 172.21.15.170:0/4127174169 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12c01017c0 0x7f12c019dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:28.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12c6483640 1 --2- 172.21.15.170:0/4127174169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12c00ffc10 0x7f12c00689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:28.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12c5c82640 1 -- 172.21.15.170:0/4127174169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12c00ffc10 msgr2=0x7f12c00689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:28.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12c5c82640 1 --2- 172.21.15.170:0/4127174169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12c00ffc10 0x7f12c00689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:28.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12c5c82640 1 -- 172.21.15.170:0/4127174169 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12c01017c0 msgr2=0x7f12c019dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:28.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12c5c82640 1 --2- 172.21.15.170:0/4127174169 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12c01017c0 0x7f12c019dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:28.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12c5c82640 1 -- 172.21.15.170:0/4127174169 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b0009490 con 0x7f12c0100e00 2024-01-25T14:59:28.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12c6c84640 1 --2- 172.21.15.170:0/4127174169 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12c01017c0 0x7f12c019dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T14:59:28.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12c5c82640 1 --2- 172.21.15.170:0/4127174169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0100e00 0x7f12c019b980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f12b000ea60 tx=0x7f12b000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:28.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12b77fe640 1 -- 172.21.15.170:0/4127174169 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b000cde0 con 0x7f12c0100e00 2024-01-25T14:59:28.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12b77fe640 1 -- 172.21.15.170:0/4127174169 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f12b00035f0 con 0x7f12c0100e00 2024-01-25T14:59:28.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12c86e7640 1 -- 172.21.15.170:0/4127174169 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b8009900 con 0x7f12c0100e00 2024-01-25T14:59:28.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12b77fe640 1 -- 172.21.15.170:0/4127174169 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b00044e0 con 0x7f12c0100e00 2024-01-25T14:59:28.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.471+0000 7f12c86e7640 1 -- 172.21.15.170:0/4127174169 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c019f0e0 con 0x7f12c0100e00 2024-01-25T14:59:28.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.472+0000 7f12c86e7640 1 -- 172.21.15.170:0/4127174169 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c0106ed0 con 0x7f12c0100e00 2024-01-25T14:59:28.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.473+0000 7f12b77fe640 1 -- 172.21.15.170:0/4127174169 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f12b0003a60 con 0x7f12c0100e00 2024-01-25T14:59:28.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.474+0000 7f12b77fe640 1 --2- 172.21.15.170:0/4127174169 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f12ac0a12e0 0x7f12ac0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:28.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.474+0000 7f12c6483640 1 --2- 172.21.15.170:0/4127174169 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f12ac0a12e0 0x7f12ac0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:28.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.474+0000 7f12b77fe640 1 -- 172.21.15.170:0/4127174169 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f12b0014070 con 0x7f12c0100e00 2024-01-25T14:59:28.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.474+0000 7f12c6483640 1 --2- 172.21.15.170:0/4127174169 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f12ac0a12e0 0x7f12ac0a37a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0058c0 tx=0x7f12bc005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:28.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.479+0000 7f12b77fe640 1 -- 172.21.15.170:0/4127174169 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f12b00964b0 con 0x7f12c0100e00 2024-01-25T14:59:28.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:28 smithi170 ceph-mon[31899]: Deploying daemon mds.e on smithi186 2024-01-25T14:59:28.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:28 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.170:6836/4204528099,v1:172.21.15.170:6837/4204528099] up:boot 2024-01-25T14:59:28.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:28 smithi170 ceph-mon[31899]: fsmap 4 up:standby 2024-01-25T14:59:28.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:28 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-01-25T14:59:28.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.686+0000 7f12c86e7640 1 -- 172.21.15.170:0/4127174169 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f12c002cad0 con 0x7f12c0100e00 2024-01-25T14:59:28.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.687+0000 7f12b77fe640 1 -- 172.21.15.170:0/4127174169 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3707 (secure 0 0 0) 0x7f12b0099ad0 con 0x7f12c0100e00 2024-01-25T14:59:28.688 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:28.688 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-25T14:59:28.688 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 5 2024-01-25T14:59:28.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.689+0000 7f12c86e7640 1 -- 172.21.15.170:0/4127174169 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f12ac0a12e0 msgr2=0x7f12ac0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:28.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.689+0000 7f12c86e7640 1 --2- 172.21.15.170:0/4127174169 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f12ac0a12e0 0x7f12ac0a37a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0058c0 tx=0x7f12bc005850 comp rx=0 tx=0).stop 2024-01-25T14:59:28.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.689+0000 7f12c86e7640 1 -- 172.21.15.170:0/4127174169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0100e00 msgr2=0x7f12c019b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:28.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.689+0000 7f12c86e7640 1 --2- 172.21.15.170:0/4127174169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0100e00 0x7f12c019b980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f12b000ea60 tx=0x7f12b000ef20 comp rx=0 tx=0).stop 2024-01-25T14:59:28.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.689+0000 7f12c86e7640 1 -- 172.21.15.170:0/4127174169 shutdown_connections 2024-01-25T14:59:28.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.689+0000 7f12c86e7640 1 --2- 172.21.15.170:0/4127174169 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f12ac0a12e0 0x7f12ac0a37a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:28.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.689+0000 7f12c86e7640 1 --2- 172.21.15.170:0/4127174169 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f12c01017c0 0x7f12c019dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:28.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.689+0000 7f12c86e7640 1 --2- 172.21.15.170:0/4127174169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f12c0100e00 0x7f12c019b980 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:28.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.689+0000 7f12c86e7640 1 --2- 172.21.15.170:0/4127174169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f12c00ffc10 0x7f12c00689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:28.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.689+0000 7f12c86e7640 1 -- 172.21.15.170:0/4127174169 >> 172.21.15.170:0/4127174169 conn(0x7f12c00fb180 msgr2=0x7f12c01040a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:28.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.689+0000 7f12c86e7640 1 -- 172.21.15.170:0/4127174169 shutdown_connections 2024-01-25T14:59:28.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:28.689+0000 7f12c86e7640 1 -- 172.21.15.170:0/4127174169 wait complete. 2024-01-25T14:59:28.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:28 smithi191 ceph-mon[36347]: Deploying daemon mds.e on smithi186 2024-01-25T14:59:28.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:28 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.170:6836/4204528099,v1:172.21.15.170:6837/4204528099] up:boot 2024-01-25T14:59:28.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:28 smithi191 ceph-mon[36347]: fsmap 4 up:standby 2024-01-25T14:59:28.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:28 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-01-25T14:59:28.755 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 14:59:28 smithi186 systemd[1]: Starting Ceph mds.e for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T14:59:29.096 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 14:59:28 smithi186 podman[66387]: 2024-01-25 14:59:28.873620521 +0000 UTC m=+0.018101636 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T14:59:29.096 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 14:59:28 smithi186 podman[66387]: 2024-01-25 14:59:28.979074875 +0000 UTC m=+0.123555976 container create 116e5f0aed5f2e6117455060b7e52010fa7988d10e2854838524211a9ef611aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-e, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.31.3) 2024-01-25T14:59:29.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:29 smithi186 ceph-mon[35697]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:29.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:29 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/4127174169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:29.605 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 14:59:29 smithi186 podman[66387]: 2024-01-25 14:59:29.2235832 +0000 UTC m=+0.368064314 container init 116e5f0aed5f2e6117455060b7e52010fa7988d10e2854838524211a9ef611aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T14:59:29.605 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 14:59:29 smithi186 podman[66387]: 2024-01-25 14:59:29.226363011 +0000 UTC m=+0.370844104 container start 116e5f0aed5f2e6117455060b7e52010fa7988d10e2854838524211a9ef611aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3) 2024-01-25T14:59:29.605 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 14:59:29 smithi186 ceph-mds[66406]: -- 172.21.15.186:0/2804260978 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b449801520 con 0x55b4497d7000 2024-01-25T14:59:29.605 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 14:59:29 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-e[66402]: starting mds.e at 2024-01-25T14:59:29.605 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 14:59:29 smithi186 bash[66387]: 116e5f0aed5f2e6117455060b7e52010fa7988d10e2854838524211a9ef611aa 2024-01-25T14:59:29.605 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 14:59:29 smithi186 systemd[1]: Started Ceph mds.e for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:59:29.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:29 smithi170 ceph-mon[31899]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:29.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:29 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/4127174169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:29.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:29 smithi191 ceph-mon[36347]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:29.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:29 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/4127174169' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:30.662 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:30 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:30.662 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:30 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:30.662 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:30 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:30.662 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:30 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:30.662 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:30 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:30.662 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:30 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:30.662 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:30 smithi191 ceph-mon[36347]: Deploying daemon mds.f on smithi191 2024-01-25T14:59:30.663 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:30 smithi191 ceph-mon[36347]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:30.663 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:30 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.186:6834/2663522449,v1:172.21.15.186:6835/2663522449] up:boot 2024-01-25T14:59:30.663 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:30 smithi191 ceph-mon[36347]: fsmap 5 up:standby 2024-01-25T14:59:30.663 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:30 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-01-25T14:59:30.701 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T14:59:30.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:30 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:30.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:30 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:30.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:30 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:30.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:30 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:30.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:30 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:30.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:30 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:30.728 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:30 smithi170 ceph-mon[31899]: Deploying daemon mds.f on smithi191 2024-01-25T14:59:30.729 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:30 smithi170 ceph-mon[31899]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:30.729 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:30 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.186:6834/2663522449,v1:172.21.15.186:6835/2663522449] up:boot 2024-01-25T14:59:30.729 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:30 smithi170 ceph-mon[31899]: fsmap 5 up:standby 2024-01-25T14:59:30.729 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:30 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-01-25T14:59:30.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.809+0000 7f91cc496640 1 -- 172.21.15.170:0/1085850803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91c4100d10 msgr2=0x7f91c4101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:30.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.809+0000 7f91cc496640 1 --2- 172.21.15.170:0/1085850803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91c4100d10 0x7f91c4101130 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f91c0009900 tx=0x7f91c002bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:30.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.809+0000 7f91cc496640 1 -- 172.21.15.170:0/1085850803 shutdown_connections 2024-01-25T14:59:30.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.809+0000 7f91cc496640 1 --2- 172.21.15.170:0/1085850803 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91c4101f00 0x7f91c4102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:30.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.809+0000 7f91cc496640 1 --2- 172.21.15.170:0/1085850803 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91c41028c0 0x7f91c4109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:30.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.809+0000 7f91cc496640 1 --2- 172.21.15.170:0/1085850803 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91c4100d10 0x7f91c4101130 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:30.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.809+0000 7f91cc496640 1 -- 172.21.15.170:0/1085850803 >> 172.21.15.170:0/1085850803 conn(0x7f91c40fc2a0 msgr2=0x7f91c40fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:30.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.809+0000 7f91cc496640 1 -- 172.21.15.170:0/1085850803 shutdown_connections 2024-01-25T14:59:30.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.809+0000 7f91cc496640 1 -- 172.21.15.170:0/1085850803 wait complete. 2024-01-25T14:59:30.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91cc496640 1 Processor -- start 2024-01-25T14:59:30.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91cc496640 1 -- start start 2024-01-25T14:59:30.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91cc496640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91c4100d10 0x7f91c4196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:30.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91cc496640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91c4101f00 0x7f91c41971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:30.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91cc496640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91c41028c0 0x7f91c419e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:30.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91cc496640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c419e7c0 con 0x7f91c4101f00 2024-01-25T14:59:30.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91cc496640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c419e930 con 0x7f91c4100d10 2024-01-25T14:59:30.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91cc496640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c419eaf0 con 0x7f91c41028c0 2024-01-25T14:59:30.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91c9a31640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91c4101f00 0x7f91c41971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:30.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91c9a31640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91c4101f00 0x7f91c41971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33036/0 (socket says 172.21.15.170:33036) 2024-01-25T14:59:30.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91c9a31640 1 -- 172.21.15.170:0/2744647401 learned_addr learned my addr 172.21.15.170:0/2744647401 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:30.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91ca232640 1 --2- 172.21.15.170:0/2744647401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91c4100d10 0x7f91c4196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:30.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91caa33640 1 --2- 172.21.15.170:0/2744647401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91c41028c0 0x7f91c419e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:30.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91c9a31640 1 -- 172.21.15.170:0/2744647401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91c41028c0 msgr2=0x7f91c419e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:30.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91c9a31640 1 --2- 172.21.15.170:0/2744647401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91c41028c0 0x7f91c419e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:30.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91c9a31640 1 -- 172.21.15.170:0/2744647401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91c4100d10 msgr2=0x7f91c4196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:30.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91c9a31640 1 --2- 172.21.15.170:0/2744647401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91c4100d10 0x7f91c4196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:30.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91c9a31640 1 -- 172.21.15.170:0/2744647401 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c0009560 con 0x7f91c4101f00 2024-01-25T14:59:30.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.810+0000 7f91caa33640 1 --2- 172.21.15.170:0/2744647401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91c41028c0 0x7f91c419e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T14:59:30.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.811+0000 7f91c9a31640 1 --2- 172.21.15.170:0/2744647401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91c4101f00 0x7f91c41971f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f91b400e9f0 tx=0x7f91b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:30.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.811+0000 7f91bb7fe640 1 -- 172.21.15.170:0/2744647401 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4009700 con 0x7f91c4101f00 2024-01-25T14:59:30.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.811+0000 7f91bb7fe640 1 -- 172.21.15.170:0/2744647401 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91b400cd80 con 0x7f91c4101f00 2024-01-25T14:59:30.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.811+0000 7f91cc496640 1 -- 172.21.15.170:0/2744647401 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c419edd0 con 0x7f91c4101f00 2024-01-25T14:59:30.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.811+0000 7f91bb7fe640 1 -- 172.21.15.170:0/2744647401 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4018860 con 0x7f91c4101f00 2024-01-25T14:59:30.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.811+0000 7f91cc496640 1 -- 172.21.15.170:0/2744647401 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c419f250 con 0x7f91c4101f00 2024-01-25T14:59:30.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.812+0000 7f91cc496640 1 -- 172.21.15.170:0/2744647401 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c4108050 con 0x7f91c4101f00 2024-01-25T14:59:30.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.813+0000 7f91bb7fe640 1 -- 172.21.15.170:0/2744647401 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f91b40189c0 con 0x7f91c4101f00 2024-01-25T14:59:30.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.813+0000 7f91bb7fe640 1 --2- 172.21.15.170:0/2744647401 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f91b00a12e0 0x7f91b00a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:30.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.813+0000 7f91ca232640 1 --2- 172.21.15.170:0/2744647401 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f91b00a12e0 0x7f91b00a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:30.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.814+0000 7f91bb7fe640 1 -- 172.21.15.170:0/2744647401 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f91b4014070 con 0x7f91c4101f00 2024-01-25T14:59:30.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.814+0000 7f91ca232640 1 --2- 172.21.15.170:0/2744647401 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f91b00a12e0 0x7f91b00a37a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f91c0000c00 tx=0x7f91c002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:30.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:30.817+0000 7f91bb7fe640 1 -- 172.21.15.170:0/2744647401 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f91b40967e0 con 0x7f91c4101f00 2024-01-25T14:59:30.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:30 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:30.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:30 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:30.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:30 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:30.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:30 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:30.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:30 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:30.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:30 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:30.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:30 smithi186 ceph-mon[35697]: Deploying daemon mds.f on smithi191 2024-01-25T14:59:30.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:30 smithi186 ceph-mon[35697]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:30.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:30 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.186:6834/2663522449,v1:172.21.15.186:6835/2663522449] up:boot 2024-01-25T14:59:30.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:30 smithi186 ceph-mon[35697]: fsmap 5 up:standby 2024-01-25T14:59:30.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:30 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-01-25T14:59:31.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:31.024+0000 7f91cc496640 1 -- 172.21.15.170:0/2744647401 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91c410c5d0 con 0x7f91c4101f00 2024-01-25T14:59:31.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:31.025+0000 7f91bb7fe640 1 -- 172.21.15.170:0/2744647401 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4501 (secure 0 0 0) 0x7f91b4099e00 con 0x7f91c4101f00 2024-01-25T14:59:31.026 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:31.026 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2024-01-25T14:59:31.027 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 6 2024-01-25T14:59:31.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:31.026+0000 7f91cc496640 1 -- 172.21.15.170:0/2744647401 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f91b00a12e0 msgr2=0x7f91b00a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:31.026+0000 7f91cc496640 1 --2- 172.21.15.170:0/2744647401 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f91b00a12e0 0x7f91b00a37a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f91c0000c00 tx=0x7f91c002c5d0 comp rx=0 tx=0).stop 2024-01-25T14:59:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:31.026+0000 7f91cc496640 1 -- 172.21.15.170:0/2744647401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91c4101f00 msgr2=0x7f91c41971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:31.026+0000 7f91cc496640 1 --2- 172.21.15.170:0/2744647401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91c4101f00 0x7f91c41971f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f91b400e9f0 tx=0x7f91b400eeb0 comp rx=0 tx=0).stop 2024-01-25T14:59:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:31.027+0000 7f91cc496640 1 -- 172.21.15.170:0/2744647401 shutdown_connections 2024-01-25T14:59:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:31.027+0000 7f91cc496640 1 --2- 172.21.15.170:0/2744647401 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f91b00a12e0 0x7f91b00a37a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:31.027+0000 7f91cc496640 1 --2- 172.21.15.170:0/2744647401 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f91c41028c0 0x7f91c419e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:31.027+0000 7f91cc496640 1 --2- 172.21.15.170:0/2744647401 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f91c4101f00 0x7f91c41971f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:31.027+0000 7f91cc496640 1 --2- 172.21.15.170:0/2744647401 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91c4100d10 0x7f91c4196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:31.027+0000 7f91cc496640 1 -- 172.21.15.170:0/2744647401 >> 172.21.15.170:0/2744647401 conn(0x7f91c40fc2a0 msgr2=0x7f91c4105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:31.027+0000 7f91cc496640 1 -- 172.21.15.170:0/2744647401 shutdown_connections 2024-01-25T14:59:31.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:31.027+0000 7f91cc496640 1 -- 172.21.15.170:0/2744647401 wait complete. 2024-01-25T14:59:31.640 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:31 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2744647401' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:31.641 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 14:59:31 smithi191 systemd[1]: Starting Ceph mds.f for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T14:59:31.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:31 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2744647401' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:31.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:31 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2744647401' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:31.892 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 14:59:31 smithi191 podman[67190]: 2024-01-25 14:59:31.54322533 +0000 UTC m=+0.017558849 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T14:59:31.893 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 14:59:31 smithi191 podman[67190]: 2024-01-25 14:59:31.656778543 +0000 UTC m=+0.131112095 container create fb08058e39a48b4bc97df85ffa6ffbc1452b1a68618ac8b86691299baeebe57d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-f, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T14:59:31.893 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 14:59:31 smithi191 podman[67190]: 2024-01-25 14:59:31.892508796 +0000 UTC m=+0.366842305 container init fb08058e39a48b4bc97df85ffa6ffbc1452b1a68618ac8b86691299baeebe57d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-f, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T14:59:32.234 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 14:59:31 smithi191 podman[67190]: 2024-01-25 14:59:31.895165716 +0000 UTC m=+0.369499231 container start fb08058e39a48b4bc97df85ffa6ffbc1452b1a68618ac8b86691299baeebe57d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, io.buildah.version=1.31.3, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-01-25T14:59:32.234 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 14:59:31 smithi191 ceph-mds[67209]: -- 172.21.15.191:0/2499541091 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5642cf131520 con 0x5642cf106800 2024-01-25T14:59:32.234 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 14:59:31 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-f[67205]: starting mds.f at 2024-01-25T14:59:32.234 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 14:59:31 smithi191 bash[67190]: fb08058e39a48b4bc97df85ffa6ffbc1452b1a68618ac8b86691299baeebe57d 2024-01-25T14:59:32.234 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 14:59:31 smithi191 systemd[1]: Started Ceph mds.f for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:59:33.040 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T14:59:33.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.153+0000 7fac4d35d640 1 -- 172.21.15.170:0/2307735977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac481017e0 msgr2=0x7fac48108070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:33.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.153+0000 7fac4d35d640 1 --2- 172.21.15.170:0/2307735977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac481017e0 0x7fac48108070 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fac40009ca0 tx=0x7fac4002c0f0 comp rx=0 tx=0).stop 2024-01-25T14:59:33.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.153+0000 7fac4d35d640 1 -- 172.21.15.170:0/2307735977 shutdown_connections 2024-01-25T14:59:33.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.153+0000 7fac4d35d640 1 --2- 172.21.15.170:0/2307735977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac48100e20 0x7fac481012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:33.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.153+0000 7fac4d35d640 1 --2- 172.21.15.170:0/2307735977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac481017e0 0x7fac48108070 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:33.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.153+0000 7fac4d35d640 1 --2- 172.21.15.170:0/2307735977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac480ffc30 0x7fac48100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:33.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.153+0000 7fac4d35d640 1 -- 172.21.15.170:0/2307735977 >> 172.21.15.170:0/2307735977 conn(0x7fac480fb1a0 msgr2=0x7fac480fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:33.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.153+0000 7fac4d35d640 1 -- 172.21.15.170:0/2307735977 shutdown_connections 2024-01-25T14:59:33.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.153+0000 7fac4d35d640 1 -- 172.21.15.170:0/2307735977 wait complete. 2024-01-25T14:59:33.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.154+0000 7fac4d35d640 1 Processor -- start 2024-01-25T14:59:33.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.154+0000 7fac4d35d640 1 -- start start 2024-01-25T14:59:33.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.154+0000 7fac4d35d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac480ffc30 0x7fac48198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:33.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.154+0000 7fac4d35d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac48100e20 0x7fac481993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:33.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.154+0000 7fac4d35d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac481017e0 0x7fac481a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:33.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.154+0000 7fac4d35d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac481a0950 con 0x7fac480ffc30 2024-01-25T14:59:33.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.154+0000 7fac4d35d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac481a0ac0 con 0x7fac481017e0 2024-01-25T14:59:33.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.154+0000 7fac4d35d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac481a0c80 con 0x7fac48100e20 2024-01-25T14:59:33.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.154+0000 7fac46ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac480ffc30 0x7fac48198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:33.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.154+0000 7fac46ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac480ffc30 0x7fac48198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33066/0 (socket says 172.21.15.170:33066) 2024-01-25T14:59:33.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.154+0000 7fac46ffd640 1 -- 172.21.15.170:0/1854739281 learned_addr learned my addr 172.21.15.170:0/1854739281 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:33.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.154+0000 7fac3ffff640 1 --2- 172.21.15.170:0/1854739281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac48100e20 0x7fac481993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:33.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.155+0000 7fac477fe640 1 --2- 172.21.15.170:0/1854739281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac481017e0 0x7fac481a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:33.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.155+0000 7fac46ffd640 1 -- 172.21.15.170:0/1854739281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac48100e20 msgr2=0x7fac481993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:33.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.155+0000 7fac46ffd640 1 --2- 172.21.15.170:0/1854739281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac48100e20 0x7fac481993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:33.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.155+0000 7fac46ffd640 1 -- 172.21.15.170:0/1854739281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac481017e0 msgr2=0x7fac481a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:33.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.155+0000 7fac46ffd640 1 --2- 172.21.15.170:0/1854739281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac481017e0 0x7fac481a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:33.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.155+0000 7fac46ffd640 1 -- 172.21.15.170:0/1854739281 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac40009900 con 0x7fac480ffc30 2024-01-25T14:59:33.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.155+0000 7fac46ffd640 1 --2- 172.21.15.170:0/1854739281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac480ffc30 0x7fac48198e60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fac3800c970 tx=0x7fac3800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:33.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.155+0000 7fac44ff9640 1 -- 172.21.15.170:0/1854739281 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac38004220 con 0x7fac480ffc30 2024-01-25T14:59:33.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.155+0000 7fac44ff9640 1 -- 172.21.15.170:0/1854739281 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac38007e70 con 0x7fac480ffc30 2024-01-25T14:59:33.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.155+0000 7fac4d35d640 1 -- 172.21.15.170:0/1854739281 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac481a0f60 con 0x7fac480ffc30 2024-01-25T14:59:33.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.155+0000 7fac44ff9640 1 -- 172.21.15.170:0/1854739281 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac38003e60 con 0x7fac480ffc30 2024-01-25T14:59:33.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.155+0000 7fac4d35d640 1 -- 172.21.15.170:0/1854739281 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac481a13e0 con 0x7fac480ffc30 2024-01-25T14:59:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.156+0000 7fac4d35d640 1 -- 172.21.15.170:0/1854739281 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4810b4d0 con 0x7fac480ffc30 2024-01-25T14:59:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.158+0000 7fac44ff9640 1 -- 172.21.15.170:0/1854739281 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fac380079b0 con 0x7fac480ffc30 2024-01-25T14:59:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.158+0000 7fac44ff9640 1 --2- 172.21.15.170:0/1854739281 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fac340a1360 0x7fac340a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.158+0000 7fac3ffff640 1 --2- 172.21.15.170:0/1854739281 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fac340a1360 0x7fac340a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.159+0000 7fac44ff9640 1 -- 172.21.15.170:0/1854739281 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fac380cc7c0 con 0x7fac480ffc30 2024-01-25T14:59:33.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.159+0000 7fac3ffff640 1 --2- 172.21.15.170:0/1854739281 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fac340a1360 0x7fac340a3820 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fac4819a370 tx=0x7fac3000a4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:33.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.162+0000 7fac44ff9640 1 -- 172.21.15.170:0/1854739281 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fac38096160 con 0x7fac480ffc30 2024-01-25T14:59:33.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:33 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:33.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:33 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:33.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:33 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:33.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:33 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:33.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:33 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:33.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:33 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:33.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:33 smithi191 ceph-mon[36347]: Deploying daemon mds.c on smithi191 2024-01-25T14:59:33.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:33 smithi191 ceph-mon[36347]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:33.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:33 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.191:6834/1870775954,v1:172.21.15.191:6835/1870775954] up:boot 2024-01-25T14:59:33.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:33 smithi191 ceph-mon[36347]: fsmap 6 up:standby 2024-01-25T14:59:33.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:33 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-01-25T14:59:33.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:33 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:33.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:33 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:33.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:33 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:33.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:33 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:33.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:33 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:33.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:33 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:33.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:33 smithi186 ceph-mon[35697]: Deploying daemon mds.c on smithi191 2024-01-25T14:59:33.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:33 smithi186 ceph-mon[35697]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:33.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:33 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.191:6834/1870775954,v1:172.21.15.191:6835/1870775954] up:boot 2024-01-25T14:59:33.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:33 smithi186 ceph-mon[35697]: fsmap 6 up:standby 2024-01-25T14:59:33.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:33 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-01-25T14:59:33.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.369+0000 7fac4d35d640 1 -- 172.21.15.170:0/1854739281 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac481a1660 con 0x7fac480ffc30 2024-01-25T14:59:33.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.370+0000 7fac44ff9640 1 -- 172.21.15.170:0/1854739281 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5295 (secure 0 0 0) 0x7fac38099780 con 0x7fac480ffc30 2024-01-25T14:59:33.371 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:33.371 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2024-01-25T14:59:33.371 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 7 2024-01-25T14:59:33.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.372+0000 7fac4d35d640 1 -- 172.21.15.170:0/1854739281 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fac340a1360 msgr2=0x7fac340a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:33.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.372+0000 7fac4d35d640 1 --2- 172.21.15.170:0/1854739281 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fac340a1360 0x7fac340a3820 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fac4819a370 tx=0x7fac3000a4c0 comp rx=0 tx=0).stop 2024-01-25T14:59:33.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.372+0000 7fac4d35d640 1 -- 172.21.15.170:0/1854739281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac480ffc30 msgr2=0x7fac48198e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:33.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.372+0000 7fac4d35d640 1 --2- 172.21.15.170:0/1854739281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac480ffc30 0x7fac48198e60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fac3800c970 tx=0x7fac3800ce30 comp rx=0 tx=0).stop 2024-01-25T14:59:33.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.372+0000 7fac4d35d640 1 -- 172.21.15.170:0/1854739281 shutdown_connections 2024-01-25T14:59:33.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.372+0000 7fac4d35d640 1 --2- 172.21.15.170:0/1854739281 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fac340a1360 0x7fac340a3820 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:33.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.372+0000 7fac4d35d640 1 --2- 172.21.15.170:0/1854739281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac481017e0 0x7fac481a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:33.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.372+0000 7fac4d35d640 1 --2- 172.21.15.170:0/1854739281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fac48100e20 0x7fac481993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:33.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.372+0000 7fac4d35d640 1 --2- 172.21.15.170:0/1854739281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fac480ffc30 0x7fac48198e60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:33.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.372+0000 7fac4d35d640 1 -- 172.21.15.170:0/1854739281 >> 172.21.15.170:0/1854739281 conn(0x7fac480fb1a0 msgr2=0x7fac480fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:33.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.372+0000 7fac4d35d640 1 -- 172.21.15.170:0/1854739281 shutdown_connections 2024-01-25T14:59:33.374 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:33.372+0000 7fac4d35d640 1 -- 172.21.15.170:0/1854739281 wait complete. 2024-01-25T14:59:33.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:33 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:33.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:33 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:33.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:33 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:33.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:33 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:33.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:33 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:33.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:33 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:33.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:33 smithi170 ceph-mon[31899]: Deploying daemon mds.c on smithi191 2024-01-25T14:59:33.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:33 smithi170 ceph-mon[31899]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:33.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:33 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.191:6834/1870775954,v1:172.21.15.191:6835/1870775954] up:boot 2024-01-25T14:59:33.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:33 smithi170 ceph-mon[31899]: fsmap 6 up:standby 2024-01-25T14:59:33.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:33 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-01-25T14:59:34.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:34 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1854739281' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:34.234 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 14:59:34 smithi191 systemd[1]: Starting Ceph mds.c for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T14:59:34.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:34 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1854739281' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:34.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:34 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1854739281' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:34.596 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 14:59:34 smithi191 podman[67501]: 2024-01-25 14:59:34.230787715 +0000 UTC m=+0.017515809 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T14:59:34.596 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 14:59:34 smithi191 podman[67501]: 2024-01-25 14:59:34.334922233 +0000 UTC m=+0.121650328 container create 08a2e92cf9f4015e962892e6e650ac5574d513c0564c8f434be5f3977db13fde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3) 2024-01-25T14:59:34.596 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 14:59:34 smithi191 podman[67501]: 2024-01-25 14:59:34.571132336 +0000 UTC m=+0.357860438 container init 08a2e92cf9f4015e962892e6e650ac5574d513c0564c8f434be5f3977db13fde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-01-25T14:59:34.597 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 14:59:34 smithi191 podman[67501]: 2024-01-25 14:59:34.573749712 +0000 UTC m=+0.360477808 container start 08a2e92cf9f4015e962892e6e650ac5574d513c0564c8f434be5f3977db13fde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-01-25T14:59:34.597 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 14:59:34 smithi191 ceph-mds[67520]: -- 172.21.15.191:0/3321340541 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x565543387520 con 0x56554335d000 2024-01-25T14:59:34.983 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 14:59:34 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: starting mds.c at 2024-01-25T14:59:34.984 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 14:59:34 smithi191 bash[67501]: 08a2e92cf9f4015e962892e6e650ac5574d513c0564c8f434be5f3977db13fde 2024-01-25T14:59:34.984 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 14:59:34 smithi191 systemd[1]: Started Ceph mds.c for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:59:35.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:35 smithi186 ceph-mon[35697]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:35.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:35.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:35.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:35 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:35 smithi170 ceph-mon[31899]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:35.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:35 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:35.385 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T14:59:35.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:35 smithi191 ceph-mon[36347]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:35.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:35 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.498+0000 7f647117d640 1 -- 172.21.15.170:0/4098410647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f646c1028d0 msgr2=0x7f646c109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.498+0000 7f647117d640 1 --2- 172.21.15.170:0/4098410647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f646c1028d0 0x7f646c109160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6464009900 tx=0x7f646402bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.498+0000 7f647117d640 1 -- 172.21.15.170:0/4098410647 shutdown_connections 2024-01-25T14:59:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.498+0000 7f647117d640 1 --2- 172.21.15.170:0/4098410647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f646c101f10 0x7f646c102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.498+0000 7f647117d640 1 --2- 172.21.15.170:0/4098410647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f646c1028d0 0x7f646c109160 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.498+0000 7f647117d640 1 --2- 172.21.15.170:0/4098410647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f646c100d20 0x7f646c101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:35.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.498+0000 7f647117d640 1 -- 172.21.15.170:0/4098410647 >> 172.21.15.170:0/4098410647 conn(0x7f646c0fc2d0 msgr2=0x7f646c0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.498+0000 7f647117d640 1 -- 172.21.15.170:0/4098410647 shutdown_connections 2024-01-25T14:59:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.498+0000 7f647117d640 1 -- 172.21.15.170:0/4098410647 wait complete. 2024-01-25T14:59:35.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.498+0000 7f647117d640 1 Processor -- start 2024-01-25T14:59:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f647117d640 1 -- start start 2024-01-25T14:59:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f647117d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f646c100d20 0x7f646c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:35.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f647117d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f646c101f10 0x7f646c0730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f647117d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f646c1028d0 0x7f646c073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f647117d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c073d80 con 0x7f646c101f10 2024-01-25T14:59:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f647117d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c073ef0 con 0x7f646c1028d0 2024-01-25T14:59:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f647117d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646c1a0d10 con 0x7f646c100d20 2024-01-25T14:59:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f646a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f646c101f10 0x7f646c0730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f646a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f646c101f10 0x7f646c0730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42488/0 (socket says 172.21.15.170:42488) 2024-01-25T14:59:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f646a59c640 1 -- 172.21.15.170:0/267903598 learned_addr learned my addr 172.21.15.170:0/267903598 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:35.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f646b59e640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f646c1028d0 0x7f646c073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f646ad9d640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f646c100d20 0x7f646c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f646b59e640 1 -- 172.21.15.170:0/267903598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f646c100d20 msgr2=0x7f646c074aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f646b59e640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f646c100d20 0x7f646c074aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f646b59e640 1 -- 172.21.15.170:0/267903598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f646c101f10 msgr2=0x7f646c0730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f646b59e640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f646c101f10 0x7f646c0730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f646b59e640 1 -- 172.21.15.170:0/267903598 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6460009840 con 0x7f646c1028d0 2024-01-25T14:59:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f646a59c640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f646c101f10 0x7f646c0730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T14:59:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f646ad9d640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f646c100d20 0x7f646c074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T14:59:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.499+0000 7f646b59e640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f646c1028d0 0x7f646c073620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f646402c170 tx=0x7f6464004e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.500+0000 7f6453fff640 1 -- 172.21.15.170:0/267903598 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64640042d0 con 0x7f646c1028d0 2024-01-25T14:59:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.500+0000 7f647117d640 1 -- 172.21.15.170:0/267903598 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6464009560 con 0x7f646c1028d0 2024-01-25T14:59:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.500+0000 7f6453fff640 1 -- 172.21.15.170:0/267903598 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6464004430 con 0x7f646c1028d0 2024-01-25T14:59:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.500+0000 7f647117d640 1 -- 172.21.15.170:0/267903598 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646c1a1260 con 0x7f646c1028d0 2024-01-25T14:59:35.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.500+0000 7f6453fff640 1 -- 172.21.15.170:0/267903598 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464003d20 con 0x7f646c1028d0 2024-01-25T14:59:35.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.501+0000 7f647117d640 1 -- 172.21.15.170:0/267903598 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646c108110 con 0x7f646c1028d0 2024-01-25T14:59:35.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.502+0000 7f6453fff640 1 -- 172.21.15.170:0/267903598 <== mon.2 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f6464005000 con 0x7f646c1028d0 2024-01-25T14:59:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.502+0000 7f6453fff640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f64540a12e0 0x7f64540a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.502+0000 7f646ad9d640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f64540a12e0 0x7f64540a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.502+0000 7f6453fff640 1 -- 172.21.15.170:0/267903598 <== mon.2 v2:172.21.15.186:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f64640eee70 con 0x7f646c1028d0 2024-01-25T14:59:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.503+0000 7f646ad9d640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f64540a12e0 0x7f64540a37a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f646c101d70 tx=0x7f645c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:35.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.506+0000 7f6453fff640 1 -- 172.21.15.170:0/267903598 <== mon.2 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f64640b8890 con 0x7f646c1028d0 2024-01-25T14:59:35.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.713+0000 7f647117d640 1 -- 172.21.15.170:0/267903598 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f646c10c7a0 con 0x7f646c1028d0 2024-01-25T14:59:35.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.714+0000 7f6453fff640 1 -- 172.21.15.170:0/267903598 <== mon.2 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6086 (secure 0 0 0) 0x7f64640bbeb0 con 0x7f646c1028d0 2024-01-25T14:59:35.715 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:35.715 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2024-01-25T14:59:35.715 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 8 2024-01-25T14:59:35.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.716+0000 7f647117d640 1 -- 172.21.15.170:0/267903598 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f64540a12e0 msgr2=0x7f64540a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:35.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.716+0000 7f647117d640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f64540a12e0 0x7f64540a37a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f646c101d70 tx=0x7f645c005f90 comp rx=0 tx=0).stop 2024-01-25T14:59:35.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.716+0000 7f647117d640 1 -- 172.21.15.170:0/267903598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f646c1028d0 msgr2=0x7f646c073620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:35.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.716+0000 7f647117d640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f646c1028d0 0x7f646c073620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f646402c170 tx=0x7f6464004e40 comp rx=0 tx=0).stop 2024-01-25T14:59:35.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.716+0000 7f647117d640 1 -- 172.21.15.170:0/267903598 shutdown_connections 2024-01-25T14:59:35.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.716+0000 7f647117d640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f64540a12e0 0x7f64540a37a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:35.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.716+0000 7f647117d640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f646c1028d0 0x7f646c073620 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:35.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.716+0000 7f647117d640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f646c101f10 0x7f646c0730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:35.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.716+0000 7f647117d640 1 --2- 172.21.15.170:0/267903598 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f646c100d20 0x7f646c074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:35.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.716+0000 7f647117d640 1 -- 172.21.15.170:0/267903598 >> 172.21.15.170:0/267903598 conn(0x7f646c0fc2d0 msgr2=0x7f646c1052e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:35.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.717+0000 7f647117d640 1 -- 172.21.15.170:0/267903598 shutdown_connections 2024-01-25T14:59:35.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:35.717+0000 7f647117d640 1 -- 172.21.15.170:0/267903598 wait complete. 2024-01-25T14:59:36.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:36 smithi186 ceph-mon[35697]: Deploying daemon mds.h on smithi186 2024-01-25T14:59:36.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:36 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] up:boot 2024-01-25T14:59:36.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:36 smithi186 ceph-mon[35697]: fsmap 7 up:standby 2024-01-25T14:59:36.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:36 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-01-25T14:59:36.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:36 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/267903598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:36.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:36 smithi170 ceph-mon[31899]: Deploying daemon mds.h on smithi186 2024-01-25T14:59:36.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:36 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] up:boot 2024-01-25T14:59:36.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:36 smithi170 ceph-mon[31899]: fsmap 7 up:standby 2024-01-25T14:59:36.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:36 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-01-25T14:59:36.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:36 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/267903598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:36.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:36 smithi191 ceph-mon[36347]: Deploying daemon mds.h on smithi186 2024-01-25T14:59:36.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:36 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] up:boot 2024-01-25T14:59:36.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:36 smithi191 ceph-mon[36347]: fsmap 7 up:standby 2024-01-25T14:59:36.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:36 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-01-25T14:59:36.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:36 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/267903598' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:37.048 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 14:59:36 smithi186 systemd[1]: Starting Ceph mds.h for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T14:59:37.326 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:37 smithi186 ceph-mon[35697]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:37.326 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 14:59:37 smithi186 podman[66696]: 2024-01-25 14:59:37.082279498 +0000 UTC m=+0.106359140 container create 0b3ecf66302fb660d88fcb5a8e67fde5d04f5aeba44dc36eea9b439d2535f549 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-h, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T14:59:37.327 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 14:59:37 smithi186 podman[66696]: 2024-01-25 14:59:36.993583514 +0000 UTC m=+0.017663161 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T14:59:37.327 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 14:59:37 smithi186 podman[66696]: 2024-01-25 14:59:37.326331756 +0000 UTC m=+0.350411407 container init 0b3ecf66302fb660d88fcb5a8e67fde5d04f5aeba44dc36eea9b439d2535f549 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-01-25T14:59:37.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:37 smithi170 ceph-mon[31899]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:37.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:37 smithi191 ceph-mon[36347]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:37.604 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 14:59:37 smithi186 podman[66696]: 2024-01-25 14:59:37.329471886 +0000 UTC m=+0.353551531 container start 0b3ecf66302fb660d88fcb5a8e67fde5d04f5aeba44dc36eea9b439d2535f549 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-h, ceph=True, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-01-25T14:59:37.605 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 14:59:37 smithi186 ceph-mds[66714]: -- 172.21.15.186:0/1005702066 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ffc8ffb520 con 0x55ffc8fd0c00 2024-01-25T14:59:37.605 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 14:59:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-h[66710]: starting mds.h at 2024-01-25T14:59:37.605 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 14:59:37 smithi186 bash[66696]: 0b3ecf66302fb660d88fcb5a8e67fde5d04f5aeba44dc36eea9b439d2535f549 2024-01-25T14:59:37.605 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 14:59:37 smithi186 systemd[1]: Started Ceph mds.h for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:59:37.729 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T14:59:37.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.841+0000 7f900e456640 1 -- 172.21.15.170:0/8630532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90080ff000 msgr2=0x7f90080ff420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:37.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.841+0000 7f900e456640 1 --2- 172.21.15.170:0/8630532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90080ff000 0x7f90080ff420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009900 tx=0x7f8ff802bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:37.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.842+0000 7f900e456640 1 -- 172.21.15.170:0/8630532 shutdown_connections 2024-01-25T14:59:37.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.842+0000 7f900e456640 1 --2- 172.21.15.170:0/8630532 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9008102070 0x7f90081024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:37.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.842+0000 7f900e456640 1 --2- 172.21.15.170:0/8630532 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9008102a30 0x7f90081092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:37.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.842+0000 7f900e456640 1 --2- 172.21.15.170:0/8630532 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f90080ff000 0x7f90080ff420 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:37.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.842+0000 7f900e456640 1 -- 172.21.15.170:0/8630532 >> 172.21.15.170:0/8630532 conn(0x7f90080fa910 msgr2=0x7f90080fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:37.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.842+0000 7f900e456640 1 -- 172.21.15.170:0/8630532 shutdown_connections 2024-01-25T14:59:37.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.842+0000 7f900e456640 1 -- 172.21.15.170:0/8630532 wait complete. 2024-01-25T14:59:37.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.842+0000 7f900e456640 1 Processor -- start 2024-01-25T14:59:37.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.842+0000 7f900e456640 1 -- start start 2024-01-25T14:59:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900e456640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90080ff000 0x7f9008196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900e456640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9008102070 0x7f9008197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900e456640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9008102a30 0x7f900819e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900e456640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900819e7d0 con 0x7f9008102a30 2024-01-25T14:59:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900e456640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900819e940 con 0x7f9008102070 2024-01-25T14:59:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900e456640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900819eb00 con 0x7f90080ff000 2024-01-25T14:59:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900c9f3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9008102a30 0x7f900819e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900c9f3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9008102a30 0x7f900819e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42520/0 (socket says 172.21.15.170:42520) 2024-01-25T14:59:37.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900c9f3640 1 -- 172.21.15.170:0/337088844 learned_addr learned my addr 172.21.15.170:0/337088844 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f9007fff640 1 --2- 172.21.15.170:0/337088844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90080ff000 0x7f9008196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f90077fe640 1 --2- 172.21.15.170:0/337088844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9008102070 0x7f9008197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900c9f3640 1 -- 172.21.15.170:0/337088844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90080ff000 msgr2=0x7f9008196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900c9f3640 1 --2- 172.21.15.170:0/337088844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90080ff000 0x7f9008196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900c9f3640 1 -- 172.21.15.170:0/337088844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9008102070 msgr2=0x7f9008197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900c9f3640 1 --2- 172.21.15.170:0/337088844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9008102070 0x7f9008197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900c9f3640 1 -- 172.21.15.170:0/337088844 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8009560 con 0x7f9008102a30 2024-01-25T14:59:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900c9f3640 1 --2- 172.21.15.170:0/337088844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9008102a30 0x7f900819e260 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f900000eb10 tx=0x7f900000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f90057fa640 1 -- 172.21.15.170:0/337088844 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000004b20 con 0x7f9008102a30 2024-01-25T14:59:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f90057fa640 1 -- 172.21.15.170:0/337088844 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9000004c80 con 0x7f9008102a30 2024-01-25T14:59:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900e456640 1 -- 172.21.15.170:0/337088844 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900819ede0 con 0x7f9008102a30 2024-01-25T14:59:37.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f90057fa640 1 -- 172.21.15.170:0/337088844 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000010690 con 0x7f9008102a30 2024-01-25T14:59:37.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.843+0000 7f900e456640 1 -- 172.21.15.170:0/337088844 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900819f200 con 0x7f9008102a30 2024-01-25T14:59:37.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.844+0000 7f900e456640 1 -- 172.21.15.170:0/337088844 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90081081c0 con 0x7f9008102a30 2024-01-25T14:59:37.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.845+0000 7f90057fa640 1 -- 172.21.15.170:0/337088844 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f9000005020 con 0x7f9008102a30 2024-01-25T14:59:37.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.846+0000 7f90057fa640 1 --2- 172.21.15.170:0/337088844 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8ff00a12e0 0x7f8ff00a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:37.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.846+0000 7f9007fff640 1 --2- 172.21.15.170:0/337088844 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8ff00a12e0 0x7f8ff00a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:37.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.846+0000 7f90057fa640 1 -- 172.21.15.170:0/337088844 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9000014070 con 0x7f9008102a30 2024-01-25T14:59:37.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.846+0000 7f9007fff640 1 --2- 172.21.15.170:0/337088844 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8ff00a12e0 0x7f8ff00a37a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8000c00 tx=0x7f8ff802c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:37.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:37.850+0000 7f90057fa640 1 -- 172.21.15.170:0/337088844 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f9000096470 con 0x7f9008102a30 2024-01-25T14:59:38.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:38.060+0000 7f900e456640 1 -- 172.21.15.170:0/337088844 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f900810c5f0 con 0x7f9008102a30 2024-01-25T14:59:38.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:38.060+0000 7f90057fa640 1 -- 172.21.15.170:0/337088844 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6880 (secure 0 0 0) 0x7f90000983a0 con 0x7f9008102a30 2024-01-25T14:59:38.061 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:38.062 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2024-01-25T14:59:38.062 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 9 2024-01-25T14:59:38.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:38.062+0000 7f900e456640 1 -- 172.21.15.170:0/337088844 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8ff00a12e0 msgr2=0x7f8ff00a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:38.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:38.062+0000 7f900e456640 1 --2- 172.21.15.170:0/337088844 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8ff00a12e0 0x7f8ff00a37a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8000c00 tx=0x7f8ff802c5d0 comp rx=0 tx=0).stop 2024-01-25T14:59:38.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:38.062+0000 7f900e456640 1 -- 172.21.15.170:0/337088844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9008102a30 msgr2=0x7f900819e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:38.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:38.062+0000 7f900e456640 1 --2- 172.21.15.170:0/337088844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9008102a30 0x7f900819e260 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f900000eb10 tx=0x7f900000c2d0 comp rx=0 tx=0).stop 2024-01-25T14:59:38.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:38.062+0000 7f900e456640 1 -- 172.21.15.170:0/337088844 shutdown_connections 2024-01-25T14:59:38.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:38.062+0000 7f900e456640 1 --2- 172.21.15.170:0/337088844 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8ff00a12e0 0x7f8ff00a37a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:38.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:38.062+0000 7f900e456640 1 --2- 172.21.15.170:0/337088844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9008102070 0x7f9008197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:38.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:38.062+0000 7f900e456640 1 --2- 172.21.15.170:0/337088844 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9008102a30 0x7f900819e260 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:38.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:38.062+0000 7f900e456640 1 --2- 172.21.15.170:0/337088844 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f90080ff000 0x7f9008196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:38.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:38.062+0000 7f900e456640 1 -- 172.21.15.170:0/337088844 >> 172.21.15.170:0/337088844 conn(0x7f90080fa910 msgr2=0x7f9008105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:38.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:38.062+0000 7f900e456640 1 -- 172.21.15.170:0/337088844 shutdown_connections 2024-01-25T14:59:38.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:38.062+0000 7f900e456640 1 -- 172.21.15.170:0/337088844 wait complete. 2024-01-25T14:59:38.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:38 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:38 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:38 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:38 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:38 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:38 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:38 smithi191 ceph-mon[36347]: Deploying daemon mds.i on smithi191 2024-01-25T14:59:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:38 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.186:6836/2382645540,v1:172.21.15.186:6837/2382645540] up:boot 2024-01-25T14:59:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:38 smithi191 ceph-mon[36347]: fsmap 8 up:standby 2024-01-25T14:59:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:38 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-01-25T14:59:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:38 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/337088844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:38 smithi191 ceph-mon[36347]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:38.739 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:38 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:38.740 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:38 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:38.740 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:38 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:38.740 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:38 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:38.740 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:38 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:38.740 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:38 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:38.740 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:38 smithi186 ceph-mon[35697]: Deploying daemon mds.i on smithi191 2024-01-25T14:59:38.740 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:38 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.186:6836/2382645540,v1:172.21.15.186:6837/2382645540] up:boot 2024-01-25T14:59:38.740 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:38 smithi186 ceph-mon[35697]: fsmap 8 up:standby 2024-01-25T14:59:38.741 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:38 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-01-25T14:59:38.741 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:38 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/337088844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:38.741 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:38 smithi186 ceph-mon[35697]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:38.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:38 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:38.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:38 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:38.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:38 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:38.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:38 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:38.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:38 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:38.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:38 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:38.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:38 smithi170 ceph-mon[31899]: Deploying daemon mds.i on smithi191 2024-01-25T14:59:38.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:38 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.186:6836/2382645540,v1:172.21.15.186:6837/2382645540] up:boot 2024-01-25T14:59:38.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:38 smithi170 ceph-mon[31899]: fsmap 8 up:standby 2024-01-25T14:59:38.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:38 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-01-25T14:59:38.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:38 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/337088844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:38.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:38 smithi170 ceph-mon[31899]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:39.734 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 14:59:39 smithi191 systemd[1]: Starting Ceph mds.i for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T14:59:40.008 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 14:59:39 smithi191 podman[67804]: 2024-01-25 14:59:39.659662628 +0000 UTC m=+0.017106987 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T14:59:40.008 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 14:59:39 smithi191 podman[67804]: 2024-01-25 14:59:39.765082226 +0000 UTC m=+0.122526569 container create 51ab556666d7d11bc742c9b7c6ca49a42fe911d2429eb9dd2f5b1bdd8bf3cf74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i, GIT_CLEAN=True, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-01-25T14:59:40.008 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 14:59:40 smithi191 podman[67804]: 2024-01-25 14:59:40.00833421 +0000 UTC m=+0.365778563 container init 51ab556666d7d11bc742c9b7c6ca49a42fe911d2429eb9dd2f5b1bdd8bf3cf74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-01-25T14:59:40.075 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T14:59:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.191+0000 7f596071d640 1 -- 172.21.15.170:0/377743093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5958104120 msgr2=0x7f5958106510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.191+0000 7f596071d640 1 --2- 172.21.15.170:0/377743093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5958104120 0x7f5958106510 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5948009900 tx=0x7f594802bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.191+0000 7f596071d640 1 -- 172.21.15.170:0/377743093 shutdown_connections 2024-01-25T14:59:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.191+0000 7f596071d640 1 --2- 172.21.15.170:0/377743093 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5958106a50 0x7f5958108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:40.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.191+0000 7f596071d640 1 --2- 172.21.15.170:0/377743093 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5958104120 0x7f5958106510 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:40.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.191+0000 7f596071d640 1 --2- 172.21.15.170:0/377743093 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59581017f0 0x7f5958103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:40.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.191+0000 7f596071d640 1 -- 172.21.15.170:0/377743093 >> 172.21.15.170:0/377743093 conn(0x7f59580fb180 msgr2=0x7f59580fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:40.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.191+0000 7f596071d640 1 -- 172.21.15.170:0/377743093 shutdown_connections 2024-01-25T14:59:40.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.191+0000 7f596071d640 1 -- 172.21.15.170:0/377743093 wait complete. 2024-01-25T14:59:40.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f596071d640 1 Processor -- start 2024-01-25T14:59:40.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f596071d640 1 -- start start 2024-01-25T14:59:40.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f596071d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59581017f0 0x7f5958101160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:40.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f596071d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5958104120 0x7f59580ff7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:40.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f596071d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5958106a50 0x7f59580ffce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:40.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f596071d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5958100440 con 0x7f5958104120 2024-01-25T14:59:40.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f596071d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59581005b0 con 0x7f59581017f0 2024-01-25T14:59:40.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f596071d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59581a0cf0 con 0x7f5958106a50 2024-01-25T14:59:40.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f595dcb8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5958104120 0x7f59580ff7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:40.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f595dcb8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5958104120 0x7f59580ff7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42536/0 (socket says 172.21.15.170:42536) 2024-01-25T14:59:40.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f595dcb8640 1 -- 172.21.15.170:0/4208169159 learned_addr learned my addr 172.21.15.170:0/4208169159 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:40.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f595e4b9640 1 --2- 172.21.15.170:0/4208169159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59581017f0 0x7f5958101160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:40.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f595ecba640 1 --2- 172.21.15.170:0/4208169159 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5958106a50 0x7f59580ffce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:40.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f595dcb8640 1 -- 172.21.15.170:0/4208169159 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5958106a50 msgr2=0x7f59580ffce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:40.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f595dcb8640 1 --2- 172.21.15.170:0/4208169159 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5958106a50 0x7f59580ffce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:40.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f595dcb8640 1 -- 172.21.15.170:0/4208169159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59581017f0 msgr2=0x7f5958101160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:40.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.192+0000 7f595dcb8640 1 --2- 172.21.15.170:0/4208169159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59581017f0 0x7f5958101160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:40.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.193+0000 7f595dcb8640 1 -- 172.21.15.170:0/4208169159 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5948009560 con 0x7f5958104120 2024-01-25T14:59:40.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.193+0000 7f595e4b9640 1 --2- 172.21.15.170:0/4208169159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59581017f0 0x7f5958101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T14:59:40.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.193+0000 7f595dcb8640 1 --2- 172.21.15.170:0/4208169159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5958104120 0x7f59580ff7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5948036040 tx=0x7f59480040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:40.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.193+0000 7f594f7fe640 1 -- 172.21.15.170:0/4208169159 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59480044c0 con 0x7f5958104120 2024-01-25T14:59:40.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.193+0000 7f594f7fe640 1 -- 172.21.15.170:0/4208169159 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59480054c0 con 0x7f5958104120 2024-01-25T14:59:40.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.193+0000 7f596071d640 1 -- 172.21.15.170:0/4208169159 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59581a0f40 con 0x7f5958104120 2024-01-25T14:59:40.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.193+0000 7f594f7fe640 1 -- 172.21.15.170:0/4208169159 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594803e450 con 0x7f5958104120 2024-01-25T14:59:40.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.193+0000 7f596071d640 1 -- 172.21.15.170:0/4208169159 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59581a1410 con 0x7f5958104120 2024-01-25T14:59:40.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.194+0000 7f596071d640 1 -- 172.21.15.170:0/4208169159 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59580fcc70 con 0x7f5958104120 2024-01-25T14:59:40.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.195+0000 7f594f7fe640 1 -- 172.21.15.170:0/4208169159 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f59480036f0 con 0x7f5958104120 2024-01-25T14:59:40.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.196+0000 7f594f7fe640 1 --2- 172.21.15.170:0/4208169159 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f59440a1360 0x7f59440a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:40.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.196+0000 7f595e4b9640 1 --2- 172.21.15.170:0/4208169159 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f59440a1360 0x7f59440a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:40.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.196+0000 7f594f7fe640 1 -- 172.21.15.170:0/4208169159 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f59480eebc0 con 0x7f5958104120 2024-01-25T14:59:40.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.196+0000 7f595e4b9640 1 --2- 172.21.15.170:0/4208169159 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f59440a1360 0x7f59440a3820 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f595400baa0 tx=0x7f5954005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:40.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.201+0000 7f594f7fe640 1 -- 172.21.15.170:0/4208169159 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f59480b84e0 con 0x7f5958104120 2024-01-25T14:59:40.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.418+0000 7f596071d640 1 -- 172.21.15.170:0/4208169159 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f595802cad0 con 0x7f5958104120 2024-01-25T14:59:40.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.419+0000 7f594f7fe640 1 -- 172.21.15.170:0/4208169159 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7676 (secure 0 0 0) 0x7f59480bbb00 con 0x7f5958104120 2024-01-25T14:59:40.420 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:40.420 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-01-25T14:59:40.420 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 10 2024-01-25T14:59:40.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.421+0000 7f596071d640 1 -- 172.21.15.170:0/4208169159 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f59440a1360 msgr2=0x7f59440a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:40.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.421+0000 7f596071d640 1 --2- 172.21.15.170:0/4208169159 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f59440a1360 0x7f59440a3820 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f595400baa0 tx=0x7f5954005d90 comp rx=0 tx=0).stop 2024-01-25T14:59:40.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.421+0000 7f596071d640 1 -- 172.21.15.170:0/4208169159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5958104120 msgr2=0x7f59580ff7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:40.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.421+0000 7f596071d640 1 --2- 172.21.15.170:0/4208169159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5958104120 0x7f59580ff7a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5948036040 tx=0x7f59480040c0 comp rx=0 tx=0).stop 2024-01-25T14:59:40.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.421+0000 7f596071d640 1 -- 172.21.15.170:0/4208169159 shutdown_connections 2024-01-25T14:59:40.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.421+0000 7f596071d640 1 --2- 172.21.15.170:0/4208169159 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f59440a1360 0x7f59440a3820 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:40.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.421+0000 7f596071d640 1 --2- 172.21.15.170:0/4208169159 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5958106a50 0x7f59580ffce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:40.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.421+0000 7f596071d640 1 --2- 172.21.15.170:0/4208169159 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5958104120 0x7f59580ff7a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:40.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.421+0000 7f596071d640 1 --2- 172.21.15.170:0/4208169159 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59581017f0 0x7f5958101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:40.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.421+0000 7f596071d640 1 -- 172.21.15.170:0/4208169159 >> 172.21.15.170:0/4208169159 conn(0x7f59580fb180 msgr2=0x7f5958102150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:40.422 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.421+0000 7f596071d640 1 -- 172.21.15.170:0/4208169159 shutdown_connections 2024-01-25T14:59:40.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:40.421+0000 7f596071d640 1 -- 172.21.15.170:0/4208169159 wait complete. 2024-01-25T14:59:40.484 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 14:59:40 smithi191 podman[67804]: 2024-01-25 14:59:40.01106583 +0000 UTC m=+0.368510180 container start 51ab556666d7d11bc742c9b7c6ca49a42fe911d2429eb9dd2f5b1bdd8bf3cf74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, GIT_CLEAN=True, org.label-schema.build-date=20240123, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T14:59:40.484 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 14:59:40 smithi191 ceph-mds[67824]: -- 172.21.15.191:0/2270092157 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561021cb1520 con 0x561021c87000 2024-01-25T14:59:40.484 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 14:59:40 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i[67820]: starting mds.i at 2024-01-25T14:59:40.484 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 14:59:40 smithi191 bash[67804]: 51ab556666d7d11bc742c9b7c6ca49a42fe911d2429eb9dd2f5b1bdd8bf3cf74 2024-01-25T14:59:40.484 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 14:59:40 smithi191 systemd[1]: Started Ceph mds.i for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:59:41.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:41 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] up:boot 2024-01-25T14:59:41.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:41 smithi186 ceph-mon[35697]: fsmap 9 up:standby 2024-01-25T14:59:41.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:41 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-01-25T14:59:41.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:41 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:41.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:41 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:41.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:41 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:41.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:41 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:41.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:41 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:41.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:41 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:41.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:41 smithi186 ceph-mon[35697]: Deploying daemon mds.g on smithi170 2024-01-25T14:59:41.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:41 smithi186 ceph-mon[35697]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:41.356 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:41 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/4208169159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:41.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:41 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] up:boot 2024-01-25T14:59:41.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:41 smithi170 ceph-mon[31899]: fsmap 9 up:standby 2024-01-25T14:59:41.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:41 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-01-25T14:59:41.376 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:41 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:41.377 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:41 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:41.377 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:41 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:41.377 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:41 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:41.377 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:41 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:41.377 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:41 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:41.377 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:41 smithi170 ceph-mon[31899]: Deploying daemon mds.g on smithi170 2024-01-25T14:59:41.377 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:41 smithi170 ceph-mon[31899]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:41.377 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:41 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/4208169159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:41.429 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:41 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] up:boot 2024-01-25T14:59:41.430 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:41 smithi191 ceph-mon[36347]: fsmap 9 up:standby 2024-01-25T14:59:41.430 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:41 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-01-25T14:59:41.430 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:41 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:41.430 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:41 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:41.430 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:41 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:41.430 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:41 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:41.430 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:41 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:41.430 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:41 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:41.430 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:41 smithi191 ceph-mon[36347]: Deploying daemon mds.g on smithi170 2024-01-25T14:59:41.430 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:41 smithi191 ceph-mon[36347]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:41.430 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:41 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/4208169159' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:42.434 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T14:59:42.462 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 14:59:42 smithi170 systemd[1]: Starting Ceph mds.g for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T14:59:42.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.549+0000 7fd505efc640 1 -- 172.21.15.170:0/1099328070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5000ff770 msgr2=0x7fd500109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:42.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.549+0000 7fd505efc640 1 --2- 172.21.15.170:0/1099328070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5000ff770 0x7fd500109320 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009ca0 tx=0x7fd4f802c0f0 comp rx=0 tx=0).stop 2024-01-25T14:59:42.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.549+0000 7fd505efc640 1 -- 172.21.15.170:0/1099328070 shutdown_connections 2024-01-25T14:59:42.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.549+0000 7fd505efc640 1 --2- 172.21.15.170:0/1099328070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5000fedb0 0x7fd5000ff230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:42.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.549+0000 7fd505efc640 1 --2- 172.21.15.170:0/1099328070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd5000ff770 0x7fd500109320 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:42.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.549+0000 7fd505efc640 1 --2- 172.21.15.170:0/1099328070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd500102340 0x7fd500102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:42.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.549+0000 7fd505efc640 1 -- 172.21.15.170:0/1099328070 >> 172.21.15.170:0/1099328070 conn(0x7fd5000fa930 msgr2=0x7fd5000fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:42.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.549+0000 7fd505efc640 1 -- 172.21.15.170:0/1099328070 shutdown_connections 2024-01-25T14:59:42.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.549+0000 7fd505efc640 1 -- 172.21.15.170:0/1099328070 wait complete. 2024-01-25T14:59:42.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.550+0000 7fd505efc640 1 Processor -- start 2024-01-25T14:59:42.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.550+0000 7fd505efc640 1 -- start start 2024-01-25T14:59:42.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.550+0000 7fd505efc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5000fedb0 0x7fd500196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:42.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.550+0000 7fd505efc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5000ff770 0x7fd500197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:42.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.550+0000 7fd505efc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd500102340 0x7fd50019e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:42.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.550+0000 7fd505efc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50019e7d0 con 0x7fd500102340 2024-01-25T14:59:42.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.550+0000 7fd505efc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50019e940 con 0x7fd5000fedb0 2024-01-25T14:59:42.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.550+0000 7fd505efc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50019eb00 con 0x7fd5000ff770 2024-01-25T14:59:42.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.550+0000 7fd4fffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd500102340 0x7fd50019e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:42.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.550+0000 7fd4fffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd500102340 0x7fd50019e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42562/0 (socket says 172.21.15.170:42562) 2024-01-25T14:59:42.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.550+0000 7fd4fffff640 1 -- 172.21.15.170:0/2617214565 learned_addr learned my addr 172.21.15.170:0/2617214565 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:42.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.550+0000 7fd4f6ffd640 1 --2- 172.21.15.170:0/2617214565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5000ff770 0x7fd500197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:42.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.550+0000 7fd4ff7fe640 1 --2- 172.21.15.170:0/2617214565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5000fedb0 0x7fd500196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:42.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.551+0000 7fd4fffff640 1 -- 172.21.15.170:0/2617214565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5000ff770 msgr2=0x7fd500197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:42.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.551+0000 7fd4fffff640 1 --2- 172.21.15.170:0/2617214565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5000ff770 0x7fd500197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:42.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.551+0000 7fd4fffff640 1 -- 172.21.15.170:0/2617214565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5000fedb0 msgr2=0x7fd500196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:42.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.551+0000 7fd4fffff640 1 --2- 172.21.15.170:0/2617214565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5000fedb0 0x7fd500196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:42.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.551+0000 7fd4fffff640 1 -- 172.21.15.170:0/2617214565 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f8009900 con 0x7fd500102340 2024-01-25T14:59:42.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.551+0000 7fd4ff7fe640 1 --2- 172.21.15.170:0/2617214565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5000fedb0 0x7fd500196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T14:59:42.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.551+0000 7fd4fffff640 1 --2- 172.21.15.170:0/2617214565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd500102340 0x7fd50019e260 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8037040 tx=0x7fd4f8032810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:42.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.551+0000 7fd4fd7fa640 1 -- 172.21.15.170:0/2617214565 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8034c70 con 0x7fd500102340 2024-01-25T14:59:42.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.551+0000 7fd4fd7fa640 1 -- 172.21.15.170:0/2617214565 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4f8003e30 con 0x7fd500102340 2024-01-25T14:59:42.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.551+0000 7fd4fd7fa640 1 -- 172.21.15.170:0/2617214565 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f803d3f0 con 0x7fd500102340 2024-01-25T14:59:42.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.551+0000 7fd505efc640 1 -- 172.21.15.170:0/2617214565 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50019ed80 con 0x7fd500102340 2024-01-25T14:59:42.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.551+0000 7fd505efc640 1 -- 172.21.15.170:0/2617214565 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50019f200 con 0x7fd500102340 2024-01-25T14:59:42.555 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.552+0000 7fd505efc640 1 -- 172.21.15.170:0/2617214565 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd500108200 con 0x7fd500102340 2024-01-25T14:59:42.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.553+0000 7fd4fd7fa640 1 -- 172.21.15.170:0/2617214565 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fd4f803b040 con 0x7fd500102340 2024-01-25T14:59:42.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.554+0000 7fd4fd7fa640 1 --2- 172.21.15.170:0/2617214565 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd4ec0a12e0 0x7fd4ec0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:42.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.554+0000 7fd4ff7fe640 1 --2- 172.21.15.170:0/2617214565 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd4ec0a12e0 0x7fd4ec0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:42.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.554+0000 7fd4fd7fa640 1 -- 172.21.15.170:0/2617214565 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd4f80eeee0 con 0x7fd500102340 2024-01-25T14:59:42.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.554+0000 7fd4ff7fe640 1 --2- 172.21.15.170:0/2617214565 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd4ec0a12e0 0x7fd4ec0a37a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0005fd0 tx=0x7fd4f0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:42.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.558+0000 7fd4fd7fa640 1 -- 172.21.15.170:0/2617214565 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fd4f80b8770 con 0x7fd500102340 2024-01-25T14:59:42.731 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 14:59:42 smithi170 podman[73247]: 2024-01-25 14:59:42.4979679 +0000 UTC m=+0.020117005 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T14:59:42.731 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 14:59:42 smithi170 podman[73247]: 2024-01-25 14:59:42.630336289 +0000 UTC m=+0.152485372 container create 4ba03dbf60228c37bf67067922ad0dd884048c02574566d30a0d3a2ba41121bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-g, org.label-schema.build-date=20240123, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-25T14:59:42.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.771+0000 7fd505efc640 1 -- 172.21.15.170:0/2617214565 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd50010c8d0 con 0x7fd500102340 2024-01-25T14:59:42.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.772+0000 7fd4fd7fa640 1 -- 172.21.15.170:0/2617214565 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7676 (secure 0 0 0) 0x7fd4f80ba6a0 con 0x7fd500102340 2024-01-25T14:59:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:42.773 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-01-25T14:59:42.773 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 10 2024-01-25T14:59:42.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.774+0000 7fd505efc640 1 -- 172.21.15.170:0/2617214565 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd4ec0a12e0 msgr2=0x7fd4ec0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:42.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.774+0000 7fd505efc640 1 --2- 172.21.15.170:0/2617214565 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd4ec0a12e0 0x7fd4ec0a37a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd4f0005fd0 tx=0x7fd4f0005850 comp rx=0 tx=0).stop 2024-01-25T14:59:42.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.774+0000 7fd505efc640 1 -- 172.21.15.170:0/2617214565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd500102340 msgr2=0x7fd50019e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:42.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.774+0000 7fd505efc640 1 --2- 172.21.15.170:0/2617214565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd500102340 0x7fd50019e260 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8037040 tx=0x7fd4f8032810 comp rx=0 tx=0).stop 2024-01-25T14:59:42.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.774+0000 7fd505efc640 1 -- 172.21.15.170:0/2617214565 shutdown_connections 2024-01-25T14:59:42.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.774+0000 7fd505efc640 1 --2- 172.21.15.170:0/2617214565 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd4ec0a12e0 0x7fd4ec0a37a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:42.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.774+0000 7fd505efc640 1 --2- 172.21.15.170:0/2617214565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd500102340 0x7fd50019e260 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:42.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.774+0000 7fd505efc640 1 --2- 172.21.15.170:0/2617214565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd5000ff770 0x7fd500197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:42.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.774+0000 7fd505efc640 1 --2- 172.21.15.170:0/2617214565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5000fedb0 0x7fd500196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:42.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.774+0000 7fd505efc640 1 -- 172.21.15.170:0/2617214565 >> 172.21.15.170:0/2617214565 conn(0x7fd5000fa930 msgr2=0x7fd5001053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:42.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.774+0000 7fd505efc640 1 -- 172.21.15.170:0/2617214565 shutdown_connections 2024-01-25T14:59:42.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:42.774+0000 7fd505efc640 1 -- 172.21.15.170:0/2617214565 wait complete. 2024-01-25T14:59:43.124 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 14:59:42 smithi170 podman[73247]: 2024-01-25 14:59:42.832889652 +0000 UTC m=+0.355038740 container init 4ba03dbf60228c37bf67067922ad0dd884048c02574566d30a0d3a2ba41121bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-g, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T14:59:43.124 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 14:59:42 smithi170 podman[73247]: 2024-01-25 14:59:42.835698907 +0000 UTC m=+0.357847997 container start 4ba03dbf60228c37bf67067922ad0dd884048c02574566d30a0d3a2ba41121bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-g, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, ceph=True, GIT_CLEAN=True) 2024-01-25T14:59:43.124 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 14:59:42 smithi170 ceph-mds[73286]: -- 172.21.15.170:0/2333107313 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c33336f520 con 0x55c333345000 2024-01-25T14:59:43.124 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 14:59:42 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-g[73280]: starting mds.g at 2024-01-25T14:59:43.124 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 14:59:42 smithi170 bash[73247]: 4ba03dbf60228c37bf67067922ad0dd884048c02574566d30a0d3a2ba41121bd 2024-01-25T14:59:43.125 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 14:59:42 smithi170 systemd[1]: Started Ceph mds.g for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:59:43.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:43 smithi186 ceph-mon[35697]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:43.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:43 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2617214565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:43.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:43 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:43.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:43 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:43.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:43 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:43.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:43 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:43.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:43 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:43.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:43 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:43.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:43 smithi170 ceph-mon[31899]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:43.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:43 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2617214565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:43.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:43 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:43.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:43 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:43.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:43 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:43.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:43 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:43.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:43 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:43.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:43 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:43.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:43 smithi191 ceph-mon[36347]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:43.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:43 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2617214565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:43.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:43 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:43.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:43 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:43.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:43 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:43.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:43 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:43.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:43 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:43.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:43 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:44.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:44 smithi186 ceph-mon[35697]: Deploying daemon mds.a on smithi170 2024-01-25T14:59:44.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:44 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.170:6838/3528948477,v1:172.21.15.170:6839/3528948477] up:boot 2024-01-25T14:59:44.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:44 smithi186 ceph-mon[35697]: fsmap 10 up:standby 2024-01-25T14:59:44.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:44 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-25T14:59:44.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:44 smithi170 ceph-mon[31899]: Deploying daemon mds.a on smithi170 2024-01-25T14:59:44.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:44 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.170:6838/3528948477,v1:172.21.15.170:6839/3528948477] up:boot 2024-01-25T14:59:44.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:44 smithi170 ceph-mon[31899]: fsmap 10 up:standby 2024-01-25T14:59:44.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:44 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-25T14:59:44.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:44 smithi191 ceph-mon[36347]: Deploying daemon mds.a on smithi170 2024-01-25T14:59:44.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:44 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.170:6838/3528948477,v1:172.21.15.170:6839/3528948477] up:boot 2024-01-25T14:59:44.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:44 smithi191 ceph-mon[36347]: fsmap 10 up:standby 2024-01-25T14:59:44.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:44 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-25T14:59:44.787 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T14:59:44.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.982+0000 7f4756b82640 1 -- 172.21.15.170:0/357289659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47500ffc10 msgr2=0x7f4750100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:44.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.982+0000 7f4756b82640 1 --2- 172.21.15.170:0/357289659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47500ffc10 0x7f4750100030 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4744009900 tx=0x7f474402bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:44.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.982+0000 7f4756b82640 1 -- 172.21.15.170:0/357289659 shutdown_connections 2024-01-25T14:59:44.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.982+0000 7f4756b82640 1 --2- 172.21.15.170:0/357289659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4750100e00 0x7f4750101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:44.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.982+0000 7f4756b82640 1 --2- 172.21.15.170:0/357289659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47501017c0 0x7f4750108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:44.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.982+0000 7f4756b82640 1 --2- 172.21.15.170:0/357289659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47500ffc10 0x7f4750100030 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:44.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.982+0000 7f4756b82640 1 -- 172.21.15.170:0/357289659 >> 172.21.15.170:0/357289659 conn(0x7f47500fb180 msgr2=0x7f47500fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:44.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.982+0000 7f4756b82640 1 -- 172.21.15.170:0/357289659 shutdown_connections 2024-01-25T14:59:44.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.982+0000 7f4756b82640 1 -- 172.21.15.170:0/357289659 wait complete. 2024-01-25T14:59:44.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f4756b82640 1 Processor -- start 2024-01-25T14:59:44.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f4756b82640 1 -- start start 2024-01-25T14:59:44.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f4756b82640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47500ffc10 0x7f47500689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:44.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f4756b82640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4750100e00 0x7f475019ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:44.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f4756b82640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47501017c0 0x7f475019e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:44.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f4756b82640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475019e800 con 0x7f47500ffc10 2024-01-25T14:59:44.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f4756b82640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475019e970 con 0x7f47501017c0 2024-01-25T14:59:44.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f4756b82640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475019eb30 con 0x7f4750100e00 2024-01-25T14:59:44.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f475491e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47500ffc10 0x7f47500689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:44.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f475491e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47500ffc10 0x7f47500689c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42622/0 (socket says 172.21.15.170:42622) 2024-01-25T14:59:44.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f475491e640 1 -- 172.21.15.170:0/847048968 learned_addr learned my addr 172.21.15.170:0/847048968 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:44.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f475511f640 1 --2- 172.21.15.170:0/847048968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47501017c0 0x7f475019e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:44.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f475491e640 1 -- 172.21.15.170:0/847048968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4750100e00 msgr2=0x7f475019ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:44.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f474ffff640 1 --2- 172.21.15.170:0/847048968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4750100e00 0x7f475019ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:44.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f475491e640 1 --2- 172.21.15.170:0/847048968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4750100e00 0x7f475019ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:44.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f475491e640 1 -- 172.21.15.170:0/847048968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47501017c0 msgr2=0x7f475019e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:44.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f475491e640 1 --2- 172.21.15.170:0/847048968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47501017c0 0x7f475019e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:44.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f475491e640 1 -- 172.21.15.170:0/847048968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744009560 con 0x7f47500ffc10 2024-01-25T14:59:44.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f475511f640 1 --2- 172.21.15.170:0/847048968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47501017c0 0x7f475019e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T14:59:44.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.983+0000 7f475491e640 1 --2- 172.21.15.170:0/847048968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47500ffc10 0x7f47500689c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4744009230 tx=0x7f4744004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:44.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.984+0000 7f474dffb640 1 -- 172.21.15.170:0/847048968 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47440042d0 con 0x7f47500ffc10 2024-01-25T14:59:44.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.984+0000 7f4756b82640 1 -- 172.21.15.170:0/847048968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475019ed50 con 0x7f47500ffc10 2024-01-25T14:59:44.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.984+0000 7f474dffb640 1 -- 172.21.15.170:0/847048968 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4744004430 con 0x7f47500ffc10 2024-01-25T14:59:44.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.984+0000 7f474dffb640 1 -- 172.21.15.170:0/847048968 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4744003d10 con 0x7f47500ffc10 2024-01-25T14:59:44.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.984+0000 7f4756b82640 1 -- 172.21.15.170:0/847048968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475019f1a0 con 0x7f47500ffc10 2024-01-25T14:59:44.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.985+0000 7f4756b82640 1 -- 172.21.15.170:0/847048968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4750106f50 con 0x7f47500ffc10 2024-01-25T14:59:44.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.986+0000 7f474dffb640 1 -- 172.21.15.170:0/847048968 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f4744005000 con 0x7f47500ffc10 2024-01-25T14:59:44.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.987+0000 7f474dffb640 1 --2- 172.21.15.170:0/847048968 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f47400a12e0 0x7f47400a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:44.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.987+0000 7f474ffff640 1 --2- 172.21.15.170:0/847048968 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f47400a12e0 0x7f47400a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:44.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.987+0000 7f474dffb640 1 -- 172.21.15.170:0/847048968 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f47440ef420 con 0x7f47500ffc10 2024-01-25T14:59:44.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.988+0000 7f474ffff640 1 --2- 172.21.15.170:0/847048968 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f47400a12e0 0x7f47400a37a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4750068730 tx=0x7f473c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:44.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:44.995+0000 7f474dffb640 1 -- 172.21.15.170:0/847048968 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f47440b8ca0 con 0x7f47500ffc10 2024-01-25T14:59:45.180 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 14:59:45 smithi170 systemd[1]: Starting Ceph mds.a for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T14:59:45.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:45.244+0000 7f4756b82640 1 -- 172.21.15.170:0/847048968 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f475010b4d0 con 0x7f47500ffc10 2024-01-25T14:59:45.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:45.246+0000 7f474dffb640 1 -- 172.21.15.170:0/847048968 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8471 (secure 0 0 0) 0x7f47440bc2c0 con 0x7f47500ffc10 2024-01-25T14:59:45.247 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:45.247 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-01-25T14:59:45.247 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 11 2024-01-25T14:59:45.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:45.248+0000 7f4756b82640 1 -- 172.21.15.170:0/847048968 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f47400a12e0 msgr2=0x7f47400a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:45.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:45.248+0000 7f4756b82640 1 --2- 172.21.15.170:0/847048968 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f47400a12e0 0x7f47400a37a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4750068730 tx=0x7f473c005f90 comp rx=0 tx=0).stop 2024-01-25T14:59:45.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:45.248+0000 7f4756b82640 1 -- 172.21.15.170:0/847048968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47500ffc10 msgr2=0x7f47500689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:45.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:45.248+0000 7f4756b82640 1 --2- 172.21.15.170:0/847048968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47500ffc10 0x7f47500689c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4744009230 tx=0x7f4744004dd0 comp rx=0 tx=0).stop 2024-01-25T14:59:45.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:45.248+0000 7f4756b82640 1 -- 172.21.15.170:0/847048968 shutdown_connections 2024-01-25T14:59:45.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:45.248+0000 7f4756b82640 1 --2- 172.21.15.170:0/847048968 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f47400a12e0 0x7f47400a37a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:45.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:45.248+0000 7f4756b82640 1 --2- 172.21.15.170:0/847048968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47501017c0 0x7f475019e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:45.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:45.248+0000 7f4756b82640 1 --2- 172.21.15.170:0/847048968 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4750100e00 0x7f475019ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:45.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:45.248+0000 7f4756b82640 1 --2- 172.21.15.170:0/847048968 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47500ffc10 0x7f47500689c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:45.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:45.248+0000 7f4756b82640 1 -- 172.21.15.170:0/847048968 >> 172.21.15.170:0/847048968 conn(0x7f47500fb180 msgr2=0x7f4750104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:45.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:45.248+0000 7f4756b82640 1 -- 172.21.15.170:0/847048968 shutdown_connections 2024-01-25T14:59:45.250 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:45.248+0000 7f4756b82640 1 -- 172.21.15.170:0/847048968 wait complete. 2024-01-25T14:59:45.538 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:45 smithi170 ceph-mon[31899]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:45.538 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:45 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/847048968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:45.538 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 14:59:45 smithi170 podman[73609]: 2024-01-25 14:59:45.266488088 +0000 UTC m=+0.020307328 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T14:59:45.538 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 14:59:45 smithi170 podman[73609]: 2024-01-25 14:59:45.377777709 +0000 UTC m=+0.131596949 container create 7357d6d22f957d193d601a5dcebc6e663e4bf92ee967529ac714ae0aef45c75e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3) 2024-01-25T14:59:45.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:45 smithi186 ceph-mon[35697]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:45.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:45 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/847048968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:45.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:45 smithi191 ceph-mon[36347]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:45.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:45 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/847048968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:45.874 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 14:59:45 smithi170 podman[73609]: 2024-01-25 14:59:45.655692749 +0000 UTC m=+0.409511982 container init 7357d6d22f957d193d601a5dcebc6e663e4bf92ee967529ac714ae0aef45c75e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-01-25T14:59:45.874 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 14:59:45 smithi170 podman[73609]: 2024-01-25 14:59:45.658577426 +0000 UTC m=+0.412396669 container start 7357d6d22f957d193d601a5dcebc6e663e4bf92ee967529ac714ae0aef45c75e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-01-25T14:59:45.874 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 14:59:45 smithi170 ceph-mds[73641]: -- 172.21.15.170:0/3108279064 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557deaf4b520 con 0x557deaf20c00 2024-01-25T14:59:45.874 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 14:59:45 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-a[73635]: starting mds.a at 2024-01-25T14:59:45.874 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 14:59:45 smithi170 bash[73609]: 7357d6d22f957d193d601a5dcebc6e663e4bf92ee967529ac714ae0aef45c75e 2024-01-25T14:59:45.875 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 14:59:45 smithi170 systemd[1]: Started Ceph mds.a for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:59:47.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:47.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:47.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:47.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:47.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:47.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:47.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:46 smithi186 ceph-mon[35697]: Deploying daemon mds.b on smithi186 2024-01-25T14:59:47.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:46 smithi186 ceph-mon[35697]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:47.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:46 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.170:6840/2918388059,v1:172.21.15.170:6841/2918388059] up:boot 2024-01-25T14:59:47.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:46 smithi186 ceph-mon[35697]: fsmap 11 up:standby 2024-01-25T14:59:47.105 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:46 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-25T14:59:47.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:47.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:47.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:47.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:47.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:47.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:47.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:46 smithi170 ceph-mon[31899]: Deploying daemon mds.b on smithi186 2024-01-25T14:59:47.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:46 smithi170 ceph-mon[31899]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:47.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:46 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.170:6840/2918388059,v1:172.21.15.170:6841/2918388059] up:boot 2024-01-25T14:59:47.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:46 smithi170 ceph-mon[31899]: fsmap 11 up:standby 2024-01-25T14:59:47.125 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:46 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-25T14:59:47.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:47.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:47.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:47.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-01-25T14:59:47.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-01-25T14:59:47.234 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:47.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:46 smithi191 ceph-mon[36347]: Deploying daemon mds.b on smithi186 2024-01-25T14:59:47.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:46 smithi191 ceph-mon[36347]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:47.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:46 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.170:6840/2918388059,v1:172.21.15.170:6841/2918388059] up:boot 2024-01-25T14:59:47.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:46 smithi191 ceph-mon[36347]: fsmap 11 up:standby 2024-01-25T14:59:47.235 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:46 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-25T14:59:47.266 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T14:59:47.386 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.383+0000 7fa653f7c640 1 -- 172.21.15.170:0/4140443748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa64c101f00 msgr2=0x7fa64c102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.383+0000 7fa653f7c640 1 --2- 172.21.15.170:0/4140443748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa64c101f00 0x7fa64c102380 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa63c009900 tx=0x7fa63c02bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.383+0000 7fa653f7c640 1 -- 172.21.15.170:0/4140443748 shutdown_connections 2024-01-25T14:59:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.383+0000 7fa653f7c640 1 --2- 172.21.15.170:0/4140443748 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa64c1028c0 0x7fa64c109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.383+0000 7fa653f7c640 1 --2- 172.21.15.170:0/4140443748 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa64c101f00 0x7fa64c102380 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.383+0000 7fa653f7c640 1 --2- 172.21.15.170:0/4140443748 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa64c100d10 0x7fa64c101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.383+0000 7fa653f7c640 1 -- 172.21.15.170:0/4140443748 >> 172.21.15.170:0/4140443748 conn(0x7fa64c0fc2a0 msgr2=0x7fa64c0fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.383+0000 7fa653f7c640 1 -- 172.21.15.170:0/4140443748 shutdown_connections 2024-01-25T14:59:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.383+0000 7fa653f7c640 1 -- 172.21.15.170:0/4140443748 wait complete. 2024-01-25T14:59:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa653f7c640 1 Processor -- start 2024-01-25T14:59:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa653f7c640 1 -- start start 2024-01-25T14:59:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa653f7c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa64c100d10 0x7fa64c196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:47.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa653f7c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa64c101f00 0x7fa64c197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:47.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa653f7c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa64c1028c0 0x7fa64c19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:47.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa653f7c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c19e7e0 con 0x7fa64c100d10 2024-01-25T14:59:47.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa653f7c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c19e950 con 0x7fa64c101f00 2024-01-25T14:59:47.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa653f7c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa64c19eb10 con 0x7fa64c1028c0 2024-01-25T14:59:47.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa651d18640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa64c100d10 0x7fa64c196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:47.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa651d18640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa64c100d10 0x7fa64c196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:48990/0 (socket says 172.21.15.170:48990) 2024-01-25T14:59:47.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa651d18640 1 -- 172.21.15.170:0/2465882054 learned_addr learned my addr 172.21.15.170:0/2465882054 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:47.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa651517640 1 --2- 172.21.15.170:0/2465882054 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa64c101f00 0x7fa64c197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:47.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa652519640 1 --2- 172.21.15.170:0/2465882054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa64c1028c0 0x7fa64c19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:47.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa651d18640 1 -- 172.21.15.170:0/2465882054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa64c1028c0 msgr2=0x7fa64c19e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:47.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa651d18640 1 --2- 172.21.15.170:0/2465882054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa64c1028c0 0x7fa64c19e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:47.388 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa651d18640 1 -- 172.21.15.170:0/2465882054 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa64c101f00 msgr2=0x7fa64c197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:47.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa651d18640 1 --2- 172.21.15.170:0/2465882054 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa64c101f00 0x7fa64c197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:47.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa651d18640 1 -- 172.21.15.170:0/2465882054 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c009560 con 0x7fa64c100d10 2024-01-25T14:59:47.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa652519640 1 --2- 172.21.15.170:0/2465882054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa64c1028c0 0x7fa64c19e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T14:59:47.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.384+0000 7fa651d18640 1 --2- 172.21.15.170:0/2465882054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa64c100d10 0x7fa64c196d00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa64800c970 tx=0x7fa64800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:47.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.385+0000 7fa642ffd640 1 -- 172.21.15.170:0/2465882054 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648004220 con 0x7fa64c100d10 2024-01-25T14:59:47.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.385+0000 7fa642ffd640 1 -- 172.21.15.170:0/2465882054 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa648007e70 con 0x7fa64c100d10 2024-01-25T14:59:47.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.385+0000 7fa653f7c640 1 -- 172.21.15.170:0/2465882054 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64c19edf0 con 0x7fa64c100d10 2024-01-25T14:59:47.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.385+0000 7fa642ffd640 1 -- 172.21.15.170:0/2465882054 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648003e60 con 0x7fa64c100d10 2024-01-25T14:59:47.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.385+0000 7fa653f7c640 1 -- 172.21.15.170:0/2465882054 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64c19f210 con 0x7fa64c100d10 2024-01-25T14:59:47.389 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.386+0000 7fa653f7c640 1 -- 172.21.15.170:0/2465882054 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa64c108050 con 0x7fa64c100d10 2024-01-25T14:59:47.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.387+0000 7fa642ffd640 1 -- 172.21.15.170:0/2465882054 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fa6480079b0 con 0x7fa64c100d10 2024-01-25T14:59:47.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.387+0000 7fa642ffd640 1 --2- 172.21.15.170:0/2465882054 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa6380a12e0 0x7fa6380a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:47.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.387+0000 7fa642ffd640 1 -- 172.21.15.170:0/2465882054 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa6480cc3f0 con 0x7fa64c100d10 2024-01-25T14:59:47.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.387+0000 7fa651517640 1 --2- 172.21.15.170:0/2465882054 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa6380a12e0 0x7fa6380a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:47.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.388+0000 7fa651517640 1 --2- 172.21.15.170:0/2465882054 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa6380a12e0 0x7fa6380a37a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa63c005ab0 tx=0x7fa63c02c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:47.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.392+0000 7fa642ffd640 1 -- 172.21.15.170:0/2465882054 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa648095c80 con 0x7fa64c100d10 2024-01-25T14:59:47.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.599+0000 7fa653f7c640 1 -- 172.21.15.170:0/2465882054 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa64c10c5b0 con 0x7fa64c100d10 2024-01-25T14:59:47.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.600+0000 7fa642ffd640 1 -- 172.21.15.170:0/2465882054 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9266 (secure 0 0 0) 0x7fa648097bb0 con 0x7fa64c100d10 2024-01-25T14:59:47.601 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:47.601 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-01-25T14:59:47.601 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 12 2024-01-25T14:59:47.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.602+0000 7fa653f7c640 1 -- 172.21.15.170:0/2465882054 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa6380a12e0 msgr2=0x7fa6380a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:47.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.602+0000 7fa653f7c640 1 --2- 172.21.15.170:0/2465882054 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa6380a12e0 0x7fa6380a37a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa63c005ab0 tx=0x7fa63c02c5d0 comp rx=0 tx=0).stop 2024-01-25T14:59:47.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.602+0000 7fa653f7c640 1 -- 172.21.15.170:0/2465882054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa64c100d10 msgr2=0x7fa64c196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:47.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.602+0000 7fa653f7c640 1 --2- 172.21.15.170:0/2465882054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa64c100d10 0x7fa64c196d00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa64800c970 tx=0x7fa64800ce30 comp rx=0 tx=0).stop 2024-01-25T14:59:47.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.602+0000 7fa653f7c640 1 -- 172.21.15.170:0/2465882054 shutdown_connections 2024-01-25T14:59:47.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.602+0000 7fa653f7c640 1 --2- 172.21.15.170:0/2465882054 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa6380a12e0 0x7fa6380a37a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:47.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.602+0000 7fa653f7c640 1 --2- 172.21.15.170:0/2465882054 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa64c101f00 0x7fa64c197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:47.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.602+0000 7fa653f7c640 1 --2- 172.21.15.170:0/2465882054 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa64c1028c0 0x7fa64c19e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:47.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.602+0000 7fa653f7c640 1 --2- 172.21.15.170:0/2465882054 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa64c100d10 0x7fa64c196d00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:47.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.602+0000 7fa653f7c640 1 -- 172.21.15.170:0/2465882054 >> 172.21.15.170:0/2465882054 conn(0x7fa64c0fc2a0 msgr2=0x7fa64c105220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:47.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.602+0000 7fa653f7c640 1 -- 172.21.15.170:0/2465882054 shutdown_connections 2024-01-25T14:59:47.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:47.602+0000 7fa653f7c640 1 -- 172.21.15.170:0/2465882054 wait complete. 2024-01-25T14:59:47.873 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:47 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2465882054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:48.104 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:47 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2465882054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:48.105 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 14:59:47 smithi186 systemd[1]: Starting Ceph mds.b for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T14:59:48.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:47 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2465882054' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:48.464 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 14:59:48 smithi186 podman[67015]: 2024-01-25 14:59:48.108259712 +0000 UTC m=+0.017420127 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T14:59:48.464 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 14:59:48 smithi186 podman[67015]: 2024-01-25 14:59:48.210326967 +0000 UTC m=+0.119487369 container create 2d011732f152b4bb408c8ddd615e01e5060fef9dd101a69f89df2dcd7cb02b8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-01-25T14:59:48.464 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 14:59:48 smithi186 podman[67015]: 2024-01-25 14:59:48.438199885 +0000 UTC m=+0.347360290 container init 2d011732f152b4bb408c8ddd615e01e5060fef9dd101a69f89df2dcd7cb02b8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-01-25T14:59:48.464 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 14:59:48 smithi186 podman[67015]: 2024-01-25 14:59:48.44087005 +0000 UTC m=+0.350030455 container start 2d011732f152b4bb408c8ddd615e01e5060fef9dd101a69f89df2dcd7cb02b8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-01-25T14:59:48.854 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 14:59:48 smithi186 ceph-mds[67036]: -- 172.21.15.186:0/1074563525 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555ad35cb520 con 0x555ad35a0800 2024-01-25T14:59:48.854 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 14:59:48 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: starting mds.b at 2024-01-25T14:59:48.854 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 14:59:48 smithi186 bash[67015]: 2d011732f152b4bb408c8ddd615e01e5060fef9dd101a69f89df2dcd7cb02b8d 2024-01-25T14:59:48.854 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 14:59:48 smithi186 systemd[1]: Started Ceph mds.b for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T14:59:49.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:49 smithi186 ceph-mon[35697]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:49.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:49 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:49.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:49 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:49.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:49 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:49.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:49 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:49.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:49 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:49.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:49 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:59:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:49 smithi170 ceph-mon[31899]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:49 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:49 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:49 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:49 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:49 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:49 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:59:49.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:49 smithi191 ceph-mon[36347]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:49.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:49 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:49.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:49 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:49.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:49 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:49.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:49 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:49.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:49 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:49.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:49 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:59:49.617 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T14:59:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.723+0000 7f6e2651d640 1 -- 172.21.15.170:0/3041393939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e201017a0 msgr2=0x7f6e20103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.723+0000 7f6e2651d640 1 --2- 172.21.15.170:0/3041393939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e201017a0 0x7f6e20103b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009900 tx=0x7f6e1002bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.723+0000 7f6e2651d640 1 -- 172.21.15.170:0/3041393939 shutdown_connections 2024-01-25T14:59:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.723+0000 7f6e2651d640 1 --2- 172.21.15.170:0/3041393939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e201040d0 0x7f6e201064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.723+0000 7f6e2651d640 1 --2- 172.21.15.170:0/3041393939 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e20106a00 0x7f6e20108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.723+0000 7f6e2651d640 1 --2- 172.21.15.170:0/3041393939 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e201017a0 0x7f6e20103b90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.723+0000 7f6e2651d640 1 -- 172.21.15.170:0/3041393939 >> 172.21.15.170:0/3041393939 conn(0x7f6e200fb1b0 msgr2=0x7f6e200fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.723+0000 7f6e2651d640 1 -- 172.21.15.170:0/3041393939 shutdown_connections 2024-01-25T14:59:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.723+0000 7f6e2651d640 1 -- 172.21.15.170:0/3041393939 wait complete. 2024-01-25T14:59:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.723+0000 7f6e2651d640 1 Processor -- start 2024-01-25T14:59:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e2651d640 1 -- start start 2024-01-25T14:59:49.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e2651d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e201017a0 0x7f6e20196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:49.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e2651d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e201040d0 0x7f6e20197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:49.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e2651d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e20106a00 0x7f6e2019e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:49.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e2651d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2019e810 con 0x7f6e20106a00 2024-01-25T14:59:49.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e2651d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2019e980 con 0x7f6e201017a0 2024-01-25T14:59:49.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e2651d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2019eb40 con 0x7f6e201040d0 2024-01-25T14:59:49.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e24aba640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e20106a00 0x7f6e2019e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:49.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e24aba640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e20106a00 0x7f6e2019e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49000/0 (socket says 172.21.15.170:49000) 2024-01-25T14:59:49.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e24aba640 1 -- 172.21.15.170:0/1859799010 learned_addr learned my addr 172.21.15.170:0/1859799010 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:49.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e1f7fe640 1 --2- 172.21.15.170:0/1859799010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e201040d0 0x7f6e20197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:49.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e1ffff640 1 --2- 172.21.15.170:0/1859799010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e201017a0 0x7f6e20196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:49.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e24aba640 1 -- 172.21.15.170:0/1859799010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e201040d0 msgr2=0x7f6e20197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:49.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e24aba640 1 --2- 172.21.15.170:0/1859799010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e201040d0 0x7f6e20197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:49.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e24aba640 1 -- 172.21.15.170:0/1859799010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e201017a0 msgr2=0x7f6e20196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:49.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.724+0000 7f6e24aba640 1 --2- 172.21.15.170:0/1859799010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e201017a0 0x7f6e20196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:49.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.725+0000 7f6e24aba640 1 -- 172.21.15.170:0/1859799010 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e10009560 con 0x7f6e20106a00 2024-01-25T14:59:49.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.725+0000 7f6e1f7fe640 1 --2- 172.21.15.170:0/1859799010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e201040d0 0x7f6e20197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T14:59:49.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.725+0000 7f6e24aba640 1 --2- 172.21.15.170:0/1859799010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e20106a00 0x7f6e2019e2a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800eaa0 tx=0x7f6e1800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:49.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.725+0000 7f6e1d7fa640 1 -- 172.21.15.170:0/1859799010 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1800cdb0 con 0x7f6e20106a00 2024-01-25T14:59:49.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.725+0000 7f6e1d7fa640 1 -- 172.21.15.170:0/1859799010 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e18005020 con 0x7f6e20106a00 2024-01-25T14:59:49.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.725+0000 7f6e2651d640 1 -- 172.21.15.170:0/1859799010 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2019ee20 con 0x7f6e20106a00 2024-01-25T14:59:49.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.725+0000 7f6e1d7fa640 1 -- 172.21.15.170:0/1859799010 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e180116d0 con 0x7f6e20106a00 2024-01-25T14:59:49.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.725+0000 7f6e2651d640 1 -- 172.21.15.170:0/1859799010 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2019f1f0 con 0x7f6e20106a00 2024-01-25T14:59:49.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.726+0000 7f6e2651d640 1 -- 172.21.15.170:0/1859799010 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e200fcca0 con 0x7f6e20106a00 2024-01-25T14:59:49.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.727+0000 7f6e1d7fa640 1 -- 172.21.15.170:0/1859799010 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f6e18005190 con 0x7f6e20106a00 2024-01-25T14:59:49.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.728+0000 7f6e1d7fa640 1 --2- 172.21.15.170:0/1859799010 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6e080a12e0 0x7f6e080a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:49.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.728+0000 7f6e1ffff640 1 --2- 172.21.15.170:0/1859799010 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6e080a12e0 0x7f6e080a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:49.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.728+0000 7f6e1d7fa640 1 -- 172.21.15.170:0/1859799010 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6e180cc860 con 0x7f6e20106a00 2024-01-25T14:59:49.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.729+0000 7f6e1ffff640 1 --2- 172.21.15.170:0/1859799010 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6e080a12e0 0x7f6e080a37a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6e10005ab0 tx=0x7f6e1002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:49.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.733+0000 7f6e1d7fa640 1 -- 172.21.15.170:0/1859799010 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f6e180961a0 con 0x7f6e20106a00 2024-01-25T14:59:49.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.945+0000 7f6e2651d640 1 -- 172.21.15.170:0/1859799010 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e2010c5e0 con 0x7f6e20106a00 2024-01-25T14:59:49.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.946+0000 7f6e1d7fa640 1 -- 172.21.15.170:0/1859799010 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10061 (secure 0 0 0) 0x7f6e180980d0 con 0x7f6e20106a00 2024-01-25T14:59:49.947 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:49.947 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14616,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14628,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24398,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24457,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24479,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/2132502182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":2132502182},{"type":"v1","addr":"172.21.15.186:6839","nonce":2132502182}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2024-01-25T14:59:49.947 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 13 2024-01-25T14:59:49.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.948+0000 7f6e2651d640 1 -- 172.21.15.170:0/1859799010 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6e080a12e0 msgr2=0x7f6e080a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:49.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.948+0000 7f6e2651d640 1 --2- 172.21.15.170:0/1859799010 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6e080a12e0 0x7f6e080a37a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6e10005ab0 tx=0x7f6e1002c5d0 comp rx=0 tx=0).stop 2024-01-25T14:59:49.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.948+0000 7f6e2651d640 1 -- 172.21.15.170:0/1859799010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e20106a00 msgr2=0x7f6e2019e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:49.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.948+0000 7f6e2651d640 1 --2- 172.21.15.170:0/1859799010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e20106a00 0x7f6e2019e2a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6e1800eaa0 tx=0x7f6e1800ef60 comp rx=0 tx=0).stop 2024-01-25T14:59:49.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.948+0000 7f6e2651d640 1 -- 172.21.15.170:0/1859799010 shutdown_connections 2024-01-25T14:59:49.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.948+0000 7f6e2651d640 1 --2- 172.21.15.170:0/1859799010 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6e080a12e0 0x7f6e080a37a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:49.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.948+0000 7f6e2651d640 1 --2- 172.21.15.170:0/1859799010 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e20106a00 0x7f6e2019e2a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:49.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.948+0000 7f6e2651d640 1 --2- 172.21.15.170:0/1859799010 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e201040d0 0x7f6e20197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:49.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.948+0000 7f6e2651d640 1 --2- 172.21.15.170:0/1859799010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e201017a0 0x7f6e20196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:49.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.948+0000 7f6e2651d640 1 -- 172.21.15.170:0/1859799010 >> 172.21.15.170:0/1859799010 conn(0x7f6e200fb1b0 msgr2=0x7f6e20102240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:49.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.948+0000 7f6e2651d640 1 -- 172.21.15.170:0/1859799010 shutdown_connections 2024-01-25T14:59:49.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:49.948+0000 7f6e2651d640 1 -- 172.21.15.170:0/1859799010 wait complete. 2024-01-25T14:59:49.960 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T14:59:50.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.062+0000 7f216255f640 1 -- 172.21.15.170:0/1181937122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f215c101f30 msgr2=0x7f215c1023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:50.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.062+0000 7f216255f640 1 --2- 172.21.15.170:0/1181937122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f215c101f30 0x7f215c1023b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f214c009900 tx=0x7f214c02bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:50.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.062+0000 7f216255f640 1 -- 172.21.15.170:0/1181937122 shutdown_connections 2024-01-25T14:59:50.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.062+0000 7f216255f640 1 --2- 172.21.15.170:0/1181937122 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c1028f0 0x7f215c109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.062+0000 7f216255f640 1 --2- 172.21.15.170:0/1181937122 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f215c101f30 0x7f215c1023b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.062+0000 7f216255f640 1 --2- 172.21.15.170:0/1181937122 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f215c100d40 0x7f215c101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.062+0000 7f216255f640 1 -- 172.21.15.170:0/1181937122 >> 172.21.15.170:0/1181937122 conn(0x7f215c0fc290 msgr2=0x7f215c0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:50.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.062+0000 7f216255f640 1 -- 172.21.15.170:0/1181937122 shutdown_connections 2024-01-25T14:59:50.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.062+0000 7f216255f640 1 -- 172.21.15.170:0/1181937122 wait complete. 2024-01-25T14:59:50.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.062+0000 7f216255f640 1 Processor -- start 2024-01-25T14:59:50.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f216255f640 1 -- start start 2024-01-25T14:59:50.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f216255f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f215c100d40 0x7f215c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:50.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f216255f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c101f30 0x7f215c0730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:50.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f216255f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f215c1028f0 0x7f215c073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:50.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f216255f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c073d80 con 0x7f215c1028f0 2024-01-25T14:59:50.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f216255f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c073ef0 con 0x7f215c100d40 2024-01-25T14:59:50.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f216255f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c1a0d40 con 0x7f215c101f30 2024-01-25T14:59:50.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f2160afc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f215c1028f0 0x7f215c073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:50.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f2160afc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f215c1028f0 0x7f215c073620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49012/0 (socket says 172.21.15.170:49012) 2024-01-25T14:59:50.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f2160afc640 1 -- 172.21.15.170:0/2773091723 learned_addr learned my addr 172.21.15.170:0/2773091723 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:50.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f215bfff640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f215c100d40 0x7f215c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:50.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f215b7fe640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c101f30 0x7f215c0730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:50.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f2160afc640 1 -- 172.21.15.170:0/2773091723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c101f30 msgr2=0x7f215c0730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:50.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f2160afc640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c101f30 0x7f215c0730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f2160afc640 1 -- 172.21.15.170:0/2773091723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f215c100d40 msgr2=0x7f215c074aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:50.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f2160afc640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f215c100d40 0x7f215c074aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f2160afc640 1 -- 172.21.15.170:0/2773091723 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c009560 con 0x7f215c1028f0 2024-01-25T14:59:50.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f215bfff640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f215c100d40 0x7f215c074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T14:59:50.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.063+0000 7f215b7fe640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c101f30 0x7f215c0730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T14:59:50.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.064+0000 7f2160afc640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f215c1028f0 0x7f215c073620 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f215400eb40 tx=0x7f215400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:50.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.064+0000 7f21597fa640 1 -- 172.21.15.170:0/2773091723 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2154004b20 con 0x7f215c1028f0 2024-01-25T14:59:50.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.064+0000 7f21597fa640 1 -- 172.21.15.170:0/2773091723 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2154004c80 con 0x7f215c1028f0 2024-01-25T14:59:50.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.064+0000 7f216255f640 1 -- 172.21.15.170:0/2773091723 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215c1a0ff0 con 0x7f215c1028f0 2024-01-25T14:59:50.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.064+0000 7f21597fa640 1 -- 172.21.15.170:0/2773091723 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2154010690 con 0x7f215c1028f0 2024-01-25T14:59:50.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.064+0000 7f216255f640 1 -- 172.21.15.170:0/2773091723 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215c1a1470 con 0x7f215c1028f0 2024-01-25T14:59:50.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.065+0000 7f216255f640 1 -- 172.21.15.170:0/2773091723 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215c108100 con 0x7f215c1028f0 2024-01-25T14:59:50.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.066+0000 7f21597fa640 1 -- 172.21.15.170:0/2773091723 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f2154005020 con 0x7f215c1028f0 2024-01-25T14:59:50.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.067+0000 7f21597fa640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f21440a12e0 0x7f21440a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:50.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.067+0000 7f215bfff640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f21440a12e0 0x7f21440a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:50.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.067+0000 7f21597fa640 1 -- 172.21.15.170:0/2773091723 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2154014070 con 0x7f215c1028f0 2024-01-25T14:59:50.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.067+0000 7f215bfff640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f21440a12e0 0x7f21440a37a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f215c101d90 tx=0x7f2150005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:50.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.071+0000 7f21597fa640 1 -- 172.21.15.170:0/2773091723 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f21540969b0 con 0x7f215c1028f0 2024-01-25T14:59:50.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.257+0000 7f216255f640 1 -- 172.21.15.170:0/2773091723 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f215c10c600 con 0x7f215c1028f0 2024-01-25T14:59:50.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.258+0000 7f21597fa640 1 -- 172.21.15.170:0/2773091723 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18466 (secure 0 0 0) 0x7f2154099fd0 con 0x7f215c1028f0 2024-01-25T14:59:50.259 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:50.260 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":81,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T14:59:04.723615+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T14:59:50.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.260+0000 7f216255f640 1 -- 172.21.15.170:0/2773091723 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f21440a12e0 msgr2=0x7f21440a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:50.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.260+0000 7f216255f640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f21440a12e0 0x7f21440a37a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f215c101d90 tx=0x7f2150005f90 comp rx=0 tx=0).stop 2024-01-25T14:59:50.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.260+0000 7f216255f640 1 -- 172.21.15.170:0/2773091723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f215c1028f0 msgr2=0x7f215c073620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:50.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.260+0000 7f216255f640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f215c1028f0 0x7f215c073620 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f215400eb40 tx=0x7f215400c2d0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.261+0000 7f216255f640 1 -- 172.21.15.170:0/2773091723 shutdown_connections 2024-01-25T14:59:50.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.261+0000 7f216255f640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f21440a12e0 0x7f21440a37a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.261+0000 7f216255f640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f215c1028f0 0x7f215c073620 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.261+0000 7f216255f640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f215c101f30 0x7f215c0730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.261+0000 7f216255f640 1 --2- 172.21.15.170:0/2773091723 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f215c100d40 0x7f215c074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.261+0000 7f216255f640 1 -- 172.21.15.170:0/2773091723 >> 172.21.15.170:0/2773091723 conn(0x7f215c0fc290 msgr2=0x7f215c1052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:50.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.261+0000 7f216255f640 1 -- 172.21.15.170:0/2773091723 shutdown_connections 2024-01-25T14:59:50.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.261+0000 7f216255f640 1 -- 172.21.15.170:0/2773091723 wait complete. 2024-01-25T14:59:50.273 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:50 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] up:boot 2024-01-25T14:59:50.273 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:50 smithi170 ceph-mon[31899]: fsmap 12 up:standby 2024-01-25T14:59:50.273 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:50 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-25T14:59:50.273 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:50 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1859799010' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:50.275 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T14:55:22.432727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T14:59:50.275 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T14:59:50.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:50 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] up:boot 2024-01-25T14:59:50.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:50 smithi186 ceph-mon[35697]: fsmap 12 up:standby 2024-01-25T14:59:50.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:50 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-25T14:59:50.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:50 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1859799010' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:50.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.387+0000 7f3a21fdc640 1 -- 172.21.15.170:0/929491777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a1c1017b0 msgr2=0x7f3a1c103ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:50.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.387+0000 7f3a21fdc640 1 --2- 172.21.15.170:0/929491777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a1c1017b0 0x7f3a1c103ba0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3a10009900 tx=0x7f3a1002bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:50.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.387+0000 7f3a21fdc640 1 -- 172.21.15.170:0/929491777 shutdown_connections 2024-01-25T14:59:50.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.387+0000 7f3a21fdc640 1 --2- 172.21.15.170:0/929491777 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a1c106a10 0x7f3a1c108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.387+0000 7f3a21fdc640 1 --2- 172.21.15.170:0/929491777 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a1c1040e0 0x7f3a1c1064d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.387+0000 7f3a21fdc640 1 --2- 172.21.15.170:0/929491777 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a1c1017b0 0x7f3a1c103ba0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.387+0000 7f3a21fdc640 1 -- 172.21.15.170:0/929491777 >> 172.21.15.170:0/929491777 conn(0x7f3a1c0fb1a0 msgr2=0x7f3a1c0fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:50.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.387+0000 7f3a21fdc640 1 -- 172.21.15.170:0/929491777 shutdown_connections 2024-01-25T14:59:50.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.387+0000 7f3a21fdc640 1 -- 172.21.15.170:0/929491777 wait complete. 2024-01-25T14:59:50.390 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.387+0000 7f3a21fdc640 1 Processor -- start 2024-01-25T14:59:50.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.387+0000 7f3a21fdc640 1 -- start start 2024-01-25T14:59:50.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a21fdc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a1c1017b0 0x7f3a1c101120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:50.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a21fdc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a1c1040e0 0x7f3a1c0ff760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:50.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a21fdc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a1c106a10 0x7f3a1c0ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:50.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a21fdc640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c100400 con 0x7f3a1c1017b0 2024-01-25T14:59:50.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a21fdc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c100570 con 0x7f3a1c1040e0 2024-01-25T14:59:50.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a21fdc640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c1a0db0 con 0x7f3a1c106a10 2024-01-25T14:59:50.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a1b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a1c1017b0 0x7f3a1c101120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:50.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a1b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a1c1017b0 0x7f3a1c101120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49032/0 (socket says 172.21.15.170:49032) 2024-01-25T14:59:50.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a1b7fe640 1 -- 172.21.15.170:0/1798025952 learned_addr learned my addr 172.21.15.170:0/1798025952 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:50.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a1bfff640 1 --2- 172.21.15.170:0/1798025952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a1c106a10 0x7f3a1c0ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:50.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a1affd640 1 --2- 172.21.15.170:0/1798025952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a1c1040e0 0x7f3a1c0ff760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:50.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a1bfff640 1 -- 172.21.15.170:0/1798025952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a1c1040e0 msgr2=0x7f3a1c0ff760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:50.391 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a1bfff640 1 --2- 172.21.15.170:0/1798025952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a1c1040e0 0x7f3a1c0ff760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a1bfff640 1 -- 172.21.15.170:0/1798025952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a1c1017b0 msgr2=0x7f3a1c101120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:50.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a1bfff640 1 --2- 172.21.15.170:0/1798025952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a1c1017b0 0x7f3a1c101120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a1bfff640 1 -- 172.21.15.170:0/1798025952 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a10009560 con 0x7f3a1c106a10 2024-01-25T14:59:50.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a1b7fe640 1 --2- 172.21.15.170:0/1798025952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a1c1017b0 0x7f3a1c101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T14:59:50.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.388+0000 7f3a1bfff640 1 --2- 172.21.15.170:0/1798025952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a1c106a10 0x7f3a1c0ffca0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009fd0 tx=0x7f3a1400ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:50.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.389+0000 7f3a18ff9640 1 -- 172.21.15.170:0/1798025952 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1400ce20 con 0x7f3a1c106a10 2024-01-25T14:59:50.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.389+0000 7f3a18ff9640 1 -- 172.21.15.170:0/1798025952 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a14005020 con 0x7f3a1c106a10 2024-01-25T14:59:50.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.389+0000 7f3a21fdc640 1 -- 172.21.15.170:0/1798025952 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c1a1060 con 0x7f3a1c106a10 2024-01-25T14:59:50.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.389+0000 7f3a18ff9640 1 -- 172.21.15.170:0/1798025952 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14010670 con 0x7f3a1c106a10 2024-01-25T14:59:50.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.389+0000 7f3a21fdc640 1 -- 172.21.15.170:0/1798025952 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c1a1570 con 0x7f3a1c106a10 2024-01-25T14:59:50.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.390+0000 7f3a21fdc640 1 -- 172.21.15.170:0/1798025952 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c0fcc90 con 0x7f3a1c106a10 2024-01-25T14:59:50.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.391+0000 7f3a18ff9640 1 -- 172.21.15.170:0/1798025952 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f3a14005450 con 0x7f3a1c106a10 2024-01-25T14:59:50.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.391+0000 7f3a18ff9640 1 --2- 172.21.15.170:0/1798025952 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3a040a1360 0x7f3a040a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:50.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.392+0000 7f3a1b7fe640 1 --2- 172.21.15.170:0/1798025952 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3a040a1360 0x7f3a040a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:50.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.392+0000 7f3a18ff9640 1 -- 172.21.15.170:0/1798025952 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3a14014070 con 0x7f3a1c106a10 2024-01-25T14:59:50.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.392+0000 7f3a1b7fe640 1 --2- 172.21.15.170:0/1798025952 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3a040a1360 0x7f3a040a3820 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3a10000c00 tx=0x7f3a1002c780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:50.396 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.396+0000 7f3a18ff9640 1 -- 172.21.15.170:0/1798025952 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f3a14096680 con 0x7f3a1c106a10 2024-01-25T14:59:50.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:50 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] up:boot 2024-01-25T14:59:50.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:50 smithi191 ceph-mon[36347]: fsmap 12 up:standby 2024-01-25T14:59:50.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:50 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-25T14:59:50.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:50 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1859799010' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T14:59:50.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.601+0000 7f3a21fdc640 1 -- 172.21.15.170:0/1798025952 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a1c02cb10 con 0x7f3a1c106a10 2024-01-25T14:59:50.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.602+0000 7f3a18ff9640 1 -- 172.21.15.170:0/1798025952 <== mon.1 v2:172.21.15.191:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a14099ca0 con 0x7f3a1c106a10 2024-01-25T14:59:50.603 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 1 2024-01-25T14:59:50.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.604+0000 7f3a21fdc640 1 -- 172.21.15.170:0/1798025952 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3a040a1360 msgr2=0x7f3a040a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:50.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.604+0000 7f3a21fdc640 1 --2- 172.21.15.170:0/1798025952 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3a040a1360 0x7f3a040a3820 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3a10000c00 tx=0x7f3a1002c780 comp rx=0 tx=0).stop 2024-01-25T14:59:50.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.604+0000 7f3a21fdc640 1 -- 172.21.15.170:0/1798025952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a1c106a10 msgr2=0x7f3a1c0ffca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:50.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.604+0000 7f3a21fdc640 1 --2- 172.21.15.170:0/1798025952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a1c106a10 0x7f3a1c0ffca0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009fd0 tx=0x7f3a1400ef10 comp rx=0 tx=0).stop 2024-01-25T14:59:50.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.604+0000 7f3a21fdc640 1 -- 172.21.15.170:0/1798025952 shutdown_connections 2024-01-25T14:59:50.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.604+0000 7f3a21fdc640 1 --2- 172.21.15.170:0/1798025952 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3a040a1360 0x7f3a040a3820 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.604+0000 7f3a21fdc640 1 --2- 172.21.15.170:0/1798025952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a1c1040e0 0x7f3a1c0ff760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.604+0000 7f3a21fdc640 1 --2- 172.21.15.170:0/1798025952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a1c106a10 0x7f3a1c0ffca0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.604+0000 7f3a21fdc640 1 --2- 172.21.15.170:0/1798025952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a1c1017b0 0x7f3a1c101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.604+0000 7f3a21fdc640 1 -- 172.21.15.170:0/1798025952 >> 172.21.15.170:0/1798025952 conn(0x7f3a1c0fb1a0 msgr2=0x7f3a1c102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:50.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.604+0000 7f3a21fdc640 1 -- 172.21.15.170:0/1798025952 shutdown_connections 2024-01-25T14:59:50.606 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.604+0000 7f3a21fdc640 1 -- 172.21.15.170:0/1798025952 wait complete. 2024-01-25T14:59:50.616 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-25T14:59:50.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.716+0000 7feb9d30c640 1 -- 172.21.15.170:0/3719664345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb981069e0 msgr2=0x7feb98108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:50.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.716+0000 7feb9d30c640 1 --2- 172.21.15.170:0/3719664345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb981069e0 0x7feb98108e30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7feb88009ca0 tx=0x7feb8802c0f0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.716+0000 7feb9d30c640 1 -- 172.21.15.170:0/3719664345 shutdown_connections 2024-01-25T14:59:50.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.716+0000 7feb9d30c640 1 --2- 172.21.15.170:0/3719664345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb980ff350 0x7feb981064a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.716+0000 7feb9d30c640 1 --2- 172.21.15.170:0/3719664345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb981069e0 0x7feb98108e30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.716+0000 7feb9d30c640 1 --2- 172.21.15.170:0/3719664345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb980fe960 0x7feb980fed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.716+0000 7feb9d30c640 1 -- 172.21.15.170:0/3719664345 >> 172.21.15.170:0/3719664345 conn(0x7feb980fa4f0 msgr2=0x7feb980fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:50.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.716+0000 7feb9d30c640 1 -- 172.21.15.170:0/3719664345 shutdown_connections 2024-01-25T14:59:50.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.716+0000 7feb9d30c640 1 -- 172.21.15.170:0/3719664345 wait complete. 2024-01-25T14:59:50.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb9d30c640 1 Processor -- start 2024-01-25T14:59:50.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb9d30c640 1 -- start start 2024-01-25T14:59:50.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb9d30c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb980fe960 0x7feb98196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:50.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb9d30c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb980ff350 0x7feb981971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:50.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb9d30c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb981069e0 0x7feb9819e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:50.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb9d30c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9819e7c0 con 0x7feb980ff350 2024-01-25T14:59:50.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb9d30c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9819e930 con 0x7feb980fe960 2024-01-25T14:59:50.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb9d30c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9819eaf0 con 0x7feb981069e0 2024-01-25T14:59:50.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb967fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb980ff350 0x7feb981971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:50.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb967fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb980ff350 0x7feb981971f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49036/0 (socket says 172.21.15.170:49036) 2024-01-25T14:59:50.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb967fc640 1 -- 172.21.15.170:0/1752904272 learned_addr learned my addr 172.21.15.170:0/1752904272 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:50.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb977fe640 1 --2- 172.21.15.170:0/1752904272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb981069e0 0x7feb9819e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:50.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb96ffd640 1 --2- 172.21.15.170:0/1752904272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb980fe960 0x7feb98196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:50.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb967fc640 1 -- 172.21.15.170:0/1752904272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb981069e0 msgr2=0x7feb9819e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:50.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb967fc640 1 --2- 172.21.15.170:0/1752904272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb981069e0 0x7feb9819e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb967fc640 1 -- 172.21.15.170:0/1752904272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb980fe960 msgr2=0x7feb98196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:50.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb967fc640 1 --2- 172.21.15.170:0/1752904272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb980fe960 0x7feb98196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.717+0000 7feb967fc640 1 -- 172.21.15.170:0/1752904272 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb88009900 con 0x7feb980ff350 2024-01-25T14:59:50.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.718+0000 7feb967fc640 1 --2- 172.21.15.170:0/1752904272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb980ff350 0x7feb981971f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feb8000b4a0 tx=0x7feb8000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:50.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.718+0000 7feb8ffff640 1 -- 172.21.15.170:0/1752904272 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80010610 con 0x7feb980ff350 2024-01-25T14:59:50.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.718+0000 7feb9d30c640 1 -- 172.21.15.170:0/1752904272 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9819edd0 con 0x7feb980ff350 2024-01-25T14:59:50.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.718+0000 7feb8ffff640 1 -- 172.21.15.170:0/1752904272 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb80010c30 con 0x7feb980ff350 2024-01-25T14:59:50.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.718+0000 7feb8ffff640 1 -- 172.21.15.170:0/1752904272 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80017dd0 con 0x7feb980ff350 2024-01-25T14:59:50.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.718+0000 7feb9d30c640 1 -- 172.21.15.170:0/1752904272 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9819f2e0 con 0x7feb980ff350 2024-01-25T14:59:50.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.719+0000 7feb9d30c640 1 -- 172.21.15.170:0/1752904272 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb981052b0 con 0x7feb980ff350 2024-01-25T14:59:50.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.720+0000 7feb8ffff640 1 -- 172.21.15.170:0/1752904272 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7feb800173f0 con 0x7feb980ff350 2024-01-25T14:59:50.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.720+0000 7feb8ffff640 1 --2- 172.21.15.170:0/1752904272 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feb840a12e0 0x7feb840a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:50.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.720+0000 7feb96ffd640 1 --2- 172.21.15.170:0/1752904272 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feb840a12e0 0x7feb840a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:50.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.720+0000 7feb8ffff640 1 -- 172.21.15.170:0/1752904272 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7feb800cbc40 con 0x7feb980ff350 2024-01-25T14:59:50.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.721+0000 7feb96ffd640 1 --2- 172.21.15.170:0/1752904272 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feb840a12e0 0x7feb840a37a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feb98197b80 tx=0x7feb9000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:50.725 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.724+0000 7feb8ffff640 1 -- 172.21.15.170:0/1752904272 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7feb80095610 con 0x7feb980ff350 2024-01-25T14:59:50.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.898+0000 7feb9d30c640 1 -- 172.21.15.170:0/1752904272 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7feb9810c830 con 0x7feb980ff350 2024-01-25T14:59:50.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.898+0000 7feb8ffff640 1 -- 172.21.15.170:0/1752904272 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+65 (secure 0 0 0) 0x7feb80098c30 con 0x7feb980ff350 2024-01-25T14:59:50.899 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:50.899 INFO:teuthology.orchestra.run.smithi170.stdout:[ 2024-01-25T14:59:50.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T14:59:50.899 INFO:teuthology.orchestra.run.smithi170.stdout: "poolnum": 1, 2024-01-25T14:59:50.900 INFO:teuthology.orchestra.run.smithi170.stdout: "poolname": ".mgr" 2024-01-25T14:59:50.900 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T14:59:50.900 INFO:teuthology.orchestra.run.smithi170.stdout:] 2024-01-25T14:59:50.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.900+0000 7feb9d30c640 1 -- 172.21.15.170:0/1752904272 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feb840a12e0 msgr2=0x7feb840a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:50.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.900+0000 7feb9d30c640 1 --2- 172.21.15.170:0/1752904272 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feb840a12e0 0x7feb840a37a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feb98197b80 tx=0x7feb9000b390 comp rx=0 tx=0).stop 2024-01-25T14:59:50.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.900+0000 7feb9d30c640 1 -- 172.21.15.170:0/1752904272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb980ff350 msgr2=0x7feb981971f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:50.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.900+0000 7feb9d30c640 1 --2- 172.21.15.170:0/1752904272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb980ff350 0x7feb981971f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feb8000b4a0 tx=0x7feb8000b960 comp rx=0 tx=0).stop 2024-01-25T14:59:50.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.900+0000 7feb9d30c640 1 -- 172.21.15.170:0/1752904272 shutdown_connections 2024-01-25T14:59:50.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.900+0000 7feb9d30c640 1 --2- 172.21.15.170:0/1752904272 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feb840a12e0 0x7feb840a37a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.900+0000 7feb9d30c640 1 --2- 172.21.15.170:0/1752904272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb981069e0 0x7feb9819e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.900+0000 7feb9d30c640 1 --2- 172.21.15.170:0/1752904272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb980ff350 0x7feb981971f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.900+0000 7feb9d30c640 1 --2- 172.21.15.170:0/1752904272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb980fe960 0x7feb98196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:50.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.900+0000 7feb9d30c640 1 -- 172.21.15.170:0/1752904272 >> 172.21.15.170:0/1752904272 conn(0x7feb980fa4f0 msgr2=0x7feb98102480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:50.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.900+0000 7feb9d30c640 1 -- 172.21.15.170:0/1752904272 shutdown_connections 2024-01-25T14:59:50.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:50.900+0000 7feb9d30c640 1 -- 172.21.15.170:0/1752904272 wait complete. 2024-01-25T14:59:50.912 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-25T14:59:50.912 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-25T14:59:51.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.020+0000 7fa584e9b640 1 -- 172.21.15.170:0/14570152 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5800ffbf0 msgr2=0x7fa580100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:51.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.020+0000 7fa584e9b640 1 --2- 172.21.15.170:0/14570152 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5800ffbf0 0x7fa580100010 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa570009900 tx=0x7fa57002bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:51.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.020+0000 7fa584e9b640 1 -- 172.21.15.170:0/14570152 shutdown_connections 2024-01-25T14:59:51.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.020+0000 7fa584e9b640 1 --2- 172.21.15.170:0/14570152 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa5801017a0 0x7fa580108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:51.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.020+0000 7fa584e9b640 1 --2- 172.21.15.170:0/14570152 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa580100de0 0x7fa580101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:51.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.020+0000 7fa584e9b640 1 --2- 172.21.15.170:0/14570152 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5800ffbf0 0x7fa580100010 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:51.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.020+0000 7fa584e9b640 1 -- 172.21.15.170:0/14570152 >> 172.21.15.170:0/14570152 conn(0x7fa5800fb180 msgr2=0x7fa5800fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:51.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.020+0000 7fa584e9b640 1 -- 172.21.15.170:0/14570152 shutdown_connections 2024-01-25T14:59:51.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.020+0000 7fa584e9b640 1 -- 172.21.15.170:0/14570152 wait complete. 2024-01-25T14:59:51.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.020+0000 7fa584e9b640 1 Processor -- start 2024-01-25T14:59:51.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.020+0000 7fa584e9b640 1 -- start start 2024-01-25T14:59:51.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa584e9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa5800ffbf0 0x7fa5800689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:51.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa584e9b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa580100de0 0x7fa58019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:51.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa584e9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5801017a0 0x7fa58019e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:51.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa584e9b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58019e810 con 0x7fa5801017a0 2024-01-25T14:59:51.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa584e9b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58019e980 con 0x7fa580100de0 2024-01-25T14:59:51.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa584e9b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58019eb40 con 0x7fa5800ffbf0 2024-01-25T14:59:51.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa57ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5801017a0 0x7fa58019e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:51.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa57ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5801017a0 0x7fa58019e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49048/0 (socket says 172.21.15.170:49048) 2024-01-25T14:59:51.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa57ed9d640 1 -- 172.21.15.170:0/3903945102 learned_addr learned my addr 172.21.15.170:0/3903945102 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:51.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa577fff640 1 --2- 172.21.15.170:0/3903945102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa580100de0 0x7fa58019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:51.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa57e59c640 1 --2- 172.21.15.170:0/3903945102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa5800ffbf0 0x7fa5800689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:51.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa57ed9d640 1 -- 172.21.15.170:0/3903945102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa5800ffbf0 msgr2=0x7fa5800689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:51.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa57ed9d640 1 --2- 172.21.15.170:0/3903945102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa5800ffbf0 0x7fa5800689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:51.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa57ed9d640 1 -- 172.21.15.170:0/3903945102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa580100de0 msgr2=0x7fa58019ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:51.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa57ed9d640 1 --2- 172.21.15.170:0/3903945102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa580100de0 0x7fa58019ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:51.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa57ed9d640 1 -- 172.21.15.170:0/3903945102 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa570009560 con 0x7fa5801017a0 2024-01-25T14:59:51.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa57ed9d640 1 --2- 172.21.15.170:0/3903945102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5801017a0 0x7fa58019e080 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa57800eb10 tx=0x7fa57800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:51.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa5777fe640 1 -- 172.21.15.170:0/3903945102 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578004b20 con 0x7fa5801017a0 2024-01-25T14:59:51.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa5777fe640 1 -- 172.21.15.170:0/3903945102 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa578004c80 con 0x7fa5801017a0 2024-01-25T14:59:51.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.021+0000 7fa584e9b640 1 -- 172.21.15.170:0/3903945102 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58019ee20 con 0x7fa5801017a0 2024-01-25T14:59:51.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.022+0000 7fa5777fe640 1 -- 172.21.15.170:0/3903945102 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa578010690 con 0x7fa5801017a0 2024-01-25T14:59:51.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.022+0000 7fa584e9b640 1 -- 172.21.15.170:0/3903945102 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58019f2b0 con 0x7fa5801017a0 2024-01-25T14:59:51.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.023+0000 7fa584e9b640 1 -- 172.21.15.170:0/3903945102 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa580106fd0 con 0x7fa5801017a0 2024-01-25T14:59:51.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.024+0000 7fa5777fe640 1 -- 172.21.15.170:0/3903945102 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fa578005020 con 0x7fa5801017a0 2024-01-25T14:59:51.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.024+0000 7fa5777fe640 1 --2- 172.21.15.170:0/3903945102 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa56c0a12e0 0x7fa56c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:51.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.024+0000 7fa57e59c640 1 --2- 172.21.15.170:0/3903945102 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa56c0a12e0 0x7fa56c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:51.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.024+0000 7fa5777fe640 1 -- 172.21.15.170:0/3903945102 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa578014070 con 0x7fa5801017a0 2024-01-25T14:59:51.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.025+0000 7fa57e59c640 1 --2- 172.21.15.170:0/3903945102 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa56c0a12e0 0x7fa56c0a37a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa57002c6b0 tx=0x7fa57002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:51.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.029+0000 7fa5777fe640 1 -- 172.21.15.170:0/3903945102 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa5780965c0 con 0x7fa5801017a0 2024-01-25T14:59:51.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:51.221+0000 7fa584e9b640 1 -- 172.21.15.170:0/3903945102 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa58010b680 con 0x7fa5801017a0 2024-01-25T14:59:51.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:51 smithi186 ceph-mon[35697]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:51.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:51 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2773091723' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T14:59:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:51 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1798025952' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T14:59:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:51 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1752904272' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-01-25T14:59:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:59:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:51 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:51 smithi170 ceph-mon[31899]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:51 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2773091723' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T14:59:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:51 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1798025952' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T14:59:51.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:51 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1752904272' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-01-25T14:59:51.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:51.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:59:51.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:51 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:51 smithi191 ceph-mon[36347]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:51 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2773091723' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T14:59:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:51 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1798025952' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T14:59:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:51 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1752904272' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-01-25T14:59:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:59:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:51 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:52.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.181+0000 7fa5777fe640 1 -- 172.21.15.170:0/3903945102 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa578099be0 con 0x7fa5801017a0 2024-01-25T14:59:52.182 INFO:teuthology.orchestra.run.smithi170.stderr:pool 'cephfs_metadata' created 2024-01-25T14:59:52.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.183+0000 7fa584e9b640 1 -- 172.21.15.170:0/3903945102 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa56c0a12e0 msgr2=0x7fa56c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:52.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.183+0000 7fa584e9b640 1 --2- 172.21.15.170:0/3903945102 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa56c0a12e0 0x7fa56c0a37a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa57002c6b0 tx=0x7fa57002c5d0 comp rx=0 tx=0).stop 2024-01-25T14:59:52.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.184+0000 7fa584e9b640 1 -- 172.21.15.170:0/3903945102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5801017a0 msgr2=0x7fa58019e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:52.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.184+0000 7fa584e9b640 1 --2- 172.21.15.170:0/3903945102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5801017a0 0x7fa58019e080 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa57800eb10 tx=0x7fa57800c2d0 comp rx=0 tx=0).stop 2024-01-25T14:59:52.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.184+0000 7fa584e9b640 1 -- 172.21.15.170:0/3903945102 shutdown_connections 2024-01-25T14:59:52.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.184+0000 7fa584e9b640 1 --2- 172.21.15.170:0/3903945102 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa56c0a12e0 0x7fa56c0a37a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:52.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.184+0000 7fa584e9b640 1 --2- 172.21.15.170:0/3903945102 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa580100de0 0x7fa58019ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:52.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.184+0000 7fa584e9b640 1 --2- 172.21.15.170:0/3903945102 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa5801017a0 0x7fa58019e080 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:52.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.184+0000 7fa584e9b640 1 --2- 172.21.15.170:0/3903945102 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa5800ffbf0 0x7fa5800689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:52.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.184+0000 7fa584e9b640 1 -- 172.21.15.170:0/3903945102 >> 172.21.15.170:0/3903945102 conn(0x7fa5800fb180 msgr2=0x7fa5801041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:52.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.184+0000 7fa584e9b640 1 -- 172.21.15.170:0/3903945102 shutdown_connections 2024-01-25T14:59:52.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.184+0000 7fa584e9b640 1 -- 172.21.15.170:0/3903945102 wait complete. 2024-01-25T14:59:52.198 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:52 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:52.198 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:52 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:59:52.198 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:52 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3903945102' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-01-25T14:59:52.199 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-25T14:59:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 -- 172.21.15.170:0/1065554705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabe01017c0 msgr2=0x7fabe0108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 --2- 172.21.15.170:0/1065554705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabe01017c0 0x7fabe0108050 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009ca0 tx=0x7fabd802c0f0 comp rx=0 tx=0).stop 2024-01-25T14:59:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 -- 172.21.15.170:0/1065554705 shutdown_connections 2024-01-25T14:59:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 --2- 172.21.15.170:0/1065554705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabe01017c0 0x7fabe0108050 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 --2- 172.21.15.170:0/1065554705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabe0100e00 0x7fabe0101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:52.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 --2- 172.21.15.170:0/1065554705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fabe00ffc10 0x7fabe0100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:52.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 -- 172.21.15.170:0/1065554705 >> 172.21.15.170:0/1065554705 conn(0x7fabe00fb180 msgr2=0x7fabe00fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:52.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 -- 172.21.15.170:0/1065554705 shutdown_connections 2024-01-25T14:59:52.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 -- 172.21.15.170:0/1065554705 wait complete. 2024-01-25T14:59:52.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 Processor -- start 2024-01-25T14:59:52.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 -- start start 2024-01-25T14:59:52.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabe00ffc10 0x7fabe0196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:52.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabe0100e00 0x7fabe01972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:52.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fabe01017c0 0x7fabe019e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:52.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe019e890 con 0x7fabe00ffc10 2024-01-25T14:59:52.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe019ea00 con 0x7fabe01017c0 2024-01-25T14:59:52.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.309+0000 7fabe8097640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe019ebc0 con 0x7fabe0100e00 2024-01-25T14:59:52.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabe5e33640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabe00ffc10 0x7fabe0196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:52.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabe5e33640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabe00ffc10 0x7fabe0196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49066/0 (socket says 172.21.15.170:49066) 2024-01-25T14:59:52.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabe5e33640 1 -- 172.21.15.170:0/1308857080 learned_addr learned my addr 172.21.15.170:0/1308857080 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:52.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabe5632640 1 --2- 172.21.15.170:0/1308857080 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabe0100e00 0x7fabe01972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:52.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabe6634640 1 --2- 172.21.15.170:0/1308857080 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fabe01017c0 0x7fabe019e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:52.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabe5e33640 1 -- 172.21.15.170:0/1308857080 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabe0100e00 msgr2=0x7fabe01972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:52.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabe5e33640 1 --2- 172.21.15.170:0/1308857080 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabe0100e00 0x7fabe01972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:52.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabe5e33640 1 -- 172.21.15.170:0/1308857080 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fabe01017c0 msgr2=0x7fabe019e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:52.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabe5e33640 1 --2- 172.21.15.170:0/1308857080 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fabe01017c0 0x7fabe019e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:52.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabe5e33640 1 -- 172.21.15.170:0/1308857080 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8009900 con 0x7fabe00ffc10 2024-01-25T14:59:52.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabe5e33640 1 --2- 172.21.15.170:0/1308857080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabe00ffc10 0x7fabe0196db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fabd400e9c0 tx=0x7fabd400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:52.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabd2ffd640 1 -- 172.21.15.170:0/1308857080 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4009700 con 0x7fabe00ffc10 2024-01-25T14:59:52.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabd2ffd640 1 -- 172.21.15.170:0/1308857080 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fabd40044e0 con 0x7fabe00ffc10 2024-01-25T14:59:52.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabe8097640 1 -- 172.21.15.170:0/1308857080 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe019eea0 con 0x7fabe00ffc10 2024-01-25T14:59:52.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabd2ffd640 1 -- 172.21.15.170:0/1308857080 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd4010430 con 0x7fabe00ffc10 2024-01-25T14:59:52.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.310+0000 7fabe8097640 1 -- 172.21.15.170:0/1308857080 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe019f2c0 con 0x7fabe00ffc10 2024-01-25T14:59:52.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.311+0000 7fabe8097640 1 -- 172.21.15.170:0/1308857080 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe010b4b0 con 0x7fabe00ffc10 2024-01-25T14:59:52.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.313+0000 7fabd2ffd640 1 -- 172.21.15.170:0/1308857080 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fabd4003f40 con 0x7fabe00ffc10 2024-01-25T14:59:52.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.313+0000 7fabd2ffd640 1 --2- 172.21.15.170:0/1308857080 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fabcc0a12e0 0x7fabcc0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:52.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.313+0000 7fabe5632640 1 --2- 172.21.15.170:0/1308857080 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fabcc0a12e0 0x7fabcc0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:52.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.313+0000 7fabd2ffd640 1 -- 172.21.15.170:0/1308857080 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7497+0+0 (secure 0 0 0) 0x7fabd4014070 con 0x7fabe00ffc10 2024-01-25T14:59:52.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.314+0000 7fabe5632640 1 --2- 172.21.15.170:0/1308857080 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fabcc0a12e0 0x7fabcc0a37a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009bd0 tx=0x7fabdc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:52.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.317+0000 7fabd2ffd640 1 -- 172.21.15.170:0/1308857080 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fabd40964f0 con 0x7fabe00ffc10 2024-01-25T14:59:52.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:52 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:52.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:52 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:59:52.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:52 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3903945102' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-01-25T14:59:52.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:52 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:52.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:52 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T14:59:52.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:52 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3903945102' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-01-25T14:59:52.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:52.495+0000 7fabe8097640 1 -- 172.21.15.170:0/1308857080 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fabe019f6e0 con 0x7fabe00ffc10 2024-01-25T14:59:53.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.186+0000 7fabd2ffd640 1 -- 172.21.15.170:0/1308857080 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) v1 ==== 170+0+0 (secure 0 0 0) 0x7fabd4099b10 con 0x7fabe00ffc10 2024-01-25T14:59:53.187 INFO:teuthology.orchestra.run.smithi170.stderr:pool 'cephfs_data' created 2024-01-25T14:59:53.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.189+0000 7fabe8097640 1 -- 172.21.15.170:0/1308857080 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fabcc0a12e0 msgr2=0x7fabcc0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:53.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.189+0000 7fabe8097640 1 --2- 172.21.15.170:0/1308857080 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fabcc0a12e0 0x7fabcc0a37a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009bd0 tx=0x7fabdc005f90 comp rx=0 tx=0).stop 2024-01-25T14:59:53.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.189+0000 7fabe8097640 1 -- 172.21.15.170:0/1308857080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabe00ffc10 msgr2=0x7fabe0196db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:53.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.189+0000 7fabe8097640 1 --2- 172.21.15.170:0/1308857080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabe00ffc10 0x7fabe0196db0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fabd400e9c0 tx=0x7fabd400ee80 comp rx=0 tx=0).stop 2024-01-25T14:59:53.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.189+0000 7fabe8097640 1 -- 172.21.15.170:0/1308857080 shutdown_connections 2024-01-25T14:59:53.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.189+0000 7fabe8097640 1 --2- 172.21.15.170:0/1308857080 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fabcc0a12e0 0x7fabcc0a37a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:53.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.189+0000 7fabe8097640 1 --2- 172.21.15.170:0/1308857080 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fabe01017c0 0x7fabe019e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:53.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.189+0000 7fabe8097640 1 --2- 172.21.15.170:0/1308857080 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fabe0100e00 0x7fabe01972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:53.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.189+0000 7fabe8097640 1 --2- 172.21.15.170:0/1308857080 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fabe00ffc10 0x7fabe0196db0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:53.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.189+0000 7fabe8097640 1 -- 172.21.15.170:0/1308857080 >> 172.21.15.170:0/1308857080 conn(0x7fabe00fb180 msgr2=0x7fabe0069020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:53.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.189+0000 7fabe8097640 1 -- 172.21.15.170:0/1308857080 shutdown_connections 2024-01-25T14:59:53.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.189+0000 7fabe8097640 1 -- 172.21.15.170:0/1308857080 wait complete. 2024-01-25T14:59:53.211 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-25T14:59:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.314+0000 7f4705ac9640 1 -- 172.21.15.170:0/3433252355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47001017a0 msgr2=0x7f4700108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.314+0000 7f4705ac9640 1 --2- 172.21.15.170:0/3433252355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47001017a0 0x7f4700108030 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f46f8009ca0 tx=0x7f46f802c0f0 comp rx=0 tx=0).stop 2024-01-25T14:59:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.314+0000 7f4705ac9640 1 -- 172.21.15.170:0/3433252355 shutdown_connections 2024-01-25T14:59:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.315+0000 7f4705ac9640 1 --2- 172.21.15.170:0/3433252355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4700100de0 0x7f4700101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.315+0000 7f4705ac9640 1 --2- 172.21.15.170:0/3433252355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47001017a0 0x7f4700108030 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.315+0000 7f4705ac9640 1 --2- 172.21.15.170:0/3433252355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47000ffbf0 0x7f4700100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.315+0000 7f4705ac9640 1 -- 172.21.15.170:0/3433252355 >> 172.21.15.170:0/3433252355 conn(0x7f47000fb180 msgr2=0x7f47000fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.315+0000 7f4705ac9640 1 -- 172.21.15.170:0/3433252355 shutdown_connections 2024-01-25T14:59:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.315+0000 7f4705ac9640 1 -- 172.21.15.170:0/3433252355 wait complete. 2024-01-25T14:59:53.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.315+0000 7f4705ac9640 1 Processor -- start 2024-01-25T14:59:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.315+0000 7f4705ac9640 1 -- start start 2024-01-25T14:59:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.315+0000 7f4705ac9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47000ffbf0 0x7f47000689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.315+0000 7f4705ac9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4700100de0 0x7f470019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.315+0000 7f4705ac9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47001017a0 0x7f470019e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.315+0000 7f4705ac9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470019e800 con 0x7f47001017a0 2024-01-25T14:59:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.315+0000 7f4705ac9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470019e970 con 0x7f4700100de0 2024-01-25T14:59:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.315+0000 7f4705ac9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470019eb30 con 0x7f47000ffbf0 2024-01-25T14:59:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.315+0000 7f46fffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47001017a0 0x7f470019e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.316+0000 7f46fffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47001017a0 0x7f470019e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49074/0 (socket says 172.21.15.170:49074) 2024-01-25T14:59:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.316+0000 7f46fffff640 1 -- 172.21.15.170:0/3312604694 learned_addr learned my addr 172.21.15.170:0/3312604694 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.316+0000 7f46ff7fe640 1 --2- 172.21.15.170:0/3312604694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47000ffbf0 0x7f47000689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.316+0000 7f46fffff640 1 -- 172.21.15.170:0/3312604694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47000ffbf0 msgr2=0x7f47000689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:53.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.316+0000 7f46fffff640 1 --2- 172.21.15.170:0/3312604694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47000ffbf0 0x7f47000689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:53.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.316+0000 7f46feffd640 1 --2- 172.21.15.170:0/3312604694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4700100de0 0x7f470019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:53.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.316+0000 7f46fffff640 1 -- 172.21.15.170:0/3312604694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4700100de0 msgr2=0x7f470019ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:53.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.316+0000 7f46fffff640 1 --2- 172.21.15.170:0/3312604694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4700100de0 0x7f470019ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:53.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.316+0000 7f46fffff640 1 -- 172.21.15.170:0/3312604694 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f8009900 con 0x7f47001017a0 2024-01-25T14:59:53.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.316+0000 7f46fffff640 1 --2- 172.21.15.170:0/3312604694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47001017a0 0x7f470019e070 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f46f8037040 tx=0x7f46f8032810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:53.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.316+0000 7f46fcff9640 1 -- 172.21.15.170:0/3312604694 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f8034e80 con 0x7f47001017a0 2024-01-25T14:59:53.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.316+0000 7f4705ac9640 1 -- 172.21.15.170:0/3312604694 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470019edb0 con 0x7f47001017a0 2024-01-25T14:59:53.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.316+0000 7f46fcff9640 1 -- 172.21.15.170:0/3312604694 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46f8003e30 con 0x7f47001017a0 2024-01-25T14:59:53.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.316+0000 7f46fcff9640 1 -- 172.21.15.170:0/3312604694 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f803d3f0 con 0x7f47001017a0 2024-01-25T14:59:53.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.316+0000 7f4705ac9640 1 -- 172.21.15.170:0/3312604694 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470019f2e0 con 0x7f47001017a0 2024-01-25T14:59:53.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.317+0000 7f4705ac9640 1 -- 172.21.15.170:0/3312604694 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4700106f10 con 0x7f47001017a0 2024-01-25T14:59:53.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.318+0000 7f46fcff9640 1 -- 172.21.15.170:0/3312604694 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f46f803b040 con 0x7f47001017a0 2024-01-25T14:59:53.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.319+0000 7f46fcff9640 1 --2- 172.21.15.170:0/3312604694 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f46e80a12e0 0x7f46e80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:53.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.319+0000 7f46ff7fe640 1 --2- 172.21.15.170:0/3312604694 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f46e80a12e0 0x7f46e80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:53.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.319+0000 7f46fcff9640 1 -- 172.21.15.170:0/3312604694 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f46f80ef560 con 0x7f47001017a0 2024-01-25T14:59:53.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.319+0000 7f46ff7fe640 1 --2- 172.21.15.170:0/3312604694 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f46e80a12e0 0x7f46e80a37a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f46f0005fd0 tx=0x7f46f000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:53.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.322+0000 7f46fcff9640 1 -- 172.21.15.170:0/3312604694 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f46f80b8b90 con 0x7f47001017a0 2024-01-25T14:59:53.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:53 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3903945102' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-01-25T14:59:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:53 smithi191 ceph-mon[36347]: osdmap e82: 12 total, 12 up, 12 in 2024-01-25T14:59:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:53 smithi191 ceph-mon[36347]: pgmap v280: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:53 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1308857080' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-01-25T14:59:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:59:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:53.532+0000 7f4705ac9640 1 -- 172.21.15.170:0/3312604694 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f470010b780 con 0x7f47001017a0 2024-01-25T14:59:53.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:53 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3903945102' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-01-25T14:59:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:53 smithi186 ceph-mon[35697]: osdmap e82: 12 total, 12 up, 12 in 2024-01-25T14:59:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:53 smithi186 ceph-mon[35697]: pgmap v280: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:53 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1308857080' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-01-25T14:59:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:59:53.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:53 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3903945102' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-01-25T14:59:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:53 smithi170 ceph-mon[31899]: osdmap e82: 12 total, 12 up, 12 in 2024-01-25T14:59:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:53 smithi170 ceph-mon[31899]: pgmap v280: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:53 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1308857080' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-01-25T14:59:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:53.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T14:59:53.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T14:59:53.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T14:59:54.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.187+0000 7f46fcff9640 1 -- 172.21.15.170:0/3312604694 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f46f80bc1b0 con 0x7f47001017a0 2024-01-25T14:59:54.189 INFO:teuthology.orchestra.run.smithi170.stderr:new fs with metadata pool 2 and data pool 3 2024-01-25T14:59:54.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.190+0000 7f4705ac9640 1 -- 172.21.15.170:0/3312604694 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f46e80a12e0 msgr2=0x7f46e80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.190+0000 7f4705ac9640 1 --2- 172.21.15.170:0/3312604694 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f46e80a12e0 0x7f46e80a37a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f46f0005fd0 tx=0x7f46f000b390 comp rx=0 tx=0).stop 2024-01-25T14:59:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.190+0000 7f4705ac9640 1 -- 172.21.15.170:0/3312604694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47001017a0 msgr2=0x7f470019e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.190+0000 7f4705ac9640 1 --2- 172.21.15.170:0/3312604694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47001017a0 0x7f470019e070 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f46f8037040 tx=0x7f46f8032810 comp rx=0 tx=0).stop 2024-01-25T14:59:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.191+0000 7f4705ac9640 1 -- 172.21.15.170:0/3312604694 shutdown_connections 2024-01-25T14:59:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.191+0000 7f4705ac9640 1 --2- 172.21.15.170:0/3312604694 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f46e80a12e0 0x7f46e80a37a0 secure :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f46f0005fd0 tx=0x7f46f000b390 comp rx=0 tx=0).stop 2024-01-25T14:59:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.191+0000 7f4705ac9640 1 --2- 172.21.15.170:0/3312604694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4700100de0 0x7f470019ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.191+0000 7f4705ac9640 1 --2- 172.21.15.170:0/3312604694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f47001017a0 0x7f470019e070 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.191+0000 7f4705ac9640 1 --2- 172.21.15.170:0/3312604694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f47000ffbf0 0x7f47000689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.191+0000 7f4705ac9640 1 -- 172.21.15.170:0/3312604694 >> 172.21.15.170:0/3312604694 conn(0x7f47000fb180 msgr2=0x7f47001040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:54.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.191+0000 7f4705ac9640 1 -- 172.21.15.170:0/3312604694 shutdown_connections 2024-01-25T14:59:54.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.191+0000 7f4705ac9640 1 -- 172.21.15.170:0/3312604694 wait complete. 2024-01-25T14:59:54.216 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T14:59:54.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.322+0000 7fece7aee640 1 -- 172.21.15.170:0/3402567062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece01017c0 msgr2=0x7fece0108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:54.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.322+0000 7fece7aee640 1 --2- 172.21.15.170:0/3402567062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece01017c0 0x7fece0108050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fecd8009900 tx=0x7fecd802bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:54.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.322+0000 7fece7aee640 1 -- 172.21.15.170:0/3402567062 shutdown_connections 2024-01-25T14:59:54.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.322+0000 7fece7aee640 1 --2- 172.21.15.170:0/3402567062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fece0100e00 0x7fece0101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.322+0000 7fece7aee640 1 --2- 172.21.15.170:0/3402567062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece01017c0 0x7fece0108050 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.322+0000 7fece7aee640 1 --2- 172.21.15.170:0/3402567062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fece00ffc10 0x7fece0100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.322+0000 7fece7aee640 1 -- 172.21.15.170:0/3402567062 >> 172.21.15.170:0/3402567062 conn(0x7fece00fb180 msgr2=0x7fece00fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:54.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.322+0000 7fece7aee640 1 -- 172.21.15.170:0/3402567062 shutdown_connections 2024-01-25T14:59:54.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.322+0000 7fece7aee640 1 -- 172.21.15.170:0/3402567062 wait complete. 2024-01-25T14:59:54.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece7aee640 1 Processor -- start 2024-01-25T14:59:54.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece7aee640 1 -- start start 2024-01-25T14:59:54.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece7aee640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece00ffc10 0x7fece0196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:54.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece7aee640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fece0100e00 0x7fece0197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:54.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece7aee640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fece01017c0 0x7fece019e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:54.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece7aee640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece019e6d0 con 0x7fece00ffc10 2024-01-25T14:59:54.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece7aee640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece019e840 con 0x7fece01017c0 2024-01-25T14:59:54.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece7aee640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece019ea00 con 0x7fece0100e00 2024-01-25T14:59:54.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece588a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece00ffc10 0x7fece0196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:54.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece588a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece00ffc10 0x7fece0196be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49090/0 (socket says 172.21.15.170:49090) 2024-01-25T14:59:54.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece588a640 1 -- 172.21.15.170:0/4092892600 learned_addr learned my addr 172.21.15.170:0/4092892600 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:54.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece5089640 1 --2- 172.21.15.170:0/4092892600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fece0100e00 0x7fece0197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:54.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece588a640 1 -- 172.21.15.170:0/4092892600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fece0100e00 msgr2=0x7fece0197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:54.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece588a640 1 --2- 172.21.15.170:0/4092892600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fece0100e00 0x7fece0197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece588a640 1 -- 172.21.15.170:0/4092892600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fece01017c0 msgr2=0x7fece019e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:54.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece588a640 1 --2- 172.21.15.170:0/4092892600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fece01017c0 0x7fece019e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.327 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.323+0000 7fece588a640 1 -- 172.21.15.170:0/4092892600 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd8009560 con 0x7fece00ffc10 2024-01-25T14:59:54.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.324+0000 7fece588a640 1 --2- 172.21.15.170:0/4092892600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece00ffc10 0x7fece0196be0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fecd000eaa0 tx=0x7fecd000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:54.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.324+0000 7fecdeffd640 1 -- 172.21.15.170:0/4092892600 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd000ce10 con 0x7fece00ffc10 2024-01-25T14:59:54.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.324+0000 7fecdeffd640 1 -- 172.21.15.170:0/4092892600 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecd0003e30 con 0x7fece00ffc10 2024-01-25T14:59:54.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.324+0000 7fece7aee640 1 -- 172.21.15.170:0/4092892600 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece019ece0 con 0x7fece00ffc10 2024-01-25T14:59:54.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.324+0000 7fecdeffd640 1 -- 172.21.15.170:0/4092892600 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd00116d0 con 0x7fece00ffc10 2024-01-25T14:59:54.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.324+0000 7fece7aee640 1 -- 172.21.15.170:0/4092892600 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece019f1a0 con 0x7fece00ffc10 2024-01-25T14:59:54.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.325+0000 7fece7aee640 1 -- 172.21.15.170:0/4092892600 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece0106e60 con 0x7fece00ffc10 2024-01-25T14:59:54.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.326+0000 7fecdeffd640 1 -- 172.21.15.170:0/4092892600 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fecd0004230 con 0x7fece00ffc10 2024-01-25T14:59:54.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.326+0000 7fecdeffd640 1 --2- 172.21.15.170:0/4092892600 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecc80a12e0 0x7fecc80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:54.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.327+0000 7fece5089640 1 --2- 172.21.15.170:0/4092892600 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecc80a12e0 0x7fecc80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:54.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.327+0000 7fecdeffd640 1 -- 172.21.15.170:0/4092892600 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fecd00cd250 con 0x7fece00ffc10 2024-01-25T14:59:54.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.327+0000 7fece5089640 1 --2- 172.21.15.170:0/4092892600 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecc80a12e0 0x7fecc80a37a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fecd4005e10 tx=0x7fecd4005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:54.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.330+0000 7fecdeffd640 1 -- 172.21.15.170:0/4092892600 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fecd0096820 con 0x7fece00ffc10 2024-01-25T14:59:54.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:54 smithi191 ceph-mon[36347]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-25T14:59:54.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:54 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1308857080' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-01-25T14:59:54.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:54 smithi191 ceph-mon[36347]: osdmap e83: 12 total, 12 up, 12 in 2024-01-25T14:59:54.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:54 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3312604694' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-01-25T14:59:54.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:54 smithi191 ceph-mon[36347]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-01-25T14:59:54.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.502+0000 7fece7aee640 1 -- 172.21.15.170:0/4092892600 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fece010c7f0 con 0x7fece00ffc10 2024-01-25T14:59:54.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.503+0000 7fecdeffd640 1 -- 172.21.15.170:0/4092892600 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22176 (secure 0 0 0) 0x7fece010c7f0 con 0x7fece00ffc10 2024-01-25T14:59:54.504 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:54.505 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":84,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T14:59:53.533718+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T14:59:54.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.505+0000 7fece7aee640 1 -- 172.21.15.170:0/4092892600 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecc80a12e0 msgr2=0x7fecc80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:54.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.505+0000 7fece7aee640 1 --2- 172.21.15.170:0/4092892600 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecc80a12e0 0x7fecc80a37a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fecd4005e10 tx=0x7fecd4005da0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.505+0000 7fece7aee640 1 -- 172.21.15.170:0/4092892600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece00ffc10 msgr2=0x7fece0196be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:54.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.505+0000 7fece7aee640 1 --2- 172.21.15.170:0/4092892600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece00ffc10 0x7fece0196be0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fecd000eaa0 tx=0x7fecd000ef60 comp rx=0 tx=0).stop 2024-01-25T14:59:54.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.505+0000 7fece7aee640 1 -- 172.21.15.170:0/4092892600 shutdown_connections 2024-01-25T14:59:54.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.505+0000 7fece7aee640 1 --2- 172.21.15.170:0/4092892600 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecc80a12e0 0x7fecc80a37a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.505+0000 7fece7aee640 1 --2- 172.21.15.170:0/4092892600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fece01017c0 0x7fece019e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.505+0000 7fece7aee640 1 --2- 172.21.15.170:0/4092892600 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fece0100e00 0x7fece0197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.505+0000 7fece7aee640 1 --2- 172.21.15.170:0/4092892600 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fece00ffc10 0x7fece0196be0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.505+0000 7fece7aee640 1 -- 172.21.15.170:0/4092892600 >> 172.21.15.170:0/4092892600 conn(0x7fece00fb180 msgr2=0x7fece0104030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:54.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.505+0000 7fece7aee640 1 -- 172.21.15.170:0/4092892600 shutdown_connections 2024-01-25T14:59:54.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.506+0000 7fece7aee640 1 -- 172.21.15.170:0/4092892600 wait complete. 2024-01-25T14:59:54.516 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:54 smithi170 ceph-mon[31899]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-25T14:59:54.516 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:54 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1308857080' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-01-25T14:59:54.516 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:54 smithi170 ceph-mon[31899]: osdmap e83: 12 total, 12 up, 12 in 2024-01-25T14:59:54.517 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:54 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3312604694' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-01-25T14:59:54.517 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:54 smithi170 ceph-mon[31899]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-01-25T14:59:54.518 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T14:59:54.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:54 smithi186 ceph-mon[35697]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-01-25T14:59:54.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:54 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1308857080' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-01-25T14:59:54.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:54 smithi186 ceph-mon[35697]: osdmap e83: 12 total, 12 up, 12 in 2024-01-25T14:59:54.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:54 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3312604694' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-01-25T14:59:54.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:54 smithi186 ceph-mon[35697]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-01-25T14:59:54.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.619+0000 7f9b8fb6f640 1 -- 172.21.15.170:0/3265193366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b88104160 msgr2=0x7f9b88106550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:54.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.619+0000 7f9b8fb6f640 1 --2- 172.21.15.170:0/3265193366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b88104160 0x7f9b88106550 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009900 tx=0x7f9b8402bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:54.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.619+0000 7f9b8fb6f640 1 -- 172.21.15.170:0/3265193366 shutdown_connections 2024-01-25T14:59:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.619+0000 7f9b8fb6f640 1 --2- 172.21.15.170:0/3265193366 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b88106a90 0x7f9b88108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.619+0000 7f9b8fb6f640 1 --2- 172.21.15.170:0/3265193366 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b88104160 0x7f9b88106550 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.619+0000 7f9b8fb6f640 1 --2- 172.21.15.170:0/3265193366 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b88101830 0x7f9b88103c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.619+0000 7f9b8fb6f640 1 -- 172.21.15.170:0/3265193366 >> 172.21.15.170:0/3265193366 conn(0x7f9b880fb180 msgr2=0x7f9b880fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.619+0000 7f9b8fb6f640 1 -- 172.21.15.170:0/3265193366 shutdown_connections 2024-01-25T14:59:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.619+0000 7f9b8fb6f640 1 -- 172.21.15.170:0/3265193366 wait complete. 2024-01-25T14:59:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.619+0000 7f9b8fb6f640 1 Processor -- start 2024-01-25T14:59:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.619+0000 7f9b8fb6f640 1 -- start start 2024-01-25T14:59:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8fb6f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b88101830 0x7f9b88196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8fb6f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b88104160 0x7f9b88197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8fb6f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b88106a90 0x7f9b8819e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8fb6f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8819e7f0 con 0x7f9b88104160 2024-01-25T14:59:54.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8fb6f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8819e960 con 0x7f9b88106a90 2024-01-25T14:59:54.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8fb6f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8819eb20 con 0x7f9b88101830 2024-01-25T14:59:54.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8d10a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b88104160 0x7f9b88197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:54.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8d10a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b88104160 0x7f9b88197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49106/0 (socket says 172.21.15.170:49106) 2024-01-25T14:59:54.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8d10a640 1 -- 172.21.15.170:0/1054395756 learned_addr learned my addr 172.21.15.170:0/1054395756 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:54.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8d90b640 1 --2- 172.21.15.170:0/1054395756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b88101830 0x7f9b88196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:54.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8e10c640 1 --2- 172.21.15.170:0/1054395756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b88106a90 0x7f9b8819e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:54.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8d10a640 1 -- 172.21.15.170:0/1054395756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b88101830 msgr2=0x7f9b88196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:54.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8d10a640 1 --2- 172.21.15.170:0/1054395756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b88101830 0x7f9b88196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8d10a640 1 -- 172.21.15.170:0/1054395756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b88106a90 msgr2=0x7f9b8819e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:54.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8d10a640 1 --2- 172.21.15.170:0/1054395756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b88106a90 0x7f9b8819e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8d10a640 1 -- 172.21.15.170:0/1054395756 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b84009560 con 0x7f9b88104160 2024-01-25T14:59:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8d10a640 1 --2- 172.21.15.170:0/1054395756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b88104160 0x7f9b88197250 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009230 tx=0x7f9b84004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b7effd640 1 -- 172.21.15.170:0/1054395756 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b840043d0 con 0x7f9b88104160 2024-01-25T14:59:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8fb6f640 1 -- 172.21.15.170:0/1054395756 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8819eda0 con 0x7f9b88104160 2024-01-25T14:59:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b7effd640 1 -- 172.21.15.170:0/1054395756 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b840054c0 con 0x7f9b88104160 2024-01-25T14:59:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b7effd640 1 -- 172.21.15.170:0/1054395756 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b84003e50 con 0x7f9b88104160 2024-01-25T14:59:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.620+0000 7f9b8fb6f640 1 -- 172.21.15.170:0/1054395756 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8819f210 con 0x7f9b88104160 2024-01-25T14:59:54.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.621+0000 7f9b8fb6f640 1 -- 172.21.15.170:0/1054395756 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b880fcc70 con 0x7f9b88104160 2024-01-25T14:59:54.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.623+0000 7f9b7effd640 1 -- 172.21.15.170:0/1054395756 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f9b840035f0 con 0x7f9b88104160 2024-01-25T14:59:54.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.623+0000 7f9b7effd640 1 --2- 172.21.15.170:0/1054395756 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9b740a12e0 0x7f9b740a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:54.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.623+0000 7f9b8d90b640 1 --2- 172.21.15.170:0/1054395756 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9b740a12e0 0x7f9b740a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:54.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.624+0000 7f9b7effd640 1 -- 172.21.15.170:0/1054395756 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9b840ef790 con 0x7f9b88104160 2024-01-25T14:59:54.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.624+0000 7f9b8d90b640 1 --2- 172.21.15.170:0/1054395756 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9b740a12e0 0x7f9b740a37a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9b881981e0 tx=0x7f9b7800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:54.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.627+0000 7f9b7effd640 1 -- 172.21.15.170:0/1054395756 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f9b840b8cd0 con 0x7f9b88104160 2024-01-25T14:59:54.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.801+0000 7f9b8fb6f640 1 -- 172.21.15.170:0/1054395756 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b8810c7a0 con 0x7f9b88104160 2024-01-25T14:59:54.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.802+0000 7f9b7effd640 1 -- 172.21.15.170:0/1054395756 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22176 (secure 0 0 0) 0x7f9b840bac00 con 0x7f9b88104160 2024-01-25T14:59:54.803 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T14:59:54.804 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":84,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T14:59:53.533718+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T14:59:54.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.804+0000 7f9b8fb6f640 1 -- 172.21.15.170:0/1054395756 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9b740a12e0 msgr2=0x7f9b740a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:54.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.804+0000 7f9b8fb6f640 1 --2- 172.21.15.170:0/1054395756 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9b740a12e0 0x7f9b740a37a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9b881981e0 tx=0x7f9b7800b390 comp rx=0 tx=0).stop 2024-01-25T14:59:54.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.804+0000 7f9b8fb6f640 1 -- 172.21.15.170:0/1054395756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b88104160 msgr2=0x7f9b88197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:54.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.804+0000 7f9b8fb6f640 1 --2- 172.21.15.170:0/1054395756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b88104160 0x7f9b88197250 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9b84009230 tx=0x7f9b84004ed0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.805+0000 7f9b8fb6f640 1 -- 172.21.15.170:0/1054395756 shutdown_connections 2024-01-25T14:59:54.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.805+0000 7f9b8fb6f640 1 --2- 172.21.15.170:0/1054395756 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9b740a12e0 0x7f9b740a37a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.805+0000 7f9b8fb6f640 1 --2- 172.21.15.170:0/1054395756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b88106a90 0x7f9b8819e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.805+0000 7f9b8fb6f640 1 --2- 172.21.15.170:0/1054395756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b88104160 0x7f9b88197250 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.805+0000 7f9b8fb6f640 1 --2- 172.21.15.170:0/1054395756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b88101830 0x7f9b88196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.805+0000 7f9b8fb6f640 1 -- 172.21.15.170:0/1054395756 >> 172.21.15.170:0/1054395756 conn(0x7f9b880fb180 msgr2=0x7f9b88102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:54.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.805+0000 7f9b8fb6f640 1 -- 172.21.15.170:0/1054395756 shutdown_connections 2024-01-25T14:59:54.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.805+0000 7f9b8fb6f640 1 -- 172.21.15.170:0/1054395756 wait complete. 2024-01-25T14:59:54.817 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-25T14:59:54.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.920+0000 7efe5f53f640 1 -- 172.21.15.170:0/1083458530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe58100f50 msgr2=0x7efe581077e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:54.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.920+0000 7efe5f53f640 1 --2- 172.21.15.170:0/1083458530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe58100f50 0x7efe581077e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7efe50009900 tx=0x7efe5002bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:54.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.920+0000 7efe5f53f640 1 -- 172.21.15.170:0/1083458530 shutdown_connections 2024-01-25T14:59:54.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.920+0000 7efe5f53f640 1 --2- 172.21.15.170:0/1083458530 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe58100f50 0x7efe581077e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.920+0000 7efe5f53f640 1 --2- 172.21.15.170:0/1083458530 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe58100590 0x7efe58100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.920+0000 7efe5f53f640 1 --2- 172.21.15.170:0/1083458530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe580ff3a0 0x7efe580ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.920+0000 7efe5f53f640 1 -- 172.21.15.170:0/1083458530 >> 172.21.15.170:0/1083458530 conn(0x7efe580fa8f0 msgr2=0x7efe580fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:54.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.920+0000 7efe5f53f640 1 -- 172.21.15.170:0/1083458530 shutdown_connections 2024-01-25T14:59:54.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.920+0000 7efe5f53f640 1 -- 172.21.15.170:0/1083458530 wait complete. 2024-01-25T14:59:54.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5f53f640 1 Processor -- start 2024-01-25T14:59:54.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5f53f640 1 -- start start 2024-01-25T14:59:54.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5f53f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe580ff3a0 0x7efe580fc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:54.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5f53f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe58100590 0x7efe5819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:54.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5f53f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe58100f50 0x7efe5819dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:54.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5f53f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5819e740 con 0x7efe580ff3a0 2024-01-25T14:59:54.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5f53f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5819e8b0 con 0x7efe58100f50 2024-01-25T14:59:54.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5f53f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5819ea70 con 0x7efe58100590 2024-01-25T14:59:54.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5d2db640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe580ff3a0 0x7efe580fc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:54.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5d2db640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe580ff3a0 0x7efe580fc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49116/0 (socket says 172.21.15.170:49116) 2024-01-25T14:59:54.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5d2db640 1 -- 172.21.15.170:0/2749741486 learned_addr learned my addr 172.21.15.170:0/2749741486 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:54.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5cada640 1 --2- 172.21.15.170:0/2749741486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe58100590 0x7efe5819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:54.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5dadc640 1 --2- 172.21.15.170:0/2749741486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe58100f50 0x7efe5819dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:54.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5d2db640 1 -- 172.21.15.170:0/2749741486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe58100590 msgr2=0x7efe5819b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:54.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5d2db640 1 --2- 172.21.15.170:0/2749741486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe58100590 0x7efe5819b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5d2db640 1 -- 172.21.15.170:0/2749741486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe58100f50 msgr2=0x7efe5819dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:54.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.921+0000 7efe5d2db640 1 --2- 172.21.15.170:0/2749741486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe58100f50 0x7efe5819dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:54.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.922+0000 7efe5d2db640 1 -- 172.21.15.170:0/2749741486 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe50009560 con 0x7efe580ff3a0 2024-01-25T14:59:54.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.922+0000 7efe5d2db640 1 --2- 172.21.15.170:0/2749741486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe580ff3a0 0x7efe580fc9d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efe5400ccb0 tx=0x7efe5400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:54.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.922+0000 7efe4e7fc640 1 -- 172.21.15.170:0/2749741486 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54003b70 con 0x7efe580ff3a0 2024-01-25T14:59:54.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.922+0000 7efe4e7fc640 1 -- 172.21.15.170:0/2749741486 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe5400ae50 con 0x7efe580ff3a0 2024-01-25T14:59:54.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.922+0000 7efe5f53f640 1 -- 172.21.15.170:0/2749741486 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5819ed50 con 0x7efe580ff3a0 2024-01-25T14:59:54.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.922+0000 7efe4e7fc640 1 -- 172.21.15.170:0/2749741486 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5400f6b0 con 0x7efe580ff3a0 2024-01-25T14:59:54.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.922+0000 7efe5f53f640 1 -- 172.21.15.170:0/2749741486 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5819f1b0 con 0x7efe580ff3a0 2024-01-25T14:59:54.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.923+0000 7efe5f53f640 1 -- 172.21.15.170:0/2749741486 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5810ac90 con 0x7efe580ff3a0 2024-01-25T14:59:54.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.924+0000 7efe4e7fc640 1 -- 172.21.15.170:0/2749741486 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7efe54004000 con 0x7efe580ff3a0 2024-01-25T14:59:54.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.924+0000 7efe4e7fc640 1 --2- 172.21.15.170:0/2749741486 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7efe440a12e0 0x7efe440a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:54.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.924+0000 7efe5cada640 1 --2- 172.21.15.170:0/2749741486 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7efe440a12e0 0x7efe440a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:54.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.924+0000 7efe4e7fc640 1 -- 172.21.15.170:0/2749741486 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7efe540ccae0 con 0x7efe580ff3a0 2024-01-25T14:59:54.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.925+0000 7efe5cada640 1 --2- 172.21.15.170:0/2749741486 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7efe440a12e0 0x7efe440a37a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efe580fcf70 tx=0x7efe48005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:54.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:54.929+0000 7efe4e7fc640 1 -- 172.21.15.170:0/2749741486 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7efe540960b0 con 0x7efe580ff3a0 2024-01-25T14:59:55.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.139+0000 7efe5f53f640 1 -- 172.21.15.170:0/2749741486 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7efe58106ab0 con 0x7efe580ff3a0 2024-01-25T14:59:55.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.196+0000 7efe4e7fc640 1 -- 172.21.15.170:0/2749741486 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7efe540996d0 con 0x7efe580ff3a0 2024-01-25T14:59:55.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.198+0000 7efe5f53f640 1 -- 172.21.15.170:0/2749741486 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7efe440a12e0 msgr2=0x7efe440a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:55.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.198+0000 7efe5f53f640 1 --2- 172.21.15.170:0/2749741486 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7efe440a12e0 0x7efe440a37a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efe580fcf70 tx=0x7efe48005f90 comp rx=0 tx=0).stop 2024-01-25T14:59:55.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.198+0000 7efe5f53f640 1 -- 172.21.15.170:0/2749741486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe580ff3a0 msgr2=0x7efe580fc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:55.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.198+0000 7efe5f53f640 1 --2- 172.21.15.170:0/2749741486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe580ff3a0 0x7efe580fc9d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efe5400ccb0 tx=0x7efe5400a620 comp rx=0 tx=0).stop 2024-01-25T14:59:55.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.198+0000 7efe5f53f640 1 -- 172.21.15.170:0/2749741486 shutdown_connections 2024-01-25T14:59:55.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.198+0000 7efe5f53f640 1 --2- 172.21.15.170:0/2749741486 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7efe440a12e0 0x7efe440a37a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:55.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.198+0000 7efe5f53f640 1 --2- 172.21.15.170:0/2749741486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efe58100f50 0x7efe5819dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:55.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.198+0000 7efe5f53f640 1 --2- 172.21.15.170:0/2749741486 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efe58100590 0x7efe5819b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:55.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.198+0000 7efe5f53f640 1 --2- 172.21.15.170:0/2749741486 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efe580ff3a0 0x7efe580fc9d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:55.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.198+0000 7efe5f53f640 1 -- 172.21.15.170:0/2749741486 >> 172.21.15.170:0/2749741486 conn(0x7efe580fa8f0 msgr2=0x7efe58103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:55.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.198+0000 7efe5f53f640 1 -- 172.21.15.170:0/2749741486 shutdown_connections 2024-01-25T14:59:55.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.198+0000 7efe5f53f640 1 -- 172.21.15.170:0/2749741486 wait complete. 2024-01-25T14:59:55.211 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-01-25T14:59:55.212 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-01-25T14:59:55.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.316+0000 7f5566e87640 1 -- 172.21.15.170:0/466606354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55600fedb0 msgr2=0x7f55600ff230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:55.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.316+0000 7f5566e87640 1 --2- 172.21.15.170:0/466606354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55600fedb0 0x7f55600ff230 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5550009900 tx=0x7f555002bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:55.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.316+0000 7f5566e87640 1 -- 172.21.15.170:0/466606354 shutdown_connections 2024-01-25T14:59:55.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.316+0000 7f5566e87640 1 --2- 172.21.15.170:0/466606354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55600ff770 0x7f5560109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:55.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.316+0000 7f5566e87640 1 --2- 172.21.15.170:0/466606354 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55600fedb0 0x7f55600ff230 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:55.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.316+0000 7f5566e87640 1 --2- 172.21.15.170:0/466606354 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5560102340 0x7f5560102760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:55.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.316+0000 7f5566e87640 1 -- 172.21.15.170:0/466606354 >> 172.21.15.170:0/466606354 conn(0x7f55600fa8f0 msgr2=0x7f55600fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:55.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.316+0000 7f5566e87640 1 -- 172.21.15.170:0/466606354 shutdown_connections 2024-01-25T14:59:55.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.316+0000 7f5566e87640 1 -- 172.21.15.170:0/466606354 wait complete. 2024-01-25T14:59:55.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5566e87640 1 Processor -- start 2024-01-25T14:59:55.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5566e87640 1 -- start start 2024-01-25T14:59:55.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5566e87640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55600fedb0 0x7f5560196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:55.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5566e87640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55600ff770 0x7f55601971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:55.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5566e87640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5560102340 0x7f556019e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:55.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5566e87640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556019e780 con 0x7f5560102340 2024-01-25T14:59:55.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5566e87640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556019e8f0 con 0x7f55600fedb0 2024-01-25T14:59:55.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5566e87640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556019eab0 con 0x7f55600ff770 2024-01-25T14:59:55.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5565424640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5560102340 0x7f556019e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:55.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5565424640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5560102340 0x7f556019e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49132/0 (socket says 172.21.15.170:49132) 2024-01-25T14:59:55.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5565424640 1 -- 172.21.15.170:0/1924932435 learned_addr learned my addr 172.21.15.170:0/1924932435 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:55.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5565424640 1 -- 172.21.15.170:0/1924932435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55600ff770 msgr2=0x7f55601971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:55.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5564c23640 1 --2- 172.21.15.170:0/1924932435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55600fedb0 0x7f5560196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:55.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5557fff640 1 --2- 172.21.15.170:0/1924932435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55600ff770 0x7f55601971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:55.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5565424640 1 --2- 172.21.15.170:0/1924932435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55600ff770 0x7f55601971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:55.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5565424640 1 -- 172.21.15.170:0/1924932435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55600fedb0 msgr2=0x7f5560196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:55.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5565424640 1 --2- 172.21.15.170:0/1924932435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55600fedb0 0x7f5560196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:55.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5565424640 1 -- 172.21.15.170:0/1924932435 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5550009560 con 0x7f5560102340 2024-01-25T14:59:55.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5557fff640 1 --2- 172.21.15.170:0/1924932435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55600ff770 0x7f55601971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T14:59:55.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5565424640 1 --2- 172.21.15.170:0/1924932435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5560102340 0x7f556019e210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f555800b970 tx=0x7f555800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:55.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5555ffb640 1 -- 172.21.15.170:0/1924932435 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800cb40 con 0x7f5560102340 2024-01-25T14:59:55.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5555ffb640 1 -- 172.21.15.170:0/1924932435 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f555800cca0 con 0x7f5560102340 2024-01-25T14:59:55.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5566e87640 1 -- 172.21.15.170:0/1924932435 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f556019ed90 con 0x7f5560102340 2024-01-25T14:59:55.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.317+0000 7f5555ffb640 1 -- 172.21.15.170:0/1924932435 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558007770 con 0x7f5560102340 2024-01-25T14:59:55.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.318+0000 7f5566e87640 1 -- 172.21.15.170:0/1924932435 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f556019f270 con 0x7f5560102340 2024-01-25T14:59:55.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.319+0000 7f5566e87640 1 -- 172.21.15.170:0/1924932435 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5560108200 con 0x7f5560102340 2024-01-25T14:59:55.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.319+0000 7f5555ffb640 1 -- 172.21.15.170:0/1924932435 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f5558014440 con 0x7f5560102340 2024-01-25T14:59:55.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.320+0000 7f5555ffb640 1 --2- 172.21.15.170:0/1924932435 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55480a12e0 0x7f55480a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:55.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.320+0000 7f5564c23640 1 --2- 172.21.15.170:0/1924932435 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55480a12e0 0x7f55480a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:55.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.320+0000 7f5555ffb640 1 -- 172.21.15.170:0/1924932435 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f55580cc370 con 0x7f5560102340 2024-01-25T14:59:55.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.320+0000 7f5564c23640 1 --2- 172.21.15.170:0/1924932435 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55480a12e0 0x7f55480a37a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f555c005fd0 tx=0x7f555c005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:55.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.324+0000 7f5555ffb640 1 -- 172.21.15.170:0/1924932435 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f555804f600 con 0x7f5560102340 2024-01-25T14:59:55.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:55 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3312604694' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-01-25T14:59:55.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:55 smithi191 ceph-mon[36347]: pgmap v283: 97 pgs: 36 creating+peering, 10 active+clean, 51 unknown; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:55.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:55 smithi191 ceph-mon[36347]: osdmap e84: 12 total, 12 up, 12 in 2024-01-25T14:59:55.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:55 smithi191 ceph-mon[36347]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-01-25T14:59:55.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:55 smithi191 ceph-mon[36347]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-01-25T14:59:55.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:55 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/4092892600' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T14:59:55.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:55 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1054395756' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T14:59:55.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:55 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2749741486' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-01-25T14:59:55.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:55 smithi191 ceph-mon[36347]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-25T14:59:55.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:55 smithi191 ceph-mon[36347]: Cluster is now healthy 2024-01-25T14:59:55.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:55.531+0000 7f5566e87640 1 -- 172.21.15.170:0/1924932435 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f556010c7e0 con 0x7f5560102340 2024-01-25T14:59:55.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:55 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3312604694' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-01-25T14:59:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:55 smithi186 ceph-mon[35697]: pgmap v283: 97 pgs: 36 creating+peering, 10 active+clean, 51 unknown; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:55 smithi186 ceph-mon[35697]: osdmap e84: 12 total, 12 up, 12 in 2024-01-25T14:59:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:55 smithi186 ceph-mon[35697]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-01-25T14:59:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:55 smithi186 ceph-mon[35697]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-01-25T14:59:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:55 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/4092892600' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T14:59:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:55 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1054395756' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T14:59:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:55 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2749741486' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-01-25T14:59:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:55 smithi186 ceph-mon[35697]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-25T14:59:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:55 smithi186 ceph-mon[35697]: Cluster is now healthy 2024-01-25T14:59:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:55 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3312604694' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-01-25T14:59:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:55 smithi170 ceph-mon[31899]: pgmap v283: 97 pgs: 36 creating+peering, 10 active+clean, 51 unknown; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:55 smithi170 ceph-mon[31899]: osdmap e84: 12 total, 12 up, 12 in 2024-01-25T14:59:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:55 smithi170 ceph-mon[31899]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-01-25T14:59:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:55 smithi170 ceph-mon[31899]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-01-25T14:59:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:55 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/4092892600' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T14:59:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:55 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1054395756' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T14:59:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:55 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2749741486' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-01-25T14:59:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:55 smithi170 ceph-mon[31899]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-01-25T14:59:55.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:55 smithi170 ceph-mon[31899]: Cluster is now healthy 2024-01-25T14:59:56.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.205+0000 7f5555ffb640 1 -- 172.21.15.170:0/1924932435 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v16) v1 ==== 105+0+0 (secure 0 0 0) 0x7f5558095940 con 0x7f5560102340 2024-01-25T14:59:56.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.208+0000 7f5566e87640 1 -- 172.21.15.170:0/1924932435 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55480a12e0 msgr2=0x7f55480a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:56.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.209+0000 7f5566e87640 1 --2- 172.21.15.170:0/1924932435 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55480a12e0 0x7f55480a37a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f555c005fd0 tx=0x7f555c005d00 comp rx=0 tx=0).stop 2024-01-25T14:59:56.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.209+0000 7f5566e87640 1 -- 172.21.15.170:0/1924932435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5560102340 msgr2=0x7f556019e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:56.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.209+0000 7f5566e87640 1 --2- 172.21.15.170:0/1924932435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5560102340 0x7f556019e210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f555800b970 tx=0x7f555800be30 comp rx=0 tx=0).stop 2024-01-25T14:59:56.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.209+0000 7f5566e87640 1 -- 172.21.15.170:0/1924932435 shutdown_connections 2024-01-25T14:59:56.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.209+0000 7f5566e87640 1 --2- 172.21.15.170:0/1924932435 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55480a12e0 0x7f55480a37a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:56.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.209+0000 7f5566e87640 1 --2- 172.21.15.170:0/1924932435 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5560102340 0x7f556019e210 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:56.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.209+0000 7f5566e87640 1 --2- 172.21.15.170:0/1924932435 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55600ff770 0x7f55601971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:56.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.209+0000 7f5566e87640 1 --2- 172.21.15.170:0/1924932435 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55600fedb0 0x7f5560196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:56.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.209+0000 7f5566e87640 1 -- 172.21.15.170:0/1924932435 >> 172.21.15.170:0/1924932435 conn(0x7f55600fa8f0 msgr2=0x7f55601053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:56.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.209+0000 7f5566e87640 1 -- 172.21.15.170:0/1924932435 shutdown_connections 2024-01-25T14:59:56.214 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.209+0000 7f5566e87640 1 -- 172.21.15.170:0/1924932435 wait complete. 2024-01-25T14:59:56.226 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-01-25T14:59:56.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.334+0000 7fc2e049b640 1 -- 172.21.15.170:0/3620000345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2d8100de0 msgr2=0x7fc2d8101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:56.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.334+0000 7fc2e049b640 1 --2- 172.21.15.170:0/3620000345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2d8100de0 0x7fc2d8101260 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009900 tx=0x7fc2d402bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:56.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.334+0000 7fc2e049b640 1 -- 172.21.15.170:0/3620000345 shutdown_connections 2024-01-25T14:59:56.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.334+0000 7fc2e049b640 1 --2- 172.21.15.170:0/3620000345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2d81017a0 0x7fc2d8108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:56.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.334+0000 7fc2e049b640 1 --2- 172.21.15.170:0/3620000345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2d8100de0 0x7fc2d8101260 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:56.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.334+0000 7fc2e049b640 1 --2- 172.21.15.170:0/3620000345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2d80ffbf0 0x7fc2d8100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:56.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.334+0000 7fc2e049b640 1 -- 172.21.15.170:0/3620000345 >> 172.21.15.170:0/3620000345 conn(0x7fc2d80fb180 msgr2=0x7fc2d80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:56.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2e049b640 1 -- 172.21.15.170:0/3620000345 shutdown_connections 2024-01-25T14:59:56.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2e049b640 1 -- 172.21.15.170:0/3620000345 wait complete. 2024-01-25T14:59:56.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2e049b640 1 Processor -- start 2024-01-25T14:59:56.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2e049b640 1 -- start start 2024-01-25T14:59:56.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2e049b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2d80ffbf0 0x7fc2d80689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:56.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2e049b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2d8100de0 0x7fc2d819bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:56.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2e049b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2d81017a0 0x7fc2d819e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:56.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2e049b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d819e990 con 0x7fc2d80ffbf0 2024-01-25T14:59:56.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2e049b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d819eb00 con 0x7fc2d81017a0 2024-01-25T14:59:56.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2e049b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d819ecc0 con 0x7fc2d8100de0 2024-01-25T14:59:56.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2de237640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2d80ffbf0 0x7fc2d80689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:56.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2de237640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2d80ffbf0 0x7fc2d80689e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54098/0 (socket says 172.21.15.170:54098) 2024-01-25T14:59:56.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2de237640 1 -- 172.21.15.170:0/3261267018 learned_addr learned my addr 172.21.15.170:0/3261267018 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:56.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2de237640 1 -- 172.21.15.170:0/3261267018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2d8100de0 msgr2=0x7fc2d819bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:56.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2de237640 1 --2- 172.21.15.170:0/3261267018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2d8100de0 0x7fc2d819bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:56.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.335+0000 7fc2de237640 1 -- 172.21.15.170:0/3261267018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2d81017a0 msgr2=0x7fc2d819e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:56.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.336+0000 7fc2de237640 1 --2- 172.21.15.170:0/3261267018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2d81017a0 0x7fc2d819e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:56.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.336+0000 7fc2de237640 1 -- 172.21.15.170:0/3261267018 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d4009560 con 0x7fc2d80ffbf0 2024-01-25T14:59:56.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.336+0000 7fc2de237640 1 --2- 172.21.15.170:0/3261267018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2d80ffbf0 0x7fc2d80689e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800b450 tx=0x7fc2c800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:56.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.336+0000 7fc2cf7fe640 1 -- 172.21.15.170:0/3261267018 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8011890 con 0x7fc2d80ffbf0 2024-01-25T14:59:56.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.336+0000 7fc2cf7fe640 1 -- 172.21.15.170:0/3261267018 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc2c80103e0 con 0x7fc2d80ffbf0 2024-01-25T14:59:56.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.336+0000 7fc2e049b640 1 -- 172.21.15.170:0/3261267018 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d819efa0 con 0x7fc2d80ffbf0 2024-01-25T14:59:56.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.336+0000 7fc2cf7fe640 1 -- 172.21.15.170:0/3261267018 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c800f5a0 con 0x7fc2d80ffbf0 2024-01-25T14:59:56.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.336+0000 7fc2e049b640 1 -- 172.21.15.170:0/3261267018 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d819f4f0 con 0x7fc2d80ffbf0 2024-01-25T14:59:56.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.337+0000 7fc2e049b640 1 -- 172.21.15.170:0/3261267018 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d81070d0 con 0x7fc2d80ffbf0 2024-01-25T14:59:56.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.338+0000 7fc2cf7fe640 1 -- 172.21.15.170:0/3261267018 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fc2c8010850 con 0x7fc2d80ffbf0 2024-01-25T14:59:56.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.338+0000 7fc2cf7fe640 1 --2- 172.21.15.170:0/3261267018 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc2c40a1360 0x7fc2c40a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:56.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.339+0000 7fc2dda36640 1 --2- 172.21.15.170:0/3261267018 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc2c40a1360 0x7fc2c40a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:56.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.339+0000 7fc2cf7fe640 1 -- 172.21.15.170:0/3261267018 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc2c80cc7b0 con 0x7fc2d80ffbf0 2024-01-25T14:59:56.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.339+0000 7fc2dda36640 1 --2- 172.21.15.170:0/3261267018 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc2c40a1360 0x7fc2c40a3820 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4005c20 tx=0x7fc2d402c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:56.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.343+0000 7fc2cf7fe640 1 -- 172.21.15.170:0/3261267018 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fc2c8095d80 con 0x7fc2d80ffbf0 2024-01-25T14:59:56.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:56 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2749741486' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-01-25T14:59:56.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:56 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] up:active 2024-01-25T14:59:56.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:56 smithi191 ceph-mon[36347]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-01-25T14:59:56.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:56 smithi191 ceph-mon[36347]: osdmap e85: 12 total, 12 up, 12 in 2024-01-25T14:59:56.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:56 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1924932435' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-01-25T14:59:56.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:56.551+0000 7fc2e049b640 1 -- 172.21.15.170:0/3261267018 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fc2d802cb10 con 0x7fc2d80ffbf0 2024-01-25T14:59:56.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:56 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2749741486' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-01-25T14:59:56.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:56 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] up:active 2024-01-25T14:59:56.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:56 smithi186 ceph-mon[35697]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-01-25T14:59:56.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:56 smithi186 ceph-mon[35697]: osdmap e85: 12 total, 12 up, 12 in 2024-01-25T14:59:56.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:56 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1924932435' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-01-25T14:59:56.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:56 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2749741486' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-01-25T14:59:56.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:56 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] up:active 2024-01-25T14:59:56.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:56 smithi170 ceph-mon[31899]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-01-25T14:59:56.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:56 smithi170 ceph-mon[31899]: osdmap e85: 12 total, 12 up, 12 in 2024-01-25T14:59:56.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:56 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1924932435' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-01-25T14:59:57.213 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.212+0000 7fc2cf7fe640 1 -- 172.21.15.170:0/3261267018 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v18) v1 ==== 121+0+0 (secure 0 0 0) 0x7fc2c80993a0 con 0x7fc2d80ffbf0 2024-01-25T14:59:57.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.215+0000 7fc2e049b640 1 -- 172.21.15.170:0/3261267018 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc2c40a1360 msgr2=0x7fc2c40a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:57.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.215+0000 7fc2e049b640 1 --2- 172.21.15.170:0/3261267018 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc2c40a1360 0x7fc2c40a3820 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4005c20 tx=0x7fc2d402c5d0 comp rx=0 tx=0).stop 2024-01-25T14:59:57.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.215+0000 7fc2e049b640 1 -- 172.21.15.170:0/3261267018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2d80ffbf0 msgr2=0x7fc2d80689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:57.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.215+0000 7fc2e049b640 1 --2- 172.21.15.170:0/3261267018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2d80ffbf0 0x7fc2d80689e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800b450 tx=0x7fc2c800b910 comp rx=0 tx=0).stop 2024-01-25T14:59:57.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.215+0000 7fc2e049b640 1 -- 172.21.15.170:0/3261267018 shutdown_connections 2024-01-25T14:59:57.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.215+0000 7fc2e049b640 1 --2- 172.21.15.170:0/3261267018 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc2c40a1360 0x7fc2c40a3820 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:57.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.215+0000 7fc2e049b640 1 --2- 172.21.15.170:0/3261267018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2d81017a0 0x7fc2d819e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:57.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.215+0000 7fc2e049b640 1 --2- 172.21.15.170:0/3261267018 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc2d8100de0 0x7fc2d819bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:57.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.215+0000 7fc2e049b640 1 --2- 172.21.15.170:0/3261267018 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc2d80ffbf0 0x7fc2d80689e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:57.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.215+0000 7fc2e049b640 1 -- 172.21.15.170:0/3261267018 >> 172.21.15.170:0/3261267018 conn(0x7fc2d80fb180 msgr2=0x7fc2d81042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:57.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.215+0000 7fc2e049b640 1 -- 172.21.15.170:0/3261267018 shutdown_connections 2024-01-25T14:59:57.217 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.215+0000 7fc2e049b640 1 -- 172.21.15.170:0/3261267018 wait complete. 2024-01-25T14:59:57.234 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-01-25T14:59:57.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 -- 172.21.15.170:0/1547177937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd52c100e00 msgr2=0x7fd52c101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:57.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 --2- 172.21.15.170:0/1547177937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd52c100e00 0x7fd52c101280 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd528009900 tx=0x7fd52802bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:57.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 -- 172.21.15.170:0/1547177937 shutdown_connections 2024-01-25T14:59:57.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 --2- 172.21.15.170:0/1547177937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd52c1017c0 0x7fd52c108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:57.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 --2- 172.21.15.170:0/1547177937 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd52c100e00 0x7fd52c101280 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:57.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 --2- 172.21.15.170:0/1547177937 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd52c0ffc10 0x7fd52c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:57.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 -- 172.21.15.170:0/1547177937 >> 172.21.15.170:0/1547177937 conn(0x7fd52c0fb180 msgr2=0x7fd52c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:57.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 -- 172.21.15.170:0/1547177937 shutdown_connections 2024-01-25T14:59:57.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 -- 172.21.15.170:0/1547177937 wait complete. 2024-01-25T14:59:57.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 Processor -- start 2024-01-25T14:59:57.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 -- start start 2024-01-25T14:59:57.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd52c0ffc10 0x7fd52c196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:57.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd52c100e00 0x7fd52c197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:57.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd52c1017c0 0x7fd52c19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:57.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c19e7e0 con 0x7fd52c1017c0 2024-01-25T14:59:57.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c19e950 con 0x7fd52c0ffc10 2024-01-25T14:59:57.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.344+0000 7fd533b5a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c19eb10 con 0x7fd52c100e00 2024-01-25T14:59:57.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd5320f7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd52c1017c0 0x7fd52c19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:57.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd5320f7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd52c1017c0 0x7fd52c19e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54120/0 (socket says 172.21.15.170:54120) 2024-01-25T14:59:57.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd5320f7640 1 -- 172.21.15.170:0/3773263283 learned_addr learned my addr 172.21.15.170:0/3773263283 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:57.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd5310f5640 1 --2- 172.21.15.170:0/3773263283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd52c100e00 0x7fd52c197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:57.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd5318f6640 1 --2- 172.21.15.170:0/3773263283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd52c0ffc10 0x7fd52c196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:57.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd5320f7640 1 -- 172.21.15.170:0/3773263283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd52c100e00 msgr2=0x7fd52c197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:57.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd5320f7640 1 --2- 172.21.15.170:0/3773263283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd52c100e00 0x7fd52c197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:57.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd5320f7640 1 -- 172.21.15.170:0/3773263283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd52c0ffc10 msgr2=0x7fd52c196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:57.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd5320f7640 1 --2- 172.21.15.170:0/3773263283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd52c0ffc10 0x7fd52c196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:57.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd5320f7640 1 -- 172.21.15.170:0/3773263283 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd528009560 con 0x7fd52c1017c0 2024-01-25T14:59:57.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd5318f6640 1 --2- 172.21.15.170:0/3773263283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd52c0ffc10 0x7fd52c196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T14:59:57.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd5320f7640 1 --2- 172.21.15.170:0/3773263283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd52c1017c0 0x7fd52c19e270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd52400cce0 tx=0x7fd52400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:57.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd51effd640 1 -- 172.21.15.170:0/3773263283 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52400f450 con 0x7fd52c1017c0 2024-01-25T14:59:57.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd51effd640 1 -- 172.21.15.170:0/3773263283 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd52400fa70 con 0x7fd52c1017c0 2024-01-25T14:59:57.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd533b5a640 1 -- 172.21.15.170:0/3773263283 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52c19edf0 con 0x7fd52c1017c0 2024-01-25T14:59:57.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd51effd640 1 -- 172.21.15.170:0/3773263283 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524018b40 con 0x7fd52c1017c0 2024-01-25T14:59:57.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.345+0000 7fd533b5a640 1 -- 172.21.15.170:0/3773263283 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52c19f1c0 con 0x7fd52c1017c0 2024-01-25T14:59:57.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.346+0000 7fd533b5a640 1 -- 172.21.15.170:0/3773263283 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52c10b4d0 con 0x7fd52c1017c0 2024-01-25T14:59:57.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.347+0000 7fd51effd640 1 -- 172.21.15.170:0/3773263283 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fd52400fbe0 con 0x7fd52c1017c0 2024-01-25T14:59:57.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.348+0000 7fd51effd640 1 --2- 172.21.15.170:0/3773263283 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd5180a12e0 0x7fd5180a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:57.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.348+0000 7fd5318f6640 1 --2- 172.21.15.170:0/3773263283 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd5180a12e0 0x7fd5180a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:57.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.348+0000 7fd51effd640 1 -- 172.21.15.170:0/3773263283 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd5240cd2d0 con 0x7fd52c1017c0 2024-01-25T14:59:57.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.348+0000 7fd5318f6640 1 --2- 172.21.15.170:0/3773263283 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd5180a12e0 0x7fd5180a37a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd520005fd0 tx=0x7fd520005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:57.353 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.352+0000 7fd51effd640 1 -- 172.21.15.170:0/3773263283 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fd524096810 con 0x7fd52c1017c0 2024-01-25T14:59:57.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:57 smithi191 ceph-mon[36347]: pgmap v285: 97 pgs: 1 creating+activating, 36 creating+peering, 38 active+clean, 22 unknown; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:57.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:57 smithi191 ceph-mon[36347]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-01-25T14:59:57.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:57 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1924932435' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-01-25T14:59:57.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:57 smithi191 ceph-mon[36347]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-01-25T14:59:57.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:57 smithi191 ceph-mon[36347]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-01-25T14:59:57.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:57 smithi191 ceph-mon[36347]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-01-25T14:59:57.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:57 smithi191 ceph-mon[36347]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-01-25T14:59:57.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:57 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3261267018' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-01-25T14:59:57.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:57.560+0000 7fd533b5a640 1 -- 172.21.15.170:0/3773263283 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fd52c19f5a0 con 0x7fd52c1017c0 2024-01-25T14:59:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:57 smithi186 ceph-mon[35697]: pgmap v285: 97 pgs: 1 creating+activating, 36 creating+peering, 38 active+clean, 22 unknown; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:57 smithi186 ceph-mon[35697]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-01-25T14:59:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:57 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1924932435' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-01-25T14:59:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:57 smithi186 ceph-mon[35697]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-01-25T14:59:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:57 smithi186 ceph-mon[35697]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-01-25T14:59:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:57 smithi186 ceph-mon[35697]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-01-25T14:59:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:57 smithi186 ceph-mon[35697]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-01-25T14:59:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:57 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3261267018' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-01-25T14:59:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:57 smithi170 ceph-mon[31899]: pgmap v285: 97 pgs: 1 creating+activating, 36 creating+peering, 38 active+clean, 22 unknown; 577 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-01-25T14:59:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:57 smithi170 ceph-mon[31899]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-01-25T14:59:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:57 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1924932435' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-01-25T14:59:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:57 smithi170 ceph-mon[31899]: daemon mds.b assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-01-25T14:59:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:57 smithi170 ceph-mon[31899]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-01-25T14:59:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:57 smithi170 ceph-mon[31899]: fsmap cephfs:2 {0=i=up:active,1=b=up:creating} 10 up:standby 2024-01-25T14:59:57.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:57 smithi170 ceph-mon[31899]: daemon mds.b is now active in filesystem cephfs as rank 1 2024-01-25T14:59:57.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:57 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3261267018' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-01-25T14:59:58.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.029+0000 7fd51effd640 1 -- 172.21.15.170:0/3773263283 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v20) v1 ==== 115+0+0 (secure 0 0 0) 0x7fd524098740 con 0x7fd52c1017c0 2024-01-25T14:59:58.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.031+0000 7fd533b5a640 1 -- 172.21.15.170:0/3773263283 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd5180a12e0 msgr2=0x7fd5180a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:58.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.031+0000 7fd533b5a640 1 --2- 172.21.15.170:0/3773263283 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd5180a12e0 0x7fd5180a37a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd520005fd0 tx=0x7fd520005850 comp rx=0 tx=0).stop 2024-01-25T14:59:58.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.031+0000 7fd533b5a640 1 -- 172.21.15.170:0/3773263283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd52c1017c0 msgr2=0x7fd52c19e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:58.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.031+0000 7fd533b5a640 1 --2- 172.21.15.170:0/3773263283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd52c1017c0 0x7fd52c19e270 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd52400cce0 tx=0x7fd52400a620 comp rx=0 tx=0).stop 2024-01-25T14:59:58.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.031+0000 7fd533b5a640 1 -- 172.21.15.170:0/3773263283 shutdown_connections 2024-01-25T14:59:58.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.031+0000 7fd533b5a640 1 --2- 172.21.15.170:0/3773263283 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd5180a12e0 0x7fd5180a37a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:58.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.031+0000 7fd533b5a640 1 --2- 172.21.15.170:0/3773263283 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd52c1017c0 0x7fd52c19e270 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:58.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.031+0000 7fd533b5a640 1 --2- 172.21.15.170:0/3773263283 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd52c100e00 0x7fd52c197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:58.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.031+0000 7fd533b5a640 1 --2- 172.21.15.170:0/3773263283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd52c0ffc10 0x7fd52c196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:58.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.031+0000 7fd533b5a640 1 -- 172.21.15.170:0/3773263283 >> 172.21.15.170:0/3773263283 conn(0x7fd52c0fb180 msgr2=0x7fd52c068f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:58.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.031+0000 7fd533b5a640 1 -- 172.21.15.170:0/3773263283 shutdown_connections 2024-01-25T14:59:58.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.031+0000 7fd533b5a640 1 -- 172.21.15.170:0/3773263283 wait complete. 2024-01-25T14:59:58.049 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-01-25T14:59:58.049 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-01-25T14:59:58.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.153+0000 7fe5c5864640 1 -- 172.21.15.170:0/3506604683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5c0100de0 msgr2=0x7fe5c0101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.153+0000 7fe5c5864640 1 --2- 172.21.15.170:0/3506604683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5c0100de0 0x7fe5c0101260 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009900 tx=0x7fe5b402bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.153+0000 7fe5c5864640 1 -- 172.21.15.170:0/3506604683 shutdown_connections 2024-01-25T14:59:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.153+0000 7fe5c5864640 1 --2- 172.21.15.170:0/3506604683 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5c01017a0 0x7fe5c0108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.153+0000 7fe5c5864640 1 --2- 172.21.15.170:0/3506604683 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5c0100de0 0x7fe5c0101260 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.153+0000 7fe5c5864640 1 --2- 172.21.15.170:0/3506604683 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5c00ffbf0 0x7fe5c0100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.153+0000 7fe5c5864640 1 -- 172.21.15.170:0/3506604683 >> 172.21.15.170:0/3506604683 conn(0x7fe5c00fb180 msgr2=0x7fe5c00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.153+0000 7fe5c5864640 1 -- 172.21.15.170:0/3506604683 shutdown_connections 2024-01-25T14:59:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.153+0000 7fe5c5864640 1 -- 172.21.15.170:0/3506604683 wait complete. 2024-01-25T14:59:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.153+0000 7fe5c5864640 1 Processor -- start 2024-01-25T14:59:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5c5864640 1 -- start start 2024-01-25T14:59:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5c5864640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5c00ffbf0 0x7fe5c0103b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5c5864640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5c0100de0 0x7fe5c01021c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:58.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5c5864640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5c01017a0 0x7fe5c0102700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5c5864640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0102e60 con 0x7fe5c0100de0 2024-01-25T14:59:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5c5864640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c0102fd0 con 0x7fe5c00ffbf0 2024-01-25T14:59:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5c5864640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c01a0ef0 con 0x7fe5c01017a0 2024-01-25T14:59:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5be7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5c0100de0 0x7fe5c01021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5be7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5c0100de0 0x7fe5c01021c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54140/0 (socket says 172.21.15.170:54140) 2024-01-25T14:59:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5be7fc640 1 -- 172.21.15.170:0/1712868855 learned_addr learned my addr 172.21.15.170:0/1712868855 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5bf7fe640 1 --2- 172.21.15.170:0/1712868855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5c01017a0 0x7fe5c0102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5be7fc640 1 -- 172.21.15.170:0/1712868855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5c01017a0 msgr2=0x7fe5c0102700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5be7fc640 1 --2- 172.21.15.170:0/1712868855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5c01017a0 0x7fe5c0102700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5be7fc640 1 -- 172.21.15.170:0/1712868855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5c00ffbf0 msgr2=0x7fe5c0103b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5beffd640 1 --2- 172.21.15.170:0/1712868855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5c00ffbf0 0x7fe5c0103b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5be7fc640 1 --2- 172.21.15.170:0/1712868855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5c00ffbf0 0x7fe5c0103b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5be7fc640 1 -- 172.21.15.170:0/1712868855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b4009560 con 0x7fe5c0100de0 2024-01-25T14:59:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5be7fc640 1 --2- 172.21.15.170:0/1712868855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5c0100de0 0x7fe5c01021c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009430 tx=0x7fe5b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:58.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.154+0000 7fe5c4862640 1 -- 172.21.15.170:0/1712868855 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40044e0 con 0x7fe5c0100de0 2024-01-25T14:59:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.155+0000 7fe5c4862640 1 -- 172.21.15.170:0/1712868855 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5b40035f0 con 0x7fe5c0100de0 2024-01-25T14:59:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.155+0000 7fe5c5864640 1 -- 172.21.15.170:0/1712868855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c01a1140 con 0x7fe5c0100de0 2024-01-25T14:59:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.155+0000 7fe5c4862640 1 -- 172.21.15.170:0/1712868855 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b403e6b0 con 0x7fe5c0100de0 2024-01-25T14:59:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.155+0000 7fe5c5864640 1 -- 172.21.15.170:0/1712868855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c01a16d0 con 0x7fe5c0100de0 2024-01-25T14:59:58.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.155+0000 7fe5c5864640 1 -- 172.21.15.170:0/1712868855 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c010b5a0 con 0x7fe5c0100de0 2024-01-25T14:59:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.157+0000 7fe5c4862640 1 -- 172.21.15.170:0/1712868855 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fe5b40039d0 con 0x7fe5c0100de0 2024-01-25T14:59:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.157+0000 7fe5c4862640 1 --2- 172.21.15.170:0/1712868855 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe5a80a12e0 0x7fe5a80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.157+0000 7fe5beffd640 1 --2- 172.21.15.170:0/1712868855 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe5a80a12e0 0x7fe5a80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.157+0000 7fe5c4862640 1 -- 172.21.15.170:0/1712868855 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe5b40eef60 con 0x7fe5c0100de0 2024-01-25T14:59:58.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.158+0000 7fe5beffd640 1 --2- 172.21.15.170:0/1712868855 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe5a80a12e0 0x7fe5a80a37a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0100c40 tx=0x7fe5b0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:58.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.162+0000 7fe5c4862640 1 -- 172.21.15.170:0/1712868855 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fe5b40b8530 con 0x7fe5c0100de0 2024-01-25T14:59:58.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:58.358+0000 7fe5c5864640 1 -- 172.21.15.170:0/1712868855 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5c0068590 con 0x7fe5a80a12e0 2024-01-25T14:59:58.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3261267018' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-01-25T14:59:58.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] up:active 2024-01-25T14:59:58.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-mon[31899]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-01-25T14:59:58.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-mon[31899]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-01-25T14:59:58.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-mon[31899]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-01-25T14:59:58.365 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-mon[31899]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-01-25T14:59:58.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3773263283' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-01-25T14:59:58.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3773263283' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-01-25T14:59:58.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] up:active 2024-01-25T14:59:58.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-mon[31899]: daemon mds.l assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-01-25T14:59:58.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-mon[31899]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-01-25T14:59:58.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-mon[31899]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=l=up:creating} 3 up:standby-replay 5 up:standby 2024-01-25T14:59:58.366 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-mon[31899]: daemon mds.l is now active in filesystem cephfs as rank 3 2024-01-25T14:59:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:58 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3261267018' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-01-25T14:59:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:58 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] up:active 2024-01-25T14:59:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:58 smithi191 ceph-mon[36347]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-01-25T14:59:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:58 smithi191 ceph-mon[36347]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-01-25T14:59:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:58 smithi191 ceph-mon[36347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-01-25T14:59:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:58 smithi191 ceph-mon[36347]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-01-25T14:59:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:58 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3773263283' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-01-25T14:59:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:58 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3773263283' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-01-25T14:59:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:58 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] up:active 2024-01-25T14:59:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:58 smithi191 ceph-mon[36347]: daemon mds.l assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-01-25T14:59:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:58 smithi191 ceph-mon[36347]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-01-25T14:59:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:58 smithi191 ceph-mon[36347]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=l=up:creating} 3 up:standby-replay 5 up:standby 2024-01-25T14:59:58.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:58 smithi191 ceph-mon[36347]: daemon mds.l is now active in filesystem cephfs as rank 3 2024-01-25T14:59:58.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:58 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3261267018' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-01-25T14:59:58.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:58 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] up:active 2024-01-25T14:59:58.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:58 smithi186 ceph-mon[35697]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-01-25T14:59:58.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:58 smithi186 ceph-mon[35697]: fsmap cephfs:2 {0=i=up:active,1=b=up:active} 10 up:standby 2024-01-25T14:59:58.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:58 smithi186 ceph-mon[35697]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:creating} 9 up:standby 2024-01-25T14:59:58.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:58 smithi186 ceph-mon[35697]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-01-25T14:59:58.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:58 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3773263283' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-01-25T14:59:58.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:58 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3773263283' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-01-25T14:59:58.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:58 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] up:active 2024-01-25T14:59:58.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:58 smithi186 ceph-mon[35697]: daemon mds.l assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-01-25T14:59:58.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:58 smithi186 ceph-mon[35697]: fsmap cephfs:3 {0=i=up:active,1=b=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-01-25T14:59:58.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:58 smithi186 ceph-mon[35697]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=l=up:creating} 3 up:standby-replay 5 up:standby 2024-01-25T14:59:58.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:58 smithi186 ceph-mon[35697]: daemon mds.l is now active in filesystem cephfs as rank 3 2024-01-25T14:59:58.624 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:59:58.363+0000 7f6563998700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-25T14:59:58.624 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:59:58.363+0000 7f6563998700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-25T14:59:58.624 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:59:58.363+0000 7f6563998700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-25T14:59:58.624 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:59:58.363+0000 7f6563998700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-25T14:59:58.624 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 14:59:58 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T14:59:58.363+0000 7f6563998700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-25T14:59:59.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.057+0000 7fe5c4862640 1 -- 172.21.15.170:0/1712868855 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe5c0068590 con 0x7fe5a80a12e0 2024-01-25T14:59:59.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.059+0000 7fe5c5864640 1 -- 172.21.15.170:0/1712868855 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe5a80a12e0 msgr2=0x7fe5a80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:59.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.059+0000 7fe5c5864640 1 --2- 172.21.15.170:0/1712868855 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe5a80a12e0 0x7fe5a80a37a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0100c40 tx=0x7fe5b0008040 comp rx=0 tx=0).stop 2024-01-25T14:59:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.059+0000 7fe5c5864640 1 -- 172.21.15.170:0/1712868855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5c0100de0 msgr2=0x7fe5c01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.059+0000 7fe5c5864640 1 --2- 172.21.15.170:0/1712868855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5c0100de0 0x7fe5c01021c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009430 tx=0x7fe5b40042f0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.059+0000 7fe5c5864640 1 -- 172.21.15.170:0/1712868855 shutdown_connections 2024-01-25T14:59:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.059+0000 7fe5c5864640 1 --2- 172.21.15.170:0/1712868855 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe5a80a12e0 0x7fe5a80a37a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.059+0000 7fe5c5864640 1 --2- 172.21.15.170:0/1712868855 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5c01017a0 0x7fe5c0102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.059+0000 7fe5c5864640 1 --2- 172.21.15.170:0/1712868855 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5c0100de0 0x7fe5c01021c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.059+0000 7fe5c5864640 1 --2- 172.21.15.170:0/1712868855 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5c00ffbf0 0x7fe5c0103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.059+0000 7fe5c5864640 1 -- 172.21.15.170:0/1712868855 >> 172.21.15.170:0/1712868855 conn(0x7fe5c00fb180 msgr2=0x7fe5c0067e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.059+0000 7fe5c5864640 1 -- 172.21.15.170:0/1712868855 shutdown_connections 2024-01-25T14:59:59.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.059+0000 7fe5c5864640 1 -- 172.21.15.170:0/1712868855 wait complete. 2024-01-25T14:59:59.072 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-01-25T14:59:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.179+0000 7f043125c640 1 -- 172.21.15.170:0/3132130310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f042c100d00 msgr2=0x7f042c101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.179+0000 7f043125c640 1 --2- 172.21.15.170:0/3132130310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f042c100d00 0x7f042c101120 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f041c009ca0 tx=0x7f041c02c0f0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.179+0000 7f043125c640 1 -- 172.21.15.170:0/3132130310 shutdown_connections 2024-01-25T14:59:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.179+0000 7f043125c640 1 --2- 172.21.15.170:0/3132130310 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f042c1028b0 0x7f042c109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.179+0000 7f043125c640 1 --2- 172.21.15.170:0/3132130310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f042c101ef0 0x7f042c102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.179+0000 7f043125c640 1 --2- 172.21.15.170:0/3132130310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f042c100d00 0x7f042c101120 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.179+0000 7f043125c640 1 -- 172.21.15.170:0/3132130310 >> 172.21.15.170:0/3132130310 conn(0x7f042c0fc290 msgr2=0x7f042c0fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.179+0000 7f043125c640 1 -- 172.21.15.170:0/3132130310 shutdown_connections 2024-01-25T14:59:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.179+0000 7f043125c640 1 -- 172.21.15.170:0/3132130310 wait complete. 2024-01-25T14:59:59.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.180+0000 7f043125c640 1 Processor -- start 2024-01-25T14:59:59.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.180+0000 7f043125c640 1 -- start start 2024-01-25T14:59:59.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.180+0000 7f043125c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f042c100d00 0x7f042c196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:59.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.180+0000 7f043125c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f042c101ef0 0x7f042c197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:59.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.180+0000 7f043125c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f042c1028b0 0x7f042c19e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:59.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.180+0000 7f043125c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c19e8a0 con 0x7f042c101ef0 2024-01-25T14:59:59.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.180+0000 7f043125c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c19ea10 con 0x7f042c100d00 2024-01-25T14:59:59.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.180+0000 7f043125c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c19ebd0 con 0x7f042c1028b0 2024-01-25T14:59:59.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.180+0000 7f042a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f042c101ef0 0x7f042c197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:59.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.180+0000 7f042a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f042c101ef0 0x7f042c197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54178/0 (socket says 172.21.15.170:54178) 2024-01-25T14:59:59.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.180+0000 7f042a59c640 1 -- 172.21.15.170:0/3244305285 learned_addr learned my addr 172.21.15.170:0/3244305285 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:59.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.180+0000 7f042ad9d640 1 --2- 172.21.15.170:0/3244305285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f042c100d00 0x7f042c196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:59.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.180+0000 7f042b59e640 1 --2- 172.21.15.170:0/3244305285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f042c1028b0 0x7f042c19e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:59.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.181+0000 7f042a59c640 1 -- 172.21.15.170:0/3244305285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f042c1028b0 msgr2=0x7f042c19e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:59.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.181+0000 7f042a59c640 1 --2- 172.21.15.170:0/3244305285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f042c1028b0 0x7f042c19e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.181+0000 7f042a59c640 1 -- 172.21.15.170:0/3244305285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f042c100d00 msgr2=0x7f042c196dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:59.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.181+0000 7f042a59c640 1 --2- 172.21.15.170:0/3244305285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f042c100d00 0x7f042c196dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.181+0000 7f042a59c640 1 -- 172.21.15.170:0/3244305285 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c009900 con 0x7f042c101ef0 2024-01-25T14:59:59.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.181+0000 7f042b59e640 1 --2- 172.21.15.170:0/3244305285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f042c1028b0 0x7f042c19e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T14:59:59.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.181+0000 7f042a59c640 1 --2- 172.21.15.170:0/3244305285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f042c101ef0 0x7f042c197300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f042000b4a0 tx=0x7f042000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:59.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.181+0000 7f0413fff640 1 -- 172.21.15.170:0/3244305285 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420010610 con 0x7f042c101ef0 2024-01-25T14:59:59.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.181+0000 7f0413fff640 1 -- 172.21.15.170:0/3244305285 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0420010c30 con 0x7f042c101ef0 2024-01-25T14:59:59.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.181+0000 7f043125c640 1 -- 172.21.15.170:0/3244305285 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042c19eeb0 con 0x7f042c101ef0 2024-01-25T14:59:59.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.181+0000 7f0413fff640 1 -- 172.21.15.170:0/3244305285 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420017dd0 con 0x7f042c101ef0 2024-01-25T14:59:59.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.181+0000 7f043125c640 1 -- 172.21.15.170:0/3244305285 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042c19f300 con 0x7f042c101ef0 2024-01-25T14:59:59.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.182+0000 7f043125c640 1 -- 172.21.15.170:0/3244305285 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042c1081b0 con 0x7f042c101ef0 2024-01-25T14:59:59.185 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.183+0000 7f0413fff640 1 -- 172.21.15.170:0/3244305285 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f04200173f0 con 0x7f042c101ef0 2024-01-25T14:59:59.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.183+0000 7f0413fff640 1 --2- 172.21.15.170:0/3244305285 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f04140a12e0 0x7f04140a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:59.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.184+0000 7f042ad9d640 1 --2- 172.21.15.170:0/3244305285 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f04140a12e0 0x7f04140a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:59.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.184+0000 7f0413fff640 1 -- 172.21.15.170:0/3244305285 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f04200cc4b0 con 0x7f042c101ef0 2024-01-25T14:59:59.186 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.184+0000 7f042ad9d640 1 --2- 172.21.15.170:0/3244305285 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f04140a12e0 0x7f04140a37a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f042c198290 tx=0x7f041c032690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:59.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.187+0000 7f0413fff640 1 -- 172.21.15.170:0/3244305285 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f04200959f0 con 0x7f042c101ef0 2024-01-25T14:59:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:59 smithi170 ceph-mon[31899]: pgmap v286: 97 pgs: 1 creating+activating, 24 creating+peering, 72 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 4.7 KiB/s wr, 14 op/s 2024-01-25T14:59:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:59 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] up:active 2024-01-25T14:59:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:59 smithi170 ceph-mon[31899]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-01-25T14:59:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:59 smithi170 ceph-mon[31899]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-01-25T14:59:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:59 smithi170 ceph-mon[31899]: Cluster is now healthy 2024-01-25T14:59:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:59 smithi170 ceph-mon[31899]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=l=up:active} 3 up:standby-replay 5 up:standby 2024-01-25T14:59:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:59 smithi170 ceph-mon[31899]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2024-01-25T14:59:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 14:59:59 smithi170 ceph-mon[31899]: daemon mds.k is now active in filesystem cephfs as rank 4 2024-01-25T14:59:59.387 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.386+0000 7f043125c640 1 -- 172.21.15.170:0/3244305285 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f042c02ccc0 con 0x7f04140a12e0 2024-01-25T14:59:59.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.408+0000 7f0413fff640 1 -- 172.21.15.170:0/3244305285 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f042c02ccc0 con 0x7f04140a12e0 2024-01-25T14:59:59.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.412+0000 7f043125c640 1 -- 172.21.15.170:0/3244305285 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f04140a12e0 msgr2=0x7f04140a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.412+0000 7f043125c640 1 --2- 172.21.15.170:0/3244305285 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f04140a12e0 0x7f04140a37a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f042c198290 tx=0x7f041c032690 comp rx=0 tx=0).stop 2024-01-25T14:59:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.412+0000 7f043125c640 1 -- 172.21.15.170:0/3244305285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f042c101ef0 msgr2=0x7f042c197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.412+0000 7f043125c640 1 --2- 172.21.15.170:0/3244305285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f042c101ef0 0x7f042c197300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f042000b4a0 tx=0x7f042000b960 comp rx=0 tx=0).stop 2024-01-25T14:59:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.412+0000 7f043125c640 1 -- 172.21.15.170:0/3244305285 shutdown_connections 2024-01-25T14:59:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.412+0000 7f043125c640 1 --2- 172.21.15.170:0/3244305285 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f04140a12e0 0x7f04140a37a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.412+0000 7f043125c640 1 --2- 172.21.15.170:0/3244305285 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f042c1028b0 0x7f042c19e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.412+0000 7f043125c640 1 --2- 172.21.15.170:0/3244305285 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f042c101ef0 0x7f042c197300 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.412+0000 7f043125c640 1 --2- 172.21.15.170:0/3244305285 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f042c100d00 0x7f042c196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.412+0000 7f043125c640 1 -- 172.21.15.170:0/3244305285 >> 172.21.15.170:0/3244305285 conn(0x7f042c0fc290 msgr2=0x7f042c105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.412+0000 7f043125c640 1 -- 172.21.15.170:0/3244305285 shutdown_connections 2024-01-25T14:59:59.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.412+0000 7f043125c640 1 -- 172.21.15.170:0/3244305285 wait complete. 2024-01-25T14:59:59.428 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-01-25T14:59:59.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:59 smithi191 ceph-mon[36347]: pgmap v286: 97 pgs: 1 creating+activating, 24 creating+peering, 72 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 4.7 KiB/s wr, 14 op/s 2024-01-25T14:59:59.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:59 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] up:active 2024-01-25T14:59:59.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:59 smithi191 ceph-mon[36347]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-01-25T14:59:59.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:59 smithi191 ceph-mon[36347]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-01-25T14:59:59.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:59 smithi191 ceph-mon[36347]: Cluster is now healthy 2024-01-25T14:59:59.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:59 smithi191 ceph-mon[36347]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=l=up:active} 3 up:standby-replay 5 up:standby 2024-01-25T14:59:59.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:59 smithi191 ceph-mon[36347]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2024-01-25T14:59:59.485 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 14:59:59 smithi191 ceph-mon[36347]: daemon mds.k is now active in filesystem cephfs as rank 4 2024-01-25T14:59:59.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.536+0000 7f134f549640 1 -- 172.21.15.170:0/355163602 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13481028b0 msgr2=0x7f1348109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:59.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.536+0000 7f134f549640 1 --2- 172.21.15.170:0/355163602 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13481028b0 0x7f1348109140 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1340009ca0 tx=0x7f134002c0f0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.536+0000 7f134f549640 1 -- 172.21.15.170:0/355163602 shutdown_connections 2024-01-25T14:59:59.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.536+0000 7f134f549640 1 --2- 172.21.15.170:0/355163602 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f13481028b0 0x7f1348109140 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.536+0000 7f134f549640 1 --2- 172.21.15.170:0/355163602 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1348101ef0 0x7f1348102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.536+0000 7f134f549640 1 --2- 172.21.15.170:0/355163602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1348100d00 0x7f1348101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.537+0000 7f134f549640 1 -- 172.21.15.170:0/355163602 >> 172.21.15.170:0/355163602 conn(0x7f13480fc290 msgr2=0x7f13480fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:59.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.537+0000 7f134f549640 1 -- 172.21.15.170:0/355163602 shutdown_connections 2024-01-25T14:59:59.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.537+0000 7f134f549640 1 -- 172.21.15.170:0/355163602 wait complete. 2024-01-25T14:59:59.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.537+0000 7f134f549640 1 Processor -- start 2024-01-25T14:59:59.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.537+0000 7f134f549640 1 -- start start 2024-01-25T14:59:59.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.537+0000 7f134f549640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1348100d00 0x7f1348196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:59.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.537+0000 7f134f549640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1348101ef0 0x7f1348197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:59.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.537+0000 7f134f549640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13481028b0 0x7f134819e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:59.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.537+0000 7f134f549640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134819e7d0 con 0x7f1348101ef0 2024-01-25T14:59:59.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.537+0000 7f134f549640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134819e940 con 0x7f13481028b0 2024-01-25T14:59:59.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.537+0000 7f134f549640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134819eb00 con 0x7f1348100d00 2024-01-25T14:59:59.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.537+0000 7f134cae4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1348101ef0 0x7f1348197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:59.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.537+0000 7f134cae4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1348101ef0 0x7f1348197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54192/0 (socket says 172.21.15.170:54192) 2024-01-25T14:59:59.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.537+0000 7f134cae4640 1 -- 172.21.15.170:0/211074801 learned_addr learned my addr 172.21.15.170:0/211074801 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:59.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.538+0000 7f134d2e5640 1 --2- 172.21.15.170:0/211074801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1348100d00 0x7f1348196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:59.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.538+0000 7f134dae6640 1 --2- 172.21.15.170:0/211074801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13481028b0 0x7f134819e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:59.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.538+0000 7f134cae4640 1 -- 172.21.15.170:0/211074801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1348100d00 msgr2=0x7f1348196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:59.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.538+0000 7f134cae4640 1 --2- 172.21.15.170:0/211074801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1348100d00 0x7f1348196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.538+0000 7f134cae4640 1 -- 172.21.15.170:0/211074801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13481028b0 msgr2=0x7f134819e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:59.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.538+0000 7f134cae4640 1 --2- 172.21.15.170:0/211074801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13481028b0 0x7f134819e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.538+0000 7f134cae4640 1 -- 172.21.15.170:0/211074801 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1340009900 con 0x7f1348101ef0 2024-01-25T14:59:59.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.538+0000 7f134cae4640 1 --2- 172.21.15.170:0/211074801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1348101ef0 0x7f1348197230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f134400b4a0 tx=0x7f134400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:59.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.538+0000 7f133e7fc640 1 -- 172.21.15.170:0/211074801 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344010610 con 0x7f1348101ef0 2024-01-25T14:59:59.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.538+0000 7f134f549640 1 -- 172.21.15.170:0/211074801 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134819ede0 con 0x7f1348101ef0 2024-01-25T14:59:59.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.538+0000 7f133e7fc640 1 -- 172.21.15.170:0/211074801 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1344010c30 con 0x7f1348101ef0 2024-01-25T14:59:59.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.538+0000 7f133e7fc640 1 -- 172.21.15.170:0/211074801 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344017dd0 con 0x7f1348101ef0 2024-01-25T14:59:59.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.538+0000 7f134f549640 1 -- 172.21.15.170:0/211074801 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134819f230 con 0x7f1348101ef0 2024-01-25T14:59:59.542 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.539+0000 7f134f549640 1 -- 172.21.15.170:0/211074801 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1348108070 con 0x7f1348101ef0 2024-01-25T14:59:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.540+0000 7f133e7fc640 1 -- 172.21.15.170:0/211074801 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f13440173f0 con 0x7f1348101ef0 2024-01-25T14:59:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.540+0000 7f133e7fc640 1 --2- 172.21.15.170:0/211074801 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f13340a12e0 0x7f13340a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.541+0000 7f134d2e5640 1 --2- 172.21.15.170:0/211074801 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f13340a12e0 0x7f13340a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.541+0000 7f133e7fc640 1 -- 172.21.15.170:0/211074801 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f13440cc430 con 0x7f1348101ef0 2024-01-25T14:59:59.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.541+0000 7f134d2e5640 1 --2- 172.21.15.170:0/211074801 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f13340a12e0 0x7f13340a37a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f13481981c0 tx=0x7f133800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:59.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.544+0000 7f133e7fc640 1 -- 172.21.15.170:0/211074801 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1344095a20 con 0x7f1348101ef0 2024-01-25T14:59:59.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:59 smithi186 ceph-mon[35697]: pgmap v286: 97 pgs: 1 creating+activating, 24 creating+peering, 72 active+clean; 579 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s rd, 4.7 KiB/s wr, 14 op/s 2024-01-25T14:59:59.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:59 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] up:active 2024-01-25T14:59:59.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:59 smithi186 ceph-mon[35697]: daemon mds.k assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-01-25T14:59:59.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:59 smithi186 ceph-mon[35697]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-01-25T14:59:59.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:59 smithi186 ceph-mon[35697]: Cluster is now healthy 2024-01-25T14:59:59.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:59 smithi186 ceph-mon[35697]: fsmap cephfs:4 {0=i=up:active,1=b=up:active,2=c=up:active,3=l=up:active} 3 up:standby-replay 5 up:standby 2024-01-25T14:59:59.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:59 smithi186 ceph-mon[35697]: fsmap cephfs:5 3 up:standby-replay 1 up:creating 4 up:standby 4 up:active 2024-01-25T14:59:59.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 14:59:59 smithi186 ceph-mon[35697]: daemon mds.k is now active in filesystem cephfs as rank 4 2024-01-25T14:59:59.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.744+0000 7f134f549640 1 -- 172.21.15.170:0/211074801 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f134802cd50 con 0x7f13340a12e0 2024-01-25T14:59:59.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.748+0000 7f133e7fc640 1 -- 172.21.15.170:0/211074801 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f134802cd50 con 0x7f13340a12e0 2024-01-25T14:59:59.749 INFO:teuthology.orchestra.run.smithi170.stdout:/volumes/qa/sv_0/e32e5d8f-0d36-44fe-ac38-02653875dbf0 2024-01-25T14:59:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.750+0000 7f134f549640 1 -- 172.21.15.170:0/211074801 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f13340a12e0 msgr2=0x7f13340a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.750+0000 7f134f549640 1 --2- 172.21.15.170:0/211074801 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f13340a12e0 0x7f13340a37a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f13481981c0 tx=0x7f133800b390 comp rx=0 tx=0).stop 2024-01-25T14:59:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.750+0000 7f134f549640 1 -- 172.21.15.170:0/211074801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1348101ef0 msgr2=0x7f1348197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.750+0000 7f134f549640 1 --2- 172.21.15.170:0/211074801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1348101ef0 0x7f1348197230 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f134400b4a0 tx=0x7f134400b960 comp rx=0 tx=0).stop 2024-01-25T14:59:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.750+0000 7f134f549640 1 -- 172.21.15.170:0/211074801 shutdown_connections 2024-01-25T14:59:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.750+0000 7f134f549640 1 --2- 172.21.15.170:0/211074801 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f13340a12e0 0x7f13340a37a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.750+0000 7f134f549640 1 --2- 172.21.15.170:0/211074801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f13481028b0 0x7f134819e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.750+0000 7f134f549640 1 --2- 172.21.15.170:0/211074801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1348101ef0 0x7f1348197230 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.750+0000 7f134f549640 1 --2- 172.21.15.170:0/211074801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1348100d00 0x7f1348196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.750+0000 7f134f549640 1 -- 172.21.15.170:0/211074801 >> 172.21.15.170:0/211074801 conn(0x7f13480fc290 msgr2=0x7f1348105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:59.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.750+0000 7f134f549640 1 -- 172.21.15.170:0/211074801 shutdown_connections 2024-01-25T14:59:59.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.750+0000 7f134f549640 1 -- 172.21.15.170:0/211074801 wait complete. 2024-01-25T14:59:59.762 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-01-25T14:59:59.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.867+0000 7fda9473e640 1 -- 172.21.15.170:0/1376187576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda8c101f10 msgr2=0x7fda8c102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:59.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.867+0000 7fda9473e640 1 --2- 172.21.15.170:0/1376187576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda8c101f10 0x7fda8c102390 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fda7c009900 tx=0x7fda7c02bc30 comp rx=0 tx=0).stop 2024-01-25T14:59:59.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.867+0000 7fda9473e640 1 -- 172.21.15.170:0/1376187576 shutdown_connections 2024-01-25T14:59:59.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.867+0000 7fda9473e640 1 --2- 172.21.15.170:0/1376187576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda8c1028d0 0x7fda8c109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.867+0000 7fda9473e640 1 --2- 172.21.15.170:0/1376187576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda8c101f10 0x7fda8c102390 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.867+0000 7fda9473e640 1 --2- 172.21.15.170:0/1376187576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda8c100d20 0x7fda8c101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.867+0000 7fda9473e640 1 -- 172.21.15.170:0/1376187576 >> 172.21.15.170:0/1376187576 conn(0x7fda8c0fc290 msgr2=0x7fda8c0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T14:59:59.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.868+0000 7fda9473e640 1 -- 172.21.15.170:0/1376187576 shutdown_connections 2024-01-25T14:59:59.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.868+0000 7fda9473e640 1 -- 172.21.15.170:0/1376187576 wait complete. 2024-01-25T14:59:59.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.868+0000 7fda9473e640 1 Processor -- start 2024-01-25T14:59:59.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.868+0000 7fda9473e640 1 -- start start 2024-01-25T14:59:59.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.868+0000 7fda9473e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda8c100d20 0x7fda8c196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:59.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.868+0000 7fda9473e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda8c101f10 0x7fda8c197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:59.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.868+0000 7fda9473e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda8c1028d0 0x7fda8c19e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:59.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.868+0000 7fda9473e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c19e810 con 0x7fda8c100d20 2024-01-25T14:59:59.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.868+0000 7fda9473e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c19e980 con 0x7fda8c1028d0 2024-01-25T14:59:59.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.868+0000 7fda9473e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c19eb40 con 0x7fda8c101f10 2024-01-25T14:59:59.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.868+0000 7fda924da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda8c100d20 0x7fda8c196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:59.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.868+0000 7fda924da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda8c100d20 0x7fda8c196d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54210/0 (socket says 172.21.15.170:54210) 2024-01-25T14:59:59.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.868+0000 7fda924da640 1 -- 172.21.15.170:0/2690949770 learned_addr learned my addr 172.21.15.170:0/2690949770 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T14:59:59.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.869+0000 7fda91cd9640 1 --2- 172.21.15.170:0/2690949770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda8c101f10 0x7fda8c197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:59.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.869+0000 7fda924da640 1 -- 172.21.15.170:0/2690949770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda8c101f10 msgr2=0x7fda8c197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:59.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.869+0000 7fda924da640 1 --2- 172.21.15.170:0/2690949770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda8c101f10 0x7fda8c197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.869+0000 7fda924da640 1 -- 172.21.15.170:0/2690949770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda8c1028d0 msgr2=0x7fda8c19e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T14:59:59.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.869+0000 7fda924da640 1 --2- 172.21.15.170:0/2690949770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda8c1028d0 0x7fda8c19e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T14:59:59.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.869+0000 7fda924da640 1 -- 172.21.15.170:0/2690949770 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c009560 con 0x7fda8c100d20 2024-01-25T14:59:59.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.869+0000 7fda91cd9640 1 --2- 172.21.15.170:0/2690949770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda8c101f10 0x7fda8c197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T14:59:59.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.869+0000 7fda924da640 1 --2- 172.21.15.170:0/2690949770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda8c100d20 0x7fda8c196d30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fda8800ea80 tx=0x7fda8800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:59.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.869+0000 7fda837fe640 1 -- 172.21.15.170:0/2690949770 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8800ce40 con 0x7fda8c100d20 2024-01-25T14:59:59.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.869+0000 7fda837fe640 1 -- 172.21.15.170:0/2690949770 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda88011930 con 0x7fda8c100d20 2024-01-25T14:59:59.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.869+0000 7fda9473e640 1 -- 172.21.15.170:0/2690949770 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8c19ee20 con 0x7fda8c100d20 2024-01-25T14:59:59.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.869+0000 7fda837fe640 1 -- 172.21.15.170:0/2690949770 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8801aaa0 con 0x7fda8c100d20 2024-01-25T14:59:59.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.869+0000 7fda9473e640 1 -- 172.21.15.170:0/2690949770 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8c19f2a0 con 0x7fda8c100d20 2024-01-25T14:59:59.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.870+0000 7fda9473e640 1 -- 172.21.15.170:0/2690949770 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8c1080b0 con 0x7fda8c100d20 2024-01-25T14:59:59.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.871+0000 7fda837fe640 1 -- 172.21.15.170:0/2690949770 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fda8801ac00 con 0x7fda8c100d20 2024-01-25T14:59:59.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.871+0000 7fda837fe640 1 --2- 172.21.15.170:0/2690949770 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fda780a1360 0x7fda780a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T14:59:59.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.872+0000 7fda91cd9640 1 --2- 172.21.15.170:0/2690949770 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fda780a1360 0x7fda780a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T14:59:59.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.872+0000 7fda837fe640 1 -- 172.21.15.170:0/2690949770 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fda880cd270 con 0x7fda8c100d20 2024-01-25T14:59:59.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.872+0000 7fda91cd9640 1 --2- 172.21.15.170:0/2690949770 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fda780a1360 0x7fda780a3820 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda7c036040 tx=0x7fda7c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T14:59:59.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T14:59:59.875+0000 7fda837fe640 1 -- 172.21.15.170:0/2690949770 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fda88096830 con 0x7fda8c100d20 2024-01-25T15:00:00.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.079+0000 7fda9473e640 1 -- 172.21.15.170:0/2690949770 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fda8c02cc70 con 0x7fda780a1360 2024-01-25T15:00:00.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.102+0000 7fda837fe640 1 -- 172.21.15.170:0/2690949770 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fda8c02cc70 con 0x7fda780a1360 2024-01-25T15:00:00.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.104+0000 7fda9473e640 1 -- 172.21.15.170:0/2690949770 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fda780a1360 msgr2=0x7fda780a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:00.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.104+0000 7fda9473e640 1 --2- 172.21.15.170:0/2690949770 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fda780a1360 0x7fda780a3820 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fda7c036040 tx=0x7fda7c000bc0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.104+0000 7fda9473e640 1 -- 172.21.15.170:0/2690949770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda8c100d20 msgr2=0x7fda8c196d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:00.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.104+0000 7fda9473e640 1 --2- 172.21.15.170:0/2690949770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda8c100d20 0x7fda8c196d30 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fda8800ea80 tx=0x7fda8800ef40 comp rx=0 tx=0).stop 2024-01-25T15:00:00.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.104+0000 7fda9473e640 1 -- 172.21.15.170:0/2690949770 shutdown_connections 2024-01-25T15:00:00.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.104+0000 7fda9473e640 1 --2- 172.21.15.170:0/2690949770 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fda780a1360 0x7fda780a3820 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.104+0000 7fda9473e640 1 --2- 172.21.15.170:0/2690949770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda8c1028d0 0x7fda8c19e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.104+0000 7fda9473e640 1 --2- 172.21.15.170:0/2690949770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda8c101f10 0x7fda8c197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.104+0000 7fda9473e640 1 --2- 172.21.15.170:0/2690949770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda8c100d20 0x7fda8c196d30 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.104+0000 7fda9473e640 1 -- 172.21.15.170:0/2690949770 >> 172.21.15.170:0/2690949770 conn(0x7fda8c0fc290 msgr2=0x7fda8c105280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:00.107 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.104+0000 7fda9473e640 1 -- 172.21.15.170:0/2690949770 shutdown_connections 2024-01-25T15:00:00.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.104+0000 7fda9473e640 1 -- 172.21.15.170:0/2690949770 wait complete. 2024-01-25T15:00:00.117 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-01-25T15:00:00.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.225+0000 7f96483ea640 1 -- 172.21.15.170:0/1224748675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96401017a0 msgr2=0x7f9640108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:00.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.225+0000 7f96483ea640 1 --2- 172.21.15.170:0/1224748675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96401017a0 0x7f9640108030 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9630009ca0 tx=0x7f963002c0f0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.225+0000 7f96483ea640 1 -- 172.21.15.170:0/1224748675 shutdown_connections 2024-01-25T15:00:00.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.225+0000 7f96483ea640 1 --2- 172.21.15.170:0/1224748675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9640100de0 0x7f9640101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.233 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.225+0000 7f96483ea640 1 --2- 172.21.15.170:0/1224748675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96401017a0 0x7f9640108030 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.225+0000 7f96483ea640 1 --2- 172.21.15.170:0/1224748675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f96400ffbf0 0x7f9640100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.225+0000 7f96483ea640 1 -- 172.21.15.170:0/1224748675 >> 172.21.15.170:0/1224748675 conn(0x7f96400fb180 msgr2=0x7f96400fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.225+0000 7f96483ea640 1 -- 172.21.15.170:0/1224748675 shutdown_connections 2024-01-25T15:00:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.225+0000 7f96483ea640 1 -- 172.21.15.170:0/1224748675 wait complete. 2024-01-25T15:00:00.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.226+0000 7f96483ea640 1 Processor -- start 2024-01-25T15:00:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.226+0000 7f96483ea640 1 -- start start 2024-01-25T15:00:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.226+0000 7f96483ea640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96400ffbf0 0x7f9640195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.226+0000 7f96483ea640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9640100de0 0x7f9640196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.226+0000 7f96483ea640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96401017a0 0x7f964019d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.226+0000 7f96483ea640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964019d710 con 0x7f96400ffbf0 2024-01-25T15:00:00.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.226+0000 7f96483ea640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964019d880 con 0x7f96401017a0 2024-01-25T15:00:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.226+0000 7f96483ea640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964019da40 con 0x7f9640100de0 2024-01-25T15:00:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.226+0000 7f9646186640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96400ffbf0 0x7f9640195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.226+0000 7f9646186640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96400ffbf0 0x7f9640195c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54218/0 (socket says 172.21.15.170:54218) 2024-01-25T15:00:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.226+0000 7f9646186640 1 -- 172.21.15.170:0/3583948692 learned_addr learned my addr 172.21.15.170:0/3583948692 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.226+0000 7f9646987640 1 --2- 172.21.15.170:0/3583948692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96401017a0 0x7f964019d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.226+0000 7f9645985640 1 --2- 172.21.15.170:0/3583948692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9640100de0 0x7f9640196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.227+0000 7f9646186640 1 -- 172.21.15.170:0/3583948692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9640100de0 msgr2=0x7f9640196170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.227+0000 7f9646186640 1 --2- 172.21.15.170:0/3583948692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9640100de0 0x7f9640196170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.227+0000 7f9646186640 1 -- 172.21.15.170:0/3583948692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96401017a0 msgr2=0x7f964019d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.227+0000 7f9646186640 1 --2- 172.21.15.170:0/3583948692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96401017a0 0x7f964019d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.227+0000 7f9646186640 1 -- 172.21.15.170:0/3583948692 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9630009900 con 0x7f96400ffbf0 2024-01-25T15:00:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.227+0000 7f9645985640 1 --2- 172.21.15.170:0/3583948692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9640100de0 0x7f9640196170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:00:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.227+0000 7f9646186640 1 --2- 172.21.15.170:0/3583948692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96400ffbf0 0x7f9640195c30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f963800c970 tx=0x7f963800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.227+0000 7f963f7fe640 1 -- 172.21.15.170:0/3583948692 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9638004220 con 0x7f96400ffbf0 2024-01-25T15:00:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.227+0000 7f963f7fe640 1 -- 172.21.15.170:0/3583948692 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9638007e70 con 0x7f96400ffbf0 2024-01-25T15:00:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.227+0000 7f96483ea640 1 -- 172.21.15.170:0/3583948692 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964019dd20 con 0x7f96400ffbf0 2024-01-25T15:00:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.227+0000 7f963f7fe640 1 -- 172.21.15.170:0/3583948692 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9638004a00 con 0x7f96400ffbf0 2024-01-25T15:00:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.227+0000 7f96483ea640 1 -- 172.21.15.170:0/3583948692 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964019e180 con 0x7f96400ffbf0 2024-01-25T15:00:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.228+0000 7f96483ea640 1 -- 172.21.15.170:0/3583948692 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9640107030 con 0x7f96400ffbf0 2024-01-25T15:00:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.230+0000 7f963f7fe640 1 -- 172.21.15.170:0/3583948692 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f96380079b0 con 0x7f96400ffbf0 2024-01-25T15:00:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.230+0000 7f963f7fe640 1 --2- 172.21.15.170:0/3583948692 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f96280a12e0 0x7f96280a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.230+0000 7f9645985640 1 --2- 172.21.15.170:0/3583948692 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f96280a12e0 0x7f96280a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.230+0000 7f963f7fe640 1 -- 172.21.15.170:0/3583948692 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f96380ccb90 con 0x7f96400ffbf0 2024-01-25T15:00:00.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.231+0000 7f9645985640 1 --2- 172.21.15.170:0/3583948692 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f96280a12e0 0x7f96280a37a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9634006fd0 tx=0x7f9634008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:00.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.234+0000 7f963f7fe640 1 -- 172.21.15.170:0/3583948692 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f96380960d0 con 0x7f96400ffbf0 2024-01-25T15:00:00.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:00 smithi170 ceph-mon[31899]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:00:00.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:00 smithi170 ceph-mon[31899]: overall HEALTH_OK 2024-01-25T15:00:00.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:00 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] up:active 2024-01-25T15:00:00.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:00 smithi170 ceph-mon[31899]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2024-01-25T15:00:00.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:00 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:00:00.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.434+0000 7f96483ea640 1 -- 172.21.15.170:0/3583948692 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f964002cd50 con 0x7f96280a12e0 2024-01-25T15:00:00.438 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.438+0000 7f963f7fe640 1 -- 172.21.15.170:0/3583948692 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f964002cd50 con 0x7f96280a12e0 2024-01-25T15:00:00.439 INFO:teuthology.orchestra.run.smithi170.stdout:/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6 2024-01-25T15:00:00.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.440+0000 7f96483ea640 1 -- 172.21.15.170:0/3583948692 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f96280a12e0 msgr2=0x7f96280a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:00.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.440+0000 7f96483ea640 1 --2- 172.21.15.170:0/3583948692 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f96280a12e0 0x7f96280a37a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9634006fd0 tx=0x7f9634008040 comp rx=0 tx=0).stop 2024-01-25T15:00:00.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.440+0000 7f96483ea640 1 -- 172.21.15.170:0/3583948692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96400ffbf0 msgr2=0x7f9640195c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:00.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.440+0000 7f96483ea640 1 --2- 172.21.15.170:0/3583948692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96400ffbf0 0x7f9640195c30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f963800c970 tx=0x7f963800ce30 comp rx=0 tx=0).stop 2024-01-25T15:00:00.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.440+0000 7f96483ea640 1 -- 172.21.15.170:0/3583948692 shutdown_connections 2024-01-25T15:00:00.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.440+0000 7f96483ea640 1 --2- 172.21.15.170:0/3583948692 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f96280a12e0 0x7f96280a37a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.440+0000 7f96483ea640 1 --2- 172.21.15.170:0/3583948692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f96401017a0 0x7f964019d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.440+0000 7f96483ea640 1 --2- 172.21.15.170:0/3583948692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9640100de0 0x7f9640196170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.440+0000 7f96483ea640 1 --2- 172.21.15.170:0/3583948692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f96400ffbf0 0x7f9640195c30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.440+0000 7f96483ea640 1 -- 172.21.15.170:0/3583948692 >> 172.21.15.170:0/3583948692 conn(0x7f96400fb180 msgr2=0x7f9640104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:00.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.440+0000 7f96483ea640 1 -- 172.21.15.170:0/3583948692 shutdown_connections 2024-01-25T15:00:00.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.440+0000 7f96483ea640 1 -- 172.21.15.170:0/3583948692 wait complete. 2024-01-25T15:00:00.452 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:00:00.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:00 smithi191 ceph-mon[36347]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:00:00.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:00 smithi191 ceph-mon[36347]: overall HEALTH_OK 2024-01-25T15:00:00.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:00 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] up:active 2024-01-25T15:00:00.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:00 smithi191 ceph-mon[36347]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2024-01-25T15:00:00.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:00 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:00:00.484 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:00:00 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i[67820]: 2024-01-25T15:00:00.108+0000 7f6b58326700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-25T15:00:00.484 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:00:00 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i[67820]: 2024-01-25T15:00:00.108+0000 7f6b58326700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-01-25T15:00:00.484 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:00:00 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i[67820]: 2024-01-25T15:00:00.108+0000 7f6b58326700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-01-25T15:00:00.484 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:00:00 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i[67820]: 2024-01-25T15:00:00.108+0000 7f6b58326700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-01-25T15:00:00.484 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:00:00 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i[67820]: 2024-01-25T15:00:00.108+0000 7f6b58326700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-01-25T15:00:00.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.554+0000 7fd36c6e5640 1 -- 172.21.15.170:0/284049729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3641005b0 msgr2=0x7fd364100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:00.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.554+0000 7fd36c6e5640 1 --2- 172.21.15.170:0/284049729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3641005b0 0x7fd364100a30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd354009900 tx=0x7fd35402bc30 comp rx=0 tx=0).stop 2024-01-25T15:00:00.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.554+0000 7fd36c6e5640 1 -- 172.21.15.170:0/284049729 shutdown_connections 2024-01-25T15:00:00.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.554+0000 7fd36c6e5640 1 --2- 172.21.15.170:0/284049729 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd364100f70 0x7fd364107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.554+0000 7fd36c6e5640 1 --2- 172.21.15.170:0/284049729 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3641005b0 0x7fd364100a30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.554+0000 7fd36c6e5640 1 --2- 172.21.15.170:0/284049729 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd3640ff3c0 0x7fd3640ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.554+0000 7fd36c6e5640 1 -- 172.21.15.170:0/284049729 >> 172.21.15.170:0/284049729 conn(0x7fd3640fa930 msgr2=0x7fd3640fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:00.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.554+0000 7fd36c6e5640 1 -- 172.21.15.170:0/284049729 shutdown_connections 2024-01-25T15:00:00.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.554+0000 7fd36c6e5640 1 -- 172.21.15.170:0/284049729 wait complete. 2024-01-25T15:00:00.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd36c6e5640 1 Processor -- start 2024-01-25T15:00:00.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd36c6e5640 1 -- start start 2024-01-25T15:00:00.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd36c6e5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3640ff3c0 0x7fd364103300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:00.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd36c6e5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3641005b0 0x7fd364101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:00.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd36c6e5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd364100f70 0x7fd364101ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:00.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd36c6e5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd364102660 con 0x7fd3641005b0 2024-01-25T15:00:00.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd36c6e5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3641027d0 con 0x7fd364100f70 2024-01-25T15:00:00.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd36c6e5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3641a0da0 con 0x7fd3640ff3c0 2024-01-25T15:00:00.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd369c80640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3641005b0 0x7fd364101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:00.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd369c80640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3641005b0 0x7fd364101990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54226/0 (socket says 172.21.15.170:54226) 2024-01-25T15:00:00.558 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd369c80640 1 -- 172.21.15.170:0/3198131929 learned_addr learned my addr 172.21.15.170:0/3198131929 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:00.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd369c80640 1 -- 172.21.15.170:0/3198131929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3640ff3c0 msgr2=0x7fd364103300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:00.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd369c80640 1 --2- 172.21.15.170:0/3198131929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3640ff3c0 0x7fd364103300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd369c80640 1 -- 172.21.15.170:0/3198131929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd364100f70 msgr2=0x7fd364101ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:00.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd369c80640 1 --2- 172.21.15.170:0/3198131929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd364100f70 0x7fd364101ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd369c80640 1 -- 172.21.15.170:0/3198131929 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd354009560 con 0x7fd3641005b0 2024-01-25T15:00:00.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd369c80640 1 --2- 172.21.15.170:0/3198131929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3641005b0 0x7fd364101990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd354009430 tx=0x7fd3540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:00.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd35b7fe640 1 -- 172.21.15.170:0/3198131929 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3540044e0 con 0x7fd3641005b0 2024-01-25T15:00:00.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd35b7fe640 1 -- 172.21.15.170:0/3198131929 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3540035f0 con 0x7fd3641005b0 2024-01-25T15:00:00.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.555+0000 7fd36c6e5640 1 -- 172.21.15.170:0/3198131929 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3641a0fa0 con 0x7fd3641005b0 2024-01-25T15:00:00.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.556+0000 7fd35b7fe640 1 -- 172.21.15.170:0/3198131929 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35403e6b0 con 0x7fd3641005b0 2024-01-25T15:00:00.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.556+0000 7fd36c6e5640 1 -- 172.21.15.170:0/3198131929 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3641a1470 con 0x7fd3641005b0 2024-01-25T15:00:00.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.557+0000 7fd36c6e5640 1 -- 172.21.15.170:0/3198131929 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd36410acb0 con 0x7fd3641005b0 2024-01-25T15:00:00.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.558+0000 7fd35b7fe640 1 -- 172.21.15.170:0/3198131929 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fd3540039d0 con 0x7fd3641005b0 2024-01-25T15:00:00.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.558+0000 7fd35b7fe640 1 --2- 172.21.15.170:0/3198131929 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd3500a1360 0x7fd3500a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:00.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.558+0000 7fd36a481640 1 --2- 172.21.15.170:0/3198131929 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd3500a1360 0x7fd3500a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:00.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.559+0000 7fd35b7fe640 1 -- 172.21.15.170:0/3198131929 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd3540ef5f0 con 0x7fd3641005b0 2024-01-25T15:00:00.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.559+0000 7fd36a481640 1 --2- 172.21.15.170:0/3198131929 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd3500a1360 0x7fd3500a3820 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd364100410 tx=0x7fd360005c10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:00.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.562+0000 7fd35b7fe640 1 -- 172.21.15.170:0/3198131929 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fd3540b8bc0 con 0x7fd3641005b0 2024-01-25T15:00:00.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:00 smithi186 ceph-mon[35697]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:00:00.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:00 smithi186 ceph-mon[35697]: overall HEALTH_OK 2024-01-25T15:00:00.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:00 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] up:active 2024-01-25T15:00:00.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:00 smithi186 ceph-mon[35697]: fsmap cephfs:5 3 up:standby-replay 4 up:standby 5 up:active 2024-01-25T15:00:00.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:00 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:00:00.771 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.770+0000 7fd36c6e5640 1 -- 172.21.15.170:0/3198131929 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3641a1660 con 0x7fd3641005b0 2024-01-25T15:00:00.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.771+0000 7fd35b7fe640 1 -- 172.21.15.170:0/3198131929 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+11411 (secure 0 0 0) 0x7fd3540bc1e0 con 0x7fd3641005b0 2024-01-25T15:00:00.772 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:00:00.772 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-25T14:59:53.534085+0000","modified":"2024-01-25T15:00:00.045800+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24484,"mds_1":24479,"mds_2":24466,"mds_3":24418,"mds_4":24398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":4,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24479":{"gid":24479,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/2132502182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":2132502182},{"type":"v1","addr":"172.21.15.186:6839","nonce":2132502182}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:00:00.772 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-01-25T15:00:00.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.773+0000 7fd36c6e5640 1 -- 172.21.15.170:0/3198131929 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd3500a1360 msgr2=0x7fd3500a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:00.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.773+0000 7fd36c6e5640 1 --2- 172.21.15.170:0/3198131929 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd3500a1360 0x7fd3500a3820 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd364100410 tx=0x7fd360005c10 comp rx=0 tx=0).stop 2024-01-25T15:00:00.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.773+0000 7fd36c6e5640 1 -- 172.21.15.170:0/3198131929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3641005b0 msgr2=0x7fd364101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:00.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.773+0000 7fd36c6e5640 1 --2- 172.21.15.170:0/3198131929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3641005b0 0x7fd364101990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd354009430 tx=0x7fd3540042f0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.773+0000 7fd36c6e5640 1 -- 172.21.15.170:0/3198131929 shutdown_connections 2024-01-25T15:00:00.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.773+0000 7fd36c6e5640 1 --2- 172.21.15.170:0/3198131929 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd3500a1360 0x7fd3500a3820 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.773+0000 7fd36c6e5640 1 --2- 172.21.15.170:0/3198131929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd364100f70 0x7fd364101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.773+0000 7fd36c6e5640 1 --2- 172.21.15.170:0/3198131929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd3641005b0 0x7fd364101990 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.773+0000 7fd36c6e5640 1 --2- 172.21.15.170:0/3198131929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd3640ff3c0 0x7fd364103300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.773+0000 7fd36c6e5640 1 -- 172.21.15.170:0/3198131929 >> 172.21.15.170:0/3198131929 conn(0x7fd3640fa930 msgr2=0x7fd3640fc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:00.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.773+0000 7fd36c6e5640 1 -- 172.21.15.170:0/3198131929 shutdown_connections 2024-01-25T15:00:00.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.773+0000 7fd36c6e5640 1 -- 172.21.15.170:0/3198131929 wait complete. 2024-01-25T15:00:00.785 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:00:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.885+0000 7fb35ed61640 1 -- 172.21.15.170:0/2101675335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3581040c0 msgr2=0x7fb3581064b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.885+0000 7fb35ed61640 1 --2- 172.21.15.170:0/2101675335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3581040c0 0x7fb3581064b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb34c009900 tx=0x7fb34c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:00:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.885+0000 7fb35ed61640 1 -- 172.21.15.170:0/2101675335 shutdown_connections 2024-01-25T15:00:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.885+0000 7fb35ed61640 1 --2- 172.21.15.170:0/2101675335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3581069f0 0x7fb358108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.885+0000 7fb35ed61640 1 --2- 172.21.15.170:0/2101675335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3581040c0 0x7fb3581064b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.885+0000 7fb35ed61640 1 --2- 172.21.15.170:0/2101675335 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb358101790 0x7fb358103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.885+0000 7fb35ed61640 1 -- 172.21.15.170:0/2101675335 >> 172.21.15.170:0/2101675335 conn(0x7fb3580fb180 msgr2=0x7fb3580fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.885+0000 7fb35ed61640 1 -- 172.21.15.170:0/2101675335 shutdown_connections 2024-01-25T15:00:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.885+0000 7fb35ed61640 1 -- 172.21.15.170:0/2101675335 wait complete. 2024-01-25T15:00:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb35ed61640 1 Processor -- start 2024-01-25T15:00:00.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb35ed61640 1 -- start start 2024-01-25T15:00:00.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb35ed61640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb358101790 0x7fb358101100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:00.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb35ed61640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3581040c0 0x7fb3580ff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:00.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb35ed61640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3581069f0 0x7fb3580ffc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:00.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb35ed61640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3581003e0 con 0x7fb3581069f0 2024-01-25T15:00:00.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb35ed61640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb358100550 con 0x7fb358101790 2024-01-25T15:00:00.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb35ed61640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3581a0d30 con 0x7fb3581040c0 2024-01-25T15:00:00.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb35d2fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3581069f0 0x7fb3580ffc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:00.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb35d2fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3581069f0 0x7fb3580ffc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54246/0 (socket says 172.21.15.170:54246) 2024-01-25T15:00:00.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb35d2fe640 1 -- 172.21.15.170:0/157957916 learned_addr learned my addr 172.21.15.170:0/157957916 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:00.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb35cafd640 1 --2- 172.21.15.170:0/157957916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb358101790 0x7fb358101100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:00.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb357fff640 1 --2- 172.21.15.170:0/157957916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3581040c0 0x7fb3580ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:00.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb35d2fe640 1 -- 172.21.15.170:0/157957916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3581040c0 msgr2=0x7fb3580ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:00.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb35d2fe640 1 --2- 172.21.15.170:0/157957916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3581040c0 0x7fb3580ff740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.886+0000 7fb35d2fe640 1 -- 172.21.15.170:0/157957916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb358101790 msgr2=0x7fb358101100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:00.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.887+0000 7fb35d2fe640 1 --2- 172.21.15.170:0/157957916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb358101790 0x7fb358101100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:00.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.887+0000 7fb35d2fe640 1 -- 172.21.15.170:0/157957916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c009560 con 0x7fb3581069f0 2024-01-25T15:00:00.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.887+0000 7fb357fff640 1 --2- 172.21.15.170:0/157957916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3581040c0 0x7fb3580ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:00:00.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.887+0000 7fb35d2fe640 1 --2- 172.21.15.170:0/157957916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3581069f0 0x7fb3580ffc80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb35000ead0 tx=0x7fb35000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:00.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.887+0000 7fb355ffb640 1 -- 172.21.15.170:0/157957916 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35000cde0 con 0x7fb3581069f0 2024-01-25T15:00:00.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.887+0000 7fb355ffb640 1 -- 172.21.15.170:0/157957916 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb350005020 con 0x7fb3581069f0 2024-01-25T15:00:00.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.887+0000 7fb35ed61640 1 -- 172.21.15.170:0/157957916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3581a0fe0 con 0x7fb3581069f0 2024-01-25T15:00:00.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.887+0000 7fb355ffb640 1 -- 172.21.15.170:0/157957916 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3500116d0 con 0x7fb3581069f0 2024-01-25T15:00:00.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.887+0000 7fb35ed61640 1 -- 172.21.15.170:0/157957916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3581a1410 con 0x7fb3581069f0 2024-01-25T15:00:00.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.888+0000 7fb35ed61640 1 -- 172.21.15.170:0/157957916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3580fcc70 con 0x7fb3581069f0 2024-01-25T15:00:00.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.889+0000 7fb355ffb640 1 -- 172.21.15.170:0/157957916 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fb350005190 con 0x7fb3581069f0 2024-01-25T15:00:00.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.890+0000 7fb355ffb640 1 --2- 172.21.15.170:0/157957916 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb3400a12e0 0x7fb3400a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:00.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.890+0000 7fb35cafd640 1 --2- 172.21.15.170:0/157957916 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb3400a12e0 0x7fb3400a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:00.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.890+0000 7fb355ffb640 1 -- 172.21.15.170:0/157957916 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb3500ccbf0 con 0x7fb3581069f0 2024-01-25T15:00:00.892 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.890+0000 7fb35cafd640 1 --2- 172.21.15.170:0/157957916 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb3400a12e0 0x7fb3400a37a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb34800bbe0 tx=0x7fb34800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:00.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:00.894+0000 7fb355ffb640 1 -- 172.21.15.170:0/157957916 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb3500961c0 con 0x7fb3581069f0 2024-01-25T15:00:01.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.068+0000 7fb35ed61640 1 -- 172.21.15.170:0/157957916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb35810c810 con 0x7fb3581069f0 2024-01-25T15:00:01.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.070+0000 7fb355ffb640 1 -- 172.21.15.170:0/157957916 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22163 (secure 0 0 0) 0x7fb35001f020 con 0x7fb3581069f0 2024-01-25T15:00:01.071 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:00:01.071 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":85,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T14:59:55.196363+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:00:01.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.072+0000 7fb35ed61640 1 -- 172.21.15.170:0/157957916 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb3400a12e0 msgr2=0x7fb3400a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:01.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.072+0000 7fb35ed61640 1 --2- 172.21.15.170:0/157957916 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb3400a12e0 0x7fb3400a37a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb34800bbe0 tx=0x7fb34800b390 comp rx=0 tx=0).stop 2024-01-25T15:00:01.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.072+0000 7fb35ed61640 1 -- 172.21.15.170:0/157957916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3581069f0 msgr2=0x7fb3580ffc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:01.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.072+0000 7fb35ed61640 1 --2- 172.21.15.170:0/157957916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3581069f0 0x7fb3580ffc80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb35000ead0 tx=0x7fb35000ef90 comp rx=0 tx=0).stop 2024-01-25T15:00:01.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.072+0000 7fb35ed61640 1 -- 172.21.15.170:0/157957916 shutdown_connections 2024-01-25T15:00:01.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.072+0000 7fb35ed61640 1 --2- 172.21.15.170:0/157957916 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb3400a12e0 0x7fb3400a37a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.072+0000 7fb35ed61640 1 --2- 172.21.15.170:0/157957916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb3581069f0 0x7fb3580ffc80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.072+0000 7fb35ed61640 1 --2- 172.21.15.170:0/157957916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb3581040c0 0x7fb3580ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.072+0000 7fb35ed61640 1 --2- 172.21.15.170:0/157957916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb358101790 0x7fb358101100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.072+0000 7fb35ed61640 1 -- 172.21.15.170:0/157957916 >> 172.21.15.170:0/157957916 conn(0x7fb3580fb180 msgr2=0x7fb358102210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.072+0000 7fb35ed61640 1 -- 172.21.15.170:0/157957916 shutdown_connections 2024-01-25T15:00:01.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.072+0000 7fb35ed61640 1 -- 172.21.15.170:0/157957916 wait complete. 2024-01-25T15:00:01.084 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-25T15:00:01.085 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:00:01.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.185+0000 7f090ad5a640 1 -- 172.21.15.170:0/2022957091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0904100e80 msgr2=0x7f0904101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:01.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.185+0000 7f090ad5a640 1 --2- 172.21.15.170:0/2022957091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0904100e80 0x7f0904101300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009900 tx=0x7f08f802bc30 comp rx=0 tx=0).stop 2024-01-25T15:00:01.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.185+0000 7f090ad5a640 1 -- 172.21.15.170:0/2022957091 shutdown_connections 2024-01-25T15:00:01.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.185+0000 7f090ad5a640 1 --2- 172.21.15.170:0/2022957091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0904101840 0x7f09041080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.185+0000 7f090ad5a640 1 --2- 172.21.15.170:0/2022957091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0904100e80 0x7f0904101300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.185+0000 7f090ad5a640 1 --2- 172.21.15.170:0/2022957091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09040ffc90 0x7f09041000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.185+0000 7f090ad5a640 1 -- 172.21.15.170:0/2022957091 >> 172.21.15.170:0/2022957091 conn(0x7f09040fb220 msgr2=0x7f09040fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:01.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.185+0000 7f090ad5a640 1 -- 172.21.15.170:0/2022957091 shutdown_connections 2024-01-25T15:00:01.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.185+0000 7f090ad5a640 1 -- 172.21.15.170:0/2022957091 wait complete. 2024-01-25T15:00:01.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f090ad5a640 1 Processor -- start 2024-01-25T15:00:01.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f090ad5a640 1 -- start start 2024-01-25T15:00:01.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f090ad5a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09040ffc90 0x7f0904196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:01.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f090ad5a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0904100e80 0x7f09041971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:01.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f090ad5a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0904101840 0x7f090419e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:01.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f090ad5a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090419e7c0 con 0x7f0904101840 2024-01-25T15:00:01.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f090ad5a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090419e930 con 0x7f09040ffc90 2024-01-25T15:00:01.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f090ad5a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090419eaf0 con 0x7f0904100e80 2024-01-25T15:00:01.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f09092f7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0904101840 0x7f090419e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:01.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f09092f7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0904101840 0x7f090419e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54266/0 (socket says 172.21.15.170:54266) 2024-01-25T15:00:01.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f09092f7640 1 -- 172.21.15.170:0/44176985 learned_addr learned my addr 172.21.15.170:0/44176985 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:01.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f0908af6640 1 --2- 172.21.15.170:0/44176985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09040ffc90 0x7f0904196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:01.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f09092f7640 1 -- 172.21.15.170:0/44176985 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0904100e80 msgr2=0x7f09041971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:01.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f09092f7640 1 --2- 172.21.15.170:0/44176985 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0904100e80 0x7f09041971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f09092f7640 1 -- 172.21.15.170:0/44176985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09040ffc90 msgr2=0x7f0904196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:01.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f09092f7640 1 --2- 172.21.15.170:0/44176985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09040ffc90 0x7f0904196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.186+0000 7f09092f7640 1 -- 172.21.15.170:0/44176985 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f8009560 con 0x7f0904101840 2024-01-25T15:00:01.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.187+0000 7f09092f7640 1 --2- 172.21.15.170:0/44176985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0904101840 0x7f090419e250 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00cad0 tx=0x7f08fc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:01.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.187+0000 7f0901ffb640 1 -- 172.21.15.170:0/44176985 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00ae20 con 0x7f0904101840 2024-01-25T15:00:01.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.187+0000 7f090ad5a640 1 -- 172.21.15.170:0/44176985 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090419edd0 con 0x7f0904101840 2024-01-25T15:00:01.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.187+0000 7f0901ffb640 1 -- 172.21.15.170:0/44176985 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08fc005020 con 0x7f0904101840 2024-01-25T15:00:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.187+0000 7f0901ffb640 1 -- 172.21.15.170:0/44176985 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00f6b0 con 0x7f0904101840 2024-01-25T15:00:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.187+0000 7f090ad5a640 1 -- 172.21.15.170:0/44176985 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090419f300 con 0x7f0904101840 2024-01-25T15:00:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.188+0000 7f090ad5a640 1 -- 172.21.15.170:0/44176985 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0904107120 con 0x7f0904101840 2024-01-25T15:00:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.189+0000 7f0901ffb640 1 -- 172.21.15.170:0/44176985 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 16) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f08fc005190 con 0x7f0904101840 2024-01-25T15:00:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.189+0000 7f0901ffb640 1 --2- 172.21.15.170:0/44176985 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f08ec0a12e0 0x7f08ec0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.189+0000 7f0908af6640 1 --2- 172.21.15.170:0/44176985 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f08ec0a12e0 0x7f08ec0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.189+0000 7f0901ffb640 1 -- 172.21.15.170:0/44176985 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f08fc0ccd60 con 0x7f0904101840 2024-01-25T15:00:01.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.190+0000 7f0908af6640 1 --2- 172.21.15.170:0/44176985 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f08ec0a12e0 0x7f08ec0a37a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0904197b80 tx=0x7f08f400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:01.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.194+0000 7f0901ffb640 1 -- 172.21.15.170:0/44176985 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f08fc096330 con 0x7f0904101840 2024-01-25T15:00:01.231 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.230+0000 7f0901ffb640 1 -- 172.21.15.170:0/44176985 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f08fc0d2020 con 0x7f0904101840 2024-01-25T15:00:01.373 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.372+0000 7f090ad5a640 1 -- 172.21.15.170:0/44176985 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f090402cb80 con 0x7f08ec0a12e0 2024-01-25T15:00:01.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:01 smithi170 ceph-mon[31899]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:00:01.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:01 smithi170 ceph-mon[31899]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:00:01.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:01 smithi170 ceph-mon[31899]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:00:01.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:01 smithi170 ceph-mon[31899]: pgmap v287: 97 pgs: 97 active+clean; 582 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 6.3 KiB/s wr, 19 op/s 2024-01-25T15:00:01.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:01 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3198131929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:00:01.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:01 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/157957916' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:00:01.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.383+0000 7f0901ffb640 1 -- 172.21.15.170:0/44176985 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336803 (secure 0 0 0) 0x7f090402cb80 con 0x7f08ec0a12e0 2024-01-25T15:00:01.388 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:00:01.390 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2024-01-25T15:00:01.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.387+0000 7f090ad5a640 1 -- 172.21.15.170:0/44176985 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f08ec0a12e0 msgr2=0x7f08ec0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:01.392 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.387+0000 7f090ad5a640 1 --2- 172.21.15.170:0/44176985 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f08ec0a12e0 0x7f08ec0a37a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0904197b80 tx=0x7f08f400b410 comp rx=0 tx=0).stop 2024-01-25T15:00:01.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.387+0000 7f090ad5a640 1 -- 172.21.15.170:0/44176985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0904101840 msgr2=0x7f090419e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:01.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.387+0000 7f090ad5a640 1 --2- 172.21.15.170:0/44176985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0904101840 0x7f090419e250 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f08fc00cad0 tx=0x7f08fc00cf90 comp rx=0 tx=0).stop 2024-01-25T15:00:01.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.387+0000 7f090ad5a640 1 -- 172.21.15.170:0/44176985 shutdown_connections 2024-01-25T15:00:01.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.387+0000 7f090ad5a640 1 --2- 172.21.15.170:0/44176985 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f08ec0a12e0 0x7f08ec0a37a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.387+0000 7f090ad5a640 1 --2- 172.21.15.170:0/44176985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0904101840 0x7f090419e250 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.387+0000 7f090ad5a640 1 --2- 172.21.15.170:0/44176985 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0904100e80 0x7f09041971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.387+0000 7f090ad5a640 1 --2- 172.21.15.170:0/44176985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09040ffc90 0x7f0904196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.387+0000 7f090ad5a640 1 -- 172.21.15.170:0/44176985 >> 172.21.15.170:0/44176985 conn(0x7f09040fb220 msgr2=0x7f09041042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:01.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.387+0000 7f090ad5a640 1 -- 172.21.15.170:0/44176985 shutdown_connections 2024-01-25T15:00:01.393 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.387+0000 7f090ad5a640 1 -- 172.21.15.170:0/44176985 wait complete. 2024-01-25T15:00:01.399 INFO:teuthology.orchestra.run.smithi170.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-01-25T15:00:00.192089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595946,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":135,"num_read_kb":116,"num_write":311,"num_write_kb":2982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":253,"ondisk_log_size":253,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":266,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390984,"kb_used_data":12664,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550840,"statfs":{"total":1151940427776,"available":1151540060160,"internally_reserved":0,"allocated":12967936,"data_stored":7029096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":387233084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5578,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":130,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.004599"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223530+0000","last_change":"2024-01-25T14:59:54.219084+0000","last_active":"2024-01-25T14:59:56.223530+0000","last_peered":"2024-01-25T14:59:56.223530+0000","last_clean":"2024-01-25T14:59:56.223530+0000","last_became_active":"2024-01-25T14:59:54.218780+0000","last_became_peered":"2024-01-25T14:59:54.218780+0000","last_unstale":"2024-01-25T14:59:56.223530+0000","last_undegraded":"2024-01-25T14:59:56.223530+0000","last_fullsized":"2024-01-25T14:59:56.223530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:05:50.441934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788549+0000","last_change":"2024-01-25T14:59:54.219130+0000","last_active":"2024-01-25T14:59:55.788549+0000","last_peered":"2024-01-25T14:59:55.788549+0000","last_clean":"2024-01-25T14:59:55.788549+0000","last_became_active":"2024-01-25T14:59:54.218744+0000","last_became_peered":"2024-01-25T14:59:54.218744+0000","last_unstale":"2024-01-25T14:59:55.788549+0000","last_undegraded":"2024-01-25T14:59:55.788549+0000","last_fullsized":"2024-01-25T14:59:55.788549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:59:35.424110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788391+0000","last_change":"2024-01-25T14:59:54.218870+0000","last_active":"2024-01-25T14:59:55.788391+0000","last_peered":"2024-01-25T14:59:55.788391+0000","last_clean":"2024-01-25T14:59:55.788391+0000","last_became_active":"2024-01-25T14:59:54.218522+0000","last_became_peered":"2024-01-25T14:59:54.218522+0000","last_unstale":"2024-01-25T14:59:55.788391+0000","last_undegraded":"2024-01-25T14:59:55.788391+0000","last_fullsized":"2024-01-25T14:59:55.788391+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:00:05.038437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.222536+0000","last_change":"2024-01-25T14:59:54.218436+0000","last_active":"2024-01-25T14:59:56.222536+0000","last_peered":"2024-01-25T14:59:56.222536+0000","last_clean":"2024-01-25T14:59:56.222536+0000","last_became_active":"2024-01-25T14:59:54.217232+0000","last_became_peered":"2024-01-25T14:59:54.217232+0000","last_unstale":"2024-01-25T14:59:56.222536+0000","last_undegraded":"2024-01-25T14:59:56.222536+0000","last_fullsized":"2024-01-25T14:59:56.222536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:24:14.642794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220398+0000","last_change":"2024-01-25T14:59:54.219094+0000","last_active":"2024-01-25T14:59:56.220398+0000","last_peered":"2024-01-25T14:59:56.220398+0000","last_clean":"2024-01-25T14:59:56.220398+0000","last_became_active":"2024-01-25T14:59:54.218778+0000","last_became_peered":"2024-01-25T14:59:54.218778+0000","last_unstale":"2024-01-25T14:59:56.220398+0000","last_undegraded":"2024-01-25T14:59:56.220398+0000","last_fullsized":"2024-01-25T14:59:56.220398+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:21.754098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.205085+0000","last_change":"2024-01-25T14:59:54.213243+0000","last_active":"2024-01-25T14:59:55.205085+0000","last_peered":"2024-01-25T14:59:55.205085+0000","last_clean":"2024-01-25T14:59:55.205085+0000","last_became_active":"2024-01-25T14:59:54.212891+0000","last_became_peered":"2024-01-25T14:59:54.212891+0000","last_unstale":"2024-01-25T14:59:55.205085+0000","last_undegraded":"2024-01-25T14:59:55.205085+0000","last_fullsized":"2024-01-25T14:59:55.205085+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:52:45.505016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.682570+0000","last_change":"2024-01-25T14:59:54.211851+0000","last_active":"2024-01-25T14:59:55.682570+0000","last_peered":"2024-01-25T14:59:55.682570+0000","last_clean":"2024-01-25T14:59:55.682570+0000","last_became_active":"2024-01-25T14:59:54.211298+0000","last_became_peered":"2024-01-25T14:59:54.211298+0000","last_unstale":"2024-01-25T14:59:55.682570+0000","last_undegraded":"2024-01-25T14:59:55.682570+0000","last_fullsized":"2024-01-25T14:59:55.682570+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:05:36.636283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.219038+0000","last_change":"2024-01-25T14:59:54.217675+0000","last_active":"2024-01-25T14:59:54.219038+0000","last_peered":"2024-01-25T14:59:54.219038+0000","last_clean":"2024-01-25T14:59:54.219038+0000","last_became_active":"2024-01-25T14:59:54.217329+0000","last_became_peered":"2024-01-25T14:59:54.217329+0000","last_unstale":"2024-01-25T14:59:54.219038+0000","last_undegraded":"2024-01-25T14:59:54.219038+0000","last_fullsized":"2024-01-25T14:59:54.219038+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:47:50.471866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.222333+0000","last_change":"2024-01-25T14:59:54.213030+0000","last_active":"2024-01-25T14:59:56.222333+0000","last_peered":"2024-01-25T14:59:56.222333+0000","last_clean":"2024-01-25T14:59:56.222333+0000","last_became_active":"2024-01-25T14:59:54.212687+0000","last_became_peered":"2024-01-25T14:59:54.212687+0000","last_unstale":"2024-01-25T14:59:56.222333+0000","last_undegraded":"2024-01-25T14:59:56.222333+0000","last_fullsized":"2024-01-25T14:59:56.222333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:47:29.562996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.205301+0000","last_change":"2024-01-25T14:59:54.215372+0000","last_active":"2024-01-25T14:59:55.205301+0000","last_peered":"2024-01-25T14:59:55.205301+0000","last_clean":"2024-01-25T14:59:55.205301+0000","last_became_active":"2024-01-25T14:59:54.214432+0000","last_became_peered":"2024-01-25T14:59:54.214432+0000","last_unstale":"2024-01-25T14:59:55.205301+0000","last_undegraded":"2024-01-25T14:59:55.205301+0000","last_fullsized":"2024-01-25T14:59:55.205301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:46:40.966009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.683045+0000","last_change":"2024-01-25T14:59:54.216252+0000","last_active":"2024-01-25T14:59:55.683045+0000","last_peered":"2024-01-25T14:59:55.683045+0000","last_clean":"2024-01-25T14:59:55.683045+0000","last_became_active":"2024-01-25T14:59:54.215892+0000","last_became_peered":"2024-01-25T14:59:54.215892+0000","last_unstale":"2024-01-25T14:59:55.683045+0000","last_undegraded":"2024-01-25T14:59:55.683045+0000","last_fullsized":"2024-01-25T14:59:55.683045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:53:27.135926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220261+0000","last_change":"2024-01-25T14:59:54.221212+0000","last_active":"2024-01-25T14:59:56.220261+0000","last_peered":"2024-01-25T14:59:56.220261+0000","last_clean":"2024-01-25T14:59:56.220261+0000","last_became_active":"2024-01-25T14:59:54.220516+0000","last_became_peered":"2024-01-25T14:59:54.220516+0000","last_unstale":"2024-01-25T14:59:56.220261+0000","last_undegraded":"2024-01-25T14:59:56.220261+0000","last_fullsized":"2024-01-25T14:59:56.220261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:00:57.398457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.203198+0000","last_change":"2024-01-25T14:59:54.204088+0000","last_active":"2024-01-25T14:59:55.203198+0000","last_peered":"2024-01-25T14:59:55.203198+0000","last_clean":"2024-01-25T14:59:55.203198+0000","last_became_active":"2024-01-25T14:59:54.202895+0000","last_became_peered":"2024-01-25T14:59:54.202895+0000","last_unstale":"2024-01-25T14:59:55.203198+0000","last_undegraded":"2024-01-25T14:59:55.203198+0000","last_fullsized":"2024-01-25T14:59:55.203198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:15:37.693577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788231+0000","last_change":"2024-01-25T14:59:54.226108+0000","last_active":"2024-01-25T14:59:55.788231+0000","last_peered":"2024-01-25T14:59:55.788231+0000","last_clean":"2024-01-25T14:59:55.788231+0000","last_became_active":"2024-01-25T14:59:54.225830+0000","last_became_peered":"2024-01-25T14:59:54.225830+0000","last_unstale":"2024-01-25T14:59:55.788231+0000","last_undegraded":"2024-01-25T14:59:55.788231+0000","last_fullsized":"2024-01-25T14:59:55.788231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:10:22.580434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788223+0000","last_change":"2024-01-25T14:59:54.224893+0000","last_active":"2024-01-25T14:59:55.788223+0000","last_peered":"2024-01-25T14:59:55.788223+0000","last_clean":"2024-01-25T14:59:55.788223+0000","last_became_active":"2024-01-25T14:59:54.224583+0000","last_became_peered":"2024-01-25T14:59:54.224583+0000","last_unstale":"2024-01-25T14:59:55.788223+0000","last_undegraded":"2024-01-25T14:59:55.788223+0000","last_fullsized":"2024-01-25T14:59:55.788223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:48:25.538489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221392+0000","last_change":"2024-01-25T14:59:54.217030+0000","last_active":"2024-01-25T14:59:56.221392+0000","last_peered":"2024-01-25T14:59:56.221392+0000","last_clean":"2024-01-25T14:59:56.221392+0000","last_became_active":"2024-01-25T14:59:54.216732+0000","last_became_peered":"2024-01-25T14:59:54.216732+0000","last_unstale":"2024-01-25T14:59:56.221392+0000","last_undegraded":"2024-01-25T14:59:56.221392+0000","last_fullsized":"2024-01-25T14:59:56.221392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:58:36.072464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223868+0000","last_change":"2024-01-25T14:59:54.223924+0000","last_active":"2024-01-25T14:59:56.223868+0000","last_peered":"2024-01-25T14:59:56.223868+0000","last_clean":"2024-01-25T14:59:56.223868+0000","last_became_active":"2024-01-25T14:59:54.223556+0000","last_became_peered":"2024-01-25T14:59:54.223556+0000","last_unstale":"2024-01-25T14:59:56.223868+0000","last_undegraded":"2024-01-25T14:59:56.223868+0000","last_fullsized":"2024-01-25T14:59:56.223868+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:54:18.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221521+0000","last_change":"2024-01-25T14:59:54.207125+0000","last_active":"2024-01-25T14:59:56.221521+0000","last_peered":"2024-01-25T14:59:56.221521+0000","last_clean":"2024-01-25T14:59:56.221521+0000","last_became_active":"2024-01-25T14:59:54.206630+0000","last_became_peered":"2024-01-25T14:59:54.206630+0000","last_unstale":"2024-01-25T14:59:56.221521+0000","last_undegraded":"2024-01-25T14:59:56.221521+0000","last_fullsized":"2024-01-25T14:59:56.221521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:10:12.685185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.204093+0000","last_change":"2024-01-25T14:59:54.210732+0000","last_active":"2024-01-25T14:59:55.204093+0000","last_peered":"2024-01-25T14:59:55.204093+0000","last_clean":"2024-01-25T14:59:55.204093+0000","last_became_active":"2024-01-25T14:59:54.210417+0000","last_became_peered":"2024-01-25T14:59:54.210417+0000","last_unstale":"2024-01-25T14:59:55.204093+0000","last_undegraded":"2024-01-25T14:59:55.204093+0000","last_fullsized":"2024-01-25T14:59:55.204093+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:05:22.305485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'11","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:58.049133+0000","last_change":"2024-01-25T14:59:53.204680+0000","last_active":"2024-01-25T14:59:58.049133+0000","last_peered":"2024-01-25T14:59:58.049133+0000","last_clean":"2024-01-25T14:59:58.049133+0000","last_became_active":"2024-01-25T14:59:53.204327+0000","last_became_peered":"2024-01-25T14:59:53.204327+0000","last_unstale":"2024-01-25T14:59:58.049133+0000","last_undegraded":"2024-01-25T14:59:58.049133+0000","last_fullsized":"2024-01-25T14:59:58.049133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:32:16.333425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.220880+0000","last_change":"2024-01-25T14:59:54.220501+0000","last_active":"2024-01-25T14:59:54.220880+0000","last_peered":"2024-01-25T14:59:54.220880+0000","last_clean":"2024-01-25T14:59:54.220880+0000","last_became_active":"2024-01-25T14:59:54.217150+0000","last_became_peered":"2024-01-25T14:59:54.217150+0000","last_unstale":"2024-01-25T14:59:54.220880+0000","last_undegraded":"2024-01-25T14:59:54.220880+0000","last_fullsized":"2024-01-25T14:59:54.220880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:46:43.127499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.225398+0000","last_change":"2024-01-25T14:59:53.209110+0000","last_active":"2024-01-25T14:59:54.225398+0000","last_peered":"2024-01-25T14:59:54.225398+0000","last_clean":"2024-01-25T14:59:54.225398+0000","last_became_active":"2024-01-25T14:59:53.208794+0000","last_became_peered":"2024-01-25T14:59:53.208794+0000","last_unstale":"2024-01-25T14:59:54.225398+0000","last_undegraded":"2024-01-25T14:59:54.225398+0000","last_fullsized":"2024-01-25T14:59:54.225398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:51:40.757062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788614+0000","last_change":"2024-01-25T14:59:54.219303+0000","last_active":"2024-01-25T14:59:55.788614+0000","last_peered":"2024-01-25T14:59:55.788614+0000","last_clean":"2024-01-25T14:59:55.788614+0000","last_became_active":"2024-01-25T14:59:54.218814+0000","last_became_peered":"2024-01-25T14:59:54.218814+0000","last_unstale":"2024-01-25T14:59:55.788614+0000","last_undegraded":"2024-01-25T14:59:55.788614+0000","last_fullsized":"2024-01-25T14:59:55.788614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:54:30.556998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:57.227840+0000","last_change":"2024-01-25T14:59:53.209770+0000","last_active":"2024-01-25T14:59:57.227840+0000","last_peered":"2024-01-25T14:59:57.227840+0000","last_clean":"2024-01-25T14:59:57.227840+0000","last_became_active":"2024-01-25T14:59:53.209466+0000","last_became_peered":"2024-01-25T14:59:53.209466+0000","last_unstale":"2024-01-25T14:59:57.227840+0000","last_undegraded":"2024-01-25T14:59:57.227840+0000","last_fullsized":"2024-01-25T14:59:57.227840+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:58:11.391155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221547+0000","last_change":"2024-01-25T14:59:54.201559+0000","last_active":"2024-01-25T14:59:56.221547+0000","last_peered":"2024-01-25T14:59:56.221547+0000","last_clean":"2024-01-25T14:59:56.221547+0000","last_became_active":"2024-01-25T14:59:54.201155+0000","last_became_peered":"2024-01-25T14:59:54.201155+0000","last_unstale":"2024-01-25T14:59:56.221547+0000","last_undegraded":"2024-01-25T14:59:56.221547+0000","last_fullsized":"2024-01-25T14:59:56.221547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:29:15.444879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220993+0000","last_change":"2024-01-25T14:59:53.208457+0000","last_active":"2024-01-25T14:59:56.220993+0000","last_peered":"2024-01-25T14:59:56.220993+0000","last_clean":"2024-01-25T14:59:56.220993+0000","last_became_active":"2024-01-25T14:59:53.208166+0000","last_became_peered":"2024-01-25T14:59:53.208166+0000","last_unstale":"2024-01-25T14:59:56.220993+0000","last_undegraded":"2024-01-25T14:59:56.220993+0000","last_fullsized":"2024-01-25T14:59:56.220993+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:29:22.580726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.093875+0000","last_change":"2024-01-25T14:59:54.212126+0000","last_active":"2024-01-25T14:59:56.093875+0000","last_peered":"2024-01-25T14:59:56.093875+0000","last_clean":"2024-01-25T14:59:56.093875+0000","last_became_active":"2024-01-25T14:59:54.211519+0000","last_became_peered":"2024-01-25T14:59:54.211519+0000","last_unstale":"2024-01-25T14:59:56.093875+0000","last_undegraded":"2024-01-25T14:59:56.093875+0000","last_fullsized":"2024-01-25T14:59:56.093875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:50:59.743852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:59.042162+0000","last_change":"2024-01-25T14:59:53.201803+0000","last_active":"2024-01-25T14:59:59.042162+0000","last_peered":"2024-01-25T14:59:59.042162+0000","last_clean":"2024-01-25T14:59:59.042162+0000","last_became_active":"2024-01-25T14:59:53.201464+0000","last_became_peered":"2024-01-25T14:59:53.201464+0000","last_unstale":"2024-01-25T14:59:59.042162+0000","last_undegraded":"2024-01-25T14:59:59.042162+0000","last_fullsized":"2024-01-25T14:59:59.042162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:36:03.922038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220692+0000","last_change":"2024-01-25T14:59:54.207126+0000","last_active":"2024-01-25T14:59:56.220692+0000","last_peered":"2024-01-25T14:59:56.220692+0000","last_clean":"2024-01-25T14:59:56.220692+0000","last_became_active":"2024-01-25T14:59:54.206826+0000","last_became_peered":"2024-01-25T14:59:54.206826+0000","last_unstale":"2024-01-25T14:59:56.220692+0000","last_undegraded":"2024-01-25T14:59:56.220692+0000","last_fullsized":"2024-01-25T14:59:56.220692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:45:07.217919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:57.227608+0000","last_change":"2024-01-25T14:59:53.200335+0000","last_active":"2024-01-25T14:59:57.227608+0000","last_peered":"2024-01-25T14:59:57.227608+0000","last_clean":"2024-01-25T14:59:57.227608+0000","last_became_active":"2024-01-25T14:59:53.200028+0000","last_became_peered":"2024-01-25T14:59:53.200028+0000","last_unstale":"2024-01-25T14:59:57.227608+0000","last_undegraded":"2024-01-25T14:59:57.227608+0000","last_fullsized":"2024-01-25T14:59:57.227608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:23:26.178260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.093652+0000","last_change":"2024-01-25T14:59:54.211048+0000","last_active":"2024-01-25T14:59:56.093652+0000","last_peered":"2024-01-25T14:59:56.093652+0000","last_clean":"2024-01-25T14:59:56.093652+0000","last_became_active":"2024-01-25T14:59:54.210724+0000","last_became_peered":"2024-01-25T14:59:54.210724+0000","last_unstale":"2024-01-25T14:59:56.093652+0000","last_undegraded":"2024-01-25T14:59:56.093652+0000","last_fullsized":"2024-01-25T14:59:56.093652+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:59:40.171707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:57.229151+0000","last_change":"2024-01-25T14:59:53.202235+0000","last_active":"2024-01-25T14:59:57.229151+0000","last_peered":"2024-01-25T14:59:57.229151+0000","last_clean":"2024-01-25T14:59:57.229151+0000","last_became_active":"2024-01-25T14:59:53.201933+0000","last_became_peered":"2024-01-25T14:59:53.201933+0000","last_unstale":"2024-01-25T14:59:57.229151+0000","last_undegraded":"2024-01-25T14:59:57.229151+0000","last_fullsized":"2024-01-25T14:59:57.229151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:40:23.725903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.205699+0000","last_change":"2024-01-25T14:59:54.205184+0000","last_active":"2024-01-25T14:59:54.205699+0000","last_peered":"2024-01-25T14:59:54.205699+0000","last_clean":"2024-01-25T14:59:54.205699+0000","last_became_active":"2024-01-25T14:59:54.204865+0000","last_became_peered":"2024-01-25T14:59:54.204865+0000","last_unstale":"2024-01-25T14:59:54.205699+0000","last_undegraded":"2024-01-25T14:59:54.205699+0000","last_fullsized":"2024-01-25T14:59:54.205699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:03:18.634359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:58.049061+0000","last_change":"2024-01-25T14:59:53.205021+0000","last_active":"2024-01-25T14:59:58.049061+0000","last_peered":"2024-01-25T14:59:58.049061+0000","last_clean":"2024-01-25T14:59:58.049061+0000","last_became_active":"2024-01-25T14:59:53.203925+0000","last_became_peered":"2024-01-25T14:59:53.203925+0000","last_unstale":"2024-01-25T14:59:58.049061+0000","last_undegraded":"2024-01-25T14:59:58.049061+0000","last_fullsized":"2024-01-25T14:59:58.049061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:20:43.003659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221149+0000","last_change":"2024-01-25T14:59:54.207234+0000","last_active":"2024-01-25T14:59:56.221149+0000","last_peered":"2024-01-25T14:59:56.221149+0000","last_clean":"2024-01-25T14:59:56.221149+0000","last_became_active":"2024-01-25T14:59:54.206727+0000","last_became_peered":"2024-01-25T14:59:54.206727+0000","last_unstale":"2024-01-25T14:59:56.221149+0000","last_undegraded":"2024-01-25T14:59:56.221149+0000","last_fullsized":"2024-01-25T14:59:56.221149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:29:08.678821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.222812+0000","last_change":"2024-01-25T14:59:53.204198+0000","last_active":"2024-01-25T14:59:56.222812+0000","last_peered":"2024-01-25T14:59:56.222812+0000","last_clean":"2024-01-25T14:59:56.222812+0000","last_became_active":"2024-01-25T14:59:53.203844+0000","last_became_peered":"2024-01-25T14:59:53.203844+0000","last_unstale":"2024-01-25T14:59:56.222812+0000","last_undegraded":"2024-01-25T14:59:56.222812+0000","last_fullsized":"2024-01-25T14:59:56.222812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:30:23.735236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221264+0000","last_change":"2024-01-25T14:59:54.203318+0000","last_active":"2024-01-25T14:59:56.221264+0000","last_peered":"2024-01-25T14:59:56.221264+0000","last_clean":"2024-01-25T14:59:56.221264+0000","last_became_active":"2024-01-25T14:59:54.202971+0000","last_became_peered":"2024-01-25T14:59:54.202971+0000","last_unstale":"2024-01-25T14:59:56.221264+0000","last_undegraded":"2024-01-25T14:59:56.221264+0000","last_fullsized":"2024-01-25T14:59:56.221264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:57:59.454857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:59.055000+0000","last_change":"2024-01-25T14:59:53.203938+0000","last_active":"2024-01-25T14:59:59.055000+0000","last_peered":"2024-01-25T14:59:59.055000+0000","last_clean":"2024-01-25T14:59:59.055000+0000","last_became_active":"2024-01-25T14:59:53.203639+0000","last_became_peered":"2024-01-25T14:59:53.203639+0000","last_unstale":"2024-01-25T14:59:59.055000+0000","last_undegraded":"2024-01-25T14:59:59.055000+0000","last_fullsized":"2024-01-25T14:59:59.055000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:12:16.819375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788552+0000","last_change":"2024-01-25T14:59:54.225131+0000","last_active":"2024-01-25T14:59:55.788552+0000","last_peered":"2024-01-25T14:59:55.788552+0000","last_clean":"2024-01-25T14:59:55.788552+0000","last_became_active":"2024-01-25T14:59:54.224786+0000","last_became_peered":"2024-01-25T14:59:54.224786+0000","last_unstale":"2024-01-25T14:59:55.788552+0000","last_undegraded":"2024-01-25T14:59:55.788552+0000","last_fullsized":"2024-01-25T14:59:55.788552+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:25:07.426433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:58.039852+0000","last_change":"2024-01-25T14:59:53.199834+0000","last_active":"2024-01-25T14:59:58.039852+0000","last_peered":"2024-01-25T14:59:58.039852+0000","last_clean":"2024-01-25T14:59:58.039852+0000","last_became_active":"2024-01-25T14:59:53.199545+0000","last_became_peered":"2024-01-25T14:59:53.199545+0000","last_unstale":"2024-01-25T14:59:58.039852+0000","last_undegraded":"2024-01-25T14:59:58.039852+0000","last_fullsized":"2024-01-25T14:59:58.039852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:38:08.973583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221824+0000","last_change":"2024-01-25T14:59:54.214768+0000","last_active":"2024-01-25T14:59:56.221824+0000","last_peered":"2024-01-25T14:59:56.221824+0000","last_clean":"2024-01-25T14:59:56.221824+0000","last_became_active":"2024-01-25T14:59:54.214038+0000","last_became_peered":"2024-01-25T14:59:54.214038+0000","last_unstale":"2024-01-25T14:59:56.221824+0000","last_undegraded":"2024-01-25T14:59:56.221824+0000","last_fullsized":"2024-01-25T14:59:56.221824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:10:20.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'8","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.222215+0000","last_change":"2024-01-25T14:59:53.203719+0000","last_active":"2024-01-25T14:59:56.222215+0000","last_peered":"2024-01-25T14:59:56.222215+0000","last_clean":"2024-01-25T14:59:56.222215+0000","last_became_active":"2024-01-25T14:59:53.203382+0000","last_became_peered":"2024-01-25T14:59:53.203382+0000","last_unstale":"2024-01-25T14:59:56.222215+0000","last_undegraded":"2024-01-25T14:59:56.222215+0000","last_fullsized":"2024-01-25T14:59:56.222215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:10:17.120929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220942+0000","last_change":"2024-01-25T14:59:54.217069+0000","last_active":"2024-01-25T14:59:56.220942+0000","last_peered":"2024-01-25T14:59:56.220942+0000","last_clean":"2024-01-25T14:59:56.220942+0000","last_became_active":"2024-01-25T14:59:54.216749+0000","last_became_peered":"2024-01-25T14:59:54.216749+0000","last_unstale":"2024-01-25T14:59:56.220942+0000","last_undegraded":"2024-01-25T14:59:56.220942+0000","last_fullsized":"2024-01-25T14:59:56.220942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:31:00.903462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223824+0000","last_change":"2024-01-25T14:59:53.198852+0000","last_active":"2024-01-25T14:59:56.223824+0000","last_peered":"2024-01-25T14:59:56.223824+0000","last_clean":"2024-01-25T14:59:56.223824+0000","last_became_active":"2024-01-25T14:59:53.198532+0000","last_became_peered":"2024-01-25T14:59:53.198532+0000","last_unstale":"2024-01-25T14:59:56.223824+0000","last_undegraded":"2024-01-25T14:59:56.223824+0000","last_fullsized":"2024-01-25T14:59:56.223824+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:03:43.251730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.202829+0000","last_change":"2024-01-25T14:59:54.209865+0000","last_active":"2024-01-25T14:59:55.202829+0000","last_peered":"2024-01-25T14:59:55.202829+0000","last_clean":"2024-01-25T14:59:55.202829+0000","last_became_active":"2024-01-25T14:59:54.209564+0000","last_became_peered":"2024-01-25T14:59:54.209564+0000","last_unstale":"2024-01-25T14:59:55.202829+0000","last_undegraded":"2024-01-25T14:59:55.202829+0000","last_fullsized":"2024-01-25T14:59:55.202829+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:19:24.461651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:58.048034+0000","last_change":"2024-01-25T14:59:53.207644+0000","last_active":"2024-01-25T14:59:58.048034+0000","last_peered":"2024-01-25T14:59:58.048034+0000","last_clean":"2024-01-25T14:59:58.048034+0000","last_became_active":"2024-01-25T14:59:53.207321+0000","last_became_peered":"2024-01-25T14:59:53.207321+0000","last_unstale":"2024-01-25T14:59:58.048034+0000","last_undegraded":"2024-01-25T14:59:58.048034+0000","last_fullsized":"2024-01-25T14:59:58.048034+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:47:12.131711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.682971+0000","last_change":"2024-01-25T14:59:54.220548+0000","last_active":"2024-01-25T14:59:55.682971+0000","last_peered":"2024-01-25T14:59:55.682971+0000","last_clean":"2024-01-25T14:59:55.682971+0000","last_became_active":"2024-01-25T14:59:54.219743+0000","last_became_peered":"2024-01-25T14:59:54.219743+0000","last_unstale":"2024-01-25T14:59:55.682971+0000","last_undegraded":"2024-01-25T14:59:55.682971+0000","last_fullsized":"2024-01-25T14:59:55.682971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:46:12.085591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220468+0000","last_change":"2024-01-25T14:59:53.201233+0000","last_active":"2024-01-25T14:59:56.220468+0000","last_peered":"2024-01-25T14:59:56.220468+0000","last_clean":"2024-01-25T14:59:56.220468+0000","last_became_active":"2024-01-25T14:59:53.200907+0000","last_became_peered":"2024-01-25T14:59:53.200907+0000","last_unstale":"2024-01-25T14:59:56.220468+0000","last_undegraded":"2024-01-25T14:59:56.220468+0000","last_fullsized":"2024-01-25T14:59:56.220468+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:30:59.640179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.682511+0000","last_change":"2024-01-25T14:59:54.212617+0000","last_active":"2024-01-25T14:59:55.682511+0000","last_peered":"2024-01-25T14:59:55.682511+0000","last_clean":"2024-01-25T14:59:55.682511+0000","last_became_active":"2024-01-25T14:59:54.212328+0000","last_became_peered":"2024-01-25T14:59:54.212328+0000","last_unstale":"2024-01-25T14:59:55.682511+0000","last_undegraded":"2024-01-25T14:59:55.682511+0000","last_fullsized":"2024-01-25T14:59:55.682511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:21:16.958894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:57.229805+0000","last_change":"2024-01-25T14:59:53.202685+0000","last_active":"2024-01-25T14:59:57.229805+0000","last_peered":"2024-01-25T14:59:57.229805+0000","last_clean":"2024-01-25T14:59:57.229805+0000","last_became_active":"2024-01-25T14:59:53.201529+0000","last_became_peered":"2024-01-25T14:59:53.201529+0000","last_unstale":"2024-01-25T14:59:57.229805+0000","last_undegraded":"2024-01-25T14:59:57.229805+0000","last_fullsized":"2024-01-25T14:59:57.229805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:43:29.823959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.093467+0000","last_change":"2024-01-25T14:59:54.208724+0000","last_active":"2024-01-25T14:59:56.093467+0000","last_peered":"2024-01-25T14:59:56.093467+0000","last_clean":"2024-01-25T14:59:56.093467+0000","last_became_active":"2024-01-25T14:59:54.208392+0000","last_became_peered":"2024-01-25T14:59:54.208392+0000","last_unstale":"2024-01-25T14:59:56.093467+0000","last_undegraded":"2024-01-25T14:59:56.093467+0000","last_fullsized":"2024-01-25T14:59:56.093467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:37.285702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220465+0000","last_change":"2024-01-25T14:59:53.202763+0000","last_active":"2024-01-25T14:59:56.220465+0000","last_peered":"2024-01-25T14:59:56.220465+0000","last_clean":"2024-01-25T14:59:56.220465+0000","last_became_active":"2024-01-25T14:59:53.202372+0000","last_became_peered":"2024-01-25T14:59:53.202372+0000","last_unstale":"2024-01-25T14:59:56.220465+0000","last_undegraded":"2024-01-25T14:59:56.220465+0000","last_fullsized":"2024-01-25T14:59:56.220465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:52:31.260903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223226+0000","last_change":"2024-01-25T14:59:54.216918+0000","last_active":"2024-01-25T14:59:56.223226+0000","last_peered":"2024-01-25T14:59:56.223226+0000","last_clean":"2024-01-25T14:59:56.223226+0000","last_became_active":"2024-01-25T14:59:54.216283+0000","last_became_peered":"2024-01-25T14:59:54.216283+0000","last_unstale":"2024-01-25T14:59:56.223226+0000","last_undegraded":"2024-01-25T14:59:56.223226+0000","last_fullsized":"2024-01-25T14:59:56.223226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:15:11.192764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221467+0000","last_change":"2024-01-25T14:59:53.207266+0000","last_active":"2024-01-25T14:59:56.221467+0000","last_peered":"2024-01-25T14:59:56.221467+0000","last_clean":"2024-01-25T14:59:56.221467+0000","last_became_active":"2024-01-25T14:59:53.206820+0000","last_became_peered":"2024-01-25T14:59:53.206820+0000","last_unstale":"2024-01-25T14:59:56.221467+0000","last_undegraded":"2024-01-25T14:59:56.221467+0000","last_fullsized":"2024-01-25T14:59:56.221467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:29:02.371577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.205189+0000","last_change":"2024-01-25T14:59:54.210434+0000","last_active":"2024-01-25T14:59:55.205189+0000","last_peered":"2024-01-25T14:59:55.205189+0000","last_clean":"2024-01-25T14:59:55.205189+0000","last_became_active":"2024-01-25T14:59:54.210100+0000","last_became_peered":"2024-01-25T14:59:54.210100+0000","last_unstale":"2024-01-25T14:59:55.205189+0000","last_undegraded":"2024-01-25T14:59:55.205189+0000","last_fullsized":"2024-01-25T14:59:55.205189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:48:21.463712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:59.054737+0000","last_change":"2024-01-25T14:59:53.202938+0000","last_active":"2024-01-25T14:59:59.054737+0000","last_peered":"2024-01-25T14:59:59.054737+0000","last_clean":"2024-01-25T14:59:59.054737+0000","last_became_active":"2024-01-25T14:59:53.202638+0000","last_became_peered":"2024-01-25T14:59:53.202638+0000","last_unstale":"2024-01-25T14:59:59.054737+0000","last_undegraded":"2024-01-25T14:59:59.054737+0000","last_fullsized":"2024-01-25T14:59:59.054737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.371375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.204950+0000","last_change":"2024-01-25T14:59:54.219778+0000","last_active":"2024-01-25T14:59:55.204950+0000","last_peered":"2024-01-25T14:59:55.204950+0000","last_clean":"2024-01-25T14:59:55.204950+0000","last_became_active":"2024-01-25T14:59:54.219385+0000","last_became_peered":"2024-01-25T14:59:54.219385+0000","last_unstale":"2024-01-25T14:59:55.204950+0000","last_undegraded":"2024-01-25T14:59:55.204950+0000","last_fullsized":"2024-01-25T14:59:55.204950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:49:27.929024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.093451+0000","last_change":"2024-01-25T14:59:54.209306+0000","last_active":"2024-01-25T14:59:56.093451+0000","last_peered":"2024-01-25T14:59:56.093451+0000","last_clean":"2024-01-25T14:59:56.093451+0000","last_became_active":"2024-01-25T14:59:54.208979+0000","last_became_peered":"2024-01-25T14:59:54.208979+0000","last_unstale":"2024-01-25T14:59:56.093451+0000","last_undegraded":"2024-01-25T14:59:56.093451+0000","last_fullsized":"2024-01-25T14:59:56.093451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:23:46.763358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:57.229632+0000","last_change":"2024-01-25T14:59:53.200590+0000","last_active":"2024-01-25T14:59:57.229632+0000","last_peered":"2024-01-25T14:59:57.229632+0000","last_clean":"2024-01-25T14:59:57.229632+0000","last_became_active":"2024-01-25T14:59:53.200292+0000","last_became_peered":"2024-01-25T14:59:53.200292+0000","last_unstale":"2024-01-25T14:59:57.229632+0000","last_undegraded":"2024-01-25T14:59:57.229632+0000","last_fullsized":"2024-01-25T14:59:57.229632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:02:05.135314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.219106+0000","last_change":"2024-01-25T14:59:54.217765+0000","last_active":"2024-01-25T14:59:54.219106+0000","last_peered":"2024-01-25T14:59:54.219106+0000","last_clean":"2024-01-25T14:59:54.219106+0000","last_became_active":"2024-01-25T14:59:54.217433+0000","last_became_peered":"2024-01-25T14:59:54.217433+0000","last_unstale":"2024-01-25T14:59:54.219106+0000","last_undegraded":"2024-01-25T14:59:54.219106+0000","last_fullsized":"2024-01-25T14:59:54.219106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:02:48.002265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221711+0000","last_change":"2024-01-25T14:59:53.197543+0000","last_active":"2024-01-25T14:59:56.221711+0000","last_peered":"2024-01-25T14:59:56.221711+0000","last_clean":"2024-01-25T14:59:56.221711+0000","last_became_active":"2024-01-25T14:59:53.197213+0000","last_became_peered":"2024-01-25T14:59:53.197213+0000","last_unstale":"2024-01-25T14:59:56.221711+0000","last_undegraded":"2024-01-25T14:59:56.221711+0000","last_fullsized":"2024-01-25T14:59:56.221711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:19:39.477948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":339,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.682538+0000","last_change":"2024-01-25T14:58:41.034413+0000","last_active":"2024-01-25T14:59:55.682538+0000","last_peered":"2024-01-25T14:59:55.682538+0000","last_clean":"2024-01-25T14:59:55.682538+0000","last_became_active":"2024-01-25T14:58:41.033881+0000","last_became_peered":"2024-01-25T14:58:41.033881+0000","last_unstale":"2024-01-25T14:59:55.682538+0000","last_undegraded":"2024-01-25T14:59:55.682538+0000","last_fullsized":"2024-01-25T14:59:55.682538+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:55:22.974068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:55:22.974068+0000","last_clean_scrub_stamp":"2024-01-25T14:55:22.974068+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:05:30.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.202681+0000","last_change":"2024-01-25T14:59:54.214713+0000","last_active":"2024-01-25T14:59:55.202681+0000","last_peered":"2024-01-25T14:59:55.202681+0000","last_clean":"2024-01-25T14:59:55.202681+0000","last_became_active":"2024-01-25T14:59:54.214348+0000","last_became_peered":"2024-01-25T14:59:54.214348+0000","last_unstale":"2024-01-25T14:59:55.202681+0000","last_undegraded":"2024-01-25T14:59:55.202681+0000","last_fullsized":"2024-01-25T14:59:55.202681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:11:46.134755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:57.228328+0000","last_change":"2024-01-25T14:59:53.202970+0000","last_active":"2024-01-25T14:59:57.228328+0000","last_peered":"2024-01-25T14:59:57.228328+0000","last_clean":"2024-01-25T14:59:57.228328+0000","last_became_active":"2024-01-25T14:59:53.202680+0000","last_became_peered":"2024-01-25T14:59:53.202680+0000","last_unstale":"2024-01-25T14:59:57.228328+0000","last_undegraded":"2024-01-25T14:59:57.228328+0000","last_fullsized":"2024-01-25T14:59:57.228328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:28:12.628390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220894+0000","last_change":"2024-01-25T14:59:53.210040+0000","last_active":"2024-01-25T14:59:56.220894+0000","last_peered":"2024-01-25T14:59:56.220894+0000","last_clean":"2024-01-25T14:59:56.220894+0000","last_became_active":"2024-01-25T14:59:53.209636+0000","last_became_peered":"2024-01-25T14:59:53.209636+0000","last_unstale":"2024-01-25T14:59:56.220894+0000","last_undegraded":"2024-01-25T14:59:56.220894+0000","last_fullsized":"2024-01-25T14:59:56.220894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:22:45.268969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.203132+0000","last_change":"2024-01-25T14:59:54.203875+0000","last_active":"2024-01-25T14:59:55.203132+0000","last_peered":"2024-01-25T14:59:55.203132+0000","last_clean":"2024-01-25T14:59:55.203132+0000","last_became_active":"2024-01-25T14:59:54.203573+0000","last_became_peered":"2024-01-25T14:59:54.203573+0000","last_unstale":"2024-01-25T14:59:55.203132+0000","last_undegraded":"2024-01-25T14:59:55.203132+0000","last_fullsized":"2024-01-25T14:59:55.203132+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:16:33.124186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'6","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:58.050062+0000","last_change":"2024-01-25T14:59:53.202984+0000","last_active":"2024-01-25T14:59:58.050062+0000","last_peered":"2024-01-25T14:59:58.050062+0000","last_clean":"2024-01-25T14:59:58.050062+0000","last_became_active":"2024-01-25T14:59:53.202651+0000","last_became_peered":"2024-01-25T14:59:53.202651+0000","last_unstale":"2024-01-25T14:59:58.050062+0000","last_undegraded":"2024-01-25T14:59:58.050062+0000","last_fullsized":"2024-01-25T14:59:58.050062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:25:06.486454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.212976+0000","last_change":"2024-01-25T14:59:54.212444+0000","last_active":"2024-01-25T14:59:54.212976+0000","last_peered":"2024-01-25T14:59:54.212976+0000","last_clean":"2024-01-25T14:59:54.212976+0000","last_became_active":"2024-01-25T14:59:54.212090+0000","last_became_peered":"2024-01-25T14:59:54.212090+0000","last_unstale":"2024-01-25T14:59:54.212976+0000","last_undegraded":"2024-01-25T14:59:54.212976+0000","last_fullsized":"2024-01-25T14:59:54.212976+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:19:22.203687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.224116+0000","last_change":"2024-01-25T14:59:53.199984+0000","last_active":"2024-01-25T14:59:56.224116+0000","last_peered":"2024-01-25T14:59:56.224116+0000","last_clean":"2024-01-25T14:59:56.224116+0000","last_became_active":"2024-01-25T14:59:53.199674+0000","last_became_peered":"2024-01-25T14:59:53.199674+0000","last_unstale":"2024-01-25T14:59:56.224116+0000","last_undegraded":"2024-01-25T14:59:56.224116+0000","last_fullsized":"2024-01-25T14:59:56.224116+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:22:01.521516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788473+0000","last_change":"2024-01-25T14:59:54.224285+0000","last_active":"2024-01-25T14:59:55.788473+0000","last_peered":"2024-01-25T14:59:55.788473+0000","last_clean":"2024-01-25T14:59:55.788473+0000","last_became_active":"2024-01-25T14:59:54.223904+0000","last_became_peered":"2024-01-25T14:59:54.223904+0000","last_unstale":"2024-01-25T14:59:55.788473+0000","last_undegraded":"2024-01-25T14:59:55.788473+0000","last_fullsized":"2024-01-25T14:59:55.788473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:49:24.717733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.224825+0000","last_change":"2024-01-25T14:59:53.203501+0000","last_active":"2024-01-25T14:59:56.224825+0000","last_peered":"2024-01-25T14:59:56.224825+0000","last_clean":"2024-01-25T14:59:56.224825+0000","last_became_active":"2024-01-25T14:59:53.203215+0000","last_became_peered":"2024-01-25T14:59:53.203215+0000","last_unstale":"2024-01-25T14:59:56.224825+0000","last_undegraded":"2024-01-25T14:59:56.224825+0000","last_fullsized":"2024-01-25T14:59:56.224825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:18:25.174639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220249+0000","last_change":"2024-01-25T14:59:54.219575+0000","last_active":"2024-01-25T14:59:56.220249+0000","last_peered":"2024-01-25T14:59:56.220249+0000","last_clean":"2024-01-25T14:59:56.220249+0000","last_became_active":"2024-01-25T14:59:54.219170+0000","last_became_peered":"2024-01-25T14:59:54.219170+0000","last_unstale":"2024-01-25T14:59:56.220249+0000","last_undegraded":"2024-01-25T14:59:56.220249+0000","last_fullsized":"2024-01-25T14:59:56.220249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:41.940927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.199798+0000","last_change":"2024-01-25T14:59:53.203864+0000","last_active":"2024-01-25T14:59:54.199798+0000","last_peered":"2024-01-25T14:59:54.199798+0000","last_clean":"2024-01-25T14:59:54.199798+0000","last_became_active":"2024-01-25T14:59:53.203564+0000","last_became_peered":"2024-01-25T14:59:53.203564+0000","last_unstale":"2024-01-25T14:59:54.199798+0000","last_undegraded":"2024-01-25T14:59:54.199798+0000","last_fullsized":"2024-01-25T14:59:54.199798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:03:21.776910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223114+0000","last_change":"2024-01-25T14:59:54.217014+0000","last_active":"2024-01-25T14:59:56.223114+0000","last_peered":"2024-01-25T14:59:56.223114+0000","last_clean":"2024-01-25T14:59:56.223114+0000","last_became_active":"2024-01-25T14:59:54.216673+0000","last_became_peered":"2024-01-25T14:59:54.216673+0000","last_unstale":"2024-01-25T14:59:56.223114+0000","last_undegraded":"2024-01-25T14:59:56.223114+0000","last_fullsized":"2024-01-25T14:59:56.223114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:46:31.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.203748+0000","last_change":"2024-01-25T14:59:53.207297+0000","last_active":"2024-01-25T14:59:55.203748+0000","last_peered":"2024-01-25T14:59:55.203748+0000","last_clean":"2024-01-25T14:59:55.203748+0000","last_became_active":"2024-01-25T14:59:53.206968+0000","last_became_peered":"2024-01-25T14:59:53.206968+0000","last_unstale":"2024-01-25T14:59:55.203748+0000","last_undegraded":"2024-01-25T14:59:55.203748+0000","last_fullsized":"2024-01-25T14:59:55.203748+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:01.679360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.219959+0000","last_change":"2024-01-25T14:59:54.218890+0000","last_active":"2024-01-25T14:59:54.219959+0000","last_peered":"2024-01-25T14:59:54.219959+0000","last_clean":"2024-01-25T14:59:54.219959+0000","last_became_active":"2024-01-25T14:59:54.218581+0000","last_became_peered":"2024-01-25T14:59:54.218581+0000","last_unstale":"2024-01-25T14:59:54.219959+0000","last_undegraded":"2024-01-25T14:59:54.219959+0000","last_fullsized":"2024-01-25T14:59:54.219959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:59:31.468054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.224850+0000","last_change":"2024-01-25T14:59:53.208219+0000","last_active":"2024-01-25T14:59:56.224850+0000","last_peered":"2024-01-25T14:59:56.224850+0000","last_clean":"2024-01-25T14:59:56.224850+0000","last_became_active":"2024-01-25T14:59:53.207878+0000","last_became_peered":"2024-01-25T14:59:53.207878+0000","last_unstale":"2024-01-25T14:59:56.224850+0000","last_undegraded":"2024-01-25T14:59:56.224850+0000","last_fullsized":"2024-01-25T14:59:56.224850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:03.410383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.682838+0000","last_change":"2024-01-25T14:59:54.208996+0000","last_active":"2024-01-25T14:59:55.682838+0000","last_peered":"2024-01-25T14:59:55.682838+0000","last_clean":"2024-01-25T14:59:55.682838+0000","last_became_active":"2024-01-25T14:59:54.208658+0000","last_became_peered":"2024-01-25T14:59:54.208658+0000","last_unstale":"2024-01-25T14:59:55.682838+0000","last_undegraded":"2024-01-25T14:59:55.682838+0000","last_fullsized":"2024-01-25T14:59:55.682838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:39:57.752381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.204161+0000","last_change":"2024-01-25T14:59:53.207106+0000","last_active":"2024-01-25T14:59:55.204161+0000","last_peered":"2024-01-25T14:59:55.204161+0000","last_clean":"2024-01-25T14:59:55.204161+0000","last_became_active":"2024-01-25T14:59:53.206688+0000","last_became_peered":"2024-01-25T14:59:53.206688+0000","last_unstale":"2024-01-25T14:59:55.204161+0000","last_undegraded":"2024-01-25T14:59:55.204161+0000","last_fullsized":"2024-01-25T14:59:55.204161+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:30:03.019791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.683147+0000","last_change":"2024-01-25T14:59:54.208994+0000","last_active":"2024-01-25T14:59:55.683147+0000","last_peered":"2024-01-25T14:59:55.683147+0000","last_clean":"2024-01-25T14:59:55.683147+0000","last_became_active":"2024-01-25T14:59:54.208638+0000","last_became_peered":"2024-01-25T14:59:54.208638+0000","last_unstale":"2024-01-25T14:59:55.683147+0000","last_undegraded":"2024-01-25T14:59:55.683147+0000","last_fullsized":"2024-01-25T14:59:55.683147+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:56.001501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:58.048447+0000","last_change":"2024-01-25T14:59:53.207659+0000","last_active":"2024-01-25T14:59:58.048447+0000","last_peered":"2024-01-25T14:59:58.048447+0000","last_clean":"2024-01-25T14:59:58.048447+0000","last_became_active":"2024-01-25T14:59:53.207373+0000","last_became_peered":"2024-01-25T14:59:53.207373+0000","last_unstale":"2024-01-25T14:59:58.048447+0000","last_undegraded":"2024-01-25T14:59:58.048447+0000","last_fullsized":"2024-01-25T14:59:58.048447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:02:18.884192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.682936+0000","last_change":"2024-01-25T14:59:54.210415+0000","last_active":"2024-01-25T14:59:55.682936+0000","last_peered":"2024-01-25T14:59:55.682936+0000","last_clean":"2024-01-25T14:59:55.682936+0000","last_became_active":"2024-01-25T14:59:54.210097+0000","last_became_peered":"2024-01-25T14:59:54.210097+0000","last_unstale":"2024-01-25T14:59:55.682936+0000","last_undegraded":"2024-01-25T14:59:55.682936+0000","last_fullsized":"2024-01-25T14:59:55.682936+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:43:18.764375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.202897+0000","last_change":"2024-01-25T14:59:53.203526+0000","last_active":"2024-01-25T14:59:55.202897+0000","last_peered":"2024-01-25T14:59:55.202897+0000","last_clean":"2024-01-25T14:59:55.202897+0000","last_became_active":"2024-01-25T14:59:53.203223+0000","last_became_peered":"2024-01-25T14:59:53.203223+0000","last_unstale":"2024-01-25T14:59:55.202897+0000","last_undegraded":"2024-01-25T14:59:55.202897+0000","last_fullsized":"2024-01-25T14:59:55.202897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:35:06.014547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.683136+0000","last_change":"2024-01-25T14:59:54.219053+0000","last_active":"2024-01-25T14:59:55.683136+0000","last_peered":"2024-01-25T14:59:55.683136+0000","last_clean":"2024-01-25T14:59:55.683136+0000","last_became_active":"2024-01-25T14:59:54.218733+0000","last_became_peered":"2024-01-25T14:59:54.218733+0000","last_unstale":"2024-01-25T14:59:55.683136+0000","last_undegraded":"2024-01-25T14:59:55.683136+0000","last_fullsized":"2024-01-25T14:59:55.683136+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:07:19.083352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223302+0000","last_change":"2024-01-25T14:59:54.210644+0000","last_active":"2024-01-25T14:59:56.223302+0000","last_peered":"2024-01-25T14:59:56.223302+0000","last_clean":"2024-01-25T14:59:56.223302+0000","last_became_active":"2024-01-25T14:59:54.210333+0000","last_became_peered":"2024-01-25T14:59:54.210333+0000","last_unstale":"2024-01-25T14:59:56.223302+0000","last_undegraded":"2024-01-25T14:59:56.223302+0000","last_fullsized":"2024-01-25T14:59:56.223302+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:25:06.201952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.203840+0000","last_change":"2024-01-25T14:59:54.218398+0000","last_active":"2024-01-25T14:59:55.203840+0000","last_peered":"2024-01-25T14:59:55.203840+0000","last_clean":"2024-01-25T14:59:55.203840+0000","last_became_active":"2024-01-25T14:59:54.217918+0000","last_became_peered":"2024-01-25T14:59:54.217918+0000","last_unstale":"2024-01-25T14:59:55.203840+0000","last_undegraded":"2024-01-25T14:59:55.203840+0000","last_fullsized":"2024-01-25T14:59:55.203840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:44:01.699125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.204008+0000","last_change":"2024-01-25T14:59:54.218260+0000","last_active":"2024-01-25T14:59:55.204008+0000","last_peered":"2024-01-25T14:59:55.204008+0000","last_clean":"2024-01-25T14:59:55.204008+0000","last_became_active":"2024-01-25T14:59:54.217381+0000","last_became_peered":"2024-01-25T14:59:54.217381+0000","last_unstale":"2024-01-25T14:59:55.204008+0000","last_undegraded":"2024-01-25T14:59:55.204008+0000","last_fullsized":"2024-01-25T14:59:55.204008+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:36:09.631749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788324+0000","last_change":"2024-01-25T14:59:54.224518+0000","last_active":"2024-01-25T14:59:55.788324+0000","last_peered":"2024-01-25T14:59:55.788324+0000","last_clean":"2024-01-25T14:59:55.788324+0000","last_became_active":"2024-01-25T14:59:54.224210+0000","last_became_peered":"2024-01-25T14:59:54.224210+0000","last_unstale":"2024-01-25T14:59:55.788324+0000","last_undegraded":"2024-01-25T14:59:55.788324+0000","last_fullsized":"2024-01-25T14:59:55.788324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:33:56.670077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.202988+0000","last_change":"2024-01-25T14:59:54.215681+0000","last_active":"2024-01-25T14:59:55.202988+0000","last_peered":"2024-01-25T14:59:55.202988+0000","last_clean":"2024-01-25T14:59:55.202988+0000","last_became_active":"2024-01-25T14:59:54.215350+0000","last_became_peered":"2024-01-25T14:59:54.215350+0000","last_unstale":"2024-01-25T14:59:55.202988+0000","last_undegraded":"2024-01-25T14:59:55.202988+0000","last_fullsized":"2024-01-25T14:59:55.202988+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:27:50.002224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223277+0000","last_change":"2024-01-25T14:59:54.217690+0000","last_active":"2024-01-25T14:59:56.223277+0000","last_peered":"2024-01-25T14:59:56.223277+0000","last_clean":"2024-01-25T14:59:56.223277+0000","last_became_active":"2024-01-25T14:59:54.217361+0000","last_became_peered":"2024-01-25T14:59:54.217361+0000","last_unstale":"2024-01-25T14:59:56.223277+0000","last_undegraded":"2024-01-25T14:59:56.223277+0000","last_fullsized":"2024-01-25T14:59:56.223277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:30:15.893502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.204359+0000","last_change":"2024-01-25T14:59:54.205201+0000","last_active":"2024-01-25T14:59:55.204359+0000","last_peered":"2024-01-25T14:59:55.204359+0000","last_clean":"2024-01-25T14:59:55.204359+0000","last_became_active":"2024-01-25T14:59:54.204893+0000","last_became_peered":"2024-01-25T14:59:54.204893+0000","last_unstale":"2024-01-25T14:59:55.204359+0000","last_undegraded":"2024-01-25T14:59:55.204359+0000","last_fullsized":"2024-01-25T14:59:55.204359+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:35:43.147029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.212300+0000","last_change":"2024-01-25T14:59:54.210681+0000","last_active":"2024-01-25T14:59:54.212300+0000","last_peered":"2024-01-25T14:59:54.212300+0000","last_clean":"2024-01-25T14:59:54.212300+0000","last_became_active":"2024-01-25T14:59:54.210347+0000","last_became_peered":"2024-01-25T14:59:54.210347+0000","last_unstale":"2024-01-25T14:59:54.212300+0000","last_undegraded":"2024-01-25T14:59:54.212300+0000","last_fullsized":"2024-01-25T14:59:54.212300+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:55:16.435362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.093327+0000","last_change":"2024-01-25T14:59:54.210792+0000","last_active":"2024-01-25T14:59:56.093327+0000","last_peered":"2024-01-25T14:59:56.093327+0000","last_clean":"2024-01-25T14:59:56.093327+0000","last_became_active":"2024-01-25T14:59:54.210416+0000","last_became_peered":"2024-01-25T14:59:54.210416+0000","last_unstale":"2024-01-25T14:59:56.093327+0000","last_undegraded":"2024-01-25T14:59:56.093327+0000","last_fullsized":"2024-01-25T14:59:56.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:45.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.205654+0000","last_change":"2024-01-25T14:59:54.204547+0000","last_active":"2024-01-25T14:59:54.205654+0000","last_peered":"2024-01-25T14:59:54.205654+0000","last_clean":"2024-01-25T14:59:54.205654+0000","last_became_active":"2024-01-25T14:59:54.204215+0000","last_became_peered":"2024-01-25T14:59:54.204215+0000","last_unstale":"2024-01-25T14:59:54.205654+0000","last_undegraded":"2024-01-25T14:59:54.205654+0000","last_fullsized":"2024-01-25T14:59:54.205654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:42:27.300849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221781+0000","last_change":"2024-01-25T14:59:54.211006+0000","last_active":"2024-01-25T14:59:56.221781+0000","last_peered":"2024-01-25T14:59:56.221781+0000","last_clean":"2024-01-25T14:59:56.221781+0000","last_became_active":"2024-01-25T14:59:54.210568+0000","last_became_peered":"2024-01-25T14:59:54.210568+0000","last_unstale":"2024-01-25T14:59:56.221781+0000","last_undegraded":"2024-01-25T14:59:56.221781+0000","last_fullsized":"2024-01-25T14:59:56.221781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:12:23.888827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.203133+0000","last_change":"2024-01-25T14:59:54.220485+0000","last_active":"2024-01-25T14:59:55.203133+0000","last_peered":"2024-01-25T14:59:55.203133+0000","last_clean":"2024-01-25T14:59:55.203133+0000","last_became_active":"2024-01-25T14:59:54.219547+0000","last_became_peered":"2024-01-25T14:59:54.219547+0000","last_unstale":"2024-01-25T14:59:55.203133+0000","last_undegraded":"2024-01-25T14:59:55.203133+0000","last_fullsized":"2024-01-25T14:59:55.203133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:43:49.858263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223117+0000","last_change":"2024-01-25T14:59:54.217605+0000","last_active":"2024-01-25T14:59:56.223117+0000","last_peered":"2024-01-25T14:59:56.223117+0000","last_clean":"2024-01-25T14:59:56.223117+0000","last_became_active":"2024-01-25T14:59:54.217295+0000","last_became_peered":"2024-01-25T14:59:54.217295+0000","last_unstale":"2024-01-25T14:59:56.223117+0000","last_undegraded":"2024-01-25T14:59:56.223117+0000","last_fullsized":"2024-01-25T14:59:56.223117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:27:59.846434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5578,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":130,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":19648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383694,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":925696,"data_stored":439274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":10,"up_from":72,"seq":309237645331,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1552384,"data_stored":1031640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.378},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.442}]},{"osd":5,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.753},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.45500000000000002}]},{"osd":8,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.70899999999999996}]},{"osd":9,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.63800000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":9,"up_from":67,"seq":287762808855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":438900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.437}]},{"osd":3,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.38}]},{"osd":7,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.77000000000000002}]},{"osd":8,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.496},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.58699999999999997}]},{"osd":10,"last update":"Thu Jan 25 14:59:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.78600000000000003}]}]},{"osd":8,"up_from":59,"seq":253403070492,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":925696,"data_stored":438708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.627,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66400000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.57999999999999996},"min":{"1min":0.38200000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77700000000000002,"5min":1.008,"15min":1.008},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76300000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.436,"15min":0.44500000000000001},"min":{"1min":0.29099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57799999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60899999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.439}]},{"osd":3,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.38800000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65600000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.65000000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78500000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77400000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.71199999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72499999999999998,"5min":1.028,"15min":1.028},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.625,"15min":0.64100000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.66800000000000004,"15min":0.68300000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.69699999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67700000000000005,"15min":0.68600000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.80800000000000005,"5min":1.04,"15min":1.04},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.69199999999999995,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89800000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76900000000000002}]},{"osd":9,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.85499999999999998}]},{"osd":10,"last update":"Thu Jan 25 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.876}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":7,"up_from":52,"seq":223338299426,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32680,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712472,"statfs":{"total":95995035648,"available":95961571328,"internally_reserved":0,"allocated":1540096,"data_stored":1031982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.53200000000000003,"15min":0.51900000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.39800000000000002},"min":{"1min":0.29199999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.496},{"interface":"front","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.45500000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68600000000000005,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.68700000000000006,"15min":0.64200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":6.508,"5min":6.508,"15min":6.508},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72299999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.47999999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78100000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.628,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.53000000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67300000000000004,"15min":0.66400000000000003},"min":{"1min":0.504,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.63700000000000001}]},{"osd":8,"last update":"Thu Jan 25 14:59:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68799999999999994,"15min":0.68300000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84399999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.748},{"interface":"front","average":{"1min":1.1200000000000001,"5min":0.78500000000000003,"15min":0.72899999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":6.5469999999999997,"5min":6.5469999999999997,"15min":6.5469999999999997},"last":0.77300000000000002}]},{"osd":9,"last update":"Thu Jan 25 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66400000000000003}]},{"osd":10,"last update":"Thu Jan 25 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.70399999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495655,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40396,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704756,"statfs":{"total":95995035648,"available":95953670144,"internally_reserved":0,"allocated":917504,"data_stored":438172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.38200000000000001,"15min":0.371},"min":{"1min":0.32400000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.379,"15min":0.36899999999999999},"min":{"1min":0.26200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 25 14:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.56799999999999995,"15min":0.55400000000000005},"min":{"1min":0.502,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.55100000000000005,"15min":0.54000000000000004},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jan 25 14:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.374}]},{"osd":3,"last update":"Thu Jan 25 14:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.436,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.47599999999999998,"15min":0.46500000000000002},"min":{"1min":0.32700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 25 14:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.45400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.48199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.69999999999999996}]},{"osd":5,"last update":"Thu Jan 25 14:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.45900000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.60999999999999999,"15min":0.59399999999999997},"min":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.437}]},{"osd":7,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68000000000000005,"15min":0.68799999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85199999999999998,"5min":1.04,"15min":1.04},"last":0.67300000000000004}]},{"osd":8,"last update":"Thu Jan 25 14:59:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80400000000000005,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.497,"5min":0.496,"15min":0.496},"max":{"1min":0.746,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.52700000000000002}]},{"osd":9,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.39500000000000002}]},{"osd":10,"last update":"Thu Jan 25 14:59:38 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.59999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":925696,"data_stored":439694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.498,"15min":0.47799999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.5,"15min":0.48399999999999999},"min":{"1min":0.39900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 25 14:59:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.53400000000000003,"15min":0.49099999999999999},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.54600000000000004,"15min":0.51000000000000001},"min":{"1min":0.42199999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 25 14:59:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.57799999999999996,"15min":0.53800000000000003},"min":{"1min":0.40799999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81599999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.56899999999999995,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80900000000000005,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 25 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.40000000000000002,"15min":0.38},"min":{"1min":0.33300000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.42399999999999999,"15min":0.39900000000000002},"min":{"1min":0.35499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.70299999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.5}]},{"osd":5,"last update":"Thu Jan 25 14:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59399999999999997,"15min":0.56999999999999995},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.59499999999999997,"15min":0.56000000000000005},"min":{"1min":0.51700000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jan 25 14:58:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.48499999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.46000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.874}]},{"osd":7,"last update":"Thu Jan 25 14:59:28 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58099999999999996,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.754},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.622},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.92200000000000004}]},{"osd":8,"last update":"Thu Jan 25 14:59:50 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.54100000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.76700000000000002}]},{"osd":9,"last update":"Thu Jan 25 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.94499999999999995}]},{"osd":10,"last update":"Thu Jan 25 14:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.85999999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":946176,"data_stored":440148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 14:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.504,"15min":0.48699999999999999},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77600000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.51500000000000001,"15min":0.505},"min":{"1min":0.373,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70199999999999996,"5min":0.748,"15min":0.748},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 25 14:59:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51100000000000001,"15min":0.502},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73999999999999999,"5min":0.748,"15min":0.748},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 25 14:58:52 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.41799999999999998,"15min":0.40200000000000002},"min":{"1min":0.28000000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.442,"15min":0.41699999999999998},"min":{"1min":0.31900000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 25 14:59:20 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.51700000000000002,"15min":0.502},"min":{"1min":0.33900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.72699999999999998,"5min":0.747,"15min":0.747},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 25 14:59:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.38900000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73899999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 25 14:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76000000000000001,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 25 14:59:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57699999999999996}]},{"osd":8,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67000000000000004,"15min":0.67200000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69599999999999995,"15min":0.70099999999999996},"min":{"1min":0.52200000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.78800000000000003}]},{"osd":9,"last update":"Thu Jan 25 14:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54500000000000004}]},{"osd":10,"last update":"Thu Jan 25 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.66200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":937984,"data_stored":440350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:33 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.307,"5min":0.246,"15min":0.246},"max":{"1min":0.67700000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.28599999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 25 14:59:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.503},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.504},"min":{"1min":0.42199999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 25 14:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56000000000000005,"15min":0.53000000000000003},"min":{"1min":0.39700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.76800000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.54400000000000004},"min":{"1min":0.34599999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 25 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.41299999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71799999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 25 14:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40899999999999997,"15min":0.39000000000000001},"min":{"1min":0.27100000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.66700000000000004,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.442,"15min":0.434},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.81899999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 25 14:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83799999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 25 14:59:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.76900000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67700000000000005,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.80500000000000005,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77500000000000002}]},{"osd":8,"last update":"Thu Jan 25 14:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.59599999999999997,"15min":0.60899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.94099999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70399999999999996}]},{"osd":9,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.752}]},{"osd":10,"last update":"Thu Jan 25 14:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.81999999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182452,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":429616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:53 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34599999999999997,"15min":0.33600000000000002},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.45600000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.36499999999999999,"15min":0.35399999999999998},"min":{"1min":0.30299999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48299999999999998,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 25 14:59:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52300000000000002,"15min":0.505},"min":{"1min":0.36699999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.52600000000000002,"15min":0.504},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 25 14:59:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78800000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.40300000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73499999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 25 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70399999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.623},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.48999999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 25 14:59:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56499999999999995,"15min":0.56000000000000005},"min":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76800000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.504},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.749,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Jan 25 14:59:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.47799999999999998,"15min":0.46899999999999997},"min":{"1min":0.36099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.499,"15min":0.47999999999999998},"min":{"1min":0.42899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 25 14:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82799999999999996,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68100000000000005}]},{"osd":8,"last update":"Thu Jan 25 14:59:53 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85899999999999999,"5min":0.872,"15min":0.872},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69599999999999995,"15min":0.69499999999999995},"min":{"1min":0.56799999999999995,"5min":0.5,"15min":0.5},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.61799999999999999}]},{"osd":9,"last update":"Thu Jan 25 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.442},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53700000000000003}]},{"osd":10,"last update":"Thu Jan 25 14:59:38 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.65500000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":4,"up_from":33,"seq":141733920816,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":429534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48599999999999999,"15min":0.47699999999999998},"min":{"1min":0.38100000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.82199999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 25 14:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.38700000000000001,"15min":0.38300000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50700000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39900000000000002,"15min":0.39500000000000002},"min":{"1min":0.27200000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jan 25 14:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.35799999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58599999999999997,"15min":0.56599999999999995},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84099999999999997,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jan 25 14:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.51800000000000002,"15min":0.5},"min":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.502},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54400000000000004,"15min":0.53800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 25 14:59:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.57899999999999996,"15min":0.56200000000000006},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 25 14:59:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.434,"5min":0.377,"15min":0.377},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.59999999999999998,"15min":0.58899999999999997},"min":{"1min":0.39500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83399999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.625}]},{"osd":7,"last update":"Thu Jan 25 14:59:25 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.55800000000000005,"15min":0.54300000000000004},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.53300000000000003,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.89200000000000002}]},{"osd":8,"last update":"Thu Jan 25 14:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.621,"15min":0.60699999999999998},"min":{"1min":0.49099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.505,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.93999999999999995}]},{"osd":9,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1,"5min":1,"15min":1},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.76400000000000001}]},{"osd":10,"last update":"Thu Jan 25 14:59:38 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.873}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757291,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32692,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712460,"statfs":{"total":95995035648,"available":95961559040,"internally_reserved":0,"allocated":1548288,"data_stored":1031078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.748,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.5}]},{"osd":1,"last update":"Thu Jan 25 14:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52800000000000002,"15min":0.51900000000000002},"min":{"1min":0.38600000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70199999999999996,"5min":0.748,"15min":0.748},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.39800000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.59799999999999998}]},{"osd":2,"last update":"Thu Jan 25 14:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39000000000000001},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67500000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.38},"min":{"1min":0.29099999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.628,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 25 14:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.749,"5min":0.873,"15min":0.873},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 25 14:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.45200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.68200000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Jan 25 14:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80200000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 25 14:59:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.627},"min":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79200000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.872},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.38,"5min":0.377,"15min":0.377},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.80900000000000005}]},{"osd":8,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.626},"min":{"1min":0.42699999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.57899999999999996}]},{"osd":9,"last update":"Thu Jan 25 14:59:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.66300000000000003}]},{"osd":10,"last update":"Thu Jan 25 14:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.75700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:00:01.406 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:00:01.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:01 smithi191 ceph-mon[36347]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:00:01.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:01 smithi191 ceph-mon[36347]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:00:01.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:01 smithi191 ceph-mon[36347]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:00:01.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:01 smithi191 ceph-mon[36347]: pgmap v287: 97 pgs: 97 active+clean; 582 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 6.3 KiB/s wr, 19 op/s 2024-01-25T15:00:01.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:01 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3198131929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:00:01.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:01 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/157957916' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:00:01.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.539+0000 7fd4742a6640 1 -- 172.21.15.170:0/1095179268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd46c100e00 msgr2=0x7fd46c101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:01.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.539+0000 7fd4742a6640 1 --2- 172.21.15.170:0/1095179268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd46c100e00 0x7fd46c101280 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd468009900 tx=0x7fd46802bc30 comp rx=0 tx=0).stop 2024-01-25T15:00:01.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.539+0000 7fd4742a6640 1 -- 172.21.15.170:0/1095179268 shutdown_connections 2024-01-25T15:00:01.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.539+0000 7fd4742a6640 1 --2- 172.21.15.170:0/1095179268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd46c1017c0 0x7fd46c108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.539+0000 7fd4742a6640 1 --2- 172.21.15.170:0/1095179268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd46c100e00 0x7fd46c101280 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.539+0000 7fd4742a6640 1 --2- 172.21.15.170:0/1095179268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd46c0ffc10 0x7fd46c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.539+0000 7fd4742a6640 1 -- 172.21.15.170:0/1095179268 >> 172.21.15.170:0/1095179268 conn(0x7fd46c0fb180 msgr2=0x7fd46c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:01.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.539+0000 7fd4742a6640 1 -- 172.21.15.170:0/1095179268 shutdown_connections 2024-01-25T15:00:01.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.539+0000 7fd4742a6640 1 -- 172.21.15.170:0/1095179268 wait complete. 2024-01-25T15:00:01.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.540+0000 7fd4742a6640 1 Processor -- start 2024-01-25T15:00:01.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.540+0000 7fd4742a6640 1 -- start start 2024-01-25T15:00:01.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.540+0000 7fd4742a6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd46c0ffc10 0x7fd46c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:01.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.540+0000 7fd4742a6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd46c100e00 0x7fd46c19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:01.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.540+0000 7fd4742a6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd46c1017c0 0x7fd46c19dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:01.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.540+0000 7fd4742a6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c19e7d0 con 0x7fd46c100e00 2024-01-25T15:00:01.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.540+0000 7fd4742a6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c19e940 con 0x7fd46c1017c0 2024-01-25T15:00:01.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.540+0000 7fd4742a6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c19eb00 con 0x7fd46c0ffc10 2024-01-25T15:00:01.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.540+0000 7fd471841640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd46c100e00 0x7fd46c19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:01.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.540+0000 7fd471841640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd46c100e00 0x7fd46c19b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54290/0 (socket says 172.21.15.170:54290) 2024-01-25T15:00:01.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.540+0000 7fd471841640 1 -- 172.21.15.170:0/1041830198 learned_addr learned my addr 172.21.15.170:0/1041830198 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:01.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.540+0000 7fd472042640 1 --2- 172.21.15.170:0/1041830198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd46c0ffc10 0x7fd46c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:01.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.540+0000 7fd472843640 1 --2- 172.21.15.170:0/1041830198 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd46c1017c0 0x7fd46c19dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:01.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.541+0000 7fd471841640 1 -- 172.21.15.170:0/1041830198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd46c0ffc10 msgr2=0x7fd46c0689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:01.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.541+0000 7fd471841640 1 --2- 172.21.15.170:0/1041830198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd46c0ffc10 0x7fd46c0689c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.541+0000 7fd471841640 1 -- 172.21.15.170:0/1041830198 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd46c1017c0 msgr2=0x7fd46c19dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:01.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.541+0000 7fd471841640 1 --2- 172.21.15.170:0/1041830198 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd46c1017c0 0x7fd46c19dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.541+0000 7fd471841640 1 -- 172.21.15.170:0/1041830198 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd468009560 con 0x7fd46c100e00 2024-01-25T15:00:01.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.541+0000 7fd471841640 1 --2- 172.21.15.170:0/1041830198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd46c100e00 0x7fd46c19b9d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd468009230 tx=0x7fd468004ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:01.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.541+0000 7fd4637fe640 1 -- 172.21.15.170:0/1041830198 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd468004350 con 0x7fd46c100e00 2024-01-25T15:00:01.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.541+0000 7fd4637fe640 1 -- 172.21.15.170:0/1041830198 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4680044b0 con 0x7fd46c100e00 2024-01-25T15:00:01.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.541+0000 7fd4637fe640 1 -- 172.21.15.170:0/1041830198 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd468003e10 con 0x7fd46c100e00 2024-01-25T15:00:01.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.541+0000 7fd4742a6640 1 -- 172.21.15.170:0/1041830198 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46c19ed20 con 0x7fd46c100e00 2024-01-25T15:00:01.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.541+0000 7fd4742a6640 1 -- 172.21.15.170:0/1041830198 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46c19f180 con 0x7fd46c100e00 2024-01-25T15:00:01.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.542+0000 7fd4742a6640 1 -- 172.21.15.170:0/1041830198 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46c106f30 con 0x7fd46c100e00 2024-01-25T15:00:01.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.543+0000 7fd4637fe640 1 -- 172.21.15.170:0/1041830198 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fd468005000 con 0x7fd46c100e00 2024-01-25T15:00:01.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.543+0000 7fd4637fe640 1 --2- 172.21.15.170:0/1041830198 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd4580a1370 0x7fd4580a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:01.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.543+0000 7fd472042640 1 --2- 172.21.15.170:0/1041830198 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd4580a1370 0x7fd4580a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:01.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.543+0000 7fd4637fe640 1 -- 172.21.15.170:0/1041830198 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd4680ef320 con 0x7fd46c100e00 2024-01-25T15:00:01.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.544+0000 7fd472042640 1 --2- 172.21.15.170:0/1041830198 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd4580a1370 0x7fd4580a3830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd46c100c60 tx=0x7fd45c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:01.554 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.548+0000 7fd4637fe640 1 -- 172.21.15.170:0/1041830198 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fd4680b8900 con 0x7fd46c100e00 2024-01-25T15:00:01.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:01 smithi186 ceph-mon[35697]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:00:01.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:01 smithi186 ceph-mon[35697]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:00:01.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:01 smithi186 ceph-mon[35697]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:00:01.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:01 smithi186 ceph-mon[35697]: pgmap v287: 97 pgs: 97 active+clean; 582 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 6.3 KiB/s wr, 19 op/s 2024-01-25T15:00:01.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:01 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3198131929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:00:01.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:01 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/157957916' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:00:01.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.716+0000 7fd4742a6640 1 -- 172.21.15.170:0/1041830198 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd46c02cc60 con 0x7fd4580a1370 2024-01-25T15:00:01.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.726+0000 7fd4637fe640 1 -- 172.21.15.170:0/1041830198 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336803 (secure 0 0 0) 0x7fd46c02cc60 con 0x7fd4580a1370 2024-01-25T15:00:01.731 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:00:01.732 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2024-01-25T15:00:01.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.729+0000 7fd4742a6640 1 -- 172.21.15.170:0/1041830198 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd4580a1370 msgr2=0x7fd4580a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:01.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.729+0000 7fd4742a6640 1 --2- 172.21.15.170:0/1041830198 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd4580a1370 0x7fd4580a3830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd46c100c60 tx=0x7fd45c005f90 comp rx=0 tx=0).stop 2024-01-25T15:00:01.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.729+0000 7fd4742a6640 1 -- 172.21.15.170:0/1041830198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd46c100e00 msgr2=0x7fd46c19b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:01.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.729+0000 7fd4742a6640 1 --2- 172.21.15.170:0/1041830198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd46c100e00 0x7fd46c19b9d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd468009230 tx=0x7fd468004ec0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.729+0000 7fd4742a6640 1 -- 172.21.15.170:0/1041830198 shutdown_connections 2024-01-25T15:00:01.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.730+0000 7fd4742a6640 1 --2- 172.21.15.170:0/1041830198 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd4580a1370 0x7fd4580a3830 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.730+0000 7fd4742a6640 1 --2- 172.21.15.170:0/1041830198 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd46c1017c0 0x7fd46c19dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.730+0000 7fd4742a6640 1 --2- 172.21.15.170:0/1041830198 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd46c100e00 0x7fd46c19b9d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.730+0000 7fd4742a6640 1 --2- 172.21.15.170:0/1041830198 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd46c0ffc10 0x7fd46c0689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:01.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.730+0000 7fd4742a6640 1 -- 172.21.15.170:0/1041830198 >> 172.21.15.170:0/1041830198 conn(0x7fd46c0fb180 msgr2=0x7fd46c104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:01.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.730+0000 7fd4742a6640 1 -- 172.21.15.170:0/1041830198 shutdown_connections 2024-01-25T15:00:01.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:01.730+0000 7fd4742a6640 1 -- 172.21.15.170:0/1041830198 wait complete. 2024-01-25T15:00:01.741 INFO:teuthology.orchestra.run.smithi170.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-01-25T15:00:00.192089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595946,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":135,"num_read_kb":116,"num_write":311,"num_write_kb":2982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":253,"ondisk_log_size":253,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":266,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390984,"kb_used_data":12664,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550840,"statfs":{"total":1151940427776,"available":1151540060160,"internally_reserved":0,"allocated":12967936,"data_stored":7029096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":387233084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5578,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":130,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.004599"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223530+0000","last_change":"2024-01-25T14:59:54.219084+0000","last_active":"2024-01-25T14:59:56.223530+0000","last_peered":"2024-01-25T14:59:56.223530+0000","last_clean":"2024-01-25T14:59:56.223530+0000","last_became_active":"2024-01-25T14:59:54.218780+0000","last_became_peered":"2024-01-25T14:59:54.218780+0000","last_unstale":"2024-01-25T14:59:56.223530+0000","last_undegraded":"2024-01-25T14:59:56.223530+0000","last_fullsized":"2024-01-25T14:59:56.223530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:05:50.441934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788549+0000","last_change":"2024-01-25T14:59:54.219130+0000","last_active":"2024-01-25T14:59:55.788549+0000","last_peered":"2024-01-25T14:59:55.788549+0000","last_clean":"2024-01-25T14:59:55.788549+0000","last_became_active":"2024-01-25T14:59:54.218744+0000","last_became_peered":"2024-01-25T14:59:54.218744+0000","last_unstale":"2024-01-25T14:59:55.788549+0000","last_undegraded":"2024-01-25T14:59:55.788549+0000","last_fullsized":"2024-01-25T14:59:55.788549+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:59:35.424110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788391+0000","last_change":"2024-01-25T14:59:54.218870+0000","last_active":"2024-01-25T14:59:55.788391+0000","last_peered":"2024-01-25T14:59:55.788391+0000","last_clean":"2024-01-25T14:59:55.788391+0000","last_became_active":"2024-01-25T14:59:54.218522+0000","last_became_peered":"2024-01-25T14:59:54.218522+0000","last_unstale":"2024-01-25T14:59:55.788391+0000","last_undegraded":"2024-01-25T14:59:55.788391+0000","last_fullsized":"2024-01-25T14:59:55.788391+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:00:05.038437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.222536+0000","last_change":"2024-01-25T14:59:54.218436+0000","last_active":"2024-01-25T14:59:56.222536+0000","last_peered":"2024-01-25T14:59:56.222536+0000","last_clean":"2024-01-25T14:59:56.222536+0000","last_became_active":"2024-01-25T14:59:54.217232+0000","last_became_peered":"2024-01-25T14:59:54.217232+0000","last_unstale":"2024-01-25T14:59:56.222536+0000","last_undegraded":"2024-01-25T14:59:56.222536+0000","last_fullsized":"2024-01-25T14:59:56.222536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:24:14.642794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220398+0000","last_change":"2024-01-25T14:59:54.219094+0000","last_active":"2024-01-25T14:59:56.220398+0000","last_peered":"2024-01-25T14:59:56.220398+0000","last_clean":"2024-01-25T14:59:56.220398+0000","last_became_active":"2024-01-25T14:59:54.218778+0000","last_became_peered":"2024-01-25T14:59:54.218778+0000","last_unstale":"2024-01-25T14:59:56.220398+0000","last_undegraded":"2024-01-25T14:59:56.220398+0000","last_fullsized":"2024-01-25T14:59:56.220398+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:21.754098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.205085+0000","last_change":"2024-01-25T14:59:54.213243+0000","last_active":"2024-01-25T14:59:55.205085+0000","last_peered":"2024-01-25T14:59:55.205085+0000","last_clean":"2024-01-25T14:59:55.205085+0000","last_became_active":"2024-01-25T14:59:54.212891+0000","last_became_peered":"2024-01-25T14:59:54.212891+0000","last_unstale":"2024-01-25T14:59:55.205085+0000","last_undegraded":"2024-01-25T14:59:55.205085+0000","last_fullsized":"2024-01-25T14:59:55.205085+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:52:45.505016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.682570+0000","last_change":"2024-01-25T14:59:54.211851+0000","last_active":"2024-01-25T14:59:55.682570+0000","last_peered":"2024-01-25T14:59:55.682570+0000","last_clean":"2024-01-25T14:59:55.682570+0000","last_became_active":"2024-01-25T14:59:54.211298+0000","last_became_peered":"2024-01-25T14:59:54.211298+0000","last_unstale":"2024-01-25T14:59:55.682570+0000","last_undegraded":"2024-01-25T14:59:55.682570+0000","last_fullsized":"2024-01-25T14:59:55.682570+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:05:36.636283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.219038+0000","last_change":"2024-01-25T14:59:54.217675+0000","last_active":"2024-01-25T14:59:54.219038+0000","last_peered":"2024-01-25T14:59:54.219038+0000","last_clean":"2024-01-25T14:59:54.219038+0000","last_became_active":"2024-01-25T14:59:54.217329+0000","last_became_peered":"2024-01-25T14:59:54.217329+0000","last_unstale":"2024-01-25T14:59:54.219038+0000","last_undegraded":"2024-01-25T14:59:54.219038+0000","last_fullsized":"2024-01-25T14:59:54.219038+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:47:50.471866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.222333+0000","last_change":"2024-01-25T14:59:54.213030+0000","last_active":"2024-01-25T14:59:56.222333+0000","last_peered":"2024-01-25T14:59:56.222333+0000","last_clean":"2024-01-25T14:59:56.222333+0000","last_became_active":"2024-01-25T14:59:54.212687+0000","last_became_peered":"2024-01-25T14:59:54.212687+0000","last_unstale":"2024-01-25T14:59:56.222333+0000","last_undegraded":"2024-01-25T14:59:56.222333+0000","last_fullsized":"2024-01-25T14:59:56.222333+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:47:29.562996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.205301+0000","last_change":"2024-01-25T14:59:54.215372+0000","last_active":"2024-01-25T14:59:55.205301+0000","last_peered":"2024-01-25T14:59:55.205301+0000","last_clean":"2024-01-25T14:59:55.205301+0000","last_became_active":"2024-01-25T14:59:54.214432+0000","last_became_peered":"2024-01-25T14:59:54.214432+0000","last_unstale":"2024-01-25T14:59:55.205301+0000","last_undegraded":"2024-01-25T14:59:55.205301+0000","last_fullsized":"2024-01-25T14:59:55.205301+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:46:40.966009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.683045+0000","last_change":"2024-01-25T14:59:54.216252+0000","last_active":"2024-01-25T14:59:55.683045+0000","last_peered":"2024-01-25T14:59:55.683045+0000","last_clean":"2024-01-25T14:59:55.683045+0000","last_became_active":"2024-01-25T14:59:54.215892+0000","last_became_peered":"2024-01-25T14:59:54.215892+0000","last_unstale":"2024-01-25T14:59:55.683045+0000","last_undegraded":"2024-01-25T14:59:55.683045+0000","last_fullsized":"2024-01-25T14:59:55.683045+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:53:27.135926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220261+0000","last_change":"2024-01-25T14:59:54.221212+0000","last_active":"2024-01-25T14:59:56.220261+0000","last_peered":"2024-01-25T14:59:56.220261+0000","last_clean":"2024-01-25T14:59:56.220261+0000","last_became_active":"2024-01-25T14:59:54.220516+0000","last_became_peered":"2024-01-25T14:59:54.220516+0000","last_unstale":"2024-01-25T14:59:56.220261+0000","last_undegraded":"2024-01-25T14:59:56.220261+0000","last_fullsized":"2024-01-25T14:59:56.220261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:00:57.398457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.203198+0000","last_change":"2024-01-25T14:59:54.204088+0000","last_active":"2024-01-25T14:59:55.203198+0000","last_peered":"2024-01-25T14:59:55.203198+0000","last_clean":"2024-01-25T14:59:55.203198+0000","last_became_active":"2024-01-25T14:59:54.202895+0000","last_became_peered":"2024-01-25T14:59:54.202895+0000","last_unstale":"2024-01-25T14:59:55.203198+0000","last_undegraded":"2024-01-25T14:59:55.203198+0000","last_fullsized":"2024-01-25T14:59:55.203198+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:15:37.693577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788231+0000","last_change":"2024-01-25T14:59:54.226108+0000","last_active":"2024-01-25T14:59:55.788231+0000","last_peered":"2024-01-25T14:59:55.788231+0000","last_clean":"2024-01-25T14:59:55.788231+0000","last_became_active":"2024-01-25T14:59:54.225830+0000","last_became_peered":"2024-01-25T14:59:54.225830+0000","last_unstale":"2024-01-25T14:59:55.788231+0000","last_undegraded":"2024-01-25T14:59:55.788231+0000","last_fullsized":"2024-01-25T14:59:55.788231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:10:22.580434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788223+0000","last_change":"2024-01-25T14:59:54.224893+0000","last_active":"2024-01-25T14:59:55.788223+0000","last_peered":"2024-01-25T14:59:55.788223+0000","last_clean":"2024-01-25T14:59:55.788223+0000","last_became_active":"2024-01-25T14:59:54.224583+0000","last_became_peered":"2024-01-25T14:59:54.224583+0000","last_unstale":"2024-01-25T14:59:55.788223+0000","last_undegraded":"2024-01-25T14:59:55.788223+0000","last_fullsized":"2024-01-25T14:59:55.788223+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:48:25.538489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221392+0000","last_change":"2024-01-25T14:59:54.217030+0000","last_active":"2024-01-25T14:59:56.221392+0000","last_peered":"2024-01-25T14:59:56.221392+0000","last_clean":"2024-01-25T14:59:56.221392+0000","last_became_active":"2024-01-25T14:59:54.216732+0000","last_became_peered":"2024-01-25T14:59:54.216732+0000","last_unstale":"2024-01-25T14:59:56.221392+0000","last_undegraded":"2024-01-25T14:59:56.221392+0000","last_fullsized":"2024-01-25T14:59:56.221392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:58:36.072464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223868+0000","last_change":"2024-01-25T14:59:54.223924+0000","last_active":"2024-01-25T14:59:56.223868+0000","last_peered":"2024-01-25T14:59:56.223868+0000","last_clean":"2024-01-25T14:59:56.223868+0000","last_became_active":"2024-01-25T14:59:54.223556+0000","last_became_peered":"2024-01-25T14:59:54.223556+0000","last_unstale":"2024-01-25T14:59:56.223868+0000","last_undegraded":"2024-01-25T14:59:56.223868+0000","last_fullsized":"2024-01-25T14:59:56.223868+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:54:18.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221521+0000","last_change":"2024-01-25T14:59:54.207125+0000","last_active":"2024-01-25T14:59:56.221521+0000","last_peered":"2024-01-25T14:59:56.221521+0000","last_clean":"2024-01-25T14:59:56.221521+0000","last_became_active":"2024-01-25T14:59:54.206630+0000","last_became_peered":"2024-01-25T14:59:54.206630+0000","last_unstale":"2024-01-25T14:59:56.221521+0000","last_undegraded":"2024-01-25T14:59:56.221521+0000","last_fullsized":"2024-01-25T14:59:56.221521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:10:12.685185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.204093+0000","last_change":"2024-01-25T14:59:54.210732+0000","last_active":"2024-01-25T14:59:55.204093+0000","last_peered":"2024-01-25T14:59:55.204093+0000","last_clean":"2024-01-25T14:59:55.204093+0000","last_became_active":"2024-01-25T14:59:54.210417+0000","last_became_peered":"2024-01-25T14:59:54.210417+0000","last_unstale":"2024-01-25T14:59:55.204093+0000","last_undegraded":"2024-01-25T14:59:55.204093+0000","last_fullsized":"2024-01-25T14:59:55.204093+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:05:22.305485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'11","reported_seq":27,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:58.049133+0000","last_change":"2024-01-25T14:59:53.204680+0000","last_active":"2024-01-25T14:59:58.049133+0000","last_peered":"2024-01-25T14:59:58.049133+0000","last_clean":"2024-01-25T14:59:58.049133+0000","last_became_active":"2024-01-25T14:59:53.204327+0000","last_became_peered":"2024-01-25T14:59:53.204327+0000","last_unstale":"2024-01-25T14:59:58.049133+0000","last_undegraded":"2024-01-25T14:59:58.049133+0000","last_fullsized":"2024-01-25T14:59:58.049133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:32:16.333425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.220880+0000","last_change":"2024-01-25T14:59:54.220501+0000","last_active":"2024-01-25T14:59:54.220880+0000","last_peered":"2024-01-25T14:59:54.220880+0000","last_clean":"2024-01-25T14:59:54.220880+0000","last_became_active":"2024-01-25T14:59:54.217150+0000","last_became_peered":"2024-01-25T14:59:54.217150+0000","last_unstale":"2024-01-25T14:59:54.220880+0000","last_undegraded":"2024-01-25T14:59:54.220880+0000","last_fullsized":"2024-01-25T14:59:54.220880+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:46:43.127499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.225398+0000","last_change":"2024-01-25T14:59:53.209110+0000","last_active":"2024-01-25T14:59:54.225398+0000","last_peered":"2024-01-25T14:59:54.225398+0000","last_clean":"2024-01-25T14:59:54.225398+0000","last_became_active":"2024-01-25T14:59:53.208794+0000","last_became_peered":"2024-01-25T14:59:53.208794+0000","last_unstale":"2024-01-25T14:59:54.225398+0000","last_undegraded":"2024-01-25T14:59:54.225398+0000","last_fullsized":"2024-01-25T14:59:54.225398+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:51:40.757062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788614+0000","last_change":"2024-01-25T14:59:54.219303+0000","last_active":"2024-01-25T14:59:55.788614+0000","last_peered":"2024-01-25T14:59:55.788614+0000","last_clean":"2024-01-25T14:59:55.788614+0000","last_became_active":"2024-01-25T14:59:54.218814+0000","last_became_peered":"2024-01-25T14:59:54.218814+0000","last_unstale":"2024-01-25T14:59:55.788614+0000","last_undegraded":"2024-01-25T14:59:55.788614+0000","last_fullsized":"2024-01-25T14:59:55.788614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:54:30.556998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:57.227840+0000","last_change":"2024-01-25T14:59:53.209770+0000","last_active":"2024-01-25T14:59:57.227840+0000","last_peered":"2024-01-25T14:59:57.227840+0000","last_clean":"2024-01-25T14:59:57.227840+0000","last_became_active":"2024-01-25T14:59:53.209466+0000","last_became_peered":"2024-01-25T14:59:53.209466+0000","last_unstale":"2024-01-25T14:59:57.227840+0000","last_undegraded":"2024-01-25T14:59:57.227840+0000","last_fullsized":"2024-01-25T14:59:57.227840+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:58:11.391155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221547+0000","last_change":"2024-01-25T14:59:54.201559+0000","last_active":"2024-01-25T14:59:56.221547+0000","last_peered":"2024-01-25T14:59:56.221547+0000","last_clean":"2024-01-25T14:59:56.221547+0000","last_became_active":"2024-01-25T14:59:54.201155+0000","last_became_peered":"2024-01-25T14:59:54.201155+0000","last_unstale":"2024-01-25T14:59:56.221547+0000","last_undegraded":"2024-01-25T14:59:56.221547+0000","last_fullsized":"2024-01-25T14:59:56.221547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:29:15.444879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220993+0000","last_change":"2024-01-25T14:59:53.208457+0000","last_active":"2024-01-25T14:59:56.220993+0000","last_peered":"2024-01-25T14:59:56.220993+0000","last_clean":"2024-01-25T14:59:56.220993+0000","last_became_active":"2024-01-25T14:59:53.208166+0000","last_became_peered":"2024-01-25T14:59:53.208166+0000","last_unstale":"2024-01-25T14:59:56.220993+0000","last_undegraded":"2024-01-25T14:59:56.220993+0000","last_fullsized":"2024-01-25T14:59:56.220993+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:29:22.580726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.093875+0000","last_change":"2024-01-25T14:59:54.212126+0000","last_active":"2024-01-25T14:59:56.093875+0000","last_peered":"2024-01-25T14:59:56.093875+0000","last_clean":"2024-01-25T14:59:56.093875+0000","last_became_active":"2024-01-25T14:59:54.211519+0000","last_became_peered":"2024-01-25T14:59:54.211519+0000","last_unstale":"2024-01-25T14:59:56.093875+0000","last_undegraded":"2024-01-25T14:59:56.093875+0000","last_fullsized":"2024-01-25T14:59:56.093875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:50:59.743852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:59.042162+0000","last_change":"2024-01-25T14:59:53.201803+0000","last_active":"2024-01-25T14:59:59.042162+0000","last_peered":"2024-01-25T14:59:59.042162+0000","last_clean":"2024-01-25T14:59:59.042162+0000","last_became_active":"2024-01-25T14:59:53.201464+0000","last_became_peered":"2024-01-25T14:59:53.201464+0000","last_unstale":"2024-01-25T14:59:59.042162+0000","last_undegraded":"2024-01-25T14:59:59.042162+0000","last_fullsized":"2024-01-25T14:59:59.042162+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:36:03.922038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220692+0000","last_change":"2024-01-25T14:59:54.207126+0000","last_active":"2024-01-25T14:59:56.220692+0000","last_peered":"2024-01-25T14:59:56.220692+0000","last_clean":"2024-01-25T14:59:56.220692+0000","last_became_active":"2024-01-25T14:59:54.206826+0000","last_became_peered":"2024-01-25T14:59:54.206826+0000","last_unstale":"2024-01-25T14:59:56.220692+0000","last_undegraded":"2024-01-25T14:59:56.220692+0000","last_fullsized":"2024-01-25T14:59:56.220692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:45:07.217919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:57.227608+0000","last_change":"2024-01-25T14:59:53.200335+0000","last_active":"2024-01-25T14:59:57.227608+0000","last_peered":"2024-01-25T14:59:57.227608+0000","last_clean":"2024-01-25T14:59:57.227608+0000","last_became_active":"2024-01-25T14:59:53.200028+0000","last_became_peered":"2024-01-25T14:59:53.200028+0000","last_unstale":"2024-01-25T14:59:57.227608+0000","last_undegraded":"2024-01-25T14:59:57.227608+0000","last_fullsized":"2024-01-25T14:59:57.227608+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:23:26.178260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.093652+0000","last_change":"2024-01-25T14:59:54.211048+0000","last_active":"2024-01-25T14:59:56.093652+0000","last_peered":"2024-01-25T14:59:56.093652+0000","last_clean":"2024-01-25T14:59:56.093652+0000","last_became_active":"2024-01-25T14:59:54.210724+0000","last_became_peered":"2024-01-25T14:59:54.210724+0000","last_unstale":"2024-01-25T14:59:56.093652+0000","last_undegraded":"2024-01-25T14:59:56.093652+0000","last_fullsized":"2024-01-25T14:59:56.093652+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:59:40.171707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:57.229151+0000","last_change":"2024-01-25T14:59:53.202235+0000","last_active":"2024-01-25T14:59:57.229151+0000","last_peered":"2024-01-25T14:59:57.229151+0000","last_clean":"2024-01-25T14:59:57.229151+0000","last_became_active":"2024-01-25T14:59:53.201933+0000","last_became_peered":"2024-01-25T14:59:53.201933+0000","last_unstale":"2024-01-25T14:59:57.229151+0000","last_undegraded":"2024-01-25T14:59:57.229151+0000","last_fullsized":"2024-01-25T14:59:57.229151+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:40:23.725903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.205699+0000","last_change":"2024-01-25T14:59:54.205184+0000","last_active":"2024-01-25T14:59:54.205699+0000","last_peered":"2024-01-25T14:59:54.205699+0000","last_clean":"2024-01-25T14:59:54.205699+0000","last_became_active":"2024-01-25T14:59:54.204865+0000","last_became_peered":"2024-01-25T14:59:54.204865+0000","last_unstale":"2024-01-25T14:59:54.205699+0000","last_undegraded":"2024-01-25T14:59:54.205699+0000","last_fullsized":"2024-01-25T14:59:54.205699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:03:18.634359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:58.049061+0000","last_change":"2024-01-25T14:59:53.205021+0000","last_active":"2024-01-25T14:59:58.049061+0000","last_peered":"2024-01-25T14:59:58.049061+0000","last_clean":"2024-01-25T14:59:58.049061+0000","last_became_active":"2024-01-25T14:59:53.203925+0000","last_became_peered":"2024-01-25T14:59:53.203925+0000","last_unstale":"2024-01-25T14:59:58.049061+0000","last_undegraded":"2024-01-25T14:59:58.049061+0000","last_fullsized":"2024-01-25T14:59:58.049061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:20:43.003659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221149+0000","last_change":"2024-01-25T14:59:54.207234+0000","last_active":"2024-01-25T14:59:56.221149+0000","last_peered":"2024-01-25T14:59:56.221149+0000","last_clean":"2024-01-25T14:59:56.221149+0000","last_became_active":"2024-01-25T14:59:54.206727+0000","last_became_peered":"2024-01-25T14:59:54.206727+0000","last_unstale":"2024-01-25T14:59:56.221149+0000","last_undegraded":"2024-01-25T14:59:56.221149+0000","last_fullsized":"2024-01-25T14:59:56.221149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:29:08.678821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.222812+0000","last_change":"2024-01-25T14:59:53.204198+0000","last_active":"2024-01-25T14:59:56.222812+0000","last_peered":"2024-01-25T14:59:56.222812+0000","last_clean":"2024-01-25T14:59:56.222812+0000","last_became_active":"2024-01-25T14:59:53.203844+0000","last_became_peered":"2024-01-25T14:59:53.203844+0000","last_unstale":"2024-01-25T14:59:56.222812+0000","last_undegraded":"2024-01-25T14:59:56.222812+0000","last_fullsized":"2024-01-25T14:59:56.222812+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:30:23.735236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221264+0000","last_change":"2024-01-25T14:59:54.203318+0000","last_active":"2024-01-25T14:59:56.221264+0000","last_peered":"2024-01-25T14:59:56.221264+0000","last_clean":"2024-01-25T14:59:56.221264+0000","last_became_active":"2024-01-25T14:59:54.202971+0000","last_became_peered":"2024-01-25T14:59:54.202971+0000","last_unstale":"2024-01-25T14:59:56.221264+0000","last_undegraded":"2024-01-25T14:59:56.221264+0000","last_fullsized":"2024-01-25T14:59:56.221264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:57:59.454857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:59.055000+0000","last_change":"2024-01-25T14:59:53.203938+0000","last_active":"2024-01-25T14:59:59.055000+0000","last_peered":"2024-01-25T14:59:59.055000+0000","last_clean":"2024-01-25T14:59:59.055000+0000","last_became_active":"2024-01-25T14:59:53.203639+0000","last_became_peered":"2024-01-25T14:59:53.203639+0000","last_unstale":"2024-01-25T14:59:59.055000+0000","last_undegraded":"2024-01-25T14:59:59.055000+0000","last_fullsized":"2024-01-25T14:59:59.055000+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:12:16.819375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788552+0000","last_change":"2024-01-25T14:59:54.225131+0000","last_active":"2024-01-25T14:59:55.788552+0000","last_peered":"2024-01-25T14:59:55.788552+0000","last_clean":"2024-01-25T14:59:55.788552+0000","last_became_active":"2024-01-25T14:59:54.224786+0000","last_became_peered":"2024-01-25T14:59:54.224786+0000","last_unstale":"2024-01-25T14:59:55.788552+0000","last_undegraded":"2024-01-25T14:59:55.788552+0000","last_fullsized":"2024-01-25T14:59:55.788552+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:25:07.426433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:58.039852+0000","last_change":"2024-01-25T14:59:53.199834+0000","last_active":"2024-01-25T14:59:58.039852+0000","last_peered":"2024-01-25T14:59:58.039852+0000","last_clean":"2024-01-25T14:59:58.039852+0000","last_became_active":"2024-01-25T14:59:53.199545+0000","last_became_peered":"2024-01-25T14:59:53.199545+0000","last_unstale":"2024-01-25T14:59:58.039852+0000","last_undegraded":"2024-01-25T14:59:58.039852+0000","last_fullsized":"2024-01-25T14:59:58.039852+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:38:08.973583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221824+0000","last_change":"2024-01-25T14:59:54.214768+0000","last_active":"2024-01-25T14:59:56.221824+0000","last_peered":"2024-01-25T14:59:56.221824+0000","last_clean":"2024-01-25T14:59:56.221824+0000","last_became_active":"2024-01-25T14:59:54.214038+0000","last_became_peered":"2024-01-25T14:59:54.214038+0000","last_unstale":"2024-01-25T14:59:56.221824+0000","last_undegraded":"2024-01-25T14:59:56.221824+0000","last_fullsized":"2024-01-25T14:59:56.221824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:10:20.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'8","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.222215+0000","last_change":"2024-01-25T14:59:53.203719+0000","last_active":"2024-01-25T14:59:56.222215+0000","last_peered":"2024-01-25T14:59:56.222215+0000","last_clean":"2024-01-25T14:59:56.222215+0000","last_became_active":"2024-01-25T14:59:53.203382+0000","last_became_peered":"2024-01-25T14:59:53.203382+0000","last_unstale":"2024-01-25T14:59:56.222215+0000","last_undegraded":"2024-01-25T14:59:56.222215+0000","last_fullsized":"2024-01-25T14:59:56.222215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:10:17.120929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220942+0000","last_change":"2024-01-25T14:59:54.217069+0000","last_active":"2024-01-25T14:59:56.220942+0000","last_peered":"2024-01-25T14:59:56.220942+0000","last_clean":"2024-01-25T14:59:56.220942+0000","last_became_active":"2024-01-25T14:59:54.216749+0000","last_became_peered":"2024-01-25T14:59:54.216749+0000","last_unstale":"2024-01-25T14:59:56.220942+0000","last_undegraded":"2024-01-25T14:59:56.220942+0000","last_fullsized":"2024-01-25T14:59:56.220942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:31:00.903462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223824+0000","last_change":"2024-01-25T14:59:53.198852+0000","last_active":"2024-01-25T14:59:56.223824+0000","last_peered":"2024-01-25T14:59:56.223824+0000","last_clean":"2024-01-25T14:59:56.223824+0000","last_became_active":"2024-01-25T14:59:53.198532+0000","last_became_peered":"2024-01-25T14:59:53.198532+0000","last_unstale":"2024-01-25T14:59:56.223824+0000","last_undegraded":"2024-01-25T14:59:56.223824+0000","last_fullsized":"2024-01-25T14:59:56.223824+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:03:43.251730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.202829+0000","last_change":"2024-01-25T14:59:54.209865+0000","last_active":"2024-01-25T14:59:55.202829+0000","last_peered":"2024-01-25T14:59:55.202829+0000","last_clean":"2024-01-25T14:59:55.202829+0000","last_became_active":"2024-01-25T14:59:54.209564+0000","last_became_peered":"2024-01-25T14:59:54.209564+0000","last_unstale":"2024-01-25T14:59:55.202829+0000","last_undegraded":"2024-01-25T14:59:55.202829+0000","last_fullsized":"2024-01-25T14:59:55.202829+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:19:24.461651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:58.048034+0000","last_change":"2024-01-25T14:59:53.207644+0000","last_active":"2024-01-25T14:59:58.048034+0000","last_peered":"2024-01-25T14:59:58.048034+0000","last_clean":"2024-01-25T14:59:58.048034+0000","last_became_active":"2024-01-25T14:59:53.207321+0000","last_became_peered":"2024-01-25T14:59:53.207321+0000","last_unstale":"2024-01-25T14:59:58.048034+0000","last_undegraded":"2024-01-25T14:59:58.048034+0000","last_fullsized":"2024-01-25T14:59:58.048034+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:47:12.131711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.682971+0000","last_change":"2024-01-25T14:59:54.220548+0000","last_active":"2024-01-25T14:59:55.682971+0000","last_peered":"2024-01-25T14:59:55.682971+0000","last_clean":"2024-01-25T14:59:55.682971+0000","last_became_active":"2024-01-25T14:59:54.219743+0000","last_became_peered":"2024-01-25T14:59:54.219743+0000","last_unstale":"2024-01-25T14:59:55.682971+0000","last_undegraded":"2024-01-25T14:59:55.682971+0000","last_fullsized":"2024-01-25T14:59:55.682971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:46:12.085591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220468+0000","last_change":"2024-01-25T14:59:53.201233+0000","last_active":"2024-01-25T14:59:56.220468+0000","last_peered":"2024-01-25T14:59:56.220468+0000","last_clean":"2024-01-25T14:59:56.220468+0000","last_became_active":"2024-01-25T14:59:53.200907+0000","last_became_peered":"2024-01-25T14:59:53.200907+0000","last_unstale":"2024-01-25T14:59:56.220468+0000","last_undegraded":"2024-01-25T14:59:56.220468+0000","last_fullsized":"2024-01-25T14:59:56.220468+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:30:59.640179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.682511+0000","last_change":"2024-01-25T14:59:54.212617+0000","last_active":"2024-01-25T14:59:55.682511+0000","last_peered":"2024-01-25T14:59:55.682511+0000","last_clean":"2024-01-25T14:59:55.682511+0000","last_became_active":"2024-01-25T14:59:54.212328+0000","last_became_peered":"2024-01-25T14:59:54.212328+0000","last_unstale":"2024-01-25T14:59:55.682511+0000","last_undegraded":"2024-01-25T14:59:55.682511+0000","last_fullsized":"2024-01-25T14:59:55.682511+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:21:16.958894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:57.229805+0000","last_change":"2024-01-25T14:59:53.202685+0000","last_active":"2024-01-25T14:59:57.229805+0000","last_peered":"2024-01-25T14:59:57.229805+0000","last_clean":"2024-01-25T14:59:57.229805+0000","last_became_active":"2024-01-25T14:59:53.201529+0000","last_became_peered":"2024-01-25T14:59:53.201529+0000","last_unstale":"2024-01-25T14:59:57.229805+0000","last_undegraded":"2024-01-25T14:59:57.229805+0000","last_fullsized":"2024-01-25T14:59:57.229805+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:43:29.823959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.093467+0000","last_change":"2024-01-25T14:59:54.208724+0000","last_active":"2024-01-25T14:59:56.093467+0000","last_peered":"2024-01-25T14:59:56.093467+0000","last_clean":"2024-01-25T14:59:56.093467+0000","last_became_active":"2024-01-25T14:59:54.208392+0000","last_became_peered":"2024-01-25T14:59:54.208392+0000","last_unstale":"2024-01-25T14:59:56.093467+0000","last_undegraded":"2024-01-25T14:59:56.093467+0000","last_fullsized":"2024-01-25T14:59:56.093467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:37.285702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220465+0000","last_change":"2024-01-25T14:59:53.202763+0000","last_active":"2024-01-25T14:59:56.220465+0000","last_peered":"2024-01-25T14:59:56.220465+0000","last_clean":"2024-01-25T14:59:56.220465+0000","last_became_active":"2024-01-25T14:59:53.202372+0000","last_became_peered":"2024-01-25T14:59:53.202372+0000","last_unstale":"2024-01-25T14:59:56.220465+0000","last_undegraded":"2024-01-25T14:59:56.220465+0000","last_fullsized":"2024-01-25T14:59:56.220465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:52:31.260903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223226+0000","last_change":"2024-01-25T14:59:54.216918+0000","last_active":"2024-01-25T14:59:56.223226+0000","last_peered":"2024-01-25T14:59:56.223226+0000","last_clean":"2024-01-25T14:59:56.223226+0000","last_became_active":"2024-01-25T14:59:54.216283+0000","last_became_peered":"2024-01-25T14:59:54.216283+0000","last_unstale":"2024-01-25T14:59:56.223226+0000","last_undegraded":"2024-01-25T14:59:56.223226+0000","last_fullsized":"2024-01-25T14:59:56.223226+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:15:11.192764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221467+0000","last_change":"2024-01-25T14:59:53.207266+0000","last_active":"2024-01-25T14:59:56.221467+0000","last_peered":"2024-01-25T14:59:56.221467+0000","last_clean":"2024-01-25T14:59:56.221467+0000","last_became_active":"2024-01-25T14:59:53.206820+0000","last_became_peered":"2024-01-25T14:59:53.206820+0000","last_unstale":"2024-01-25T14:59:56.221467+0000","last_undegraded":"2024-01-25T14:59:56.221467+0000","last_fullsized":"2024-01-25T14:59:56.221467+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:29:02.371577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.205189+0000","last_change":"2024-01-25T14:59:54.210434+0000","last_active":"2024-01-25T14:59:55.205189+0000","last_peered":"2024-01-25T14:59:55.205189+0000","last_clean":"2024-01-25T14:59:55.205189+0000","last_became_active":"2024-01-25T14:59:54.210100+0000","last_became_peered":"2024-01-25T14:59:54.210100+0000","last_unstale":"2024-01-25T14:59:55.205189+0000","last_undegraded":"2024-01-25T14:59:55.205189+0000","last_fullsized":"2024-01-25T14:59:55.205189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:48:21.463712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:59.054737+0000","last_change":"2024-01-25T14:59:53.202938+0000","last_active":"2024-01-25T14:59:59.054737+0000","last_peered":"2024-01-25T14:59:59.054737+0000","last_clean":"2024-01-25T14:59:59.054737+0000","last_became_active":"2024-01-25T14:59:53.202638+0000","last_became_peered":"2024-01-25T14:59:53.202638+0000","last_unstale":"2024-01-25T14:59:59.054737+0000","last_undegraded":"2024-01-25T14:59:59.054737+0000","last_fullsized":"2024-01-25T14:59:59.054737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.371375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.204950+0000","last_change":"2024-01-25T14:59:54.219778+0000","last_active":"2024-01-25T14:59:55.204950+0000","last_peered":"2024-01-25T14:59:55.204950+0000","last_clean":"2024-01-25T14:59:55.204950+0000","last_became_active":"2024-01-25T14:59:54.219385+0000","last_became_peered":"2024-01-25T14:59:54.219385+0000","last_unstale":"2024-01-25T14:59:55.204950+0000","last_undegraded":"2024-01-25T14:59:55.204950+0000","last_fullsized":"2024-01-25T14:59:55.204950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:49:27.929024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.093451+0000","last_change":"2024-01-25T14:59:54.209306+0000","last_active":"2024-01-25T14:59:56.093451+0000","last_peered":"2024-01-25T14:59:56.093451+0000","last_clean":"2024-01-25T14:59:56.093451+0000","last_became_active":"2024-01-25T14:59:54.208979+0000","last_became_peered":"2024-01-25T14:59:54.208979+0000","last_unstale":"2024-01-25T14:59:56.093451+0000","last_undegraded":"2024-01-25T14:59:56.093451+0000","last_fullsized":"2024-01-25T14:59:56.093451+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:23:46.763358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:57.229632+0000","last_change":"2024-01-25T14:59:53.200590+0000","last_active":"2024-01-25T14:59:57.229632+0000","last_peered":"2024-01-25T14:59:57.229632+0000","last_clean":"2024-01-25T14:59:57.229632+0000","last_became_active":"2024-01-25T14:59:53.200292+0000","last_became_peered":"2024-01-25T14:59:53.200292+0000","last_unstale":"2024-01-25T14:59:57.229632+0000","last_undegraded":"2024-01-25T14:59:57.229632+0000","last_fullsized":"2024-01-25T14:59:57.229632+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:02:05.135314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.219106+0000","last_change":"2024-01-25T14:59:54.217765+0000","last_active":"2024-01-25T14:59:54.219106+0000","last_peered":"2024-01-25T14:59:54.219106+0000","last_clean":"2024-01-25T14:59:54.219106+0000","last_became_active":"2024-01-25T14:59:54.217433+0000","last_became_peered":"2024-01-25T14:59:54.217433+0000","last_unstale":"2024-01-25T14:59:54.219106+0000","last_undegraded":"2024-01-25T14:59:54.219106+0000","last_fullsized":"2024-01-25T14:59:54.219106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:02:48.002265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221711+0000","last_change":"2024-01-25T14:59:53.197543+0000","last_active":"2024-01-25T14:59:56.221711+0000","last_peered":"2024-01-25T14:59:56.221711+0000","last_clean":"2024-01-25T14:59:56.221711+0000","last_became_active":"2024-01-25T14:59:53.197213+0000","last_became_peered":"2024-01-25T14:59:53.197213+0000","last_unstale":"2024-01-25T14:59:56.221711+0000","last_undegraded":"2024-01-25T14:59:56.221711+0000","last_fullsized":"2024-01-25T14:59:56.221711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:19:39.477948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":339,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.682538+0000","last_change":"2024-01-25T14:58:41.034413+0000","last_active":"2024-01-25T14:59:55.682538+0000","last_peered":"2024-01-25T14:59:55.682538+0000","last_clean":"2024-01-25T14:59:55.682538+0000","last_became_active":"2024-01-25T14:58:41.033881+0000","last_became_peered":"2024-01-25T14:58:41.033881+0000","last_unstale":"2024-01-25T14:59:55.682538+0000","last_undegraded":"2024-01-25T14:59:55.682538+0000","last_fullsized":"2024-01-25T14:59:55.682538+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:55:22.974068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:55:22.974068+0000","last_clean_scrub_stamp":"2024-01-25T14:55:22.974068+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:05:30.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.202681+0000","last_change":"2024-01-25T14:59:54.214713+0000","last_active":"2024-01-25T14:59:55.202681+0000","last_peered":"2024-01-25T14:59:55.202681+0000","last_clean":"2024-01-25T14:59:55.202681+0000","last_became_active":"2024-01-25T14:59:54.214348+0000","last_became_peered":"2024-01-25T14:59:54.214348+0000","last_unstale":"2024-01-25T14:59:55.202681+0000","last_undegraded":"2024-01-25T14:59:55.202681+0000","last_fullsized":"2024-01-25T14:59:55.202681+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:11:46.134755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:57.228328+0000","last_change":"2024-01-25T14:59:53.202970+0000","last_active":"2024-01-25T14:59:57.228328+0000","last_peered":"2024-01-25T14:59:57.228328+0000","last_clean":"2024-01-25T14:59:57.228328+0000","last_became_active":"2024-01-25T14:59:53.202680+0000","last_became_peered":"2024-01-25T14:59:53.202680+0000","last_unstale":"2024-01-25T14:59:57.228328+0000","last_undegraded":"2024-01-25T14:59:57.228328+0000","last_fullsized":"2024-01-25T14:59:57.228328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:28:12.628390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220894+0000","last_change":"2024-01-25T14:59:53.210040+0000","last_active":"2024-01-25T14:59:56.220894+0000","last_peered":"2024-01-25T14:59:56.220894+0000","last_clean":"2024-01-25T14:59:56.220894+0000","last_became_active":"2024-01-25T14:59:53.209636+0000","last_became_peered":"2024-01-25T14:59:53.209636+0000","last_unstale":"2024-01-25T14:59:56.220894+0000","last_undegraded":"2024-01-25T14:59:56.220894+0000","last_fullsized":"2024-01-25T14:59:56.220894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:22:45.268969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.203132+0000","last_change":"2024-01-25T14:59:54.203875+0000","last_active":"2024-01-25T14:59:55.203132+0000","last_peered":"2024-01-25T14:59:55.203132+0000","last_clean":"2024-01-25T14:59:55.203132+0000","last_became_active":"2024-01-25T14:59:54.203573+0000","last_became_peered":"2024-01-25T14:59:54.203573+0000","last_unstale":"2024-01-25T14:59:55.203132+0000","last_undegraded":"2024-01-25T14:59:55.203132+0000","last_fullsized":"2024-01-25T14:59:55.203132+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:16:33.124186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'6","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:58.050062+0000","last_change":"2024-01-25T14:59:53.202984+0000","last_active":"2024-01-25T14:59:58.050062+0000","last_peered":"2024-01-25T14:59:58.050062+0000","last_clean":"2024-01-25T14:59:58.050062+0000","last_became_active":"2024-01-25T14:59:53.202651+0000","last_became_peered":"2024-01-25T14:59:53.202651+0000","last_unstale":"2024-01-25T14:59:58.050062+0000","last_undegraded":"2024-01-25T14:59:58.050062+0000","last_fullsized":"2024-01-25T14:59:58.050062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:25:06.486454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.212976+0000","last_change":"2024-01-25T14:59:54.212444+0000","last_active":"2024-01-25T14:59:54.212976+0000","last_peered":"2024-01-25T14:59:54.212976+0000","last_clean":"2024-01-25T14:59:54.212976+0000","last_became_active":"2024-01-25T14:59:54.212090+0000","last_became_peered":"2024-01-25T14:59:54.212090+0000","last_unstale":"2024-01-25T14:59:54.212976+0000","last_undegraded":"2024-01-25T14:59:54.212976+0000","last_fullsized":"2024-01-25T14:59:54.212976+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:19:22.203687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.224116+0000","last_change":"2024-01-25T14:59:53.199984+0000","last_active":"2024-01-25T14:59:56.224116+0000","last_peered":"2024-01-25T14:59:56.224116+0000","last_clean":"2024-01-25T14:59:56.224116+0000","last_became_active":"2024-01-25T14:59:53.199674+0000","last_became_peered":"2024-01-25T14:59:53.199674+0000","last_unstale":"2024-01-25T14:59:56.224116+0000","last_undegraded":"2024-01-25T14:59:56.224116+0000","last_fullsized":"2024-01-25T14:59:56.224116+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:22:01.521516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788473+0000","last_change":"2024-01-25T14:59:54.224285+0000","last_active":"2024-01-25T14:59:55.788473+0000","last_peered":"2024-01-25T14:59:55.788473+0000","last_clean":"2024-01-25T14:59:55.788473+0000","last_became_active":"2024-01-25T14:59:54.223904+0000","last_became_peered":"2024-01-25T14:59:54.223904+0000","last_unstale":"2024-01-25T14:59:55.788473+0000","last_undegraded":"2024-01-25T14:59:55.788473+0000","last_fullsized":"2024-01-25T14:59:55.788473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:49:24.717733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.224825+0000","last_change":"2024-01-25T14:59:53.203501+0000","last_active":"2024-01-25T14:59:56.224825+0000","last_peered":"2024-01-25T14:59:56.224825+0000","last_clean":"2024-01-25T14:59:56.224825+0000","last_became_active":"2024-01-25T14:59:53.203215+0000","last_became_peered":"2024-01-25T14:59:53.203215+0000","last_unstale":"2024-01-25T14:59:56.224825+0000","last_undegraded":"2024-01-25T14:59:56.224825+0000","last_fullsized":"2024-01-25T14:59:56.224825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:18:25.174639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.220249+0000","last_change":"2024-01-25T14:59:54.219575+0000","last_active":"2024-01-25T14:59:56.220249+0000","last_peered":"2024-01-25T14:59:56.220249+0000","last_clean":"2024-01-25T14:59:56.220249+0000","last_became_active":"2024-01-25T14:59:54.219170+0000","last_became_peered":"2024-01-25T14:59:54.219170+0000","last_unstale":"2024-01-25T14:59:56.220249+0000","last_undegraded":"2024-01-25T14:59:56.220249+0000","last_fullsized":"2024-01-25T14:59:56.220249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:41.940927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.199798+0000","last_change":"2024-01-25T14:59:53.203864+0000","last_active":"2024-01-25T14:59:54.199798+0000","last_peered":"2024-01-25T14:59:54.199798+0000","last_clean":"2024-01-25T14:59:54.199798+0000","last_became_active":"2024-01-25T14:59:53.203564+0000","last_became_peered":"2024-01-25T14:59:53.203564+0000","last_unstale":"2024-01-25T14:59:54.199798+0000","last_undegraded":"2024-01-25T14:59:54.199798+0000","last_fullsized":"2024-01-25T14:59:54.199798+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:03:21.776910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223114+0000","last_change":"2024-01-25T14:59:54.217014+0000","last_active":"2024-01-25T14:59:56.223114+0000","last_peered":"2024-01-25T14:59:56.223114+0000","last_clean":"2024-01-25T14:59:56.223114+0000","last_became_active":"2024-01-25T14:59:54.216673+0000","last_became_peered":"2024-01-25T14:59:54.216673+0000","last_unstale":"2024-01-25T14:59:56.223114+0000","last_undegraded":"2024-01-25T14:59:56.223114+0000","last_fullsized":"2024-01-25T14:59:56.223114+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:46:31.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.203748+0000","last_change":"2024-01-25T14:59:53.207297+0000","last_active":"2024-01-25T14:59:55.203748+0000","last_peered":"2024-01-25T14:59:55.203748+0000","last_clean":"2024-01-25T14:59:55.203748+0000","last_became_active":"2024-01-25T14:59:53.206968+0000","last_became_peered":"2024-01-25T14:59:53.206968+0000","last_unstale":"2024-01-25T14:59:55.203748+0000","last_undegraded":"2024-01-25T14:59:55.203748+0000","last_fullsized":"2024-01-25T14:59:55.203748+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:01.679360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.219959+0000","last_change":"2024-01-25T14:59:54.218890+0000","last_active":"2024-01-25T14:59:54.219959+0000","last_peered":"2024-01-25T14:59:54.219959+0000","last_clean":"2024-01-25T14:59:54.219959+0000","last_became_active":"2024-01-25T14:59:54.218581+0000","last_became_peered":"2024-01-25T14:59:54.218581+0000","last_unstale":"2024-01-25T14:59:54.219959+0000","last_undegraded":"2024-01-25T14:59:54.219959+0000","last_fullsized":"2024-01-25T14:59:54.219959+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:59:31.468054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.224850+0000","last_change":"2024-01-25T14:59:53.208219+0000","last_active":"2024-01-25T14:59:56.224850+0000","last_peered":"2024-01-25T14:59:56.224850+0000","last_clean":"2024-01-25T14:59:56.224850+0000","last_became_active":"2024-01-25T14:59:53.207878+0000","last_became_peered":"2024-01-25T14:59:53.207878+0000","last_unstale":"2024-01-25T14:59:56.224850+0000","last_undegraded":"2024-01-25T14:59:56.224850+0000","last_fullsized":"2024-01-25T14:59:56.224850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:03.410383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.682838+0000","last_change":"2024-01-25T14:59:54.208996+0000","last_active":"2024-01-25T14:59:55.682838+0000","last_peered":"2024-01-25T14:59:55.682838+0000","last_clean":"2024-01-25T14:59:55.682838+0000","last_became_active":"2024-01-25T14:59:54.208658+0000","last_became_peered":"2024-01-25T14:59:54.208658+0000","last_unstale":"2024-01-25T14:59:55.682838+0000","last_undegraded":"2024-01-25T14:59:55.682838+0000","last_fullsized":"2024-01-25T14:59:55.682838+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:39:57.752381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.204161+0000","last_change":"2024-01-25T14:59:53.207106+0000","last_active":"2024-01-25T14:59:55.204161+0000","last_peered":"2024-01-25T14:59:55.204161+0000","last_clean":"2024-01-25T14:59:55.204161+0000","last_became_active":"2024-01-25T14:59:53.206688+0000","last_became_peered":"2024-01-25T14:59:53.206688+0000","last_unstale":"2024-01-25T14:59:55.204161+0000","last_undegraded":"2024-01-25T14:59:55.204161+0000","last_fullsized":"2024-01-25T14:59:55.204161+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:30:03.019791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.683147+0000","last_change":"2024-01-25T14:59:54.208994+0000","last_active":"2024-01-25T14:59:55.683147+0000","last_peered":"2024-01-25T14:59:55.683147+0000","last_clean":"2024-01-25T14:59:55.683147+0000","last_became_active":"2024-01-25T14:59:54.208638+0000","last_became_peered":"2024-01-25T14:59:54.208638+0000","last_unstale":"2024-01-25T14:59:55.683147+0000","last_undegraded":"2024-01-25T14:59:55.683147+0000","last_fullsized":"2024-01-25T14:59:55.683147+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:56.001501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:58.048447+0000","last_change":"2024-01-25T14:59:53.207659+0000","last_active":"2024-01-25T14:59:58.048447+0000","last_peered":"2024-01-25T14:59:58.048447+0000","last_clean":"2024-01-25T14:59:58.048447+0000","last_became_active":"2024-01-25T14:59:53.207373+0000","last_became_peered":"2024-01-25T14:59:53.207373+0000","last_unstale":"2024-01-25T14:59:58.048447+0000","last_undegraded":"2024-01-25T14:59:58.048447+0000","last_fullsized":"2024-01-25T14:59:58.048447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:02:18.884192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.682936+0000","last_change":"2024-01-25T14:59:54.210415+0000","last_active":"2024-01-25T14:59:55.682936+0000","last_peered":"2024-01-25T14:59:55.682936+0000","last_clean":"2024-01-25T14:59:55.682936+0000","last_became_active":"2024-01-25T14:59:54.210097+0000","last_became_peered":"2024-01-25T14:59:54.210097+0000","last_unstale":"2024-01-25T14:59:55.682936+0000","last_undegraded":"2024-01-25T14:59:55.682936+0000","last_fullsized":"2024-01-25T14:59:55.682936+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:43:18.764375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.202897+0000","last_change":"2024-01-25T14:59:53.203526+0000","last_active":"2024-01-25T14:59:55.202897+0000","last_peered":"2024-01-25T14:59:55.202897+0000","last_clean":"2024-01-25T14:59:55.202897+0000","last_became_active":"2024-01-25T14:59:53.203223+0000","last_became_peered":"2024-01-25T14:59:53.203223+0000","last_unstale":"2024-01-25T14:59:55.202897+0000","last_undegraded":"2024-01-25T14:59:55.202897+0000","last_fullsized":"2024-01-25T14:59:55.202897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:35:06.014547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.683136+0000","last_change":"2024-01-25T14:59:54.219053+0000","last_active":"2024-01-25T14:59:55.683136+0000","last_peered":"2024-01-25T14:59:55.683136+0000","last_clean":"2024-01-25T14:59:55.683136+0000","last_became_active":"2024-01-25T14:59:54.218733+0000","last_became_peered":"2024-01-25T14:59:54.218733+0000","last_unstale":"2024-01-25T14:59:55.683136+0000","last_undegraded":"2024-01-25T14:59:55.683136+0000","last_fullsized":"2024-01-25T14:59:55.683136+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:07:19.083352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223302+0000","last_change":"2024-01-25T14:59:54.210644+0000","last_active":"2024-01-25T14:59:56.223302+0000","last_peered":"2024-01-25T14:59:56.223302+0000","last_clean":"2024-01-25T14:59:56.223302+0000","last_became_active":"2024-01-25T14:59:54.210333+0000","last_became_peered":"2024-01-25T14:59:54.210333+0000","last_unstale":"2024-01-25T14:59:56.223302+0000","last_undegraded":"2024-01-25T14:59:56.223302+0000","last_fullsized":"2024-01-25T14:59:56.223302+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:25:06.201952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.203840+0000","last_change":"2024-01-25T14:59:54.218398+0000","last_active":"2024-01-25T14:59:55.203840+0000","last_peered":"2024-01-25T14:59:55.203840+0000","last_clean":"2024-01-25T14:59:55.203840+0000","last_became_active":"2024-01-25T14:59:54.217918+0000","last_became_peered":"2024-01-25T14:59:54.217918+0000","last_unstale":"2024-01-25T14:59:55.203840+0000","last_undegraded":"2024-01-25T14:59:55.203840+0000","last_fullsized":"2024-01-25T14:59:55.203840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:44:01.699125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.204008+0000","last_change":"2024-01-25T14:59:54.218260+0000","last_active":"2024-01-25T14:59:55.204008+0000","last_peered":"2024-01-25T14:59:55.204008+0000","last_clean":"2024-01-25T14:59:55.204008+0000","last_became_active":"2024-01-25T14:59:54.217381+0000","last_became_peered":"2024-01-25T14:59:54.217381+0000","last_unstale":"2024-01-25T14:59:55.204008+0000","last_undegraded":"2024-01-25T14:59:55.204008+0000","last_fullsized":"2024-01-25T14:59:55.204008+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:36:09.631749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.788324+0000","last_change":"2024-01-25T14:59:54.224518+0000","last_active":"2024-01-25T14:59:55.788324+0000","last_peered":"2024-01-25T14:59:55.788324+0000","last_clean":"2024-01-25T14:59:55.788324+0000","last_became_active":"2024-01-25T14:59:54.224210+0000","last_became_peered":"2024-01-25T14:59:54.224210+0000","last_unstale":"2024-01-25T14:59:55.788324+0000","last_undegraded":"2024-01-25T14:59:55.788324+0000","last_fullsized":"2024-01-25T14:59:55.788324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:33:56.670077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.202988+0000","last_change":"2024-01-25T14:59:54.215681+0000","last_active":"2024-01-25T14:59:55.202988+0000","last_peered":"2024-01-25T14:59:55.202988+0000","last_clean":"2024-01-25T14:59:55.202988+0000","last_became_active":"2024-01-25T14:59:54.215350+0000","last_became_peered":"2024-01-25T14:59:54.215350+0000","last_unstale":"2024-01-25T14:59:55.202988+0000","last_undegraded":"2024-01-25T14:59:55.202988+0000","last_fullsized":"2024-01-25T14:59:55.202988+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:27:50.002224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223277+0000","last_change":"2024-01-25T14:59:54.217690+0000","last_active":"2024-01-25T14:59:56.223277+0000","last_peered":"2024-01-25T14:59:56.223277+0000","last_clean":"2024-01-25T14:59:56.223277+0000","last_became_active":"2024-01-25T14:59:54.217361+0000","last_became_peered":"2024-01-25T14:59:54.217361+0000","last_unstale":"2024-01-25T14:59:56.223277+0000","last_undegraded":"2024-01-25T14:59:56.223277+0000","last_fullsized":"2024-01-25T14:59:56.223277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:30:15.893502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.204359+0000","last_change":"2024-01-25T14:59:54.205201+0000","last_active":"2024-01-25T14:59:55.204359+0000","last_peered":"2024-01-25T14:59:55.204359+0000","last_clean":"2024-01-25T14:59:55.204359+0000","last_became_active":"2024-01-25T14:59:54.204893+0000","last_became_peered":"2024-01-25T14:59:54.204893+0000","last_unstale":"2024-01-25T14:59:55.204359+0000","last_undegraded":"2024-01-25T14:59:55.204359+0000","last_fullsized":"2024-01-25T14:59:55.204359+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:35:43.147029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.212300+0000","last_change":"2024-01-25T14:59:54.210681+0000","last_active":"2024-01-25T14:59:54.212300+0000","last_peered":"2024-01-25T14:59:54.212300+0000","last_clean":"2024-01-25T14:59:54.212300+0000","last_became_active":"2024-01-25T14:59:54.210347+0000","last_became_peered":"2024-01-25T14:59:54.210347+0000","last_unstale":"2024-01-25T14:59:54.212300+0000","last_undegraded":"2024-01-25T14:59:54.212300+0000","last_fullsized":"2024-01-25T14:59:54.212300+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:55:16.435362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.093327+0000","last_change":"2024-01-25T14:59:54.210792+0000","last_active":"2024-01-25T14:59:56.093327+0000","last_peered":"2024-01-25T14:59:56.093327+0000","last_clean":"2024-01-25T14:59:56.093327+0000","last_became_active":"2024-01-25T14:59:54.210416+0000","last_became_peered":"2024-01-25T14:59:54.210416+0000","last_unstale":"2024-01-25T14:59:56.093327+0000","last_undegraded":"2024-01-25T14:59:56.093327+0000","last_fullsized":"2024-01-25T14:59:56.093327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:45.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-25T14:59:54.205654+0000","last_change":"2024-01-25T14:59:54.204547+0000","last_active":"2024-01-25T14:59:54.205654+0000","last_peered":"2024-01-25T14:59:54.205654+0000","last_clean":"2024-01-25T14:59:54.205654+0000","last_became_active":"2024-01-25T14:59:54.204215+0000","last_became_peered":"2024-01-25T14:59:54.204215+0000","last_unstale":"2024-01-25T14:59:54.205654+0000","last_undegraded":"2024-01-25T14:59:54.205654+0000","last_fullsized":"2024-01-25T14:59:54.205654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:42:27.300849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.221781+0000","last_change":"2024-01-25T14:59:54.211006+0000","last_active":"2024-01-25T14:59:56.221781+0000","last_peered":"2024-01-25T14:59:56.221781+0000","last_clean":"2024-01-25T14:59:56.221781+0000","last_became_active":"2024-01-25T14:59:54.210568+0000","last_became_peered":"2024-01-25T14:59:54.210568+0000","last_unstale":"2024-01-25T14:59:56.221781+0000","last_undegraded":"2024-01-25T14:59:56.221781+0000","last_fullsized":"2024-01-25T14:59:56.221781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:12:23.888827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:55.203133+0000","last_change":"2024-01-25T14:59:54.220485+0000","last_active":"2024-01-25T14:59:55.203133+0000","last_peered":"2024-01-25T14:59:55.203133+0000","last_clean":"2024-01-25T14:59:55.203133+0000","last_became_active":"2024-01-25T14:59:54.219547+0000","last_became_peered":"2024-01-25T14:59:54.219547+0000","last_unstale":"2024-01-25T14:59:55.203133+0000","last_undegraded":"2024-01-25T14:59:55.203133+0000","last_fullsized":"2024-01-25T14:59:55.203133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:43:49.858263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-01-25T14:59:56.223117+0000","last_change":"2024-01-25T14:59:54.217605+0000","last_active":"2024-01-25T14:59:56.223117+0000","last_peered":"2024-01-25T14:59:56.223117+0000","last_clean":"2024-01-25T14:59:56.223117+0000","last_became_active":"2024-01-25T14:59:54.217295+0000","last_became_peered":"2024-01-25T14:59:54.217295+0000","last_unstale":"2024-01-25T14:59:56.223117+0000","last_undegraded":"2024-01-25T14:59:56.223117+0000","last_fullsized":"2024-01-25T14:59:56.223117+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:27:59.846434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5578,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":130,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":19648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383694,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":925696,"data_stored":439274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":10,"up_from":72,"seq":309237645331,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28532,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716620,"statfs":{"total":95995035648,"available":95965818880,"internally_reserved":0,"allocated":1552384,"data_stored":1031640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.378},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.55500000000000005}]},{"osd":4,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.442}]},{"osd":5,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.753},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.45500000000000002}]},{"osd":8,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.70899999999999996}]},{"osd":9,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.63800000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]}]},{"osd":9,"up_from":67,"seq":287762808855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":438900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.437}]},{"osd":3,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.38}]},{"osd":7,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.77000000000000002}]},{"osd":8,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.496},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.58699999999999997}]},{"osd":10,"last update":"Thu Jan 25 14:59:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.78600000000000003}]}]},{"osd":8,"up_from":59,"seq":253403070492,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":925696,"data_stored":438708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.627,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.56899999999999995,"15min":0.58199999999999996},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66400000000000003,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58299999999999996,"15min":0.57999999999999996},"min":{"1min":0.38200000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77700000000000002,"5min":1.008,"15min":1.008},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76300000000000001,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.436,"15min":0.44500000000000001},"min":{"1min":0.29099999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.57799999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60899999999999999,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.439}]},{"osd":3,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.38800000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65600000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.56999999999999995,"15min":0.57699999999999996},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.65000000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78500000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.61499999999999999,"15min":0.62},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77400000000000002,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.71199999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.57099999999999995,"15min":0.58399999999999996},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.72499999999999998,"5min":1.028,"15min":1.028},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.625,"15min":0.64100000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73899999999999999,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.66800000000000004,"15min":0.68300000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.69699999999999995,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.67700000000000005,"15min":0.68600000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.80800000000000005,"5min":1.04,"15min":1.04},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.69199999999999995,"15min":0.69799999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.89800000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.76900000000000002}]},{"osd":9,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.85499999999999998}]},{"osd":10,"last update":"Thu Jan 25 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.876}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":7,"up_from":52,"seq":223338299426,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32680,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712472,"statfs":{"total":95995035648,"available":95961571328,"internally_reserved":0,"allocated":1540096,"data_stored":1031982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.53200000000000003,"15min":0.51900000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.40600000000000003,"15min":0.39800000000000002},"min":{"1min":0.29199999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.496},{"interface":"front","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.45500000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68600000000000005,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.68700000000000006,"15min":0.64200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":6.508,"5min":6.508,"15min":6.508},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57099999999999995,"15min":0.56599999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72299999999999998,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.47999999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78100000000000003,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.628,"15min":0.622},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.621,"15min":0.61899999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.69099999999999995,"15min":0.68899999999999995},"min":{"1min":0.53000000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67300000000000004,"15min":0.66400000000000003},"min":{"1min":0.504,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.63700000000000001}]},{"osd":8,"last update":"Thu Jan 25 14:59:50 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.68799999999999994,"15min":0.68300000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84399999999999997,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.748},{"interface":"front","average":{"1min":1.1200000000000001,"5min":0.78500000000000003,"15min":0.72899999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":6.5469999999999997,"5min":6.5469999999999997,"15min":6.5469999999999997},"last":0.77300000000000002}]},{"osd":9,"last update":"Thu Jan 25 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66400000000000003}]},{"osd":10,"last update":"Thu Jan 25 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.70399999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495655,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40396,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704756,"statfs":{"total":95995035648,"available":95953670144,"internally_reserved":0,"allocated":917504,"data_stored":438172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.38200000000000001,"15min":0.371},"min":{"1min":0.32400000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.379,"15min":0.36899999999999999},"min":{"1min":0.26200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 25 14:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.56799999999999995,"15min":0.55400000000000005},"min":{"1min":0.502,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.55100000000000005,"15min":0.54000000000000004},"min":{"1min":0.42999999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Jan 25 14:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.42699999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.374}]},{"osd":3,"last update":"Thu Jan 25 14:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.436,"15min":0.42499999999999999},"min":{"1min":0.30199999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.47599999999999998,"15min":0.46500000000000002},"min":{"1min":0.32700000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 25 14:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.45400000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.60099999999999998,"15min":0.58299999999999996},"min":{"1min":0.48199999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.69999999999999996}]},{"osd":5,"last update":"Thu Jan 25 14:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.45900000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.60999999999999999,"15min":0.59399999999999997},"min":{"1min":0.41299999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.437}]},{"osd":7,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68000000000000005,"15min":0.68799999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76900000000000002,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.70299999999999996,"15min":0.70499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85199999999999998,"5min":1.04,"15min":1.04},"last":0.67300000000000004}]},{"osd":8,"last update":"Thu Jan 25 14:59:50 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.41199999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.80400000000000005,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.497,"5min":0.496,"15min":0.496},"max":{"1min":0.746,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.52700000000000002}]},{"osd":9,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.39500000000000002}]},{"osd":10,"last update":"Thu Jan 25 14:59:38 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.59999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":925696,"data_stored":439694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.498,"15min":0.47799999999999998},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.5,"15min":0.48399999999999999},"min":{"1min":0.39900000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 25 14:59:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.53400000000000003,"15min":0.49099999999999999},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.54600000000000004,"15min":0.51000000000000001},"min":{"1min":0.42199999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 25 14:59:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.57799999999999996,"15min":0.53800000000000003},"min":{"1min":0.40799999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.81599999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.56899999999999995,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.80900000000000005,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 25 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.40000000000000002,"15min":0.38},"min":{"1min":0.33300000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.42399999999999999,"15min":0.39900000000000002},"min":{"1min":0.35499999999999998,"5min":0.25,"15min":0.25},"max":{"1min":0.70299999999999996,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.5}]},{"osd":5,"last update":"Thu Jan 25 14:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59399999999999997,"15min":0.56999999999999995},"min":{"1min":0.40100000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.59499999999999997,"15min":0.56000000000000005},"min":{"1min":0.51700000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Jan 25 14:58:59 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.48499999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.60399999999999998,"15min":0.59799999999999998},"min":{"1min":0.46000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.874}]},{"osd":7,"last update":"Thu Jan 25 14:59:28 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.58099999999999996,"15min":0.57399999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.754},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.628,"15min":0.622},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.92200000000000004}]},{"osd":8,"last update":"Thu Jan 25 14:59:50 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72999999999999998,"15min":0.72599999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67500000000000004,"15min":0.66900000000000004},"min":{"1min":0.54100000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.76700000000000002}]},{"osd":9,"last update":"Thu Jan 25 14:59:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.94499999999999995}]},{"osd":10,"last update":"Thu Jan 25 14:59:42 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.85999999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40424,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704728,"statfs":{"total":95995035648,"available":95953641472,"internally_reserved":0,"allocated":946176,"data_stored":440148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 14:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.504,"15min":0.48699999999999999},"min":{"1min":0.34499999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77600000000000002,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.51500000000000001,"15min":0.505},"min":{"1min":0.373,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70199999999999996,"5min":0.748,"15min":0.748},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 25 14:59:30 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51100000000000001,"15min":0.502},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73999999999999999,"5min":0.748,"15min":0.748},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51400000000000001,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 25 14:58:52 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.41799999999999998,"15min":0.40200000000000002},"min":{"1min":0.28000000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.71599999999999997,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.442,"15min":0.41699999999999998},"min":{"1min":0.31900000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 25 14:59:20 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.51700000000000002,"15min":0.502},"min":{"1min":0.33900000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.72699999999999998,"5min":0.747,"15min":0.747},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.53200000000000003,"15min":0.52000000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Jan 25 14:59:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.54100000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.38900000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73899999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Thu Jan 25 14:59:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76000000000000001,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.51100000000000001,"15min":0.501},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 25 14:59:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57699999999999996}]},{"osd":8,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.67000000000000004,"15min":0.67200000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69599999999999995,"15min":0.70099999999999996},"min":{"1min":0.52200000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.78800000000000003}]},{"osd":9,"last update":"Thu Jan 25 14:59:16 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54500000000000004}]},{"osd":10,"last update":"Thu Jan 25 14:59:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.66200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":937984,"data_stored":440350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:33 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.307,"5min":0.246,"15min":0.246},"max":{"1min":0.67700000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.28599999999999998,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 25 14:59:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.50900000000000001},"min":{"1min":0.39200000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.503},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.504},"min":{"1min":0.42199999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 25 14:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56000000000000005,"15min":0.53000000000000003},"min":{"1min":0.39700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.76800000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.54400000000000004},"min":{"1min":0.34599999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 25 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.41299999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71799999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 25 14:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.40899999999999997,"15min":0.39000000000000001},"min":{"1min":0.27100000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.66700000000000004,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.442,"15min":0.434},"min":{"1min":0.29299999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.81899999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 25 14:59:04 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58299999999999996,"15min":0.57799999999999996},"min":{"1min":0.44800000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83799999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Jan 25 14:59:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.76900000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67700000000000005,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.80500000000000005,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77500000000000002}]},{"osd":8,"last update":"Thu Jan 25 14:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.59599999999999997,"15min":0.60899999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.627,"15min":0.63900000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.94099999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70399999999999996}]},{"osd":9,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.752}]},{"osd":10,"last update":"Thu Jan 25 14:59:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.81999999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182452,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":429616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:53 2024","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.34599999999999997,"15min":0.33600000000000002},"min":{"1min":0.25700000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.45600000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.36499999999999999,"15min":0.35399999999999998},"min":{"1min":0.30299999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.48299999999999998,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.32800000000000001}]},{"osd":1,"last update":"Thu Jan 25 14:59:53 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52300000000000002,"15min":0.505},"min":{"1min":0.36699999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.52600000000000002,"15min":0.504},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 25 14:59:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78800000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.40300000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73499999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 25 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55000000000000004,"15min":0.54600000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.70399999999999996,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.623},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.48999999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 25 14:59:38 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56499999999999995,"15min":0.56000000000000005},"min":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76800000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.504},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.749,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Jan 25 14:59:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.47799999999999998,"15min":0.46899999999999997},"min":{"1min":0.36099999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.499,"15min":0.47999999999999998},"min":{"1min":0.42899999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 25 14:59:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82799999999999996,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68100000000000005}]},{"osd":8,"last update":"Thu Jan 25 14:59:53 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85899999999999999,"5min":0.872,"15min":0.872},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69599999999999995,"15min":0.69499999999999995},"min":{"1min":0.56799999999999995,"5min":0.5,"15min":0.5},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.61799999999999999}]},{"osd":9,"last update":"Thu Jan 25 14:59:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.442},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53700000000000003}]},{"osd":10,"last update":"Thu Jan 25 14:59:38 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.65500000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":4,"up_from":33,"seq":141733920816,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":429534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48599999999999999,"15min":0.47699999999999998},"min":{"1min":0.38100000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.82199999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 25 14:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.38700000000000001,"15min":0.38300000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.50700000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.39900000000000002,"15min":0.39500000000000002},"min":{"1min":0.27200000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.74399999999999999}]},{"osd":2,"last update":"Thu Jan 25 14:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.53600000000000003},"min":{"1min":0.35799999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58599999999999997,"15min":0.56599999999999995},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84099999999999997,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jan 25 14:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.51800000000000002,"15min":0.5},"min":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.502},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.54400000000000004,"15min":0.53800000000000003},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.54500000000000004}]},{"osd":5,"last update":"Thu Jan 25 14:59:44 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.57899999999999996,"15min":0.56200000000000006},"min":{"1min":0.47399999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.45100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 25 14:59:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.434,"5min":0.377,"15min":0.377},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.59999999999999998,"15min":0.58899999999999997},"min":{"1min":0.39500000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83399999999999996,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.625}]},{"osd":7,"last update":"Thu Jan 25 14:59:25 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.55800000000000005,"15min":0.54300000000000004},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.53300000000000003,"15min":0.51900000000000002},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.89200000000000002}]},{"osd":8,"last update":"Thu Jan 25 14:59:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.621,"15min":0.60699999999999998},"min":{"1min":0.49099999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.67400000000000004,"15min":0.66600000000000004},"min":{"1min":0.505,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.93999999999999995}]},{"osd":9,"last update":"Thu Jan 25 14:59:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1,"5min":1,"15min":1},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.76400000000000001}]},{"osd":10,"last update":"Thu Jan 25 14:59:38 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.873}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757291,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32692,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712460,"statfs":{"total":95995035648,"available":95961559040,"internally_reserved":0,"allocated":1548288,"data_stored":1031078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.50900000000000001},"min":{"1min":0.34899999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.52300000000000002,"15min":0.52500000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.748,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.5}]},{"osd":1,"last update":"Thu Jan 25 14:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52800000000000002,"15min":0.51900000000000002},"min":{"1min":0.38600000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.70199999999999996,"5min":0.748,"15min":0.748},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.39800000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.59799999999999998}]},{"osd":2,"last update":"Thu Jan 25 14:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39000000000000001},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67500000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.38400000000000001,"15min":0.38},"min":{"1min":0.29099999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.628,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 25 14:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.749,"5min":0.873,"15min":0.873},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.41699999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Jan 25 14:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55700000000000005,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.55000000000000004},"min":{"1min":0.45200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.68200000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.76900000000000002}]},{"osd":6,"last update":"Thu Jan 25 14:59:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80200000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 25 14:59:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.624,"15min":0.627},"min":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79200000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.872},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60999999999999999,"15min":0.61099999999999999},"min":{"1min":0.38,"5min":0.377,"15min":0.377},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.80900000000000005}]},{"osd":8,"last update":"Thu Jan 25 14:59:52 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55300000000000005,"15min":0.55000000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.628,"15min":0.626},"min":{"1min":0.42699999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.57899999999999996}]},{"osd":9,"last update":"Thu Jan 25 14:59:14 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.66300000000000003}]},{"osd":10,"last update":"Thu Jan 25 14:59:41 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.75700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:00:01.749 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-25T15:00:01.749 INFO:tasks.cephadm:Setting up client nodes... 2024-01-25T15:00:01.749 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-01-25T15:00:02.020 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:02.393 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:02 smithi170 ceph-mon[31899]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:00:02.394 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:02 smithi170 ceph-mon[31899]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-01-25T15:00:02.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:02 smithi186 ceph-mon[35697]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:00:02.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:02 smithi186 ceph-mon[35697]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-01-25T15:00:02.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:02 smithi191 ceph-mon[36347]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:00:02.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:02 smithi191 ceph-mon[36347]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-01-25T15:00:03.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:03 smithi170 ceph-mon[31899]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:00:03.479 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:03 smithi170 ceph-mon[31899]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:00:03.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:03 smithi170 ceph-mon[31899]: pgmap v288: 97 pgs: 97 active+clean; 584 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6.5 KiB/s wr, 24 op/s 2024-01-25T15:00:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:03 smithi186 ceph-mon[35697]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:00:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:03 smithi186 ceph-mon[35697]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:00:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:03 smithi186 ceph-mon[35697]: pgmap v288: 97 pgs: 97 active+clean; 584 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6.5 KiB/s wr, 24 op/s 2024-01-25T15:00:03.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.703+0000 7f67cce59700 1 -- 172.21.15.170:0/3169167550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67c8102300 msgr2=0x7f67c8108bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:03.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.703+0000 7f67cce59700 1 --2- 172.21.15.170:0/3169167550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67c8102300 0x7f67c8108bb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f67c000b0d0 tx=0x7f67c000b3e0 comp rx=0 tx=0).stop 2024-01-25T15:00:03.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.703+0000 7f67cce59700 1 -- 172.21.15.170:0/3169167550 shutdown_connections 2024-01-25T15:00:03.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.703+0000 7f67cce59700 1 --2- 172.21.15.170:0/3169167550 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67c8102300 0x7f67c8108bb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:03.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.703+0000 7f67cce59700 1 --2- 172.21.15.170:0/3169167550 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67c8100760 0x7f67c8100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:03.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.703+0000 7f67cce59700 1 --2- 172.21.15.170:0/3169167550 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c8101960 0x7f67c8101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:03.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.703+0000 7f67cce59700 1 -- 172.21.15.170:0/3169167550 >> 172.21.15.170:0/3169167550 conn(0x7f67c80fbd00 msgr2=0x7f67c80fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:03.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.703+0000 7f67cce59700 1 -- 172.21.15.170:0/3169167550 shutdown_connections 2024-01-25T15:00:03.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.703+0000 7f67cce59700 1 -- 172.21.15.170:0/3169167550 wait complete. 2024-01-25T15:00:03.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67cce59700 1 Processor -- start 2024-01-25T15:00:03.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67cce59700 1 -- start start 2024-01-25T15:00:03.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67cce59700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67c8100760 0x7f67c81976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:03.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67cce59700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c8101960 0x7f67c8197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:03.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67cce59700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67c8102300 0x7f67c819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:03.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67cce59700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c819f270 con 0x7f67c8100760 2024-01-25T15:00:03.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67cce59700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c819f3b0 con 0x7f67c8102300 2024-01-25T15:00:03.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67cce59700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c819f540 con 0x7f67c8101960 2024-01-25T15:00:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67c659c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67c8100760 0x7f67c81976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67c659c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67c8100760 0x7f67c81976e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54300/0 (socket says 172.21.15.170:54300) 2024-01-25T15:00:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67c659c700 1 -- 172.21.15.170:0/2473344658 learned_addr learned my addr 172.21.15.170:0/2473344658 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67c5d9b700 1 --2- 172.21.15.170:0/2473344658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c8101960 0x7f67c8197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67c6d9d700 1 --2- 172.21.15.170:0/2473344658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67c8102300 0x7f67c819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67c659c700 1 -- 172.21.15.170:0/2473344658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c8101960 msgr2=0x7f67c8197c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67c659c700 1 --2- 172.21.15.170:0/2473344658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c8101960 0x7f67c8197c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67c659c700 1 -- 172.21.15.170:0/2473344658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67c8102300 msgr2=0x7f67c819eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67c659c700 1 --2- 172.21.15.170:0/2473344658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67c8102300 0x7f67c819eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67c659c700 1 -- 172.21.15.170:0/2473344658 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c0009d00 con 0x7f67c8100760 2024-01-25T15:00:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.704+0000 7f67c659c700 1 --2- 172.21.15.170:0/2473344658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67c8100760 0x7f67c81976e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f67b800c9a0 tx=0x7f67b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.705+0000 7f67b77fe700 1 -- 172.21.15.170:0/2473344658 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b8004220 con 0x7f67c8100760 2024-01-25T15:00:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.705+0000 7f67b77fe700 1 -- 172.21.15.170:0/2473344658 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67b8004380 con 0x7f67c8100760 2024-01-25T15:00:03.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.705+0000 7f67cce59700 1 -- 172.21.15.170:0/2473344658 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c819f820 con 0x7f67c8100760 2024-01-25T15:00:03.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.705+0000 7f67b77fe700 1 -- 172.21.15.170:0/2473344658 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b8003b40 con 0x7f67c8100760 2024-01-25T15:00:03.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.705+0000 7f67cce59700 1 -- 172.21.15.170:0/2473344658 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c819fd70 con 0x7f67c8100760 2024-01-25T15:00:03.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.706+0000 7f67cce59700 1 -- 172.21.15.170:0/2473344658 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c804fcf0 con 0x7f67c8100760 2024-01-25T15:00:03.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.707+0000 7f67b77fe700 1 -- 172.21.15.170:0/2473344658 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f67b80076d0 con 0x7f67c8100760 2024-01-25T15:00:03.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.707+0000 7f67b77fe700 1 --2- 172.21.15.170:0/2473344658 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f67b00a1530 0x7f67b00a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:03.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.707+0000 7f67c5d9b700 1 --2- 172.21.15.170:0/2473344658 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f67b00a1530 0x7f67b00a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:03.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.707+0000 7f67b77fe700 1 -- 172.21.15.170:0/2473344658 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f67b80cc570 con 0x7f67c8100760 2024-01-25T15:00:03.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.708+0000 7f67c5d9b700 1 --2- 172.21.15.170:0/2473344658 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f67b00a1530 0x7f67b00a39f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009c60 tx=0x7f67bc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:03.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.712+0000 7f67b77fe700 1 -- 172.21.15.170:0/2473344658 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f67b8095a40 con 0x7f67c8100760 2024-01-25T15:00:03.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:03 smithi191 ceph-mon[36347]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:00:03.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:03 smithi191 ceph-mon[36347]: from='client.14775 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:00:03.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:03 smithi191 ceph-mon[36347]: pgmap v288: 97 pgs: 97 active+clean; 584 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6.5 KiB/s wr, 24 op/s 2024-01-25T15:00:03.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.982+0000 7f67cce59700 1 -- 172.21.15.170:0/2473344658 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f67c810bf80 con 0x7f67c8100760 2024-01-25T15:00:03.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.984+0000 7f67b77fe700 1 -- 172.21.15.170:0/2473344658 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7f67b8099060 con 0x7f67c8100760 2024-01-25T15:00:03.985 INFO:teuthology.orchestra.run.smithi170.stdout:[client.0] 2024-01-25T15:00:03.985 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQBzd7JlRDKjOhAAxzhiDlc8q2Sn4xbbHUKX/Q== 2024-01-25T15:00:03.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.986+0000 7f67cce59700 1 -- 172.21.15.170:0/2473344658 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f67b00a1530 msgr2=0x7f67b00a39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:03.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.986+0000 7f67cce59700 1 --2- 172.21.15.170:0/2473344658 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f67b00a1530 0x7f67b00a39f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f67bc009c60 tx=0x7f67bc009260 comp rx=0 tx=0).stop 2024-01-25T15:00:03.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.986+0000 7f67cce59700 1 -- 172.21.15.170:0/2473344658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67c8100760 msgr2=0x7f67c81976e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:03.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.986+0000 7f67cce59700 1 --2- 172.21.15.170:0/2473344658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67c8100760 0x7f67c81976e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f67b800c9a0 tx=0x7f67b800ccb0 comp rx=0 tx=0).stop 2024-01-25T15:00:03.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.986+0000 7f67cce59700 1 -- 172.21.15.170:0/2473344658 shutdown_connections 2024-01-25T15:00:03.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.986+0000 7f67cce59700 1 --2- 172.21.15.170:0/2473344658 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f67b00a1530 0x7f67b00a39f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:03.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.986+0000 7f67cce59700 1 --2- 172.21.15.170:0/2473344658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f67c8102300 0x7f67c819eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:03.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.986+0000 7f67cce59700 1 --2- 172.21.15.170:0/2473344658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f67c8100760 0x7f67c81976e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:03.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.986+0000 7f67cce59700 1 --2- 172.21.15.170:0/2473344658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f67c8101960 0x7f67c8197c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:03.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.986+0000 7f67cce59700 1 -- 172.21.15.170:0/2473344658 >> 172.21.15.170:0/2473344658 conn(0x7f67c80fbd00 msgr2=0x7f67c80fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:03.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.986+0000 7f67cce59700 1 -- 172.21.15.170:0/2473344658 shutdown_connections 2024-01-25T15:00:03.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:03.987+0000 7f67cce59700 1 -- 172.21.15.170:0/2473344658 wait complete. 2024-01-25T15:00:04.589 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:04 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2473344658' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-25T15:00:04.589 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:04 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2473344658' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-25T15:00:04.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:04 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2473344658' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-25T15:00:04.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:04 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2473344658' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-25T15:00:04.615 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T15:00:04.616 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-01-25T15:00:04.616 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-25T15:00:04.659 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-25T15:00:04.659 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-01-25T15:00:04.659 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph mgr dump --format=json 2024-01-25T15:00:04.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:04 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2473344658' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-01-25T15:00:04.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:04 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2473344658' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-01-25T15:00:04.937 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:05.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:05 smithi170 ceph-mon[31899]: pgmap v289: 97 pgs: 97 active+clean; 621 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 10 KiB/s wr, 29 op/s 2024-01-25T15:00:05.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:05 smithi186 ceph-mon[35697]: pgmap v289: 97 pgs: 97 active+clean; 621 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 10 KiB/s wr, 29 op/s 2024-01-25T15:00:05.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:05 smithi191 ceph-mon[36347]: pgmap v289: 97 pgs: 97 active+clean; 621 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 10 KiB/s wr, 29 op/s 2024-01-25T15:00:06.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.608+0000 7f6e57681700 1 -- 172.21.15.170:0/1108151163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50106650 msgr2=0x7f6e50106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:06.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.608+0000 7f6e57681700 1 --2- 172.21.15.170:0/1108151163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50106650 0x7f6e50106a30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0099c0 tx=0x7f6e4c009cd0 comp rx=0 tx=0).stop 2024-01-25T15:00:06.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.608+0000 7f6e57681700 1 -- 172.21.15.170:0/1108151163 shutdown_connections 2024-01-25T15:00:06.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.608+0000 7f6e57681700 1 --2- 172.21.15.170:0/1108151163 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e501021f0 0x7f6e5010e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:06.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.608+0000 7f6e57681700 1 --2- 172.21.15.170:0/1108151163 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50106650 0x7f6e50106a30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:06.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.608+0000 7f6e57681700 1 --2- 172.21.15.170:0/1108151163 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e50101830 0x7f6e50101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:06.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.608+0000 7f6e57681700 1 -- 172.21.15.170:0/1108151163 >> 172.21.15.170:0/1108151163 conn(0x7f6e50078910 msgr2=0x7f6e50078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:06.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.608+0000 7f6e57681700 1 -- 172.21.15.170:0/1108151163 shutdown_connections 2024-01-25T15:00:06.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.608+0000 7f6e57681700 1 -- 172.21.15.170:0/1108151163 wait complete. 2024-01-25T15:00:06.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.609+0000 7f6e57681700 1 Processor -- start 2024-01-25T15:00:06.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.609+0000 7f6e57681700 1 -- start start 2024-01-25T15:00:06.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.609+0000 7f6e57681700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50101830 0x7f6e50199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:06.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.609+0000 7f6e57681700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e501021f0 0x7f6e5019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:06.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.609+0000 7f6e57681700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e50106650 0x7f6e5019e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:06.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.609+0000 7f6e57681700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5019ed60 con 0x7f6e50101830 2024-01-25T15:00:06.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.609+0000 7f6e57681700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5019eed0 con 0x7f6e501021f0 2024-01-25T15:00:06.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.609+0000 7f6e57681700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5019f090 con 0x7f6e50106650 2024-01-25T15:00:06.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.609+0000 7f6e5541d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50101830 0x7f6e50199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:06.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.609+0000 7f6e5541d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50101830 0x7f6e50199e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53534/0 (socket says 172.21.15.170:53534) 2024-01-25T15:00:06.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.609+0000 7f6e5541d700 1 -- 172.21.15.170:0/318451909 learned_addr learned my addr 172.21.15.170:0/318451909 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:06.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.609+0000 7f6e55c1e700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e50106650 0x7f6e5019e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:06.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.609+0000 7f6e54c1c700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e501021f0 0x7f6e5019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:06.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.609+0000 7f6e5541d700 1 -- 172.21.15.170:0/318451909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e50106650 msgr2=0x7f6e5019e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:06.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.610+0000 7f6e5541d700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e50106650 0x7f6e5019e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:06.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.610+0000 7f6e5541d700 1 -- 172.21.15.170:0/318451909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e501021f0 msgr2=0x7f6e5019a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:06.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.610+0000 7f6e5541d700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e501021f0 0x7f6e5019a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:06.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.610+0000 7f6e5541d700 1 -- 172.21.15.170:0/318451909 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c0095f0 con 0x7f6e50101830 2024-01-25T15:00:06.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.610+0000 7f6e55c1e700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e50106650 0x7f6e5019e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:00:06.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.610+0000 7f6e54c1c700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e501021f0 0x7f6e5019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:00:06.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.610+0000 7f6e5541d700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50101830 0x7f6e50199e80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00b580 tx=0x7f6e4c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:06.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.610+0000 7f6e467fc700 1 -- 172.21.15.170:0/318451909 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c01d070 con 0x7f6e50101830 2024-01-25T15:00:06.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.610+0000 7f6e467fc700 1 -- 172.21.15.170:0/318451909 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e4c00fc30 con 0x7f6e50101830 2024-01-25T15:00:06.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.610+0000 7f6e57681700 1 -- 172.21.15.170:0/318451909 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5019f310 con 0x7f6e50101830 2024-01-25T15:00:06.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.610+0000 7f6e57681700 1 -- 172.21.15.170:0/318451909 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e501a6bd0 con 0x7f6e50101830 2024-01-25T15:00:06.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.611+0000 7f6e467fc700 1 -- 172.21.15.170:0/318451909 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c022df0 con 0x7f6e50101830 2024-01-25T15:00:06.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.611+0000 7f6e57681700 1 -- 172.21.15.170:0/318451909 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e50102ec0 con 0x7f6e50101830 2024-01-25T15:00:06.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.612+0000 7f6e467fc700 1 -- 172.21.15.170:0/318451909 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f6e4c022500 con 0x7f6e50101830 2024-01-25T15:00:06.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.613+0000 7f6e467fc700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6e3c0a1400 0x7f6e3c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:06.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.613+0000 7f6e54c1c700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6e3c0a1400 0x7f6e3c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:06.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.613+0000 7f6e467fc700 1 -- 172.21.15.170:0/318451909 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6e4c0cde70 con 0x7f6e50101830 2024-01-25T15:00:06.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.614+0000 7f6e54c1c700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6e3c0a1400 0x7f6e3c0a38c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6e40005fd0 tx=0x7f6e40005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:06.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.617+0000 7f6e467fc700 1 -- 172.21.15.170:0/318451909 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f6e4c097480 con 0x7f6e50101830 2024-01-25T15:00:06.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.863+0000 7f6e57681700 1 -- 172.21.15.170:0/318451909 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6e5019b1e0 con 0x7f6e50101830 2024-01-25T15:00:06.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.867+0000 7f6e467fc700 1 -- 172.21.15.170:0/318451909 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+259970 (secure 0 0 0) 0x7f6e4c09aaa0 con 0x7f6e50101830 2024-01-25T15:00:06.871 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:00:06.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.870+0000 7f6e57681700 1 -- 172.21.15.170:0/318451909 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6e3c0a1400 msgr2=0x7f6e3c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:06.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.870+0000 7f6e57681700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6e3c0a1400 0x7f6e3c0a38c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6e40005fd0 tx=0x7f6e40005dc0 comp rx=0 tx=0).stop 2024-01-25T15:00:06.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.870+0000 7f6e57681700 1 -- 172.21.15.170:0/318451909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50101830 msgr2=0x7f6e50199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:06.873 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.870+0000 7f6e57681700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50101830 0x7f6e50199e80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00b580 tx=0x7f6e4c005e80 comp rx=0 tx=0).stop 2024-01-25T15:00:06.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.870+0000 7f6e57681700 1 -- 172.21.15.170:0/318451909 shutdown_connections 2024-01-25T15:00:06.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.870+0000 7f6e57681700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6e3c0a1400 0x7f6e3c0a38c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:06.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.871+0000 7f6e57681700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6e50106650 0x7f6e5019e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:06.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.871+0000 7f6e57681700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6e50101830 0x7f6e50199e80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:06.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.871+0000 7f6e57681700 1 --2- 172.21.15.170:0/318451909 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e501021f0 0x7f6e5019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:06.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.871+0000 7f6e57681700 1 -- 172.21.15.170:0/318451909 >> 172.21.15.170:0/318451909 conn(0x7f6e50078910 msgr2=0x7f6e500ff6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:06.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.871+0000 7f6e57681700 1 -- 172.21.15.170:0/318451909 shutdown_connections 2024-01-25T15:00:06.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:06.871+0000 7f6e57681700 1 -- 172.21.15.170:0/318451909 wait complete. 2024-01-25T15:00:07.512 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:07 smithi170 ceph-mon[31899]: pgmap v290: 97 pgs: 97 active+clean; 621 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 9.6 KiB/s wr, 27 op/s 2024-01-25T15:00:07.512 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:07 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/318451909' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-01-25T15:00:07.539 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":3767785684},{"type":"v1","addr":"172.21.15.170:6801","nonce":3767785684}]},"active_addr":"172.21.15.170:6801/3767785684","active_change":"2024-01-25T14:52:56.093158+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.170:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":3192391279}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1561929268}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1198040672}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":3306022550}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":3219777261}]}]} 2024-01-25T15:00:07.544 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-01-25T15:00:07.544 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-01-25T15:00:07.544 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd dump --format=json 2024-01-25T15:00:07.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:07 smithi186 ceph-mon[35697]: pgmap v290: 97 pgs: 97 active+clean; 621 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 9.6 KiB/s wr, 27 op/s 2024-01-25T15:00:07.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:07 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/318451909' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-01-25T15:00:07.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:07 smithi191 ceph-mon[36347]: pgmap v290: 97 pgs: 97 active+clean; 621 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 9.6 KiB/s wr, 27 op/s 2024-01-25T15:00:07.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:07 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/318451909' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-01-25T15:00:07.782 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:09.209 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:09 smithi170 ceph-mon[31899]: pgmap v291: 97 pgs: 97 active+clean; 630 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.9 KiB/s wr, 28 op/s 2024-01-25T15:00:09.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:09 smithi186 ceph-mon[35697]: pgmap v291: 97 pgs: 97 active+clean; 630 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.9 KiB/s wr, 28 op/s 2024-01-25T15:00:09.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.447+0000 7f507705d700 1 -- 172.21.15.170:0/1117062242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5070073f50 msgr2=0x7f50700743d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:09.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.447+0000 7f507705d700 1 --2- 172.21.15.170:0/1117062242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5070073f50 0x7f50700743d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f505c009990 tx=0x7f505c009ca0 comp rx=0 tx=0).stop 2024-01-25T15:00:09.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.447+0000 7f507705d700 1 -- 172.21.15.170:0/1117062242 shutdown_connections 2024-01-25T15:00:09.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.447+0000 7f507705d700 1 --2- 172.21.15.170:0/1117062242 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5070112470 0x7f5070114860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:09.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.447+0000 7f507705d700 1 --2- 172.21.15.170:0/1117062242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5070075810 0x7f5070073a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:09.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.447+0000 7f507705d700 1 --2- 172.21.15.170:0/1117062242 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5070073f50 0x7f50700743d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:09.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.447+0000 7f507705d700 1 -- 172.21.15.170:0/1117062242 >> 172.21.15.170:0/1117062242 conn(0x7f5070078910 msgr2=0x7f5070078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:09.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.447+0000 7f507705d700 1 -- 172.21.15.170:0/1117062242 shutdown_connections 2024-01-25T15:00:09.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.447+0000 7f507705d700 1 -- 172.21.15.170:0/1117062242 wait complete. 2024-01-25T15:00:09.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.447+0000 7f507705d700 1 Processor -- start 2024-01-25T15:00:09.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.447+0000 7f507705d700 1 -- start start 2024-01-25T15:00:09.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f507705d700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5070073f50 0x7f507019e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:09.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f507705d700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5070075810 0x7f507019e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:09.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f507705d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5070112470 0x7f50701a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:09.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f507705d700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50701a3100 con 0x7f5070112470 2024-01-25T15:00:09.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f507705d700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50701a3270 con 0x7f5070075810 2024-01-25T15:00:09.450 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f507705d700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50701a3430 con 0x7f5070073f50 2024-01-25T15:00:09.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f50755fa700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5070112470 0x7f50701a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:09.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f50755fa700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5070112470 0x7f50701a2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53552/0 (socket says 172.21.15.170:53552) 2024-01-25T15:00:09.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f50755fa700 1 -- 172.21.15.170:0/2920817549 learned_addr learned my addr 172.21.15.170:0/2920817549 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:09.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f506ffff700 1 --2- 172.21.15.170:0/2920817549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5070075810 0x7f507019e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:09.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f5074df9700 1 --2- 172.21.15.170:0/2920817549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5070073f50 0x7f507019e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:09.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f50755fa700 1 -- 172.21.15.170:0/2920817549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5070073f50 msgr2=0x7f507019e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:09.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f50755fa700 1 --2- 172.21.15.170:0/2920817549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5070073f50 0x7f507019e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:09.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f50755fa700 1 -- 172.21.15.170:0/2920817549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5070075810 msgr2=0x7f507019e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:09.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f50755fa700 1 --2- 172.21.15.170:0/2920817549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5070075810 0x7f507019e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:09.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f50755fa700 1 -- 172.21.15.170:0/2920817549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c0095f0 con 0x7f5070112470 2024-01-25T15:00:09.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f50755fa700 1 --2- 172.21.15.170:0/2920817549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5070112470 0x7f50701a2af0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f50680094f0 tx=0x7f506800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:09.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f506dffb700 1 -- 172.21.15.170:0/2920817549 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068004db0 con 0x7f5070112470 2024-01-25T15:00:09.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f506dffb700 1 -- 172.21.15.170:0/2920817549 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f506800f040 con 0x7f5070112470 2024-01-25T15:00:09.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f507705d700 1 -- 172.21.15.170:0/2920817549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50701a3710 con 0x7f5070112470 2024-01-25T15:00:09.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.448+0000 7f506dffb700 1 -- 172.21.15.170:0/2920817549 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068005980 con 0x7f5070112470 2024-01-25T15:00:09.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.449+0000 7f507705d700 1 -- 172.21.15.170:0/2920817549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50701aaf70 con 0x7f5070112470 2024-01-25T15:00:09.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.450+0000 7f507705d700 1 -- 172.21.15.170:0/2920817549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50700684a0 con 0x7f5070112470 2024-01-25T15:00:09.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.450+0000 7f506dffb700 1 -- 172.21.15.170:0/2920817549 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f5068005020 con 0x7f5070112470 2024-01-25T15:00:09.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.451+0000 7f506dffb700 1 --2- 172.21.15.170:0/2920817549 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f50600a1400 0x7f50600a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:09.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.451+0000 7f5074df9700 1 --2- 172.21.15.170:0/2920817549 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f50600a1400 0x7f50600a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:09.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.451+0000 7f506dffb700 1 -- 172.21.15.170:0/2920817549 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f50680cc3d0 con 0x7f5070112470 2024-01-25T15:00:09.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.452+0000 7f5074df9700 1 --2- 172.21.15.170:0/2920817549 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f50600a1400 0x7f50600a38c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5064007be0 tx=0x7f50640073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:09.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.457+0000 7f506dffb700 1 -- 172.21.15.170:0/2920817549 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f50680958a0 con 0x7f5070112470 2024-01-25T15:00:09.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:09 smithi191 ceph-mon[36347]: pgmap v291: 97 pgs: 97 active+clean; 630 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.9 KiB/s wr, 28 op/s 2024-01-25T15:00:09.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.649+0000 7f507705d700 1 -- 172.21.15.170:0/2920817549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5070117cf0 con 0x7f5070112470 2024-01-25T15:00:09.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.651+0000 7f506dffb700 1 -- 172.21.15.170:0/2920817549 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22163 (secure 0 0 0) 0x7f5068095030 con 0x7f5070112470 2024-01-25T15:00:09.651 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:00:09.652 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":85,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T14:59:55.196363+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:00:09.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.653+0000 7f507705d700 1 -- 172.21.15.170:0/2920817549 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f50600a1400 msgr2=0x7f50600a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:09.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.653+0000 7f507705d700 1 --2- 172.21.15.170:0/2920817549 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f50600a1400 0x7f50600a38c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5064007be0 tx=0x7f50640073d0 comp rx=0 tx=0).stop 2024-01-25T15:00:09.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.653+0000 7f507705d700 1 -- 172.21.15.170:0/2920817549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5070112470 msgr2=0x7f50701a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:09.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.653+0000 7f507705d700 1 --2- 172.21.15.170:0/2920817549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5070112470 0x7f50701a2af0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f50680094f0 tx=0x7f506800d3b0 comp rx=0 tx=0).stop 2024-01-25T15:00:09.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.653+0000 7f507705d700 1 -- 172.21.15.170:0/2920817549 shutdown_connections 2024-01-25T15:00:09.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.653+0000 7f507705d700 1 --2- 172.21.15.170:0/2920817549 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f50600a1400 0x7f50600a38c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:09.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.653+0000 7f507705d700 1 --2- 172.21.15.170:0/2920817549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5070073f50 0x7f507019e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:09.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.653+0000 7f507705d700 1 --2- 172.21.15.170:0/2920817549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5070112470 0x7f50701a2af0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:09.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.653+0000 7f507705d700 1 --2- 172.21.15.170:0/2920817549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5070075810 0x7f507019e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:09.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.653+0000 7f507705d700 1 -- 172.21.15.170:0/2920817549 >> 172.21.15.170:0/2920817549 conn(0x7f5070078910 msgr2=0x7f50701111d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:09.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.653+0000 7f507705d700 1 -- 172.21.15.170:0/2920817549 shutdown_connections 2024-01-25T15:00:09.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:09.653+0000 7f507705d700 1 -- 172.21.15.170:0/2920817549 wait complete. 2024-01-25T15:00:10.253 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:10 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2920817549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:00:10.280 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-01-25T15:00:10.281 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd dump --format=json 2024-01-25T15:00:10.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:10 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2920817549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:00:10.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:10 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2920817549' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:00:10.520 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:11.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:11 smithi186 ceph-mon[35697]: pgmap v292: 97 pgs: 97 active+clean; 630 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 22 op/s 2024-01-25T15:00:11.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:11 smithi170 ceph-mon[31899]: pgmap v292: 97 pgs: 97 active+clean; 630 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 22 op/s 2024-01-25T15:00:11.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:11 smithi191 ceph-mon[36347]: pgmap v292: 97 pgs: 97 active+clean; 630 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 KiB/s wr, 22 op/s 2024-01-25T15:00:12.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.196+0000 7fa0ab4a2700 1 -- 172.21.15.170:0/3420198312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0a4102250 msgr2=0x7fa0a410e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:12.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.196+0000 7fa0ab4a2700 1 --2- 172.21.15.170:0/3420198312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0a4102250 0x7fa0a410e640 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00b0a0 tx=0x7fa09c00b3b0 comp rx=0 tx=0).stop 2024-01-25T15:00:12.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.197+0000 7fa0ab4a2700 1 -- 172.21.15.170:0/3420198312 shutdown_connections 2024-01-25T15:00:12.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.197+0000 7fa0ab4a2700 1 --2- 172.21.15.170:0/3420198312 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0a41067b0 0x7fa0a4106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:12.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.197+0000 7fa0ab4a2700 1 --2- 172.21.15.170:0/3420198312 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0a4102250 0x7fa0a410e640 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:12.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.197+0000 7fa0ab4a2700 1 --2- 172.21.15.170:0/3420198312 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0a4101890 0x7fa0a4101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:12.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.197+0000 7fa0ab4a2700 1 -- 172.21.15.170:0/3420198312 >> 172.21.15.170:0/3420198312 conn(0x7fa0a40788b0 msgr2=0x7fa0a4078cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:12.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.197+0000 7fa0ab4a2700 1 -- 172.21.15.170:0/3420198312 shutdown_connections 2024-01-25T15:00:12.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.197+0000 7fa0ab4a2700 1 -- 172.21.15.170:0/3420198312 wait complete. 2024-01-25T15:00:12.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.197+0000 7fa0ab4a2700 1 Processor -- start 2024-01-25T15:00:12.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.197+0000 7fa0ab4a2700 1 -- start start 2024-01-25T15:00:12.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.197+0000 7fa0ab4a2700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0a4101890 0x7fa0a419da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:12.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.197+0000 7fa0ab4a2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0a4102250 0x7fa0a419dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:12.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.197+0000 7fa0ab4a2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0a41067b0 0x7fa0a4197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:12.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.197+0000 7fa0ab4a2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a41982e0 con 0x7fa0a41067b0 2024-01-25T15:00:12.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.197+0000 7fa0ab4a2700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4198450 con 0x7fa0a4101890 2024-01-25T15:00:12.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.197+0000 7fa0ab4a2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4198610 con 0x7fa0a4102250 2024-01-25T15:00:12.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa0a9a3f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0a41067b0 0x7fa0a4197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:12.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa0a9a3f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0a41067b0 0x7fa0a4197b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53566/0 (socket says 172.21.15.170:53566) 2024-01-25T15:00:12.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa0a9a3f700 1 -- 172.21.15.170:0/2572707398 learned_addr learned my addr 172.21.15.170:0/2572707398 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:12.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa0a923e700 1 --2- 172.21.15.170:0/2572707398 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0a4101890 0x7fa0a419da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:12.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa0a8a3d700 1 --2- 172.21.15.170:0/2572707398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0a4102250 0x7fa0a419dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:12.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa0a9a3f700 1 -- 172.21.15.170:0/2572707398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0a4102250 msgr2=0x7fa0a419dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:12.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa0a9a3f700 1 --2- 172.21.15.170:0/2572707398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0a4102250 0x7fa0a419dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:12.203 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa0a9a3f700 1 -- 172.21.15.170:0/2572707398 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0a4101890 msgr2=0x7fa0a419da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:12.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa0a9a3f700 1 --2- 172.21.15.170:0/2572707398 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0a4101890 0x7fa0a419da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:12.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa0a9a3f700 1 -- 172.21.15.170:0/2572707398 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c009d00 con 0x7fa0a41067b0 2024-01-25T15:00:12.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa0a9a3f700 1 --2- 172.21.15.170:0/2572707398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0a41067b0 0x7fa0a4197b30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00b830 tx=0x7fa09c0077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:12.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa09a7fc700 1 -- 172.21.15.170:0/2572707398 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c00e040 con 0x7fa0a41067b0 2024-01-25T15:00:12.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa09a7fc700 1 -- 172.21.15.170:0/2572707398 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa09c004e60 con 0x7fa0a41067b0 2024-01-25T15:00:12.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa0ab4a2700 1 -- 172.21.15.170:0/2572707398 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a4198890 con 0x7fa0a41067b0 2024-01-25T15:00:12.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa09a7fc700 1 -- 172.21.15.170:0/2572707398 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c0053c0 con 0x7fa0a41067b0 2024-01-25T15:00:12.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.198+0000 7fa0ab4a2700 1 -- 172.21.15.170:0/2572707398 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a41a49e0 con 0x7fa0a41067b0 2024-01-25T15:00:12.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.199+0000 7fa0ab4a2700 1 -- 172.21.15.170:0/2572707398 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a4109d00 con 0x7fa0a41067b0 2024-01-25T15:00:12.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.201+0000 7fa09a7fc700 1 -- 172.21.15.170:0/2572707398 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fa09c01b450 con 0x7fa0a41067b0 2024-01-25T15:00:12.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.201+0000 7fa09a7fc700 1 --2- 172.21.15.170:0/2572707398 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa0900a1400 0x7fa0900a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:12.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.201+0000 7fa0a923e700 1 --2- 172.21.15.170:0/2572707398 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa0900a1400 0x7fa0900a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:12.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.201+0000 7fa09a7fc700 1 -- 172.21.15.170:0/2572707398 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa09c0ceb10 con 0x7fa0a41067b0 2024-01-25T15:00:12.205 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.202+0000 7fa0a923e700 1 --2- 172.21.15.170:0/2572707398 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa0900a1400 0x7fa0900a38c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000ac50 tx=0x7fa0a000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:12.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.205+0000 7fa09a7fc700 1 -- 172.21.15.170:0/2572707398 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa09c098070 con 0x7fa0a41067b0 2024-01-25T15:00:12.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.398+0000 7fa0ab4a2700 1 -- 172.21.15.170:0/2572707398 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0a4102f20 con 0x7fa0a41067b0 2024-01-25T15:00:12.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.399+0000 7fa09a7fc700 1 -- 172.21.15.170:0/2572707398 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22163 (secure 0 0 0) 0x7fa09c09b690 con 0x7fa0a41067b0 2024-01-25T15:00:12.400 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:00:12.401 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":85,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T14:59:55.196363+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:00:12.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.401+0000 7fa0ab4a2700 1 -- 172.21.15.170:0/2572707398 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa0900a1400 msgr2=0x7fa0900a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:12.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.401+0000 7fa0ab4a2700 1 --2- 172.21.15.170:0/2572707398 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa0900a1400 0x7fa0900a38c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000ac50 tx=0x7fa0a000a380 comp rx=0 tx=0).stop 2024-01-25T15:00:12.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.401+0000 7fa0ab4a2700 1 -- 172.21.15.170:0/2572707398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0a41067b0 msgr2=0x7fa0a4197b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:12.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.401+0000 7fa0ab4a2700 1 --2- 172.21.15.170:0/2572707398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0a41067b0 0x7fa0a4197b30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00b830 tx=0x7fa09c0077f0 comp rx=0 tx=0).stop 2024-01-25T15:00:12.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.401+0000 7fa0ab4a2700 1 -- 172.21.15.170:0/2572707398 shutdown_connections 2024-01-25T15:00:12.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.401+0000 7fa0ab4a2700 1 --2- 172.21.15.170:0/2572707398 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa0900a1400 0x7fa0900a38c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:12.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.401+0000 7fa0ab4a2700 1 --2- 172.21.15.170:0/2572707398 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa0a41067b0 0x7fa0a4197b30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:12.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.401+0000 7fa0ab4a2700 1 --2- 172.21.15.170:0/2572707398 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa0a4101890 0x7fa0a419da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:12.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.402+0000 7fa0ab4a2700 1 --2- 172.21.15.170:0/2572707398 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa0a4102250 0x7fa0a419dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:12.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.402+0000 7fa0ab4a2700 1 -- 172.21.15.170:0/2572707398 >> 172.21.15.170:0/2572707398 conn(0x7fa0a40788b0 msgr2=0x7fa0a40ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:12.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.402+0000 7fa0ab4a2700 1 -- 172.21.15.170:0/2572707398 shutdown_connections 2024-01-25T15:00:12.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:12.402+0000 7fa0ab4a2700 1 -- 172.21.15.170:0/2572707398 wait complete. 2024-01-25T15:00:13.038 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-01-25T15:00:13.038 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-01-25T15:00:13.039 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-01-25T15:00:13.039 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-01-25T15:00:13.040 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-01-25T15:00:13.040 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-01-25T15:00:13.040 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-01-25T15:00:13.041 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-01-25T15:00:13.041 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph tell osd.8 flush_pg_stats 2024-01-25T15:00:13.042 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph tell osd.9 flush_pg_stats 2024-01-25T15:00:13.042 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph tell osd.10 flush_pg_stats 2024-01-25T15:00:13.042 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph tell osd.11 flush_pg_stats 2024-01-25T15:00:13.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:13 smithi170 ceph-mon[31899]: pgmap v293: 97 pgs: 97 active+clean; 630 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 19 op/s 2024-01-25T15:00:13.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:13 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2572707398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:00:13.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:13 smithi186 ceph-mon[35697]: pgmap v293: 97 pgs: 97 active+clean; 630 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 19 op/s 2024-01-25T15:00:13.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:13 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2572707398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:00:13.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:13 smithi191 ceph-mon[36347]: pgmap v293: 97 pgs: 97 active+clean; 630 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 19 op/s 2024-01-25T15:00:13.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:13 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2572707398' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:00:13.867 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:13.870 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:13.871 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:13.873 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:13.874 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:13.874 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:13.880 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:13.882 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:13.904 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:13.907 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:13.911 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:13.964 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:15.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:15 smithi186 ceph-mon[35697]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 KiB/s wr, 18 op/s 2024-01-25T15:00:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:15 smithi170 ceph-mon[31899]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 KiB/s wr, 18 op/s 2024-01-25T15:00:15.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:15 smithi191 ceph-mon[36347]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 KiB/s wr, 18 op/s 2024-01-25T15:00:17.522 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:17 smithi170 ceph-mon[31899]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-01-25T15:00:17.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:17 smithi186 ceph-mon[35697]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-01-25T15:00:17.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:17 smithi191 ceph-mon[36347]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-01-25T15:00:19.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:19 smithi170 ceph-mon[31899]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-01-25T15:00:19.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:19 smithi186 ceph-mon[35697]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-01-25T15:00:19.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:19 smithi191 ceph-mon[36347]: pgmap v296: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.1 KiB/s wr, 12 op/s 2024-01-25T15:00:21.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:21 smithi186 ceph-mon[35697]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 10 op/s 2024-01-25T15:00:21.614 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:21 smithi170 ceph-mon[31899]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 10 op/s 2024-01-25T15:00:21.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:21 smithi191 ceph-mon[36347]: pgmap v297: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1023 B/s wr, 10 op/s 2024-01-25T15:00:22.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.890+0000 7f1499edb700 1 -- 172.21.15.170:0/1562271952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f149410bed0 msgr2=0x7f149410e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.890+0000 7f1499edb700 1 --2- 172.21.15.170:0/1562271952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f149410bed0 0x7f149410e300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f148c00b0a0 tx=0x7f148c00b3b0 comp rx=0 tx=0).stop 2024-01-25T15:00:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.890+0000 7f1499edb700 1 -- 172.21.15.170:0/1562271952 shutdown_connections 2024-01-25T15:00:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.890+0000 7f1499edb700 1 --2- 172.21.15.170:0/1562271952 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f149410bed0 0x7f149410e300 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.890+0000 7f1499edb700 1 --2- 172.21.15.170:0/1562271952 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1494102af0 0x7f1494102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.890+0000 7f1499edb700 1 --2- 172.21.15.170:0/1562271952 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1494103410 0x7f149410b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.890+0000 7f1499edb700 1 -- 172.21.15.170:0/1562271952 >> 172.21.15.170:0/1562271952 conn(0x7f1494077810 msgr2=0x7f1494077c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.890+0000 7f1499edb700 1 -- 172.21.15.170:0/1562271952 shutdown_connections 2024-01-25T15:00:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.891+0000 7f1499edb700 1 -- 172.21.15.170:0/1562271952 wait complete. 2024-01-25T15:00:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.891+0000 7f1499edb700 1 Processor -- start 2024-01-25T15:00:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.891+0000 7f1499edb700 1 -- start start 2024-01-25T15:00:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.891+0000 7f1499edb700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1494102af0 0x7f1494102340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.891+0000 7f1499edb700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1494103410 0x7f1494100750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:22.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.891+0000 7f1499edb700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f149410bed0 0x7f1494100db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.891+0000 7f1499edb700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1494101580 con 0x7f149410bed0 2024-01-25T15:00:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.891+0000 7f1499edb700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14941aa8c0 con 0x7f1494102af0 2024-01-25T15:00:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.891+0000 7f1499edb700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14941aaa30 con 0x7f1494103410 2024-01-25T15:00:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f1493fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f149410bed0 0x7f1494100db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f1493fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f149410bed0 0x7f1494100db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49570/0 (socket says 172.21.15.170:49570) 2024-01-25T15:00:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f1493fff700 1 -- 172.21.15.170:0/2439569008 learned_addr learned my addr 172.21.15.170:0/2439569008 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f1492ffd700 1 --2- 172.21.15.170:0/2439569008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1494103410 0x7f1494100750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f14937fe700 1 --2- 172.21.15.170:0/2439569008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1494102af0 0x7f1494102340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f1493fff700 1 -- 172.21.15.170:0/2439569008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1494103410 msgr2=0x7f1494100750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f1493fff700 1 --2- 172.21.15.170:0/2439569008 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1494103410 0x7f1494100750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f1493fff700 1 -- 172.21.15.170:0/2439569008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1494102af0 msgr2=0x7f1494102340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f1493fff700 1 --2- 172.21.15.170:0/2439569008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1494102af0 0x7f1494102340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f1493fff700 1 -- 172.21.15.170:0/2439569008 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c009d00 con 0x7f149410bed0 2024-01-25T15:00:22.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f14937fe700 1 --2- 172.21.15.170:0/2439569008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1494102af0 0x7f1494102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:00:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f1493fff700 1 --2- 172.21.15.170:0/2439569008 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f149410bed0 0x7f1494100db0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f148c006070 tx=0x7f148c0077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f1490ff9700 1 -- 172.21.15.170:0/2439569008 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c00e040 con 0x7f149410bed0 2024-01-25T15:00:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f1499edb700 1 -- 172.21.15.170:0/2439569008 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14941aacb0 con 0x7f149410bed0 2024-01-25T15:00:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f1490ff9700 1 -- 172.21.15.170:0/2439569008 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f148c003c10 con 0x7f149410bed0 2024-01-25T15:00:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f1490ff9700 1 -- 172.21.15.170:0/2439569008 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c01c660 con 0x7f149410bed0 2024-01-25T15:00:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.892+0000 7f1499edb700 1 -- 172.21.15.170:0/2439569008 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14941ab150 con 0x7f149410bed0 2024-01-25T15:00:22.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.893+0000 7f1499edb700 1 -- 172.21.15.170:0/2439569008 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1494111b70 con 0x7f149410bed0 2024-01-25T15:00:22.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.894+0000 7f1490ff9700 1 -- 172.21.15.170:0/2439569008 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f148c005040 con 0x7f149410bed0 2024-01-25T15:00:22.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.895+0000 7f1490ff9700 1 --2- 172.21.15.170:0/2439569008 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f147c0a1400 0x7f147c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.895+0000 7f14937fe700 1 --2- 172.21.15.170:0/2439569008 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f147c0a1400 0x7f147c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.895+0000 7f1490ff9700 1 -- 172.21.15.170:0/2439569008 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f148c0cdfd0 con 0x7f149410bed0 2024-01-25T15:00:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.895+0000 7f1490ff9700 1 --2- 172.21.15.170:0/2439569008 >> [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883] conn(0x7f147c0aabe0 0x7f147c0ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.895+0000 7f1490ff9700 1 -- 172.21.15.170:0/2439569008 --> [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f147c0ad6b0 con 0x7f147c0aabe0 2024-01-25T15:00:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.895+0000 7f1490ff9700 1 -- 172.21.15.170:0/2439569008 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f148c0ce470 con 0x7f149410bed0 2024-01-25T15:00:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.895+0000 7f14937fe700 1 --2- 172.21.15.170:0/2439569008 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f147c0a1400 0x7f147c0a38c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1484007900 tx=0x7f1484008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.895+0000 7f1492ffd700 1 --2- 172.21.15.170:0/2439569008 >> [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883] conn(0x7f147c0aabe0 0x7f147c0ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.896+0000 7f1492ffd700 1 --2- 172.21.15.170:0/2439569008 >> [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883] conn(0x7f147c0aabe0 0x7f147c0ad000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:22.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.897+0000 7f1490ff9700 1 -- 172.21.15.170:0/2439569008 <== osd.4 v2:172.21.15.186:6808/3679177883 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f147c0ad6b0 con 0x7f147c0aabe0 2024-01-25T15:00:22.913 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.912+0000 7f1499edb700 1 -- 172.21.15.170:0/2439569008 --> [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1494061e70 con 0x7f147c0aabe0 2024-01-25T15:00:22.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.913+0000 7f1490ff9700 1 -- 172.21.15.170:0/2439569008 <== osd.4 v2:172.21.15.186:6808/3679177883 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f1494061e70 con 0x7f147c0aabe0 2024-01-25T15:00:22.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.913+0000 7f1499edb700 1 -- 172.21.15.170:0/2439569008 >> [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883] conn(0x7f147c0aabe0 msgr2=0x7f147c0ad000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:22.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.913+0000 7f1499edb700 1 --2- 172.21.15.170:0/2439569008 >> [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883] conn(0x7f147c0aabe0 0x7f147c0ad000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:22.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.913+0000 7f1499edb700 1 -- 172.21.15.170:0/2439569008 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f147c0a1400 msgr2=0x7f147c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:22.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.913+0000 7f1499edb700 1 --2- 172.21.15.170:0/2439569008 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f147c0a1400 0x7f147c0a38c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1484007900 tx=0x7f1484008040 comp rx=0 tx=0).stop 2024-01-25T15:00:22.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.913+0000 7f1499edb700 1 -- 172.21.15.170:0/2439569008 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f149410bed0 msgr2=0x7f1494100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:22.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.913+0000 7f1499edb700 1 --2- 172.21.15.170:0/2439569008 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f149410bed0 0x7f1494100db0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f148c006070 tx=0x7f148c0077f0 comp rx=0 tx=0).stop 2024-01-25T15:00:22.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.913+0000 7f1493fff700 1 -- 172.21.15.170:0/2439569008 reap_dead start 2024-01-25T15:00:22.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.914+0000 7f1499edb700 1 -- 172.21.15.170:0/2439569008 shutdown_connections 2024-01-25T15:00:22.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.914+0000 7f1499edb700 1 -- 172.21.15.170:0/2439569008 >> 172.21.15.170:0/2439569008 conn(0x7f1494077810 msgr2=0x7f14940fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:22.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.914+0000 7f1499edb700 1 -- 172.21.15.170:0/2439569008 shutdown_connections 2024-01-25T15:00:22.915 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:22.914+0000 7f1499edb700 1 -- 172.21.15.170:0/2439569008 wait complete. 2024-01-25T15:00:23.545 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:23 smithi170 ceph-mon[31899]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-01-25T15:00:23.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:23 smithi186 ceph-mon[35697]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-01-25T15:00:23.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:23 smithi191 ceph-mon[36347]: pgmap v298: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1023 B/s wr, 9 op/s 2024-01-25T15:00:24.767 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.765+0000 7f35e6e97700 1 -- 172.21.15.170:0/1082900099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35e0106850 msgr2=0x7f35e0106c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:24.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.765+0000 7f35e6e97700 1 --2- 172.21.15.170:0/1082900099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35e0106850 0x7f35e0106c30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f35d800b0a0 tx=0x7f35d800b3b0 comp rx=0 tx=0).stop 2024-01-25T15:00:24.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.765+0000 7f35e6e97700 1 -- 172.21.15.170:0/1082900099 shutdown_connections 2024-01-25T15:00:24.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.765+0000 7f35e6e97700 1 --2- 172.21.15.170:0/1082900099 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35e0100790 0x7f35e010e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:24.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.765+0000 7f35e6e97700 1 --2- 172.21.15.170:0/1082900099 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35e0106850 0x7f35e0106c30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:24.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.765+0000 7f35e6e97700 1 --2- 172.21.15.170:0/1082900099 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35e00ffdd0 0x7f35e0100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:24.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.765+0000 7f35e6e97700 1 -- 172.21.15.170:0/1082900099 >> 172.21.15.170:0/1082900099 conn(0x7f35e0076ce0 msgr2=0x7f35e00fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:24.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.765+0000 7f35e6e97700 1 -- 172.21.15.170:0/1082900099 shutdown_connections 2024-01-25T15:00:24.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.765+0000 7f35e6e97700 1 -- 172.21.15.170:0/1082900099 wait complete. 2024-01-25T15:00:24.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.765+0000 7f35e6e97700 1 Processor -- start 2024-01-25T15:00:24.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.765+0000 7f35e6e97700 1 -- start start 2024-01-25T15:00:24.768 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35e6e97700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35e00ffdd0 0x7f35e0197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:24.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35e6e97700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35e0100790 0x7f35e01984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:24.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35e6e97700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35e0106850 0x7f35e019c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:24.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35e6e97700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e019ce40 con 0x7f35e0100790 2024-01-25T15:00:24.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35e6e97700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e019cfb0 con 0x7f35e0106850 2024-01-25T15:00:24.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35e6e97700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e019d170 con 0x7f35e00ffdd0 2024-01-25T15:00:24.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35dffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35e0100790 0x7f35e01984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:24.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35dffff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35e0100790 0x7f35e01984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49590/0 (socket says 172.21.15.170:49590) 2024-01-25T15:00:24.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35dffff700 1 -- 172.21.15.170:0/1452335560 learned_addr learned my addr 172.21.15.170:0/1452335560 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:24.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35e5434700 1 --2- 172.21.15.170:0/1452335560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35e0106850 0x7f35e019c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:24.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35e4c33700 1 --2- 172.21.15.170:0/1452335560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35e00ffdd0 0x7f35e0197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:24.769 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35dffff700 1 -- 172.21.15.170:0/1452335560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35e00ffdd0 msgr2=0x7f35e0197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:24.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35dffff700 1 --2- 172.21.15.170:0/1452335560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f35e00ffdd0 0x7f35e0197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:24.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35dffff700 1 -- 172.21.15.170:0/1452335560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35e0106850 msgr2=0x7f35e019c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:24.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35dffff700 1 --2- 172.21.15.170:0/1452335560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35e0106850 0x7f35e019c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:24.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35dffff700 1 -- 172.21.15.170:0/1452335560 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d8009d00 con 0x7f35e0100790 2024-01-25T15:00:24.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35dffff700 1 --2- 172.21.15.170:0/1452335560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35e0100790 0x7f35e01984a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f35c800b530 tx=0x7f35c800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:24.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35ddffb700 1 -- 172.21.15.170:0/1452335560 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8011830 con 0x7f35e0100790 2024-01-25T15:00:24.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35ddffb700 1 -- 172.21.15.170:0/1452335560 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f35c8011e50 con 0x7f35e0100790 2024-01-25T15:00:24.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35e6e97700 1 -- 172.21.15.170:0/1452335560 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e019d450 con 0x7f35e0100790 2024-01-25T15:00:24.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.766+0000 7f35ddffb700 1 -- 172.21.15.170:0/1452335560 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c800f2e0 con 0x7f35e0100790 2024-01-25T15:00:24.770 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.767+0000 7f35e6e97700 1 -- 172.21.15.170:0/1452335560 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e01a4cb0 con 0x7f35e0100790 2024-01-25T15:00:24.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.767+0000 7f35e6e97700 1 -- 172.21.15.170:0/1452335560 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f35e0111c40 con 0x7f35e0100790 2024-01-25T15:00:24.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.769+0000 7f35ddffb700 1 -- 172.21.15.170:0/1452335560 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f35c80105a0 con 0x7f35e0100790 2024-01-25T15:00:24.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.769+0000 7f35ddffb700 1 --2- 172.21.15.170:0/1452335560 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f35cc0a1400 0x7f35cc0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:24.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.769+0000 7f35e4c33700 1 --2- 172.21.15.170:0/1452335560 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f35cc0a1400 0x7f35cc0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:24.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.769+0000 7f35ddffb700 1 -- 172.21.15.170:0/1452335560 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f35c80cca10 con 0x7f35e0100790 2024-01-25T15:00:24.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.769+0000 7f35ddffb700 1 --2- 172.21.15.170:0/1452335560 >> [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632] conn(0x7f35cc0aabe0 0x7f35cc0ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:24.773 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.769+0000 7f35ddffb700 1 -- 172.21.15.170:0/1452335560 --> [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35cc0ad6b0 con 0x7f35cc0aabe0 2024-01-25T15:00:24.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.769+0000 7f35ddffb700 1 -- 172.21.15.170:0/1452335560 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35c80cceb0 con 0x7f35e0100790 2024-01-25T15:00:24.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.770+0000 7f35e4c33700 1 --2- 172.21.15.170:0/1452335560 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f35cc0a1400 0x7f35cc0a38c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009fd0 tx=0x7f35d800b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:24.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.770+0000 7f35e5434700 1 --2- 172.21.15.170:0/1452335560 >> [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632] conn(0x7f35cc0aabe0 0x7f35cc0ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:24.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.770+0000 7f35e5434700 1 --2- 172.21.15.170:0/1452335560 >> [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632] conn(0x7f35cc0aabe0 0x7f35cc0ad000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:24.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.771+0000 7f35ddffb700 1 -- 172.21.15.170:0/1452335560 <== osd.1 v2:172.21.15.186:6800/694515632 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f35cc0ad6b0 con 0x7f35cc0aabe0 2024-01-25T15:00:24.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.788+0000 7f35e6e97700 1 -- 172.21.15.170:0/1452335560 --> [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f35e0061ef0 con 0x7f35cc0aabe0 2024-01-25T15:00:24.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.789+0000 7f35ddffb700 1 -- 172.21.15.170:0/1452335560 <== osd.1 v2:172.21.15.186:6800/694515632 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f35e0061ef0 con 0x7f35cc0aabe0 2024-01-25T15:00:24.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.789+0000 7f35e6e97700 1 -- 172.21.15.170:0/1452335560 >> [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632] conn(0x7f35cc0aabe0 msgr2=0x7f35cc0ad000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:24.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.789+0000 7f35e6e97700 1 --2- 172.21.15.170:0/1452335560 >> [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632] conn(0x7f35cc0aabe0 0x7f35cc0ad000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:24.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.789+0000 7f35e6e97700 1 -- 172.21.15.170:0/1452335560 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f35cc0a1400 msgr2=0x7f35cc0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:24.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.789+0000 7f35e6e97700 1 --2- 172.21.15.170:0/1452335560 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f35cc0a1400 0x7f35cc0a38c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009fd0 tx=0x7f35d800b7b0 comp rx=0 tx=0).stop 2024-01-25T15:00:24.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.789+0000 7f35e6e97700 1 -- 172.21.15.170:0/1452335560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35e0100790 msgr2=0x7f35e01984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:24.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.789+0000 7f35e6e97700 1 --2- 172.21.15.170:0/1452335560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f35e0100790 0x7f35e01984a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f35c800b530 tx=0x7f35c800b840 comp rx=0 tx=0).stop 2024-01-25T15:00:24.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.789+0000 7f35e5434700 1 -- 172.21.15.170:0/1452335560 reap_dead start 2024-01-25T15:00:24.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.789+0000 7f35e6e97700 1 -- 172.21.15.170:0/1452335560 shutdown_connections 2024-01-25T15:00:24.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.789+0000 7f35e6e97700 1 -- 172.21.15.170:0/1452335560 >> 172.21.15.170:0/1452335560 conn(0x7f35e0076ce0 msgr2=0x7f35e0104930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:24.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.789+0000 7f35e6e97700 1 -- 172.21.15.170:0/1452335560 shutdown_connections 2024-01-25T15:00:24.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.789+0000 7f35e6e97700 1 -- 172.21.15.170:0/1452335560 wait complete. 2024-01-25T15:00:25.553 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:25 smithi170 ceph-mon[31899]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 11 op/s 2024-01-25T15:00:25.581 INFO:teuthology.orchestra.run.smithi170.stdout:141733920822 2024-01-25T15:00:25.582 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-01-25T15:00:25.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:25 smithi186 ceph-mon[35697]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 11 op/s 2024-01-25T15:00:25.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:25 smithi191 ceph-mon[36347]: pgmap v299: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1023 B/s wr, 11 op/s 2024-01-25T15:00:26.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.193+0000 7f2b780bd700 1 -- 172.21.15.170:0/4042171801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b70069490 msgr2=0x7f2b700698f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:26.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.193+0000 7f2b780bd700 1 --2- 172.21.15.170:0/4042171801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b70069490 0x7f2b700698f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2b600099c0 tx=0x7f2b60009cd0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.193+0000 7f2b780bd700 1 -- 172.21.15.170:0/4042171801 shutdown_connections 2024-01-25T15:00:26.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.193+0000 7f2b780bd700 1 --2- 172.21.15.170:0/4042171801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b70069e30 0x7f2b7010e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.193+0000 7f2b780bd700 1 --2- 172.21.15.170:0/4042171801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b701077a0 0x7f2b70107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.193+0000 7f2b780bd700 1 --2- 172.21.15.170:0/4042171801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b70069490 0x7f2b700698f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.193+0000 7f2b780bd700 1 -- 172.21.15.170:0/4042171801 >> 172.21.15.170:0/4042171801 conn(0x7f2b70077610 msgr2=0x7f2b70077a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:26.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.193+0000 7f2b780bd700 1 -- 172.21.15.170:0/4042171801 shutdown_connections 2024-01-25T15:00:26.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.193+0000 7f2b780bd700 1 -- 172.21.15.170:0/4042171801 wait complete. 2024-01-25T15:00:26.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b780bd700 1 Processor -- start 2024-01-25T15:00:26.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b780bd700 1 -- start start 2024-01-25T15:00:26.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b780bd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b70069490 0x7f2b701007b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:26.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b780bd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b70069e30 0x7f2b70100cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:26.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b780bd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b701077a0 0x7f2b70101230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:26.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b780bd700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701a6000 con 0x7f2b70069490 2024-01-25T15:00:26.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b780bd700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701a6170 con 0x7f2b70069e30 2024-01-25T15:00:26.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b780bd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701a6330 con 0x7f2b701077a0 2024-01-25T15:00:26.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b75e59700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b70069490 0x7f2b701007b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:26.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b75e59700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b70069490 0x7f2b701007b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50218/0 (socket says 172.21.15.170:50218) 2024-01-25T15:00:26.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b75e59700 1 -- 172.21.15.170:0/367081813 learned_addr learned my addr 172.21.15.170:0/367081813 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:26.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b75e59700 1 -- 172.21.15.170:0/367081813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b701077a0 msgr2=0x7f2b70101230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:26.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b75658700 1 --2- 172.21.15.170:0/367081813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b70069e30 0x7f2b70100cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:26.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b7665a700 1 --2- 172.21.15.170:0/367081813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b701077a0 0x7f2b70101230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:26.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b75e59700 1 --2- 172.21.15.170:0/367081813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b701077a0 0x7f2b70101230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b75e59700 1 -- 172.21.15.170:0/367081813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b70069e30 msgr2=0x7f2b70100cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:26.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b75e59700 1 --2- 172.21.15.170:0/367081813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b70069e30 0x7f2b70100cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.194+0000 7f2b75e59700 1 -- 172.21.15.170:0/367081813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b600095f0 con 0x7f2b70069490 2024-01-25T15:00:26.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.195+0000 7f2b75e59700 1 --2- 172.21.15.170:0/367081813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b70069490 0x7f2b701007b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00c9b0 tx=0x7f2b6c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:26.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.195+0000 7f2b66ffd700 1 -- 172.21.15.170:0/367081813 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c007b00 con 0x7f2b70069490 2024-01-25T15:00:26.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.195+0000 7f2b780bd700 1 -- 172.21.15.170:0/367081813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b701a6610 con 0x7f2b70069490 2024-01-25T15:00:26.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.195+0000 7f2b66ffd700 1 -- 172.21.15.170:0/367081813 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b6c007c60 con 0x7f2b70069490 2024-01-25T15:00:26.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.195+0000 7f2b66ffd700 1 -- 172.21.15.170:0/367081813 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c018660 con 0x7f2b70069490 2024-01-25T15:00:26.198 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.195+0000 7f2b780bd700 1 -- 172.21.15.170:0/367081813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b701a6b60 con 0x7f2b70069490 2024-01-25T15:00:26.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.196+0000 7f2b780bd700 1 -- 172.21.15.170:0/367081813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b701119c0 con 0x7f2b70069490 2024-01-25T15:00:26.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.197+0000 7f2b66ffd700 1 -- 172.21.15.170:0/367081813 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f2b6c018880 con 0x7f2b70069490 2024-01-25T15:00:26.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.197+0000 7f2b66ffd700 1 --2- 172.21.15.170:0/367081813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b5c0a1400 0x7f2b5c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:26.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.197+0000 7f2b75658700 1 --2- 172.21.15.170:0/367081813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b5c0a1400 0x7f2b5c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:26.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.198+0000 7f2b66ffd700 1 -- 172.21.15.170:0/367081813 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2b6c0ccf90 con 0x7f2b70069490 2024-01-25T15:00:26.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.198+0000 7f2b66ffd700 1 --2- 172.21.15.170:0/367081813 >> [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188] conn(0x7f2b5c0aabe0 0x7f2b5c0ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:26.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.198+0000 7f2b66ffd700 1 -- 172.21.15.170:0/367081813 --> [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b5c0ad6b0 con 0x7f2b5c0aabe0 2024-01-25T15:00:26.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.198+0000 7f2b66ffd700 1 -- 172.21.15.170:0/367081813 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b6c0cd430 con 0x7f2b70069490 2024-01-25T15:00:26.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.198+0000 7f2b7665a700 1 --2- 172.21.15.170:0/367081813 >> [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188] conn(0x7f2b5c0aabe0 0x7f2b5c0ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:26.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.198+0000 7f2b75658700 1 --2- 172.21.15.170:0/367081813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b5c0a1400 0x7f2b5c0a38c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2b60006010 tx=0x7f2b60000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:26.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.198+0000 7f2b7665a700 1 --2- 172.21.15.170:0/367081813 >> [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188] conn(0x7f2b5c0aabe0 0x7f2b5c0ad000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:26.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.199+0000 7f2b66ffd700 1 -- 172.21.15.170:0/367081813 <== osd.3 v2:172.21.15.170:6810/1814173188 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2b5c0ad6b0 con 0x7f2b5c0aabe0 2024-01-25T15:00:26.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.219+0000 7f2b780bd700 1 -- 172.21.15.170:0/367081813 --> [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2b70061e70 con 0x7f2b5c0aabe0 2024-01-25T15:00:26.220 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.219+0000 7f2b66ffd700 1 -- 172.21.15.170:0/367081813 <== osd.3 v2:172.21.15.170:6810/1814173188 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2b70061e70 con 0x7f2b5c0aabe0 2024-01-25T15:00:26.221 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.220+0000 7f2b780bd700 1 -- 172.21.15.170:0/367081813 >> [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188] conn(0x7f2b5c0aabe0 msgr2=0x7f2b5c0ad000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:26.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.220+0000 7f2b780bd700 1 --2- 172.21.15.170:0/367081813 >> [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188] conn(0x7f2b5c0aabe0 0x7f2b5c0ad000 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.220+0000 7f2b780bd700 1 -- 172.21.15.170:0/367081813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b5c0a1400 msgr2=0x7f2b5c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:26.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.220+0000 7f2b780bd700 1 --2- 172.21.15.170:0/367081813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b5c0a1400 0x7f2b5c0a38c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2b60006010 tx=0x7f2b60000bc0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.220+0000 7f2b780bd700 1 -- 172.21.15.170:0/367081813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b70069490 msgr2=0x7f2b701007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:26.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.220+0000 7f2b780bd700 1 --2- 172.21.15.170:0/367081813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b70069490 0x7f2b701007b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00c9b0 tx=0x7f2b6c00cd70 comp rx=0 tx=0).stop 2024-01-25T15:00:26.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.220+0000 7f2b7665a700 1 -- 172.21.15.170:0/367081813 reap_dead start 2024-01-25T15:00:26.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.220+0000 7f2b780bd700 1 -- 172.21.15.170:0/367081813 shutdown_connections 2024-01-25T15:00:26.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.220+0000 7f2b780bd700 1 -- 172.21.15.170:0/367081813 >> 172.21.15.170:0/367081813 conn(0x7f2b70077610 msgr2=0x7f2b700fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:26.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.220+0000 7f2b780bd700 1 -- 172.21.15.170:0/367081813 shutdown_connections 2024-01-25T15:00:26.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:26.220+0000 7f2b780bd700 1 -- 172.21.15.170:0/367081813 wait complete. 2024-01-25T15:00:26.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.980+0000 7faa1c598700 1 -- 172.21.15.170:0/919141259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa14101830 msgr2=0x7faa14101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:26.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.980+0000 7faa1c598700 1 --2- 172.21.15.170:0/919141259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa14101830 0x7faa14101cb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faa040099c0 tx=0x7faa04009cd0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.981+0000 7faa1c598700 1 -- 172.21.15.170:0/919141259 shutdown_connections 2024-01-25T15:00:26.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.981+0000 7faa1c598700 1 --2- 172.21.15.170:0/919141259 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa141021f0 0x7faa1410e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.981+0000 7faa1c598700 1 --2- 172.21.15.170:0/919141259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa14106650 0x7faa14106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.981+0000 7faa1c598700 1 --2- 172.21.15.170:0/919141259 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa14101830 0x7faa14101cb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.981+0000 7faa1c598700 1 -- 172.21.15.170:0/919141259 >> 172.21.15.170:0/919141259 conn(0x7faa14078910 msgr2=0x7faa14078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:26.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.981+0000 7faa1c598700 1 -- 172.21.15.170:0/919141259 shutdown_connections 2024-01-25T15:00:26.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.981+0000 7faa1c598700 1 -- 172.21.15.170:0/919141259 wait complete. 2024-01-25T15:00:26.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.981+0000 7faa1c598700 1 Processor -- start 2024-01-25T15:00:26.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.981+0000 7faa1c598700 1 -- start start 2024-01-25T15:00:26.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.981+0000 7faa1c598700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa14101830 0x7faa1419d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:26.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.981+0000 7faa1c598700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa141021f0 0x7faa1419dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:26.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.981+0000 7faa1c598700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa14106650 0x7faa14197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:26.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.981+0000 7faa1c598700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa141980b0 con 0x7faa141021f0 2024-01-25T15:00:26.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.981+0000 7faa1c598700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa141981f0 con 0x7faa14101830 2024-01-25T15:00:26.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.981+0000 7faa1c598700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa141983b0 con 0x7faa14106650 2024-01-25T15:00:26.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa19b33700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa141021f0 0x7faa1419dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:26.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa19b33700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa141021f0 0x7faa1419dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49602/0 (socket says 172.21.15.170:49602) 2024-01-25T15:00:26.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa19b33700 1 -- 172.21.15.170:0/3469928893 learned_addr learned my addr 172.21.15.170:0/3469928893 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:26.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa1ab35700 1 --2- 172.21.15.170:0/3469928893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa14106650 0x7faa14197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:26.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa1a334700 1 --2- 172.21.15.170:0/3469928893 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa14101830 0x7faa1419d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:26.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa19b33700 1 -- 172.21.15.170:0/3469928893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa14106650 msgr2=0x7faa14197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:26.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa19b33700 1 --2- 172.21.15.170:0/3469928893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa14106650 0x7faa14197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa19b33700 1 -- 172.21.15.170:0/3469928893 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa14101830 msgr2=0x7faa1419d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:26.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa19b33700 1 --2- 172.21.15.170:0/3469928893 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa14101830 0x7faa1419d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa19b33700 1 -- 172.21.15.170:0/3469928893 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa040095f0 con 0x7faa141021f0 2024-01-25T15:00:26.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa19b33700 1 --2- 172.21.15.170:0/3469928893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa141021f0 0x7faa1419dd80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faa040098e0 tx=0x7faa040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:26.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa0b7fe700 1 -- 172.21.15.170:0/3469928893 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0401d070 con 0x7faa141021f0 2024-01-25T15:00:26.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa0b7fe700 1 -- 172.21.15.170:0/3469928893 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa0400fcb0 con 0x7faa141021f0 2024-01-25T15:00:26.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa1c598700 1 -- 172.21.15.170:0/3469928893 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa14198630 con 0x7faa141021f0 2024-01-25T15:00:26.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa0b7fe700 1 -- 172.21.15.170:0/3469928893 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa04022e40 con 0x7faa141021f0 2024-01-25T15:00:26.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.982+0000 7faa1c598700 1 -- 172.21.15.170:0/3469928893 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa141a48e0 con 0x7faa141021f0 2024-01-25T15:00:26.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.983+0000 7faa1c598700 1 -- 172.21.15.170:0/3469928893 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa14102ec0 con 0x7faa141021f0 2024-01-25T15:00:26.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.984+0000 7faa0b7fe700 1 -- 172.21.15.170:0/3469928893 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7faa04022570 con 0x7faa141021f0 2024-01-25T15:00:26.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.985+0000 7faa0b7fe700 1 --2- 172.21.15.170:0/3469928893 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faa000a1400 0x7faa000a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:26.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.985+0000 7faa1a334700 1 --2- 172.21.15.170:0/3469928893 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faa000a1400 0x7faa000a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:26.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.985+0000 7faa0b7fe700 1 -- 172.21.15.170:0/3469928893 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7faa040ce520 con 0x7faa141021f0 2024-01-25T15:00:26.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.985+0000 7faa0b7fe700 1 --2- 172.21.15.170:0/3469928893 >> [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213] conn(0x7faa000aabe0 0x7faa000ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:26.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.985+0000 7faa0b7fe700 1 -- 172.21.15.170:0/3469928893 --> [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa000ad6b0 con 0x7faa000aabe0 2024-01-25T15:00:26.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.985+0000 7faa0b7fe700 1 -- 172.21.15.170:0/3469928893 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa040ce9c0 con 0x7faa141021f0 2024-01-25T15:00:26.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.985+0000 7faa1a334700 1 --2- 172.21.15.170:0/3469928893 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faa000a1400 0x7faa000a38c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faa10005950 tx=0x7faa10005c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:26.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.985+0000 7faa1ab35700 1 --2- 172.21.15.170:0/3469928893 >> [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213] conn(0x7faa000aabe0 0x7faa000ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:26.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.986+0000 7faa1ab35700 1 --2- 172.21.15.170:0/3469928893 >> [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213] conn(0x7faa000aabe0 0x7faa000ad000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:26.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:24.987+0000 7faa0b7fe700 1 -- 172.21.15.170:0/3469928893 <== osd.5 v2:172.21.15.191:6808/1800857213 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7faa000ad6b0 con 0x7faa000aabe0 2024-01-25T15:00:26.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:25.003+0000 7faa1c598700 1 -- 172.21.15.170:0/3469928893 --> [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa141119e0 con 0x7faa000aabe0 2024-01-25T15:00:26.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:25.003+0000 7faa0b7fe700 1 -- 172.21.15.170:0/3469928893 <== osd.5 v2:172.21.15.191:6808/1800857213 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7faa141119e0 con 0x7faa000aabe0 2024-01-25T15:00:26.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:25.003+0000 7faa1c598700 1 -- 172.21.15.170:0/3469928893 >> [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213] conn(0x7faa000aabe0 msgr2=0x7faa000ad000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:26.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:25.003+0000 7faa1c598700 1 --2- 172.21.15.170:0/3469928893 >> [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213] conn(0x7faa000aabe0 0x7faa000ad000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:25.004+0000 7faa1c598700 1 -- 172.21.15.170:0/3469928893 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faa000a1400 msgr2=0x7faa000a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:26.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:25.004+0000 7faa1c598700 1 --2- 172.21.15.170:0/3469928893 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faa000a1400 0x7faa000a38c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7faa10005950 tx=0x7faa10005c90 comp rx=0 tx=0).stop 2024-01-25T15:00:26.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:25.004+0000 7faa1c598700 1 -- 172.21.15.170:0/3469928893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa141021f0 msgr2=0x7faa1419dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:26.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:25.004+0000 7faa1c598700 1 --2- 172.21.15.170:0/3469928893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa141021f0 0x7faa1419dd80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faa040098e0 tx=0x7faa040057f0 comp rx=0 tx=0).stop 2024-01-25T15:00:26.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:25.004+0000 7faa1ab35700 1 -- 172.21.15.170:0/3469928893 reap_dead start 2024-01-25T15:00:26.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:25.004+0000 7faa1c598700 1 -- 172.21.15.170:0/3469928893 shutdown_connections 2024-01-25T15:00:26.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:25.004+0000 7faa1c598700 1 -- 172.21.15.170:0/3469928893 >> 172.21.15.170:0/3469928893 conn(0x7faa14078910 msgr2=0x7faa140ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:26.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:25.004+0000 7faa1c598700 1 -- 172.21.15.170:0/3469928893 shutdown_connections 2024-01-25T15:00:26.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:25.004+0000 7faa1c598700 1 -- 172.21.15.170:0/3469928893 wait complete. 2024-01-25T15:00:27.175 INFO:teuthology.orchestra.run.smithi170.stdout:163208757297 2024-01-25T15:00:27.176 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-01-25T15:00:27.404 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:27 smithi170 ceph-mon[31899]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-01-25T15:00:27.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:27 smithi186 ceph-mon[35697]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-01-25T15:00:27.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:27 smithi191 ceph-mon[36347]: pgmap v300: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-01-25T15:00:27.778 INFO:teuthology.orchestra.run.smithi170.stdout:107374182459 2024-01-25T15:00:27.779 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-01-25T15:00:27.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.964+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/2095508753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0b0101830 msgr2=0x7fd0b0101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:27.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.964+0000 7fd0b4c0e700 1 --2- 172.21.15.170:0/2095508753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0b0101830 0x7fd0b0101cb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd0a40099c0 tx=0x7fd0a4009cd0 comp rx=0 tx=0).stop 2024-01-25T15:00:27.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.964+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/2095508753 shutdown_connections 2024-01-25T15:00:27.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.964+0000 7fd0b4c0e700 1 --2- 172.21.15.170:0/2095508753 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0b0106650 0x7fd0b0106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:27.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.964+0000 7fd0b4c0e700 1 --2- 172.21.15.170:0/2095508753 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0b01021f0 0x7fd0b010e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:27.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.964+0000 7fd0b4c0e700 1 --2- 172.21.15.170:0/2095508753 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0b0101830 0x7fd0b0101cb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:27.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.964+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/2095508753 >> 172.21.15.170:0/2095508753 conn(0x7fd0b0078910 msgr2=0x7fd0b0078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:27.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.964+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/2095508753 shutdown_connections 2024-01-25T15:00:27.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.964+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/2095508753 wait complete. 2024-01-25T15:00:27.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.965+0000 7fd0b4c0e700 1 Processor -- start 2024-01-25T15:00:27.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.965+0000 7fd0b4c0e700 1 -- start start 2024-01-25T15:00:27.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.965+0000 7fd0b4c0e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0b0101830 0x7fd0b019d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:27.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.965+0000 7fd0b4c0e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0b01021f0 0x7fd0b019ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:27.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.965+0000 7fd0b4c0e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0b0106650 0x7fd0b0197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:27.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.965+0000 7fd0b4c0e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b01980d0 con 0x7fd0b01021f0 2024-01-25T15:00:27.968 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.965+0000 7fd0b4c0e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b0198210 con 0x7fd0b0106650 2024-01-25T15:00:27.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.965+0000 7fd0b4c0e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b01983d0 con 0x7fd0b0101830 2024-01-25T15:00:27.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.965+0000 7fd0add9b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0b01021f0 0x7fd0b019ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:27.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd0add9b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0b01021f0 0x7fd0b019ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50236/0 (socket says 172.21.15.170:50236) 2024-01-25T15:00:27.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd0add9b700 1 -- 172.21.15.170:0/4213076565 learned_addr learned my addr 172.21.15.170:0/4213076565 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:27.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd0ae59c700 1 --2- 172.21.15.170:0/4213076565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0b0101830 0x7fd0b019d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:27.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd0aed9d700 1 --2- 172.21.15.170:0/4213076565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0b0106650 0x7fd0b0197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:27.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd0add9b700 1 -- 172.21.15.170:0/4213076565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0b0101830 msgr2=0x7fd0b019d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:27.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd0add9b700 1 --2- 172.21.15.170:0/4213076565 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd0b0101830 0x7fd0b019d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:27.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd0add9b700 1 -- 172.21.15.170:0/4213076565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0b0106650 msgr2=0x7fd0b0197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:27.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd0add9b700 1 --2- 172.21.15.170:0/4213076565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0b0106650 0x7fd0b0197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:27.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd0add9b700 1 -- 172.21.15.170:0/4213076565 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a40095f0 con 0x7fd0b01021f0 2024-01-25T15:00:27.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd0aed9d700 1 --2- 172.21.15.170:0/4213076565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd0b0106650 0x7fd0b0197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:00:27.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd0add9b700 1 --2- 172.21.15.170:0/4213076565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0b01021f0 0x7fd0b019ddf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400b580 tx=0x7fd0a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:27.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd09f7fe700 1 -- 172.21.15.170:0/4213076565 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a401d070 con 0x7fd0b01021f0 2024-01-25T15:00:27.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd09f7fe700 1 -- 172.21.15.170:0/4213076565 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0a400fd20 con 0x7fd0b01021f0 2024-01-25T15:00:27.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/4213076565 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b0198650 con 0x7fd0b01021f0 2024-01-25T15:00:27.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/4213076565 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b01a4950 con 0x7fd0b01021f0 2024-01-25T15:00:27.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.966+0000 7fd09f7fe700 1 -- 172.21.15.170:0/4213076565 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4022e20 con 0x7fd0b01021f0 2024-01-25T15:00:27.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.967+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/4213076565 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd0b0102ec0 con 0x7fd0b01021f0 2024-01-25T15:00:27.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.968+0000 7fd09f7fe700 1 -- 172.21.15.170:0/4213076565 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fd0a4022470 con 0x7fd0b01021f0 2024-01-25T15:00:27.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.969+0000 7fd09f7fe700 1 --2- 172.21.15.170:0/4213076565 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd0980a1400 0x7fd0980a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:27.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.969+0000 7fd0ae59c700 1 --2- 172.21.15.170:0/4213076565 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd0980a1400 0x7fd0980a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:27.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.969+0000 7fd09f7fe700 1 -- 172.21.15.170:0/4213076565 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd0a40cdd00 con 0x7fd0b01021f0 2024-01-25T15:00:27.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.969+0000 7fd09f7fe700 1 --2- 172.21.15.170:0/4213076565 >> [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286] conn(0x7fd0980aabe0 0x7fd0980ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:27.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.969+0000 7fd09f7fe700 1 -- 172.21.15.170:0/4213076565 --> [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd0980ad6b0 con 0x7fd0980aabe0 2024-01-25T15:00:27.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.969+0000 7fd09f7fe700 1 -- 172.21.15.170:0/4213076565 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0a40d0410 con 0x7fd0b01021f0 2024-01-25T15:00:27.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.969+0000 7fd0ae59c700 1 --2- 172.21.15.170:0/4213076565 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd0980a1400 0x7fd0980a38c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0005950 tx=0x7fd0a000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:27.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.969+0000 7fd0aed9d700 1 --2- 172.21.15.170:0/4213076565 >> [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286] conn(0x7fd0980aabe0 0x7fd0980ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:27.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.970+0000 7fd0aed9d700 1 --2- 172.21.15.170:0/4213076565 >> [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286] conn(0x7fd0980aabe0 0x7fd0980ad000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:27.972 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.971+0000 7fd09f7fe700 1 -- 172.21.15.170:0/4213076565 <== osd.8 v2:172.21.15.191:6816/454890286 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd0980ad6b0 con 0x7fd0980aabe0 2024-01-25T15:00:27.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.987+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/4213076565 --> [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd0b0111a80 con 0x7fd0980aabe0 2024-01-25T15:00:27.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.987+0000 7fd09f7fe700 1 -- 172.21.15.170:0/4213076565 <== osd.8 v2:172.21.15.191:6816/454890286 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd0b0111a80 con 0x7fd0980aabe0 2024-01-25T15:00:27.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.988+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/4213076565 >> [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286] conn(0x7fd0980aabe0 msgr2=0x7fd0980ad000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:27.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.988+0000 7fd0b4c0e700 1 --2- 172.21.15.170:0/4213076565 >> [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286] conn(0x7fd0980aabe0 0x7fd0980ad000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:27.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.988+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/4213076565 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd0980a1400 msgr2=0x7fd0980a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:27.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.988+0000 7fd0b4c0e700 1 --2- 172.21.15.170:0/4213076565 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd0980a1400 0x7fd0980a38c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0005950 tx=0x7fd0a000a300 comp rx=0 tx=0).stop 2024-01-25T15:00:27.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.988+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/4213076565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0b01021f0 msgr2=0x7fd0b019ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:27.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.988+0000 7fd0b4c0e700 1 --2- 172.21.15.170:0/4213076565 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd0b01021f0 0x7fd0b019ddf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400b580 tx=0x7fd0a4004730 comp rx=0 tx=0).stop 2024-01-25T15:00:27.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.988+0000 7fd0aed9d700 1 -- 172.21.15.170:0/4213076565 reap_dead start 2024-01-25T15:00:27.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.988+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/4213076565 shutdown_connections 2024-01-25T15:00:27.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.988+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/4213076565 >> 172.21.15.170:0/4213076565 conn(0x7fd0b0078910 msgr2=0x7fd0b00ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:27.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.988+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/4213076565 shutdown_connections 2024-01-25T15:00:27.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:27.988+0000 7fd0b4c0e700 1 -- 172.21.15.170:0/4213076565 wait complete. 2024-01-25T15:00:29.354 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:29 smithi170 ceph-mon[31899]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-01-25T15:00:29.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:29 smithi186 ceph-mon[35697]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-01-25T15:00:29.382 INFO:teuthology.orchestra.run.smithi170.stdout:55834574917 2024-01-25T15:00:29.382 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-01-25T15:00:29.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:29 smithi191 ceph-mon[36347]: pgmap v301: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-01-25T15:00:29.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.852+0000 7f505a558700 1 -- 172.21.15.170:0/1584122663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50541010d0 msgr2=0x7f505410d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:29.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.852+0000 7f505a558700 1 --2- 172.21.15.170:0/1584122663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50541010d0 0x7f505410d550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f504c00b0a0 tx=0x7f504c00b3b0 comp rx=0 tx=0).stop 2024-01-25T15:00:29.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.852+0000 7f505a558700 1 -- 172.21.15.170:0/1584122663 shutdown_connections 2024-01-25T15:00:29.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.852+0000 7f505a558700 1 --2- 172.21.15.170:0/1584122663 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5054106680 0x7f5054106a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:29.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.852+0000 7f505a558700 1 --2- 172.21.15.170:0/1584122663 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f50541010d0 0x7f505410d550 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:29.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.852+0000 7f505a558700 1 --2- 172.21.15.170:0/1584122663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5054100710 0x7f5054100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:29.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.852+0000 7f505a558700 1 -- 172.21.15.170:0/1584122663 >> 172.21.15.170:0/1584122663 conn(0x7f5054076730 msgr2=0x7f5054076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:29.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.852+0000 7f505a558700 1 -- 172.21.15.170:0/1584122663 shutdown_connections 2024-01-25T15:00:29.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.852+0000 7f505a558700 1 -- 172.21.15.170:0/1584122663 wait complete. 2024-01-25T15:00:29.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.852+0000 7f505a558700 1 Processor -- start 2024-01-25T15:00:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.852+0000 7f505a558700 1 -- start start 2024-01-25T15:00:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f505a558700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5054100710 0x7f505419da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f505a558700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50541010d0 0x7f505419dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f505a558700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5054106680 0x7f5054197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f505a558700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50541982e0 con 0x7f5054100710 2024-01-25T15:00:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f505a558700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5054198450 con 0x7f5054106680 2024-01-25T15:00:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f505a558700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5054198610 con 0x7f50541010d0 2024-01-25T15:00:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f5053fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5054100710 0x7f505419da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f5053fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5054100710 0x7f505419da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50262/0 (socket says 172.21.15.170:50262) 2024-01-25T15:00:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f5053fff700 1 -- 172.21.15.170:0/895422782 learned_addr learned my addr 172.21.15.170:0/895422782 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f50537fe700 1 --2- 172.21.15.170:0/895422782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50541010d0 0x7f505419dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f5058af5700 1 --2- 172.21.15.170:0/895422782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5054106680 0x7f5054197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:29.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f5053fff700 1 -- 172.21.15.170:0/895422782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50541010d0 msgr2=0x7f505419dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f5053fff700 1 --2- 172.21.15.170:0/895422782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f50541010d0 0x7f505419dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f5053fff700 1 -- 172.21.15.170:0/895422782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5054106680 msgr2=0x7f5054197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f5053fff700 1 --2- 172.21.15.170:0/895422782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5054106680 0x7f5054197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f5053fff700 1 -- 172.21.15.170:0/895422782 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c009d00 con 0x7f5054100710 2024-01-25T15:00:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f5053fff700 1 --2- 172.21.15.170:0/895422782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5054100710 0x7f505419da60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f503c00b530 tx=0x7f503c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f50517fa700 1 -- 172.21.15.170:0/895422782 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c011830 con 0x7f5054100710 2024-01-25T15:00:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.853+0000 7f50517fa700 1 -- 172.21.15.170:0/895422782 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f503c011e50 con 0x7f5054100710 2024-01-25T15:00:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.854+0000 7f505a558700 1 -- 172.21.15.170:0/895422782 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50541988f0 con 0x7f5054100710 2024-01-25T15:00:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.854+0000 7f50517fa700 1 -- 172.21.15.170:0/895422782 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c00f2e0 con 0x7f5054100710 2024-01-25T15:00:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.854+0000 7f505a558700 1 -- 172.21.15.170:0/895422782 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50541a49e0 con 0x7f5054100710 2024-01-25T15:00:29.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.854+0000 7f505a558700 1 -- 172.21.15.170:0/895422782 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5054101dc0 con 0x7f5054100710 2024-01-25T15:00:29.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.855+0000 7f50517fa700 1 -- 172.21.15.170:0/895422782 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f503c010580 con 0x7f5054100710 2024-01-25T15:00:29.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.856+0000 7f50517fa700 1 --2- 172.21.15.170:0/895422782 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f50400a1400 0x7f50400a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:29.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.856+0000 7f50537fe700 1 --2- 172.21.15.170:0/895422782 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f50400a1400 0x7f50400a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:29.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.856+0000 7f50517fa700 1 -- 172.21.15.170:0/895422782 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f503c0ccb80 con 0x7f5054100710 2024-01-25T15:00:29.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.856+0000 7f50517fa700 1 --2- 172.21.15.170:0/895422782 >> [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638] conn(0x7f50400aabe0 0x7f50400ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:29.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.856+0000 7f50517fa700 1 -- 172.21.15.170:0/895422782 --> [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50400ad6b0 con 0x7f50400aabe0 2024-01-25T15:00:29.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.856+0000 7f50517fa700 1 -- 172.21.15.170:0/895422782 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f503c0cd020 con 0x7f5054100710 2024-01-25T15:00:29.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.857+0000 7f50537fe700 1 --2- 172.21.15.170:0/895422782 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f50400a1400 0x7f50400a38c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5044005ea0 tx=0x7f5044005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:29.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.857+0000 7f5058af5700 1 --2- 172.21.15.170:0/895422782 >> [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638] conn(0x7f50400aabe0 0x7f50400ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:29.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.857+0000 7f5058af5700 1 --2- 172.21.15.170:0/895422782 >> [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638] conn(0x7f50400aabe0 0x7f50400ad000 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:29.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.858+0000 7f50517fa700 1 -- 172.21.15.170:0/895422782 <== osd.7 v2:172.21.15.186:6816/2767449638 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f50400ad6b0 con 0x7f50400aabe0 2024-01-25T15:00:29.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.874+0000 7f505a558700 1 -- 172.21.15.170:0/895422782 --> [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5054111a80 con 0x7f50400aabe0 2024-01-25T15:00:29.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.875+0000 7f50517fa700 1 -- 172.21.15.170:0/895422782 <== osd.7 v2:172.21.15.186:6816/2767449638 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5054111a80 con 0x7f50400aabe0 2024-01-25T15:00:29.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.875+0000 7f505a558700 1 -- 172.21.15.170:0/895422782 >> [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638] conn(0x7f50400aabe0 msgr2=0x7f50400ad000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:29.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.875+0000 7f505a558700 1 --2- 172.21.15.170:0/895422782 >> [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638] conn(0x7f50400aabe0 0x7f50400ad000 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:29.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.875+0000 7f505a558700 1 -- 172.21.15.170:0/895422782 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f50400a1400 msgr2=0x7f50400a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:29.876 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.875+0000 7f505a558700 1 --2- 172.21.15.170:0/895422782 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f50400a1400 0x7f50400a38c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5044005ea0 tx=0x7f5044005e30 comp rx=0 tx=0).stop 2024-01-25T15:00:29.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.875+0000 7f505a558700 1 -- 172.21.15.170:0/895422782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5054100710 msgr2=0x7f505419da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:29.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.875+0000 7f505a558700 1 --2- 172.21.15.170:0/895422782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5054100710 0x7f505419da60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f503c00b530 tx=0x7f503c00b8f0 comp rx=0 tx=0).stop 2024-01-25T15:00:29.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.875+0000 7f5058af5700 1 -- 172.21.15.170:0/895422782 reap_dead start 2024-01-25T15:00:29.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.875+0000 7f505a558700 1 -- 172.21.15.170:0/895422782 shutdown_connections 2024-01-25T15:00:29.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.875+0000 7f505a558700 1 -- 172.21.15.170:0/895422782 >> 172.21.15.170:0/895422782 conn(0x7f5054076730 msgr2=0x7f50540fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:29.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.875+0000 7f505a558700 1 -- 172.21.15.170:0/895422782 shutdown_connections 2024-01-25T15:00:29.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:29.875+0000 7f505a558700 1 -- 172.21.15.170:0/895422782 wait complete. 2024-01-25T15:00:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.269+0000 7f553b6c1700 1 -- 172.21.15.170:0/897654828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55341021a0 msgr2=0x7f553410e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.269+0000 7f553b6c1700 1 --2- 172.21.15.170:0/897654828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55341021a0 0x7f553410e6b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f552c00b0a0 tx=0x7f552c00b3b0 comp rx=0 tx=0).stop 2024-01-25T15:00:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.269+0000 7f553b6c1700 1 -- 172.21.15.170:0/897654828 shutdown_connections 2024-01-25T15:00:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.269+0000 7f553b6c1700 1 --2- 172.21.15.170:0/897654828 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55341021a0 0x7f553410e6b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.269+0000 7f553b6c1700 1 --2- 172.21.15.170:0/897654828 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55341077e0 0x7f5534107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.269+0000 7f553b6c1700 1 --2- 172.21.15.170:0/897654828 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55341017e0 0x7f5534101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.269+0000 7f553b6c1700 1 -- 172.21.15.170:0/897654828 >> 172.21.15.170:0/897654828 conn(0x7f55340fd2b0 msgr2=0x7f55340ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:30.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.269+0000 7f553b6c1700 1 -- 172.21.15.170:0/897654828 shutdown_connections 2024-01-25T15:00:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.269+0000 7f553b6c1700 1 -- 172.21.15.170:0/897654828 wait complete. 2024-01-25T15:00:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.270+0000 7f553b6c1700 1 Processor -- start 2024-01-25T15:00:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.270+0000 7f553b6c1700 1 -- start start 2024-01-25T15:00:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.270+0000 7f553b6c1700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55341017e0 0x7f5534073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.270+0000 7f553b6c1700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55341021a0 0x7f5534074020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.270+0000 7f553b6c1700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55341077e0 0x7f5534074560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.270+0000 7f553b6c1700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55341a61e0 con 0x7f55341077e0 2024-01-25T15:00:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.270+0000 7f553b6c1700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55341a6350 con 0x7f55341017e0 2024-01-25T15:00:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.270+0000 7f553b6c1700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55341a6510 con 0x7f55341021a0 2024-01-25T15:00:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.270+0000 7f5539c5e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55341077e0 0x7f5534074560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.270+0000 7f5539c5e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55341077e0 0x7f5534074560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50282/0 (socket says 172.21.15.170:50282) 2024-01-25T15:00:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.270+0000 7f5539c5e700 1 -- 172.21.15.170:0/42211992 learned_addr learned my addr 172.21.15.170:0/42211992 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.270+0000 7f5538c5c700 1 --2- 172.21.15.170:0/42211992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55341021a0 0x7f5534074020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:30.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.271+0000 7f553945d700 1 --2- 172.21.15.170:0/42211992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55341017e0 0x7f5534073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.271+0000 7f5539c5e700 1 -- 172.21.15.170:0/42211992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55341021a0 msgr2=0x7f5534074020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.271+0000 7f5539c5e700 1 --2- 172.21.15.170:0/42211992 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55341021a0 0x7f5534074020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.271+0000 7f5539c5e700 1 -- 172.21.15.170:0/42211992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55341017e0 msgr2=0x7f5534073ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.271+0000 7f5539c5e700 1 --2- 172.21.15.170:0/42211992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55341017e0 0x7f5534073ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.271+0000 7f5539c5e700 1 -- 172.21.15.170:0/42211992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c009d00 con 0x7f55341077e0 2024-01-25T15:00:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.271+0000 7f553945d700 1 --2- 172.21.15.170:0/42211992 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55341017e0 0x7f5534073ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:00:30.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.271+0000 7f5539c5e700 1 --2- 172.21.15.170:0/42211992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55341077e0 0x7f5534074560 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f552c00b830 tx=0x7f552c0077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:30.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.271+0000 7f552a7fc700 1 -- 172.21.15.170:0/42211992 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c00e040 con 0x7f55341077e0 2024-01-25T15:00:30.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.271+0000 7f552a7fc700 1 -- 172.21.15.170:0/42211992 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f552c004e60 con 0x7f55341077e0 2024-01-25T15:00:30.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.271+0000 7f552a7fc700 1 -- 172.21.15.170:0/42211992 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c0053c0 con 0x7f55341077e0 2024-01-25T15:00:30.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.271+0000 7f553b6c1700 1 -- 172.21.15.170:0/42211992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55341a6790 con 0x7f55341077e0 2024-01-25T15:00:30.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.271+0000 7f553b6c1700 1 -- 172.21.15.170:0/42211992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55341a6bb0 con 0x7f55341077e0 2024-01-25T15:00:30.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.272+0000 7f553b6c1700 1 -- 172.21.15.170:0/42211992 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5534111a60 con 0x7f55341077e0 2024-01-25T15:00:30.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.273+0000 7f552a7fc700 1 -- 172.21.15.170:0/42211992 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f552c01b450 con 0x7f55341077e0 2024-01-25T15:00:30.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.274+0000 7f552a7fc700 1 --2- 172.21.15.170:0/42211992 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55200a1400 0x7f55200a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:30.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.274+0000 7f553945d700 1 --2- 172.21.15.170:0/42211992 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55200a1400 0x7f55200a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:30.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.274+0000 7f552a7fc700 1 -- 172.21.15.170:0/42211992 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f552c0ce490 con 0x7f55341077e0 2024-01-25T15:00:30.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.274+0000 7f552a7fc700 1 --2- 172.21.15.170:0/42211992 >> [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876] conn(0x7f55200aabe0 0x7f55200ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:30.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.274+0000 7f552a7fc700 1 -- 172.21.15.170:0/42211992 --> [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f55200ad6b0 con 0x7f55200aabe0 2024-01-25T15:00:30.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.274+0000 7f552a7fc700 1 -- 172.21.15.170:0/42211992 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f552c0d0a70 con 0x7f55341077e0 2024-01-25T15:00:30.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.274+0000 7f5538c5c700 1 --2- 172.21.15.170:0/42211992 >> [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876] conn(0x7f55200aabe0 0x7f55200ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:30.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.274+0000 7f553945d700 1 --2- 172.21.15.170:0/42211992 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55200a1400 0x7f55200a38c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f55300099d0 tx=0x7f5530008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:30.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.275+0000 7f5538c5c700 1 --2- 172.21.15.170:0/42211992 >> [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876] conn(0x7f55200aabe0 0x7f55200ad000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:30.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.275+0000 7f552a7fc700 1 -- 172.21.15.170:0/42211992 <== osd.6 v2:172.21.15.170:6818/1982694876 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f55200ad6b0 con 0x7f55200aabe0 2024-01-25T15:00:30.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.292+0000 7f553b6c1700 1 -- 172.21.15.170:0/42211992 --> [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5534061f20 con 0x7f55200aabe0 2024-01-25T15:00:30.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.292+0000 7f552a7fc700 1 -- 172.21.15.170:0/42211992 <== osd.6 v2:172.21.15.170:6818/1982694876 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5534061f20 con 0x7f55200aabe0 2024-01-25T15:00:30.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.292+0000 7f553b6c1700 1 -- 172.21.15.170:0/42211992 >> [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876] conn(0x7f55200aabe0 msgr2=0x7f55200ad000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:30.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.292+0000 7f553b6c1700 1 --2- 172.21.15.170:0/42211992 >> [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876] conn(0x7f55200aabe0 0x7f55200ad000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:30.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.292+0000 7f553b6c1700 1 -- 172.21.15.170:0/42211992 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55200a1400 msgr2=0x7f55200a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:30.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.292+0000 7f553b6c1700 1 --2- 172.21.15.170:0/42211992 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55200a1400 0x7f55200a38c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f55300099d0 tx=0x7f5530008040 comp rx=0 tx=0).stop 2024-01-25T15:00:30.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.292+0000 7f553b6c1700 1 -- 172.21.15.170:0/42211992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55341077e0 msgr2=0x7f5534074560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:30.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.292+0000 7f553b6c1700 1 --2- 172.21.15.170:0/42211992 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f55341077e0 0x7f5534074560 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f552c00b830 tx=0x7f552c0077f0 comp rx=0 tx=0).stop 2024-01-25T15:00:30.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.293+0000 7f5539c5e700 1 -- 172.21.15.170:0/42211992 reap_dead start 2024-01-25T15:00:30.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.293+0000 7f553b6c1700 1 -- 172.21.15.170:0/42211992 shutdown_connections 2024-01-25T15:00:30.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.293+0000 7f553b6c1700 1 -- 172.21.15.170:0/42211992 >> 172.21.15.170:0/42211992 conn(0x7f55340fd2b0 msgr2=0x7f55340fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:30.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.293+0000 7f553b6c1700 1 -- 172.21.15.170:0/42211992 shutdown_connections 2024-01-25T15:00:30.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:30.293+0000 7f553b6c1700 1 -- 172.21.15.170:0/42211992 wait complete. 2024-01-25T15:00:31.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:31 smithi170 ceph-mon[31899]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:00:31.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:31 smithi186 ceph-mon[35697]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:00:31.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:31 smithi191 ceph-mon[36347]: pgmap v302: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:00:32.962 INFO:teuthology.orchestra.run.smithi170.stdout:253403070499 2024-01-25T15:00:32.963 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd last-stat-seq osd.8 2024-01-25T15:00:33.543 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:33 smithi170 ceph-mon[31899]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-01-25T15:00:33.570 INFO:teuthology.orchestra.run.smithi170.stdout:197568495662 2024-01-25T15:00:33.570 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-01-25T15:00:33.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:33 smithi186 ceph-mon[35697]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-01-25T15:00:33.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:33 smithi191 ceph-mon[36347]: pgmap v303: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-01-25T15:00:33.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.781+0000 7f76ce3f6700 1 -- 172.21.15.170:0/751272543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c81021f0 msgr2=0x7f76c810e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:33.784 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.781+0000 7f76ce3f6700 1 --2- 172.21.15.170:0/751272543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c81021f0 0x7f76c810e690 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f76c000b0a0 tx=0x7f76c000b3b0 comp rx=0 tx=0).stop 2024-01-25T15:00:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.781+0000 7f76ce3f6700 1 -- 172.21.15.170:0/751272543 shutdown_connections 2024-01-25T15:00:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.781+0000 7f76ce3f6700 1 --2- 172.21.15.170:0/751272543 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c8106700 0x7f76c8106ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.781+0000 7f76ce3f6700 1 --2- 172.21.15.170:0/751272543 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c81021f0 0x7f76c810e690 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.781+0000 7f76ce3f6700 1 --2- 172.21.15.170:0/751272543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76c8101830 0x7f76c8101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.781+0000 7f76ce3f6700 1 -- 172.21.15.170:0/751272543 >> 172.21.15.170:0/751272543 conn(0x7f76c8078910 msgr2=0x7f76c8078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.781+0000 7f76ce3f6700 1 -- 172.21.15.170:0/751272543 shutdown_connections 2024-01-25T15:00:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.781+0000 7f76ce3f6700 1 -- 172.21.15.170:0/751272543 wait complete. 2024-01-25T15:00:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.782+0000 7f76ce3f6700 1 Processor -- start 2024-01-25T15:00:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.782+0000 7f76ce3f6700 1 -- start start 2024-01-25T15:00:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.782+0000 7f76ce3f6700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c8101830 0x7f76c8197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.782+0000 7f76ce3f6700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76c81021f0 0x7f76c8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:33.785 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.782+0000 7f76ce3f6700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8106700 0x7f76c819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.782+0000 7f76ce3f6700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c819ce10 con 0x7f76c8106700 2024-01-25T15:00:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.782+0000 7f76ce3f6700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c819cf80 con 0x7f76c81021f0 2024-01-25T15:00:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.782+0000 7f76ce3f6700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c819d140 con 0x7f76c8101830 2024-01-25T15:00:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.782+0000 7f76cc993700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8106700 0x7f76c819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.782+0000 7f76cc993700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8106700 0x7f76c819c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50298/0 (socket says 172.21.15.170:50298) 2024-01-25T15:00:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.782+0000 7f76cc993700 1 -- 172.21.15.170:0/2955291893 learned_addr learned my addr 172.21.15.170:0/2955291893 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.783+0000 7f76c77fe700 1 --2- 172.21.15.170:0/2955291893 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76c81021f0 0x7f76c8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.783+0000 7f76c7fff700 1 --2- 172.21.15.170:0/2955291893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c8101830 0x7f76c8197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.783+0000 7f76cc993700 1 -- 172.21.15.170:0/2955291893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c8101830 msgr2=0x7f76c8197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.783+0000 7f76cc993700 1 --2- 172.21.15.170:0/2955291893 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76c8101830 0x7f76c8197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:33.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.783+0000 7f76cc993700 1 -- 172.21.15.170:0/2955291893 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76c81021f0 msgr2=0x7f76c8198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.783+0000 7f76cc993700 1 --2- 172.21.15.170:0/2955291893 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76c81021f0 0x7f76c8198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.783+0000 7f76cc993700 1 -- 172.21.15.170:0/2955291893 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c0009d00 con 0x7f76c8106700 2024-01-25T15:00:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.783+0000 7f76c77fe700 1 --2- 172.21.15.170:0/2955291893 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76c81021f0 0x7f76c8198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:00:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.783+0000 7f76cc993700 1 --2- 172.21.15.170:0/2955291893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8106700 0x7f76c819c800 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f76c000b830 tx=0x7f76c00078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.783+0000 7f76c57fa700 1 -- 172.21.15.170:0/2955291893 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c000e040 con 0x7f76c8106700 2024-01-25T15:00:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.783+0000 7f76ce3f6700 1 -- 172.21.15.170:0/2955291893 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c819d3c0 con 0x7f76c8106700 2024-01-25T15:00:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.783+0000 7f76c57fa700 1 -- 172.21.15.170:0/2955291893 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76c0004e60 con 0x7f76c8106700 2024-01-25T15:00:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.783+0000 7f76c57fa700 1 -- 172.21.15.170:0/2955291893 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c0005420 con 0x7f76c8106700 2024-01-25T15:00:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.783+0000 7f76ce3f6700 1 -- 172.21.15.170:0/2955291893 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c81a4c80 con 0x7f76c8106700 2024-01-25T15:00:33.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.784+0000 7f76ce3f6700 1 -- 172.21.15.170:0/2955291893 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76c8111af0 con 0x7f76c8106700 2024-01-25T15:00:33.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.785+0000 7f76c57fa700 1 -- 172.21.15.170:0/2955291893 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f76c001bb30 con 0x7f76c8106700 2024-01-25T15:00:33.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.785+0000 7f76c57fa700 1 --2- 172.21.15.170:0/2955291893 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f76b40a1400 0x7f76b40a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:33.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.786+0000 7f76c7fff700 1 --2- 172.21.15.170:0/2955291893 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f76b40a1400 0x7f76b40a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:33.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.786+0000 7f76c57fa700 1 -- 172.21.15.170:0/2955291893 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f76c00ce710 con 0x7f76c8106700 2024-01-25T15:00:33.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.786+0000 7f76c57fa700 1 --2- 172.21.15.170:0/2955291893 >> [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675] conn(0x7f76b40aabe0 0x7f76b40ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:33.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.786+0000 7f76c57fa700 1 -- 172.21.15.170:0/2955291893 --> [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76b40ad6b0 con 0x7f76b40aabe0 2024-01-25T15:00:33.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.786+0000 7f76c57fa700 1 -- 172.21.15.170:0/2955291893 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76c00cebb0 con 0x7f76c8106700 2024-01-25T15:00:33.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.786+0000 7f76c77fe700 1 --2- 172.21.15.170:0/2955291893 >> [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675] conn(0x7f76b40aabe0 0x7f76b40ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:33.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.786+0000 7f76c7fff700 1 --2- 172.21.15.170:0/2955291893 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f76b40a1400 0x7f76b40a38c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f76b0006fd0 tx=0x7f76b0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:33.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.786+0000 7f76c77fe700 1 --2- 172.21.15.170:0/2955291893 >> [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675] conn(0x7f76b40aabe0 0x7f76b40ad000 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:33.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.787+0000 7f76c57fa700 1 -- 172.21.15.170:0/2955291893 <== osd.0 v2:172.21.15.170:6802/3114059675 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f76b40ad6b0 con 0x7f76b40aabe0 2024-01-25T15:00:33.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.804+0000 7f76ce3f6700 1 -- 172.21.15.170:0/2955291893 --> [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76c8061ea0 con 0x7f76b40aabe0 2024-01-25T15:00:33.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.804+0000 7f76c57fa700 1 -- 172.21.15.170:0/2955291893 <== osd.0 v2:172.21.15.170:6802/3114059675 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f76c8061ea0 con 0x7f76b40aabe0 2024-01-25T15:00:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.805+0000 7f76ce3f6700 1 -- 172.21.15.170:0/2955291893 >> [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675] conn(0x7f76b40aabe0 msgr2=0x7f76b40ad000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.805+0000 7f76ce3f6700 1 --2- 172.21.15.170:0/2955291893 >> [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675] conn(0x7f76b40aabe0 0x7f76b40ad000 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.805+0000 7f76ce3f6700 1 -- 172.21.15.170:0/2955291893 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f76b40a1400 msgr2=0x7f76b40a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.805+0000 7f76ce3f6700 1 --2- 172.21.15.170:0/2955291893 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f76b40a1400 0x7f76b40a38c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f76b0006fd0 tx=0x7f76b0008040 comp rx=0 tx=0).stop 2024-01-25T15:00:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.805+0000 7f76ce3f6700 1 -- 172.21.15.170:0/2955291893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8106700 msgr2=0x7f76c819c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.805+0000 7f76ce3f6700 1 --2- 172.21.15.170:0/2955291893 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76c8106700 0x7f76c819c800 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f76c000b830 tx=0x7f76c00078a0 comp rx=0 tx=0).stop 2024-01-25T15:00:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.805+0000 7f76cc993700 1 -- 172.21.15.170:0/2955291893 reap_dead start 2024-01-25T15:00:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.805+0000 7f76ce3f6700 1 -- 172.21.15.170:0/2955291893 shutdown_connections 2024-01-25T15:00:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.805+0000 7f76ce3f6700 1 -- 172.21.15.170:0/2955291893 >> 172.21.15.170:0/2955291893 conn(0x7f76c8078910 msgr2=0x7f76c80ff9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:33.806 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.805+0000 7f76ce3f6700 1 -- 172.21.15.170:0/2955291893 shutdown_connections 2024-01-25T15:00:33.807 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:33.805+0000 7f76ce3f6700 1 -- 172.21.15.170:0/2955291893 wait complete. 2024-01-25T15:00:34.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.300+0000 7f4edaded700 1 -- 172.21.15.170:0/2681434418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ed4074330 msgr2=0x7f4ed4112470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:34.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.300+0000 7f4edaded700 1 --2- 172.21.15.170:0/2681434418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ed4074330 0x7f4ed4112470 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4ec00099c0 tx=0x7f4ec0009cd0 comp rx=0 tx=0).stop 2024-01-25T15:00:34.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.301+0000 7f4edaded700 1 -- 172.21.15.170:0/2681434418 shutdown_connections 2024-01-25T15:00:34.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.301+0000 7f4edaded700 1 --2- 172.21.15.170:0/2681434418 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ed41129b0 0x7f4ed4114da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:34.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.301+0000 7f4edaded700 1 --2- 172.21.15.170:0/2681434418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ed4073a10 0x7f4ed4073df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:34.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.301+0000 7f4edaded700 1 --2- 172.21.15.170:0/2681434418 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ed4074330 0x7f4ed4112470 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:34.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.301+0000 7f4edaded700 1 -- 172.21.15.170:0/2681434418 >> 172.21.15.170:0/2681434418 conn(0x7f4ed4078910 msgr2=0x7f4ed4078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:34.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.301+0000 7f4edaded700 1 -- 172.21.15.170:0/2681434418 shutdown_connections 2024-01-25T15:00:34.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.301+0000 7f4edaded700 1 -- 172.21.15.170:0/2681434418 wait complete. 2024-01-25T15:00:34.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.301+0000 7f4edaded700 1 Processor -- start 2024-01-25T15:00:34.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.301+0000 7f4edaded700 1 -- start start 2024-01-25T15:00:34.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4edaded700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ed4073a10 0x7f4ed419e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:34.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4edaded700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ed4074330 0x7f4ed419e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:34.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4edaded700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ed41129b0 0x7f4ed41a2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:34.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4edaded700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed41a31c0 con 0x7f4ed4073a10 2024-01-25T15:00:34.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4edaded700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed41a3330 con 0x7f4ed4074330 2024-01-25T15:00:34.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4edaded700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed41a34f0 con 0x7f4ed41129b0 2024-01-25T15:00:34.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4ed8b89700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ed4073a10 0x7f4ed419e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:34.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4ed8b89700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ed4073a10 0x7f4ed419e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50318/0 (socket says 172.21.15.170:50318) 2024-01-25T15:00:34.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4ed8b89700 1 -- 172.21.15.170:0/623795763 learned_addr learned my addr 172.21.15.170:0/623795763 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:34.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4ed938a700 1 --2- 172.21.15.170:0/623795763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ed41129b0 0x7f4ed41a2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:34.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4ed3fff700 1 --2- 172.21.15.170:0/623795763 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ed4074330 0x7f4ed419e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:34.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4ed8b89700 1 -- 172.21.15.170:0/623795763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ed41129b0 msgr2=0x7f4ed41a2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:34.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4ed8b89700 1 --2- 172.21.15.170:0/623795763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4ed41129b0 0x7f4ed41a2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:34.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4ed8b89700 1 -- 172.21.15.170:0/623795763 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ed4074330 msgr2=0x7f4ed419e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:34.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4ed8b89700 1 --2- 172.21.15.170:0/623795763 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ed4074330 0x7f4ed419e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:34.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4ed8b89700 1 -- 172.21.15.170:0/623795763 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec00095f0 con 0x7f4ed4073a10 2024-01-25T15:00:34.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4ed8b89700 1 --2- 172.21.15.170:0/623795763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ed4073a10 0x7f4ed419e2e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4ec800d950 tx=0x7f4ec800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:34.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4ed1ffb700 1 -- 172.21.15.170:0/623795763 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec8009940 con 0x7f4ed4073a10 2024-01-25T15:00:34.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4ed1ffb700 1 -- 172.21.15.170:0/623795763 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ec8010460 con 0x7f4ed4073a10 2024-01-25T15:00:34.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4ed1ffb700 1 -- 172.21.15.170:0/623795763 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec800f620 con 0x7f4ed4073a10 2024-01-25T15:00:34.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.302+0000 7f4edaded700 1 -- 172.21.15.170:0/623795763 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed41a37d0 con 0x7f4ed4073a10 2024-01-25T15:00:34.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.303+0000 7f4edaded700 1 -- 172.21.15.170:0/623795763 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed41ab030 con 0x7f4ed4073a10 2024-01-25T15:00:34.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.303+0000 7f4edaded700 1 -- 172.21.15.170:0/623795763 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ed4117fc0 con 0x7f4ed4073a10 2024-01-25T15:00:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.305+0000 7f4ed1ffb700 1 -- 172.21.15.170:0/623795763 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f4ec80108d0 con 0x7f4ed4073a10 2024-01-25T15:00:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.305+0000 7f4ed1ffb700 1 --2- 172.21.15.170:0/623795763 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4ec40a1400 0x7f4ec40a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.305+0000 7f4ed3fff700 1 --2- 172.21.15.170:0/623795763 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4ec40a1400 0x7f4ec40a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.305+0000 7f4ed1ffb700 1 -- 172.21.15.170:0/623795763 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4ec80cce50 con 0x7f4ed4073a10 2024-01-25T15:00:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.306+0000 7f4ed1ffb700 1 --2- 172.21.15.170:0/623795763 >> [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441] conn(0x7f4ec40aabe0 0x7f4ec40ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:34.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.306+0000 7f4ed1ffb700 1 -- 172.21.15.170:0/623795763 --> [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ec40ad6b0 con 0x7f4ec40aabe0 2024-01-25T15:00:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.306+0000 7f4ed1ffb700 1 -- 172.21.15.170:0/623795763 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ec80cd2f0 con 0x7f4ed4073a10 2024-01-25T15:00:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.306+0000 7f4ed3fff700 1 --2- 172.21.15.170:0/623795763 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4ec40a1400 0x7f4ec40a38c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4ed410f320 tx=0x7f4ec0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.306+0000 7f4ed938a700 1 --2- 172.21.15.170:0/623795763 >> [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441] conn(0x7f4ec40aabe0 0x7f4ec40ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.306+0000 7f4ed938a700 1 --2- 172.21.15.170:0/623795763 >> [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441] conn(0x7f4ec40aabe0 0x7f4ec40ad000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:34.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.307+0000 7f4ed1ffb700 1 -- 172.21.15.170:0/623795763 <== osd.2 v2:172.21.15.191:6800/872180441 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4ec40ad6b0 con 0x7f4ec40aabe0 2024-01-25T15:00:34.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.323+0000 7f4edaded700 1 -- 172.21.15.170:0/623795763 --> [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4ed4061ef0 con 0x7f4ec40aabe0 2024-01-25T15:00:34.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.324+0000 7f4ed1ffb700 1 -- 172.21.15.170:0/623795763 <== osd.2 v2:172.21.15.191:6800/872180441 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4ed4061ef0 con 0x7f4ec40aabe0 2024-01-25T15:00:34.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.324+0000 7f4edaded700 1 -- 172.21.15.170:0/623795763 >> [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441] conn(0x7f4ec40aabe0 msgr2=0x7f4ec40ad000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:34.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.324+0000 7f4edaded700 1 --2- 172.21.15.170:0/623795763 >> [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441] conn(0x7f4ec40aabe0 0x7f4ec40ad000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:34.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.324+0000 7f4edaded700 1 -- 172.21.15.170:0/623795763 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4ec40a1400 msgr2=0x7f4ec40a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:34.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.324+0000 7f4edaded700 1 --2- 172.21.15.170:0/623795763 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4ec40a1400 0x7f4ec40a38c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4ed410f320 tx=0x7f4ec0005fd0 comp rx=0 tx=0).stop 2024-01-25T15:00:34.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.325+0000 7f4edaded700 1 -- 172.21.15.170:0/623795763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ed4073a10 msgr2=0x7f4ed419e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:34.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.325+0000 7f4edaded700 1 --2- 172.21.15.170:0/623795763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4ed4073a10 0x7f4ed419e2e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4ec800d950 tx=0x7f4ec800dc60 comp rx=0 tx=0).stop 2024-01-25T15:00:34.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.325+0000 7f4ed938a700 1 -- 172.21.15.170:0/623795763 reap_dead start 2024-01-25T15:00:34.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.325+0000 7f4edaded700 1 -- 172.21.15.170:0/623795763 shutdown_connections 2024-01-25T15:00:34.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.325+0000 7f4edaded700 1 -- 172.21.15.170:0/623795763 >> 172.21.15.170:0/623795763 conn(0x7f4ed4078910 msgr2=0x7f4ed410f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:34.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.325+0000 7f4edaded700 1 -- 172.21.15.170:0/623795763 shutdown_connections 2024-01-25T15:00:34.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:34.325+0000 7f4edaded700 1 -- 172.21.15.170:0/623795763 wait complete. 2024-01-25T15:00:34.438 INFO:teuthology.orchestra.run.smithi170.stdout:223338299433 2024-01-25T15:00:34.438 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-01-25T15:00:35.556 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:35 smithi170 ceph-mon[31899]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-01-25T15:00:35.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:35 smithi186 ceph-mon[35697]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-01-25T15:00:35.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:35 smithi191 ceph-mon[36347]: pgmap v304: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-01-25T15:00:35.874 INFO:teuthology.orchestra.run.smithi170.stdout:34359738443 2024-01-25T15:00:35.874 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-01-25T15:00:36.399 INFO:teuthology.orchestra.run.smithi170.stdout:77309411394 2024-01-25T15:00:36.400 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-01-25T15:00:37.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.215+0000 7fc72b423700 1 -- 172.21.15.170:0/932620469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc724105590 msgr2=0x7fc724105970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:37.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.215+0000 7fc72b423700 1 --2- 172.21.15.170:0/932620469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc724105590 0x7fc724105970 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc71c00b0a0 tx=0x7fc71c00b3b0 comp rx=0 tx=0).stop 2024-01-25T15:00:37.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.215+0000 7fc72b423700 1 -- 172.21.15.170:0/932620469 shutdown_connections 2024-01-25T15:00:37.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.215+0000 7fc72b423700 1 --2- 172.21.15.170:0/932620469 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc724101080 0x7fc72410d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:37.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.215+0000 7fc72b423700 1 --2- 172.21.15.170:0/932620469 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc724105590 0x7fc724105970 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:37.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.215+0000 7fc72b423700 1 --2- 172.21.15.170:0/932620469 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc7241006c0 0x7fc724100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:37.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.215+0000 7fc72b423700 1 -- 172.21.15.170:0/932620469 >> 172.21.15.170:0/932620469 conn(0x7fc7240776f0 msgr2=0x7fc724077b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:37.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.215+0000 7fc72b423700 1 -- 172.21.15.170:0/932620469 shutdown_connections 2024-01-25T15:00:37.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.215+0000 7fc72b423700 1 -- 172.21.15.170:0/932620469 wait complete. 2024-01-25T15:00:37.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc72b423700 1 Processor -- start 2024-01-25T15:00:37.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc72b423700 1 -- start start 2024-01-25T15:00:37.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc72b423700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7241006c0 0x7fc724198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:37.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc72b423700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc724101080 0x7fc724199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:37.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc72b423700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc724105590 0x7fc7241a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:37.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc72b423700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc724199b80 con 0x7fc7241006c0 2024-01-25T15:00:37.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc72b423700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7241a4300 con 0x7fc724101080 2024-01-25T15:00:37.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc72b423700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7241a4470 con 0x7fc724105590 2024-01-25T15:00:37.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc7291bf700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7241006c0 0x7fc724198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:37.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc7291bf700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7241006c0 0x7fc724198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36940/0 (socket says 172.21.15.170:36940) 2024-01-25T15:00:37.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc7291bf700 1 -- 172.21.15.170:0/2595926934 learned_addr learned my addr 172.21.15.170:0/2595926934 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:37.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc7289be700 1 --2- 172.21.15.170:0/2595926934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc724101080 0x7fc724199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:37.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc7291bf700 1 -- 172.21.15.170:0/2595926934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc724105590 msgr2=0x7fc7241a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:37.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc7291bf700 1 --2- 172.21.15.170:0/2595926934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc724105590 0x7fc7241a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:37.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc7291bf700 1 -- 172.21.15.170:0/2595926934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc724101080 msgr2=0x7fc724199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:37.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc7291bf700 1 --2- 172.21.15.170:0/2595926934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc724101080 0x7fc724199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:37.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.216+0000 7fc7291bf700 1 -- 172.21.15.170:0/2595926934 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c009d00 con 0x7fc7241006c0 2024-01-25T15:00:37.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.217+0000 7fc7291bf700 1 --2- 172.21.15.170:0/2595926934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7241006c0 0x7fc724198d40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc71c006070 tx=0x7fc71c007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:37.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.217+0000 7fc7227fc700 1 -- 172.21.15.170:0/2595926934 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c021070 con 0x7fc7241006c0 2024-01-25T15:00:37.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.217+0000 7fc72b423700 1 -- 172.21.15.170:0/2595926934 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7241a46f0 con 0x7fc7241006c0 2024-01-25T15:00:37.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.217+0000 7fc7227fc700 1 -- 172.21.15.170:0/2595926934 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc71c0094c0 con 0x7fc7241006c0 2024-01-25T15:00:37.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.217+0000 7fc7227fc700 1 -- 172.21.15.170:0/2595926934 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c00e040 con 0x7fc7241006c0 2024-01-25T15:00:37.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.217+0000 7fc72b423700 1 -- 172.21.15.170:0/2595926934 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7241a4b00 con 0x7fc7241006c0 2024-01-25T15:00:37.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.218+0000 7fc72b423700 1 -- 172.21.15.170:0/2595926934 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc724110a10 con 0x7fc7241006c0 2024-01-25T15:00:37.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.219+0000 7fc7227fc700 1 -- 172.21.15.170:0/2595926934 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fc71c01d480 con 0x7fc7241006c0 2024-01-25T15:00:37.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.219+0000 7fc7227fc700 1 --2- 172.21.15.170:0/2595926934 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc70c0a1400 0x7fc70c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:37.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.220+0000 7fc7289be700 1 --2- 172.21.15.170:0/2595926934 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc70c0a1400 0x7fc70c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:37.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.220+0000 7fc7227fc700 1 -- 172.21.15.170:0/2595926934 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc71c0ce130 con 0x7fc7241006c0 2024-01-25T15:00:37.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.220+0000 7fc7227fc700 1 --2- 172.21.15.170:0/2595926934 >> [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767] conn(0x7fc70c0aabe0 0x7fc70c0ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:37.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.220+0000 7fc7227fc700 1 -- 172.21.15.170:0/2595926934 --> [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc70c0ad6b0 con 0x7fc70c0aabe0 2024-01-25T15:00:37.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.220+0000 7fc7227fc700 1 -- 172.21.15.170:0/2595926934 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc71c0ce5d0 con 0x7fc7241006c0 2024-01-25T15:00:37.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.220+0000 7fc7289be700 1 --2- 172.21.15.170:0/2595926934 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc70c0a1400 0x7fc70c0a38c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc718006fd0 tx=0x7fc718008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:37.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.220+0000 7fc7299c0700 1 --2- 172.21.15.170:0/2595926934 >> [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767] conn(0x7fc70c0aabe0 0x7fc70c0ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:37.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.221+0000 7fc7299c0700 1 --2- 172.21.15.170:0/2595926934 >> [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767] conn(0x7fc70c0aabe0 0x7fc70c0ad000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:37.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.221+0000 7fc7227fc700 1 -- 172.21.15.170:0/2595926934 <== osd.10 v2:172.21.15.186:6824/795318767 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc70c0ad6b0 con 0x7fc70c0aabe0 2024-01-25T15:00:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.239+0000 7fc72b423700 1 -- 172.21.15.170:0/2595926934 --> [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc724061e70 con 0x7fc70c0aabe0 2024-01-25T15:00:37.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.240+0000 7fc7227fc700 1 -- 172.21.15.170:0/2595926934 <== osd.10 v2:172.21.15.186:6824/795318767 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc724061e70 con 0x7fc70c0aabe0 2024-01-25T15:00:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.240+0000 7fc72b423700 1 -- 172.21.15.170:0/2595926934 >> [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767] conn(0x7fc70c0aabe0 msgr2=0x7fc70c0ad000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.240+0000 7fc72b423700 1 --2- 172.21.15.170:0/2595926934 >> [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767] conn(0x7fc70c0aabe0 0x7fc70c0ad000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.240+0000 7fc72b423700 1 -- 172.21.15.170:0/2595926934 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc70c0a1400 msgr2=0x7fc70c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.240+0000 7fc72b423700 1 --2- 172.21.15.170:0/2595926934 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc70c0a1400 0x7fc70c0a38c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc718006fd0 tx=0x7fc718008040 comp rx=0 tx=0).stop 2024-01-25T15:00:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.240+0000 7fc72b423700 1 -- 172.21.15.170:0/2595926934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7241006c0 msgr2=0x7fc724198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.240+0000 7fc72b423700 1 --2- 172.21.15.170:0/2595926934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc7241006c0 0x7fc724198d40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc71c006070 tx=0x7fc71c007920 comp rx=0 tx=0).stop 2024-01-25T15:00:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.240+0000 7fc7299c0700 1 -- 172.21.15.170:0/2595926934 reap_dead start 2024-01-25T15:00:37.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.240+0000 7fc72b423700 1 -- 172.21.15.170:0/2595926934 shutdown_connections 2024-01-25T15:00:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.240+0000 7fc72b423700 1 -- 172.21.15.170:0/2595926934 >> 172.21.15.170:0/2595926934 conn(0x7fc7240776f0 msgr2=0x7fc7240fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.240+0000 7fc72b423700 1 -- 172.21.15.170:0/2595926934 shutdown_connections 2024-01-25T15:00:37.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.241+0000 7fc72b423700 1 -- 172.21.15.170:0/2595926934 wait complete. 2024-01-25T15:00:37.602 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:37 smithi170 ceph-mon[31899]: pgmap v305: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:00:37.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:37 smithi186 ceph-mon[35697]: pgmap v305: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:00:37.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:37 smithi191 ceph-mon[36347]: pgmap v305: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:00:37.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.785+0000 7f76b7be2700 1 -- 172.21.15.170:0/754169153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b0101830 msgr2=0x7f76b0101cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:37.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.785+0000 7f76b7be2700 1 --2- 172.21.15.170:0/754169153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b0101830 0x7f76b0101cb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f76a0009990 tx=0x7f76a0009ca0 comp rx=0 tx=0).stop 2024-01-25T15:00:37.786 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.785+0000 7f76b7be2700 1 -- 172.21.15.170:0/754169153 shutdown_connections 2024-01-25T15:00:37.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.785+0000 7f76b7be2700 1 --2- 172.21.15.170:0/754169153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76b0106700 0x7f76b0106ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:37.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.785+0000 7f76b7be2700 1 --2- 172.21.15.170:0/754169153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76b01021f0 0x7f76b010e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:37.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.785+0000 7f76b7be2700 1 --2- 172.21.15.170:0/754169153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b0101830 0x7f76b0101cb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:37.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.785+0000 7f76b7be2700 1 -- 172.21.15.170:0/754169153 >> 172.21.15.170:0/754169153 conn(0x7f76b0078910 msgr2=0x7f76b0078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:37.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.785+0000 7f76b7be2700 1 -- 172.21.15.170:0/754169153 shutdown_connections 2024-01-25T15:00:37.787 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.785+0000 7f76b7be2700 1 -- 172.21.15.170:0/754169153 wait complete. 2024-01-25T15:00:37.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.786+0000 7f76b7be2700 1 Processor -- start 2024-01-25T15:00:37.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.786+0000 7f76b7be2700 1 -- start start 2024-01-25T15:00:37.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.786+0000 7f76b7be2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76b0101830 0x7f76b0073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:37.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.786+0000 7f76b7be2700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76b01021f0 0x7f76b0074020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:37.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.786+0000 7f76b7be2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b0106700 0x7f76b0074560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:37.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.786+0000 7f76b7be2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b01a6150 con 0x7f76b0106700 2024-01-25T15:00:37.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.786+0000 7f76b7be2700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b01a62c0 con 0x7f76b01021f0 2024-01-25T15:00:37.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.786+0000 7f76b7be2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b01a6480 con 0x7f76b0101830 2024-01-25T15:00:37.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76b617f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b0106700 0x7f76b0074560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:37.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76b597e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76b0101830 0x7f76b0073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:37.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76b597e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76b0101830 0x7f76b0073ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:46454/0 (socket says 172.21.15.170:46454) 2024-01-25T15:00:37.789 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76b617f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b0106700 0x7f76b0074560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36958/0 (socket says 172.21.15.170:36958) 2024-01-25T15:00:37.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76b597e700 1 -- 172.21.15.170:0/710623096 learned_addr learned my addr 172.21.15.170:0/710623096 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:37.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76b517d700 1 --2- 172.21.15.170:0/710623096 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76b01021f0 0x7f76b0074020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:37.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76b617f700 1 -- 172.21.15.170:0/710623096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76b0101830 msgr2=0x7f76b0073ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:37.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76b617f700 1 --2- 172.21.15.170:0/710623096 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f76b0101830 0x7f76b0073ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:37.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76b617f700 1 -- 172.21.15.170:0/710623096 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76b01021f0 msgr2=0x7f76b0074020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:37.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76b617f700 1 --2- 172.21.15.170:0/710623096 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76b01021f0 0x7f76b0074020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:37.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76b617f700 1 -- 172.21.15.170:0/710623096 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a00095f0 con 0x7f76b0106700 2024-01-25T15:00:37.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76b617f700 1 --2- 172.21.15.170:0/710623096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b0106700 0x7f76b0074560 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f76a800be20 tx=0x7f76a8009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:37.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76a6ffd700 1 -- 172.21.15.170:0/710623096 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a800cb90 con 0x7f76b0106700 2024-01-25T15:00:37.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76a6ffd700 1 -- 172.21.15.170:0/710623096 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76a800ccf0 con 0x7f76b0106700 2024-01-25T15:00:37.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76b7be2700 1 -- 172.21.15.170:0/710623096 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b01a6760 con 0x7f76b0106700 2024-01-25T15:00:37.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76a6ffd700 1 -- 172.21.15.170:0/710623096 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8012670 con 0x7f76b0106700 2024-01-25T15:00:37.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.787+0000 7f76b7be2700 1 -- 172.21.15.170:0/710623096 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b01a6c30 con 0x7f76b0106700 2024-01-25T15:00:37.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.788+0000 7f76b7be2700 1 -- 172.21.15.170:0/710623096 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76b0111ad0 con 0x7f76b0106700 2024-01-25T15:00:37.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.789+0000 7f76a6ffd700 1 -- 172.21.15.170:0/710623096 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f76a8014440 con 0x7f76b0106700 2024-01-25T15:00:37.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.790+0000 7f76a6ffd700 1 --2- 172.21.15.170:0/710623096 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f769c0a1400 0x7f769c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:37.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.790+0000 7f76b597e700 1 --2- 172.21.15.170:0/710623096 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f769c0a1400 0x7f769c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:37.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.790+0000 7f76a6ffd700 1 -- 172.21.15.170:0/710623096 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f76a8006e40 con 0x7f76b0106700 2024-01-25T15:00:37.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.790+0000 7f76a6ffd700 1 --2- 172.21.15.170:0/710623096 >> [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083] conn(0x7f769c0aabe0 0x7f769c0ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:37.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.790+0000 7f76a6ffd700 1 -- 172.21.15.170:0/710623096 --> [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f769c0ad6b0 con 0x7f769c0aabe0 2024-01-25T15:00:37.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.790+0000 7f76a6ffd700 1 -- 172.21.15.170:0/710623096 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76a80ccd00 con 0x7f76b0106700 2024-01-25T15:00:37.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.790+0000 7f76b517d700 1 --2- 172.21.15.170:0/710623096 >> [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083] conn(0x7f769c0aabe0 0x7f769c0ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:37.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.790+0000 7f76b597e700 1 --2- 172.21.15.170:0/710623096 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f769c0a1400 0x7f769c0a38c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f76ac005950 tx=0x7f76ac00b500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:37.792 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.791+0000 7f76b517d700 1 --2- 172.21.15.170:0/710623096 >> [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083] conn(0x7f769c0aabe0 0x7f769c0ad000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:37.793 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.791+0000 7f76a6ffd700 1 -- 172.21.15.170:0/710623096 <== osd.9 v2:172.21.15.170:6826/2766984083 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f769c0ad6b0 con 0x7f769c0aabe0 2024-01-25T15:00:37.801 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:37.802 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:37.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.821+0000 7f76b7be2700 1 -- 172.21.15.170:0/710623096 --> [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76b0061e70 con 0x7f769c0aabe0 2024-01-25T15:00:37.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.822+0000 7f76a6ffd700 1 -- 172.21.15.170:0/710623096 <== osd.9 v2:172.21.15.170:6826/2766984083 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f76b0061e70 con 0x7f769c0aabe0 2024-01-25T15:00:37.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.822+0000 7f76b7be2700 1 -- 172.21.15.170:0/710623096 >> [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083] conn(0x7f769c0aabe0 msgr2=0x7f769c0ad000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:37.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.822+0000 7f76b7be2700 1 --2- 172.21.15.170:0/710623096 >> [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083] conn(0x7f769c0aabe0 0x7f769c0ad000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:37.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.823+0000 7f76b7be2700 1 -- 172.21.15.170:0/710623096 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f769c0a1400 msgr2=0x7f769c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:37.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.823+0000 7f76b7be2700 1 --2- 172.21.15.170:0/710623096 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f769c0a1400 0x7f769c0a38c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f76ac005950 tx=0x7f76ac00b500 comp rx=0 tx=0).stop 2024-01-25T15:00:37.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.823+0000 7f76b7be2700 1 -- 172.21.15.170:0/710623096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b0106700 msgr2=0x7f76b0074560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:37.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.823+0000 7f76b7be2700 1 --2- 172.21.15.170:0/710623096 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f76b0106700 0x7f76b0074560 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f76a800be20 tx=0x7f76a8009ed0 comp rx=0 tx=0).stop 2024-01-25T15:00:37.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.823+0000 7f76b617f700 1 -- 172.21.15.170:0/710623096 reap_dead start 2024-01-25T15:00:37.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.827+0000 7f76b7be2700 1 -- 172.21.15.170:0/710623096 shutdown_connections 2024-01-25T15:00:37.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.827+0000 7f76b7be2700 1 -- 172.21.15.170:0/710623096 >> 172.21.15.170:0/710623096 conn(0x7f76b0078910 msgr2=0x7f76b00ff9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:37.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.828+0000 7f76b7be2700 1 -- 172.21.15.170:0/710623096 shutdown_connections 2024-01-25T15:00:37.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:37.828+0000 7f76b7be2700 1 -- 172.21.15.170:0/710623096 wait complete. 2024-01-25T15:00:38.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.451+0000 7f83944f8700 1 -- 172.21.15.170:0/332673733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f838c1067b0 msgr2=0x7f838c106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:38.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.451+0000 7f83944f8700 1 --2- 172.21.15.170:0/332673733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f838c1067b0 0x7f838c106b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8388009990 tx=0x7f8388009ca0 comp rx=0 tx=0).stop 2024-01-25T15:00:38.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.452+0000 7f83944f8700 1 -- 172.21.15.170:0/332673733 shutdown_connections 2024-01-25T15:00:38.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.452+0000 7f83944f8700 1 --2- 172.21.15.170:0/332673733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f838c1018a0 0x7f838c10d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:38.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.452+0000 7f83944f8700 1 --2- 172.21.15.170:0/332673733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f838c1067b0 0x7f838c106b90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:38.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.452+0000 7f83944f8700 1 --2- 172.21.15.170:0/332673733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838c100ee0 0x7f838c101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:38.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.452+0000 7f83944f8700 1 -- 172.21.15.170:0/332673733 >> 172.21.15.170:0/332673733 conn(0x7f838c076ce0 msgr2=0x7f838c0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:38.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.452+0000 7f83944f8700 1 -- 172.21.15.170:0/332673733 shutdown_connections 2024-01-25T15:00:38.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.452+0000 7f83944f8700 1 -- 172.21.15.170:0/332673733 wait complete. 2024-01-25T15:00:38.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.452+0000 7f83944f8700 1 Processor -- start 2024-01-25T15:00:38.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.452+0000 7f83944f8700 1 -- start start 2024-01-25T15:00:38.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.452+0000 7f83944f8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f838c100ee0 0x7f838c1023c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:38.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.452+0000 7f83944f8700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f838c1018a0 0x7f838c102900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:38.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.452+0000 7f83944f8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838c1067b0 0x7f838c102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:38.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f83944f8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c1a6050 con 0x7f838c100ee0 2024-01-25T15:00:38.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f83944f8700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c1a61c0 con 0x7f838c1018a0 2024-01-25T15:00:38.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f83944f8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c1a6380 con 0x7f838c1067b0 2024-01-25T15:00:38.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f8392294700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f838c100ee0 0x7f838c1023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:38.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f8392294700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f838c100ee0 0x7f838c1023c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36968/0 (socket says 172.21.15.170:36968) 2024-01-25T15:00:38.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f8392294700 1 -- 172.21.15.170:0/1499112849 learned_addr learned my addr 172.21.15.170:0/1499112849 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:38.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f8392a95700 1 --2- 172.21.15.170:0/1499112849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838c1067b0 0x7f838c102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:38.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f8391a93700 1 --2- 172.21.15.170:0/1499112849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f838c1018a0 0x7f838c102900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:38.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f8392294700 1 -- 172.21.15.170:0/1499112849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838c1067b0 msgr2=0x7f838c102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:38.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f8392294700 1 --2- 172.21.15.170:0/1499112849 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f838c1067b0 0x7f838c102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:38.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f8392294700 1 -- 172.21.15.170:0/1499112849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f838c1018a0 msgr2=0x7f838c102900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:38.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f8392294700 1 --2- 172.21.15.170:0/1499112849 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f838c1018a0 0x7f838c102900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:38.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f8392294700 1 -- 172.21.15.170:0/1499112849 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880095f0 con 0x7f838c100ee0 2024-01-25T15:00:38.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f8392294700 1 --2- 172.21.15.170:0/1499112849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f838c100ee0 0x7f838c1023c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8388000c00 tx=0x7f838800f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:38.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f83837fe700 1 -- 172.21.15.170:0/1499112849 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838801d070 con 0x7f838c100ee0 2024-01-25T15:00:38.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.453+0000 7f83944f8700 1 -- 172.21.15.170:0/1499112849 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f838c1a6600 con 0x7f838c100ee0 2024-01-25T15:00:38.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.454+0000 7f83944f8700 1 -- 172.21.15.170:0/1499112849 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838c1a6a70 con 0x7f838c100ee0 2024-01-25T15:00:38.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.454+0000 7f83837fe700 1 -- 172.21.15.170:0/1499112849 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f838800fc50 con 0x7f838c100ee0 2024-01-25T15:00:38.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.454+0000 7f83837fe700 1 -- 172.21.15.170:0/1499112849 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388017630 con 0x7f838c100ee0 2024-01-25T15:00:38.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.454+0000 7f83944f8700 1 -- 172.21.15.170:0/1499112849 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8370001030 con 0x7f838c100ee0 2024-01-25T15:00:38.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.456+0000 7f83837fe700 1 -- 172.21.15.170:0/1499112849 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f8388022470 con 0x7f838c100ee0 2024-01-25T15:00:38.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.456+0000 7f83837fe700 1 --2- 172.21.15.170:0/1499112849 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f83780a1480 0x7f83780a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:38.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.457+0000 7f8391a93700 1 --2- 172.21.15.170:0/1499112849 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f83780a1480 0x7f83780a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:38.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.457+0000 7f83837fe700 1 -- 172.21.15.170:0/1499112849 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f83880ce7e0 con 0x7f838c100ee0 2024-01-25T15:00:38.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.457+0000 7f83837fe700 1 --2- 172.21.15.170:0/1499112849 >> [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135] conn(0x7f83780aac60 0x7f83780ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:38.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.457+0000 7f83837fe700 1 -- 172.21.15.170:0/1499112849 --> [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83780ad730 con 0x7f83780aac60 2024-01-25T15:00:38.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.457+0000 7f83837fe700 1 -- 172.21.15.170:0/1499112849 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83880cec80 con 0x7f838c100ee0 2024-01-25T15:00:38.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.457+0000 7f8391a93700 1 --2- 172.21.15.170:0/1499112849 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f83780a1480 0x7f83780a3940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f838c105550 tx=0x7f837c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:38.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.457+0000 7f8392a95700 1 --2- 172.21.15.170:0/1499112849 >> [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135] conn(0x7f83780aac60 0x7f83780ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:38.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.458+0000 7f8392a95700 1 --2- 172.21.15.170:0/1499112849 >> [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135] conn(0x7f83780aac60 0x7f83780ad080 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:38.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.459+0000 7f83837fe700 1 -- 172.21.15.170:0/1499112849 <== osd.11 v2:172.21.15.191:6824/2951008135 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f83780ad730 con 0x7f83780aac60 2024-01-25T15:00:38.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.480+0000 7f83944f8700 1 -- 172.21.15.170:0/1499112849 --> [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8370002dc0 con 0x7f83780aac60 2024-01-25T15:00:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.481+0000 7f83837fe700 1 -- 172.21.15.170:0/1499112849 <== osd.11 v2:172.21.15.191:6824/2951008135 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8370002dc0 con 0x7f83780aac60 2024-01-25T15:00:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.481+0000 7f83944f8700 1 -- 172.21.15.170:0/1499112849 >> [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135] conn(0x7f83780aac60 msgr2=0x7f83780ad080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.481+0000 7f83944f8700 1 --2- 172.21.15.170:0/1499112849 >> [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135] conn(0x7f83780aac60 0x7f83780ad080 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.481+0000 7f83944f8700 1 -- 172.21.15.170:0/1499112849 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f83780a1480 msgr2=0x7f83780a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.481+0000 7f83944f8700 1 --2- 172.21.15.170:0/1499112849 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f83780a1480 0x7f83780a3940 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f838c105550 tx=0x7f837c009190 comp rx=0 tx=0).stop 2024-01-25T15:00:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.482+0000 7f83944f8700 1 -- 172.21.15.170:0/1499112849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f838c100ee0 msgr2=0x7f838c1023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.482+0000 7f83944f8700 1 --2- 172.21.15.170:0/1499112849 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f838c100ee0 0x7f838c1023c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8388000c00 tx=0x7f838800f7d0 comp rx=0 tx=0).stop 2024-01-25T15:00:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.482+0000 7f8392a95700 1 -- 172.21.15.170:0/1499112849 reap_dead start 2024-01-25T15:00:38.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.482+0000 7f83944f8700 1 -- 172.21.15.170:0/1499112849 shutdown_connections 2024-01-25T15:00:38.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.482+0000 7f83944f8700 1 -- 172.21.15.170:0/1499112849 >> 172.21.15.170:0/1499112849 conn(0x7f838c076ce0 msgr2=0x7f838c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:38.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.483+0000 7f83944f8700 1 -- 172.21.15.170:0/1499112849 shutdown_connections 2024-01-25T15:00:38.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:38.483+0000 7f83944f8700 1 -- 172.21.15.170:0/1499112849 wait complete. 2024-01-25T15:00:39.123 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:39 smithi170 ceph-mon[31899]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-01-25T15:00:39.224 INFO:teuthology.orchestra.run.smithi170.stdout:309237645339 2024-01-25T15:00:39.224 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd last-stat-seq osd.10 2024-01-25T15:00:39.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:39 smithi186 ceph-mon[35697]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-01-25T15:00:39.429 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:39.429 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:39.432 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:39.433 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:39.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:39 smithi191 ceph-mon[36347]: pgmap v306: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-01-25T15:00:41.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:41 smithi186 ceph-mon[35697]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:00:41.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:41 smithi170 ceph-mon[31899]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:00:41.698 INFO:teuthology.orchestra.run.smithi170.stdout:343597383702 2024-01-25T15:00:41.699 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd last-stat-seq osd.11 2024-01-25T15:00:41.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:41 smithi191 ceph-mon[36347]: pgmap v307: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:00:42.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.129+0000 7f308797f700 1 -- 172.21.15.170:0/3020827616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30801021c0 msgr2=0x7f308010e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:42.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.129+0000 7f308797f700 1 --2- 172.21.15.170:0/3020827616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30801021c0 0x7f308010e6d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f307800b0a0 tx=0x7f307800b3b0 comp rx=0 tx=0).stop 2024-01-25T15:00:42.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.129+0000 7f308797f700 1 -- 172.21.15.170:0/3020827616 shutdown_connections 2024-01-25T15:00:42.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.129+0000 7f308797f700 1 --2- 172.21.15.170:0/3020827616 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f30801021c0 0x7f308010e6d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:42.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.129+0000 7f308797f700 1 --2- 172.21.15.170:0/3020827616 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3080107800 0x7f3080107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:42.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.129+0000 7f308797f700 1 --2- 172.21.15.170:0/3020827616 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3080101800 0x7f3080101c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:42.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.129+0000 7f308797f700 1 -- 172.21.15.170:0/3020827616 >> 172.21.15.170:0/3020827616 conn(0x7f30800fd2b0 msgr2=0x7f30800ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:42.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.129+0000 7f308797f700 1 -- 172.21.15.170:0/3020827616 shutdown_connections 2024-01-25T15:00:42.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.129+0000 7f308797f700 1 -- 172.21.15.170:0/3020827616 wait complete. 2024-01-25T15:00:42.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f308797f700 1 Processor -- start 2024-01-25T15:00:42.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f308797f700 1 -- start start 2024-01-25T15:00:42.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f308797f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3080101800 0x7f3080073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:42.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f308797f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f30801021c0 0x7f3080074020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:42.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f308797f700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3080107800 0x7f3080074560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:42.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f308797f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30801a6260 con 0x7f3080101800 2024-01-25T15:00:42.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f308797f700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30801a63d0 con 0x7f3080107800 2024-01-25T15:00:42.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f308797f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30801a6590 con 0x7f30801021c0 2024-01-25T15:00:42.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f308571b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3080101800 0x7f3080073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:42.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f308571b700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3080101800 0x7f3080073ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36998/0 (socket says 172.21.15.170:36998) 2024-01-25T15:00:42.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f308571b700 1 -- 172.21.15.170:0/2278292951 learned_addr learned my addr 172.21.15.170:0/2278292951 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:42.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f3084f1a700 1 --2- 172.21.15.170:0/2278292951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f30801021c0 0x7f3080074020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:42.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f308571b700 1 -- 172.21.15.170:0/2278292951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f30801021c0 msgr2=0x7f3080074020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:42.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f308571b700 1 --2- 172.21.15.170:0/2278292951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f30801021c0 0x7f3080074020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:42.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f3085f1c700 1 --2- 172.21.15.170:0/2278292951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3080107800 0x7f3080074560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:42.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f308571b700 1 -- 172.21.15.170:0/2278292951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3080107800 msgr2=0x7f3080074560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:42.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.130+0000 7f308571b700 1 --2- 172.21.15.170:0/2278292951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3080107800 0x7f3080074560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:42.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.131+0000 7f308571b700 1 -- 172.21.15.170:0/2278292951 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3078009d00 con 0x7f3080101800 2024-01-25T15:00:42.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.131+0000 7f308571b700 1 --2- 172.21.15.170:0/2278292951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3080101800 0x7f3080073ae0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f307000b530 tx=0x7f307000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:42.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.131+0000 7f30767fc700 1 -- 172.21.15.170:0/2278292951 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3070011830 con 0x7f3080101800 2024-01-25T15:00:42.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.131+0000 7f30767fc700 1 -- 172.21.15.170:0/2278292951 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3070011e50 con 0x7f3080101800 2024-01-25T15:00:42.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.131+0000 7f308797f700 1 -- 172.21.15.170:0/2278292951 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30801a6870 con 0x7f3080101800 2024-01-25T15:00:42.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.131+0000 7f30767fc700 1 -- 172.21.15.170:0/2278292951 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307000f2e0 con 0x7f3080101800 2024-01-25T15:00:42.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.131+0000 7f308797f700 1 -- 172.21.15.170:0/2278292951 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30801a6d70 con 0x7f3080101800 2024-01-25T15:00:42.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.132+0000 7f308797f700 1 -- 172.21.15.170:0/2278292951 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3080109e20 con 0x7f3080101800 2024-01-25T15:00:42.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.133+0000 7f30767fc700 1 -- 172.21.15.170:0/2278292951 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f3070010580 con 0x7f3080101800 2024-01-25T15:00:42.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.134+0000 7f30767fc700 1 --2- 172.21.15.170:0/2278292951 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f306c0a1400 0x7f306c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:42.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.134+0000 7f3084f1a700 1 --2- 172.21.15.170:0/2278292951 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f306c0a1400 0x7f306c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:42.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.134+0000 7f30767fc700 1 -- 172.21.15.170:0/2278292951 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f30700cc650 con 0x7f3080101800 2024-01-25T15:00:42.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.135+0000 7f3084f1a700 1 --2- 172.21.15.170:0/2278292951 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f306c0a1400 0x7f306c0a38c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f307c006fd0 tx=0x7f307c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:42.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.138+0000 7f30767fc700 1 -- 172.21.15.170:0/2278292951 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f3070095b30 con 0x7f3080101800 2024-01-25T15:00:42.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.344+0000 7f308797f700 1 -- 172.21.15.170:0/2278292951 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3080075010 con 0x7f3080101800 2024-01-25T15:00:42.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.344+0000 7f30767fc700 1 -- 172.21.15.170:0/2278292951 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3070099150 con 0x7f3080101800 2024-01-25T15:00:42.345 INFO:teuthology.orchestra.run.smithi170.stdout:55834574920 2024-01-25T15:00:42.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.346+0000 7f308797f700 1 -- 172.21.15.170:0/2278292951 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f306c0a1400 msgr2=0x7f306c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:42.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.346+0000 7f308797f700 1 --2- 172.21.15.170:0/2278292951 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f306c0a1400 0x7f306c0a38c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f307c006fd0 tx=0x7f307c008040 comp rx=0 tx=0).stop 2024-01-25T15:00:42.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.346+0000 7f308797f700 1 -- 172.21.15.170:0/2278292951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3080101800 msgr2=0x7f3080073ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:42.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.346+0000 7f308797f700 1 --2- 172.21.15.170:0/2278292951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3080101800 0x7f3080073ae0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f307000b530 tx=0x7f307000b8f0 comp rx=0 tx=0).stop 2024-01-25T15:00:42.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.346+0000 7f308797f700 1 -- 172.21.15.170:0/2278292951 shutdown_connections 2024-01-25T15:00:42.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.346+0000 7f308797f700 1 --2- 172.21.15.170:0/2278292951 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f306c0a1400 0x7f306c0a38c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:42.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.346+0000 7f308797f700 1 --2- 172.21.15.170:0/2278292951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3080107800 0x7f3080074560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:42.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.346+0000 7f308797f700 1 --2- 172.21.15.170:0/2278292951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3080101800 0x7f3080073ae0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:42.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.346+0000 7f308797f700 1 --2- 172.21.15.170:0/2278292951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f30801021c0 0x7f3080074020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:42.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.346+0000 7f308797f700 1 -- 172.21.15.170:0/2278292951 >> 172.21.15.170:0/2278292951 conn(0x7f30800fd2b0 msgr2=0x7f30800fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:42.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.346+0000 7f308797f700 1 -- 172.21.15.170:0/2278292951 shutdown_connections 2024-01-25T15:00:42.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:42.346+0000 7f308797f700 1 -- 172.21.15.170:0/2278292951 wait complete. 2024-01-25T15:00:43.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:43 smithi170 ceph-mon[31899]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-25T15:00:43.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:43 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2278292951' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-01-25T15:00:43.507 INFO:teuthology.orchestra.run.smithi170.stdout:287762808863 2024-01-25T15:00:43.507 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph osd last-stat-seq osd.9 2024-01-25T15:00:43.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:43 smithi186 ceph-mon[35697]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-25T15:00:43.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:43 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2278292951' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-01-25T15:00:43.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:43 smithi191 ceph-mon[36347]: pgmap v308: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-25T15:00:43.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:43 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2278292951' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-01-25T15:00:43.942 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574917 got 55834574920 for osd.1 2024-01-25T15:00:43.943 DEBUG:teuthology.parallel:result is None 2024-01-25T15:00:45.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:45 smithi186 ceph-mon[35697]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2024-01-25T15:00:45.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:45 smithi170 ceph-mon[31899]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2024-01-25T15:00:45.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:45 smithi191 ceph-mon[36347]: pgmap v309: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 10 op/s 2024-01-25T15:00:46.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.310+0000 7febf6ea3700 1 -- 172.21.15.170:0/2909004316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febf0106700 msgr2=0x7febf0106ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:46.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.310+0000 7febf6ea3700 1 --2- 172.21.15.170:0/2909004316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febf0106700 0x7febf0106ae0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7febe4009990 tx=0x7febe4009ca0 comp rx=0 tx=0).stop 2024-01-25T15:00:46.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.310+0000 7febf6ea3700 1 -- 172.21.15.170:0/2909004316 shutdown_connections 2024-01-25T15:00:46.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.310+0000 7febf6ea3700 1 --2- 172.21.15.170:0/2909004316 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febf01021f0 0x7febf010e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:46.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.310+0000 7febf6ea3700 1 --2- 172.21.15.170:0/2909004316 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febf0106700 0x7febf0106ae0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:46.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.310+0000 7febf6ea3700 1 --2- 172.21.15.170:0/2909004316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febf0101830 0x7febf0101cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:46.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.310+0000 7febf6ea3700 1 -- 172.21.15.170:0/2909004316 >> 172.21.15.170:0/2909004316 conn(0x7febf0078910 msgr2=0x7febf0078d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:46.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.310+0000 7febf6ea3700 1 -- 172.21.15.170:0/2909004316 shutdown_connections 2024-01-25T15:00:46.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.310+0000 7febf6ea3700 1 -- 172.21.15.170:0/2909004316 wait complete. 2024-01-25T15:00:46.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf6ea3700 1 Processor -- start 2024-01-25T15:00:46.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf6ea3700 1 -- start start 2024-01-25T15:00:46.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf6ea3700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febf0101830 0x7febf019da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:46.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf6ea3700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febf01021f0 0x7febf019df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:46.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf6ea3700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febf0106700 0x7febf0197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:46.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf6ea3700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf01982d0 con 0x7febf0101830 2024-01-25T15:00:46.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf6ea3700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf0198440 con 0x7febf01021f0 2024-01-25T15:00:46.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf6ea3700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf0198600 con 0x7febf0106700 2024-01-25T15:00:46.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf4c3f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febf0101830 0x7febf019da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:46.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf4c3f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febf0101830 0x7febf019da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50064/0 (socket says 172.21.15.170:50064) 2024-01-25T15:00:46.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf4c3f700 1 -- 172.21.15.170:0/3991728675 learned_addr learned my addr 172.21.15.170:0/3991728675 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:46.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf4c3f700 1 -- 172.21.15.170:0/3991728675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febf0106700 msgr2=0x7febf0197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:46.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf4c3f700 1 --2- 172.21.15.170:0/3991728675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febf0106700 0x7febf0197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:46.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febeffff700 1 --2- 172.21.15.170:0/3991728675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febf01021f0 0x7febf019df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:46.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf4c3f700 1 -- 172.21.15.170:0/3991728675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febf01021f0 msgr2=0x7febf019df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:46.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf4c3f700 1 --2- 172.21.15.170:0/3991728675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febf01021f0 0x7febf019df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:46.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febf4c3f700 1 -- 172.21.15.170:0/3991728675 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe40095f0 con 0x7febf0101830 2024-01-25T15:00:46.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.311+0000 7febeffff700 1 --2- 172.21.15.170:0/3991728675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febf01021f0 0x7febf019df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:00:46.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.312+0000 7febf4c3f700 1 --2- 172.21.15.170:0/3991728675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febf0101830 0x7febf019da50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7febe4000c00 tx=0x7febe400f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:46.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.312+0000 7febedffb700 1 -- 172.21.15.170:0/3991728675 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe401d070 con 0x7febf0101830 2024-01-25T15:00:46.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.312+0000 7febedffb700 1 -- 172.21.15.170:0/3991728675 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febe400fde0 con 0x7febf0101830 2024-01-25T15:00:46.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.312+0000 7febf6ea3700 1 -- 172.21.15.170:0/3991728675 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf0198880 con 0x7febf0101830 2024-01-25T15:00:46.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.312+0000 7febedffb700 1 -- 172.21.15.170:0/3991728675 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4017770 con 0x7febf0101830 2024-01-25T15:00:46.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.312+0000 7febf6ea3700 1 -- 172.21.15.170:0/3991728675 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf01a49d0 con 0x7febf0101830 2024-01-25T15:00:46.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.313+0000 7febf6ea3700 1 -- 172.21.15.170:0/3991728675 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf0109d70 con 0x7febf0101830 2024-01-25T15:00:46.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.314+0000 7febedffb700 1 -- 172.21.15.170:0/3991728675 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7febe4022aa0 con 0x7febf0101830 2024-01-25T15:00:46.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.315+0000 7febedffb700 1 --2- 172.21.15.170:0/3991728675 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7febe00a1400 0x7febe00a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:46.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.315+0000 7febeffff700 1 --2- 172.21.15.170:0/3991728675 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7febe00a1400 0x7febe00a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:46.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.315+0000 7febedffb700 1 -- 172.21.15.170:0/3991728675 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7febe40ce1d0 con 0x7febf0101830 2024-01-25T15:00:46.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.315+0000 7febeffff700 1 --2- 172.21.15.170:0/3991728675 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7febe00a1400 0x7febe00a38c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7febdc005fd0 tx=0x7febdc005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:46.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.318+0000 7febedffb700 1 -- 172.21.15.170:0/3991728675 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7febe4097730 con 0x7febf0101830 2024-01-25T15:00:46.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.520+0000 7febf6ea3700 1 -- 172.21.15.170:0/3991728675 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7febf0102f20 con 0x7febf0101830 2024-01-25T15:00:46.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.521+0000 7febedffb700 1 -- 172.21.15.170:0/3991728675 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7febe409ad50 con 0x7febf0101830 2024-01-25T15:00:46.522 INFO:teuthology.orchestra.run.smithi170.stdout:197568495665 2024-01-25T15:00:46.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.523+0000 7febf6ea3700 1 -- 172.21.15.170:0/3991728675 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7febe00a1400 msgr2=0x7febe00a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:46.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.523+0000 7febf6ea3700 1 --2- 172.21.15.170:0/3991728675 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7febe00a1400 0x7febe00a38c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7febdc005fd0 tx=0x7febdc005dc0 comp rx=0 tx=0).stop 2024-01-25T15:00:46.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.523+0000 7febf6ea3700 1 -- 172.21.15.170:0/3991728675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febf0101830 msgr2=0x7febf019da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:46.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.523+0000 7febf6ea3700 1 --2- 172.21.15.170:0/3991728675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febf0101830 0x7febf019da50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7febe4000c00 tx=0x7febe400f880 comp rx=0 tx=0).stop 2024-01-25T15:00:46.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.523+0000 7febf6ea3700 1 -- 172.21.15.170:0/3991728675 shutdown_connections 2024-01-25T15:00:46.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.523+0000 7febf6ea3700 1 --2- 172.21.15.170:0/3991728675 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7febe00a1400 0x7febe00a38c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:46.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.523+0000 7febf6ea3700 1 --2- 172.21.15.170:0/3991728675 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febf0106700 0x7febf0197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:46.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.523+0000 7febf6ea3700 1 --2- 172.21.15.170:0/3991728675 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febf0101830 0x7febf019da50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:46.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.523+0000 7febf6ea3700 1 --2- 172.21.15.170:0/3991728675 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febf01021f0 0x7febf019df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:46.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.523+0000 7febf6ea3700 1 -- 172.21.15.170:0/3991728675 >> 172.21.15.170:0/3991728675 conn(0x7febf0078910 msgr2=0x7febf00ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:46.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.523+0000 7febf6ea3700 1 -- 172.21.15.170:0/3991728675 shutdown_connections 2024-01-25T15:00:46.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:46.523+0000 7febf6ea3700 1 -- 172.21.15.170:0/3991728675 wait complete. 2024-01-25T15:00:47.426 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:47 smithi170 ceph-mon[31899]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:00:47.427 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:47 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3991728675' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-01-25T15:00:47.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:47 smithi186 ceph-mon[35697]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:00:47.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:47 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3991728675' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-01-25T15:00:47.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:47 smithi191 ceph-mon[36347]: pgmap v310: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:00:47.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:47 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3991728675' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-01-25T15:00:47.788 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495662 got 197568495665 for osd.6 2024-01-25T15:00:47.788 DEBUG:teuthology.parallel:result is None 2024-01-25T15:00:47.994 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:47.994 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:47.996 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:48.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.696+0000 7f97b1194700 1 -- 172.21.15.170:0/1887657972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac100710 msgr2=0x7f97ac100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:48.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.696+0000 7f97b1194700 1 --2- 172.21.15.170:0/1887657972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac100710 0x7f97ac100b90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9794009990 tx=0x7f9794009ca0 comp rx=0 tx=0).stop 2024-01-25T15:00:48.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.696+0000 7f97b1194700 1 -- 172.21.15.170:0/1887657972 shutdown_connections 2024-01-25T15:00:48.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.696+0000 7f97b1194700 1 --2- 172.21.15.170:0/1887657972 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97ac1066c0 0x7f97ac106aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:48.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.696+0000 7f97b1194700 1 --2- 172.21.15.170:0/1887657972 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97ac1010d0 0x7f97ac10d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:48.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.696+0000 7f97b1194700 1 --2- 172.21.15.170:0/1887657972 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac100710 0x7f97ac100b90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:48.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.696+0000 7f97b1194700 1 -- 172.21.15.170:0/1887657972 >> 172.21.15.170:0/1887657972 conn(0x7f97ac0766f0 msgr2=0x7f97ac076b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:48.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.696+0000 7f97b1194700 1 -- 172.21.15.170:0/1887657972 shutdown_connections 2024-01-25T15:00:48.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.696+0000 7f97b1194700 1 -- 172.21.15.170:0/1887657972 wait complete. 2024-01-25T15:00:48.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.697+0000 7f97b1194700 1 Processor -- start 2024-01-25T15:00:48.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.697+0000 7f97b1194700 1 -- start start 2024-01-25T15:00:48.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.697+0000 7f97b1194700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97ac100710 0x7f97ac19d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:48.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.697+0000 7f97b1194700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac1010d0 0x7f97ac19ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:48.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.697+0000 7f97b1194700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97ac1066c0 0x7f97ac197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:48.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.697+0000 7f97b1194700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac198140 con 0x7f97ac1010d0 2024-01-25T15:00:48.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.697+0000 7f97b1194700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac198280 con 0x7f97ac100710 2024-01-25T15:00:48.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.697+0000 7f97b1194700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac198440 con 0x7f97ac1066c0 2024-01-25T15:00:48.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.697+0000 7f97aa59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac1010d0 0x7f97ac19ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:48.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.697+0000 7f97aa59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac1010d0 0x7f97ac19ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50072/0 (socket says 172.21.15.170:50072) 2024-01-25T15:00:48.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.697+0000 7f97aa59c700 1 -- 172.21.15.170:0/1178127786 learned_addr learned my addr 172.21.15.170:0/1178127786 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:48.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.698+0000 7f97ab59e700 1 --2- 172.21.15.170:0/1178127786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97ac1066c0 0x7f97ac197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:48.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.698+0000 7f97aad9d700 1 --2- 172.21.15.170:0/1178127786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97ac100710 0x7f97ac19d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:48.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.698+0000 7f97aa59c700 1 -- 172.21.15.170:0/1178127786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97ac1066c0 msgr2=0x7f97ac197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:48.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.698+0000 7f97aa59c700 1 --2- 172.21.15.170:0/1178127786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97ac1066c0 0x7f97ac197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:48.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.698+0000 7f97aa59c700 1 -- 172.21.15.170:0/1178127786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97ac100710 msgr2=0x7f97ac19d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:48.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.698+0000 7f97aa59c700 1 --2- 172.21.15.170:0/1178127786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97ac100710 0x7f97ac19d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:48.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.698+0000 7f97aa59c700 1 -- 172.21.15.170:0/1178127786 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97940095f0 con 0x7f97ac1010d0 2024-01-25T15:00:48.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.698+0000 7f97aa59c700 1 --2- 172.21.15.170:0/1178127786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac1010d0 0x7f97ac19ddc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9794000c00 tx=0x7f979400f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:48.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.698+0000 7f97a3fff700 1 -- 172.21.15.170:0/1178127786 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979401d070 con 0x7f97ac1010d0 2024-01-25T15:00:48.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.698+0000 7f97b1194700 1 -- 172.21.15.170:0/1178127786 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ac1986c0 con 0x7f97ac1010d0 2024-01-25T15:00:48.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.698+0000 7f97a3fff700 1 -- 172.21.15.170:0/1178127786 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f979400fc80 con 0x7f97ac1010d0 2024-01-25T15:00:48.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.698+0000 7f97a3fff700 1 -- 172.21.15.170:0/1178127786 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9794017630 con 0x7f97ac1010d0 2024-01-25T15:00:48.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.698+0000 7f97b1194700 1 -- 172.21.15.170:0/1178127786 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac1a4920 con 0x7f97ac1010d0 2024-01-25T15:00:48.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.699+0000 7f97b1194700 1 -- 172.21.15.170:0/1178127786 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ac101df0 con 0x7f97ac1010d0 2024-01-25T15:00:48.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.700+0000 7f97a3fff700 1 -- 172.21.15.170:0/1178127786 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f9794004830 con 0x7f97ac1010d0 2024-01-25T15:00:48.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.701+0000 7f97a3fff700 1 --2- 172.21.15.170:0/1178127786 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f97980a1400 0x7f97980a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:48.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.701+0000 7f97aad9d700 1 --2- 172.21.15.170:0/1178127786 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f97980a1400 0x7f97980a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:48.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.701+0000 7f97a3fff700 1 -- 172.21.15.170:0/1178127786 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f97940ce370 con 0x7f97ac1010d0 2024-01-25T15:00:48.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.701+0000 7f97aad9d700 1 --2- 172.21.15.170:0/1178127786 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f97980a1400 0x7f97980a38c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f97a40060b0 tx=0x7f97a400c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:48.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.704+0000 7f97a3fff700 1 -- 172.21.15.170:0/1178127786 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f97940978d0 con 0x7f97ac1010d0 2024-01-25T15:00:48.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.899+0000 7f97b1194700 1 -- 172.21.15.170:0/1178127786 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f97ac0684a0 con 0x7f97ac1010d0 2024-01-25T15:00:48.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.899+0000 7f97a3fff700 1 -- 172.21.15.170:0/1178127786 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f979409aef0 con 0x7f97ac1010d0 2024-01-25T15:00:48.900 INFO:teuthology.orchestra.run.smithi170.stdout:163208757301 2024-01-25T15:00:48.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.901+0000 7f97b1194700 1 -- 172.21.15.170:0/1178127786 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f97980a1400 msgr2=0x7f97980a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:48.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.901+0000 7f97b1194700 1 --2- 172.21.15.170:0/1178127786 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f97980a1400 0x7f97980a38c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f97a40060b0 tx=0x7f97a400c040 comp rx=0 tx=0).stop 2024-01-25T15:00:48.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.901+0000 7f97b1194700 1 -- 172.21.15.170:0/1178127786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac1010d0 msgr2=0x7f97ac19ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:48.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.901+0000 7f97b1194700 1 --2- 172.21.15.170:0/1178127786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac1010d0 0x7f97ac19ddc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9794000c00 tx=0x7f979400f7d0 comp rx=0 tx=0).stop 2024-01-25T15:00:48.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.901+0000 7f97b1194700 1 -- 172.21.15.170:0/1178127786 shutdown_connections 2024-01-25T15:00:48.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.901+0000 7f97b1194700 1 --2- 172.21.15.170:0/1178127786 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f97980a1400 0x7f97980a38c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:48.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.901+0000 7f97b1194700 1 --2- 172.21.15.170:0/1178127786 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97ac1066c0 0x7f97ac197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:48.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.901+0000 7f97b1194700 1 --2- 172.21.15.170:0/1178127786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97ac100710 0x7f97ac19d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:48.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.901+0000 7f97b1194700 1 --2- 172.21.15.170:0/1178127786 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97ac1010d0 0x7f97ac19ddc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:48.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.901+0000 7f97b1194700 1 -- 172.21.15.170:0/1178127786 >> 172.21.15.170:0/1178127786 conn(0x7f97ac0766f0 msgr2=0x7f97ac06a180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:48.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.901+0000 7f97b1194700 1 -- 172.21.15.170:0/1178127786 shutdown_connections 2024-01-25T15:00:48.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:48.901+0000 7f97b1194700 1 -- 172.21.15.170:0/1178127786 wait complete. 2024-01-25T15:00:49.223 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:49 smithi170 ceph-mon[31899]: pgmap v311: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-01-25T15:00:49.223 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:49 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1178127786' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-01-25T15:00:49.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:49 smithi186 ceph-mon[35697]: pgmap v311: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-01-25T15:00:49.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:49 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1178127786' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-01-25T15:00:49.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:49 smithi191 ceph-mon[36347]: pgmap v311: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-01-25T15:00:49.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:49 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1178127786' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-01-25T15:00:51.271 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757297 got 163208757301 for osd.5 2024-01-25T15:00:51.271 DEBUG:teuthology.parallel:result is None 2024-01-25T15:00:51.576 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:51 smithi170 ceph-mon[31899]: pgmap v312: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:00:51.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:51 smithi186 ceph-mon[35697]: pgmap v312: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:00:51.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.678+0000 7f37c2750700 1 -- 172.21.15.170:0/3422863862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37bc06a8a0 msgr2=0x7f37bc10e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:51.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.678+0000 7f37c2750700 1 --2- 172.21.15.170:0/3422863862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37bc06a8a0 0x7f37bc10e670 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f37b400b0d0 tx=0x7f37b400b3e0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.678+0000 7f37c2750700 1 -- 172.21.15.170:0/3422863862 shutdown_connections 2024-01-25T15:00:51.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.678+0000 7f37c2750700 1 --2- 172.21.15.170:0/3422863862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37bc06a8a0 0x7f37bc10e670 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.678+0000 7f37c2750700 1 --2- 172.21.15.170:0/3422863862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37bc1077c0 0x7f37bc107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.678+0000 7f37c2750700 1 --2- 172.21.15.170:0/3422863862 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37bc069ee0 0x7f37bc06a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.678+0000 7f37c2750700 1 -- 172.21.15.170:0/3422863862 >> 172.21.15.170:0/3422863862 conn(0x7f37bc076730 msgr2=0x7f37bc076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:51.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.678+0000 7f37c2750700 1 -- 172.21.15.170:0/3422863862 shutdown_connections 2024-01-25T15:00:51.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.678+0000 7f37c2750700 1 -- 172.21.15.170:0/3422863862 wait complete. 2024-01-25T15:00:51.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.679+0000 7f37c2750700 1 Processor -- start 2024-01-25T15:00:51.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.679+0000 7f37c2750700 1 -- start start 2024-01-25T15:00:51.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.679+0000 7f37c2750700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37bc069ee0 0x7f37bc100810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:51.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.679+0000 7f37c2750700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37bc06a8a0 0x7f37bc100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:51.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.679+0000 7f37c2750700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37bc1077c0 0x7f37bc101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:51.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.679+0000 7f37c2750700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc1a6080 con 0x7f37bc1077c0 2024-01-25T15:00:51.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.679+0000 7f37c2750700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc1a61f0 con 0x7f37bc06a8a0 2024-01-25T15:00:51.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.679+0000 7f37c2750700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc1a63b0 con 0x7f37bc069ee0 2024-01-25T15:00:51.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.679+0000 7f37c0ced700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37bc1077c0 0x7f37bc101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:51.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.679+0000 7f37c0ced700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37bc1077c0 0x7f37bc101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50092/0 (socket says 172.21.15.170:50092) 2024-01-25T15:00:51.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.679+0000 7f37c0ced700 1 -- 172.21.15.170:0/4218918912 learned_addr learned my addr 172.21.15.170:0/4218918912 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:51.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.679+0000 7f37bbfff700 1 --2- 172.21.15.170:0/4218918912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37bc069ee0 0x7f37bc100810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:51.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.679+0000 7f37bb7fe700 1 --2- 172.21.15.170:0/4218918912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37bc06a8a0 0x7f37bc100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:51.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.680+0000 7f37c0ced700 1 -- 172.21.15.170:0/4218918912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37bc069ee0 msgr2=0x7f37bc100810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:51.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.680+0000 7f37c0ced700 1 --2- 172.21.15.170:0/4218918912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37bc069ee0 0x7f37bc100810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.680+0000 7f37c0ced700 1 -- 172.21.15.170:0/4218918912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37bc06a8a0 msgr2=0x7f37bc100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:51.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.680+0000 7f37c0ced700 1 --2- 172.21.15.170:0/4218918912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37bc06a8a0 0x7f37bc100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.680+0000 7f37c0ced700 1 -- 172.21.15.170:0/4218918912 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4009d00 con 0x7f37bc1077c0 2024-01-25T15:00:51.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.680+0000 7f37bb7fe700 1 --2- 172.21.15.170:0/4218918912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37bc06a8a0 0x7f37bc100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:00:51.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.680+0000 7f37c0ced700 1 --2- 172.21.15.170:0/4218918912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37bc1077c0 0x7f37bc101290 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f37b4007fd0 tx=0x7f37b40094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:51.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.680+0000 7f37b97fa700 1 -- 172.21.15.170:0/4218918912 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b400e040 con 0x7f37bc1077c0 2024-01-25T15:00:51.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.680+0000 7f37c2750700 1 -- 172.21.15.170:0/4218918912 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc1a6630 con 0x7f37bc1077c0 2024-01-25T15:00:51.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.680+0000 7f37b97fa700 1 -- 172.21.15.170:0/4218918912 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37b4007950 con 0x7f37bc1077c0 2024-01-25T15:00:51.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.680+0000 7f37b97fa700 1 -- 172.21.15.170:0/4218918912 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b401b6b0 con 0x7f37bc1077c0 2024-01-25T15:00:51.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.680+0000 7f37c2750700 1 -- 172.21.15.170:0/4218918912 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc1a6aa0 con 0x7f37bc1077c0 2024-01-25T15:00:51.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.681+0000 7f37c2750700 1 -- 172.21.15.170:0/4218918912 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc0684a0 con 0x7f37bc1077c0 2024-01-25T15:00:51.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.682+0000 7f37b97fa700 1 -- 172.21.15.170:0/4218918912 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f37b4005050 con 0x7f37bc1077c0 2024-01-25T15:00:51.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.683+0000 7f37b97fa700 1 --2- 172.21.15.170:0/4218918912 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f37a40a1400 0x7f37a40a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:51.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.683+0000 7f37bbfff700 1 --2- 172.21.15.170:0/4218918912 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f37a40a1400 0x7f37a40a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:51.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.683+0000 7f37b97fa700 1 -- 172.21.15.170:0/4218918912 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f37b40ce490 con 0x7f37bc1077c0 2024-01-25T15:00:51.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.683+0000 7f37bbfff700 1 --2- 172.21.15.170:0/4218918912 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f37a40a1400 0x7f37a40a38c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00abd0 tx=0x7f37ac00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:51.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.686+0000 7f37b97fa700 1 -- 172.21.15.170:0/4218918912 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f37b40979f0 con 0x7f37bc1077c0 2024-01-25T15:00:51.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:51 smithi191 ceph-mon[36347]: pgmap v312: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:00:51.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.886+0000 7f37c2750700 1 -- 172.21.15.170:0/4218918912 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f37bc111710 con 0x7f37bc1077c0 2024-01-25T15:00:51.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.887+0000 7f37b97fa700 1 -- 172.21.15.170:0/4218918912 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f37b409b010 con 0x7f37bc1077c0 2024-01-25T15:00:51.888 INFO:teuthology.orchestra.run.smithi170.stdout:223338299437 2024-01-25T15:00:51.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.889+0000 7f37c2750700 1 -- 172.21.15.170:0/4218918912 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f37a40a1400 msgr2=0x7f37a40a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:51.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.889+0000 7f37c2750700 1 --2- 172.21.15.170:0/4218918912 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f37a40a1400 0x7f37a40a38c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f37ac00abd0 tx=0x7f37ac00a380 comp rx=0 tx=0).stop 2024-01-25T15:00:51.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.889+0000 7f37c2750700 1 -- 172.21.15.170:0/4218918912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37bc1077c0 msgr2=0x7f37bc101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:51.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.889+0000 7f37c2750700 1 --2- 172.21.15.170:0/4218918912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37bc1077c0 0x7f37bc101290 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f37b4007fd0 tx=0x7f37b40094c0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.889+0000 7f37c2750700 1 -- 172.21.15.170:0/4218918912 shutdown_connections 2024-01-25T15:00:51.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.889+0000 7f37c2750700 1 --2- 172.21.15.170:0/4218918912 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f37a40a1400 0x7f37a40a38c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.889+0000 7f37c2750700 1 --2- 172.21.15.170:0/4218918912 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f37bc069ee0 0x7f37bc100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.889+0000 7f37c2750700 1 --2- 172.21.15.170:0/4218918912 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f37bc1077c0 0x7f37bc101290 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.889+0000 7f37c2750700 1 --2- 172.21.15.170:0/4218918912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f37bc06a8a0 0x7f37bc100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.889+0000 7f37c2750700 1 -- 172.21.15.170:0/4218918912 >> 172.21.15.170:0/4218918912 conn(0x7f37bc076730 msgr2=0x7f37bc0ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:51.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.889+0000 7f37c2750700 1 -- 172.21.15.170:0/4218918912 shutdown_connections 2024-01-25T15:00:51.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.889+0000 7f37c2750700 1 -- 172.21.15.170:0/4218918912 wait complete. 2024-01-25T15:00:51.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.914+0000 7febe15bd700 1 -- 172.21.15.170:0/635553506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febdc1077a0 msgr2=0x7febdc107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:51.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.914+0000 7febe15bd700 1 --2- 172.21.15.170:0/635553506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febdc1077a0 0x7febdc107b80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7febcc0099c0 tx=0x7febcc009cd0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.914+0000 7febe15bd700 1 -- 172.21.15.170:0/635553506 shutdown_connections 2024-01-25T15:00:51.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.914+0000 7febe15bd700 1 --2- 172.21.15.170:0/635553506 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febdc069e30 0x7febdc10e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.914+0000 7febe15bd700 1 --2- 172.21.15.170:0/635553506 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febdc1077a0 0x7febdc107b80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.914+0000 7febe15bd700 1 --2- 172.21.15.170:0/635553506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febdc069490 0x7febdc0698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.914+0000 7febe15bd700 1 -- 172.21.15.170:0/635553506 >> 172.21.15.170:0/635553506 conn(0x7febdc077610 msgr2=0x7febdc077a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:51.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.914+0000 7febe15bd700 1 -- 172.21.15.170:0/635553506 shutdown_connections 2024-01-25T15:00:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.914+0000 7febe15bd700 1 -- 172.21.15.170:0/635553506 wait complete. 2024-01-25T15:00:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.914+0000 7febe15bd700 1 Processor -- start 2024-01-25T15:00:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febe15bd700 1 -- start start 2024-01-25T15:00:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febe15bd700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febdc069490 0x7febdc19d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febe15bd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febdc069e30 0x7febdc19dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febe15bd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febdc1077a0 0x7febdc1979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febe15bd700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc198050 con 0x7febdc069e30 2024-01-25T15:00:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febe15bd700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc198190 con 0x7febdc1077a0 2024-01-25T15:00:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febe15bd700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc198350 con 0x7febdc069490 2024-01-25T15:00:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febda7fc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febdc069e30 0x7febdc19dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febda7fc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febdc069e30 0x7febdc19dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50116/0 (socket says 172.21.15.170:50116) 2024-01-25T15:00:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febda7fc700 1 -- 172.21.15.170:0/626133521 learned_addr learned my addr 172.21.15.170:0/626133521 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febdaffd700 1 --2- 172.21.15.170:0/626133521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febdc069490 0x7febdc19d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febdb7fe700 1 --2- 172.21.15.170:0/626133521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febdc1077a0 0x7febdc1979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:51.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febda7fc700 1 -- 172.21.15.170:0/626133521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febdc069490 msgr2=0x7febdc19d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:51.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febda7fc700 1 --2- 172.21.15.170:0/626133521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febdc069490 0x7febdc19d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febda7fc700 1 -- 172.21.15.170:0/626133521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febdc1077a0 msgr2=0x7febdc1979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:51.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febda7fc700 1 --2- 172.21.15.170:0/626133521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febdc1077a0 0x7febdc1979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:51.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febda7fc700 1 -- 172.21.15.170:0/626133521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc0095f0 con 0x7febdc069e30 2024-01-25T15:00:51.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.915+0000 7febdaffd700 1 --2- 172.21.15.170:0/626133521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febdc069490 0x7febdc19d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:00:51.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.916+0000 7febda7fc700 1 --2- 172.21.15.170:0/626133521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febdc069e30 0x7febdc19dd70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7febd000c9b0 tx=0x7febd000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:51.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.916+0000 7febc3fff700 1 -- 172.21.15.170:0/626133521 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0007b00 con 0x7febdc069e30 2024-01-25T15:00:51.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.916+0000 7febe15bd700 1 -- 172.21.15.170:0/626133521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febdc198630 con 0x7febdc069e30 2024-01-25T15:00:51.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.916+0000 7febc3fff700 1 -- 172.21.15.170:0/626133521 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febd0007c60 con 0x7febdc069e30 2024-01-25T15:00:51.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.916+0000 7febc3fff700 1 -- 172.21.15.170:0/626133521 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0018660 con 0x7febdc069e30 2024-01-25T15:00:51.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.916+0000 7febe15bd700 1 -- 172.21.15.170:0/626133521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febdc1a48d0 con 0x7febdc069e30 2024-01-25T15:00:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.917+0000 7febe15bd700 1 -- 172.21.15.170:0/626133521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febdc109d50 con 0x7febdc069e30 2024-01-25T15:00:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.918+0000 7febc3fff700 1 -- 172.21.15.170:0/626133521 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7febd000f450 con 0x7febdc069e30 2024-01-25T15:00:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.919+0000 7febc3fff700 1 --2- 172.21.15.170:0/626133521 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7febc40a1400 0x7febc40a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:51.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.919+0000 7febc3fff700 1 -- 172.21.15.170:0/626133521 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7febd00ccad0 con 0x7febdc069e30 2024-01-25T15:00:51.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.919+0000 7febdaffd700 1 --2- 172.21.15.170:0/626133521 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7febc40a1400 0x7febc40a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:51.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.920+0000 7febdaffd700 1 --2- 172.21.15.170:0/626133521 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7febc40a1400 0x7febc40a38c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7febcc000c00 tx=0x7febcc005940 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:51.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:51.924+0000 7febc3fff700 1 -- 172.21.15.170:0/626133521 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7febd0095fa0 con 0x7febdc069e30 2024-01-25T15:00:52.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:52.123+0000 7febe15bd700 1 -- 172.21.15.170:0/626133521 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7febdc198f20 con 0x7febdc069e30 2024-01-25T15:00:52.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:52.124+0000 7febc3fff700 1 -- 172.21.15.170:0/626133521 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7febd00995c0 con 0x7febdc069e30 2024-01-25T15:00:52.125 INFO:teuthology.orchestra.run.smithi170.stdout:141733920827 2024-01-25T15:00:52.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:52.126+0000 7febe15bd700 1 -- 172.21.15.170:0/626133521 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7febc40a1400 msgr2=0x7febc40a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:52.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:52.126+0000 7febe15bd700 1 --2- 172.21.15.170:0/626133521 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7febc40a1400 0x7febc40a38c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7febcc000c00 tx=0x7febcc005940 comp rx=0 tx=0).stop 2024-01-25T15:00:52.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:52.126+0000 7febe15bd700 1 -- 172.21.15.170:0/626133521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febdc069e30 msgr2=0x7febdc19dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:52.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:52.126+0000 7febe15bd700 1 --2- 172.21.15.170:0/626133521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febdc069e30 0x7febdc19dd70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7febd000c9b0 tx=0x7febd000ccc0 comp rx=0 tx=0).stop 2024-01-25T15:00:52.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:52.126+0000 7febe15bd700 1 -- 172.21.15.170:0/626133521 shutdown_connections 2024-01-25T15:00:52.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:52.126+0000 7febe15bd700 1 --2- 172.21.15.170:0/626133521 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7febc40a1400 0x7febc40a38c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:52.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:52.126+0000 7febe15bd700 1 --2- 172.21.15.170:0/626133521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7febdc069490 0x7febdc19d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:52.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:52.126+0000 7febe15bd700 1 --2- 172.21.15.170:0/626133521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7febdc1077a0 0x7febdc1979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:52.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:52.126+0000 7febe15bd700 1 --2- 172.21.15.170:0/626133521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7febdc069e30 0x7febdc19dd70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:52.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:52.126+0000 7febe15bd700 1 -- 172.21.15.170:0/626133521 >> 172.21.15.170:0/626133521 conn(0x7febdc077610 msgr2=0x7febdc0fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:52.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:52.126+0000 7febe15bd700 1 -- 172.21.15.170:0/626133521 shutdown_connections 2024-01-25T15:00:52.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:52.126+0000 7febe15bd700 1 -- 172.21.15.170:0/626133521 wait complete. 2024-01-25T15:00:52.533 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:52 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/4218918912' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-01-25T15:00:52.533 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:52 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/626133521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-01-25T15:00:52.558 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299433 got 223338299437 for osd.7 2024-01-25T15:00:52.558 DEBUG:teuthology.parallel:result is None 2024-01-25T15:00:52.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:52 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/4218918912' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-01-25T15:00:52.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:52 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/626133521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-01-25T15:00:52.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:52 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/4218918912' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-01-25T15:00:52.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:52 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/626133521' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-01-25T15:00:53.516 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:53 smithi170 ceph-mon[31899]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-25T15:00:53.516 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:53 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T15:00:53.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:53 smithi186 ceph-mon[35697]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-25T15:00:53.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:53 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T15:00:53.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:53 smithi191 ceph-mon[36347]: pgmap v313: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-25T15:00:53.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:53 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T15:00:55.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:55 smithi170 ceph-mon[31899]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-01-25T15:00:55.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:55 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:00:55.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:55 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:00:55.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:55 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:00:55.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:55 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:00:55.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:55 smithi186 ceph-mon[35697]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-01-25T15:00:55.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:55 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:00:55.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:55 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:00:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:55 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:00:55.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:55 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:00:55.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.637+0000 7f7d1a17c700 1 -- 172.21.15.170:0/4068497076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d141077d0 msgr2=0x7f7d14107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:55.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.637+0000 7f7d1a17c700 1 --2- 172.21.15.170:0/4068497076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d141077d0 0x7f7d14107bb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7d040099c0 tx=0x7f7d04009cd0 comp rx=0 tx=0).stop 2024-01-25T15:00:55.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.637+0000 7f7d1a17c700 1 -- 172.21.15.170:0/4068497076 shutdown_connections 2024-01-25T15:00:55.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.637+0000 7f7d1a17c700 1 --2- 172.21.15.170:0/4068497076 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d1406a880 0x7f7d1410e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:55.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.637+0000 7f7d1a17c700 1 --2- 172.21.15.170:0/4068497076 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d141077d0 0x7f7d14107bb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:55.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.637+0000 7f7d1a17c700 1 --2- 172.21.15.170:0/4068497076 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d14069ee0 0x7f7d1406a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:55.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.637+0000 7f7d1a17c700 1 -- 172.21.15.170:0/4068497076 >> 172.21.15.170:0/4068497076 conn(0x7f7d14076700 msgr2=0x7f7d14076b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:55.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.638+0000 7f7d1a17c700 1 -- 172.21.15.170:0/4068497076 shutdown_connections 2024-01-25T15:00:55.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.638+0000 7f7d1a17c700 1 -- 172.21.15.170:0/4068497076 wait complete. 2024-01-25T15:00:55.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.638+0000 7f7d1a17c700 1 Processor -- start 2024-01-25T15:00:55.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.638+0000 7f7d1a17c700 1 -- start start 2024-01-25T15:00:55.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.638+0000 7f7d1a17c700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d14069ee0 0x7f7d141007e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:55.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.638+0000 7f7d1a17c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d1406a880 0x7f7d14100d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:55.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.638+0000 7f7d1a17c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d141077d0 0x7f7d14101260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:55.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.638+0000 7f7d1a17c700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d141a6110 con 0x7f7d141077d0 2024-01-25T15:00:55.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.638+0000 7f7d1a17c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d141a6280 con 0x7f7d1406a880 2024-01-25T15:00:55.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.638+0000 7f7d1a17c700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d141a6440 con 0x7f7d14069ee0 2024-01-25T15:00:55.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.638+0000 7f7d13fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d141077d0 0x7f7d14101260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:55.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.638+0000 7f7d13fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d141077d0 0x7f7d14101260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35190/0 (socket says 172.21.15.170:35190) 2024-01-25T15:00:55.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.639+0000 7f7d13fff700 1 -- 172.21.15.170:0/3637224456 learned_addr learned my addr 172.21.15.170:0/3637224456 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:55.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.639+0000 7f7d0bfff700 1 --2- 172.21.15.170:0/3637224456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d1406a880 0x7f7d14100d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:55.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.639+0000 7f7d137fe700 1 --2- 172.21.15.170:0/3637224456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d14069ee0 0x7f7d141007e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:55.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.639+0000 7f7d13fff700 1 -- 172.21.15.170:0/3637224456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d14069ee0 msgr2=0x7f7d141007e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:55.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.639+0000 7f7d13fff700 1 --2- 172.21.15.170:0/3637224456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d14069ee0 0x7f7d141007e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:55.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.639+0000 7f7d13fff700 1 -- 172.21.15.170:0/3637224456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d1406a880 msgr2=0x7f7d14100d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:55.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.639+0000 7f7d13fff700 1 --2- 172.21.15.170:0/3637224456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d1406a880 0x7f7d14100d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:55.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.639+0000 7f7d13fff700 1 -- 172.21.15.170:0/3637224456 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d040095f0 con 0x7f7d141077d0 2024-01-25T15:00:55.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.639+0000 7f7d13fff700 1 --2- 172.21.15.170:0/3637224456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d141077d0 0x7f7d14101260 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00b970 tx=0x7f7d0c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:55.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.639+0000 7f7d117fa700 1 -- 172.21.15.170:0/3637224456 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c00d860 con 0x7f7d141077d0 2024-01-25T15:00:55.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.639+0000 7f7d1a17c700 1 -- 172.21.15.170:0/3637224456 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d141a6720 con 0x7f7d141077d0 2024-01-25T15:00:55.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.639+0000 7f7d117fa700 1 -- 172.21.15.170:0/3637224456 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d0c00de80 con 0x7f7d141077d0 2024-01-25T15:00:55.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.639+0000 7f7d117fa700 1 -- 172.21.15.170:0/3637224456 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0c017400 con 0x7f7d141077d0 2024-01-25T15:00:55.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.639+0000 7f7d1a17c700 1 -- 172.21.15.170:0/3637224456 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d141a6c20 con 0x7f7d141077d0 2024-01-25T15:00:55.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.640+0000 7f7d1a17c700 1 -- 172.21.15.170:0/3637224456 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d14109d80 con 0x7f7d141077d0 2024-01-25T15:00:55.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.642+0000 7f7d117fa700 1 -- 172.21.15.170:0/3637224456 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f7d0c00e630 con 0x7f7d141077d0 2024-01-25T15:00:55.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.642+0000 7f7d117fa700 1 --2- 172.21.15.170:0/3637224456 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7d000a1400 0x7f7d000a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:55.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.642+0000 7f7d137fe700 1 --2- 172.21.15.170:0/3637224456 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7d000a1400 0x7f7d000a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:55.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.642+0000 7f7d117fa700 1 -- 172.21.15.170:0/3637224456 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7d0c006e40 con 0x7f7d141077d0 2024-01-25T15:00:55.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.643+0000 7f7d137fe700 1 --2- 172.21.15.170:0/3637224456 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7d000a1400 0x7f7d000a38c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009990 tx=0x7f7d04005040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:55.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.645+0000 7f7d117fa700 1 -- 172.21.15.170:0/3637224456 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f7d0c095dd0 con 0x7f7d141077d0 2024-01-25T15:00:55.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:55 smithi191 ceph-mon[36347]: pgmap v314: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-01-25T15:00:55.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:55 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:00:55.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:55 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:00:55.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:55 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:00:55.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:55 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:00:55.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.843+0000 7f7d1a17c700 1 -- 172.21.15.170:0/3637224456 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f7d14102f10 con 0x7f7d141077d0 2024-01-25T15:00:55.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.844+0000 7f7d117fa700 1 -- 172.21.15.170:0/3637224456 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d0c0993f0 con 0x7f7d141077d0 2024-01-25T15:00:55.845 INFO:teuthology.orchestra.run.smithi170.stdout:253403070504 2024-01-25T15:00:55.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.846+0000 7f7d1a17c700 1 -- 172.21.15.170:0/3637224456 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7d000a1400 msgr2=0x7f7d000a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:55.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.846+0000 7f7d1a17c700 1 --2- 172.21.15.170:0/3637224456 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7d000a1400 0x7f7d000a38c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7d04009990 tx=0x7f7d04005040 comp rx=0 tx=0).stop 2024-01-25T15:00:55.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.846+0000 7f7d1a17c700 1 -- 172.21.15.170:0/3637224456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d141077d0 msgr2=0x7f7d14101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:55.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.846+0000 7f7d1a17c700 1 --2- 172.21.15.170:0/3637224456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d141077d0 0x7f7d14101260 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c00b970 tx=0x7f7d0c00bc80 comp rx=0 tx=0).stop 2024-01-25T15:00:55.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.846+0000 7f7d1a17c700 1 -- 172.21.15.170:0/3637224456 shutdown_connections 2024-01-25T15:00:55.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.846+0000 7f7d1a17c700 1 --2- 172.21.15.170:0/3637224456 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7d000a1400 0x7f7d000a38c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:55.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.846+0000 7f7d1a17c700 1 --2- 172.21.15.170:0/3637224456 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7d14069ee0 0x7f7d141007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:55.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.846+0000 7f7d1a17c700 1 --2- 172.21.15.170:0/3637224456 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7d141077d0 0x7f7d14101260 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:55.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.846+0000 7f7d1a17c700 1 --2- 172.21.15.170:0/3637224456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7d1406a880 0x7f7d14100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:55.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.846+0000 7f7d1a17c700 1 -- 172.21.15.170:0/3637224456 >> 172.21.15.170:0/3637224456 conn(0x7f7d14076700 msgr2=0x7f7d140fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:55.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.846+0000 7f7d1a17c700 1 -- 172.21.15.170:0/3637224456 shutdown_connections 2024-01-25T15:00:55.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:55.846+0000 7f7d1a17c700 1 -- 172.21.15.170:0/3637224456 wait complete. 2024-01-25T15:00:56.520 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:56 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3637224456' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-01-25T15:00:56.520 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-01-25T15:00:56.520 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-01-25T15:00:56.521 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-01-25T15:00:56.521 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-01-25T15:00:56.521 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-01-25T15:00:56.521 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-01-25T15:00:56.521 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:56 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-01-25T15:00:56.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:56 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3637224456' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-01-25T15:00:56.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-01-25T15:00:56.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-01-25T15:00:56.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-01-25T15:00:56.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-01-25T15:00:56.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-01-25T15:00:56.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-01-25T15:00:56.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:56 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-01-25T15:00:56.662 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920822 got 141733920827 for osd.4 2024-01-25T15:00:56.662 DEBUG:teuthology.parallel:result is None 2024-01-25T15:00:56.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.313+0000 7fcb3307a700 1 -- 172.21.15.170:0/2983958583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb2c069d20 msgr2=0x7fcb2c06a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:56.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.313+0000 7fcb3307a700 1 --2- 172.21.15.170:0/2983958583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb2c069d20 0x7fcb2c06a1a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcb180099c0 tx=0x7fcb18009cd0 comp rx=0 tx=0).stop 2024-01-25T15:00:56.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.313+0000 7fcb3307a700 1 -- 172.21.15.170:0/2983958583 shutdown_connections 2024-01-25T15:00:56.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.313+0000 7fcb3307a700 1 --2- 172.21.15.170:0/2983958583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb2c107790 0x7fcb2c107b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:56.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.313+0000 7fcb3307a700 1 --2- 172.21.15.170:0/2983958583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb2c06a6e0 0x7fcb2c10e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:56.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.313+0000 7fcb3307a700 1 --2- 172.21.15.170:0/2983958583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb2c069d20 0x7fcb2c06a1a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:56.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.313+0000 7fcb3307a700 1 -- 172.21.15.170:0/2983958583 >> 172.21.15.170:0/2983958583 conn(0x7fcb2c076730 msgr2=0x7fcb2c076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:56.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.313+0000 7fcb3307a700 1 -- 172.21.15.170:0/2983958583 shutdown_connections 2024-01-25T15:00:56.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.313+0000 7fcb3307a700 1 -- 172.21.15.170:0/2983958583 wait complete. 2024-01-25T15:00:56.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.313+0000 7fcb3307a700 1 Processor -- start 2024-01-25T15:00:56.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb3307a700 1 -- start start 2024-01-25T15:00:56.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb3307a700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb2c069d20 0x7fcb2c1007e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:56.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb3307a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb2c06a6e0 0x7fcb2c100d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:56.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb3307a700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb2c107790 0x7fcb2c101260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:56.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb3307a700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c1a6070 con 0x7fcb2c107790 2024-01-25T15:00:56.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb3307a700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c1a61e0 con 0x7fcb2c06a6e0 2024-01-25T15:00:56.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb3307a700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c1a63a0 con 0x7fcb2c069d20 2024-01-25T15:00:56.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb31617700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb2c107790 0x7fcb2c101260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:56.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb31617700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb2c107790 0x7fcb2c101260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35202/0 (socket says 172.21.15.170:35202) 2024-01-25T15:00:56.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb31617700 1 -- 172.21.15.170:0/553049706 learned_addr learned my addr 172.21.15.170:0/553049706 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:56.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb2bfff700 1 --2- 172.21.15.170:0/553049706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb2c06a6e0 0x7fcb2c100d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:56.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb30e16700 1 --2- 172.21.15.170:0/553049706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb2c069d20 0x7fcb2c1007e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:56.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb31617700 1 -- 172.21.15.170:0/553049706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb2c069d20 msgr2=0x7fcb2c1007e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:56.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb31617700 1 --2- 172.21.15.170:0/553049706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb2c069d20 0x7fcb2c1007e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:56.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb31617700 1 -- 172.21.15.170:0/553049706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb2c06a6e0 msgr2=0x7fcb2c100d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:56.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb31617700 1 --2- 172.21.15.170:0/553049706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb2c06a6e0 0x7fcb2c100d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:56.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb31617700 1 -- 172.21.15.170:0/553049706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb180095f0 con 0x7fcb2c107790 2024-01-25T15:00:56.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb31617700 1 --2- 172.21.15.170:0/553049706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb2c107790 0x7fcb2c101260 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400ef30 tx=0x7fcb2400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:56.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb29ffb700 1 -- 172.21.15.170:0/553049706 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24018070 con 0x7fcb2c107790 2024-01-25T15:00:56.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb29ffb700 1 -- 172.21.15.170:0/553049706 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb2400f040 con 0x7fcb2c107790 2024-01-25T15:00:56.733 INFO:teuthology.orchestra.run.smithi170.stdout:34359738448 2024-01-25T15:00:56.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb3307a700 1 -- 172.21.15.170:0/553049706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2c1a6620 con 0x7fcb2c107790 2024-01-25T15:00:56.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.314+0000 7fcb29ffb700 1 -- 172.21.15.170:0/553049706 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2400cdb0 con 0x7fcb2c107790 2024-01-25T15:00:56.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.315+0000 7fcb3307a700 1 -- 172.21.15.170:0/553049706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2c1a6aa0 con 0x7fcb2c107790 2024-01-25T15:00:56.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.315+0000 7fcb3307a700 1 -- 172.21.15.170:0/553049706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2c109d20 con 0x7fcb2c107790 2024-01-25T15:00:56.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.317+0000 7fcb29ffb700 1 -- 172.21.15.170:0/553049706 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fcb24003a00 con 0x7fcb2c107790 2024-01-25T15:00:56.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.317+0000 7fcb29ffb700 1 --2- 172.21.15.170:0/553049706 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fcb1c0a1400 0x7fcb1c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:56.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.317+0000 7fcb30e16700 1 --2- 172.21.15.170:0/553049706 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fcb1c0a1400 0x7fcb1c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.317+0000 7fcb29ffb700 1 -- 172.21.15.170:0/553049706 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fcb240cd280 con 0x7fcb2c107790 2024-01-25T15:00:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.318+0000 7fcb30e16700 1 --2- 172.21.15.170:0/553049706 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fcb1c0a1400 0x7fcb1c0a38c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcb20006fd0 tx=0x7fcb20008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.321+0000 7fcb29ffb700 1 -- 172.21.15.170:0/553049706 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fcb24096660 con 0x7fcb2c107790 2024-01-25T15:00:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.519+0000 7fcb3307a700 1 -- 172.21.15.170:0/553049706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcb2c0684a0 con 0x7fcb2c107790 2024-01-25T15:00:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.519+0000 7fcb29ffb700 1 -- 172.21.15.170:0/553049706 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcb24099c80 con 0x7fcb2c107790 2024-01-25T15:00:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.521+0000 7fcb3307a700 1 -- 172.21.15.170:0/553049706 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fcb1c0a1400 msgr2=0x7fcb1c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.521+0000 7fcb3307a700 1 --2- 172.21.15.170:0/553049706 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fcb1c0a1400 0x7fcb1c0a38c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcb20006fd0 tx=0x7fcb20008040 comp rx=0 tx=0).stop 2024-01-25T15:00:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.521+0000 7fcb3307a700 1 -- 172.21.15.170:0/553049706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb2c107790 msgr2=0x7fcb2c101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.521+0000 7fcb3307a700 1 --2- 172.21.15.170:0/553049706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb2c107790 0x7fcb2c101260 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400ef30 tx=0x7fcb2400c3a0 comp rx=0 tx=0).stop 2024-01-25T15:00:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.521+0000 7fcb3307a700 1 -- 172.21.15.170:0/553049706 shutdown_connections 2024-01-25T15:00:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.521+0000 7fcb3307a700 1 --2- 172.21.15.170:0/553049706 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fcb1c0a1400 0x7fcb1c0a38c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.521+0000 7fcb3307a700 1 --2- 172.21.15.170:0/553049706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcb2c069d20 0x7fcb2c1007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.521+0000 7fcb3307a700 1 --2- 172.21.15.170:0/553049706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcb2c107790 0x7fcb2c101260 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:56.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.521+0000 7fcb3307a700 1 --2- 172.21.15.170:0/553049706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb2c06a6e0 0x7fcb2c100d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:56.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.521+0000 7fcb3307a700 1 -- 172.21.15.170:0/553049706 >> 172.21.15.170:0/553049706 conn(0x7fcb2c076730 msgr2=0x7fcb2c0ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:56.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.521+0000 7fcb3307a700 1 -- 172.21.15.170:0/553049706 shutdown_connections 2024-01-25T15:00:56.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:56.522+0000 7fcb3307a700 1 -- 172.21.15.170:0/553049706 wait complete. 2024-01-25T15:00:56.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:56 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3637224456' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-01-25T15:00:56.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]: dispatch 2024-01-25T15:00:56.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-01-25T15:00:56.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-01-25T15:00:56.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-01-25T15:00:56.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2024-01-25T15:00:56.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-01-25T15:00:56.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:56 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-01-25T15:00:57.080 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:57.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.083+0000 7fad0a9c2700 1 -- 172.21.15.170:0/451286376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad041006e0 msgr2=0x7fad04100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:57.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.083+0000 7fad0a9c2700 1 --2- 172.21.15.170:0/451286376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad041006e0 0x7fad04100b40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7facf8009990 tx=0x7facf8009ca0 comp rx=0 tx=0).stop 2024-01-25T15:00:57.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.083+0000 7fad0a9c2700 1 -- 172.21.15.170:0/451286376 shutdown_connections 2024-01-25T15:00:57.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.083+0000 7fad0a9c2700 1 --2- 172.21.15.170:0/451286376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad04101080 0x7fad0410d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:57.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.083+0000 7fad0a9c2700 1 --2- 172.21.15.170:0/451286376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad04106690 0x7fad04106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:57.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.083+0000 7fad0a9c2700 1 --2- 172.21.15.170:0/451286376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad041006e0 0x7fad04100b40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:57.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.083+0000 7fad0a9c2700 1 -- 172.21.15.170:0/451286376 >> 172.21.15.170:0/451286376 conn(0x7fad04077610 msgr2=0x7fad04077a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:57.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.083+0000 7fad0a9c2700 1 -- 172.21.15.170:0/451286376 shutdown_connections 2024-01-25T15:00:57.085 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.083+0000 7fad0a9c2700 1 -- 172.21.15.170:0/451286376 wait complete. 2024-01-25T15:00:57.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.084+0000 7fad0a9c2700 1 Processor -- start 2024-01-25T15:00:57.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.084+0000 7fad0a9c2700 1 -- start start 2024-01-25T15:00:57.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.084+0000 7fad0a9c2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad041006e0 0x7fad0419d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:57.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.084+0000 7fad0a9c2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad04101080 0x7fad0419dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:57.086 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.084+0000 7fad0a9c2700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad04106690 0x7fad041979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.084+0000 7fad0a9c2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad04198000 con 0x7fad041006e0 2024-01-25T15:00:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.084+0000 7fad0a9c2700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad04198140 con 0x7fad04106690 2024-01-25T15:00:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.084+0000 7fad0a9c2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad04198300 con 0x7fad04101080 2024-01-25T15:00:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.084+0000 7fad03fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad041006e0 0x7fad0419d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.084+0000 7fad03fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad041006e0 0x7fad0419d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35214/0 (socket says 172.21.15.170:35214) 2024-01-25T15:00:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.084+0000 7fad03fff700 1 -- 172.21.15.170:0/13050214 learned_addr learned my addr 172.21.15.170:0/13050214 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:00:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.084+0000 7fad037fe700 1 --2- 172.21.15.170:0/13050214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad04101080 0x7fad0419dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.085+0000 7fad08f5f700 1 --2- 172.21.15.170:0/13050214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad04106690 0x7fad041979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.085+0000 7fad03fff700 1 -- 172.21.15.170:0/13050214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad04101080 msgr2=0x7fad0419dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.085+0000 7fad03fff700 1 --2- 172.21.15.170:0/13050214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad04101080 0x7fad0419dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.085+0000 7fad03fff700 1 -- 172.21.15.170:0/13050214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad04106690 msgr2=0x7fad041979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.085+0000 7fad03fff700 1 --2- 172.21.15.170:0/13050214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad04106690 0x7fad041979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.085+0000 7fad03fff700 1 -- 172.21.15.170:0/13050214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf80095f0 con 0x7fad041006e0 2024-01-25T15:00:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.085+0000 7fad03fff700 1 --2- 172.21.15.170:0/13050214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad041006e0 0x7fad0419d7e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7facf400c9b0 tx=0x7facf400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:57.087 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.085+0000 7fad017fa700 1 -- 172.21.15.170:0/13050214 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4007b00 con 0x7fad041006e0 2024-01-25T15:00:57.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.085+0000 7fad0a9c2700 1 -- 172.21.15.170:0/13050214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad041985e0 con 0x7fad041006e0 2024-01-25T15:00:57.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.085+0000 7fad017fa700 1 -- 172.21.15.170:0/13050214 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7facf400ce50 con 0x7fad041006e0 2024-01-25T15:00:57.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.085+0000 7fad017fa700 1 -- 172.21.15.170:0/13050214 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4018660 con 0x7fad041006e0 2024-01-25T15:00:57.089 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.085+0000 7fad0a9c2700 1 -- 172.21.15.170:0/13050214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad041a4880 con 0x7fad041006e0 2024-01-25T15:00:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.086+0000 7fad0a9c2700 1 -- 172.21.15.170:0/13050214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad04109c30 con 0x7fad041006e0 2024-01-25T15:00:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.087+0000 7fad017fa700 1 -- 172.21.15.170:0/13050214 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7facf400f450 con 0x7fad041006e0 2024-01-25T15:00:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.088+0000 7fad017fa700 1 --2- 172.21.15.170:0/13050214 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7facec0a1400 0x7facec0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:00:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.088+0000 7fad037fe700 1 --2- 172.21.15.170:0/13050214 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7facec0a1400 0x7facec0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:00:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.088+0000 7fad017fa700 1 -- 172.21.15.170:0/13050214 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8182+0+0 (secure 0 0 0) 0x7facf40ccb60 con 0x7fad041006e0 2024-01-25T15:00:57.090 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.089+0000 7fad037fe700 1 --2- 172.21.15.170:0/13050214 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7facec0a1400 0x7facec0a38c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7facf800b5c0 tx=0x7facf8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:00:57.093 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.093+0000 7fad017fa700 1 -- 172.21.15.170:0/13050214 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7facf4095eb0 con 0x7fad041006e0 2024-01-25T15:00:57.120 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:57.120 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:00:57.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.312+0000 7fad0a9c2700 1 -- 172.21.15.170:0/13050214 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad04198ed0 con 0x7fad041006e0 2024-01-25T15:00:57.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.312+0000 7fad017fa700 1 -- 172.21.15.170:0/13050214 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7facf4007e60 con 0x7fad041006e0 2024-01-25T15:00:57.313 INFO:teuthology.orchestra.run.smithi170.stdout:107374182465 2024-01-25T15:00:57.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.314+0000 7fad0a9c2700 1 -- 172.21.15.170:0/13050214 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7facec0a1400 msgr2=0x7facec0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:57.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.314+0000 7fad0a9c2700 1 --2- 172.21.15.170:0/13050214 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7facec0a1400 0x7facec0a38c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7facf800b5c0 tx=0x7facf8005960 comp rx=0 tx=0).stop 2024-01-25T15:00:57.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.314+0000 7fad0a9c2700 1 -- 172.21.15.170:0/13050214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad041006e0 msgr2=0x7fad0419d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:00:57.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.314+0000 7fad0a9c2700 1 --2- 172.21.15.170:0/13050214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad041006e0 0x7fad0419d7e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7facf400c9b0 tx=0x7facf400ccc0 comp rx=0 tx=0).stop 2024-01-25T15:00:57.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.314+0000 7fad0a9c2700 1 -- 172.21.15.170:0/13050214 shutdown_connections 2024-01-25T15:00:57.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.314+0000 7fad0a9c2700 1 --2- 172.21.15.170:0/13050214 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7facec0a1400 0x7facec0a38c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:57.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.314+0000 7fad0a9c2700 1 --2- 172.21.15.170:0/13050214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad04106690 0x7fad041979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:57.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.314+0000 7fad0a9c2700 1 --2- 172.21.15.170:0/13050214 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad041006e0 0x7fad0419d7e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:57.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.314+0000 7fad0a9c2700 1 --2- 172.21.15.170:0/13050214 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad04101080 0x7fad0419dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:00:57.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.314+0000 7fad0a9c2700 1 -- 172.21.15.170:0/13050214 >> 172.21.15.170:0/13050214 conn(0x7fad04077610 msgr2=0x7fad04069830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:00:57.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.314+0000 7fad0a9c2700 1 -- 172.21.15.170:0/13050214 shutdown_connections 2024-01-25T15:00:57.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:00:57.314+0000 7fad0a9c2700 1 -- 172.21.15.170:0/13050214 wait complete. 2024-01-25T15:00:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:57 smithi186 ceph-mon[35697]: pgmap v315: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:00:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:57 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-01-25T15:00:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:57 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-01-25T15:00:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:57 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-01-25T15:00:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:57 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-01-25T15:00:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:57 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-01-25T15:00:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:57 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-01-25T15:00:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:57 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-01-25T15:00:57.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:57 smithi186 ceph-mon[35697]: osdmap e86: 12 total, 12 up, 12 in 2024-01-25T15:00:57.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:57 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/553049706' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-01-25T15:00:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:57 smithi170 ceph-mon[31899]: pgmap v315: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:00:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:57 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-01-25T15:00:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:57 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-01-25T15:00:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:57 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-01-25T15:00:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:57 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-01-25T15:00:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:57 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-01-25T15:00:57.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:57 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-01-25T15:00:57.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:57 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-01-25T15:00:57.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:57 smithi170 ceph-mon[31899]: osdmap e86: 12 total, 12 up, 12 in 2024-01-25T15:00:57.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:57 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/553049706' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-01-25T15:00:57.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:57 smithi191 ceph-mon[36347]: pgmap v315: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:00:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:57 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-01-25T15:00:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:57 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-01-25T15:00:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:57 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-01-25T15:00:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:57 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-01-25T15:00:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:57 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2024-01-25T15:00:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:57 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-01-25T15:00:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:57 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-01-25T15:00:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:57 smithi191 ceph-mon[36347]: osdmap e86: 12 total, 12 up, 12 in 2024-01-25T15:00:57.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:57 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/553049706' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-01-25T15:00:58.325 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:58 smithi170 ceph-mon[31899]: osdmap e87: 12 total, 12 up, 12 in 2024-01-25T15:00:58.325 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:58 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/13050214' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-01-25T15:00:58.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:58 smithi186 ceph-mon[35697]: osdmap e87: 12 total, 12 up, 12 in 2024-01-25T15:00:58.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:58 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/13050214' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-01-25T15:00:58.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:58 smithi191 ceph-mon[36347]: osdmap e87: 12 total, 12 up, 12 in 2024-01-25T15:00:58.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:58 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/13050214' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-01-25T15:00:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:59 smithi170 ceph-mon[31899]: pgmap v318: 97 pgs: 1 peering, 96 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s; 7.1 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:00:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:00:59 smithi170 ceph-mon[31899]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-01-25T15:00:59.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:59 smithi186 ceph-mon[35697]: pgmap v318: 97 pgs: 1 peering, 96 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s; 7.1 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:00:59.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:00:59 smithi186 ceph-mon[35697]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-01-25T15:00:59.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:59 smithi191 ceph-mon[36347]: pgmap v318: 97 pgs: 1 peering, 96 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 8 op/s; 7.1 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:00:59.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:00:59 smithi191 ceph-mon[36347]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-01-25T15:01:00.556 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738443 got 34359738448 for osd.0 2024-01-25T15:01:00.557 DEBUG:teuthology.parallel:result is None 2024-01-25T15:01:01.451 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:01 smithi170 ceph-mon[31899]: pgmap v319: 97 pgs: 1 peering, 96 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 7.1 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:01:01.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:01 smithi186 ceph-mon[35697]: pgmap v319: 97 pgs: 1 peering, 96 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 7.1 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:01:01.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:01 smithi191 ceph-mon[36347]: pgmap v319: 97 pgs: 1 peering, 96 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 7.1 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:01:02.146 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182459 got 107374182465 for osd.3 2024-01-25T15:01:02.146 DEBUG:teuthology.parallel:result is None 2024-01-25T15:01:02.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:02 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2303428104' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-01-25T15:01:02.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:02 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2303428104' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-01-25T15:01:02.631 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070499 got 253403070504 for osd.8 2024-01-25T15:01:02.632 DEBUG:teuthology.parallel:result is None 2024-01-25T15:01:02.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:02 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2303428104' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-01-25T15:01:03.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.450+0000 7efee8148700 1 -- 172.21.15.170:0/1091426036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efee0100790 msgr2=0x7efee010e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:03.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.450+0000 7efee8148700 1 --2- 172.21.15.170:0/1091426036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efee0100790 0x7efee010e6f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efed800b0a0 tx=0x7efed800b3b0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.450+0000 7efee8148700 1 -- 172.21.15.170:0/1091426036 shutdown_connections 2024-01-25T15:01:03.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.450+0000 7efee8148700 1 --2- 172.21.15.170:0/1091426036 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efee0106850 0x7efee0106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.187 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.450+0000 7efee8148700 1 --2- 172.21.15.170:0/1091426036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efee0100790 0x7efee010e6f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.450+0000 7efee8148700 1 --2- 172.21.15.170:0/1091426036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efee00ffdd0 0x7efee0100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.450+0000 7efee8148700 1 -- 172.21.15.170:0/1091426036 >> 172.21.15.170:0/1091426036 conn(0x7efee0076ce0 msgr2=0x7efee00fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.450+0000 7efee8148700 1 -- 172.21.15.170:0/1091426036 shutdown_connections 2024-01-25T15:01:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.450+0000 7efee8148700 1 -- 172.21.15.170:0/1091426036 wait complete. 2024-01-25T15:01:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.451+0000 7efee8148700 1 Processor -- start 2024-01-25T15:01:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.451+0000 7efee8148700 1 -- start start 2024-01-25T15:01:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.451+0000 7efee8148700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efee00ffdd0 0x7efee0198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.451+0000 7efee8148700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efee0100790 0x7efee0198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.451+0000 7efee8148700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efee0106850 0x7efee019c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.451+0000 7efee8148700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee019ceb0 con 0x7efee00ffdd0 2024-01-25T15:01:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.451+0000 7efee8148700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee019d020 con 0x7efee0100790 2024-01-25T15:01:03.188 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.451+0000 7efee8148700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee019d1e0 con 0x7efee0106850 2024-01-25T15:01:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.451+0000 7efee5ee4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efee00ffdd0 0x7efee0198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.451+0000 7efee5ee4700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efee00ffdd0 0x7efee0198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35230/0 (socket says 172.21.15.170:35230) 2024-01-25T15:01:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.451+0000 7efee5ee4700 1 -- 172.21.15.170:0/2303428104 learned_addr learned my addr 172.21.15.170:0/2303428104 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:03.189 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.452+0000 7efee66e5700 1 --2- 172.21.15.170:0/2303428104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efee0106850 0x7efee019c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:03.189 INFO:teuthology.orchestra.run.smithi170.stdout:77309411399 2024-01-25T15:01:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.452+0000 7efee56e3700 1 --2- 172.21.15.170:0/2303428104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efee0100790 0x7efee0198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.452+0000 7efee5ee4700 1 -- 172.21.15.170:0/2303428104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efee0106850 msgr2=0x7efee019c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.452+0000 7efee5ee4700 1 --2- 172.21.15.170:0/2303428104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efee0106850 0x7efee019c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.452+0000 7efee5ee4700 1 -- 172.21.15.170:0/2303428104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efee0100790 msgr2=0x7efee0198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.452+0000 7efee5ee4700 1 --2- 172.21.15.170:0/2303428104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efee0100790 0x7efee0198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.452+0000 7efee5ee4700 1 -- 172.21.15.170:0/2303428104 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed8009d00 con 0x7efee00ffdd0 2024-01-25T15:01:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.452+0000 7efee5ee4700 1 --2- 172.21.15.170:0/2303428104 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efee00ffdd0 0x7efee0198020 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efedc00b530 tx=0x7efedc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.452+0000 7efed6ffd700 1 -- 172.21.15.170:0/2303428104 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc011830 con 0x7efee00ffdd0 2024-01-25T15:01:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.452+0000 7efed6ffd700 1 -- 172.21.15.170:0/2303428104 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efedc011e50 con 0x7efee00ffdd0 2024-01-25T15:01:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.452+0000 7efee8148700 1 -- 172.21.15.170:0/2303428104 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee019d4c0 con 0x7efee00ffdd0 2024-01-25T15:01:03.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.452+0000 7efed6ffd700 1 -- 172.21.15.170:0/2303428104 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc00f2e0 con 0x7efee00ffdd0 2024-01-25T15:01:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.452+0000 7efee8148700 1 -- 172.21.15.170:0/2303428104 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee01a4d20 con 0x7efee00ffdd0 2024-01-25T15:01:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.453+0000 7efee8148700 1 -- 172.21.15.170:0/2303428104 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee0109e20 con 0x7efee00ffdd0 2024-01-25T15:01:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.454+0000 7efed6ffd700 1 -- 172.21.15.170:0/2303428104 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7efedc010380 con 0x7efee00ffdd0 2024-01-25T15:01:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.455+0000 7efed6ffd700 1 --2- 172.21.15.170:0/2303428104 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7efecc0a1400 0x7efecc0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.455+0000 7efee56e3700 1 --2- 172.21.15.170:0/2303428104 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7efecc0a1400 0x7efecc0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.455+0000 7efed6ffd700 1 -- 172.21.15.170:0/2303428104 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7efedc0ccc80 con 0x7efee00ffdd0 2024-01-25T15:01:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.455+0000 7efee56e3700 1 --2- 172.21.15.170:0/2303428104 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7efecc0a1400 0x7efecc0a38c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efed0006fd0 tx=0x7efed0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.458+0000 7efed6ffd700 1 -- 172.21.15.170:0/2303428104 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7efedc0960e0 con 0x7efee00ffdd0 2024-01-25T15:01:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.657+0000 7efee8148700 1 -- 172.21.15.170:0/2303428104 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efee0068500 con 0x7efee00ffdd0 2024-01-25T15:01:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.658+0000 7efed6ffd700 1 -- 172.21.15.170:0/2303428104 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efedc015090 con 0x7efee00ffdd0 2024-01-25T15:01:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.660+0000 7efee8148700 1 -- 172.21.15.170:0/2303428104 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7efecc0a1400 msgr2=0x7efecc0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.660+0000 7efee8148700 1 --2- 172.21.15.170:0/2303428104 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7efecc0a1400 0x7efecc0a38c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efed0006fd0 tx=0x7efed0008040 comp rx=0 tx=0).stop 2024-01-25T15:01:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.660+0000 7efee8148700 1 -- 172.21.15.170:0/2303428104 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efee00ffdd0 msgr2=0x7efee0198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:03.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.660+0000 7efee8148700 1 --2- 172.21.15.170:0/2303428104 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efee00ffdd0 0x7efee0198020 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efedc00b530 tx=0x7efedc00b840 comp rx=0 tx=0).stop 2024-01-25T15:01:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.660+0000 7efee8148700 1 -- 172.21.15.170:0/2303428104 shutdown_connections 2024-01-25T15:01:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.660+0000 7efee8148700 1 --2- 172.21.15.170:0/2303428104 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7efecc0a1400 0x7efecc0a38c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.660+0000 7efee8148700 1 --2- 172.21.15.170:0/2303428104 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7efee0106850 0x7efee019c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.660+0000 7efee8148700 1 --2- 172.21.15.170:0/2303428104 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7efee00ffdd0 0x7efee0198020 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.660+0000 7efee8148700 1 --2- 172.21.15.170:0/2303428104 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efee0100790 0x7efee0198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.660+0000 7efee8148700 1 -- 172.21.15.170:0/2303428104 >> 172.21.15.170:0/2303428104 conn(0x7efee0076ce0 msgr2=0x7efee0104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.660+0000 7efee8148700 1 -- 172.21.15.170:0/2303428104 shutdown_connections 2024-01-25T15:01:03.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:01.660+0000 7efee8148700 1 -- 172.21.15.170:0/2303428104 wait complete. 2024-01-25T15:01:03.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:03 smithi186 ceph-mon[35697]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 6 op/s; 7.1 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:01:03.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:03 smithi186 ceph-mon[35697]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-01-25T15:01:03.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:03 smithi186 ceph-mon[35697]: Cluster is now healthy 2024-01-25T15:01:03.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:03 smithi170 ceph-mon[31899]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 6 op/s; 7.1 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:01:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:03 smithi170 ceph-mon[31899]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-01-25T15:01:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:03 smithi170 ceph-mon[31899]: Cluster is now healthy 2024-01-25T15:01:03.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:03 smithi191 ceph-mon[36347]: pgmap v320: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 6 op/s; 7.1 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:01:03.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:03 smithi191 ceph-mon[36347]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-01-25T15:01:03.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:03 smithi191 ceph-mon[36347]: Cluster is now healthy 2024-01-25T15:01:03.743 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411394 got 77309411399 for osd.2 2024-01-25T15:01:03.743 DEBUG:teuthology.parallel:result is None 2024-01-25T15:01:03.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.951+0000 7f1e4a1a0700 1 -- 172.21.15.170:0/3718492121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e441028e0 msgr2=0x7f1e44102cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:03.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.951+0000 7f1e4a1a0700 1 --2- 172.21.15.170:0/3718492121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e441028e0 0x7f1e44102cc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1e40009990 tx=0x7f1e40009ca0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.951+0000 7f1e4a1a0700 1 -- 172.21.15.170:0/3718492121 shutdown_connections 2024-01-25T15:01:03.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.951+0000 7f1e4a1a0700 1 --2- 172.21.15.170:0/3718492121 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e4410bcc0 0x7f1e4410e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.951+0000 7f1e4a1a0700 1 --2- 172.21.15.170:0/3718492121 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e441028e0 0x7f1e44102cc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.951+0000 7f1e4a1a0700 1 --2- 172.21.15.170:0/3718492121 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e44103200 0x7f1e4410b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.951+0000 7f1e4a1a0700 1 -- 172.21.15.170:0/3718492121 >> 172.21.15.170:0/3718492121 conn(0x7f1e440fc0b0 msgr2=0x7f1e440fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:03.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.951+0000 7f1e4a1a0700 1 -- 172.21.15.170:0/3718492121 shutdown_connections 2024-01-25T15:01:03.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.951+0000 7f1e4a1a0700 1 -- 172.21.15.170:0/3718492121 wait complete. 2024-01-25T15:01:03.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4a1a0700 1 Processor -- start 2024-01-25T15:01:03.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4a1a0700 1 -- start start 2024-01-25T15:01:03.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4a1a0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e441028e0 0x7f1e4419d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4a1a0700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e44103200 0x7f1e4419dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4a1a0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e4410bcc0 0x7f1e44197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4a1a0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e44198080 con 0x7f1e441028e0 2024-01-25T15:01:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4a1a0700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e441981c0 con 0x7f1e44103200 2024-01-25T15:01:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4a1a0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e44198380 con 0x7f1e4410bcc0 2024-01-25T15:01:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4919e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e441028e0 0x7f1e4419d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4919e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e441028e0 0x7f1e4419d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35248/0 (socket says 172.21.15.170:35248) 2024-01-25T15:01:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4919e700 1 -- 172.21.15.170:0/1313925545 learned_addr learned my addr 172.21.15.170:0/1313925545 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4919e700 1 -- 172.21.15.170:0/1313925545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e4410bcc0 msgr2=0x7f1e44197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4919e700 1 --2- 172.21.15.170:0/1313925545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e4410bcc0 0x7f1e44197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4919e700 1 -- 172.21.15.170:0/1313925545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e44103200 msgr2=0x7f1e4419dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4919e700 1 --2- 172.21.15.170:0/1313925545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e44103200 0x7f1e4419dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:03.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4919e700 1 -- 172.21.15.170:0/1313925545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e400095f0 con 0x7f1e441028e0 2024-01-25T15:01:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.952+0000 7f1e4919e700 1 --2- 172.21.15.170:0/1313925545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e441028e0 0x7f1e4419d810 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1e40000c00 tx=0x7f1e4000f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.953+0000 7f1e3a7fc700 1 -- 172.21.15.170:0/1313925545 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4001d070 con 0x7f1e441028e0 2024-01-25T15:01:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.953+0000 7f1e3a7fc700 1 -- 172.21.15.170:0/1313925545 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e4000fde0 con 0x7f1e441028e0 2024-01-25T15:01:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.953+0000 7f1e4a1a0700 1 -- 172.21.15.170:0/1313925545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e44198600 con 0x7f1e441028e0 2024-01-25T15:01:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.953+0000 7f1e3a7fc700 1 -- 172.21.15.170:0/1313925545 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e40017770 con 0x7f1e441028e0 2024-01-25T15:01:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.953+0000 7f1e4a1a0700 1 -- 172.21.15.170:0/1313925545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e441a48b0 con 0x7f1e441028e0 2024-01-25T15:01:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.953+0000 7f1e4a1a0700 1 -- 172.21.15.170:0/1313925545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e44106e40 con 0x7f1e441028e0 2024-01-25T15:01:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.955+0000 7f1e3a7fc700 1 -- 172.21.15.170:0/1313925545 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f1e40022aa0 con 0x7f1e441028e0 2024-01-25T15:01:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.955+0000 7f1e3a7fc700 1 --2- 172.21.15.170:0/1313925545 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1e300a1480 0x7f1e300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.955+0000 7f1e4899d700 1 --2- 172.21.15.170:0/1313925545 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1e300a1480 0x7f1e300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.955+0000 7f1e3a7fc700 1 -- 172.21.15.170:0/1313925545 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f1e400ce1d0 con 0x7f1e441028e0 2024-01-25T15:01:03.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.956+0000 7f1e4899d700 1 --2- 172.21.15.170:0/1313925545 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1e300a1480 0x7f1e300a3940 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1e4410d0b0 tx=0x7f1e34006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:03.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:03.960+0000 7f1e3a7fc700 1 -- 172.21.15.170:0/1313925545 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1e4005d600 con 0x7f1e441028e0 2024-01-25T15:01:04.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:04.161+0000 7f1e4a1a0700 1 -- 172.21.15.170:0/1313925545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f1e44198f00 con 0x7f1e441028e0 2024-01-25T15:01:04.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:04.161+0000 7f1e3a7fc700 1 -- 172.21.15.170:0/1313925545 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f1e400976d0 con 0x7f1e441028e0 2024-01-25T15:01:04.162 INFO:teuthology.orchestra.run.smithi170.stdout:309237645344 2024-01-25T15:01:04.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:04.163+0000 7f1e4a1a0700 1 -- 172.21.15.170:0/1313925545 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1e300a1480 msgr2=0x7f1e300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:04.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:04.163+0000 7f1e4a1a0700 1 --2- 172.21.15.170:0/1313925545 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1e300a1480 0x7f1e300a3940 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1e4410d0b0 tx=0x7f1e34006d20 comp rx=0 tx=0).stop 2024-01-25T15:01:04.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:04.163+0000 7f1e4a1a0700 1 -- 172.21.15.170:0/1313925545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e441028e0 msgr2=0x7f1e4419d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:04.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:04.163+0000 7f1e4a1a0700 1 --2- 172.21.15.170:0/1313925545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e441028e0 0x7f1e4419d810 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1e40000c00 tx=0x7f1e4000f880 comp rx=0 tx=0).stop 2024-01-25T15:01:04.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:04.163+0000 7f1e4a1a0700 1 -- 172.21.15.170:0/1313925545 shutdown_connections 2024-01-25T15:01:04.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:04.163+0000 7f1e4a1a0700 1 --2- 172.21.15.170:0/1313925545 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1e300a1480 0x7f1e300a3940 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:04.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:04.163+0000 7f1e4a1a0700 1 --2- 172.21.15.170:0/1313925545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1e4410bcc0 0x7f1e44197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:04.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:04.163+0000 7f1e4a1a0700 1 --2- 172.21.15.170:0/1313925545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1e441028e0 0x7f1e4419d810 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:04.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:04.163+0000 7f1e4a1a0700 1 --2- 172.21.15.170:0/1313925545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1e44103200 0x7f1e4419dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:04.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:04.163+0000 7f1e4a1a0700 1 -- 172.21.15.170:0/1313925545 >> 172.21.15.170:0/1313925545 conn(0x7f1e440fc0b0 msgr2=0x7f1e440fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:04.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:04.163+0000 7f1e4a1a0700 1 -- 172.21.15.170:0/1313925545 shutdown_connections 2024-01-25T15:01:04.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:04.163+0000 7f1e4a1a0700 1 -- 172.21.15.170:0/1313925545 wait complete. 2024-01-25T15:01:04.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:04 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1313925545' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-01-25T15:01:04.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:04 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1313925545' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-01-25T15:01:04.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:04 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1313925545' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-01-25T15:01:04.826 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645339 got 309237645344 for osd.10 2024-01-25T15:01:04.826 DEBUG:teuthology.parallel:result is None 2024-01-25T15:01:05.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.009+0000 7f84c9413700 1 -- 172.21.15.170:0/135753690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84c4101860 msgr2=0x7f84c4101cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:05.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.009+0000 7f84c9413700 1 --2- 172.21.15.170:0/135753690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84c4101860 0x7f84c4101cc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009990 tx=0x7f84b8009ca0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.010+0000 7f84c9413700 1 -- 172.21.15.170:0/135753690 shutdown_connections 2024-01-25T15:01:05.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.010+0000 7f84c9413700 1 --2- 172.21.15.170:0/135753690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84c4102200 0x7f84c410e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.010+0000 7f84c9413700 1 --2- 172.21.15.170:0/135753690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84c41077e0 0x7f84c4107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.010+0000 7f84c9413700 1 --2- 172.21.15.170:0/135753690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84c4101860 0x7f84c4101cc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.010+0000 7f84c9413700 1 -- 172.21.15.170:0/135753690 >> 172.21.15.170:0/135753690 conn(0x7f84c40788b0 msgr2=0x7f84c4078cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:05.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.010+0000 7f84c9413700 1 -- 172.21.15.170:0/135753690 shutdown_connections 2024-01-25T15:01:05.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.010+0000 7f84c9413700 1 -- 172.21.15.170:0/135753690 wait complete. 2024-01-25T15:01:05.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.010+0000 7f84c9413700 1 Processor -- start 2024-01-25T15:01:05.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.010+0000 7f84c9413700 1 -- start start 2024-01-25T15:01:05.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c9413700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84c4101860 0x7f84c419d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:05.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c9413700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84c4102200 0x7f84c419de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:05.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c9413700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84c41077e0 0x7f84c4197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:05.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c9413700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c41980e0 con 0x7f84c4102200 2024-01-25T15:01:05.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c9413700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c4198220 con 0x7f84c4101860 2024-01-25T15:01:05.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c9413700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c41983e0 con 0x7f84c41077e0 2024-01-25T15:01:05.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c27fc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84c4102200 0x7f84c419de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:05.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c27fc700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84c4102200 0x7f84c419de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35258/0 (socket says 172.21.15.170:35258) 2024-01-25T15:01:05.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c27fc700 1 -- 172.21.15.170:0/2347500603 learned_addr learned my addr 172.21.15.170:0/2347500603 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:05.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c2ffd700 1 --2- 172.21.15.170:0/2347500603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84c4101860 0x7f84c419d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:05.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c37fe700 1 --2- 172.21.15.170:0/2347500603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84c41077e0 0x7f84c4197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:05.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c27fc700 1 -- 172.21.15.170:0/2347500603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84c41077e0 msgr2=0x7f84c4197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:05.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c27fc700 1 --2- 172.21.15.170:0/2347500603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84c41077e0 0x7f84c4197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c27fc700 1 -- 172.21.15.170:0/2347500603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84c4101860 msgr2=0x7f84c419d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:05.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c27fc700 1 --2- 172.21.15.170:0/2347500603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84c4101860 0x7f84c419d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c27fc700 1 -- 172.21.15.170:0/2347500603 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b80095f0 con 0x7f84c4102200 2024-01-25T15:01:05.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c27fc700 1 --2- 172.21.15.170:0/2347500603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84c4102200 0x7f84c419de00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f84b80092e0 tx=0x7f84b800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:05.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84abfff700 1 -- 172.21.15.170:0/2347500603 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b801d070 con 0x7f84c4102200 2024-01-25T15:01:05.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c9413700 1 -- 172.21.15.170:0/2347500603 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c4198660 con 0x7f84c4102200 2024-01-25T15:01:05.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.011+0000 7f84c9413700 1 -- 172.21.15.170:0/2347500603 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c41a4960 con 0x7f84c4102200 2024-01-25T15:01:05.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.012+0000 7f84abfff700 1 -- 172.21.15.170:0/2347500603 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84b8005da0 con 0x7f84c4102200 2024-01-25T15:01:05.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.012+0000 7f84abfff700 1 -- 172.21.15.170:0/2347500603 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b80054d0 con 0x7f84c4102200 2024-01-25T15:01:05.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.012+0000 7f84c9413700 1 -- 172.21.15.170:0/2347500603 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c4109d90 con 0x7f84c4102200 2024-01-25T15:01:05.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.014+0000 7f84abfff700 1 -- 172.21.15.170:0/2347500603 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f84b800fbb0 con 0x7f84c4102200 2024-01-25T15:01:05.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.015+0000 7f84abfff700 1 --2- 172.21.15.170:0/2347500603 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f84ac0a1400 0x7f84ac0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:05.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.015+0000 7f84c2ffd700 1 --2- 172.21.15.170:0/2347500603 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f84ac0a1400 0x7f84ac0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:05.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.015+0000 7f84abfff700 1 -- 172.21.15.170:0/2347500603 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f84b80cdca0 con 0x7f84c4102200 2024-01-25T15:01:05.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.015+0000 7f84c2ffd700 1 --2- 172.21.15.170:0/2347500603 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f84ac0a1400 0x7f84ac0a38c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f84c4198bc0 tx=0x7f84b400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:05.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.018+0000 7f84abfff700 1 -- 172.21.15.170:0/2347500603 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f84b8097080 con 0x7f84c4102200 2024-01-25T15:01:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.218+0000 7f84c9413700 1 -- 172.21.15.170:0/2347500603 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f84c4198fb0 con 0x7f84c4102200 2024-01-25T15:01:05.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.219+0000 7f84abfff700 1 -- 172.21.15.170:0/2347500603 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84b8005630 con 0x7f84c4102200 2024-01-25T15:01:05.220 INFO:teuthology.orchestra.run.smithi170.stdout:287762808869 2024-01-25T15:01:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.221+0000 7f84c9413700 1 -- 172.21.15.170:0/2347500603 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f84ac0a1400 msgr2=0x7f84ac0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.221+0000 7f84c9413700 1 --2- 172.21.15.170:0/2347500603 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f84ac0a1400 0x7f84ac0a38c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f84c4198bc0 tx=0x7f84b400b410 comp rx=0 tx=0).stop 2024-01-25T15:01:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.221+0000 7f84c9413700 1 -- 172.21.15.170:0/2347500603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84c4102200 msgr2=0x7f84c419de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.221+0000 7f84c9413700 1 --2- 172.21.15.170:0/2347500603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84c4102200 0x7f84c419de00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f84b80092e0 tx=0x7f84b800f690 comp rx=0 tx=0).stop 2024-01-25T15:01:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.221+0000 7f84c9413700 1 -- 172.21.15.170:0/2347500603 shutdown_connections 2024-01-25T15:01:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.221+0000 7f84c9413700 1 --2- 172.21.15.170:0/2347500603 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f84ac0a1400 0x7f84ac0a38c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.221+0000 7f84c9413700 1 --2- 172.21.15.170:0/2347500603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f84c41077e0 0x7f84c4197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.221+0000 7f84c9413700 1 --2- 172.21.15.170:0/2347500603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84c4101860 0x7f84c419d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.221+0000 7f84c9413700 1 --2- 172.21.15.170:0/2347500603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f84c4102200 0x7f84c419de00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.222 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.221+0000 7f84c9413700 1 -- 172.21.15.170:0/2347500603 >> 172.21.15.170:0/2347500603 conn(0x7f84c40788b0 msgr2=0x7f84c40ff9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:05.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.221+0000 7f84c9413700 1 -- 172.21.15.170:0/2347500603 shutdown_connections 2024-01-25T15:01:05.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.221+0000 7f84c9413700 1 -- 172.21.15.170:0/2347500603 wait complete. 2024-01-25T15:01:05.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.238+0000 7ff9bcca2700 1 -- 172.21.15.170:0/3976081414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9b8100790 msgr2=0x7ff9b810e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:05.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.238+0000 7ff9bcca2700 1 --2- 172.21.15.170:0/3976081414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9b8100790 0x7ff9b810e6f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000b0a0 tx=0x7ff9b000b3b0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.238+0000 7ff9bcca2700 1 -- 172.21.15.170:0/3976081414 shutdown_connections 2024-01-25T15:01:05.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.238+0000 7ff9bcca2700 1 --2- 172.21.15.170:0/3976081414 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9b8100790 0x7ff9b810e6f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.238+0000 7ff9bcca2700 1 --2- 172.21.15.170:0/3976081414 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b8106850 0x7ff9b8106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.238+0000 7ff9bcca2700 1 --2- 172.21.15.170:0/3976081414 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9b80ffdd0 0x7ff9b8100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.238+0000 7ff9bcca2700 1 -- 172.21.15.170:0/3976081414 >> 172.21.15.170:0/3976081414 conn(0x7ff9b8076ce0 msgr2=0x7ff9b80fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:05.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.239+0000 7ff9bcca2700 1 -- 172.21.15.170:0/3976081414 shutdown_connections 2024-01-25T15:01:05.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.239+0000 7ff9bcca2700 1 -- 172.21.15.170:0/3976081414 wait complete. 2024-01-25T15:01:05.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.239+0000 7ff9bcca2700 1 Processor -- start 2024-01-25T15:01:05.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.239+0000 7ff9bcca2700 1 -- start start 2024-01-25T15:01:05.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9bcca2700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9b80ffdd0 0x7ff9b819da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:05.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9bcca2700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b8100790 0x7ff9b819df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:05.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9bcca2700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9b8106850 0x7ff9b8197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:05.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9bcca2700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b81982c0 con 0x7ff9b80ffdd0 2024-01-25T15:01:05.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9bcca2700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b8198430 con 0x7ff9b8100790 2024-01-25T15:01:05.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9bcca2700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b81985f0 con 0x7ff9b8106850 2024-01-25T15:01:05.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9b659c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9b80ffdd0 0x7ff9b819da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:05.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9b659c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9b80ffdd0 0x7ff9b819da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35276/0 (socket says 172.21.15.170:35276) 2024-01-25T15:01:05.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9b659c700 1 -- 172.21.15.170:0/3409119038 learned_addr learned my addr 172.21.15.170:0/3409119038 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:05.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9b5d9b700 1 --2- 172.21.15.170:0/3409119038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b8100790 0x7ff9b819df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:05.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9b6d9d700 1 --2- 172.21.15.170:0/3409119038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9b8106850 0x7ff9b8197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:05.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9b659c700 1 -- 172.21.15.170:0/3409119038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9b8106850 msgr2=0x7ff9b8197b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:05.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9b659c700 1 --2- 172.21.15.170:0/3409119038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9b8106850 0x7ff9b8197b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9b659c700 1 -- 172.21.15.170:0/3409119038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b8100790 msgr2=0x7ff9b819df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:05.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9b659c700 1 --2- 172.21.15.170:0/3409119038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b8100790 0x7ff9b819df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9b659c700 1 -- 172.21.15.170:0/3409119038 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b0009d00 con 0x7ff9b80ffdd0 2024-01-25T15:01:05.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9b659c700 1 --2- 172.21.15.170:0/3409119038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9b80ffdd0 0x7ff9b819da40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800c9b0 tx=0x7ff9a800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:05.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.240+0000 7ff9a77fe700 1 -- 172.21.15.170:0/3409119038 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8007b00 con 0x7ff9b80ffdd0 2024-01-25T15:01:05.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.241+0000 7ff9bcca2700 1 -- 172.21.15.170:0/3409119038 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b81988d0 con 0x7ff9b80ffdd0 2024-01-25T15:01:05.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.241+0000 7ff9a77fe700 1 -- 172.21.15.170:0/3409119038 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9a800ce50 con 0x7ff9b80ffdd0 2024-01-25T15:01:05.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.241+0000 7ff9a77fe700 1 -- 172.21.15.170:0/3409119038 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8018660 con 0x7ff9b80ffdd0 2024-01-25T15:01:05.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.241+0000 7ff9bcca2700 1 -- 172.21.15.170:0/3409119038 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b81a49c0 con 0x7ff9b80ffdd0 2024-01-25T15:01:05.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.242+0000 7ff9bcca2700 1 -- 172.21.15.170:0/3409119038 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b81030f0 con 0x7ff9b80ffdd0 2024-01-25T15:01:05.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.243+0000 7ff9a77fe700 1 -- 172.21.15.170:0/3409119038 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7ff9a800f450 con 0x7ff9b80ffdd0 2024-01-25T15:01:05.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.244+0000 7ff9a77fe700 1 --2- 172.21.15.170:0/3409119038 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff9a00a1400 0x7ff9a00a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:05.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.244+0000 7ff9b5d9b700 1 --2- 172.21.15.170:0/3409119038 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff9a00a1400 0x7ff9a00a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:05.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.244+0000 7ff9a77fe700 1 -- 172.21.15.170:0/3409119038 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7ff9a80cce50 con 0x7ff9b80ffdd0 2024-01-25T15:01:05.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.244+0000 7ff9b5d9b700 1 --2- 172.21.15.170:0/3409119038 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff9a00a1400 0x7ff9a00a38c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8199260 tx=0x7ff9ac00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:05.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.247+0000 7ff9a77fe700 1 -- 172.21.15.170:0/3409119038 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ff9a8096230 con 0x7ff9b80ffdd0 2024-01-25T15:01:05.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.450+0000 7ff9bcca2700 1 -- 172.21.15.170:0/3409119038 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7ff9b8198fd0 con 0x7ff9b80ffdd0 2024-01-25T15:01:05.451 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.450+0000 7ff9a77fe700 1 -- 172.21.15.170:0/3409119038 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7ff9a8007e60 con 0x7ff9b80ffdd0 2024-01-25T15:01:05.452 INFO:teuthology.orchestra.run.smithi170.stdout:343597383708 2024-01-25T15:01:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.452+0000 7ff9bcca2700 1 -- 172.21.15.170:0/3409119038 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff9a00a1400 msgr2=0x7ff9a00a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.452+0000 7ff9bcca2700 1 --2- 172.21.15.170:0/3409119038 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff9a00a1400 0x7ff9a00a38c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8199260 tx=0x7ff9ac00a380 comp rx=0 tx=0).stop 2024-01-25T15:01:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.452+0000 7ff9bcca2700 1 -- 172.21.15.170:0/3409119038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9b80ffdd0 msgr2=0x7ff9b819da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.452+0000 7ff9bcca2700 1 --2- 172.21.15.170:0/3409119038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9b80ffdd0 0x7ff9b819da40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800c9b0 tx=0x7ff9a800ccc0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.453+0000 7ff9bcca2700 1 -- 172.21.15.170:0/3409119038 shutdown_connections 2024-01-25T15:01:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.453+0000 7ff9bcca2700 1 --2- 172.21.15.170:0/3409119038 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff9a00a1400 0x7ff9a00a38c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.453+0000 7ff9bcca2700 1 --2- 172.21.15.170:0/3409119038 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff9b8106850 0x7ff9b8197b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.453+0000 7ff9bcca2700 1 --2- 172.21.15.170:0/3409119038 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff9b80ffdd0 0x7ff9b819da40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.453+0000 7ff9bcca2700 1 --2- 172.21.15.170:0/3409119038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9b8100790 0x7ff9b819df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.453+0000 7ff9bcca2700 1 -- 172.21.15.170:0/3409119038 >> 172.21.15.170:0/3409119038 conn(0x7ff9b8076ce0 msgr2=0x7ff9b80fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.453+0000 7ff9bcca2700 1 -- 172.21.15.170:0/3409119038 shutdown_connections 2024-01-25T15:01:05.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:05.453+0000 7ff9bcca2700 1 -- 172.21.15.170:0/3409119038 wait complete. 2024-01-25T15:01:05.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:05 smithi186 ceph-mon[35697]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 7.1 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:01:05.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:05 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2347500603' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-01-25T15:01:05.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:05 smithi170 ceph-mon[31899]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 7.1 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:01:05.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:05 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2347500603' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-01-25T15:01:05.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:05 smithi191 ceph-mon[36347]: pgmap v321: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 7.1 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:01:05.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:05 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2347500603' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-01-25T15:01:06.126 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808863 got 287762808869 for osd.9 2024-01-25T15:01:06.126 DEBUG:teuthology.parallel:result is None 2024-01-25T15:01:06.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:06 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3409119038' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-01-25T15:01:06.512 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383702 got 343597383708 for osd.11 2024-01-25T15:01:06.512 DEBUG:teuthology.parallel:result is None 2024-01-25T15:01:06.512 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-01-25T15:01:06.512 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph pg dump --format=json 2024-01-25T15:01:06.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:06 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3409119038' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-01-25T15:01:06.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:06 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3409119038' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-01-25T15:01:07.300 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:01:07.558 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:07 smithi170 ceph-mon[31899]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 5.7 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:01:07.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:07 smithi186 ceph-mon[35697]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 5.7 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:01:07.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:07 smithi191 ceph-mon[36347]: pgmap v322: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 5.7 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:01:09.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.015+0000 7f69b60f8700 1 -- 172.21.15.170:0/3194135915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69b01077c0 msgr2=0x7f69b0107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:09.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.015+0000 7f69b60f8700 1 --2- 172.21.15.170:0/3194135915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69b01077c0 0x7f69b0107ba0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009990 tx=0x7f69a0009ca0 comp rx=0 tx=0).stop 2024-01-25T15:01:09.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.015+0000 7f69b60f8700 1 -- 172.21.15.170:0/3194135915 shutdown_connections 2024-01-25T15:01:09.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.015+0000 7f69b60f8700 1 --2- 172.21.15.170:0/3194135915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69b0102180 0x7f69b010e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:09.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.015+0000 7f69b60f8700 1 --2- 172.21.15.170:0/3194135915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69b01077c0 0x7f69b0107ba0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:09.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.015+0000 7f69b60f8700 1 --2- 172.21.15.170:0/3194135915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69b01017c0 0x7f69b0101c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:09.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.015+0000 7f69b60f8700 1 -- 172.21.15.170:0/3194135915 >> 172.21.15.170:0/3194135915 conn(0x7f69b00fd290 msgr2=0x7f69b00ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:09.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.015+0000 7f69b60f8700 1 -- 172.21.15.170:0/3194135915 shutdown_connections 2024-01-25T15:01:09.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.015+0000 7f69b60f8700 1 -- 172.21.15.170:0/3194135915 wait complete. 2024-01-25T15:01:09.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.016+0000 7f69b60f8700 1 Processor -- start 2024-01-25T15:01:09.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.016+0000 7f69b60f8700 1 -- start start 2024-01-25T15:01:09.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.016+0000 7f69b60f8700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69b01017c0 0x7f69b0073ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:09.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.016+0000 7f69b60f8700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69b0102180 0x7f69b0074020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:09.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.016+0000 7f69b60f8700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69b01077c0 0x7f69b0074560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:09.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.016+0000 7f69b60f8700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b01a6060 con 0x7f69b0102180 2024-01-25T15:01:09.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.016+0000 7f69b60f8700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b01a61d0 con 0x7f69b01077c0 2024-01-25T15:01:09.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.016+0000 7f69b60f8700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b01a6390 con 0x7f69b01017c0 2024-01-25T15:01:09.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69af7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69b01017c0 0x7f69b0073ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:09.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69af7fe700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69b01017c0 0x7f69b0073ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:35432/0 (socket says 172.21.15.170:35432) 2024-01-25T15:01:09.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69af7fe700 1 -- 172.21.15.170:0/1882578062 learned_addr learned my addr 172.21.15.170:0/1882578062 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:09.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69affff700 1 --2- 172.21.15.170:0/1882578062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69b01077c0 0x7f69b0074560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:09.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69a6ffd700 1 --2- 172.21.15.170:0/1882578062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69b0102180 0x7f69b0074020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:09.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69af7fe700 1 -- 172.21.15.170:0/1882578062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69b01077c0 msgr2=0x7f69b0074560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:09.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69af7fe700 1 --2- 172.21.15.170:0/1882578062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69b01077c0 0x7f69b0074560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:09.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69af7fe700 1 -- 172.21.15.170:0/1882578062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69b0102180 msgr2=0x7f69b0074020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:09.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69af7fe700 1 --2- 172.21.15.170:0/1882578062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69b0102180 0x7f69b0074020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:09.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69af7fe700 1 -- 172.21.15.170:0/1882578062 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a00095f0 con 0x7f69b01017c0 2024-01-25T15:01:09.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69affff700 1 --2- 172.21.15.170:0/1882578062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69b01077c0 0x7f69b0074560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:01:09.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69af7fe700 1 --2- 172.21.15.170:0/1882578062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69b01017c0 0x7f69b0073ae0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009fd0 tx=0x7f69a000f670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:09.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69ad7fa700 1 -- 172.21.15.170:0/1882578062 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a001d070 con 0x7f69b01017c0 2024-01-25T15:01:09.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69b60f8700 1 -- 172.21.15.170:0/1882578062 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b01a6610 con 0x7f69b01017c0 2024-01-25T15:01:09.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69ad7fa700 1 -- 172.21.15.170:0/1882578062 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69a0005050 con 0x7f69b01017c0 2024-01-25T15:01:09.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.017+0000 7f69ad7fa700 1 -- 172.21.15.170:0/1882578062 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a0004a90 con 0x7f69b01017c0 2024-01-25T15:01:09.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.018+0000 7f69b60f8700 1 -- 172.21.15.170:0/1882578062 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b01a6b00 con 0x7f69b01017c0 2024-01-25T15:01:09.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.018+0000 7f69b60f8700 1 -- 172.21.15.170:0/1882578062 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b0109dc0 con 0x7f69b01017c0 2024-01-25T15:01:09.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.020+0000 7f69ad7fa700 1 -- 172.21.15.170:0/1882578062 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f69a00051c0 con 0x7f69b01017c0 2024-01-25T15:01:09.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.020+0000 7f69ad7fa700 1 --2- 172.21.15.170:0/1882578062 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f699c0a1400 0x7f699c0a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:09.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.020+0000 7f69a6ffd700 1 --2- 172.21.15.170:0/1882578062 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f699c0a1400 0x7f699c0a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:09.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.020+0000 7f69ad7fa700 1 -- 172.21.15.170:0/1882578062 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f69a00cdd60 con 0x7f69b01017c0 2024-01-25T15:01:09.022 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.021+0000 7f69a6ffd700 1 --2- 172.21.15.170:0/1882578062 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f699c0a1400 0x7f699c0a38c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f69b00ff930 tx=0x7f699800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:09.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.024+0000 7f69ad7fa700 1 -- 172.21.15.170:0/1882578062 <== mon.1 v2:172.21.15.191:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f69a0097140 con 0x7f69b01017c0 2024-01-25T15:01:09.234 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.232+0000 7f69b60f8700 1 -- 172.21.15.170:0/1882578062 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69b01117b0 con 0x7f699c0a1400 2024-01-25T15:01:09.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.244+0000 7f69ad7fa700 1 -- 172.21.15.170:0/1882578062 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344998 (secure 0 0 0) 0x7f69b01117b0 con 0x7f699c0a1400 2024-01-25T15:01:09.249 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:09.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.247+0000 7f69b60f8700 1 -- 172.21.15.170:0/1882578062 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f699c0a1400 msgr2=0x7f699c0a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:09.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.247+0000 7f69b60f8700 1 --2- 172.21.15.170:0/1882578062 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f699c0a1400 0x7f699c0a38c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f69b00ff930 tx=0x7f699800b410 comp rx=0 tx=0).stop 2024-01-25T15:01:09.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.247+0000 7f69b60f8700 1 -- 172.21.15.170:0/1882578062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69b01017c0 msgr2=0x7f69b0073ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:09.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.247+0000 7f69b60f8700 1 --2- 172.21.15.170:0/1882578062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69b01017c0 0x7f69b0073ae0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f69a0009fd0 tx=0x7f69a000f670 comp rx=0 tx=0).stop 2024-01-25T15:01:09.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.247+0000 7f69b60f8700 1 -- 172.21.15.170:0/1882578062 shutdown_connections 2024-01-25T15:01:09.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.247+0000 7f69b60f8700 1 --2- 172.21.15.170:0/1882578062 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f699c0a1400 0x7f699c0a38c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:09.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.247+0000 7f69b60f8700 1 --2- 172.21.15.170:0/1882578062 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f69b01017c0 0x7f69b0073ae0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:09.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.247+0000 7f69b60f8700 1 --2- 172.21.15.170:0/1882578062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69b01077c0 0x7f69b0074560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:09.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.247+0000 7f69b60f8700 1 --2- 172.21.15.170:0/1882578062 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f69b0102180 0x7f69b0074020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:09.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.247+0000 7f69b60f8700 1 -- 172.21.15.170:0/1882578062 >> 172.21.15.170:0/1882578062 conn(0x7f69b00fd290 msgr2=0x7f69b00fda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:09.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.247+0000 7f69b60f8700 1 -- 172.21.15.170:0/1882578062 shutdown_connections 2024-01-25T15:01:09.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:09.247+0000 7f69b60f8700 1 -- 172.21.15.170:0/1882578062 wait complete. 2024-01-25T15:01:09.254 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2024-01-25T15:01:09.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:09 smithi186 ceph-mon[35697]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 5.2 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:01:09.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:09 smithi170 ceph-mon[31899]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 5.2 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:01:09.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:09 smithi191 ceph-mon[36347]: pgmap v323: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s; 5.2 KiB/s, 0 keys/s, 1 objects/s recovering 2024-01-25T15:01:10.031 INFO:teuthology.orchestra.run.smithi170.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-01-25T15:01:08.208954+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655745,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":830,"num_read_kb":535,"num_write":416,"num_write_kb":3069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1239089,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391672,"kb_used_data":13308,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550152,"statfs":{"total":1151940427776,"available":1151539355648,"internally_reserved":0,"allocated":13627392,"data_stored":7428399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":387233084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":62,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58353,"num_keys_recovered":7,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.932892"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281623+0000","last_change":"2024-01-25T14:59:54.219084+0000","last_active":"2024-01-25T15:00:57.281623+0000","last_peered":"2024-01-25T15:00:57.281623+0000","last_clean":"2024-01-25T15:00:57.281623+0000","last_became_active":"2024-01-25T14:59:54.218780+0000","last_became_peered":"2024-01-25T14:59:54.218780+0000","last_unstale":"2024-01-25T15:00:57.281623+0000","last_undegraded":"2024-01-25T15:00:57.281623+0000","last_fullsized":"2024-01-25T15:00:57.281623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:05:50.441934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277787+0000","last_change":"2024-01-25T14:59:54.219130+0000","last_active":"2024-01-25T15:00:57.277787+0000","last_peered":"2024-01-25T15:00:57.277787+0000","last_clean":"2024-01-25T15:00:57.277787+0000","last_became_active":"2024-01-25T14:59:54.218744+0000","last_became_peered":"2024-01-25T14:59:54.218744+0000","last_unstale":"2024-01-25T15:00:57.277787+0000","last_undegraded":"2024-01-25T15:00:57.277787+0000","last_fullsized":"2024-01-25T15:00:57.277787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:59:35.424110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277694+0000","last_change":"2024-01-25T14:59:54.218870+0000","last_active":"2024-01-25T15:00:57.277694+0000","last_peered":"2024-01-25T15:00:57.277694+0000","last_clean":"2024-01-25T15:00:57.277694+0000","last_became_active":"2024-01-25T14:59:54.218522+0000","last_became_peered":"2024-01-25T14:59:54.218522+0000","last_unstale":"2024-01-25T15:00:57.277694+0000","last_undegraded":"2024-01-25T15:00:57.277694+0000","last_fullsized":"2024-01-25T15:00:57.277694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:00:05.038437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279426+0000","last_change":"2024-01-25T14:59:54.218436+0000","last_active":"2024-01-25T15:00:57.279426+0000","last_peered":"2024-01-25T15:00:57.279426+0000","last_clean":"2024-01-25T15:00:57.279426+0000","last_became_active":"2024-01-25T14:59:54.217232+0000","last_became_peered":"2024-01-25T14:59:54.217232+0000","last_unstale":"2024-01-25T15:00:57.279426+0000","last_undegraded":"2024-01-25T15:00:57.279426+0000","last_fullsized":"2024-01-25T15:00:57.279426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:24:14.642794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278510+0000","last_change":"2024-01-25T14:59:54.219094+0000","last_active":"2024-01-25T15:00:57.278510+0000","last_peered":"2024-01-25T15:00:57.278510+0000","last_clean":"2024-01-25T15:00:57.278510+0000","last_became_active":"2024-01-25T14:59:54.218778+0000","last_became_peered":"2024-01-25T14:59:54.218778+0000","last_unstale":"2024-01-25T15:00:57.278510+0000","last_undegraded":"2024-01-25T15:00:57.278510+0000","last_fullsized":"2024-01-25T15:00:57.278510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:21.754098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281409+0000","last_change":"2024-01-25T14:59:54.213243+0000","last_active":"2024-01-25T15:00:57.281409+0000","last_peered":"2024-01-25T15:00:57.281409+0000","last_clean":"2024-01-25T15:00:57.281409+0000","last_became_active":"2024-01-25T14:59:54.212891+0000","last_became_peered":"2024-01-25T14:59:54.212891+0000","last_unstale":"2024-01-25T15:00:57.281409+0000","last_undegraded":"2024-01-25T15:00:57.281409+0000","last_fullsized":"2024-01-25T15:00:57.281409+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:52:45.505016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282580+0000","last_change":"2024-01-25T14:59:54.211851+0000","last_active":"2024-01-25T15:00:57.282580+0000","last_peered":"2024-01-25T15:00:57.282580+0000","last_clean":"2024-01-25T15:00:57.282580+0000","last_became_active":"2024-01-25T14:59:54.211298+0000","last_became_peered":"2024-01-25T14:59:54.211298+0000","last_unstale":"2024-01-25T15:00:57.282580+0000","last_undegraded":"2024-01-25T15:00:57.282580+0000","last_fullsized":"2024-01-25T15:00:57.282580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:05:36.636283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282815+0000","last_change":"2024-01-25T14:59:54.217675+0000","last_active":"2024-01-25T15:00:57.282815+0000","last_peered":"2024-01-25T15:00:57.282815+0000","last_clean":"2024-01-25T15:00:57.282815+0000","last_became_active":"2024-01-25T14:59:54.217329+0000","last_became_peered":"2024-01-25T14:59:54.217329+0000","last_unstale":"2024-01-25T15:00:57.282815+0000","last_undegraded":"2024-01-25T15:00:57.282815+0000","last_fullsized":"2024-01-25T15:00:57.282815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:32:07.769974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.285711+0000","last_change":"2024-01-25T14:59:54.213030+0000","last_active":"2024-01-25T15:00:57.285711+0000","last_peered":"2024-01-25T15:00:57.285711+0000","last_clean":"2024-01-25T15:00:57.285711+0000","last_became_active":"2024-01-25T14:59:54.212687+0000","last_became_peered":"2024-01-25T14:59:54.212687+0000","last_unstale":"2024-01-25T15:00:57.285711+0000","last_undegraded":"2024-01-25T15:00:57.285711+0000","last_fullsized":"2024-01-25T15:00:57.285711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:47:29.562996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284759+0000","last_change":"2024-01-25T15:00:57.284759+0000","last_active":"2024-01-25T15:00:57.284759+0000","last_peered":"2024-01-25T15:00:57.284759+0000","last_clean":"2024-01-25T15:00:57.284759+0000","last_became_active":"2024-01-25T15:00:57.284306+0000","last_became_peered":"2024-01-25T15:00:57.284306+0000","last_unstale":"2024-01-25T15:00:57.284759+0000","last_undegraded":"2024-01-25T15:00:57.284759+0000","last_fullsized":"2024-01-25T15:00:57.284759+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:56:49.173903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283196+0000","last_change":"2024-01-25T14:59:54.216252+0000","last_active":"2024-01-25T15:00:57.283196+0000","last_peered":"2024-01-25T15:00:57.283196+0000","last_clean":"2024-01-25T15:00:57.283196+0000","last_became_active":"2024-01-25T14:59:54.215892+0000","last_became_peered":"2024-01-25T14:59:54.215892+0000","last_unstale":"2024-01-25T15:00:57.283196+0000","last_undegraded":"2024-01-25T15:00:57.283196+0000","last_fullsized":"2024-01-25T15:00:57.283196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:53:27.135926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279396+0000","last_change":"2024-01-25T14:59:54.221212+0000","last_active":"2024-01-25T15:00:57.279396+0000","last_peered":"2024-01-25T15:00:57.279396+0000","last_clean":"2024-01-25T15:00:57.279396+0000","last_became_active":"2024-01-25T14:59:54.220516+0000","last_became_peered":"2024-01-25T14:59:54.220516+0000","last_unstale":"2024-01-25T15:00:57.279396+0000","last_undegraded":"2024-01-25T15:00:57.279396+0000","last_fullsized":"2024-01-25T15:00:57.279396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:00:57.398457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279713+0000","last_change":"2024-01-25T14:59:54.204088+0000","last_active":"2024-01-25T15:00:57.279713+0000","last_peered":"2024-01-25T15:00:57.279713+0000","last_clean":"2024-01-25T15:00:57.279713+0000","last_became_active":"2024-01-25T14:59:54.202895+0000","last_became_peered":"2024-01-25T14:59:54.202895+0000","last_unstale":"2024-01-25T15:00:57.279713+0000","last_undegraded":"2024-01-25T15:00:57.279713+0000","last_fullsized":"2024-01-25T15:00:57.279713+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:15:37.693577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277766+0000","last_change":"2024-01-25T14:59:54.226108+0000","last_active":"2024-01-25T15:00:57.277766+0000","last_peered":"2024-01-25T15:00:57.277766+0000","last_clean":"2024-01-25T15:00:57.277766+0000","last_became_active":"2024-01-25T14:59:54.225830+0000","last_became_peered":"2024-01-25T14:59:54.225830+0000","last_unstale":"2024-01-25T15:00:57.277766+0000","last_undegraded":"2024-01-25T15:00:57.277766+0000","last_fullsized":"2024-01-25T15:00:57.277766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:10:22.580434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277463+0000","last_change":"2024-01-25T14:59:54.224893+0000","last_active":"2024-01-25T15:00:57.277463+0000","last_peered":"2024-01-25T15:00:57.277463+0000","last_clean":"2024-01-25T15:00:57.277463+0000","last_became_active":"2024-01-25T14:59:54.224583+0000","last_became_peered":"2024-01-25T14:59:54.224583+0000","last_unstale":"2024-01-25T15:00:57.277463+0000","last_undegraded":"2024-01-25T15:00:57.277463+0000","last_fullsized":"2024-01-25T15:00:57.277463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:48:25.538489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284500+0000","last_change":"2024-01-25T14:59:54.217030+0000","last_active":"2024-01-25T15:00:57.284500+0000","last_peered":"2024-01-25T15:00:57.284500+0000","last_clean":"2024-01-25T15:00:57.284500+0000","last_became_active":"2024-01-25T14:59:54.216732+0000","last_became_peered":"2024-01-25T14:59:54.216732+0000","last_unstale":"2024-01-25T15:00:57.284500+0000","last_undegraded":"2024-01-25T15:00:57.284500+0000","last_fullsized":"2024-01-25T15:00:57.284500+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:58:36.072464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281058+0000","last_change":"2024-01-25T14:59:54.223924+0000","last_active":"2024-01-25T15:00:57.281058+0000","last_peered":"2024-01-25T15:00:57.281058+0000","last_clean":"2024-01-25T15:00:57.281058+0000","last_became_active":"2024-01-25T14:59:54.223556+0000","last_became_peered":"2024-01-25T14:59:54.223556+0000","last_unstale":"2024-01-25T15:00:57.281058+0000","last_undegraded":"2024-01-25T15:00:57.281058+0000","last_fullsized":"2024-01-25T15:00:57.281058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:54:18.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280925+0000","last_change":"2024-01-25T14:59:54.207125+0000","last_active":"2024-01-25T15:00:57.280925+0000","last_peered":"2024-01-25T15:00:57.280925+0000","last_clean":"2024-01-25T15:00:57.280925+0000","last_became_active":"2024-01-25T14:59:54.206630+0000","last_became_peered":"2024-01-25T14:59:54.206630+0000","last_unstale":"2024-01-25T15:00:57.280925+0000","last_undegraded":"2024-01-25T15:00:57.280925+0000","last_fullsized":"2024-01-25T15:00:57.280925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:10:12.685185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281546+0000","last_change":"2024-01-25T14:59:54.210732+0000","last_active":"2024-01-25T15:00:57.281546+0000","last_peered":"2024-01-25T15:00:57.281546+0000","last_clean":"2024-01-25T15:00:57.281546+0000","last_became_active":"2024-01-25T14:59:54.210417+0000","last_became_peered":"2024-01-25T14:59:54.210417+0000","last_unstale":"2024-01-25T15:00:57.281546+0000","last_undegraded":"2024-01-25T15:00:57.281546+0000","last_fullsized":"2024-01-25T15:00:57.281546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:05:22.305485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'13","reported_seq":102,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:07.136635+0000","last_change":"2024-01-25T14:59:53.204680+0000","last_active":"2024-01-25T15:01:07.136635+0000","last_peered":"2024-01-25T15:01:07.136635+0000","last_clean":"2024-01-25T15:01:07.136635+0000","last_became_active":"2024-01-25T14:59:53.204327+0000","last_became_peered":"2024-01-25T14:59:53.204327+0000","last_unstale":"2024-01-25T15:01:07.136635+0000","last_undegraded":"2024-01-25T15:01:07.136635+0000","last_fullsized":"2024-01-25T15:01:07.136635+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:32:16.333425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284202+0000","last_change":"2024-01-25T14:59:54.220501+0000","last_active":"2024-01-25T15:00:57.284202+0000","last_peered":"2024-01-25T15:00:57.284202+0000","last_clean":"2024-01-25T15:00:57.284202+0000","last_became_active":"2024-01-25T14:59:54.217150+0000","last_became_peered":"2024-01-25T14:59:54.217150+0000","last_unstale":"2024-01-25T15:00:57.284202+0000","last_undegraded":"2024-01-25T15:00:57.284202+0000","last_fullsized":"2024-01-25T15:00:57.284202+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:16:00.811698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284319+0000","last_change":"2024-01-25T14:59:53.209110+0000","last_active":"2024-01-25T15:00:57.284319+0000","last_peered":"2024-01-25T15:00:57.284319+0000","last_clean":"2024-01-25T15:00:57.284319+0000","last_became_active":"2024-01-25T14:59:53.208794+0000","last_became_peered":"2024-01-25T14:59:53.208794+0000","last_unstale":"2024-01-25T15:00:57.284319+0000","last_undegraded":"2024-01-25T15:00:57.284319+0000","last_fullsized":"2024-01-25T15:00:57.284319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:51:40.757062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277775+0000","last_change":"2024-01-25T14:59:54.219303+0000","last_active":"2024-01-25T15:00:57.277775+0000","last_peered":"2024-01-25T15:00:57.277775+0000","last_clean":"2024-01-25T15:00:57.277775+0000","last_became_active":"2024-01-25T14:59:54.218814+0000","last_became_peered":"2024-01-25T14:59:54.218814+0000","last_unstale":"2024-01-25T15:00:57.277775+0000","last_undegraded":"2024-01-25T15:00:57.277775+0000","last_fullsized":"2024-01-25T15:00:57.277775+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:54:30.556998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278661+0000","last_change":"2024-01-25T14:59:53.209770+0000","last_active":"2024-01-25T15:00:57.278661+0000","last_peered":"2024-01-25T15:00:57.278661+0000","last_clean":"2024-01-25T15:00:57.278661+0000","last_became_active":"2024-01-25T14:59:53.209466+0000","last_became_peered":"2024-01-25T14:59:53.209466+0000","last_unstale":"2024-01-25T15:00:57.278661+0000","last_undegraded":"2024-01-25T15:00:57.278661+0000","last_fullsized":"2024-01-25T15:00:57.278661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:58:11.391155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.285497+0000","last_change":"2024-01-25T14:59:54.201559+0000","last_active":"2024-01-25T15:00:57.285497+0000","last_peered":"2024-01-25T15:00:57.285497+0000","last_clean":"2024-01-25T15:00:57.285497+0000","last_became_active":"2024-01-25T14:59:54.201155+0000","last_became_peered":"2024-01-25T14:59:54.201155+0000","last_unstale":"2024-01-25T15:00:57.285497+0000","last_undegraded":"2024-01-25T15:00:57.285497+0000","last_fullsized":"2024-01-25T15:00:57.285497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:29:15.444879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278742+0000","last_change":"2024-01-25T14:59:53.208457+0000","last_active":"2024-01-25T15:00:57.278742+0000","last_peered":"2024-01-25T15:00:57.278742+0000","last_clean":"2024-01-25T15:00:57.278742+0000","last_became_active":"2024-01-25T14:59:53.208166+0000","last_became_peered":"2024-01-25T14:59:53.208166+0000","last_unstale":"2024-01-25T15:00:57.278742+0000","last_undegraded":"2024-01-25T15:00:57.278742+0000","last_fullsized":"2024-01-25T15:00:57.278742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:29:22.580726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283819+0000","last_change":"2024-01-25T14:59:54.212126+0000","last_active":"2024-01-25T15:00:57.283819+0000","last_peered":"2024-01-25T15:00:57.283819+0000","last_clean":"2024-01-25T15:00:57.283819+0000","last_became_active":"2024-01-25T14:59:54.211519+0000","last_became_peered":"2024-01-25T14:59:54.211519+0000","last_unstale":"2024-01-25T15:00:57.283819+0000","last_undegraded":"2024-01-25T15:00:57.283819+0000","last_fullsized":"2024-01-25T15:00:57.283819+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:50:59.743852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":94,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:02.130321+0000","last_change":"2024-01-25T14:59:53.201803+0000","last_active":"2024-01-25T15:01:02.130321+0000","last_peered":"2024-01-25T15:01:02.130321+0000","last_clean":"2024-01-25T15:01:02.130321+0000","last_became_active":"2024-01-25T14:59:53.201464+0000","last_became_peered":"2024-01-25T14:59:53.201464+0000","last_unstale":"2024-01-25T15:01:02.130321+0000","last_undegraded":"2024-01-25T15:01:02.130321+0000","last_fullsized":"2024-01-25T15:01:02.130321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:36:03.922038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278264+0000","last_change":"2024-01-25T14:59:54.207126+0000","last_active":"2024-01-25T15:00:57.278264+0000","last_peered":"2024-01-25T15:00:57.278264+0000","last_clean":"2024-01-25T15:00:57.278264+0000","last_became_active":"2024-01-25T14:59:54.206826+0000","last_became_peered":"2024-01-25T14:59:54.206826+0000","last_unstale":"2024-01-25T15:00:57.278264+0000","last_undegraded":"2024-01-25T15:00:57.278264+0000","last_fullsized":"2024-01-25T15:00:57.278264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:45:07.217919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281277+0000","last_change":"2024-01-25T14:59:53.200335+0000","last_active":"2024-01-25T15:00:57.281277+0000","last_peered":"2024-01-25T15:00:57.281277+0000","last_clean":"2024-01-25T15:00:57.281277+0000","last_became_active":"2024-01-25T14:59:53.200028+0000","last_became_peered":"2024-01-25T14:59:53.200028+0000","last_unstale":"2024-01-25T15:00:57.281277+0000","last_undegraded":"2024-01-25T15:00:57.281277+0000","last_fullsized":"2024-01-25T15:00:57.281277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:23:26.178260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283783+0000","last_change":"2024-01-25T14:59:54.211048+0000","last_active":"2024-01-25T15:00:57.283783+0000","last_peered":"2024-01-25T15:00:57.283783+0000","last_clean":"2024-01-25T15:00:57.283783+0000","last_became_active":"2024-01-25T14:59:54.210724+0000","last_became_peered":"2024-01-25T14:59:54.210724+0000","last_unstale":"2024-01-25T15:00:57.283783+0000","last_undegraded":"2024-01-25T15:00:57.283783+0000","last_fullsized":"2024-01-25T15:00:57.283783+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:59:40.171707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279454+0000","last_change":"2024-01-25T14:59:53.202235+0000","last_active":"2024-01-25T15:00:57.279454+0000","last_peered":"2024-01-25T15:00:57.279454+0000","last_clean":"2024-01-25T15:00:57.279454+0000","last_became_active":"2024-01-25T14:59:53.201933+0000","last_became_peered":"2024-01-25T14:59:53.201933+0000","last_unstale":"2024-01-25T15:00:57.279454+0000","last_undegraded":"2024-01-25T15:00:57.279454+0000","last_fullsized":"2024-01-25T15:00:57.279454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:40:23.725903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282749+0000","last_change":"2024-01-25T14:59:54.205184+0000","last_active":"2024-01-25T15:00:57.282749+0000","last_peered":"2024-01-25T15:00:57.282749+0000","last_clean":"2024-01-25T15:00:57.282749+0000","last_became_active":"2024-01-25T14:59:54.204865+0000","last_became_peered":"2024-01-25T14:59:54.204865+0000","last_unstale":"2024-01-25T15:00:57.282749+0000","last_undegraded":"2024-01-25T15:00:57.282749+0000","last_fullsized":"2024-01-25T15:00:57.282749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:07:25.559601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283603+0000","last_change":"2024-01-25T14:59:53.205021+0000","last_active":"2024-01-25T15:00:57.283603+0000","last_peered":"2024-01-25T15:00:57.283603+0000","last_clean":"2024-01-25T15:00:57.283603+0000","last_became_active":"2024-01-25T14:59:53.203925+0000","last_became_peered":"2024-01-25T14:59:53.203925+0000","last_unstale":"2024-01-25T15:00:57.283603+0000","last_undegraded":"2024-01-25T15:00:57.283603+0000","last_fullsized":"2024-01-25T15:00:57.283603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:20:43.003659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280714+0000","last_change":"2024-01-25T14:59:54.207234+0000","last_active":"2024-01-25T15:00:57.280714+0000","last_peered":"2024-01-25T15:00:57.280714+0000","last_clean":"2024-01-25T15:00:57.280714+0000","last_became_active":"2024-01-25T14:59:54.206727+0000","last_became_peered":"2024-01-25T14:59:54.206727+0000","last_unstale":"2024-01-25T15:00:57.280714+0000","last_undegraded":"2024-01-25T15:00:57.280714+0000","last_fullsized":"2024-01-25T15:00:57.280714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:29:08.678821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:07.136469+0000","last_change":"2024-01-25T14:59:53.204198+0000","last_active":"2024-01-25T15:01:07.136469+0000","last_peered":"2024-01-25T15:01:07.136469+0000","last_clean":"2024-01-25T15:01:07.136469+0000","last_became_active":"2024-01-25T14:59:53.203844+0000","last_became_peered":"2024-01-25T14:59:53.203844+0000","last_unstale":"2024-01-25T15:01:07.136469+0000","last_undegraded":"2024-01-25T15:01:07.136469+0000","last_fullsized":"2024-01-25T15:01:07.136469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:30:23.735236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.285562+0000","last_change":"2024-01-25T14:59:54.203318+0000","last_active":"2024-01-25T15:00:57.285562+0000","last_peered":"2024-01-25T15:00:57.285562+0000","last_clean":"2024-01-25T15:00:57.285562+0000","last_became_active":"2024-01-25T14:59:54.202971+0000","last_became_peered":"2024-01-25T14:59:54.202971+0000","last_unstale":"2024-01-25T15:00:57.285562+0000","last_undegraded":"2024-01-25T15:00:57.285562+0000","last_fullsized":"2024-01-25T15:00:57.285562+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:57:59.454857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.300726+0000","last_change":"2024-01-25T15:00:57.300726+0000","last_active":"2024-01-25T15:00:57.300726+0000","last_peered":"2024-01-25T15:00:57.300726+0000","last_clean":"2024-01-25T15:00:57.300726+0000","last_became_active":"2024-01-25T15:00:57.288184+0000","last_became_peered":"2024-01-25T15:00:57.288184+0000","last_unstale":"2024-01-25T15:00:57.300726+0000","last_undegraded":"2024-01-25T15:00:57.300726+0000","last_fullsized":"2024-01-25T15:00:57.300726+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:17:00.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277850+0000","last_change":"2024-01-25T14:59:54.225131+0000","last_active":"2024-01-25T15:00:57.277850+0000","last_peered":"2024-01-25T15:00:57.277850+0000","last_clean":"2024-01-25T15:00:57.277850+0000","last_became_active":"2024-01-25T14:59:54.224786+0000","last_became_peered":"2024-01-25T14:59:54.224786+0000","last_unstale":"2024-01-25T15:00:57.277850+0000","last_undegraded":"2024-01-25T15:00:57.277850+0000","last_fullsized":"2024-01-25T15:00:57.277850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:25:07.426433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283977+0000","last_change":"2024-01-25T14:59:53.199834+0000","last_active":"2024-01-25T15:00:57.283977+0000","last_peered":"2024-01-25T15:00:57.283977+0000","last_clean":"2024-01-25T15:00:57.283977+0000","last_became_active":"2024-01-25T14:59:53.199545+0000","last_became_peered":"2024-01-25T14:59:53.199545+0000","last_unstale":"2024-01-25T15:00:57.283977+0000","last_undegraded":"2024-01-25T15:00:57.283977+0000","last_fullsized":"2024-01-25T15:00:57.283977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:38:08.973583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.285702+0000","last_change":"2024-01-25T14:59:54.214768+0000","last_active":"2024-01-25T15:00:57.285702+0000","last_peered":"2024-01-25T15:00:57.285702+0000","last_clean":"2024-01-25T15:00:57.285702+0000","last_became_active":"2024-01-25T14:59:54.214038+0000","last_became_peered":"2024-01-25T14:59:54.214038+0000","last_unstale":"2024-01-25T15:00:57.285702+0000","last_undegraded":"2024-01-25T15:00:57.285702+0000","last_fullsized":"2024-01-25T15:00:57.285702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:10:20.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'29","reported_seq":216,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:07.303797+0000","last_change":"2024-01-25T15:00:57.297320+0000","last_active":"2024-01-25T15:01:07.303797+0000","last_peered":"2024-01-25T15:01:07.303797+0000","last_clean":"2024-01-25T15:01:07.303797+0000","last_became_active":"2024-01-25T15:00:57.287208+0000","last_became_peered":"2024-01-25T15:00:57.287208+0000","last_unstale":"2024-01-25T15:01:07.303797+0000","last_undegraded":"2024-01-25T15:01:07.303797+0000","last_fullsized":"2024-01-25T15:01:07.303797+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:36:17.161523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58331,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":134,"num_read_kb":123,"num_write":31,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":58331,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278465+0000","last_change":"2024-01-25T14:59:54.217069+0000","last_active":"2024-01-25T15:00:57.278465+0000","last_peered":"2024-01-25T15:00:57.278465+0000","last_clean":"2024-01-25T15:00:57.278465+0000","last_became_active":"2024-01-25T14:59:54.216749+0000","last_became_peered":"2024-01-25T14:59:54.216749+0000","last_unstale":"2024-01-25T15:00:57.278465+0000","last_undegraded":"2024-01-25T15:00:57.278465+0000","last_fullsized":"2024-01-25T15:00:57.278465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:31:00.903462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282050+0000","last_change":"2024-01-25T14:59:53.198852+0000","last_active":"2024-01-25T15:00:57.282050+0000","last_peered":"2024-01-25T15:00:57.282050+0000","last_clean":"2024-01-25T15:00:57.282050+0000","last_became_active":"2024-01-25T14:59:53.198532+0000","last_became_peered":"2024-01-25T14:59:53.198532+0000","last_unstale":"2024-01-25T15:00:57.282050+0000","last_undegraded":"2024-01-25T15:00:57.282050+0000","last_fullsized":"2024-01-25T15:00:57.282050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:03:43.251730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279444+0000","last_change":"2024-01-25T14:59:54.209865+0000","last_active":"2024-01-25T15:00:57.279444+0000","last_peered":"2024-01-25T15:00:57.279444+0000","last_clean":"2024-01-25T15:00:57.279444+0000","last_became_active":"2024-01-25T14:59:54.209564+0000","last_became_peered":"2024-01-25T14:59:54.209564+0000","last_unstale":"2024-01-25T15:00:57.279444+0000","last_undegraded":"2024-01-25T15:00:57.279444+0000","last_fullsized":"2024-01-25T15:00:57.279444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:19:24.461651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283550+0000","last_change":"2024-01-25T14:59:53.207644+0000","last_active":"2024-01-25T15:00:57.283550+0000","last_peered":"2024-01-25T15:00:57.283550+0000","last_clean":"2024-01-25T15:00:57.283550+0000","last_became_active":"2024-01-25T14:59:53.207321+0000","last_became_peered":"2024-01-25T14:59:53.207321+0000","last_unstale":"2024-01-25T15:00:57.283550+0000","last_undegraded":"2024-01-25T15:00:57.283550+0000","last_fullsized":"2024-01-25T15:00:57.283550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:47:12.131711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283161+0000","last_change":"2024-01-25T14:59:54.220548+0000","last_active":"2024-01-25T15:00:57.283161+0000","last_peered":"2024-01-25T15:00:57.283161+0000","last_clean":"2024-01-25T15:00:57.283161+0000","last_became_active":"2024-01-25T14:59:54.219743+0000","last_became_peered":"2024-01-25T14:59:54.219743+0000","last_unstale":"2024-01-25T15:00:57.283161+0000","last_undegraded":"2024-01-25T15:00:57.283161+0000","last_fullsized":"2024-01-25T15:00:57.283161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:46:12.085591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":95,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:05.134008+0000","last_change":"2024-01-25T14:59:53.201233+0000","last_active":"2024-01-25T15:01:05.134008+0000","last_peered":"2024-01-25T15:01:05.134008+0000","last_clean":"2024-01-25T15:01:05.134008+0000","last_became_active":"2024-01-25T14:59:53.200907+0000","last_became_peered":"2024-01-25T14:59:53.200907+0000","last_unstale":"2024-01-25T15:01:05.134008+0000","last_undegraded":"2024-01-25T15:01:05.134008+0000","last_fullsized":"2024-01-25T15:01:05.134008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:30:59.640179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282292+0000","last_change":"2024-01-25T14:59:54.212617+0000","last_active":"2024-01-25T15:00:57.282292+0000","last_peered":"2024-01-25T15:00:57.282292+0000","last_clean":"2024-01-25T15:00:57.282292+0000","last_became_active":"2024-01-25T14:59:54.212328+0000","last_became_peered":"2024-01-25T14:59:54.212328+0000","last_unstale":"2024-01-25T15:00:57.282292+0000","last_undegraded":"2024-01-25T15:00:57.282292+0000","last_fullsized":"2024-01-25T15:00:57.282292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:21:16.958894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278147+0000","last_change":"2024-01-25T14:59:53.202685+0000","last_active":"2024-01-25T15:00:57.278147+0000","last_peered":"2024-01-25T15:00:57.278147+0000","last_clean":"2024-01-25T15:00:57.278147+0000","last_became_active":"2024-01-25T14:59:53.201529+0000","last_became_peered":"2024-01-25T14:59:53.201529+0000","last_unstale":"2024-01-25T15:00:57.278147+0000","last_undegraded":"2024-01-25T15:00:57.278147+0000","last_fullsized":"2024-01-25T15:00:57.278147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:43:29.823959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283935+0000","last_change":"2024-01-25T14:59:54.208724+0000","last_active":"2024-01-25T15:00:57.283935+0000","last_peered":"2024-01-25T15:00:57.283935+0000","last_clean":"2024-01-25T15:00:57.283935+0000","last_became_active":"2024-01-25T14:59:54.208392+0000","last_became_peered":"2024-01-25T14:59:54.208392+0000","last_unstale":"2024-01-25T15:00:57.283935+0000","last_undegraded":"2024-01-25T15:00:57.283935+0000","last_fullsized":"2024-01-25T15:00:57.283935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:37.285702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.291362+0000","last_change":"2024-01-25T15:00:57.290806+0000","last_active":"2024-01-25T15:00:57.291362+0000","last_peered":"2024-01-25T15:00:57.291362+0000","last_clean":"2024-01-25T15:00:57.291362+0000","last_became_active":"2024-01-25T15:00:57.285194+0000","last_became_peered":"2024-01-25T15:00:57.285194+0000","last_unstale":"2024-01-25T15:00:57.291362+0000","last_undegraded":"2024-01-25T15:00:57.291362+0000","last_fullsized":"2024-01-25T15:00:57.291362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:49:16.627616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280498+0000","last_change":"2024-01-25T14:59:54.216918+0000","last_active":"2024-01-25T15:00:57.280498+0000","last_peered":"2024-01-25T15:00:57.280498+0000","last_clean":"2024-01-25T15:00:57.280498+0000","last_became_active":"2024-01-25T14:59:54.216283+0000","last_became_peered":"2024-01-25T14:59:54.216283+0000","last_unstale":"2024-01-25T15:00:57.280498+0000","last_undegraded":"2024-01-25T15:00:57.280498+0000","last_fullsized":"2024-01-25T15:00:57.280498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:15:11.192764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280876+0000","last_change":"2024-01-25T14:59:53.207266+0000","last_active":"2024-01-25T15:00:57.280876+0000","last_peered":"2024-01-25T15:00:57.280876+0000","last_clean":"2024-01-25T15:00:57.280876+0000","last_became_active":"2024-01-25T14:59:53.206820+0000","last_became_peered":"2024-01-25T14:59:53.206820+0000","last_unstale":"2024-01-25T15:00:57.280876+0000","last_undegraded":"2024-01-25T15:00:57.280876+0000","last_fullsized":"2024-01-25T15:00:57.280876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:29:02.371577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281657+0000","last_change":"2024-01-25T14:59:54.210434+0000","last_active":"2024-01-25T15:00:57.281657+0000","last_peered":"2024-01-25T15:00:57.281657+0000","last_clean":"2024-01-25T15:00:57.281657+0000","last_became_active":"2024-01-25T14:59:54.210100+0000","last_became_peered":"2024-01-25T14:59:54.210100+0000","last_unstale":"2024-01-25T15:00:57.281657+0000","last_undegraded":"2024-01-25T15:00:57.281657+0000","last_fullsized":"2024-01-25T15:00:57.281657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:48:21.463712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":90,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:03.133124+0000","last_change":"2024-01-25T14:59:53.202938+0000","last_active":"2024-01-25T15:01:03.133124+0000","last_peered":"2024-01-25T15:01:03.133124+0000","last_clean":"2024-01-25T15:01:03.133124+0000","last_became_active":"2024-01-25T14:59:53.202638+0000","last_became_peered":"2024-01-25T14:59:53.202638+0000","last_unstale":"2024-01-25T15:01:03.133124+0000","last_undegraded":"2024-01-25T15:01:03.133124+0000","last_fullsized":"2024-01-25T15:01:03.133124+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.371375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281405+0000","last_change":"2024-01-25T14:59:54.219778+0000","last_active":"2024-01-25T15:00:57.281405+0000","last_peered":"2024-01-25T15:00:57.281405+0000","last_clean":"2024-01-25T15:00:57.281405+0000","last_became_active":"2024-01-25T14:59:54.219385+0000","last_became_peered":"2024-01-25T14:59:54.219385+0000","last_unstale":"2024-01-25T15:00:57.281405+0000","last_undegraded":"2024-01-25T15:00:57.281405+0000","last_fullsized":"2024-01-25T15:00:57.281405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:49:27.929024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284236+0000","last_change":"2024-01-25T14:59:54.209306+0000","last_active":"2024-01-25T15:00:57.284236+0000","last_peered":"2024-01-25T15:00:57.284236+0000","last_clean":"2024-01-25T15:00:57.284236+0000","last_became_active":"2024-01-25T14:59:54.208979+0000","last_became_peered":"2024-01-25T14:59:54.208979+0000","last_unstale":"2024-01-25T15:00:57.284236+0000","last_undegraded":"2024-01-25T15:00:57.284236+0000","last_fullsized":"2024-01-25T15:00:57.284236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:23:46.763358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":91,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:02.129212+0000","last_change":"2024-01-25T14:59:53.200590+0000","last_active":"2024-01-25T15:01:02.129212+0000","last_peered":"2024-01-25T15:01:02.129212+0000","last_clean":"2024-01-25T15:01:02.129212+0000","last_became_active":"2024-01-25T14:59:53.200292+0000","last_became_peered":"2024-01-25T14:59:53.200292+0000","last_unstale":"2024-01-25T15:01:02.129212+0000","last_undegraded":"2024-01-25T15:01:02.129212+0000","last_fullsized":"2024-01-25T15:01:02.129212+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:02:05.135314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":67,"num_read_kb":67,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283892+0000","last_change":"2024-01-25T14:59:54.217765+0000","last_active":"2024-01-25T15:00:57.283892+0000","last_peered":"2024-01-25T15:00:57.283892+0000","last_clean":"2024-01-25T15:00:57.283892+0000","last_became_active":"2024-01-25T14:59:54.217433+0000","last_became_peered":"2024-01-25T14:59:54.217433+0000","last_unstale":"2024-01-25T15:00:57.283892+0000","last_undegraded":"2024-01-25T15:00:57.283892+0000","last_fullsized":"2024-01-25T15:00:57.283892+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:45:25.520091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279378+0000","last_change":"2024-01-25T14:59:53.197543+0000","last_active":"2024-01-25T15:00:57.279378+0000","last_peered":"2024-01-25T15:00:57.279378+0000","last_clean":"2024-01-25T15:00:57.279378+0000","last_became_active":"2024-01-25T14:59:53.197213+0000","last_became_peered":"2024-01-25T14:59:53.197213+0000","last_unstale":"2024-01-25T15:00:57.279378+0000","last_undegraded":"2024-01-25T15:00:57.279378+0000","last_fullsized":"2024-01-25T15:00:57.279378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:19:39.477948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":343,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282327+0000","last_change":"2024-01-25T14:58:41.034413+0000","last_active":"2024-01-25T15:00:57.282327+0000","last_peered":"2024-01-25T15:00:57.282327+0000","last_clean":"2024-01-25T15:00:57.282327+0000","last_became_active":"2024-01-25T14:58:41.033881+0000","last_became_peered":"2024-01-25T14:58:41.033881+0000","last_unstale":"2024-01-25T15:00:57.282327+0000","last_undegraded":"2024-01-25T15:00:57.282327+0000","last_fullsized":"2024-01-25T15:00:57.282327+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:55:22.974068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:55:22.974068+0000","last_clean_scrub_stamp":"2024-01-25T14:55:22.974068+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:05:30.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279055+0000","last_change":"2024-01-25T14:59:54.214713+0000","last_active":"2024-01-25T15:00:57.279055+0000","last_peered":"2024-01-25T15:00:57.279055+0000","last_clean":"2024-01-25T15:00:57.279055+0000","last_became_active":"2024-01-25T14:59:54.214348+0000","last_became_peered":"2024-01-25T14:59:54.214348+0000","last_unstale":"2024-01-25T15:00:57.279055+0000","last_undegraded":"2024-01-25T15:00:57.279055+0000","last_fullsized":"2024-01-25T15:00:57.279055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:11:46.134755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282443+0000","last_change":"2024-01-25T14:59:53.202970+0000","last_active":"2024-01-25T15:00:57.282443+0000","last_peered":"2024-01-25T15:00:57.282443+0000","last_clean":"2024-01-25T15:00:57.282443+0000","last_became_active":"2024-01-25T14:59:53.202680+0000","last_became_peered":"2024-01-25T14:59:53.202680+0000","last_unstale":"2024-01-25T15:00:57.282443+0000","last_undegraded":"2024-01-25T15:00:57.282443+0000","last_fullsized":"2024-01-25T15:00:57.282443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:28:12.628390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278506+0000","last_change":"2024-01-25T14:59:53.210040+0000","last_active":"2024-01-25T15:00:57.278506+0000","last_peered":"2024-01-25T15:00:57.278506+0000","last_clean":"2024-01-25T15:00:57.278506+0000","last_became_active":"2024-01-25T14:59:53.209636+0000","last_became_peered":"2024-01-25T14:59:53.209636+0000","last_unstale":"2024-01-25T15:00:57.278506+0000","last_undegraded":"2024-01-25T15:00:57.278506+0000","last_fullsized":"2024-01-25T15:00:57.278506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:22:45.268969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279740+0000","last_change":"2024-01-25T14:59:54.203875+0000","last_active":"2024-01-25T15:00:57.279740+0000","last_peered":"2024-01-25T15:00:57.279740+0000","last_clean":"2024-01-25T15:00:57.279740+0000","last_became_active":"2024-01-25T14:59:54.203573+0000","last_became_peered":"2024-01-25T14:59:54.203573+0000","last_unstale":"2024-01-25T15:00:57.279740+0000","last_undegraded":"2024-01-25T15:00:57.279740+0000","last_fullsized":"2024-01-25T15:00:57.279740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:16:33.124186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'10","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.292346+0000","last_change":"2024-01-25T15:00:57.292346+0000","last_active":"2024-01-25T15:00:57.292346+0000","last_peered":"2024-01-25T15:00:57.292346+0000","last_clean":"2024-01-25T15:00:57.292346+0000","last_became_active":"2024-01-25T15:00:57.284921+0000","last_became_peered":"2024-01-25T15:00:57.284921+0000","last_unstale":"2024-01-25T15:00:57.292346+0000","last_undegraded":"2024-01-25T15:00:57.292346+0000","last_fullsized":"2024-01-25T15:00:57.292346+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:35:09.229129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284194+0000","last_change":"2024-01-25T14:59:54.212444+0000","last_active":"2024-01-25T15:00:57.284194+0000","last_peered":"2024-01-25T15:00:57.284194+0000","last_clean":"2024-01-25T15:00:57.284194+0000","last_became_active":"2024-01-25T14:59:54.212090+0000","last_became_peered":"2024-01-25T14:59:54.212090+0000","last_unstale":"2024-01-25T15:00:57.284194+0000","last_undegraded":"2024-01-25T15:00:57.284194+0000","last_fullsized":"2024-01-25T15:00:57.284194+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:27:26.416373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279589+0000","last_change":"2024-01-25T14:59:53.199984+0000","last_active":"2024-01-25T15:00:57.279589+0000","last_peered":"2024-01-25T15:00:57.279589+0000","last_clean":"2024-01-25T15:00:57.279589+0000","last_became_active":"2024-01-25T14:59:53.199674+0000","last_became_peered":"2024-01-25T14:59:53.199674+0000","last_unstale":"2024-01-25T15:00:57.279589+0000","last_undegraded":"2024-01-25T15:00:57.279589+0000","last_fullsized":"2024-01-25T15:00:57.279589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:22:01.521516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277901+0000","last_change":"2024-01-25T14:59:54.224285+0000","last_active":"2024-01-25T15:00:57.277901+0000","last_peered":"2024-01-25T15:00:57.277901+0000","last_clean":"2024-01-25T15:00:57.277901+0000","last_became_active":"2024-01-25T14:59:54.223904+0000","last_became_peered":"2024-01-25T14:59:54.223904+0000","last_unstale":"2024-01-25T15:00:57.277901+0000","last_undegraded":"2024-01-25T15:00:57.277901+0000","last_fullsized":"2024-01-25T15:00:57.277901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:49:24.717733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284549+0000","last_change":"2024-01-25T14:59:53.203501+0000","last_active":"2024-01-25T15:00:57.284549+0000","last_peered":"2024-01-25T15:00:57.284549+0000","last_clean":"2024-01-25T15:00:57.284549+0000","last_became_active":"2024-01-25T14:59:53.203215+0000","last_became_peered":"2024-01-25T14:59:53.203215+0000","last_unstale":"2024-01-25T15:00:57.284549+0000","last_undegraded":"2024-01-25T15:00:57.284549+0000","last_fullsized":"2024-01-25T15:00:57.284549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:18:25.174639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278144+0000","last_change":"2024-01-25T14:59:54.219575+0000","last_active":"2024-01-25T15:00:57.278144+0000","last_peered":"2024-01-25T15:00:57.278144+0000","last_clean":"2024-01-25T15:00:57.278144+0000","last_became_active":"2024-01-25T14:59:54.219170+0000","last_became_peered":"2024-01-25T14:59:54.219170+0000","last_unstale":"2024-01-25T15:00:57.278144+0000","last_undegraded":"2024-01-25T15:00:57.278144+0000","last_fullsized":"2024-01-25T15:00:57.278144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:41.940927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283084+0000","last_change":"2024-01-25T14:59:53.203864+0000","last_active":"2024-01-25T15:00:57.283084+0000","last_peered":"2024-01-25T15:00:57.283084+0000","last_clean":"2024-01-25T15:00:57.283084+0000","last_became_active":"2024-01-25T14:59:53.203564+0000","last_became_peered":"2024-01-25T14:59:53.203564+0000","last_unstale":"2024-01-25T15:00:57.283084+0000","last_undegraded":"2024-01-25T15:00:57.283084+0000","last_fullsized":"2024-01-25T15:00:57.283084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:03:21.776910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280167+0000","last_change":"2024-01-25T14:59:54.217014+0000","last_active":"2024-01-25T15:00:57.280167+0000","last_peered":"2024-01-25T15:00:57.280167+0000","last_clean":"2024-01-25T15:00:57.280167+0000","last_became_active":"2024-01-25T14:59:54.216673+0000","last_became_peered":"2024-01-25T14:59:54.216673+0000","last_unstale":"2024-01-25T15:00:57.280167+0000","last_undegraded":"2024-01-25T15:00:57.280167+0000","last_fullsized":"2024-01-25T15:00:57.280167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:46:31.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281990+0000","last_change":"2024-01-25T14:59:53.207297+0000","last_active":"2024-01-25T15:00:57.281990+0000","last_peered":"2024-01-25T15:00:57.281990+0000","last_clean":"2024-01-25T15:00:57.281990+0000","last_became_active":"2024-01-25T14:59:53.206968+0000","last_became_peered":"2024-01-25T14:59:53.206968+0000","last_unstale":"2024-01-25T15:00:57.281990+0000","last_undegraded":"2024-01-25T15:00:57.281990+0000","last_fullsized":"2024-01-25T15:00:57.281990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:01.679360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284156+0000","last_change":"2024-01-25T14:59:54.218890+0000","last_active":"2024-01-25T15:00:57.284156+0000","last_peered":"2024-01-25T15:00:57.284156+0000","last_clean":"2024-01-25T15:00:57.284156+0000","last_became_active":"2024-01-25T14:59:54.218581+0000","last_became_peered":"2024-01-25T14:59:54.218581+0000","last_unstale":"2024-01-25T15:00:57.284156+0000","last_undegraded":"2024-01-25T15:00:57.284156+0000","last_fullsized":"2024-01-25T15:00:57.284156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:13:07.383270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278450+0000","last_change":"2024-01-25T14:59:53.208219+0000","last_active":"2024-01-25T15:00:57.278450+0000","last_peered":"2024-01-25T15:00:57.278450+0000","last_clean":"2024-01-25T15:00:57.278450+0000","last_became_active":"2024-01-25T14:59:53.207878+0000","last_became_peered":"2024-01-25T14:59:53.207878+0000","last_unstale":"2024-01-25T15:00:57.278450+0000","last_undegraded":"2024-01-25T15:00:57.278450+0000","last_fullsized":"2024-01-25T15:00:57.278450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:03.410383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282926+0000","last_change":"2024-01-25T14:59:54.208996+0000","last_active":"2024-01-25T15:00:57.282926+0000","last_peered":"2024-01-25T15:00:57.282926+0000","last_clean":"2024-01-25T15:00:57.282926+0000","last_became_active":"2024-01-25T14:59:54.208658+0000","last_became_peered":"2024-01-25T14:59:54.208658+0000","last_unstale":"2024-01-25T15:00:57.282926+0000","last_undegraded":"2024-01-25T15:00:57.282926+0000","last_fullsized":"2024-01-25T15:00:57.282926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:39:57.752381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":93,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:05.136066+0000","last_change":"2024-01-25T14:59:53.207106+0000","last_active":"2024-01-25T15:01:05.136066+0000","last_peered":"2024-01-25T15:01:05.136066+0000","last_clean":"2024-01-25T15:01:05.136066+0000","last_became_active":"2024-01-25T14:59:53.206688+0000","last_became_peered":"2024-01-25T14:59:53.206688+0000","last_unstale":"2024-01-25T15:01:05.136066+0000","last_undegraded":"2024-01-25T15:01:05.136066+0000","last_fullsized":"2024-01-25T15:01:05.136066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:30:03.019791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":69,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283237+0000","last_change":"2024-01-25T14:59:54.208994+0000","last_active":"2024-01-25T15:00:57.283237+0000","last_peered":"2024-01-25T15:00:57.283237+0000","last_clean":"2024-01-25T15:00:57.283237+0000","last_became_active":"2024-01-25T14:59:54.208638+0000","last_became_peered":"2024-01-25T14:59:54.208638+0000","last_unstale":"2024-01-25T15:00:57.283237+0000","last_undegraded":"2024-01-25T15:00:57.283237+0000","last_fullsized":"2024-01-25T15:00:57.283237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:56.001501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283687+0000","last_change":"2024-01-25T14:59:53.207659+0000","last_active":"2024-01-25T15:00:57.283687+0000","last_peered":"2024-01-25T15:00:57.283687+0000","last_clean":"2024-01-25T15:00:57.283687+0000","last_became_active":"2024-01-25T14:59:53.207373+0000","last_became_peered":"2024-01-25T14:59:53.207373+0000","last_unstale":"2024-01-25T15:00:57.283687+0000","last_undegraded":"2024-01-25T15:00:57.283687+0000","last_fullsized":"2024-01-25T15:00:57.283687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:02:18.884192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282991+0000","last_change":"2024-01-25T14:59:54.210415+0000","last_active":"2024-01-25T15:00:57.282991+0000","last_peered":"2024-01-25T15:00:57.282991+0000","last_clean":"2024-01-25T15:00:57.282991+0000","last_became_active":"2024-01-25T14:59:54.210097+0000","last_became_peered":"2024-01-25T14:59:54.210097+0000","last_unstale":"2024-01-25T15:00:57.282991+0000","last_undegraded":"2024-01-25T15:00:57.282991+0000","last_fullsized":"2024-01-25T15:00:57.282991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:43:18.764375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279899+0000","last_change":"2024-01-25T14:59:53.203526+0000","last_active":"2024-01-25T15:00:57.279899+0000","last_peered":"2024-01-25T15:00:57.279899+0000","last_clean":"2024-01-25T15:00:57.279899+0000","last_became_active":"2024-01-25T14:59:53.203223+0000","last_became_peered":"2024-01-25T14:59:53.203223+0000","last_unstale":"2024-01-25T15:00:57.279899+0000","last_undegraded":"2024-01-25T15:00:57.279899+0000","last_fullsized":"2024-01-25T15:00:57.279899+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:35:06.014547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283471+0000","last_change":"2024-01-25T14:59:54.219053+0000","last_active":"2024-01-25T15:00:57.283471+0000","last_peered":"2024-01-25T15:00:57.283471+0000","last_clean":"2024-01-25T15:00:57.283471+0000","last_became_active":"2024-01-25T14:59:54.218733+0000","last_became_peered":"2024-01-25T14:59:54.218733+0000","last_unstale":"2024-01-25T15:00:57.283471+0000","last_undegraded":"2024-01-25T15:00:57.283471+0000","last_fullsized":"2024-01-25T15:00:57.283471+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:07:19.083352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280255+0000","last_change":"2024-01-25T14:59:54.210644+0000","last_active":"2024-01-25T15:00:57.280255+0000","last_peered":"2024-01-25T15:00:57.280255+0000","last_clean":"2024-01-25T15:00:57.280255+0000","last_became_active":"2024-01-25T14:59:54.210333+0000","last_became_peered":"2024-01-25T14:59:54.210333+0000","last_unstale":"2024-01-25T15:00:57.280255+0000","last_undegraded":"2024-01-25T15:00:57.280255+0000","last_fullsized":"2024-01-25T15:00:57.280255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:25:06.201952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.286523+0000","last_change":"2024-01-25T15:00:57.286523+0000","last_active":"2024-01-25T15:00:57.286523+0000","last_peered":"2024-01-25T15:00:57.286523+0000","last_clean":"2024-01-25T15:00:57.286523+0000","last_became_active":"2024-01-25T15:00:57.286115+0000","last_became_peered":"2024-01-25T15:00:57.286115+0000","last_unstale":"2024-01-25T15:00:57.286523+0000","last_undegraded":"2024-01-25T15:00:57.286523+0000","last_fullsized":"2024-01-25T15:00:57.286523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:53:47.571571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281874+0000","last_change":"2024-01-25T14:59:54.218260+0000","last_active":"2024-01-25T15:00:57.281874+0000","last_peered":"2024-01-25T15:00:57.281874+0000","last_clean":"2024-01-25T15:00:57.281874+0000","last_became_active":"2024-01-25T14:59:54.217381+0000","last_became_peered":"2024-01-25T14:59:54.217381+0000","last_unstale":"2024-01-25T15:00:57.281874+0000","last_undegraded":"2024-01-25T15:00:57.281874+0000","last_fullsized":"2024-01-25T15:00:57.281874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:36:09.631749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277531+0000","last_change":"2024-01-25T14:59:54.224518+0000","last_active":"2024-01-25T15:00:57.277531+0000","last_peered":"2024-01-25T15:00:57.277531+0000","last_clean":"2024-01-25T15:00:57.277531+0000","last_became_active":"2024-01-25T14:59:54.224210+0000","last_became_peered":"2024-01-25T14:59:54.224210+0000","last_unstale":"2024-01-25T15:00:57.277531+0000","last_undegraded":"2024-01-25T15:00:57.277531+0000","last_fullsized":"2024-01-25T15:00:57.277531+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:33:56.670077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282096+0000","last_change":"2024-01-25T15:00:57.282096+0000","last_active":"2024-01-25T15:00:57.282096+0000","last_peered":"2024-01-25T15:00:57.282096+0000","last_clean":"2024-01-25T15:00:57.282096+0000","last_became_active":"2024-01-25T15:00:57.281725+0000","last_became_peered":"2024-01-25T15:00:57.281725+0000","last_unstale":"2024-01-25T15:00:57.282096+0000","last_undegraded":"2024-01-25T15:00:57.282096+0000","last_fullsized":"2024-01-25T15:00:57.282096+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:53:03.519667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280680+0000","last_change":"2024-01-25T14:59:54.217690+0000","last_active":"2024-01-25T15:00:57.280680+0000","last_peered":"2024-01-25T15:00:57.280680+0000","last_clean":"2024-01-25T15:00:57.280680+0000","last_became_active":"2024-01-25T14:59:54.217361+0000","last_became_peered":"2024-01-25T14:59:54.217361+0000","last_unstale":"2024-01-25T15:00:57.280680+0000","last_undegraded":"2024-01-25T15:00:57.280680+0000","last_fullsized":"2024-01-25T15:00:57.280680+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:30:15.893502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282590+0000","last_change":"2024-01-25T14:59:54.205201+0000","last_active":"2024-01-25T15:00:57.282590+0000","last_peered":"2024-01-25T15:00:57.282590+0000","last_clean":"2024-01-25T15:00:57.282590+0000","last_became_active":"2024-01-25T14:59:54.204893+0000","last_became_peered":"2024-01-25T14:59:54.204893+0000","last_unstale":"2024-01-25T15:00:57.282590+0000","last_undegraded":"2024-01-25T15:00:57.282590+0000","last_fullsized":"2024-01-25T15:00:57.282590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:35:43.147029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284098+0000","last_change":"2024-01-25T14:59:54.210681+0000","last_active":"2024-01-25T15:00:57.284098+0000","last_peered":"2024-01-25T15:00:57.284098+0000","last_clean":"2024-01-25T15:00:57.284098+0000","last_became_active":"2024-01-25T14:59:54.210347+0000","last_became_peered":"2024-01-25T14:59:54.210347+0000","last_unstale":"2024-01-25T15:00:57.284098+0000","last_undegraded":"2024-01-25T15:00:57.284098+0000","last_fullsized":"2024-01-25T15:00:57.284098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:44:12.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283660+0000","last_change":"2024-01-25T14:59:54.210792+0000","last_active":"2024-01-25T15:00:57.283660+0000","last_peered":"2024-01-25T15:00:57.283660+0000","last_clean":"2024-01-25T15:00:57.283660+0000","last_became_active":"2024-01-25T14:59:54.210416+0000","last_became_peered":"2024-01-25T14:59:54.210416+0000","last_unstale":"2024-01-25T15:00:57.283660+0000","last_undegraded":"2024-01-25T15:00:57.283660+0000","last_fullsized":"2024-01-25T15:00:57.283660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:45.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282918+0000","last_change":"2024-01-25T14:59:54.204547+0000","last_active":"2024-01-25T15:00:57.282918+0000","last_peered":"2024-01-25T15:00:57.282918+0000","last_clean":"2024-01-25T15:00:57.282918+0000","last_became_active":"2024-01-25T14:59:54.204215+0000","last_became_peered":"2024-01-25T14:59:54.204215+0000","last_unstale":"2024-01-25T15:00:57.282918+0000","last_undegraded":"2024-01-25T15:00:57.282918+0000","last_fullsized":"2024-01-25T15:00:57.282918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:34:04.413137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284871+0000","last_change":"2024-01-25T14:59:54.211006+0000","last_active":"2024-01-25T15:00:57.284871+0000","last_peered":"2024-01-25T15:00:57.284871+0000","last_clean":"2024-01-25T15:00:57.284871+0000","last_became_active":"2024-01-25T14:59:54.210568+0000","last_became_peered":"2024-01-25T14:59:54.210568+0000","last_unstale":"2024-01-25T15:00:57.284871+0000","last_undegraded":"2024-01-25T15:00:57.284871+0000","last_fullsized":"2024-01-25T15:00:57.284871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:12:23.888827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279656+0000","last_change":"2024-01-25T14:59:54.220485+0000","last_active":"2024-01-25T15:00:57.279656+0000","last_peered":"2024-01-25T15:00:57.279656+0000","last_clean":"2024-01-25T15:00:57.279656+0000","last_became_active":"2024-01-25T14:59:54.219547+0000","last_became_peered":"2024-01-25T14:59:54.219547+0000","last_unstale":"2024-01-25T15:00:57.279656+0000","last_undegraded":"2024-01-25T15:00:57.279656+0000","last_fullsized":"2024-01-25T15:00:57.279656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:43:49.858263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280232+0000","last_change":"2024-01-25T14:59:54.217605+0000","last_active":"2024-01-25T15:00:57.280232+0000","last_peered":"2024-01-25T15:00:57.280232+0000","last_clean":"2024-01-25T15:00:57.280232+0000","last_became_active":"2024-01-25T14:59:54.217295+0000","last_became_peered":"2024-01-25T14:59:54.217295+0000","last_unstale":"2024-01-25T15:00:57.280232+0000","last_undegraded":"2024-01-25T15:00:57.280232+0000","last_fullsized":"2024-01-25T15:00:57.280232+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:27:59.846434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65143,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":704,"num_read_kb":426,"num_write":233,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58353,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":195429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383708,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":456311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 25 15:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.745}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.79100000000000004}]},{"osd":5,"last update":"Thu Jan 25 15:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.88700000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.80900000000000005}]},{"osd":7,"last update":"Thu Jan 25 15:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.876}]},{"osd":8,"last update":"Thu Jan 25 15:00:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.82699999999999996}]},{"osd":9,"last update":"Thu Jan 25 15:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.536,"5min":1.536,"15min":1.536},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":1.0109999999999999}]},{"osd":10,"last update":"Thu Jan 25 15:00:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":0.89900000000000002}]}]},{"osd":10,"up_from":72,"seq":309237645346,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1650688,"data_stored":1105649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.33600000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69299999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78900000000000003,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.42499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.873}]},{"osd":3,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.77100000000000002,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.63600000000000001,"15min":0.64700000000000002},"min":{"1min":0.44,"5min":0.435,"15min":0.435},"max":{"1min":0.72399999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78400000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58999999999999997,"15min":0.59399999999999997},"min":{"1min":0.41699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72999999999999998,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66100000000000003},"min":{"1min":0.442,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84099999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.87,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.748,"15min":0.76200000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89800000000000002,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.53300000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.84299999999999997,"5min":1.347,"15min":1.347},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.45500000000000002}]},{"osd":8,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":1.282,"15min":1.282},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.50600000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.93300000000000005,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83499999999999996}]},{"osd":9,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94699999999999995,"5min":1.262,"15min":1.262},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.81799999999999995,"15min":0.83099999999999996},"min":{"1min":0.57199999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.878,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.89100000000000001}]},{"osd":11,"last update":"Thu Jan 25 15:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.85799999999999998}]}]},{"osd":9,"up_from":67,"seq":287762808870,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":456219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.44800000000000001,"15min":0.45500000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57799999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.46200000000000002,"15min":0.47199999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53000000000000003,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":0.79600000000000004,"5min":0.875,"15min":0.875},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73899999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.622,"15min":0.63400000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76200000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.74099999999999999,"5min":1.012,"15min":1.012},"last":0.625}]},{"osd":3,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61099999999999999,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.33100000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":0.876,"15min":0.876},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.314,"15min":0.314},"max":{"1min":0.78000000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.4419999999999999,"5min":0.82599999999999996,"15min":0.72299999999999998},"min":{"1min":0.39000000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":17.138999999999999,"5min":17.138999999999999,"15min":17.138999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":0.84899999999999998,"15min":0.749},"min":{"1min":0.46300000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":17.117000000000001,"5min":17.117000000000001,"15min":17.117000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.73299999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80900000000000005,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.66100000000000003,"15min":0.67900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77100000000000002,"5min":1.036,"15min":1.036},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.59999999999999998,"15min":0.61599999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69399999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.73899999999999999,"15min":0.75600000000000001},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85599999999999998,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.79100000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89100000000000001,"5min":1.125,"15min":1.125},"last":0.52800000000000002}]},{"osd":8,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.496,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.83299999999999996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.745,"15min":0.76000000000000001},"min":{"1min":0.55900000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.77400000000000002,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.54000000000000004}]},{"osd":10,"last update":"Thu Jan 25 15:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.92600000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.503},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.91100000000000003,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56499999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":8,"up_from":59,"seq":253403070507,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":456575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.438,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69499999999999995,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68300000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.60299999999999998,"15min":0.58699999999999997},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94299999999999995,"5min":1.008,"15min":1.008},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59699999999999998,"15min":0.58599999999999997},"min":{"1min":0.46300000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.39700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.65500000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.47799999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78500000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.49099999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91800000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.63600000000000001,"15min":0.627},"min":{"1min":0.59099999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.45700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.42799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80600000000000005,"5min":1.028,"15min":1.028},"last":0.441}]},{"osd":6,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.54600000000000004,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.751},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.51600000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86299999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.61199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88800000000000001,"5min":1.04,"15min":1.04},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.70899999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.995,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.88900000000000001}]},{"osd":9,"last update":"Thu Jan 25 15:00:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64400000000000002,"15min":0.63300000000000001},"min":{"1min":0.50900000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.52400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.82599999999999996}]},{"osd":10,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.69599999999999995,"15min":0.67700000000000005},"min":{"1min":0.61499999999999999,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.875}]},{"osd":11,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.77600000000000002}]}]},{"osd":7,"up_from":52,"seq":223338299440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32712,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712440,"statfs":{"total":95995035648,"available":95961538560,"internally_reserved":0,"allocated":1568768,"data_stored":1049114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.53200000000000003,"15min":0.51900000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 25 15:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41199999999999998,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45400000000000001,"15min":0.45600000000000002},"min":{"1min":0.27600000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.68400000000000005,"15min":0.64100000000000001},"min":{"1min":0.38100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80200000000000005,"5min":6.508,"15min":6.508},"last":0.629},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56899999999999995,"15min":0.55800000000000005},"min":{"1min":0.39600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.80100000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.748}]},{"osd":3,"last update":"Thu Jan 25 15:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57399999999999995,"15min":0.56699999999999995},"min":{"1min":0.39600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.435},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.502,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.79800000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70099999999999996,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77900000000000003,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 25 15:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.69899999999999995}]},{"osd":6,"last update":"Thu Jan 25 15:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83899999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89600000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.46200000000000002}]},{"osd":8,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69199999999999995,"15min":0.68400000000000005},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.79500000000000004,"15min":0.73299999999999998},"min":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.97099999999999997,"5min":6.5469999999999997,"15min":6.5469999999999997},"last":0.72799999999999998}]},{"osd":9,"last update":"Thu Jan 25 15:00:20 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93899999999999995,"5min":1.022,"15min":1.022},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.65900000000000003}]},{"osd":10,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0669999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.61599999999999999}]},{"osd":11,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.71299999999999997}]}]},{"osd":6,"up_from":46,"seq":197568495669,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40440,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704712,"statfs":{"total":95995035648,"available":95953625088,"internally_reserved":0,"allocated":958464,"data_stored":455936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:03 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39100000000000001,"15min":0.374},"min":{"1min":0.28799999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.39000000000000001,"15min":0.372},"min":{"1min":0.28899999999999998,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.312}]},{"osd":1,"last update":"Thu Jan 25 15:00:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.56499999999999995,"15min":0.55300000000000005},"min":{"1min":0.374,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69299999999999995,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.443},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55500000000000005,"15min":0.54100000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.80800000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:00:03 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.67700000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84199999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 25 15:00:03 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.434,"15min":0.42399999999999999},"min":{"1min":0.318,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57099999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.47499999999999998,"15min":0.46500000000000002},"min":{"1min":0.35399999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:00:03 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.58299999999999996,"15min":0.57899999999999996},"min":{"1min":0.372,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.78200000000000003,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.58499999999999996},"min":{"1min":0.42099999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76300000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 25 15:00:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.57799999999999996,"15min":0.56899999999999995},"min":{"1min":0.42799999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.745,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60599999999999998,"15min":0.59299999999999997},"min":{"1min":0.42799999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.81999999999999995,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 25 15:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66600000000000004,"15min":0.68300000000000005},"min":{"1min":0.40400000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.68899999999999995,"15min":0.69999999999999996},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96099999999999997,"5min":1.04,"15min":1.04},"last":0.56399999999999995}]},{"osd":8,"last update":"Thu Jan 25 15:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67700000000000005,"15min":0.70599999999999996},"min":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89900000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.52700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.57099999999999995}]},{"osd":9,"last update":"Thu Jan 25 15:00:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.67500000000000004,"15min":0.68899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.115,"5min":1.121,"15min":1.121},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.69999999999999996,"15min":0.71599999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92600000000000005,"5min":1.147,"15min":1.147},"last":0.495}]},{"osd":10,"last update":"Thu Jan 25 15:00:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67400000000000004,"15min":0.67900000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.72599999999999998,"15min":0.73499999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.58099999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":515180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.51900000000000002,"15min":0.48499999999999999},"min":{"1min":0.35199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.48799999999999999},"min":{"1min":0.42099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73599999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:00:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.57099999999999995,"15min":0.503},"min":{"1min":0.36299999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.57899999999999996,"15min":0.52100000000000002},"min":{"1min":0.44700000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 25 15:00:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59499999999999997,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90300000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.56399999999999995,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78700000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.70099999999999996}]},{"osd":4,"last update":"Thu Jan 25 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.43099999999999999,"15min":0.39100000000000001},"min":{"1min":0.29599999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.439},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44,"15min":0.40400000000000003},"min":{"1min":0.26800000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.66300000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 25 15:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.627,"15min":0.58099999999999996},"min":{"1min":0.46600000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.63300000000000001,"15min":0.57299999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88100000000000001,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.65100000000000002}]},{"osd":6,"last update":"Thu Jan 25 15:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63100000000000001,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94399999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.755},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65200000000000002,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.873}]},{"osd":7,"last update":"Thu Jan 25 15:00:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59699999999999998,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80800000000000005,"5min":1.008,"15min":1.008},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65100000000000002,"15min":0.629},"min":{"1min":0.47799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92200000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.83999999999999997}]},{"osd":8,"last update":"Thu Jan 25 15:00:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.755,"15min":0.73499999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.69299999999999995,"15min":0.67500000000000004},"min":{"1min":0.63900000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.63400000000000001}]},{"osd":9,"last update":"Thu Jan 25 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.57399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90800000000000003,"5min":1.089,"15min":1.089},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77400000000000002,"15min":0.77300000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.94499999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.89600000000000002}]},{"osd":10,"last update":"Thu Jan 25 15:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72899999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.54200000000000004,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0309999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.88300000000000001}]},{"osd":11,"last update":"Thu Jan 25 15:00:56 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.85499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40460,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704692,"statfs":{"total":95995035648,"available":95953604608,"internally_reserved":0,"allocated":978944,"data_stored":457275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:00:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.52600000000000002,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.505},"min":{"1min":0.36699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:00:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.50900000000000001},"min":{"1min":0.41499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.498},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.373,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 25 15:00:57 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.432}]},{"osd":4,"last update":"Thu Jan 25 15:00:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.55100000000000005,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.313,"15min":0.313},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.55400000000000005,"15min":0.52700000000000002},"min":{"1min":0.442,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 25 15:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":4.6779999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.56299999999999994,"15min":0.54700000000000004},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.48199999999999998}]},{"osd":6,"last update":"Thu Jan 25 15:00:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.309,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52400000000000002,"15min":0.505},"min":{"1min":0.36799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 25 14:59:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57699999999999996}]},{"osd":8,"last update":"Thu Jan 25 15:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66300000000000003,"15min":0.67000000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.69899999999999995},"min":{"1min":0.47699999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.56000000000000005}]},{"osd":9,"last update":"Thu Jan 25 15:00:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.42299999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.40799999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.46000000000000002}]},{"osd":10,"last update":"Thu Jan 25 15:00:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.54900000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.0700000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":4.6550000000000002}]},{"osd":11,"last update":"Thu Jan 25 15:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.59399999999999997}]}]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":457459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.505,"15min":0.497},"min":{"1min":0.33400000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67800000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.433}]},{"osd":1,"last update":"Thu Jan 25 15:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.54600000000000004,"15min":0.52000000000000002},"min":{"1min":0.39800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.55700000000000005,"15min":0.51500000000000001},"min":{"1min":0.505,"5min":0.311,"15min":0.311},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 25 15:00:48 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58399999999999996,"15min":0.53800000000000003},"min":{"1min":0.47099999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.83199999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.621},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.55000000000000004},"min":{"1min":0.45000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.755,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 25 15:00:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.44,"15min":0.40000000000000002},"min":{"1min":0.32500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.73999999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.47099999999999997,"15min":0.443},"min":{"1min":0.37,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.74199999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 25 15:00:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70899999999999996,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.499},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86299999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Jan 25 14:59:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.76900000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67700000000000005,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.80500000000000005,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77500000000000002}]},{"osd":8,"last update":"Thu Jan 25 15:00:48 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.435,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.90500000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63400000000000001,"15min":0.64100000000000001},"min":{"1min":0.48399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93400000000000005,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.71199999999999997}]},{"osd":9,"last update":"Thu Jan 25 15:00:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82499999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69099999999999995,"15min":0.68999999999999995},"min":{"1min":0.47399999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.69599999999999995}]},{"osd":10,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.67900000000000005,"15min":0.66000000000000003},"min":{"1min":0.63300000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97299999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.68100000000000005,"15min":0.65900000000000003},"min":{"1min":0.60599999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.84899999999999998}]},{"osd":11,"last update":"Thu Jan 25 15:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.89300000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":455761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.34000000000000002},"min":{"1min":0.254,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.314},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.27200000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53700000000000003,"15min":0.51000000000000001},"min":{"1min":0.376,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54600000000000004,"15min":0.51000000000000001},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.753,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73899999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 25 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55500000000000005,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72899999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.39300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.753,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71199999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.495},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68500000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.379}]},{"osd":6,"last update":"Thu Jan 25 15:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.501,"15min":0.48099999999999998},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76600000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Jan 25 15:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76000000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.47399999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54000000000000004}]},{"osd":8,"last update":"Thu Jan 25 14:59:53 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85899999999999999,"5min":0.872,"15min":0.872},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69599999999999995,"15min":0.69499999999999995},"min":{"1min":0.56799999999999995,"5min":0.5,"15min":0.5},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.61799999999999999}]},{"osd":9,"last update":"Thu Jan 25 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.67400000000000004,"15min":0.69399999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84099999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86099999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.625}]},{"osd":10,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.72399999999999998,"15min":0.72999999999999998},"min":{"1min":0.53000000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.84699999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.76200000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58999999999999997}]},{"osd":11,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67300000000000004}]}]},{"osd":4,"up_from":33,"seq":141733920831,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":514128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48599999999999999,"15min":0.47699999999999998},"min":{"1min":0.38100000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.82199999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 25 15:00:24 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.40699999999999997,"15min":0.38900000000000001},"min":{"1min":0.28799999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.41599999999999998,"15min":0.40100000000000002},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:00:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.54900000000000004,"15min":0.54000000000000004},"min":{"1min":0.371,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85999999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.71799999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:00:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53600000000000003,"15min":0.50600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.39400000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.46100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.753},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.39600000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jan 25 15:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.56399999999999995},"min":{"1min":0.46400000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81000000000000005,"5min":0.879,"15min":0.879},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.36499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90700000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 25 15:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.58099999999999996,"15min":0.55100000000000005},"min":{"1min":0.35099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.626},{"interface":"front","average":{"1min":0.63,"5min":0.55600000000000005,"15min":0.52700000000000002},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.66100000000000003}]},{"osd":8,"last update":"Thu Jan 25 15:00:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.47699999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89400000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69899999999999995,"15min":0.67400000000000004},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96799999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.73999999999999999}]},{"osd":9,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.52000000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95699999999999996,"5min":1,"15min":1},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.55900000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.98099999999999998,"5min":1.044,"15min":1.044},"last":0.67700000000000005}]},{"osd":10,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98099999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.73199999999999998}]},{"osd":11,"last update":"Thu Jan 25 15:00:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.76000000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757305,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32728,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712424,"statfs":{"total":95995035648,"available":95961522176,"internally_reserved":0,"allocated":1581056,"data_stored":1048792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66600000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.46000000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.41399999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.36799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81200000000000006,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.40600000000000003,"15min":0.39400000000000002},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57499999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.39500000000000002,"15min":0.38400000000000001},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.64000000000000001,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55000000000000004,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.753,"5min":0.873,"15min":0.873},"last":0.309},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54100000000000004,"15min":0.54500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84099999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57399999999999995,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.47299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.82699999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Thu Jan 25 15:00:04 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.86499999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.42799999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 25 15:00:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.62,"15min":0.61399999999999999},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.91200000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.67200000000000004}]},{"osd":8,"last update":"Thu Jan 25 15:00:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83199999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79800000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.53000000000000003}]},{"osd":9,"last update":"Thu Jan 25 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65300000000000002,"15min":0.64400000000000002},"min":{"1min":0.496,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.504},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.50800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.93899999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.54300000000000004}]},{"osd":10,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.70599999999999996,"15min":0.69599999999999995},"min":{"1min":0.52900000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.69399999999999995,"15min":0.68400000000000005},"min":{"1min":0.57499999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.78800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":59031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:01:10.038 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph pg dump --format=json 2024-01-25T15:01:10.280 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:01:10.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:01:10.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:01:10.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:10 smithi170 ceph-mon[31899]: from='client.24676 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:01:10.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T15:01:10.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T15:01:10.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:01:10.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:01:10.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:01:10.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:10 smithi191 ceph-mon[36347]: from='client.24676 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:01:10.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T15:01:10.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T15:01:10.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:01:10.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:01:10.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:01:10.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:10 smithi186 ceph-mon[35697]: from='client.24676 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:01:10.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T15:01:10.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T15:01:10.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:01:11.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:11 smithi191 ceph-mon[36347]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 1 B/s, 0 objects/s recovering 2024-01-25T15:01:11.585 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:11 smithi170 ceph-mon[31899]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 1 B/s, 0 objects/s recovering 2024-01-25T15:01:11.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:11 smithi186 ceph-mon[35697]: pgmap v324: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 1 B/s, 0 objects/s recovering 2024-01-25T15:01:11.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.915+0000 7f09ba1e5700 1 -- 172.21.15.170:0/3239221689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b406a900 msgr2=0x7f09b410e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:11.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.915+0000 7f09ba1e5700 1 --2- 172.21.15.170:0/3239221689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b406a900 0x7f09b410e660 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f09ac00b0a0 tx=0x7f09ac00b3b0 comp rx=0 tx=0).stop 2024-01-25T15:01:11.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.915+0000 7f09ba1e5700 1 -- 172.21.15.170:0/3239221689 shutdown_connections 2024-01-25T15:01:11.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.915+0000 7f09ba1e5700 1 --2- 172.21.15.170:0/3239221689 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b406a900 0x7f09b410e660 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:11.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.915+0000 7f09ba1e5700 1 --2- 172.21.15.170:0/3239221689 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09b4107790 0x7f09b4107b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:11.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.915+0000 7f09ba1e5700 1 --2- 172.21.15.170:0/3239221689 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09b4069f40 0x7f09b406a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:11.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.915+0000 7f09ba1e5700 1 -- 172.21.15.170:0/3239221689 >> 172.21.15.170:0/3239221689 conn(0x7f09b4076720 msgr2=0x7f09b4076b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:11.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.915+0000 7f09ba1e5700 1 -- 172.21.15.170:0/3239221689 shutdown_connections 2024-01-25T15:01:11.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.915+0000 7f09ba1e5700 1 -- 172.21.15.170:0/3239221689 wait complete. 2024-01-25T15:01:11.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.916+0000 7f09ba1e5700 1 Processor -- start 2024-01-25T15:01:11.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.916+0000 7f09ba1e5700 1 -- start start 2024-01-25T15:01:11.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.916+0000 7f09ba1e5700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09b4069f40 0x7f09b4199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:11.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.916+0000 7f09ba1e5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b406a900 0x7f09b419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:11.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.916+0000 7f09ba1e5700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09b4107790 0x7f09b419e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:11.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.916+0000 7f09ba1e5700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b419eda0 con 0x7f09b406a900 2024-01-25T15:01:11.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.916+0000 7f09ba1e5700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b419ef10 con 0x7f09b4069f40 2024-01-25T15:01:11.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.916+0000 7f09ba1e5700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b419f0d0 con 0x7f09b4107790 2024-01-25T15:01:11.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.916+0000 7f09aaffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b406a900 0x7f09b419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:11.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.916+0000 7f09aaffd700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b406a900 0x7f09b419a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56530/0 (socket says 172.21.15.170:56530) 2024-01-25T15:01:11.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.916+0000 7f09aaffd700 1 -- 172.21.15.170:0/1430924572 learned_addr learned my addr 172.21.15.170:0/1430924572 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:11.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.916+0000 7f09b3fff700 1 --2- 172.21.15.170:0/1430924572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09b4107790 0x7f09b419e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:11.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.917+0000 7f09b37fe700 1 --2- 172.21.15.170:0/1430924572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09b4069f40 0x7f09b4199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:11.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.917+0000 7f09aaffd700 1 -- 172.21.15.170:0/1430924572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09b4107790 msgr2=0x7f09b419e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:11.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.917+0000 7f09aaffd700 1 --2- 172.21.15.170:0/1430924572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09b4107790 0x7f09b419e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:11.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.917+0000 7f09aaffd700 1 -- 172.21.15.170:0/1430924572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09b4069f40 msgr2=0x7f09b4199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:11.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.917+0000 7f09aaffd700 1 --2- 172.21.15.170:0/1430924572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09b4069f40 0x7f09b4199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:11.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.917+0000 7f09aaffd700 1 -- 172.21.15.170:0/1430924572 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac009d00 con 0x7f09b406a900 2024-01-25T15:01:11.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.917+0000 7f09b37fe700 1 --2- 172.21.15.170:0/1430924572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09b4069f40 0x7f09b4199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:11.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.917+0000 7f09aaffd700 1 --2- 172.21.15.170:0/1430924572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b406a900 0x7f09b419a450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f099c00d950 tx=0x7f099c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:11.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.917+0000 7f09b17fa700 1 -- 172.21.15.170:0/1430924572 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c009940 con 0x7f09b406a900 2024-01-25T15:01:11.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.917+0000 7f09b17fa700 1 -- 172.21.15.170:0/1430924572 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f099c010460 con 0x7f09b406a900 2024-01-25T15:01:11.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.917+0000 7f09ba1e5700 1 -- 172.21.15.170:0/1430924572 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b419f3b0 con 0x7f09b406a900 2024-01-25T15:01:11.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.917+0000 7f09b17fa700 1 -- 172.21.15.170:0/1430924572 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099c00f620 con 0x7f09b406a900 2024-01-25T15:01:11.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.917+0000 7f09ba1e5700 1 -- 172.21.15.170:0/1430924572 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b41a6c10 con 0x7f09b406a900 2024-01-25T15:01:11.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.918+0000 7f09ba1e5700 1 -- 172.21.15.170:0/1430924572 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b40ffd20 con 0x7f09b406a900 2024-01-25T15:01:11.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.919+0000 7f09b17fa700 1 -- 172.21.15.170:0/1430924572 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f099c0108d0 con 0x7f09b406a900 2024-01-25T15:01:11.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.919+0000 7f09b17fa700 1 --2- 172.21.15.170:0/1430924572 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f09a00a1400 0x7f09a00a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:11.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.920+0000 7f09b37fe700 1 --2- 172.21.15.170:0/1430924572 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f09a00a1400 0x7f09a00a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:11.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.920+0000 7f09b17fa700 1 -- 172.21.15.170:0/1430924572 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f099c0ccad0 con 0x7f09b406a900 2024-01-25T15:01:11.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.920+0000 7f09b37fe700 1 --2- 172.21.15.170:0/1430924572 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f09a00a1400 0x7f09a00a38c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f09a4005fd0 tx=0x7f09a4005d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:11.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:11.924+0000 7f09b17fa700 1 -- 172.21.15.170:0/1430924572 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f099c095e20 con 0x7f09b406a900 2024-01-25T15:01:12.111 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:12.110+0000 7f09ba1e5700 1 -- 172.21.15.170:0/1430924572 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09b4111720 con 0x7f09a00a1400 2024-01-25T15:01:12.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:12.120+0000 7f09b17fa700 1 -- 172.21.15.170:0/1430924572 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344784 (secure 0 0 0) 0x7f09b4111720 con 0x7f09a00a1400 2024-01-25T15:01:12.126 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:12.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:12.125+0000 7f09ba1e5700 1 -- 172.21.15.170:0/1430924572 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f09a00a1400 msgr2=0x7f09a00a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:12.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:12.125+0000 7f09ba1e5700 1 --2- 172.21.15.170:0/1430924572 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f09a00a1400 0x7f09a00a38c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f09a4005fd0 tx=0x7f09a4005d40 comp rx=0 tx=0).stop 2024-01-25T15:01:12.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:12.125+0000 7f09ba1e5700 1 -- 172.21.15.170:0/1430924572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b406a900 msgr2=0x7f09b419a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:12.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:12.125+0000 7f09ba1e5700 1 --2- 172.21.15.170:0/1430924572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b406a900 0x7f09b419a450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f099c00d950 tx=0x7f099c00dc60 comp rx=0 tx=0).stop 2024-01-25T15:01:12.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:12.125+0000 7f09ba1e5700 1 -- 172.21.15.170:0/1430924572 shutdown_connections 2024-01-25T15:01:12.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:12.125+0000 7f09ba1e5700 1 --2- 172.21.15.170:0/1430924572 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f09a00a1400 0x7f09a00a38c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:12.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:12.125+0000 7f09ba1e5700 1 --2- 172.21.15.170:0/1430924572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f09b4107790 0x7f09b419e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:12.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:12.125+0000 7f09ba1e5700 1 --2- 172.21.15.170:0/1430924572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09b4069f40 0x7f09b4199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:12.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:12.125+0000 7f09ba1e5700 1 --2- 172.21.15.170:0/1430924572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f09b406a900 0x7f09b419a450 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:12.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:12.125+0000 7f09ba1e5700 1 -- 172.21.15.170:0/1430924572 >> 172.21.15.170:0/1430924572 conn(0x7f09b4076720 msgr2=0x7f09b410cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:12.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:12.125+0000 7f09ba1e5700 1 -- 172.21.15.170:0/1430924572 shutdown_connections 2024-01-25T15:01:12.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:12.125+0000 7f09ba1e5700 1 -- 172.21.15.170:0/1430924572 wait complete. 2024-01-25T15:01:12.130 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2024-01-25T15:01:12.798 INFO:teuthology.orchestra.run.smithi170.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-01-25T15:01:10.209365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655745,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":845,"num_read_kb":540,"num_write":416,"num_write_kb":3069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1239089,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":341,"ondisk_log_size":341,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":391672,"kb_used_data":13308,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124550152,"statfs":{"total":1151940427776,"available":1151539355648,"internally_reserved":0,"allocated":13627392,"data_stored":7428399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":387233084},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":54,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002997"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281623+0000","last_change":"2024-01-25T14:59:54.219084+0000","last_active":"2024-01-25T15:00:57.281623+0000","last_peered":"2024-01-25T15:00:57.281623+0000","last_clean":"2024-01-25T15:00:57.281623+0000","last_became_active":"2024-01-25T14:59:54.218780+0000","last_became_peered":"2024-01-25T14:59:54.218780+0000","last_unstale":"2024-01-25T15:00:57.281623+0000","last_undegraded":"2024-01-25T15:00:57.281623+0000","last_fullsized":"2024-01-25T15:00:57.281623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:05:50.441934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277787+0000","last_change":"2024-01-25T14:59:54.219130+0000","last_active":"2024-01-25T15:00:57.277787+0000","last_peered":"2024-01-25T15:00:57.277787+0000","last_clean":"2024-01-25T15:00:57.277787+0000","last_became_active":"2024-01-25T14:59:54.218744+0000","last_became_peered":"2024-01-25T14:59:54.218744+0000","last_unstale":"2024-01-25T15:00:57.277787+0000","last_undegraded":"2024-01-25T15:00:57.277787+0000","last_fullsized":"2024-01-25T15:00:57.277787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:59:35.424110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277694+0000","last_change":"2024-01-25T14:59:54.218870+0000","last_active":"2024-01-25T15:00:57.277694+0000","last_peered":"2024-01-25T15:00:57.277694+0000","last_clean":"2024-01-25T15:00:57.277694+0000","last_became_active":"2024-01-25T14:59:54.218522+0000","last_became_peered":"2024-01-25T14:59:54.218522+0000","last_unstale":"2024-01-25T15:00:57.277694+0000","last_undegraded":"2024-01-25T15:00:57.277694+0000","last_fullsized":"2024-01-25T15:00:57.277694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:00:05.038437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279426+0000","last_change":"2024-01-25T14:59:54.218436+0000","last_active":"2024-01-25T15:00:57.279426+0000","last_peered":"2024-01-25T15:00:57.279426+0000","last_clean":"2024-01-25T15:00:57.279426+0000","last_became_active":"2024-01-25T14:59:54.217232+0000","last_became_peered":"2024-01-25T14:59:54.217232+0000","last_unstale":"2024-01-25T15:00:57.279426+0000","last_undegraded":"2024-01-25T15:00:57.279426+0000","last_fullsized":"2024-01-25T15:00:57.279426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:24:14.642794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278510+0000","last_change":"2024-01-25T14:59:54.219094+0000","last_active":"2024-01-25T15:00:57.278510+0000","last_peered":"2024-01-25T15:00:57.278510+0000","last_clean":"2024-01-25T15:00:57.278510+0000","last_became_active":"2024-01-25T14:59:54.218778+0000","last_became_peered":"2024-01-25T14:59:54.218778+0000","last_unstale":"2024-01-25T15:00:57.278510+0000","last_undegraded":"2024-01-25T15:00:57.278510+0000","last_fullsized":"2024-01-25T15:00:57.278510+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:21.754098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281409+0000","last_change":"2024-01-25T14:59:54.213243+0000","last_active":"2024-01-25T15:00:57.281409+0000","last_peered":"2024-01-25T15:00:57.281409+0000","last_clean":"2024-01-25T15:00:57.281409+0000","last_became_active":"2024-01-25T14:59:54.212891+0000","last_became_peered":"2024-01-25T14:59:54.212891+0000","last_unstale":"2024-01-25T15:00:57.281409+0000","last_undegraded":"2024-01-25T15:00:57.281409+0000","last_fullsized":"2024-01-25T15:00:57.281409+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:52:45.505016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282580+0000","last_change":"2024-01-25T14:59:54.211851+0000","last_active":"2024-01-25T15:00:57.282580+0000","last_peered":"2024-01-25T15:00:57.282580+0000","last_clean":"2024-01-25T15:00:57.282580+0000","last_became_active":"2024-01-25T14:59:54.211298+0000","last_became_peered":"2024-01-25T14:59:54.211298+0000","last_unstale":"2024-01-25T15:00:57.282580+0000","last_undegraded":"2024-01-25T15:00:57.282580+0000","last_fullsized":"2024-01-25T15:00:57.282580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:05:36.636283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282815+0000","last_change":"2024-01-25T14:59:54.217675+0000","last_active":"2024-01-25T15:00:57.282815+0000","last_peered":"2024-01-25T15:00:57.282815+0000","last_clean":"2024-01-25T15:00:57.282815+0000","last_became_active":"2024-01-25T14:59:54.217329+0000","last_became_peered":"2024-01-25T14:59:54.217329+0000","last_unstale":"2024-01-25T15:00:57.282815+0000","last_undegraded":"2024-01-25T15:00:57.282815+0000","last_fullsized":"2024-01-25T15:00:57.282815+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:32:07.769974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.285711+0000","last_change":"2024-01-25T14:59:54.213030+0000","last_active":"2024-01-25T15:00:57.285711+0000","last_peered":"2024-01-25T15:00:57.285711+0000","last_clean":"2024-01-25T15:00:57.285711+0000","last_became_active":"2024-01-25T14:59:54.212687+0000","last_became_peered":"2024-01-25T14:59:54.212687+0000","last_unstale":"2024-01-25T15:00:57.285711+0000","last_undegraded":"2024-01-25T15:00:57.285711+0000","last_fullsized":"2024-01-25T15:00:57.285711+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:47:29.562996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284759+0000","last_change":"2024-01-25T15:00:57.284759+0000","last_active":"2024-01-25T15:00:57.284759+0000","last_peered":"2024-01-25T15:00:57.284759+0000","last_clean":"2024-01-25T15:00:57.284759+0000","last_became_active":"2024-01-25T15:00:57.284306+0000","last_became_peered":"2024-01-25T15:00:57.284306+0000","last_unstale":"2024-01-25T15:00:57.284759+0000","last_undegraded":"2024-01-25T15:00:57.284759+0000","last_fullsized":"2024-01-25T15:00:57.284759+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:56:49.173903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283196+0000","last_change":"2024-01-25T14:59:54.216252+0000","last_active":"2024-01-25T15:00:57.283196+0000","last_peered":"2024-01-25T15:00:57.283196+0000","last_clean":"2024-01-25T15:00:57.283196+0000","last_became_active":"2024-01-25T14:59:54.215892+0000","last_became_peered":"2024-01-25T14:59:54.215892+0000","last_unstale":"2024-01-25T15:00:57.283196+0000","last_undegraded":"2024-01-25T15:00:57.283196+0000","last_fullsized":"2024-01-25T15:00:57.283196+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:53:27.135926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279396+0000","last_change":"2024-01-25T14:59:54.221212+0000","last_active":"2024-01-25T15:00:57.279396+0000","last_peered":"2024-01-25T15:00:57.279396+0000","last_clean":"2024-01-25T15:00:57.279396+0000","last_became_active":"2024-01-25T14:59:54.220516+0000","last_became_peered":"2024-01-25T14:59:54.220516+0000","last_unstale":"2024-01-25T15:00:57.279396+0000","last_undegraded":"2024-01-25T15:00:57.279396+0000","last_fullsized":"2024-01-25T15:00:57.279396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:00:57.398457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279713+0000","last_change":"2024-01-25T14:59:54.204088+0000","last_active":"2024-01-25T15:00:57.279713+0000","last_peered":"2024-01-25T15:00:57.279713+0000","last_clean":"2024-01-25T15:00:57.279713+0000","last_became_active":"2024-01-25T14:59:54.202895+0000","last_became_peered":"2024-01-25T14:59:54.202895+0000","last_unstale":"2024-01-25T15:00:57.279713+0000","last_undegraded":"2024-01-25T15:00:57.279713+0000","last_fullsized":"2024-01-25T15:00:57.279713+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:15:37.693577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277766+0000","last_change":"2024-01-25T14:59:54.226108+0000","last_active":"2024-01-25T15:00:57.277766+0000","last_peered":"2024-01-25T15:00:57.277766+0000","last_clean":"2024-01-25T15:00:57.277766+0000","last_became_active":"2024-01-25T14:59:54.225830+0000","last_became_peered":"2024-01-25T14:59:54.225830+0000","last_unstale":"2024-01-25T15:00:57.277766+0000","last_undegraded":"2024-01-25T15:00:57.277766+0000","last_fullsized":"2024-01-25T15:00:57.277766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:10:22.580434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277463+0000","last_change":"2024-01-25T14:59:54.224893+0000","last_active":"2024-01-25T15:00:57.277463+0000","last_peered":"2024-01-25T15:00:57.277463+0000","last_clean":"2024-01-25T15:00:57.277463+0000","last_became_active":"2024-01-25T14:59:54.224583+0000","last_became_peered":"2024-01-25T14:59:54.224583+0000","last_unstale":"2024-01-25T15:00:57.277463+0000","last_undegraded":"2024-01-25T15:00:57.277463+0000","last_fullsized":"2024-01-25T15:00:57.277463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:48:25.538489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284500+0000","last_change":"2024-01-25T14:59:54.217030+0000","last_active":"2024-01-25T15:00:57.284500+0000","last_peered":"2024-01-25T15:00:57.284500+0000","last_clean":"2024-01-25T15:00:57.284500+0000","last_became_active":"2024-01-25T14:59:54.216732+0000","last_became_peered":"2024-01-25T14:59:54.216732+0000","last_unstale":"2024-01-25T15:00:57.284500+0000","last_undegraded":"2024-01-25T15:00:57.284500+0000","last_fullsized":"2024-01-25T15:00:57.284500+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:58:36.072464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281058+0000","last_change":"2024-01-25T14:59:54.223924+0000","last_active":"2024-01-25T15:00:57.281058+0000","last_peered":"2024-01-25T15:00:57.281058+0000","last_clean":"2024-01-25T15:00:57.281058+0000","last_became_active":"2024-01-25T14:59:54.223556+0000","last_became_peered":"2024-01-25T14:59:54.223556+0000","last_unstale":"2024-01-25T15:00:57.281058+0000","last_undegraded":"2024-01-25T15:00:57.281058+0000","last_fullsized":"2024-01-25T15:00:57.281058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:54:18.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280925+0000","last_change":"2024-01-25T14:59:54.207125+0000","last_active":"2024-01-25T15:00:57.280925+0000","last_peered":"2024-01-25T15:00:57.280925+0000","last_clean":"2024-01-25T15:00:57.280925+0000","last_became_active":"2024-01-25T14:59:54.206630+0000","last_became_peered":"2024-01-25T14:59:54.206630+0000","last_unstale":"2024-01-25T15:00:57.280925+0000","last_undegraded":"2024-01-25T15:00:57.280925+0000","last_fullsized":"2024-01-25T15:00:57.280925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:10:12.685185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281546+0000","last_change":"2024-01-25T14:59:54.210732+0000","last_active":"2024-01-25T15:00:57.281546+0000","last_peered":"2024-01-25T15:00:57.281546+0000","last_clean":"2024-01-25T15:00:57.281546+0000","last_became_active":"2024-01-25T14:59:54.210417+0000","last_became_peered":"2024-01-25T14:59:54.210417+0000","last_unstale":"2024-01-25T15:00:57.281546+0000","last_undegraded":"2024-01-25T15:00:57.281546+0000","last_fullsized":"2024-01-25T15:00:57.281546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:05:22.305485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'13","reported_seq":102,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:07.136635+0000","last_change":"2024-01-25T14:59:53.204680+0000","last_active":"2024-01-25T15:01:07.136635+0000","last_peered":"2024-01-25T15:01:07.136635+0000","last_clean":"2024-01-25T15:01:07.136635+0000","last_became_active":"2024-01-25T14:59:53.204327+0000","last_became_peered":"2024-01-25T14:59:53.204327+0000","last_unstale":"2024-01-25T15:01:07.136635+0000","last_undegraded":"2024-01-25T15:01:07.136635+0000","last_fullsized":"2024-01-25T15:01:07.136635+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:32:16.333425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284202+0000","last_change":"2024-01-25T14:59:54.220501+0000","last_active":"2024-01-25T15:00:57.284202+0000","last_peered":"2024-01-25T15:00:57.284202+0000","last_clean":"2024-01-25T15:00:57.284202+0000","last_became_active":"2024-01-25T14:59:54.217150+0000","last_became_peered":"2024-01-25T14:59:54.217150+0000","last_unstale":"2024-01-25T15:00:57.284202+0000","last_undegraded":"2024-01-25T15:00:57.284202+0000","last_fullsized":"2024-01-25T15:00:57.284202+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:16:00.811698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284319+0000","last_change":"2024-01-25T14:59:53.209110+0000","last_active":"2024-01-25T15:00:57.284319+0000","last_peered":"2024-01-25T15:00:57.284319+0000","last_clean":"2024-01-25T15:00:57.284319+0000","last_became_active":"2024-01-25T14:59:53.208794+0000","last_became_peered":"2024-01-25T14:59:53.208794+0000","last_unstale":"2024-01-25T15:00:57.284319+0000","last_undegraded":"2024-01-25T15:00:57.284319+0000","last_fullsized":"2024-01-25T15:00:57.284319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:51:40.757062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277775+0000","last_change":"2024-01-25T14:59:54.219303+0000","last_active":"2024-01-25T15:00:57.277775+0000","last_peered":"2024-01-25T15:00:57.277775+0000","last_clean":"2024-01-25T15:00:57.277775+0000","last_became_active":"2024-01-25T14:59:54.218814+0000","last_became_peered":"2024-01-25T14:59:54.218814+0000","last_unstale":"2024-01-25T15:00:57.277775+0000","last_undegraded":"2024-01-25T15:00:57.277775+0000","last_fullsized":"2024-01-25T15:00:57.277775+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:54:30.556998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278661+0000","last_change":"2024-01-25T14:59:53.209770+0000","last_active":"2024-01-25T15:00:57.278661+0000","last_peered":"2024-01-25T15:00:57.278661+0000","last_clean":"2024-01-25T15:00:57.278661+0000","last_became_active":"2024-01-25T14:59:53.209466+0000","last_became_peered":"2024-01-25T14:59:53.209466+0000","last_unstale":"2024-01-25T15:00:57.278661+0000","last_undegraded":"2024-01-25T15:00:57.278661+0000","last_fullsized":"2024-01-25T15:00:57.278661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:58:11.391155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.285497+0000","last_change":"2024-01-25T14:59:54.201559+0000","last_active":"2024-01-25T15:00:57.285497+0000","last_peered":"2024-01-25T15:00:57.285497+0000","last_clean":"2024-01-25T15:00:57.285497+0000","last_became_active":"2024-01-25T14:59:54.201155+0000","last_became_peered":"2024-01-25T14:59:54.201155+0000","last_unstale":"2024-01-25T15:00:57.285497+0000","last_undegraded":"2024-01-25T15:00:57.285497+0000","last_fullsized":"2024-01-25T15:00:57.285497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:29:15.444879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278742+0000","last_change":"2024-01-25T14:59:53.208457+0000","last_active":"2024-01-25T15:00:57.278742+0000","last_peered":"2024-01-25T15:00:57.278742+0000","last_clean":"2024-01-25T15:00:57.278742+0000","last_became_active":"2024-01-25T14:59:53.208166+0000","last_became_peered":"2024-01-25T14:59:53.208166+0000","last_unstale":"2024-01-25T15:00:57.278742+0000","last_undegraded":"2024-01-25T15:00:57.278742+0000","last_fullsized":"2024-01-25T15:00:57.278742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:29:22.580726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283819+0000","last_change":"2024-01-25T14:59:54.212126+0000","last_active":"2024-01-25T15:00:57.283819+0000","last_peered":"2024-01-25T15:00:57.283819+0000","last_clean":"2024-01-25T15:00:57.283819+0000","last_became_active":"2024-01-25T14:59:54.211519+0000","last_became_peered":"2024-01-25T14:59:54.211519+0000","last_unstale":"2024-01-25T15:00:57.283819+0000","last_undegraded":"2024-01-25T15:00:57.283819+0000","last_fullsized":"2024-01-25T15:00:57.283819+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:50:59.743852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":99,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:07.137233+0000","last_change":"2024-01-25T14:59:53.201803+0000","last_active":"2024-01-25T15:01:07.137233+0000","last_peered":"2024-01-25T15:01:07.137233+0000","last_clean":"2024-01-25T15:01:07.137233+0000","last_became_active":"2024-01-25T14:59:53.201464+0000","last_became_peered":"2024-01-25T14:59:53.201464+0000","last_unstale":"2024-01-25T15:01:07.137233+0000","last_undegraded":"2024-01-25T15:01:07.137233+0000","last_fullsized":"2024-01-25T15:01:07.137233+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:36:03.922038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278264+0000","last_change":"2024-01-25T14:59:54.207126+0000","last_active":"2024-01-25T15:00:57.278264+0000","last_peered":"2024-01-25T15:00:57.278264+0000","last_clean":"2024-01-25T15:00:57.278264+0000","last_became_active":"2024-01-25T14:59:54.206826+0000","last_became_peered":"2024-01-25T14:59:54.206826+0000","last_unstale":"2024-01-25T15:00:57.278264+0000","last_undegraded":"2024-01-25T15:00:57.278264+0000","last_fullsized":"2024-01-25T15:00:57.278264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:45:07.217919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281277+0000","last_change":"2024-01-25T14:59:53.200335+0000","last_active":"2024-01-25T15:00:57.281277+0000","last_peered":"2024-01-25T15:00:57.281277+0000","last_clean":"2024-01-25T15:00:57.281277+0000","last_became_active":"2024-01-25T14:59:53.200028+0000","last_became_peered":"2024-01-25T14:59:53.200028+0000","last_unstale":"2024-01-25T15:00:57.281277+0000","last_undegraded":"2024-01-25T15:00:57.281277+0000","last_fullsized":"2024-01-25T15:00:57.281277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:23:26.178260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283783+0000","last_change":"2024-01-25T14:59:54.211048+0000","last_active":"2024-01-25T15:00:57.283783+0000","last_peered":"2024-01-25T15:00:57.283783+0000","last_clean":"2024-01-25T15:00:57.283783+0000","last_became_active":"2024-01-25T14:59:54.210724+0000","last_became_peered":"2024-01-25T14:59:54.210724+0000","last_unstale":"2024-01-25T15:00:57.283783+0000","last_undegraded":"2024-01-25T15:00:57.283783+0000","last_fullsized":"2024-01-25T15:00:57.283783+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:59:40.171707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279454+0000","last_change":"2024-01-25T14:59:53.202235+0000","last_active":"2024-01-25T15:00:57.279454+0000","last_peered":"2024-01-25T15:00:57.279454+0000","last_clean":"2024-01-25T15:00:57.279454+0000","last_became_active":"2024-01-25T14:59:53.201933+0000","last_became_peered":"2024-01-25T14:59:53.201933+0000","last_unstale":"2024-01-25T15:00:57.279454+0000","last_undegraded":"2024-01-25T15:00:57.279454+0000","last_fullsized":"2024-01-25T15:00:57.279454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:40:23.725903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282749+0000","last_change":"2024-01-25T14:59:54.205184+0000","last_active":"2024-01-25T15:00:57.282749+0000","last_peered":"2024-01-25T15:00:57.282749+0000","last_clean":"2024-01-25T15:00:57.282749+0000","last_became_active":"2024-01-25T14:59:54.204865+0000","last_became_peered":"2024-01-25T14:59:54.204865+0000","last_unstale":"2024-01-25T15:00:57.282749+0000","last_undegraded":"2024-01-25T15:00:57.282749+0000","last_fullsized":"2024-01-25T15:00:57.282749+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:07:25.559601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283603+0000","last_change":"2024-01-25T14:59:53.205021+0000","last_active":"2024-01-25T15:00:57.283603+0000","last_peered":"2024-01-25T15:00:57.283603+0000","last_clean":"2024-01-25T15:00:57.283603+0000","last_became_active":"2024-01-25T14:59:53.203925+0000","last_became_peered":"2024-01-25T14:59:53.203925+0000","last_unstale":"2024-01-25T15:00:57.283603+0000","last_undegraded":"2024-01-25T15:00:57.283603+0000","last_fullsized":"2024-01-25T15:00:57.283603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:20:43.003659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280714+0000","last_change":"2024-01-25T14:59:54.207234+0000","last_active":"2024-01-25T15:00:57.280714+0000","last_peered":"2024-01-25T15:00:57.280714+0000","last_clean":"2024-01-25T15:00:57.280714+0000","last_became_active":"2024-01-25T14:59:54.206727+0000","last_became_peered":"2024-01-25T14:59:54.206727+0000","last_unstale":"2024-01-25T15:00:57.280714+0000","last_undegraded":"2024-01-25T15:00:57.280714+0000","last_fullsized":"2024-01-25T15:00:57.280714+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:29:08.678821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'4","reported_seq":161,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:07.136469+0000","last_change":"2024-01-25T14:59:53.204198+0000","last_active":"2024-01-25T15:01:07.136469+0000","last_peered":"2024-01-25T15:01:07.136469+0000","last_clean":"2024-01-25T15:01:07.136469+0000","last_became_active":"2024-01-25T14:59:53.203844+0000","last_became_peered":"2024-01-25T14:59:53.203844+0000","last_unstale":"2024-01-25T15:01:07.136469+0000","last_undegraded":"2024-01-25T15:01:07.136469+0000","last_fullsized":"2024-01-25T15:01:07.136469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:30:23.735236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":138,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.285562+0000","last_change":"2024-01-25T14:59:54.203318+0000","last_active":"2024-01-25T15:00:57.285562+0000","last_peered":"2024-01-25T15:00:57.285562+0000","last_clean":"2024-01-25T15:00:57.285562+0000","last_became_active":"2024-01-25T14:59:54.202971+0000","last_became_peered":"2024-01-25T14:59:54.202971+0000","last_unstale":"2024-01-25T15:00:57.285562+0000","last_undegraded":"2024-01-25T15:00:57.285562+0000","last_fullsized":"2024-01-25T15:00:57.285562+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:57:59.454857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.300726+0000","last_change":"2024-01-25T15:00:57.300726+0000","last_active":"2024-01-25T15:00:57.300726+0000","last_peered":"2024-01-25T15:00:57.300726+0000","last_clean":"2024-01-25T15:00:57.300726+0000","last_became_active":"2024-01-25T15:00:57.288184+0000","last_became_peered":"2024-01-25T15:00:57.288184+0000","last_unstale":"2024-01-25T15:00:57.300726+0000","last_undegraded":"2024-01-25T15:00:57.300726+0000","last_fullsized":"2024-01-25T15:00:57.300726+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:17:00.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277850+0000","last_change":"2024-01-25T14:59:54.225131+0000","last_active":"2024-01-25T15:00:57.277850+0000","last_peered":"2024-01-25T15:00:57.277850+0000","last_clean":"2024-01-25T15:00:57.277850+0000","last_became_active":"2024-01-25T14:59:54.224786+0000","last_became_peered":"2024-01-25T14:59:54.224786+0000","last_unstale":"2024-01-25T15:00:57.277850+0000","last_undegraded":"2024-01-25T15:00:57.277850+0000","last_fullsized":"2024-01-25T15:00:57.277850+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:25:07.426433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283977+0000","last_change":"2024-01-25T14:59:53.199834+0000","last_active":"2024-01-25T15:00:57.283977+0000","last_peered":"2024-01-25T15:00:57.283977+0000","last_clean":"2024-01-25T15:00:57.283977+0000","last_became_active":"2024-01-25T14:59:53.199545+0000","last_became_peered":"2024-01-25T14:59:53.199545+0000","last_unstale":"2024-01-25T15:00:57.283977+0000","last_undegraded":"2024-01-25T15:00:57.283977+0000","last_fullsized":"2024-01-25T15:00:57.283977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:38:08.973583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.285702+0000","last_change":"2024-01-25T14:59:54.214768+0000","last_active":"2024-01-25T15:00:57.285702+0000","last_peered":"2024-01-25T15:00:57.285702+0000","last_clean":"2024-01-25T15:00:57.285702+0000","last_became_active":"2024-01-25T14:59:54.214038+0000","last_became_peered":"2024-01-25T14:59:54.214038+0000","last_unstale":"2024-01-25T15:00:57.285702+0000","last_undegraded":"2024-01-25T15:00:57.285702+0000","last_fullsized":"2024-01-25T15:00:57.285702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:10:20.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'29","reported_seq":216,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:07.303797+0000","last_change":"2024-01-25T15:00:57.297320+0000","last_active":"2024-01-25T15:01:07.303797+0000","last_peered":"2024-01-25T15:01:07.303797+0000","last_clean":"2024-01-25T15:01:07.303797+0000","last_became_active":"2024-01-25T15:00:57.287208+0000","last_became_peered":"2024-01-25T15:00:57.287208+0000","last_unstale":"2024-01-25T15:01:07.303797+0000","last_undegraded":"2024-01-25T15:01:07.303797+0000","last_fullsized":"2024-01-25T15:01:07.303797+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:36:17.161523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58331,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":134,"num_read_kb":123,"num_write":31,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":58331,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278465+0000","last_change":"2024-01-25T14:59:54.217069+0000","last_active":"2024-01-25T15:00:57.278465+0000","last_peered":"2024-01-25T15:00:57.278465+0000","last_clean":"2024-01-25T15:00:57.278465+0000","last_became_active":"2024-01-25T14:59:54.216749+0000","last_became_peered":"2024-01-25T14:59:54.216749+0000","last_unstale":"2024-01-25T15:00:57.278465+0000","last_undegraded":"2024-01-25T15:00:57.278465+0000","last_fullsized":"2024-01-25T15:00:57.278465+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:31:00.903462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282050+0000","last_change":"2024-01-25T14:59:53.198852+0000","last_active":"2024-01-25T15:00:57.282050+0000","last_peered":"2024-01-25T15:00:57.282050+0000","last_clean":"2024-01-25T15:00:57.282050+0000","last_became_active":"2024-01-25T14:59:53.198532+0000","last_became_peered":"2024-01-25T14:59:53.198532+0000","last_unstale":"2024-01-25T15:00:57.282050+0000","last_undegraded":"2024-01-25T15:00:57.282050+0000","last_fullsized":"2024-01-25T15:00:57.282050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:03:43.251730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279444+0000","last_change":"2024-01-25T14:59:54.209865+0000","last_active":"2024-01-25T15:00:57.279444+0000","last_peered":"2024-01-25T15:00:57.279444+0000","last_clean":"2024-01-25T15:00:57.279444+0000","last_became_active":"2024-01-25T14:59:54.209564+0000","last_became_peered":"2024-01-25T14:59:54.209564+0000","last_unstale":"2024-01-25T15:00:57.279444+0000","last_undegraded":"2024-01-25T15:00:57.279444+0000","last_fullsized":"2024-01-25T15:00:57.279444+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:19:24.461651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283550+0000","last_change":"2024-01-25T14:59:53.207644+0000","last_active":"2024-01-25T15:00:57.283550+0000","last_peered":"2024-01-25T15:00:57.283550+0000","last_clean":"2024-01-25T15:00:57.283550+0000","last_became_active":"2024-01-25T14:59:53.207321+0000","last_became_peered":"2024-01-25T14:59:53.207321+0000","last_unstale":"2024-01-25T15:00:57.283550+0000","last_undegraded":"2024-01-25T15:00:57.283550+0000","last_fullsized":"2024-01-25T15:00:57.283550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:47:12.131711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283161+0000","last_change":"2024-01-25T14:59:54.220548+0000","last_active":"2024-01-25T15:00:57.283161+0000","last_peered":"2024-01-25T15:00:57.283161+0000","last_clean":"2024-01-25T15:00:57.283161+0000","last_became_active":"2024-01-25T14:59:54.219743+0000","last_became_peered":"2024-01-25T14:59:54.219743+0000","last_unstale":"2024-01-25T15:00:57.283161+0000","last_undegraded":"2024-01-25T15:00:57.283161+0000","last_fullsized":"2024-01-25T15:00:57.283161+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:46:12.085591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":95,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:05.134008+0000","last_change":"2024-01-25T14:59:53.201233+0000","last_active":"2024-01-25T15:01:05.134008+0000","last_peered":"2024-01-25T15:01:05.134008+0000","last_clean":"2024-01-25T15:01:05.134008+0000","last_became_active":"2024-01-25T14:59:53.200907+0000","last_became_peered":"2024-01-25T14:59:53.200907+0000","last_unstale":"2024-01-25T15:01:05.134008+0000","last_undegraded":"2024-01-25T15:01:05.134008+0000","last_fullsized":"2024-01-25T15:01:05.134008+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:30:59.640179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282292+0000","last_change":"2024-01-25T14:59:54.212617+0000","last_active":"2024-01-25T15:00:57.282292+0000","last_peered":"2024-01-25T15:00:57.282292+0000","last_clean":"2024-01-25T15:00:57.282292+0000","last_became_active":"2024-01-25T14:59:54.212328+0000","last_became_peered":"2024-01-25T14:59:54.212328+0000","last_unstale":"2024-01-25T15:00:57.282292+0000","last_undegraded":"2024-01-25T15:00:57.282292+0000","last_fullsized":"2024-01-25T15:00:57.282292+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:21:16.958894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278147+0000","last_change":"2024-01-25T14:59:53.202685+0000","last_active":"2024-01-25T15:00:57.278147+0000","last_peered":"2024-01-25T15:00:57.278147+0000","last_clean":"2024-01-25T15:00:57.278147+0000","last_became_active":"2024-01-25T14:59:53.201529+0000","last_became_peered":"2024-01-25T14:59:53.201529+0000","last_unstale":"2024-01-25T15:00:57.278147+0000","last_undegraded":"2024-01-25T15:00:57.278147+0000","last_fullsized":"2024-01-25T15:00:57.278147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:43:29.823959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283935+0000","last_change":"2024-01-25T14:59:54.208724+0000","last_active":"2024-01-25T15:00:57.283935+0000","last_peered":"2024-01-25T15:00:57.283935+0000","last_clean":"2024-01-25T15:00:57.283935+0000","last_became_active":"2024-01-25T14:59:54.208392+0000","last_became_peered":"2024-01-25T14:59:54.208392+0000","last_unstale":"2024-01-25T15:00:57.283935+0000","last_undegraded":"2024-01-25T15:00:57.283935+0000","last_fullsized":"2024-01-25T15:00:57.283935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:37.285702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.291362+0000","last_change":"2024-01-25T15:00:57.290806+0000","last_active":"2024-01-25T15:00:57.291362+0000","last_peered":"2024-01-25T15:00:57.291362+0000","last_clean":"2024-01-25T15:00:57.291362+0000","last_became_active":"2024-01-25T15:00:57.285194+0000","last_became_peered":"2024-01-25T15:00:57.285194+0000","last_unstale":"2024-01-25T15:00:57.291362+0000","last_undegraded":"2024-01-25T15:00:57.291362+0000","last_fullsized":"2024-01-25T15:00:57.291362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:49:16.627616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280498+0000","last_change":"2024-01-25T14:59:54.216918+0000","last_active":"2024-01-25T15:00:57.280498+0000","last_peered":"2024-01-25T15:00:57.280498+0000","last_clean":"2024-01-25T15:00:57.280498+0000","last_became_active":"2024-01-25T14:59:54.216283+0000","last_became_peered":"2024-01-25T14:59:54.216283+0000","last_unstale":"2024-01-25T15:00:57.280498+0000","last_undegraded":"2024-01-25T15:00:57.280498+0000","last_fullsized":"2024-01-25T15:00:57.280498+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:15:11.192764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280876+0000","last_change":"2024-01-25T14:59:53.207266+0000","last_active":"2024-01-25T15:00:57.280876+0000","last_peered":"2024-01-25T15:00:57.280876+0000","last_clean":"2024-01-25T15:00:57.280876+0000","last_became_active":"2024-01-25T14:59:53.206820+0000","last_became_peered":"2024-01-25T14:59:53.206820+0000","last_unstale":"2024-01-25T15:00:57.280876+0000","last_undegraded":"2024-01-25T15:00:57.280876+0000","last_fullsized":"2024-01-25T15:00:57.280876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:29:02.371577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281657+0000","last_change":"2024-01-25T14:59:54.210434+0000","last_active":"2024-01-25T15:00:57.281657+0000","last_peered":"2024-01-25T15:00:57.281657+0000","last_clean":"2024-01-25T15:00:57.281657+0000","last_became_active":"2024-01-25T14:59:54.210100+0000","last_became_peered":"2024-01-25T14:59:54.210100+0000","last_unstale":"2024-01-25T15:00:57.281657+0000","last_undegraded":"2024-01-25T15:00:57.281657+0000","last_fullsized":"2024-01-25T15:00:57.281657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:48:21.463712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":95,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:08.138286+0000","last_change":"2024-01-25T14:59:53.202938+0000","last_active":"2024-01-25T15:01:08.138286+0000","last_peered":"2024-01-25T15:01:08.138286+0000","last_clean":"2024-01-25T15:01:08.138286+0000","last_became_active":"2024-01-25T14:59:53.202638+0000","last_became_peered":"2024-01-25T14:59:53.202638+0000","last_unstale":"2024-01-25T15:01:08.138286+0000","last_undegraded":"2024-01-25T15:01:08.138286+0000","last_fullsized":"2024-01-25T15:01:08.138286+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.371375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":71,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281405+0000","last_change":"2024-01-25T14:59:54.219778+0000","last_active":"2024-01-25T15:00:57.281405+0000","last_peered":"2024-01-25T15:00:57.281405+0000","last_clean":"2024-01-25T15:00:57.281405+0000","last_became_active":"2024-01-25T14:59:54.219385+0000","last_became_peered":"2024-01-25T14:59:54.219385+0000","last_unstale":"2024-01-25T15:00:57.281405+0000","last_undegraded":"2024-01-25T15:00:57.281405+0000","last_fullsized":"2024-01-25T15:00:57.281405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:49:27.929024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284236+0000","last_change":"2024-01-25T14:59:54.209306+0000","last_active":"2024-01-25T15:00:57.284236+0000","last_peered":"2024-01-25T15:00:57.284236+0000","last_clean":"2024-01-25T15:00:57.284236+0000","last_became_active":"2024-01-25T14:59:54.208979+0000","last_became_peered":"2024-01-25T14:59:54.208979+0000","last_unstale":"2024-01-25T15:00:57.284236+0000","last_undegraded":"2024-01-25T15:00:57.284236+0000","last_fullsized":"2024-01-25T15:00:57.284236+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:23:46.763358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":96,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:07.135996+0000","last_change":"2024-01-25T14:59:53.200590+0000","last_active":"2024-01-25T15:01:07.135996+0000","last_peered":"2024-01-25T15:01:07.135996+0000","last_clean":"2024-01-25T15:01:07.135996+0000","last_became_active":"2024-01-25T14:59:53.200292+0000","last_became_peered":"2024-01-25T14:59:53.200292+0000","last_unstale":"2024-01-25T15:01:07.135996+0000","last_undegraded":"2024-01-25T15:01:07.135996+0000","last_fullsized":"2024-01-25T15:01:07.135996+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:02:05.135314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":72,"num_read_kb":72,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283892+0000","last_change":"2024-01-25T14:59:54.217765+0000","last_active":"2024-01-25T15:00:57.283892+0000","last_peered":"2024-01-25T15:00:57.283892+0000","last_clean":"2024-01-25T15:00:57.283892+0000","last_became_active":"2024-01-25T14:59:54.217433+0000","last_became_peered":"2024-01-25T14:59:54.217433+0000","last_unstale":"2024-01-25T15:00:57.283892+0000","last_undegraded":"2024-01-25T15:00:57.283892+0000","last_fullsized":"2024-01-25T15:00:57.283892+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:45:25.520091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279378+0000","last_change":"2024-01-25T14:59:53.197543+0000","last_active":"2024-01-25T15:00:57.279378+0000","last_peered":"2024-01-25T15:00:57.279378+0000","last_clean":"2024-01-25T15:00:57.279378+0000","last_became_active":"2024-01-25T14:59:53.197213+0000","last_became_peered":"2024-01-25T14:59:53.197213+0000","last_unstale":"2024-01-25T15:00:57.279378+0000","last_undegraded":"2024-01-25T15:00:57.279378+0000","last_fullsized":"2024-01-25T15:00:57.279378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:19:39.477948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":343,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282327+0000","last_change":"2024-01-25T14:58:41.034413+0000","last_active":"2024-01-25T15:00:57.282327+0000","last_peered":"2024-01-25T15:00:57.282327+0000","last_clean":"2024-01-25T15:00:57.282327+0000","last_became_active":"2024-01-25T14:58:41.033881+0000","last_became_peered":"2024-01-25T14:58:41.033881+0000","last_unstale":"2024-01-25T15:00:57.282327+0000","last_undegraded":"2024-01-25T15:00:57.282327+0000","last_fullsized":"2024-01-25T15:00:57.282327+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:55:22.974068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:55:22.974068+0000","last_clean_scrub_stamp":"2024-01-25T14:55:22.974068+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:05:30.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279055+0000","last_change":"2024-01-25T14:59:54.214713+0000","last_active":"2024-01-25T15:00:57.279055+0000","last_peered":"2024-01-25T15:00:57.279055+0000","last_clean":"2024-01-25T15:00:57.279055+0000","last_became_active":"2024-01-25T14:59:54.214348+0000","last_became_peered":"2024-01-25T14:59:54.214348+0000","last_unstale":"2024-01-25T15:00:57.279055+0000","last_undegraded":"2024-01-25T15:00:57.279055+0000","last_fullsized":"2024-01-25T15:00:57.279055+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:11:46.134755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282443+0000","last_change":"2024-01-25T14:59:53.202970+0000","last_active":"2024-01-25T15:00:57.282443+0000","last_peered":"2024-01-25T15:00:57.282443+0000","last_clean":"2024-01-25T15:00:57.282443+0000","last_became_active":"2024-01-25T14:59:53.202680+0000","last_became_peered":"2024-01-25T14:59:53.202680+0000","last_unstale":"2024-01-25T15:00:57.282443+0000","last_undegraded":"2024-01-25T15:00:57.282443+0000","last_fullsized":"2024-01-25T15:00:57.282443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:28:12.628390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278506+0000","last_change":"2024-01-25T14:59:53.210040+0000","last_active":"2024-01-25T15:00:57.278506+0000","last_peered":"2024-01-25T15:00:57.278506+0000","last_clean":"2024-01-25T15:00:57.278506+0000","last_became_active":"2024-01-25T14:59:53.209636+0000","last_became_peered":"2024-01-25T14:59:53.209636+0000","last_unstale":"2024-01-25T15:00:57.278506+0000","last_undegraded":"2024-01-25T15:00:57.278506+0000","last_fullsized":"2024-01-25T15:00:57.278506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:22:45.268969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279740+0000","last_change":"2024-01-25T14:59:54.203875+0000","last_active":"2024-01-25T15:00:57.279740+0000","last_peered":"2024-01-25T15:00:57.279740+0000","last_clean":"2024-01-25T15:00:57.279740+0000","last_became_active":"2024-01-25T14:59:54.203573+0000","last_became_peered":"2024-01-25T14:59:54.203573+0000","last_unstale":"2024-01-25T15:00:57.279740+0000","last_undegraded":"2024-01-25T15:00:57.279740+0000","last_fullsized":"2024-01-25T15:00:57.279740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:16:33.124186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'10","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.292346+0000","last_change":"2024-01-25T15:00:57.292346+0000","last_active":"2024-01-25T15:00:57.292346+0000","last_peered":"2024-01-25T15:00:57.292346+0000","last_clean":"2024-01-25T15:00:57.292346+0000","last_became_active":"2024-01-25T15:00:57.284921+0000","last_became_peered":"2024-01-25T15:00:57.284921+0000","last_unstale":"2024-01-25T15:00:57.292346+0000","last_undegraded":"2024-01-25T15:00:57.292346+0000","last_fullsized":"2024-01-25T15:00:57.292346+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:35:09.229129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284194+0000","last_change":"2024-01-25T14:59:54.212444+0000","last_active":"2024-01-25T15:00:57.284194+0000","last_peered":"2024-01-25T15:00:57.284194+0000","last_clean":"2024-01-25T15:00:57.284194+0000","last_became_active":"2024-01-25T14:59:54.212090+0000","last_became_peered":"2024-01-25T14:59:54.212090+0000","last_unstale":"2024-01-25T15:00:57.284194+0000","last_undegraded":"2024-01-25T15:00:57.284194+0000","last_fullsized":"2024-01-25T15:00:57.284194+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:27:26.416373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279589+0000","last_change":"2024-01-25T14:59:53.199984+0000","last_active":"2024-01-25T15:00:57.279589+0000","last_peered":"2024-01-25T15:00:57.279589+0000","last_clean":"2024-01-25T15:00:57.279589+0000","last_became_active":"2024-01-25T14:59:53.199674+0000","last_became_peered":"2024-01-25T14:59:53.199674+0000","last_unstale":"2024-01-25T15:00:57.279589+0000","last_undegraded":"2024-01-25T15:00:57.279589+0000","last_fullsized":"2024-01-25T15:00:57.279589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:22:01.521516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277901+0000","last_change":"2024-01-25T14:59:54.224285+0000","last_active":"2024-01-25T15:00:57.277901+0000","last_peered":"2024-01-25T15:00:57.277901+0000","last_clean":"2024-01-25T15:00:57.277901+0000","last_became_active":"2024-01-25T14:59:54.223904+0000","last_became_peered":"2024-01-25T14:59:54.223904+0000","last_unstale":"2024-01-25T15:00:57.277901+0000","last_undegraded":"2024-01-25T15:00:57.277901+0000","last_fullsized":"2024-01-25T15:00:57.277901+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:49:24.717733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284549+0000","last_change":"2024-01-25T14:59:53.203501+0000","last_active":"2024-01-25T15:00:57.284549+0000","last_peered":"2024-01-25T15:00:57.284549+0000","last_clean":"2024-01-25T15:00:57.284549+0000","last_became_active":"2024-01-25T14:59:53.203215+0000","last_became_peered":"2024-01-25T14:59:53.203215+0000","last_unstale":"2024-01-25T15:00:57.284549+0000","last_undegraded":"2024-01-25T15:00:57.284549+0000","last_fullsized":"2024-01-25T15:00:57.284549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:18:25.174639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278144+0000","last_change":"2024-01-25T14:59:54.219575+0000","last_active":"2024-01-25T15:00:57.278144+0000","last_peered":"2024-01-25T15:00:57.278144+0000","last_clean":"2024-01-25T15:00:57.278144+0000","last_became_active":"2024-01-25T14:59:54.219170+0000","last_became_peered":"2024-01-25T14:59:54.219170+0000","last_unstale":"2024-01-25T15:00:57.278144+0000","last_undegraded":"2024-01-25T15:00:57.278144+0000","last_fullsized":"2024-01-25T15:00:57.278144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:41.940927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283084+0000","last_change":"2024-01-25T14:59:53.203864+0000","last_active":"2024-01-25T15:00:57.283084+0000","last_peered":"2024-01-25T15:00:57.283084+0000","last_clean":"2024-01-25T15:00:57.283084+0000","last_became_active":"2024-01-25T14:59:53.203564+0000","last_became_peered":"2024-01-25T14:59:53.203564+0000","last_unstale":"2024-01-25T15:00:57.283084+0000","last_undegraded":"2024-01-25T15:00:57.283084+0000","last_fullsized":"2024-01-25T15:00:57.283084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:03:21.776910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280167+0000","last_change":"2024-01-25T14:59:54.217014+0000","last_active":"2024-01-25T15:00:57.280167+0000","last_peered":"2024-01-25T15:00:57.280167+0000","last_clean":"2024-01-25T15:00:57.280167+0000","last_became_active":"2024-01-25T14:59:54.216673+0000","last_became_peered":"2024-01-25T14:59:54.216673+0000","last_unstale":"2024-01-25T15:00:57.280167+0000","last_undegraded":"2024-01-25T15:00:57.280167+0000","last_fullsized":"2024-01-25T15:00:57.280167+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:46:31.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281990+0000","last_change":"2024-01-25T14:59:53.207297+0000","last_active":"2024-01-25T15:00:57.281990+0000","last_peered":"2024-01-25T15:00:57.281990+0000","last_clean":"2024-01-25T15:00:57.281990+0000","last_became_active":"2024-01-25T14:59:53.206968+0000","last_became_peered":"2024-01-25T14:59:53.206968+0000","last_unstale":"2024-01-25T15:00:57.281990+0000","last_undegraded":"2024-01-25T15:00:57.281990+0000","last_fullsized":"2024-01-25T15:00:57.281990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:01.679360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284156+0000","last_change":"2024-01-25T14:59:54.218890+0000","last_active":"2024-01-25T15:00:57.284156+0000","last_peered":"2024-01-25T15:00:57.284156+0000","last_clean":"2024-01-25T15:00:57.284156+0000","last_became_active":"2024-01-25T14:59:54.218581+0000","last_became_peered":"2024-01-25T14:59:54.218581+0000","last_unstale":"2024-01-25T15:00:57.284156+0000","last_undegraded":"2024-01-25T15:00:57.284156+0000","last_fullsized":"2024-01-25T15:00:57.284156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:13:07.383270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278450+0000","last_change":"2024-01-25T14:59:53.208219+0000","last_active":"2024-01-25T15:00:57.278450+0000","last_peered":"2024-01-25T15:00:57.278450+0000","last_clean":"2024-01-25T15:00:57.278450+0000","last_became_active":"2024-01-25T14:59:53.207878+0000","last_became_peered":"2024-01-25T14:59:53.207878+0000","last_unstale":"2024-01-25T15:00:57.278450+0000","last_undegraded":"2024-01-25T15:00:57.278450+0000","last_fullsized":"2024-01-25T15:00:57.278450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:03.410383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282926+0000","last_change":"2024-01-25T14:59:54.208996+0000","last_active":"2024-01-25T15:00:57.282926+0000","last_peered":"2024-01-25T15:00:57.282926+0000","last_clean":"2024-01-25T15:00:57.282926+0000","last_became_active":"2024-01-25T14:59:54.208658+0000","last_became_peered":"2024-01-25T14:59:54.208658+0000","last_unstale":"2024-01-25T15:00:57.282926+0000","last_undegraded":"2024-01-25T15:00:57.282926+0000","last_fullsized":"2024-01-25T15:00:57.282926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:39:57.752381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'5","reported_seq":93,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:05.136066+0000","last_change":"2024-01-25T14:59:53.207106+0000","last_active":"2024-01-25T15:01:05.136066+0000","last_peered":"2024-01-25T15:01:05.136066+0000","last_clean":"2024-01-25T15:01:05.136066+0000","last_became_active":"2024-01-25T14:59:53.206688+0000","last_became_peered":"2024-01-25T14:59:53.206688+0000","last_unstale":"2024-01-25T15:01:05.136066+0000","last_undegraded":"2024-01-25T15:01:05.136066+0000","last_fullsized":"2024-01-25T15:01:05.136066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:30:03.019791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":69,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283237+0000","last_change":"2024-01-25T14:59:54.208994+0000","last_active":"2024-01-25T15:00:57.283237+0000","last_peered":"2024-01-25T15:00:57.283237+0000","last_clean":"2024-01-25T15:00:57.283237+0000","last_became_active":"2024-01-25T14:59:54.208638+0000","last_became_peered":"2024-01-25T14:59:54.208638+0000","last_unstale":"2024-01-25T15:00:57.283237+0000","last_undegraded":"2024-01-25T15:00:57.283237+0000","last_fullsized":"2024-01-25T15:00:57.283237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:56.001501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283687+0000","last_change":"2024-01-25T14:59:53.207659+0000","last_active":"2024-01-25T15:00:57.283687+0000","last_peered":"2024-01-25T15:00:57.283687+0000","last_clean":"2024-01-25T15:00:57.283687+0000","last_became_active":"2024-01-25T14:59:53.207373+0000","last_became_peered":"2024-01-25T14:59:53.207373+0000","last_unstale":"2024-01-25T15:00:57.283687+0000","last_undegraded":"2024-01-25T15:00:57.283687+0000","last_fullsized":"2024-01-25T15:00:57.283687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:02:18.884192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282991+0000","last_change":"2024-01-25T14:59:54.210415+0000","last_active":"2024-01-25T15:00:57.282991+0000","last_peered":"2024-01-25T15:00:57.282991+0000","last_clean":"2024-01-25T15:00:57.282991+0000","last_became_active":"2024-01-25T14:59:54.210097+0000","last_became_peered":"2024-01-25T14:59:54.210097+0000","last_unstale":"2024-01-25T15:00:57.282991+0000","last_undegraded":"2024-01-25T15:00:57.282991+0000","last_fullsized":"2024-01-25T15:00:57.282991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:43:18.764375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279899+0000","last_change":"2024-01-25T14:59:53.203526+0000","last_active":"2024-01-25T15:00:57.279899+0000","last_peered":"2024-01-25T15:00:57.279899+0000","last_clean":"2024-01-25T15:00:57.279899+0000","last_became_active":"2024-01-25T14:59:53.203223+0000","last_became_peered":"2024-01-25T14:59:53.203223+0000","last_unstale":"2024-01-25T15:00:57.279899+0000","last_undegraded":"2024-01-25T15:00:57.279899+0000","last_fullsized":"2024-01-25T15:00:57.279899+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:35:06.014547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283471+0000","last_change":"2024-01-25T14:59:54.219053+0000","last_active":"2024-01-25T15:00:57.283471+0000","last_peered":"2024-01-25T15:00:57.283471+0000","last_clean":"2024-01-25T15:00:57.283471+0000","last_became_active":"2024-01-25T14:59:54.218733+0000","last_became_peered":"2024-01-25T14:59:54.218733+0000","last_unstale":"2024-01-25T15:00:57.283471+0000","last_undegraded":"2024-01-25T15:00:57.283471+0000","last_fullsized":"2024-01-25T15:00:57.283471+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:07:19.083352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280255+0000","last_change":"2024-01-25T14:59:54.210644+0000","last_active":"2024-01-25T15:00:57.280255+0000","last_peered":"2024-01-25T15:00:57.280255+0000","last_clean":"2024-01-25T15:00:57.280255+0000","last_became_active":"2024-01-25T14:59:54.210333+0000","last_became_peered":"2024-01-25T14:59:54.210333+0000","last_unstale":"2024-01-25T15:00:57.280255+0000","last_undegraded":"2024-01-25T15:00:57.280255+0000","last_fullsized":"2024-01-25T15:00:57.280255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:25:06.201952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.286523+0000","last_change":"2024-01-25T15:00:57.286523+0000","last_active":"2024-01-25T15:00:57.286523+0000","last_peered":"2024-01-25T15:00:57.286523+0000","last_clean":"2024-01-25T15:00:57.286523+0000","last_became_active":"2024-01-25T15:00:57.286115+0000","last_became_peered":"2024-01-25T15:00:57.286115+0000","last_unstale":"2024-01-25T15:00:57.286523+0000","last_undegraded":"2024-01-25T15:00:57.286523+0000","last_fullsized":"2024-01-25T15:00:57.286523+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:53:47.571571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281874+0000","last_change":"2024-01-25T14:59:54.218260+0000","last_active":"2024-01-25T15:00:57.281874+0000","last_peered":"2024-01-25T15:00:57.281874+0000","last_clean":"2024-01-25T15:00:57.281874+0000","last_became_active":"2024-01-25T14:59:54.217381+0000","last_became_peered":"2024-01-25T14:59:54.217381+0000","last_unstale":"2024-01-25T15:00:57.281874+0000","last_undegraded":"2024-01-25T15:00:57.281874+0000","last_fullsized":"2024-01-25T15:00:57.281874+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:36:09.631749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.277531+0000","last_change":"2024-01-25T14:59:54.224518+0000","last_active":"2024-01-25T15:00:57.277531+0000","last_peered":"2024-01-25T15:00:57.277531+0000","last_clean":"2024-01-25T15:00:57.277531+0000","last_became_active":"2024-01-25T14:59:54.224210+0000","last_became_peered":"2024-01-25T14:59:54.224210+0000","last_unstale":"2024-01-25T15:00:57.277531+0000","last_undegraded":"2024-01-25T15:00:57.277531+0000","last_fullsized":"2024-01-25T15:00:57.277531+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:33:56.670077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282096+0000","last_change":"2024-01-25T15:00:57.282096+0000","last_active":"2024-01-25T15:00:57.282096+0000","last_peered":"2024-01-25T15:00:57.282096+0000","last_clean":"2024-01-25T15:00:57.282096+0000","last_became_active":"2024-01-25T15:00:57.281725+0000","last_became_peered":"2024-01-25T15:00:57.281725+0000","last_unstale":"2024-01-25T15:00:57.282096+0000","last_undegraded":"2024-01-25T15:00:57.282096+0000","last_fullsized":"2024-01-25T15:00:57.282096+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:53:03.519667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280680+0000","last_change":"2024-01-25T14:59:54.217690+0000","last_active":"2024-01-25T15:00:57.280680+0000","last_peered":"2024-01-25T15:00:57.280680+0000","last_clean":"2024-01-25T15:00:57.280680+0000","last_became_active":"2024-01-25T14:59:54.217361+0000","last_became_peered":"2024-01-25T14:59:54.217361+0000","last_unstale":"2024-01-25T15:00:57.280680+0000","last_undegraded":"2024-01-25T15:00:57.280680+0000","last_fullsized":"2024-01-25T15:00:57.280680+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:30:15.893502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282590+0000","last_change":"2024-01-25T14:59:54.205201+0000","last_active":"2024-01-25T15:00:57.282590+0000","last_peered":"2024-01-25T15:00:57.282590+0000","last_clean":"2024-01-25T15:00:57.282590+0000","last_became_active":"2024-01-25T14:59:54.204893+0000","last_became_peered":"2024-01-25T14:59:54.204893+0000","last_unstale":"2024-01-25T15:00:57.282590+0000","last_undegraded":"2024-01-25T15:00:57.282590+0000","last_fullsized":"2024-01-25T15:00:57.282590+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:35:43.147029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284098+0000","last_change":"2024-01-25T14:59:54.210681+0000","last_active":"2024-01-25T15:00:57.284098+0000","last_peered":"2024-01-25T15:00:57.284098+0000","last_clean":"2024-01-25T15:00:57.284098+0000","last_became_active":"2024-01-25T14:59:54.210347+0000","last_became_peered":"2024-01-25T14:59:54.210347+0000","last_unstale":"2024-01-25T15:00:57.284098+0000","last_undegraded":"2024-01-25T15:00:57.284098+0000","last_fullsized":"2024-01-25T15:00:57.284098+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:44:12.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283660+0000","last_change":"2024-01-25T14:59:54.210792+0000","last_active":"2024-01-25T15:00:57.283660+0000","last_peered":"2024-01-25T15:00:57.283660+0000","last_clean":"2024-01-25T15:00:57.283660+0000","last_became_active":"2024-01-25T14:59:54.210416+0000","last_became_peered":"2024-01-25T14:59:54.210416+0000","last_unstale":"2024-01-25T15:00:57.283660+0000","last_undegraded":"2024-01-25T15:00:57.283660+0000","last_fullsized":"2024-01-25T15:00:57.283660+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:45.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282918+0000","last_change":"2024-01-25T14:59:54.204547+0000","last_active":"2024-01-25T15:00:57.282918+0000","last_peered":"2024-01-25T15:00:57.282918+0000","last_clean":"2024-01-25T15:00:57.282918+0000","last_became_active":"2024-01-25T14:59:54.204215+0000","last_became_peered":"2024-01-25T14:59:54.204215+0000","last_unstale":"2024-01-25T15:00:57.282918+0000","last_undegraded":"2024-01-25T15:00:57.282918+0000","last_fullsized":"2024-01-25T15:00:57.282918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:34:04.413137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284871+0000","last_change":"2024-01-25T14:59:54.211006+0000","last_active":"2024-01-25T15:00:57.284871+0000","last_peered":"2024-01-25T15:00:57.284871+0000","last_clean":"2024-01-25T15:00:57.284871+0000","last_became_active":"2024-01-25T14:59:54.210568+0000","last_became_peered":"2024-01-25T14:59:54.210568+0000","last_unstale":"2024-01-25T15:00:57.284871+0000","last_undegraded":"2024-01-25T15:00:57.284871+0000","last_fullsized":"2024-01-25T15:00:57.284871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:12:23.888827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279656+0000","last_change":"2024-01-25T14:59:54.220485+0000","last_active":"2024-01-25T15:00:57.279656+0000","last_peered":"2024-01-25T15:00:57.279656+0000","last_clean":"2024-01-25T15:00:57.279656+0000","last_became_active":"2024-01-25T14:59:54.219547+0000","last_became_peered":"2024-01-25T14:59:54.219547+0000","last_unstale":"2024-01-25T15:00:57.279656+0000","last_undegraded":"2024-01-25T15:00:57.279656+0000","last_fullsized":"2024-01-25T15:00:57.279656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:43:49.858263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280232+0000","last_change":"2024-01-25T14:59:54.217605+0000","last_active":"2024-01-25T15:00:57.280232+0000","last_peered":"2024-01-25T15:00:57.280232+0000","last_clean":"2024-01-25T15:00:57.280232+0000","last_became_active":"2024-01-25T14:59:54.217295+0000","last_became_peered":"2024-01-25T14:59:54.217295+0000","last_unstale":"2024-01-25T15:00:57.280232+0000","last_undegraded":"2024-01-25T15:00:57.280232+0000","last_fullsized":"2024-01-25T15:00:57.280232+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:27:59.846434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65143,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":719,"num_read_kb":431,"num_write":233,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58353,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":195429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383709,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":456311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.69699999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":1.444,"15min":1.444},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.53600000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93300000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.5,"15min":0.48199999999999998},"min":{"1min":0.40500000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.66300000000000003},"min":{"1min":0.58599999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.92700000000000005,"5min":1.079,"15min":1.079},"last":0.87},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61699999999999999,"15min":0.61099999999999999},"min":{"1min":0.496,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83999999999999997,"5min":1.387,"15min":1.387},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.42799999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.71999999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.58499999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97499999999999998,"5min":1.571,"15min":1.571},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.748,"15min":0.73399999999999999},"min":{"1min":0.72399999999999998,"5min":0.5,"15min":0.5},"max":{"1min":0.99099999999999999,"5min":1.129,"15min":1.129},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.70699999999999996,"15min":0.69799999999999995},"min":{"1min":0.55800000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91700000000000004,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.85299999999999998}]},{"osd":8,"last update":"Thu Jan 25 15:00:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.71299999999999997}]},{"osd":9,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75900000000000001,"15min":0.75800000000000001},"min":{"1min":0.65100000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94399999999999995,"5min":1.536,"15min":1.536},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.87,"5min":0.76600000000000001,"15min":0.749},"min":{"1min":0.71999999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.028,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.83099999999999996}]},{"osd":10,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.67200000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92300000000000004,"5min":1.101,"15min":1.101},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79600000000000004,"15min":0.79500000000000004},"min":{"1min":0.60899999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.004,"5min":1.603,"15min":1.603},"last":0.80200000000000005}]}]},{"osd":10,"up_from":72,"seq":309237645346,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1650688,"data_stored":1105649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49399999999999999,"15min":0.496},"min":{"1min":0.33600000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51600000000000001,"15min":0.51800000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.69299999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51200000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78900000000000003,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.42499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.873}]},{"osd":3,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.66200000000000003,"15min":0.66800000000000004},"min":{"1min":0.52600000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.77100000000000002,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.63600000000000001,"15min":0.64700000000000002},"min":{"1min":0.44,"5min":0.435,"15min":0.435},"max":{"1min":0.72399999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.78400000000000003,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58999999999999997,"15min":0.59399999999999997},"min":{"1min":0.41699999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72999999999999998,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66100000000000003},"min":{"1min":0.442,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84099999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69499999999999995,"15min":0.69599999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.87,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.748,"15min":0.76200000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89800000000000002,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.53300000000000003,"5min":0.499,"15min":0.499},"max":{"1min":0.84299999999999997,"5min":1.347,"15min":1.347},"last":0.90700000000000003}]},{"osd":7,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.45500000000000002}]},{"osd":8,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93700000000000006,"5min":1.282,"15min":1.282},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.752,"5min":0.79600000000000004,"15min":0.80300000000000005},"min":{"1min":0.50600000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.93300000000000005,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.83499999999999996}]},{"osd":9,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94699999999999995,"5min":1.262,"15min":1.262},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.81799999999999995,"15min":0.83099999999999996},"min":{"1min":0.57199999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.878,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.89100000000000001}]},{"osd":11,"last update":"Thu Jan 25 15:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.85799999999999998}]}]},{"osd":9,"up_from":67,"seq":287762808870,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":456219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.44800000000000001,"15min":0.45500000000000002},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57799999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.46200000000000002,"15min":0.47199999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53000000000000003,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.432,"5min":0.37,"15min":0.37},"max":{"1min":0.79600000000000004,"5min":0.875,"15min":0.875},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73899999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.622,"15min":0.63400000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76200000000000001,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.57099999999999995,"15min":0.58099999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.74099999999999999,"5min":1.012,"15min":1.012},"last":0.625}]},{"osd":3,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.51700000000000002,"15min":0.53200000000000003},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.61099999999999999,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.54400000000000004,"15min":0.55500000000000005},"min":{"1min":0.33100000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":0.876,"15min":0.876},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.314,"15min":0.314},"max":{"1min":0.78000000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.4419999999999999,"5min":0.82599999999999996,"15min":0.72299999999999998},"min":{"1min":0.39000000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":17.138999999999999,"5min":17.138999999999999,"15min":17.138999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":0.84899999999999998,"15min":0.749},"min":{"1min":0.46300000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":17.117000000000001,"5min":17.117000000000001,"15min":17.117000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.71699999999999997,"15min":0.73299999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.80900000000000005,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.55600000000000005}]},{"osd":6,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.66100000000000003,"15min":0.67900000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.77100000000000002,"5min":1.036,"15min":1.036},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.59999999999999998,"15min":0.61599999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69399999999999995,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.73899999999999999,"15min":0.75600000000000001},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85599999999999998,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.79100000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.89100000000000001,"5min":1.125,"15min":1.125},"last":0.52800000000000002}]},{"osd":8,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.496,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.83299999999999996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.745,"15min":0.76000000000000001},"min":{"1min":0.55900000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.77400000000000002,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.54000000000000004}]},{"osd":10,"last update":"Thu Jan 25 15:00:38 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.92600000000000005,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.503},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.91100000000000003,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.56499999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":8,"up_from":59,"seq":253403070507,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32128,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713024,"statfs":{"total":95995035648,"available":95962136576,"internally_reserved":0,"allocated":966656,"data_stored":456575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.438,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69499999999999995,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68300000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.60299999999999998,"15min":0.58699999999999997},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94299999999999995,"5min":1.008,"15min":1.008},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59699999999999998,"15min":0.58599999999999997},"min":{"1min":0.46300000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.81000000000000005}]},{"osd":2,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.39700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.65500000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.47799999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78500000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.56999999999999995}]},{"osd":4,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.49099999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91800000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.63600000000000001,"15min":0.627},"min":{"1min":0.59099999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.45700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.42799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80600000000000005,"5min":1.028,"15min":1.028},"last":0.441}]},{"osd":6,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.54600000000000004,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.751},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.51600000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86299999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.76200000000000001}]},{"osd":7,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.61199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88800000000000001,"5min":1.04,"15min":1.04},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.70899999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.995,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.88900000000000001}]},{"osd":9,"last update":"Thu Jan 25 15:00:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64400000000000002,"15min":0.63300000000000001},"min":{"1min":0.50900000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.52400000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.82599999999999996}]},{"osd":10,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.69599999999999995,"15min":0.67700000000000005},"min":{"1min":0.61499999999999999,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.59799999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.875}]},{"osd":11,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.77600000000000002}]}]},{"osd":7,"up_from":52,"seq":223338299441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32712,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712440,"statfs":{"total":95995035648,"available":95961538560,"internally_reserved":0,"allocated":1568768,"data_stored":1049114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.53200000000000003,"15min":0.51900000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 25 15:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.41199999999999998,"15min":0.40000000000000002},"min":{"1min":0.29599999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.60699999999999998,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45400000000000001,"15min":0.45600000000000002},"min":{"1min":0.27600000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.437}]},{"osd":2,"last update":"Thu Jan 25 15:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.68400000000000005,"15min":0.64100000000000001},"min":{"1min":0.38100000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80200000000000005,"5min":6.508,"15min":6.508},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.56899999999999995,"15min":0.55800000000000005},"min":{"1min":0.39600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.80100000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.626}]},{"osd":3,"last update":"Thu Jan 25 15:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57399999999999995,"15min":0.56699999999999995},"min":{"1min":0.39600000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.61799999999999999,"15min":0.61299999999999999},"min":{"1min":0.502,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.79800000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.755}]},{"osd":4,"last update":"Thu Jan 25 15:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.53000000000000003,"15min":0.53800000000000003},"min":{"1min":0.33200000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70099999999999996,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.77900000000000003,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.63600000000000001,"15min":0.625},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.622,"15min":0.61899999999999999},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 25 15:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.68300000000000005,"15min":0.68600000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.83899999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.89600000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.89700000000000002}]},{"osd":8,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69199999999999995,"15min":0.68400000000000005},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.79500000000000004,"15min":0.73299999999999998},"min":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.97099999999999997,"5min":6.5469999999999997,"15min":6.5469999999999997},"last":0.78900000000000003}]},{"osd":9,"last update":"Thu Jan 25 15:00:20 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.73399999999999999,"15min":0.73199999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93899999999999995,"5min":1.022,"15min":1.022},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.83999999999999997}]},{"osd":10,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0669999999999999,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.88300000000000001}]},{"osd":11,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.86699999999999999}]}]},{"osd":6,"up_from":46,"seq":197568495670,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40440,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704712,"statfs":{"total":95995035648,"available":95953625088,"internally_reserved":0,"allocated":958464,"data_stored":455936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39900000000000002,"15min":0.377},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.40400000000000003,"15min":0.377},"min":{"1min":0.27400000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.39200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56299999999999994,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55000000000000004,"15min":0.52400000000000002},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89100000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.432,"15min":0.42399999999999999},"min":{"1min":0.29099999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48099999999999998,"15min":0.46700000000000003},"min":{"1min":0.315,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.623,"5min":0.61599999999999999,"15min":0.58799999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61599999999999999,"15min":0.59599999999999997},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 25 15:00:28 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.66600000000000004,"15min":0.68300000000000005},"min":{"1min":0.40400000000000003,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.68899999999999995,"15min":0.69999999999999996},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.96099999999999997,"5min":1.04,"15min":1.04},"last":0.73099999999999998}]},{"osd":8,"last update":"Thu Jan 25 15:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67700000000000005,"15min":0.70599999999999996},"min":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89900000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.52700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.65200000000000002}]},{"osd":9,"last update":"Thu Jan 25 15:00:13 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.67500000000000004,"15min":0.68899999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.115,"5min":1.121,"15min":1.121},"last":0.624},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.69999999999999996,"15min":0.71599999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92600000000000005,"5min":1.147,"15min":1.147},"last":0.60899999999999999}]},{"osd":10,"last update":"Thu Jan 25 15:00:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.67400000000000004,"15min":0.67900000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.72599999999999998,"15min":0.73499999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.71599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":515180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.51900000000000002,"15min":0.48499999999999999},"min":{"1min":0.35199999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51200000000000001,"15min":0.48799999999999999},"min":{"1min":0.42099999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.73599999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:00:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.57099999999999995,"15min":0.503},"min":{"1min":0.36299999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.57899999999999996,"15min":0.52100000000000002},"min":{"1min":0.44700000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.69899999999999995}]},{"osd":3,"last update":"Thu Jan 25 15:00:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59499999999999997,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90300000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.56399999999999995,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78700000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.90300000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.43099999999999999,"15min":0.39100000000000001},"min":{"1min":0.29599999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.44,"15min":0.40400000000000003},"min":{"1min":0.26800000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.66300000000000003,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 25 15:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.627,"15min":0.58099999999999996},"min":{"1min":0.46600000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.63300000000000001,"15min":0.57299999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88100000000000001,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 25 15:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63100000000000001,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94399999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65200000000000002,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.99399999999999999}]},{"osd":7,"last update":"Thu Jan 25 15:00:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59699999999999998,"15min":0.57899999999999996},"min":{"1min":0.436,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80800000000000005,"5min":1.008,"15min":1.008},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65100000000000002,"15min":0.629},"min":{"1min":0.47799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.92200000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.91600000000000004}]},{"osd":8,"last update":"Thu Jan 25 15:00:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.755,"15min":0.73499999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.69299999999999995,"15min":0.67500000000000004},"min":{"1min":0.63900000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.80100000000000005}]},{"osd":9,"last update":"Thu Jan 25 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.57399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.90800000000000003,"5min":1.089,"15min":1.089},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77400000000000002,"15min":0.77300000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.94499999999999995,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.96199999999999997}]},{"osd":10,"last update":"Thu Jan 25 15:00:46 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.72899999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.81000000000000005,"15min":0.80600000000000005},"min":{"1min":0.54200000000000004,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0309999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.0169999999999999}]},{"osd":11,"last update":"Thu Jan 25 15:00:56 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":1.0669999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40460,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704692,"statfs":{"total":95995035648,"available":95953604608,"internally_reserved":0,"allocated":978944,"data_stored":457275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:00:10 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.52600000000000002,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.505},"min":{"1min":0.36699999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45500000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:00:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.50900000000000001},"min":{"1min":0.41499999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.373,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.62}]},{"osd":3,"last update":"Thu Jan 25 15:00:57 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.379},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 25 15:00:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.55100000000000005,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.313,"15min":0.313},"max":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.55400000000000005,"15min":0.52700000000000002},"min":{"1min":0.442,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.56399999999999995}]},{"osd":5,"last update":"Thu Jan 25 15:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":3.1869999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.56299999999999994,"15min":0.54700000000000004},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:00:10 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.51500000000000001,"15min":0.52400000000000002},"min":{"1min":0.309,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52400000000000002,"15min":0.505},"min":{"1min":0.36799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.55000000000000004}]},{"osd":7,"last update":"Thu Jan 25 14:59:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57699999999999996}]},{"osd":8,"last update":"Thu Jan 25 15:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66300000000000003,"15min":0.67000000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.69899999999999995},"min":{"1min":0.47699999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.71999999999999997}]},{"osd":9,"last update":"Thu Jan 25 15:00:18 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.61599999999999999,"15min":0.62},"min":{"1min":0.42299999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.40799999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.441}]},{"osd":10,"last update":"Thu Jan 25 15:00:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.54900000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.0700000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72299999999999998,"15min":0.72499999999999998},"min":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.294,"5min":1.294,"15min":1.294},"last":3.2029999999999998}]},{"osd":11,"last update":"Thu Jan 25 15:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1140000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72099999999999997,"15min":0.72399999999999998},"min":{"1min":0.58599999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.65700000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":457459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.505,"15min":0.497},"min":{"1min":0.33400000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51500000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67800000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.433}]},{"osd":1,"last update":"Thu Jan 25 15:00:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.54600000000000004,"15min":0.52000000000000002},"min":{"1min":0.39800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.55700000000000005,"15min":0.51500000000000001},"min":{"1min":0.505,"5min":0.311,"15min":0.311},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 25 15:00:48 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58399999999999996,"15min":0.53800000000000003},"min":{"1min":0.47099999999999997,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.83199999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.621},{"interface":"front","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.55000000000000004},"min":{"1min":0.45000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.755,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.56699999999999995}]},{"osd":4,"last update":"Thu Jan 25 15:00:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64200000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.44,"15min":0.40000000000000002},"min":{"1min":0.32500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.73999999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.47099999999999997,"15min":0.443},"min":{"1min":0.37,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.74199999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 25 15:00:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.58199999999999996,"15min":0.57799999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.70899999999999996,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.499},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86299999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60499999999999998}]},{"osd":7,"last update":"Thu Jan 25 14:59:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.76900000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67700000000000005,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.80500000000000005,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77500000000000002}]},{"osd":8,"last update":"Thu Jan 25 15:00:48 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60499999999999998,"15min":0.61199999999999999},"min":{"1min":0.435,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.90500000000000003,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.63400000000000001,"15min":0.64100000000000001},"min":{"1min":0.48399999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.93400000000000005,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.71199999999999997}]},{"osd":9,"last update":"Thu Jan 25 15:00:16 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82499999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69099999999999995,"15min":0.68999999999999995},"min":{"1min":0.47399999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.69599999999999995}]},{"osd":10,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.67900000000000005,"15min":0.66000000000000003},"min":{"1min":0.63300000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97299999999999998,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.68100000000000005,"15min":0.65900000000000003},"min":{"1min":0.60599999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.84899999999999998}]},{"osd":11,"last update":"Thu Jan 25 15:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.89300000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":455761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.34000000000000002},"min":{"1min":0.254,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.314},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.27200000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53700000000000003,"15min":0.51000000000000001},"min":{"1min":0.376,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54600000000000004,"15min":0.51000000000000001},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.753,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73899999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Jan 25 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55500000000000005,"15min":0.54800000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.72899999999999998,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59899999999999998,"15min":0.58699999999999997},"min":{"1min":0.39300000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.753,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.71199999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.495},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.68500000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.379}]},{"osd":6,"last update":"Thu Jan 25 15:00:05 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47599999999999998,"15min":0.46800000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.501,"15min":0.48099999999999998},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76600000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.46899999999999997}]},{"osd":7,"last update":"Thu Jan 25 15:00:25 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64800000000000002,"15min":0.64400000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76000000000000001,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63800000000000001,"15min":0.64400000000000002},"min":{"1min":0.47399999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54000000000000004}]},{"osd":8,"last update":"Thu Jan 25 14:59:53 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85899999999999999,"5min":0.872,"15min":0.872},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69599999999999995,"15min":0.69499999999999995},"min":{"1min":0.56799999999999995,"5min":0.5,"15min":0.5},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.61799999999999999}]},{"osd":9,"last update":"Thu Jan 25 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.67400000000000004,"15min":0.69399999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84099999999999997,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.70399999999999996,"15min":0.72299999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86099999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.625}]},{"osd":10,"last update":"Thu Jan 25 15:00:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.72399999999999998,"15min":0.72999999999999998},"min":{"1min":0.53000000000000003,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.84699999999999998,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65300000000000002,"15min":0.65500000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.76200000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58999999999999997}]},{"osd":11,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67300000000000004}]}]},{"osd":4,"up_from":33,"seq":141733920831,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1028096,"data_stored":514128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48599999999999999,"15min":0.47699999999999998},"min":{"1min":0.38100000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.82199999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 25 15:00:24 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.40699999999999997,"15min":0.38900000000000001},"min":{"1min":0.28799999999999998,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.41599999999999998,"15min":0.40100000000000002},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:00:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.54900000000000004,"15min":0.54000000000000004},"min":{"1min":0.371,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.60399999999999998,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85999999999999999,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.71799999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:00:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53600000000000003,"15min":0.50600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55600000000000005,"15min":0.54200000000000004},"min":{"1min":0.39400000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.46100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.753},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.39600000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Jan 25 15:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.56399999999999995},"min":{"1min":0.46400000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81000000000000005,"5min":0.879,"15min":0.879},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.36499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90700000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 25 15:00:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.58099999999999996,"15min":0.55100000000000005},"min":{"1min":0.35099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.626},{"interface":"front","average":{"1min":0.63,"5min":0.55600000000000005,"15min":0.52700000000000002},"min":{"1min":0.36199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.66100000000000003}]},{"osd":8,"last update":"Thu Jan 25 15:00:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.47699999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89400000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69899999999999995,"15min":0.67400000000000004},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96799999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.73999999999999999}]},{"osd":9,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.52000000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95699999999999996,"5min":1,"15min":1},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.76600000000000001,"15min":0.77000000000000002},"min":{"1min":0.55900000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.98099999999999998,"5min":1.044,"15min":1.044},"last":0.67700000000000005}]},{"osd":10,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98099999999999998,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.73199999999999998}]},{"osd":11,"last update":"Thu Jan 25 15:00:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.76000000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757306,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32728,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712424,"statfs":{"total":95995035648,"available":95961522176,"internally_reserved":0,"allocated":1581056,"data_stored":1048792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.34200000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.66600000000000004,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.82799999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.55200000000000005,"15min":0.52700000000000002},"min":{"1min":0.41399999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.54900000000000004,"15min":0.53600000000000003},"min":{"1min":0.36799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.81200000000000006,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.40600000000000003,"15min":0.39400000000000002},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.57499999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.374},{"interface":"front","average":{"1min":0.435,"5min":0.39500000000000002,"15min":0.38400000000000001},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.64000000000000001,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.55000000000000004,"15min":0.53500000000000003},"min":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.753,"5min":0.873,"15min":0.873},"last":0.437},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54100000000000004,"15min":0.54500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84099999999999997,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57399999999999995,"15min":0.55000000000000004},"min":{"1min":0.40400000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.47299999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.82699999999999996,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jan 25 15:01:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.58799999999999997},"min":{"1min":0.38500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.81699999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81399999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.46200000000000002}]},{"osd":7,"last update":"Thu Jan 25 15:00:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.63700000000000001,"15min":0.63100000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.62,"15min":0.61399999999999999},"min":{"1min":0.48599999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.91200000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.71599999999999997}]},{"osd":8,"last update":"Thu Jan 25 15:00:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83199999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79800000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.57199999999999995}]},{"osd":9,"last update":"Thu Jan 25 15:00:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65300000000000002,"15min":0.64400000000000002},"min":{"1min":0.496,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66000000000000003,"15min":0.65400000000000003},"min":{"1min":0.50800000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.93899999999999995,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.54300000000000004}]},{"osd":10,"last update":"Thu Jan 25 15:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.70599999999999996,"15min":0.69599999999999995},"min":{"1min":0.52900000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.69399999999999995,"15min":0.68400000000000005},"min":{"1min":0.57499999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":59031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:01:12.804 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-01-25T15:01:12.804 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-25T15:01:12.804 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-01-25T15:01:12.805 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph health --format=json 2024-01-25T15:01:13.042 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:01:13.466 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:13 smithi170 ceph-mon[31899]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:01:13.466 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:13 smithi170 ceph-mon[31899]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-25T15:01:13.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:13 smithi186 ceph-mon[35697]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:01:13.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:13 smithi186 ceph-mon[35697]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-25T15:01:13.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:13 smithi191 ceph-mon[36347]: from='client.14955 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:01:13.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:13 smithi191 ceph-mon[36347]: pgmap v325: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-25T15:01:14.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.855+0000 7f8b5c594700 1 -- 172.21.15.170:0/415325687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b5410e2c0 msgr2=0x7f8b541106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:14.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.855+0000 7f8b5c594700 1 --2- 172.21.15.170:0/415325687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b5410e2c0 0x7f8b541106b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009990 tx=0x7f8b50009ca0 comp rx=0 tx=0).stop 2024-01-25T15:01:14.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.856+0000 7f8b5c594700 1 -- 172.21.15.170:0/415325687 shutdown_connections 2024-01-25T15:01:14.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.856+0000 7f8b5c594700 1 --2- 172.21.15.170:0/415325687 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b5410e2c0 0x7f8b541106b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:14.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.856+0000 7f8b5c594700 1 --2- 172.21.15.170:0/415325687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b54069d20 0x7f8b5406a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:14.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.856+0000 7f8b5c594700 1 --2- 172.21.15.170:0/415325687 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b5406a640 0x7f8b5410dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:14.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.856+0000 7f8b5c594700 1 -- 172.21.15.170:0/415325687 >> 172.21.15.170:0/415325687 conn(0x7f8b54076730 msgr2=0x7f8b54076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:14.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.856+0000 7f8b5c594700 1 -- 172.21.15.170:0/415325687 shutdown_connections 2024-01-25T15:01:14.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.856+0000 7f8b5c594700 1 -- 172.21.15.170:0/415325687 wait complete. 2024-01-25T15:01:14.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.856+0000 7f8b5c594700 1 Processor -- start 2024-01-25T15:01:14.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.856+0000 7f8b5c594700 1 -- start start 2024-01-25T15:01:14.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.856+0000 7f8b5c594700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b54069d20 0x7f8b5419fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:14.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.856+0000 7f8b5c594700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b5406a640 0x7f8b5419ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:14.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.856+0000 7f8b5c594700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b5410e2c0 0x7f8b54199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:14.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.856+0000 7f8b5c594700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5419a2e0 con 0x7f8b5406a640 2024-01-25T15:01:14.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.856+0000 7f8b5c594700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5419a450 con 0x7f8b54069d20 2024-01-25T15:01:14.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.856+0000 7f8b5c594700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5419a610 con 0x7f8b5410e2c0 2024-01-25T15:01:14.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b59b2f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b5406a640 0x7f8b5419ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:14.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b59b2f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b5406a640 0x7f8b5419ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56556/0 (socket says 172.21.15.170:56556) 2024-01-25T15:01:14.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b59b2f700 1 -- 172.21.15.170:0/1591415581 learned_addr learned my addr 172.21.15.170:0/1591415581 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:14.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b5ab31700 1 --2- 172.21.15.170:0/1591415581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b5410e2c0 0x7f8b54199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:14.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b5a330700 1 --2- 172.21.15.170:0/1591415581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b54069d20 0x7f8b5419fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:14.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b59b2f700 1 -- 172.21.15.170:0/1591415581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b5410e2c0 msgr2=0x7f8b54199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:14.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b59b2f700 1 --2- 172.21.15.170:0/1591415581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b5410e2c0 0x7f8b54199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:14.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b59b2f700 1 -- 172.21.15.170:0/1591415581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b54069d20 msgr2=0x7f8b5419fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:14.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b59b2f700 1 --2- 172.21.15.170:0/1591415581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b54069d20 0x7f8b5419fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:14.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b59b2f700 1 -- 172.21.15.170:0/1591415581 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b500095f0 con 0x7f8b5406a640 2024-01-25T15:01:14.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b59b2f700 1 --2- 172.21.15.170:0/1591415581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b5406a640 0x7f8b5419ffa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400d950 tx=0x7f8b4400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:14.860 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b4b7fe700 1 -- 172.21.15.170:0/1591415581 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44009940 con 0x7f8b5406a640 2024-01-25T15:01:14.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b5c594700 1 -- 172.21.15.170:0/1591415581 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5419a8f0 con 0x7f8b5406a640 2024-01-25T15:01:14.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b4b7fe700 1 -- 172.21.15.170:0/1591415581 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b44010460 con 0x7f8b5406a640 2024-01-25T15:01:14.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b4b7fe700 1 -- 172.21.15.170:0/1591415581 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4400f620 con 0x7f8b5406a640 2024-01-25T15:01:14.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.857+0000 7f8b5c594700 1 -- 172.21.15.170:0/1591415581 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b541a6a30 con 0x7f8b5406a640 2024-01-25T15:01:14.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.858+0000 7f8b5c594700 1 -- 172.21.15.170:0/1591415581 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b54100cf0 con 0x7f8b5406a640 2024-01-25T15:01:14.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.859+0000 7f8b4b7fe700 1 -- 172.21.15.170:0/1591415581 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f8b440108d0 con 0x7f8b5406a640 2024-01-25T15:01:14.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.860+0000 7f8b4b7fe700 1 --2- 172.21.15.170:0/1591415581 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8b400a1400 0x7f8b400a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:14.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.860+0000 7f8b5a330700 1 --2- 172.21.15.170:0/1591415581 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8b400a1400 0x7f8b400a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:14.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.860+0000 7f8b4b7fe700 1 -- 172.21.15.170:0/1591415581 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f8b440cca80 con 0x7f8b5406a640 2024-01-25T15:01:14.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.860+0000 7f8b5a330700 1 --2- 172.21.15.170:0/1591415581 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8b400a1400 0x7f8b400a38c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00e270 tx=0x7f8b4c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:14.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:14.864+0000 7f8b4b7fe700 1 -- 172.21.15.170:0/1591415581 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f8b44095dd0 con 0x7f8b5406a640 2024-01-25T15:01:15.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.094+0000 7f8b5c594700 1 -- 172.21.15.170:0/1591415581 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8b54113910 con 0x7f8b5406a640 2024-01-25T15:01:15.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.095+0000 7f8b4b7fe700 1 -- 172.21.15.170:0/1591415581 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8b440993f0 con 0x7f8b5406a640 2024-01-25T15:01:15.096 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:15.096 INFO:teuthology.orchestra.run.smithi170.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-25T15:01:15.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.097+0000 7f8b5c594700 1 -- 172.21.15.170:0/1591415581 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8b400a1400 msgr2=0x7f8b400a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:15.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.097+0000 7f8b5c594700 1 --2- 172.21.15.170:0/1591415581 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8b400a1400 0x7f8b400a38c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00e270 tx=0x7f8b4c009040 comp rx=0 tx=0).stop 2024-01-25T15:01:15.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.097+0000 7f8b5c594700 1 -- 172.21.15.170:0/1591415581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b5406a640 msgr2=0x7f8b5419ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:15.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.097+0000 7f8b5c594700 1 --2- 172.21.15.170:0/1591415581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b5406a640 0x7f8b5419ffa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400d950 tx=0x7f8b4400dc60 comp rx=0 tx=0).stop 2024-01-25T15:01:15.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.097+0000 7f8b5c594700 1 -- 172.21.15.170:0/1591415581 shutdown_connections 2024-01-25T15:01:15.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.097+0000 7f8b5c594700 1 --2- 172.21.15.170:0/1591415581 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8b400a1400 0x7f8b400a38c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:15.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.097+0000 7f8b5c594700 1 --2- 172.21.15.170:0/1591415581 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b5410e2c0 0x7f8b54199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:15.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.097+0000 7f8b5c594700 1 --2- 172.21.15.170:0/1591415581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b54069d20 0x7f8b5419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:15.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.097+0000 7f8b5c594700 1 --2- 172.21.15.170:0/1591415581 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b5406a640 0x7f8b5419ffa0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:15.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.097+0000 7f8b5c594700 1 -- 172.21.15.170:0/1591415581 >> 172.21.15.170:0/1591415581 conn(0x7f8b54076730 msgr2=0x7f8b5410f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:15.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.097+0000 7f8b5c594700 1 -- 172.21.15.170:0/1591415581 shutdown_connections 2024-01-25T15:01:15.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.097+0000 7f8b5c594700 1 -- 172.21.15.170:0/1591415581 wait complete. 2024-01-25T15:01:15.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:15 smithi170 ceph-mon[31899]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-01-25T15:01:15.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:15 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1591415581' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-01-25T15:01:15.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:15 smithi186 ceph-mon[35697]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-01-25T15:01:15.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:15 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1591415581' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-01-25T15:01:15.720 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-01-25T15:01:15.721 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:01:15.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:15 smithi191 ceph-mon[36347]: pgmap v326: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-01-25T15:01:15.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:15 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1591415581' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-01-25T15:01:15.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.826+0000 7f9b0d7b6640 1 -- 172.21.15.170:0/981652355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b081017e0 msgr2=0x7f9b08108070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:15.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.826+0000 7f9b0d7b6640 1 --2- 172.21.15.170:0/981652355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b081017e0 0x7f9b08108070 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009ca0 tx=0x7f9b0002c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:15.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.826+0000 7f9b0d7b6640 1 -- 172.21.15.170:0/981652355 shutdown_connections 2024-01-25T15:01:15.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.826+0000 7f9b0d7b6640 1 --2- 172.21.15.170:0/981652355 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b08100e20 0x7f9b081012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:15.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.826+0000 7f9b0d7b6640 1 --2- 172.21.15.170:0/981652355 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b081017e0 0x7f9b08108070 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:15.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.826+0000 7f9b0d7b6640 1 --2- 172.21.15.170:0/981652355 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b080ffc30 0x7f9b08100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:15.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.826+0000 7f9b0d7b6640 1 -- 172.21.15.170:0/981652355 >> 172.21.15.170:0/981652355 conn(0x7f9b080fb1a0 msgr2=0x7f9b080fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:15.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.826+0000 7f9b0d7b6640 1 -- 172.21.15.170:0/981652355 shutdown_connections 2024-01-25T15:01:15.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.827+0000 7f9b0d7b6640 1 -- 172.21.15.170:0/981652355 wait complete. 2024-01-25T15:01:15.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.827+0000 7f9b0d7b6640 1 Processor -- start 2024-01-25T15:01:15.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.827+0000 7f9b0d7b6640 1 -- start start 2024-01-25T15:01:15.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.827+0000 7f9b0d7b6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b080ffc30 0x7f9b08196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:15.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.827+0000 7f9b0d7b6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b08100e20 0x7f9b081971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:15.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.827+0000 7f9b0d7b6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b081017e0 0x7f9b0819e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:15.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.827+0000 7f9b0d7b6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0819e7a0 con 0x7f9b08100e20 2024-01-25T15:01:15.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.827+0000 7f9b0d7b6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0819e910 con 0x7f9b081017e0 2024-01-25T15:01:15.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.827+0000 7f9b0d7b6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0819ead0 con 0x7f9b080ffc30 2024-01-25T15:01:15.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.827+0000 7f9b067fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b08100e20 0x7f9b081971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:15.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.827+0000 7f9b067fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b08100e20 0x7f9b081971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53734/0 (socket says 172.21.15.170:53734) 2024-01-25T15:01:15.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.827+0000 7f9b067fc640 1 -- 172.21.15.170:0/869330647 learned_addr learned my addr 172.21.15.170:0/869330647 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:15.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.828+0000 7f9b06ffd640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b080ffc30 0x7f9b08196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:15.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.828+0000 7f9b077fe640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b081017e0 0x7f9b0819e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:15.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.828+0000 7f9b067fc640 1 -- 172.21.15.170:0/869330647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b080ffc30 msgr2=0x7f9b08196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:15.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.828+0000 7f9b067fc640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b080ffc30 0x7f9b08196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:15.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.828+0000 7f9b067fc640 1 -- 172.21.15.170:0/869330647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b081017e0 msgr2=0x7f9b0819e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:15.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.828+0000 7f9b067fc640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b081017e0 0x7f9b0819e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:15.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.828+0000 7f9b067fc640 1 -- 172.21.15.170:0/869330647 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b00009900 con 0x7f9b08100e20 2024-01-25T15:01:15.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.828+0000 7f9b06ffd640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b080ffc30 0x7f9b08196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:15.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.828+0000 7f9b077fe640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b081017e0 0x7f9b0819e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:15.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.828+0000 7f9b067fc640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b08100e20 0x7f9b081971d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00d950 tx=0x7f9afc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:15.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.828+0000 7f9aeffff640 1 -- 172.21.15.170:0/869330647 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc009c30 con 0x7f9b08100e20 2024-01-25T15:01:15.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.828+0000 7f9b0d7b6640 1 -- 172.21.15.170:0/869330647 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0819edb0 con 0x7f9b08100e20 2024-01-25T15:01:15.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.828+0000 7f9aeffff640 1 -- 172.21.15.170:0/869330647 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9afc009d90 con 0x7f9b08100e20 2024-01-25T15:01:15.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.828+0000 7f9aeffff640 1 -- 172.21.15.170:0/869330647 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc00f740 con 0x7f9b08100e20 2024-01-25T15:01:15.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.828+0000 7f9b0d7b6640 1 -- 172.21.15.170:0/869330647 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0819f280 con 0x7f9b08100e20 2024-01-25T15:01:15.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.829+0000 7f9b0d7b6640 1 -- 172.21.15.170:0/869330647 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b08106f50 con 0x7f9b08100e20 2024-01-25T15:01:15.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.830+0000 7f9aeffff640 1 -- 172.21.15.170:0/869330647 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f9afc010a20 con 0x7f9b08100e20 2024-01-25T15:01:15.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.830+0000 7f9aeffff640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9af00a1370 0x7f9af00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:15.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.831+0000 7f9b06ffd640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9af00a1370 0x7f9af00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:15.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.831+0000 7f9aeffff640 1 -- 172.21.15.170:0/869330647 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f9afc0cc9d0 con 0x7f9b08100e20 2024-01-25T15:01:15.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.831+0000 7f9b06ffd640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9af00a1370 0x7f9af00a3830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9af8005fd0 tx=0x7f9af8005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:15.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:15.835+0000 7f9aeffff640 1 -- 172.21.15.170:0/869330647 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f9afc095d20 con 0x7f9b08100e20 2024-01-25T15:01:16.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.008+0000 7f9b0d7b6640 1 -- 172.21.15.170:0/869330647 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b0802cb40 con 0x7f9b08100e20 2024-01-25T15:01:16.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.010+0000 7f9aeffff640 1 -- 172.21.15.170:0/869330647 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22550 (secure 0 0 0) 0x7f9afc099340 con 0x7f9b08100e20 2024-01-25T15:01:16.012 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:16.012 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":87,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T15:00:57.274280+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:01:16.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.012+0000 7f9b0d7b6640 1 -- 172.21.15.170:0/869330647 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9af00a1370 msgr2=0x7f9af00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.012+0000 7f9b0d7b6640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9af00a1370 0x7f9af00a3830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9af8005fd0 tx=0x7f9af8005ee0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.012+0000 7f9b0d7b6640 1 -- 172.21.15.170:0/869330647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b08100e20 msgr2=0x7f9b081971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.012+0000 7f9b0d7b6640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b08100e20 0x7f9b081971d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00d950 tx=0x7f9afc00de10 comp rx=0 tx=0).stop 2024-01-25T15:01:16.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.012+0000 7f9b0d7b6640 1 -- 172.21.15.170:0/869330647 shutdown_connections 2024-01-25T15:01:16.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.012+0000 7f9b0d7b6640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9af00a1370 0x7f9af00a3830 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.012+0000 7f9b0d7b6640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b081017e0 0x7f9b0819e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.012+0000 7f9b0d7b6640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9b08100e20 0x7f9b081971d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.012+0000 7f9b0d7b6640 1 --2- 172.21.15.170:0/869330647 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9b080ffc30 0x7f9b08196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.012+0000 7f9b0d7b6640 1 -- 172.21.15.170:0/869330647 >> 172.21.15.170:0/869330647 conn(0x7f9b080fb1a0 msgr2=0x7f9b08104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:16.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.012+0000 7f9b0d7b6640 1 -- 172.21.15.170:0/869330647 shutdown_connections 2024-01-25T15:01:16.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.012+0000 7f9b0d7b6640 1 -- 172.21.15.170:0/869330647 wait complete. 2024-01-25T15:01:16.024 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T14:55:22.432727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T14:59:51.465304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T14:59:52.749298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:01:16.025 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:01:16.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.129+0000 7f77996d4640 1 -- 172.21.15.170:0/2227088448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7794100de0 msgr2=0x7f7794101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.129+0000 7f77996d4640 1 --2- 172.21.15.170:0/2227088448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7794100de0 0x7f7794101260 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7788009900 tx=0x7f778802bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:16.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.129+0000 7f77996d4640 1 -- 172.21.15.170:0/2227088448 shutdown_connections 2024-01-25T15:01:16.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.129+0000 7f77996d4640 1 --2- 172.21.15.170:0/2227088448 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77941017a0 0x7f7794108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.129+0000 7f77996d4640 1 --2- 172.21.15.170:0/2227088448 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7794100de0 0x7f7794101260 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.129+0000 7f77996d4640 1 --2- 172.21.15.170:0/2227088448 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77940ffbf0 0x7f7794100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.129+0000 7f77996d4640 1 -- 172.21.15.170:0/2227088448 >> 172.21.15.170:0/2227088448 conn(0x7f77940fb180 msgr2=0x7f77940fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:16.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.129+0000 7f77996d4640 1 -- 172.21.15.170:0/2227088448 shutdown_connections 2024-01-25T15:01:16.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.129+0000 7f77996d4640 1 -- 172.21.15.170:0/2227088448 wait complete. 2024-01-25T15:01:16.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.130+0000 7f77996d4640 1 Processor -- start 2024-01-25T15:01:16.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.130+0000 7f77996d4640 1 -- start start 2024-01-25T15:01:16.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.130+0000 7f77996d4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77940ffbf0 0x7f77940689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:16.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.130+0000 7f77996d4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7794100de0 0x7f779419bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:16.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.130+0000 7f77996d4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77941017a0 0x7f779419e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:16.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.130+0000 7f77996d4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779419e990 con 0x7f7794100de0 2024-01-25T15:01:16.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.130+0000 7f77996d4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779419eb00 con 0x7f77941017a0 2024-01-25T15:01:16.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.130+0000 7f77996d4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779419ecc0 con 0x7f77940ffbf0 2024-01-25T15:01:16.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.130+0000 7f77927fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7794100de0 0x7f779419bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:16.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.130+0000 7f77927fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7794100de0 0x7f779419bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53746/0 (socket says 172.21.15.170:53746) 2024-01-25T15:01:16.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.130+0000 7f77927fc640 1 -- 172.21.15.170:0/3810161216 learned_addr learned my addr 172.21.15.170:0/3810161216 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:16.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.131+0000 7f77927fc640 1 -- 172.21.15.170:0/3810161216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77940ffbf0 msgr2=0x7f77940689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.131+0000 7f77927fc640 1 --2- 172.21.15.170:0/3810161216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77940ffbf0 0x7f77940689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.131+0000 7f77927fc640 1 -- 172.21.15.170:0/3810161216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77941017a0 msgr2=0x7f779419e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.131+0000 7f77927fc640 1 --2- 172.21.15.170:0/3810161216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77941017a0 0x7f779419e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.131+0000 7f77927fc640 1 -- 172.21.15.170:0/3810161216 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7788009560 con 0x7f7794100de0 2024-01-25T15:01:16.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.131+0000 7f77927fc640 1 --2- 172.21.15.170:0/3810161216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7794100de0 0x7f779419bbc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7788009230 tx=0x7f77880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:16.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.131+0000 7f777bfff640 1 -- 172.21.15.170:0/3810161216 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77880044e0 con 0x7f7794100de0 2024-01-25T15:01:16.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.131+0000 7f777bfff640 1 -- 172.21.15.170:0/3810161216 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77880035f0 con 0x7f7794100de0 2024-01-25T15:01:16.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.131+0000 7f77996d4640 1 -- 172.21.15.170:0/3810161216 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779419ef40 con 0x7f7794100de0 2024-01-25T15:01:16.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.131+0000 7f777bfff640 1 -- 172.21.15.170:0/3810161216 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778803e6b0 con 0x7f7794100de0 2024-01-25T15:01:16.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.131+0000 7f77996d4640 1 -- 172.21.15.170:0/3810161216 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779419f440 con 0x7f7794100de0 2024-01-25T15:01:16.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.132+0000 7f77996d4640 1 -- 172.21.15.170:0/3810161216 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77941070d0 con 0x7f7794100de0 2024-01-25T15:01:16.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.133+0000 7f777bfff640 1 -- 172.21.15.170:0/3810161216 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f7788003960 con 0x7f7794100de0 2024-01-25T15:01:16.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.134+0000 7f777bfff640 1 --2- 172.21.15.170:0/3810161216 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f777c0a1370 0x7f777c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:16.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.134+0000 7f7792ffd640 1 --2- 172.21.15.170:0/3810161216 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f777c0a1370 0x7f777c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:16.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.134+0000 7f777bfff640 1 -- 172.21.15.170:0/3810161216 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f77880ef7c0 con 0x7f7794100de0 2024-01-25T15:01:16.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.134+0000 7f7792ffd640 1 --2- 172.21.15.170:0/3810161216 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f777c0a1370 0x7f777c0a3830 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7794100c40 tx=0x7f7784009250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:16.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.138+0000 7f777bfff640 1 -- 172.21.15.170:0/3810161216 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f77880b8d40 con 0x7f7794100de0 2024-01-25T15:01:16.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.311+0000 7f77996d4640 1 -- 172.21.15.170:0/3810161216 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f779402cb50 con 0x7f7794100de0 2024-01-25T15:01:16.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.311+0000 7f777bfff640 1 -- 172.21.15.170:0/3810161216 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7788043020 con 0x7f7794100de0 2024-01-25T15:01:16.312 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 1 2024-01-25T15:01:16.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.313+0000 7f77996d4640 1 -- 172.21.15.170:0/3810161216 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f777c0a1370 msgr2=0x7f777c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.313+0000 7f77996d4640 1 --2- 172.21.15.170:0/3810161216 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f777c0a1370 0x7f777c0a3830 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7794100c40 tx=0x7f7784009250 comp rx=0 tx=0).stop 2024-01-25T15:01:16.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.313+0000 7f77996d4640 1 -- 172.21.15.170:0/3810161216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7794100de0 msgr2=0x7f779419bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.313+0000 7f77996d4640 1 --2- 172.21.15.170:0/3810161216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7794100de0 0x7f779419bbc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7788009230 tx=0x7f77880042f0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.313+0000 7f77996d4640 1 -- 172.21.15.170:0/3810161216 shutdown_connections 2024-01-25T15:01:16.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.313+0000 7f77996d4640 1 --2- 172.21.15.170:0/3810161216 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f777c0a1370 0x7f777c0a3830 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.313+0000 7f77996d4640 1 --2- 172.21.15.170:0/3810161216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f77941017a0 0x7f779419e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.313+0000 7f77996d4640 1 --2- 172.21.15.170:0/3810161216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7794100de0 0x7f779419bbc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.313+0000 7f77996d4640 1 --2- 172.21.15.170:0/3810161216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f77940ffbf0 0x7f77940689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.313+0000 7f77996d4640 1 -- 172.21.15.170:0/3810161216 >> 172.21.15.170:0/3810161216 conn(0x7f77940fb180 msgr2=0x7f77941042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:16.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.313+0000 7f77996d4640 1 -- 172.21.15.170:0/3810161216 shutdown_connections 2024-01-25T15:01:16.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.313+0000 7f77996d4640 1 -- 172.21.15.170:0/3810161216 wait complete. 2024-01-25T15:01:16.324 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:16 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/869330647' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:16.325 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:01:16.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.429+0000 7fa3447c3640 1 -- 172.21.15.170:0/1953893402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa33c0ffc00 msgr2=0x7fa33c100020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.429+0000 7fa3447c3640 1 --2- 172.21.15.170:0/1953893402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa33c0ffc00 0x7fa33c100020 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa334009ca0 tx=0x7fa33402c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.429+0000 7fa3447c3640 1 -- 172.21.15.170:0/1953893402 shutdown_connections 2024-01-25T15:01:16.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.429+0000 7fa3447c3640 1 --2- 172.21.15.170:0/1953893402 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa33c100df0 0x7fa33c101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.429+0000 7fa3447c3640 1 --2- 172.21.15.170:0/1953893402 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa33c1017b0 0x7fa33c108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.429+0000 7fa3447c3640 1 --2- 172.21.15.170:0/1953893402 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa33c0ffc00 0x7fa33c100020 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.429+0000 7fa3447c3640 1 -- 172.21.15.170:0/1953893402 >> 172.21.15.170:0/1953893402 conn(0x7fa33c0fb190 msgr2=0x7fa33c0fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:16.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.429+0000 7fa3447c3640 1 -- 172.21.15.170:0/1953893402 shutdown_connections 2024-01-25T15:01:16.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.429+0000 7fa3447c3640 1 -- 172.21.15.170:0/1953893402 wait complete. 2024-01-25T15:01:16.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.429+0000 7fa3447c3640 1 Processor -- start 2024-01-25T15:01:16.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.429+0000 7fa3447c3640 1 -- start start 2024-01-25T15:01:16.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.429+0000 7fa3447c3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa33c0ffc00 0x7fa33c196d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:16.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.429+0000 7fa3447c3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa33c100df0 0x7fa33c1972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:16.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.429+0000 7fa3447c3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa33c1017b0 0x7fa33c19e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:16.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.429+0000 7fa3447c3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c19e860 con 0x7fa33c100df0 2024-01-25T15:01:16.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa3447c3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c19e9d0 con 0x7fa33c1017b0 2024-01-25T15:01:16.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa3447c3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33c19eb90 con 0x7fa33c0ffc00 2024-01-25T15:01:16.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa341d5e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa33c100df0 0x7fa33c1972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:16.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa341d5e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa33c100df0 0x7fa33c1972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53770/0 (socket says 172.21.15.170:53770) 2024-01-25T15:01:16.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa341d5e640 1 -- 172.21.15.170:0/2140840112 learned_addr learned my addr 172.21.15.170:0/2140840112 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:16.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa341d5e640 1 -- 172.21.15.170:0/2140840112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa33c0ffc00 msgr2=0x7fa33c196d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa341d5e640 1 --2- 172.21.15.170:0/2140840112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa33c0ffc00 0x7fa33c196d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa341d5e640 1 -- 172.21.15.170:0/2140840112 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa33c1017b0 msgr2=0x7fa33c19e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa341d5e640 1 --2- 172.21.15.170:0/2140840112 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa33c1017b0 0x7fa33c19e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa341d5e640 1 -- 172.21.15.170:0/2140840112 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa334009900 con 0x7fa33c100df0 2024-01-25T15:01:16.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa341d5e640 1 --2- 172.21.15.170:0/2140840112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa33c100df0 0x7fa33c1972b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa33000d950 tx=0x7fa33000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:16.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa33b7fe640 1 -- 172.21.15.170:0/2140840112 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330009c30 con 0x7fa33c100df0 2024-01-25T15:01:16.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa3447c3640 1 -- 172.21.15.170:0/2140840112 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa33c19ee70 con 0x7fa33c100df0 2024-01-25T15:01:16.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa33b7fe640 1 -- 172.21.15.170:0/2140840112 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa330009d90 con 0x7fa33c100df0 2024-01-25T15:01:16.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa33b7fe640 1 -- 172.21.15.170:0/2140840112 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33000f740 con 0x7fa33c100df0 2024-01-25T15:01:16.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.430+0000 7fa3447c3640 1 -- 172.21.15.170:0/2140840112 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33c19f370 con 0x7fa33c100df0 2024-01-25T15:01:16.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.431+0000 7fa3447c3640 1 -- 172.21.15.170:0/2140840112 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33c107090 con 0x7fa33c100df0 2024-01-25T15:01:16.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.432+0000 7fa33b7fe640 1 -- 172.21.15.170:0/2140840112 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fa330010a20 con 0x7fa33c100df0 2024-01-25T15:01:16.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.433+0000 7fa33b7fe640 1 --2- 172.21.15.170:0/2140840112 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa3240a1370 0x7fa3240a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:16.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.433+0000 7fa34255f640 1 --2- 172.21.15.170:0/2140840112 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa3240a1370 0x7fa3240a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:16.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.433+0000 7fa33b7fe640 1 -- 172.21.15.170:0/2140840112 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fa3300cc9a0 con 0x7fa33c100df0 2024-01-25T15:01:16.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.433+0000 7fa34255f640 1 --2- 172.21.15.170:0/2140840112 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa3240a1370 0x7fa3240a3830 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa334006010 tx=0x7fa334009890 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:16.437 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.437+0000 7fa33b7fe640 1 -- 172.21.15.170:0/2140840112 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa330095c90 con 0x7fa33c100df0 2024-01-25T15:01:16.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:16 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/869330647' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:16.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.608+0000 7fa3447c3640 1 -- 172.21.15.170:0/2140840112 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa33c10c7a0 con 0x7fa33c100df0 2024-01-25T15:01:16.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.609+0000 7fa33b7fe640 1 -- 172.21.15.170:0/2140840112 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa330020020 con 0x7fa33c100df0 2024-01-25T15:01:16.610 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 32 2024-01-25T15:01:16.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.611+0000 7fa3447c3640 1 -- 172.21.15.170:0/2140840112 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa3240a1370 msgr2=0x7fa3240a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.611+0000 7fa3447c3640 1 --2- 172.21.15.170:0/2140840112 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa3240a1370 0x7fa3240a3830 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa334006010 tx=0x7fa334009890 comp rx=0 tx=0).stop 2024-01-25T15:01:16.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.611+0000 7fa3447c3640 1 -- 172.21.15.170:0/2140840112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa33c100df0 msgr2=0x7fa33c1972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.611+0000 7fa3447c3640 1 --2- 172.21.15.170:0/2140840112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa33c100df0 0x7fa33c1972b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa33000d950 tx=0x7fa33000de10 comp rx=0 tx=0).stop 2024-01-25T15:01:16.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.611+0000 7fa3447c3640 1 -- 172.21.15.170:0/2140840112 shutdown_connections 2024-01-25T15:01:16.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.611+0000 7fa3447c3640 1 --2- 172.21.15.170:0/2140840112 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa3240a1370 0x7fa3240a3830 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.611+0000 7fa3447c3640 1 --2- 172.21.15.170:0/2140840112 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa33c1017b0 0x7fa33c19e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.611+0000 7fa3447c3640 1 --2- 172.21.15.170:0/2140840112 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa33c100df0 0x7fa33c1972b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.611+0000 7fa3447c3640 1 --2- 172.21.15.170:0/2140840112 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa33c0ffc00 0x7fa33c196d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.611+0000 7fa3447c3640 1 -- 172.21.15.170:0/2140840112 >> 172.21.15.170:0/2140840112 conn(0x7fa33c0fb190 msgr2=0x7fa33c104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:16.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.611+0000 7fa3447c3640 1 -- 172.21.15.170:0/2140840112 shutdown_connections 2024-01-25T15:01:16.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.611+0000 7fa3447c3640 1 -- 172.21.15.170:0/2140840112 wait complete. 2024-01-25T15:01:16.623 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:01:16.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.727+0000 7f8b1b3c5640 1 -- 172.21.15.170:0/1050319160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b141017a0 msgr2=0x7f8b14108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.727+0000 7f8b1b3c5640 1 --2- 172.21.15.170:0/1050319160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b141017a0 0x7f8b14108030 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c009ca0 tx=0x7f8b0c02c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.727+0000 7f8b1b3c5640 1 -- 172.21.15.170:0/1050319160 shutdown_connections 2024-01-25T15:01:16.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.727+0000 7f8b1b3c5640 1 --2- 172.21.15.170:0/1050319160 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b141017a0 0x7f8b14108030 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.727+0000 7f8b1b3c5640 1 --2- 172.21.15.170:0/1050319160 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b14100de0 0x7f8b14101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.727+0000 7f8b1b3c5640 1 --2- 172.21.15.170:0/1050319160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b140ffbf0 0x7f8b14100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.727+0000 7f8b1b3c5640 1 -- 172.21.15.170:0/1050319160 >> 172.21.15.170:0/1050319160 conn(0x7f8b140fb180 msgr2=0x7f8b140fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:16.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.728+0000 7f8b1b3c5640 1 -- 172.21.15.170:0/1050319160 shutdown_connections 2024-01-25T15:01:16.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.728+0000 7f8b1b3c5640 1 -- 172.21.15.170:0/1050319160 wait complete. 2024-01-25T15:01:16.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.728+0000 7f8b1b3c5640 1 Processor -- start 2024-01-25T15:01:16.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.728+0000 7f8b1b3c5640 1 -- start start 2024-01-25T15:01:16.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.728+0000 7f8b1b3c5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b140ffbf0 0x7f8b14196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:16.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.728+0000 7f8b1b3c5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b14100de0 0x7f8b14197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:16.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.728+0000 7f8b1b3c5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b141017a0 0x7f8b1419e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:16.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.728+0000 7f8b1b3c5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1419e7d0 con 0x7f8b14100de0 2024-01-25T15:01:16.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.728+0000 7f8b1b3c5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1419e940 con 0x7f8b141017a0 2024-01-25T15:01:16.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.728+0000 7f8b1b3c5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1419eb00 con 0x7f8b140ffbf0 2024-01-25T15:01:16.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.728+0000 7f8b18960640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b14100de0 0x7f8b14197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:16.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.728+0000 7f8b18960640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b14100de0 0x7f8b14197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53786/0 (socket says 172.21.15.170:53786) 2024-01-25T15:01:16.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.728+0000 7f8b18960640 1 -- 172.21.15.170:0/1644510183 learned_addr learned my addr 172.21.15.170:0/1644510183 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:16.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.728+0000 7f8b19161640 1 --2- 172.21.15.170:0/1644510183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b140ffbf0 0x7f8b14196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:16.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.729+0000 7f8b18960640 1 -- 172.21.15.170:0/1644510183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b140ffbf0 msgr2=0x7f8b14196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.729+0000 7f8b18960640 1 --2- 172.21.15.170:0/1644510183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b140ffbf0 0x7f8b14196cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.729+0000 7f8b19962640 1 --2- 172.21.15.170:0/1644510183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b141017a0 0x7f8b1419e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:16.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.729+0000 7f8b18960640 1 -- 172.21.15.170:0/1644510183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b141017a0 msgr2=0x7f8b1419e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.729+0000 7f8b18960640 1 --2- 172.21.15.170:0/1644510183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b141017a0 0x7f8b1419e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.729+0000 7f8b18960640 1 -- 172.21.15.170:0/1644510183 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c009900 con 0x7f8b14100de0 2024-01-25T15:01:16.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.729+0000 7f8b18960640 1 --2- 172.21.15.170:0/1644510183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b14100de0 0x7f8b14197200 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400c970 tx=0x7f8b0400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:16.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.729+0000 7f8b0a7fc640 1 -- 172.21.15.170:0/1644510183 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04007bb0 con 0x7f8b14100de0 2024-01-25T15:01:16.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.729+0000 7f8b1b3c5640 1 -- 172.21.15.170:0/1644510183 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1419ede0 con 0x7f8b14100de0 2024-01-25T15:01:16.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.729+0000 7f8b0a7fc640 1 -- 172.21.15.170:0/1644510183 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b04007d10 con 0x7f8b14100de0 2024-01-25T15:01:16.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.729+0000 7f8b0a7fc640 1 -- 172.21.15.170:0/1644510183 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04004e40 con 0x7f8b14100de0 2024-01-25T15:01:16.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.729+0000 7f8b1b3c5640 1 -- 172.21.15.170:0/1644510183 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1419f210 con 0x7f8b14100de0 2024-01-25T15:01:16.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.730+0000 7f8b1b3c5640 1 -- 172.21.15.170:0/1644510183 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1410b4b0 con 0x7f8b14100de0 2024-01-25T15:01:16.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.731+0000 7f8b0a7fc640 1 -- 172.21.15.170:0/1644510183 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f8b04005000 con 0x7f8b14100de0 2024-01-25T15:01:16.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.731+0000 7f8b0a7fc640 1 --2- 172.21.15.170:0/1644510183 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8b000a1370 0x7f8b000a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:16.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.732+0000 7f8b19161640 1 --2- 172.21.15.170:0/1644510183 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8b000a1370 0x7f8b000a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:16.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.732+0000 7f8b0a7fc640 1 -- 172.21.15.170:0/1644510183 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f8b040cce40 con 0x7f8b14100de0 2024-01-25T15:01:16.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.732+0000 7f8b19161640 1 --2- 172.21.15.170:0/1644510183 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8b000a1370 0x7f8b000a3830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8b10005db0 tx=0x7f8b10005d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:16.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:16 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/869330647' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:16.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.735+0000 7f8b0a7fc640 1 -- 172.21.15.170:0/1644510183 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f8b04096190 con 0x7f8b14100de0 2024-01-25T15:01:16.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.907+0000 7f8b1b3c5640 1 -- 172.21.15.170:0/1644510183 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b1410b670 con 0x7f8b14100de0 2024-01-25T15:01:16.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.907+0000 7f8b0a7fc640 1 -- 172.21.15.170:0/1644510183 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b0401d020 con 0x7f8b14100de0 2024-01-25T15:01:16.908 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 64 2024-01-25T15:01:16.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.909+0000 7f8b1b3c5640 1 -- 172.21.15.170:0/1644510183 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8b000a1370 msgr2=0x7f8b000a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.909+0000 7f8b1b3c5640 1 --2- 172.21.15.170:0/1644510183 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8b000a1370 0x7f8b000a3830 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8b10005db0 tx=0x7f8b10005d40 comp rx=0 tx=0).stop 2024-01-25T15:01:16.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.909+0000 7f8b1b3c5640 1 -- 172.21.15.170:0/1644510183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b14100de0 msgr2=0x7f8b14197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:16.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.909+0000 7f8b1b3c5640 1 --2- 172.21.15.170:0/1644510183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b14100de0 0x7f8b14197200 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400c970 tx=0x7f8b0400ce30 comp rx=0 tx=0).stop 2024-01-25T15:01:16.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.909+0000 7f8b1b3c5640 1 -- 172.21.15.170:0/1644510183 shutdown_connections 2024-01-25T15:01:16.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.909+0000 7f8b1b3c5640 1 --2- 172.21.15.170:0/1644510183 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8b000a1370 0x7f8b000a3830 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.909+0000 7f8b1b3c5640 1 --2- 172.21.15.170:0/1644510183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8b141017a0 0x7f8b1419e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.909+0000 7f8b1b3c5640 1 --2- 172.21.15.170:0/1644510183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8b14100de0 0x7f8b14197200 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.909+0000 7f8b1b3c5640 1 --2- 172.21.15.170:0/1644510183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8b140ffbf0 0x7f8b14196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:16.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.909+0000 7f8b1b3c5640 1 -- 172.21.15.170:0/1644510183 >> 172.21.15.170:0/1644510183 conn(0x7f8b140fb180 msgr2=0x7f8b140fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:16.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.909+0000 7f8b1b3c5640 1 -- 172.21.15.170:0/1644510183 shutdown_connections 2024-01-25T15:01:16.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:16.909+0000 7f8b1b3c5640 1 -- 172.21.15.170:0/1644510183 wait complete. 2024-01-25T15:01:16.921 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:01:17.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.022+0000 7f5cb0f01640 1 -- 172.21.15.170:0/622008733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cac100e10 msgr2=0x7f5cac101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.022+0000 7f5cb0f01640 1 --2- 172.21.15.170:0/622008733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cac100e10 0x7f5cac101290 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009900 tx=0x7f5c9402bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:17.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.022+0000 7f5cb0f01640 1 -- 172.21.15.170:0/622008733 shutdown_connections 2024-01-25T15:01:17.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.022+0000 7f5cb0f01640 1 --2- 172.21.15.170:0/622008733 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cac1017d0 0x7f5cac108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.022+0000 7f5cb0f01640 1 --2- 172.21.15.170:0/622008733 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cac100e10 0x7f5cac101290 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.022+0000 7f5cb0f01640 1 --2- 172.21.15.170:0/622008733 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cac0ffc20 0x7f5cac100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.022+0000 7f5cb0f01640 1 -- 172.21.15.170:0/622008733 >> 172.21.15.170:0/622008733 conn(0x7f5cac0fb1d0 msgr2=0x7f5cac0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:17.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.022+0000 7f5cb0f01640 1 -- 172.21.15.170:0/622008733 shutdown_connections 2024-01-25T15:01:17.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.022+0000 7f5cb0f01640 1 -- 172.21.15.170:0/622008733 wait complete. 2024-01-25T15:01:17.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.022+0000 7f5cb0f01640 1 Processor -- start 2024-01-25T15:01:17.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.022+0000 7f5cb0f01640 1 -- start start 2024-01-25T15:01:17.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5cb0f01640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cac0ffc20 0x7f5cac196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5cb0f01640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cac100e10 0x7f5cac197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5cb0f01640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cac1017d0 0x7f5cac19e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5cb0f01640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac19e7f0 con 0x7f5cac100e10 2024-01-25T15:01:17.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5cb0f01640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac19e960 con 0x7f5cac0ffc20 2024-01-25T15:01:17.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5cb0f01640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac19eb20 con 0x7f5cac1017d0 2024-01-25T15:01:17.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5ca9d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cac100e10 0x7f5cac197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:17.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5ca9d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cac100e10 0x7f5cac197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53804/0 (socket says 172.21.15.170:53804) 2024-01-25T15:01:17.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5ca9d9b640 1 -- 172.21.15.170:0/705583211 learned_addr learned my addr 172.21.15.170:0/705583211 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:17.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5caad9d640 1 --2- 172.21.15.170:0/705583211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cac1017d0 0x7f5cac19e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:17.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5caa59c640 1 --2- 172.21.15.170:0/705583211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cac0ffc20 0x7f5cac196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:17.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5ca9d9b640 1 -- 172.21.15.170:0/705583211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cac1017d0 msgr2=0x7f5cac19e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5ca9d9b640 1 --2- 172.21.15.170:0/705583211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cac1017d0 0x7f5cac19e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5ca9d9b640 1 -- 172.21.15.170:0/705583211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cac0ffc20 msgr2=0x7f5cac196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5ca9d9b640 1 --2- 172.21.15.170:0/705583211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cac0ffc20 0x7f5cac196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5ca9d9b640 1 -- 172.21.15.170:0/705583211 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c94009560 con 0x7f5cac100e10 2024-01-25T15:01:17.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5ca9d9b640 1 --2- 172.21.15.170:0/705583211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cac100e10 0x7f5cac197250 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5c94000c00 tx=0x7f5c940042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:17.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5ca37fe640 1 -- 172.21.15.170:0/705583211 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c940044e0 con 0x7f5cac100e10 2024-01-25T15:01:17.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5ca37fe640 1 -- 172.21.15.170:0/705583211 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c94003cc0 con 0x7f5cac100e10 2024-01-25T15:01:17.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5cb0f01640 1 -- 172.21.15.170:0/705583211 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cac19eda0 con 0x7f5cac100e10 2024-01-25T15:01:17.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5ca37fe640 1 -- 172.21.15.170:0/705583211 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9403e450 con 0x7f5cac100e10 2024-01-25T15:01:17.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.023+0000 7f5cb0f01640 1 -- 172.21.15.170:0/705583211 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cac19f1f0 con 0x7f5cac100e10 2024-01-25T15:01:17.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.024+0000 7f5cb0f01640 1 -- 172.21.15.170:0/705583211 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cac10b530 con 0x7f5cac100e10 2024-01-25T15:01:17.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.025+0000 7f5ca37fe640 1 -- 172.21.15.170:0/705583211 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f5c94004dd0 con 0x7f5cac100e10 2024-01-25T15:01:17.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.026+0000 7f5ca37fe640 1 --2- 172.21.15.170:0/705583211 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5c980a1370 0x7f5c980a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.026+0000 7f5caa59c640 1 --2- 172.21.15.170:0/705583211 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5c980a1370 0x7f5c980a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:17.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.026+0000 7f5ca37fe640 1 -- 172.21.15.170:0/705583211 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f5c940ef750 con 0x7f5cac100e10 2024-01-25T15:01:17.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.026+0000 7f5caa59c640 1 --2- 172.21.15.170:0/705583211 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5c980a1370 0x7f5c980a3830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4005db0 tx=0x7f5ca4005d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:17.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.030+0000 7f5ca37fe640 1 -- 172.21.15.170:0/705583211 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f5c940b8c40 con 0x7f5cac100e10 2024-01-25T15:01:17.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.239+0000 7f5cb0f01640 1 -- 172.21.15.170:0/705583211 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cac19f4a0 con 0x7f5cac100e10 2024-01-25T15:01:17.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.240+0000 7f5ca37fe640 1 -- 172.21.15.170:0/705583211 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+11411 (secure 0 0 0) 0x7f5c94043020 con 0x7f5cac100e10 2024-01-25T15:01:17.241 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:17.241 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-25T14:59:53.534085+0000","modified":"2024-01-25T15:00:00.045800+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24484,"mds_1":24479,"mds_2":24466,"mds_3":24418,"mds_4":24398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":4,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24479":{"gid":24479,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/2132502182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":2132502182},{"type":"v1","addr":"172.21.15.186:6839","nonce":2132502182}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:01:17.241 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-01-25T15:01:17.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.242+0000 7f5cb0f01640 1 -- 172.21.15.170:0/705583211 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5c980a1370 msgr2=0x7f5c980a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.242+0000 7f5cb0f01640 1 --2- 172.21.15.170:0/705583211 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5c980a1370 0x7f5c980a3830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4005db0 tx=0x7f5ca4005d40 comp rx=0 tx=0).stop 2024-01-25T15:01:17.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.242+0000 7f5cb0f01640 1 -- 172.21.15.170:0/705583211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cac100e10 msgr2=0x7f5cac197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.242+0000 7f5cb0f01640 1 --2- 172.21.15.170:0/705583211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cac100e10 0x7f5cac197250 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5c94000c00 tx=0x7f5c940042f0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.242+0000 7f5cb0f01640 1 -- 172.21.15.170:0/705583211 shutdown_connections 2024-01-25T15:01:17.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.242+0000 7f5cb0f01640 1 --2- 172.21.15.170:0/705583211 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5c980a1370 0x7f5c980a3830 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.242+0000 7f5cb0f01640 1 --2- 172.21.15.170:0/705583211 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5cac1017d0 0x7f5cac19e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.242+0000 7f5cb0f01640 1 --2- 172.21.15.170:0/705583211 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5cac100e10 0x7f5cac197250 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.242+0000 7f5cb0f01640 1 --2- 172.21.15.170:0/705583211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cac0ffc20 0x7f5cac196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.242+0000 7f5cb0f01640 1 -- 172.21.15.170:0/705583211 >> 172.21.15.170:0/705583211 conn(0x7f5cac0fb1d0 msgr2=0x7f5cac0fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:17.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.242+0000 7f5cb0f01640 1 -- 172.21.15.170:0/705583211 shutdown_connections 2024-01-25T15:01:17.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.242+0000 7f5cb0f01640 1 -- 172.21.15.170:0/705583211 wait complete. 2024-01-25T15:01:17.255 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:01:17.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.355+0000 7ffb2c51a640 1 -- 172.21.15.170:0/4035603031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb241017e0 msgr2=0x7ffb24108070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.355+0000 7ffb2c51a640 1 --2- 172.21.15.170:0/4035603031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb241017e0 0x7ffb24108070 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009ca0 tx=0x7ffb1c02c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.356+0000 7ffb2c51a640 1 -- 172.21.15.170:0/4035603031 shutdown_connections 2024-01-25T15:01:17.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.356+0000 7ffb2c51a640 1 --2- 172.21.15.170:0/4035603031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb241017e0 0x7ffb24108070 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.356+0000 7ffb2c51a640 1 --2- 172.21.15.170:0/4035603031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb24100e20 0x7ffb241012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.356+0000 7ffb2c51a640 1 --2- 172.21.15.170:0/4035603031 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb240ffc30 0x7ffb24100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.356+0000 7ffb2c51a640 1 -- 172.21.15.170:0/4035603031 >> 172.21.15.170:0/4035603031 conn(0x7ffb240fb1a0 msgr2=0x7ffb240fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:17.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.356+0000 7ffb2c51a640 1 -- 172.21.15.170:0/4035603031 shutdown_connections 2024-01-25T15:01:17.359 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.356+0000 7ffb2c51a640 1 -- 172.21.15.170:0/4035603031 wait complete. 2024-01-25T15:01:17.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.356+0000 7ffb2c51a640 1 Processor -- start 2024-01-25T15:01:17.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.356+0000 7ffb2c51a640 1 -- start start 2024-01-25T15:01:17.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.356+0000 7ffb2c51a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb240ffc30 0x7ffb24069eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.356+0000 7ffb2c51a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb24100e20 0x7ffb2419b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.356+0000 7ffb2c51a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb241017e0 0x7ffb2419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.356+0000 7ffb2c51a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2419e780 con 0x7ffb241017e0 2024-01-25T15:01:17.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.356+0000 7ffb2c51a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2419e8f0 con 0x7ffb24100e20 2024-01-25T15:01:17.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.356+0000 7ffb2c51a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2419eab0 con 0x7ffb240ffc30 2024-01-25T15:01:17.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb2aab7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb241017e0 0x7ffb2419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:17.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb2aab7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb241017e0 0x7ffb2419dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53824/0 (socket says 172.21.15.170:53824) 2024-01-25T15:01:17.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb2aab7640 1 -- 172.21.15.170:0/859686053 learned_addr learned my addr 172.21.15.170:0/859686053 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:17.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb2a2b6640 1 --2- 172.21.15.170:0/859686053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb240ffc30 0x7ffb24069eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:17.360 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb29ab5640 1 --2- 172.21.15.170:0/859686053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb24100e20 0x7ffb2419b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:17.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb2aab7640 1 -- 172.21.15.170:0/859686053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb240ffc30 msgr2=0x7ffb24069eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb2aab7640 1 --2- 172.21.15.170:0/859686053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb240ffc30 0x7ffb24069eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb2aab7640 1 -- 172.21.15.170:0/859686053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb24100e20 msgr2=0x7ffb2419b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb2aab7640 1 --2- 172.21.15.170:0/859686053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb24100e20 0x7ffb2419b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb2aab7640 1 -- 172.21.15.170:0/859686053 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c009900 con 0x7ffb241017e0 2024-01-25T15:01:17.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb2aab7640 1 --2- 172.21.15.170:0/859686053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb241017e0 0x7ffb2419dff0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c037040 tx=0x7ffb1c032810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:17.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb177fe640 1 -- 172.21.15.170:0/859686053 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c034e80 con 0x7ffb241017e0 2024-01-25T15:01:17.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb177fe640 1 -- 172.21.15.170:0/859686053 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb1c003e30 con 0x7ffb241017e0 2024-01-25T15:01:17.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb2c51a640 1 -- 172.21.15.170:0/859686053 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2419ed30 con 0x7ffb241017e0 2024-01-25T15:01:17.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb177fe640 1 -- 172.21.15.170:0/859686053 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c03d3f0 con 0x7ffb241017e0 2024-01-25T15:01:17.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.357+0000 7ffb2c51a640 1 -- 172.21.15.170:0/859686053 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2419f1e0 con 0x7ffb241017e0 2024-01-25T15:01:17.361 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.358+0000 7ffb2c51a640 1 -- 172.21.15.170:0/859686053 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb24106f70 con 0x7ffb241017e0 2024-01-25T15:01:17.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.359+0000 7ffb177fe640 1 -- 172.21.15.170:0/859686053 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7ffb1c03b040 con 0x7ffb241017e0 2024-01-25T15:01:17.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.360+0000 7ffb177fe640 1 --2- 172.21.15.170:0/859686053 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ffb100a1370 0x7ffb100a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.362 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.360+0000 7ffb2a2b6640 1 --2- 172.21.15.170:0/859686053 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ffb100a1370 0x7ffb100a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:17.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.360+0000 7ffb177fe640 1 -- 172.21.15.170:0/859686053 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7ffb1c0ef380 con 0x7ffb241017e0 2024-01-25T15:01:17.363 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.360+0000 7ffb2a2b6640 1 --2- 172.21.15.170:0/859686053 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ffb100a1370 0x7ffb100a3830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffb24100c80 tx=0x7ffb2000a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:17.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.364+0000 7ffb177fe640 1 -- 172.21.15.170:0/859686053 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ffb1c0b87e0 con 0x7ffb241017e0 2024-01-25T15:01:17.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.539+0000 7ffb2c51a640 1 -- 172.21.15.170:0/859686053 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb2402cb10 con 0x7ffb241017e0 2024-01-25T15:01:17.541 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.540+0000 7ffb177fe640 1 -- 172.21.15.170:0/859686053 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22550 (secure 0 0 0) 0x7ffb1c0bbe00 con 0x7ffb241017e0 2024-01-25T15:01:17.541 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:17.541 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":87,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T15:00:57.274280+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:01:17.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.542+0000 7ffb2c51a640 1 -- 172.21.15.170:0/859686053 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ffb100a1370 msgr2=0x7ffb100a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.542+0000 7ffb2c51a640 1 --2- 172.21.15.170:0/859686053 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ffb100a1370 0x7ffb100a3830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ffb24100c80 tx=0x7ffb2000a2d0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.542+0000 7ffb2c51a640 1 -- 172.21.15.170:0/859686053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb241017e0 msgr2=0x7ffb2419dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.542+0000 7ffb2c51a640 1 --2- 172.21.15.170:0/859686053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb241017e0 0x7ffb2419dff0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c037040 tx=0x7ffb1c032810 comp rx=0 tx=0).stop 2024-01-25T15:01:17.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.542+0000 7ffb2c51a640 1 -- 172.21.15.170:0/859686053 shutdown_connections 2024-01-25T15:01:17.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.542+0000 7ffb2c51a640 1 --2- 172.21.15.170:0/859686053 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ffb100a1370 0x7ffb100a3830 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.542+0000 7ffb2c51a640 1 --2- 172.21.15.170:0/859686053 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb24100e20 0x7ffb2419b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.542+0000 7ffb2c51a640 1 --2- 172.21.15.170:0/859686053 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb241017e0 0x7ffb2419dff0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.542+0000 7ffb2c51a640 1 --2- 172.21.15.170:0/859686053 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb240ffc30 0x7ffb24069eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.542+0000 7ffb2c51a640 1 -- 172.21.15.170:0/859686053 >> 172.21.15.170:0/859686053 conn(0x7ffb240fb1a0 msgr2=0x7ffb24104140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:17.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.542+0000 7ffb2c51a640 1 -- 172.21.15.170:0/859686053 shutdown_connections 2024-01-25T15:01:17.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.542+0000 7ffb2c51a640 1 -- 172.21.15.170:0/859686053 wait complete. 2024-01-25T15:01:17.553 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:17 smithi170 ceph-mon[31899]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:01:17.553 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:17 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3810161216' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:17.553 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:17 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2140840112' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:17.553 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:17 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1644510183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:17.554 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:17 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/705583211' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:17.555 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T14:55:22.432727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T14:59:51.465304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T14:59:52.749298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:01:17.555 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:01:17.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:17 smithi186 ceph-mon[35697]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:01:17.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:17 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3810161216' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:17.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:17 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2140840112' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:17.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:17 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1644510183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:17.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:17 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/705583211' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:17.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.660+0000 7eff2a896640 1 -- 172.21.15.170:0/3464303690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff24101ef0 msgr2=0x7eff24102370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.660+0000 7eff2a896640 1 --2- 172.21.15.170:0/3464303690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff24101ef0 0x7eff24102370 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7eff14009900 tx=0x7eff1402bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:17.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.660+0000 7eff2a896640 1 -- 172.21.15.170:0/3464303690 shutdown_connections 2024-01-25T15:01:17.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.660+0000 7eff2a896640 1 --2- 172.21.15.170:0/3464303690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff241028b0 0x7eff24109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.660+0000 7eff2a896640 1 --2- 172.21.15.170:0/3464303690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff24101ef0 0x7eff24102370 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.660+0000 7eff2a896640 1 --2- 172.21.15.170:0/3464303690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff24100d00 0x7eff24101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.660+0000 7eff2a896640 1 -- 172.21.15.170:0/3464303690 >> 172.21.15.170:0/3464303690 conn(0x7eff240fc290 msgr2=0x7eff240fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:17.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.660+0000 7eff2a896640 1 -- 172.21.15.170:0/3464303690 shutdown_connections 2024-01-25T15:01:17.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.660+0000 7eff2a896640 1 -- 172.21.15.170:0/3464303690 wait complete. 2024-01-25T15:01:17.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.660+0000 7eff2a896640 1 Processor -- start 2024-01-25T15:01:17.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.660+0000 7eff2a896640 1 -- start start 2024-01-25T15:01:17.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff2a896640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff24100d00 0x7eff24196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff2a896640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff24101ef0 0x7eff241972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff2a896640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff241028b0 0x7eff2419e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff2a896640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2419e850 con 0x7eff24100d00 2024-01-25T15:01:17.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff2a896640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2419e9c0 con 0x7eff24101ef0 2024-01-25T15:01:17.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff2a896640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2419eb80 con 0x7eff241028b0 2024-01-25T15:01:17.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff23fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff24100d00 0x7eff24196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:17.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff23fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff24100d00 0x7eff24196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53846/0 (socket says 172.21.15.170:53846) 2024-01-25T15:01:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff23fff640 1 -- 172.21.15.170:0/1282212120 learned_addr learned my addr 172.21.15.170:0/1282212120 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff237fe640 1 --2- 172.21.15.170:0/1282212120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff24101ef0 0x7eff241972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff28e33640 1 --2- 172.21.15.170:0/1282212120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff241028b0 0x7eff2419e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff23fff640 1 -- 172.21.15.170:0/1282212120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff241028b0 msgr2=0x7eff2419e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff23fff640 1 --2- 172.21.15.170:0/1282212120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff241028b0 0x7eff2419e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff23fff640 1 -- 172.21.15.170:0/1282212120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff24101ef0 msgr2=0x7eff241972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff23fff640 1 --2- 172.21.15.170:0/1282212120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff24101ef0 0x7eff241972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff23fff640 1 -- 172.21.15.170:0/1282212120 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff14009560 con 0x7eff24100d00 2024-01-25T15:01:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff23fff640 1 --2- 172.21.15.170:0/1282212120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff24100d00 0x7eff24196d60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7eff1800b450 tx=0x7eff1800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff217fa640 1 -- 172.21.15.170:0/1282212120 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18011890 con 0x7eff24100d00 2024-01-25T15:01:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff217fa640 1 -- 172.21.15.170:0/1282212120 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff180103e0 con 0x7eff24100d00 2024-01-25T15:01:17.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff2a896640 1 -- 172.21.15.170:0/1282212120 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2419ee60 con 0x7eff24100d00 2024-01-25T15:01:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff217fa640 1 -- 172.21.15.170:0/1282212120 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1800f5a0 con 0x7eff24100d00 2024-01-25T15:01:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.661+0000 7eff2a896640 1 -- 172.21.15.170:0/1282212120 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2419f2b0 con 0x7eff24100d00 2024-01-25T15:01:17.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.662+0000 7eff2a896640 1 -- 172.21.15.170:0/1282212120 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff24108160 con 0x7eff24100d00 2024-01-25T15:01:17.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.664+0000 7eff217fa640 1 -- 172.21.15.170:0/1282212120 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7eff18010850 con 0x7eff24100d00 2024-01-25T15:01:17.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.665+0000 7eff217fa640 1 --2- 172.21.15.170:0/1282212120 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7eff0c0a1370 0x7eff0c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.665+0000 7eff237fe640 1 --2- 172.21.15.170:0/1282212120 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7eff0c0a1370 0x7eff0c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:17.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.665+0000 7eff217fa640 1 -- 172.21.15.170:0/1282212120 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7eff180cce30 con 0x7eff24100d00 2024-01-25T15:01:17.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.665+0000 7eff237fe640 1 --2- 172.21.15.170:0/1282212120 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7eff0c0a1370 0x7eff0c0a3830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7eff14006010 tx=0x7eff1402c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:17.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.668+0000 7eff217fa640 1 -- 172.21.15.170:0/1282212120 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7eff18096290 con 0x7eff24100d00 2024-01-25T15:01:17.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:17 smithi191 ceph-mon[36347]: pgmap v327: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:01:17.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:17 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3810161216' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:17.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:17 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2140840112' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:17.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:17 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1644510183' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:17.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:17 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/705583211' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:17.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.837+0000 7eff2a896640 1 -- 172.21.15.170:0/1282212120 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff2410c880 con 0x7eff24100d00 2024-01-25T15:01:17.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.837+0000 7eff217fa640 1 -- 172.21.15.170:0/1282212120 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff180998b0 con 0x7eff24100d00 2024-01-25T15:01:17.838 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 1 2024-01-25T15:01:17.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.840+0000 7eff2a896640 1 -- 172.21.15.170:0/1282212120 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7eff0c0a1370 msgr2=0x7eff0c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.840+0000 7eff2a896640 1 --2- 172.21.15.170:0/1282212120 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7eff0c0a1370 0x7eff0c0a3830 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7eff14006010 tx=0x7eff1402c5d0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.840+0000 7eff2a896640 1 -- 172.21.15.170:0/1282212120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff24100d00 msgr2=0x7eff24196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.840+0000 7eff2a896640 1 --2- 172.21.15.170:0/1282212120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff24100d00 0x7eff24196d60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7eff1800b450 tx=0x7eff1800b910 comp rx=0 tx=0).stop 2024-01-25T15:01:17.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.840+0000 7eff2a896640 1 -- 172.21.15.170:0/1282212120 shutdown_connections 2024-01-25T15:01:17.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.840+0000 7eff2a896640 1 --2- 172.21.15.170:0/1282212120 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7eff0c0a1370 0x7eff0c0a3830 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.840+0000 7eff2a896640 1 --2- 172.21.15.170:0/1282212120 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff24101ef0 0x7eff241972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.840+0000 7eff2a896640 1 --2- 172.21.15.170:0/1282212120 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff241028b0 0x7eff2419e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.840+0000 7eff2a896640 1 --2- 172.21.15.170:0/1282212120 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff24100d00 0x7eff24196d60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.840+0000 7eff2a896640 1 -- 172.21.15.170:0/1282212120 >> 172.21.15.170:0/1282212120 conn(0x7eff240fc290 msgr2=0x7eff24105330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:17.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.840+0000 7eff2a896640 1 -- 172.21.15.170:0/1282212120 shutdown_connections 2024-01-25T15:01:17.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.840+0000 7eff2a896640 1 -- 172.21.15.170:0/1282212120 wait complete. 2024-01-25T15:01:17.852 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:01:17.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.955+0000 7fb79d91f640 1 -- 172.21.15.170:0/1990685323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb798101770 msgr2=0x7fb798103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.955+0000 7fb79d91f640 1 --2- 172.21.15.170:0/1990685323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb798101770 0x7fb798103b60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb788009ca0 tx=0x7fb78802c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.955+0000 7fb79d91f640 1 -- 172.21.15.170:0/1990685323 shutdown_connections 2024-01-25T15:01:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.955+0000 7fb79d91f640 1 --2- 172.21.15.170:0/1990685323 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7981040a0 0x7fb798106490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.955+0000 7fb79d91f640 1 --2- 172.21.15.170:0/1990685323 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7981069d0 0x7fb798108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.955+0000 7fb79d91f640 1 --2- 172.21.15.170:0/1990685323 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb798101770 0x7fb798103b60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.955+0000 7fb79d91f640 1 -- 172.21.15.170:0/1990685323 >> 172.21.15.170:0/1990685323 conn(0x7fb7980fb180 msgr2=0x7fb7980fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.955+0000 7fb79d91f640 1 -- 172.21.15.170:0/1990685323 shutdown_connections 2024-01-25T15:01:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.955+0000 7fb79d91f640 1 -- 172.21.15.170:0/1990685323 wait complete. 2024-01-25T15:01:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.956+0000 7fb79d91f640 1 Processor -- start 2024-01-25T15:01:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.956+0000 7fb79d91f640 1 -- start start 2024-01-25T15:01:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.956+0000 7fb79d91f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb798101770 0x7fb798196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.956+0000 7fb79d91f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7981040a0 0x7fb798197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.956+0000 7fb79d91f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7981069d0 0x7fb79819e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.956+0000 7fb79d91f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79819e7d0 con 0x7fb7981069d0 2024-01-25T15:01:17.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.956+0000 7fb79d91f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79819e940 con 0x7fb798101770 2024-01-25T15:01:17.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.956+0000 7fb79d91f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79819eb00 con 0x7fb7981040a0 2024-01-25T15:01:17.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.956+0000 7fb7977fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7981069d0 0x7fb79819e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:17.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.956+0000 7fb7977fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7981069d0 0x7fb79819e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53872/0 (socket says 172.21.15.170:53872) 2024-01-25T15:01:17.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.956+0000 7fb7977fe640 1 -- 172.21.15.170:0/4145193461 learned_addr learned my addr 172.21.15.170:0/4145193461 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:17.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.956+0000 7fb7967fc640 1 --2- 172.21.15.170:0/4145193461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7981040a0 0x7fb798197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:17.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.957+0000 7fb7977fe640 1 -- 172.21.15.170:0/4145193461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7981040a0 msgr2=0x7fb798197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.957+0000 7fb7977fe640 1 --2- 172.21.15.170:0/4145193461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7981040a0 0x7fb798197200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.957+0000 7fb7977fe640 1 -- 172.21.15.170:0/4145193461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb798101770 msgr2=0x7fb798196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:17.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.957+0000 7fb7977fe640 1 --2- 172.21.15.170:0/4145193461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb798101770 0x7fb798196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:17.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.957+0000 7fb7977fe640 1 -- 172.21.15.170:0/4145193461 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb788009900 con 0x7fb7981069d0 2024-01-25T15:01:17.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.957+0000 7fb7967fc640 1 --2- 172.21.15.170:0/4145193461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7981040a0 0x7fb798197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:17.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.957+0000 7fb7977fe640 1 --2- 172.21.15.170:0/4145193461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7981069d0 0x7fb79819e260 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb79000c970 tx=0x7fb79000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:17.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.957+0000 7fb79c91d640 1 -- 172.21.15.170:0/4145193461 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb790007bb0 con 0x7fb7981069d0 2024-01-25T15:01:17.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.957+0000 7fb79c91d640 1 -- 172.21.15.170:0/4145193461 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb790007d10 con 0x7fb7981069d0 2024-01-25T15:01:17.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.957+0000 7fb79c91d640 1 -- 172.21.15.170:0/4145193461 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7900186c0 con 0x7fb7981069d0 2024-01-25T15:01:17.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.957+0000 7fb79d91f640 1 -- 172.21.15.170:0/4145193461 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79819ede0 con 0x7fb7981069d0 2024-01-25T15:01:17.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.957+0000 7fb79d91f640 1 -- 172.21.15.170:0/4145193461 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79819f210 con 0x7fb7981069d0 2024-01-25T15:01:17.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.958+0000 7fb79d91f640 1 -- 172.21.15.170:0/4145193461 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7980fcc70 con 0x7fb7981069d0 2024-01-25T15:01:17.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.959+0000 7fb79c91d640 1 -- 172.21.15.170:0/4145193461 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fb79000f450 con 0x7fb7981069d0 2024-01-25T15:01:17.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.959+0000 7fb79c91d640 1 --2- 172.21.15.170:0/4145193461 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7840a1370 0x7fb7840a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:17.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.960+0000 7fb796ffd640 1 --2- 172.21.15.170:0/4145193461 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7840a1370 0x7fb7840a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:17.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.960+0000 7fb79c91d640 1 -- 172.21.15.170:0/4145193461 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fb7900cce50 con 0x7fb7981069d0 2024-01-25T15:01:17.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.960+0000 7fb796ffd640 1 --2- 172.21.15.170:0/4145193461 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7840a1370 0x7fb7840a3830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb7880325c0 tx=0x7fb788009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:17.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:17.963+0000 7fb79c91d640 1 -- 172.21.15.170:0/4145193461 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb790096230 con 0x7fb7981069d0 2024-01-25T15:01:18.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.139+0000 7fb79d91f640 1 -- 172.21.15.170:0/4145193461 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb79810c820 con 0x7fb7981069d0 2024-01-25T15:01:18.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.140+0000 7fb79c91d640 1 -- 172.21.15.170:0/4145193461 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb790099850 con 0x7fb7981069d0 2024-01-25T15:01:18.141 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 32 2024-01-25T15:01:18.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.142+0000 7fb79d91f640 1 -- 172.21.15.170:0/4145193461 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7840a1370 msgr2=0x7fb7840a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:18.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.142+0000 7fb79d91f640 1 --2- 172.21.15.170:0/4145193461 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7840a1370 0x7fb7840a3830 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb7880325c0 tx=0x7fb788009360 comp rx=0 tx=0).stop 2024-01-25T15:01:18.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.142+0000 7fb79d91f640 1 -- 172.21.15.170:0/4145193461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7981069d0 msgr2=0x7fb79819e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:18.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.142+0000 7fb79d91f640 1 --2- 172.21.15.170:0/4145193461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7981069d0 0x7fb79819e260 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb79000c970 tx=0x7fb79000ce30 comp rx=0 tx=0).stop 2024-01-25T15:01:18.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.142+0000 7fb79d91f640 1 -- 172.21.15.170:0/4145193461 shutdown_connections 2024-01-25T15:01:18.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.142+0000 7fb79d91f640 1 --2- 172.21.15.170:0/4145193461 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7840a1370 0x7fb7840a3830 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.142+0000 7fb79d91f640 1 --2- 172.21.15.170:0/4145193461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb7981069d0 0x7fb79819e260 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.142+0000 7fb79d91f640 1 --2- 172.21.15.170:0/4145193461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb7981040a0 0x7fb798197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.142+0000 7fb79d91f640 1 --2- 172.21.15.170:0/4145193461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb798101770 0x7fb798196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.142+0000 7fb79d91f640 1 -- 172.21.15.170:0/4145193461 >> 172.21.15.170:0/4145193461 conn(0x7fb7980fb180 msgr2=0x7fb7981020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:18.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.142+0000 7fb79d91f640 1 -- 172.21.15.170:0/4145193461 shutdown_connections 2024-01-25T15:01:18.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.142+0000 7fb79d91f640 1 -- 172.21.15.170:0/4145193461 wait complete. 2024-01-25T15:01:18.154 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:01:18.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.258+0000 7f820c207640 1 -- 172.21.15.170:0/3146714069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82041017a0 msgr2=0x7f8204108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:18.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.258+0000 7f820c207640 1 --2- 172.21.15.170:0/3146714069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82041017a0 0x7f8204108030 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009ca0 tx=0x7f81fc02c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.258+0000 7f820c207640 1 -- 172.21.15.170:0/3146714069 shutdown_connections 2024-01-25T15:01:18.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.258+0000 7f820c207640 1 --2- 172.21.15.170:0/3146714069 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f82041017a0 0x7f8204108030 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.258+0000 7f820c207640 1 --2- 172.21.15.170:0/3146714069 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8204100de0 0x7f8204101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.258+0000 7f820c207640 1 --2- 172.21.15.170:0/3146714069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82040ffbf0 0x7f8204100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.258+0000 7f820c207640 1 -- 172.21.15.170:0/3146714069 >> 172.21.15.170:0/3146714069 conn(0x7f82040fb180 msgr2=0x7f82040fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:18.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.259+0000 7f820c207640 1 -- 172.21.15.170:0/3146714069 shutdown_connections 2024-01-25T15:01:18.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.259+0000 7f820c207640 1 -- 172.21.15.170:0/3146714069 wait complete. 2024-01-25T15:01:18.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.259+0000 7f820c207640 1 Processor -- start 2024-01-25T15:01:18.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.259+0000 7f820c207640 1 -- start start 2024-01-25T15:01:18.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.259+0000 7f820c207640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82040ffbf0 0x7f8204196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:18.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.259+0000 7f820c207640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8204100de0 0x7f82041972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:18.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.259+0000 7f820c207640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82041017a0 0x7f820419e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:18.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.259+0000 7f820c207640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820419e850 con 0x7f8204100de0 2024-01-25T15:01:18.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.259+0000 7f820c207640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820419e9c0 con 0x7f82040ffbf0 2024-01-25T15:01:18.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.259+0000 7f820c207640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820419eb80 con 0x7f82041017a0 2024-01-25T15:01:18.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.259+0000 7f82097a2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8204100de0 0x7f82041972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:18.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.259+0000 7f82097a2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8204100de0 0x7f82041972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53886/0 (socket says 172.21.15.170:53886) 2024-01-25T15:01:18.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.259+0000 7f82097a2640 1 -- 172.21.15.170:0/3641215411 learned_addr learned my addr 172.21.15.170:0/3641215411 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:18.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.259+0000 7f820a7a4640 1 --2- 172.21.15.170:0/3641215411 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82041017a0 0x7f820419e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:18.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.260+0000 7f82097a2640 1 -- 172.21.15.170:0/3641215411 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82041017a0 msgr2=0x7f820419e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:18.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.260+0000 7f82097a2640 1 --2- 172.21.15.170:0/3641215411 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82041017a0 0x7f820419e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.260+0000 7f82097a2640 1 -- 172.21.15.170:0/3641215411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82040ffbf0 msgr2=0x7f8204196d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:18.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.260+0000 7f82097a2640 1 --2- 172.21.15.170:0/3641215411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82040ffbf0 0x7f8204196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.260+0000 7f82097a2640 1 -- 172.21.15.170:0/3641215411 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc009900 con 0x7f8204100de0 2024-01-25T15:01:18.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.260+0000 7f820a7a4640 1 --2- 172.21.15.170:0/3641215411 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82041017a0 0x7f820419e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:18.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.260+0000 7f82097a2640 1 --2- 172.21.15.170:0/3641215411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8204100de0 0x7f82041972a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f81f800d770 tx=0x7f81f800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:18.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.260+0000 7f8202ffd640 1 -- 172.21.15.170:0/3641215411 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8009c30 con 0x7f8204100de0 2024-01-25T15:01:18.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.260+0000 7f8202ffd640 1 -- 172.21.15.170:0/3641215411 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81f800de80 con 0x7f8204100de0 2024-01-25T15:01:18.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.260+0000 7f820c207640 1 -- 172.21.15.170:0/3641215411 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820419ee60 con 0x7f8204100de0 2024-01-25T15:01:18.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.260+0000 7f8202ffd640 1 -- 172.21.15.170:0/3641215411 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8004de0 con 0x7f8204100de0 2024-01-25T15:01:18.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.260+0000 7f820c207640 1 -- 172.21.15.170:0/3641215411 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820419f310 con 0x7f8204100de0 2024-01-25T15:01:18.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.261+0000 7f820c207640 1 -- 172.21.15.170:0/3641215411 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820410b550 con 0x7f8204100de0 2024-01-25T15:01:18.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.262+0000 7f8202ffd640 1 -- 172.21.15.170:0/3641215411 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f81f8004f40 con 0x7f8204100de0 2024-01-25T15:01:18.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.262+0000 7f8202ffd640 1 --2- 172.21.15.170:0/3641215411 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f81ec0a1370 0x7f81ec0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:18.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.262+0000 7f8209fa3640 1 --2- 172.21.15.170:0/3641215411 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f81ec0a1370 0x7f81ec0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:18.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.262+0000 7f8202ffd640 1 -- 172.21.15.170:0/3641215411 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f81f80cc7f0 con 0x7f8204100de0 2024-01-25T15:01:18.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.263+0000 7f8209fa3640 1 --2- 172.21.15.170:0/3641215411 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f81ec0a1370 0x7f81ec0a3830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8204100c40 tx=0x7f81f4006c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:18.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.267+0000 7f8202ffd640 1 -- 172.21.15.170:0/3641215411 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f81f8095b40 con 0x7f8204100de0 2024-01-25T15:01:18.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.440+0000 7f820c207640 1 -- 172.21.15.170:0/3641215411 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f820419f880 con 0x7f8204100de0 2024-01-25T15:01:18.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.441+0000 7f8202ffd640 1 -- 172.21.15.170:0/3641215411 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f81f8099160 con 0x7f8204100de0 2024-01-25T15:01:18.442 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 64 2024-01-25T15:01:18.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.443+0000 7f820c207640 1 -- 172.21.15.170:0/3641215411 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f81ec0a1370 msgr2=0x7f81ec0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:18.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.443+0000 7f820c207640 1 --2- 172.21.15.170:0/3641215411 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f81ec0a1370 0x7f81ec0a3830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8204100c40 tx=0x7f81f4006c90 comp rx=0 tx=0).stop 2024-01-25T15:01:18.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.443+0000 7f820c207640 1 -- 172.21.15.170:0/3641215411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8204100de0 msgr2=0x7f82041972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:18.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.443+0000 7f820c207640 1 --2- 172.21.15.170:0/3641215411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8204100de0 0x7f82041972a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f81f800d770 tx=0x7f81f800dc30 comp rx=0 tx=0).stop 2024-01-25T15:01:18.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.443+0000 7f820c207640 1 -- 172.21.15.170:0/3641215411 shutdown_connections 2024-01-25T15:01:18.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.443+0000 7f820c207640 1 --2- 172.21.15.170:0/3641215411 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f81ec0a1370 0x7f81ec0a3830 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.443+0000 7f820c207640 1 --2- 172.21.15.170:0/3641215411 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f82041017a0 0x7f820419e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.443+0000 7f820c207640 1 --2- 172.21.15.170:0/3641215411 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8204100de0 0x7f82041972a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.443+0000 7f820c207640 1 --2- 172.21.15.170:0/3641215411 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82040ffbf0 0x7f8204196d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.443+0000 7f820c207640 1 -- 172.21.15.170:0/3641215411 >> 172.21.15.170:0/3641215411 conn(0x7f82040fb180 msgr2=0x7f82040fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:18.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.443+0000 7f820c207640 1 -- 172.21.15.170:0/3641215411 shutdown_connections 2024-01-25T15:01:18.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.443+0000 7f820c207640 1 -- 172.21.15.170:0/3641215411 wait complete. 2024-01-25T15:01:18.454 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:18 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/859686053' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:18.454 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:18 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1282212120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:18.454 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:18 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/4145193461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:18.455 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:01:18.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.555+0000 7f18decd3640 1 -- 172.21.15.170:0/1698738464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18d81017c0 msgr2=0x7f18d8108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:18.559 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.555+0000 7f18decd3640 1 --2- 172.21.15.170:0/1698738464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18d81017c0 0x7f18d8108050 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009ca0 tx=0x7f18d002c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18decd3640 1 -- 172.21.15.170:0/1698738464 shutdown_connections 2024-01-25T15:01:18.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18decd3640 1 --2- 172.21.15.170:0/1698738464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18d8100e00 0x7f18d8101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18decd3640 1 --2- 172.21.15.170:0/1698738464 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18d81017c0 0x7f18d8108050 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18decd3640 1 --2- 172.21.15.170:0/1698738464 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18d80ffc10 0x7f18d8100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18decd3640 1 -- 172.21.15.170:0/1698738464 >> 172.21.15.170:0/1698738464 conn(0x7f18d80fb180 msgr2=0x7f18d80fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:18.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18decd3640 1 -- 172.21.15.170:0/1698738464 shutdown_connections 2024-01-25T15:01:18.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18decd3640 1 -- 172.21.15.170:0/1698738464 wait complete. 2024-01-25T15:01:18.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18decd3640 1 Processor -- start 2024-01-25T15:01:18.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18decd3640 1 -- start start 2024-01-25T15:01:18.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18decd3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18d80ffc10 0x7f18d8196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:18.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18decd3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18d8100e00 0x7f18d8197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:18.560 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18decd3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18d81017c0 0x7f18d819e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:18.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18decd3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d819e7e0 con 0x7f18d80ffc10 2024-01-25T15:01:18.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18decd3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d819e950 con 0x7f18d8100e00 2024-01-25T15:01:18.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18decd3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d819eb10 con 0x7f18d81017c0 2024-01-25T15:01:18.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18dca6f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18d80ffc10 0x7f18d8196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:18.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18dca6f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18d80ffc10 0x7f18d8196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53904/0 (socket says 172.21.15.170:53904) 2024-01-25T15:01:18.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18dca6f640 1 -- 172.21.15.170:0/1042683204 learned_addr learned my addr 172.21.15.170:0/1042683204 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:18.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.556+0000 7f18d7fff640 1 --2- 172.21.15.170:0/1042683204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18d8100e00 0x7f18d8197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:18.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.557+0000 7f18dca6f640 1 -- 172.21.15.170:0/1042683204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18d81017c0 msgr2=0x7f18d819e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:18.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.557+0000 7f18dca6f640 1 --2- 172.21.15.170:0/1042683204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18d81017c0 0x7f18d819e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.557+0000 7f18dca6f640 1 -- 172.21.15.170:0/1042683204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18d8100e00 msgr2=0x7f18d8197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:18.561 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.557+0000 7f18dca6f640 1 --2- 172.21.15.170:0/1042683204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18d8100e00 0x7f18d8197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.557+0000 7f18dca6f640 1 -- 172.21.15.170:0/1042683204 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d0009900 con 0x7f18d80ffc10 2024-01-25T15:01:18.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.557+0000 7f18d7fff640 1 --2- 172.21.15.170:0/1042683204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18d8100e00 0x7f18d8197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:18.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.557+0000 7f18dca6f640 1 --2- 172.21.15.170:0/1042683204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18d80ffc10 0x7f18d8196d00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00b450 tx=0x7f18cc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:18.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.557+0000 7f18d5ffb640 1 -- 172.21.15.170:0/1042683204 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc011890 con 0x7f18d80ffc10 2024-01-25T15:01:18.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.557+0000 7f18d5ffb640 1 -- 172.21.15.170:0/1042683204 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18cc0103e0 con 0x7f18d80ffc10 2024-01-25T15:01:18.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.557+0000 7f18d5ffb640 1 -- 172.21.15.170:0/1042683204 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc00f5a0 con 0x7f18d80ffc10 2024-01-25T15:01:18.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.557+0000 7f18decd3640 1 -- 172.21.15.170:0/1042683204 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d819edf0 con 0x7f18d80ffc10 2024-01-25T15:01:18.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.557+0000 7f18decd3640 1 -- 172.21.15.170:0/1042683204 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d819f2a0 con 0x7f18d80ffc10 2024-01-25T15:01:18.562 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.558+0000 7f18decd3640 1 -- 172.21.15.170:0/1042683204 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d8106fb0 con 0x7f18d80ffc10 2024-01-25T15:01:18.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.559+0000 7f18d5ffb640 1 -- 172.21.15.170:0/1042683204 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f18cc010850 con 0x7f18d80ffc10 2024-01-25T15:01:18.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.559+0000 7f18d5ffb640 1 --2- 172.21.15.170:0/1042683204 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f18c80a1370 0x7f18c80a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:18.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.560+0000 7f18d7fff640 1 --2- 172.21.15.170:0/1042683204 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f18c80a1370 0x7f18c80a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:18.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.560+0000 7f18d5ffb640 1 -- 172.21.15.170:0/1042683204 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f18cc0ccae0 con 0x7f18d80ffc10 2024-01-25T15:01:18.563 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.560+0000 7f18d7fff640 1 --2- 172.21.15.170:0/1042683204 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f18c80a1370 0x7f18c80a3830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f18c40058c0 tx=0x7f18c4005ec0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:18.564 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.564+0000 7f18d5ffb640 1 -- 172.21.15.170:0/1042683204 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f18cc095eb0 con 0x7f18d80ffc10 2024-01-25T15:01:18.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:18 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/859686053' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:18.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:18 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1282212120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:18.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:18 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/4145193461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:18.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:18 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/859686053' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:18.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:18 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1282212120' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:18.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:18 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/4145193461' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.771+0000 7f18decd3640 1 -- 172.21.15.170:0/1042683204 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18d802caa0 con 0x7f18d80ffc10 2024-01-25T15:01:18.772 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.772+0000 7f18d5ffb640 1 -- 172.21.15.170:0/1042683204 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+11411 (secure 0 0 0) 0x7f18cc097de0 con 0x7f18d80ffc10 2024-01-25T15:01:18.773 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:18.773 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-25T14:59:53.534085+0000","modified":"2024-01-25T15:00:00.045800+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24484,"mds_1":24479,"mds_2":24466,"mds_3":24418,"mds_4":24398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":4,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24479":{"gid":24479,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/2132502182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":2132502182},{"type":"v1","addr":"172.21.15.186:6839","nonce":2132502182}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:01:18.773 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-01-25T15:01:18.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.774+0000 7f18decd3640 1 -- 172.21.15.170:0/1042683204 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f18c80a1370 msgr2=0x7f18c80a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:18.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.774+0000 7f18decd3640 1 --2- 172.21.15.170:0/1042683204 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f18c80a1370 0x7f18c80a3830 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f18c40058c0 tx=0x7f18c4005ec0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.774+0000 7f18decd3640 1 -- 172.21.15.170:0/1042683204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18d80ffc10 msgr2=0x7f18d8196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:18.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.774+0000 7f18decd3640 1 --2- 172.21.15.170:0/1042683204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18d80ffc10 0x7f18d8196d00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00b450 tx=0x7f18cc00b910 comp rx=0 tx=0).stop 2024-01-25T15:01:18.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.774+0000 7f18decd3640 1 -- 172.21.15.170:0/1042683204 shutdown_connections 2024-01-25T15:01:18.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.774+0000 7f18decd3640 1 --2- 172.21.15.170:0/1042683204 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f18c80a1370 0x7f18c80a3830 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.774+0000 7f18decd3640 1 --2- 172.21.15.170:0/1042683204 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18d8100e00 0x7f18d8197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.774+0000 7f18decd3640 1 --2- 172.21.15.170:0/1042683204 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18d81017c0 0x7f18d819e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.774+0000 7f18decd3640 1 --2- 172.21.15.170:0/1042683204 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18d80ffc10 0x7f18d8196d00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.774+0000 7f18decd3640 1 -- 172.21.15.170:0/1042683204 >> 172.21.15.170:0/1042683204 conn(0x7f18d80fb180 msgr2=0x7f18d8104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:18.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.774+0000 7f18decd3640 1 -- 172.21.15.170:0/1042683204 shutdown_connections 2024-01-25T15:01:18.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.774+0000 7f18decd3640 1 -- 172.21.15.170:0/1042683204 wait complete. 2024-01-25T15:01:18.786 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:01:18.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.886+0000 7f558b275640 1 -- 172.21.15.170:0/2983734310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5584104920 msgr2=0x7f5584104da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:18.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.886+0000 7f558b275640 1 --2- 172.21.15.170:0/2983734310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5584104920 0x7f5584104da0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f557c009900 tx=0x7f557c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:18.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.886+0000 7f558b275640 1 -- 172.21.15.170:0/2983734310 shutdown_connections 2024-01-25T15:01:18.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.886+0000 7f558b275640 1 --2- 172.21.15.170:0/2983734310 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5584101f70 0x7f55841043e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.886+0000 7f558b275640 1 --2- 172.21.15.170:0/2983734310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5584104920 0x7f5584104da0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.886+0000 7f558b275640 1 --2- 172.21.15.170:0/2983734310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f55840ff600 0x7f5584101a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.886+0000 7f558b275640 1 -- 172.21.15.170:0/2983734310 >> 172.21.15.170:0/2983734310 conn(0x7f55840fb220 msgr2=0x7f55840fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.886+0000 7f558b275640 1 -- 172.21.15.170:0/2983734310 shutdown_connections 2024-01-25T15:01:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.887+0000 7f558b275640 1 -- 172.21.15.170:0/2983734310 wait complete. 2024-01-25T15:01:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.887+0000 7f558b275640 1 Processor -- start 2024-01-25T15:01:18.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.887+0000 7f558b275640 1 -- start start 2024-01-25T15:01:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.887+0000 7f558b275640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55840ff600 0x7f558419d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.887+0000 7f558b275640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5584101f70 0x7f558419d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.887+0000 7f558b275640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5584104920 0x7f55841a47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.887+0000 7f558b275640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55841a4d20 con 0x7f5584104920 2024-01-25T15:01:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.887+0000 7f558b275640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55841a4e90 con 0x7f55840ff600 2024-01-25T15:01:18.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.887+0000 7f558b275640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55841a5050 con 0x7f5584101f70 2024-01-25T15:01:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.887+0000 7f5589812640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5584104920 0x7f55841a47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.887+0000 7f5589812640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5584104920 0x7f55841a47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53932/0 (socket says 172.21.15.170:53932) 2024-01-25T15:01:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.887+0000 7f5589812640 1 -- 172.21.15.170:0/2878200632 learned_addr learned my addr 172.21.15.170:0/2878200632 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.887+0000 7f5588810640 1 --2- 172.21.15.170:0/2878200632 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5584101f70 0x7f558419d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.888+0000 7f5589011640 1 --2- 172.21.15.170:0/2878200632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55840ff600 0x7f558419d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.888+0000 7f5589812640 1 -- 172.21.15.170:0/2878200632 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5584101f70 msgr2=0x7f558419d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.888+0000 7f5589812640 1 --2- 172.21.15.170:0/2878200632 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5584101f70 0x7f558419d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.888+0000 7f5589812640 1 -- 172.21.15.170:0/2878200632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55840ff600 msgr2=0x7f558419d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.888+0000 7f5589812640 1 --2- 172.21.15.170:0/2878200632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55840ff600 0x7f558419d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.888+0000 7f5589812640 1 -- 172.21.15.170:0/2878200632 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557c009560 con 0x7f5584104920 2024-01-25T15:01:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.888+0000 7f5589011640 1 --2- 172.21.15.170:0/2878200632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55840ff600 0x7f558419d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:18.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.888+0000 7f5589812640 1 --2- 172.21.15.170:0/2878200632 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5584104920 0x7f55841a47e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f557c02c7e0 tx=0x7f557c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.888+0000 7f557a7fc640 1 -- 172.21.15.170:0/2878200632 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c005000 con 0x7f5584104920 2024-01-25T15:01:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.888+0000 7f558b275640 1 -- 172.21.15.170:0/2878200632 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55841a52d0 con 0x7f5584104920 2024-01-25T15:01:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.888+0000 7f557a7fc640 1 -- 172.21.15.170:0/2878200632 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f557c005620 con 0x7f5584104920 2024-01-25T15:01:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.888+0000 7f557a7fc640 1 -- 172.21.15.170:0/2878200632 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c03e450 con 0x7f5584104920 2024-01-25T15:01:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.888+0000 7f558b275640 1 -- 172.21.15.170:0/2878200632 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55841a57e0 con 0x7f5584104920 2024-01-25T15:01:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.889+0000 7f558b275640 1 -- 172.21.15.170:0/2878200632 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55840fcd10 con 0x7f5584104920 2024-01-25T15:01:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.890+0000 7f557a7fc640 1 -- 172.21.15.170:0/2878200632 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f557c005370 con 0x7f5584104920 2024-01-25T15:01:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.891+0000 7f557a7fc640 1 --2- 172.21.15.170:0/2878200632 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55700a1370 0x7f55700a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.891+0000 7f5589011640 1 --2- 172.21.15.170:0/2878200632 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55700a1370 0x7f55700a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.891+0000 7f557a7fc640 1 -- 172.21.15.170:0/2878200632 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f557c0efc00 con 0x7f5584104920 2024-01-25T15:01:18.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.891+0000 7f5589011640 1 --2- 172.21.15.170:0/2878200632 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55700a1370 0x7f55700a3830 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5580005c40 tx=0x7f55800082f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:18.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:18.894+0000 7f557a7fc640 1 -- 172.21.15.170:0/2878200632 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f557c0b9060 con 0x7f5584104920 2024-01-25T15:01:19.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.068+0000 7f558b275640 1 -- 172.21.15.170:0/2878200632 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55840fc780 con 0x7f5584104920 2024-01-25T15:01:19.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.069+0000 7f557a7fc640 1 -- 172.21.15.170:0/2878200632 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22550 (secure 0 0 0) 0x7f557c0bc680 con 0x7f5584104920 2024-01-25T15:01:19.070 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:19.070 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":87,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T15:00:57.274280+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:01:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.071+0000 7f558b275640 1 -- 172.21.15.170:0/2878200632 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55700a1370 msgr2=0x7f55700a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.071+0000 7f558b275640 1 --2- 172.21.15.170:0/2878200632 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55700a1370 0x7f55700a3830 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5580005c40 tx=0x7f55800082f0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.071+0000 7f558b275640 1 -- 172.21.15.170:0/2878200632 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5584104920 msgr2=0x7f55841a47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.071+0000 7f558b275640 1 --2- 172.21.15.170:0/2878200632 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5584104920 0x7f55841a47e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f557c02c7e0 tx=0x7f557c004270 comp rx=0 tx=0).stop 2024-01-25T15:01:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.071+0000 7f558b275640 1 -- 172.21.15.170:0/2878200632 shutdown_connections 2024-01-25T15:01:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.071+0000 7f558b275640 1 --2- 172.21.15.170:0/2878200632 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f55700a1370 0x7f55700a3830 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.071+0000 7f558b275640 1 --2- 172.21.15.170:0/2878200632 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5584104920 0x7f55841a47e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.071+0000 7f558b275640 1 --2- 172.21.15.170:0/2878200632 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5584101f70 0x7f558419d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.071+0000 7f558b275640 1 --2- 172.21.15.170:0/2878200632 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f55840ff600 0x7f558419d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.071+0000 7f558b275640 1 -- 172.21.15.170:0/2878200632 >> 172.21.15.170:0/2878200632 conn(0x7f55840fb220 msgr2=0x7f5584102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.071+0000 7f558b275640 1 -- 172.21.15.170:0/2878200632 shutdown_connections 2024-01-25T15:01:19.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.071+0000 7f558b275640 1 -- 172.21.15.170:0/2878200632 wait complete. 2024-01-25T15:01:19.084 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:01:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.188+0000 7f38d0696640 1 -- 172.21.15.170:0/1648050737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38c81017c0 msgr2=0x7f38c8108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.188+0000 7f38d0696640 1 --2- 172.21.15.170:0/1648050737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38c81017c0 0x7f38c8108050 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f38c0009ca0 tx=0x7f38c002c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.188+0000 7f38d0696640 1 -- 172.21.15.170:0/1648050737 shutdown_connections 2024-01-25T15:01:19.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.188+0000 7f38d0696640 1 --2- 172.21.15.170:0/1648050737 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38c81017c0 0x7f38c8108050 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.188+0000 7f38d0696640 1 --2- 172.21.15.170:0/1648050737 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38c8100e00 0x7f38c8101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.188+0000 7f38d0696640 1 --2- 172.21.15.170:0/1648050737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38c80ffc10 0x7f38c8100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.188+0000 7f38d0696640 1 -- 172.21.15.170:0/1648050737 >> 172.21.15.170:0/1648050737 conn(0x7f38c80fb180 msgr2=0x7f38c80fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.188+0000 7f38d0696640 1 -- 172.21.15.170:0/1648050737 shutdown_connections 2024-01-25T15:01:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.188+0000 7f38d0696640 1 -- 172.21.15.170:0/1648050737 wait complete. 2024-01-25T15:01:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.188+0000 7f38d0696640 1 Processor -- start 2024-01-25T15:01:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38d0696640 1 -- start start 2024-01-25T15:01:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38d0696640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38c80ffc10 0x7f38c80689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38d0696640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38c8100e00 0x7f38c819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38d0696640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38c81017c0 0x7f38c819dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38d0696640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c819e770 con 0x7f38c81017c0 2024-01-25T15:01:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38d0696640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c819e8e0 con 0x7f38c80ffc10 2024-01-25T15:01:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38d0696640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c819eaa0 con 0x7f38c8100e00 2024-01-25T15:01:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38cec33640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38c81017c0 0x7f38c819dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38cec33640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38c81017c0 0x7f38c819dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53960/0 (socket says 172.21.15.170:53960) 2024-01-25T15:01:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38cec33640 1 -- 172.21.15.170:0/3416678773 learned_addr learned my addr 172.21.15.170:0/3416678773 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38ce432640 1 --2- 172.21.15.170:0/3416678773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38c80ffc10 0x7f38c80689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38cdc31640 1 --2- 172.21.15.170:0/3416678773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38c8100e00 0x7f38c819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38cec33640 1 -- 172.21.15.170:0/3416678773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38c8100e00 msgr2=0x7f38c819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38cec33640 1 --2- 172.21.15.170:0/3416678773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38c8100e00 0x7f38c819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38cec33640 1 -- 172.21.15.170:0/3416678773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38c80ffc10 msgr2=0x7f38c80689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38cec33640 1 --2- 172.21.15.170:0/3416678773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38c80ffc10 0x7f38c80689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38cec33640 1 -- 172.21.15.170:0/3416678773 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0009900 con 0x7f38c81017c0 2024-01-25T15:01:19.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38cdc31640 1 --2- 172.21.15.170:0/3416678773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38c8100e00 0x7f38c819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:19.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38cec33640 1 --2- 172.21.15.170:0/3416678773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38c81017c0 0x7f38c819dfe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f38c002c630 tx=0x7f38c00329c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38bf7fe640 1 -- 172.21.15.170:0/3416678773 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0034e80 con 0x7f38c81017c0 2024-01-25T15:01:19.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38bf7fe640 1 -- 172.21.15.170:0/3416678773 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f38c0032e90 con 0x7f38c81017c0 2024-01-25T15:01:19.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38d0696640 1 -- 172.21.15.170:0/3416678773 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c819ed20 con 0x7f38c81017c0 2024-01-25T15:01:19.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.189+0000 7f38bf7fe640 1 -- 172.21.15.170:0/3416678773 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0004860 con 0x7f38c81017c0 2024-01-25T15:01:19.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.190+0000 7f38d0696640 1 -- 172.21.15.170:0/3416678773 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c819f220 con 0x7f38c81017c0 2024-01-25T15:01:19.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.190+0000 7f38d0696640 1 -- 172.21.15.170:0/3416678773 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c8106fb0 con 0x7f38c81017c0 2024-01-25T15:01:19.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.191+0000 7f38bf7fe640 1 -- 172.21.15.170:0/3416678773 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f38c003b040 con 0x7f38c81017c0 2024-01-25T15:01:19.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.192+0000 7f38bf7fe640 1 --2- 172.21.15.170:0/3416678773 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f38b40a13f0 0x7f38b40a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.192+0000 7f38ce432640 1 --2- 172.21.15.170:0/3416678773 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f38b40a13f0 0x7f38b40a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.192+0000 7f38bf7fe640 1 -- 172.21.15.170:0/3416678773 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f38c00ef5f0 con 0x7f38c81017c0 2024-01-25T15:01:19.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.193+0000 7f38ce432640 1 --2- 172.21.15.170:0/3416678773 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f38b40a13f0 0x7f38b40a38b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f38c8100c60 tx=0x7f38c400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.196 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.196+0000 7f38bf7fe640 1 -- 172.21.15.170:0/3416678773 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f38c00b8a50 con 0x7f38c81017c0 2024-01-25T15:01:19.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:19 smithi170 ceph-mon[31899]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-01-25T15:01:19.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:19 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3641215411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:19.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:19 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1042683204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:19.357 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:19 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2878200632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:19.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.413+0000 7f38d0696640 1 -- 172.21.15.170:0/3416678773 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38c810b4d0 con 0x7f38c81017c0 2024-01-25T15:01:19.414 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.413+0000 7f38bf7fe640 1 -- 172.21.15.170:0/3416678773 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+11411 (secure 0 0 0) 0x7f38c00bc070 con 0x7f38c81017c0 2024-01-25T15:01:19.414 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:19.414 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-25T14:59:53.534085+0000","modified":"2024-01-25T15:00:00.045800+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24484,"mds_1":24479,"mds_2":24466,"mds_3":24418,"mds_4":24398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":4,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24479":{"gid":24479,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/2132502182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":2132502182},{"type":"v1","addr":"172.21.15.186:6839","nonce":2132502182}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:01:19.415 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-01-25T15:01:19.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.415+0000 7f38d0696640 1 -- 172.21.15.170:0/3416678773 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f38b40a13f0 msgr2=0x7f38b40a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.416 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.415+0000 7f38d0696640 1 --2- 172.21.15.170:0/3416678773 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f38b40a13f0 0x7f38b40a38b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f38c8100c60 tx=0x7f38c400b390 comp rx=0 tx=0).stop 2024-01-25T15:01:19.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.415+0000 7f38d0696640 1 -- 172.21.15.170:0/3416678773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38c81017c0 msgr2=0x7f38c819dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.415+0000 7f38d0696640 1 --2- 172.21.15.170:0/3416678773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38c81017c0 0x7f38c819dfe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f38c002c630 tx=0x7f38c00329c0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.415+0000 7f38d0696640 1 -- 172.21.15.170:0/3416678773 shutdown_connections 2024-01-25T15:01:19.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.415+0000 7f38d0696640 1 --2- 172.21.15.170:0/3416678773 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f38b40a13f0 0x7f38b40a38b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.415+0000 7f38d0696640 1 --2- 172.21.15.170:0/3416678773 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38c81017c0 0x7f38c819dfe0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.415+0000 7f38d0696640 1 --2- 172.21.15.170:0/3416678773 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f38c8100e00 0x7f38c819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.415+0000 7f38d0696640 1 --2- 172.21.15.170:0/3416678773 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38c80ffc10 0x7f38c80689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.415+0000 7f38d0696640 1 -- 172.21.15.170:0/3416678773 >> 172.21.15.170:0/3416678773 conn(0x7f38c80fb180 msgr2=0x7f38c8104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.416+0000 7f38d0696640 1 -- 172.21.15.170:0/3416678773 shutdown_connections 2024-01-25T15:01:19.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.416+0000 7f38d0696640 1 -- 172.21.15.170:0/3416678773 wait complete. 2024-01-25T15:01:19.428 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-01-25T14:59:53.534085+0000', 'modified': '2024-01-25T15:00:00.045800+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24484, 'mds_1': 24479, 'mds_2': 24466, 'mds_3': 24418, 'mds_4': 24398}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14616': {'gid': 14616, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.170:6839/3528948477', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6838', 'nonce': 3528948477}, {'type': 'v1', 'addr': '172.21.15.170:6839', 'nonce': 3528948477}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14628': {'gid': 14628, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.170:6841/2918388059', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6840', 'nonce': 2918388059}, {'type': 'v1', 'addr': '172.21.15.170:6841', 'nonce': 2918388059}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24398': {'gid': 24398, 'name': 'k', 'rank': 4, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.186:6833/1347511259', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6832', 'nonce': 1347511259}, {'type': 'v1', 'addr': '172.21.15.186:6833', 'nonce': 1347511259}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24418': {'gid': 24418, 'name': 'l', 'rank': 3, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.191:6833/274874056', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6832', 'nonce': 274874056}, {'type': 'v1', 'addr': '172.21.15.191:6833', 'nonce': 274874056}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24428': {'gid': 24428, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6835/2663522449', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6834', 'nonce': 2663522449}, {'type': 'v1', 'addr': '172.21.15.186:6835', 'nonce': 2663522449}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24449': {'gid': 24449, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6837/2382645540', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6836', 'nonce': 2382645540}, {'type': 'v1', 'addr': '172.21.15.186:6837', 'nonce': 2382645540}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24457': {'gid': 24457, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6835/1870775954', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 1870775954}, {'type': 'v1', 'addr': '172.21.15.191:6835', 'nonce': 1870775954}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.191:6837/719224494', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6836', 'nonce': 719224494}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 719224494}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24479': {'gid': 24479, 'name': 'b', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.186:6839/2132502182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6838', 'nonce': 2132502182}, {'type': 'v1', 'addr': '172.21.15.186:6839', 'nonce': 2132502182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24484': {'gid': 24484, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.191:6839/2461767313', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6838', 'nonce': 2461767313}, {'type': 'v1', 'addr': '172.21.15.191:6839', 'nonce': 2461767313}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-25T15:01:19.428 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-01-25T15:01:19.429 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2024-01-25T15:01:19.535 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.534+0000 7f3a8e6d5640 1 -- 172.21.15.170:0/1792844050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a880ff5c0 msgr2=0x7f3a880ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.534+0000 7f3a8e6d5640 1 --2- 172.21.15.170:0/1792844050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a880ff5c0 0x7f3a880ff9e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3a70009900 tx=0x7f3a7002bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:19.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.534+0000 7f3a8e6d5640 1 -- 172.21.15.170:0/1792844050 shutdown_connections 2024-01-25T15:01:19.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.534+0000 7f3a8e6d5640 1 --2- 172.21.15.170:0/1792844050 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a881008c0 0x7f3a88100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.534+0000 7f3a8e6d5640 1 --2- 172.21.15.170:0/1792844050 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a880fff20 0x7f3a88100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.534+0000 7f3a8e6d5640 1 --2- 172.21.15.170:0/1792844050 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a880ff5c0 0x7f3a880ff9e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.534+0000 7f3a8e6d5640 1 -- 172.21.15.170:0/1792844050 >> 172.21.15.170:0/1792844050 conn(0x7f3a880fb180 msgr2=0x7f3a880fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.534+0000 7f3a8e6d5640 1 -- 172.21.15.170:0/1792844050 shutdown_connections 2024-01-25T15:01:19.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.534+0000 7f3a8e6d5640 1 -- 172.21.15.170:0/1792844050 wait complete. 2024-01-25T15:01:19.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.535+0000 7f3a8e6d5640 1 Processor -- start 2024-01-25T15:01:19.536 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.535+0000 7f3a8e6d5640 1 -- start start 2024-01-25T15:01:19.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.535+0000 7f3a8e6d5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a880ff5c0 0x7f3a8819d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.535+0000 7f3a8e6d5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a880fff20 0x7f3a8819d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.535+0000 7f3a8e6d5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a881008c0 0x7f3a881a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.535+0000 7f3a8e6d5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a881a4dc0 con 0x7f3a881008c0 2024-01-25T15:01:19.538 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.535+0000 7f3a8e6d5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a881a4f30 con 0x7f3a880fff20 2024-01-25T15:01:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.535+0000 7f3a8e6d5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a881a50f0 con 0x7f3a880ff5c0 2024-01-25T15:01:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.535+0000 7f3a8cc72640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a881008c0 0x7f3a881a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.535+0000 7f3a8cc72640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a881008c0 0x7f3a881a4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53982/0 (socket says 172.21.15.170:53982) 2024-01-25T15:01:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.535+0000 7f3a8cc72640 1 -- 172.21.15.170:0/3295287077 learned_addr learned my addr 172.21.15.170:0/3295287077 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.536+0000 7f3a877fe640 1 --2- 172.21.15.170:0/3295287077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a880fff20 0x7f3a8819d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.536+0000 7f3a87fff640 1 --2- 172.21.15.170:0/3295287077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a880ff5c0 0x7f3a8819d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.536+0000 7f3a8cc72640 1 -- 172.21.15.170:0/3295287077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a880ff5c0 msgr2=0x7f3a8819d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.536+0000 7f3a8cc72640 1 --2- 172.21.15.170:0/3295287077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a880ff5c0 0x7f3a8819d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.536+0000 7f3a8cc72640 1 -- 172.21.15.170:0/3295287077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a880fff20 msgr2=0x7f3a8819d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.536+0000 7f3a8cc72640 1 --2- 172.21.15.170:0/3295287077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a880fff20 0x7f3a8819d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.536+0000 7f3a8cc72640 1 -- 172.21.15.170:0/3295287077 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a70009560 con 0x7f3a881008c0 2024-01-25T15:01:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.536+0000 7f3a8cc72640 1 --2- 172.21.15.170:0/3295287077 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a881008c0 0x7f3a881a4880 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000cce0 tx=0x7f3a8000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.536+0000 7f3a857fa640 1 -- 172.21.15.170:0/3295287077 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8000f450 con 0x7f3a881008c0 2024-01-25T15:01:19.539 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.536+0000 7f3a8e6d5640 1 -- 172.21.15.170:0/3295287077 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a881a53d0 con 0x7f3a881008c0 2024-01-25T15:01:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.536+0000 7f3a857fa640 1 -- 172.21.15.170:0/3295287077 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a8000fa70 con 0x7f3a881008c0 2024-01-25T15:01:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.536+0000 7f3a857fa640 1 -- 172.21.15.170:0/3295287077 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80018b40 con 0x7f3a881008c0 2024-01-25T15:01:19.540 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.536+0000 7f3a8e6d5640 1 -- 172.21.15.170:0/3295287077 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a881a58e0 con 0x7f3a881008c0 2024-01-25T15:01:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.539+0000 7f3a9137a740 1 Processor -- start 2024-01-25T15:01:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.539+0000 7f3a857fa640 1 -- 172.21.15.170:0/3295287077 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f3a8000fbe0 con 0x7f3a881008c0 2024-01-25T15:01:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.539+0000 7f3a9137a740 1 -- start start 2024-01-25T15:01:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.539+0000 7f3a9137a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0563286a0 0x55d056328ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.539+0000 7f3a9137a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d056329090 0x55d05632db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.539+0000 7f3a9137a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d05632e200 0x55d056330690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.539+0000 7f3a9137a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d056297030 con 0x55d0563286a0 2024-01-25T15:01:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.539+0000 7f3a9137a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d056294720 con 0x55d056329090 2024-01-25T15:01:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.539+0000 7f3a9137a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d056290010 con 0x55d05632e200 2024-01-25T15:01:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.539+0000 7f3a877fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0563286a0 0x55d056328ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.539+0000 7f3a877fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0563286a0 0x55d056328ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53992/0 (socket says 172.21.15.170:53992) 2024-01-25T15:01:19.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.539+0000 7f3a877fe640 1 -- 172.21.15.170:0/1617142119 learned_addr learned my addr 172.21.15.170:0/1617142119 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.540+0000 7f3a87fff640 1 --2- 172.21.15.170:0/1617142119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d056329090 0x55d05632db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.540+0000 7f3a877fe640 1 --2- 172.21.15.170:0/1617142119 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d05632e200 0x55d056330690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.540+0000 7f3a857fa640 1 --2- 172.21.15.170:0/3295287077 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3a740a1370 0x7f3a740a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.540+0000 7f3a877fe640 1 -- 172.21.15.170:0/1617142119 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d05632e200 msgr2=0x55d056330690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.540+0000 7f3a877fe640 1 --2- 172.21.15.170:0/1617142119 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d05632e200 0x55d056330690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.540+0000 7f3a877fe640 1 -- 172.21.15.170:0/1617142119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d056329090 msgr2=0x55d05632db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.540+0000 7f3a877fe640 1 --2- 172.21.15.170:0/1617142119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d056329090 0x55d05632db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.540+0000 7f3a877fe640 1 -- 172.21.15.170:0/1617142119 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d056252680 con 0x55d0563286a0 2024-01-25T15:01:19.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.540+0000 7f3a8cc72640 1 --2- 172.21.15.170:0/3295287077 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3a740a1370 0x7f3a740a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.540+0000 7f3a877fe640 1 --2- 172.21.15.170:0/1617142119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0563286a0 0x55d056328ac0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800af60 tx=0x7f3a7800a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafbb3c7f9c4b083 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.540+0000 7f3a857fa640 1 -- 172.21.15.170:0/3295287077 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f3a800cd440 con 0x7f3a881008c0 2024-01-25T15:01:19.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.540+0000 7f3a7e7fc640 1 -- 172.21.15.170:0/1617142119 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a780110d0 con 0x55d0563286a0 2024-01-25T15:01:19.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.540+0000 7f3a7e7fc640 1 -- 172.21.15.170:0/1617142119 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a78011230 con 0x55d0563286a0 2024-01-25T15:01:19.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.540+0000 7f3a7e7fc640 1 -- 172.21.15.170:0/1617142119 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78004dc0 con 0x55d0563286a0 2024-01-25T15:01:19.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.541+0000 7f3a9137a740 1 -- 172.21.15.170:0/1617142119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0563286a0 msgr2=0x55d056328ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.541+0000 7f3a9137a740 1 --2- 172.21.15.170:0/1617142119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0563286a0 0x55d056328ac0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3a7800af60 tx=0x7f3a7800a780 comp rx=0 tx=0).stop 2024-01-25T15:01:19.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.541+0000 7f3a8cc72640 1 --2- 172.21.15.170:0/3295287077 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3a740a1370 0x7f3a740a3830 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3a8009a3e0 tx=0x7f3a800185a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.541+0000 7f3a9137a740 1 -- 172.21.15.170:0/1617142119 shutdown_connections 2024-01-25T15:01:19.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.541+0000 7f3a9137a740 1 --2- 172.21.15.170:0/1617142119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d056329090 0x55d05632db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.541+0000 7f3a9137a740 1 --2- 172.21.15.170:0/1617142119 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d05632e200 0x55d056330690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.541+0000 7f3a9137a740 1 --2- 172.21.15.170:0/1617142119 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0563286a0 0x55d056328ac0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.541+0000 7f3a9137a740 1 -- 172.21.15.170:0/1617142119 >> 172.21.15.170:0/1617142119 conn(0x55d056323c10 msgr2=0x55d056324010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.541+0000 7f3a9137a740 1 -- 172.21.15.170:0/1617142119 shutdown_connections 2024-01-25T15:01:19.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.541+0000 7f3a9137a740 1 -- 172.21.15.170:0/1617142119 wait complete. 2024-01-25T15:01:19.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.541+0000 7f3a9137a740 1 -- start start 2024-01-25T15:01:19.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a9137a740 1 Processor -- start 2024-01-25T15:01:19.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a9137a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0563286a0 0x55d0563328e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a9137a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056332e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a9137a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d05632e200 0x55d056339df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a9137a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0562495f0 con 0x55d056329090 2024-01-25T15:01:19.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a9137a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d056249290 con 0x55d0563286a0 2024-01-25T15:01:19.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a9137a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d05620e300 con 0x55d05632e200 2024-01-25T15:01:19.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a9137a740 10 client.0 _ll_register_callbacks cb 0x55d056244260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:19.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a87fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056332e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a87fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056332e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53996/0 (socket says 172.21.15.170:53996) 2024-01-25T15:01:19.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a87fff640 1 -- 172.21.15.170:0/753644617 learned_addr learned my addr 172.21.15.170:0/753644617 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a877fe640 1 --2- 172.21.15.170:0/753644617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d05632e200 0x55d056339df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a87fff640 1 -- 172.21.15.170:0/753644617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d05632e200 msgr2=0x55d056339df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a87fff640 1 --2- 172.21.15.170:0/753644617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d05632e200 0x55d056339df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a87fff640 1 -- 172.21.15.170:0/753644617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0563286a0 msgr2=0x55d0563328e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a87fff640 1 --2- 172.21.15.170:0/753644617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0563286a0 0x55d0563328e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a87fff640 1 -- 172.21.15.170:0/753644617 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7800ad40 con 0x55d056329090 2024-01-25T15:01:19.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a877fe640 1 --2- 172.21.15.170:0/753644617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d05632e200 0x55d056339df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:19.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a87fff640 1 --2- 172.21.15.170:0/753644617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056332e20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3a70036040 tx=0x7f3a70004a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607d0b0d60ce83f9 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a677fe640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:19.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a677fe640 1 -- 172.21.15.170:0/753644617 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70004310 con 0x55d056329090 2024-01-25T15:01:19.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a677fe640 1 -- 172.21.15.170:0/753644617 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f3a70045070 con 0x55d056329090 2024-01-25T15:01:19.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.542+0000 7f3a9137a740 1 -- 172.21.15.170:0/753644617 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d056288ea0 con 0x55d056329090 2024-01-25T15:01:19.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.543+0000 7f3a677fe640 1 -- 172.21.15.170:0/753644617 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a70004470 con 0x55d056329090 2024-01-25T15:01:19.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.543+0000 7f3a9137a740 10 client.15045 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:19.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.543+0000 7f3a9137a740 1 -- 172.21.15.170:0/753644617 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55d05628e690 con 0x55d056329090 2024-01-25T15:01:19.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.543+0000 7f3a677fe640 1 -- 172.21.15.170:0/753644617 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d056288ea0 con 0x55d056329090 2024-01-25T15:01:19.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.543+0000 7f3a677fe640 1 -- 172.21.15.170:0/753644617 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3a7003c040 con 0x55d056329090 2024-01-25T15:01:19.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.543+0000 7f3a9137a740 10 client.15045 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:19.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.543+0000 7f3a9137a740 10 client.15045 resolve_mds: resolved name 'k' to daemon mds.k 2024-01-25T15:01:19.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.543+0000 7f3a9137a740 20 client.15045 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:19.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.543+0000 7f3a9137a740 1 --2- 172.21.15.170:0/753644617 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55d05633fa30 0x55d05633e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.543+0000 7f3a9137a740 4 client.15045 mds_command: new command op to 24398 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:01:19.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.543+0000 7f3a9137a740 1 -- 172.21.15.170:0/753644617 --> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d056288bc0 con 0x55d05633fa30 2024-01-25T15:01:19.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.543+0000 7f3a877fe640 1 --2- 172.21.15.170:0/753644617 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55d05633fa30 0x55d05633e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.544+0000 7f3a677fe640 10 client.15045 ms_handle_connect on v2:172.21.15.186:6832/1347511259 2024-01-25T15:01:19.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.544+0000 7f3a877fe640 1 --2- 172.21.15.170:0/753644617 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55d05633fa30 0x55d05633e4c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6d143191dd35c256 server_cookie=9ec1b73704c28949 in_seq=0 out_seq=0 2024-01-25T15:01:19.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.544+0000 7f3a677fe640 1 -- 172.21.15.170:0/753644617 <== mds.4 v2:172.21.15.186:6832/1347511259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d056288bc0 con 0x55d05633fa30 2024-01-25T15:01:19.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.544+0000 7f3a677fe640 10 client.15045 handle_command_reply: tid=0 2024-01-25T15:01:19.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.544+0000 7f3a9137a740 1 client.15045 shutdown 2024-01-25T15:01:19.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.545+0000 7f3a9137a740 1 -- 172.21.15.170:0/753644617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 msgr2=0x55d056332e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.545+0000 7f3a9137a740 1 --2- 172.21.15.170:0/753644617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056332e20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3a70036040 tx=0x7f3a70004a30 comp rx=0 tx=0).stop 2024-01-25T15:01:19.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.545+0000 7f3a9137a740 1 -- 172.21.15.170:0/753644617 shutdown_connections 2024-01-25T15:01:19.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.545+0000 7f3a9137a740 1 --2- 172.21.15.170:0/753644617 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55d05633fa30 0x55d05633e4c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.545+0000 7f3a9137a740 1 --2- 172.21.15.170:0/753644617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d05632e200 0x55d056339df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.545+0000 7f3a9137a740 1 --2- 172.21.15.170:0/753644617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056332e20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.545+0000 7f3a9137a740 1 --2- 172.21.15.170:0/753644617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0563286a0 0x55d0563328e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.545+0000 7f3a9137a740 1 -- 172.21.15.170:0/753644617 >> 172.21.15.170:0/753644617 conn(0x55d056323c10 msgr2=0x55d056322da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.545+0000 7f3a677fe640 0 client.15045 ms_handle_reset on v2:172.21.15.186:6832/1347511259 2024-01-25T15:01:19.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.545+0000 7f3a9137a740 1 -- 172.21.15.170:0/753644617 shutdown_connections 2024-01-25T15:01:19.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.545+0000 7f3a9137a740 1 -- 172.21.15.170:0/753644617 wait complete. 2024-01-25T15:01:19.553 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.545+0000 7f3a9137a740 20 client.15045 trim_cache size 0 max 16384 2024-01-25T15:01:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a9137a740 1 Processor -- start 2024-01-25T15:01:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a9137a740 1 -- start start 2024-01-25T15:01:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a9137a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0563286a0 0x55d056347210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a9137a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056339db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.567 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a9137a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d05632e200 0x55d05632a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a9137a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d056324700 con 0x55d056329090 2024-01-25T15:01:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a9137a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d056330d50 con 0x55d0563286a0 2024-01-25T15:01:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a9137a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d056288bf0 con 0x55d05632e200 2024-01-25T15:01:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a87fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056339db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a87fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056339db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53998/0 (socket says 172.21.15.170:53998) 2024-01-25T15:01:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a87fff640 1 -- 172.21.15.170:0/2394885552 learned_addr learned my addr 172.21.15.170:0/2394885552 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a877fe640 1 --2- 172.21.15.170:0/2394885552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0563286a0 0x55d056347210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a87fff640 1 -- 172.21.15.170:0/2394885552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d05632e200 msgr2=0x55d05632a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a87fff640 1 --2- 172.21.15.170:0/2394885552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d05632e200 0x55d05632a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a87fff640 1 -- 172.21.15.170:0/2394885552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0563286a0 msgr2=0x55d056347210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a87fff640 1 --2- 172.21.15.170:0/2394885552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0563286a0 0x55d056347210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a87fff640 1 -- 172.21.15.170:0/2394885552 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d05622b390 con 0x55d056329090 2024-01-25T15:01:19.568 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a877fe640 1 --2- 172.21.15.170:0/2394885552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0563286a0 0x55d056347210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a87fff640 1 --2- 172.21.15.170:0/2394885552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056339db0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3a7002c6b0 tx=0x7f3a7002bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66995c4ca2918519 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a7dffb640 1 -- 172.21.15.170:0/2394885552 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70004510 con 0x55d056329090 2024-01-25T15:01:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a7dffb640 1 -- 172.21.15.170:0/2394885552 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a70043070 con 0x55d056329090 2024-01-25T15:01:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.561+0000 7f3a7dffb640 1 -- 172.21.15.170:0/2394885552 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a700055e0 con 0x55d056329090 2024-01-25T15:01:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.562+0000 7f3a9137a740 1 -- 172.21.15.170:0/2394885552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 msgr2=0x55d056339db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.562+0000 7f3a9137a740 1 --2- 172.21.15.170:0/2394885552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056339db0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3a7002c6b0 tx=0x7f3a7002bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.562+0000 7f3a9137a740 1 -- 172.21.15.170:0/2394885552 shutdown_connections 2024-01-25T15:01:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.562+0000 7f3a9137a740 1 --2- 172.21.15.170:0/2394885552 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d05632e200 0x55d05632a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.562+0000 7f3a9137a740 1 --2- 172.21.15.170:0/2394885552 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056339db0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.562+0000 7f3a9137a740 1 --2- 172.21.15.170:0/2394885552 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0563286a0 0x55d056347210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.562+0000 7f3a9137a740 1 -- 172.21.15.170:0/2394885552 >> 172.21.15.170:0/2394885552 conn(0x55d056323c10 msgr2=0x55d056323ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.562+0000 7f3a9137a740 1 -- 172.21.15.170:0/2394885552 shutdown_connections 2024-01-25T15:01:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.562+0000 7f3a9137a740 1 -- 172.21.15.170:0/2394885552 wait complete. 2024-01-25T15:01:19.569 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.562+0000 7f3a9137a740 1 -- start start 2024-01-25T15:01:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a9137a740 1 Processor -- start 2024-01-25T15:01:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a9137a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0563286a0 0x55d056339960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a9137a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056336540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a9137a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d05632e200 0x55d056336a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a9137a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d056337180 con 0x55d056329090 2024-01-25T15:01:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a9137a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d056339f90 con 0x55d05632e200 2024-01-25T15:01:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a9137a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d05633a150 con 0x55d0563286a0 2024-01-25T15:01:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a9137a740 10 client.0 _ll_register_callbacks cb 0x7f3a7800a690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a87fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056336540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a87fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056336540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54010/0 (socket says 172.21.15.170:54010) 2024-01-25T15:01:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a87fff640 1 -- 172.21.15.170:0/1728960932 learned_addr learned my addr 172.21.15.170:0/1728960932 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a877fe640 1 --2- 172.21.15.170:0/1728960932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0563286a0 0x55d056339960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.570 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a877fe640 1 --2- 172.21.15.170:0/1728960932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d05632e200 0x55d056336a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a87fff640 1 -- 172.21.15.170:0/1728960932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0563286a0 msgr2=0x55d056339960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a87fff640 1 --2- 172.21.15.170:0/1728960932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0563286a0 0x55d056339960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a87fff640 1 -- 172.21.15.170:0/1728960932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d05632e200 msgr2=0x55d056336a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a87fff640 1 --2- 172.21.15.170:0/1728960932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d05632e200 0x55d056336a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a87fff640 1 -- 172.21.15.170:0/1728960932 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d05628e690 con 0x55d056329090 2024-01-25T15:01:19.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a877fe640 1 --2- 172.21.15.170:0/1728960932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d05632e200 0x55d056336a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:19.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a87fff640 1 --2- 172.21.15.170:0/1728960932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056336540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3a7002c170 tx=0x7f3a7002c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b9fdc696a14a55 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.563+0000 7f3a677fe640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:19.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.564+0000 7f3a677fe640 1 -- 172.21.15.170:0/1728960932 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a700054e0 con 0x55d056329090 2024-01-25T15:01:19.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.564+0000 7f3a677fe640 1 -- 172.21.15.170:0/1728960932 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f3a70045040 con 0x55d056329090 2024-01-25T15:01:19.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.564+0000 7f3a9137a740 1 -- 172.21.15.170:0/1728960932 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a78011230 con 0x55d056329090 2024-01-25T15:01:19.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.564+0000 7f3a677fe640 1 -- 172.21.15.170:0/1728960932 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a70005640 con 0x55d056329090 2024-01-25T15:01:19.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.564+0000 7f3a9137a740 10 client.15051 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:19.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.564+0000 7f3a9137a740 1 -- 172.21.15.170:0/1728960932 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55d056250ee0 con 0x55d056329090 2024-01-25T15:01:19.571 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.564+0000 7f3a677fe640 1 -- 172.21.15.170:0/1728960932 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a78011230 con 0x55d056329090 2024-01-25T15:01:19.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.564+0000 7f3a677fe640 1 -- 172.21.15.170:0/1728960932 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3a7003c040 con 0x55d056329090 2024-01-25T15:01:19.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.564+0000 7f3a9137a740 10 client.15051 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:19.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.564+0000 7f3a9137a740 10 client.15051 resolve_mds: resolved name 'k' to daemon mds.k 2024-01-25T15:01:19.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.564+0000 7f3a9137a740 20 client.15051 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:19.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.564+0000 7f3a9137a740 1 --2- 172.21.15.170:0/1728960932 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55d056399590 0x55d056395a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.564+0000 7f3a9137a740 4 client.15051 mds_command: new command op to 24398 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-25T15:01:19.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.564+0000 7f3a9137a740 1 -- 172.21.15.170:0/1728960932 --> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d055f8f6c0 con 0x55d056399590 2024-01-25T15:01:19.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a877fe640 1 --2- 172.21.15.170:0/1728960932 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55d056399590 0x55d056395a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a877fe640 1 --2- 172.21.15.170:0/1728960932 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55d056399590 0x55d056395a90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b8e98cd3f695fc25 server_cookie=61b185ab94b91287 in_seq=0 out_seq=0 2024-01-25T15:01:19.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a677fe640 10 client.15051 ms_handle_connect on v2:172.21.15.186:6832/1347511259 2024-01-25T15:01:19.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a677fe640 1 -- 172.21.15.170:0/1728960932 <== mds.4 v2:172.21.15.186:6832/1347511259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55d055f8f6c0 con 0x55d056399590 2024-01-25T15:01:19.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a677fe640 10 client.15051 handle_command_reply: tid=0 2024-01-25T15:01:19.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a9137a740 1 client.15051 shutdown 2024-01-25T15:01:19.572 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a9137a740 1 -- 172.21.15.170:0/1728960932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 msgr2=0x55d056336540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a9137a740 1 --2- 172.21.15.170:0/1728960932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056336540 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3a7002c170 tx=0x7f3a7002c5d0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a9137a740 1 -- 172.21.15.170:0/1728960932 shutdown_connections 2024-01-25T15:01:19.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a9137a740 1 --2- 172.21.15.170:0/1728960932 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d05632e200 0x55d056336a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a9137a740 1 --2- 172.21.15.170:0/1728960932 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55d056399590 0x55d056395a90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a9137a740 1 --2- 172.21.15.170:0/1728960932 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d056329090 0x55d056336540 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a677fe640 0 client.15051 ms_handle_reset on v2:172.21.15.186:6832/1347511259 2024-01-25T15:01:19.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a9137a740 1 --2- 172.21.15.170:0/1728960932 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0563286a0 0x55d056339960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a9137a740 1 -- 172.21.15.170:0/1728960932 >> 172.21.15.170:0/1728960932 conn(0x55d056323c10 msgr2=0x55d056347210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a9137a740 1 -- 172.21.15.170:0/1728960932 shutdown_connections 2024-01-25T15:01:19.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a9137a740 1 -- 172.21.15.170:0/1728960932 wait complete. 2024-01-25T15:01:19.573 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.565+0000 7f3a9137a740 20 client.15051 trim_cache size 0 max 16384 2024-01-25T15:01:19.574 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:01:19.574 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "267213a8-bb91-11ee-95b2-87774f69a715", 2024-01-25T15:01:19.574 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 4, 2024-01-25T15:01:19.574 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 24398, 2024-01-25T15:01:19.574 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2024-01-25T15:01:19.574 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2024-01-25T15:01:19.574 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs", 2024-01-25T15:01:19.574 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 80.523220328999997, 2024-01-25T15:01:19.574 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 25, 2024-01-25T15:01:19.574 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 87, 2024-01-25T15:01:19.574 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 85, 2024-01-25T15:01:19.574 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 118.500982451 2024-01-25T15:01:19.574 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:01:19.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.566+0000 7f3a8e6d5640 1 -- 172.21.15.170:0/3295287077 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3a740a1370 msgr2=0x7f3a740a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.566+0000 7f3a8e6d5640 1 --2- 172.21.15.170:0/3295287077 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3a740a1370 0x7f3a740a3830 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3a8009a3e0 tx=0x7f3a800185a0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.566+0000 7f3a8e6d5640 1 -- 172.21.15.170:0/3295287077 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a881008c0 msgr2=0x7f3a881a4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.566+0000 7f3a8e6d5640 1 --2- 172.21.15.170:0/3295287077 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a881008c0 0x7f3a881a4880 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000cce0 tx=0x7f3a8000a620 comp rx=0 tx=0).stop 2024-01-25T15:01:19.575 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.566+0000 7f3a8e6d5640 1 -- 172.21.15.170:0/3295287077 shutdown_connections 2024-01-25T15:01:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.566+0000 7f3a8e6d5640 1 --2- 172.21.15.170:0/3295287077 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3a740a1370 0x7f3a740a3830 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.566+0000 7f3a8e6d5640 1 --2- 172.21.15.170:0/3295287077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a880fff20 0x7f3a8819d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.566+0000 7f3a8e6d5640 1 --2- 172.21.15.170:0/3295287077 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3a881008c0 0x7f3a881a4880 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.566+0000 7f3a8e6d5640 1 --2- 172.21.15.170:0/3295287077 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3a880ff5c0 0x7f3a8819d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.566+0000 7f3a8e6d5640 1 -- 172.21.15.170:0/3295287077 >> 172.21.15.170:0/3295287077 conn(0x7f3a880fb180 msgr2=0x7f3a880fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.566+0000 7f3a8e6d5640 1 -- 172.21.15.170:0/3295287077 shutdown_connections 2024-01-25T15:01:19.576 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.566+0000 7f3a8e6d5640 1 -- 172.21.15.170:0/3295287077 wait complete. 2024-01-25T15:01:19.578 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2024-01-25T15:01:19.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:19 smithi186 ceph-mon[35697]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-01-25T15:01:19.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:19 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3641215411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:19.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:19 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1042683204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:19.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:19 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2878200632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:19.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.681+0000 7f93e90a6640 1 -- 172.21.15.170:0/1791207756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e40ffbf0 msgr2=0x7f93e4100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.681+0000 7f93e90a6640 1 --2- 172.21.15.170:0/1791207756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e40ffbf0 0x7f93e4100010 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009900 tx=0x7f93cc02bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:19.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.681+0000 7f93e90a6640 1 -- 172.21.15.170:0/1791207756 shutdown_connections 2024-01-25T15:01:19.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.681+0000 7f93e90a6640 1 --2- 172.21.15.170:0/1791207756 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93e41017a0 0x7f93e4108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.681+0000 7f93e90a6640 1 --2- 172.21.15.170:0/1791207756 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93e4100de0 0x7f93e4101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.681+0000 7f93e90a6640 1 --2- 172.21.15.170:0/1791207756 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e40ffbf0 0x7f93e4100010 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.681+0000 7f93e90a6640 1 -- 172.21.15.170:0/1791207756 >> 172.21.15.170:0/1791207756 conn(0x7f93e40fb180 msgr2=0x7f93e40fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.681+0000 7f93e90a6640 1 -- 172.21.15.170:0/1791207756 shutdown_connections 2024-01-25T15:01:19.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.681+0000 7f93e90a6640 1 -- 172.21.15.170:0/1791207756 wait complete. 2024-01-25T15:01:19.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.682+0000 7f93e90a6640 1 Processor -- start 2024-01-25T15:01:19.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.682+0000 7f93e90a6640 1 -- start start 2024-01-25T15:01:19.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.682+0000 7f93e90a6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e40ffbf0 0x7f93e4198f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.682+0000 7f93e90a6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93e4100de0 0x7f93e41994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.682+0000 7f93e90a6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93e41017a0 0x7f93e41a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.682+0000 7f93e90a6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e41a0a60 con 0x7f93e40ffbf0 2024-01-25T15:01:19.685 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.682+0000 7f93e90a6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e41a0bd0 con 0x7f93e41017a0 2024-01-25T15:01:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.682+0000 7f93e90a6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e41a0d90 con 0x7f93e4100de0 2024-01-25T15:01:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.682+0000 7f93e2d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e40ffbf0 0x7f93e4198f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.682+0000 7f93e2d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e40ffbf0 0x7f93e4198f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54024/0 (socket says 172.21.15.170:54024) 2024-01-25T15:01:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.682+0000 7f93e2d9d640 1 -- 172.21.15.170:0/2842852813 learned_addr learned my addr 172.21.15.170:0/2842852813 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.683+0000 7f93e259c640 1 --2- 172.21.15.170:0/2842852813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93e4100de0 0x7f93e41994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.683+0000 7f93e359e640 1 --2- 172.21.15.170:0/2842852813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93e41017a0 0x7f93e41a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.683+0000 7f93e2d9d640 1 -- 172.21.15.170:0/2842852813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93e4100de0 msgr2=0x7f93e41994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.683+0000 7f93e2d9d640 1 --2- 172.21.15.170:0/2842852813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93e4100de0 0x7f93e41994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.683+0000 7f93e2d9d640 1 -- 172.21.15.170:0/2842852813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93e41017a0 msgr2=0x7f93e41a0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.683+0000 7f93e2d9d640 1 --2- 172.21.15.170:0/2842852813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93e41017a0 0x7f93e41a0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.683+0000 7f93e2d9d640 1 -- 172.21.15.170:0/2842852813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc009560 con 0x7f93e40ffbf0 2024-01-25T15:01:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.683+0000 7f93e359e640 1 --2- 172.21.15.170:0/2842852813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93e41017a0 0x7f93e41a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.683+0000 7f93e2d9d640 1 --2- 172.21.15.170:0/2842852813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e40ffbf0 0x7f93e4198f70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009230 tx=0x7f93cc004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.683+0000 7f93dbfff640 1 -- 172.21.15.170:0/2842852813 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0043d0 con 0x7f93e40ffbf0 2024-01-25T15:01:19.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.683+0000 7f93dbfff640 1 -- 172.21.15.170:0/2842852813 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93cc0054c0 con 0x7f93e40ffbf0 2024-01-25T15:01:19.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.683+0000 7f93e90a6640 1 -- 172.21.15.170:0/2842852813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e41a1010 con 0x7f93e40ffbf0 2024-01-25T15:01:19.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.683+0000 7f93dbfff640 1 -- 172.21.15.170:0/2842852813 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc003e60 con 0x7f93e40ffbf0 2024-01-25T15:01:19.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.683+0000 7f93e90a6640 1 -- 172.21.15.170:0/2842852813 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e41a1520 con 0x7f93e40ffbf0 2024-01-25T15:01:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.685+0000 7f93dbfff640 1 -- 172.21.15.170:0/2842852813 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f93cc0035f0 con 0x7f93e40ffbf0 2024-01-25T15:01:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.686+0000 7f93dbfff640 1 --2- 172.21.15.170:0/2842852813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f93d00a1370 0x7f93d00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.686+0000 7f93e259c640 1 --2- 172.21.15.170:0/2842852813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f93d00a1370 0x7f93d00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.686+0000 7f93dbfff640 1 -- 172.21.15.170:0/2842852813 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f93cc0ef550 con 0x7f93e40ffbf0 2024-01-25T15:01:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.686+0000 7f93e259c640 1 --2- 172.21.15.170:0/2842852813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f93d00a1370 0x7f93d00a3830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f93e419a480 tx=0x7f93d400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93ebc62740 1 Processor -- start 2024-01-25T15:01:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93ebc62740 1 -- start start 2024-01-25T15:01:19.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93ebc62740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feeb56a0 0x5614feeb5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93ebc62740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feeb6090 0x5614feebab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93ebc62740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feebb200 0x5614feebd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93ebc62740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614fee24030 con 0x5614feeb56a0 2024-01-25T15:01:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93ebc62740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614fee21720 con 0x5614feebb200 2024-01-25T15:01:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93ebc62740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614fee1d010 con 0x5614feeb6090 2024-01-25T15:01:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93e2d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feeb56a0 0x5614feeb5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93e2d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feeb56a0 0x5614feeb5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54028/0 (socket says 172.21.15.170:54028) 2024-01-25T15:01:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93e2d9d640 1 -- 172.21.15.170:0/3546112798 learned_addr learned my addr 172.21.15.170:0/3546112798 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93e259c640 1 --2- 172.21.15.170:0/3546112798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feeb6090 0x5614feebab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93e2d9d640 1 -- 172.21.15.170:0/3546112798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feeb6090 msgr2=0x5614feebab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93e2d9d640 1 --2- 172.21.15.170:0/3546112798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feeb6090 0x5614feebab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93e2d9d640 1 -- 172.21.15.170:0/3546112798 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feebb200 msgr2=0x5614feebd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93e2d9d640 1 --2- 172.21.15.170:0/3546112798 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feebb200 0x5614feebd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.693 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93e2d9d640 1 -- 172.21.15.170:0/3546112798 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614feddf680 con 0x5614feeb56a0 2024-01-25T15:01:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.687+0000 7f93e2d9d640 1 --2- 172.21.15.170:0/3546112798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feeb56a0 0x5614feeb5ac0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f93cc005910 tx=0x7f93cc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b663cb844a006a14 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.688+0000 7f93d97fa640 1 -- 172.21.15.170:0/3546112798 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0bc670 con 0x5614feeb56a0 2024-01-25T15:01:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.688+0000 7f93d97fa640 1 -- 172.21.15.170:0/3546112798 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93cc0c07c0 con 0x5614feeb56a0 2024-01-25T15:01:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.688+0000 7f93d97fa640 1 -- 172.21.15.170:0/3546112798 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0bbb60 con 0x5614feeb56a0 2024-01-25T15:01:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.688+0000 7f93ebc62740 1 -- 172.21.15.170:0/3546112798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feeb56a0 msgr2=0x5614feeb5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.688+0000 7f93ebc62740 1 --2- 172.21.15.170:0/3546112798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feeb56a0 0x5614feeb5ac0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f93cc005910 tx=0x7f93cc005fd0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.688+0000 7f93ebc62740 1 -- 172.21.15.170:0/3546112798 shutdown_connections 2024-01-25T15:01:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.688+0000 7f93ebc62740 1 --2- 172.21.15.170:0/3546112798 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feebb200 0x5614feebd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.688+0000 7f93ebc62740 1 --2- 172.21.15.170:0/3546112798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feeb6090 0x5614feebab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.688+0000 7f93ebc62740 1 --2- 172.21.15.170:0/3546112798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feeb56a0 0x5614feeb5ac0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.688+0000 7f93ebc62740 1 -- 172.21.15.170:0/3546112798 >> 172.21.15.170:0/3546112798 conn(0x5614feeb0c10 msgr2=0x5614feeb1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.688+0000 7f93ebc62740 1 -- 172.21.15.170:0/3546112798 shutdown_connections 2024-01-25T15:01:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93ebc62740 1 -- 172.21.15.170:0/3546112798 wait complete. 2024-01-25T15:01:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93ebc62740 1 -- start start 2024-01-25T15:01:19.694 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93ebc62740 1 Processor -- start 2024-01-25T15:01:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93ebc62740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 0x5614feebf650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93ebc62740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feeb6090 0x5614feebfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93ebc62740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feebb200 0x5614feec6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93ebc62740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614fedd65f0 con 0x5614feebb200 2024-01-25T15:01:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93ebc62740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614fedd6290 con 0x5614feeb56a0 2024-01-25T15:01:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93ebc62740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614fed9b300 con 0x5614feeb6090 2024-01-25T15:01:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93ebc62740 10 client.0 _ll_register_callbacks cb 0x5614fedd1260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93e359e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feebb200 0x5614feec6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93e359e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feebb200 0x5614feec6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54042/0 (socket says 172.21.15.170:54042) 2024-01-25T15:01:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93e359e640 1 -- 172.21.15.170:0/4259498439 learned_addr learned my addr 172.21.15.170:0/4259498439 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93e259c640 1 --2- 172.21.15.170:0/4259498439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feeb6090 0x5614feebfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93e359e640 1 -- 172.21.15.170:0/4259498439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feeb6090 msgr2=0x5614feebfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93e359e640 1 --2- 172.21.15.170:0/4259498439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feeb6090 0x5614feebfb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93e359e640 1 -- 172.21.15.170:0/4259498439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 msgr2=0x5614feebf650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93e2d9d640 1 --2- 172.21.15.170:0/4259498439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 0x5614feebf650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93e359e640 1 --2- 172.21.15.170:0/4259498439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 0x5614feebf650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.689+0000 7f93e359e640 1 -- 172.21.15.170:0/4259498439 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e41a1520 con 0x5614feebb200 2024-01-25T15:01:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93e359e640 1 --2- 172.21.15.170:0/4259498439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feebb200 0x5614feec6bd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00d6b0 tx=0x7f93dc00db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a259eb96f53b2e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93ca7fc640 1 -- 172.21.15.170:0/4259498439 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc00ba40 con 0x5614feebb200 2024-01-25T15:01:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93ca7fc640 1 -- 172.21.15.170:0/4259498439 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f93dc013070 con 0x5614feebb200 2024-01-25T15:01:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93ebc62740 1 -- 172.21.15.170:0/4259498439 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5614fee15ea0 con 0x5614feebb200 2024-01-25T15:01:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93ca7fc640 1 -- 172.21.15.170:0/4259498439 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93dc00bba0 con 0x5614feebb200 2024-01-25T15:01:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93ebc62740 10 client.15063 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93ebc62740 1 -- 172.21.15.170:0/4259498439 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5614fee1b690 con 0x5614feebb200 2024-01-25T15:01:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93ca7fc640 1 -- 172.21.15.170:0/4259498439 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5614fee15ea0 con 0x5614feebb200 2024-01-25T15:01:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93ca7fc640 1 -- 172.21.15.170:0/4259498439 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f93dc017420 con 0x5614feebb200 2024-01-25T15:01:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93ebc62740 10 client.15063 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:19.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93ebc62740 10 client.15063 resolve_mds: resolved name 'l' to daemon mds.l 2024-01-25T15:01:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93ebc62740 20 client.15063 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93ebc62740 1 --2- 172.21.15.170:0/4259498439 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5614feecc890 0x5614feecb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93ebc62740 4 client.15063 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:01:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.690+0000 7f93ebc62740 1 -- 172.21.15.170:0/4259498439 --> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5614fee15bc0 con 0x5614feecc890 2024-01-25T15:01:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.691+0000 7f93e2d9d640 1 --2- 172.21.15.170:0/4259498439 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5614feecc890 0x5614feecb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.691+0000 7f93ca7fc640 10 client.15063 ms_handle_connect on v2:172.21.15.191:6832/274874056 2024-01-25T15:01:19.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.691+0000 7f93e2d9d640 1 --2- 172.21.15.170:0/4259498439 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5614feecc890 0x5614feecb2b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5fbb4e510539c0db server_cookie=11ef256a8f46a455 in_seq=0 out_seq=0 2024-01-25T15:01:19.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.692+0000 7f93ca7fc640 1 -- 172.21.15.170:0/4259498439 <== mds.3 v2:172.21.15.191:6832/274874056 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5614fee15bc0 con 0x5614feecc890 2024-01-25T15:01:19.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.692+0000 7f93ca7fc640 10 client.15063 handle_command_reply: tid=0 2024-01-25T15:01:19.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.692+0000 7f93ebc62740 1 client.15063 shutdown 2024-01-25T15:01:19.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.692+0000 7f93ebc62740 1 -- 172.21.15.170:0/4259498439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feebb200 msgr2=0x5614feec6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.692+0000 7f93ebc62740 1 --2- 172.21.15.170:0/4259498439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feebb200 0x5614feec6bd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00d6b0 tx=0x7f93dc00db70 comp rx=0 tx=0).stop 2024-01-25T15:01:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.692+0000 7f93ebc62740 1 -- 172.21.15.170:0/4259498439 shutdown_connections 2024-01-25T15:01:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.692+0000 7f93ebc62740 1 --2- 172.21.15.170:0/4259498439 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5614feecc890 0x5614feecb2b0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.692+0000 7f93ebc62740 1 --2- 172.21.15.170:0/4259498439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feebb200 0x5614feec6bd0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.692+0000 7f93ebc62740 1 --2- 172.21.15.170:0/4259498439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feeb6090 0x5614feebfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.692+0000 7f93ca7fc640 0 client.15063 ms_handle_reset on v2:172.21.15.191:6832/274874056 2024-01-25T15:01:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.692+0000 7f93ebc62740 1 --2- 172.21.15.170:0/4259498439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 0x5614feebf650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.692+0000 7f93ebc62740 1 -- 172.21.15.170:0/4259498439 >> 172.21.15.170:0/4259498439 conn(0x5614feeb0c10 msgr2=0x5614feeafda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.692+0000 7f93ebc62740 1 -- 172.21.15.170:0/4259498439 shutdown_connections 2024-01-25T15:01:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.692+0000 7f93ebc62740 1 -- 172.21.15.170:0/4259498439 wait complete. 2024-01-25T15:01:19.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.692+0000 7f93ebc62740 20 client.15063 trim_cache size 0 max 16384 2024-01-25T15:01:19.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93ebc62740 1 Processor -- start 2024-01-25T15:01:19.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93ebc62740 1 -- start start 2024-01-25T15:01:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93ebc62740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 0x5614feecb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93ebc62740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feeb6090 0x5614feec6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93ebc62740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feebb200 0x5614feeaf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93ebc62740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614feed46e0 con 0x5614feebb200 2024-01-25T15:01:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93ebc62740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614fee15bc0 con 0x5614feeb56a0 2024-01-25T15:01:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93ebc62740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614fee15ea0 con 0x5614feeb6090 2024-01-25T15:01:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93e359e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feebb200 0x5614feeaf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93e359e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feebb200 0x5614feeaf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54048/0 (socket says 172.21.15.170:54048) 2024-01-25T15:01:19.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93e359e640 1 -- 172.21.15.170:0/2888351572 learned_addr learned my addr 172.21.15.170:0/2888351572 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93e2d9d640 1 --2- 172.21.15.170:0/2888351572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 0x5614feecb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93e359e640 1 -- 172.21.15.170:0/2888351572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feeb6090 msgr2=0x5614feec6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93e359e640 1 --2- 172.21.15.170:0/2888351572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feeb6090 0x5614feec6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93e359e640 1 -- 172.21.15.170:0/2888351572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 msgr2=0x5614feecb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93e359e640 1 --2- 172.21.15.170:0/2888351572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 0x5614feecb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.708+0000 7f93e359e640 1 -- 172.21.15.170:0/2888351572 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614fedb8390 con 0x5614feebb200 2024-01-25T15:01:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.709+0000 7f93e359e640 1 --2- 172.21.15.170:0/2888351572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feebb200 0x5614feeaf510 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f93dc000f80 tx=0x7f93dc005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b324ec8faf75ea server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.709+0000 7f93d8ff9640 1 -- 172.21.15.170:0/2888351572 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc029050 con 0x5614feebb200 2024-01-25T15:01:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.709+0000 7f93d8ff9640 1 -- 172.21.15.170:0/2888351572 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93dc017a40 con 0x5614feebb200 2024-01-25T15:01:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.709+0000 7f93d8ff9640 1 -- 172.21.15.170:0/2888351572 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc0238e0 con 0x5614feebb200 2024-01-25T15:01:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.709+0000 7f93ebc62740 1 -- 172.21.15.170:0/2888351572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feebb200 msgr2=0x5614feeaf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.709+0000 7f93ebc62740 1 --2- 172.21.15.170:0/2888351572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feebb200 0x5614feeaf510 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f93dc000f80 tx=0x7f93dc005ef0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 1 -- 172.21.15.170:0/2888351572 shutdown_connections 2024-01-25T15:01:19.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 1 --2- 172.21.15.170:0/2888351572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feebb200 0x5614feeaf510 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 1 --2- 172.21.15.170:0/2888351572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feeb6090 0x5614feec6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 1 --2- 172.21.15.170:0/2888351572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 0x5614feecb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 1 -- 172.21.15.170:0/2888351572 >> 172.21.15.170:0/2888351572 conn(0x5614feeb0c10 msgr2=0x5614feecb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 1 -- 172.21.15.170:0/2888351572 shutdown_connections 2024-01-25T15:01:19.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 1 -- 172.21.15.170:0/2888351572 wait complete. 2024-01-25T15:01:19.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 1 -- start start 2024-01-25T15:01:19.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 1 Processor -- start 2024-01-25T15:01:19.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 0x5614feec3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feeb6090 0x5614feec43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feebb200 0x5614feec53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614feec58f0 con 0x5614feeb6090 2024-01-25T15:01:19.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614feec5a60 con 0x5614feeb56a0 2024-01-25T15:01:19.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614feec5c20 con 0x5614feebb200 2024-01-25T15:01:19.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93ebc62740 10 client.0 _ll_register_callbacks cb 0x7f93cc004530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:19.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93e259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feeb6090 0x5614feec43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93e259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feeb6090 0x5614feec43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54058/0 (socket says 172.21.15.170:54058) 2024-01-25T15:01:19.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93e259c640 1 -- 172.21.15.170:0/3473635324 learned_addr learned my addr 172.21.15.170:0/3473635324 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93e2d9d640 1 --2- 172.21.15.170:0/3473635324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 0x5614feec3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93e259c640 1 -- 172.21.15.170:0/3473635324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feebb200 msgr2=0x5614feec53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93e259c640 1 --2- 172.21.15.170:0/3473635324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feebb200 0x5614feec53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93e259c640 1 -- 172.21.15.170:0/3473635324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 msgr2=0x5614feec3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93e259c640 1 --2- 172.21.15.170:0/3473635324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 0x5614feec3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.710+0000 7f93e259c640 1 -- 172.21.15.170:0/3473635324 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5614fee1b690 con 0x5614feeb6090 2024-01-25T15:01:19.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93e2d9d640 1 --2- 172.21.15.170:0/3473635324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 0x5614feec3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:19.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93e259c640 1 --2- 172.21.15.170:0/3473635324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feeb6090 0x5614feec43a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f93d4005d00 tx=0x7f93d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139cb9b65e566806 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:19.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93ca7fc640 1 -- 172.21.15.170:0/3473635324 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4020910 con 0x5614feeb6090 2024-01-25T15:01:19.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93ca7fc640 1 -- 172.21.15.170:0/3473635324 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f93d4017070 con 0x5614feeb6090 2024-01-25T15:01:19.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93ebc62740 1 -- 172.21.15.170:0/3473635324 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f93cc0c07c0 con 0x5614feeb6090 2024-01-25T15:01:19.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93ca7fc640 1 -- 172.21.15.170:0/3473635324 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93d4020a70 con 0x5614feeb6090 2024-01-25T15:01:19.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93ebc62740 10 client.15069 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:19.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93ebc62740 1 -- 172.21.15.170:0/3473635324 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5614fedddee0 con 0x5614feeb6090 2024-01-25T15:01:19.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93ca7fc640 1 -- 172.21.15.170:0/3473635324 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93cc0c07c0 con 0x5614feeb6090 2024-01-25T15:01:19.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93ca7fc640 1 -- 172.21.15.170:0/3473635324 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f93d401f440 con 0x5614feeb6090 2024-01-25T15:01:19.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93ebc62740 10 client.15069 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:19.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93ebc62740 10 client.15069 resolve_mds: resolved name 'l' to daemon mds.l 2024-01-25T15:01:19.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93ebc62740 20 client.15069 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:19.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93ebc62740 1 --2- 172.21.15.170:0/3473635324 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5614feecc890 0x5614fef23b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93ebc62740 4 client.15069 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-25T15:01:19.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.711+0000 7f93ebc62740 1 -- 172.21.15.170:0/3473635324 --> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5614feb1c6c0 con 0x5614feecc890 2024-01-25T15:01:19.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93e2d9d640 1 --2- 172.21.15.170:0/3473635324 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5614feecc890 0x5614fef23b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93ca7fc640 10 client.15069 ms_handle_connect on v2:172.21.15.191:6832/274874056 2024-01-25T15:01:19.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93e2d9d640 1 --2- 172.21.15.170:0/3473635324 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5614feecc890 0x5614fef23b70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=546bd8941701b3f9 server_cookie=de4b3e20c28f53b in_seq=0 out_seq=0 2024-01-25T15:01:19.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93ca7fc640 1 -- 172.21.15.170:0/3473635324 <== mds.3 v2:172.21.15.191:6832/274874056 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5614feb1c6c0 con 0x5614feecc890 2024-01-25T15:01:19.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93ca7fc640 10 client.15069 handle_command_reply: tid=0 2024-01-25T15:01:19.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93ebc62740 1 client.15069 shutdown 2024-01-25T15:01:19.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93ebc62740 1 -- 172.21.15.170:0/3473635324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feeb6090 msgr2=0x5614feec43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93ebc62740 1 --2- 172.21.15.170:0/3473635324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feeb6090 0x5614feec43a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f93d4005d00 tx=0x7f93d40046c0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93ebc62740 1 -- 172.21.15.170:0/3473635324 shutdown_connections 2024-01-25T15:01:19.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93ebc62740 1 --2- 172.21.15.170:0/3473635324 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5614feecc890 0x5614fef23b70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93ebc62740 1 --2- 172.21.15.170:0/3473635324 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5614feebb200 0x5614feec53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93ca7fc640 0 client.15069 ms_handle_reset on v2:172.21.15.191:6832/274874056 2024-01-25T15:01:19.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93ebc62740 1 --2- 172.21.15.170:0/3473635324 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5614feeb6090 0x5614feec43a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93ebc62740 1 --2- 172.21.15.170:0/3473635324 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5614feeb56a0 0x5614feec3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93ebc62740 1 -- 172.21.15.170:0/3473635324 >> 172.21.15.170:0/3473635324 conn(0x5614feeb0c10 msgr2=0x5614feeaf510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93ebc62740 1 -- 172.21.15.170:0/3473635324 shutdown_connections 2024-01-25T15:01:19.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.712+0000 7f93ebc62740 1 -- 172.21.15.170:0/3473635324 wait complete. 2024-01-25T15:01:19.720 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.713+0000 7f93ebc62740 20 client.15069 trim_cache size 0 max 16384 2024-01-25T15:01:19.720 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:01:19.720 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "267213a8-bb91-11ee-95b2-87774f69a715", 2024-01-25T15:01:19.720 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 3, 2024-01-25T15:01:19.720 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 24418, 2024-01-25T15:01:19.720 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2024-01-25T15:01:19.720 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2024-01-25T15:01:19.720 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs", 2024-01-25T15:01:19.720 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 81.675032979999997, 2024-01-25T15:01:19.720 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 25, 2024-01-25T15:01:19.721 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 87, 2024-01-25T15:01:19.721 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 85, 2024-01-25T15:01:19.721 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 121.5710809 2024-01-25T15:01:19.721 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:01:19.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.713+0000 7f93e90a6640 1 -- 172.21.15.170:0/2842852813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f93d00a1370 msgr2=0x7f93d00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.713+0000 7f93e90a6640 1 --2- 172.21.15.170:0/2842852813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f93d00a1370 0x7f93d00a3830 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f93e419a480 tx=0x7f93d400b410 comp rx=0 tx=0).stop 2024-01-25T15:01:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.713+0000 7f93e90a6640 1 -- 172.21.15.170:0/2842852813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e40ffbf0 msgr2=0x7f93e4198f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.713+0000 7f93e90a6640 1 --2- 172.21.15.170:0/2842852813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e40ffbf0 0x7f93e4198f70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009230 tx=0x7f93cc004f40 comp rx=0 tx=0).stop 2024-01-25T15:01:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.713+0000 7f93e90a6640 1 -- 172.21.15.170:0/2842852813 shutdown_connections 2024-01-25T15:01:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.713+0000 7f93e90a6640 1 --2- 172.21.15.170:0/2842852813 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f93d00a1370 0x7f93d00a3830 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.713+0000 7f93e90a6640 1 --2- 172.21.15.170:0/2842852813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93e41017a0 0x7f93e41a0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.713+0000 7f93e90a6640 1 --2- 172.21.15.170:0/2842852813 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f93e4100de0 0x7f93e41994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.713+0000 7f93e90a6640 1 --2- 172.21.15.170:0/2842852813 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f93e40ffbf0 0x7f93e4198f70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.713+0000 7f93e90a6640 1 -- 172.21.15.170:0/2842852813 >> 172.21.15.170:0/2842852813 conn(0x7f93e40fb180 msgr2=0x7f93e4067ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.713+0000 7f93e90a6640 1 -- 172.21.15.170:0/2842852813 shutdown_connections 2024-01-25T15:01:19.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.713+0000 7f93e90a6640 1 -- 172.21.15.170:0/2842852813 wait complete. 2024-01-25T15:01:19.725 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-25T15:01:19.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:19 smithi191 ceph-mon[36347]: pgmap v328: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-01-25T15:01:19.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:19 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3641215411' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:19.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:19 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1042683204' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:19.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:19 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2878200632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.829+0000 7f2eb31be640 1 -- 172.21.15.170:0/687385702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac1040a0 msgr2=0x7f2eac106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.829+0000 7f2eb31be640 1 --2- 172.21.15.170:0/687385702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac1040a0 0x7f2eac106490 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009900 tx=0x7f2e9802bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:19.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.829+0000 7f2eb31be640 1 -- 172.21.15.170:0/687385702 shutdown_connections 2024-01-25T15:01:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.829+0000 7f2eb31be640 1 --2- 172.21.15.170:0/687385702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2eac1069d0 0x7f2eac108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.829+0000 7f2eb31be640 1 --2- 172.21.15.170:0/687385702 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac1040a0 0x7f2eac106490 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.829+0000 7f2eb31be640 1 --2- 172.21.15.170:0/687385702 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2eac101770 0x7f2eac103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.829+0000 7f2eb31be640 1 -- 172.21.15.170:0/687385702 >> 172.21.15.170:0/687385702 conn(0x7f2eac0fb180 msgr2=0x7f2eac0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.829+0000 7f2eb31be640 1 -- 172.21.15.170:0/687385702 shutdown_connections 2024-01-25T15:01:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.829+0000 7f2eb31be640 1 -- 172.21.15.170:0/687385702 wait complete. 2024-01-25T15:01:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb31be640 1 Processor -- start 2024-01-25T15:01:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb31be640 1 -- start start 2024-01-25T15:01:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb31be640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2eac101770 0x7f2eac196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb31be640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2eac1040a0 0x7f2eac1972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb31be640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac1069d0 0x7f2eac19e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb31be640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac19e810 con 0x7f2eac1069d0 2024-01-25T15:01:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb31be640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac19e980 con 0x7f2eac1040a0 2024-01-25T15:01:19.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb31be640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac19eb40 con 0x7f2eac101770 2024-01-25T15:01:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb175b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac1069d0 0x7f2eac19e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb175b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac1069d0 0x7f2eac19e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54084/0 (socket says 172.21.15.170:54084) 2024-01-25T15:01:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb175b640 1 -- 172.21.15.170:0/640674184 learned_addr learned my addr 172.21.15.170:0/640674184 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb0f5a640 1 --2- 172.21.15.170:0/640674184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2eac101770 0x7f2eac196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eabfff640 1 --2- 172.21.15.170:0/640674184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2eac1040a0 0x7f2eac1972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb175b640 1 -- 172.21.15.170:0/640674184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2eac101770 msgr2=0x7f2eac196d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb175b640 1 --2- 172.21.15.170:0/640674184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2eac101770 0x7f2eac196d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb175b640 1 -- 172.21.15.170:0/640674184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2eac1040a0 msgr2=0x7f2eac1972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb175b640 1 --2- 172.21.15.170:0/640674184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2eac1040a0 0x7f2eac1972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb175b640 1 -- 172.21.15.170:0/640674184 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e98009560 con 0x7f2eac1069d0 2024-01-25T15:01:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eabfff640 1 --2- 172.21.15.170:0/640674184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2eac1040a0 0x7f2eac1972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.830+0000 7f2eb175b640 1 --2- 172.21.15.170:0/640674184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac1069d0 0x7f2eac19e2a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400eaa0 tx=0x7f2ea400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.831+0000 7f2ea9ffb640 1 -- 172.21.15.170:0/640674184 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea400cdb0 con 0x7f2eac1069d0 2024-01-25T15:01:19.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.831+0000 7f2ea9ffb640 1 -- 172.21.15.170:0/640674184 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ea4005020 con 0x7f2eac1069d0 2024-01-25T15:01:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.831+0000 7f2eb31be640 1 -- 172.21.15.170:0/640674184 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac19ee20 con 0x7f2eac1069d0 2024-01-25T15:01:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.831+0000 7f2ea9ffb640 1 -- 172.21.15.170:0/640674184 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40116d0 con 0x7f2eac1069d0 2024-01-25T15:01:19.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.831+0000 7f2eb31be640 1 -- 172.21.15.170:0/640674184 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac19f1f0 con 0x7f2eac1069d0 2024-01-25T15:01:19.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.833+0000 7f2eb5d7c740 1 Processor -- start 2024-01-25T15:01:19.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.833+0000 7f2ea9ffb640 1 -- 172.21.15.170:0/640674184 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f2ea4005190 con 0x7f2eac1069d0 2024-01-25T15:01:19.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.833+0000 7f2eb5d7c740 1 -- start start 2024-01-25T15:01:19.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eb5d7c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b2fab0 0x556f79b2fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eb5d7c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b304a0 0x556f79b34fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eb5d7c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b35610 0x556f79b37aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eb5d7c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f79a9a030 con 0x556f79b35610 2024-01-25T15:01:19.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eb5d7c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f79a97720 con 0x556f79b2fab0 2024-01-25T15:01:19.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eb5d7c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f79a93010 con 0x556f79b304a0 2024-01-25T15:01:19.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eabfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b35610 0x556f79b37aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eabfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b35610 0x556f79b37aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54098/0 (socket says 172.21.15.170:54098) 2024-01-25T15:01:19.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eabfff640 1 -- 172.21.15.170:0/223964694 learned_addr learned my addr 172.21.15.170:0/223964694 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eb0f5a640 1 --2- 172.21.15.170:0/223964694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b304a0 0x556f79b34fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eabfff640 1 --2- 172.21.15.170:0/223964694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b2fab0 0x556f79b2fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2ea9ffb640 1 --2- 172.21.15.170:0/640674184 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2e9c0a1370 0x7f2e9c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eabfff640 1 -- 172.21.15.170:0/223964694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b304a0 msgr2=0x556f79b34fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eabfff640 1 --2- 172.21.15.170:0/223964694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b304a0 0x556f79b34fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.842 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eabfff640 1 -- 172.21.15.170:0/223964694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b2fab0 msgr2=0x556f79b2fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eabfff640 1 --2- 172.21.15.170:0/223964694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b2fab0 0x556f79b2fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eabfff640 1 -- 172.21.15.170:0/223964694 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f79a55680 con 0x556f79b35610 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eabfff640 1 --2- 172.21.15.170:0/223964694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b35610 0x556f79b37aa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2e98004f80 tx=0x7f2e98005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8fb24b67c8fe1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2ea9ffb640 1 -- 172.21.15.170:0/640674184 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f2ea40ccf90 con 0x7f2eac1069d0 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2eb175b640 1 --2- 172.21.15.170:0/640674184 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2e9c0a1370 0x7f2e9c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.834+0000 7f2e96ffd640 1 -- 172.21.15.170:0/223964694 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980048c0 con 0x556f79b35610 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.835+0000 7f2e96ffd640 1 -- 172.21.15.170:0/223964694 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e98004500 con 0x556f79b35610 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.835+0000 7f2e96ffd640 1 -- 172.21.15.170:0/223964694 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98005600 con 0x556f79b35610 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.835+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/223964694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b35610 msgr2=0x556f79b37aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.835+0000 7f2eb175b640 1 --2- 172.21.15.170:0/640674184 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2e9c0a1370 0x7f2e9c0a3830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009270 tx=0x7f2ea400cf10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.835+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/223964694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b35610 0x556f79b37aa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2e98004f80 tx=0x7f2e98005fd0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.835+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/223964694 shutdown_connections 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.835+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/223964694 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b35610 0x556f79b37aa0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.835+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/223964694 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b304a0 0x556f79b34fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.835+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/223964694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b2fab0 0x556f79b2fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.843 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.835+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/223964694 >> 172.21.15.170:0/223964694 conn(0x556f79b26c10 msgr2=0x556f79b27010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.835+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/223964694 shutdown_connections 2024-01-25T15:01:19.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.835+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/223964694 wait complete. 2024-01-25T15:01:19.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eb5d7c740 1 -- start start 2024-01-25T15:01:19.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eb5d7c740 1 Processor -- start 2024-01-25T15:01:19.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eb5d7c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b2fab0 0x556f79b39cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eb5d7c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b304a0 0x556f79b3a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eb5d7c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b35610 0x556f79b41240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eb5d7c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f79a4c5f0 con 0x556f79b2fab0 2024-01-25T15:01:19.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eb5d7c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f79a4c290 con 0x556f79b35610 2024-01-25T15:01:19.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eb5d7c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f79a11300 con 0x556f79b304a0 2024-01-25T15:01:19.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eb5d7c740 10 client.0 _ll_register_callbacks cb 0x556f79a47260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:19.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eabfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b2fab0 0x556f79b39cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eabfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b2fab0 0x556f79b39cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54108/0 (socket says 172.21.15.170:54108) 2024-01-25T15:01:19.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eabfff640 1 -- 172.21.15.170:0/3954592234 learned_addr learned my addr 172.21.15.170:0/3954592234 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eabfff640 1 --2- 172.21.15.170:0/3954592234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b35610 0x556f79b41240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eb0f5a640 1 --2- 172.21.15.170:0/3954592234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b304a0 0x556f79b3a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eabfff640 1 -- 172.21.15.170:0/3954592234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b304a0 msgr2=0x556f79b3a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eabfff640 1 --2- 172.21.15.170:0/3954592234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b304a0 0x556f79b3a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eabfff640 1 -- 172.21.15.170:0/3954592234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b35610 msgr2=0x556f79b41240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eabfff640 1 --2- 172.21.15.170:0/3954592234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b35610 0x556f79b41240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eabfff640 1 -- 172.21.15.170:0/3954592234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac109a00 con 0x556f79b2fab0 2024-01-25T15:01:19.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.836+0000 7f2eb0f5a640 1 --2- 172.21.15.170:0/3954592234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b304a0 0x556f79b3a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:19.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2eabfff640 1 --2- 172.21.15.170:0/3954592234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b2fab0 0x556f79b39cc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2e98000c00 tx=0x7f2e9802c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cef40940b3cda1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2e8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:19.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2e8bfff640 1 -- 172.21.15.170:0/3954592234 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980044d0 con 0x556f79b2fab0 2024-01-25T15:01:19.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2e8bfff640 1 -- 172.21.15.170:0/3954592234 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f2e980035f0 con 0x556f79b2fab0 2024-01-25T15:01:19.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/3954592234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f79a8bbc0 con 0x556f79b2fab0 2024-01-25T15:01:19.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2e8bfff640 1 -- 172.21.15.170:0/3954592234 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e980037b0 con 0x556f79b2fab0 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2eb5d7c740 10 client.15081 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/3954592234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x556f79a91690 con 0x556f79b2fab0 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2e8bfff640 1 -- 172.21.15.170:0/3954592234 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e98063020 con 0x556f79b2fab0 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2e8bfff640 1 -- 172.21.15.170:0/3954592234 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2e9805d890 con 0x556f79b2fab0 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2eb5d7c740 10 client.15081 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2eb5d7c740 10 client.15081 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2eb5d7c740 20 client.15081 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/3954592234 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x556f79b46bd0 0x556f79b45730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2eb5d7c740 4 client.15081 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.837+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/3954592234 --> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f797926c0 con 0x556f79b46bd0 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.838+0000 7f2eb0f5a640 1 --2- 172.21.15.170:0/3954592234 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x556f79b46bd0 0x556f79b45730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.838+0000 7f2e8bfff640 10 client.15081 ms_handle_connect on v2:172.21.15.191:6836/719224494 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.838+0000 7f2eb0f5a640 1 --2- 172.21.15.170:0/3954592234 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x556f79b46bd0 0x556f79b45730 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6520295bb07776ec server_cookie=47ca64a35201d05a in_seq=0 out_seq=0 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.839+0000 7f2e8bfff640 1 -- 172.21.15.170:0/3954592234 <== mds.2 v2:172.21.15.191:6836/719224494 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556f797926c0 con 0x556f79b46bd0 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.839+0000 7f2e8bfff640 10 client.15081 handle_command_reply: tid=0 2024-01-25T15:01:19.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.839+0000 7f2eb5d7c740 1 client.15081 shutdown 2024-01-25T15:01:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.839+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/3954592234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b2fab0 msgr2=0x556f79b39cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.839+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/3954592234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b2fab0 0x556f79b39cc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2e98000c00 tx=0x7f2e9802c780 comp rx=0 tx=0).stop 2024-01-25T15:01:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.839+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/3954592234 shutdown_connections 2024-01-25T15:01:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.839+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/3954592234 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x556f79b46bd0 0x556f79b45730 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.839+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/3954592234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b35610 0x556f79b41240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.839+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/3954592234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b304a0 0x556f79b3a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.839+0000 7f2e8bfff640 0 client.15081 ms_handle_reset on v2:172.21.15.191:6836/719224494 2024-01-25T15:01:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.839+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/3954592234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b2fab0 0x556f79b39cc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.839+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/3954592234 >> 172.21.15.170:0/3954592234 conn(0x556f79b26c10 msgr2=0x556f79b25da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.839+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/3954592234 shutdown_connections 2024-01-25T15:01:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.839+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/3954592234 wait complete. 2024-01-25T15:01:19.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.839+0000 7f2eb5d7c740 20 client.15081 trim_cache size 0 max 16384 2024-01-25T15:01:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb5d7c740 1 Processor -- start 2024-01-25T15:01:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb5d7c740 1 -- start start 2024-01-25T15:01:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb5d7c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b2fab0 0x556f79b4e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb5d7c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b304a0 0x556f79b411d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb5d7c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b35610 0x556f79b31a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb5d7c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f79b3a8d0 con 0x556f79b304a0 2024-01-25T15:01:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb5d7c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f79b2f770 con 0x556f79b35610 2024-01-25T15:01:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb5d7c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f79b27700 con 0x556f79b2fab0 2024-01-25T15:01:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb0f5a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b304a0 0x556f79b411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb0f5a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b304a0 0x556f79b411d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54124/0 (socket says 172.21.15.170:54124) 2024-01-25T15:01:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb0f5a640 1 -- 172.21.15.170:0/725120957 learned_addr learned my addr 172.21.15.170:0/725120957 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eabfff640 1 --2- 172.21.15.170:0/725120957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b2fab0 0x556f79b4e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb0f5a640 1 -- 172.21.15.170:0/725120957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b2fab0 msgr2=0x556f79b4e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb0f5a640 1 --2- 172.21.15.170:0/725120957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b2fab0 0x556f79b4e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb0f5a640 1 -- 172.21.15.170:0/725120957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b35610 msgr2=0x556f79b31a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb0f5a640 1 --2- 172.21.15.170:0/725120957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b35610 0x556f79b31a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb0f5a640 1 -- 172.21.15.170:0/725120957 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f79a2e390 con 0x556f79b304a0 2024-01-25T15:01:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.855+0000 7f2eb0f5a640 1 --2- 172.21.15.170:0/725120957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b304a0 0x556f79b411d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x556f79b30f10 tx=0x7f2ea0012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d119e878337601a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.856+0000 7f2e967fc640 1 -- 172.21.15.170:0/725120957 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0012ec0 con 0x556f79b304a0 2024-01-25T15:01:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.856+0000 7f2e967fc640 1 -- 172.21.15.170:0/725120957 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ea00122d0 con 0x556f79b304a0 2024-01-25T15:01:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.856+0000 7f2e967fc640 1 -- 172.21.15.170:0/725120957 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea001e070 con 0x556f79b304a0 2024-01-25T15:01:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.856+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/725120957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b304a0 msgr2=0x556f79b411d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.856+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/725120957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b304a0 0x556f79b411d0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x556f79b30f10 tx=0x7f2ea0012820 comp rx=0 tx=0).stop 2024-01-25T15:01:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.856+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/725120957 shutdown_connections 2024-01-25T15:01:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.856+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/725120957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b35610 0x556f79b31a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.856+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/725120957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b304a0 0x556f79b411d0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.856+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/725120957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b2fab0 0x556f79b4e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.856+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/725120957 >> 172.21.15.170:0/725120957 conn(0x556f79b26c10 msgr2=0x556f79b26ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.856+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/725120957 shutdown_connections 2024-01-25T15:01:19.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.856+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/725120957 wait complete. 2024-01-25T15:01:19.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eb5d7c740 1 -- start start 2024-01-25T15:01:19.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eb5d7c740 1 Processor -- start 2024-01-25T15:01:19.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eb5d7c740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b2fab0 0x556f79b41110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eb5d7c740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b304a0 0x556f79b3dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eb5d7c740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b35610 0x556f79b3e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eb5d7c740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f79b3e810 con 0x556f79b35610 2024-01-25T15:01:19.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eb5d7c740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f79b9bb10 con 0x556f79b304a0 2024-01-25T15:01:19.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eb5d7c740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f79b9bc50 con 0x556f79b2fab0 2024-01-25T15:01:19.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eb5d7c740 10 client.0 _ll_register_callbacks cb 0x7f2ea0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:19.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eabfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b35610 0x556f79b3e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eabfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b35610 0x556f79b3e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54134/0 (socket says 172.21.15.170:54134) 2024-01-25T15:01:19.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eabfff640 1 -- 172.21.15.170:0/4262806320 learned_addr learned my addr 172.21.15.170:0/4262806320 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eabfff640 1 --2- 172.21.15.170:0/4262806320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b2fab0 0x556f79b41110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eabfff640 1 -- 172.21.15.170:0/4262806320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b2fab0 msgr2=0x556f79b41110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eabfff640 1 --2- 172.21.15.170:0/4262806320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b2fab0 0x556f79b41110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eabfff640 1 -- 172.21.15.170:0/4262806320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b304a0 msgr2=0x556f79b3dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eb0f5a640 1 --2- 172.21.15.170:0/4262806320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b304a0 0x556f79b3dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eabfff640 1 --2- 172.21.15.170:0/4262806320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b304a0 0x556f79b3dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eabfff640 1 -- 172.21.15.170:0/4262806320 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea0009d20 con 0x556f79b35610 2024-01-25T15:01:19.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2eabfff640 1 --2- 172.21.15.170:0/4262806320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b35610 0x556f79b3e200 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2e98005560 tx=0x7f2e9802bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945e61992f3c269b server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.857+0000 7f2e8bfff640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:19.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.858+0000 7f2e8bfff640 1 -- 172.21.15.170:0/4262806320 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9805d480 con 0x556f79b35610 2024-01-25T15:01:19.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.858+0000 7f2e8bfff640 1 -- 172.21.15.170:0/4262806320 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f2e98000e40 con 0x556f79b35610 2024-01-25T15:01:19.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.858+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/4262806320 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f797e5d10 con 0x556f79b35610 2024-01-25T15:01:19.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.858+0000 7f2e8bfff640 1 -- 172.21.15.170:0/4262806320 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e9805d5e0 con 0x556f79b35610 2024-01-25T15:01:19.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.858+0000 7f2eb5d7c740 10 client.15087 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:19.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.858+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/4262806320 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x556f79a53ee0 con 0x556f79b35610 2024-01-25T15:01:19.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.858+0000 7f2e8bfff640 1 -- 172.21.15.170:0/4262806320 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e9806e080 con 0x556f79b35610 2024-01-25T15:01:19.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.858+0000 7f2e8bfff640 1 -- 172.21.15.170:0/4262806320 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2e98066020 con 0x556f79b35610 2024-01-25T15:01:19.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.858+0000 7f2eb5d7c740 10 client.15087 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:19.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.858+0000 7f2eb5d7c740 10 client.15087 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-25T15:01:19.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.858+0000 7f2eb5d7c740 20 client.15087 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:19.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.858+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/4262806320 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x556f79ba0bb0 0x556f79b9d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.858+0000 7f2eb5d7c740 4 client.15087 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-25T15:01:19.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.858+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/4262806320 --> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556f79b463f0 con 0x556f79ba0bb0 2024-01-25T15:01:19.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.858+0000 7f2eb0f5a640 1 --2- 172.21.15.170:0/4262806320 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x556f79ba0bb0 0x556f79b9d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2eb0f5a640 1 --2- 172.21.15.170:0/4262806320 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x556f79ba0bb0 0x556f79b9d010 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=57ad65ad13284b8a server_cookie=de5ffb9fe58510d7 in_seq=0 out_seq=0 2024-01-25T15:01:19.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2e8bfff640 10 client.15087 ms_handle_connect on v2:172.21.15.191:6836/719224494 2024-01-25T15:01:19.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2e8bfff640 1 -- 172.21.15.170:0/4262806320 <== mds.2 v2:172.21.15.191:6836/719224494 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x7f2ea0004d80 con 0x556f79ba0bb0 2024-01-25T15:01:19.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2e8bfff640 10 client.15087 handle_command_reply: tid=0 2024-01-25T15:01:19.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2eb5d7c740 1 client.15087 shutdown 2024-01-25T15:01:19.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/4262806320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b35610 msgr2=0x556f79b3e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/4262806320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b35610 0x556f79b3e200 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2e98005560 tx=0x7f2e9802bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:19.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/4262806320 shutdown_connections 2024-01-25T15:01:19.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/4262806320 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x556f79ba0bb0 0x556f79b9d010 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/4262806320 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556f79b304a0 0x556f79b3dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2e8bfff640 0 client.15087 ms_handle_reset on v2:172.21.15.191:6836/719224494 2024-01-25T15:01:19.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/4262806320 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556f79b35610 0x556f79b3e200 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2eb5d7c740 1 --2- 172.21.15.170:0/4262806320 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556f79b2fab0 0x556f79b41110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/4262806320 >> 172.21.15.170:0/4262806320 conn(0x556f79b26c10 msgr2=0x556f79b4e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/4262806320 shutdown_connections 2024-01-25T15:01:19.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2eb5d7c740 1 -- 172.21.15.170:0/4262806320 wait complete. 2024-01-25T15:01:19.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.859+0000 7f2eb5d7c740 20 client.15087 trim_cache size 0 max 16384 2024-01-25T15:01:19.866 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:01:19.867 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "267213a8-bb91-11ee-95b2-87774f69a715", 2024-01-25T15:01:19.867 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 2, 2024-01-25T15:01:19.867 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 24466, 2024-01-25T15:01:19.867 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2024-01-25T15:01:19.867 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2024-01-25T15:01:19.867 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs", 2024-01-25T15:01:19.867 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 82.640916529999998, 2024-01-25T15:01:19.867 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 25, 2024-01-25T15:01:19.867 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 87, 2024-01-25T15:01:19.867 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 85, 2024-01-25T15:01:19.867 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 105.26138284300001 2024-01-25T15:01:19.867 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:01:19.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.860+0000 7f2eb31be640 1 -- 172.21.15.170:0/640674184 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2e9c0a1370 msgr2=0x7f2e9c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.860+0000 7f2eb31be640 1 --2- 172.21.15.170:0/640674184 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2e9c0a1370 0x7f2e9c0a3830 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009270 tx=0x7f2ea400cf10 comp rx=0 tx=0).stop 2024-01-25T15:01:19.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.860+0000 7f2eb31be640 1 -- 172.21.15.170:0/640674184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac1069d0 msgr2=0x7f2eac19e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.860+0000 7f2eb31be640 1 --2- 172.21.15.170:0/640674184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac1069d0 0x7f2eac19e2a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400eaa0 tx=0x7f2ea400ef60 comp rx=0 tx=0).stop 2024-01-25T15:01:19.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.860+0000 7f2eb31be640 1 -- 172.21.15.170:0/640674184 shutdown_connections 2024-01-25T15:01:19.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.860+0000 7f2eb31be640 1 --2- 172.21.15.170:0/640674184 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2e9c0a1370 0x7f2e9c0a3830 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.860+0000 7f2eb31be640 1 --2- 172.21.15.170:0/640674184 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2eac1040a0 0x7f2eac1972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.860+0000 7f2eb31be640 1 --2- 172.21.15.170:0/640674184 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eac1069d0 0x7f2eac19e2a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.860+0000 7f2eb31be640 1 --2- 172.21.15.170:0/640674184 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2eac101770 0x7f2eac196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.860+0000 7f2eb31be640 1 -- 172.21.15.170:0/640674184 >> 172.21.15.170:0/640674184 conn(0x7f2eac0fb180 msgr2=0x7f2eac1035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.860+0000 7f2eb31be640 1 -- 172.21.15.170:0/640674184 shutdown_connections 2024-01-25T15:01:19.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.860+0000 7f2eb31be640 1 -- 172.21.15.170:0/640674184 wait complete. 2024-01-25T15:01:19.871 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-25T15:01:19.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.974+0000 7f38966c9640 1 -- 172.21.15.170:0/1696980672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38900736f0 msgr2=0x7f3890073b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.974+0000 7f38966c9640 1 --2- 172.21.15.170:0/1696980672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38900736f0 0x7f3890073b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3880009900 tx=0x7f388002bcd0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.974+0000 7f38966c9640 1 -- 172.21.15.170:0/1696980672 shutdown_connections 2024-01-25T15:01:19.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.974+0000 7f38966c9640 1 --2- 172.21.15.170:0/1696980672 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3890108bb0 0x7f389010b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.974+0000 7f38966c9640 1 --2- 172.21.15.170:0/1696980672 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38900736f0 0x7f3890073b50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.974+0000 7f38966c9640 1 --2- 172.21.15.170:0/1696980672 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3890074cd0 0x7f3890073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.974+0000 7f38966c9640 1 -- 172.21.15.170:0/1696980672 >> 172.21.15.170:0/1696980672 conn(0x7f38900fc290 msgr2=0x7f38900fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.974+0000 7f38966c9640 1 -- 172.21.15.170:0/1696980672 shutdown_connections 2024-01-25T15:01:19.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.974+0000 7f38966c9640 1 -- 172.21.15.170:0/1696980672 wait complete. 2024-01-25T15:01:19.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f38966c9640 1 Processor -- start 2024-01-25T15:01:19.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f38966c9640 1 -- start start 2024-01-25T15:01:19.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f38966c9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38900736f0 0x7f3890198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f38966c9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3890074cd0 0x7f3890199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f38966c9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3890108bb0 0x7f38901a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f38966c9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38901a09f0 con 0x7f38900736f0 2024-01-25T15:01:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f38966c9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38901a0b60 con 0x7f3890074cd0 2024-01-25T15:01:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f38966c9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38901a0d20 con 0x7f3890108bb0 2024-01-25T15:01:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f388ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38900736f0 0x7f3890198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f388ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38900736f0 0x7f3890198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54158/0 (socket says 172.21.15.170:54158) 2024-01-25T15:01:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f388ffff640 1 -- 172.21.15.170:0/1068914268 learned_addr learned my addr 172.21.15.170:0/1068914268 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f3894c66640 1 --2- 172.21.15.170:0/1068914268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3890108bb0 0x7f38901a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f388f7fe640 1 --2- 172.21.15.170:0/1068914268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3890074cd0 0x7f3890199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f388ffff640 1 -- 172.21.15.170:0/1068914268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3890108bb0 msgr2=0x7f38901a04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f388ffff640 1 --2- 172.21.15.170:0/1068914268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3890108bb0 0x7f38901a04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f388ffff640 1 -- 172.21.15.170:0/1068914268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3890074cd0 msgr2=0x7f3890199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f388ffff640 1 --2- 172.21.15.170:0/1068914268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3890074cd0 0x7f3890199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.975+0000 7f388ffff640 1 -- 172.21.15.170:0/1068914268 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3880009560 con 0x7f38900736f0 2024-01-25T15:01:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.976+0000 7f388ffff640 1 --2- 172.21.15.170:0/1068914268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38900736f0 0x7f3890198f00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f388400e9f0 tx=0x7f388400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.976+0000 7f388d7fa640 1 -- 172.21.15.170:0/1068914268 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884009700 con 0x7f38900736f0 2024-01-25T15:01:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.976+0000 7f388d7fa640 1 -- 172.21.15.170:0/1068914268 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f388400cd80 con 0x7f38900736f0 2024-01-25T15:01:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.976+0000 7f38966c9640 1 -- 172.21.15.170:0/1068914268 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38901a0fa0 con 0x7f38900736f0 2024-01-25T15:01:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.976+0000 7f388d7fa640 1 -- 172.21.15.170:0/1068914268 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3884018860 con 0x7f38900736f0 2024-01-25T15:01:19.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.976+0000 7f38966c9640 1 -- 172.21.15.170:0/1068914268 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38901a1420 con 0x7f38900736f0 2024-01-25T15:01:19.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.978+0000 7f388d7fa640 1 -- 172.21.15.170:0/1068914268 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f38840189c0 con 0x7f38900736f0 2024-01-25T15:01:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.978+0000 7f3899365740 1 Processor -- start 2024-01-25T15:01:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.978+0000 7f3899365740 1 -- start start 2024-01-25T15:01:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f388d7fa640 1 --2- 172.21.15.170:0/1068914268 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f38780a1370 0x7f38780a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f3899365740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3db96a0 0x5646c3db9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f3899365740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dba090 0x5646c3dbeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f3899365740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3dbf200 0x5646c3dc1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f3899365740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c3d28030 con 0x5646c3dbf200 2024-01-25T15:01:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f3899365740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c3d25720 con 0x5646c3dba090 2024-01-25T15:01:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f3899365740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c3d21010 con 0x5646c3db96a0 2024-01-25T15:01:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f3894c66640 1 --2- 172.21.15.170:0/1068914268 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f38780a1370 0x7f38780a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f388d7fa640 1 -- 172.21.15.170:0/1068914268 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f3884014070 con 0x7f38900736f0 2024-01-25T15:01:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f3894c66640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3dbf200 0x5646c3dc1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f3894c66640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3dbf200 0x5646c3dc1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54164/0 (socket says 172.21.15.170:54164) 2024-01-25T15:01:19.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f3894c66640 1 -- 172.21.15.170:0/2973945902 learned_addr learned my addr 172.21.15.170:0/2973945902 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f388f7fe640 1 --2- 172.21.15.170:0/2973945902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dba090 0x5646c3dbeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f388ffff640 1 --2- 172.21.15.170:0/2973945902 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3db96a0 0x5646c3db9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f388f7fe640 1 -- 172.21.15.170:0/2973945902 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3db96a0 msgr2=0x5646c3db9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f388f7fe640 1 --2- 172.21.15.170:0/2973945902 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3db96a0 0x5646c3db9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f388f7fe640 1 -- 172.21.15.170:0/2973945902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3dbf200 msgr2=0x5646c3dc1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f388f7fe640 1 --2- 172.21.15.170:0/2973945902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3dbf200 0x5646c3dc1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f388f7fe640 1 -- 172.21.15.170:0/2973945902 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646c3ce3680 con 0x5646c3dba090 2024-01-25T15:01:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f3894c66640 1 --2- 172.21.15.170:0/1068914268 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f38780a1370 0x7f38780a3830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3888012c80 tx=0x7f3888009e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f388f7fe640 1 --2- 172.21.15.170:0/2973945902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dba090 0x5646c3dbeb90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3880009230 tx=0x7f3880005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5516e85b51875ad4 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.979+0000 7f38767fc640 1 -- 172.21.15.170:0/2973945902 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880004800 con 0x5646c3dba090 2024-01-25T15:01:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.980+0000 7f38767fc640 1 -- 172.21.15.170:0/2973945902 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3880004500 con 0x5646c3dba090 2024-01-25T15:01:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.980+0000 7f38767fc640 1 -- 172.21.15.170:0/2973945902 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880005260 con 0x5646c3dba090 2024-01-25T15:01:19.988 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.980+0000 7f3899365740 1 -- 172.21.15.170:0/2973945902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dba090 msgr2=0x5646c3dbeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.980+0000 7f3899365740 1 --2- 172.21.15.170:0/2973945902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dba090 0x5646c3dbeb90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3880009230 tx=0x7f3880005c00 comp rx=0 tx=0).stop 2024-01-25T15:01:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.980+0000 7f3899365740 1 -- 172.21.15.170:0/2973945902 shutdown_connections 2024-01-25T15:01:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.980+0000 7f3899365740 1 --2- 172.21.15.170:0/2973945902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dba090 0x5646c3dbeb90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.980+0000 7f3899365740 1 --2- 172.21.15.170:0/2973945902 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3dbf200 0x5646c3dc1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.980+0000 7f3899365740 1 --2- 172.21.15.170:0/2973945902 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3db96a0 0x5646c3db9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.980+0000 7f3899365740 1 -- 172.21.15.170:0/2973945902 >> 172.21.15.170:0/2973945902 conn(0x5646c3db4c10 msgr2=0x5646c3db5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.980+0000 7f3899365740 1 -- 172.21.15.170:0/2973945902 shutdown_connections 2024-01-25T15:01:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.980+0000 7f3899365740 1 -- 172.21.15.170:0/2973945902 wait complete. 2024-01-25T15:01:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f3899365740 1 -- start start 2024-01-25T15:01:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f3899365740 1 Processor -- start 2024-01-25T15:01:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f3899365740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3db96a0 0x5646c3dc3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f3899365740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dba090 0x5646c3dc3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.989 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f3899365740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dbf200 0x5646c3dcae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f3899365740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c3cda5f0 con 0x5646c3db96a0 2024-01-25T15:01:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f3899365740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c3cda290 con 0x5646c3dba090 2024-01-25T15:01:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f3899365740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c3c9f300 con 0x5646c3dbf200 2024-01-25T15:01:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f388ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3db96a0 0x5646c3dc3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f3899365740 10 client.0 _ll_register_callbacks cb 0x5646c3cd5260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f388ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3db96a0 0x5646c3dc3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54176/0 (socket says 172.21.15.170:54176) 2024-01-25T15:01:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f388ffff640 1 -- 172.21.15.170:0/3915893544 learned_addr learned my addr 172.21.15.170:0/3915893544 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f388f7fe640 1 --2- 172.21.15.170:0/3915893544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dba090 0x5646c3dc3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f3894c66640 1 --2- 172.21.15.170:0/3915893544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dbf200 0x5646c3dcae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f388ffff640 1 -- 172.21.15.170:0/3915893544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dbf200 msgr2=0x5646c3dcae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f388ffff640 1 --2- 172.21.15.170:0/3915893544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dbf200 0x5646c3dcae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f388ffff640 1 -- 172.21.15.170:0/3915893544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dba090 msgr2=0x5646c3dc3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:19.990 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f388ffff640 1 --2- 172.21.15.170:0/3915893544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dba090 0x5646c3dc3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.981+0000 7f388ffff640 1 -- 172.21.15.170:0/3915893544 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389010bc30 con 0x5646c3db96a0 2024-01-25T15:01:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f388ffff640 1 --2- 172.21.15.170:0/3915893544 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3db96a0 0x5646c3dc3880 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3884099d40 tx=0x7f38840ac670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b247a92837e34a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f386f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f386f7fe640 1 -- 172.21.15.170:0/3915893544 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388409a040 con 0x5646c3db96a0 2024-01-25T15:01:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f386f7fe640 1 -- 172.21.15.170:0/3915893544 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f388409e0e0 con 0x5646c3db96a0 2024-01-25T15:01:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f3899365740 1 -- 172.21.15.170:0/3915893544 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646c3d19bc0 con 0x5646c3db96a0 2024-01-25T15:01:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f386f7fe640 1 -- 172.21.15.170:0/3915893544 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38840a2320 con 0x5646c3db96a0 2024-01-25T15:01:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f3899365740 10 client.15099 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f3899365740 1 -- 172.21.15.170:0/3915893544 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5646c3d1f690 con 0x5646c3db96a0 2024-01-25T15:01:19.991 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f386f7fe640 1 -- 172.21.15.170:0/3915893544 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5646c3d19bc0 con 0x5646c3db96a0 2024-01-25T15:01:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f386f7fe640 1 -- 172.21.15.170:0/3915893544 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f38840a1e90 con 0x5646c3db96a0 2024-01-25T15:01:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f3899365740 10 client.15099 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f3899365740 10 client.15099 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-25T15:01:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f3899365740 20 client.15099 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f3899365740 1 --2- 172.21.15.170:0/3915893544 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5646c3dd0a60 0x5646c3dcf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f3899365740 4 client.15099 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:01:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f3899365740 1 -- 172.21.15.170:0/3915893544 --> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5646c3a206c0 con 0x5646c3dd0a60 2024-01-25T15:01:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.982+0000 7f388f7fe640 1 --2- 172.21.15.170:0/3915893544 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5646c3dd0a60 0x5646c3dcf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.983+0000 7f386f7fe640 10 client.15099 ms_handle_connect on v2:172.21.15.186:6838/2132502182 2024-01-25T15:01:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.983+0000 7f388f7fe640 1 --2- 172.21.15.170:0/3915893544 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5646c3dd0a60 0x5646c3dcf4d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7a97b96013b97bbe server_cookie=694b97261e33d73c in_seq=0 out_seq=0 2024-01-25T15:01:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.983+0000 7f386f7fe640 1 -- 172.21.15.170:0/3915893544 <== mds.1 v2:172.21.15.186:6838/2132502182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5646c3a206c0 con 0x5646c3dd0a60 2024-01-25T15:01:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.983+0000 7f386f7fe640 10 client.15099 handle_command_reply: tid=0 2024-01-25T15:01:19.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.984+0000 7f3899365740 1 client.15099 shutdown 2024-01-25T15:01:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.984+0000 7f3899365740 1 -- 172.21.15.170:0/3915893544 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3db96a0 msgr2=0x5646c3dc3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.984+0000 7f3899365740 1 --2- 172.21.15.170:0/3915893544 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3db96a0 0x5646c3dc3880 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3884099d40 tx=0x7f38840ac670 comp rx=0 tx=0).stop 2024-01-25T15:01:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.984+0000 7f3899365740 1 -- 172.21.15.170:0/3915893544 shutdown_connections 2024-01-25T15:01:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.984+0000 7f3899365740 1 --2- 172.21.15.170:0/3915893544 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5646c3dd0a60 0x5646c3dcf4d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.984+0000 7f3899365740 1 --2- 172.21.15.170:0/3915893544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dba090 0x5646c3dc3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.984+0000 7f3899365740 1 --2- 172.21.15.170:0/3915893544 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dbf200 0x5646c3dcae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.984+0000 7f386f7fe640 0 client.15099 ms_handle_reset on v2:172.21.15.186:6838/2132502182 2024-01-25T15:01:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.984+0000 7f3899365740 1 --2- 172.21.15.170:0/3915893544 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3db96a0 0x5646c3dc3880 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.984+0000 7f3899365740 1 -- 172.21.15.170:0/3915893544 >> 172.21.15.170:0/3915893544 conn(0x5646c3db4c10 msgr2=0x5646c3db3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.984+0000 7f3899365740 1 -- 172.21.15.170:0/3915893544 shutdown_connections 2024-01-25T15:01:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.984+0000 7f3899365740 1 -- 172.21.15.170:0/3915893544 wait complete. 2024-01-25T15:01:19.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.984+0000 7f3899365740 20 client.15099 trim_cache size 0 max 16384 2024-01-25T15:01:20.005 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.999+0000 7f3899365740 1 Processor -- start 2024-01-25T15:01:20.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.999+0000 7f3899365740 1 -- start start 2024-01-25T15:01:20.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.999+0000 7f3899365740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3db96a0 0x5646c3dbb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.999+0000 7f3899365740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3dba090 0x5646c3dbbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.999+0000 7f3899365740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dbf200 0x5646c3dcad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.999+0000 7f3899365740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c3dd1d80 con 0x5646c3dba090 2024-01-25T15:01:20.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.999+0000 7f3899365740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c3db9260 con 0x5646c3db96a0 2024-01-25T15:01:20.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.999+0000 7f3899365740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c3a206c0 con 0x5646c3dbf200 2024-01-25T15:01:20.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.999+0000 7f388f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3dba090 0x5646c3dbbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.999+0000 7f388f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3dba090 0x5646c3dbbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54178/0 (socket says 172.21.15.170:54178) 2024-01-25T15:01:20.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:19.999+0000 7f388f7fe640 1 -- 172.21.15.170:0/3664322801 learned_addr learned my addr 172.21.15.170:0/3664322801 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:20.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.000+0000 7f3894c66640 1 --2- 172.21.15.170:0/3664322801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dbf200 0x5646c3dcad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.000+0000 7f388f7fe640 1 -- 172.21.15.170:0/3664322801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dbf200 msgr2=0x5646c3dcad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:20.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.000+0000 7f388f7fe640 1 --2- 172.21.15.170:0/3664322801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dbf200 0x5646c3dcad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.000+0000 7f388f7fe640 1 -- 172.21.15.170:0/3664322801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3db96a0 msgr2=0x5646c3dbb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:20.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.000+0000 7f388ffff640 1 --2- 172.21.15.170:0/3664322801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3db96a0 0x5646c3dbb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.000+0000 7f388f7fe640 1 --2- 172.21.15.170:0/3664322801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3db96a0 0x5646c3dbb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.000+0000 7f388f7fe640 1 -- 172.21.15.170:0/3664322801 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646c3cbc390 con 0x5646c3dba090 2024-01-25T15:01:20.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.000+0000 7f3894c66640 1 --2- 172.21.15.170:0/3664322801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dbf200 0x5646c3dcad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:20.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.000+0000 7f388f7fe640 1 --2- 172.21.15.170:0/3664322801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3dba090 0x5646c3dbbb30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3880009900 tx=0x7f3880009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376433cbc9791916 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:20.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.000+0000 7f3875ffb640 1 -- 172.21.15.170:0/3664322801 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3880051b80 con 0x5646c3dba090 2024-01-25T15:01:20.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.000+0000 7f3875ffb640 1 -- 172.21.15.170:0/3664322801 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3880004040 con 0x5646c3dba090 2024-01-25T15:01:20.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.000+0000 7f3875ffb640 1 -- 172.21.15.170:0/3664322801 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38800050e0 con 0x5646c3dba090 2024-01-25T15:01:20.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 -- 172.21.15.170:0/3664322801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3dba090 msgr2=0x5646c3dbbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:20.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 --2- 172.21.15.170:0/3664322801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3dba090 0x5646c3dbbb30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3880009900 tx=0x7f3880009260 comp rx=0 tx=0).stop 2024-01-25T15:01:20.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 -- 172.21.15.170:0/3664322801 shutdown_connections 2024-01-25T15:01:20.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 --2- 172.21.15.170:0/3664322801 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dbf200 0x5646c3dcad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 --2- 172.21.15.170:0/3664322801 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3dba090 0x5646c3dbbb30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 --2- 172.21.15.170:0/3664322801 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3db96a0 0x5646c3dbb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 -- 172.21.15.170:0/3664322801 >> 172.21.15.170:0/3664322801 conn(0x5646c3db4c10 msgr2=0x5646c3dbab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:20.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 -- 172.21.15.170:0/3664322801 shutdown_connections 2024-01-25T15:01:20.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 -- 172.21.15.170:0/3664322801 wait complete. 2024-01-25T15:01:20.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 -- start start 2024-01-25T15:01:20.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 Processor -- start 2024-01-25T15:01:20.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3db96a0 0x5646c3dcac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dba090 0x5646c3dc78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dbf200 0x5646c3dc7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c3dc8440 con 0x5646c3db96a0 2024-01-25T15:01:20.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c3e259a0 con 0x5646c3dbf200 2024-01-25T15:01:20.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c3e25ae0 con 0x5646c3dba090 2024-01-25T15:01:20.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.001+0000 7f3899365740 10 client.0 _ll_register_callbacks cb 0x7f3880009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:20.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f388ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3db96a0 0x5646c3dcac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f388f7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dba090 0x5646c3dc78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f388ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3db96a0 0x5646c3dcac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54192/0 (socket says 172.21.15.170:54192) 2024-01-25T15:01:20.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f388ffff640 1 -- 172.21.15.170:0/1307705356 learned_addr learned my addr 172.21.15.170:0/1307705356 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:20.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f3894c66640 1 --2- 172.21.15.170:0/1307705356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dbf200 0x5646c3dc7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f388ffff640 1 -- 172.21.15.170:0/1307705356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dba090 msgr2=0x5646c3dc78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:20.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f388ffff640 1 --2- 172.21.15.170:0/1307705356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dba090 0x5646c3dc78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f388ffff640 1 -- 172.21.15.170:0/1307705356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dbf200 msgr2=0x5646c3dc7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:20.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f388ffff640 1 --2- 172.21.15.170:0/1307705356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dbf200 0x5646c3dc7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f388ffff640 1 -- 172.21.15.170:0/1307705356 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5646c3ce3680 con 0x5646c3db96a0 2024-01-25T15:01:20.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f388f7fe640 1 --2- 172.21.15.170:0/1307705356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dba090 0x5646c3dc78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:01:20.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f388ffff640 1 --2- 172.21.15.170:0/1307705356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3db96a0 0x5646c3dcac80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f38840a1df0 tx=0x7f388401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18144174d35a252c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:20.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f386f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:20.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f386f7fe640 1 -- 172.21.15.170:0/1307705356 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388409e0e0 con 0x5646c3db96a0 2024-01-25T15:01:20.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f386f7fe640 1 -- 172.21.15.170:0/1307705356 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f388409a040 con 0x5646c3db96a0 2024-01-25T15:01:20.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f3899365740 1 -- 172.21.15.170:0/1307705356 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646c3d19ea0 con 0x5646c3db96a0 2024-01-25T15:01:20.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f386f7fe640 1 -- 172.21.15.170:0/1307705356 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38840a2320 con 0x5646c3db96a0 2024-01-25T15:01:20.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f3899365740 10 client.15105 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:20.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f3899365740 1 -- 172.21.15.170:0/1307705356 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5646c3ce1ee0 con 0x5646c3db96a0 2024-01-25T15:01:20.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.002+0000 7f386f7fe640 1 -- 172.21.15.170:0/1307705356 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5646c3d19ea0 con 0x5646c3db96a0 2024-01-25T15:01:20.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.003+0000 7f386f7fe640 1 -- 172.21.15.170:0/1307705356 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f38840a1e90 con 0x5646c3db96a0 2024-01-25T15:01:20.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.003+0000 7f3899365740 10 client.15105 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:20.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.003+0000 7f3899365740 10 client.15105 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-25T15:01:20.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.003+0000 7f3899365740 20 client.15105 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:20.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.003+0000 7f3899365740 1 --2- 172.21.15.170:0/1307705356 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5646c3e2a9f0 0x5646c3e26f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.003+0000 7f3899365740 4 client.15105 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-25T15:01:20.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.003+0000 7f3899365740 1 -- 172.21.15.170:0/1307705356 --> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5646c3a73d10 con 0x5646c3e2a9f0 2024-01-25T15:01:20.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.003+0000 7f388f7fe640 1 --2- 172.21.15.170:0/1307705356 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5646c3e2a9f0 0x5646c3e26f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.003+0000 7f386f7fe640 10 client.15105 ms_handle_connect on v2:172.21.15.186:6838/2132502182 2024-01-25T15:01:20.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.003+0000 7f388f7fe640 1 --2- 172.21.15.170:0/1307705356 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5646c3e2a9f0 0x5646c3e26f00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=680ceb0db0058d60 server_cookie=d825a0eebc3e404a in_seq=0 out_seq=0 2024-01-25T15:01:20.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.003+0000 7f386f7fe640 1 -- 172.21.15.170:0/1307705356 <== mds.1 v2:172.21.15.186:6838/2132502182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5646c3a73d10 con 0x5646c3e2a9f0 2024-01-25T15:01:20.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.003+0000 7f386f7fe640 10 client.15105 handle_command_reply: tid=0 2024-01-25T15:01:20.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.003+0000 7f3899365740 1 client.15105 shutdown 2024-01-25T15:01:20.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f3899365740 1 -- 172.21.15.170:0/1307705356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3db96a0 msgr2=0x5646c3dcac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:20.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f3899365740 1 --2- 172.21.15.170:0/1307705356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3db96a0 0x5646c3dcac80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f38840a1df0 tx=0x7f388401f000 comp rx=0 tx=0).stop 2024-01-25T15:01:20.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f3899365740 1 -- 172.21.15.170:0/1307705356 shutdown_connections 2024-01-25T15:01:20.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f3899365740 1 --2- 172.21.15.170:0/1307705356 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5646c3e2a9f0 0x5646c3e26f00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f3899365740 1 --2- 172.21.15.170:0/1307705356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5646c3dbf200 0x5646c3dc7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f3899365740 1 --2- 172.21.15.170:0/1307705356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5646c3dba090 0x5646c3dc78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f386f7fe640 0 client.15105 ms_handle_reset on v2:172.21.15.186:6838/2132502182 2024-01-25T15:01:20.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f3899365740 1 --2- 172.21.15.170:0/1307705356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5646c3db96a0 0x5646c3dcac80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f3899365740 1 -- 172.21.15.170:0/1307705356 >> 172.21.15.170:0/1307705356 conn(0x5646c3db4c10 msgr2=0x5646c3dbb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:20.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f3899365740 1 -- 172.21.15.170:0/1307705356 shutdown_connections 2024-01-25T15:01:20.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f3899365740 1 -- 172.21.15.170:0/1307705356 wait complete. 2024-01-25T15:01:20.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f3899365740 20 client.15105 trim_cache size 0 max 16384 2024-01-25T15:01:20.012 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:01:20.012 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "267213a8-bb91-11ee-95b2-87774f69a715", 2024-01-25T15:01:20.012 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 1, 2024-01-25T15:01:20.012 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 24479, 2024-01-25T15:01:20.012 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2024-01-25T15:01:20.012 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2024-01-25T15:01:20.012 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs", 2024-01-25T15:01:20.012 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 83.791232621000006, 2024-01-25T15:01:20.012 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 25, 2024-01-25T15:01:20.012 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 87, 2024-01-25T15:01:20.013 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 85, 2024-01-25T15:01:20.013 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 91.538405439000002 2024-01-25T15:01:20.013 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:01:20.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f38966c9640 1 -- 172.21.15.170:0/1068914268 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f38780a1370 msgr2=0x7f38780a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:20.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f38966c9640 1 --2- 172.21.15.170:0/1068914268 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f38780a1370 0x7f38780a3830 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3888012c80 tx=0x7f3888009e80 comp rx=0 tx=0).stop 2024-01-25T15:01:20.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f38966c9640 1 -- 172.21.15.170:0/1068914268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38900736f0 msgr2=0x7f3890198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:20.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f38966c9640 1 --2- 172.21.15.170:0/1068914268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38900736f0 0x7f3890198f00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f388400e9f0 tx=0x7f388400eeb0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f38966c9640 1 -- 172.21.15.170:0/1068914268 shutdown_connections 2024-01-25T15:01:20.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f38966c9640 1 --2- 172.21.15.170:0/1068914268 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f38780a1370 0x7f38780a3830 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f38966c9640 1 --2- 172.21.15.170:0/1068914268 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3890074cd0 0x7f3890199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f38966c9640 1 --2- 172.21.15.170:0/1068914268 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3890108bb0 0x7f38901a04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f38966c9640 1 --2- 172.21.15.170:0/1068914268 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f38900736f0 0x7f3890198f00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f38966c9640 1 -- 172.21.15.170:0/1068914268 >> 172.21.15.170:0/1068914268 conn(0x7f38900fc290 msgr2=0x7f3890104b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:20.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f38966c9640 1 -- 172.21.15.170:0/1068914268 shutdown_connections 2024-01-25T15:01:20.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.004+0000 7f38966c9640 1 -- 172.21.15.170:0/1068914268 wait complete. 2024-01-25T15:01:20.016 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-01-25T15:01:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.119+0000 7fa18a23d640 1 -- 172.21.15.170:0/1308342719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1840fff40 msgr2=0x7fa1841003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.119+0000 7fa18a23d640 1 --2- 172.21.15.170:0/1308342719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1840fff40 0x7fa1841003a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa16c009900 tx=0x7fa16c02bcd0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.119+0000 7fa18a23d640 1 -- 172.21.15.170:0/1308342719 shutdown_connections 2024-01-25T15:01:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.119+0000 7fa18a23d640 1 --2- 172.21.15.170:0/1308342719 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1841008e0 0x7fa184100d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.119+0000 7fa18a23d640 1 --2- 172.21.15.170:0/1308342719 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1840fff40 0x7fa1841003a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.119+0000 7fa18a23d640 1 --2- 172.21.15.170:0/1308342719 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1840ff5e0 0x7fa1840ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.119+0000 7fa18a23d640 1 -- 172.21.15.170:0/1308342719 >> 172.21.15.170:0/1308342719 conn(0x7fa1840fb180 msgr2=0x7fa1840fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:20.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.119+0000 7fa18a23d640 1 -- 172.21.15.170:0/1308342719 shutdown_connections 2024-01-25T15:01:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.119+0000 7fa18a23d640 1 -- 172.21.15.170:0/1308342719 wait complete. 2024-01-25T15:01:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa18a23d640 1 Processor -- start 2024-01-25T15:01:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa18a23d640 1 -- start start 2024-01-25T15:01:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa18a23d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1840ff5e0 0x7fa184198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa18a23d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1840fff40 0x7fa1841993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa18a23d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1841008e0 0x7fa1841a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa18a23d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1841a0950 con 0x7fa1841008e0 2024-01-25T15:01:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa18a23d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1841a0ac0 con 0x7fa1840fff40 2024-01-25T15:01:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa18a23d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1841a0c80 con 0x7fa1840ff5e0 2024-01-25T15:01:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa183fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1841008e0 0x7fa1841a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa183fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1841008e0 0x7fa1841a0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54210/0 (socket says 172.21.15.170:54210) 2024-01-25T15:01:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa183fff640 1 -- 172.21.15.170:0/473112503 learned_addr learned my addr 172.21.15.170:0/473112503 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa17affd640 1 --2- 172.21.15.170:0/473112503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1840fff40 0x7fa1841993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa1837fe640 1 --2- 172.21.15.170:0/473112503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1840ff5e0 0x7fa184198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa183fff640 1 -- 172.21.15.170:0/473112503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1840ff5e0 msgr2=0x7fa184198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa183fff640 1 --2- 172.21.15.170:0/473112503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1840ff5e0 0x7fa184198e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa183fff640 1 -- 172.21.15.170:0/473112503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1840fff40 msgr2=0x7fa1841993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa183fff640 1 --2- 172.21.15.170:0/473112503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1840fff40 0x7fa1841993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.120+0000 7fa183fff640 1 -- 172.21.15.170:0/473112503 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c009560 con 0x7fa1841008e0 2024-01-25T15:01:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.121+0000 7fa183fff640 1 --2- 172.21.15.170:0/473112503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1841008e0 0x7fa1841a0410 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00cce0 tx=0x7fa17c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.121+0000 7fa1817fa640 1 -- 172.21.15.170:0/473112503 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c00f450 con 0x7fa1841008e0 2024-01-25T15:01:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.121+0000 7fa18a23d640 1 -- 172.21.15.170:0/473112503 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1841a0f60 con 0x7fa1841008e0 2024-01-25T15:01:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.121+0000 7fa1817fa640 1 -- 172.21.15.170:0/473112503 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa17c00fa70 con 0x7fa1841008e0 2024-01-25T15:01:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.121+0000 7fa1817fa640 1 -- 172.21.15.170:0/473112503 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c018b40 con 0x7fa1841008e0 2024-01-25T15:01:20.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.121+0000 7fa18a23d640 1 -- 172.21.15.170:0/473112503 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1841a1390 con 0x7fa1841008e0 2024-01-25T15:01:20.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.123+0000 7fa1817fa640 1 -- 172.21.15.170:0/473112503 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fa17c00fbe0 con 0x7fa1841008e0 2024-01-25T15:01:20.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.123+0000 7fa18ce02740 1 Processor -- start 2024-01-25T15:01:20.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.123+0000 7fa18ce02740 1 -- start start 2024-01-25T15:01:20.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa1817fa640 1 --2- 172.21.15.170:0/473112503 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa1700a1370 0x7fa1700a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa18ce02740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 0x55b3647b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa18ce02740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647b3090 0x55b3647b7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa18ce02740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b8200 0x55b3647ba690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa18ce02740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b364721030 con 0x55b3647b8200 2024-01-25T15:01:20.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa18ce02740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b36471e720 con 0x55b3647b3090 2024-01-25T15:01:20.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa18ce02740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b36471a010 con 0x55b3647b26a0 2024-01-25T15:01:20.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa17affd640 1 --2- 172.21.15.170:0/473112503 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa1700a1370 0x7fa1700a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa183fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b8200 0x55b3647ba690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa183fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b8200 0x55b3647ba690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54220/0 (socket says 172.21.15.170:54220) 2024-01-25T15:01:20.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa183fff640 1 -- 172.21.15.170:0/3983945070 learned_addr learned my addr 172.21.15.170:0/3983945070 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:20.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa1817fa640 1 -- 172.21.15.170:0/473112503 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fa17c0cd500 con 0x7fa1841008e0 2024-01-25T15:01:20.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa1837fe640 1 --2- 172.21.15.170:0/3983945070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 0x55b3647b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa183fff640 1 -- 172.21.15.170:0/3983945070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 msgr2=0x55b3647b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:20.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa183fff640 1 --2- 172.21.15.170:0/3983945070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 0x55b3647b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa183fff640 1 -- 172.21.15.170:0/3983945070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647b3090 msgr2=0x55b3647b7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:20.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa183fff640 1 --2- 172.21.15.170:0/3983945070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647b3090 0x55b3647b7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa183fff640 1 -- 172.21.15.170:0/3983945070 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3646dc680 con 0x55b3647b8200 2024-01-25T15:01:20.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa183fff640 1 --2- 172.21.15.170:0/3983945070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b8200 0x55b3647ba690 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa17c09a210 tx=0x7fa17c09a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e882c3d02016832 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:20.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa17affd640 1 --2- 172.21.15.170:0/473112503 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa1700a1370 0x7fa1700a3830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa16c005ab0 tx=0x7fa16c005b50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:20.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa179ffb640 1 -- 172.21.15.170:0/3983945070 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c09ac10 con 0x55b3647b8200 2024-01-25T15:01:20.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa179ffb640 1 -- 172.21.15.170:0/3983945070 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa17c016d30 con 0x55b3647b8200 2024-01-25T15:01:20.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.124+0000 7fa179ffb640 1 -- 172.21.15.170:0/3983945070 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0a2930 con 0x55b3647b8200 2024-01-25T15:01:20.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.125+0000 7fa18ce02740 1 -- 172.21.15.170:0/3983945070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b8200 msgr2=0x55b3647ba690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:20.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.125+0000 7fa18ce02740 1 --2- 172.21.15.170:0/3983945070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b8200 0x55b3647ba690 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa17c09a210 tx=0x7fa17c09a110 comp rx=0 tx=0).stop 2024-01-25T15:01:20.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.125+0000 7fa18ce02740 1 -- 172.21.15.170:0/3983945070 shutdown_connections 2024-01-25T15:01:20.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.125+0000 7fa18ce02740 1 --2- 172.21.15.170:0/3983945070 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647b3090 0x55b3647b7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.125+0000 7fa18ce02740 1 --2- 172.21.15.170:0/3983945070 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b8200 0x55b3647ba690 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.125+0000 7fa18ce02740 1 --2- 172.21.15.170:0/3983945070 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 0x55b3647b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.125+0000 7fa18ce02740 1 -- 172.21.15.170:0/3983945070 >> 172.21.15.170:0/3983945070 conn(0x55b3647adc10 msgr2=0x55b3647ae010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:20.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.125+0000 7fa18ce02740 1 -- 172.21.15.170:0/3983945070 shutdown_connections 2024-01-25T15:01:20.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.125+0000 7fa18ce02740 1 -- 172.21.15.170:0/3983945070 wait complete. 2024-01-25T15:01:20.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.125+0000 7fa18ce02740 1 -- start start 2024-01-25T15:01:20.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa18ce02740 1 Processor -- start 2024-01-25T15:01:20.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa18ce02740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b26a0 0x55b3647bc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa18ce02740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647b3090 0x55b3647bce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa18ce02740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b8200 0x55b3647c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa18ce02740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3646d35f0 con 0x55b3647b26a0 2024-01-25T15:01:20.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa18ce02740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3646d3290 con 0x55b3647b3090 2024-01-25T15:01:20.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa18ce02740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b364698300 con 0x55b3647b8200 2024-01-25T15:01:20.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa18ce02740 10 client.0 _ll_register_callbacks cb 0x55b3646ce260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:20.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b26a0 0x55b3647bc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa1837fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b26a0 0x55b3647bc8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54222/0 (socket says 172.21.15.170:54222) 2024-01-25T15:01:20.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa1837fe640 1 -- 172.21.15.170:0/4196661013 learned_addr learned my addr 172.21.15.170:0/4196661013 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:20.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa183fff640 1 --2- 172.21.15.170:0/4196661013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b8200 0x55b3647c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa17affd640 1 --2- 172.21.15.170:0/4196661013 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647b3090 0x55b3647bce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa1837fe640 1 -- 172.21.15.170:0/4196661013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b8200 msgr2=0x55b3647c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:20.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa1837fe640 1 --2- 172.21.15.170:0/4196661013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b8200 0x55b3647c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa1837fe640 1 -- 172.21.15.170:0/4196661013 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647b3090 msgr2=0x55b3647bce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:20.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa1837fe640 1 --2- 172.21.15.170:0/4196661013 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647b3090 0x55b3647bce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa1837fe640 1 -- 172.21.15.170:0/4196661013 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1841a1390 con 0x55b3647b26a0 2024-01-25T15:01:20.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.126+0000 7fa17affd640 1 --2- 172.21.15.170:0/4196661013 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647b3090 0x55b3647bce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:20.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa1837fe640 1 --2- 172.21.15.170:0/4196661013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b26a0 0x55b3647bc8e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa174009dc0 tx=0x7fa1740117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=652d0473484d1a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:20.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa162ffd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:20.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa162ffd640 1 -- 172.21.15.170:0/4196661013 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174012860 con 0x55b3647b26a0 2024-01-25T15:01:20.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa162ffd640 1 -- 172.21.15.170:0/4196661013 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fa174011e60 con 0x55b3647b26a0 2024-01-25T15:01:20.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa18ce02740 1 -- 172.21.15.170:0/4196661013 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b364712ea0 con 0x55b3647b26a0 2024-01-25T15:01:20.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa162ffd640 1 -- 172.21.15.170:0/4196661013 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1740129c0 con 0x55b3647b26a0 2024-01-25T15:01:20.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa18ce02740 10 client.15117 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:20.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa18ce02740 1 -- 172.21.15.170:0/4196661013 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55b364718690 con 0x55b3647b26a0 2024-01-25T15:01:20.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa162ffd640 1 -- 172.21.15.170:0/4196661013 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b364712ea0 con 0x55b3647b26a0 2024-01-25T15:01:20.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa162ffd640 1 -- 172.21.15.170:0/4196661013 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa17400c070 con 0x55b3647b26a0 2024-01-25T15:01:20.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa18ce02740 10 client.15117 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:20.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa18ce02740 10 client.15117 resolve_mds: resolved name 'i' to daemon mds.i 2024-01-25T15:01:20.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa18ce02740 20 client.15117 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:20.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa18ce02740 1 --2- 172.21.15.170:0/4196661013 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b3647c9b40 0x55b3647c8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa18ce02740 4 client.15117 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:01:20.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.127+0000 7fa18ce02740 1 -- 172.21.15.170:0/4196661013 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b364712bc0 con 0x55b3647c9b40 2024-01-25T15:01:20.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.128+0000 7fa17affd640 1 --2- 172.21.15.170:0/4196661013 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b3647c9b40 0x55b3647c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.128+0000 7fa17affd640 1 --2- 172.21.15.170:0/4196661013 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b3647c9b40 0x55b3647c8540 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7423aa18525b73f5 server_cookie=a581190a672411d8 in_seq=0 out_seq=0 2024-01-25T15:01:20.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.128+0000 7fa162ffd640 10 client.15117 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:20.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.129+0000 7fa162ffd640 1 -- 172.21.15.170:0/4196661013 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b364712bc0 con 0x55b3647c9b40 2024-01-25T15:01:20.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.129+0000 7fa162ffd640 10 client.15117 handle_command_reply: tid=0 2024-01-25T15:01:20.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.129+0000 7fa18ce02740 1 client.15117 shutdown 2024-01-25T15:01:20.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.129+0000 7fa18ce02740 1 -- 172.21.15.170:0/4196661013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b26a0 msgr2=0x55b3647bc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:20.136 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.129+0000 7fa18ce02740 1 --2- 172.21.15.170:0/4196661013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b26a0 0x55b3647bc8e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa174009dc0 tx=0x7fa1740117b0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.129+0000 7fa18ce02740 1 -- 172.21.15.170:0/4196661013 shutdown_connections 2024-01-25T15:01:20.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.129+0000 7fa18ce02740 1 --2- 172.21.15.170:0/4196661013 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b3647c9b40 0x55b3647c8540 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.129+0000 7fa18ce02740 1 --2- 172.21.15.170:0/4196661013 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647b3090 0x55b3647bce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.129+0000 7fa18ce02740 1 --2- 172.21.15.170:0/4196661013 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b8200 0x55b3647c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.129+0000 7fa162ffd640 0 client.15117 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:20.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.129+0000 7fa18ce02740 1 --2- 172.21.15.170:0/4196661013 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b26a0 0x55b3647bc8e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.129+0000 7fa18ce02740 1 -- 172.21.15.170:0/4196661013 >> 172.21.15.170:0/4196661013 conn(0x55b3647adc10 msgr2=0x55b3647acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:20.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.129+0000 7fa18ce02740 1 -- 172.21.15.170:0/4196661013 shutdown_connections 2024-01-25T15:01:20.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.129+0000 7fa18ce02740 1 -- 172.21.15.170:0/4196661013 wait complete. 2024-01-25T15:01:20.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.129+0000 7fa18ce02740 20 client.15117 trim_cache size 0 max 16384 2024-01-25T15:01:20.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.144+0000 7fa18ce02740 1 Processor -- start 2024-01-25T15:01:20.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.144+0000 7fa18ce02740 1 -- start start 2024-01-25T15:01:20.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa18ce02740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647adc10 0x55b3647c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa18ce02740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 0x55b3647c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa18ce02740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b3090 0x55b3647ac510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa18ce02740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3647a94e0 con 0x55b3647b3090 2024-01-25T15:01:20.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa18ce02740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3646be020 con 0x55b3647adc10 2024-01-25T15:01:20.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa18ce02740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3646c67d0 con 0x55b3647b26a0 2024-01-25T15:01:20.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa183fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b3090 0x55b3647ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa183fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b3090 0x55b3647ac510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54224/0 (socket says 172.21.15.170:54224) 2024-01-25T15:01:20.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa183fff640 1 -- 172.21.15.170:0/3825772995 learned_addr learned my addr 172.21.15.170:0/3825772995 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:20.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa17affd640 1 --2- 172.21.15.170:0/3825772995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 0x55b3647c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa1837fe640 1 --2- 172.21.15.170:0/3825772995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647adc10 0x55b3647c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa183fff640 1 -- 172.21.15.170:0/3825772995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 msgr2=0x55b3647c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:20.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa183fff640 1 --2- 172.21.15.170:0/3825772995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 0x55b3647c3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa183fff640 1 -- 172.21.15.170:0/3825772995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647adc10 msgr2=0x55b3647c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:20.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa183fff640 1 --2- 172.21.15.170:0/3825772995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647adc10 0x55b3647c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.152 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa183fff640 1 -- 172.21.15.170:0/3825772995 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3646b5390 con 0x55b3647b3090 2024-01-25T15:01:20.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa17affd640 1 --2- 172.21.15.170:0/3825772995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 0x55b3647c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:20.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa183fff640 1 --2- 172.21.15.170:0/3825772995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b3090 0x55b3647ac510 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0850b0 tx=0x7fa17c0185a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bca7e70673cdea6 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:20.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa1797fa640 1 -- 172.21.15.170:0/3825772995 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c09e6d0 con 0x55b3647b3090 2024-01-25T15:01:20.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa1797fa640 1 -- 172.21.15.170:0/3825772995 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa17c09ac10 con 0x55b3647b3090 2024-01-25T15:01:20.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.145+0000 7fa1797fa640 1 -- 172.21.15.170:0/3825772995 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0cd0f0 con 0x55b3647b3090 2024-01-25T15:01:20.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.146+0000 7fa18ce02740 1 -- 172.21.15.170:0/3825772995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b3090 msgr2=0x55b3647ac510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:20.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.146+0000 7fa18ce02740 1 --2- 172.21.15.170:0/3825772995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b3090 0x55b3647ac510 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0850b0 tx=0x7fa17c0185a0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.146+0000 7fa18ce02740 1 -- 172.21.15.170:0/3825772995 shutdown_connections 2024-01-25T15:01:20.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.146+0000 7fa18ce02740 1 --2- 172.21.15.170:0/3825772995 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b3090 0x55b3647ac510 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.146+0000 7fa18ce02740 1 --2- 172.21.15.170:0/3825772995 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 0x55b3647c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.146+0000 7fa18ce02740 1 --2- 172.21.15.170:0/3825772995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647adc10 0x55b3647c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.146+0000 7fa18ce02740 1 -- 172.21.15.170:0/3825772995 >> 172.21.15.170:0/3825772995 conn(0x55b3647b3e30 msgr2=0x55b3647c8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:20.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.146+0000 7fa18ce02740 1 -- 172.21.15.170:0/3825772995 shutdown_connections 2024-01-25T15:01:20.153 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.146+0000 7fa18ce02740 1 -- 172.21.15.170:0/3825772995 wait complete. 2024-01-25T15:01:20.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.146+0000 7fa18ce02740 1 -- start start 2024-01-25T15:01:20.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa18ce02740 1 Processor -- start 2024-01-25T15:01:20.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa18ce02740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647adc10 0x55b3647c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa18ce02740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 0x55b3647c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa18ce02740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b3090 0x55b3647c3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa18ce02740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b36481ebf0 con 0x55b3647b3090 2024-01-25T15:01:20.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa18ce02740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b36481ed60 con 0x55b3647adc10 2024-01-25T15:01:20.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa18ce02740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b36481ef20 con 0x55b3647b26a0 2024-01-25T15:01:20.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa18ce02740 10 client.0 _ll_register_callbacks cb 0x7fa17c00af30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:20.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa183fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b3090 0x55b3647c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa183fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b3090 0x55b3647c3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54238/0 (socket says 172.21.15.170:54238) 2024-01-25T15:01:20.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa183fff640 1 -- 172.21.15.170:0/2572583215 learned_addr learned my addr 172.21.15.170:0/2572583215 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:20.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa17affd640 1 --2- 172.21.15.170:0/2572583215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 0x55b3647c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.154 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa1837fe640 1 --2- 172.21.15.170:0/2572583215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647adc10 0x55b3647c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa183fff640 1 -- 172.21.15.170:0/2572583215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 msgr2=0x55b3647c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:20.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa183fff640 1 --2- 172.21.15.170:0/2572583215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 0x55b3647c2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa183fff640 1 -- 172.21.15.170:0/2572583215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647adc10 msgr2=0x55b3647c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:20.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa183fff640 1 --2- 172.21.15.170:0/2572583215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647adc10 0x55b3647c2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa183fff640 1 -- 172.21.15.170:0/2572583215 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3646dc680 con 0x55b3647b3090 2024-01-25T15:01:20.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa1837fe640 1 --2- 172.21.15.170:0/2572583215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647adc10 0x55b3647c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:20.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa183fff640 1 --2- 172.21.15.170:0/2572583215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b3090 0x55b3647c3520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0cb3a0 tx=0x7fa17c0cd320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d679fbfbeb383755 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:20.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa162ffd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:20.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa162ffd640 1 -- 172.21.15.170:0/2572583215 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c09a510 con 0x55b3647b3090 2024-01-25T15:01:20.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa162ffd640 1 -- 172.21.15.170:0/2572583215 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fa17c0a28a0 con 0x55b3647b3090 2024-01-25T15:01:20.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.147+0000 7fa18ce02740 1 -- 172.21.15.170:0/2572583215 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa17c016d30 con 0x55b3647b3090 2024-01-25T15:01:20.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.148+0000 7fa162ffd640 1 -- 172.21.15.170:0/2572583215 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa17c09e660 con 0x55b3647b3090 2024-01-25T15:01:20.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.148+0000 7fa18ce02740 10 client.15123 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:20.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.148+0000 7fa18ce02740 1 -- 172.21.15.170:0/2572583215 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55b3646daee0 con 0x55b3647b3090 2024-01-25T15:01:20.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.148+0000 7fa162ffd640 1 -- 172.21.15.170:0/2572583215 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa17c016d30 con 0x55b3647b3090 2024-01-25T15:01:20.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.148+0000 7fa162ffd640 1 -- 172.21.15.170:0/2572583215 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa17c082050 con 0x55b3647b3090 2024-01-25T15:01:20.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.148+0000 7fa18ce02740 10 client.15123 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:20.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.148+0000 7fa18ce02740 10 client.15123 resolve_mds: resolved name 'i' to daemon mds.i 2024-01-25T15:01:20.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.148+0000 7fa18ce02740 20 client.15123 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:20.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.148+0000 7fa18ce02740 1 --2- 172.21.15.170:0/2572583215 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b3647b8200 0x55b3648201f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:20.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.148+0000 7fa18ce02740 4 client.15123 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-25T15:01:20.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.148+0000 7fa18ce02740 1 -- 172.21.15.170:0/2572583215 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b3644196c0 con 0x55b3647b8200 2024-01-25T15:01:20.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.148+0000 7fa1837fe640 1 --2- 172.21.15.170:0/2572583215 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b3647b8200 0x55b3648201f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:20.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa1837fe640 1 --2- 172.21.15.170:0/2572583215 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b3647b8200 0x55b3648201f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=380645bf6781e49f server_cookie=b05299193c3ace47 in_seq=0 out_seq=0 2024-01-25T15:01:20.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa162ffd640 10 client.15123 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:20.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa162ffd640 1 -- 172.21.15.170:0/2572583215 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55b3644196c0 con 0x55b3647b8200 2024-01-25T15:01:20.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa162ffd640 10 client.15123 handle_command_reply: tid=0 2024-01-25T15:01:20.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa18ce02740 1 client.15123 shutdown 2024-01-25T15:01:20.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa18ce02740 1 -- 172.21.15.170:0/2572583215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b3090 msgr2=0x55b3647c3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:20.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa18ce02740 1 --2- 172.21.15.170:0/2572583215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b3090 0x55b3647c3520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0cb3a0 tx=0x7fa17c0cd320 comp rx=0 tx=0).stop 2024-01-25T15:01:20.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa18ce02740 1 -- 172.21.15.170:0/2572583215 shutdown_connections 2024-01-25T15:01:20.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa18ce02740 1 --2- 172.21.15.170:0/2572583215 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b3647b8200 0x55b3648201f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa18ce02740 1 --2- 172.21.15.170:0/2572583215 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b3647b3090 0x55b3647c3520 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa18ce02740 1 --2- 172.21.15.170:0/2572583215 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b3647b26a0 0x55b3647c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa162ffd640 0 client.15123 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:20.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa18ce02740 1 --2- 172.21.15.170:0/2572583215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b3647adc10 0x55b3647c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa18ce02740 1 -- 172.21.15.170:0/2572583215 >> 172.21.15.170:0/2572583215 conn(0x55b3647b3e30 msgr2=0x55b3647ac510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:20.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa18ce02740 1 -- 172.21.15.170:0/2572583215 shutdown_connections 2024-01-25T15:01:20.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa18ce02740 1 -- 172.21.15.170:0/2572583215 wait complete. 2024-01-25T15:01:20.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.149+0000 7fa18ce02740 20 client.15123 trim_cache size 0 max 16384 2024-01-25T15:01:20.160 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:01:20.160 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "267213a8-bb91-11ee-95b2-87774f69a715", 2024-01-25T15:01:20.160 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 0, 2024-01-25T15:01:20.160 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 24484, 2024-01-25T15:01:20.160 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2024-01-25T15:01:20.160 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2024-01-25T15:01:20.161 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs", 2024-01-25T15:01:20.161 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 85.960034284000002, 2024-01-25T15:01:20.161 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 25, 2024-01-25T15:01:20.161 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 87, 2024-01-25T15:01:20.161 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 85, 2024-01-25T15:01:20.161 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 100.113841733 2024-01-25T15:01:20.161 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:01:20.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.150+0000 7fa18a23d640 1 -- 172.21.15.170:0/473112503 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa1700a1370 msgr2=0x7fa1700a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:20.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.150+0000 7fa18a23d640 1 --2- 172.21.15.170:0/473112503 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa1700a1370 0x7fa1700a3830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa16c005ab0 tx=0x7fa16c005b50 comp rx=0 tx=0).stop 2024-01-25T15:01:20.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.150+0000 7fa18a23d640 1 -- 172.21.15.170:0/473112503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1841008e0 msgr2=0x7fa1841a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:20.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.150+0000 7fa18a23d640 1 --2- 172.21.15.170:0/473112503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1841008e0 0x7fa1841a0410 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa17c00cce0 tx=0x7fa17c00a620 comp rx=0 tx=0).stop 2024-01-25T15:01:20.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.150+0000 7fa18a23d640 1 -- 172.21.15.170:0/473112503 shutdown_connections 2024-01-25T15:01:20.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.150+0000 7fa18a23d640 1 --2- 172.21.15.170:0/473112503 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa1700a1370 0x7fa1700a3830 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.150+0000 7fa18a23d640 1 --2- 172.21.15.170:0/473112503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1840fff40 0x7fa1841993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.150+0000 7fa18a23d640 1 --2- 172.21.15.170:0/473112503 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1841008e0 0x7fa1841a0410 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.150+0000 7fa18a23d640 1 --2- 172.21.15.170:0/473112503 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1840ff5e0 0x7fa184198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:20.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.150+0000 7fa18a23d640 1 -- 172.21.15.170:0/473112503 >> 172.21.15.170:0/473112503 conn(0x7fa1840fb180 msgr2=0x7fa1840fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:20.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.150+0000 7fa18a23d640 1 -- 172.21.15.170:0/473112503 shutdown_connections 2024-01-25T15:01:20.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:20.150+0000 7fa18a23d640 1 -- 172.21.15.170:0/473112503 wait complete. 2024-01-25T15:01:20.163 INFO:tasks.cephadm:Setup complete, yielding 2024-01-25T15:01:20.164 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-01-25T15:01:20.174 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi170.front.sepia.ceph.com 2024-01-25T15:01:20.175 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- bash -c 'ceph orch status' 2024-01-25T15:01:20.420 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:01:20.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:20 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3416678773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:20.542 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:20 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3416678773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:20.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:20 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3416678773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:21.550 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:21 smithi170 ceph-mon[31899]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:01:21.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:21 smithi186 ceph-mon[35697]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:01:21.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:21 smithi191 ceph-mon[36347]: pgmap v329: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:01:22.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.073+0000 7ff6a9fc0700 1 -- 172.21.15.170:0/3756263301 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6a41022c0 msgr2=0x7ff6a4108b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:22.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.073+0000 7ff6a9fc0700 1 --2- 172.21.15.170:0/3756263301 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6a41022c0 0x7ff6a4108b70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00b0d0 tx=0x7ff69c00b3e0 comp rx=0 tx=0).stop 2024-01-25T15:01:22.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.073+0000 7ff6a9fc0700 1 -- 172.21.15.170:0/3756263301 shutdown_connections 2024-01-25T15:01:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.073+0000 7ff6a9fc0700 1 --2- 172.21.15.170:0/3756263301 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6a41022c0 0x7ff6a4108b70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.073+0000 7ff6a9fc0700 1 --2- 172.21.15.170:0/3756263301 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6a4100720 0x7ff6a4100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.073+0000 7ff6a9fc0700 1 --2- 172.21.15.170:0/3756263301 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6a4101920 0x7ff6a4101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.073+0000 7ff6a9fc0700 1 -- 172.21.15.170:0/3756263301 >> 172.21.15.170:0/3756263301 conn(0x7ff6a40fbce0 msgr2=0x7ff6a40fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.073+0000 7ff6a9fc0700 1 -- 172.21.15.170:0/3756263301 shutdown_connections 2024-01-25T15:01:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.073+0000 7ff6a9fc0700 1 -- 172.21.15.170:0/3756263301 wait complete. 2024-01-25T15:01:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.074+0000 7ff6a9fc0700 1 Processor -- start 2024-01-25T15:01:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.074+0000 7ff6a9fc0700 1 -- start start 2024-01-25T15:01:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.074+0000 7ff6a9fc0700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6a4100720 0x7ff6a4197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.074+0000 7ff6a9fc0700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6a4101920 0x7ff6a4197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.074+0000 7ff6a9fc0700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6a41022c0 0x7ff6a419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.074+0000 7ff6a9fc0700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a419f410 con 0x7ff6a41022c0 2024-01-25T15:01:22.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.074+0000 7ff6a9fc0700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a419f550 con 0x7ff6a4100720 2024-01-25T15:01:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.074+0000 7ff6a9fc0700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a419f6e0 con 0x7ff6a4101920 2024-01-25T15:01:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.074+0000 7ff6a3fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6a41022c0 0x7ff6a419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.075+0000 7ff6a3fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6a41022c0 0x7ff6a419ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54256/0 (socket says 172.21.15.170:54256) 2024-01-25T15:01:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.075+0000 7ff6a3fff700 1 -- 172.21.15.170:0/3676060192 learned_addr learned my addr 172.21.15.170:0/3676060192 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.075+0000 7ff6a2ffd700 1 --2- 172.21.15.170:0/3676060192 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6a4101920 0x7ff6a4197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.075+0000 7ff6a37fe700 1 --2- 172.21.15.170:0/3676060192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6a4100720 0x7ff6a4197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.075+0000 7ff6a3fff700 1 -- 172.21.15.170:0/3676060192 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6a4101920 msgr2=0x7ff6a4197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.075+0000 7ff6a3fff700 1 --2- 172.21.15.170:0/3676060192 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6a4101920 0x7ff6a4197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.075+0000 7ff6a3fff700 1 -- 172.21.15.170:0/3676060192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6a4100720 msgr2=0x7ff6a4197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.075+0000 7ff6a3fff700 1 --2- 172.21.15.170:0/3676060192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6a4100720 0x7ff6a4197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.075+0000 7ff6a3fff700 1 -- 172.21.15.170:0/3676060192 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69c009d00 con 0x7ff6a41022c0 2024-01-25T15:01:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.075+0000 7ff6a3fff700 1 --2- 172.21.15.170:0/3676060192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6a41022c0 0x7ff6a419ee40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00d010 tx=0x7ff69c0079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:22.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.075+0000 7ff6a0ff9700 1 -- 172.21.15.170:0/3676060192 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c00e040 con 0x7ff6a41022c0 2024-01-25T15:01:22.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.075+0000 7ff6a0ff9700 1 -- 172.21.15.170:0/3676060192 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff69c01db40 con 0x7ff6a41022c0 2024-01-25T15:01:22.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.075+0000 7ff6a0ff9700 1 -- 172.21.15.170:0/3676060192 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c01bb50 con 0x7ff6a41022c0 2024-01-25T15:01:22.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.075+0000 7ff6a9fc0700 1 -- 172.21.15.170:0/3676060192 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a419f960 con 0x7ff6a41022c0 2024-01-25T15:01:22.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.075+0000 7ff6a9fc0700 1 -- 172.21.15.170:0/3676060192 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a419fe50 con 0x7ff6a41022c0 2024-01-25T15:01:22.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.076+0000 7ff6a9fc0700 1 -- 172.21.15.170:0/3676060192 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a40684a0 con 0x7ff6a41022c0 2024-01-25T15:01:22.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.077+0000 7ff6a0ff9700 1 -- 172.21.15.170:0/3676060192 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7ff69c01dcb0 con 0x7ff6a41022c0 2024-01-25T15:01:22.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.078+0000 7ff6a0ff9700 1 --2- 172.21.15.170:0/3676060192 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff68c0a1480 0x7ff68c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:22.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.078+0000 7ff6a37fe700 1 --2- 172.21.15.170:0/3676060192 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff68c0a1480 0x7ff68c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:22.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.078+0000 7ff6a0ff9700 1 -- 172.21.15.170:0/3676060192 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7ff69c0ce730 con 0x7ff6a41022c0 2024-01-25T15:01:22.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.079+0000 7ff6a37fe700 1 --2- 172.21.15.170:0/3676060192 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff68c0a1480 0x7ff68c0a3940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4101780 tx=0x7ff69400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:22.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.083+0000 7ff6a0ff9700 1 -- 172.21.15.170:0/3676060192 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ff69c097b10 con 0x7ff6a41022c0 2024-01-25T15:01:22.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.300+0000 7ff6a9fc0700 1 -- 172.21.15.170:0/3676060192 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6a40fded0 con 0x7ff68c0a1480 2024-01-25T15:01:22.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.301+0000 7ff6a0ff9700 1 -- 172.21.15.170:0/3676060192 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7ff6a40fded0 con 0x7ff68c0a1480 2024-01-25T15:01:22.302 INFO:teuthology.orchestra.run.smithi170.stdout:Backend: cephadm 2024-01-25T15:01:22.302 INFO:teuthology.orchestra.run.smithi170.stdout:Available: Yes 2024-01-25T15:01:22.302 INFO:teuthology.orchestra.run.smithi170.stdout:Paused: No 2024-01-25T15:01:22.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.303+0000 7ff6a9fc0700 1 -- 172.21.15.170:0/3676060192 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff68c0a1480 msgr2=0x7ff68c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:22.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.303+0000 7ff6a9fc0700 1 --2- 172.21.15.170:0/3676060192 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff68c0a1480 0x7ff68c0a3940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4101780 tx=0x7ff69400a380 comp rx=0 tx=0).stop 2024-01-25T15:01:22.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.303+0000 7ff6a9fc0700 1 -- 172.21.15.170:0/3676060192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6a41022c0 msgr2=0x7ff6a419ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:22.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.303+0000 7ff6a9fc0700 1 --2- 172.21.15.170:0/3676060192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6a41022c0 0x7ff6a419ee40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00d010 tx=0x7ff69c0079b0 comp rx=0 tx=0).stop 2024-01-25T15:01:22.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.303+0000 7ff6a9fc0700 1 -- 172.21.15.170:0/3676060192 shutdown_connections 2024-01-25T15:01:22.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.303+0000 7ff6a9fc0700 1 --2- 172.21.15.170:0/3676060192 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff68c0a1480 0x7ff68c0a3940 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:22.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.303+0000 7ff6a9fc0700 1 --2- 172.21.15.170:0/3676060192 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6a41022c0 0x7ff6a419ee40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:22.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.303+0000 7ff6a9fc0700 1 --2- 172.21.15.170:0/3676060192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6a4100720 0x7ff6a4197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:22.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.303+0000 7ff6a9fc0700 1 --2- 172.21.15.170:0/3676060192 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6a4101920 0x7ff6a4197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:22.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.303+0000 7ff6a9fc0700 1 -- 172.21.15.170:0/3676060192 >> 172.21.15.170:0/3676060192 conn(0x7ff6a40fbce0 msgr2=0x7ff6a40fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:22.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.304+0000 7ff6a9fc0700 1 -- 172.21.15.170:0/3676060192 shutdown_connections 2024-01-25T15:01:22.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:22.304+0000 7ff6a9fc0700 1 -- 172.21.15.170:0/3676060192 wait complete. 2024-01-25T15:01:22.997 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- bash -c 'ceph orch ps' 2024-01-25T15:01:23.237 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:01:23.598 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:23 smithi170 ceph-mon[31899]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-25T15:01:23.598 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:23 smithi170 ceph-mon[31899]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:23.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:23 smithi186 ceph-mon[35697]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-25T15:01:23.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:23 smithi186 ceph-mon[35697]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:23.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:23 smithi191 ceph-mon[36347]: pgmap v330: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-25T15:01:23.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:23 smithi191 ceph-mon[36347]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:24.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.874+0000 7f3cc87ac700 1 -- 172.21.15.170:0/3658357371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cc01075a0 msgr2=0x7f3cc0109990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:24.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.874+0000 7f3cc87ac700 1 --2- 172.21.15.170:0/3658357371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cc01075a0 0x7f3cc0109990 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009990 tx=0x7f3cb0009ca0 comp rx=0 tx=0).stop 2024-01-25T15:01:24.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.874+0000 7f3cc87ac700 1 -- 172.21.15.170:0/3658357371 shutdown_connections 2024-01-25T15:01:24.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.874+0000 7f3cc87ac700 1 --2- 172.21.15.170:0/3658357371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cc0102340 0x7f3cc0104730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:24.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.874+0000 7f3cc87ac700 1 --2- 172.21.15.170:0/3658357371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cc01075a0 0x7f3cc0109990 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:24.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.874+0000 7f3cc87ac700 1 --2- 172.21.15.170:0/3658357371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3cc0104c70 0x7f3cc0107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:24.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.874+0000 7f3cc87ac700 1 -- 172.21.15.170:0/3658357371 >> 172.21.15.170:0/3658357371 conn(0x7f3cc00fbcb0 msgr2=0x7f3cc00fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:24.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.874+0000 7f3cc87ac700 1 -- 172.21.15.170:0/3658357371 shutdown_connections 2024-01-25T15:01:24.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.874+0000 7f3cc87ac700 1 -- 172.21.15.170:0/3658357371 wait complete. 2024-01-25T15:01:24.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc87ac700 1 Processor -- start 2024-01-25T15:01:24.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc87ac700 1 -- start start 2024-01-25T15:01:24.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc87ac700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cc0102340 0x7f3cc0197750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:24.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc87ac700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3cc0104c70 0x7f3cc0197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:24.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc87ac700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cc01075a0 0x7f3cc019ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:24.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc87ac700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc019f2e0 con 0x7f3cc0102340 2024-01-25T15:01:24.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc87ac700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc019f420 con 0x7f3cc0104c70 2024-01-25T15:01:24.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc87ac700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc019f5b0 con 0x7f3cc01075a0 2024-01-25T15:01:24.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc6548700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cc0102340 0x7f3cc0197750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:24.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc6548700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cc0102340 0x7f3cc0197750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54272/0 (socket says 172.21.15.170:54272) 2024-01-25T15:01:24.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc6548700 1 -- 172.21.15.170:0/1051924333 learned_addr learned my addr 172.21.15.170:0/1051924333 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:24.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc6d49700 1 --2- 172.21.15.170:0/1051924333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cc01075a0 0x7f3cc019ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:24.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc5d47700 1 --2- 172.21.15.170:0/1051924333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3cc0104c70 0x7f3cc0197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:24.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc6548700 1 -- 172.21.15.170:0/1051924333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cc01075a0 msgr2=0x7f3cc019ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:24.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc6548700 1 --2- 172.21.15.170:0/1051924333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cc01075a0 0x7f3cc019ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:24.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc6548700 1 -- 172.21.15.170:0/1051924333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3cc0104c70 msgr2=0x7f3cc0197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:24.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc6548700 1 --2- 172.21.15.170:0/1051924333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3cc0104c70 0x7f3cc0197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:24.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc6548700 1 -- 172.21.15.170:0/1051924333 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb00095f0 con 0x7f3cc0102340 2024-01-25T15:01:24.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc6d49700 1 --2- 172.21.15.170:0/1051924333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cc01075a0 0x7f3cc019ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:24.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc6548700 1 --2- 172.21.15.170:0/1051924333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cc0102340 0x7f3cc0197750 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800ba80 tx=0x7f3cb800be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:24.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cbf7fe700 1 -- 172.21.15.170:0/1051924333 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb800ca50 con 0x7f3cc0102340 2024-01-25T15:01:24.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cc87ac700 1 -- 172.21.15.170:0/1051924333 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc019f890 con 0x7f3cc0102340 2024-01-25T15:01:24.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.875+0000 7f3cbf7fe700 1 -- 172.21.15.170:0/1051924333 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3cb800cbb0 con 0x7f3cc0102340 2024-01-25T15:01:24.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.876+0000 7f3cbf7fe700 1 -- 172.21.15.170:0/1051924333 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb80075d0 con 0x7f3cc0102340 2024-01-25T15:01:24.879 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.876+0000 7f3cc87ac700 1 -- 172.21.15.170:0/1051924333 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc019fe60 con 0x7f3cc0102340 2024-01-25T15:01:24.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.877+0000 7f3cc87ac700 1 -- 172.21.15.170:0/1051924333 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc00fd830 con 0x7f3cc0102340 2024-01-25T15:01:24.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.877+0000 7f3cbf7fe700 1 -- 172.21.15.170:0/1051924333 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 17) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f3cb8014440 con 0x7f3cc0102340 2024-01-25T15:01:24.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.878+0000 7f3cbf7fe700 1 --2- 172.21.15.170:0/1051924333 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3ca80a1400 0x7f3ca80a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:24.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.878+0000 7f3cc5d47700 1 --2- 172.21.15.170:0/1051924333 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3ca80a1400 0x7f3ca80a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:24.880 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.878+0000 7f3cbf7fe700 1 -- 172.21.15.170:0/1051924333 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f3cb8006e40 con 0x7f3cc0102340 2024-01-25T15:01:24.881 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.878+0000 7f3cc5d47700 1 --2- 172.21.15.170:0/1051924333 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3ca80a1400 0x7f3ca80a38c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4006fd0 tx=0x7f3cb4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:24.883 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:24.882+0000 7f3cbf7fe700 1 -- 172.21.15.170:0/1051924333 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f3cb80958e0 con 0x7f3cc0102340 2024-01-25T15:01:25.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:25.081+0000 7f3cc87ac700 1 -- 172.21.15.170:0/1051924333 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3cc002d4a0 con 0x7f3ca80a1400 2024-01-25T15:01:25.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:25.095+0000 7f3cbf7fe700 1 -- 172.21.15.170:0/1051924333 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4154 (secure 0 0 0) 0x7f3cc002d4a0 con 0x7f3ca80a1400 2024-01-25T15:01:25.096 INFO:teuthology.orchestra.run.smithi170.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-01-25T15:01:25.096 INFO:teuthology.orchestra.run.smithi170.stdout:mds.a smithi170 running (99s) 15s ago 99s 17.0M - 19.0.0-885-g661946e7 0b5dc47a38d7 7357d6d22f95 2024-01-25T15:01:25.096 INFO:teuthology.orchestra.run.smithi170.stdout:mds.b smithi186 running (96s) 30s ago 96s 19.6M - 19.0.0-885-g661946e7 0b5dc47a38d7 2d011732f152 2024-01-25T15:01:25.096 INFO:teuthology.orchestra.run.smithi170.stdout:mds.c smithi191 running (110s) 30s ago 110s 16.9M - 19.0.0-885-g661946e7 0b5dc47a38d7 08a2e92cf9f4 2024-01-25T15:01:25.096 INFO:teuthology.orchestra.run.smithi170.stdout:mds.d smithi170 running (118s) 15s ago 118s 15.2M - 19.0.0-885-g661946e7 0b5dc47a38d7 2305340b89c4 2024-01-25T15:01:25.096 INFO:teuthology.orchestra.run.smithi170.stdout:mds.e smithi186 running (116s) 30s ago 115s 19.2M - 19.0.0-885-g661946e7 0b5dc47a38d7 116e5f0aed5f 2024-01-25T15:01:25.096 INFO:teuthology.orchestra.run.smithi170.stdout:mds.f smithi191 running (113s) 30s ago 113s 18.0M - 19.0.0-885-g661946e7 0b5dc47a38d7 fb08058e39a4 2024-01-25T15:01:25.096 INFO:teuthology.orchestra.run.smithi170.stdout:mds.g smithi170 running (102s) 15s ago 102s 17.0M - 19.0.0-885-g661946e7 0b5dc47a38d7 4ba03dbf6022 2024-01-25T15:01:25.097 INFO:teuthology.orchestra.run.smithi170.stdout:mds.h smithi186 running (108s) 30s ago 107s 19.2M - 19.0.0-885-g661946e7 0b5dc47a38d7 0b3ecf66302f 2024-01-25T15:01:25.097 INFO:teuthology.orchestra.run.smithi170.stdout:mds.i smithi191 running (105s) 30s ago 104s 25.3M - 19.0.0-885-g661946e7 0b5dc47a38d7 51ab556666d7 2024-01-25T15:01:25.097 INFO:teuthology.orchestra.run.smithi170.stdout:mds.j smithi170 running (2m) 15s ago 2m 12.8M - 19.0.0-885-g661946e7 0b5dc47a38d7 2becd56945cc 2024-01-25T15:01:25.097 INFO:teuthology.orchestra.run.smithi170.stdout:mds.k smithi186 running (2m) 30s ago 2m 19.4M - 19.0.0-885-g661946e7 0b5dc47a38d7 79db010c01ce 2024-01-25T15:01:25.097 INFO:teuthology.orchestra.run.smithi170.stdout:mds.l smithi191 running (2m) 30s ago 2m 16.1M - 19.0.0-885-g661946e7 0b5dc47a38d7 1375f367e3b2 2024-01-25T15:01:25.097 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.x smithi170 *:9283,8765 running (9m) 15s ago 9m 504M - 19.0.0-885-g661946e7 0b5dc47a38d7 2dfaab9a732b 2024-01-25T15:01:25.097 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.y smithi186 *:8443,8765 running (7m) 30s ago 7m 445M - 19.0.0-885-g661946e7 0b5dc47a38d7 12182a542c3e 2024-01-25T15:01:25.097 INFO:teuthology.orchestra.run.smithi170.stdout:mgr.z smithi191 *:8443,8765 running (7m) 30s ago 7m 444M - 19.0.0-885-g661946e7 0b5dc47a38d7 d0dadc34146b 2024-01-25T15:01:25.097 INFO:teuthology.orchestra.run.smithi170.stdout:mon.a smithi170 running (9m) 15s ago 9m 53.9M 2048M 19.0.0-885-g661946e7 0b5dc47a38d7 a97f19dae568 2024-01-25T15:01:25.097 INFO:teuthology.orchestra.run.smithi170.stdout:mon.b smithi186 running (7m) 30s ago 7m 40.2M 2048M 19.0.0-885-g661946e7 0b5dc47a38d7 59459cc2b141 2024-01-25T15:01:25.097 INFO:teuthology.orchestra.run.smithi170.stdout:mon.c smithi191 running (7m) 30s ago 7m 42.4M 2048M 19.0.0-885-g661946e7 0b5dc47a38d7 64aefc2b8f6c 2024-01-25T15:01:25.097 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 smithi170 running (6m) 15s ago 6m 54.9M 4272M 19.0.0-885-g661946e7 0b5dc47a38d7 4a808e0575da 2024-01-25T15:01:25.097 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 smithi186 running (6m) 30s ago 6m 55.8M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 d6d8b78fe6f4 2024-01-25T15:01:25.097 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 smithi191 running (6m) 30s ago 6m 56.8M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 f08add379509 2024-01-25T15:01:25.098 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 smithi170 running (5m) 15s ago 5m 46.8M 4272M 19.0.0-885-g661946e7 0b5dc47a38d7 dbfb28138440 2024-01-25T15:01:25.098 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 smithi186 running (5m) 30s ago 5m 45.6M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 29e732d33db4 2024-01-25T15:01:25.098 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 smithi191 running (4m) 30s ago 4m 54.7M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 31b1667a819e 2024-01-25T15:01:25.098 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 smithi170 running (4m) 15s ago 4m 49.5M 4272M 19.0.0-885-g661946e7 0b5dc47a38d7 5847b060a0b6 2024-01-25T15:01:25.098 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 smithi186 running (4m) 30s ago 4m 56.3M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 3e48d5a47682 2024-01-25T15:01:25.098 INFO:teuthology.orchestra.run.smithi170.stdout:osd.8 smithi191 running (3m) 30s ago 3m 54.5M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 583ac5818637 2024-01-25T15:01:25.098 INFO:teuthology.orchestra.run.smithi170.stdout:osd.9 smithi170 running (3m) 15s ago 3m 45.7M 4272M 19.0.0-885-g661946e7 0b5dc47a38d7 c3156772aff3 2024-01-25T15:01:25.098 INFO:teuthology.orchestra.run.smithi170.stdout:osd.10 smithi186 running (2m) 30s ago 2m 49.4M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 07c46c2749eb 2024-01-25T15:01:25.098 INFO:teuthology.orchestra.run.smithi170.stdout:osd.11 smithi191 running (2m) 30s ago 2m 50.3M 4270M 19.0.0-885-g661946e7 0b5dc47a38d7 f984fb38bf52 2024-01-25T15:01:25.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:25.097+0000 7f3cc87ac700 1 -- 172.21.15.170:0/1051924333 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3ca80a1400 msgr2=0x7f3ca80a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:25.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:25.097+0000 7f3cc87ac700 1 --2- 172.21.15.170:0/1051924333 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3ca80a1400 0x7f3ca80a38c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4006fd0 tx=0x7f3cb4008040 comp rx=0 tx=0).stop 2024-01-25T15:01:25.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:25.097+0000 7f3cc87ac700 1 -- 172.21.15.170:0/1051924333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cc0102340 msgr2=0x7f3cc0197750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:25.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:25.097+0000 7f3cc87ac700 1 --2- 172.21.15.170:0/1051924333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cc0102340 0x7f3cc0197750 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800ba80 tx=0x7f3cb800be40 comp rx=0 tx=0).stop 2024-01-25T15:01:25.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:25.097+0000 7f3cc87ac700 1 -- 172.21.15.170:0/1051924333 shutdown_connections 2024-01-25T15:01:25.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:25.097+0000 7f3cc87ac700 1 --2- 172.21.15.170:0/1051924333 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3ca80a1400 0x7f3ca80a38c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:25.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:25.097+0000 7f3cc87ac700 1 --2- 172.21.15.170:0/1051924333 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3cc01075a0 0x7f3cc019ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:25.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:25.097+0000 7f3cc87ac700 1 --2- 172.21.15.170:0/1051924333 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3cc0102340 0x7f3cc0197750 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:25.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:25.097+0000 7f3cc87ac700 1 --2- 172.21.15.170:0/1051924333 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3cc0104c70 0x7f3cc0197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:25.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:25.097+0000 7f3cc87ac700 1 -- 172.21.15.170:0/1051924333 >> 172.21.15.170:0/1051924333 conn(0x7f3cc00fbcb0 msgr2=0x7f3cc0102be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:25.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:25.097+0000 7f3cc87ac700 1 -- 172.21.15.170:0/1051924333 shutdown_connections 2024-01-25T15:01:25.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:25.097+0000 7f3cc87ac700 1 -- 172.21.15.170:0/1051924333 wait complete. 2024-01-25T15:01:25.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:25 smithi170 ceph-mon[31899]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-01-25T15:01:25.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:25 smithi186 ceph-mon[35697]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-01-25T15:01:25.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:25 smithi191 ceph-mon[36347]: pgmap v331: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-01-25T15:01:25.760 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- bash -c 'ceph orch ls' 2024-01-25T15:01:25.999 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:01:26.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:26 smithi170 ceph-mon[31899]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:26.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:26 smithi186 ceph-mon[35697]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:26.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:26 smithi191 ceph-mon[36347]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:27.461 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:27 smithi170 ceph-mon[31899]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:01:27.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:27 smithi186 ceph-mon[35697]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:01:27.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.681+0000 7f41f0208700 1 -- 172.21.15.170:0/3103556662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41e81022b0 msgr2=0x7f41e8108b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:27.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.681+0000 7f41f0208700 1 --2- 172.21.15.170:0/3103556662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41e81022b0 0x7f41e8108b60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f41e000b0d0 tx=0x7f41e000b3e0 comp rx=0 tx=0).stop 2024-01-25T15:01:27.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.681+0000 7f41f0208700 1 -- 172.21.15.170:0/3103556662 shutdown_connections 2024-01-25T15:01:27.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.681+0000 7f41f0208700 1 --2- 172.21.15.170:0/3103556662 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41e81022b0 0x7f41e8108b60 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:27.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.681+0000 7f41f0208700 1 --2- 172.21.15.170:0/3103556662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41e8100710 0x7f41e8100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:27.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.681+0000 7f41f0208700 1 --2- 172.21.15.170:0/3103556662 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41e8101910 0x7f41e8101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:27.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.681+0000 7f41f0208700 1 -- 172.21.15.170:0/3103556662 >> 172.21.15.170:0/3103556662 conn(0x7f41e80fbcd0 msgr2=0x7f41e80fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:27.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.681+0000 7f41f0208700 1 -- 172.21.15.170:0/3103556662 shutdown_connections 2024-01-25T15:01:27.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.681+0000 7f41f0208700 1 -- 172.21.15.170:0/3103556662 wait complete. 2024-01-25T15:01:27.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.682+0000 7f41f0208700 1 Processor -- start 2024-01-25T15:01:27.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.682+0000 7f41f0208700 1 -- start start 2024-01-25T15:01:27.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.682+0000 7f41f0208700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41e8100710 0x7f41e806aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:27.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.682+0000 7f41f0208700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41e8101910 0x7f41e819c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:27.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.682+0000 7f41f0208700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41e81022b0 0x7f41e819eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:27.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.682+0000 7f41f0208700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e819f2a0 con 0x7f41e81022b0 2024-01-25T15:01:27.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.682+0000 7f41f0208700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e819f410 con 0x7f41e8101910 2024-01-25T15:01:27.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.682+0000 7f41f0208700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e819f5d0 con 0x7f41e8100710 2024-01-25T15:01:27.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.682+0000 7f41ee7a5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41e81022b0 0x7f41e819eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:27.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.682+0000 7f41ee7a5700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41e81022b0 0x7f41e819eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56578/0 (socket says 172.21.15.170:56578) 2024-01-25T15:01:27.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.682+0000 7f41ee7a5700 1 -- 172.21.15.170:0/2688251347 learned_addr learned my addr 172.21.15.170:0/2688251347 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:27.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.682+0000 7f41ed7a3700 1 --2- 172.21.15.170:0/2688251347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41e8101910 0x7f41e819c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:27.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.683+0000 7f41ee7a5700 1 -- 172.21.15.170:0/2688251347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41e8100710 msgr2=0x7f41e806aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:27.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.683+0000 7f41edfa4700 1 --2- 172.21.15.170:0/2688251347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41e8100710 0x7f41e806aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:27.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.683+0000 7f41ee7a5700 1 --2- 172.21.15.170:0/2688251347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41e8100710 0x7f41e806aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:27.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.683+0000 7f41ee7a5700 1 -- 172.21.15.170:0/2688251347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41e8101910 msgr2=0x7f41e819c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:27.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.683+0000 7f41ee7a5700 1 --2- 172.21.15.170:0/2688251347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41e8101910 0x7f41e819c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:27.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.683+0000 7f41ee7a5700 1 -- 172.21.15.170:0/2688251347 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e0009d00 con 0x7f41e81022b0 2024-01-25T15:01:27.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.683+0000 7f41ed7a3700 1 --2- 172.21.15.170:0/2688251347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41e8101910 0x7f41e819c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:27.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.683+0000 7f41ee7a5700 1 --2- 172.21.15.170:0/2688251347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41e81022b0 0x7f41e819eb00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f41e0007bd0 tx=0x7f41e00094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:27.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.683+0000 7f41deffd700 1 -- 172.21.15.170:0/2688251347 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e000e040 con 0x7f41e81022b0 2024-01-25T15:01:27.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.683+0000 7f41deffd700 1 -- 172.21.15.170:0/2688251347 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f41e0012dc0 con 0x7f41e81022b0 2024-01-25T15:01:27.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.683+0000 7f41deffd700 1 -- 172.21.15.170:0/2688251347 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e001b450 con 0x7f41e81022b0 2024-01-25T15:01:27.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.683+0000 7f41f0208700 1 -- 172.21.15.170:0/2688251347 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e819f850 con 0x7f41e81022b0 2024-01-25T15:01:27.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.683+0000 7f41f0208700 1 -- 172.21.15.170:0/2688251347 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e819fd10 con 0x7f41e81022b0 2024-01-25T15:01:27.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.684+0000 7f41f0208700 1 -- 172.21.15.170:0/2688251347 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e8107ad0 con 0x7f41e81022b0 2024-01-25T15:01:27.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.685+0000 7f41deffd700 1 -- 172.21.15.170:0/2688251347 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f41e001d610 con 0x7f41e81022b0 2024-01-25T15:01:27.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.686+0000 7f41deffd700 1 --2- 172.21.15.170:0/2688251347 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f41d40a13f0 0x7f41d40a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:27.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.686+0000 7f41edfa4700 1 --2- 172.21.15.170:0/2688251347 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f41d40a13f0 0x7f41d40a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:27.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.686+0000 7f41deffd700 1 -- 172.21.15.170:0/2688251347 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f41e00ce920 con 0x7f41e81022b0 2024-01-25T15:01:27.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.686+0000 7f41edfa4700 1 --2- 172.21.15.170:0/2688251347 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f41d40a13f0 0x7f41d40a38b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f41e8101770 tx=0x7f41e4005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:27.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.690+0000 7f41deffd700 1 -- 172.21.15.170:0/2688251347 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f41e0097e60 con 0x7f41e81022b0 2024-01-25T15:01:27.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:27 smithi191 ceph-mon[36347]: pgmap v332: 97 pgs: 97 active+clean; 640 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:01:27.893 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.892+0000 7f41f0208700 1 -- 172.21.15.170:0/2688251347 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f41e802d540 con 0x7f41d40a13f0 2024-01-25T15:01:27.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.898+0000 7f41deffd700 1 -- 172.21.15.170:0/2688251347 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f41e802d540 con 0x7f41d40a13f0 2024-01-25T15:01:27.899 INFO:teuthology.orchestra.run.smithi170.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-01-25T15:01:27.899 INFO:teuthology.orchestra.run.smithi170.stdout:mds.all 12/12 33s ago 2m smithi170=a;smithi170=d;smithi170=g;smithi170=j;smithi186=b;smithi186=e;smithi186=h;smithi186=k;smithi191=c;smithi191=f;smithi191=i;smithi191=l;count:12 2024-01-25T15:01:27.899 INFO:teuthology.orchestra.run.smithi170.stdout:mgr 3/3 33s ago 7m smithi170=x;smithi186=y;smithi191=z;count:3 2024-01-25T15:01:27.899 INFO:teuthology.orchestra.run.smithi170.stdout:mon 3/3 33s ago 7m smithi170:172.21.15.170=a;smithi186:172.21.15.186=b;smithi191:172.21.15.191=c;count:3 2024-01-25T15:01:27.899 INFO:teuthology.orchestra.run.smithi170.stdout:osd 12 33s ago - 2024-01-25T15:01:27.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.900+0000 7f41f0208700 1 -- 172.21.15.170:0/2688251347 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f41d40a13f0 msgr2=0x7f41d40a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:27.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.900+0000 7f41f0208700 1 --2- 172.21.15.170:0/2688251347 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f41d40a13f0 0x7f41d40a38b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f41e8101770 tx=0x7f41e4005cf0 comp rx=0 tx=0).stop 2024-01-25T15:01:27.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.900+0000 7f41f0208700 1 -- 172.21.15.170:0/2688251347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41e81022b0 msgr2=0x7f41e819eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:27.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.900+0000 7f41f0208700 1 --2- 172.21.15.170:0/2688251347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41e81022b0 0x7f41e819eb00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f41e0007bd0 tx=0x7f41e00094f0 comp rx=0 tx=0).stop 2024-01-25T15:01:27.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.900+0000 7f41f0208700 1 -- 172.21.15.170:0/2688251347 shutdown_connections 2024-01-25T15:01:27.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.900+0000 7f41f0208700 1 --2- 172.21.15.170:0/2688251347 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f41d40a13f0 0x7f41d40a38b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:27.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.900+0000 7f41f0208700 1 --2- 172.21.15.170:0/2688251347 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41e8100710 0x7f41e806aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:27.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.900+0000 7f41f0208700 1 --2- 172.21.15.170:0/2688251347 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f41e81022b0 0x7f41e819eb00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:27.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.900+0000 7f41f0208700 1 --2- 172.21.15.170:0/2688251347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41e8101910 0x7f41e819c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:27.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.900+0000 7f41f0208700 1 -- 172.21.15.170:0/2688251347 >> 172.21.15.170:0/2688251347 conn(0x7f41e80fbcd0 msgr2=0x7f41e8104c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:27.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.900+0000 7f41f0208700 1 -- 172.21.15.170:0/2688251347 shutdown_connections 2024-01-25T15:01:27.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:27.900+0000 7f41f0208700 1 -- 172.21.15.170:0/2688251347 wait complete. 2024-01-25T15:01:28.553 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:28 smithi170 ceph-mon[31899]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-01-25T15:01:28.579 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- bash -c 'ceph orch host ls' 2024-01-25T15:01:28.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:28 smithi186 ceph-mon[35697]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-01-25T15:01:28.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:28 smithi191 ceph-mon[36347]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-01-25T15:01:28.818 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:01:29.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:29 smithi186 ceph-mon[35697]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:29.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:29 smithi186 ceph-mon[35697]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 341 B/s wr, 11 op/s 2024-01-25T15:01:29.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:29 smithi170 ceph-mon[31899]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:29.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:29 smithi170 ceph-mon[31899]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 341 B/s wr, 11 op/s 2024-01-25T15:01:29.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:29 smithi191 ceph-mon[36347]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:29.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:29 smithi191 ceph-mon[36347]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 341 B/s wr, 11 op/s 2024-01-25T15:01:30.440 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.439+0000 7f65cb02e700 1 -- 172.21.15.170:0/2685794078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c41033b0 msgr2=0x7f65c4109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.439+0000 7f65cb02e700 1 --2- 172.21.15.170:0/2685794078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c41033b0 0x7f65c4109c60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f65bc00b0d0 tx=0x7f65bc00b3e0 comp rx=0 tx=0).stop 2024-01-25T15:01:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.439+0000 7f65cb02e700 1 -- 172.21.15.170:0/2685794078 shutdown_connections 2024-01-25T15:01:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.439+0000 7f65cb02e700 1 --2- 172.21.15.170:0/2685794078 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c41033b0 0x7f65c4109c60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.439+0000 7f65cb02e700 1 --2- 172.21.15.170:0/2685794078 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65c4101810 0x7f65c4101c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.439+0000 7f65cb02e700 1 --2- 172.21.15.170:0/2685794078 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65c4102a10 0x7f65c4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.439+0000 7f65cb02e700 1 -- 172.21.15.170:0/2685794078 >> 172.21.15.170:0/2685794078 conn(0x7f65c40fcdf0 msgr2=0x7f65c40ff210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.440+0000 7f65cb02e700 1 -- 172.21.15.170:0/2685794078 shutdown_connections 2024-01-25T15:01:30.441 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.440+0000 7f65cb02e700 1 -- 172.21.15.170:0/2685794078 wait complete. 2024-01-25T15:01:30.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.440+0000 7f65cb02e700 1 Processor -- start 2024-01-25T15:01:30.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.440+0000 7f65cb02e700 1 -- start start 2024-01-25T15:01:30.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65cb02e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65c4101810 0x7f65c4197730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:30.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65cb02e700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c4102a10 0x7f65c4197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:30.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65cb02e700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65c41033b0 0x7f65c419ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:30.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65cb02e700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c419f2c0 con 0x7f65c4102a10 2024-01-25T15:01:30.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65cb02e700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c419f400 con 0x7f65c4101810 2024-01-25T15:01:30.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65cb02e700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c419f590 con 0x7f65c41033b0 2024-01-25T15:01:30.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65c3fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c4102a10 0x7f65c4197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:30.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65c3fff700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c4102a10 0x7f65c4197c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56590/0 (socket says 172.21.15.170:56590) 2024-01-25T15:01:30.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65c3fff700 1 -- 172.21.15.170:0/2888459276 learned_addr learned my addr 172.21.15.170:0/2888459276 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:30.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65c8dca700 1 --2- 172.21.15.170:0/2888459276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65c4101810 0x7f65c4197730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:30.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65c95cb700 1 --2- 172.21.15.170:0/2888459276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65c41033b0 0x7f65c419ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:30.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65c3fff700 1 -- 172.21.15.170:0/2888459276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65c41033b0 msgr2=0x7f65c419ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:30.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65c3fff700 1 --2- 172.21.15.170:0/2888459276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65c41033b0 0x7f65c419ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:30.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65c3fff700 1 -- 172.21.15.170:0/2888459276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65c4101810 msgr2=0x7f65c4197730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:30.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65c3fff700 1 --2- 172.21.15.170:0/2888459276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65c4101810 0x7f65c4197730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:30.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65c3fff700 1 -- 172.21.15.170:0/2888459276 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc009d00 con 0x7f65c4102a10 2024-01-25T15:01:30.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65c3fff700 1 --2- 172.21.15.170:0/2888459276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c4102a10 0x7f65c4197c70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f65b000c950 tx=0x7f65b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:30.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65c1ffb700 1 -- 172.21.15.170:0/2888459276 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b00078d0 con 0x7f65c4102a10 2024-01-25T15:01:30.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65c1ffb700 1 -- 172.21.15.170:0/2888459276 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65b000f450 con 0x7f65c4102a10 2024-01-25T15:01:30.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.441+0000 7f65cb02e700 1 -- 172.21.15.170:0/2888459276 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c4073a70 con 0x7f65c4102a10 2024-01-25T15:01:30.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.442+0000 7f65c1ffb700 1 -- 172.21.15.170:0/2888459276 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0018660 con 0x7f65c4102a10 2024-01-25T15:01:30.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.442+0000 7f65cb02e700 1 -- 172.21.15.170:0/2888459276 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c4073f70 con 0x7f65c4102a10 2024-01-25T15:01:30.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.443+0000 7f65cb02e700 1 -- 172.21.15.170:0/2888459276 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c4108bd0 con 0x7f65c4102a10 2024-01-25T15:01:30.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.444+0000 7f65c1ffb700 1 -- 172.21.15.170:0/2888459276 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f65b0007a30 con 0x7f65c4102a10 2024-01-25T15:01:30.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.444+0000 7f65c1ffb700 1 --2- 172.21.15.170:0/2888459276 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65b40a1370 0x7f65b40a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:30.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.444+0000 7f65c8dca700 1 --2- 172.21.15.170:0/2888459276 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65b40a1370 0x7f65b40a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:30.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.444+0000 7f65c1ffb700 1 -- 172.21.15.170:0/2888459276 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f65b00cc8f0 con 0x7f65c4102a10 2024-01-25T15:01:30.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.445+0000 7f65c8dca700 1 --2- 172.21.15.170:0/2888459276 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65b40a1370 0x7f65b40a3830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f65c4102870 tx=0x7f65b800a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:30.449 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.449+0000 7f65c1ffb700 1 -- 172.21.15.170:0/2888459276 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f65b0095da0 con 0x7f65c4102a10 2024-01-25T15:01:30.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.647+0000 7f65cb02e700 1 -- 172.21.15.170:0/2888459276 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f65c402d540 con 0x7f65b40a1370 2024-01-25T15:01:30.649 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.648+0000 7f65c1ffb700 1 -- 172.21.15.170:0/2888459276 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f65c402d540 con 0x7f65b40a1370 2024-01-25T15:01:30.649 INFO:teuthology.orchestra.run.smithi170.stdout:HOST ADDR LABELS STATUS 2024-01-25T15:01:30.649 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170 172.21.15.170 2024-01-25T15:01:30.649 INFO:teuthology.orchestra.run.smithi170.stdout:smithi186 172.21.15.186 2024-01-25T15:01:30.649 INFO:teuthology.orchestra.run.smithi170.stdout:smithi191 172.21.15.191 2024-01-25T15:01:30.649 INFO:teuthology.orchestra.run.smithi170.stdout:3 hosts in cluster 2024-01-25T15:01:30.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.650+0000 7f65cb02e700 1 -- 172.21.15.170:0/2888459276 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65b40a1370 msgr2=0x7f65b40a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:30.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.650+0000 7f65cb02e700 1 --2- 172.21.15.170:0/2888459276 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65b40a1370 0x7f65b40a3830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f65c4102870 tx=0x7f65b800a3b0 comp rx=0 tx=0).stop 2024-01-25T15:01:30.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.650+0000 7f65cb02e700 1 -- 172.21.15.170:0/2888459276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c4102a10 msgr2=0x7f65c4197c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:30.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.650+0000 7f65cb02e700 1 --2- 172.21.15.170:0/2888459276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c4102a10 0x7f65c4197c70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f65b000c950 tx=0x7f65b000cc60 comp rx=0 tx=0).stop 2024-01-25T15:01:30.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.651+0000 7f65cb02e700 1 -- 172.21.15.170:0/2888459276 shutdown_connections 2024-01-25T15:01:30.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.651+0000 7f65cb02e700 1 --2- 172.21.15.170:0/2888459276 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65b40a1370 0x7f65b40a3830 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:30.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.651+0000 7f65cb02e700 1 --2- 172.21.15.170:0/2888459276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65c41033b0 0x7f65c419ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:30.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.651+0000 7f65cb02e700 1 --2- 172.21.15.170:0/2888459276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65c4101810 0x7f65c4197730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:30.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.651+0000 7f65cb02e700 1 --2- 172.21.15.170:0/2888459276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c4102a10 0x7f65c4197c70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:30.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.651+0000 7f65cb02e700 1 -- 172.21.15.170:0/2888459276 >> 172.21.15.170:0/2888459276 conn(0x7f65c40fcdf0 msgr2=0x7f65c4105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:30.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.651+0000 7f65cb02e700 1 -- 172.21.15.170:0/2888459276 shutdown_connections 2024-01-25T15:01:30.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:30.651+0000 7f65cb02e700 1 -- 172.21.15.170:0/2888459276 wait complete. 2024-01-25T15:01:31.373 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- bash -c 'ceph orch device ls' 2024-01-25T15:01:31.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:31 smithi186 ceph-mon[35697]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-01-25T15:01:31.615 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:01:31.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:31 smithi170 ceph-mon[31899]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-01-25T15:01:31.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:31 smithi191 ceph-mon[36347]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-01-25T15:01:32.367 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:32 smithi170 ceph-mon[31899]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:32.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:32 smithi186 ceph-mon[35697]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:32.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:32 smithi191 ceph-mon[36347]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.188+0000 7f0bf0502700 1 -- 172.21.15.170:0/388363436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0be8100710 msgr2=0x7f0be8100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.188+0000 7f0bf0502700 1 --2- 172.21.15.170:0/388363436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0be8100710 0x7f0be8100b30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80099c0 tx=0x7f0bd8009cd0 comp rx=0 tx=0).stop 2024-01-25T15:01:33.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.188+0000 7f0bf0502700 1 -- 172.21.15.170:0/388363436 shutdown_connections 2024-01-25T15:01:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.188+0000 7f0bf0502700 1 --2- 172.21.15.170:0/388363436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0be81022b0 0x7f0be8108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.188+0000 7f0bf0502700 1 --2- 172.21.15.170:0/388363436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0be8100710 0x7f0be8100b30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.188+0000 7f0bf0502700 1 --2- 172.21.15.170:0/388363436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0be8101910 0x7f0be8101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.188+0000 7f0bf0502700 1 -- 172.21.15.170:0/388363436 >> 172.21.15.170:0/388363436 conn(0x7f0be80fbcd0 msgr2=0x7f0be80fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.188+0000 7f0bf0502700 1 -- 172.21.15.170:0/388363436 shutdown_connections 2024-01-25T15:01:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.188+0000 7f0bf0502700 1 -- 172.21.15.170:0/388363436 wait complete. 2024-01-25T15:01:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0bf0502700 1 Processor -- start 2024-01-25T15:01:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0bf0502700 1 -- start start 2024-01-25T15:01:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0bf0502700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0be8100710 0x7f0be81977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0bf0502700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0be8101910 0x7f0be8197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0bf0502700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0be81022b0 0x7f0be819ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0bf0502700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be819f360 con 0x7f0be8101910 2024-01-25T15:01:33.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0bf0502700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be819f4a0 con 0x7f0be81022b0 2024-01-25T15:01:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0bf0502700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be819f630 con 0x7f0be8100710 2024-01-25T15:01:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0beda9d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0be8101910 0x7f0be8197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0beda9d700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0be8101910 0x7f0be8197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56596/0 (socket says 172.21.15.170:56596) 2024-01-25T15:01:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0beda9d700 1 -- 172.21.15.170:0/246343541 learned_addr learned my addr 172.21.15.170:0/246343541 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0beea9f700 1 --2- 172.21.15.170:0/246343541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0be81022b0 0x7f0be819ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0bee29e700 1 --2- 172.21.15.170:0/246343541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0be8100710 0x7f0be81977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0beda9d700 1 -- 172.21.15.170:0/246343541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0be8100710 msgr2=0x7f0be81977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0beda9d700 1 --2- 172.21.15.170:0/246343541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0be8100710 0x7f0be81977d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0beda9d700 1 -- 172.21.15.170:0/246343541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0be81022b0 msgr2=0x7f0be819ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0beda9d700 1 --2- 172.21.15.170:0/246343541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0be81022b0 0x7f0be819ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.189+0000 7f0beda9d700 1 -- 172.21.15.170:0/246343541 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd80095f0 con 0x7f0be8101910 2024-01-25T15:01:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.190+0000 7f0beda9d700 1 --2- 172.21.15.170:0/246343541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0be8101910 0x7f0be8197d10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0be400b560 tx=0x7f0be400b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:33.193 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.190+0000 7f0bdf7fe700 1 -- 172.21.15.170:0/246343541 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4011830 con 0x7f0be8101910 2024-01-25T15:01:33.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.190+0000 7f0bdf7fe700 1 -- 172.21.15.170:0/246343541 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0be4011e50 con 0x7f0be8101910 2024-01-25T15:01:33.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.190+0000 7f0bdf7fe700 1 -- 172.21.15.170:0/246343541 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be400f2e0 con 0x7f0be8101910 2024-01-25T15:01:33.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.190+0000 7f0bf0502700 1 -- 172.21.15.170:0/246343541 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be819f910 con 0x7f0be8101910 2024-01-25T15:01:33.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.190+0000 7f0bf0502700 1 -- 172.21.15.170:0/246343541 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be819fee0 con 0x7f0be8101910 2024-01-25T15:01:33.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.191+0000 7f0bf0502700 1 -- 172.21.15.170:0/246343541 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be80684a0 con 0x7f0be8101910 2024-01-25T15:01:33.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.192+0000 7f0bdf7fe700 1 -- 172.21.15.170:0/246343541 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f0be4011990 con 0x7f0be8101910 2024-01-25T15:01:33.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.192+0000 7f0bdf7fe700 1 --2- 172.21.15.170:0/246343541 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0bd40a13f0 0x7f0bd40a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:33.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.192+0000 7f0bee29e700 1 --2- 172.21.15.170:0/246343541 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0bd40a13f0 0x7f0bd40a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:33.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.192+0000 7f0bdf7fe700 1 -- 172.21.15.170:0/246343541 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f0be40cc5f0 con 0x7f0be8101910 2024-01-25T15:01:33.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.193+0000 7f0bee29e700 1 --2- 172.21.15.170:0/246343541 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0bd40a13f0 0x7f0bd40a38b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8003820 tx=0x7f0bd8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:33.197 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.197+0000 7f0bdf7fe700 1 -- 172.21.15.170:0/246343541 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f0be4095aa0 con 0x7f0be8101910 2024-01-25T15:01:33.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.398+0000 7f0bf0502700 1 -- 172.21.15.170:0/246343541 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0be806a660 con 0x7f0bd40a13f0 2024-01-25T15:01:33.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.400+0000 7f0bdf7fe700 1 -- 172.21.15.170:0/246343541 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f0be806a660 con 0x7f0bd40a13f0 2024-01-25T15:01:33.401 INFO:teuthology.orchestra.run.smithi170.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-01-25T15:01:33.401 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476002R480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-01-25T15:01:33.401 INFO:teuthology.orchestra.run.smithi170.stdout:smithi186 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300CB400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-01-25T15:01:33.401 INFO:teuthology.orchestra.run.smithi170.stdout:smithi191 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303008M400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-01-25T15:01:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.402+0000 7f0bf0502700 1 -- 172.21.15.170:0/246343541 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0bd40a13f0 msgr2=0x7f0bd40a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.402+0000 7f0bf0502700 1 --2- 172.21.15.170:0/246343541 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0bd40a13f0 0x7f0bd40a38b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8003820 tx=0x7f0bd8000bc0 comp rx=0 tx=0).stop 2024-01-25T15:01:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.402+0000 7f0bf0502700 1 -- 172.21.15.170:0/246343541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0be8101910 msgr2=0x7f0be8197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:33.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.402+0000 7f0bf0502700 1 --2- 172.21.15.170:0/246343541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0be8101910 0x7f0be8197d10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0be400b560 tx=0x7f0be400b920 comp rx=0 tx=0).stop 2024-01-25T15:01:33.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.402+0000 7f0bf0502700 1 -- 172.21.15.170:0/246343541 shutdown_connections 2024-01-25T15:01:33.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.402+0000 7f0bf0502700 1 --2- 172.21.15.170:0/246343541 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0bd40a13f0 0x7f0bd40a38b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:33.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.402+0000 7f0bf0502700 1 --2- 172.21.15.170:0/246343541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0be8100710 0x7f0be81977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:33.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.402+0000 7f0bf0502700 1 --2- 172.21.15.170:0/246343541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0be81022b0 0x7f0be819ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:33.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.402+0000 7f0bf0502700 1 --2- 172.21.15.170:0/246343541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0be8101910 0x7f0be8197d10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:33.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.402+0000 7f0bf0502700 1 -- 172.21.15.170:0/246343541 >> 172.21.15.170:0/246343541 conn(0x7f0be80fbcd0 msgr2=0x7f0be8069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:33.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.402+0000 7f0bf0502700 1 -- 172.21.15.170:0/246343541 shutdown_connections 2024-01-25T15:01:33.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:33.402+0000 7f0bf0502700 1 -- 172.21.15.170:0/246343541 wait complete. 2024-01-25T15:01:33.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:33 smithi186 ceph-mon[35697]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-01-25T15:01:33.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:33 smithi170 ceph-mon[31899]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-01-25T15:01:33.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:33 smithi191 ceph-mon[36347]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-01-25T15:01:34.119 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-01-25T15:01:34.129 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi170.front.sepia.ceph.com 2024-01-25T15:01:34.129 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- bash -c 'ceph fs dump' 2024-01-25T15:01:34.372 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:01:35.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:35 smithi186 ceph-mon[35697]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:35.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:35 smithi186 ceph-mon[35697]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-25T15:01:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:35 smithi170 ceph-mon[31899]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:35.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:35 smithi170 ceph-mon[31899]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-25T15:01:35.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:35 smithi191 ceph-mon[36347]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:35.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:35 smithi191 ceph-mon[36347]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-25T15:01:36.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.086+0000 7f23eb343700 1 -- 172.21.15.170:0/867400583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e4101900 msgr2=0x7f23e4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:36.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.086+0000 7f23eb343700 1 --2- 172.21.15.170:0/867400583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e4101900 0x7f23e4101d60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f23d40099c0 tx=0x7f23d4009cd0 comp rx=0 tx=0).stop 2024-01-25T15:01:36.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.086+0000 7f23eb343700 1 -- 172.21.15.170:0/867400583 shutdown_connections 2024-01-25T15:01:36.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.086+0000 7f23eb343700 1 --2- 172.21.15.170:0/867400583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e41022a0 0x7f23e4108b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:36.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.086+0000 7f23eb343700 1 --2- 172.21.15.170:0/867400583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23e4100700 0x7f23e4100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:36.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.086+0000 7f23eb343700 1 --2- 172.21.15.170:0/867400583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e4101900 0x7f23e4101d60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:36.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.086+0000 7f23eb343700 1 -- 172.21.15.170:0/867400583 >> 172.21.15.170:0/867400583 conn(0x7f23e40fbcc0 msgr2=0x7f23e40fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:36.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.086+0000 7f23eb343700 1 -- 172.21.15.170:0/867400583 shutdown_connections 2024-01-25T15:01:36.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.086+0000 7f23eb343700 1 -- 172.21.15.170:0/867400583 wait complete. 2024-01-25T15:01:36.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23eb343700 1 Processor -- start 2024-01-25T15:01:36.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23eb343700 1 -- start start 2024-01-25T15:01:36.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23eb343700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e4100700 0x7f23e406ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:36.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23eb343700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e4101900 0x7f23e419c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:36.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23eb343700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23e41022a0 0x7f23e419e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:36.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23eb343700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e419f140 con 0x7f23e4101900 2024-01-25T15:01:36.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23eb343700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e419f2b0 con 0x7f23e41022a0 2024-01-25T15:01:36.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23eb343700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e419f470 con 0x7f23e4100700 2024-01-25T15:01:36.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23e88de700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e4101900 0x7f23e419c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:36.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23e88de700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e4101900 0x7f23e419c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:32872/0 (socket says 172.21.15.170:32872) 2024-01-25T15:01:36.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23e88de700 1 -- 172.21.15.170:0/503089587 learned_addr learned my addr 172.21.15.170:0/503089587 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:36.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23e98e0700 1 --2- 172.21.15.170:0/503089587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23e41022a0 0x7f23e419e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:36.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23e88de700 1 -- 172.21.15.170:0/503089587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e4100700 msgr2=0x7f23e406ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:36.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23e88de700 1 --2- 172.21.15.170:0/503089587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e4100700 0x7f23e406ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:36.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23e88de700 1 -- 172.21.15.170:0/503089587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23e41022a0 msgr2=0x7f23e419e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:36.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23e88de700 1 --2- 172.21.15.170:0/503089587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23e41022a0 0x7f23e419e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:36.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23e88de700 1 -- 172.21.15.170:0/503089587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d40095f0 con 0x7f23e4101900 2024-01-25T15:01:36.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.087+0000 7f23e88de700 1 --2- 172.21.15.170:0/503089587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e4101900 0x7f23e419c350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f23d400b580 tx=0x7f23d4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:36.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.088+0000 7f23da7fc700 1 -- 172.21.15.170:0/503089587 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d401d070 con 0x7f23e4101900 2024-01-25T15:01:36.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.088+0000 7f23eb343700 1 -- 172.21.15.170:0/503089587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e419f6f0 con 0x7f23e4101900 2024-01-25T15:01:36.097 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.088+0000 7f23da7fc700 1 -- 172.21.15.170:0/503089587 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23d4004110 con 0x7f23e4101900 2024-01-25T15:01:36.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.088+0000 7f23da7fc700 1 -- 172.21.15.170:0/503089587 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d4022e10 con 0x7f23e4101900 2024-01-25T15:01:36.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.088+0000 7f23eb343700 1 -- 172.21.15.170:0/503089587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e419fbe0 con 0x7f23e4101900 2024-01-25T15:01:36.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.089+0000 7f23eb343700 1 -- 172.21.15.170:0/503089587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e4107ac0 con 0x7f23e4101900 2024-01-25T15:01:36.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.090+0000 7f23da7fc700 1 -- 172.21.15.170:0/503089587 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f23d4022500 con 0x7f23e4101900 2024-01-25T15:01:36.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.090+0000 7f23da7fc700 1 --2- 172.21.15.170:0/503089587 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f23d00a1370 0x7f23d00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:36.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.090+0000 7f23e90df700 1 --2- 172.21.15.170:0/503089587 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f23d00a1370 0x7f23d00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:36.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.090+0000 7f23da7fc700 1 -- 172.21.15.170:0/503089587 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f23d40cde20 con 0x7f23e4101900 2024-01-25T15:01:36.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.091+0000 7f23e90df700 1 --2- 172.21.15.170:0/503089587 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f23d00a1370 0x7f23d00a3830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f23e4101760 tx=0x7f23e0009470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:36.098 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.095+0000 7f23da7fc700 1 -- 172.21.15.170:0/503089587 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f23d4097360 con 0x7f23e4101900 2024-01-25T15:01:36.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.332+0000 7f23eb343700 1 -- 172.21.15.170:0/503089587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f23e40684a0 con 0x7f23e4101900 2024-01-25T15:01:36.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.333+0000 7f23da7fc700 1 -- 172.21.15.170:0/503089587 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) v1 ==== 76+0+2983 (secure 0 0 0) 0x7f23d4027bc0 con 0x7f23e4101900 2024-01-25T15:01:36.334 INFO:teuthology.orchestra.run.smithi170.stdout:e25 2024-01-25T15:01:36.334 INFO:teuthology.orchestra.run.smithi170.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-01-25T15:01:36.334 INFO:teuthology.orchestra.run.smithi170.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-01-25T15:01:36.334 INFO:teuthology.orchestra.run.smithi170.stdout:legacy client fscid: 1 2024-01-25T15:01:36.334 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:36.334 INFO:teuthology.orchestra.run.smithi170.stdout:Filesystem 'cephfs' (1) 2024-01-25T15:01:36.334 INFO:teuthology.orchestra.run.smithi170.stdout:fs_name cephfs 2024-01-25T15:01:36.334 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 25 2024-01-25T15:01:36.335 INFO:teuthology.orchestra.run.smithi170.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-01-25T15:01:36.335 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-01-25T14:59:53.534085+0000 2024-01-25T15:01:36.335 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-01-25T15:00:00.045800+0000 2024-01-25T15:01:36.335 INFO:teuthology.orchestra.run.smithi170.stdout:tableserver 0 2024-01-25T15:01:36.335 INFO:teuthology.orchestra.run.smithi170.stdout:root 0 2024-01-25T15:01:36.335 INFO:teuthology.orchestra.run.smithi170.stdout:session_timeout 300 2024-01-25T15:01:36.335 INFO:teuthology.orchestra.run.smithi170.stdout:session_autoclose 300 2024-01-25T15:01:36.335 INFO:teuthology.orchestra.run.smithi170.stdout:max_file_size 1099511627776 2024-01-25T15:01:36.335 INFO:teuthology.orchestra.run.smithi170.stdout:max_xattr_size 65536 2024-01-25T15:01:36.335 INFO:teuthology.orchestra.run.smithi170.stdout:required_client_features {} 2024-01-25T15:01:36.335 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure 0 2024-01-25T15:01:36.335 INFO:teuthology.orchestra.run.smithi170.stdout:last_failure_osd_epoch 0 2024-01-25T15:01:36.335 INFO:teuthology.orchestra.run.smithi170.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-01-25T15:01:36.335 INFO:teuthology.orchestra.run.smithi170.stdout:max_mds 5 2024-01-25T15:01:36.335 INFO:teuthology.orchestra.run.smithi170.stdout:in 0,1,2,3,4 2024-01-25T15:01:36.336 INFO:teuthology.orchestra.run.smithi170.stdout:up {0=24484,1=24479,2=24466,3=24418,4=24398} 2024-01-25T15:01:36.336 INFO:teuthology.orchestra.run.smithi170.stdout:failed 2024-01-25T15:01:36.336 INFO:teuthology.orchestra.run.smithi170.stdout:damaged 2024-01-25T15:01:36.336 INFO:teuthology.orchestra.run.smithi170.stdout:stopped 2024-01-25T15:01:36.336 INFO:teuthology.orchestra.run.smithi170.stdout:data_pools [3] 2024-01-25T15:01:36.336 INFO:teuthology.orchestra.run.smithi170.stdout:metadata_pool 2 2024-01-25T15:01:36.336 INFO:teuthology.orchestra.run.smithi170.stdout:inline_data disabled 2024-01-25T15:01:36.336 INFO:teuthology.orchestra.run.smithi170.stdout:balancer 2024-01-25T15:01:36.336 INFO:teuthology.orchestra.run.smithi170.stdout:bal_rank_mask -1 2024-01-25T15:01:36.336 INFO:teuthology.orchestra.run.smithi170.stdout:standby_count_wanted 0 2024-01-25T15:01:36.336 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.i{0:24484} state up:active seq 5 addr [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] compat {c=[1],r=[1],i=[fff]}] 2024-01-25T15:01:36.336 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.f{0:24457} state up:standby-replay seq 1 addr [v2:172.21.15.191:6834/1870775954,v1:172.21.15.191:6835/1870775954] compat {c=[1],r=[1],i=[fff]}] 2024-01-25T15:01:36.336 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.b{1:24479} state up:active seq 3 addr [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] compat {c=[1],r=[1],i=[fff]}] 2024-01-25T15:01:36.337 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.h{1:24449} state up:standby-replay seq 1 addr [v2:172.21.15.186:6836/2382645540,v1:172.21.15.186:6837/2382645540] compat {c=[1],r=[1],i=[fff]}] 2024-01-25T15:01:36.337 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.c{2:24466} state up:active seq 7 addr [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] compat {c=[1],r=[1],i=[fff]}] 2024-01-25T15:01:36.337 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.e{2:24428} state up:standby-replay seq 1 addr [v2:172.21.15.186:6834/2663522449,v1:172.21.15.186:6835/2663522449] compat {c=[1],r=[1],i=[fff]}] 2024-01-25T15:01:36.337 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.l{3:24418} state up:active seq 11 addr [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] compat {c=[1],r=[1],i=[fff]}] 2024-01-25T15:01:36.337 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.a{3:14628} state up:standby-replay seq 1 addr [v2:172.21.15.170:6840/2918388059,v1:172.21.15.170:6841/2918388059] compat {c=[1],r=[1],i=[fff]}] 2024-01-25T15:01:36.337 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.k{4:24398} state up:active seq 11 addr [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] compat {c=[1],r=[1],i=[fff]}] 2024-01-25T15:01:36.337 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.g{4:14616} state up:standby-replay seq 1 addr [v2:172.21.15.170:6838/3528948477,v1:172.21.15.170:6839/3528948477] compat {c=[1],r=[1],i=[fff]}] 2024-01-25T15:01:36.337 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:36.337 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:36.337 INFO:teuthology.orchestra.run.smithi170.stdout:Standby daemons: 2024-01-25T15:01:36.337 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:36.337 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.j{-1:14547} state up:standby seq 1 addr [v2:172.21.15.170:6834/1911625476,v1:172.21.15.170:6835/1911625476] compat {c=[1],r=[1],i=[fff]}] 2024-01-25T15:01:36.337 INFO:teuthology.orchestra.run.smithi170.stdout:[mds.d{-1:14559} state up:standby seq 1 addr [v2:172.21.15.170:6836/4204528099,v1:172.21.15.170:6837/4204528099] compat {c=[1],r=[1],i=[fff]}] 2024-01-25T15:01:36.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.335+0000 7f23eb343700 1 -- 172.21.15.170:0/503089587 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f23d00a1370 msgr2=0x7f23d00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:36.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.335+0000 7f23eb343700 1 --2- 172.21.15.170:0/503089587 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f23d00a1370 0x7f23d00a3830 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f23e4101760 tx=0x7f23e0009470 comp rx=0 tx=0).stop 2024-01-25T15:01:36.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.335+0000 7f23eb343700 1 -- 172.21.15.170:0/503089587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e4101900 msgr2=0x7f23e419c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:36.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.335+0000 7f23eb343700 1 --2- 172.21.15.170:0/503089587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e4101900 0x7f23e419c350 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f23d400b580 tx=0x7f23d4009580 comp rx=0 tx=0).stop 2024-01-25T15:01:36.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.335+0000 7f23eb343700 1 -- 172.21.15.170:0/503089587 shutdown_connections 2024-01-25T15:01:36.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.335+0000 7f23eb343700 1 --2- 172.21.15.170:0/503089587 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f23d00a1370 0x7f23d00a3830 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:36.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.335+0000 7f23eb343700 1 --2- 172.21.15.170:0/503089587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23e4100700 0x7f23e406ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:36.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.335+0000 7f23eb343700 1 --2- 172.21.15.170:0/503089587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23e41022a0 0x7f23e419e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:36.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.335+0000 7f23eb343700 1 --2- 172.21.15.170:0/503089587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23e4101900 0x7f23e419c350 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:36.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.335+0000 7f23eb343700 1 -- 172.21.15.170:0/503089587 >> 172.21.15.170:0/503089587 conn(0x7f23e40fbcc0 msgr2=0x7f23e4104c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:36.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.335+0000 7f23eb343700 1 -- 172.21.15.170:0/503089587 shutdown_connections 2024-01-25T15:01:36.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:36.335+0000 7f23eb343700 1 -- 172.21.15.170:0/503089587 wait complete. 2024-01-25T15:01:36.339 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-01-25T15:01:37.005 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- bash -c 'ceph osd dump' 2024-01-25T15:01:37.249 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:01:37.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:37 smithi186 ceph-mon[35697]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-01-25T15:01:37.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:37 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/503089587' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-01-25T15:01:37.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:37 smithi170 ceph-mon[31899]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-01-25T15:01:37.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:37 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/503089587' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-01-25T15:01:37.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:37 smithi191 ceph-mon[36347]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-01-25T15:01:37.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:37 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/503089587' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-01-25T15:01:38.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.960+0000 7f9f23076700 1 -- 172.21.15.170:0/3595646183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f1c100710 msgr2=0x7f9f1c100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:38.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.960+0000 7f9f23076700 1 --2- 172.21.15.170:0/3595646183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f1c100710 0x7f9f1c100b30 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400b0d0 tx=0x7f9f1400b3e0 comp rx=0 tx=0).stop 2024-01-25T15:01:38.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.960+0000 7f9f23076700 1 -- 172.21.15.170:0/3595646183 shutdown_connections 2024-01-25T15:01:38.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.960+0000 7f9f23076700 1 --2- 172.21.15.170:0/3595646183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f1c1022b0 0x7f9f1c108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:38.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.960+0000 7f9f23076700 1 --2- 172.21.15.170:0/3595646183 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f1c100710 0x7f9f1c100b30 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:38.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.960+0000 7f9f23076700 1 --2- 172.21.15.170:0/3595646183 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f1c101910 0x7f9f1c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:38.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.960+0000 7f9f23076700 1 -- 172.21.15.170:0/3595646183 >> 172.21.15.170:0/3595646183 conn(0x7f9f1c0fbcb0 msgr2=0x7f9f1c0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:38.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.960+0000 7f9f23076700 1 -- 172.21.15.170:0/3595646183 shutdown_connections 2024-01-25T15:01:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.960+0000 7f9f23076700 1 -- 172.21.15.170:0/3595646183 wait complete. 2024-01-25T15:01:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f23076700 1 Processor -- start 2024-01-25T15:01:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f23076700 1 -- start start 2024-01-25T15:01:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f23076700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f1c100710 0x7f9f1c199b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f23076700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f1c101910 0x7f9f1c19a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f23076700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f1c1022b0 0x7f9f1c1a10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f23076700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c1a1680 con 0x7f9f1c100710 2024-01-25T15:01:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f23076700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c1a17c0 con 0x7f9f1c101910 2024-01-25T15:01:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f23076700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1c1a1950 con 0x7f9f1c1022b0 2024-01-25T15:01:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f20e12700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f1c100710 0x7f9f1c199b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f20e12700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f1c100710 0x7f9f1c199b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:32894/0 (socket says 172.21.15.170:32894) 2024-01-25T15:01:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f20e12700 1 -- 172.21.15.170:0/4078394417 learned_addr learned my addr 172.21.15.170:0/4078394417 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f1bfff700 1 --2- 172.21.15.170:0/4078394417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f1c101910 0x7f9f1c19a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:38.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f21613700 1 --2- 172.21.15.170:0/4078394417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f1c1022b0 0x7f9f1c1a10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:38.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f20e12700 1 -- 172.21.15.170:0/4078394417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f1c1022b0 msgr2=0x7f9f1c1a10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:38.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f20e12700 1 --2- 172.21.15.170:0/4078394417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f1c1022b0 0x7f9f1c1a10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:38.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f20e12700 1 -- 172.21.15.170:0/4078394417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f1c101910 msgr2=0x7f9f1c19a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:38.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f20e12700 1 --2- 172.21.15.170:0/4078394417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f1c101910 0x7f9f1c19a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:38.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f20e12700 1 -- 172.21.15.170:0/4078394417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f14009d00 con 0x7f9f1c100710 2024-01-25T15:01:38.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f21613700 1 --2- 172.21.15.170:0/4078394417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f1c1022b0 0x7f9f1c1a10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:38.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f20e12700 1 --2- 172.21.15.170:0/4078394417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f1c100710 0x7f9f1c199b40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400d010 tx=0x7f9f14009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:38.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.961+0000 7f9f19ffb700 1 -- 172.21.15.170:0/4078394417 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1400e040 con 0x7f9f1c100710 2024-01-25T15:01:38.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.962+0000 7f9f23076700 1 -- 172.21.15.170:0/4078394417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f1c1a1bd0 con 0x7f9f1c100710 2024-01-25T15:01:38.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.962+0000 7f9f19ffb700 1 -- 172.21.15.170:0/4078394417 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f14003e10 con 0x7f9f1c100710 2024-01-25T15:01:38.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.962+0000 7f9f19ffb700 1 -- 172.21.15.170:0/4078394417 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1401d930 con 0x7f9f1c100710 2024-01-25T15:01:38.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.962+0000 7f9f23076700 1 -- 172.21.15.170:0/4078394417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1c1a2040 con 0x7f9f1c100710 2024-01-25T15:01:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.963+0000 7f9f23076700 1 -- 172.21.15.170:0/4078394417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1c0684d0 con 0x7f9f1c100710 2024-01-25T15:01:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.964+0000 7f9f19ffb700 1 -- 172.21.15.170:0/4078394417 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f9f14005630 con 0x7f9f1c100710 2024-01-25T15:01:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.965+0000 7f9f19ffb700 1 --2- 172.21.15.170:0/4078394417 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9f080a1370 0x7f9f080a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:38.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.965+0000 7f9f1bfff700 1 --2- 172.21.15.170:0/4078394417 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9f080a1370 0x7f9f080a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:38.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.965+0000 7f9f19ffb700 1 -- 172.21.15.170:0/4078394417 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f9f140cdee0 con 0x7f9f1c100710 2024-01-25T15:01:38.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.965+0000 7f9f1bfff700 1 --2- 172.21.15.170:0/4078394417 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9f080a1370 0x7f9f080a3830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009a10 tx=0x7f9f04009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:38.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:38.969+0000 7f9f19ffb700 1 -- 172.21.15.170:0/4078394417 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f9f140974b0 con 0x7f9f1c100710 2024-01-25T15:01:39.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:39.164+0000 7f9f23076700 1 -- 172.21.15.170:0/4078394417 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f9f1c10c1e0 con 0x7f9f1c100710 2024-01-25T15:01:39.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:39.165+0000 7f9f19ffb700 1 -- 172.21.15.170:0/4078394417 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v87) v1 ==== 56+0+5277 (secure 0 0 0) 0x7f9f1409aad0 con 0x7f9f1c100710 2024-01-25T15:01:39.166 INFO:teuthology.orchestra.run.smithi170.stdout:epoch 87 2024-01-25T15:01:39.166 INFO:teuthology.orchestra.run.smithi170.stdout:fsid 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T15:01:39.166 INFO:teuthology.orchestra.run.smithi170.stdout:created 2024-01-25T14:51:53.335110+0000 2024-01-25T15:01:39.166 INFO:teuthology.orchestra.run.smithi170.stdout:modified 2024-01-25T15:00:57.274280+0000 2024-01-25T15:01:39.166 INFO:teuthology.orchestra.run.smithi170.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-01-25T15:01:39.166 INFO:teuthology.orchestra.run.smithi170.stdout:crush_version 26 2024-01-25T15:01:39.166 INFO:teuthology.orchestra.run.smithi170.stdout:full_ratio 0.95 2024-01-25T15:01:39.166 INFO:teuthology.orchestra.run.smithi170.stdout:backfillfull_ratio 0.9 2024-01-25T15:01:39.166 INFO:teuthology.orchestra.run.smithi170.stdout:nearfull_ratio 0.85 2024-01-25T15:01:39.167 INFO:teuthology.orchestra.run.smithi170.stdout:require_min_compat_client luminous 2024-01-25T15:01:39.167 INFO:teuthology.orchestra.run.smithi170.stdout:min_compat_client luminous 2024-01-25T15:01:39.167 INFO:teuthology.orchestra.run.smithi170.stdout:require_osd_release squid 2024-01-25T15:01:39.167 INFO:teuthology.orchestra.run.smithi170.stdout:stretch_mode_enabled false 2024-01-25T15:01:39.167 INFO:teuthology.orchestra.run.smithi170.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-01-25T15:01:39.167 INFO:teuthology.orchestra.run.smithi170.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-01-25T15:01:39.167 INFO:teuthology.orchestra.run.smithi170.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-01-25T15:01:39.167 INFO:teuthology.orchestra.run.smithi170.stdout:max_osd 12 2024-01-25T15:01:39.167 INFO:teuthology.orchestra.run.smithi170.stdout:osd.0 up in weight 1 up_from 8 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6802/3114059675,v1:172.21.15.170:6803/3114059675] [v2:172.21.15.170:6804/3114059675,v1:172.21.15.170:6805/3114059675] exists,up 8b3a88cc-9c73-40fc-8c14-5e146fe81c0d 2024-01-25T15:01:39.167 INFO:teuthology.orchestra.run.smithi170.stdout:osd.1 up in weight 1 up_from 13 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6800/694515632,v1:172.21.15.186:6801/694515632] [v2:172.21.15.186:6802/694515632,v1:172.21.15.186:6803/694515632] exists,up 98a73f57-0d6f-4c4a-a576-bb8de76c7350 2024-01-25T15:01:39.167 INFO:teuthology.orchestra.run.smithi170.stdout:osd.2 up in weight 1 up_from 18 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6800/872180441,v1:172.21.15.191:6801/872180441] [v2:172.21.15.191:6802/872180441,v1:172.21.15.191:6803/872180441] exists,up 0379e70c-8d2d-4014-b174-f5f39f243368 2024-01-25T15:01:39.167 INFO:teuthology.orchestra.run.smithi170.stdout:osd.3 up in weight 1 up_from 25 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6810/1814173188,v1:172.21.15.170:6811/1814173188] [v2:172.21.15.170:6812/1814173188,v1:172.21.15.170:6813/1814173188] exists,up 2faea223-522c-4369-a25c-bdca49890e1b 2024-01-25T15:01:39.167 INFO:teuthology.orchestra.run.smithi170.stdout:osd.4 up in weight 1 up_from 33 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6808/3679177883,v1:172.21.15.186:6809/3679177883] [v2:172.21.15.186:6810/3679177883,v1:172.21.15.186:6811/3679177883] exists,up 60e47fb9-7166-4be7-8e9f-0881b771b116 2024-01-25T15:01:39.167 INFO:teuthology.orchestra.run.smithi170.stdout:osd.5 up in weight 1 up_from 38 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6808/1800857213,v1:172.21.15.191:6809/1800857213] [v2:172.21.15.191:6810/1800857213,v1:172.21.15.191:6811/1800857213] exists,up 945d8742-1594-45a5-8130-7aaa94abeaad 2024-01-25T15:01:39.168 INFO:teuthology.orchestra.run.smithi170.stdout:osd.6 up in weight 1 up_from 46 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6818/1982694876,v1:172.21.15.170:6819/1982694876] [v2:172.21.15.170:6820/1982694876,v1:172.21.15.170:6821/1982694876] exists,up a1e8e90e-5bac-4ba8-a44b-3a96beaf0525 2024-01-25T15:01:39.168 INFO:teuthology.orchestra.run.smithi170.stdout:osd.7 up in weight 1 up_from 52 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6816/2767449638,v1:172.21.15.186:6817/2767449638] [v2:172.21.15.186:6818/2767449638,v1:172.21.15.186:6819/2767449638] exists,up 3cc3b25d-83d5-46e4-a365-3fd8bebd6587 2024-01-25T15:01:39.168 INFO:teuthology.orchestra.run.smithi170.stdout:osd.8 up in weight 1 up_from 59 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6816/454890286,v1:172.21.15.191:6817/454890286] [v2:172.21.15.191:6818/454890286,v1:172.21.15.191:6819/454890286] exists,up 8100e99a-c2d3-4222-abb0-5c6840703cc6 2024-01-25T15:01:39.168 INFO:teuthology.orchestra.run.smithi170.stdout:osd.9 up in weight 1 up_from 67 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6826/2766984083,v1:172.21.15.170:6827/2766984083] [v2:172.21.15.170:6828/2766984083,v1:172.21.15.170:6829/2766984083] exists,up 3d335ab7-8f9d-4636-a436-724f2be1e20b 2024-01-25T15:01:39.168 INFO:teuthology.orchestra.run.smithi170.stdout:osd.10 up in weight 1 up_from 72 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6824/795318767,v1:172.21.15.186:6825/795318767] [v2:172.21.15.186:6826/795318767,v1:172.21.15.186:6827/795318767] exists,up 5d831d49-5068-4086-8d30-0a572d252432 2024-01-25T15:01:39.168 INFO:teuthology.orchestra.run.smithi170.stdout:osd.11 up in weight 1 up_from 80 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.191:6824/2951008135,v1:172.21.15.191:6825/2951008135] [v2:172.21.15.191:6826/2951008135,v1:172.21.15.191:6827/2951008135] exists,up 228841f5-d3d2-4481-a47c-c6c86c90925c 2024-01-25T15:01:39.168 INFO:teuthology.orchestra.run.smithi170.stdout:pg_upmap_items 2.6 [8,11] 2024-01-25T15:01:39.168 INFO:teuthology.orchestra.run.smithi170.stdout:pg_upmap_items 2.f [8,11] 2024-01-25T15:01:39.168 INFO:teuthology.orchestra.run.smithi170.stdout:pg_upmap_items 2.14 [2,4] 2024-01-25T15:01:39.168 INFO:teuthology.orchestra.run.smithi170.stdout:pg_upmap_items 2.16 [2,4] 2024-01-25T15:01:39.168 INFO:teuthology.orchestra.run.smithi170.stdout:pg_upmap_items 3.21 [5,9] 2024-01-25T15:01:39.168 INFO:teuthology.orchestra.run.smithi170.stdout:pg_upmap_items 3.24 [4,9] 2024-01-25T15:01:39.168 INFO:teuthology.orchestra.run.smithi170.stdout:pg_upmap_items 3.36 [4,9] 2024-01-25T15:01:39.169 INFO:teuthology.orchestra.run.smithi170.stdout:blocklist 172.21.15.170:0/781425854 expires 2024-01-26T14:52:56.092999+0000 2024-01-25T15:01:39.169 INFO:teuthology.orchestra.run.smithi170.stdout:blocklist 172.21.15.170:6800/358194066 expires 2024-01-26T14:52:56.092999+0000 2024-01-25T15:01:39.169 INFO:teuthology.orchestra.run.smithi170.stdout:blocklist 172.21.15.170:6800/622367049 expires 2024-01-26T14:52:29.612886+0000 2024-01-25T15:01:39.169 INFO:teuthology.orchestra.run.smithi170.stdout:blocklist 172.21.15.170:0/1314470118 expires 2024-01-26T14:52:56.092999+0000 2024-01-25T15:01:39.169 INFO:teuthology.orchestra.run.smithi170.stdout:blocklist 172.21.15.170:0/3177304860 expires 2024-01-26T14:52:29.612886+0000 2024-01-25T15:01:39.169 INFO:teuthology.orchestra.run.smithi170.stdout:blocklist 172.21.15.170:0/2154892792 expires 2024-01-26T14:52:29.612886+0000 2024-01-25T15:01:39.169 INFO:teuthology.orchestra.run.smithi170.stdout:blocklist 172.21.15.170:6801/622367049 expires 2024-01-26T14:52:29.612886+0000 2024-01-25T15:01:39.169 INFO:teuthology.orchestra.run.smithi170.stdout:blocklist 172.21.15.170:0/3790162374 expires 2024-01-26T14:52:29.612886+0000 2024-01-25T15:01:39.169 INFO:teuthology.orchestra.run.smithi170.stdout:blocklist 172.21.15.170:6801/358194066 expires 2024-01-26T14:52:56.092999+0000 2024-01-25T15:01:39.169 INFO:teuthology.orchestra.run.smithi170.stdout:blocklist 172.21.15.170:0/1116986212 expires 2024-01-26T14:52:56.092999+0000 2024-01-25T15:01:39.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:39.167+0000 7f9f23076700 1 -- 172.21.15.170:0/4078394417 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9f080a1370 msgr2=0x7f9f080a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:39.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:39.167+0000 7f9f23076700 1 --2- 172.21.15.170:0/4078394417 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9f080a1370 0x7f9f080a3830 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9f04009a10 tx=0x7f9f04009190 comp rx=0 tx=0).stop 2024-01-25T15:01:39.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:39.167+0000 7f9f23076700 1 -- 172.21.15.170:0/4078394417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f1c100710 msgr2=0x7f9f1c199b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:39.170 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:39.167+0000 7f9f23076700 1 --2- 172.21.15.170:0/4078394417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f1c100710 0x7f9f1c199b40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9f1400d010 tx=0x7f9f14009380 comp rx=0 tx=0).stop 2024-01-25T15:01:39.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:39.167+0000 7f9f23076700 1 -- 172.21.15.170:0/4078394417 shutdown_connections 2024-01-25T15:01:39.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:39.167+0000 7f9f23076700 1 --2- 172.21.15.170:0/4078394417 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9f080a1370 0x7f9f080a3830 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:39.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:39.167+0000 7f9f23076700 1 --2- 172.21.15.170:0/4078394417 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9f1c1022b0 0x7f9f1c1a10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:39.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:39.167+0000 7f9f23076700 1 --2- 172.21.15.170:0/4078394417 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9f1c100710 0x7f9f1c199b40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:39.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:39.167+0000 7f9f23076700 1 --2- 172.21.15.170:0/4078394417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f1c101910 0x7f9f1c19a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:39.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:39.167+0000 7f9f23076700 1 -- 172.21.15.170:0/4078394417 >> 172.21.15.170:0/4078394417 conn(0x7f9f1c0fbcb0 msgr2=0x7f9f1c069490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:39.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:39.167+0000 7f9f23076700 1 -- 172.21.15.170:0/4078394417 shutdown_connections 2024-01-25T15:01:39.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:39.167+0000 7f9f23076700 1 -- 172.21.15.170:0/4078394417 wait complete. 2024-01-25T15:01:39.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:39 smithi186 ceph-mon[35697]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-25T15:01:39.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:39 smithi170 ceph-mon[31899]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-25T15:01:39.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:39 smithi191 ceph-mon[36347]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-25T15:01:39.886 INFO:teuthology.run_tasks:Running task fs.ready... 2024-01-25T15:01:39.899 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:01:40.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 -- 172.21.15.170:0/962568695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1fc1040c0 msgr2=0x7fc1fc1064b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 --2- 172.21.15.170:0/962568695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1fc1040c0 0x7fc1fc1064b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009900 tx=0x7fc1ec02bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:40.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 -- 172.21.15.170:0/962568695 shutdown_connections 2024-01-25T15:01:40.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 --2- 172.21.15.170:0/962568695 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1fc1069f0 0x7fc1fc108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 --2- 172.21.15.170:0/962568695 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1fc1040c0 0x7fc1fc1064b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 --2- 172.21.15.170:0/962568695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1fc101790 0x7fc1fc103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 -- 172.21.15.170:0/962568695 >> 172.21.15.170:0/962568695 conn(0x7fc1fc0fb180 msgr2=0x7fc1fc0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:40.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 -- 172.21.15.170:0/962568695 shutdown_connections 2024-01-25T15:01:40.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 -- 172.21.15.170:0/962568695 wait complete. 2024-01-25T15:01:40.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 Processor -- start 2024-01-25T15:01:40.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 -- start start 2024-01-25T15:01:40.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1fc101790 0x7fc1fc196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1fc1040c0 0x7fc1fc1973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1fc1069f0 0x7fc1fc19e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc19e950 con 0x7fc1fc1069f0 2024-01-25T15:01:40.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc19eac0 con 0x7fc1fc101790 2024-01-25T15:01:40.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.006+0000 7fc203b43640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc19ec80 con 0x7fc1fc1040c0 2024-01-25T15:01:40.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc2020e0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1fc1069f0 0x7fc1fc19e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:40.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc2020e0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1fc1069f0 0x7fc1fc19e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:32906/0 (socket says 172.21.15.170:32906) 2024-01-25T15:01:40.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc2020e0640 1 -- 172.21.15.170:0/2881607716 learned_addr learned my addr 172.21.15.170:0/2881607716 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:40.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc2010de640 1 --2- 172.21.15.170:0/2881607716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1fc1040c0 0x7fc1fc1973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:40.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc2018df640 1 --2- 172.21.15.170:0/2881607716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1fc101790 0x7fc1fc196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:40.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc2020e0640 1 -- 172.21.15.170:0/2881607716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1fc1040c0 msgr2=0x7fc1fc1973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc2020e0640 1 --2- 172.21.15.170:0/2881607716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1fc1040c0 0x7fc1fc1973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc2020e0640 1 -- 172.21.15.170:0/2881607716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1fc101790 msgr2=0x7fc1fc196e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc2020e0640 1 --2- 172.21.15.170:0/2881607716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1fc101790 0x7fc1fc196e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc2020e0640 1 -- 172.21.15.170:0/2881607716 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ec009560 con 0x7fc1fc1069f0 2024-01-25T15:01:40.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc2018df640 1 --2- 172.21.15.170:0/2881607716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1fc101790 0x7fc1fc196e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:40.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc2020e0640 1 --2- 172.21.15.170:0/2881607716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1fc1069f0 0x7fc1fc19e410 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800b970 tx=0x7fc1f800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:40.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc1f2ffd640 1 -- 172.21.15.170:0/2881607716 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f800cb40 con 0x7fc1fc1069f0 2024-01-25T15:01:40.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc203b43640 1 -- 172.21.15.170:0/2881607716 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1fc19ef60 con 0x7fc1fc1069f0 2024-01-25T15:01:40.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc1f2ffd640 1 -- 172.21.15.170:0/2881607716 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1f800cca0 con 0x7fc1fc1069f0 2024-01-25T15:01:40.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc1f2ffd640 1 -- 172.21.15.170:0/2881607716 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8007770 con 0x7fc1fc1069f0 2024-01-25T15:01:40.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.007+0000 7fc203b43640 1 -- 172.21.15.170:0/2881607716 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1fc19f460 con 0x7fc1fc1069f0 2024-01-25T15:01:40.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.008+0000 7fc203b43640 1 -- 172.21.15.170:0/2881607716 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1fc0fcc70 con 0x7fc1fc1069f0 2024-01-25T15:01:40.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.009+0000 7fc1f2ffd640 1 -- 172.21.15.170:0/2881607716 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fc1f8014440 con 0x7fc1fc1069f0 2024-01-25T15:01:40.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.010+0000 7fc1f2ffd640 1 --2- 172.21.15.170:0/2881607716 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc1e80a12e0 0x7fc1e80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.010+0000 7fc2018df640 1 --2- 172.21.15.170:0/2881607716 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc1e80a12e0 0x7fc1e80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:40.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.010+0000 7fc1f2ffd640 1 -- 172.21.15.170:0/2881607716 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fc1f80cc480 con 0x7fc1fc1069f0 2024-01-25T15:01:40.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.010+0000 7fc2018df640 1 --2- 172.21.15.170:0/2881607716 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc1e80a12e0 0x7fc1e80a37a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4006fd0 tx=0x7fc1f4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:40.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.014+0000 7fc1f2ffd640 1 -- 172.21.15.170:0/2881607716 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fc1f804f600 con 0x7fc1fc1069f0 2024-01-25T15:01:40.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:40 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/4078394417' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-01-25T15:01:40.190 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.189+0000 7fc203b43640 1 -- 172.21.15.170:0/2881607716 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1fc02cb70 con 0x7fc1fc1069f0 2024-01-25T15:01:40.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.191+0000 7fc1f2ffd640 1 -- 172.21.15.170:0/2881607716 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22550 (secure 0 0 0) 0x7fc1f8095930 con 0x7fc1fc1069f0 2024-01-25T15:01:40.192 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:40.192 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":87,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T15:00:57.274280+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:01:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.193+0000 7fc203b43640 1 -- 172.21.15.170:0/2881607716 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc1e80a12e0 msgr2=0x7fc1e80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.193+0000 7fc203b43640 1 --2- 172.21.15.170:0/2881607716 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc1e80a12e0 0x7fc1e80a37a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4006fd0 tx=0x7fc1f4008040 comp rx=0 tx=0).stop 2024-01-25T15:01:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.193+0000 7fc203b43640 1 -- 172.21.15.170:0/2881607716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1fc1069f0 msgr2=0x7fc1fc19e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.193+0000 7fc203b43640 1 --2- 172.21.15.170:0/2881607716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1fc1069f0 0x7fc1fc19e410 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc1f800b970 tx=0x7fc1f800be30 comp rx=0 tx=0).stop 2024-01-25T15:01:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.193+0000 7fc203b43640 1 -- 172.21.15.170:0/2881607716 shutdown_connections 2024-01-25T15:01:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.193+0000 7fc203b43640 1 --2- 172.21.15.170:0/2881607716 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc1e80a12e0 0x7fc1e80a37a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.193+0000 7fc203b43640 1 --2- 172.21.15.170:0/2881607716 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc1fc1069f0 0x7fc1fc19e410 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.193+0000 7fc203b43640 1 --2- 172.21.15.170:0/2881607716 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc1fc1040c0 0x7fc1fc1973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.193+0000 7fc203b43640 1 --2- 172.21.15.170:0/2881607716 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1fc101790 0x7fc1fc196e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.193+0000 7fc203b43640 1 -- 172.21.15.170:0/2881607716 >> 172.21.15.170:0/2881607716 conn(0x7fc1fc0fb180 msgr2=0x7fc1fc1021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.193+0000 7fc203b43640 1 -- 172.21.15.170:0/2881607716 shutdown_connections 2024-01-25T15:01:40.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.193+0000 7fc203b43640 1 -- 172.21.15.170:0/2881607716 wait complete. 2024-01-25T15:01:40.205 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T14:55:22.432727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T14:59:51.465304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T14:59:52.749298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:01:40.206 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:01:40.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.310+0000 7fc97e7b6640 1 -- 172.21.15.170:0/1980714439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9780ffbf0 msgr2=0x7fc978100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.310+0000 7fc97e7b6640 1 --2- 172.21.15.170:0/1980714439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9780ffbf0 0x7fc978100010 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc96c009900 tx=0x7fc96c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:40.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.310+0000 7fc97e7b6640 1 -- 172.21.15.170:0/1980714439 shutdown_connections 2024-01-25T15:01:40.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.310+0000 7fc97e7b6640 1 --2- 172.21.15.170:0/1980714439 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc978100de0 0x7fc978101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.310+0000 7fc97e7b6640 1 --2- 172.21.15.170:0/1980714439 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9781017a0 0x7fc978108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.310+0000 7fc97e7b6640 1 --2- 172.21.15.170:0/1980714439 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9780ffbf0 0x7fc978100010 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.310+0000 7fc97e7b6640 1 -- 172.21.15.170:0/1980714439 >> 172.21.15.170:0/1980714439 conn(0x7fc9780fb180 msgr2=0x7fc9780fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:40.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.310+0000 7fc97e7b6640 1 -- 172.21.15.170:0/1980714439 shutdown_connections 2024-01-25T15:01:40.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.310+0000 7fc97e7b6640 1 -- 172.21.15.170:0/1980714439 wait complete. 2024-01-25T15:01:40.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.311+0000 7fc97e7b6640 1 Processor -- start 2024-01-25T15:01:40.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.311+0000 7fc97e7b6640 1 -- start start 2024-01-25T15:01:40.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.311+0000 7fc97e7b6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9780ffbf0 0x7fc97810a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.311+0000 7fc97e7b6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc978100de0 0x7fc978108af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.311+0000 7fc97e7b6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9781017a0 0x7fc978109030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.311+0000 7fc97e7b6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc978109790 con 0x7fc9780ffbf0 2024-01-25T15:01:40.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.311+0000 7fc97e7b6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc978109900 con 0x7fc978100de0 2024-01-25T15:01:40.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.311+0000 7fc97e7b6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9781a0dc0 con 0x7fc9781017a0 2024-01-25T15:01:40.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.311+0000 7fc977fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9780ffbf0 0x7fc97810a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:40.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.311+0000 7fc977fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9780ffbf0 0x7fc97810a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:32924/0 (socket says 172.21.15.170:32924) 2024-01-25T15:01:40.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.311+0000 7fc977fff640 1 -- 172.21.15.170:0/1122854047 learned_addr learned my addr 172.21.15.170:0/1122854047 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:40.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.312+0000 7fc9777fe640 1 --2- 172.21.15.170:0/1122854047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc978100de0 0x7fc978108af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:40.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.312+0000 7fc977fff640 1 -- 172.21.15.170:0/1122854047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9781017a0 msgr2=0x7fc978109030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.312+0000 7fc977fff640 1 --2- 172.21.15.170:0/1122854047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9781017a0 0x7fc978109030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.312+0000 7fc977fff640 1 -- 172.21.15.170:0/1122854047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc978100de0 msgr2=0x7fc978108af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.312+0000 7fc977fff640 1 --2- 172.21.15.170:0/1122854047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc978100de0 0x7fc978108af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.312+0000 7fc977fff640 1 -- 172.21.15.170:0/1122854047 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c009560 con 0x7fc9780ffbf0 2024-01-25T15:01:40.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.312+0000 7fc9777fe640 1 --2- 172.21.15.170:0/1122854047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc978100de0 0x7fc978108af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:40.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.312+0000 7fc977fff640 1 --2- 172.21.15.170:0/1122854047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9780ffbf0 0x7fc97810a4b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc96c036040 tx=0x7fc96c004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:40.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.312+0000 7fc9757fa640 1 -- 172.21.15.170:0/1122854047 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c0043d0 con 0x7fc9780ffbf0 2024-01-25T15:01:40.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.312+0000 7fc9757fa640 1 -- 172.21.15.170:0/1122854047 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc96c0054c0 con 0x7fc9780ffbf0 2024-01-25T15:01:40.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.312+0000 7fc9757fa640 1 -- 172.21.15.170:0/1122854047 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96c003e10 con 0x7fc9780ffbf0 2024-01-25T15:01:40.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.312+0000 7fc97e7b6640 1 -- 172.21.15.170:0/1122854047 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9781a1010 con 0x7fc9780ffbf0 2024-01-25T15:01:40.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.312+0000 7fc97e7b6640 1 -- 172.21.15.170:0/1122854047 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9781a1550 con 0x7fc9780ffbf0 2024-01-25T15:01:40.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.313+0000 7fc97e7b6640 1 -- 172.21.15.170:0/1122854047 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc978107050 con 0x7fc9780ffbf0 2024-01-25T15:01:40.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.314+0000 7fc9757fa640 1 -- 172.21.15.170:0/1122854047 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fc96c005000 con 0x7fc9780ffbf0 2024-01-25T15:01:40.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.314+0000 7fc9757fa640 1 --2- 172.21.15.170:0/1122854047 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc9600a1360 0x7fc9600a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.315+0000 7fc9777fe640 1 --2- 172.21.15.170:0/1122854047 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc9600a1360 0x7fc9600a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:40.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.315+0000 7fc9757fa640 1 -- 172.21.15.170:0/1122854047 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fc96c0eeef0 con 0x7fc9780ffbf0 2024-01-25T15:01:40.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.315+0000 7fc9777fe640 1 --2- 172.21.15.170:0/1122854047 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc9600a1360 0x7fc9600a3820 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc97810a220 tx=0x7fc968005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:40.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.319+0000 7fc9757fa640 1 -- 172.21.15.170:0/1122854047 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fc96c0b83a0 con 0x7fc9780ffbf0 2024-01-25T15:01:40.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:40 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/4078394417' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-01-25T15:01:40.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:40 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/4078394417' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-01-25T15:01:40.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.491+0000 7fc97e7b6640 1 -- 172.21.15.170:0/1122854047 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc97802cc30 con 0x7fc9780ffbf0 2024-01-25T15:01:40.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.492+0000 7fc9757fa640 1 -- 172.21.15.170:0/1122854047 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc96c005630 con 0x7fc9780ffbf0 2024-01-25T15:01:40.492 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 1 2024-01-25T15:01:40.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.493+0000 7fc97e7b6640 1 -- 172.21.15.170:0/1122854047 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc9600a1360 msgr2=0x7fc9600a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.493+0000 7fc97e7b6640 1 --2- 172.21.15.170:0/1122854047 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc9600a1360 0x7fc9600a3820 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc97810a220 tx=0x7fc968005e50 comp rx=0 tx=0).stop 2024-01-25T15:01:40.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.493+0000 7fc97e7b6640 1 -- 172.21.15.170:0/1122854047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9780ffbf0 msgr2=0x7fc97810a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.493+0000 7fc97e7b6640 1 --2- 172.21.15.170:0/1122854047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9780ffbf0 0x7fc97810a4b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fc96c036040 tx=0x7fc96c004f40 comp rx=0 tx=0).stop 2024-01-25T15:01:40.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.494+0000 7fc97e7b6640 1 -- 172.21.15.170:0/1122854047 shutdown_connections 2024-01-25T15:01:40.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.494+0000 7fc97e7b6640 1 --2- 172.21.15.170:0/1122854047 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc9600a1360 0x7fc9600a3820 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.494+0000 7fc97e7b6640 1 --2- 172.21.15.170:0/1122854047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc978100de0 0x7fc978108af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.494+0000 7fc97e7b6640 1 --2- 172.21.15.170:0/1122854047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc9781017a0 0x7fc978109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.494+0000 7fc97e7b6640 1 --2- 172.21.15.170:0/1122854047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc9780ffbf0 0x7fc97810a4b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.494+0000 7fc97e7b6640 1 -- 172.21.15.170:0/1122854047 >> 172.21.15.170:0/1122854047 conn(0x7fc9780fb180 msgr2=0x7fc978104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:40.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.494+0000 7fc97e7b6640 1 -- 172.21.15.170:0/1122854047 shutdown_connections 2024-01-25T15:01:40.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.494+0000 7fc97e7b6640 1 -- 172.21.15.170:0/1122854047 wait complete. 2024-01-25T15:01:40.506 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:01:40.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.609+0000 7f593517c640 1 -- 172.21.15.170:0/186741578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5930100de0 msgr2=0x7f5930101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.609+0000 7f593517c640 1 --2- 172.21.15.170:0/186741578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5930100de0 0x7f5930101260 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5918009900 tx=0x7f591802bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:40.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.609+0000 7f593517c640 1 -- 172.21.15.170:0/186741578 shutdown_connections 2024-01-25T15:01:40.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.609+0000 7f593517c640 1 --2- 172.21.15.170:0/186741578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59301017a0 0x7f5930108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.609+0000 7f593517c640 1 --2- 172.21.15.170:0/186741578 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5930100de0 0x7f5930101260 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.609+0000 7f593517c640 1 --2- 172.21.15.170:0/186741578 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59300ffbf0 0x7f5930100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.609+0000 7f593517c640 1 -- 172.21.15.170:0/186741578 >> 172.21.15.170:0/186741578 conn(0x7f59300fb180 msgr2=0x7f59300fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:40.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.609+0000 7f593517c640 1 -- 172.21.15.170:0/186741578 shutdown_connections 2024-01-25T15:01:40.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.609+0000 7f593517c640 1 -- 172.21.15.170:0/186741578 wait complete. 2024-01-25T15:01:40.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.609+0000 7f593517c640 1 Processor -- start 2024-01-25T15:01:40.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.609+0000 7f593517c640 1 -- start start 2024-01-25T15:01:40.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f593517c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59300ffbf0 0x7f5930103b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f593517c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5930100de0 0x7f59301021c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f593517c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59301017a0 0x7f5930102700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f593517c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5930102e60 con 0x7f5930100de0 2024-01-25T15:01:40.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f593517c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5930102fd0 con 0x7f59300ffbf0 2024-01-25T15:01:40.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f593517c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59301a0e00 con 0x7f59301017a0 2024-01-25T15:01:40.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f5927fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5930100de0 0x7f59301021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:40.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f5927fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5930100de0 0x7f59301021c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:32936/0 (socket says 172.21.15.170:32936) 2024-01-25T15:01:40.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f5927fff640 1 -- 172.21.15.170:0/3555901587 learned_addr learned my addr 172.21.15.170:0/3555901587 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:40.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f592ed9d640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59300ffbf0 0x7f5930103b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:40.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f592f59e640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59301017a0 0x7f5930102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:40.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f5927fff640 1 -- 172.21.15.170:0/3555901587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59301017a0 msgr2=0x7f5930102700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f5927fff640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59301017a0 0x7f5930102700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f5927fff640 1 -- 172.21.15.170:0/3555901587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59300ffbf0 msgr2=0x7f5930103b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f5927fff640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59300ffbf0 0x7f5930103b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f5927fff640 1 -- 172.21.15.170:0/3555901587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5918009560 con 0x7f5930100de0 2024-01-25T15:01:40.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f592f59e640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59301017a0 0x7f5930102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:40.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f592ed9d640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59300ffbf0 0x7f5930103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:40.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f5927fff640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5930100de0 0x7f59301021c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5918009430 tx=0x7f5918004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:40.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f592cd99640 1 -- 172.21.15.170:0/3555901587 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180043d0 con 0x7f5930100de0 2024-01-25T15:01:40.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f592cd99640 1 -- 172.21.15.170:0/3555901587 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f59180054c0 con 0x7f5930100de0 2024-01-25T15:01:40.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f593517c640 1 -- 172.21.15.170:0/3555901587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59301a1050 con 0x7f5930100de0 2024-01-25T15:01:40.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f592cd99640 1 -- 172.21.15.170:0/3555901587 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918003e80 con 0x7f5930100de0 2024-01-25T15:01:40.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.610+0000 7f593517c640 1 -- 172.21.15.170:0/3555901587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59301a15e0 con 0x7f5930100de0 2024-01-25T15:01:40.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.611+0000 7f593517c640 1 -- 172.21.15.170:0/3555901587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593010b520 con 0x7f5930100de0 2024-01-25T15:01:40.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.612+0000 7f592cd99640 1 -- 172.21.15.170:0/3555901587 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f59180035f0 con 0x7f5930100de0 2024-01-25T15:01:40.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.613+0000 7f592cd99640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f591c0a12e0 0x7f591c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.613+0000 7f592ed9d640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f591c0a12e0 0x7f591c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:40.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.613+0000 7f592cd99640 1 -- 172.21.15.170:0/3555901587 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f59180eeff0 con 0x7f5930100de0 2024-01-25T15:01:40.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.613+0000 7f592ed9d640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f591c0a12e0 0x7f591c0a37a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5920006fd0 tx=0x7f5920008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:40.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.617+0000 7f592cd99640 1 -- 172.21.15.170:0/3555901587 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f59180b84a0 con 0x7f5930100de0 2024-01-25T15:01:40.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.787+0000 7f593517c640 1 -- 172.21.15.170:0/3555901587 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f59301a1a70 con 0x7f5930100de0 2024-01-25T15:01:40.788 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.788+0000 7f592cd99640 1 -- 172.21.15.170:0/3555901587 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f59180bbac0 con 0x7f5930100de0 2024-01-25T15:01:40.789 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 32 2024-01-25T15:01:40.790 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.789+0000 7f593517c640 1 -- 172.21.15.170:0/3555901587 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f591c0a12e0 msgr2=0x7f591c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.789+0000 7f593517c640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f591c0a12e0 0x7f591c0a37a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5920006fd0 tx=0x7f5920008040 comp rx=0 tx=0).stop 2024-01-25T15:01:40.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.790+0000 7f593517c640 1 -- 172.21.15.170:0/3555901587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5930100de0 msgr2=0x7f59301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.790+0000 7f593517c640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5930100de0 0x7f59301021c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5918009430 tx=0x7f5918004ee0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.790+0000 7f593517c640 1 -- 172.21.15.170:0/3555901587 shutdown_connections 2024-01-25T15:01:40.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.790+0000 7f593517c640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f591c0a12e0 0x7f591c0a37a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.790+0000 7f593517c640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f59301017a0 0x7f5930102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.790+0000 7f593517c640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5930100de0 0x7f59301021c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.790+0000 7f593517c640 1 --2- 172.21.15.170:0/3555901587 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59300ffbf0 0x7f5930103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.790+0000 7f593517c640 1 -- 172.21.15.170:0/3555901587 >> 172.21.15.170:0/3555901587 conn(0x7f59300fb180 msgr2=0x7f5930067f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:40.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.790+0000 7f593517c640 1 -- 172.21.15.170:0/3555901587 shutdown_connections 2024-01-25T15:01:40.791 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.790+0000 7f593517c640 1 -- 172.21.15.170:0/3555901587 wait complete. 2024-01-25T15:01:40.802 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:01:40.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.905+0000 7f4dbd53e640 1 -- 172.21.15.170:0/1210291048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4db81017f0 msgr2=0x7f4db8103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.905+0000 7f4dbd53e640 1 --2- 172.21.15.170:0/1210291048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4db81017f0 0x7f4db8103be0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009900 tx=0x7f4da802bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:40.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.905+0000 7f4dbd53e640 1 -- 172.21.15.170:0/1210291048 shutdown_connections 2024-01-25T15:01:40.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.905+0000 7f4dbd53e640 1 --2- 172.21.15.170:0/1210291048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4db8106a50 0x7f4db8108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.905+0000 7f4dbd53e640 1 --2- 172.21.15.170:0/1210291048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4db8104120 0x7f4db8106510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.905+0000 7f4dbd53e640 1 --2- 172.21.15.170:0/1210291048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4db81017f0 0x7f4db8103be0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.905+0000 7f4dbd53e640 1 -- 172.21.15.170:0/1210291048 >> 172.21.15.170:0/1210291048 conn(0x7f4db80fb180 msgr2=0x7f4db80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:40.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.905+0000 7f4dbd53e640 1 -- 172.21.15.170:0/1210291048 shutdown_connections 2024-01-25T15:01:40.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.905+0000 7f4dbd53e640 1 -- 172.21.15.170:0/1210291048 wait complete. 2024-01-25T15:01:40.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4dbd53e640 1 Processor -- start 2024-01-25T15:01:40.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4dbd53e640 1 -- start start 2024-01-25T15:01:40.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4dbd53e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4db81017f0 0x7f4db8196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4dbd53e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4db8104120 0x7f4db81972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4dbd53e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4db8106a50 0x7f4db819e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4dbd53e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db819e850 con 0x7f4db81017f0 2024-01-25T15:01:40.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4dbd53e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db819e9c0 con 0x7f4db8104120 2024-01-25T15:01:40.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4dbd53e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db819eb80 con 0x7f4db8106a50 2024-01-25T15:01:40.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4db6ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4db81017f0 0x7f4db8196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:40.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4db6ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4db81017f0 0x7f4db8196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:32958/0 (socket says 172.21.15.170:32958) 2024-01-25T15:01:40.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4db6ffd640 1 -- 172.21.15.170:0/3822449438 learned_addr learned my addr 172.21.15.170:0/3822449438 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:40.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4db67fc640 1 --2- 172.21.15.170:0/3822449438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4db8104120 0x7f4db81972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:40.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4db6ffd640 1 -- 172.21.15.170:0/3822449438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4db8106a50 msgr2=0x7f4db819e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4db6ffd640 1 --2- 172.21.15.170:0/3822449438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4db8106a50 0x7f4db819e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4db6ffd640 1 -- 172.21.15.170:0/3822449438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4db8104120 msgr2=0x7f4db81972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:40.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4db6ffd640 1 --2- 172.21.15.170:0/3822449438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4db8104120 0x7f4db81972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:40.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4db6ffd640 1 -- 172.21.15.170:0/3822449438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da8009560 con 0x7f4db81017f0 2024-01-25T15:01:40.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4db67fc640 1 --2- 172.21.15.170:0/3822449438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4db8104120 0x7f4db81972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:40.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4db6ffd640 1 --2- 172.21.15.170:0/3822449438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4db81017f0 0x7f4db8196d60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009230 tx=0x7f4da8004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:40.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.906+0000 7f4d9ffff640 1 -- 172.21.15.170:0/3822449438 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80043d0 con 0x7f4db81017f0 2024-01-25T15:01:40.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.907+0000 7f4d9ffff640 1 -- 172.21.15.170:0/3822449438 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4da80054c0 con 0x7f4db81017f0 2024-01-25T15:01:40.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.907+0000 7f4dbd53e640 1 -- 172.21.15.170:0/3822449438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db819ee00 con 0x7f4db81017f0 2024-01-25T15:01:40.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.907+0000 7f4d9ffff640 1 -- 172.21.15.170:0/3822449438 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da803e450 con 0x7f4db81017f0 2024-01-25T15:01:40.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.907+0000 7f4dbd53e640 1 -- 172.21.15.170:0/3822449438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db819f300 con 0x7f4db81017f0 2024-01-25T15:01:40.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.908+0000 7f4dbd53e640 1 -- 172.21.15.170:0/3822449438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db80fcc70 con 0x7f4db81017f0 2024-01-25T15:01:40.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.908+0000 7f4d9ffff640 1 -- 172.21.15.170:0/3822449438 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f4da80035f0 con 0x7f4db81017f0 2024-01-25T15:01:40.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.909+0000 7f4d9ffff640 1 --2- 172.21.15.170:0/3822449438 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4da00a12e0 0x7f4da00a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:40.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.909+0000 7f4db67fc640 1 --2- 172.21.15.170:0/3822449438 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4da00a12e0 0x7f4da00a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:40.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.909+0000 7f4d9ffff640 1 -- 172.21.15.170:0/3822449438 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f4da80ef5d0 con 0x7f4db81017f0 2024-01-25T15:01:40.912 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.909+0000 7f4db67fc640 1 --2- 172.21.15.170:0/3822449438 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4da00a12e0 0x7f4da00a37a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4db8198270 tx=0x7f4dac008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:40.914 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:40.913+0000 7f4d9ffff640 1 -- 172.21.15.170:0/3822449438 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f4da80b8a80 con 0x7f4db81017f0 2024-01-25T15:01:41.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.087+0000 7f4dbd53e640 1 -- 172.21.15.170:0/3822449438 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4db802cbf0 con 0x7f4db81017f0 2024-01-25T15:01:41.088 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.088+0000 7f4d9ffff640 1 -- 172.21.15.170:0/3822449438 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4da80bc0a0 con 0x7f4db81017f0 2024-01-25T15:01:41.089 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 64 2024-01-25T15:01:41.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.090+0000 7f4dbd53e640 1 -- 172.21.15.170:0/3822449438 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4da00a12e0 msgr2=0x7f4da00a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:41.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.090+0000 7f4dbd53e640 1 --2- 172.21.15.170:0/3822449438 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4da00a12e0 0x7f4da00a37a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4db8198270 tx=0x7f4dac008040 comp rx=0 tx=0).stop 2024-01-25T15:01:41.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.090+0000 7f4dbd53e640 1 -- 172.21.15.170:0/3822449438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4db81017f0 msgr2=0x7f4db8196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:41.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.090+0000 7f4dbd53e640 1 --2- 172.21.15.170:0/3822449438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4db81017f0 0x7f4db8196d60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009230 tx=0x7f4da8004ee0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.090+0000 7f4dbd53e640 1 -- 172.21.15.170:0/3822449438 shutdown_connections 2024-01-25T15:01:41.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.090+0000 7f4dbd53e640 1 --2- 172.21.15.170:0/3822449438 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4da00a12e0 0x7f4da00a37a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.090+0000 7f4dbd53e640 1 --2- 172.21.15.170:0/3822449438 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4db8104120 0x7f4db81972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.090+0000 7f4dbd53e640 1 --2- 172.21.15.170:0/3822449438 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4db8106a50 0x7f4db819e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.090+0000 7f4dbd53e640 1 --2- 172.21.15.170:0/3822449438 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4db81017f0 0x7f4db8196d60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.090+0000 7f4dbd53e640 1 -- 172.21.15.170:0/3822449438 >> 172.21.15.170:0/3822449438 conn(0x7f4db80fb180 msgr2=0x7f4db81022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:41.091 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.090+0000 7f4dbd53e640 1 -- 172.21.15.170:0/3822449438 shutdown_connections 2024-01-25T15:01:41.092 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.090+0000 7f4dbd53e640 1 -- 172.21.15.170:0/3822449438 wait complete. 2024-01-25T15:01:41.102 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:01:41.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.203+0000 7faa31b33640 1 -- 172.21.15.170:0/3575233262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa2c0fefd0 msgr2=0x7faa2c0ff3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:41.206 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.203+0000 7faa31b33640 1 --2- 172.21.15.170:0/3575233262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa2c0fefd0 0x7faa2c0ff3f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009900 tx=0x7faa1c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:41.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.203+0000 7faa31b33640 1 -- 172.21.15.170:0/3575233262 shutdown_connections 2024-01-25T15:01:41.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.203+0000 7faa31b33640 1 --2- 172.21.15.170:0/3575233262 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa2c102960 0x7faa2c1091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.203+0000 7faa31b33640 1 --2- 172.21.15.170:0/3575233262 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa2c101fa0 0x7faa2c102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.203+0000 7faa31b33640 1 --2- 172.21.15.170:0/3575233262 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa2c0fefd0 0x7faa2c0ff3f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.203+0000 7faa31b33640 1 -- 172.21.15.170:0/3575233262 >> 172.21.15.170:0/3575233262 conn(0x7faa2c0fa920 msgr2=0x7faa2c0fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:41.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.203+0000 7faa31b33640 1 -- 172.21.15.170:0/3575233262 shutdown_connections 2024-01-25T15:01:41.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.203+0000 7faa31b33640 1 -- 172.21.15.170:0/3575233262 wait complete. 2024-01-25T15:01:41.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.203+0000 7faa31b33640 1 Processor -- start 2024-01-25T15:01:41.207 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.203+0000 7faa31b33640 1 -- start start 2024-01-25T15:01:41.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa31b33640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa2c0fefd0 0x7faa2c196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:41.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa31b33640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa2c101fa0 0x7faa2c1972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:41.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa31b33640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa2c102960 0x7faa2c19e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:41.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa31b33640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c19e890 con 0x7faa2c102960 2024-01-25T15:01:41.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa31b33640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c19ea00 con 0x7faa2c101fa0 2024-01-25T15:01:41.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa31b33640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c19ebc0 con 0x7faa2c0fefd0 2024-01-25T15:01:41.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa2bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa2c102960 0x7faa2c19e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:41.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa2bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa2c102960 0x7faa2c19e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:32968/0 (socket says 172.21.15.170:32968) 2024-01-25T15:01:41.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa2bfff640 1 -- 172.21.15.170:0/3364403340 learned_addr learned my addr 172.21.15.170:0/3364403340 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:41.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa2affd640 1 --2- 172.21.15.170:0/3364403340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa2c101fa0 0x7faa2c1972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:41.208 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa2b7fe640 1 --2- 172.21.15.170:0/3364403340 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa2c0fefd0 0x7faa2c196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:41.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa2bfff640 1 -- 172.21.15.170:0/3364403340 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa2c0fefd0 msgr2=0x7faa2c196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:41.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa2bfff640 1 --2- 172.21.15.170:0/3364403340 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa2c0fefd0 0x7faa2c196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa2bfff640 1 -- 172.21.15.170:0/3364403340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa2c101fa0 msgr2=0x7faa2c1972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:41.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa2bfff640 1 --2- 172.21.15.170:0/3364403340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa2c101fa0 0x7faa2c1972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa2bfff640 1 -- 172.21.15.170:0/3364403340 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c009560 con 0x7faa2c102960 2024-01-25T15:01:41.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa2affd640 1 --2- 172.21.15.170:0/3364403340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa2c101fa0 0x7faa2c1972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:41.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa2bfff640 1 --2- 172.21.15.170:0/3364403340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa2c102960 0x7faa2c19e320 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faa2400b970 tx=0x7faa2400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:41.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa28ff9640 1 -- 172.21.15.170:0/3364403340 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2400cb40 con 0x7faa2c102960 2024-01-25T15:01:41.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa28ff9640 1 -- 172.21.15.170:0/3364403340 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa2400cca0 con 0x7faa2c102960 2024-01-25T15:01:41.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa28ff9640 1 -- 172.21.15.170:0/3364403340 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa24007770 con 0x7faa2c102960 2024-01-25T15:01:41.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.204+0000 7faa31b33640 1 -- 172.21.15.170:0/3364403340 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2c19eea0 con 0x7faa2c102960 2024-01-25T15:01:41.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.205+0000 7faa31b33640 1 -- 172.21.15.170:0/3364403340 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2c19f2f0 con 0x7faa2c102960 2024-01-25T15:01:41.209 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.206+0000 7faa31b33640 1 -- 172.21.15.170:0/3364403340 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa2c1081f0 con 0x7faa2c102960 2024-01-25T15:01:41.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.207+0000 7faa28ff9640 1 -- 172.21.15.170:0/3364403340 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7faa24014440 con 0x7faa2c102960 2024-01-25T15:01:41.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.207+0000 7faa28ff9640 1 --2- 172.21.15.170:0/3364403340 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faa180a12e0 0x7faa180a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:41.210 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.207+0000 7faa2b7fe640 1 --2- 172.21.15.170:0/3364403340 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faa180a12e0 0x7faa180a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:41.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.207+0000 7faa28ff9640 1 -- 172.21.15.170:0/3364403340 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7faa240cc470 con 0x7faa2c102960 2024-01-25T15:01:41.211 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.208+0000 7faa2b7fe640 1 --2- 172.21.15.170:0/3364403340 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faa180a12e0 0x7faa180a37a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faa1c000c00 tx=0x7faa1c02c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:41.212 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.211+0000 7faa28ff9640 1 -- 172.21.15.170:0/3364403340 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7faa2404f600 con 0x7faa2c102960 2024-01-25T15:01:41.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:41 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2881607716' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:41.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:41 smithi186 ceph-mon[35697]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-01-25T15:01:41.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:41 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1122854047' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:41.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:41 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3555901587' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:41.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:41 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2881607716' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:41.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:41 smithi170 ceph-mon[31899]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-01-25T15:01:41.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:41 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1122854047' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:41.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:41 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3555901587' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:41.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.425+0000 7faa31b33640 1 -- 172.21.15.170:0/3364403340 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa2c02cbb0 con 0x7faa2c102960 2024-01-25T15:01:41.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.425+0000 7faa28ff9640 1 -- 172.21.15.170:0/3364403340 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+11411 (secure 0 0 0) 0x7faa24095940 con 0x7faa2c102960 2024-01-25T15:01:41.426 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:41.426 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-25T14:59:53.534085+0000","modified":"2024-01-25T15:00:00.045800+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24484,"mds_1":24479,"mds_2":24466,"mds_3":24418,"mds_4":24398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":4,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24479":{"gid":24479,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/2132502182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":2132502182},{"type":"v1","addr":"172.21.15.186:6839","nonce":2132502182}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:01:41.427 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-01-25T15:01:41.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.427+0000 7faa31b33640 1 -- 172.21.15.170:0/3364403340 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faa180a12e0 msgr2=0x7faa180a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:41.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.427+0000 7faa31b33640 1 --2- 172.21.15.170:0/3364403340 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faa180a12e0 0x7faa180a37a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faa1c000c00 tx=0x7faa1c02c5d0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.427+0000 7faa31b33640 1 -- 172.21.15.170:0/3364403340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa2c102960 msgr2=0x7faa2c19e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:41.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.427+0000 7faa31b33640 1 --2- 172.21.15.170:0/3364403340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa2c102960 0x7faa2c19e320 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faa2400b970 tx=0x7faa2400be30 comp rx=0 tx=0).stop 2024-01-25T15:01:41.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.427+0000 7faa31b33640 1 -- 172.21.15.170:0/3364403340 shutdown_connections 2024-01-25T15:01:41.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.427+0000 7faa31b33640 1 --2- 172.21.15.170:0/3364403340 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faa180a12e0 0x7faa180a37a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.427+0000 7faa31b33640 1 --2- 172.21.15.170:0/3364403340 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa2c101fa0 0x7faa2c1972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.427+0000 7faa31b33640 1 --2- 172.21.15.170:0/3364403340 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa2c102960 0x7faa2c19e320 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.427+0000 7faa31b33640 1 --2- 172.21.15.170:0/3364403340 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa2c0fefd0 0x7faa2c196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.427+0000 7faa31b33640 1 -- 172.21.15.170:0/3364403340 >> 172.21.15.170:0/3364403340 conn(0x7faa2c0fa920 msgr2=0x7faa2c1053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:41.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.428+0000 7faa31b33640 1 -- 172.21.15.170:0/3364403340 shutdown_connections 2024-01-25T15:01:41.429 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.428+0000 7faa31b33640 1 -- 172.21.15.170:0/3364403340 wait complete. 2024-01-25T15:01:41.439 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:01:41.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:41 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2881607716' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:41.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:41 smithi191 ceph-mon[36347]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-01-25T15:01:41.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:41 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1122854047' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:41.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:41 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3555901587' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:41.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 -- 172.21.15.170:0/234124137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d68100d00 msgr2=0x7f4d68101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:41.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 --2- 172.21.15.170:0/234124137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d68100d00 0x7f4d68101120 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4d58009ca0 tx=0x7f4d5802c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 -- 172.21.15.170:0/234124137 shutdown_connections 2024-01-25T15:01:41.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 --2- 172.21.15.170:0/234124137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d68101ef0 0x7f4d68102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 --2- 172.21.15.170:0/234124137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d681028b0 0x7f4d68109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 --2- 172.21.15.170:0/234124137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d68100d00 0x7f4d68101120 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 -- 172.21.15.170:0/234124137 >> 172.21.15.170:0/234124137 conn(0x7f4d680fc2d0 msgr2=0x7f4d680fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:41.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 -- 172.21.15.170:0/234124137 shutdown_connections 2024-01-25T15:01:41.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 -- 172.21.15.170:0/234124137 wait complete. 2024-01-25T15:01:41.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 Processor -- start 2024-01-25T15:01:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 -- start start 2024-01-25T15:01:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d68100d00 0x7f4d68196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d68101ef0 0x7f4d68197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d681028b0 0x7f4d6819e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6819e820 con 0x7f4d68101ef0 2024-01-25T15:01:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6819e990 con 0x7f4d681028b0 2024-01-25T15:01:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d6f264640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6819eb50 con 0x7f4d68100d00 2024-01-25T15:01:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.540+0000 7f4d67fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d68101ef0 0x7f4d68197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d67fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d68101ef0 0x7f4d68197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:32998/0 (socket says 172.21.15.170:32998) 2024-01-25T15:01:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d67fff640 1 -- 172.21.15.170:0/4050354087 learned_addr learned my addr 172.21.15.170:0/4050354087 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d6d000640 1 --2- 172.21.15.170:0/4050354087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d68100d00 0x7f4d68196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d67fff640 1 -- 172.21.15.170:0/4050354087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d68100d00 msgr2=0x7f4d68196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:41.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d67fff640 1 --2- 172.21.15.170:0/4050354087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d68100d00 0x7f4d68196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d67fff640 1 -- 172.21.15.170:0/4050354087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d681028b0 msgr2=0x7f4d6819e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:41.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d6d801640 1 --2- 172.21.15.170:0/4050354087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d681028b0 0x7f4d6819e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:41.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d67fff640 1 --2- 172.21.15.170:0/4050354087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d681028b0 0x7f4d6819e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d67fff640 1 -- 172.21.15.170:0/4050354087 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d58009900 con 0x7f4d68101ef0 2024-01-25T15:01:41.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d6d000640 1 --2- 172.21.15.170:0/4050354087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d68100d00 0x7f4d68196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:41.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d67fff640 1 --2- 172.21.15.170:0/4050354087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d68101ef0 0x7f4d68197280 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000c890 tx=0x7f4d5000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:41.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d65ffb640 1 -- 172.21.15.170:0/4050354087 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50004220 con 0x7f4d68101ef0 2024-01-25T15:01:41.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d65ffb640 1 -- 172.21.15.170:0/4050354087 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d50007e70 con 0x7f4d68101ef0 2024-01-25T15:01:41.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d65ffb640 1 -- 172.21.15.170:0/4050354087 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d50005690 con 0x7f4d68101ef0 2024-01-25T15:01:41.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d6f264640 1 -- 172.21.15.170:0/4050354087 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6819ee30 con 0x7f4d68101ef0 2024-01-25T15:01:41.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.541+0000 7f4d6f264640 1 -- 172.21.15.170:0/4050354087 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6819f200 con 0x7f4d68101ef0 2024-01-25T15:01:41.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.543+0000 7f4d6f264640 1 -- 172.21.15.170:0/4050354087 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d681080e0 con 0x7f4d68101ef0 2024-01-25T15:01:41.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.543+0000 7f4d65ffb640 1 -- 172.21.15.170:0/4050354087 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f4d500079b0 con 0x7f4d68101ef0 2024-01-25T15:01:41.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.544+0000 7f4d65ffb640 1 --2- 172.21.15.170:0/4050354087 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d540a1360 0x7f4d540a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:41.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.544+0000 7f4d6d000640 1 --2- 172.21.15.170:0/4050354087 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d540a1360 0x7f4d540a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:41.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.544+0000 7f4d65ffb640 1 -- 172.21.15.170:0/4050354087 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f4d500cc8e0 con 0x7f4d68101ef0 2024-01-25T15:01:41.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.544+0000 7f4d6d000640 1 --2- 172.21.15.170:0/4050354087 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d540a1360 0x7f4d540a3820 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4d58005cc0 tx=0x7f4d58005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:41.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.548+0000 7f4d65ffb640 1 -- 172.21.15.170:0/4050354087 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f4d50095d00 con 0x7f4d68101ef0 2024-01-25T15:01:41.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.722+0000 7f4d6f264640 1 -- 172.21.15.170:0/4050354087 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d6810c5c0 con 0x7f4d68101ef0 2024-01-25T15:01:41.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.723+0000 7f4d65ffb640 1 -- 172.21.15.170:0/4050354087 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22550 (secure 0 0 0) 0x7f4d50097c30 con 0x7f4d68101ef0 2024-01-25T15:01:41.724 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:41.725 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":87,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T15:00:57.274280+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:01:41.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.725+0000 7f4d6f264640 1 -- 172.21.15.170:0/4050354087 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d540a1360 msgr2=0x7f4d540a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:41.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.725+0000 7f4d6f264640 1 --2- 172.21.15.170:0/4050354087 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d540a1360 0x7f4d540a3820 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4d58005cc0 tx=0x7f4d58005c50 comp rx=0 tx=0).stop 2024-01-25T15:01:41.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.725+0000 7f4d6f264640 1 -- 172.21.15.170:0/4050354087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d68101ef0 msgr2=0x7f4d68197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:41.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.725+0000 7f4d6f264640 1 --2- 172.21.15.170:0/4050354087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d68101ef0 0x7f4d68197280 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000c890 tx=0x7f4d5000cd50 comp rx=0 tx=0).stop 2024-01-25T15:01:41.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.726+0000 7f4d6f264640 1 -- 172.21.15.170:0/4050354087 shutdown_connections 2024-01-25T15:01:41.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.726+0000 7f4d6f264640 1 --2- 172.21.15.170:0/4050354087 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d540a1360 0x7f4d540a3820 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.726+0000 7f4d6f264640 1 --2- 172.21.15.170:0/4050354087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d681028b0 0x7f4d6819e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.726+0000 7f4d6f264640 1 --2- 172.21.15.170:0/4050354087 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4d68101ef0 0x7f4d68197280 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.726+0000 7f4d6f264640 1 --2- 172.21.15.170:0/4050354087 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4d68100d00 0x7f4d68196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.726+0000 7f4d6f264640 1 -- 172.21.15.170:0/4050354087 >> 172.21.15.170:0/4050354087 conn(0x7f4d680fc2d0 msgr2=0x7f4d681052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:41.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.726+0000 7f4d6f264640 1 -- 172.21.15.170:0/4050354087 shutdown_connections 2024-01-25T15:01:41.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.726+0000 7f4d6f264640 1 -- 172.21.15.170:0/4050354087 wait complete. 2024-01-25T15:01:41.738 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T14:55:22.432727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T14:59:51.465304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T14:59:52.749298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:01:41.738 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:01:41.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.841+0000 7f7339df5640 1 -- 172.21.15.170:0/3204435705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73340ffbf0 msgr2=0x7f7334100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:41.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.841+0000 7f7339df5640 1 --2- 172.21.15.170:0/3204435705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73340ffbf0 0x7f7334100010 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7324009900 tx=0x7f732402bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:41.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.841+0000 7f7339df5640 1 -- 172.21.15.170:0/3204435705 shutdown_connections 2024-01-25T15:01:41.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.841+0000 7f7339df5640 1 --2- 172.21.15.170:0/3204435705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7334100de0 0x7f7334101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.841+0000 7f7339df5640 1 --2- 172.21.15.170:0/3204435705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73341017a0 0x7f7334108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.841+0000 7f7339df5640 1 --2- 172.21.15.170:0/3204435705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73340ffbf0 0x7f7334100010 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.841+0000 7f7339df5640 1 -- 172.21.15.170:0/3204435705 >> 172.21.15.170:0/3204435705 conn(0x7f73340fb180 msgr2=0x7f73340fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:41.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.841+0000 7f7339df5640 1 -- 172.21.15.170:0/3204435705 shutdown_connections 2024-01-25T15:01:41.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.841+0000 7f7339df5640 1 -- 172.21.15.170:0/3204435705 wait complete. 2024-01-25T15:01:41.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.842+0000 7f7339df5640 1 Processor -- start 2024-01-25T15:01:41.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.842+0000 7f7339df5640 1 -- start start 2024-01-25T15:01:41.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.842+0000 7f7339df5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73340ffbf0 0x7f73340689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:41.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.842+0000 7f7339df5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7334100de0 0x7f733419bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:41.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.842+0000 7f7339df5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73341017a0 0x7f733419e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:41.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.842+0000 7f7339df5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733419e880 con 0x7f73341017a0 2024-01-25T15:01:41.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.842+0000 7f7339df5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733419e9f0 con 0x7f7334100de0 2024-01-25T15:01:41.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.842+0000 7f7339df5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733419ebb0 con 0x7f73340ffbf0 2024-01-25T15:01:41.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.842+0000 7f7333fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73341017a0 0x7f733419e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:41.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.842+0000 7f7333fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73341017a0 0x7f733419e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33024/0 (socket says 172.21.15.170:33024) 2024-01-25T15:01:41.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.842+0000 7f7333fff640 1 -- 172.21.15.170:0/135243114 learned_addr learned my addr 172.21.15.170:0/135243114 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:41.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.843+0000 7f732affd640 1 --2- 172.21.15.170:0/135243114 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7334100de0 0x7f733419bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:41.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.843+0000 7f73337fe640 1 --2- 172.21.15.170:0/135243114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73340ffbf0 0x7f73340689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:41.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.843+0000 7f7333fff640 1 -- 172.21.15.170:0/135243114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73340ffbf0 msgr2=0x7f73340689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:41.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.843+0000 7f7333fff640 1 --2- 172.21.15.170:0/135243114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73340ffbf0 0x7f73340689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.843+0000 7f7333fff640 1 -- 172.21.15.170:0/135243114 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7334100de0 msgr2=0x7f733419bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:41.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.843+0000 7f7333fff640 1 --2- 172.21.15.170:0/135243114 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7334100de0 0x7f733419bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:41.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.843+0000 7f7333fff640 1 -- 172.21.15.170:0/135243114 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7324009560 con 0x7f73341017a0 2024-01-25T15:01:41.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.843+0000 7f7333fff640 1 --2- 172.21.15.170:0/135243114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73341017a0 0x7f733419e0f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f732c00b970 tx=0x7f732c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:41.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.843+0000 7f73317fa640 1 -- 172.21.15.170:0/135243114 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c00cb40 con 0x7f73341017a0 2024-01-25T15:01:41.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.843+0000 7f73317fa640 1 -- 172.21.15.170:0/135243114 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f732c00cca0 con 0x7f73341017a0 2024-01-25T15:01:41.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.843+0000 7f7339df5640 1 -- 172.21.15.170:0/135243114 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733419ee90 con 0x7f73341017a0 2024-01-25T15:01:41.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.843+0000 7f73317fa640 1 -- 172.21.15.170:0/135243114 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c007770 con 0x7f73341017a0 2024-01-25T15:01:41.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.843+0000 7f7339df5640 1 -- 172.21.15.170:0/135243114 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733419f370 con 0x7f73341017a0 2024-01-25T15:01:41.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.844+0000 7f7339df5640 1 -- 172.21.15.170:0/135243114 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7334107030 con 0x7f73341017a0 2024-01-25T15:01:41.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.845+0000 7f73317fa640 1 -- 172.21.15.170:0/135243114 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f732c014440 con 0x7f73341017a0 2024-01-25T15:01:41.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.845+0000 7f73317fa640 1 --2- 172.21.15.170:0/135243114 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f73200a12e0 0x7f73200a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:41.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.846+0000 7f73337fe640 1 --2- 172.21.15.170:0/135243114 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f73200a12e0 0x7f73200a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:41.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.846+0000 7f73317fa640 1 -- 172.21.15.170:0/135243114 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f732c0cc370 con 0x7f73341017a0 2024-01-25T15:01:41.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.846+0000 7f73337fe640 1 --2- 172.21.15.170:0/135243114 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f73200a12e0 0x7f73200a37a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f732402c6b0 tx=0x7f732402c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:41.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:41.850+0000 7f73317fa640 1 -- 172.21.15.170:0/135243114 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f732c04f600 con 0x7f73341017a0 2024-01-25T15:01:42.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.020+0000 7f7339df5640 1 -- 172.21.15.170:0/135243114 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f733402cb10 con 0x7f73341017a0 2024-01-25T15:01:42.021 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.021+0000 7f73317fa640 1 -- 172.21.15.170:0/135243114 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f732c0958d0 con 0x7f73341017a0 2024-01-25T15:01:42.022 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 1 2024-01-25T15:01:42.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.023+0000 7f7339df5640 1 -- 172.21.15.170:0/135243114 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f73200a12e0 msgr2=0x7f73200a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.023+0000 7f7339df5640 1 --2- 172.21.15.170:0/135243114 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f73200a12e0 0x7f73200a37a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f732402c6b0 tx=0x7f732402c5d0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.023+0000 7f7339df5640 1 -- 172.21.15.170:0/135243114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73341017a0 msgr2=0x7f733419e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.023+0000 7f7339df5640 1 --2- 172.21.15.170:0/135243114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73341017a0 0x7f733419e0f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f732c00b970 tx=0x7f732c00be30 comp rx=0 tx=0).stop 2024-01-25T15:01:42.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.023+0000 7f7339df5640 1 -- 172.21.15.170:0/135243114 shutdown_connections 2024-01-25T15:01:42.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.023+0000 7f7339df5640 1 --2- 172.21.15.170:0/135243114 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f73200a12e0 0x7f73200a37a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.023+0000 7f7339df5640 1 --2- 172.21.15.170:0/135243114 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7334100de0 0x7f733419bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.023+0000 7f7339df5640 1 --2- 172.21.15.170:0/135243114 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f73341017a0 0x7f733419e0f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.023+0000 7f7339df5640 1 --2- 172.21.15.170:0/135243114 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f73340ffbf0 0x7f73340689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.023+0000 7f7339df5640 1 -- 172.21.15.170:0/135243114 >> 172.21.15.170:0/135243114 conn(0x7f73340fb180 msgr2=0x7f7334104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:42.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.023+0000 7f7339df5640 1 -- 172.21.15.170:0/135243114 shutdown_connections 2024-01-25T15:01:42.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.023+0000 7f7339df5640 1 -- 172.21.15.170:0/135243114 wait complete. 2024-01-25T15:01:42.035 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:01:42.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.138+0000 7f7cbce1e640 1 -- 172.21.15.170:0/2763093915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cb81017a0 msgr2=0x7f7cb8108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.138+0000 7f7cbce1e640 1 --2- 172.21.15.170:0/2763093915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cb81017a0 0x7f7cb8108030 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009900 tx=0x7f7cb002bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:42.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.139+0000 7f7cbce1e640 1 -- 172.21.15.170:0/2763093915 shutdown_connections 2024-01-25T15:01:42.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.139+0000 7f7cbce1e640 1 --2- 172.21.15.170:0/2763093915 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cb8100de0 0x7f7cb8101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.139+0000 7f7cbce1e640 1 --2- 172.21.15.170:0/2763093915 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cb81017a0 0x7f7cb8108030 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.139+0000 7f7cbce1e640 1 --2- 172.21.15.170:0/2763093915 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7cb80ffbf0 0x7f7cb8100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.139+0000 7f7cbce1e640 1 -- 172.21.15.170:0/2763093915 >> 172.21.15.170:0/2763093915 conn(0x7f7cb80fb180 msgr2=0x7f7cb80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:42.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.139+0000 7f7cbce1e640 1 -- 172.21.15.170:0/2763093915 shutdown_connections 2024-01-25T15:01:42.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.139+0000 7f7cbce1e640 1 -- 172.21.15.170:0/2763093915 wait complete. 2024-01-25T15:01:42.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.139+0000 7f7cbce1e640 1 Processor -- start 2024-01-25T15:01:42.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.139+0000 7f7cbce1e640 1 -- start start 2024-01-25T15:01:42.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.139+0000 7f7cbce1e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7cb80ffbf0 0x7f7cb810a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:42.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.139+0000 7f7cbce1e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cb8100de0 0x7f7cb8108af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:42.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.139+0000 7f7cbce1e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cb81017a0 0x7f7cb8109030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:42.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.139+0000 7f7cbce1e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8109790 con 0x7f7cb8100de0 2024-01-25T15:01:42.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.139+0000 7f7cbce1e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb8109900 con 0x7f7cb81017a0 2024-01-25T15:01:42.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7cbce1e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb81a0ce0 con 0x7f7cb80ffbf0 2024-01-25T15:01:42.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7cb5d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cb8100de0 0x7f7cb8108af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:42.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7cb5d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cb8100de0 0x7f7cb8108af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33042/0 (socket says 172.21.15.170:33042) 2024-01-25T15:01:42.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7cb5d9b640 1 -- 172.21.15.170:0/1308834381 learned_addr learned my addr 172.21.15.170:0/1308834381 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:42.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7cb659c640 1 --2- 172.21.15.170:0/1308834381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7cb80ffbf0 0x7f7cb810a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:42.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7cb6d9d640 1 --2- 172.21.15.170:0/1308834381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cb81017a0 0x7f7cb8109030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:42.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7cb5d9b640 1 -- 172.21.15.170:0/1308834381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7cb80ffbf0 msgr2=0x7f7cb810a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7cb5d9b640 1 --2- 172.21.15.170:0/1308834381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7cb80ffbf0 0x7f7cb810a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7cb5d9b640 1 -- 172.21.15.170:0/1308834381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cb81017a0 msgr2=0x7f7cb8109030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7cb5d9b640 1 --2- 172.21.15.170:0/1308834381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cb81017a0 0x7f7cb8109030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7cb5d9b640 1 -- 172.21.15.170:0/1308834381 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb0009560 con 0x7f7cb8100de0 2024-01-25T15:01:42.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7cb6d9d640 1 --2- 172.21.15.170:0/1308834381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cb81017a0 0x7f7cb8109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:42.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7cb5d9b640 1 --2- 172.21.15.170:0/1308834381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cb8100de0 0x7f7cb8108af0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00d980 tx=0x7f7cac00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:42.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7ca77fe640 1 -- 172.21.15.170:0/1308834381 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac009c30 con 0x7f7cb8100de0 2024-01-25T15:01:42.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7ca77fe640 1 -- 172.21.15.170:0/1308834381 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7cac00b660 con 0x7f7cb8100de0 2024-01-25T15:01:42.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7cbce1e640 1 -- 172.21.15.170:0/1308834381 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb81a0f90 con 0x7f7cb8100de0 2024-01-25T15:01:42.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7ca77fe640 1 -- 172.21.15.170:0/1308834381 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac00f620 con 0x7f7cb8100de0 2024-01-25T15:01:42.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.140+0000 7f7cbce1e640 1 -- 172.21.15.170:0/1308834381 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb81a1460 con 0x7f7cb8100de0 2024-01-25T15:01:42.144 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.141+0000 7f7cbce1e640 1 -- 172.21.15.170:0/1308834381 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb8106f90 con 0x7f7cb8100de0 2024-01-25T15:01:42.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.142+0000 7f7ca77fe640 1 -- 172.21.15.170:0/1308834381 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f7cac010460 con 0x7f7cb8100de0 2024-01-25T15:01:42.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.143+0000 7f7ca77fe640 1 --2- 172.21.15.170:0/1308834381 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7ca00a1360 0x7f7ca00a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:42.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.143+0000 7f7cb659c640 1 --2- 172.21.15.170:0/1308834381 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7ca00a1360 0x7f7ca00a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:42.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.143+0000 7f7ca77fe640 1 -- 172.21.15.170:0/1308834381 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f7cac0cc680 con 0x7f7cb8100de0 2024-01-25T15:01:42.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.143+0000 7f7cb659c640 1 --2- 172.21.15.170:0/1308834381 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7ca00a1360 0x7f7ca00a3820 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8005c40 tx=0x7f7ca800a590 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:42.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.147+0000 7f7ca77fe640 1 -- 172.21.15.170:0/1308834381 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f7cac095b30 con 0x7f7cb8100de0 2024-01-25T15:01:42.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.319+0000 7f7cbce1e640 1 -- 172.21.15.170:0/1308834381 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7cb802cbb0 con 0x7f7cb8100de0 2024-01-25T15:01:42.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.320+0000 7f7ca77fe640 1 -- 172.21.15.170:0/1308834381 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7cac099150 con 0x7f7cb8100de0 2024-01-25T15:01:42.321 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 32 2024-01-25T15:01:42.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.322+0000 7f7cbce1e640 1 -- 172.21.15.170:0/1308834381 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7ca00a1360 msgr2=0x7f7ca00a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.322+0000 7f7cbce1e640 1 --2- 172.21.15.170:0/1308834381 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7ca00a1360 0x7f7ca00a3820 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8005c40 tx=0x7f7ca800a590 comp rx=0 tx=0).stop 2024-01-25T15:01:42.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.322+0000 7f7cbce1e640 1 -- 172.21.15.170:0/1308834381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cb8100de0 msgr2=0x7f7cb8108af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.322+0000 7f7cbce1e640 1 --2- 172.21.15.170:0/1308834381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cb8100de0 0x7f7cb8108af0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00d980 tx=0x7f7cac00de40 comp rx=0 tx=0).stop 2024-01-25T15:01:42.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.322+0000 7f7cbce1e640 1 -- 172.21.15.170:0/1308834381 shutdown_connections 2024-01-25T15:01:42.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.322+0000 7f7cbce1e640 1 --2- 172.21.15.170:0/1308834381 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7ca00a1360 0x7f7ca00a3820 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.322+0000 7f7cbce1e640 1 --2- 172.21.15.170:0/1308834381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7cb81017a0 0x7f7cb8109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.322+0000 7f7cbce1e640 1 --2- 172.21.15.170:0/1308834381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7cb8100de0 0x7f7cb8108af0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.322+0000 7f7cbce1e640 1 --2- 172.21.15.170:0/1308834381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7cb80ffbf0 0x7f7cb810a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.322+0000 7f7cbce1e640 1 -- 172.21.15.170:0/1308834381 >> 172.21.15.170:0/1308834381 conn(0x7f7cb80fb180 msgr2=0x7f7cb8104160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:42.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.322+0000 7f7cbce1e640 1 -- 172.21.15.170:0/1308834381 shutdown_connections 2024-01-25T15:01:42.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.322+0000 7f7cbce1e640 1 -- 172.21.15.170:0/1308834381 wait complete. 2024-01-25T15:01:42.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:42 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3822449438' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:42.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:42 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3364403340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:42.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:42 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/4050354087' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:42.333 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:42 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/135243114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:42.334 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:01:42.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:42 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3822449438' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:42.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:42 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3364403340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:42.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:42 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/4050354087' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:42.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:42 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/135243114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:42.442 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.439+0000 7f9d858d3640 1 -- 172.21.15.170:0/1666155032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d80106a90 msgr2=0x7f9d80108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.439+0000 7f9d858d3640 1 --2- 172.21.15.170:0/1666155032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d80106a90 0x7f9d80108e80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9d78009ca0 tx=0x7f9d7802c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.439+0000 7f9d858d3640 1 -- 172.21.15.170:0/1666155032 shutdown_connections 2024-01-25T15:01:42.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.439+0000 7f9d858d3640 1 --2- 172.21.15.170:0/1666155032 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d80104160 0x7f9d80106550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.439+0000 7f9d858d3640 1 --2- 172.21.15.170:0/1666155032 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d80106a90 0x7f9d80108e80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.439+0000 7f9d858d3640 1 --2- 172.21.15.170:0/1666155032 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d80101830 0x7f9d80103c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.439+0000 7f9d858d3640 1 -- 172.21.15.170:0/1666155032 >> 172.21.15.170:0/1666155032 conn(0x7f9d800fb180 msgr2=0x7f9d800fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:42.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.439+0000 7f9d858d3640 1 -- 172.21.15.170:0/1666155032 shutdown_connections 2024-01-25T15:01:42.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.439+0000 7f9d858d3640 1 -- 172.21.15.170:0/1666155032 wait complete. 2024-01-25T15:01:42.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d858d3640 1 Processor -- start 2024-01-25T15:01:42.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d858d3640 1 -- start start 2024-01-25T15:01:42.443 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d858d3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d80101830 0x7f9d80196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:42.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d858d3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d80104160 0x7f9d80197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:42.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d858d3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d80106a90 0x7f9d8019e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:42.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d858d3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8019e7d0 con 0x7f9d80106a90 2024-01-25T15:01:42.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d858d3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8019e940 con 0x7f9d80101830 2024-01-25T15:01:42.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d858d3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8019eb00 con 0x7f9d80104160 2024-01-25T15:01:42.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d7f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d80106a90 0x7f9d8019e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:42.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d7f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d80106a90 0x7f9d8019e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33056/0 (socket says 172.21.15.170:33056) 2024-01-25T15:01:42.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d7f7fe640 1 -- 172.21.15.170:0/579874824 learned_addr learned my addr 172.21.15.170:0/579874824 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:42.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d7effd640 1 --2- 172.21.15.170:0/579874824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d80101830 0x7f9d80196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:42.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d767fc640 1 --2- 172.21.15.170:0/579874824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d80104160 0x7f9d80197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:42.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d7f7fe640 1 -- 172.21.15.170:0/579874824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d80104160 msgr2=0x7f9d80197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d7f7fe640 1 --2- 172.21.15.170:0/579874824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d80104160 0x7f9d80197200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d7f7fe640 1 -- 172.21.15.170:0/579874824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d80101830 msgr2=0x7f9d80196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.444 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.440+0000 7f9d7f7fe640 1 --2- 172.21.15.170:0/579874824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d80101830 0x7f9d80196cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.441+0000 7f9d7f7fe640 1 -- 172.21.15.170:0/579874824 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d78009900 con 0x7f9d80106a90 2024-01-25T15:01:42.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.441+0000 7f9d767fc640 1 --2- 172.21.15.170:0/579874824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d80104160 0x7f9d80197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:42.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.441+0000 7f9d7f7fe640 1 --2- 172.21.15.170:0/579874824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d80106a90 0x7f9d8019e260 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9d78037040 tx=0x7f9d78032810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:42.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.441+0000 7f9d848d1640 1 -- 172.21.15.170:0/579874824 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78034e80 con 0x7f9d80106a90 2024-01-25T15:01:42.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.441+0000 7f9d858d3640 1 -- 172.21.15.170:0/579874824 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8019ed80 con 0x7f9d80106a90 2024-01-25T15:01:42.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.441+0000 7f9d848d1640 1 -- 172.21.15.170:0/579874824 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d78003e30 con 0x7f9d80106a90 2024-01-25T15:01:42.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.441+0000 7f9d848d1640 1 -- 172.21.15.170:0/579874824 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7803d3f0 con 0x7f9d80106a90 2024-01-25T15:01:42.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.441+0000 7f9d858d3640 1 -- 172.21.15.170:0/579874824 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8019f220 con 0x7f9d80106a90 2024-01-25T15:01:42.445 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.442+0000 7f9d858d3640 1 -- 172.21.15.170:0/579874824 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d800fcc70 con 0x7f9d80106a90 2024-01-25T15:01:42.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.443+0000 7f9d848d1640 1 -- 172.21.15.170:0/579874824 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f9d7803b040 con 0x7f9d80106a90 2024-01-25T15:01:42.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.443+0000 7f9d848d1640 1 --2- 172.21.15.170:0/579874824 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9d6c0a12e0 0x7f9d6c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:42.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.444+0000 7f9d7effd640 1 --2- 172.21.15.170:0/579874824 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9d6c0a12e0 0x7f9d6c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:42.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.444+0000 7f9d848d1640 1 -- 172.21.15.170:0/579874824 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f9d780ef6e0 con 0x7f9d80106a90 2024-01-25T15:01:42.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.444+0000 7f9d7effd640 1 --2- 172.21.15.170:0/579874824 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9d6c0a12e0 0x7f9d6c0a37a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9d700058c0 tx=0x7f9d7000a250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:42.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.447+0000 7f9d848d1640 1 -- 172.21.15.170:0/579874824 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f9d780b8b90 con 0x7f9d80106a90 2024-01-25T15:01:42.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:42 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3822449438' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:42.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:42 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3364403340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:42.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:42 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/4050354087' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:42.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:42 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/135243114' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:42.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.617+0000 7f9d858d3640 1 -- 172.21.15.170:0/579874824 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d8010c790 con 0x7f9d80106a90 2024-01-25T15:01:42.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.618+0000 7f9d848d1640 1 -- 172.21.15.170:0/579874824 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d780bc1b0 con 0x7f9d80106a90 2024-01-25T15:01:42.618 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 64 2024-01-25T15:01:42.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.620+0000 7f9d858d3640 1 -- 172.21.15.170:0/579874824 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9d6c0a12e0 msgr2=0x7f9d6c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.620+0000 7f9d858d3640 1 --2- 172.21.15.170:0/579874824 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9d6c0a12e0 0x7f9d6c0a37a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9d700058c0 tx=0x7f9d7000a250 comp rx=0 tx=0).stop 2024-01-25T15:01:42.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.620+0000 7f9d858d3640 1 -- 172.21.15.170:0/579874824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d80106a90 msgr2=0x7f9d8019e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.620+0000 7f9d858d3640 1 --2- 172.21.15.170:0/579874824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d80106a90 0x7f9d8019e260 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9d78037040 tx=0x7f9d78032810 comp rx=0 tx=0).stop 2024-01-25T15:01:42.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.620+0000 7f9d858d3640 1 -- 172.21.15.170:0/579874824 shutdown_connections 2024-01-25T15:01:42.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.620+0000 7f9d858d3640 1 --2- 172.21.15.170:0/579874824 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9d6c0a12e0 0x7f9d6c0a37a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.620+0000 7f9d858d3640 1 --2- 172.21.15.170:0/579874824 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9d80106a90 0x7f9d8019e260 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.620+0000 7f9d858d3640 1 --2- 172.21.15.170:0/579874824 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9d80104160 0x7f9d80197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.620+0000 7f9d858d3640 1 --2- 172.21.15.170:0/579874824 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d80101830 0x7f9d80196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.620+0000 7f9d858d3640 1 -- 172.21.15.170:0/579874824 >> 172.21.15.170:0/579874824 conn(0x7f9d800fb180 msgr2=0x7f9d80102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:42.621 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.620+0000 7f9d858d3640 1 -- 172.21.15.170:0/579874824 shutdown_connections 2024-01-25T15:01:42.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.620+0000 7f9d858d3640 1 -- 172.21.15.170:0/579874824 wait complete. 2024-01-25T15:01:42.632 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:01:42.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.732+0000 7f8f100ec640 1 -- 172.21.15.170:0/1505183341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f08100f70 msgr2=0x7f8f08107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.732+0000 7f8f100ec640 1 --2- 172.21.15.170:0/1505183341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f08100f70 0x7f8f08107800 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8f00009900 tx=0x7f8f0002bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:42.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.732+0000 7f8f100ec640 1 -- 172.21.15.170:0/1505183341 shutdown_connections 2024-01-25T15:01:42.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.732+0000 7f8f100ec640 1 --2- 172.21.15.170:0/1505183341 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f081005b0 0x7f8f08100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.732+0000 7f8f100ec640 1 --2- 172.21.15.170:0/1505183341 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f08100f70 0x7f8f08107800 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.732+0000 7f8f100ec640 1 --2- 172.21.15.170:0/1505183341 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8f080ff3c0 0x7f8f080ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.732+0000 7f8f100ec640 1 -- 172.21.15.170:0/1505183341 >> 172.21.15.170:0/1505183341 conn(0x7f8f080fa930 msgr2=0x7f8f080fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:42.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.733+0000 7f8f100ec640 1 -- 172.21.15.170:0/1505183341 shutdown_connections 2024-01-25T15:01:42.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.733+0000 7f8f100ec640 1 -- 172.21.15.170:0/1505183341 wait complete. 2024-01-25T15:01:42.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.733+0000 7f8f100ec640 1 Processor -- start 2024-01-25T15:01:42.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.733+0000 7f8f100ec640 1 -- start start 2024-01-25T15:01:42.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.733+0000 7f8f100ec640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f080ff3c0 0x7f8f080fcac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:42.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.733+0000 7f8f100ec640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f081005b0 0x7f8f0819bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:42.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.733+0000 7f8f100ec640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8f08100f70 0x7f8f0819e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:42.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.733+0000 7f8f100ec640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0819e8b0 con 0x7f8f080ff3c0 2024-01-25T15:01:42.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.733+0000 7f8f100ec640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0819ea20 con 0x7f8f081005b0 2024-01-25T15:01:42.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.733+0000 7f8f100ec640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0819ebe0 con 0x7f8f08100f70 2024-01-25T15:01:42.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.733+0000 7f8f0de88640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f080ff3c0 0x7f8f080fcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:42.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.733+0000 7f8f0de88640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f080ff3c0 0x7f8f080fcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33070/0 (socket says 172.21.15.170:33070) 2024-01-25T15:01:42.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.733+0000 7f8f0de88640 1 -- 172.21.15.170:0/106653305 learned_addr learned my addr 172.21.15.170:0/106653305 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:42.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.734+0000 7f8f0e689640 1 --2- 172.21.15.170:0/106653305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8f08100f70 0x7f8f0819e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:42.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.734+0000 7f8f0de88640 1 -- 172.21.15.170:0/106653305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8f08100f70 msgr2=0x7f8f0819e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.734+0000 7f8f0de88640 1 --2- 172.21.15.170:0/106653305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8f08100f70 0x7f8f0819e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.734+0000 7f8f0de88640 1 -- 172.21.15.170:0/106653305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f081005b0 msgr2=0x7f8f0819bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.734+0000 7f8f0de88640 1 --2- 172.21.15.170:0/106653305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f081005b0 0x7f8f0819bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.734+0000 7f8f0de88640 1 -- 172.21.15.170:0/106653305 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00009560 con 0x7f8f080ff3c0 2024-01-25T15:01:42.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.734+0000 7f8f0de88640 1 --2- 172.21.15.170:0/106653305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f080ff3c0 0x7f8f080fcac0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400eaa0 tx=0x7f8f0400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:42.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.734+0000 7f8efeffd640 1 -- 172.21.15.170:0/106653305 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0400ce10 con 0x7f8f080ff3c0 2024-01-25T15:01:42.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.734+0000 7f8efeffd640 1 -- 172.21.15.170:0/106653305 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f04003e30 con 0x7f8f080ff3c0 2024-01-25T15:01:42.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.734+0000 7f8f100ec640 1 -- 172.21.15.170:0/106653305 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0819ee60 con 0x7f8f080ff3c0 2024-01-25T15:01:42.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.734+0000 7f8efeffd640 1 -- 172.21.15.170:0/106653305 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f040116d0 con 0x7f8f080ff3c0 2024-01-25T15:01:42.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.734+0000 7f8f100ec640 1 -- 172.21.15.170:0/106653305 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0819f360 con 0x7f8f080ff3c0 2024-01-25T15:01:42.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.735+0000 7f8f100ec640 1 -- 172.21.15.170:0/106653305 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f08106b70 con 0x7f8f080ff3c0 2024-01-25T15:01:42.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.737+0000 7f8efeffd640 1 -- 172.21.15.170:0/106653305 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f8f04004230 con 0x7f8f080ff3c0 2024-01-25T15:01:42.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.737+0000 7f8efeffd640 1 --2- 172.21.15.170:0/106653305 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8ef40a1360 0x7f8ef40a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:42.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.737+0000 7f8f0d687640 1 --2- 172.21.15.170:0/106653305 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8ef40a1360 0x7f8ef40a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:42.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.737+0000 7f8efeffd640 1 -- 172.21.15.170:0/106653305 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f8f040cd310 con 0x7f8f080ff3c0 2024-01-25T15:01:42.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.738+0000 7f8f0d687640 1 --2- 172.21.15.170:0/106653305 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8ef40a1360 0x7f8ef40a3820 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8f080fc830 tx=0x7f8ef8006c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:42.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.741+0000 7f8efeffd640 1 -- 172.21.15.170:0/106653305 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f8f04096840 con 0x7f8f080ff3c0 2024-01-25T15:01:42.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.947+0000 7f8f100ec640 1 -- 172.21.15.170:0/106653305 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f0810aeb0 con 0x7f8f080ff3c0 2024-01-25T15:01:42.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.947+0000 7f8efeffd640 1 -- 172.21.15.170:0/106653305 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+11411 (secure 0 0 0) 0x7f8f04099e60 con 0x7f8f080ff3c0 2024-01-25T15:01:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:42.948 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-25T14:59:53.534085+0000","modified":"2024-01-25T15:00:00.045800+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24484,"mds_1":24479,"mds_2":24466,"mds_3":24418,"mds_4":24398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":4,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24479":{"gid":24479,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/2132502182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":2132502182},{"type":"v1","addr":"172.21.15.186:6839","nonce":2132502182}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:01:42.949 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 25 2024-01-25T15:01:42.950 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.949+0000 7f8f100ec640 1 -- 172.21.15.170:0/106653305 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8ef40a1360 msgr2=0x7f8ef40a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.949+0000 7f8f100ec640 1 --2- 172.21.15.170:0/106653305 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8ef40a1360 0x7f8ef40a3820 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8f080fc830 tx=0x7f8ef8006c90 comp rx=0 tx=0).stop 2024-01-25T15:01:42.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.949+0000 7f8f100ec640 1 -- 172.21.15.170:0/106653305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f080ff3c0 msgr2=0x7f8f080fcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:42.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.949+0000 7f8f100ec640 1 --2- 172.21.15.170:0/106653305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f080ff3c0 0x7f8f080fcac0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8f0400eaa0 tx=0x7f8f0400ef60 comp rx=0 tx=0).stop 2024-01-25T15:01:42.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.949+0000 7f8f100ec640 1 -- 172.21.15.170:0/106653305 shutdown_connections 2024-01-25T15:01:42.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.949+0000 7f8f100ec640 1 --2- 172.21.15.170:0/106653305 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8ef40a1360 0x7f8ef40a3820 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.949+0000 7f8f100ec640 1 --2- 172.21.15.170:0/106653305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8f081005b0 0x7f8f0819bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.949+0000 7f8f100ec640 1 --2- 172.21.15.170:0/106653305 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8f08100f70 0x7f8f0819e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.949+0000 7f8f100ec640 1 --2- 172.21.15.170:0/106653305 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8f080ff3c0 0x7f8f080fcac0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:42.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.949+0000 7f8f100ec640 1 -- 172.21.15.170:0/106653305 >> 172.21.15.170:0/106653305 conn(0x7f8f080fa930 msgr2=0x7f8f08103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:42.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.950+0000 7f8f100ec640 1 -- 172.21.15.170:0/106653305 shutdown_connections 2024-01-25T15:01:42.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:42.950+0000 7f8f100ec640 1 -- 172.21.15.170:0/106653305 wait complete. 2024-01-25T15:01:42.962 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:01:43.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.063+0000 7fa21fa15640 1 -- 172.21.15.170:0/2243688584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa218101f90 msgr2=0x7fa218102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.063+0000 7fa21fa15640 1 --2- 172.21.15.170:0/2243688584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa218101f90 0x7fa218102410 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa208009900 tx=0x7fa20802bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:43.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.063+0000 7fa21fa15640 1 -- 172.21.15.170:0/2243688584 shutdown_connections 2024-01-25T15:01:43.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.063+0000 7fa21fa15640 1 --2- 172.21.15.170:0/2243688584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa218102950 0x7fa2181091e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.063+0000 7fa21fa15640 1 --2- 172.21.15.170:0/2243688584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa218101f90 0x7fa218102410 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.063+0000 7fa21fa15640 1 --2- 172.21.15.170:0/2243688584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2180fefc0 0x7fa2180ff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.063+0000 7fa21fa15640 1 -- 172.21.15.170:0/2243688584 >> 172.21.15.170:0/2243688584 conn(0x7fa2180fa8f0 msgr2=0x7fa2180fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.063+0000 7fa21fa15640 1 -- 172.21.15.170:0/2243688584 shutdown_connections 2024-01-25T15:01:43.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.063+0000 7fa21fa15640 1 -- 172.21.15.170:0/2243688584 wait complete. 2024-01-25T15:01:43.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.063+0000 7fa21fa15640 1 Processor -- start 2024-01-25T15:01:43.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.063+0000 7fa21fa15640 1 -- start start 2024-01-25T15:01:43.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21fa15640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2180fefc0 0x7fa218196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.067 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21fa15640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa218101f90 0x7fa218197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21fa15640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa218102950 0x7fa21819e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21fa15640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21819e820 con 0x7fa218101f90 2024-01-25T15:01:43.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21fa15640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21819e990 con 0x7fa218102950 2024-01-25T15:01:43.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21fa15640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21819eb50 con 0x7fa2180fefc0 2024-01-25T15:01:43.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21cfb0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa218101f90 0x7fa218197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21cfb0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa218101f90 0x7fa218197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33098/0 (socket says 172.21.15.170:33098) 2024-01-25T15:01:43.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21cfb0640 1 -- 172.21.15.170:0/181587011 learned_addr learned my addr 172.21.15.170:0/181587011 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21dfb2640 1 --2- 172.21.15.170:0/181587011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa218102950 0x7fa21819e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21d7b1640 1 --2- 172.21.15.170:0/181587011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2180fefc0 0x7fa218196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21cfb0640 1 -- 172.21.15.170:0/181587011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2180fefc0 msgr2=0x7fa218196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21cfb0640 1 --2- 172.21.15.170:0/181587011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2180fefc0 0x7fa218196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21cfb0640 1 -- 172.21.15.170:0/181587011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa218102950 msgr2=0x7fa21819e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21cfb0640 1 --2- 172.21.15.170:0/181587011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa218102950 0x7fa21819e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21cfb0640 1 -- 172.21.15.170:0/181587011 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa208009560 con 0x7fa218101f90 2024-01-25T15:01:43.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21d7b1640 1 --2- 172.21.15.170:0/181587011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2180fefc0 0x7fa218196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:43.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21cfb0640 1 --2- 172.21.15.170:0/181587011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa218101f90 0x7fa218197280 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa208005ab0 tx=0x7fa2080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa20e7fc640 1 -- 172.21.15.170:0/181587011 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa208004ac0 con 0x7fa218101f90 2024-01-25T15:01:43.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21fa15640 1 -- 172.21.15.170:0/181587011 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21819edd0 con 0x7fa218101f90 2024-01-25T15:01:43.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa20e7fc640 1 -- 172.21.15.170:0/181587011 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2080044e0 con 0x7fa218101f90 2024-01-25T15:01:43.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa20e7fc640 1 -- 172.21.15.170:0/181587011 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20803e450 con 0x7fa218101f90 2024-01-25T15:01:43.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.064+0000 7fa21fa15640 1 -- 172.21.15.170:0/181587011 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa21819f200 con 0x7fa218101f90 2024-01-25T15:01:43.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.065+0000 7fa21fa15640 1 -- 172.21.15.170:0/181587011 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa218108190 con 0x7fa218101f90 2024-01-25T15:01:43.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.066+0000 7fa20e7fc640 1 -- 172.21.15.170:0/181587011 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fa208004dd0 con 0x7fa218101f90 2024-01-25T15:01:43.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.067+0000 7fa20e7fc640 1 --2- 172.21.15.170:0/181587011 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa2040a12e0 0x7fa2040a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.067+0000 7fa21d7b1640 1 --2- 172.21.15.170:0/181587011 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa2040a12e0 0x7fa2040a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.067+0000 7fa20e7fc640 1 -- 172.21.15.170:0/181587011 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fa2080ef4d0 con 0x7fa218101f90 2024-01-25T15:01:43.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.067+0000 7fa21d7b1640 1 --2- 172.21.15.170:0/181587011 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa2040a12e0 0x7fa2040a37a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa218198210 tx=0x7fa214005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.071+0000 7fa20e7fc640 1 -- 172.21.15.170:0/181587011 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa2080b88f0 con 0x7fa218101f90 2024-01-25T15:01:43.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.247+0000 7fa21fa15640 1 -- 172.21.15.170:0/181587011 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa21802cbc0 con 0x7fa218101f90 2024-01-25T15:01:43.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.248+0000 7fa20e7fc640 1 -- 172.21.15.170:0/181587011 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22550 (secure 0 0 0) 0x7fa208043090 con 0x7fa218101f90 2024-01-25T15:01:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:43.250 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":87,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T15:00:57.274280+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:01:43.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.250+0000 7fa21fa15640 1 -- 172.21.15.170:0/181587011 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa2040a12e0 msgr2=0x7fa2040a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.250+0000 7fa21fa15640 1 --2- 172.21.15.170:0/181587011 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa2040a12e0 0x7fa2040a37a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa218198210 tx=0x7fa214005f90 comp rx=0 tx=0).stop 2024-01-25T15:01:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.250+0000 7fa21fa15640 1 -- 172.21.15.170:0/181587011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa218101f90 msgr2=0x7fa218197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.250+0000 7fa21fa15640 1 --2- 172.21.15.170:0/181587011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa218101f90 0x7fa218197280 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa208005ab0 tx=0x7fa2080042f0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.250+0000 7fa21fa15640 1 -- 172.21.15.170:0/181587011 shutdown_connections 2024-01-25T15:01:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.250+0000 7fa21fa15640 1 --2- 172.21.15.170:0/181587011 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa2040a12e0 0x7fa2040a37a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.250+0000 7fa21fa15640 1 --2- 172.21.15.170:0/181587011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa218102950 0x7fa21819e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.250+0000 7fa21fa15640 1 --2- 172.21.15.170:0/181587011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa218101f90 0x7fa218197280 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.251+0000 7fa21fa15640 1 --2- 172.21.15.170:0/181587011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa2180fefc0 0x7fa218196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.251+0000 7fa21fa15640 1 -- 172.21.15.170:0/181587011 >> 172.21.15.170:0/181587011 conn(0x7fa2180fa8f0 msgr2=0x7fa218105360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.251+0000 7fa21fa15640 1 -- 172.21.15.170:0/181587011 shutdown_connections 2024-01-25T15:01:43.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.251+0000 7fa21fa15640 1 -- 172.21.15.170:0/181587011 wait complete. 2024-01-25T15:01:43.262 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:43 smithi170 ceph-mon[31899]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-01-25T15:01:43.262 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:43 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1308834381' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:43.262 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:43 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/579874824' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:43.262 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:43 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/106653305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:43.264 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-01-25T14:59:53.534085+0000', 'modified': '2024-01-25T15:00:00.045800+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24484, 'mds_1': 24479, 'mds_2': 24466, 'mds_3': 24418, 'mds_4': 24398}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14616': {'gid': 14616, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.170:6839/3528948477', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6838', 'nonce': 3528948477}, {'type': 'v1', 'addr': '172.21.15.170:6839', 'nonce': 3528948477}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14628': {'gid': 14628, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.170:6841/2918388059', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6840', 'nonce': 2918388059}, {'type': 'v1', 'addr': '172.21.15.170:6841', 'nonce': 2918388059}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24398': {'gid': 24398, 'name': 'k', 'rank': 4, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.186:6833/1347511259', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6832', 'nonce': 1347511259}, {'type': 'v1', 'addr': '172.21.15.186:6833', 'nonce': 1347511259}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24418': {'gid': 24418, 'name': 'l', 'rank': 3, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.191:6833/274874056', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6832', 'nonce': 274874056}, {'type': 'v1', 'addr': '172.21.15.191:6833', 'nonce': 274874056}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24428': {'gid': 24428, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6835/2663522449', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6834', 'nonce': 2663522449}, {'type': 'v1', 'addr': '172.21.15.186:6835', 'nonce': 2663522449}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24449': {'gid': 24449, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6837/2382645540', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6836', 'nonce': 2382645540}, {'type': 'v1', 'addr': '172.21.15.186:6837', 'nonce': 2382645540}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24457': {'gid': 24457, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.191:6835/1870775954', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6834', 'nonce': 1870775954}, {'type': 'v1', 'addr': '172.21.15.191:6835', 'nonce': 1870775954}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 2, 'incarnation': 19, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.191:6837/719224494', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6836', 'nonce': 719224494}, {'type': 'v1', 'addr': '172.21.15.191:6837', 'nonce': 719224494}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24479': {'gid': 24479, 'name': 'b', 'rank': 1, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.186:6839/2132502182', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6838', 'nonce': 2132502182}, {'type': 'v1', 'addr': '172.21.15.186:6839', 'nonce': 2132502182}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24484': {'gid': 24484, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.191:6839/2461767313', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.191:6838', 'nonce': 2461767313}, {'type': 'v1', 'addr': '172.21.15.191:6839', 'nonce': 2461767313}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-25T15:01:43.264 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-01-25T15:01:43.264 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2024-01-25T15:01:43.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:43 smithi186 ceph-mon[35697]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-01-25T15:01:43.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:43 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1308834381' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:43.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:43 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/579874824' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:43.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:43 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/106653305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:43.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.367+0000 7f56b5e97640 1 -- 172.21.15.170:0/3895460693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56b00ff680 msgr2=0x7f56b00ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.367+0000 7f56b5e97640 1 --2- 172.21.15.170:0/3895460693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56b00ff680 0x7f56b00ffaa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f56a0009900 tx=0x7f56a002bcd0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.367+0000 7f56b5e97640 1 -- 172.21.15.170:0/3895460693 shutdown_connections 2024-01-25T15:01:43.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.367+0000 7f56b5e97640 1 --2- 172.21.15.170:0/3895460693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56b0100980 0x7f56b0100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.367+0000 7f56b5e97640 1 --2- 172.21.15.170:0/3895460693 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56b00fffe0 0x7f56b0100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.367+0000 7f56b5e97640 1 --2- 172.21.15.170:0/3895460693 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56b00ff680 0x7f56b00ffaa0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.367+0000 7f56b5e97640 1 -- 172.21.15.170:0/3895460693 >> 172.21.15.170:0/3895460693 conn(0x7f56b00fb200 msgr2=0x7f56b00fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.367+0000 7f56b5e97640 1 -- 172.21.15.170:0/3895460693 shutdown_connections 2024-01-25T15:01:43.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.367+0000 7f56b5e97640 1 -- 172.21.15.170:0/3895460693 wait complete. 2024-01-25T15:01:43.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.367+0000 7f56b5e97640 1 Processor -- start 2024-01-25T15:01:43.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56b5e97640 1 -- start start 2024-01-25T15:01:43.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56b5e97640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56b00ff680 0x7f56b0198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56b5e97640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56b00fffe0 0x7f56b0199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56b5e97640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56b0100980 0x7f56b01a04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56b5e97640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b01a0a20 con 0x7f56b0100980 2024-01-25T15:01:43.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56b5e97640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b01a0b90 con 0x7f56b00fffe0 2024-01-25T15:01:43.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56b5e97640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b01a0d50 con 0x7f56b00ff680 2024-01-25T15:01:43.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56affff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56b0100980 0x7f56b01a04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56affff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56b0100980 0x7f56b01a04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33112/0 (socket says 172.21.15.170:33112) 2024-01-25T15:01:43.371 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56affff640 1 -- 172.21.15.170:0/3695161964 learned_addr learned my addr 172.21.15.170:0/3695161964 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56af7fe640 1 --2- 172.21.15.170:0/3695161964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56b00ff680 0x7f56b0198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56affff640 1 -- 172.21.15.170:0/3695161964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56b00ff680 msgr2=0x7f56b0198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56affff640 1 --2- 172.21.15.170:0/3695161964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56b00ff680 0x7f56b0198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56aeffd640 1 --2- 172.21.15.170:0/3695161964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56b00fffe0 0x7f56b0199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56affff640 1 -- 172.21.15.170:0/3695161964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56b00fffe0 msgr2=0x7f56b0199470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56affff640 1 --2- 172.21.15.170:0/3695161964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56b00fffe0 0x7f56b0199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56affff640 1 -- 172.21.15.170:0/3695161964 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a0009560 con 0x7f56b0100980 2024-01-25T15:01:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56affff640 1 --2- 172.21.15.170:0/3695161964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56b0100980 0x7f56b01a04e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f56a800cce0 tx=0x7f56a800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.368+0000 7f56acff9640 1 -- 172.21.15.170:0/3695161964 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a800f450 con 0x7f56b0100980 2024-01-25T15:01:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.369+0000 7f56acff9640 1 -- 172.21.15.170:0/3695161964 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56a800fa70 con 0x7f56b0100980 2024-01-25T15:01:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.369+0000 7f56b5e97640 1 -- 172.21.15.170:0/3695161964 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b01a0fd0 con 0x7f56b0100980 2024-01-25T15:01:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.369+0000 7f56acff9640 1 -- 172.21.15.170:0/3695161964 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a8018b40 con 0x7f56b0100980 2024-01-25T15:01:43.372 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.369+0000 7f56b5e97640 1 -- 172.21.15.170:0/3695161964 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b01a1460 con 0x7f56b0100980 2024-01-25T15:01:43.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.371+0000 7f56acff9640 1 -- 172.21.15.170:0/3695161964 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f56a800fbe0 con 0x7f56b0100980 2024-01-25T15:01:43.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.371+0000 7f56b8a5a740 1 Processor -- start 2024-01-25T15:01:43.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.371+0000 7f56b8a5a740 1 -- start start 2024-01-25T15:01:43.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.371+0000 7f56b8a5a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecd86a0 0x563f3ecd8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.371+0000 7f56b8a5a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd9090 0x563f3ecddb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.371+0000 7f56b8a5a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecde200 0x563f3ece0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.371+0000 7f56b8a5a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3ec47030 con 0x563f3ecd86a0 2024-01-25T15:01:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.371+0000 7f56b8a5a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3ec44720 con 0x563f3ecde200 2024-01-25T15:01:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.371+0000 7f56b8a5a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3ec40010 con 0x563f3ecd9090 2024-01-25T15:01:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.371+0000 7f56acff9640 1 --2- 172.21.15.170:0/3695161964 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f56980a12e0 0x7f56980a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.371+0000 7f56aeffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecd86a0 0x563f3ecd8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.371+0000 7f56aeffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecd86a0 0x563f3ecd8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33120/0 (socket says 172.21.15.170:33120) 2024-01-25T15:01:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.371+0000 7f56aeffd640 1 -- 172.21.15.170:0/1610597318 learned_addr learned my addr 172.21.15.170:0/1610597318 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.371+0000 7f56affff640 1 --2- 172.21.15.170:0/3695161964 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f56980a12e0 0x7f56980a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.372+0000 7f56af7fe640 1 --2- 172.21.15.170:0/1610597318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd9090 0x563f3ecddb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.372+0000 7f56acff9640 1 -- 172.21.15.170:0/3695161964 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f56a80cd400 con 0x7f56b0100980 2024-01-25T15:01:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.372+0000 7f56aeffd640 1 -- 172.21.15.170:0/1610597318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd9090 msgr2=0x563f3ecddb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.372+0000 7f56aeffd640 1 --2- 172.21.15.170:0/1610597318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd9090 0x563f3ecddb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.372+0000 7f56aeffd640 1 -- 172.21.15.170:0/1610597318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecde200 msgr2=0x563f3ece0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.372+0000 7f56aeffd640 1 --2- 172.21.15.170:0/1610597318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecde200 0x563f3ece0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.372+0000 7f56aeffd640 1 -- 172.21.15.170:0/1610597318 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f3ec02680 con 0x563f3ecd86a0 2024-01-25T15:01:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.372+0000 7f56aeffd640 1 --2- 172.21.15.170:0/1610597318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecd86a0 0x563f3ecd8ac0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f56a400bb10 tx=0x7f56a400f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7c95775a82d0c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.372+0000 7f56affff640 1 --2- 172.21.15.170:0/3695161964 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f56980a12e0 0x7f56980a37a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f56a8096fe0 tx=0x7f56a806c620 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.372+0000 7f5695ffb640 1 -- 172.21.15.170:0/1610597318 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a4005020 con 0x563f3ecd86a0 2024-01-25T15:01:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.372+0000 7f5695ffb640 1 -- 172.21.15.170:0/1610597318 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56a4005640 con 0x563f3ecd86a0 2024-01-25T15:01:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.372+0000 7f5695ffb640 1 -- 172.21.15.170:0/1610597318 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a4011720 con 0x563f3ecd86a0 2024-01-25T15:01:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.373+0000 7f56b8a5a740 1 -- 172.21.15.170:0/1610597318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecd86a0 msgr2=0x563f3ecd8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.373+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/1610597318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecd86a0 0x563f3ecd8ac0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f56a400bb10 tx=0x7f56a400f360 comp rx=0 tx=0).stop 2024-01-25T15:01:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.373+0000 7f56b8a5a740 1 -- 172.21.15.170:0/1610597318 shutdown_connections 2024-01-25T15:01:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.373+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/1610597318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecde200 0x563f3ece0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.373+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/1610597318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd9090 0x563f3ecddb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.373+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/1610597318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecd86a0 0x563f3ecd8ac0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.373+0000 7f56b8a5a740 1 -- 172.21.15.170:0/1610597318 >> 172.21.15.170:0/1610597318 conn(0x563f3ecd3c10 msgr2=0x563f3ecd4010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.373+0000 7f56b8a5a740 1 -- 172.21.15.170:0/1610597318 shutdown_connections 2024-01-25T15:01:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.373+0000 7f56b8a5a740 1 -- 172.21.15.170:0/1610597318 wait complete. 2024-01-25T15:01:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.373+0000 7f56b8a5a740 1 -- start start 2024-01-25T15:01:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.373+0000 7f56b8a5a740 1 Processor -- start 2024-01-25T15:01:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.373+0000 7f56b8a5a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd86a0 0x563f3ece2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.373+0000 7f56b8a5a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecd9090 0x563f3ece2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.373+0000 7f56b8a5a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecde200 0x563f3ece9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56b8a5a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3ebf95f0 con 0x563f3ecd9090 2024-01-25T15:01:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56b8a5a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3ebf9290 con 0x563f3ecde200 2024-01-25T15:01:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56b8a5a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3ebbe300 con 0x563f3ecd86a0 2024-01-25T15:01:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56b8a5a740 10 client.0 _ll_register_callbacks cb 0x563f3ebf4260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56af7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecd9090 0x563f3ece2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56af7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecd9090 0x563f3ece2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33132/0 (socket says 172.21.15.170:33132) 2024-01-25T15:01:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56af7fe640 1 -- 172.21.15.170:0/1790720898 learned_addr learned my addr 172.21.15.170:0/1790720898 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.382 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56aeffd640 1 --2- 172.21.15.170:0/1790720898 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd86a0 0x563f3ece2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56aeffd640 1 --2- 172.21.15.170:0/1790720898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecde200 0x563f3ece9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56af7fe640 1 -- 172.21.15.170:0/1790720898 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd86a0 msgr2=0x563f3ece2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56af7fe640 1 --2- 172.21.15.170:0/1790720898 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd86a0 0x563f3ece2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56af7fe640 1 -- 172.21.15.170:0/1790720898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecde200 msgr2=0x563f3ece9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56af7fe640 1 --2- 172.21.15.170:0/1790720898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecde200 0x563f3ece9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56af7fe640 1 -- 172.21.15.170:0/1790720898 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a400b7f0 con 0x563f3ecd9090 2024-01-25T15:01:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56aeffd640 1 --2- 172.21.15.170:0/1790720898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecde200 0x563f3ece9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56af7fe640 1 --2- 172.21.15.170:0/1790720898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecd9090 0x563f3ece2dd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f56a002c6b0 tx=0x7f56a0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92cb97151d2bcd30 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f568effd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f568effd640 1 -- 172.21.15.170:0/1790720898 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a002c920 con 0x563f3ecd9090 2024-01-25T15:01:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f568effd640 1 -- 172.21.15.170:0/1790720898 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f56a002ca80 con 0x563f3ecd9090 2024-01-25T15:01:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56b8a5a740 1 -- 172.21.15.170:0/1790720898 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f3ec38ea0 con 0x563f3ecd9090 2024-01-25T15:01:43.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f568effd640 1 -- 172.21.15.170:0/1790720898 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56a002cc40 con 0x563f3ecd9090 2024-01-25T15:01:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56b8a5a740 10 client.15243 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f56b8a5a740 1 -- 172.21.15.170:0/1790720898 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x563f3ec3e690 con 0x563f3ecd9090 2024-01-25T15:01:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.374+0000 7f568effd640 1 -- 172.21.15.170:0/1790720898 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563f3ec38ea0 con 0x563f3ecd9090 2024-01-25T15:01:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.375+0000 7f568effd640 1 -- 172.21.15.170:0/1790720898 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f56a003c050 con 0x563f3ecd9090 2024-01-25T15:01:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.375+0000 7f56b8a5a740 10 client.15243 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.375+0000 7f56b8a5a740 10 client.15243 resolve_mds: resolved name 'k' to daemon mds.k 2024-01-25T15:01:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.375+0000 7f56b8a5a740 20 client.15243 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.375+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/1790720898 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f3ecefa00 0x563f3ecee490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.375+0000 7f56b8a5a740 4 client.15243 mds_command: new command op to 24398 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:01:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.375+0000 7f56b8a5a740 1 -- 172.21.15.170:0/1790720898 --> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f3ec38bc0 con 0x563f3ecefa00 2024-01-25T15:01:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.375+0000 7f56aeffd640 1 --2- 172.21.15.170:0/1790720898 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f3ecefa00 0x563f3ecee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.375+0000 7f568effd640 10 client.15243 ms_handle_connect on v2:172.21.15.186:6832/1347511259 2024-01-25T15:01:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.375+0000 7f56aeffd640 1 --2- 172.21.15.170:0/1790720898 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f3ecefa00 0x563f3ecee490 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=41f3cccb52465ded server_cookie=ae7e8c75327738ff in_seq=0 out_seq=0 2024-01-25T15:01:43.384 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.376+0000 7f568effd640 1 -- 172.21.15.170:0/1790720898 <== mds.4 v2:172.21.15.186:6832/1347511259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563f3ec38bc0 con 0x563f3ecefa00 2024-01-25T15:01:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.376+0000 7f568effd640 10 client.15243 handle_command_reply: tid=0 2024-01-25T15:01:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.376+0000 7f56b8a5a740 1 client.15243 shutdown 2024-01-25T15:01:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.376+0000 7f56b8a5a740 1 -- 172.21.15.170:0/1790720898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecd9090 msgr2=0x563f3ece2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.376+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/1790720898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecd9090 0x563f3ece2dd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f56a002c6b0 tx=0x7f56a0004270 comp rx=0 tx=0).stop 2024-01-25T15:01:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.376+0000 7f56b8a5a740 1 -- 172.21.15.170:0/1790720898 shutdown_connections 2024-01-25T15:01:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.376+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/1790720898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecde200 0x563f3ece9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.376+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/1790720898 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f3ecefa00 0x563f3ecee490 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.376+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/1790720898 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecd9090 0x563f3ece2dd0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.376+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/1790720898 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd86a0 0x563f3ece2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.376+0000 7f568effd640 0 client.15243 ms_handle_reset on v2:172.21.15.186:6832/1347511259 2024-01-25T15:01:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.376+0000 7f56b8a5a740 1 -- 172.21.15.170:0/1790720898 >> 172.21.15.170:0/1790720898 conn(0x563f3ecd3c10 msgr2=0x563f3ecd2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.377+0000 7f56b8a5a740 1 -- 172.21.15.170:0/1790720898 shutdown_connections 2024-01-25T15:01:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.377+0000 7f56b8a5a740 1 -- 172.21.15.170:0/1790720898 wait complete. 2024-01-25T15:01:43.385 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.377+0000 7f56b8a5a740 20 client.15243 trim_cache size 0 max 16384 2024-01-25T15:01:43.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56b8a5a740 1 Processor -- start 2024-01-25T15:01:43.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56b8a5a740 1 -- start start 2024-01-25T15:01:43.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56b8a5a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecd86a0 0x563f3ece2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56b8a5a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd9090 0x563f3ece9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56b8a5a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecde200 0x563f3ece2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56b8a5a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3ecd3ac0 con 0x563f3ecde200 2024-01-25T15:01:43.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56b8a5a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3ece0d50 con 0x563f3ecd86a0 2024-01-25T15:01:43.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56b8a5a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3ec38bf0 con 0x563f3ecd9090 2024-01-25T15:01:43.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56aeffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecde200 0x563f3ece2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56aeffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecde200 0x563f3ece2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33146/0 (socket says 172.21.15.170:33146) 2024-01-25T15:01:43.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56aeffd640 1 -- 172.21.15.170:0/3877135656 learned_addr learned my addr 172.21.15.170:0/3877135656 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56af7fe640 1 --2- 172.21.15.170:0/3877135656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd9090 0x563f3ece9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56aeffd640 1 -- 172.21.15.170:0/3877135656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd9090 msgr2=0x563f3ece9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56aeffd640 1 --2- 172.21.15.170:0/3877135656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd9090 0x563f3ece9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56aeffd640 1 -- 172.21.15.170:0/3877135656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecd86a0 msgr2=0x563f3ece2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56aeffd640 1 --2- 172.21.15.170:0/3877135656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecd86a0 0x563f3ece2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56aeffd640 1 -- 172.21.15.170:0/3877135656 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f3ebdb390 con 0x563f3ecde200 2024-01-25T15:01:43.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.392+0000 7f56af7fe640 1 --2- 172.21.15.170:0/3877135656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd9090 0x563f3ece9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:43.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.393+0000 7f56aeffd640 1 --2- 172.21.15.170:0/3877135656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecde200 0x563f3ece2dd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f56a4005c00 tx=0x7f56a400f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a1d6f19bc5ddef6 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.393+0000 7f56957fa640 1 -- 172.21.15.170:0/3877135656 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a4004d50 con 0x563f3ecde200 2024-01-25T15:01:43.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.393+0000 7f56957fa640 1 -- 172.21.15.170:0/3877135656 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56a401d070 con 0x563f3ecde200 2024-01-25T15:01:43.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.393+0000 7f56957fa640 1 -- 172.21.15.170:0/3877135656 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a402a810 con 0x563f3ecde200 2024-01-25T15:01:43.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.393+0000 7f56b8a5a740 1 -- 172.21.15.170:0/3877135656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecde200 msgr2=0x563f3ece2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.393+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/3877135656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecde200 0x563f3ece2dd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f56a4005c00 tx=0x7f56a400f360 comp rx=0 tx=0).stop 2024-01-25T15:01:43.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.393+0000 7f56b8a5a740 1 -- 172.21.15.170:0/3877135656 shutdown_connections 2024-01-25T15:01:43.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.393+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/3877135656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecde200 0x563f3ece2dd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.393+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/3877135656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd9090 0x563f3ece9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.393+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/3877135656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecd86a0 0x563f3ece2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.393+0000 7f56b8a5a740 1 -- 172.21.15.170:0/3877135656 >> 172.21.15.170:0/3877135656 conn(0x563f3ecd3c10 msgr2=0x563f3ecda590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.393+0000 7f56b8a5a740 1 -- 172.21.15.170:0/3877135656 shutdown_connections 2024-01-25T15:01:43.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.393+0000 7f56b8a5a740 1 -- 172.21.15.170:0/3877135656 wait complete. 2024-01-25T15:01:43.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56b8a5a740 1 -- start start 2024-01-25T15:01:43.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56b8a5a740 1 Processor -- start 2024-01-25T15:01:43.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56b8a5a740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd86a0 0x563f3ece7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56b8a5a740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecd9090 0x563f3ece7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56b8a5a740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecde200 0x563f3ed4d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56b8a5a740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3ece9fa0 con 0x563f3ecde200 2024-01-25T15:01:43.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56b8a5a740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3ecea110 con 0x563f3ecd9090 2024-01-25T15:01:43.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56b8a5a740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f3ed4d690 con 0x563f3ecd86a0 2024-01-25T15:01:43.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56b8a5a740 10 client.0 _ll_register_callbacks cb 0x7f56a400b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:43.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56aeffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecde200 0x563f3ed4d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56aeffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecde200 0x563f3ed4d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33152/0 (socket says 172.21.15.170:33152) 2024-01-25T15:01:43.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56aeffd640 1 -- 172.21.15.170:0/3072037916 learned_addr learned my addr 172.21.15.170:0/3072037916 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56aeffd640 1 --2- 172.21.15.170:0/3072037916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd86a0 0x563f3ece7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56af7fe640 1 --2- 172.21.15.170:0/3072037916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecd9090 0x563f3ece7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56aeffd640 1 -- 172.21.15.170:0/3072037916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd86a0 msgr2=0x563f3ece7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56aeffd640 1 --2- 172.21.15.170:0/3072037916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd86a0 0x563f3ece7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56aeffd640 1 -- 172.21.15.170:0/3072037916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecd9090 msgr2=0x563f3ece7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56aeffd640 1 --2- 172.21.15.170:0/3072037916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecd9090 0x563f3ece7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.394+0000 7f56aeffd640 1 -- 172.21.15.170:0/3072037916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f3ec02680 con 0x563f3ecde200 2024-01-25T15:01:43.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f56aeffd640 1 --2- 172.21.15.170:0/3072037916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecde200 0x563f3ed4d150 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f56a400bfd0 tx=0x7f56a4005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b980c4ea03ff751c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f568effd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:43.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f568effd640 1 -- 172.21.15.170:0/3072037916 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a4004cd0 con 0x563f3ecde200 2024-01-25T15:01:43.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f568effd640 1 -- 172.21.15.170:0/3072037916 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f56a4000e40 con 0x563f3ecde200 2024-01-25T15:01:43.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f56b8a5a740 1 -- 172.21.15.170:0/3072037916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f56a4005640 con 0x563f3ecde200 2024-01-25T15:01:43.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f568effd640 1 -- 172.21.15.170:0/3072037916 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56a4004e30 con 0x563f3ecde200 2024-01-25T15:01:43.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f56b8a5a740 10 client.15249 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:43.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f56b8a5a740 1 -- 172.21.15.170:0/3072037916 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x563f3ec00ee0 con 0x563f3ecde200 2024-01-25T15:01:43.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f568effd640 1 -- 172.21.15.170:0/3072037916 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56a4005640 con 0x563f3ecde200 2024-01-25T15:01:43.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f568effd640 1 -- 172.21.15.170:0/3072037916 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f56a402ad20 con 0x563f3ecde200 2024-01-25T15:01:43.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f56b8a5a740 10 client.15249 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:43.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f56b8a5a740 10 client.15249 resolve_mds: resolved name 'k' to daemon mds.k 2024-01-25T15:01:43.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f56b8a5a740 20 client.15249 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:43.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/3072037916 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f3ed523f0 0x563f3ed4e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f56b8a5a740 4 client.15249 mds_command: new command op to 24398 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-25T15:01:43.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.395+0000 7f56b8a5a740 1 -- 172.21.15.170:0/3072037916 --> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563f3e93f6c0 con 0x563f3ed523f0 2024-01-25T15:01:43.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f56af7fe640 1 --2- 172.21.15.170:0/3072037916 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f3ed523f0 0x563f3ed4e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f568effd640 10 client.15249 ms_handle_connect on v2:172.21.15.186:6832/1347511259 2024-01-25T15:01:43.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f56af7fe640 1 --2- 172.21.15.170:0/3072037916 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f3ed523f0 0x563f3ed4e890 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=104aea9a0bb4f0e1 server_cookie=3dfeac79bde10c28 in_seq=0 out_seq=0 2024-01-25T15:01:43.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f568effd640 1 -- 172.21.15.170:0/3072037916 <== mds.4 v2:172.21.15.186:6832/1347511259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x563f3e93f6c0 con 0x563f3ed523f0 2024-01-25T15:01:43.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f568effd640 10 client.15249 handle_command_reply: tid=0 2024-01-25T15:01:43.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f56b8a5a740 1 client.15249 shutdown 2024-01-25T15:01:43.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f56b8a5a740 1 -- 172.21.15.170:0/3072037916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecde200 msgr2=0x563f3ed4d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/3072037916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecde200 0x563f3ed4d150 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f56a400bfd0 tx=0x7f56a4005b70 comp rx=0 tx=0).stop 2024-01-25T15:01:43.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f56b8a5a740 1 -- 172.21.15.170:0/3072037916 shutdown_connections 2024-01-25T15:01:43.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/3072037916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f3ecd9090 0x563f3ece7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/3072037916 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f3ed523f0 0x563f3ed4e890 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.403 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/3072037916 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f3ecde200 0x563f3ed4d150 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f568effd640 0 client.15249 ms_handle_reset on v2:172.21.15.186:6832/1347511259 2024-01-25T15:01:43.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f56b8a5a740 1 --2- 172.21.15.170:0/3072037916 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f3ecd86a0 0x563f3ece7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f56b8a5a740 1 -- 172.21.15.170:0/3072037916 >> 172.21.15.170:0/3072037916 conn(0x563f3ecd3c10 msgr2=0x563f3ecda590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f56b8a5a740 1 -- 172.21.15.170:0/3072037916 shutdown_connections 2024-01-25T15:01:43.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f56b8a5a740 1 -- 172.21.15.170:0/3072037916 wait complete. 2024-01-25T15:01:43.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.396+0000 7f56b8a5a740 20 client.15249 trim_cache size 0 max 16384 2024-01-25T15:01:43.404 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:01:43.404 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "267213a8-bb91-11ee-95b2-87774f69a715", 2024-01-25T15:01:43.404 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 4, 2024-01-25T15:01:43.404 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 24398, 2024-01-25T15:01:43.405 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2024-01-25T15:01:43.405 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2024-01-25T15:01:43.405 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs", 2024-01-25T15:01:43.405 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 104.354206148, 2024-01-25T15:01:43.405 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 25, 2024-01-25T15:01:43.405 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 87, 2024-01-25T15:01:43.405 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 85, 2024-01-25T15:01:43.405 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 142.33196438600001 2024-01-25T15:01:43.405 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:01:43.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.397+0000 7f56b5e97640 1 -- 172.21.15.170:0/3695161964 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f56980a12e0 msgr2=0x7f56980a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.397+0000 7f56b5e97640 1 --2- 172.21.15.170:0/3695161964 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f56980a12e0 0x7f56980a37a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f56a8096fe0 tx=0x7f56a806c620 comp rx=0 tx=0).stop 2024-01-25T15:01:43.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.397+0000 7f56b5e97640 1 -- 172.21.15.170:0/3695161964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56b0100980 msgr2=0x7f56b01a04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.397+0000 7f56b5e97640 1 --2- 172.21.15.170:0/3695161964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56b0100980 0x7f56b01a04e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f56a800cce0 tx=0x7f56a800a620 comp rx=0 tx=0).stop 2024-01-25T15:01:43.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.397+0000 7f56b5e97640 1 -- 172.21.15.170:0/3695161964 shutdown_connections 2024-01-25T15:01:43.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.397+0000 7f56b5e97640 1 --2- 172.21.15.170:0/3695161964 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f56980a12e0 0x7f56980a37a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.397+0000 7f56b5e97640 1 --2- 172.21.15.170:0/3695161964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f56b00fffe0 0x7f56b0199470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.397+0000 7f56b5e97640 1 --2- 172.21.15.170:0/3695161964 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f56b0100980 0x7f56b01a04e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.397+0000 7f56b5e97640 1 --2- 172.21.15.170:0/3695161964 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f56b00ff680 0x7f56b0198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.397+0000 7f56b5e97640 1 -- 172.21.15.170:0/3695161964 >> 172.21.15.170:0/3695161964 conn(0x7f56b00fb200 msgr2=0x7f56b00fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.397+0000 7f56b5e97640 1 -- 172.21.15.170:0/3695161964 shutdown_connections 2024-01-25T15:01:43.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.397+0000 7f56b5e97640 1 -- 172.21.15.170:0/3695161964 wait complete. 2024-01-25T15:01:43.409 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2024-01-25T15:01:43.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:43 smithi191 ceph-mon[36347]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-01-25T15:01:43.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:43 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1308834381' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:43.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:43 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/579874824' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:43.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:43 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/106653305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:43.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.510+0000 7f9758f9a640 1 -- 172.21.15.170:0/1555857045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97541017a0 msgr2=0x7f9754108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.510+0000 7f9758f9a640 1 --2- 172.21.15.170:0/1555857045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97541017a0 0x7f9754108030 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f974c009ca0 tx=0x7f974c02c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.511+0000 7f9758f9a640 1 -- 172.21.15.170:0/1555857045 shutdown_connections 2024-01-25T15:01:43.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.511+0000 7f9758f9a640 1 --2- 172.21.15.170:0/1555857045 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9754100de0 0x7f9754101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.511+0000 7f9758f9a640 1 --2- 172.21.15.170:0/1555857045 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97541017a0 0x7f9754108030 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.511+0000 7f9758f9a640 1 --2- 172.21.15.170:0/1555857045 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97540ffbf0 0x7f9754100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.511+0000 7f9758f9a640 1 -- 172.21.15.170:0/1555857045 >> 172.21.15.170:0/1555857045 conn(0x7f97540fb180 msgr2=0x7f97540fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.511+0000 7f9758f9a640 1 -- 172.21.15.170:0/1555857045 shutdown_connections 2024-01-25T15:01:43.514 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.511+0000 7f9758f9a640 1 -- 172.21.15.170:0/1555857045 wait complete. 2024-01-25T15:01:43.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.511+0000 7f9758f9a640 1 Processor -- start 2024-01-25T15:01:43.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.511+0000 7f9758f9a640 1 -- start start 2024-01-25T15:01:43.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.511+0000 7f9758f9a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97540ffbf0 0x7f9754068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.511+0000 7f9758f9a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9754100de0 0x7f975419b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.511+0000 7f9758f9a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97541017a0 0x7f975419dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.511+0000 7f9758f9a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975419e760 con 0x7f9754100de0 2024-01-25T15:01:43.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.511+0000 7f9758f9a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975419e8d0 con 0x7f97540ffbf0 2024-01-25T15:01:43.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.511+0000 7f9758f9a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975419ea90 con 0x7f97541017a0 2024-01-25T15:01:43.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f9751d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9754100de0 0x7f975419b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f9751d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9754100de0 0x7f975419b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33182/0 (socket says 172.21.15.170:33182) 2024-01-25T15:01:43.515 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f9751d9b640 1 -- 172.21.15.170:0/2758145907 learned_addr learned my addr 172.21.15.170:0/2758145907 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f9752d9d640 1 --2- 172.21.15.170:0/2758145907 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97541017a0 0x7f975419dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f975259c640 1 --2- 172.21.15.170:0/2758145907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97540ffbf0 0x7f9754068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f9751d9b640 1 -- 172.21.15.170:0/2758145907 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97541017a0 msgr2=0x7f975419dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f9751d9b640 1 --2- 172.21.15.170:0/2758145907 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97541017a0 0x7f975419dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f9751d9b640 1 -- 172.21.15.170:0/2758145907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97540ffbf0 msgr2=0x7f9754068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f9751d9b640 1 --2- 172.21.15.170:0/2758145907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97540ffbf0 0x7f9754068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f9751d9b640 1 -- 172.21.15.170:0/2758145907 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c009900 con 0x7f9754100de0 2024-01-25T15:01:43.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f975259c640 1 --2- 172.21.15.170:0/2758145907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97540ffbf0 0x7f9754068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:43.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f9751d9b640 1 --2- 172.21.15.170:0/2758145907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9754100de0 0x7f975419b960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f974400c890 tx=0x7f974400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f97437fe640 1 -- 172.21.15.170:0/2758145907 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9744004220 con 0x7f9754100de0 2024-01-25T15:01:43.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f9758f9a640 1 -- 172.21.15.170:0/2758145907 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975419ed70 con 0x7f9754100de0 2024-01-25T15:01:43.516 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f97437fe640 1 -- 172.21.15.170:0/2758145907 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9744007e70 con 0x7f9754100de0 2024-01-25T15:01:43.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f97437fe640 1 -- 172.21.15.170:0/2758145907 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9744005690 con 0x7f9754100de0 2024-01-25T15:01:43.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.512+0000 7f9758f9a640 1 -- 172.21.15.170:0/2758145907 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975419f220 con 0x7f9754100de0 2024-01-25T15:01:43.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.514+0000 7f97437fe640 1 -- 172.21.15.170:0/2758145907 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f97440079b0 con 0x7f9754100de0 2024-01-25T15:01:43.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f975bc33740 1 Processor -- start 2024-01-25T15:01:43.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f97437fe640 1 --2- 172.21.15.170:0/2758145907 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f973c0a12e0 0x7f973c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f97437fe640 1 -- 172.21.15.170:0/2758145907 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f97440cc820 con 0x7f9754100de0 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f9752d9d640 1 --2- 172.21.15.170:0/2758145907 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f973c0a12e0 0x7f973c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f975bc33740 1 -- start start 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f975bc33740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06bc6a0 0x55d0a06bcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f975bc33740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bd090 0x55d0a06c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f975bc33740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06c2200 0x55d0a06c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f975bc33740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a062b030 con 0x55d0a06bc6a0 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f975bc33740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a0628720 con 0x55d0a06bd090 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f975bc33740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a0624010 con 0x55d0a06c2200 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f975259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06bc6a0 0x55d0a06bcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f975259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06bc6a0 0x55d0a06bcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33188/0 (socket says 172.21.15.170:33188) 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f975259c640 1 -- 172.21.15.170:0/275301699 learned_addr learned my addr 172.21.15.170:0/275301699 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f9752d9d640 1 --2- 172.21.15.170:0/2758145907 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f973c0a12e0 0x7f973c0a37a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f974c005e30 tx=0x7f974c032690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.515+0000 7f9751d9b640 1 --2- 172.21.15.170:0/275301699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bd090 0x55d0a06c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.516+0000 7f9752d9d640 1 --2- 172.21.15.170:0/275301699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06c2200 0x55d0a06c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.516+0000 7f975259c640 1 -- 172.21.15.170:0/275301699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06c2200 msgr2=0x55d0a06c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.516+0000 7f975259c640 1 --2- 172.21.15.170:0/275301699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06c2200 0x55d0a06c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.516+0000 7f975259c640 1 -- 172.21.15.170:0/275301699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bd090 msgr2=0x55d0a06c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.516+0000 7f975259c640 1 --2- 172.21.15.170:0/275301699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bd090 0x55d0a06c1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.516+0000 7f975259c640 1 -- 172.21.15.170:0/275301699 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0a05e6680 con 0x55d0a06bc6a0 2024-01-25T15:01:43.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.516+0000 7f975259c640 1 --2- 172.21.15.170:0/275301699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06bc6a0 0x55d0a06bcac0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f974800bd30 tx=0x7f974800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da717ffcb950e6b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.516+0000 7f9740ff9640 1 -- 172.21.15.170:0/275301699 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974801a660 con 0x55d0a06bc6a0 2024-01-25T15:01:43.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.516+0000 7f9740ff9640 1 -- 172.21.15.170:0/275301699 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f974800be20 con 0x55d0a06bc6a0 2024-01-25T15:01:43.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.516+0000 7f9740ff9640 1 -- 172.21.15.170:0/275301699 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9748010650 con 0x55d0a06bc6a0 2024-01-25T15:01:43.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 -- 172.21.15.170:0/275301699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06bc6a0 msgr2=0x55d0a06bcac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 --2- 172.21.15.170:0/275301699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06bc6a0 0x55d0a06bcac0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f974800bd30 tx=0x7f974800f730 comp rx=0 tx=0).stop 2024-01-25T15:01:43.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 -- 172.21.15.170:0/275301699 shutdown_connections 2024-01-25T15:01:43.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 --2- 172.21.15.170:0/275301699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bd090 0x55d0a06c1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 --2- 172.21.15.170:0/275301699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06c2200 0x55d0a06c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 --2- 172.21.15.170:0/275301699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06bc6a0 0x55d0a06bcac0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 -- 172.21.15.170:0/275301699 >> 172.21.15.170:0/275301699 conn(0x55d0a06b7c10 msgr2=0x55d0a06b8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 -- 172.21.15.170:0/275301699 shutdown_connections 2024-01-25T15:01:43.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 -- 172.21.15.170:0/275301699 wait complete. 2024-01-25T15:01:43.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 -- start start 2024-01-25T15:01:43.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 Processor -- start 2024-01-25T15:01:43.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bc6a0 0x55d0a06c6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06bd090 0x55d0a06c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06c2200 0x55d0a06cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a05dd5f0 con 0x55d0a06bd090 2024-01-25T15:01:43.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a05dd290 con 0x55d0a06bc6a0 2024-01-25T15:01:43.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a05a2300 con 0x55d0a06c2200 2024-01-25T15:01:43.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f9751d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06bd090 0x55d0a06c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f975bc33740 10 client.0 _ll_register_callbacks cb 0x55d0a05d8260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:43.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f9751d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06bd090 0x55d0a06c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33204/0 (socket says 172.21.15.170:33204) 2024-01-25T15:01:43.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.517+0000 7f9751d9b640 1 -- 172.21.15.170:0/945114266 learned_addr learned my addr 172.21.15.170:0/945114266 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f9752d9d640 1 --2- 172.21.15.170:0/945114266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06c2200 0x55d0a06cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f975259c640 1 --2- 172.21.15.170:0/945114266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bc6a0 0x55d0a06c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f9751d9b640 1 -- 172.21.15.170:0/945114266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06c2200 msgr2=0x55d0a06cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f9751d9b640 1 --2- 172.21.15.170:0/945114266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06c2200 0x55d0a06cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f9751d9b640 1 -- 172.21.15.170:0/945114266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bc6a0 msgr2=0x55d0a06c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f9751d9b640 1 --2- 172.21.15.170:0/945114266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bc6a0 0x55d0a06c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f9751d9b640 1 -- 172.21.15.170:0/945114266 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974800b960 con 0x55d0a06bd090 2024-01-25T15:01:43.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f9752d9d640 1 --2- 172.21.15.170:0/945114266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06c2200 0x55d0a06cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:43.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f9751d9b640 1 --2- 172.21.15.170:0/945114266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06bd090 0x55d0a06c6d90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f97440058c0 tx=0x7f9744004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4334f7c58847585 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f9739ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:43.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f9739ffb640 1 -- 172.21.15.170:0/945114266 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974409dae0 con 0x55d0a06bd090 2024-01-25T15:01:43.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f9739ffb640 1 -- 172.21.15.170:0/945114266 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f97440a1d20 con 0x55d0a06bd090 2024-01-25T15:01:43.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f975bc33740 1 -- 172.21.15.170:0/945114266 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d0a061cea0 con 0x55d0a06bd090 2024-01-25T15:01:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f9739ffb640 1 -- 172.21.15.170:0/945114266 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97440b90d0 con 0x55d0a06bd090 2024-01-25T15:01:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f975bc33740 10 client.15261 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f975bc33740 1 -- 172.21.15.170:0/945114266 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55d0a0622690 con 0x55d0a06bd090 2024-01-25T15:01:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f9739ffb640 1 -- 172.21.15.170:0/945114266 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d0a061cea0 con 0x55d0a06bd090 2024-01-25T15:01:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f9739ffb640 1 -- 172.21.15.170:0/945114266 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f97440b3070 con 0x55d0a06bd090 2024-01-25T15:01:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f975bc33740 10 client.15261 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f975bc33740 10 client.15261 resolve_mds: resolved name 'l' to daemon mds.l 2024-01-25T15:01:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f975bc33740 20 client.15261 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f975bc33740 1 --2- 172.21.15.170:0/945114266 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55d0a06d39e0 0x55d0a06d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f975bc33740 4 client.15261 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:01:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.518+0000 7f975bc33740 1 -- 172.21.15.170:0/945114266 --> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d0a061cbc0 con 0x55d0a06d39e0 2024-01-25T15:01:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.519+0000 7f975259c640 1 --2- 172.21.15.170:0/945114266 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55d0a06d39e0 0x55d0a06d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.519+0000 7f975259c640 1 --2- 172.21.15.170:0/945114266 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55d0a06d39e0 0x55d0a06d24b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=92b36eefb9a54366 server_cookie=c1219f9e08695444 in_seq=0 out_seq=0 2024-01-25T15:01:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.519+0000 7f9739ffb640 10 client.15261 ms_handle_connect on v2:172.21.15.191:6832/274874056 2024-01-25T15:01:43.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.520+0000 7f9739ffb640 1 -- 172.21.15.170:0/945114266 <== mds.3 v2:172.21.15.191:6832/274874056 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d0a061cbc0 con 0x55d0a06d39e0 2024-01-25T15:01:43.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.520+0000 7f9739ffb640 10 client.15261 handle_command_reply: tid=0 2024-01-25T15:01:43.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.520+0000 7f975bc33740 1 client.15261 shutdown 2024-01-25T15:01:43.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.520+0000 7f975bc33740 1 -- 172.21.15.170:0/945114266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06bd090 msgr2=0x55d0a06c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.520+0000 7f975bc33740 1 --2- 172.21.15.170:0/945114266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06bd090 0x55d0a06c6d90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f97440058c0 tx=0x7f9744004380 comp rx=0 tx=0).stop 2024-01-25T15:01:43.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.520+0000 7f975bc33740 1 -- 172.21.15.170:0/945114266 shutdown_connections 2024-01-25T15:01:43.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.520+0000 7f975bc33740 1 --2- 172.21.15.170:0/945114266 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55d0a06d39e0 0x55d0a06d24b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.520+0000 7f975bc33740 1 --2- 172.21.15.170:0/945114266 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06c2200 0x55d0a06cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.520+0000 7f9739ffb640 0 client.15261 ms_handle_reset on v2:172.21.15.191:6832/274874056 2024-01-25T15:01:43.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.520+0000 7f975bc33740 1 --2- 172.21.15.170:0/945114266 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06bd090 0x55d0a06c6d90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.520+0000 7f975bc33740 1 --2- 172.21.15.170:0/945114266 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bc6a0 0x55d0a06c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.520+0000 7f975bc33740 1 -- 172.21.15.170:0/945114266 >> 172.21.15.170:0/945114266 conn(0x55d0a06b7c10 msgr2=0x55d0a06b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.520+0000 7f975bc33740 1 -- 172.21.15.170:0/945114266 shutdown_connections 2024-01-25T15:01:43.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.520+0000 7f975bc33740 1 -- 172.21.15.170:0/945114266 wait complete. 2024-01-25T15:01:43.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.520+0000 7f975bc33740 20 client.15261 trim_cache size 0 max 16384 2024-01-25T15:01:43.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.535+0000 7f975bc33740 1 Processor -- start 2024-01-25T15:01:43.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.535+0000 7f975bc33740 1 -- start start 2024-01-25T15:01:43.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f975bc33740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06b7c10 0x55d0a06c6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f975bc33740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06bc6a0 0x55d0a06cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f975bc33740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bd090 0x55d0a06c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f975bc33740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a06bccd0 con 0x55d0a06b7c10 2024-01-25T15:01:43.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f975bc33740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a06b32a0 con 0x55d0a06bd090 2024-01-25T15:01:43.543 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f975bc33740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a061cbc0 con 0x55d0a06bc6a0 2024-01-25T15:01:43.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f975259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06b7c10 0x55d0a06c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f975259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06b7c10 0x55d0a06c6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33208/0 (socket says 172.21.15.170:33208) 2024-01-25T15:01:43.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f975259c640 1 -- 172.21.15.170:0/3637892556 learned_addr learned my addr 172.21.15.170:0/3637892556 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f9751d9b640 1 --2- 172.21.15.170:0/3637892556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06bc6a0 0x55d0a06cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f975259c640 1 -- 172.21.15.170:0/3637892556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06bc6a0 msgr2=0x55d0a06cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f975259c640 1 --2- 172.21.15.170:0/3637892556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06bc6a0 0x55d0a06cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f9752d9d640 1 --2- 172.21.15.170:0/3637892556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bd090 0x55d0a06c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f975259c640 1 -- 172.21.15.170:0/3637892556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bd090 msgr2=0x55d0a06c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f975259c640 1 --2- 172.21.15.170:0/3637892556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bd090 0x55d0a06c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f975259c640 1 -- 172.21.15.170:0/3637892556 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0a05bf390 con 0x55d0a06b7c10 2024-01-25T15:01:43.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f9751d9b640 1 --2- 172.21.15.170:0/3637892556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06bc6a0 0x55d0a06cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:43.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f9752d9d640 1 --2- 172.21.15.170:0/3637892556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bd090 0x55d0a06c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:43.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f975259c640 1 --2- 172.21.15.170:0/3637892556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06b7c10 0x55d0a06c6850 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9748000c00 tx=0x7f974800b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b50f93514f030b4 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f973bfff640 1 -- 172.21.15.170:0/3637892556 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974802a070 con 0x55d0a06b7c10 2024-01-25T15:01:43.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f973bfff640 1 -- 172.21.15.170:0/3637892556 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9748021040 con 0x55d0a06b7c10 2024-01-25T15:01:43.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.536+0000 7f973bfff640 1 -- 172.21.15.170:0/3637892556 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97480263c0 con 0x55d0a06b7c10 2024-01-25T15:01:43.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 -- 172.21.15.170:0/3637892556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06b7c10 msgr2=0x55d0a06c6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 --2- 172.21.15.170:0/3637892556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06b7c10 0x55d0a06c6850 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9748000c00 tx=0x7f974800b620 comp rx=0 tx=0).stop 2024-01-25T15:01:43.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 -- 172.21.15.170:0/3637892556 shutdown_connections 2024-01-25T15:01:43.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 --2- 172.21.15.170:0/3637892556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bd090 0x55d0a06c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 --2- 172.21.15.170:0/3637892556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06bc6a0 0x55d0a06cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 --2- 172.21.15.170:0/3637892556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06b7c10 0x55d0a06c6850 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 -- 172.21.15.170:0/3637892556 >> 172.21.15.170:0/3637892556 conn(0x55d0a06c6410 msgr2=0x55d0a06be550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 -- 172.21.15.170:0/3637892556 shutdown_connections 2024-01-25T15:01:43.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 -- 172.21.15.170:0/3637892556 wait complete. 2024-01-25T15:01:43.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 -- start start 2024-01-25T15:01:43.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 Processor -- start 2024-01-25T15:01:43.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06b7c10 0x55d0a06cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bc6a0 0x55d0a06cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06bd090 0x55d0a06cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a06cd210 con 0x55d0a06b7c10 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a06cd380 con 0x55d0a06bc6a0 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0a06cd540 con 0x55d0a06bd090 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975bc33740 10 client.0 _ll_register_callbacks cb 0x7f974800b4c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06b7c10 0x55d0a06cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06b7c10 0x55d0a06cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33210/0 (socket says 172.21.15.170:33210) 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.537+0000 7f975259c640 1 -- 172.21.15.170:0/1236165492 learned_addr learned my addr 172.21.15.170:0/1236165492 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f9751d9b640 1 --2- 172.21.15.170:0/1236165492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bc6a0 0x55d0a06cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f9752d9d640 1 --2- 172.21.15.170:0/1236165492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06bd090 0x55d0a06cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f975259c640 1 -- 172.21.15.170:0/1236165492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06bd090 msgr2=0x55d0a06cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f975259c640 1 --2- 172.21.15.170:0/1236165492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06bd090 0x55d0a06cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f975259c640 1 -- 172.21.15.170:0/1236165492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bc6a0 msgr2=0x55d0a06cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f975259c640 1 --2- 172.21.15.170:0/1236165492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bc6a0 0x55d0a06cbd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f975259c640 1 -- 172.21.15.170:0/1236165492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d0a05e6680 con 0x55d0a06b7c10 2024-01-25T15:01:43.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f9751d9b640 1 --2- 172.21.15.170:0/1236165492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bc6a0 0x55d0a06cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:43.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f9752d9d640 1 --2- 172.21.15.170:0/1236165492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06bd090 0x55d0a06cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:43.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f975259c640 1 --2- 172.21.15.170:0/1236165492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06b7c10 0x55d0a06cb820 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f974800b910 tx=0x7f9748005a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dccb4d3ddb62818 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f9739ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:43.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f9739ffb640 1 -- 172.21.15.170:0/1236165492 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974802a030 con 0x55d0a06b7c10 2024-01-25T15:01:43.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f9739ffb640 1 -- 172.21.15.170:0/1236165492 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f974802b070 con 0x55d0a06b7c10 2024-01-25T15:01:43.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f975bc33740 1 -- 172.21.15.170:0/1236165492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d0a06d36f0 con 0x55d0a06b7c10 2024-01-25T15:01:43.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f9739ffb640 1 -- 172.21.15.170:0/1236165492 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97480044b0 con 0x55d0a06b7c10 2024-01-25T15:01:43.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f975bc33740 10 client.15267 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:43.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f975bc33740 1 -- 172.21.15.170:0/1236165492 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55d0a05e4ee0 con 0x55d0a06b7c10 2024-01-25T15:01:43.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f9739ffb640 1 -- 172.21.15.170:0/1236165492 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d0a06d36f0 con 0x55d0a06b7c10 2024-01-25T15:01:43.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f9739ffb640 1 -- 172.21.15.170:0/1236165492 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9748011600 con 0x55d0a06b7c10 2024-01-25T15:01:43.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f975bc33740 10 client.15267 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:43.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f975bc33740 10 client.15267 resolve_mds: resolved name 'l' to daemon mds.l 2024-01-25T15:01:43.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f975bc33740 20 client.15267 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:43.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.538+0000 7f975bc33740 1 --2- 172.21.15.170:0/1236165492 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55d0a06c2200 0x55d0a072aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f975bc33740 4 client.15267 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-25T15:01:43.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f975bc33740 1 -- 172.21.15.170:0/1236165492 --> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f974800be20 con 0x55d0a06c2200 2024-01-25T15:01:43.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f9751d9b640 1 --2- 172.21.15.170:0/1236165492 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55d0a06c2200 0x55d0a072aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f9739ffb640 10 client.15267 ms_handle_connect on v2:172.21.15.191:6832/274874056 2024-01-25T15:01:43.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f9751d9b640 1 --2- 172.21.15.170:0/1236165492 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55d0a06c2200 0x55d0a072aec0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=45ed4a3da3963c9a server_cookie=dc352fbe5ed1baef in_seq=0 out_seq=0 2024-01-25T15:01:43.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f9739ffb640 1 -- 172.21.15.170:0/1236165492 <== mds.3 v2:172.21.15.191:6832/274874056 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7f974800be20 con 0x55d0a06c2200 2024-01-25T15:01:43.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f9739ffb640 10 client.15267 handle_command_reply: tid=0 2024-01-25T15:01:43.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f975bc33740 1 client.15267 shutdown 2024-01-25T15:01:43.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f975bc33740 1 -- 172.21.15.170:0/1236165492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06b7c10 msgr2=0x55d0a06cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f975bc33740 1 --2- 172.21.15.170:0/1236165492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06b7c10 0x55d0a06cb820 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f974800b910 tx=0x7f9748005a70 comp rx=0 tx=0).stop 2024-01-25T15:01:43.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f975bc33740 1 -- 172.21.15.170:0/1236165492 shutdown_connections 2024-01-25T15:01:43.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f975bc33740 1 --2- 172.21.15.170:0/1236165492 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55d0a06c2200 0x55d0a072aec0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f975bc33740 1 --2- 172.21.15.170:0/1236165492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d0a06bc6a0 0x55d0a06cbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f975bc33740 1 --2- 172.21.15.170:0/1236165492 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0a06bd090 0x55d0a06cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f9739ffb640 0 client.15267 ms_handle_reset on v2:172.21.15.191:6832/274874056 2024-01-25T15:01:43.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f975bc33740 1 --2- 172.21.15.170:0/1236165492 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0a06b7c10 0x55d0a06cb820 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.539+0000 7f975bc33740 1 -- 172.21.15.170:0/1236165492 >> 172.21.15.170:0/1236165492 conn(0x55d0a06c6410 msgr2=0x55d0a06be550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.540+0000 7f975bc33740 1 -- 172.21.15.170:0/1236165492 shutdown_connections 2024-01-25T15:01:43.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.540+0000 7f975bc33740 1 -- 172.21.15.170:0/1236165492 wait complete. 2024-01-25T15:01:43.549 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.540+0000 7f975bc33740 20 client.15267 trim_cache size 0 max 16384 2024-01-25T15:01:43.549 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:01:43.549 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "267213a8-bb91-11ee-95b2-87774f69a715", 2024-01-25T15:01:43.549 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 3, 2024-01-25T15:01:43.549 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 24418, 2024-01-25T15:01:43.550 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2024-01-25T15:01:43.550 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2024-01-25T15:01:43.550 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs", 2024-01-25T15:01:43.550 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 105.502136311, 2024-01-25T15:01:43.550 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 25, 2024-01-25T15:01:43.550 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 87, 2024-01-25T15:01:43.550 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 85, 2024-01-25T15:01:43.550 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 145.39818404600001 2024-01-25T15:01:43.550 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:01:43.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.540+0000 7f9758f9a640 1 -- 172.21.15.170:0/2758145907 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f973c0a12e0 msgr2=0x7f973c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.540+0000 7f9758f9a640 1 --2- 172.21.15.170:0/2758145907 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f973c0a12e0 0x7f973c0a37a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f974c005e30 tx=0x7f974c032690 comp rx=0 tx=0).stop 2024-01-25T15:01:43.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.540+0000 7f9758f9a640 1 -- 172.21.15.170:0/2758145907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9754100de0 msgr2=0x7f975419b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.540+0000 7f9758f9a640 1 --2- 172.21.15.170:0/2758145907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9754100de0 0x7f975419b960 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f974400c890 tx=0x7f974400cd50 comp rx=0 tx=0).stop 2024-01-25T15:01:43.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.540+0000 7f9758f9a640 1 -- 172.21.15.170:0/2758145907 shutdown_connections 2024-01-25T15:01:43.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.540+0000 7f9758f9a640 1 --2- 172.21.15.170:0/2758145907 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f973c0a12e0 0x7f973c0a37a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.540+0000 7f9758f9a640 1 --2- 172.21.15.170:0/2758145907 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97541017a0 0x7f975419dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.540+0000 7f9758f9a640 1 --2- 172.21.15.170:0/2758145907 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9754100de0 0x7f975419b960 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.551 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.540+0000 7f9758f9a640 1 --2- 172.21.15.170:0/2758145907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97540ffbf0 0x7f9754068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.540+0000 7f9758f9a640 1 -- 172.21.15.170:0/2758145907 >> 172.21.15.170:0/2758145907 conn(0x7f97540fb180 msgr2=0x7f9754104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.540+0000 7f9758f9a640 1 -- 172.21.15.170:0/2758145907 shutdown_connections 2024-01-25T15:01:43.552 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.540+0000 7f9758f9a640 1 -- 172.21.15.170:0/2758145907 wait complete. 2024-01-25T15:01:43.553 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-25T15:01:43.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.654+0000 7f23f9305640 1 -- 172.21.15.170:0/1008470666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23f4101830 msgr2=0x7f23f4103c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.654+0000 7f23f9305640 1 --2- 172.21.15.170:0/1008470666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23f4101830 0x7f23f4103c20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009ca0 tx=0x7f23e402c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.654+0000 7f23f9305640 1 -- 172.21.15.170:0/1008470666 shutdown_connections 2024-01-25T15:01:43.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.654+0000 7f23f9305640 1 --2- 172.21.15.170:0/1008470666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23f4104160 0x7f23f4106550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.654+0000 7f23f9305640 1 --2- 172.21.15.170:0/1008470666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23f4106a90 0x7f23f4108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.654+0000 7f23f9305640 1 --2- 172.21.15.170:0/1008470666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23f4101830 0x7f23f4103c20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.654+0000 7f23f9305640 1 -- 172.21.15.170:0/1008470666 >> 172.21.15.170:0/1008470666 conn(0x7f23f40fb1a0 msgr2=0x7f23f40fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.654+0000 7f23f9305640 1 -- 172.21.15.170:0/1008470666 shutdown_connections 2024-01-25T15:01:43.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.654+0000 7f23f9305640 1 -- 172.21.15.170:0/1008470666 wait complete. 2024-01-25T15:01:43.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.654+0000 7f23f9305640 1 Processor -- start 2024-01-25T15:01:43.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.654+0000 7f23f9305640 1 -- start start 2024-01-25T15:01:43.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.654+0000 7f23f9305640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23f4101830 0x7f23f4196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.654+0000 7f23f9305640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23f4104160 0x7f23f4197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f9305640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23f4106a90 0x7f23f419e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f9305640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f419e820 con 0x7f23f4101830 2024-01-25T15:01:43.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f9305640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f419e990 con 0x7f23f4106a90 2024-01-25T15:01:43.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f9305640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f419eb50 con 0x7f23f4104160 2024-01-25T15:01:43.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23f4101830 0x7f23f4196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23f4101830 0x7f23f4196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33236/0 (socket says 172.21.15.170:33236) 2024-01-25T15:01:43.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f2ffd640 1 -- 172.21.15.170:0/516155812 learned_addr learned my addr 172.21.15.170:0/516155812 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f37fe640 1 --2- 172.21.15.170:0/516155812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23f4106a90 0x7f23f419e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f2ffd640 1 -- 172.21.15.170:0/516155812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23f4104160 msgr2=0x7f23f4197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f2ffd640 1 --2- 172.21.15.170:0/516155812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23f4104160 0x7f23f4197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f2ffd640 1 -- 172.21.15.170:0/516155812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23f4106a90 msgr2=0x7f23f419e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f2ffd640 1 --2- 172.21.15.170:0/516155812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23f4106a90 0x7f23f419e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f2ffd640 1 -- 172.21.15.170:0/516155812 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e4009900 con 0x7f23f4101830 2024-01-25T15:01:43.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f37fe640 1 --2- 172.21.15.170:0/516155812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23f4106a90 0x7f23f419e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:43.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f2ffd640 1 --2- 172.21.15.170:0/516155812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23f4101830 0x7f23f4196d40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f23e40325c0 tx=0x7f23e4032a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23dbfff640 1 -- 172.21.15.170:0/516155812 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e4003970 con 0x7f23f4101830 2024-01-25T15:01:43.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f9305640 1 -- 172.21.15.170:0/516155812 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f419edd0 con 0x7f23f4101830 2024-01-25T15:01:43.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23dbfff640 1 -- 172.21.15.170:0/516155812 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23e4004040 con 0x7f23f4101830 2024-01-25T15:01:43.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23dbfff640 1 -- 172.21.15.170:0/516155812 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e403d650 con 0x7f23f4101830 2024-01-25T15:01:43.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.655+0000 7f23f9305640 1 -- 172.21.15.170:0/516155812 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f419f210 con 0x7f23f4101830 2024-01-25T15:01:43.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.657+0000 7f23dbfff640 1 -- 172.21.15.170:0/516155812 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f23e403b040 con 0x7f23f4101830 2024-01-25T15:01:43.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.657+0000 7f23fbfa0740 1 Processor -- start 2024-01-25T15:01:43.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23fbfa0740 1 -- start start 2024-01-25T15:01:43.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23dbfff640 1 --2- 172.21.15.170:0/516155812 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f23dc0a12e0 0x7f23dc0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23fbfa0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc6e4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23fbfa0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e5090 0x5629fc6e9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23fbfa0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 0x5629fc6ec690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23fbfa0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fc653030 con 0x5629fc6e46a0 2024-01-25T15:01:43.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23fbfa0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fc650720 con 0x5629fc6e5090 2024-01-25T15:01:43.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23fbfa0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fc64c010 con 0x5629fc6ea200 2024-01-25T15:01:43.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23f2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc6e4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23f37fe640 1 --2- 172.21.15.170:0/516155812 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f23dc0a12e0 0x7f23dc0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23f2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc6e4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33252/0 (socket says 172.21.15.170:33252) 2024-01-25T15:01:43.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23f2ffd640 1 -- 172.21.15.170:0/1142541031 learned_addr learned my addr 172.21.15.170:0/1142541031 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23dbfff640 1 -- 172.21.15.170:0/516155812 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f23e40ef4f0 con 0x7f23f4101830 2024-01-25T15:01:43.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23f27fc640 1 --2- 172.21.15.170:0/1142541031 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e5090 0x5629fc6e9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23f37fe640 1 --2- 172.21.15.170:0/1142541031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 0x5629fc6ec690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23f2ffd640 1 -- 172.21.15.170:0/1142541031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 msgr2=0x5629fc6ec690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23f2ffd640 1 --2- 172.21.15.170:0/1142541031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 0x5629fc6ec690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23f2ffd640 1 -- 172.21.15.170:0/1142541031 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e5090 msgr2=0x5629fc6e9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23f2ffd640 1 --2- 172.21.15.170:0/1142541031 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e5090 0x5629fc6e9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23f2ffd640 1 -- 172.21.15.170:0/1142541031 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629fc60e680 con 0x5629fc6e46a0 2024-01-25T15:01:43.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23f37fe640 1 --2- 172.21.15.170:0/1142541031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 0x5629fc6ec690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:43.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23f2ffd640 1 --2- 172.21.15.170:0/1142541031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc6e4ac0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f23e40b8ad0 tx=0x7f23e40093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bff87487a18eb7b server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23f37fe640 1 --2- 172.21.15.170:0/516155812 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f23dc0a12e0 0x7f23dc0a37a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00bce0 tx=0x7f23ec00b4b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23d97fa640 1 -- 172.21.15.170:0/1142541031 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e40a70d0 con 0x5629fc6e46a0 2024-01-25T15:01:43.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23d97fa640 1 -- 172.21.15.170:0/1142541031 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23e40ba840 con 0x5629fc6e46a0 2024-01-25T15:01:43.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.658+0000 7f23d97fa640 1 -- 172.21.15.170:0/1142541031 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e40c07b0 con 0x5629fc6e46a0 2024-01-25T15:01:43.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.659+0000 7f23fbfa0740 1 -- 172.21.15.170:0/1142541031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 msgr2=0x5629fc6e4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.659+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/1142541031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc6e4ac0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f23e40b8ad0 tx=0x7f23e40093f0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.659+0000 7f23fbfa0740 1 -- 172.21.15.170:0/1142541031 shutdown_connections 2024-01-25T15:01:43.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.659+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/1142541031 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e5090 0x5629fc6e9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.659+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/1142541031 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 0x5629fc6ec690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.659+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/1142541031 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc6e4ac0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.659+0000 7f23fbfa0740 1 -- 172.21.15.170:0/1142541031 >> 172.21.15.170:0/1142541031 conn(0x5629fc6dfc10 msgr2=0x5629fc6e0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.659+0000 7f23fbfa0740 1 -- 172.21.15.170:0/1142541031 shutdown_connections 2024-01-25T15:01:43.669 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.659+0000 7f23fbfa0740 1 -- 172.21.15.170:0/1142541031 wait complete. 2024-01-25T15:01:43.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.659+0000 7f23fbfa0740 1 -- start start 2024-01-25T15:01:43.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.659+0000 7f23fbfa0740 1 Processor -- start 2024-01-25T15:01:43.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23fbfa0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc6ee4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23fbfa0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e5090 0x5629fc6eea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23fbfa0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 0x5629fc6f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23fbfa0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fc6055f0 con 0x5629fc6e46a0 2024-01-25T15:01:43.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23fbfa0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fc605290 con 0x5629fc6e5090 2024-01-25T15:01:43.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23fbfa0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fc5ca300 con 0x5629fc6ea200 2024-01-25T15:01:43.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23fbfa0740 10 client.0 _ll_register_callbacks cb 0x5629fc600260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:43.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23f2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc6ee4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23f2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc6ee4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33258/0 (socket says 172.21.15.170:33258) 2024-01-25T15:01:43.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23f2ffd640 1 -- 172.21.15.170:0/2874599724 learned_addr learned my addr 172.21.15.170:0/2874599724 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23f27fc640 1 --2- 172.21.15.170:0/2874599724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e5090 0x5629fc6eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.670 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23f37fe640 1 --2- 172.21.15.170:0/2874599724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 0x5629fc6f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23f2ffd640 1 -- 172.21.15.170:0/2874599724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 msgr2=0x5629fc6f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23f2ffd640 1 --2- 172.21.15.170:0/2874599724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 0x5629fc6f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23f2ffd640 1 -- 172.21.15.170:0/2874599724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e5090 msgr2=0x5629fc6eea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23f2ffd640 1 --2- 172.21.15.170:0/2874599724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e5090 0x5629fc6eea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23f2ffd640 1 -- 172.21.15.170:0/2874599724 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f419f210 con 0x5629fc6e46a0 2024-01-25T15:01:43.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23f37fe640 1 --2- 172.21.15.170:0/2874599724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 0x5629fc6f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:43.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23f27fc640 1 --2- 172.21.15.170:0/2874599724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e5090 0x5629fc6eea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:43.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23f2ffd640 1 --2- 172.21.15.170:0/2874599724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc6ee4d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009dc0 tx=0x7f23e40b8a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303f3ec14f65dd39 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:43.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23d6ff5640 1 -- 172.21.15.170:0/2874599724 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e40bcd60 con 0x5629fc6e46a0 2024-01-25T15:01:43.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23d6ff5640 1 -- 172.21.15.170:0/2874599724 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f23e40c1cd0 con 0x5629fc6e46a0 2024-01-25T15:01:43.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23fbfa0740 1 -- 172.21.15.170:0/2874599724 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629fc644ea0 con 0x5629fc6e46a0 2024-01-25T15:01:43.671 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23d6ff5640 1 -- 172.21.15.170:0/2874599724 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23e40c49f0 con 0x5629fc6e46a0 2024-01-25T15:01:43.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23fbfa0740 10 client.15279 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:43.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.660+0000 7f23fbfa0740 1 -- 172.21.15.170:0/2874599724 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5629fc64a690 con 0x5629fc6e46a0 2024-01-25T15:01:43.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.661+0000 7f23d6ff5640 1 -- 172.21.15.170:0/2874599724 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5629fc644ea0 con 0x5629fc6e46a0 2024-01-25T15:01:43.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.661+0000 7f23d6ff5640 1 -- 172.21.15.170:0/2874599724 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f23e40c41f0 con 0x5629fc6e46a0 2024-01-25T15:01:43.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.661+0000 7f23fbfa0740 10 client.15279 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:43.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.661+0000 7f23fbfa0740 10 client.15279 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-25T15:01:43.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.661+0000 7f23fbfa0740 20 client.15279 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:43.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.661+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/2874599724 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5629fc6fb230 0x5629fc6f9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.661+0000 7f23fbfa0740 4 client.15279 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:01:43.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.661+0000 7f23fbfa0740 1 -- 172.21.15.170:0/2874599724 --> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5629fc644bc0 con 0x5629fc6fb230 2024-01-25T15:01:43.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.661+0000 7f23f27fc640 1 --2- 172.21.15.170:0/2874599724 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5629fc6fb230 0x5629fc6f9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.661+0000 7f23d6ff5640 10 client.15279 ms_handle_connect on v2:172.21.15.191:6836/719224494 2024-01-25T15:01:43.672 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.661+0000 7f23f27fc640 1 --2- 172.21.15.170:0/2874599724 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5629fc6fb230 0x5629fc6f9eb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e6182145dc03ecbe server_cookie=a7694118c0bf137e in_seq=0 out_seq=0 2024-01-25T15:01:43.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.662+0000 7f23d6ff5640 1 -- 172.21.15.170:0/2874599724 <== mds.2 v2:172.21.15.191:6836/719224494 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5629fc644bc0 con 0x5629fc6fb230 2024-01-25T15:01:43.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.662+0000 7f23d6ff5640 10 client.15279 handle_command_reply: tid=0 2024-01-25T15:01:43.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.662+0000 7f23fbfa0740 1 client.15279 shutdown 2024-01-25T15:01:43.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.662+0000 7f23fbfa0740 1 -- 172.21.15.170:0/2874599724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 msgr2=0x5629fc6ee4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.662+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/2874599724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc6ee4d0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009dc0 tx=0x7f23e40b8a40 comp rx=0 tx=0).stop 2024-01-25T15:01:43.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.662+0000 7f23fbfa0740 1 -- 172.21.15.170:0/2874599724 shutdown_connections 2024-01-25T15:01:43.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.662+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/2874599724 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5629fc6fb230 0x5629fc6f9eb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.662+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/2874599724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e5090 0x5629fc6eea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.662+0000 7f23d6ff5640 0 client.15279 ms_handle_reset on v2:172.21.15.191:6836/719224494 2024-01-25T15:01:43.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.662+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/2874599724 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 0x5629fc6f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.662+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/2874599724 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc6ee4d0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.662+0000 7f23fbfa0740 1 -- 172.21.15.170:0/2874599724 >> 172.21.15.170:0/2874599724 conn(0x5629fc6dfc10 msgr2=0x5629fc6deda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.662+0000 7f23fbfa0740 1 -- 172.21.15.170:0/2874599724 shutdown_connections 2024-01-25T15:01:43.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.662+0000 7f23fbfa0740 1 -- 172.21.15.170:0/2874599724 wait complete. 2024-01-25T15:01:43.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.662+0000 7f23fbfa0740 20 client.15279 trim_cache size 0 max 16384 2024-01-25T15:01:43.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23fbfa0740 1 Processor -- start 2024-01-25T15:01:43.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23fbfa0740 1 -- start start 2024-01-25T15:01:43.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23fbfa0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc702a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23fbfa0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e5090 0x5629fc6f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23fbfa0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 0x5629fc6dfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23fbfa0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fc6f66d0 con 0x5629fc6e46a0 2024-01-25T15:01:43.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23fbfa0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fc6ec820 con 0x5629fc6e5090 2024-01-25T15:01:43.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23fbfa0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fc6e5d60 con 0x5629fc6ea200 2024-01-25T15:01:43.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23f2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc702a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23f2ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc702a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33272/0 (socket says 172.21.15.170:33272) 2024-01-25T15:01:43.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23f2ffd640 1 -- 172.21.15.170:0/120901360 learned_addr learned my addr 172.21.15.170:0/120901360 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23f2ffd640 1 -- 172.21.15.170:0/120901360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 msgr2=0x5629fc6dfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23f2ffd640 1 --2- 172.21.15.170:0/120901360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 0x5629fc6dfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23f2ffd640 1 -- 172.21.15.170:0/120901360 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e5090 msgr2=0x5629fc6f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23f2ffd640 1 --2- 172.21.15.170:0/120901360 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e5090 0x5629fc6f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23f2ffd640 1 -- 172.21.15.170:0/120901360 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629fc5e7390 con 0x5629fc6e46a0 2024-01-25T15:01:43.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23f2ffd640 1 --2- 172.21.15.170:0/120901360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc702a10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f23e40b8ad0 tx=0x7f23e40bac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b26e8cc027daae server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23d8ff9640 1 -- 172.21.15.170:0/120901360 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e40ef370 con 0x5629fc6e46a0 2024-01-25T15:01:43.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23d8ff9640 1 -- 172.21.15.170:0/120901360 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23e40bcd60 con 0x5629fc6e46a0 2024-01-25T15:01:43.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.678+0000 7f23d8ff9640 1 -- 172.21.15.170:0/120901360 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e40c4160 con 0x5629fc6e46a0 2024-01-25T15:01:43.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.679+0000 7f23fbfa0740 1 -- 172.21.15.170:0/120901360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 msgr2=0x5629fc702a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.679+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/120901360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc702a10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f23e40b8ad0 tx=0x7f23e40bac10 comp rx=0 tx=0).stop 2024-01-25T15:01:43.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.679+0000 7f23fbfa0740 1 -- 172.21.15.170:0/120901360 shutdown_connections 2024-01-25T15:01:43.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.679+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/120901360 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e5090 0x5629fc6f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.679+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/120901360 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6ea200 0x5629fc6dfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.679+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/120901360 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6e46a0 0x5629fc702a10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.679+0000 7f23fbfa0740 1 -- 172.21.15.170:0/120901360 >> 172.21.15.170:0/120901360 conn(0x5629fc6dfc10 msgr2=0x5629fc6ee0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.679+0000 7f23fbfa0740 1 -- 172.21.15.170:0/120901360 shutdown_connections 2024-01-25T15:01:43.688 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.679+0000 7f23fbfa0740 1 -- 172.21.15.170:0/120901360 wait complete. 2024-01-25T15:01:43.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.679+0000 7f23fbfa0740 1 -- start start 2024-01-25T15:01:43.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.679+0000 7f23fbfa0740 1 Processor -- start 2024-01-25T15:01:43.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23fbfa0740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e46a0 0x5629fc6f2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23fbfa0740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6e5090 0x5629fc6f2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23fbfa0740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6ea200 0x5629fc750170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23fbfa0740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fc6f5b90 con 0x5629fc6ea200 2024-01-25T15:01:43.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23fbfa0740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fc6f5d00 con 0x5629fc6e46a0 2024-01-25T15:01:43.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23fbfa0740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629fc7506b0 con 0x5629fc6e5090 2024-01-25T15:01:43.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23fbfa0740 10 client.0 _ll_register_callbacks cb 0x7f23e4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:43.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23f37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6ea200 0x5629fc750170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23f37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6ea200 0x5629fc750170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33288/0 (socket says 172.21.15.170:33288) 2024-01-25T15:01:43.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23f37fe640 1 -- 172.21.15.170:0/3265387364 learned_addr learned my addr 172.21.15.170:0/3265387364 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23f37fe640 1 -- 172.21.15.170:0/3265387364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6e5090 msgr2=0x5629fc6f2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.689 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23f37fe640 1 --2- 172.21.15.170:0/3265387364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6e5090 0x5629fc6f2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23f37fe640 1 -- 172.21.15.170:0/3265387364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e46a0 msgr2=0x5629fc6f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23f37fe640 1 --2- 172.21.15.170:0/3265387364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e46a0 0x5629fc6f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23f37fe640 1 -- 172.21.15.170:0/3265387364 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629fc64a690 con 0x5629fc6ea200 2024-01-25T15:01:43.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23f37fe640 1 --2- 172.21.15.170:0/3265387364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6ea200 0x5629fc750170 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0128e0 tx=0x7f23ec005cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda06ccb080eb717 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:43.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23d6ff5640 1 -- 172.21.15.170:0/3265387364 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec012e60 con 0x5629fc6ea200 2024-01-25T15:01:43.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23d6ff5640 1 -- 172.21.15.170:0/3265387364 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f23ec011b50 con 0x5629fc6ea200 2024-01-25T15:01:43.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23fbfa0740 1 -- 172.21.15.170:0/3265387364 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f23e40ba840 con 0x5629fc6ea200 2024-01-25T15:01:43.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23d6ff5640 1 -- 172.21.15.170:0/3265387364 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23ec011d10 con 0x5629fc6ea200 2024-01-25T15:01:43.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23fbfa0740 10 client.15285 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:43.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.680+0000 7f23fbfa0740 1 -- 172.21.15.170:0/3265387364 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5629fc60cee0 con 0x5629fc6ea200 2024-01-25T15:01:43.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.681+0000 7f23d6ff5640 1 -- 172.21.15.170:0/3265387364 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23e40ba840 con 0x5629fc6ea200 2024-01-25T15:01:43.690 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.681+0000 7f23d6ff5640 1 -- 172.21.15.170:0/3265387364 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f23ec00b050 con 0x5629fc6ea200 2024-01-25T15:01:43.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.681+0000 7f23fbfa0740 10 client.15285 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:43.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.681+0000 7f23fbfa0740 10 client.15285 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-25T15:01:43.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.681+0000 7f23fbfa0740 20 client.15285 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:43.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.681+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/3265387364 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5629fc7559d0 0x5629fc751db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.681+0000 7f23fbfa0740 4 client.15285 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-25T15:01:43.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.681+0000 7f23fbfa0740 1 -- 172.21.15.170:0/3265387364 --> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5629fc34b6c0 con 0x5629fc7559d0 2024-01-25T15:01:43.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.681+0000 7f23f2ffd640 1 --2- 172.21.15.170:0/3265387364 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5629fc7559d0 0x5629fc751db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.681+0000 7f23f2ffd640 1 --2- 172.21.15.170:0/3265387364 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5629fc7559d0 0x5629fc751db0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=248879e4e5d3d252 server_cookie=e2a3e0d75f70bdc2 in_seq=0 out_seq=0 2024-01-25T15:01:43.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.681+0000 7f23d6ff5640 10 client.15285 ms_handle_connect on v2:172.21.15.191:6836/719224494 2024-01-25T15:01:43.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23d6ff5640 1 -- 172.21.15.170:0/3265387364 <== mds.2 v2:172.21.15.191:6836/719224494 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5629fc34b6c0 con 0x5629fc7559d0 2024-01-25T15:01:43.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23d6ff5640 10 client.15285 handle_command_reply: tid=0 2024-01-25T15:01:43.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23fbfa0740 1 client.15285 shutdown 2024-01-25T15:01:43.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23fbfa0740 1 -- 172.21.15.170:0/3265387364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6ea200 msgr2=0x5629fc750170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/3265387364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6ea200 0x5629fc750170 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0128e0 tx=0x7f23ec005cd0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.691 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23fbfa0740 1 -- 172.21.15.170:0/3265387364 shutdown_connections 2024-01-25T15:01:43.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/3265387364 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5629fc7559d0 0x5629fc751db0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/3265387364 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5629fc6ea200 0x5629fc750170 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/3265387364 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5629fc6e5090 0x5629fc6f2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23d6ff5640 0 client.15285 ms_handle_reset on v2:172.21.15.191:6836/719224494 2024-01-25T15:01:43.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23fbfa0740 1 --2- 172.21.15.170:0/3265387364 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5629fc6e46a0 0x5629fc6f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23fbfa0740 1 -- 172.21.15.170:0/3265387364 >> 172.21.15.170:0/3265387364 conn(0x5629fc6dfc10 msgr2=0x5629fc6deda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23fbfa0740 1 -- 172.21.15.170:0/3265387364 shutdown_connections 2024-01-25T15:01:43.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23fbfa0740 1 -- 172.21.15.170:0/3265387364 wait complete. 2024-01-25T15:01:43.692 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23fbfa0740 20 client.15285 trim_cache size 0 max 16384 2024-01-25T15:01:43.692 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:01:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "267213a8-bb91-11ee-95b2-87774f69a715", 2024-01-25T15:01:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 2, 2024-01-25T15:01:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 24466, 2024-01-25T15:01:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2024-01-25T15:01:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2024-01-25T15:01:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs", 2024-01-25T15:01:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 106.463495241, 2024-01-25T15:01:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 25, 2024-01-25T15:01:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 87, 2024-01-25T15:01:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 85, 2024-01-25T15:01:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 129.08396117199999 2024-01-25T15:01:43.693 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:01:43.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23f9305640 1 -- 172.21.15.170:0/516155812 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f23dc0a12e0 msgr2=0x7f23dc0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23f9305640 1 --2- 172.21.15.170:0/516155812 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f23dc0a12e0 0x7f23dc0a37a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f23ec00bce0 tx=0x7f23ec00b4b0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23f9305640 1 -- 172.21.15.170:0/516155812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23f4101830 msgr2=0x7f23f4196d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23f9305640 1 --2- 172.21.15.170:0/516155812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23f4101830 0x7f23f4196d40 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f23e40325c0 tx=0x7f23e4032a90 comp rx=0 tx=0).stop 2024-01-25T15:01:43.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23f9305640 1 -- 172.21.15.170:0/516155812 shutdown_connections 2024-01-25T15:01:43.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23f9305640 1 --2- 172.21.15.170:0/516155812 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f23dc0a12e0 0x7f23dc0a37a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23f9305640 1 --2- 172.21.15.170:0/516155812 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f23f4106a90 0x7f23f419e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23f9305640 1 --2- 172.21.15.170:0/516155812 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f23f4104160 0x7f23f4197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23f9305640 1 --2- 172.21.15.170:0/516155812 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f23f4101830 0x7f23f4196d40 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23f9305640 1 -- 172.21.15.170:0/516155812 >> 172.21.15.170:0/516155812 conn(0x7f23f40fb1a0 msgr2=0x7f23f4102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23f9305640 1 -- 172.21.15.170:0/516155812 shutdown_connections 2024-01-25T15:01:43.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.682+0000 7f23f9305640 1 -- 172.21.15.170:0/516155812 wait complete. 2024-01-25T15:01:43.696 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-25T15:01:43.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.797+0000 7f540dda9640 1 -- 172.21.15.170:0/29770157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5408101810 msgr2=0x7f5408103c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.797+0000 7f540dda9640 1 --2- 172.21.15.170:0/29770157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5408101810 0x7f5408103c00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5400009ca0 tx=0x7f540002c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.797+0000 7f540dda9640 1 -- 172.21.15.170:0/29770157 shutdown_connections 2024-01-25T15:01:43.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.797+0000 7f540dda9640 1 --2- 172.21.15.170:0/29770157 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5408106a70 0x7f5408108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.797+0000 7f540dda9640 1 --2- 172.21.15.170:0/29770157 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5408104140 0x7f5408106530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.797+0000 7f540dda9640 1 --2- 172.21.15.170:0/29770157 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5408101810 0x7f5408103c00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.797+0000 7f540dda9640 1 -- 172.21.15.170:0/29770157 >> 172.21.15.170:0/29770157 conn(0x7f54080fb180 msgr2=0x7f54080fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.797+0000 7f540dda9640 1 -- 172.21.15.170:0/29770157 shutdown_connections 2024-01-25T15:01:43.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.797+0000 7f540dda9640 1 -- 172.21.15.170:0/29770157 wait complete. 2024-01-25T15:01:43.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.798+0000 7f540dda9640 1 Processor -- start 2024-01-25T15:01:43.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.798+0000 7f540dda9640 1 -- start start 2024-01-25T15:01:43.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.798+0000 7f540dda9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5408101810 0x7f5408196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.798+0000 7f540dda9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5408104140 0x7f54081972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.798+0000 7f540dda9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5408106a70 0x7f540819e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.798+0000 7f540dda9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540819e8a0 con 0x7f5408106a70 2024-01-25T15:01:43.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.798+0000 7f540dda9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540819ea10 con 0x7f5408101810 2024-01-25T15:01:43.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.798+0000 7f540dda9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540819ebd0 con 0x7f5408104140 2024-01-25T15:01:43.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.798+0000 7f5407fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5408106a70 0x7f540819e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.798+0000 7f5407fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5408106a70 0x7f540819e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33296/0 (socket says 172.21.15.170:33296) 2024-01-25T15:01:43.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.798+0000 7f5407fff640 1 -- 172.21.15.170:0/226802473 learned_addr learned my addr 172.21.15.170:0/226802473 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.799+0000 7f5406ffd640 1 --2- 172.21.15.170:0/226802473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5408104140 0x7f54081972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.799+0000 7f54077fe640 1 --2- 172.21.15.170:0/226802473 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5408101810 0x7f5408196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.799+0000 7f5407fff640 1 -- 172.21.15.170:0/226802473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5408104140 msgr2=0x7f54081972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.799+0000 7f5407fff640 1 --2- 172.21.15.170:0/226802473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5408104140 0x7f54081972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.799+0000 7f5407fff640 1 -- 172.21.15.170:0/226802473 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5408101810 msgr2=0x7f5408196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.799+0000 7f5407fff640 1 --2- 172.21.15.170:0/226802473 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5408101810 0x7f5408196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.799+0000 7f5407fff640 1 -- 172.21.15.170:0/226802473 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5400009900 con 0x7f5408106a70 2024-01-25T15:01:43.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.799+0000 7f5406ffd640 1 --2- 172.21.15.170:0/226802473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5408104140 0x7f54081972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:43.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.799+0000 7f5407fff640 1 --2- 172.21.15.170:0/226802473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5408106a70 0x7f540819e360 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c970 tx=0x7f53f800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.799+0000 7f5404ff9640 1 -- 172.21.15.170:0/226802473 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f8007bb0 con 0x7f5408106a70 2024-01-25T15:01:43.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.799+0000 7f5404ff9640 1 -- 172.21.15.170:0/226802473 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53f8007d10 con 0x7f5408106a70 2024-01-25T15:01:43.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.799+0000 7f540dda9640 1 -- 172.21.15.170:0/226802473 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540819eeb0 con 0x7f5408106a70 2024-01-25T15:01:43.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.799+0000 7f5404ff9640 1 -- 172.21.15.170:0/226802473 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f8004e20 con 0x7f5408106a70 2024-01-25T15:01:43.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.799+0000 7f540dda9640 1 -- 172.21.15.170:0/226802473 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540819f360 con 0x7f5408106a70 2024-01-25T15:01:43.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.801+0000 7f5404ff9640 1 -- 172.21.15.170:0/226802473 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f53f8005000 con 0x7f5408106a70 2024-01-25T15:01:43.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.801+0000 7f5410968740 1 Processor -- start 2024-01-25T15:01:43.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.801+0000 7f5410968740 1 -- start start 2024-01-25T15:01:43.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.801+0000 7f5410968740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16b56a0 0x5576f16b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.811 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5410968740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16b6090 0x5576f16bab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5410968740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16bb200 0x5576f16bd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5410968740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f1624030 con 0x5576f16bb200 2024-01-25T15:01:43.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5410968740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f1621720 con 0x5576f16b6090 2024-01-25T15:01:43.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5410968740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f161d010 con 0x5576f16b56a0 2024-01-25T15:01:43.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5406ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16bb200 0x5576f16bd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5406ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16bb200 0x5576f16bd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33308/0 (socket says 172.21.15.170:33308) 2024-01-25T15:01:43.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5406ffd640 1 -- 172.21.15.170:0/2895598771 learned_addr learned my addr 172.21.15.170:0/2895598771 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5404ff9640 1 --2- 172.21.15.170:0/226802473 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f53f40a12e0 0x7f53f40a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f54077fe640 1 --2- 172.21.15.170:0/2895598771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16b6090 0x5576f16bab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5406ffd640 1 --2- 172.21.15.170:0/2895598771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16b56a0 0x5576f16b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.812 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5407fff640 1 --2- 172.21.15.170:0/226802473 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f53f40a12e0 0x7f53f40a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5406ffd640 1 -- 172.21.15.170:0/2895598771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16b56a0 msgr2=0x5576f16b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5406ffd640 1 --2- 172.21.15.170:0/2895598771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16b56a0 0x5576f16b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5406ffd640 1 -- 172.21.15.170:0/2895598771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16b6090 msgr2=0x5576f16bab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5406ffd640 1 --2- 172.21.15.170:0/2895598771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16b6090 0x5576f16bab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5406ffd640 1 -- 172.21.15.170:0/2895598771 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576f15df680 con 0x5576f16bb200 2024-01-25T15:01:43.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5404ff9640 1 -- 172.21.15.170:0/226802473 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f53f80cc880 con 0x7f5408106a70 2024-01-25T15:01:43.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5406ffd640 1 --2- 172.21.15.170:0/2895598771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16bb200 0x5576f16bd690 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f53f000ad90 tx=0x7f53f000a4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3add9b1e6a9c8f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f53fdffb640 1 -- 172.21.15.170:0/2895598771 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f000fdf0 con 0x5576f16bb200 2024-01-25T15:01:43.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f53fdffb640 1 -- 172.21.15.170:0/2895598771 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53f000c070 con 0x5576f16bb200 2024-01-25T15:01:43.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f53fdffb640 1 -- 172.21.15.170:0/2895598771 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f00146a0 con 0x5576f16bb200 2024-01-25T15:01:43.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.802+0000 7f5407fff640 1 --2- 172.21.15.170:0/226802473 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f53f40a12e0 0x7f53f40a37a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f53f80996f0 tx=0x7f53f80c3ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.813 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.803+0000 7f5410968740 1 -- 172.21.15.170:0/2895598771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16bb200 msgr2=0x5576f16bd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.803+0000 7f5410968740 1 --2- 172.21.15.170:0/2895598771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16bb200 0x5576f16bd690 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f53f000ad90 tx=0x7f53f000a4f0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.803+0000 7f5410968740 1 -- 172.21.15.170:0/2895598771 shutdown_connections 2024-01-25T15:01:43.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.803+0000 7f5410968740 1 --2- 172.21.15.170:0/2895598771 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16b6090 0x5576f16bab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.803+0000 7f5410968740 1 --2- 172.21.15.170:0/2895598771 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16bb200 0x5576f16bd690 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.803+0000 7f5410968740 1 --2- 172.21.15.170:0/2895598771 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16b56a0 0x5576f16b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.803+0000 7f5410968740 1 -- 172.21.15.170:0/2895598771 >> 172.21.15.170:0/2895598771 conn(0x5576f16b0c10 msgr2=0x5576f16b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.803+0000 7f5410968740 1 -- 172.21.15.170:0/2895598771 shutdown_connections 2024-01-25T15:01:43.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.803+0000 7f5410968740 1 -- 172.21.15.170:0/2895598771 wait complete. 2024-01-25T15:01:43.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.803+0000 7f5410968740 1 -- start start 2024-01-25T15:01:43.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f5410968740 1 Processor -- start 2024-01-25T15:01:43.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f5410968740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16b56a0 0x5576f16bf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.814 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f5410968740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16b6090 0x5576f16bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f5410968740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16bb200 0x5576f16c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f5410968740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f15d65f0 con 0x5576f16b6090 2024-01-25T15:01:43.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f5410968740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f15d6290 con 0x5576f16bb200 2024-01-25T15:01:43.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f5410968740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f159b300 con 0x5576f16b56a0 2024-01-25T15:01:43.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f5410968740 10 client.0 _ll_register_callbacks cb 0x5576f15d1260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:43.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f54077fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16b6090 0x5576f16bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f54077fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16b6090 0x5576f16bfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33314/0 (socket says 172.21.15.170:33314) 2024-01-25T15:01:43.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f54077fe640 1 -- 172.21.15.170:0/4289252180 learned_addr learned my addr 172.21.15.170:0/4289252180 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f5406ffd640 1 --2- 172.21.15.170:0/4289252180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16bb200 0x5576f16c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f54077fe640 1 -- 172.21.15.170:0/4289252180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16b56a0 msgr2=0x5576f16bf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f54077fe640 1 --2- 172.21.15.170:0/4289252180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16b56a0 0x5576f16bf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f54077fe640 1 -- 172.21.15.170:0/4289252180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16bb200 msgr2=0x5576f16c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f54077fe640 1 --2- 172.21.15.170:0/4289252180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16bb200 0x5576f16c6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f54077fe640 1 -- 172.21.15.170:0/4289252180 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f000e040 con 0x5576f16b6090 2024-01-25T15:01:43.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f54077fe640 1 --2- 172.21.15.170:0/4289252180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16b6090 0x5576f16bfdd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f540002c700 tx=0x7f5400032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e8022b582f4969 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f53e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:43.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f53e6ffd640 1 -- 172.21.15.170:0/4289252180 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5400034a70 con 0x5576f16b6090 2024-01-25T15:01:43.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f53e6ffd640 1 -- 172.21.15.170:0/4289252180 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f5400034bd0 con 0x5576f16b6090 2024-01-25T15:01:43.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f5410968740 1 -- 172.21.15.170:0/4289252180 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5576f1615ea0 con 0x5576f16b6090 2024-01-25T15:01:43.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f53e6ffd640 1 -- 172.21.15.170:0/4289252180 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5400034d90 con 0x5576f16b6090 2024-01-25T15:01:43.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f5410968740 10 client.15297 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:43.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.804+0000 7f5410968740 1 -- 172.21.15.170:0/4289252180 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5576f161b690 con 0x5576f16b6090 2024-01-25T15:01:43.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.805+0000 7f53e6ffd640 1 -- 172.21.15.170:0/4289252180 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5576f1615ea0 con 0x5576f16b6090 2024-01-25T15:01:43.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.805+0000 7f53e6ffd640 1 -- 172.21.15.170:0/4289252180 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5400004670 con 0x5576f16b6090 2024-01-25T15:01:43.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.805+0000 7f5410968740 10 client.15297 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:43.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.805+0000 7f5410968740 10 client.15297 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-25T15:01:43.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.805+0000 7f5410968740 20 client.15297 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:43.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.805+0000 7f5410968740 1 --2- 172.21.15.170:0/4289252180 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5576f16cca90 0x5576f16cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.805+0000 7f5410968740 4 client.15297 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:01:43.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.805+0000 7f5410968740 1 -- 172.21.15.170:0/4289252180 --> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5576f1615bc0 con 0x5576f16cca90 2024-01-25T15:01:43.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.805+0000 7f5406ffd640 1 --2- 172.21.15.170:0/4289252180 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5576f16cca90 0x5576f16cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.806+0000 7f53e6ffd640 10 client.15297 ms_handle_connect on v2:172.21.15.186:6838/2132502182 2024-01-25T15:01:43.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.806+0000 7f5406ffd640 1 --2- 172.21.15.170:0/4289252180 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5576f16cca90 0x5576f16cb4e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a879ce3687be3942 server_cookie=3d2e5d9f695070a9 in_seq=0 out_seq=0 2024-01-25T15:01:43.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.806+0000 7f53e6ffd640 1 -- 172.21.15.170:0/4289252180 <== mds.1 v2:172.21.15.186:6838/2132502182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5576f1615bc0 con 0x5576f16cca90 2024-01-25T15:01:43.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.806+0000 7f53e6ffd640 10 client.15297 handle_command_reply: tid=0 2024-01-25T15:01:43.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.806+0000 7f5410968740 1 client.15297 shutdown 2024-01-25T15:01:43.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.806+0000 7f5410968740 1 -- 172.21.15.170:0/4289252180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16b6090 msgr2=0x5576f16bfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.806+0000 7f5410968740 1 --2- 172.21.15.170:0/4289252180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16b6090 0x5576f16bfdd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f540002c700 tx=0x7f5400032f60 comp rx=0 tx=0).stop 2024-01-25T15:01:43.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.806+0000 7f5410968740 1 -- 172.21.15.170:0/4289252180 shutdown_connections 2024-01-25T15:01:43.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.806+0000 7f5410968740 1 --2- 172.21.15.170:0/4289252180 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5576f16cca90 0x5576f16cb4e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.806+0000 7f5410968740 1 --2- 172.21.15.170:0/4289252180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16bb200 0x5576f16c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.806+0000 7f5410968740 1 --2- 172.21.15.170:0/4289252180 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16b6090 0x5576f16bfdd0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.806+0000 7f53e6ffd640 0 client.15297 ms_handle_reset on v2:172.21.15.186:6838/2132502182 2024-01-25T15:01:43.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.806+0000 7f5410968740 1 --2- 172.21.15.170:0/4289252180 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16b56a0 0x5576f16bf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.806+0000 7f5410968740 1 -- 172.21.15.170:0/4289252180 >> 172.21.15.170:0/4289252180 conn(0x5576f16b0c10 msgr2=0x5576f16afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.807+0000 7f5410968740 1 -- 172.21.15.170:0/4289252180 shutdown_connections 2024-01-25T15:01:43.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.807+0000 7f5410968740 1 -- 172.21.15.170:0/4289252180 wait complete. 2024-01-25T15:01:43.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.807+0000 7f5410968740 20 client.15297 trim_cache size 0 max 16384 2024-01-25T15:01:43.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5410968740 1 Processor -- start 2024-01-25T15:01:43.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5410968740 1 -- start start 2024-01-25T15:01:43.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5410968740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16b56a0 0x5576f16abc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5410968740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16b6090 0x5576f16c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5410968740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16bb200 0x5576f16b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5410968740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f16b6780 con 0x5576f16b56a0 2024-01-25T15:01:43.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5410968740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f1615bc0 con 0x5576f16b6090 2024-01-25T15:01:43.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5410968740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f1615ea0 con 0x5576f16bb200 2024-01-25T15:01:43.829 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5406ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16b56a0 0x5576f16abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5406ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16b56a0 0x5576f16abc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33320/0 (socket says 172.21.15.170:33320) 2024-01-25T15:01:43.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5406ffd640 1 -- 172.21.15.170:0/3054210023 learned_addr learned my addr 172.21.15.170:0/3054210023 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5406ffd640 1 -- 172.21.15.170:0/3054210023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16bb200 msgr2=0x5576f16b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5406ffd640 1 --2- 172.21.15.170:0/3054210023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16bb200 0x5576f16b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5406ffd640 1 -- 172.21.15.170:0/3054210023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16b6090 msgr2=0x5576f16c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5406ffd640 1 --2- 172.21.15.170:0/3054210023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16b6090 0x5576f16c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.822+0000 7f5406ffd640 1 -- 172.21.15.170:0/3054210023 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576f15b8390 con 0x5576f16b56a0 2024-01-25T15:01:43.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.823+0000 7f5406ffd640 1 --2- 172.21.15.170:0/3054210023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16b56a0 0x5576f16abc30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f53f000ad60 tx=0x7f53f0004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ce7a288c345cfa server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.823+0000 7f53fd7fa640 1 -- 172.21.15.170:0/3054210023 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0027ea0 con 0x5576f16b56a0 2024-01-25T15:01:43.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.823+0000 7f53fd7fa640 1 -- 172.21.15.170:0/3054210023 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53f002b070 con 0x5576f16b56a0 2024-01-25T15:01:43.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.823+0000 7f53fd7fa640 1 -- 172.21.15.170:0/3054210023 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0017980 con 0x5576f16b56a0 2024-01-25T15:01:43.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.823+0000 7f5410968740 1 -- 172.21.15.170:0/3054210023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16b56a0 msgr2=0x5576f16abc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.830 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.823+0000 7f5410968740 1 --2- 172.21.15.170:0/3054210023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16b56a0 0x5576f16abc30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f53f000ad60 tx=0x7f53f0004640 comp rx=0 tx=0).stop 2024-01-25T15:01:43.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.823+0000 7f5410968740 1 -- 172.21.15.170:0/3054210023 shutdown_connections 2024-01-25T15:01:43.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.823+0000 7f5410968740 1 --2- 172.21.15.170:0/3054210023 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16b6090 0x5576f16c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.823+0000 7f5410968740 1 --2- 172.21.15.170:0/3054210023 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16bb200 0x5576f16b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.823+0000 7f5410968740 1 --2- 172.21.15.170:0/3054210023 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16b56a0 0x5576f16abc30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.823+0000 7f5410968740 1 -- 172.21.15.170:0/3054210023 >> 172.21.15.170:0/3054210023 conn(0x5576f16b0c10 msgr2=0x5576f16cb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.823+0000 7f5410968740 1 -- 172.21.15.170:0/3054210023 shutdown_connections 2024-01-25T15:01:43.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.823+0000 7f5410968740 1 -- 172.21.15.170:0/3054210023 wait complete. 2024-01-25T15:01:43.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5410968740 1 -- start start 2024-01-25T15:01:43.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5410968740 1 Processor -- start 2024-01-25T15:01:43.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5410968740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16b56a0 0x5576f16c4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5410968740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16b6090 0x5576f16c45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5410968740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16bb200 0x5576f16c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5410968740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f16c58e0 con 0x5576f16bb200 2024-01-25T15:01:43.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5410968740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f16c5a50 con 0x5576f16b6090 2024-01-25T15:01:43.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5410968740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576f16c5c10 con 0x5576f16b56a0 2024-01-25T15:01:43.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5410968740 10 client.0 _ll_register_callbacks cb 0x7f53f000a390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:43.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5406ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16bb200 0x5576f16c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5406ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16bb200 0x5576f16c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33334/0 (socket says 172.21.15.170:33334) 2024-01-25T15:01:43.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5406ffd640 1 -- 172.21.15.170:0/886805472 learned_addr learned my addr 172.21.15.170:0/886805472 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f54077fe640 1 --2- 172.21.15.170:0/886805472 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16b6090 0x5576f16c45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5406ffd640 1 --2- 172.21.15.170:0/886805472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16b56a0 0x5576f16c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5406ffd640 1 -- 172.21.15.170:0/886805472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16b56a0 msgr2=0x5576f16c4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5406ffd640 1 --2- 172.21.15.170:0/886805472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16b56a0 0x5576f16c4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5406ffd640 1 -- 172.21.15.170:0/886805472 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16b6090 msgr2=0x5576f16c45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5406ffd640 1 --2- 172.21.15.170:0/886805472 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16b6090 0x5576f16c45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5406ffd640 1 -- 172.21.15.170:0/886805472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5576f15df680 con 0x5576f16bb200 2024-01-25T15:01:43.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f5406ffd640 1 --2- 172.21.15.170:0/886805472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16bb200 0x5576f16c53a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f53f0006b50 tx=0x7f53f00047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7531c190591730 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.824+0000 7f53e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:43.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.825+0000 7f53e6ffd640 1 -- 172.21.15.170:0/886805472 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f0005bc0 con 0x5576f16bb200 2024-01-25T15:01:43.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.825+0000 7f53e6ffd640 1 -- 172.21.15.170:0/886805472 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f53f0000e40 con 0x5576f16bb200 2024-01-25T15:01:43.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.825+0000 7f5410968740 1 -- 172.21.15.170:0/886805472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f53f000c070 con 0x5576f16bb200 2024-01-25T15:01:43.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.825+0000 7f53e6ffd640 1 -- 172.21.15.170:0/886805472 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53f0005d20 con 0x5576f16bb200 2024-01-25T15:01:43.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.825+0000 7f5410968740 10 client.15303 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:43.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.825+0000 7f5410968740 1 -- 172.21.15.170:0/886805472 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5576f15ddee0 con 0x5576f16bb200 2024-01-25T15:01:43.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.825+0000 7f53e6ffd640 1 -- 172.21.15.170:0/886805472 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53f0043080 con 0x5576f16bb200 2024-01-25T15:01:43.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.825+0000 7f53e6ffd640 1 -- 172.21.15.170:0/886805472 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f53f0017a20 con 0x5576f16bb200 2024-01-25T15:01:43.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.825+0000 7f5410968740 10 client.15303 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:43.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.825+0000 7f5410968740 10 client.15303 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-25T15:01:43.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.825+0000 7f5410968740 20 client.15303 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:43.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.825+0000 7f5410968740 1 --2- 172.21.15.170:0/886805472 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5576f17271c0 0x5576f17239e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.825+0000 7f5410968740 4 client.15303 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-25T15:01:43.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.825+0000 7f5410968740 1 -- 172.21.15.170:0/886805472 --> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5576f131c6c0 con 0x5576f17271c0 2024-01-25T15:01:43.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.825+0000 7f54077fe640 1 --2- 172.21.15.170:0/886805472 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5576f17271c0 0x5576f17239e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f54077fe640 1 --2- 172.21.15.170:0/886805472 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5576f17271c0 0x5576f17239e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72c5932dc76ed345 server_cookie=cf2b44268664cb9f in_seq=0 out_seq=0 2024-01-25T15:01:43.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f53e6ffd640 10 client.15303 ms_handle_connect on v2:172.21.15.186:6838/2132502182 2024-01-25T15:01:43.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f53e6ffd640 1 -- 172.21.15.170:0/886805472 <== mds.1 v2:172.21.15.186:6838/2132502182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x5576f131c6c0 con 0x5576f17271c0 2024-01-25T15:01:43.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f53e6ffd640 10 client.15303 handle_command_reply: tid=0 2024-01-25T15:01:43.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f5410968740 1 client.15303 shutdown 2024-01-25T15:01:43.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f5410968740 1 -- 172.21.15.170:0/886805472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16bb200 msgr2=0x5576f16c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f5410968740 1 --2- 172.21.15.170:0/886805472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16bb200 0x5576f16c53a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f53f0006b50 tx=0x7f53f00047d0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f5410968740 1 -- 172.21.15.170:0/886805472 shutdown_connections 2024-01-25T15:01:43.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f5410968740 1 --2- 172.21.15.170:0/886805472 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x5576f17271c0 0x5576f17239e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f5410968740 1 --2- 172.21.15.170:0/886805472 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5576f16b6090 0x5576f16c45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f5410968740 1 --2- 172.21.15.170:0/886805472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5576f16bb200 0x5576f16c53a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f53e6ffd640 0 client.15303 ms_handle_reset on v2:172.21.15.186:6838/2132502182 2024-01-25T15:01:43.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f5410968740 1 --2- 172.21.15.170:0/886805472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5576f16b56a0 0x5576f16c4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f5410968740 1 -- 172.21.15.170:0/886805472 >> 172.21.15.170:0/886805472 conn(0x5576f16b0c10 msgr2=0x5576f16af510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f5410968740 1 -- 172.21.15.170:0/886805472 shutdown_connections 2024-01-25T15:01:43.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f5410968740 1 -- 172.21.15.170:0/886805472 wait complete. 2024-01-25T15:01:43.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.826+0000 7f5410968740 20 client.15303 trim_cache size 0 max 16384 2024-01-25T15:01:43.836 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:01:43.836 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "267213a8-bb91-11ee-95b2-87774f69a715", 2024-01-25T15:01:43.836 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 1, 2024-01-25T15:01:43.836 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 24479, 2024-01-25T15:01:43.836 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2024-01-25T15:01:43.837 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2024-01-25T15:01:43.837 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs", 2024-01-25T15:01:43.837 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 107.613729467, 2024-01-25T15:01:43.837 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 25, 2024-01-25T15:01:43.837 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 87, 2024-01-25T15:01:43.837 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 85, 2024-01-25T15:01:43.837 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 115.36090134 2024-01-25T15:01:43.837 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:01:43.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.827+0000 7f540dda9640 1 -- 172.21.15.170:0/226802473 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f53f40a12e0 msgr2=0x7f53f40a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.827+0000 7f540dda9640 1 --2- 172.21.15.170:0/226802473 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f53f40a12e0 0x7f53f40a37a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f53f80996f0 tx=0x7f53f80c3ee0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.827+0000 7f540dda9640 1 -- 172.21.15.170:0/226802473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5408106a70 msgr2=0x7f540819e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.827+0000 7f540dda9640 1 --2- 172.21.15.170:0/226802473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5408106a70 0x7f540819e360 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c970 tx=0x7f53f800ce30 comp rx=0 tx=0).stop 2024-01-25T15:01:43.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.827+0000 7f540dda9640 1 -- 172.21.15.170:0/226802473 shutdown_connections 2024-01-25T15:01:43.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.827+0000 7f540dda9640 1 --2- 172.21.15.170:0/226802473 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f53f40a12e0 0x7f53f40a37a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.827+0000 7f540dda9640 1 --2- 172.21.15.170:0/226802473 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5408106a70 0x7f540819e360 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.827+0000 7f540dda9640 1 --2- 172.21.15.170:0/226802473 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5408104140 0x7f54081972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.827+0000 7f540dda9640 1 --2- 172.21.15.170:0/226802473 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5408101810 0x7f5408196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.827+0000 7f540dda9640 1 -- 172.21.15.170:0/226802473 >> 172.21.15.170:0/226802473 conn(0x7f54080fb180 msgr2=0x7f54081036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.827+0000 7f540dda9640 1 -- 172.21.15.170:0/226802473 shutdown_connections 2024-01-25T15:01:43.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.827+0000 7f540dda9640 1 -- 172.21.15.170:0/226802473 wait complete. 2024-01-25T15:01:43.841 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-01-25T15:01:43.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.943+0000 7f1043f14640 1 -- 172.21.15.170:0/3127846007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f103c1017f0 msgr2=0x7f103c103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.943+0000 7f1043f14640 1 --2- 172.21.15.170:0/3127846007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f103c1017f0 0x7f103c103be0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1038009900 tx=0x7f103802bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:43.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.943+0000 7f1043f14640 1 -- 172.21.15.170:0/3127846007 shutdown_connections 2024-01-25T15:01:43.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.943+0000 7f1043f14640 1 --2- 172.21.15.170:0/3127846007 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f103c104120 0x7f103c106510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.943+0000 7f1043f14640 1 --2- 172.21.15.170:0/3127846007 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f103c106a50 0x7f103c108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.943+0000 7f1043f14640 1 --2- 172.21.15.170:0/3127846007 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f103c1017f0 0x7f103c103be0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.943+0000 7f1043f14640 1 -- 172.21.15.170:0/3127846007 >> 172.21.15.170:0/3127846007 conn(0x7f103c0fb1a0 msgr2=0x7f103c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.943+0000 7f1043f14640 1 -- 172.21.15.170:0/3127846007 shutdown_connections 2024-01-25T15:01:43.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.943+0000 7f1043f14640 1 -- 172.21.15.170:0/3127846007 wait complete. 2024-01-25T15:01:43.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f1043f14640 1 Processor -- start 2024-01-25T15:01:43.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f1043f14640 1 -- start start 2024-01-25T15:01:43.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f1043f14640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f103c1017f0 0x7f103c196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f1043f14640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f103c104120 0x7f103c1972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f1043f14640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f103c106a50 0x7f103c19e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f1043f14640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c19e8a0 con 0x7f103c104120 2024-01-25T15:01:43.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f1043f14640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c19ea10 con 0x7f103c1017f0 2024-01-25T15:01:43.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f1043f14640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103c19ebd0 con 0x7f103c106a50 2024-01-25T15:01:43.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f10414af640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f103c104120 0x7f103c1972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f10414af640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f103c104120 0x7f103c1972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33352/0 (socket says 172.21.15.170:33352) 2024-01-25T15:01:43.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f10414af640 1 -- 172.21.15.170:0/447891965 learned_addr learned my addr 172.21.15.170:0/447891965 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f10414af640 1 -- 172.21.15.170:0/447891965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f103c106a50 msgr2=0x7f103c19e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f10414af640 1 --2- 172.21.15.170:0/447891965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f103c106a50 0x7f103c19e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f10414af640 1 -- 172.21.15.170:0/447891965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f103c1017f0 msgr2=0x7f103c196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f10414af640 1 --2- 172.21.15.170:0/447891965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f103c1017f0 0x7f103c196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f10414af640 1 -- 172.21.15.170:0/447891965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1038009560 con 0x7f103c104120 2024-01-25T15:01:43.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f10414af640 1 --2- 172.21.15.170:0/447891965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f103c104120 0x7f103c1972f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f102c00d770 tx=0x7f102c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f1032ffd640 1 -- 172.21.15.170:0/447891965 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c009c30 con 0x7f103c104120 2024-01-25T15:01:43.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f1032ffd640 1 -- 172.21.15.170:0/447891965 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f102c00de80 con 0x7f103c104120 2024-01-25T15:01:43.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f1043f14640 1 -- 172.21.15.170:0/447891965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103c19eeb0 con 0x7f103c104120 2024-01-25T15:01:43.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.944+0000 7f1032ffd640 1 -- 172.21.15.170:0/447891965 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c00f620 con 0x7f103c104120 2024-01-25T15:01:43.948 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.945+0000 7f1043f14640 1 -- 172.21.15.170:0/447891965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103c19f3b0 con 0x7f103c104120 2024-01-25T15:01:43.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.946+0000 7f1032ffd640 1 -- 172.21.15.170:0/447891965 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f102c010460 con 0x7f103c104120 2024-01-25T15:01:43.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f1046bb9740 1 Processor -- start 2024-01-25T15:01:43.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f1046bb9740 1 -- start start 2024-01-25T15:01:43.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f1046bb9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a57d6a0 0x55a76a57dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f1046bb9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57e090 0x55a76a582b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f1046bb9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a583200 0x55a76a585690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f1046bb9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76a4ec030 con 0x55a76a57d6a0 2024-01-25T15:01:43.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f1046bb9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76a4e9720 con 0x55a76a583200 2024-01-25T15:01:43.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f1046bb9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76a4e5010 con 0x55a76a57e090 2024-01-25T15:01:43.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f1032ffd640 1 --2- 172.21.15.170:0/447891965 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f10280a12e0 0x7f10280a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f10424b1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a57d6a0 0x55a76a57dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f10424b1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a57d6a0 0x55a76a57dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33360/0 (socket says 172.21.15.170:33360) 2024-01-25T15:01:43.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f10424b1640 1 -- 172.21.15.170:0/2696828865 learned_addr learned my addr 172.21.15.170:0/2696828865 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f10424b1640 1 --2- 172.21.15.170:0/447891965 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f10280a12e0 0x7f10280a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f1041cb0640 1 --2- 172.21.15.170:0/2696828865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57e090 0x55a76a582b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f1032ffd640 1 -- 172.21.15.170:0/447891965 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f102c0cc960 con 0x7f103c104120 2024-01-25T15:01:43.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.947+0000 7f10414af640 1 --2- 172.21.15.170:0/2696828865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a583200 0x55a76a585690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.948+0000 7f1041cb0640 1 -- 172.21.15.170:0/2696828865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a583200 msgr2=0x55a76a585690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.948+0000 7f1041cb0640 1 --2- 172.21.15.170:0/2696828865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a583200 0x55a76a585690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.948+0000 7f1041cb0640 1 -- 172.21.15.170:0/2696828865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a57d6a0 msgr2=0x55a76a57dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.948+0000 7f1041cb0640 1 --2- 172.21.15.170:0/2696828865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a57d6a0 0x55a76a57dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.948+0000 7f1041cb0640 1 -- 172.21.15.170:0/2696828865 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a76a4a7680 con 0x55a76a57e090 2024-01-25T15:01:43.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.948+0000 7f10424b1640 1 --2- 172.21.15.170:0/2696828865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a57d6a0 0x55a76a57dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:01:43.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.948+0000 7f10424b1640 1 --2- 172.21.15.170:0/447891965 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f10280a12e0 0x7f10280a37a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f10340126d0 tx=0x7f103400b700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.948+0000 7f1041cb0640 1 --2- 172.21.15.170:0/2696828865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57e090 0x55a76a582b90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f103802c7e0 tx=0x7f1038000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1bd62d88a580c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.948+0000 7f1027fff640 1 -- 172.21.15.170:0/2696828865 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103802c900 con 0x55a76a57e090 2024-01-25T15:01:43.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.948+0000 7f1027fff640 1 -- 172.21.15.170:0/2696828865 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f103802ca60 con 0x55a76a57e090 2024-01-25T15:01:43.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.948+0000 7f1027fff640 1 -- 172.21.15.170:0/2696828865 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038005260 con 0x55a76a57e090 2024-01-25T15:01:43.957 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.949+0000 7f1046bb9740 1 -- 172.21.15.170:0/2696828865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57e090 msgr2=0x55a76a582b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.949+0000 7f1046bb9740 1 --2- 172.21.15.170:0/2696828865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57e090 0x55a76a582b90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f103802c7e0 tx=0x7f1038000bc0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.949+0000 7f1046bb9740 1 -- 172.21.15.170:0/2696828865 shutdown_connections 2024-01-25T15:01:43.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.949+0000 7f1046bb9740 1 --2- 172.21.15.170:0/2696828865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a583200 0x55a76a585690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.949+0000 7f1046bb9740 1 --2- 172.21.15.170:0/2696828865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57e090 0x55a76a582b90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.949+0000 7f1046bb9740 1 --2- 172.21.15.170:0/2696828865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a57d6a0 0x55a76a57dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.949+0000 7f1046bb9740 1 -- 172.21.15.170:0/2696828865 >> 172.21.15.170:0/2696828865 conn(0x55a76a578c10 msgr2=0x55a76a579010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.949+0000 7f1046bb9740 1 -- 172.21.15.170:0/2696828865 shutdown_connections 2024-01-25T15:01:43.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.949+0000 7f1046bb9740 1 -- 172.21.15.170:0/2696828865 wait complete. 2024-01-25T15:01:43.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.949+0000 7f1046bb9740 1 -- start start 2024-01-25T15:01:43.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.949+0000 7f1046bb9740 1 Processor -- start 2024-01-25T15:01:43.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f1046bb9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a57d6a0 0x55a76a587850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f1046bb9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57e090 0x55a76a587d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f1046bb9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a583200 0x55a76a58edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f1046bb9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76a49e5f0 con 0x55a76a583200 2024-01-25T15:01:43.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f1046bb9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76a49e290 con 0x55a76a57d6a0 2024-01-25T15:01:43.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f1046bb9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76a463300 con 0x55a76a57e090 2024-01-25T15:01:43.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f1046bb9740 10 client.0 _ll_register_callbacks cb 0x55a76a499260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:43.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f10424b1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a583200 0x55a76a58edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f10424b1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a583200 0x55a76a58edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33372/0 (socket says 172.21.15.170:33372) 2024-01-25T15:01:43.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f10424b1640 1 -- 172.21.15.170:0/2381797595 learned_addr learned my addr 172.21.15.170:0/2381797595 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f1041cb0640 1 --2- 172.21.15.170:0/2381797595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a57d6a0 0x55a76a587850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f10414af640 1 --2- 172.21.15.170:0/2381797595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57e090 0x55a76a587d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f10424b1640 1 -- 172.21.15.170:0/2381797595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57e090 msgr2=0x55a76a587d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f10424b1640 1 --2- 172.21.15.170:0/2381797595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57e090 0x55a76a587d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f10424b1640 1 -- 172.21.15.170:0/2381797595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a57d6a0 msgr2=0x55a76a587850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f10424b1640 1 --2- 172.21.15.170:0/2381797595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a57d6a0 0x55a76a587850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f10424b1640 1 -- 172.21.15.170:0/2381797595 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103c109a20 con 0x55a76a583200 2024-01-25T15:01:43.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f10424b1640 1 --2- 172.21.15.170:0/2381797595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a583200 0x55a76a58edd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f10340067f0 tx=0x7f103400b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1457c4504ad4474a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f10257fa640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:43.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f10257fa640 1 -- 172.21.15.170:0/2381797595 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034003b70 con 0x55a76a583200 2024-01-25T15:01:43.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f10257fa640 1 -- 172.21.15.170:0/2381797595 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f1034012fe0 con 0x55a76a583200 2024-01-25T15:01:43.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.950+0000 7f1046bb9740 1 -- 172.21.15.170:0/2381797595 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a76a4ddea0 con 0x55a76a583200 2024-01-25T15:01:43.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.951+0000 7f10257fa640 1 -- 172.21.15.170:0/2381797595 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1034003cd0 con 0x55a76a583200 2024-01-25T15:01:43.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.951+0000 7f1046bb9740 10 client.15315 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:43.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.951+0000 7f1046bb9740 1 -- 172.21.15.170:0/2381797595 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55a76a4e3690 con 0x55a76a583200 2024-01-25T15:01:43.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.951+0000 7f10257fa640 1 -- 172.21.15.170:0/2381797595 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a76a4ddea0 con 0x55a76a583200 2024-01-25T15:01:43.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.951+0000 7f10257fa640 1 -- 172.21.15.170:0/2381797595 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f10340044e0 con 0x55a76a583200 2024-01-25T15:01:43.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.951+0000 7f1046bb9740 10 client.15315 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:43.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.951+0000 7f1046bb9740 10 client.15315 resolve_mds: resolved name 'i' to daemon mds.i 2024-01-25T15:01:43.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.951+0000 7f1046bb9740 20 client.15315 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:43.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.951+0000 7f1046bb9740 1 --2- 172.21.15.170:0/2381797595 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55a76a594ac0 0x55a76a5934f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.960 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.951+0000 7f1046bb9740 4 client.15315 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:01:43.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.951+0000 7f1046bb9740 1 -- 172.21.15.170:0/2381797595 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a76a4ddbc0 con 0x55a76a594ac0 2024-01-25T15:01:43.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.951+0000 7f1041cb0640 1 --2- 172.21.15.170:0/2381797595 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55a76a594ac0 0x55a76a5934f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.952+0000 7f10257fa640 10 client.15315 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:43.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.952+0000 7f1041cb0640 1 --2- 172.21.15.170:0/2381797595 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55a76a594ac0 0x55a76a5934f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7549251cd52451ef server_cookie=de6096f4b52e766a in_seq=0 out_seq=0 2024-01-25T15:01:43.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.952+0000 7f10257fa640 1 -- 172.21.15.170:0/2381797595 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a76a4ddbc0 con 0x55a76a594ac0 2024-01-25T15:01:43.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.952+0000 7f10257fa640 10 client.15315 handle_command_reply: tid=0 2024-01-25T15:01:43.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.952+0000 7f1046bb9740 1 client.15315 shutdown 2024-01-25T15:01:43.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.953+0000 7f1046bb9740 1 -- 172.21.15.170:0/2381797595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a583200 msgr2=0x55a76a58edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.953+0000 7f1046bb9740 1 --2- 172.21.15.170:0/2381797595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a583200 0x55a76a58edd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f10340067f0 tx=0x7f103400b500 comp rx=0 tx=0).stop 2024-01-25T15:01:43.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.953+0000 7f1046bb9740 1 -- 172.21.15.170:0/2381797595 shutdown_connections 2024-01-25T15:01:43.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.953+0000 7f1046bb9740 1 --2- 172.21.15.170:0/2381797595 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55a76a594ac0 0x55a76a5934f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.961 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.953+0000 7f1046bb9740 1 --2- 172.21.15.170:0/2381797595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a583200 0x55a76a58edd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.953+0000 7f1046bb9740 1 --2- 172.21.15.170:0/2381797595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57e090 0x55a76a587d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.953+0000 7f1046bb9740 1 --2- 172.21.15.170:0/2381797595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a57d6a0 0x55a76a587850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.953+0000 7f10257fa640 0 client.15315 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:43.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.953+0000 7f1046bb9740 1 -- 172.21.15.170:0/2381797595 >> 172.21.15.170:0/2381797595 conn(0x55a76a578c10 msgr2=0x55a76a577da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.953+0000 7f1046bb9740 1 -- 172.21.15.170:0/2381797595 shutdown_connections 2024-01-25T15:01:43.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.953+0000 7f1046bb9740 1 -- 172.21.15.170:0/2381797595 wait complete. 2024-01-25T15:01:43.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.953+0000 7f1046bb9740 20 client.15315 trim_cache size 0 max 16384 2024-01-25T15:01:43.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.968+0000 7f1046bb9740 1 Processor -- start 2024-01-25T15:01:43.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.968+0000 7f1046bb9740 1 -- start start 2024-01-25T15:01:43.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.968+0000 7f1046bb9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57d6a0 0x55a76a5855f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.968+0000 7f1046bb9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a57e090 0x55a76a58ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.968+0000 7f1046bb9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a583200 0x55a76a57f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.968+0000 7f1046bb9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76a57e4e0 con 0x55a76a583200 2024-01-25T15:01:43.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.968+0000 7f1046bb9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76a5744e0 con 0x55a76a57e090 2024-01-25T15:01:43.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.968+0000 7f1046bb9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76a5872d0 con 0x55a76a57d6a0 2024-01-25T15:01:43.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.969+0000 7f10424b1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a583200 0x55a76a57f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.969+0000 7f10424b1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a583200 0x55a76a57f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33376/0 (socket says 172.21.15.170:33376) 2024-01-25T15:01:43.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.969+0000 7f10424b1640 1 -- 172.21.15.170:0/3569374708 learned_addr learned my addr 172.21.15.170:0/3569374708 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.969+0000 7f10414af640 1 --2- 172.21.15.170:0/3569374708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a57e090 0x55a76a58ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.969+0000 7f10424b1640 1 -- 172.21.15.170:0/3569374708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57d6a0 msgr2=0x55a76a5855f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.969+0000 7f1041cb0640 1 --2- 172.21.15.170:0/3569374708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57d6a0 0x55a76a5855f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.969+0000 7f10424b1640 1 --2- 172.21.15.170:0/3569374708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57d6a0 0x55a76a5855f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.969+0000 7f10424b1640 1 -- 172.21.15.170:0/3569374708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a57e090 msgr2=0x55a76a58ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.969+0000 7f10424b1640 1 --2- 172.21.15.170:0/3569374708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a57e090 0x55a76a58ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.969+0000 7f10424b1640 1 -- 172.21.15.170:0/3569374708 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a76a480390 con 0x55a76a583200 2024-01-25T15:01:43.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.969+0000 7f10414af640 1 --2- 172.21.15.170:0/3569374708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a57e090 0x55a76a58ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:43.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.969+0000 7f10424b1640 1 --2- 172.21.15.170:0/3569374708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a583200 0x55a76a57f550 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f103400b5a0 tx=0x7f1034006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653fffdd046fbcfc server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.969+0000 7f10277fe640 1 -- 172.21.15.170:0/3569374708 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10340090c0 con 0x55a76a583200 2024-01-25T15:01:43.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.969+0000 7f10277fe640 1 -- 172.21.15.170:0/3569374708 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f103401e070 con 0x55a76a583200 2024-01-25T15:01:43.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.969+0000 7f10277fe640 1 -- 172.21.15.170:0/3569374708 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034019c50 con 0x55a76a583200 2024-01-25T15:01:43.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 -- 172.21.15.170:0/3569374708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a583200 msgr2=0x55a76a57f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 --2- 172.21.15.170:0/3569374708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a583200 0x55a76a57f550 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f103400b5a0 tx=0x7f1034006420 comp rx=0 tx=0).stop 2024-01-25T15:01:43.976 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 -- 172.21.15.170:0/3569374708 shutdown_connections 2024-01-25T15:01:43.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 --2- 172.21.15.170:0/3569374708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a57e090 0x55a76a58ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 --2- 172.21.15.170:0/3569374708 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a583200 0x55a76a57f550 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 --2- 172.21.15.170:0/3569374708 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57d6a0 0x55a76a5855f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 -- 172.21.15.170:0/3569374708 >> 172.21.15.170:0/3569374708 conn(0x55a76a578c10 msgr2=0x55a76a587850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 -- 172.21.15.170:0/3569374708 shutdown_connections 2024-01-25T15:01:43.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 -- 172.21.15.170:0/3569374708 wait complete. 2024-01-25T15:01:43.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 -- start start 2024-01-25T15:01:43.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 Processor -- start 2024-01-25T15:01:43.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a57d6a0 0x55a76a58bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57e090 0x55a76a58c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a583200 0x55a76a5e9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76a58c710 con 0x55a76a57d6a0 2024-01-25T15:01:43.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76a58c880 con 0x55a76a583200 2024-01-25T15:01:43.977 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a76a5e9fc0 con 0x55a76a57e090 2024-01-25T15:01:43.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1046bb9740 10 client.0 _ll_register_callbacks cb 0x7f1038009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:43.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1041cb0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a57d6a0 0x55a76a58bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1041cb0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a57d6a0 0x55a76a58bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:33392/0 (socket says 172.21.15.170:33392) 2024-01-25T15:01:43.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.970+0000 7f1041cb0640 1 -- 172.21.15.170:0/4212255044 learned_addr learned my addr 172.21.15.170:0/4212255044 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:43.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f10424b1640 1 --2- 172.21.15.170:0/4212255044 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a583200 0x55a76a5e9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f1041cb0640 1 -- 172.21.15.170:0/4212255044 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57e090 msgr2=0x55a76a58c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f1041cb0640 1 --2- 172.21.15.170:0/4212255044 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57e090 0x55a76a58c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f1041cb0640 1 -- 172.21.15.170:0/4212255044 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a583200 msgr2=0x55a76a5e9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:43.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f1041cb0640 1 --2- 172.21.15.170:0/4212255044 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a583200 0x55a76a5e9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f1041cb0640 1 -- 172.21.15.170:0/4212255044 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a76a4e3690 con 0x55a76a57d6a0 2024-01-25T15:01:43.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f10424b1640 1 --2- 172.21.15.170:0/4212255044 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a583200 0x55a76a5e9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:43.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f1041cb0640 1 --2- 172.21.15.170:0/4212255044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a57d6a0 0x55a76a58bc10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1038009900 tx=0x7f103802c1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552d1b9db42d33a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:43.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f10257fa640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:43.978 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f10257fa640 1 -- 172.21.15.170:0/4212255044 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038051df0 con 0x55a76a57d6a0 2024-01-25T15:01:43.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f10257fa640 1 -- 172.21.15.170:0/4212255044 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f103804e040 con 0x55a76a57d6a0 2024-01-25T15:01:43.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f1046bb9740 1 -- 172.21.15.170:0/4212255044 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f103802ca60 con 0x55a76a57d6a0 2024-01-25T15:01:43.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f10257fa640 1 -- 172.21.15.170:0/4212255044 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10380046c0 con 0x55a76a57d6a0 2024-01-25T15:01:43.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f1046bb9740 10 client.15321 fetch_fsmap learned FSMap version 25 2024-01-25T15:01:43.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f1046bb9740 1 -- 172.21.15.170:0/4212255044 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55a76a4a5ee0 con 0x55a76a57d6a0 2024-01-25T15:01:43.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f10257fa640 1 -- 172.21.15.170:0/4212255044 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1038060020 con 0x55a76a57d6a0 2024-01-25T15:01:43.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f10257fa640 1 -- 172.21.15.170:0/4212255044 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 25) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f103803c070 con 0x55a76a57d6a0 2024-01-25T15:01:43.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f1046bb9740 10 client.15321 fetch_fsmap finished waiting for FSMap version 25 2024-01-25T15:01:43.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f1046bb9740 10 client.15321 resolve_mds: resolved name 'i' to daemon mds.i 2024-01-25T15:01:43.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f1046bb9740 20 client.15321 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:43.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.971+0000 7f1046bb9740 1 --2- 172.21.15.170:0/4212255044 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55a76a5ef1e0 0x55a76a5eb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:43.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.972+0000 7f1046bb9740 4 client.15321 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-25T15:01:43.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.972+0000 7f1046bb9740 1 -- 172.21.15.170:0/4212255044 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a76a1e46c0 con 0x55a76a5ef1e0 2024-01-25T15:01:43.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.972+0000 7f10414af640 1 --2- 172.21.15.170:0/4212255044 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55a76a5ef1e0 0x55a76a5eb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:43.979 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.972+0000 7f10257fa640 10 client.15321 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:43.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.972+0000 7f10414af640 1 --2- 172.21.15.170:0/4212255044 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55a76a5ef1e0 0x55a76a5eb670 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68f847ed64950712 server_cookie=fa0d7d81af23a035 in_seq=0 out_seq=0 2024-01-25T15:01:43.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.972+0000 7f10257fa640 1 -- 172.21.15.170:0/4212255044 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x55a76a1e46c0 con 0x55a76a5ef1e0 2024-01-25T15:01:43.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.972+0000 7f10257fa640 10 client.15321 handle_command_reply: tid=0 2024-01-25T15:01:43.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.972+0000 7f1046bb9740 1 client.15321 shutdown 2024-01-25T15:01:43.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1046bb9740 1 -- 172.21.15.170:0/4212255044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a57d6a0 msgr2=0x55a76a58bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1046bb9740 1 --2- 172.21.15.170:0/4212255044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a57d6a0 0x55a76a58bc10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1038009900 tx=0x7f103802c1f0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1046bb9740 1 -- 172.21.15.170:0/4212255044 shutdown_connections 2024-01-25T15:01:43.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1046bb9740 1 --2- 172.21.15.170:0/4212255044 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55a76a5ef1e0 0x55a76a5eb670 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1046bb9740 1 --2- 172.21.15.170:0/4212255044 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a76a583200 0x55a76a5e9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f10257fa640 0 client.15321 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:43.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1046bb9740 1 --2- 172.21.15.170:0/4212255044 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a76a57e090 0x55a76a58c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1046bb9740 1 --2- 172.21.15.170:0/4212255044 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a76a57d6a0 0x55a76a58bc10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.980 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1046bb9740 1 -- 172.21.15.170:0/4212255044 >> 172.21.15.170:0/4212255044 conn(0x55a76a578c10 msgr2=0x55a76a587850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1046bb9740 1 -- 172.21.15.170:0/4212255044 shutdown_connections 2024-01-25T15:01:43.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1046bb9740 1 -- 172.21.15.170:0/4212255044 wait complete. 2024-01-25T15:01:43.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1046bb9740 20 client.15321 trim_cache size 0 max 16384 2024-01-25T15:01:43.981 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:01:43.981 INFO:teuthology.orchestra.run.smithi170.stdout: "cluster_fsid": "267213a8-bb91-11ee-95b2-87774f69a715", 2024-01-25T15:01:43.981 INFO:teuthology.orchestra.run.smithi170.stdout: "whoami": 0, 2024-01-25T15:01:43.981 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 24484, 2024-01-25T15:01:43.981 INFO:teuthology.orchestra.run.smithi170.stdout: "want_state": "up:active", 2024-01-25T15:01:43.981 INFO:teuthology.orchestra.run.smithi170.stdout: "state": "up:active", 2024-01-25T15:01:43.981 INFO:teuthology.orchestra.run.smithi170.stdout: "fs_name": "cephfs", 2024-01-25T15:01:43.981 INFO:teuthology.orchestra.run.smithi170.stdout: "rank_uptime": 109.783502035, 2024-01-25T15:01:43.982 INFO:teuthology.orchestra.run.smithi170.stdout: "mdsmap_epoch": 25, 2024-01-25T15:01:43.982 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch": 87, 2024-01-25T15:01:43.982 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_epoch_barrier": 85, 2024-01-25T15:01:43.982 INFO:teuthology.orchestra.run.smithi170.stdout: "uptime": 123.93730214 2024-01-25T15:01:43.982 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:01:43.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1043f14640 1 -- 172.21.15.170:0/447891965 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f10280a12e0 msgr2=0x7f10280a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1043f14640 1 --2- 172.21.15.170:0/447891965 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f10280a12e0 0x7f10280a37a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f10340126d0 tx=0x7f103400b700 comp rx=0 tx=0).stop 2024-01-25T15:01:43.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1043f14640 1 -- 172.21.15.170:0/447891965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f103c104120 msgr2=0x7f103c1972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:43.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1043f14640 1 --2- 172.21.15.170:0/447891965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f103c104120 0x7f103c1972f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f102c00d770 tx=0x7f102c00dc30 comp rx=0 tx=0).stop 2024-01-25T15:01:43.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1043f14640 1 -- 172.21.15.170:0/447891965 shutdown_connections 2024-01-25T15:01:43.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1043f14640 1 --2- 172.21.15.170:0/447891965 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f10280a12e0 0x7f10280a37a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1043f14640 1 --2- 172.21.15.170:0/447891965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f103c106a50 0x7f103c19e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1043f14640 1 --2- 172.21.15.170:0/447891965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f103c104120 0x7f103c1972f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1043f14640 1 --2- 172.21.15.170:0/447891965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f103c1017f0 0x7f103c196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:43.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1043f14640 1 -- 172.21.15.170:0/447891965 >> 172.21.15.170:0/447891965 conn(0x7f103c0fb1a0 msgr2=0x7f103c102150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:43.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1043f14640 1 -- 172.21.15.170:0/447891965 shutdown_connections 2024-01-25T15:01:43.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:43.973+0000 7f1043f14640 1 -- 172.21.15.170:0/447891965 wait complete. 2024-01-25T15:01:43.985 INFO:teuthology.run_tasks:Running task kclient... 2024-01-25T15:01:44.009 INFO:tasks.kclient:Mounting kernel clients... 2024-01-25T15:01:44.009 INFO:tasks.kclient:config is {'client.0': {}} 2024-01-25T15:01:44.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:44.009 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-01-25T15:01:44.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:44.025 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2024-01-25T15:01:44.089 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:44 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/181587011' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:44.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T15:01:44.096 INFO:teuthology.orchestra.run.smithi170.stderr:Cannot find device "ceph-brx" 2024-01-25T15:01:44.096 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-01-25T15:01:44.096 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-25T15:01:44.097 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-25T15:01:44.097 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph fs ls 2024-01-25T15:01:44.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:44 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/181587011' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:44.376 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:01:44.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:44 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/181587011' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:45.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:45 smithi170 ceph-mon[31899]: pgmap v341: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-01-25T15:01:45.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:45 smithi186 ceph-mon[35697]: pgmap v341: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-01-25T15:01:45.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:45 smithi191 ceph-mon[36347]: pgmap v341: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 0 B/s wr, 11 op/s 2024-01-25T15:01:46.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.126+0000 7f4c74e9f700 1 -- 172.21.15.170:0/2551422792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c70069e30 msgr2=0x7f4c7010e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:46.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.126+0000 7f4c74e9f700 1 --2- 172.21.15.170:0/2551422792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c70069e30 0x7f4c7010e670 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f4c6800b0d0 tx=0x7f4c6800b3e0 comp rx=0 tx=0).stop 2024-01-25T15:01:46.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.126+0000 7f4c74e9f700 1 -- 172.21.15.170:0/2551422792 shutdown_connections 2024-01-25T15:01:46.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.126+0000 7f4c74e9f700 1 --2- 172.21.15.170:0/2551422792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c701077a0 0x7f4c70107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:46.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.126+0000 7f4c74e9f700 1 --2- 172.21.15.170:0/2551422792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c70069e30 0x7f4c7010e670 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:46.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.126+0000 7f4c74e9f700 1 --2- 172.21.15.170:0/2551422792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c70069490 0x7f4c700698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:46.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.126+0000 7f4c74e9f700 1 -- 172.21.15.170:0/2551422792 >> 172.21.15.170:0/2551422792 conn(0x7f4c70077610 msgr2=0x7f4c70077a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:46.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.126+0000 7f4c74e9f700 1 -- 172.21.15.170:0/2551422792 shutdown_connections 2024-01-25T15:01:46.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.126+0000 7f4c74e9f700 1 -- 172.21.15.170:0/2551422792 wait complete. 2024-01-25T15:01:46.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.127+0000 7f4c74e9f700 1 Processor -- start 2024-01-25T15:01:46.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.127+0000 7f4c74e9f700 1 -- start start 2024-01-25T15:01:46.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.127+0000 7f4c74e9f700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c70069490 0x7f4c7019d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:46.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.127+0000 7f4c74e9f700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c70069e30 0x7f4c7019de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:46.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.127+0000 7f4c74e9f700 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c701077a0 0x7f4c70197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:46.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.127+0000 7f4c74e9f700 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70198110 con 0x7f4c70069490 2024-01-25T15:01:46.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.127+0000 7f4c74e9f700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70198250 con 0x7f4c70069e30 2024-01-25T15:01:46.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.127+0000 7f4c74e9f700 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70198410 con 0x7f4c701077a0 2024-01-25T15:01:46.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.127+0000 7f4c6e59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c70069490 0x7f4c7019d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:46.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.127+0000 7f4c6e59c700 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c70069490 0x7f4c7019d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36054/0 (socket says 172.21.15.170:36054) 2024-01-25T15:01:46.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.127+0000 7f4c6e59c700 1 -- 172.21.15.170:0/486269195 learned_addr learned my addr 172.21.15.170:0/486269195 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:46.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.127+0000 7f4c6ed9d700 1 --2- 172.21.15.170:0/486269195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c701077a0 0x7f4c70197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:46.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.128+0000 7f4c6dd9b700 1 --2- 172.21.15.170:0/486269195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c70069e30 0x7f4c7019de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:46.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.128+0000 7f4c6e59c700 1 -- 172.21.15.170:0/486269195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c701077a0 msgr2=0x7f4c70197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:46.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.128+0000 7f4c6e59c700 1 --2- 172.21.15.170:0/486269195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c701077a0 0x7f4c70197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:46.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.128+0000 7f4c6e59c700 1 -- 172.21.15.170:0/486269195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c70069e30 msgr2=0x7f4c7019de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:46.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.128+0000 7f4c6e59c700 1 --2- 172.21.15.170:0/486269195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c70069e30 0x7f4c7019de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:46.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.128+0000 7f4c6e59c700 1 -- 172.21.15.170:0/486269195 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c68009d00 con 0x7f4c70069490 2024-01-25T15:01:46.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.128+0000 7f4c6e59c700 1 --2- 172.21.15.170:0/486269195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c70069490 0x7f4c7019d8f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000c9b0 tx=0x7f4c6000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:46.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.128+0000 7f4c5f7fe700 1 -- 172.21.15.170:0/486269195 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60007b00 con 0x7f4c70069490 2024-01-25T15:01:46.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.128+0000 7f4c74e9f700 1 -- 172.21.15.170:0/486269195 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c701986f0 con 0x7f4c70069490 2024-01-25T15:01:46.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.128+0000 7f4c5f7fe700 1 -- 172.21.15.170:0/486269195 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c60007c60 con 0x7f4c70069490 2024-01-25T15:01:46.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.128+0000 7f4c5f7fe700 1 -- 172.21.15.170:0/486269195 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c60018660 con 0x7f4c70069490 2024-01-25T15:01:46.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.128+0000 7f4c74e9f700 1 -- 172.21.15.170:0/486269195 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c701a4990 con 0x7f4c70069490 2024-01-25T15:01:46.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.129+0000 7f4c74e9f700 1 -- 172.21.15.170:0/486269195 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c70109d50 con 0x7f4c70069490 2024-01-25T15:01:46.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.130+0000 7f4c5f7fe700 1 -- 172.21.15.170:0/486269195 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f4c6000f450 con 0x7f4c70069490 2024-01-25T15:01:46.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.131+0000 7f4c5f7fe700 1 --2- 172.21.15.170:0/486269195 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4c580a1370 0x7f4c580a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:46.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.131+0000 7f4c6dd9b700 1 --2- 172.21.15.170:0/486269195 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4c580a1370 0x7f4c580a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:46.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.131+0000 7f4c5f7fe700 1 -- 172.21.15.170:0/486269195 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f4c600ccd20 con 0x7f4c70069490 2024-01-25T15:01:46.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.131+0000 7f4c6dd9b700 1 --2- 172.21.15.170:0/486269195 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4c580a1370 0x7f4c580a3830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4c64005fd0 tx=0x7f4c6400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:46.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.134+0000 7f4c5f7fe700 1 -- 172.21.15.170:0/486269195 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f4c60096260 con 0x7f4c70069490 2024-01-25T15:01:46.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.377+0000 7f4c74e9f700 1 -- 172.21.15.170:0/486269195 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4c70198fe0 con 0x7f4c70069490 2024-01-25T15:01:46.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.377+0000 7f4c5f7fe700 1 -- 172.21.15.170:0/486269195 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4c60099880 con 0x7f4c70069490 2024-01-25T15:01:46.378 INFO:teuthology.orchestra.run.smithi170.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-25T15:01:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.379+0000 7f4c74e9f700 1 -- 172.21.15.170:0/486269195 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4c580a1370 msgr2=0x7f4c580a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.379+0000 7f4c74e9f700 1 --2- 172.21.15.170:0/486269195 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4c580a1370 0x7f4c580a3830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4c64005fd0 tx=0x7f4c6400a560 comp rx=0 tx=0).stop 2024-01-25T15:01:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.379+0000 7f4c74e9f700 1 -- 172.21.15.170:0/486269195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c70069490 msgr2=0x7f4c7019d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.379+0000 7f4c74e9f700 1 --2- 172.21.15.170:0/486269195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c70069490 0x7f4c7019d8f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000c9b0 tx=0x7f4c6000ccc0 comp rx=0 tx=0).stop 2024-01-25T15:01:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.379+0000 7f4c74e9f700 1 -- 172.21.15.170:0/486269195 shutdown_connections 2024-01-25T15:01:46.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.379+0000 7f4c74e9f700 1 --2- 172.21.15.170:0/486269195 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4c580a1370 0x7f4c580a3830 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:46.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.379+0000 7f4c74e9f700 1 --2- 172.21.15.170:0/486269195 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4c701077a0 0x7f4c70197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:46.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.379+0000 7f4c74e9f700 1 --2- 172.21.15.170:0/486269195 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4c70069490 0x7f4c7019d8f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:46.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.379+0000 7f4c74e9f700 1 --2- 172.21.15.170:0/486269195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c70069e30 0x7f4c7019de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:46.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.379+0000 7f4c74e9f700 1 -- 172.21.15.170:0/486269195 >> 172.21.15.170:0/486269195 conn(0x7f4c70077610 msgr2=0x7f4c700fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:46.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.379+0000 7f4c74e9f700 1 -- 172.21.15.170:0/486269195 shutdown_connections 2024-01-25T15:01:46.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:46.379+0000 7f4c74e9f700 1 -- 172.21.15.170:0/486269195 wait complete. 2024-01-25T15:01:47.285 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-25T15:01:47.285 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-25T15:01:47.285 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi170.front.sepia.ceph.com 2024-01-25T15:01:47.285 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-25T15:01:47.285 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-25T15:01:47.285 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-25T15:01:47.285 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-25T15:01:47.285 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-25T15:01:47.285 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-25T15:01:47.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:47.286 DEBUG:teuthology.orchestra.run.smithi170:> ip addr 2024-01-25T15:01:47.303 INFO:teuthology.orchestra.run.smithi170.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-25T15:01:47.304 INFO:teuthology.orchestra.run.smithi170.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-25T15:01:47.304 INFO:teuthology.orchestra.run.smithi170.stdout: inet 127.0.0.1/8 scope host lo 2024-01-25T15:01:47.304 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:01:47.304 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 ::1/128 scope host 2024-01-25T15:01:47.304 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:01:47.304 INFO:teuthology.orchestra.run.smithi170.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:01:47.304 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:54 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:01:47.304 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f0 2024-01-25T15:01:47.304 INFO:teuthology.orchestra.run.smithi170.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:01:47.304 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:d9:3b:55 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:01:47.304 INFO:teuthology.orchestra.run.smithi170.stdout: altname enp7s0f1 2024-01-25T15:01:47.304 INFO:teuthology.orchestra.run.smithi170.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-25T15:01:47.304 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:54 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:01:47.305 INFO:teuthology.orchestra.run.smithi170.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-25T15:01:47.305 INFO:teuthology.orchestra.run.smithi170.stdout: link/ether 0c:c4:7a:88:72:55 brd ff:ff:ff:ff:ff:ff 2024-01-25T15:01:47.305 INFO:teuthology.orchestra.run.smithi170.stdout: inet 172.21.15.170/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-25T15:01:47.305 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft 42167sec preferred_lft 42167sec 2024-01-25T15:01:47.305 INFO:teuthology.orchestra.run.smithi170.stdout: inet6 fe80::ec4:7aff:fe88:7255/64 scope link 2024-01-25T15:01:47.305 INFO:teuthology.orchestra.run.smithi170.stdout: valid_lft forever preferred_lft forever 2024-01-25T15:01:47.305 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-25T15:01:47.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:47.305 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2024-01-25T15:01:47.305 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-01-25T15:01:47.306 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add name ceph-brx type bridge 2024-01-25T15:01:47.306 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip addr flush dev ceph-brx 2024-01-25T15:01:47.306 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set ceph-brx up 2024-01-25T15:01:47.306 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-25T15:01:47.306 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-01-25T15:01:47.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:47.475 DEBUG:teuthology.orchestra.run.smithi170:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-25T15:01:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:47 smithi170 ceph-mon[31899]: pgmap v342: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:01:47.499 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:47 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/486269195' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-01-25T15:01:47.502 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-01-25T15:01:47.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:47.504 DEBUG:teuthology.orchestra.run.smithi170:> route 2024-01-25T15:01:47.576 INFO:teuthology.orchestra.run.smithi170.stdout:Kernel IP routing table 2024-01-25T15:01:47.577 INFO:teuthology.orchestra.run.smithi170.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-25T15:01:47.577 INFO:teuthology.orchestra.run.smithi170.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-25T15:01:47.577 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-25T15:01:47.577 INFO:teuthology.orchestra.run.smithi170.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-25T15:01:47.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:47.577 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2024-01-25T15:01:47.577 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-01-25T15:01:47.578 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-25T15:01:47.578 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-25T15:01:47.578 DEBUG:teuthology.orchestra.run.smithi170:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-25T15:01:47.578 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-01-25T15:01:47.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:47 smithi186 ceph-mon[35697]: pgmap v342: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:01:47.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:47 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/486269195' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-01-25T15:01:47.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:47 smithi191 ceph-mon[36347]: pgmap v342: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-01-25T15:01:47.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:47 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/486269195' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-01-25T15:01:47.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:47.898 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-01-25T15:01:47.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:47.914 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list-id 2024-01-25T15:01:47.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:47.969 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2024-01-25T15:01:47.969 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-01-25T15:01:47.969 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-25T15:01:47.969 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-25T15:01:47.969 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-01-25T15:01:48.051 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-25T15:01:48.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:48.051 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2024-01-25T15:01:48.052 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-01-25T15:01:48.052 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-25T15:01:48.052 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-25T15:01:48.052 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-25T15:01:48.052 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-25T15:01:48.052 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-25T15:01:48.052 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-01-25T15:01:48.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:48.191 DEBUG:teuthology.orchestra.run.smithi170:> (cd / && exec bash -c ' 2024-01-25T15:01:48.191 DEBUG:teuthology.orchestra.run.smithi170:> set -e 2024-01-25T15:01:48.191 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set brx.0 up 2024-01-25T15:01:48.191 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link set dev brx.0 master ceph-brx 2024-01-25T15:01:48.191 DEBUG:teuthology.orchestra.run.smithi170:> ') 2024-01-25T15:01:48.233 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:01:48.233 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-25T15:01:48.288 INFO:teuthology.orchestra.run.smithi170.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-25T15:01:48.288 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-25T15:01:48.289 DEBUG:teuthology.orchestra.run.smithi170:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-25T15:01:48.343 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-01-25T15:01:48.343 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-01-25T15:01:48.343 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6 2024-01-25T15:01:48.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:48.343 DEBUG:teuthology.orchestra.run.smithi170:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-01-25T15:01:48.452 INFO:teuthology.orchestra.run.smithi170.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-01-25T15:01:48.452 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-01-25T15:01:48.452 INFO:teuthology.orchestra.run.smithi170.stdout:invalid new device string format 2024-01-25T15:01:48.552 INFO:teuthology.orchestra.run.smithi170.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-01-25T15:01:48.552 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-01-25T15:01:48.552 INFO:teuthology.orchestra.run.smithi170.stdout:invalid new device string format 2024-01-25T15:01:48.552 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: resolved to: "172.21.15.170:3300,172.21.15.186:3300,172.21.15.191:3300" 2024-01-25T15:01:48.553 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.170:3300,172.21.15.186:3300,172.21.15.191:3300:/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6 2024-01-25T15:01:48.553 INFO:teuthology.orchestra.run.smithi170.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,key=0,fsid=267213a8-bb91-11ee-95b2-87774f69a715" will pass to kernel 2024-01-25T15:01:48.553 INFO:teuthology.orchestra.run.smithi170.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-01-25T15:01:48.553 INFO:teuthology.orchestra.run.smithi170.stdout: You just mounted a file system that supports labels which does not 2024-01-25T15:01:48.553 INFO:teuthology.orchestra.run.smithi170.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-25T15:01:48.554 INFO:teuthology.orchestra.run.smithi170.stdout: applications will generate AVC messages and not be allowed access to 2024-01-25T15:01:48.554 INFO:teuthology.orchestra.run.smithi170.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-25T15:01:48.555 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-25T15:01:48.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:48.555 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-25T15:01:48.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:48.588 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-25T15:01:48.645 INFO:teuthology.orchestra.run.smithi170.stdout:client24803 2024-01-25T15:01:48.645 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T15:01:48.646 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:01:48.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:48.703 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-25T15:01:48.760 INFO:teuthology.orchestra.run.smithi170.stdout:client24803 2024-01-25T15:01:48.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:48.760 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-25T15:01:48.816 INFO:teuthology.orchestra.run.smithi170.stdout:client24803 2024-01-25T15:01:48.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:01:48.817 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/267213a8-bb91-11ee-95b2-87774f69a715.client24803/status') 2024-01-25T15:01:48.885 INFO:teuthology.orchestra.run.smithi170.stdout:instance: client.24803 (3)172.21.15.170:0/1462725151 2024-01-25T15:01:48.885 INFO:teuthology.orchestra.run.smithi170.stdout:blocklisted: false 2024-01-25T15:01:48.885 INFO:teuthology.orchestra.run.smithi170.stderr:0+1 records in 2024-01-25T15:01:48.886 INFO:teuthology.orchestra.run.smithi170.stderr:0+1 records out 2024-01-25T15:01:48.886 INFO:teuthology.orchestra.run.smithi170.stderr:72 bytes copied, 3.0246e-05 s, 2.4 MB/s 2024-01-25T15:01:48.887 INFO:teuthology.run_tasks:Running task exec... 2024-01-25T15:01:48.897 INFO:teuthology.task.exec:Executing custom commands... 2024-01-25T15:01:48.897 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi170.front.sepia.ceph.com 2024-01-25T15:01:48.897 DEBUG:teuthology.orchestra.run.smithi170:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-01-25T15:01:49.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.028+0000 7f2ef3246640 1 -- 172.21.15.170:0/3498420836 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eec0ffc20 msgr2=0x7f2eec100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:49.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.028+0000 7f2ef3246640 1 --2- 172.21.15.170:0/3498420836 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eec0ffc20 0x7f2eec100040 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009900 tx=0x7f2ee802bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:49.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.028+0000 7f2ef3246640 1 -- 172.21.15.170:0/3498420836 shutdown_connections 2024-01-25T15:01:49.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.028+0000 7f2ef3246640 1 --2- 172.21.15.170:0/3498420836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2eec100e10 0x7f2eec101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:49.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.028+0000 7f2ef3246640 1 --2- 172.21.15.170:0/3498420836 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2eec1017d0 0x7f2eec108060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:49.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.028+0000 7f2ef3246640 1 --2- 172.21.15.170:0/3498420836 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eec0ffc20 0x7f2eec100040 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:49.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.028+0000 7f2ef3246640 1 -- 172.21.15.170:0/3498420836 >> 172.21.15.170:0/3498420836 conn(0x7f2eec0fb190 msgr2=0x7f2eec0fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:49.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.028+0000 7f2ef3246640 1 -- 172.21.15.170:0/3498420836 shutdown_connections 2024-01-25T15:01:49.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.028+0000 7f2ef3246640 1 -- 172.21.15.170:0/3498420836 wait complete. 2024-01-25T15:01:49.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ef3246640 1 Processor -- start 2024-01-25T15:01:49.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ef3246640 1 -- start start 2024-01-25T15:01:49.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ef3246640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2eec0ffc20 0x7f2eec196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:49.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ef3246640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eec100e10 0x7f2eec1971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:49.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ef3246640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2eec1017d0 0x7f2eec19e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:49.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ef3246640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec19e740 con 0x7f2eec100e10 2024-01-25T15:01:49.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ef3246640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec19e8b0 con 0x7f2eec1017d0 2024-01-25T15:01:49.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ef3246640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eec19ea70 con 0x7f2eec0ffc20 2024-01-25T15:01:49.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eec100e10 0x7f2eec1971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:49.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eec100e10 0x7f2eec1971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36078/0 (socket says 172.21.15.170:36078) 2024-01-25T15:01:49.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ee3fff640 1 -- 172.21.15.170:0/866604743 learned_addr learned my addr 172.21.15.170:0/866604743 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:49.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ef0fe2640 1 --2- 172.21.15.170:0/866604743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2eec0ffc20 0x7f2eec196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:49.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ee3fff640 1 -- 172.21.15.170:0/866604743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2eec0ffc20 msgr2=0x7f2eec196c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:49.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ee3fff640 1 --2- 172.21.15.170:0/866604743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2eec0ffc20 0x7f2eec196c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:49.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ef17e3640 1 --2- 172.21.15.170:0/866604743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2eec1017d0 0x7f2eec19e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:49.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ee3fff640 1 -- 172.21.15.170:0/866604743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2eec1017d0 msgr2=0x7f2eec19e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:49.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ee3fff640 1 --2- 172.21.15.170:0/866604743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2eec1017d0 0x7f2eec19e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:49.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ee3fff640 1 -- 172.21.15.170:0/866604743 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee8009560 con 0x7f2eec100e10 2024-01-25T15:01:49.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.029+0000 7f2ef0fe2640 1 --2- 172.21.15.170:0/866604743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2eec0ffc20 0x7f2eec196c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:49.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.030+0000 7f2ee3fff640 1 --2- 172.21.15.170:0/866604743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eec100e10 0x7f2eec1971a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2edc00b4a0 tx=0x7f2edc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:49.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.030+0000 7f2ee1ffb640 1 -- 172.21.15.170:0/866604743 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc010610 con 0x7f2eec100e10 2024-01-25T15:01:49.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.030+0000 7f2ee1ffb640 1 -- 172.21.15.170:0/866604743 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2edc010c30 con 0x7f2eec100e10 2024-01-25T15:01:49.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.030+0000 7f2ef3246640 1 -- 172.21.15.170:0/866604743 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eec19ed50 con 0x7f2eec100e10 2024-01-25T15:01:49.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.030+0000 7f2ee1ffb640 1 -- 172.21.15.170:0/866604743 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2edc017dd0 con 0x7f2eec100e10 2024-01-25T15:01:49.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.030+0000 7f2ef3246640 1 -- 172.21.15.170:0/866604743 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eec19f230 con 0x7f2eec100e10 2024-01-25T15:01:49.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.031+0000 7f2ef3246640 1 -- 172.21.15.170:0/866604743 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eec106ee0 con 0x7f2eec100e10 2024-01-25T15:01:49.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.032+0000 7f2ee1ffb640 1 -- 172.21.15.170:0/866604743 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f2edc0173f0 con 0x7f2eec100e10 2024-01-25T15:01:49.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.033+0000 7f2ee1ffb640 1 --2- 172.21.15.170:0/866604743 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2ed40a1380 0x7f2ed40a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:49.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.033+0000 7f2ef0fe2640 1 --2- 172.21.15.170:0/866604743 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2ed40a1380 0x7f2ed40a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:49.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.033+0000 7f2ee1ffb640 1 -- 172.21.15.170:0/866604743 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f2edc0cc5f0 con 0x7f2eec100e10 2024-01-25T15:01:49.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.033+0000 7f2ef0fe2640 1 --2- 172.21.15.170:0/866604743 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2ed40a1380 0x7f2ed40a3840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8006010 tx=0x7f2ee8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:49.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.037+0000 7f2ee1ffb640 1 -- 172.21.15.170:0/866604743 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f2edc095a10 con 0x7f2eec100e10 2024-01-25T15:01:49.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:49.251+0000 7f2ef3246640 1 -- 172.21.15.170:0/866604743 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) v1 -- 0x7f2eec02cbf0 con 0x7f2eec100e10 2024-01-25T15:01:49.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:49 smithi186 ceph-mon[35697]: pgmap v343: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-01-25T15:01:49.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:49 smithi170 ceph-mon[31899]: pgmap v343: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-01-25T15:01:49.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:49 smithi191 ceph-mon[36347]: pgmap v343: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-01-25T15:01:50.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.072+0000 7f2ee1ffb640 1 -- 172.21.15.170:0/866604743 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v26) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2edc097940 con 0x7f2eec100e10 2024-01-25T15:01:50.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.075+0000 7f2ef3246640 1 -- 172.21.15.170:0/866604743 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2ed40a1380 msgr2=0x7f2ed40a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:50.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.075+0000 7f2ef3246640 1 --2- 172.21.15.170:0/866604743 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2ed40a1380 0x7f2ed40a3840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8006010 tx=0x7f2ee8000bc0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.075+0000 7f2ef3246640 1 -- 172.21.15.170:0/866604743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eec100e10 msgr2=0x7f2eec1971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:50.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.075+0000 7f2ef3246640 1 --2- 172.21.15.170:0/866604743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eec100e10 0x7f2eec1971a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2edc00b4a0 tx=0x7f2edc00b960 comp rx=0 tx=0).stop 2024-01-25T15:01:50.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.075+0000 7f2ef3246640 1 -- 172.21.15.170:0/866604743 shutdown_connections 2024-01-25T15:01:50.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.075+0000 7f2ef3246640 1 --2- 172.21.15.170:0/866604743 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2ed40a1380 0x7f2ed40a3840 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.075+0000 7f2ef3246640 1 --2- 172.21.15.170:0/866604743 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2eec1017d0 0x7f2eec19e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.075+0000 7f2ef3246640 1 --2- 172.21.15.170:0/866604743 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2eec100e10 0x7f2eec1971a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.075+0000 7f2ef3246640 1 --2- 172.21.15.170:0/866604743 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2eec0ffc20 0x7f2eec196c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.075+0000 7f2ef3246640 1 -- 172.21.15.170:0/866604743 >> 172.21.15.170:0/866604743 conn(0x7f2eec0fb190 msgr2=0x7f2eec1040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:50.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.075+0000 7f2ef3246640 1 -- 172.21.15.170:0/866604743 shutdown_connections 2024-01-25T15:01:50.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.075+0000 7f2ef3246640 1 -- 172.21.15.170:0/866604743 wait complete. 2024-01-25T15:01:50.088 DEBUG:teuthology.orchestra.run.smithi170:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-01-25T15:01:50.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.195+0000 7fda9992c640 1 -- 172.21.15.170:0/3653526336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda94100e50 msgr2=0x7fda941012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:50.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.195+0000 7fda9992c640 1 --2- 172.21.15.170:0/3653526336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda94100e50 0x7fda941012d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fda7c009900 tx=0x7fda7c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:50.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.195+0000 7fda9992c640 1 -- 172.21.15.170:0/3653526336 shutdown_connections 2024-01-25T15:01:50.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.195+0000 7fda9992c640 1 --2- 172.21.15.170:0/3653526336 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda94101810 0x7fda941080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.195+0000 7fda9992c640 1 --2- 172.21.15.170:0/3653526336 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda94100e50 0x7fda941012d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.195+0000 7fda9992c640 1 --2- 172.21.15.170:0/3653526336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda940ffc60 0x7fda94100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.195+0000 7fda9992c640 1 -- 172.21.15.170:0/3653526336 >> 172.21.15.170:0/3653526336 conn(0x7fda940fb1d0 msgr2=0x7fda940fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:50.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.195+0000 7fda9992c640 1 -- 172.21.15.170:0/3653526336 shutdown_connections 2024-01-25T15:01:50.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.195+0000 7fda9992c640 1 -- 172.21.15.170:0/3653526336 wait complete. 2024-01-25T15:01:50.199 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.196+0000 7fda9992c640 1 Processor -- start 2024-01-25T15:01:50.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.196+0000 7fda9992c640 1 -- start start 2024-01-25T15:01:50.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.196+0000 7fda9992c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda940ffc60 0x7fda9406a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:50.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.196+0000 7fda9992c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda94100e50 0x7fda9419b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:50.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.196+0000 7fda9992c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda94101810 0x7fda9419df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:50.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.196+0000 7fda9992c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9419e6e0 con 0x7fda94100e50 2024-01-25T15:01:50.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.196+0000 7fda9992c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9419e850 con 0x7fda94101810 2024-01-25T15:01:50.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.196+0000 7fda9992c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9419ea10 con 0x7fda940ffc60 2024-01-25T15:01:50.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.196+0000 7fda8bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda94100e50 0x7fda9419b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:50.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.196+0000 7fda8bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda94100e50 0x7fda9419b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36092/0 (socket says 172.21.15.170:36092) 2024-01-25T15:01:50.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.196+0000 7fda8bfff640 1 -- 172.21.15.170:0/2135679488 learned_addr learned my addr 172.21.15.170:0/2135679488 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:50.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.196+0000 7fda937fe640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda94101810 0x7fda9419df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:50.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.196+0000 7fda92ffd640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda940ffc60 0x7fda9406a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:50.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.197+0000 7fda8bfff640 1 -- 172.21.15.170:0/2135679488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda940ffc60 msgr2=0x7fda9406a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:50.200 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.197+0000 7fda8bfff640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda940ffc60 0x7fda9406a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.197+0000 7fda8bfff640 1 -- 172.21.15.170:0/2135679488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda94101810 msgr2=0x7fda9419df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:50.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.197+0000 7fda8bfff640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda94101810 0x7fda9419df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.197+0000 7fda8bfff640 1 -- 172.21.15.170:0/2135679488 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c009560 con 0x7fda94100e50 2024-01-25T15:01:50.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.197+0000 7fda92ffd640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda940ffc60 0x7fda9406a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:50.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.197+0000 7fda937fe640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda94101810 0x7fda9419df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:50.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.197+0000 7fda8bfff640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda94100e50 0x7fda9419b8e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fda7c009230 tx=0x7fda7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:50.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.197+0000 7fda9892a640 1 -- 172.21.15.170:0/2135679488 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c0044e0 con 0x7fda94100e50 2024-01-25T15:01:50.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.197+0000 7fda9892a640 1 -- 172.21.15.170:0/2135679488 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda7c0035f0 con 0x7fda94100e50 2024-01-25T15:01:50.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.197+0000 7fda9992c640 1 -- 172.21.15.170:0/2135679488 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9419ec30 con 0x7fda94100e50 2024-01-25T15:01:50.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.197+0000 7fda9892a640 1 -- 172.21.15.170:0/2135679488 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c03e6b0 con 0x7fda94100e50 2024-01-25T15:01:50.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.197+0000 7fda9992c640 1 -- 172.21.15.170:0/2135679488 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9419f190 con 0x7fda94100e50 2024-01-25T15:01:50.201 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.198+0000 7fda9992c640 1 -- 172.21.15.170:0/2135679488 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda94106eb0 con 0x7fda94100e50 2024-01-25T15:01:50.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.199+0000 7fda9892a640 1 -- 172.21.15.170:0/2135679488 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fda7c003960 con 0x7fda94100e50 2024-01-25T15:01:50.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.200+0000 7fda9892a640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fda800a1400 0x7fda800a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:50.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.200+0000 7fda92ffd640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fda800a1400 0x7fda800a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:50.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.200+0000 7fda9892a640 1 -- 172.21.15.170:0/2135679488 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fda7c0ef5f0 con 0x7fda94100e50 2024-01-25T15:01:50.202 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.200+0000 7fda92ffd640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fda800a1400 0x7fda800a38c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fda94100cb0 tx=0x7fda84005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:50.204 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.204+0000 7fda9892a640 1 -- 172.21.15.170:0/2135679488 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fda7c0b8bc0 con 0x7fda94100e50 2024-01-25T15:01:50.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:50 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/866604743' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-01-25T15:01:50.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:50 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/866604743' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-01-25T15:01:50.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.412+0000 7fda9992c640 1 -- 172.21.15.170:0/2135679488 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) v1 -- 0x7fda9402cb80 con 0x7fda800a1400 2024-01-25T15:01:50.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.430+0000 7fda9892a640 1 -- 172.21.15.170:0/2135679488 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7fda9402cb80 con 0x7fda800a1400 2024-01-25T15:01:50.431 INFO:teuthology.orchestra.run.smithi170.stdout:{} 2024-01-25T15:01:50.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.433+0000 7fda9992c640 1 -- 172.21.15.170:0/2135679488 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fda800a1400 msgr2=0x7fda800a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:50.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.433+0000 7fda9992c640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fda800a1400 0x7fda800a38c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fda94100cb0 tx=0x7fda84005db0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.433+0000 7fda9992c640 1 -- 172.21.15.170:0/2135679488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda94100e50 msgr2=0x7fda9419b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:50.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.433+0000 7fda9992c640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda94100e50 0x7fda9419b8e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fda7c009230 tx=0x7fda7c0042f0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.433+0000 7fda9992c640 1 -- 172.21.15.170:0/2135679488 shutdown_connections 2024-01-25T15:01:50.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.433+0000 7fda9992c640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fda800a1400 0x7fda800a38c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.433+0000 7fda9992c640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda94101810 0x7fda9419df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.433+0000 7fda9992c640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fda94100e50 0x7fda9419b8e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.433+0000 7fda9992c640 1 --2- 172.21.15.170:0/2135679488 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fda940ffc60 0x7fda9406a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.433+0000 7fda9992c640 1 -- 172.21.15.170:0/2135679488 >> 172.21.15.170:0/2135679488 conn(0x7fda940fb1d0 msgr2=0x7fda94104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:50.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.433+0000 7fda9992c640 1 -- 172.21.15.170:0/2135679488 shutdown_connections 2024-01-25T15:01:50.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.433+0000 7fda9992c640 1 -- 172.21.15.170:0/2135679488 wait complete. 2024-01-25T15:01:50.444 INFO:teuthology.run_tasks:Running task check-counter... 2024-01-25T15:01:50.457 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-01-25T15:01:50.516 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:01:50.517 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:50 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/866604743' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-01-25T15:01:50.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.619+0000 7f3b9cba9640 1 -- 172.21.15.170:0/3879000056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98100e00 msgr2=0x7f3b98101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:50.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.619+0000 7f3b9cba9640 1 --2- 172.21.15.170:0/3879000056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98100e00 0x7f3b98101280 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009900 tx=0x7f3b8c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:50.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.619+0000 7f3b9cba9640 1 -- 172.21.15.170:0/3879000056 shutdown_connections 2024-01-25T15:01:50.622 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.619+0000 7f3b9cba9640 1 --2- 172.21.15.170:0/3879000056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b981017c0 0x7f3b98108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.619+0000 7f3b9cba9640 1 --2- 172.21.15.170:0/3879000056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98100e00 0x7f3b98101280 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.619+0000 7f3b9cba9640 1 --2- 172.21.15.170:0/3879000056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b980ffc10 0x7f3b98100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.619+0000 7f3b9cba9640 1 -- 172.21.15.170:0/3879000056 >> 172.21.15.170:0/3879000056 conn(0x7f3b980fb1a0 msgr2=0x7f3b980fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.619+0000 7f3b9cba9640 1 -- 172.21.15.170:0/3879000056 shutdown_connections 2024-01-25T15:01:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.619+0000 7f3b9cba9640 1 -- 172.21.15.170:0/3879000056 wait complete. 2024-01-25T15:01:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b9cba9640 1 Processor -- start 2024-01-25T15:01:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b9cba9640 1 -- start start 2024-01-25T15:01:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b9cba9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b980ffc10 0x7f3b98069eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b9cba9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98100e00 0x7f3b9819ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b9cba9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b981017c0 0x7f3b9819e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b9cba9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9819e870 con 0x7f3b98100e00 2024-01-25T15:01:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b9cba9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9819e9e0 con 0x7f3b981017c0 2024-01-25T15:01:50.623 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b9cba9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9819eba0 con 0x7f3b980ffc10 2024-01-25T15:01:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b95d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98100e00 0x7f3b9819ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b95d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98100e00 0x7f3b9819ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36134/0 (socket says 172.21.15.170:36134) 2024-01-25T15:01:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b95d9b640 1 -- 172.21.15.170:0/3954840179 learned_addr learned my addr 172.21.15.170:0/3954840179 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b96d9d640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b981017c0 0x7f3b9819e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b95d9b640 1 -- 172.21.15.170:0/3954840179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b980ffc10 msgr2=0x7f3b98069eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b9659c640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b980ffc10 0x7f3b98069eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b95d9b640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b980ffc10 0x7f3b98069eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b95d9b640 1 -- 172.21.15.170:0/3954840179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b981017c0 msgr2=0x7f3b9819e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b95d9b640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b981017c0 0x7f3b9819e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b95d9b640 1 -- 172.21.15.170:0/3954840179 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c009560 con 0x7f3b98100e00 2024-01-25T15:01:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b96d9d640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b981017c0 0x7f3b9819e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b9659c640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b980ffc10 0x7f3b98069eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.620+0000 7f3b95d9b640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98100e00 0x7f3b9819ba70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009230 tx=0x7f3b8c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:50.624 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.621+0000 7f3b877fe640 1 -- 172.21.15.170:0/3954840179 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0044e0 con 0x7f3b98100e00 2024-01-25T15:01:50.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.621+0000 7f3b9cba9640 1 -- 172.21.15.170:0/3954840179 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9819edc0 con 0x7f3b98100e00 2024-01-25T15:01:50.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.621+0000 7f3b877fe640 1 -- 172.21.15.170:0/3954840179 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b8c0035f0 con 0x7f3b98100e00 2024-01-25T15:01:50.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.621+0000 7f3b877fe640 1 -- 172.21.15.170:0/3954840179 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c03e6b0 con 0x7f3b98100e00 2024-01-25T15:01:50.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.621+0000 7f3b9cba9640 1 -- 172.21.15.170:0/3954840179 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9819f2d0 con 0x7f3b98100e00 2024-01-25T15:01:50.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.622+0000 7f3b9cba9640 1 -- 172.21.15.170:0/3954840179 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b98106f30 con 0x7f3b98100e00 2024-01-25T15:01:50.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.623+0000 7f3b877fe640 1 -- 172.21.15.170:0/3954840179 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f3b8c003960 con 0x7f3b98100e00 2024-01-25T15:01:50.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.623+0000 7f3b877fe640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3b800a12e0 0x7f3b800a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:50.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.624+0000 7f3b9659c640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3b800a12e0 0x7f3b800a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:50.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.624+0000 7f3b877fe640 1 -- 172.21.15.170:0/3954840179 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f3b8c0ef680 con 0x7f3b98100e00 2024-01-25T15:01:50.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.624+0000 7f3b9659c640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3b800a12e0 0x7f3b800a37a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3b98100c60 tx=0x7f3b900073c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:50.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.628+0000 7f3b877fe640 1 -- 172.21.15.170:0/3954840179 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f3b8c0b8b30 con 0x7f3b98100e00 2024-01-25T15:01:50.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.800+0000 7f3b9cba9640 1 -- 172.21.15.170:0/3954840179 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b9802cb40 con 0x7f3b98100e00 2024-01-25T15:01:50.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.801+0000 7f3b877fe640 1 -- 172.21.15.170:0/3954840179 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22550 (secure 0 0 0) 0x7f3b8c0bc150 con 0x7f3b98100e00 2024-01-25T15:01:50.802 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:50.802 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":87,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T15:00:57.274280+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:01:50.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.803+0000 7f3b9cba9640 1 -- 172.21.15.170:0/3954840179 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3b800a12e0 msgr2=0x7f3b800a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:50.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.803+0000 7f3b9cba9640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3b800a12e0 0x7f3b800a37a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3b98100c60 tx=0x7f3b900073c0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.803+0000 7f3b9cba9640 1 -- 172.21.15.170:0/3954840179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98100e00 msgr2=0x7f3b9819ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:50.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.803+0000 7f3b9cba9640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98100e00 0x7f3b9819ba70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c009230 tx=0x7f3b8c0042f0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.803+0000 7f3b9cba9640 1 -- 172.21.15.170:0/3954840179 shutdown_connections 2024-01-25T15:01:50.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.803+0000 7f3b9cba9640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3b800a12e0 0x7f3b800a37a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.803+0000 7f3b9cba9640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b981017c0 0x7f3b9819e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.803+0000 7f3b9cba9640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3b98100e00 0x7f3b9819ba70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.803+0000 7f3b9cba9640 1 --2- 172.21.15.170:0/3954840179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3b980ffc10 0x7f3b98069eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.803+0000 7f3b9cba9640 1 -- 172.21.15.170:0/3954840179 >> 172.21.15.170:0/3954840179 conn(0x7f3b980fb1a0 msgr2=0x7f3b98104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:50.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.803+0000 7f3b9cba9640 1 -- 172.21.15.170:0/3954840179 shutdown_connections 2024-01-25T15:01:50.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.803+0000 7f3b9cba9640 1 -- 172.21.15.170:0/3954840179 wait complete. 2024-01-25T15:01:50.814 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 15:01:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T15:01:50.416+0000 7f6563998700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-25T15:01:50.815 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 15:01:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T15:01:50.416+0000 7f6563998700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-25T15:01:50.815 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 15:01:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T15:01:50.416+0000 7f6563998700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-25T15:01:50.815 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 15:01:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T15:01:50.416+0000 7f6563998700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-25T15:01:50.815 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 15:01:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T15:01:50.416+0000 7f6563998700 -1 client.0 error registering admin socket command: (17) File exists 2024-01-25T15:01:50.816 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T14:55:22.432727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T14:59:51.465304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T14:59:52.749298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:01:50.816 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:01:50.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.921+0000 7fe75870e640 1 -- 172.21.15.170:0/502600400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe750100f40 msgr2=0x7fe7501077d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:50.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.921+0000 7fe75870e640 1 --2- 172.21.15.170:0/502600400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe750100f40 0x7fe7501077d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe748009ca0 tx=0x7fe74802c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.921+0000 7fe75870e640 1 -- 172.21.15.170:0/502600400 shutdown_connections 2024-01-25T15:01:50.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.921+0000 7fe75870e640 1 --2- 172.21.15.170:0/502600400 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe750100580 0x7fe750100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.921+0000 7fe75870e640 1 --2- 172.21.15.170:0/502600400 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe750100f40 0x7fe7501077d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.921+0000 7fe75870e640 1 --2- 172.21.15.170:0/502600400 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7500ff390 0x7fe7500ff7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.921+0000 7fe75870e640 1 -- 172.21.15.170:0/502600400 >> 172.21.15.170:0/502600400 conn(0x7fe7500fa920 msgr2=0x7fe7500fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:50.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.921+0000 7fe75870e640 1 -- 172.21.15.170:0/502600400 shutdown_connections 2024-01-25T15:01:50.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.921+0000 7fe75870e640 1 -- 172.21.15.170:0/502600400 wait complete. 2024-01-25T15:01:50.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe75870e640 1 Processor -- start 2024-01-25T15:01:50.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe75870e640 1 -- start start 2024-01-25T15:01:50.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe75870e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7500ff390 0x7fe750196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:50.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe75870e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe750100580 0x7fe7501970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:50.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe75870e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe750100f40 0x7fe75019e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:50.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe75870e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75019e690 con 0x7fe750100f40 2024-01-25T15:01:50.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe75870e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75019e800 con 0x7fe750100580 2024-01-25T15:01:50.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe75870e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75019e9c0 con 0x7fe7500ff390 2024-01-25T15:01:50.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe756cab640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe750100f40 0x7fe75019e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:50.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe756cab640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe750100f40 0x7fe75019e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36144/0 (socket says 172.21.15.170:36144) 2024-01-25T15:01:50.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe756cab640 1 -- 172.21.15.170:0/3529863213 learned_addr learned my addr 172.21.15.170:0/3529863213 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:50.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe7564aa640 1 --2- 172.21.15.170:0/3529863213 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7500ff390 0x7fe750196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:50.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe755ca9640 1 --2- 172.21.15.170:0/3529863213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe750100580 0x7fe7501970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:50.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe756cab640 1 -- 172.21.15.170:0/3529863213 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7500ff390 msgr2=0x7fe750196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:50.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe756cab640 1 --2- 172.21.15.170:0/3529863213 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7500ff390 0x7fe750196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe756cab640 1 -- 172.21.15.170:0/3529863213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe750100580 msgr2=0x7fe7501970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:50.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe756cab640 1 --2- 172.21.15.170:0/3529863213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe750100580 0x7fe7501970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:50.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe756cab640 1 -- 172.21.15.170:0/3529863213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe748009900 con 0x7fe750100f40 2024-01-25T15:01:50.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe756cab640 1 --2- 172.21.15.170:0/3529863213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe750100f40 0x7fe75019e150 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe748037040 tx=0x7fe748032a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:50.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe7437fe640 1 -- 172.21.15.170:0/3529863213 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748003970 con 0x7fe750100f40 2024-01-25T15:01:50.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe7437fe640 1 -- 172.21.15.170:0/3529863213 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe748004040 con 0x7fe750100f40 2024-01-25T15:01:50.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe75870e640 1 -- 172.21.15.170:0/3529863213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75019ec40 con 0x7fe750100f40 2024-01-25T15:01:50.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.922+0000 7fe7437fe640 1 -- 172.21.15.170:0/3529863213 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74803d650 con 0x7fe750100f40 2024-01-25T15:01:50.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.923+0000 7fe75870e640 1 -- 172.21.15.170:0/3529863213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75019f0f0 con 0x7fe750100f40 2024-01-25T15:01:50.926 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.924+0000 7fe75870e640 1 -- 172.21.15.170:0/3529863213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7501066b0 con 0x7fe750100f40 2024-01-25T15:01:50.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.924+0000 7fe7437fe640 1 -- 172.21.15.170:0/3529863213 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fe74803b040 con 0x7fe750100f40 2024-01-25T15:01:50.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.925+0000 7fe7437fe640 1 --2- 172.21.15.170:0/3529863213 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe73c0a12e0 0x7fe73c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:50.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.925+0000 7fe7564aa640 1 --2- 172.21.15.170:0/3529863213 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe73c0a12e0 0x7fe73c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:50.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.925+0000 7fe7437fe640 1 -- 172.21.15.170:0/3529863213 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fe7480ef420 con 0x7fe750100f40 2024-01-25T15:01:50.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.925+0000 7fe7564aa640 1 --2- 172.21.15.170:0/3529863213 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe73c0a12e0 0x7fe73c0a37a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe7501003e0 tx=0x7fe74c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:50.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:50.929+0000 7fe7437fe640 1 -- 172.21.15.170:0/3529863213 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fe7480b88d0 con 0x7fe750100f40 2024-01-25T15:01:51.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.101+0000 7fe75870e640 1 -- 172.21.15.170:0/3529863213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe75002cb70 con 0x7fe750100f40 2024-01-25T15:01:51.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.102+0000 7fe7437fe640 1 -- 172.21.15.170:0/3529863213 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe7480bbef0 con 0x7fe750100f40 2024-01-25T15:01:51.103 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 1 2024-01-25T15:01:51.104 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.104+0000 7fe75870e640 1 -- 172.21.15.170:0/3529863213 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe73c0a12e0 msgr2=0x7fe73c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:51.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.104+0000 7fe75870e640 1 --2- 172.21.15.170:0/3529863213 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe73c0a12e0 0x7fe73c0a37a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe7501003e0 tx=0x7fe74c00a2d0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.104+0000 7fe75870e640 1 -- 172.21.15.170:0/3529863213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe750100f40 msgr2=0x7fe75019e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:51.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.104+0000 7fe75870e640 1 --2- 172.21.15.170:0/3529863213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe750100f40 0x7fe75019e150 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fe748037040 tx=0x7fe748032a40 comp rx=0 tx=0).stop 2024-01-25T15:01:51.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.104+0000 7fe75870e640 1 -- 172.21.15.170:0/3529863213 shutdown_connections 2024-01-25T15:01:51.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.104+0000 7fe75870e640 1 --2- 172.21.15.170:0/3529863213 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe73c0a12e0 0x7fe73c0a37a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.104+0000 7fe75870e640 1 --2- 172.21.15.170:0/3529863213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe750100580 0x7fe7501970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.104+0000 7fe75870e640 1 --2- 172.21.15.170:0/3529863213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe750100f40 0x7fe75019e150 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.104+0000 7fe75870e640 1 --2- 172.21.15.170:0/3529863213 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe7500ff390 0x7fe750196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.104+0000 7fe75870e640 1 -- 172.21.15.170:0/3529863213 >> 172.21.15.170:0/3529863213 conn(0x7fe7500fa920 msgr2=0x7fe750103880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:51.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.104+0000 7fe75870e640 1 -- 172.21.15.170:0/3529863213 shutdown_connections 2024-01-25T15:01:51.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.104+0000 7fe75870e640 1 -- 172.21.15.170:0/3529863213 wait complete. 2024-01-25T15:01:51.115 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:01:51.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.220+0000 7f6155d2c640 1 -- 172.21.15.170:0/1624008577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6150101790 msgr2=0x7f6150103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:51.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.220+0000 7f6155d2c640 1 --2- 172.21.15.170:0/1624008577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6150101790 0x7f6150103b80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6140009900 tx=0x7f614002bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:51.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.220+0000 7f6155d2c640 1 -- 172.21.15.170:0/1624008577 shutdown_connections 2024-01-25T15:01:51.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.220+0000 7f6155d2c640 1 --2- 172.21.15.170:0/1624008577 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f61501069f0 0x7f6150108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.223 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.220+0000 7f6155d2c640 1 --2- 172.21.15.170:0/1624008577 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61501040c0 0x7f61501064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.220+0000 7f6155d2c640 1 --2- 172.21.15.170:0/1624008577 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6150101790 0x7f6150103b80 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.220+0000 7f6155d2c640 1 -- 172.21.15.170:0/1624008577 >> 172.21.15.170:0/1624008577 conn(0x7f61500fb1a0 msgr2=0x7f61500fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:51.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.220+0000 7f6155d2c640 1 -- 172.21.15.170:0/1624008577 shutdown_connections 2024-01-25T15:01:51.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.220+0000 7f6155d2c640 1 -- 172.21.15.170:0/1624008577 wait complete. 2024-01-25T15:01:51.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.221+0000 7f6155d2c640 1 Processor -- start 2024-01-25T15:01:51.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.221+0000 7f6155d2c640 1 -- start start 2024-01-25T15:01:51.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.221+0000 7f6155d2c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6150101790 0x7f6150198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:51.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.221+0000 7f6155d2c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61501040c0 0x7f61501994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:51.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.221+0000 7f6155d2c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61501069f0 0x7f61501a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:51.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.221+0000 7f6155d2c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61501a0a80 con 0x7f61501040c0 2024-01-25T15:01:51.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.221+0000 7f6155d2c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61501a0bf0 con 0x7f6150101790 2024-01-25T15:01:51.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.221+0000 7f6155d2c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61501a0db0 con 0x7f61501069f0 2024-01-25T15:01:51.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.221+0000 7f614effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61501040c0 0x7f61501994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:51.224 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.221+0000 7f614effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61501040c0 0x7f61501994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36160/0 (socket says 172.21.15.170:36160) 2024-01-25T15:01:51.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.221+0000 7f614effd640 1 -- 172.21.15.170:0/78219137 learned_addr learned my addr 172.21.15.170:0/78219137 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:51.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.222+0000 7f614f7fe640 1 --2- 172.21.15.170:0/78219137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6150101790 0x7f6150198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:51.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.222+0000 7f614ffff640 1 --2- 172.21.15.170:0/78219137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61501069f0 0x7f61501a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:51.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.222+0000 7f614effd640 1 -- 172.21.15.170:0/78219137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61501069f0 msgr2=0x7f61501a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:51.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.222+0000 7f614effd640 1 --2- 172.21.15.170:0/78219137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61501069f0 0x7f61501a0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.222+0000 7f614effd640 1 -- 172.21.15.170:0/78219137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6150101790 msgr2=0x7f6150198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:51.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.222+0000 7f614effd640 1 --2- 172.21.15.170:0/78219137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6150101790 0x7f6150198f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.222+0000 7f614effd640 1 -- 172.21.15.170:0/78219137 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6140009560 con 0x7f61501040c0 2024-01-25T15:01:51.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.222+0000 7f614f7fe640 1 --2- 172.21.15.170:0/78219137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6150101790 0x7f6150198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:51.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.222+0000 7f614effd640 1 --2- 172.21.15.170:0/78219137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61501040c0 0x7f61501994d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f614400d740 tx=0x7f614400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:51.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.222+0000 7f614cff9640 1 -- 172.21.15.170:0/78219137 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144009c30 con 0x7f61501040c0 2024-01-25T15:01:51.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.222+0000 7f6155d2c640 1 -- 172.21.15.170:0/78219137 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61501a1090 con 0x7f61501040c0 2024-01-25T15:01:51.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.222+0000 7f614cff9640 1 -- 172.21.15.170:0/78219137 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f614400de50 con 0x7f61501040c0 2024-01-25T15:01:51.225 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.222+0000 7f614cff9640 1 -- 172.21.15.170:0/78219137 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144004ea0 con 0x7f61501040c0 2024-01-25T15:01:51.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.222+0000 7f6155d2c640 1 -- 172.21.15.170:0/78219137 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61501a1550 con 0x7f61501040c0 2024-01-25T15:01:51.226 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.223+0000 7f6155d2c640 1 -- 172.21.15.170:0/78219137 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6150108540 con 0x7f61501040c0 2024-01-25T15:01:51.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.224+0000 7f614cff9640 1 -- 172.21.15.170:0/78219137 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f6144005000 con 0x7f61501040c0 2024-01-25T15:01:51.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.224+0000 7f614cff9640 1 --2- 172.21.15.170:0/78219137 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f61380a12e0 0x7f61380a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:51.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.225+0000 7f614f7fe640 1 --2- 172.21.15.170:0/78219137 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f61380a12e0 0x7f61380a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:51.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.225+0000 7f614cff9640 1 -- 172.21.15.170:0/78219137 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f61440cc940 con 0x7f61501040c0 2024-01-25T15:01:51.227 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.225+0000 7f614f7fe640 1 --2- 172.21.15.170:0/78219137 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f61380a12e0 0x7f61380a37a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6140036040 tx=0x7f6140000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:51.228 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.228+0000 7f614cff9640 1 -- 172.21.15.170:0/78219137 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f6144095df0 con 0x7f61501040c0 2024-01-25T15:01:51.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:51 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/866604743' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-01-25T15:01:51.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:51 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:01:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:51 smithi186 ceph-mon[35697]: pgmap v344: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:01:51.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:51 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3954840179' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:51.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:51 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/866604743' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-01-25T15:01:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:51 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:01:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:51 smithi170 ceph-mon[31899]: pgmap v344: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:01:51.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:51 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3954840179' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:51.404 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.404+0000 7f6155d2c640 1 -- 172.21.15.170:0/78219137 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f615010c790 con 0x7f61501040c0 2024-01-25T15:01:51.405 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.404+0000 7f614cff9640 1 -- 172.21.15.170:0/78219137 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f615010c790 con 0x7f61501040c0 2024-01-25T15:01:51.405 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 32 2024-01-25T15:01:51.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.406+0000 7f6155d2c640 1 -- 172.21.15.170:0/78219137 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f61380a12e0 msgr2=0x7f61380a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:51.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.406+0000 7f6155d2c640 1 --2- 172.21.15.170:0/78219137 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f61380a12e0 0x7f61380a37a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6140036040 tx=0x7f6140000bc0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.406+0000 7f6155d2c640 1 -- 172.21.15.170:0/78219137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61501040c0 msgr2=0x7f61501994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:51.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.406+0000 7f6155d2c640 1 --2- 172.21.15.170:0/78219137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61501040c0 0x7f61501994d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f614400d740 tx=0x7f614400dc00 comp rx=0 tx=0).stop 2024-01-25T15:01:51.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.406+0000 7f6155d2c640 1 -- 172.21.15.170:0/78219137 shutdown_connections 2024-01-25T15:01:51.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.406+0000 7f6155d2c640 1 --2- 172.21.15.170:0/78219137 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f61380a12e0 0x7f61380a37a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.406+0000 7f6155d2c640 1 --2- 172.21.15.170:0/78219137 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f61501069f0 0x7f61501a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.406+0000 7f6155d2c640 1 --2- 172.21.15.170:0/78219137 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f61501040c0 0x7f61501994d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.406+0000 7f6155d2c640 1 --2- 172.21.15.170:0/78219137 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6150101790 0x7f6150198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.406+0000 7f6155d2c640 1 -- 172.21.15.170:0/78219137 >> 172.21.15.170:0/78219137 conn(0x7f61500fb1a0 msgr2=0x7f6150100f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:51.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.406+0000 7f6155d2c640 1 -- 172.21.15.170:0/78219137 shutdown_connections 2024-01-25T15:01:51.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.406+0000 7f6155d2c640 1 -- 172.21.15.170:0/78219137 wait complete. 2024-01-25T15:01:51.418 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:01:51.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:51 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/866604743' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-01-25T15:01:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:51 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:01:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:51 smithi191 ceph-mon[36347]: pgmap v344: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:01:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:51 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3954840179' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:51.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.522+0000 7feb1259e640 1 -- 172.21.15.170:0/3525625576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb0c1017d0 msgr2=0x7feb0c103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:51.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.522+0000 7feb1259e640 1 --2- 172.21.15.170:0/3525625576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb0c1017d0 0x7feb0c103bc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7feafc009900 tx=0x7feafc02bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:51.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.522+0000 7feb1259e640 1 -- 172.21.15.170:0/3525625576 shutdown_connections 2024-01-25T15:01:51.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.522+0000 7feb1259e640 1 --2- 172.21.15.170:0/3525625576 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb0c106a30 0x7feb0c108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.522+0000 7feb1259e640 1 --2- 172.21.15.170:0/3525625576 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb0c104100 0x7feb0c1064f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.522+0000 7feb1259e640 1 --2- 172.21.15.170:0/3525625576 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb0c1017d0 0x7feb0c103bc0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.522+0000 7feb1259e640 1 -- 172.21.15.170:0/3525625576 >> 172.21.15.170:0/3525625576 conn(0x7feb0c0fb180 msgr2=0x7feb0c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:51.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.522+0000 7feb1259e640 1 -- 172.21.15.170:0/3525625576 shutdown_connections 2024-01-25T15:01:51.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.522+0000 7feb1259e640 1 -- 172.21.15.170:0/3525625576 wait complete. 2024-01-25T15:01:51.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.522+0000 7feb1259e640 1 Processor -- start 2024-01-25T15:01:51.529 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.522+0000 7feb1259e640 1 -- start start 2024-01-25T15:01:51.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb1259e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb0c1017d0 0x7feb0c196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:51.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb1259e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb0c104100 0x7feb0c197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:51.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb1259e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb0c106a30 0x7feb0c19e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:51.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb1259e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c19e7e0 con 0x7feb0c106a30 2024-01-25T15:01:51.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb1259e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c19e950 con 0x7feb0c1017d0 2024-01-25T15:01:51.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb1259e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c19eb10 con 0x7feb0c104100 2024-01-25T15:01:51.530 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb10b3b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb0c106a30 0x7feb0c19e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:51.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb10b3b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb0c106a30 0x7feb0c19e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36182/0 (socket says 172.21.15.170:36182) 2024-01-25T15:01:51.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb10b3b640 1 -- 172.21.15.170:0/28067535 learned_addr learned my addr 172.21.15.170:0/28067535 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:51.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb0bfff640 1 --2- 172.21.15.170:0/28067535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb0c1017d0 0x7feb0c196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:51.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb0b7fe640 1 --2- 172.21.15.170:0/28067535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb0c104100 0x7feb0c197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:51.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb10b3b640 1 -- 172.21.15.170:0/28067535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb0c104100 msgr2=0x7feb0c197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:51.531 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb10b3b640 1 --2- 172.21.15.170:0/28067535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb0c104100 0x7feb0c197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb10b3b640 1 -- 172.21.15.170:0/28067535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb0c1017d0 msgr2=0x7feb0c196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:51.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb10b3b640 1 --2- 172.21.15.170:0/28067535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb0c1017d0 0x7feb0c196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb10b3b640 1 -- 172.21.15.170:0/28067535 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc009560 con 0x7feb0c106a30 2024-01-25T15:01:51.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb10b3b640 1 --2- 172.21.15.170:0/28067535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb0c106a30 0x7feb0c19e270 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7feb0400cad0 tx=0x7feb0400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:51.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.523+0000 7feb097fa640 1 -- 172.21.15.170:0/28067535 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400ae20 con 0x7feb0c106a30 2024-01-25T15:01:51.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.524+0000 7feb1259e640 1 -- 172.21.15.170:0/28067535 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0c19edf0 con 0x7feb0c106a30 2024-01-25T15:01:51.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.524+0000 7feb097fa640 1 -- 172.21.15.170:0/28067535 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb04005020 con 0x7feb0c106a30 2024-01-25T15:01:51.532 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.524+0000 7feb097fa640 1 -- 172.21.15.170:0/28067535 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400f6b0 con 0x7feb0c106a30 2024-01-25T15:01:51.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.524+0000 7feb1259e640 1 -- 172.21.15.170:0/28067535 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0c19f220 con 0x7feb0c106a30 2024-01-25T15:01:51.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.525+0000 7feb1259e640 1 -- 172.21.15.170:0/28067535 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0c0fcc70 con 0x7feb0c106a30 2024-01-25T15:01:51.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.526+0000 7feb097fa640 1 -- 172.21.15.170:0/28067535 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7feb04005190 con 0x7feb0c106a30 2024-01-25T15:01:51.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.526+0000 7feb097fa640 1 --2- 172.21.15.170:0/28067535 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feaf40a12e0 0x7feaf40a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:51.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.526+0000 7feb0bfff640 1 --2- 172.21.15.170:0/28067535 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feaf40a12e0 0x7feaf40a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:51.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.526+0000 7feb097fa640 1 -- 172.21.15.170:0/28067535 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7feb040ccd70 con 0x7feb0c106a30 2024-01-25T15:01:51.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.527+0000 7feb0bfff640 1 --2- 172.21.15.170:0/28067535 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feaf40a12e0 0x7feaf40a37a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feafc02c6b0 tx=0x7feafc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:51.533 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.530+0000 7feb097fa640 1 -- 172.21.15.170:0/28067535 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7feb04096190 con 0x7feb0c106a30 2024-01-25T15:01:51.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.703+0000 7feb1259e640 1 -- 172.21.15.170:0/28067535 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb0c02cbc0 con 0x7feb0c106a30 2024-01-25T15:01:51.704 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.703+0000 7feb097fa640 1 -- 172.21.15.170:0/28067535 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb0401d0a0 con 0x7feb0c106a30 2024-01-25T15:01:51.704 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 64 2024-01-25T15:01:51.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.705+0000 7feb1259e640 1 -- 172.21.15.170:0/28067535 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feaf40a12e0 msgr2=0x7feaf40a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:51.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.705+0000 7feb1259e640 1 --2- 172.21.15.170:0/28067535 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feaf40a12e0 0x7feaf40a37a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feafc02c6b0 tx=0x7feafc005fd0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.705+0000 7feb1259e640 1 -- 172.21.15.170:0/28067535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb0c106a30 msgr2=0x7feb0c19e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:51.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.705+0000 7feb1259e640 1 --2- 172.21.15.170:0/28067535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb0c106a30 0x7feb0c19e270 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7feb0400cad0 tx=0x7feb0400cf90 comp rx=0 tx=0).stop 2024-01-25T15:01:51.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.705+0000 7feb1259e640 1 -- 172.21.15.170:0/28067535 shutdown_connections 2024-01-25T15:01:51.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.705+0000 7feb1259e640 1 --2- 172.21.15.170:0/28067535 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feaf40a12e0 0x7feaf40a37a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.705+0000 7feb1259e640 1 --2- 172.21.15.170:0/28067535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feb0c106a30 0x7feb0c19e270 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.705+0000 7feb1259e640 1 --2- 172.21.15.170:0/28067535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feb0c104100 0x7feb0c197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.705+0000 7feb1259e640 1 --2- 172.21.15.170:0/28067535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb0c1017d0 0x7feb0c196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.705+0000 7feb1259e640 1 -- 172.21.15.170:0/28067535 >> 172.21.15.170:0/28067535 conn(0x7feb0c0fb180 msgr2=0x7feb0c102130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:51.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.705+0000 7feb1259e640 1 -- 172.21.15.170:0/28067535 shutdown_connections 2024-01-25T15:01:51.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.705+0000 7feb1259e640 1 -- 172.21.15.170:0/28067535 wait complete. 2024-01-25T15:01:51.718 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:01:51.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.819+0000 7ff2eb097640 1 -- 172.21.15.170:0/2915560819 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2e4100d10 msgr2=0x7ff2e4101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:51.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.819+0000 7ff2eb097640 1 --2- 172.21.15.170:0/2915560819 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2e4100d10 0x7ff2e4101130 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8009900 tx=0x7ff2d802bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:51.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.819+0000 7ff2eb097640 1 -- 172.21.15.170:0/2915560819 shutdown_connections 2024-01-25T15:01:51.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.819+0000 7ff2eb097640 1 --2- 172.21.15.170:0/2915560819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2e41028c0 0x7ff2e4109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.819+0000 7ff2eb097640 1 --2- 172.21.15.170:0/2915560819 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2e4101f00 0x7ff2e4102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.819+0000 7ff2eb097640 1 --2- 172.21.15.170:0/2915560819 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2e4100d10 0x7ff2e4101130 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.819+0000 7ff2eb097640 1 -- 172.21.15.170:0/2915560819 >> 172.21.15.170:0/2915560819 conn(0x7ff2e40fc2a0 msgr2=0x7ff2e40fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:51.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.819+0000 7ff2eb097640 1 -- 172.21.15.170:0/2915560819 shutdown_connections 2024-01-25T15:01:51.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.819+0000 7ff2eb097640 1 -- 172.21.15.170:0/2915560819 wait complete. 2024-01-25T15:01:51.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.819+0000 7ff2eb097640 1 Processor -- start 2024-01-25T15:01:51.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2eb097640 1 -- start start 2024-01-25T15:01:51.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2eb097640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2e4100d10 0x7ff2e4196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:51.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2eb097640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2e4101f00 0x7ff2e4197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:51.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2eb097640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2e41028c0 0x7ff2e419e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:51.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2eb097640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e419e800 con 0x7ff2e41028c0 2024-01-25T15:01:51.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2eb097640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e419e970 con 0x7ff2e4100d10 2024-01-25T15:01:51.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2eb097640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e419eb30 con 0x7ff2e4101f00 2024-01-25T15:01:51.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2e9634640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2e41028c0 0x7ff2e419e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:51.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2e9634640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2e41028c0 0x7ff2e419e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36192/0 (socket says 172.21.15.170:36192) 2024-01-25T15:01:51.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2e9634640 1 -- 172.21.15.170:0/995695263 learned_addr learned my addr 172.21.15.170:0/995695263 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:51.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2e8e33640 1 --2- 172.21.15.170:0/995695263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2e4100d10 0x7ff2e4196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:51.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2e9634640 1 -- 172.21.15.170:0/995695263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2e4101f00 msgr2=0x7ff2e4197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:51.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2e3fff640 1 --2- 172.21.15.170:0/995695263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2e4101f00 0x7ff2e4197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:51.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2e9634640 1 --2- 172.21.15.170:0/995695263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2e4101f00 0x7ff2e4197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2e9634640 1 -- 172.21.15.170:0/995695263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2e4100d10 msgr2=0x7ff2e4196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:51.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2e9634640 1 --2- 172.21.15.170:0/995695263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2e4100d10 0x7ff2e4196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:51.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2e9634640 1 -- 172.21.15.170:0/995695263 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d8009560 con 0x7ff2e41028c0 2024-01-25T15:01:51.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2e3fff640 1 --2- 172.21.15.170:0/995695263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2e4101f00 0x7ff2e4197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:51.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2e9634640 1 --2- 172.21.15.170:0/995695263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2e41028c0 0x7ff2e419e290 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00eaa0 tx=0x7ff2dc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:51.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2e1ffb640 1 -- 172.21.15.170:0/995695263 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc00cdb0 con 0x7ff2e41028c0 2024-01-25T15:01:51.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2e1ffb640 1 -- 172.21.15.170:0/995695263 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2dc005020 con 0x7ff2e41028c0 2024-01-25T15:01:51.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.820+0000 7ff2eb097640 1 -- 172.21.15.170:0/995695263 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e419ee10 con 0x7ff2e41028c0 2024-01-25T15:01:51.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.821+0000 7ff2e1ffb640 1 -- 172.21.15.170:0/995695263 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc0116d0 con 0x7ff2e41028c0 2024-01-25T15:01:51.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.821+0000 7ff2eb097640 1 -- 172.21.15.170:0/995695263 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e419f1e0 con 0x7ff2e41028c0 2024-01-25T15:01:51.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.822+0000 7ff2eb097640 1 -- 172.21.15.170:0/995695263 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e4108150 con 0x7ff2e41028c0 2024-01-25T15:01:51.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.823+0000 7ff2e1ffb640 1 -- 172.21.15.170:0/995695263 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 18) v1 ==== 135896+0+0 (secure 0 0 0) 0x7ff2dc005190 con 0x7ff2e41028c0 2024-01-25T15:01:51.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.823+0000 7ff2e1ffb640 1 --2- 172.21.15.170:0/995695263 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff2d40a12e0 0x7ff2d40a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:51.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.823+0000 7ff2e1ffb640 1 -- 172.21.15.170:0/995695263 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7ff2dc0ccdd0 con 0x7ff2e41028c0 2024-01-25T15:01:51.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.823+0000 7ff2e8e33640 1 --2- 172.21.15.170:0/995695263 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff2d40a12e0 0x7ff2d40a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:51.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.824+0000 7ff2e8e33640 1 --2- 172.21.15.170:0/995695263 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff2d40a12e0 0x7ff2d40a37a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8000c00 tx=0x7ff2d802c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:51.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:51.827+0000 7ff2e1ffb640 1 -- 172.21.15.170:0/995695263 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ff2dc0961f0 con 0x7ff2e41028c0 2024-01-25T15:01:52.001 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.000+0000 7ff2eb097640 1 -- 172.21.15.170:0/995695263 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2e410c5c0 con 0x7ff2e41028c0 2024-01-25T15:01:52.003 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.002+0000 7ff2e1ffb640 1 -- 172.21.15.170:0/995695263 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22550 (secure 0 0 0) 0x7ff2dc01f020 con 0x7ff2e41028c0 2024-01-25T15:01:52.004 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:52.004 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":87,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T15:00:57.274280+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:01:52.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.004+0000 7ff2eb097640 1 -- 172.21.15.170:0/995695263 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff2d40a12e0 msgr2=0x7ff2d40a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.004+0000 7ff2eb097640 1 --2- 172.21.15.170:0/995695263 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff2d40a12e0 0x7ff2d40a37a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff2d8000c00 tx=0x7ff2d802c5d0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.004+0000 7ff2eb097640 1 -- 172.21.15.170:0/995695263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2e41028c0 msgr2=0x7ff2e419e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.004+0000 7ff2eb097640 1 --2- 172.21.15.170:0/995695263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2e41028c0 0x7ff2e419e290 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00eaa0 tx=0x7ff2dc00ef60 comp rx=0 tx=0).stop 2024-01-25T15:01:52.006 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.004+0000 7ff2eb097640 1 -- 172.21.15.170:0/995695263 shutdown_connections 2024-01-25T15:01:52.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.004+0000 7ff2eb097640 1 --2- 172.21.15.170:0/995695263 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff2d40a12e0 0x7ff2d40a37a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.004+0000 7ff2eb097640 1 --2- 172.21.15.170:0/995695263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff2e41028c0 0x7ff2e419e290 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.005+0000 7ff2eb097640 1 --2- 172.21.15.170:0/995695263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff2e4101f00 0x7ff2e4197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.005+0000 7ff2eb097640 1 --2- 172.21.15.170:0/995695263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff2e4100d10 0x7ff2e4196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.005+0000 7ff2eb097640 1 -- 172.21.15.170:0/995695263 >> 172.21.15.170:0/995695263 conn(0x7ff2e40fc2a0 msgr2=0x7ff2e4105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:52.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.005+0000 7ff2eb097640 1 -- 172.21.15.170:0/995695263 shutdown_connections 2024-01-25T15:01:52.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.005+0000 7ff2eb097640 1 -- 172.21.15.170:0/995695263 wait complete. 2024-01-25T15:01:52.017 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T14:55:22.432727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T14:59:51.465304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T14:59:52.749298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:01:52.018 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:01:52.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 -- 172.21.15.170:0/4185909060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97900fefb0 msgr2=0x7f97900ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 --2- 172.21.15.170:0/4185909060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97900fefb0 0x7f97900ff3d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f978c009900 tx=0x7f978c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:52.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 -- 172.21.15.170:0/4185909060 shutdown_connections 2024-01-25T15:01:52.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 --2- 172.21.15.170:0/4185909060 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9790102940 0x7f97901091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 --2- 172.21.15.170:0/4185909060 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9790101f80 0x7f9790102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 --2- 172.21.15.170:0/4185909060 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97900fefb0 0x7f97900ff3d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 -- 172.21.15.170:0/4185909060 >> 172.21.15.170:0/4185909060 conn(0x7f97900fa8e0 msgr2=0x7f97900fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:52.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 -- 172.21.15.170:0/4185909060 shutdown_connections 2024-01-25T15:01:52.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 -- 172.21.15.170:0/4185909060 wait complete. 2024-01-25T15:01:52.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 Processor -- start 2024-01-25T15:01:52.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 -- start start 2024-01-25T15:01:52.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97900fefb0 0x7f9790196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:52.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9790101f80 0x7f97901971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:52.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9790102940 0x7f979019e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:52.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979019e7b0 con 0x7f97900fefb0 2024-01-25T15:01:52.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979019e920 con 0x7f9790101f80 2024-01-25T15:01:52.132 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.128+0000 7f979853e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979019eae0 con 0x7f9790102940 2024-01-25T15:01:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f97962da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97900fefb0 0x7f9790196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f97962da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97900fefb0 0x7f9790196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36212/0 (socket says 172.21.15.170:36212) 2024-01-25T15:01:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f97962da640 1 -- 172.21.15.170:0/1489479004 learned_addr learned my addr 172.21.15.170:0/1489479004 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f9796adb640 1 --2- 172.21.15.170:0/1489479004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9790102940 0x7f979019e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f9795ad9640 1 --2- 172.21.15.170:0/1489479004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9790101f80 0x7f97901971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f97962da640 1 -- 172.21.15.170:0/1489479004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9790102940 msgr2=0x7f979019e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f97962da640 1 --2- 172.21.15.170:0/1489479004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9790102940 0x7f979019e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f97962da640 1 -- 172.21.15.170:0/1489479004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9790101f80 msgr2=0x7f97901971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f97962da640 1 --2- 172.21.15.170:0/1489479004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9790101f80 0x7f97901971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f97962da640 1 -- 172.21.15.170:0/1489479004 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c009560 con 0x7f97900fefb0 2024-01-25T15:01:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f9796adb640 1 --2- 172.21.15.170:0/1489479004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9790102940 0x7f979019e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f97962da640 1 --2- 172.21.15.170:0/1489479004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97900fefb0 0x7f9790196ca0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f978c009230 tx=0x7f978c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f97877fe640 1 -- 172.21.15.170:0/1489479004 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c004440 con 0x7f97900fefb0 2024-01-25T15:01:52.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f97877fe640 1 -- 172.21.15.170:0/1489479004 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f978c0054c0 con 0x7f97900fefb0 2024-01-25T15:01:52.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f979853e640 1 -- 172.21.15.170:0/1489479004 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979019ed60 con 0x7f97900fefb0 2024-01-25T15:01:52.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f97877fe640 1 -- 172.21.15.170:0/1489479004 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c003e80 con 0x7f97900fefb0 2024-01-25T15:01:52.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.129+0000 7f979853e640 1 -- 172.21.15.170:0/1489479004 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979019f200 con 0x7f97900fefb0 2024-01-25T15:01:52.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.130+0000 7f979853e640 1 -- 172.21.15.170:0/1489479004 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97901081d0 con 0x7f97900fefb0 2024-01-25T15:01:52.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.131+0000 7f97877fe640 1 -- 172.21.15.170:0/1489479004 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f978c0035f0 con 0x7f97900fefb0 2024-01-25T15:01:52.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.132+0000 7f97877fe640 1 --2- 172.21.15.170:0/1489479004 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f977c0a13f0 0x7f977c0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:52.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.132+0000 7f97877fe640 1 -- 172.21.15.170:0/1489479004 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f978c0ef570 con 0x7f97900fefb0 2024-01-25T15:01:52.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.132+0000 7f9795ad9640 1 --2- 172.21.15.170:0/1489479004 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f977c0a13f0 0x7f977c0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:52.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.132+0000 7f9795ad9640 1 --2- 172.21.15.170:0/1489479004 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f977c0a13f0 0x7f977c0a38b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9780005e10 tx=0x7f9780005da0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:52.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.136+0000 7f97877fe640 1 -- 172.21.15.170:0/1489479004 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f978c0b8af0 con 0x7f97900fefb0 2024-01-25T15:01:52.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.308+0000 7f979853e640 1 -- 172.21.15.170:0/1489479004 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f979002cb10 con 0x7f97900fefb0 2024-01-25T15:01:52.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.309+0000 7f97877fe640 1 -- 172.21.15.170:0/1489479004 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f978c043020 con 0x7f97900fefb0 2024-01-25T15:01:52.309 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 1 2024-01-25T15:01:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.310+0000 7f979853e640 1 -- 172.21.15.170:0/1489479004 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f977c0a13f0 msgr2=0x7f977c0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.310+0000 7f979853e640 1 --2- 172.21.15.170:0/1489479004 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f977c0a13f0 0x7f977c0a38b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9780005e10 tx=0x7f9780005da0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.310+0000 7f979853e640 1 -- 172.21.15.170:0/1489479004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97900fefb0 msgr2=0x7f9790196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.310+0000 7f979853e640 1 --2- 172.21.15.170:0/1489479004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97900fefb0 0x7f9790196ca0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f978c009230 tx=0x7f978c004040 comp rx=0 tx=0).stop 2024-01-25T15:01:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.311+0000 7f979853e640 1 -- 172.21.15.170:0/1489479004 shutdown_connections 2024-01-25T15:01:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.311+0000 7f979853e640 1 --2- 172.21.15.170:0/1489479004 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f977c0a13f0 0x7f977c0a38b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.311+0000 7f979853e640 1 --2- 172.21.15.170:0/1489479004 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9790101f80 0x7f97901971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.311+0000 7f979853e640 1 --2- 172.21.15.170:0/1489479004 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9790102940 0x7f979019e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.311+0000 7f979853e640 1 --2- 172.21.15.170:0/1489479004 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97900fefb0 0x7f9790196ca0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.311+0000 7f979853e640 1 -- 172.21.15.170:0/1489479004 >> 172.21.15.170:0/1489479004 conn(0x7f97900fa8e0 msgr2=0x7f97901053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:52.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.311+0000 7f979853e640 1 -- 172.21.15.170:0/1489479004 shutdown_connections 2024-01-25T15:01:52.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.311+0000 7f979853e640 1 -- 172.21.15.170:0/1489479004 wait complete. 2024-01-25T15:01:52.322 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:52 smithi170 ceph-mon[31899]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:52.322 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:52 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3529863213' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:52.322 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:52 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/78219137' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:52.322 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:52 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/28067535' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:52.322 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:52 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/995695263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:52.323 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:01:52.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:52 smithi186 ceph-mon[35697]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:52.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:52 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3529863213' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:52.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:52 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/78219137' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:52.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:52 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/28067535' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:52.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:52 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/995695263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.426+0000 7fa3851ad640 1 -- 172.21.15.170:0/89065973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3801017d0 msgr2=0x7fa380103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.426+0000 7fa3851ad640 1 --2- 172.21.15.170:0/89065973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3801017d0 0x7fa380103bc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa370009ca0 tx=0x7fa37002c100 comp rx=0 tx=0).stop 2024-01-25T15:01:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.426+0000 7fa3851ad640 1 -- 172.21.15.170:0/89065973 shutdown_connections 2024-01-25T15:01:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.426+0000 7fa3851ad640 1 --2- 172.21.15.170:0/89065973 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa380104100 0x7fa3801064f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.426+0000 7fa3851ad640 1 --2- 172.21.15.170:0/89065973 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa380106a30 0x7fa380108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.426+0000 7fa3851ad640 1 --2- 172.21.15.170:0/89065973 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3801017d0 0x7fa380103bc0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.426+0000 7fa3851ad640 1 -- 172.21.15.170:0/89065973 >> 172.21.15.170:0/89065973 conn(0x7fa3800fb180 msgr2=0x7fa3800fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.426+0000 7fa3851ad640 1 -- 172.21.15.170:0/89065973 shutdown_connections 2024-01-25T15:01:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.426+0000 7fa3851ad640 1 -- 172.21.15.170:0/89065973 wait complete. 2024-01-25T15:01:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.427+0000 7fa3851ad640 1 Processor -- start 2024-01-25T15:01:52.431 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.427+0000 7fa3851ad640 1 -- start start 2024-01-25T15:01:52.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.427+0000 7fa3851ad640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3801017d0 0x7fa380196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:52.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.427+0000 7fa3851ad640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa380104100 0x7fa3801971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:52.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.427+0000 7fa3851ad640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa380106a30 0x7fa38019e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:52.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.427+0000 7fa3851ad640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38019e790 con 0x7fa3801017d0 2024-01-25T15:01:52.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.427+0000 7fa3851ad640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38019e900 con 0x7fa380104100 2024-01-25T15:01:52.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.427+0000 7fa3851ad640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38019eac0 con 0x7fa380106a30 2024-01-25T15:01:52.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.427+0000 7fa37ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3801017d0 0x7fa380196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:52.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.427+0000 7fa37ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3801017d0 0x7fa380196c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36228/0 (socket says 172.21.15.170:36228) 2024-01-25T15:01:52.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.427+0000 7fa37ed9d640 1 -- 172.21.15.170:0/3536485998 learned_addr learned my addr 172.21.15.170:0/3536485998 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:52.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.428+0000 7fa37f59e640 1 --2- 172.21.15.170:0/3536485998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa380106a30 0x7fa38019e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:52.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.428+0000 7fa37e59c640 1 --2- 172.21.15.170:0/3536485998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa380104100 0x7fa3801971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:52.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.428+0000 7fa37ed9d640 1 -- 172.21.15.170:0/3536485998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa380106a30 msgr2=0x7fa38019e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.432 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.428+0000 7fa37ed9d640 1 --2- 172.21.15.170:0/3536485998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa380106a30 0x7fa38019e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.428+0000 7fa37ed9d640 1 -- 172.21.15.170:0/3536485998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa380104100 msgr2=0x7fa3801971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.428+0000 7fa37ed9d640 1 --2- 172.21.15.170:0/3536485998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa380104100 0x7fa3801971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.428+0000 7fa37ed9d640 1 -- 172.21.15.170:0/3536485998 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa370009900 con 0x7fa3801017d0 2024-01-25T15:01:52.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.428+0000 7fa37e59c640 1 --2- 172.21.15.170:0/3536485998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa380104100 0x7fa3801971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:52.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.428+0000 7fa37ed9d640 1 --2- 172.21.15.170:0/3536485998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3801017d0 0x7fa380196c80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa3700098d0 tx=0x7fa370032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:52.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.428+0000 7fa367fff640 1 -- 172.21.15.170:0/3536485998 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa370034850 con 0x7fa3801017d0 2024-01-25T15:01:52.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.428+0000 7fa3851ad640 1 -- 172.21.15.170:0/3536485998 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38019ed40 con 0x7fa3801017d0 2024-01-25T15:01:52.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.428+0000 7fa367fff640 1 -- 172.21.15.170:0/3536485998 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa370003e30 con 0x7fa3801017d0 2024-01-25T15:01:52.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.428+0000 7fa367fff640 1 -- 172.21.15.170:0/3536485998 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3700406b0 con 0x7fa3801017d0 2024-01-25T15:01:52.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.428+0000 7fa3851ad640 1 -- 172.21.15.170:0/3536485998 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38019f1a0 con 0x7fa3801017d0 2024-01-25T15:01:52.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.429+0000 7fa3851ad640 1 -- 172.21.15.170:0/3536485998 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3800fcc70 con 0x7fa3801017d0 2024-01-25T15:01:52.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.430+0000 7fa367fff640 1 -- 172.21.15.170:0/3536485998 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fa37000a040 con 0x7fa3801017d0 2024-01-25T15:01:52.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.430+0000 7fa367fff640 1 --2- 172.21.15.170:0/3536485998 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa3680a1370 0x7fa3680a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:52.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.431+0000 7fa37e59c640 1 --2- 172.21.15.170:0/3536485998 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa3680a1370 0x7fa3680a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:52.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.431+0000 7fa367fff640 1 -- 172.21.15.170:0/3536485998 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fa3700efa80 con 0x7fa3801017d0 2024-01-25T15:01:52.434 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.431+0000 7fa37e59c640 1 --2- 172.21.15.170:0/3536485998 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa3680a1370 0x7fa3680a3830 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa380198180 tx=0x7fa374005d90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:52.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.435+0000 7fa367fff640 1 -- 172.21.15.170:0/3536485998 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa3700f1e60 con 0x7fa3801017d0 2024-01-25T15:01:52.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:52 smithi191 ceph-mon[36347]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-01-25T15:01:52.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:52 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3529863213' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:52.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:52 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/78219137' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:52.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:52 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/28067535' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:52.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:52 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/995695263' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:52.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.607+0000 7fa3851ad640 1 -- 172.21.15.170:0/3536485998 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa38010c820 con 0x7fa3801017d0 2024-01-25T15:01:52.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.608+0000 7fa367fff640 1 -- 172.21.15.170:0/3536485998 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa3700b8ee0 con 0x7fa3801017d0 2024-01-25T15:01:52.609 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 32 2024-01-25T15:01:52.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.610+0000 7fa3851ad640 1 -- 172.21.15.170:0/3536485998 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa3680a1370 msgr2=0x7fa3680a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.610+0000 7fa3851ad640 1 --2- 172.21.15.170:0/3536485998 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa3680a1370 0x7fa3680a3830 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa380198180 tx=0x7fa374005d90 comp rx=0 tx=0).stop 2024-01-25T15:01:52.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.610+0000 7fa3851ad640 1 -- 172.21.15.170:0/3536485998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3801017d0 msgr2=0x7fa380196c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.610+0000 7fa3851ad640 1 --2- 172.21.15.170:0/3536485998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3801017d0 0x7fa380196c80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa3700098d0 tx=0x7fa370032a10 comp rx=0 tx=0).stop 2024-01-25T15:01:52.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.610+0000 7fa3851ad640 1 -- 172.21.15.170:0/3536485998 shutdown_connections 2024-01-25T15:01:52.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.610+0000 7fa3851ad640 1 --2- 172.21.15.170:0/3536485998 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa3680a1370 0x7fa3680a3830 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.610+0000 7fa3851ad640 1 --2- 172.21.15.170:0/3536485998 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa380104100 0x7fa3801971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.610+0000 7fa3851ad640 1 --2- 172.21.15.170:0/3536485998 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa380106a30 0x7fa38019e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.610+0000 7fa3851ad640 1 --2- 172.21.15.170:0/3536485998 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa3801017d0 0x7fa380196c80 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.610+0000 7fa3851ad640 1 -- 172.21.15.170:0/3536485998 >> 172.21.15.170:0/3536485998 conn(0x7fa3800fb180 msgr2=0x7fa380102130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:52.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.610+0000 7fa3851ad640 1 -- 172.21.15.170:0/3536485998 shutdown_connections 2024-01-25T15:01:52.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.610+0000 7fa3851ad640 1 -- 172.21.15.170:0/3536485998 wait complete. 2024-01-25T15:01:52.622 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:01:52.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.725+0000 7fa7ee4c9640 1 -- 172.21.15.170:0/1165751302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7e8100d00 msgr2=0x7fa7e8101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.725+0000 7fa7ee4c9640 1 --2- 172.21.15.170:0/1165751302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7e8100d00 0x7fa7e8101120 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009900 tx=0x7fa7d802bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:52.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.725+0000 7fa7ee4c9640 1 -- 172.21.15.170:0/1165751302 shutdown_connections 2024-01-25T15:01:52.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.725+0000 7fa7ee4c9640 1 --2- 172.21.15.170:0/1165751302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7e81028b0 0x7fa7e8109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.725+0000 7fa7ee4c9640 1 --2- 172.21.15.170:0/1165751302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7e8101ef0 0x7fa7e8102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.725+0000 7fa7ee4c9640 1 --2- 172.21.15.170:0/1165751302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7e8100d00 0x7fa7e8101120 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.725+0000 7fa7ee4c9640 1 -- 172.21.15.170:0/1165751302 >> 172.21.15.170:0/1165751302 conn(0x7fa7e80fc290 msgr2=0x7fa7e80fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:52.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.725+0000 7fa7ee4c9640 1 -- 172.21.15.170:0/1165751302 shutdown_connections 2024-01-25T15:01:52.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.725+0000 7fa7ee4c9640 1 -- 172.21.15.170:0/1165751302 wait complete. 2024-01-25T15:01:52.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.726+0000 7fa7ee4c9640 1 Processor -- start 2024-01-25T15:01:52.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.726+0000 7fa7ee4c9640 1 -- start start 2024-01-25T15:01:52.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.726+0000 7fa7ee4c9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7e8100d00 0x7fa7e8196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:52.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.726+0000 7fa7ee4c9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7e8101ef0 0x7fa7e8197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:52.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.726+0000 7fa7ee4c9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7e81028b0 0x7fa7e819e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:52.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.726+0000 7fa7ee4c9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e819e810 con 0x7fa7e81028b0 2024-01-25T15:01:52.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.726+0000 7fa7ee4c9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e819e980 con 0x7fa7e8101ef0 2024-01-25T15:01:52.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.726+0000 7fa7ee4c9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e819eb40 con 0x7fa7e8100d00 2024-01-25T15:01:52.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.726+0000 7fa7eca66640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7e81028b0 0x7fa7e819e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:52.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.726+0000 7fa7eca66640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7e81028b0 0x7fa7e819e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36246/0 (socket says 172.21.15.170:36246) 2024-01-25T15:01:52.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.726+0000 7fa7eca66640 1 -- 172.21.15.170:0/3416509607 learned_addr learned my addr 172.21.15.170:0/3416509607 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:52.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.726+0000 7fa7e77fe640 1 --2- 172.21.15.170:0/3416509607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7e8101ef0 0x7fa7e8197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:52.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.726+0000 7fa7e7fff640 1 --2- 172.21.15.170:0/3416509607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7e8100d00 0x7fa7e8196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:52.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.727+0000 7fa7eca66640 1 -- 172.21.15.170:0/3416509607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7e8100d00 msgr2=0x7fa7e8196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.727+0000 7fa7eca66640 1 --2- 172.21.15.170:0/3416509607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7e8100d00 0x7fa7e8196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.727+0000 7fa7eca66640 1 -- 172.21.15.170:0/3416509607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7e8101ef0 msgr2=0x7fa7e8197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.727+0000 7fa7eca66640 1 --2- 172.21.15.170:0/3416509607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7e8101ef0 0x7fa7e8197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.727+0000 7fa7eca66640 1 -- 172.21.15.170:0/3416509607 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d8009560 con 0x7fa7e81028b0 2024-01-25T15:01:52.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.727+0000 7fa7eca66640 1 --2- 172.21.15.170:0/3416509607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7e81028b0 0x7fa7e819e2a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000eaa0 tx=0x7fa7e000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:52.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.727+0000 7fa7e57fa640 1 -- 172.21.15.170:0/3416509607 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000cdb0 con 0x7fa7e81028b0 2024-01-25T15:01:52.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.727+0000 7fa7e57fa640 1 -- 172.21.15.170:0/3416509607 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa7e0005020 con 0x7fa7e81028b0 2024-01-25T15:01:52.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.727+0000 7fa7ee4c9640 1 -- 172.21.15.170:0/3416509607 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e819ee20 con 0x7fa7e81028b0 2024-01-25T15:01:52.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.727+0000 7fa7e57fa640 1 -- 172.21.15.170:0/3416509607 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e00116d0 con 0x7fa7e81028b0 2024-01-25T15:01:52.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.727+0000 7fa7ee4c9640 1 -- 172.21.15.170:0/3416509607 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e819f240 con 0x7fa7e81028b0 2024-01-25T15:01:52.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.728+0000 7fa7ee4c9640 1 -- 172.21.15.170:0/3416509607 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e8108160 con 0x7fa7e81028b0 2024-01-25T15:01:52.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.729+0000 7fa7e57fa640 1 -- 172.21.15.170:0/3416509607 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fa7e0005190 con 0x7fa7e81028b0 2024-01-25T15:01:52.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.730+0000 7fa7e57fa640 1 --2- 172.21.15.170:0/3416509607 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa7d00a13f0 0x7fa7d00a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:52.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.730+0000 7fa7e7fff640 1 --2- 172.21.15.170:0/3416509607 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa7d00a13f0 0x7fa7d00a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:52.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.730+0000 7fa7e57fa640 1 -- 172.21.15.170:0/3416509607 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fa7e00cce40 con 0x7fa7e81028b0 2024-01-25T15:01:52.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.730+0000 7fa7e7fff640 1 --2- 172.21.15.170:0/3416509607 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa7d00a13f0 0x7fa7d00a38b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8000c00 tx=0x7fa7d802c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:52.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.734+0000 7fa7e57fa640 1 -- 172.21.15.170:0/3416509607 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa7e00961b0 con 0x7fa7e81028b0 2024-01-25T15:01:52.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.906+0000 7fa7ee4c9640 1 -- 172.21.15.170:0/3416509607 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa7e810c800 con 0x7fa7e81028b0 2024-01-25T15:01:52.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.906+0000 7fa7e57fa640 1 -- 172.21.15.170:0/3416509607 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa7e001f020 con 0x7fa7e81028b0 2024-01-25T15:01:52.907 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 64 2024-01-25T15:01:52.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.908+0000 7fa7ee4c9640 1 -- 172.21.15.170:0/3416509607 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa7d00a13f0 msgr2=0x7fa7d00a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.908+0000 7fa7ee4c9640 1 --2- 172.21.15.170:0/3416509607 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa7d00a13f0 0x7fa7d00a38b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8000c00 tx=0x7fa7d802c5d0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.908+0000 7fa7ee4c9640 1 -- 172.21.15.170:0/3416509607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7e81028b0 msgr2=0x7fa7e819e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:52.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.908+0000 7fa7ee4c9640 1 --2- 172.21.15.170:0/3416509607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7e81028b0 0x7fa7e819e2a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa7e000eaa0 tx=0x7fa7e000ef60 comp rx=0 tx=0).stop 2024-01-25T15:01:52.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.908+0000 7fa7ee4c9640 1 -- 172.21.15.170:0/3416509607 shutdown_connections 2024-01-25T15:01:52.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.908+0000 7fa7ee4c9640 1 --2- 172.21.15.170:0/3416509607 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa7d00a13f0 0x7fa7d00a38b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.908+0000 7fa7ee4c9640 1 --2- 172.21.15.170:0/3416509607 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa7e8101ef0 0x7fa7e8197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.908+0000 7fa7ee4c9640 1 --2- 172.21.15.170:0/3416509607 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa7e81028b0 0x7fa7e819e2a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.908+0000 7fa7ee4c9640 1 --2- 172.21.15.170:0/3416509607 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa7e8100d00 0x7fa7e8196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:52.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.908+0000 7fa7ee4c9640 1 -- 172.21.15.170:0/3416509607 >> 172.21.15.170:0/3416509607 conn(0x7fa7e80fc290 msgr2=0x7fa7e8105330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:52.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.908+0000 7fa7ee4c9640 1 -- 172.21.15.170:0/3416509607 shutdown_connections 2024-01-25T15:01:52.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:52.908+0000 7fa7ee4c9640 1 -- 172.21.15.170:0/3416509607 wait complete. 2024-01-25T15:01:52.920 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-01-25T15:01:52.920 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:01:53.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.019+0000 7fb7a09a4640 1 -- 172.21.15.170:0/859603798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb79c1017c0 msgr2=0x7fb79c108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:53.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.019+0000 7fb7a09a4640 1 --2- 172.21.15.170:0/859603798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb79c1017c0 0x7fb79c108050 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb78c009ca0 tx=0x7fb78c02c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.020+0000 7fb7a09a4640 1 -- 172.21.15.170:0/859603798 shutdown_connections 2024-01-25T15:01:53.023 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.020+0000 7fb7a09a4640 1 --2- 172.21.15.170:0/859603798 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb79c100e00 0x7fb79c101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.020+0000 7fb7a09a4640 1 --2- 172.21.15.170:0/859603798 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb79c1017c0 0x7fb79c108050 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.020+0000 7fb7a09a4640 1 --2- 172.21.15.170:0/859603798 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb79c0ffc10 0x7fb79c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.020+0000 7fb7a09a4640 1 -- 172.21.15.170:0/859603798 >> 172.21.15.170:0/859603798 conn(0x7fb79c0fb180 msgr2=0x7fb79c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:53.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.020+0000 7fb7a09a4640 1 -- 172.21.15.170:0/859603798 shutdown_connections 2024-01-25T15:01:53.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.020+0000 7fb7a09a4640 1 -- 172.21.15.170:0/859603798 wait complete. 2024-01-25T15:01:53.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.020+0000 7fb7a09a4640 1 Processor -- start 2024-01-25T15:01:53.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.020+0000 7fb7a09a4640 1 -- start start 2024-01-25T15:01:53.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb7a09a4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb79c0ffc10 0x7fb79c195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:53.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb7a09a4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb79c100e00 0x7fb79c1960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:53.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb7a09a4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb79c1017c0 0x7fb79c19d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:53.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb7a09a4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c19d660 con 0x7fb79c100e00 2024-01-25T15:01:53.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb7a09a4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c19d7d0 con 0x7fb79c0ffc10 2024-01-25T15:01:53.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb7a09a4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb79c19d990 con 0x7fb79c1017c0 2024-01-25T15:01:53.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb799d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb79c100e00 0x7fb79c1960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:53.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb799d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb79c100e00 0x7fb79c1960b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36258/0 (socket says 172.21.15.170:36258) 2024-01-25T15:01:53.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb799d9b640 1 -- 172.21.15.170:0/2288427661 learned_addr learned my addr 172.21.15.170:0/2288427661 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:53.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb79a59c640 1 --2- 172.21.15.170:0/2288427661 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb79c0ffc10 0x7fb79c195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:53.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb79ad9d640 1 --2- 172.21.15.170:0/2288427661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb79c1017c0 0x7fb79c19d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:53.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb799d9b640 1 -- 172.21.15.170:0/2288427661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb79c1017c0 msgr2=0x7fb79c19d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:53.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb799d9b640 1 --2- 172.21.15.170:0/2288427661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb79c1017c0 0x7fb79c19d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb799d9b640 1 -- 172.21.15.170:0/2288427661 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb79c0ffc10 msgr2=0x7fb79c195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:53.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb799d9b640 1 --2- 172.21.15.170:0/2288427661 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb79c0ffc10 0x7fb79c195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb799d9b640 1 -- 172.21.15.170:0/2288427661 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78c009900 con 0x7fb79c100e00 2024-01-25T15:01:53.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb79a59c640 1 --2- 172.21.15.170:0/2288427661 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb79c0ffc10 0x7fb79c195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:53.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb799d9b640 1 --2- 172.21.15.170:0/2288427661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb79c100e00 0x7fb79c1960b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb784007b50 tx=0x7fb78400e420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:53.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb7937fe640 1 -- 172.21.15.170:0/2288427661 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784011070 con 0x7fb79c100e00 2024-01-25T15:01:53.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb7937fe640 1 -- 172.21.15.170:0/2288427661 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb78400c2e0 con 0x7fb79c100e00 2024-01-25T15:01:53.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb7a09a4640 1 -- 172.21.15.170:0/2288427661 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb79c067eb0 con 0x7fb79c100e00 2024-01-25T15:01:53.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb7937fe640 1 -- 172.21.15.170:0/2288427661 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78400ab30 con 0x7fb79c100e00 2024-01-25T15:01:53.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.021+0000 7fb7a09a4640 1 -- 172.21.15.170:0/2288427661 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79c0683c0 con 0x7fb79c100e00 2024-01-25T15:01:53.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.022+0000 7fb7a09a4640 1 -- 172.21.15.170:0/2288427661 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb79c067ae0 con 0x7fb79c100e00 2024-01-25T15:01:53.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.023+0000 7fb7937fe640 1 -- 172.21.15.170:0/2288427661 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fb78400acd0 con 0x7fb79c100e00 2024-01-25T15:01:53.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.024+0000 7fb7937fe640 1 --2- 172.21.15.170:0/2288427661 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7880a1370 0x7fb7880a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:53.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.024+0000 7fb79a59c640 1 --2- 172.21.15.170:0/2288427661 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7880a1370 0x7fb7880a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:53.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.024+0000 7fb7937fe640 1 -- 172.21.15.170:0/2288427661 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fb7840ce070 con 0x7fb79c100e00 2024-01-25T15:01:53.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.024+0000 7fb79a59c640 1 --2- 172.21.15.170:0/2288427661 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7880a1370 0x7fb7880a3830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb7940058c0 tx=0x7fb794005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:53.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.028+0000 7fb7937fe640 1 -- 172.21.15.170:0/2288427661 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fb784097450 con 0x7fb79c100e00 2024-01-25T15:01:53.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.244+0000 7fb7a09a4640 1 -- 172.21.15.170:0/2288427661 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb79c10b6a0 con 0x7fb79c100e00 2024-01-25T15:01:53.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.245+0000 7fb7937fe640 1 -- 172.21.15.170:0/2288427661 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11411 (secure 0 0 0) 0x7fb78409aa70 con 0x7fb79c100e00 2024-01-25T15:01:53.246 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:53.246 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-25T14:59:53.534085+0000","modified":"2024-01-25T15:01:49.253000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24484,"mds_1":24479,"mds_2":24466,"mds_3":24418,"mds_4":24398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":4,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24479":{"gid":24479,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/2132502182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":2132502182},{"type":"v1","addr":"172.21.15.186:6839","nonce":2132502182}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:01:53.246 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 26 2024-01-25T15:01:53.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.247+0000 7fb7a09a4640 1 -- 172.21.15.170:0/2288427661 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7880a1370 msgr2=0x7fb7880a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:53.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.247+0000 7fb7a09a4640 1 --2- 172.21.15.170:0/2288427661 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7880a1370 0x7fb7880a3830 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb7940058c0 tx=0x7fb794005850 comp rx=0 tx=0).stop 2024-01-25T15:01:53.248 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.247+0000 7fb7a09a4640 1 -- 172.21.15.170:0/2288427661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb79c100e00 msgr2=0x7fb79c1960b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:53.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.247+0000 7fb7a09a4640 1 --2- 172.21.15.170:0/2288427661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb79c100e00 0x7fb79c1960b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb784007b50 tx=0x7fb78400e420 comp rx=0 tx=0).stop 2024-01-25T15:01:53.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.247+0000 7fb7a09a4640 1 -- 172.21.15.170:0/2288427661 shutdown_connections 2024-01-25T15:01:53.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.247+0000 7fb7a09a4640 1 --2- 172.21.15.170:0/2288427661 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb7880a1370 0x7fb7880a3830 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.247+0000 7fb7a09a4640 1 --2- 172.21.15.170:0/2288427661 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb79c1017c0 0x7fb79c19d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.247+0000 7fb7a09a4640 1 --2- 172.21.15.170:0/2288427661 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb79c100e00 0x7fb79c1960b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.247+0000 7fb7a09a4640 1 --2- 172.21.15.170:0/2288427661 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb79c0ffc10 0x7fb79c195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.247+0000 7fb7a09a4640 1 -- 172.21.15.170:0/2288427661 >> 172.21.15.170:0/2288427661 conn(0x7fb79c0fb180 msgr2=0x7fb79c1040a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:53.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.247+0000 7fb7a09a4640 1 -- 172.21.15.170:0/2288427661 shutdown_connections 2024-01-25T15:01:53.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.247+0000 7fb7a09a4640 1 -- 172.21.15.170:0/2288427661 wait complete. 2024-01-25T15:01:53.258 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:53 smithi170 ceph-mon[31899]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-01-25T15:01:53.258 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:53 smithi170 ceph-mon[31899]: pgmap v345: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-01-25T15:01:53.258 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:53 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1489479004' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:53.259 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:53 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3536485998' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:53.259 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:53 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3416509607' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:53.260 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-01-25T15:01:53.260 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-01-25T15:01:53.260 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:01:53.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:53 smithi186 ceph-mon[35697]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-01-25T15:01:53.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:53 smithi186 ceph-mon[35697]: pgmap v345: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-01-25T15:01:53.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:53 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1489479004' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:53.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:53 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3536485998' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:53.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:53 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3416509607' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.361+0000 7f45f6941640 1 -- 172.21.15.170:0/2875865309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45f01017c0 msgr2=0x7f45f0108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.361+0000 7f45f6941640 1 --2- 172.21.15.170:0/2875865309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45f01017c0 0x7f45f0108050 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f45e8009ca0 tx=0x7f45e802c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.361+0000 7f45f6941640 1 -- 172.21.15.170:0/2875865309 shutdown_connections 2024-01-25T15:01:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.361+0000 7f45f6941640 1 --2- 172.21.15.170:0/2875865309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45f01017c0 0x7f45f0108050 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.361+0000 7f45f6941640 1 --2- 172.21.15.170:0/2875865309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45f0100e00 0x7f45f0101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.364 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.361+0000 7f45f6941640 1 --2- 172.21.15.170:0/2875865309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45f00ffc10 0x7f45f0100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.361+0000 7f45f6941640 1 -- 172.21.15.170:0/2875865309 >> 172.21.15.170:0/2875865309 conn(0x7f45f00fb180 msgr2=0x7f45f00fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.361+0000 7f45f6941640 1 -- 172.21.15.170:0/2875865309 shutdown_connections 2024-01-25T15:01:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.361+0000 7f45f6941640 1 -- 172.21.15.170:0/2875865309 wait complete. 2024-01-25T15:01:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.362+0000 7f45f6941640 1 Processor -- start 2024-01-25T15:01:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.362+0000 7f45f6941640 1 -- start start 2024-01-25T15:01:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.362+0000 7f45f6941640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45f00ffc10 0x7f45f00689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.362+0000 7f45f6941640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45f0100e00 0x7f45f019b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.362+0000 7f45f6941640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45f01017c0 0x7f45f019dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.362+0000 7f45f6941640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f019e770 con 0x7f45f0100e00 2024-01-25T15:01:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.362+0000 7f45f6941640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f019e8e0 con 0x7f45f01017c0 2024-01-25T15:01:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.362+0000 7f45f6941640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f019eaa0 con 0x7f45f00ffc10 2024-01-25T15:01:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.362+0000 7f45ef7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45f0100e00 0x7f45f019b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.362+0000 7f45ef7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45f0100e00 0x7f45f019b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36268/0 (socket says 172.21.15.170:36268) 2024-01-25T15:01:53.365 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.362+0000 7f45ef7fe640 1 -- 172.21.15.170:0/133968541 learned_addr learned my addr 172.21.15.170:0/133968541 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.362+0000 7f45f4ede640 1 --2- 172.21.15.170:0/133968541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45f01017c0 0x7f45f019dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.363+0000 7f45effff640 1 --2- 172.21.15.170:0/133968541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45f00ffc10 0x7f45f00689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.363+0000 7f45ef7fe640 1 -- 172.21.15.170:0/133968541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45f00ffc10 msgr2=0x7f45f00689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.363+0000 7f45ef7fe640 1 --2- 172.21.15.170:0/133968541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45f00ffc10 0x7f45f00689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.363+0000 7f45ef7fe640 1 -- 172.21.15.170:0/133968541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45f01017c0 msgr2=0x7f45f019dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.363+0000 7f45ef7fe640 1 --2- 172.21.15.170:0/133968541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45f01017c0 0x7f45f019dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.363+0000 7f45ef7fe640 1 -- 172.21.15.170:0/133968541 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e8009900 con 0x7f45f0100e00 2024-01-25T15:01:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.363+0000 7f45ef7fe640 1 --2- 172.21.15.170:0/133968541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45f0100e00 0x7f45f019b9a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f45e400c970 tx=0x7f45e400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.363+0000 7f45ed7fa640 1 -- 172.21.15.170:0/133968541 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4007bb0 con 0x7f45f0100e00 2024-01-25T15:01:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.363+0000 7f45f6941640 1 -- 172.21.15.170:0/133968541 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f019ed80 con 0x7f45f0100e00 2024-01-25T15:01:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.363+0000 7f45ed7fa640 1 -- 172.21.15.170:0/133968541 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45e4007d10 con 0x7f45f0100e00 2024-01-25T15:01:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.363+0000 7f45ed7fa640 1 -- 172.21.15.170:0/133968541 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4004e40 con 0x7f45f0100e00 2024-01-25T15:01:53.366 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.363+0000 7f45f6941640 1 -- 172.21.15.170:0/133968541 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f019f1e0 con 0x7f45f0100e00 2024-01-25T15:01:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.364+0000 7f45f6941640 1 -- 172.21.15.170:0/133968541 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f0106fb0 con 0x7f45f0100e00 2024-01-25T15:01:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.365+0000 7f45ed7fa640 1 -- 172.21.15.170:0/133968541 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f45e4005000 con 0x7f45f0100e00 2024-01-25T15:01:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.366+0000 7f45ed7fa640 1 --2- 172.21.15.170:0/133968541 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f45d80a1370 0x7f45d80a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:53.367 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.366+0000 7f45effff640 1 --2- 172.21.15.170:0/133968541 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f45d80a1370 0x7f45d80a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:53.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.366+0000 7f45ed7fa640 1 -- 172.21.15.170:0/133968541 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f45e40ccd90 con 0x7f45f0100e00 2024-01-25T15:01:53.368 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.366+0000 7f45effff640 1 --2- 172.21.15.170:0/133968541 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f45d80a1370 0x7f45d80a3830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f45e0005fd0 tx=0x7f45e0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:53.370 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.369+0000 7f45ed7fa640 1 -- 172.21.15.170:0/133968541 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f45e40960e0 con 0x7f45f0100e00 2024-01-25T15:01:53.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:53 smithi191 ceph-mon[36347]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-01-25T15:01:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:53 smithi191 ceph-mon[36347]: pgmap v345: 97 pgs: 97 active+clean; 641 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-01-25T15:01:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:53 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1489479004' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:53 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3536485998' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:53.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:53 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3416509607' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:53.537 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.537+0000 7f45f6941640 1 -- 172.21.15.170:0/133968541 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f45f002cc20 con 0x7f45d80a1370 2024-01-25T15:01:53.548 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.547+0000 7f45ed7fa640 1 -- 172.21.15.170:0/133968541 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344757 (secure 0 0 0) 0x7f45f002cc20 con 0x7f45d80a1370 2024-01-25T15:01:53.552 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:53.554 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2024-01-25T15:01:53.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.551+0000 7f45f6941640 1 -- 172.21.15.170:0/133968541 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f45d80a1370 msgr2=0x7f45d80a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:53.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.551+0000 7f45f6941640 1 --2- 172.21.15.170:0/133968541 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f45d80a1370 0x7f45d80a3830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f45e0005fd0 tx=0x7f45e0005850 comp rx=0 tx=0).stop 2024-01-25T15:01:53.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.551+0000 7f45f6941640 1 -- 172.21.15.170:0/133968541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45f0100e00 msgr2=0x7f45f019b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:53.556 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.551+0000 7f45f6941640 1 --2- 172.21.15.170:0/133968541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45f0100e00 0x7f45f019b9a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f45e400c970 tx=0x7f45e400ce30 comp rx=0 tx=0).stop 2024-01-25T15:01:53.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.551+0000 7f45f6941640 1 -- 172.21.15.170:0/133968541 shutdown_connections 2024-01-25T15:01:53.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.551+0000 7f45f6941640 1 --2- 172.21.15.170:0/133968541 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f45d80a1370 0x7f45d80a3830 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.551+0000 7f45f6941640 1 --2- 172.21.15.170:0/133968541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45f01017c0 0x7f45f019dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.551+0000 7f45f6941640 1 --2- 172.21.15.170:0/133968541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45f0100e00 0x7f45f019b9a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.551+0000 7f45f6941640 1 --2- 172.21.15.170:0/133968541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45f00ffc10 0x7f45f00689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.551+0000 7f45f6941640 1 -- 172.21.15.170:0/133968541 >> 172.21.15.170:0/133968541 conn(0x7f45f00fb180 msgr2=0x7f45f0104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:53.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.551+0000 7f45f6941640 1 -- 172.21.15.170:0/133968541 shutdown_connections 2024-01-25T15:01:53.557 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.551+0000 7f45f6941640 1 -- 172.21.15.170:0/133968541 wait complete. 2024-01-25T15:01:53.563 INFO:teuthology.orchestra.run.smithi170.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-01-25T15:01:52.219739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656443,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1257,"num_read_kb":742,"num_write":424,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1239089,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":848,"ondisk_log_size":848,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":395744,"kb_used_data":13312,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124546080,"statfs":{"total":1151940427776,"available":1151535185920,"internally_reserved":0,"allocated":13631488,"data_stored":7434889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":391492924},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":51,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002679"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.230737+0000","last_change":"2024-01-25T14:59:54.219084+0000","last_active":"2024-01-25T15:01:26.230737+0000","last_peered":"2024-01-25T15:01:26.230737+0000","last_clean":"2024-01-25T15:01:26.230737+0000","last_became_active":"2024-01-25T14:59:54.218780+0000","last_became_peered":"2024-01-25T14:59:54.218780+0000","last_unstale":"2024-01-25T15:01:26.230737+0000","last_undegraded":"2024-01-25T15:01:26.230737+0000","last_fullsized":"2024-01-25T15:01:26.230737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:05:50.441934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221600+0000","last_change":"2024-01-25T14:59:54.219130+0000","last_active":"2024-01-25T15:01:26.221600+0000","last_peered":"2024-01-25T15:01:26.221600+0000","last_clean":"2024-01-25T15:01:26.221600+0000","last_became_active":"2024-01-25T14:59:54.218744+0000","last_became_peered":"2024-01-25T14:59:54.218744+0000","last_unstale":"2024-01-25T15:01:26.221600+0000","last_undegraded":"2024-01-25T15:01:26.221600+0000","last_fullsized":"2024-01-25T15:01:26.221600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:59:35.424110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.232001+0000","last_change":"2024-01-25T14:59:54.218870+0000","last_active":"2024-01-25T15:01:26.232001+0000","last_peered":"2024-01-25T15:01:26.232001+0000","last_clean":"2024-01-25T15:01:26.232001+0000","last_became_active":"2024-01-25T14:59:54.218522+0000","last_became_peered":"2024-01-25T14:59:54.218522+0000","last_unstale":"2024-01-25T15:01:26.232001+0000","last_undegraded":"2024-01-25T15:01:26.232001+0000","last_fullsized":"2024-01-25T15:01:26.232001+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:00:05.038437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.217791+0000","last_change":"2024-01-25T14:59:54.218436+0000","last_active":"2024-01-25T15:01:26.217791+0000","last_peered":"2024-01-25T15:01:26.217791+0000","last_clean":"2024-01-25T15:01:26.217791+0000","last_became_active":"2024-01-25T14:59:54.217232+0000","last_became_peered":"2024-01-25T14:59:54.217232+0000","last_unstale":"2024-01-25T15:01:26.217791+0000","last_undegraded":"2024-01-25T15:01:26.217791+0000","last_fullsized":"2024-01-25T15:01:26.217791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:24:14.642794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221036+0000","last_change":"2024-01-25T14:59:54.219094+0000","last_active":"2024-01-25T15:01:26.221036+0000","last_peered":"2024-01-25T15:01:26.221036+0000","last_clean":"2024-01-25T15:01:26.221036+0000","last_became_active":"2024-01-25T14:59:54.218778+0000","last_became_peered":"2024-01-25T14:59:54.218778+0000","last_unstale":"2024-01-25T15:01:26.221036+0000","last_undegraded":"2024-01-25T15:01:26.221036+0000","last_fullsized":"2024-01-25T15:01:26.221036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:21.754098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.220371+0000","last_change":"2024-01-25T14:59:54.213243+0000","last_active":"2024-01-25T15:01:26.220371+0000","last_peered":"2024-01-25T15:01:26.220371+0000","last_clean":"2024-01-25T15:01:26.220371+0000","last_became_active":"2024-01-25T14:59:54.212891+0000","last_became_peered":"2024-01-25T14:59:54.212891+0000","last_unstale":"2024-01-25T15:01:26.220371+0000","last_undegraded":"2024-01-25T15:01:26.220371+0000","last_fullsized":"2024-01-25T15:01:26.220371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:52:45.505016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221723+0000","last_change":"2024-01-25T14:59:54.211851+0000","last_active":"2024-01-25T15:01:26.221723+0000","last_peered":"2024-01-25T15:01:26.221723+0000","last_clean":"2024-01-25T15:01:26.221723+0000","last_became_active":"2024-01-25T14:59:54.211298+0000","last_became_peered":"2024-01-25T14:59:54.211298+0000","last_unstale":"2024-01-25T15:01:26.221723+0000","last_undegraded":"2024-01-25T15:01:26.221723+0000","last_fullsized":"2024-01-25T15:01:26.221723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:05:36.636283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.222334+0000","last_change":"2024-01-25T14:59:54.217675+0000","last_active":"2024-01-25T15:01:26.222334+0000","last_peered":"2024-01-25T15:01:26.222334+0000","last_clean":"2024-01-25T15:01:26.222334+0000","last_became_active":"2024-01-25T14:59:54.217329+0000","last_became_peered":"2024-01-25T14:59:54.217329+0000","last_unstale":"2024-01-25T15:01:26.222334+0000","last_undegraded":"2024-01-25T15:01:26.222334+0000","last_fullsized":"2024-01-25T15:01:26.222334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:32:07.769974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.230192+0000","last_change":"2024-01-25T14:59:54.213030+0000","last_active":"2024-01-25T15:01:26.230192+0000","last_peered":"2024-01-25T15:01:26.230192+0000","last_clean":"2024-01-25T15:01:26.230192+0000","last_became_active":"2024-01-25T14:59:54.212687+0000","last_became_peered":"2024-01-25T14:59:54.212687+0000","last_unstale":"2024-01-25T15:01:26.230192+0000","last_undegraded":"2024-01-25T15:01:26.230192+0000","last_fullsized":"2024-01-25T15:01:26.230192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:47:29.562996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.220569+0000","last_change":"2024-01-25T15:00:57.284759+0000","last_active":"2024-01-25T15:01:26.220569+0000","last_peered":"2024-01-25T15:01:26.220569+0000","last_clean":"2024-01-25T15:01:26.220569+0000","last_became_active":"2024-01-25T15:00:57.284306+0000","last_became_peered":"2024-01-25T15:00:57.284306+0000","last_unstale":"2024-01-25T15:01:26.220569+0000","last_undegraded":"2024-01-25T15:01:26.220569+0000","last_fullsized":"2024-01-25T15:01:26.220569+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:56:49.173903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.231337+0000","last_change":"2024-01-25T14:59:54.216252+0000","last_active":"2024-01-25T15:01:26.231337+0000","last_peered":"2024-01-25T15:01:26.231337+0000","last_clean":"2024-01-25T15:01:26.231337+0000","last_became_active":"2024-01-25T14:59:54.215892+0000","last_became_peered":"2024-01-25T14:59:54.215892+0000","last_unstale":"2024-01-25T15:01:26.231337+0000","last_undegraded":"2024-01-25T15:01:26.231337+0000","last_fullsized":"2024-01-25T15:01:26.231337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:53:27.135926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.215703+0000","last_change":"2024-01-25T14:59:54.221212+0000","last_active":"2024-01-25T15:01:26.215703+0000","last_peered":"2024-01-25T15:01:26.215703+0000","last_clean":"2024-01-25T15:01:26.215703+0000","last_became_active":"2024-01-25T14:59:54.220516+0000","last_became_peered":"2024-01-25T14:59:54.220516+0000","last_unstale":"2024-01-25T15:01:26.215703+0000","last_undegraded":"2024-01-25T15:01:26.215703+0000","last_fullsized":"2024-01-25T15:01:26.215703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:00:57.398457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221443+0000","last_change":"2024-01-25T14:59:54.204088+0000","last_active":"2024-01-25T15:01:26.221443+0000","last_peered":"2024-01-25T15:01:26.221443+0000","last_clean":"2024-01-25T15:01:26.221443+0000","last_became_active":"2024-01-25T14:59:54.202895+0000","last_became_peered":"2024-01-25T14:59:54.202895+0000","last_unstale":"2024-01-25T15:01:26.221443+0000","last_undegraded":"2024-01-25T15:01:26.221443+0000","last_fullsized":"2024-01-25T15:01:26.221443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:15:37.693577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.227904+0000","last_change":"2024-01-25T14:59:54.226108+0000","last_active":"2024-01-25T15:01:26.227904+0000","last_peered":"2024-01-25T15:01:26.227904+0000","last_clean":"2024-01-25T15:01:26.227904+0000","last_became_active":"2024-01-25T14:59:54.225830+0000","last_became_peered":"2024-01-25T14:59:54.225830+0000","last_unstale":"2024-01-25T15:01:26.227904+0000","last_undegraded":"2024-01-25T15:01:26.227904+0000","last_fullsized":"2024-01-25T15:01:26.227904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:10:22.580434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226902+0000","last_change":"2024-01-25T14:59:54.224893+0000","last_active":"2024-01-25T15:01:26.226902+0000","last_peered":"2024-01-25T15:01:26.226902+0000","last_clean":"2024-01-25T15:01:26.226902+0000","last_became_active":"2024-01-25T14:59:54.224583+0000","last_became_peered":"2024-01-25T14:59:54.224583+0000","last_unstale":"2024-01-25T15:01:26.226902+0000","last_undegraded":"2024-01-25T15:01:26.226902+0000","last_fullsized":"2024-01-25T15:01:26.226902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:48:25.538489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.232195+0000","last_change":"2024-01-25T14:59:54.217030+0000","last_active":"2024-01-25T15:01:26.232195+0000","last_peered":"2024-01-25T15:01:26.232195+0000","last_clean":"2024-01-25T15:01:26.232195+0000","last_became_active":"2024-01-25T14:59:54.216732+0000","last_became_peered":"2024-01-25T14:59:54.216732+0000","last_unstale":"2024-01-25T15:01:26.232195+0000","last_undegraded":"2024-01-25T15:01:26.232195+0000","last_fullsized":"2024-01-25T15:01:26.232195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:58:36.072464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.230834+0000","last_change":"2024-01-25T14:59:54.223924+0000","last_active":"2024-01-25T15:01:26.230834+0000","last_peered":"2024-01-25T15:01:26.230834+0000","last_clean":"2024-01-25T15:01:26.230834+0000","last_became_active":"2024-01-25T14:59:54.223556+0000","last_became_peered":"2024-01-25T14:59:54.223556+0000","last_unstale":"2024-01-25T15:01:26.230834+0000","last_undegraded":"2024-01-25T15:01:26.230834+0000","last_fullsized":"2024-01-25T15:01:26.230834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:54:18.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.217329+0000","last_change":"2024-01-25T14:59:54.207125+0000","last_active":"2024-01-25T15:01:26.217329+0000","last_peered":"2024-01-25T15:01:26.217329+0000","last_clean":"2024-01-25T15:01:26.217329+0000","last_became_active":"2024-01-25T14:59:54.206630+0000","last_became_peered":"2024-01-25T14:59:54.206630+0000","last_unstale":"2024-01-25T15:01:26.217329+0000","last_undegraded":"2024-01-25T15:01:26.217329+0000","last_fullsized":"2024-01-25T15:01:26.217329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:10:12.685185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.220361+0000","last_change":"2024-01-25T14:59:54.210732+0000","last_active":"2024-01-25T15:01:26.220361+0000","last_peered":"2024-01-25T15:01:26.220361+0000","last_clean":"2024-01-25T15:01:26.220361+0000","last_became_active":"2024-01-25T14:59:54.210417+0000","last_became_peered":"2024-01-25T14:59:54.210417+0000","last_unstale":"2024-01-25T15:01:26.220361+0000","last_undegraded":"2024-01-25T15:01:26.220361+0000","last_fullsized":"2024-01-25T15:01:26.220361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:05:22.305485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'13","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:46.183148+0000","last_change":"2024-01-25T14:59:53.204680+0000","last_active":"2024-01-25T15:01:46.183148+0000","last_peered":"2024-01-25T15:01:46.183148+0000","last_clean":"2024-01-25T15:01:46.183148+0000","last_became_active":"2024-01-25T14:59:53.204327+0000","last_became_peered":"2024-01-25T14:59:53.204327+0000","last_unstale":"2024-01-25T15:01:46.183148+0000","last_undegraded":"2024-01-25T15:01:46.183148+0000","last_fullsized":"2024-01-25T15:01:46.183148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:32:16.333425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221365+0000","last_change":"2024-01-25T14:59:54.220501+0000","last_active":"2024-01-25T15:01:26.221365+0000","last_peered":"2024-01-25T15:01:26.221365+0000","last_clean":"2024-01-25T15:01:26.221365+0000","last_became_active":"2024-01-25T14:59:54.217150+0000","last_became_peered":"2024-01-25T14:59:54.217150+0000","last_unstale":"2024-01-25T15:01:26.221365+0000","last_undegraded":"2024-01-25T15:01:26.221365+0000","last_fullsized":"2024-01-25T15:01:26.221365+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:16:00.811698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284319+0000","last_change":"2024-01-25T14:59:53.209110+0000","last_active":"2024-01-25T15:00:57.284319+0000","last_peered":"2024-01-25T15:00:57.284319+0000","last_clean":"2024-01-25T15:00:57.284319+0000","last_became_active":"2024-01-25T14:59:53.208794+0000","last_became_peered":"2024-01-25T14:59:53.208794+0000","last_unstale":"2024-01-25T15:00:57.284319+0000","last_undegraded":"2024-01-25T15:00:57.284319+0000","last_fullsized":"2024-01-25T15:00:57.284319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:51:40.757062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.232260+0000","last_change":"2024-01-25T14:59:54.219303+0000","last_active":"2024-01-25T15:01:26.232260+0000","last_peered":"2024-01-25T15:01:26.232260+0000","last_clean":"2024-01-25T15:01:26.232260+0000","last_became_active":"2024-01-25T14:59:54.218814+0000","last_became_peered":"2024-01-25T14:59:54.218814+0000","last_unstale":"2024-01-25T15:01:26.232260+0000","last_undegraded":"2024-01-25T15:01:26.232260+0000","last_fullsized":"2024-01-25T15:01:26.232260+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:54:30.556998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278661+0000","last_change":"2024-01-25T14:59:53.209770+0000","last_active":"2024-01-25T15:00:57.278661+0000","last_peered":"2024-01-25T15:00:57.278661+0000","last_clean":"2024-01-25T15:00:57.278661+0000","last_became_active":"2024-01-25T14:59:53.209466+0000","last_became_peered":"2024-01-25T14:59:53.209466+0000","last_unstale":"2024-01-25T15:00:57.278661+0000","last_undegraded":"2024-01-25T15:00:57.278661+0000","last_fullsized":"2024-01-25T15:00:57.278661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:58:11.391155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.230793+0000","last_change":"2024-01-25T14:59:54.201559+0000","last_active":"2024-01-25T15:01:26.230793+0000","last_peered":"2024-01-25T15:01:26.230793+0000","last_clean":"2024-01-25T15:01:26.230793+0000","last_became_active":"2024-01-25T14:59:54.201155+0000","last_became_peered":"2024-01-25T14:59:54.201155+0000","last_unstale":"2024-01-25T15:01:26.230793+0000","last_undegraded":"2024-01-25T15:01:26.230793+0000","last_fullsized":"2024-01-25T15:01:26.230793+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:29:15.444879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278742+0000","last_change":"2024-01-25T14:59:53.208457+0000","last_active":"2024-01-25T15:00:57.278742+0000","last_peered":"2024-01-25T15:00:57.278742+0000","last_clean":"2024-01-25T15:00:57.278742+0000","last_became_active":"2024-01-25T14:59:53.208166+0000","last_became_peered":"2024-01-25T14:59:53.208166+0000","last_unstale":"2024-01-25T15:00:57.278742+0000","last_undegraded":"2024-01-25T15:00:57.278742+0000","last_fullsized":"2024-01-25T15:00:57.278742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:29:22.580726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.228568+0000","last_change":"2024-01-25T14:59:54.212126+0000","last_active":"2024-01-25T15:01:26.228568+0000","last_peered":"2024-01-25T15:01:26.228568+0000","last_clean":"2024-01-25T15:01:26.228568+0000","last_became_active":"2024-01-25T14:59:54.211519+0000","last_became_peered":"2024-01-25T14:59:54.211519+0000","last_unstale":"2024-01-25T15:01:26.228568+0000","last_undegraded":"2024-01-25T15:01:26.228568+0000","last_fullsized":"2024-01-25T15:01:26.228568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:50:59.743852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"87'7","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:47.195469+0000","last_change":"2024-01-25T14:59:53.201803+0000","last_active":"2024-01-25T15:01:47.195469+0000","last_peered":"2024-01-25T15:01:47.195469+0000","last_clean":"2024-01-25T15:01:47.195469+0000","last_became_active":"2024-01-25T14:59:53.201464+0000","last_became_peered":"2024-01-25T14:59:53.201464+0000","last_unstale":"2024-01-25T15:01:47.195469+0000","last_undegraded":"2024-01-25T15:01:47.195469+0000","last_fullsized":"2024-01-25T15:01:47.195469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:36:03.922038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.227153+0000","last_change":"2024-01-25T14:59:54.207126+0000","last_active":"2024-01-25T15:01:26.227153+0000","last_peered":"2024-01-25T15:01:26.227153+0000","last_clean":"2024-01-25T15:01:26.227153+0000","last_became_active":"2024-01-25T14:59:54.206826+0000","last_became_peered":"2024-01-25T14:59:54.206826+0000","last_unstale":"2024-01-25T15:01:26.227153+0000","last_undegraded":"2024-01-25T15:01:26.227153+0000","last_fullsized":"2024-01-25T15:01:26.227153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:45:07.217919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281277+0000","last_change":"2024-01-25T14:59:53.200335+0000","last_active":"2024-01-25T15:00:57.281277+0000","last_peered":"2024-01-25T15:00:57.281277+0000","last_clean":"2024-01-25T15:00:57.281277+0000","last_became_active":"2024-01-25T14:59:53.200028+0000","last_became_peered":"2024-01-25T14:59:53.200028+0000","last_unstale":"2024-01-25T15:00:57.281277+0000","last_undegraded":"2024-01-25T15:00:57.281277+0000","last_fullsized":"2024-01-25T15:00:57.281277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:23:26.178260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.219277+0000","last_change":"2024-01-25T14:59:54.211048+0000","last_active":"2024-01-25T15:01:26.219277+0000","last_peered":"2024-01-25T15:01:26.219277+0000","last_clean":"2024-01-25T15:01:26.219277+0000","last_became_active":"2024-01-25T14:59:54.210724+0000","last_became_peered":"2024-01-25T14:59:54.210724+0000","last_unstale":"2024-01-25T15:01:26.219277+0000","last_undegraded":"2024-01-25T15:01:26.219277+0000","last_fullsized":"2024-01-25T15:01:26.219277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:59:40.171707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279454+0000","last_change":"2024-01-25T14:59:53.202235+0000","last_active":"2024-01-25T15:00:57.279454+0000","last_peered":"2024-01-25T15:00:57.279454+0000","last_clean":"2024-01-25T15:00:57.279454+0000","last_became_active":"2024-01-25T14:59:53.201933+0000","last_became_peered":"2024-01-25T14:59:53.201933+0000","last_unstale":"2024-01-25T15:00:57.279454+0000","last_undegraded":"2024-01-25T15:00:57.279454+0000","last_fullsized":"2024-01-25T15:00:57.279454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:40:23.725903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.220083+0000","last_change":"2024-01-25T14:59:54.205184+0000","last_active":"2024-01-25T15:01:26.220083+0000","last_peered":"2024-01-25T15:01:26.220083+0000","last_clean":"2024-01-25T15:01:26.220083+0000","last_became_active":"2024-01-25T14:59:54.204865+0000","last_became_peered":"2024-01-25T14:59:54.204865+0000","last_unstale":"2024-01-25T15:01:26.220083+0000","last_undegraded":"2024-01-25T15:01:26.220083+0000","last_fullsized":"2024-01-25T15:01:26.220083+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:07:25.559601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283603+0000","last_change":"2024-01-25T14:59:53.205021+0000","last_active":"2024-01-25T15:00:57.283603+0000","last_peered":"2024-01-25T15:00:57.283603+0000","last_clean":"2024-01-25T15:00:57.283603+0000","last_became_active":"2024-01-25T14:59:53.203925+0000","last_became_peered":"2024-01-25T14:59:53.203925+0000","last_unstale":"2024-01-25T15:00:57.283603+0000","last_undegraded":"2024-01-25T15:00:57.283603+0000","last_fullsized":"2024-01-25T15:00:57.283603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:20:43.003659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.218984+0000","last_change":"2024-01-25T14:59:54.207234+0000","last_active":"2024-01-25T15:01:26.218984+0000","last_peered":"2024-01-25T15:01:26.218984+0000","last_clean":"2024-01-25T15:01:26.218984+0000","last_became_active":"2024-01-25T14:59:54.206727+0000","last_became_peered":"2024-01-25T14:59:54.206727+0000","last_unstale":"2024-01-25T15:01:26.218984+0000","last_undegraded":"2024-01-25T15:01:26.218984+0000","last_fullsized":"2024-01-25T15:01:26.218984+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:29:08.678821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'5","reported_seq":242,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:47.194624+0000","last_change":"2024-01-25T14:59:53.204198+0000","last_active":"2024-01-25T15:01:47.194624+0000","last_peered":"2024-01-25T15:01:47.194624+0000","last_clean":"2024-01-25T15:01:47.194624+0000","last_became_active":"2024-01-25T14:59:53.203844+0000","last_became_peered":"2024-01-25T14:59:53.203844+0000","last_unstale":"2024-01-25T15:01:47.194624+0000","last_undegraded":"2024-01-25T15:01:47.194624+0000","last_fullsized":"2024-01-25T15:01:47.194624+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:30:23.735236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":218,"num_read_kb":218,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226081+0000","last_change":"2024-01-25T14:59:54.203318+0000","last_active":"2024-01-25T15:01:26.226081+0000","last_peered":"2024-01-25T15:01:26.226081+0000","last_clean":"2024-01-25T15:01:26.226081+0000","last_became_active":"2024-01-25T14:59:54.202971+0000","last_became_peered":"2024-01-25T14:59:54.202971+0000","last_unstale":"2024-01-25T15:01:26.226081+0000","last_undegraded":"2024-01-25T15:01:26.226081+0000","last_fullsized":"2024-01-25T15:01:26.226081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:57:59.454857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.300726+0000","last_change":"2024-01-25T15:00:57.300726+0000","last_active":"2024-01-25T15:00:57.300726+0000","last_peered":"2024-01-25T15:00:57.300726+0000","last_clean":"2024-01-25T15:00:57.300726+0000","last_became_active":"2024-01-25T15:00:57.288184+0000","last_became_peered":"2024-01-25T15:00:57.288184+0000","last_unstale":"2024-01-25T15:00:57.300726+0000","last_undegraded":"2024-01-25T15:00:57.300726+0000","last_fullsized":"2024-01-25T15:00:57.300726+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:17:00.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226739+0000","last_change":"2024-01-25T14:59:54.225131+0000","last_active":"2024-01-25T15:01:26.226739+0000","last_peered":"2024-01-25T15:01:26.226739+0000","last_clean":"2024-01-25T15:01:26.226739+0000","last_became_active":"2024-01-25T14:59:54.224786+0000","last_became_peered":"2024-01-25T14:59:54.224786+0000","last_unstale":"2024-01-25T15:01:26.226739+0000","last_undegraded":"2024-01-25T15:01:26.226739+0000","last_fullsized":"2024-01-25T15:01:26.226739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:25:07.426433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283977+0000","last_change":"2024-01-25T14:59:53.199834+0000","last_active":"2024-01-25T15:00:57.283977+0000","last_peered":"2024-01-25T15:00:57.283977+0000","last_clean":"2024-01-25T15:00:57.283977+0000","last_became_active":"2024-01-25T14:59:53.199545+0000","last_became_peered":"2024-01-25T14:59:53.199545+0000","last_unstale":"2024-01-25T15:00:57.283977+0000","last_undegraded":"2024-01-25T15:00:57.283977+0000","last_fullsized":"2024-01-25T15:00:57.283977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:38:08.973583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.232212+0000","last_change":"2024-01-25T14:59:54.214768+0000","last_active":"2024-01-25T15:01:26.232212+0000","last_peered":"2024-01-25T15:01:26.232212+0000","last_clean":"2024-01-25T15:01:26.232212+0000","last_became_active":"2024-01-25T14:59:54.214038+0000","last_became_peered":"2024-01-25T14:59:54.214038+0000","last_unstale":"2024-01-25T15:01:26.232212+0000","last_undegraded":"2024-01-25T15:01:26.232212+0000","last_fullsized":"2024-01-25T15:01:26.232212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:10:20.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'32","reported_seq":300,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:47.365698+0000","last_change":"2024-01-25T15:00:57.297320+0000","last_active":"2024-01-25T15:01:47.365698+0000","last_peered":"2024-01-25T15:01:47.365698+0000","last_clean":"2024-01-25T15:01:47.365698+0000","last_became_active":"2024-01-25T15:00:57.287208+0000","last_became_peered":"2024-01-25T15:00:57.287208+0000","last_unstale":"2024-01-25T15:01:47.365698+0000","last_undegraded":"2024-01-25T15:01:47.365698+0000","last_fullsized":"2024-01-25T15:01:47.365698+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:36:17.161523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58580,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":215,"num_read_kb":164,"num_write":34,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":58331,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.225776+0000","last_change":"2024-01-25T14:59:54.217069+0000","last_active":"2024-01-25T15:01:26.225776+0000","last_peered":"2024-01-25T15:01:26.225776+0000","last_clean":"2024-01-25T15:01:26.225776+0000","last_became_active":"2024-01-25T14:59:54.216749+0000","last_became_peered":"2024-01-25T14:59:54.216749+0000","last_unstale":"2024-01-25T15:01:26.225776+0000","last_undegraded":"2024-01-25T15:01:26.225776+0000","last_fullsized":"2024-01-25T15:01:26.225776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:31:00.903462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282050+0000","last_change":"2024-01-25T14:59:53.198852+0000","last_active":"2024-01-25T15:00:57.282050+0000","last_peered":"2024-01-25T15:00:57.282050+0000","last_clean":"2024-01-25T15:00:57.282050+0000","last_became_active":"2024-01-25T14:59:53.198532+0000","last_became_peered":"2024-01-25T14:59:53.198532+0000","last_unstale":"2024-01-25T15:00:57.282050+0000","last_undegraded":"2024-01-25T15:00:57.282050+0000","last_fullsized":"2024-01-25T15:00:57.282050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:03:43.251730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.217159+0000","last_change":"2024-01-25T14:59:54.209865+0000","last_active":"2024-01-25T15:01:26.217159+0000","last_peered":"2024-01-25T15:01:26.217159+0000","last_clean":"2024-01-25T15:01:26.217159+0000","last_became_active":"2024-01-25T14:59:54.209564+0000","last_became_peered":"2024-01-25T14:59:54.209564+0000","last_unstale":"2024-01-25T15:01:26.217159+0000","last_undegraded":"2024-01-25T15:01:26.217159+0000","last_fullsized":"2024-01-25T15:01:26.217159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:19:24.461651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283550+0000","last_change":"2024-01-25T14:59:53.207644+0000","last_active":"2024-01-25T15:00:57.283550+0000","last_peered":"2024-01-25T15:00:57.283550+0000","last_clean":"2024-01-25T15:00:57.283550+0000","last_became_active":"2024-01-25T14:59:53.207321+0000","last_became_peered":"2024-01-25T14:59:53.207321+0000","last_unstale":"2024-01-25T15:00:57.283550+0000","last_undegraded":"2024-01-25T15:00:57.283550+0000","last_fullsized":"2024-01-25T15:00:57.283550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:47:12.131711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.224293+0000","last_change":"2024-01-25T14:59:54.220548+0000","last_active":"2024-01-25T15:01:26.224293+0000","last_peered":"2024-01-25T15:01:26.224293+0000","last_clean":"2024-01-25T15:01:26.224293+0000","last_became_active":"2024-01-25T14:59:54.219743+0000","last_became_peered":"2024-01-25T14:59:54.219743+0000","last_unstale":"2024-01-25T15:01:26.224293+0000","last_undegraded":"2024-01-25T15:01:26.224293+0000","last_fullsized":"2024-01-25T15:01:26.224293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:46:12.085591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:50.189040+0000","last_change":"2024-01-25T14:59:53.201233+0000","last_active":"2024-01-25T15:01:50.189040+0000","last_peered":"2024-01-25T15:01:50.189040+0000","last_clean":"2024-01-25T15:01:50.189040+0000","last_became_active":"2024-01-25T14:59:53.200907+0000","last_became_peered":"2024-01-25T14:59:53.200907+0000","last_unstale":"2024-01-25T15:01:50.189040+0000","last_undegraded":"2024-01-25T15:01:50.189040+0000","last_fullsized":"2024-01-25T15:01:50.189040+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:30:59.640179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221042+0000","last_change":"2024-01-25T14:59:54.212617+0000","last_active":"2024-01-25T15:01:26.221042+0000","last_peered":"2024-01-25T15:01:26.221042+0000","last_clean":"2024-01-25T15:01:26.221042+0000","last_became_active":"2024-01-25T14:59:54.212328+0000","last_became_peered":"2024-01-25T14:59:54.212328+0000","last_unstale":"2024-01-25T15:01:26.221042+0000","last_undegraded":"2024-01-25T15:01:26.221042+0000","last_fullsized":"2024-01-25T15:01:26.221042+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:21:16.958894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278147+0000","last_change":"2024-01-25T14:59:53.202685+0000","last_active":"2024-01-25T15:00:57.278147+0000","last_peered":"2024-01-25T15:00:57.278147+0000","last_clean":"2024-01-25T15:00:57.278147+0000","last_became_active":"2024-01-25T14:59:53.201529+0000","last_became_peered":"2024-01-25T14:59:53.201529+0000","last_unstale":"2024-01-25T15:00:57.278147+0000","last_undegraded":"2024-01-25T15:00:57.278147+0000","last_fullsized":"2024-01-25T15:00:57.278147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:43:29.823959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.223899+0000","last_change":"2024-01-25T14:59:54.208724+0000","last_active":"2024-01-25T15:01:26.223899+0000","last_peered":"2024-01-25T15:01:26.223899+0000","last_clean":"2024-01-25T15:01:26.223899+0000","last_became_active":"2024-01-25T14:59:54.208392+0000","last_became_peered":"2024-01-25T14:59:54.208392+0000","last_unstale":"2024-01-25T15:01:26.223899+0000","last_undegraded":"2024-01-25T15:01:26.223899+0000","last_fullsized":"2024-01-25T15:01:26.223899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:37.285702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.291362+0000","last_change":"2024-01-25T15:00:57.290806+0000","last_active":"2024-01-25T15:00:57.291362+0000","last_peered":"2024-01-25T15:00:57.291362+0000","last_clean":"2024-01-25T15:00:57.291362+0000","last_became_active":"2024-01-25T15:00:57.285194+0000","last_became_peered":"2024-01-25T15:00:57.285194+0000","last_unstale":"2024-01-25T15:00:57.291362+0000","last_undegraded":"2024-01-25T15:00:57.291362+0000","last_fullsized":"2024-01-25T15:00:57.291362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:49:16.627616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.224447+0000","last_change":"2024-01-25T14:59:54.216918+0000","last_active":"2024-01-25T15:01:26.224447+0000","last_peered":"2024-01-25T15:01:26.224447+0000","last_clean":"2024-01-25T15:01:26.224447+0000","last_became_active":"2024-01-25T14:59:54.216283+0000","last_became_peered":"2024-01-25T14:59:54.216283+0000","last_unstale":"2024-01-25T15:01:26.224447+0000","last_undegraded":"2024-01-25T15:01:26.224447+0000","last_fullsized":"2024-01-25T15:01:26.224447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:15:11.192764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280876+0000","last_change":"2024-01-25T14:59:53.207266+0000","last_active":"2024-01-25T15:00:57.280876+0000","last_peered":"2024-01-25T15:00:57.280876+0000","last_clean":"2024-01-25T15:00:57.280876+0000","last_became_active":"2024-01-25T14:59:53.206820+0000","last_became_peered":"2024-01-25T14:59:53.206820+0000","last_unstale":"2024-01-25T15:00:57.280876+0000","last_undegraded":"2024-01-25T15:00:57.280876+0000","last_fullsized":"2024-01-25T15:00:57.280876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:29:02.371577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.215941+0000","last_change":"2024-01-25T14:59:54.210434+0000","last_active":"2024-01-25T15:01:26.215941+0000","last_peered":"2024-01-25T15:01:26.215941+0000","last_clean":"2024-01-25T15:01:26.215941+0000","last_became_active":"2024-01-25T14:59:54.210100+0000","last_became_peered":"2024-01-25T14:59:54.210100+0000","last_unstale":"2024-01-25T15:01:26.215941+0000","last_undegraded":"2024-01-25T15:01:26.215941+0000","last_fullsized":"2024-01-25T15:01:26.215941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:48:21.463712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":135,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:48.186230+0000","last_change":"2024-01-25T14:59:53.202938+0000","last_active":"2024-01-25T15:01:48.186230+0000","last_peered":"2024-01-25T15:01:48.186230+0000","last_clean":"2024-01-25T15:01:48.186230+0000","last_became_active":"2024-01-25T14:59:53.202638+0000","last_became_peered":"2024-01-25T14:59:53.202638+0000","last_unstale":"2024-01-25T15:01:48.186230+0000","last_undegraded":"2024-01-25T15:01:48.186230+0000","last_fullsized":"2024-01-25T15:01:48.186230+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.371375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.202039+0000","last_change":"2024-01-25T14:59:54.219778+0000","last_active":"2024-01-25T15:01:26.202039+0000","last_peered":"2024-01-25T15:01:26.202039+0000","last_clean":"2024-01-25T15:01:26.202039+0000","last_became_active":"2024-01-25T14:59:54.219385+0000","last_became_peered":"2024-01-25T14:59:54.219385+0000","last_unstale":"2024-01-25T15:01:26.202039+0000","last_undegraded":"2024-01-25T15:01:26.202039+0000","last_fullsized":"2024-01-25T15:01:26.202039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:49:27.929024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.224210+0000","last_change":"2024-01-25T14:59:54.209306+0000","last_active":"2024-01-25T15:01:26.224210+0000","last_peered":"2024-01-25T15:01:26.224210+0000","last_clean":"2024-01-25T15:01:26.224210+0000","last_became_active":"2024-01-25T14:59:54.208979+0000","last_became_peered":"2024-01-25T14:59:54.208979+0000","last_unstale":"2024-01-25T15:01:26.224210+0000","last_undegraded":"2024-01-25T15:01:26.224210+0000","last_fullsized":"2024-01-25T15:01:26.224210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:23:46.763358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:47.184825+0000","last_change":"2024-01-25T14:59:53.200590+0000","last_active":"2024-01-25T15:01:47.184825+0000","last_peered":"2024-01-25T15:01:47.184825+0000","last_clean":"2024-01-25T15:01:47.184825+0000","last_became_active":"2024-01-25T14:59:53.200292+0000","last_became_peered":"2024-01-25T14:59:53.200292+0000","last_unstale":"2024-01-25T15:01:47.184825+0000","last_undegraded":"2024-01-25T15:01:47.184825+0000","last_fullsized":"2024-01-25T15:01:47.184825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:02:05.135314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.222120+0000","last_change":"2024-01-25T14:59:54.217765+0000","last_active":"2024-01-25T15:01:26.222120+0000","last_peered":"2024-01-25T15:01:26.222120+0000","last_clean":"2024-01-25T15:01:26.222120+0000","last_became_active":"2024-01-25T14:59:54.217433+0000","last_became_peered":"2024-01-25T14:59:54.217433+0000","last_unstale":"2024-01-25T15:01:26.222120+0000","last_undegraded":"2024-01-25T15:01:26.222120+0000","last_fullsized":"2024-01-25T15:01:26.222120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:45:25.520091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279378+0000","last_change":"2024-01-25T14:59:53.197543+0000","last_active":"2024-01-25T15:00:57.279378+0000","last_peered":"2024-01-25T15:00:57.279378+0000","last_clean":"2024-01-25T15:00:57.279378+0000","last_became_active":"2024-01-25T14:59:53.197213+0000","last_became_peered":"2024-01-25T14:59:53.197213+0000","last_unstale":"2024-01-25T15:00:57.279378+0000","last_undegraded":"2024-01-25T15:00:57.279378+0000","last_fullsized":"2024-01-25T15:00:57.279378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:19:39.477948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282381+0000","last_change":"2024-01-25T14:58:41.034413+0000","last_active":"2024-01-25T15:00:57.282381+0000","last_peered":"2024-01-25T15:00:57.282381+0000","last_clean":"2024-01-25T15:00:57.282381+0000","last_became_active":"2024-01-25T14:58:41.033881+0000","last_became_peered":"2024-01-25T14:58:41.033881+0000","last_unstale":"2024-01-25T15:00:57.282381+0000","last_undegraded":"2024-01-25T15:00:57.282381+0000","last_fullsized":"2024-01-25T15:00:57.282381+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:55:22.974068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:55:22.974068+0000","last_clean_scrub_stamp":"2024-01-25T14:55:22.974068+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:05:30.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221753+0000","last_change":"2024-01-25T14:59:54.214713+0000","last_active":"2024-01-25T15:01:26.221753+0000","last_peered":"2024-01-25T15:01:26.221753+0000","last_clean":"2024-01-25T15:01:26.221753+0000","last_became_active":"2024-01-25T14:59:54.214348+0000","last_became_peered":"2024-01-25T14:59:54.214348+0000","last_unstale":"2024-01-25T15:01:26.221753+0000","last_undegraded":"2024-01-25T15:01:26.221753+0000","last_fullsized":"2024-01-25T15:01:26.221753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:11:46.134755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282443+0000","last_change":"2024-01-25T14:59:53.202970+0000","last_active":"2024-01-25T15:00:57.282443+0000","last_peered":"2024-01-25T15:00:57.282443+0000","last_clean":"2024-01-25T15:00:57.282443+0000","last_became_active":"2024-01-25T14:59:53.202680+0000","last_became_peered":"2024-01-25T14:59:53.202680+0000","last_unstale":"2024-01-25T15:00:57.282443+0000","last_undegraded":"2024-01-25T15:00:57.282443+0000","last_fullsized":"2024-01-25T15:00:57.282443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:28:12.628390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278506+0000","last_change":"2024-01-25T14:59:53.210040+0000","last_active":"2024-01-25T15:00:57.278506+0000","last_peered":"2024-01-25T15:00:57.278506+0000","last_clean":"2024-01-25T15:00:57.278506+0000","last_became_active":"2024-01-25T14:59:53.209636+0000","last_became_peered":"2024-01-25T14:59:53.209636+0000","last_unstale":"2024-01-25T15:00:57.278506+0000","last_undegraded":"2024-01-25T15:00:57.278506+0000","last_fullsized":"2024-01-25T15:00:57.278506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:22:45.268969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.211212+0000","last_change":"2024-01-25T14:59:54.203875+0000","last_active":"2024-01-25T15:01:26.211212+0000","last_peered":"2024-01-25T15:01:26.211212+0000","last_clean":"2024-01-25T15:01:26.211212+0000","last_became_active":"2024-01-25T14:59:54.203573+0000","last_became_peered":"2024-01-25T14:59:54.203573+0000","last_unstale":"2024-01-25T15:01:26.211212+0000","last_undegraded":"2024-01-25T15:01:26.211212+0000","last_fullsized":"2024-01-25T15:01:26.211212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:16:33.124186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'11","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.292768+0000","last_change":"2024-01-25T15:00:57.292346+0000","last_active":"2024-01-25T15:00:57.292768+0000","last_peered":"2024-01-25T15:00:57.292768+0000","last_clean":"2024-01-25T15:00:57.292768+0000","last_became_active":"2024-01-25T15:00:57.284921+0000","last_became_peered":"2024-01-25T15:00:57.284921+0000","last_unstale":"2024-01-25T15:00:57.292768+0000","last_undegraded":"2024-01-25T15:00:57.292768+0000","last_fullsized":"2024-01-25T15:00:57.292768+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:35:09.229129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.222766+0000","last_change":"2024-01-25T14:59:54.212444+0000","last_active":"2024-01-25T15:01:26.222766+0000","last_peered":"2024-01-25T15:01:26.222766+0000","last_clean":"2024-01-25T15:01:26.222766+0000","last_became_active":"2024-01-25T14:59:54.212090+0000","last_became_peered":"2024-01-25T14:59:54.212090+0000","last_unstale":"2024-01-25T15:01:26.222766+0000","last_undegraded":"2024-01-25T15:01:26.222766+0000","last_fullsized":"2024-01-25T15:01:26.222766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:27:26.416373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279589+0000","last_change":"2024-01-25T14:59:53.199984+0000","last_active":"2024-01-25T15:00:57.279589+0000","last_peered":"2024-01-25T15:00:57.279589+0000","last_clean":"2024-01-25T15:00:57.279589+0000","last_became_active":"2024-01-25T14:59:53.199674+0000","last_became_peered":"2024-01-25T14:59:53.199674+0000","last_unstale":"2024-01-25T15:00:57.279589+0000","last_undegraded":"2024-01-25T15:00:57.279589+0000","last_fullsized":"2024-01-25T15:00:57.279589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:22:01.521516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.228496+0000","last_change":"2024-01-25T14:59:54.224285+0000","last_active":"2024-01-25T15:01:26.228496+0000","last_peered":"2024-01-25T15:01:26.228496+0000","last_clean":"2024-01-25T15:01:26.228496+0000","last_became_active":"2024-01-25T14:59:54.223904+0000","last_became_peered":"2024-01-25T14:59:54.223904+0000","last_unstale":"2024-01-25T15:01:26.228496+0000","last_undegraded":"2024-01-25T15:01:26.228496+0000","last_fullsized":"2024-01-25T15:01:26.228496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:49:24.717733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284549+0000","last_change":"2024-01-25T14:59:53.203501+0000","last_active":"2024-01-25T15:00:57.284549+0000","last_peered":"2024-01-25T15:00:57.284549+0000","last_clean":"2024-01-25T15:00:57.284549+0000","last_became_active":"2024-01-25T14:59:53.203215+0000","last_became_peered":"2024-01-25T14:59:53.203215+0000","last_unstale":"2024-01-25T15:00:57.284549+0000","last_undegraded":"2024-01-25T15:00:57.284549+0000","last_fullsized":"2024-01-25T15:00:57.284549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:18:25.174639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.185770+0000","last_change":"2024-01-25T14:59:54.219575+0000","last_active":"2024-01-25T15:01:26.185770+0000","last_peered":"2024-01-25T15:01:26.185770+0000","last_clean":"2024-01-25T15:01:26.185770+0000","last_became_active":"2024-01-25T14:59:54.219170+0000","last_became_peered":"2024-01-25T14:59:54.219170+0000","last_unstale":"2024-01-25T15:01:26.185770+0000","last_undegraded":"2024-01-25T15:01:26.185770+0000","last_fullsized":"2024-01-25T15:01:26.185770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:41.940927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283084+0000","last_change":"2024-01-25T14:59:53.203864+0000","last_active":"2024-01-25T15:00:57.283084+0000","last_peered":"2024-01-25T15:00:57.283084+0000","last_clean":"2024-01-25T15:00:57.283084+0000","last_became_active":"2024-01-25T14:59:53.203564+0000","last_became_peered":"2024-01-25T14:59:53.203564+0000","last_unstale":"2024-01-25T15:00:57.283084+0000","last_undegraded":"2024-01-25T15:00:57.283084+0000","last_fullsized":"2024-01-25T15:00:57.283084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:03:21.776910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226178+0000","last_change":"2024-01-25T14:59:54.217014+0000","last_active":"2024-01-25T15:01:26.226178+0000","last_peered":"2024-01-25T15:01:26.226178+0000","last_clean":"2024-01-25T15:01:26.226178+0000","last_became_active":"2024-01-25T14:59:54.216673+0000","last_became_peered":"2024-01-25T14:59:54.216673+0000","last_unstale":"2024-01-25T15:01:26.226178+0000","last_undegraded":"2024-01-25T15:01:26.226178+0000","last_fullsized":"2024-01-25T15:01:26.226178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:46:31.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281990+0000","last_change":"2024-01-25T14:59:53.207297+0000","last_active":"2024-01-25T15:00:57.281990+0000","last_peered":"2024-01-25T15:00:57.281990+0000","last_clean":"2024-01-25T15:00:57.281990+0000","last_became_active":"2024-01-25T14:59:53.206968+0000","last_became_peered":"2024-01-25T14:59:53.206968+0000","last_unstale":"2024-01-25T15:00:57.281990+0000","last_undegraded":"2024-01-25T15:00:57.281990+0000","last_fullsized":"2024-01-25T15:00:57.281990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:01.679360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.225254+0000","last_change":"2024-01-25T14:59:54.218890+0000","last_active":"2024-01-25T15:01:26.225254+0000","last_peered":"2024-01-25T15:01:26.225254+0000","last_clean":"2024-01-25T15:01:26.225254+0000","last_became_active":"2024-01-25T14:59:54.218581+0000","last_became_peered":"2024-01-25T14:59:54.218581+0000","last_unstale":"2024-01-25T15:01:26.225254+0000","last_undegraded":"2024-01-25T15:01:26.225254+0000","last_fullsized":"2024-01-25T15:01:26.225254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:13:07.383270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278450+0000","last_change":"2024-01-25T14:59:53.208219+0000","last_active":"2024-01-25T15:00:57.278450+0000","last_peered":"2024-01-25T15:00:57.278450+0000","last_clean":"2024-01-25T15:00:57.278450+0000","last_became_active":"2024-01-25T14:59:53.207878+0000","last_became_peered":"2024-01-25T14:59:53.207878+0000","last_unstale":"2024-01-25T15:00:57.278450+0000","last_undegraded":"2024-01-25T15:00:57.278450+0000","last_fullsized":"2024-01-25T15:00:57.278450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:03.410383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.230836+0000","last_change":"2024-01-25T14:59:54.208996+0000","last_active":"2024-01-25T15:01:26.230836+0000","last_peered":"2024-01-25T15:01:26.230836+0000","last_clean":"2024-01-25T15:01:26.230836+0000","last_became_active":"2024-01-25T14:59:54.208658+0000","last_became_peered":"2024-01-25T14:59:54.208658+0000","last_unstale":"2024-01-25T15:01:26.230836+0000","last_undegraded":"2024-01-25T15:01:26.230836+0000","last_fullsized":"2024-01-25T15:01:26.230836+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:39:57.752381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'6","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:50.200224+0000","last_change":"2024-01-25T14:59:53.207106+0000","last_active":"2024-01-25T15:01:50.200224+0000","last_peered":"2024-01-25T15:01:50.200224+0000","last_clean":"2024-01-25T15:01:50.200224+0000","last_became_active":"2024-01-25T14:59:53.206688+0000","last_became_peered":"2024-01-25T14:59:53.206688+0000","last_unstale":"2024-01-25T15:01:50.200224+0000","last_undegraded":"2024-01-25T15:01:50.200224+0000","last_fullsized":"2024-01-25T15:01:50.200224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:30:03.019791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1478,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.231461+0000","last_change":"2024-01-25T14:59:54.208994+0000","last_active":"2024-01-25T15:01:26.231461+0000","last_peered":"2024-01-25T15:01:26.231461+0000","last_clean":"2024-01-25T15:01:26.231461+0000","last_became_active":"2024-01-25T14:59:54.208638+0000","last_became_peered":"2024-01-25T14:59:54.208638+0000","last_unstale":"2024-01-25T15:01:26.231461+0000","last_undegraded":"2024-01-25T15:01:26.231461+0000","last_fullsized":"2024-01-25T15:01:26.231461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:56.001501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283687+0000","last_change":"2024-01-25T14:59:53.207659+0000","last_active":"2024-01-25T15:00:57.283687+0000","last_peered":"2024-01-25T15:00:57.283687+0000","last_clean":"2024-01-25T15:00:57.283687+0000","last_became_active":"2024-01-25T14:59:53.207373+0000","last_became_peered":"2024-01-25T14:59:53.207373+0000","last_unstale":"2024-01-25T15:00:57.283687+0000","last_undegraded":"2024-01-25T15:00:57.283687+0000","last_fullsized":"2024-01-25T15:00:57.283687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:02:18.884192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.219871+0000","last_change":"2024-01-25T14:59:54.210415+0000","last_active":"2024-01-25T15:01:26.219871+0000","last_peered":"2024-01-25T15:01:26.219871+0000","last_clean":"2024-01-25T15:01:26.219871+0000","last_became_active":"2024-01-25T14:59:54.210097+0000","last_became_peered":"2024-01-25T14:59:54.210097+0000","last_unstale":"2024-01-25T15:01:26.219871+0000","last_undegraded":"2024-01-25T15:01:26.219871+0000","last_fullsized":"2024-01-25T15:01:26.219871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:43:18.764375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279899+0000","last_change":"2024-01-25T14:59:53.203526+0000","last_active":"2024-01-25T15:00:57.279899+0000","last_peered":"2024-01-25T15:00:57.279899+0000","last_clean":"2024-01-25T15:00:57.279899+0000","last_became_active":"2024-01-25T14:59:53.203223+0000","last_became_peered":"2024-01-25T14:59:53.203223+0000","last_unstale":"2024-01-25T15:00:57.279899+0000","last_undegraded":"2024-01-25T15:00:57.279899+0000","last_fullsized":"2024-01-25T15:00:57.279899+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:35:06.014547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226672+0000","last_change":"2024-01-25T14:59:54.219053+0000","last_active":"2024-01-25T15:01:26.226672+0000","last_peered":"2024-01-25T15:01:26.226672+0000","last_clean":"2024-01-25T15:01:26.226672+0000","last_became_active":"2024-01-25T14:59:54.218733+0000","last_became_peered":"2024-01-25T14:59:54.218733+0000","last_unstale":"2024-01-25T15:01:26.226672+0000","last_undegraded":"2024-01-25T15:01:26.226672+0000","last_fullsized":"2024-01-25T15:01:26.226672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:07:19.083352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.225238+0000","last_change":"2024-01-25T14:59:54.210644+0000","last_active":"2024-01-25T15:01:26.225238+0000","last_peered":"2024-01-25T15:01:26.225238+0000","last_clean":"2024-01-25T15:01:26.225238+0000","last_became_active":"2024-01-25T14:59:54.210333+0000","last_became_peered":"2024-01-25T14:59:54.210333+0000","last_unstale":"2024-01-25T15:01:26.225238+0000","last_undegraded":"2024-01-25T15:01:26.225238+0000","last_fullsized":"2024-01-25T15:01:26.225238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:25:06.201952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.216766+0000","last_change":"2024-01-25T15:00:57.286523+0000","last_active":"2024-01-25T15:01:26.216766+0000","last_peered":"2024-01-25T15:01:26.216766+0000","last_clean":"2024-01-25T15:01:26.216766+0000","last_became_active":"2024-01-25T15:00:57.286115+0000","last_became_peered":"2024-01-25T15:00:57.286115+0000","last_unstale":"2024-01-25T15:01:26.216766+0000","last_undegraded":"2024-01-25T15:01:26.216766+0000","last_fullsized":"2024-01-25T15:01:26.216766+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:53:47.571571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.200328+0000","last_change":"2024-01-25T14:59:54.218260+0000","last_active":"2024-01-25T15:01:26.200328+0000","last_peered":"2024-01-25T15:01:26.200328+0000","last_clean":"2024-01-25T15:01:26.200328+0000","last_became_active":"2024-01-25T14:59:54.217381+0000","last_became_peered":"2024-01-25T14:59:54.217381+0000","last_unstale":"2024-01-25T15:01:26.200328+0000","last_undegraded":"2024-01-25T15:01:26.200328+0000","last_fullsized":"2024-01-25T15:01:26.200328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:36:09.631749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226804+0000","last_change":"2024-01-25T14:59:54.224518+0000","last_active":"2024-01-25T15:01:26.226804+0000","last_peered":"2024-01-25T15:01:26.226804+0000","last_clean":"2024-01-25T15:01:26.226804+0000","last_became_active":"2024-01-25T14:59:54.224210+0000","last_became_peered":"2024-01-25T14:59:54.224210+0000","last_unstale":"2024-01-25T15:01:26.226804+0000","last_undegraded":"2024-01-25T15:01:26.226804+0000","last_fullsized":"2024-01-25T15:01:26.226804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:33:56.670077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.224130+0000","last_change":"2024-01-25T15:00:57.282096+0000","last_active":"2024-01-25T15:01:26.224130+0000","last_peered":"2024-01-25T15:01:26.224130+0000","last_clean":"2024-01-25T15:01:26.224130+0000","last_became_active":"2024-01-25T15:00:57.281725+0000","last_became_peered":"2024-01-25T15:00:57.281725+0000","last_unstale":"2024-01-25T15:01:26.224130+0000","last_undegraded":"2024-01-25T15:01:26.224130+0000","last_fullsized":"2024-01-25T15:01:26.224130+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:53:03.519667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.227701+0000","last_change":"2024-01-25T14:59:54.217690+0000","last_active":"2024-01-25T15:01:26.227701+0000","last_peered":"2024-01-25T15:01:26.227701+0000","last_clean":"2024-01-25T15:01:26.227701+0000","last_became_active":"2024-01-25T14:59:54.217361+0000","last_became_peered":"2024-01-25T14:59:54.217361+0000","last_unstale":"2024-01-25T15:01:26.227701+0000","last_undegraded":"2024-01-25T15:01:26.227701+0000","last_fullsized":"2024-01-25T15:01:26.227701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:30:15.893502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.212394+0000","last_change":"2024-01-25T14:59:54.205201+0000","last_active":"2024-01-25T15:01:26.212394+0000","last_peered":"2024-01-25T15:01:26.212394+0000","last_clean":"2024-01-25T15:01:26.212394+0000","last_became_active":"2024-01-25T14:59:54.204893+0000","last_became_peered":"2024-01-25T14:59:54.204893+0000","last_unstale":"2024-01-25T15:01:26.212394+0000","last_undegraded":"2024-01-25T15:01:26.212394+0000","last_fullsized":"2024-01-25T15:01:26.212394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:35:43.147029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221643+0000","last_change":"2024-01-25T14:59:54.210681+0000","last_active":"2024-01-25T15:01:26.221643+0000","last_peered":"2024-01-25T15:01:26.221643+0000","last_clean":"2024-01-25T15:01:26.221643+0000","last_became_active":"2024-01-25T14:59:54.210347+0000","last_became_peered":"2024-01-25T14:59:54.210347+0000","last_unstale":"2024-01-25T15:01:26.221643+0000","last_undegraded":"2024-01-25T15:01:26.221643+0000","last_fullsized":"2024-01-25T15:01:26.221643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:44:12.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221684+0000","last_change":"2024-01-25T14:59:54.210792+0000","last_active":"2024-01-25T15:01:26.221684+0000","last_peered":"2024-01-25T15:01:26.221684+0000","last_clean":"2024-01-25T15:01:26.221684+0000","last_became_active":"2024-01-25T14:59:54.210416+0000","last_became_peered":"2024-01-25T14:59:54.210416+0000","last_unstale":"2024-01-25T15:01:26.221684+0000","last_undegraded":"2024-01-25T15:01:26.221684+0000","last_fullsized":"2024-01-25T15:01:26.221684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:45.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.222916+0000","last_change":"2024-01-25T14:59:54.204547+0000","last_active":"2024-01-25T15:01:26.222916+0000","last_peered":"2024-01-25T15:01:26.222916+0000","last_clean":"2024-01-25T15:01:26.222916+0000","last_became_active":"2024-01-25T14:59:54.204215+0000","last_became_peered":"2024-01-25T14:59:54.204215+0000","last_unstale":"2024-01-25T15:01:26.222916+0000","last_undegraded":"2024-01-25T15:01:26.222916+0000","last_fullsized":"2024-01-25T15:01:26.222916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:34:04.413137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.232166+0000","last_change":"2024-01-25T14:59:54.211006+0000","last_active":"2024-01-25T15:01:26.232166+0000","last_peered":"2024-01-25T15:01:26.232166+0000","last_clean":"2024-01-25T15:01:26.232166+0000","last_became_active":"2024-01-25T14:59:54.210568+0000","last_became_peered":"2024-01-25T14:59:54.210568+0000","last_unstale":"2024-01-25T15:01:26.232166+0000","last_undegraded":"2024-01-25T15:01:26.232166+0000","last_fullsized":"2024-01-25T15:01:26.232166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:12:23.888827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.224809+0000","last_change":"2024-01-25T14:59:54.220485+0000","last_active":"2024-01-25T15:01:26.224809+0000","last_peered":"2024-01-25T15:01:26.224809+0000","last_clean":"2024-01-25T15:01:26.224809+0000","last_became_active":"2024-01-25T14:59:54.219547+0000","last_became_peered":"2024-01-25T14:59:54.219547+0000","last_unstale":"2024-01-25T15:01:26.224809+0000","last_undegraded":"2024-01-25T15:01:26.224809+0000","last_fullsized":"2024-01-25T15:01:26.224809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:43:49.858263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.228144+0000","last_change":"2024-01-25T14:59:54.217605+0000","last_active":"2024-01-25T15:01:26.228144+0000","last_peered":"2024-01-25T15:01:26.228144+0000","last_clean":"2024-01-25T15:01:26.228144+0000","last_became_active":"2024-01-25T14:59:54.217295+0000","last_became_peered":"2024-01-25T14:59:54.217295+0000","last_unstale":"2024-01-25T15:01:26.228144+0000","last_undegraded":"2024-01-25T15:01:26.228144+0000","last_fullsized":"2024-01-25T15:01:26.228144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:27:59.846434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65841,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1131,"num_read_kb":633,"num_write":241,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58353,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":202535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383717,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":954368,"data_stored":456311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.69699999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":1.444,"15min":1.444},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.53600000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93300000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.5,"15min":0.48199999999999998},"min":{"1min":0.40500000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.66300000000000003},"min":{"1min":0.58599999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.92700000000000005,"5min":1.079,"15min":1.079},"last":0.878},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61699999999999999,"15min":0.61099999999999999},"min":{"1min":0.496,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.86199999999999999}]},{"osd":5,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83999999999999997,"5min":1.387,"15min":1.387},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.42799999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.71999999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.58499999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97499999999999998,"5min":1.571,"15min":1.571},"last":0.751}]},{"osd":7,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.748,"15min":0.73399999999999999},"min":{"1min":0.72399999999999998,"5min":0.5,"15min":0.5},"max":{"1min":0.99099999999999999,"5min":1.129,"15min":1.129},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.70699999999999996,"15min":0.69799999999999995},"min":{"1min":0.55800000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91700000000000004,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.81799999999999995}]},{"osd":8,"last update":"Thu Jan 25 15:00:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.91400000000000003}]},{"osd":9,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75900000000000001,"15min":0.75800000000000001},"min":{"1min":0.65100000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94399999999999995,"5min":1.536,"15min":1.536},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.87,"5min":0.76600000000000001,"15min":0.749},"min":{"1min":0.71999999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.028,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97599999999999998}]},{"osd":10,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.67200000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92300000000000004,"5min":1.101,"15min":1.101},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79600000000000004,"15min":0.79500000000000004},"min":{"1min":0.60899999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.004,"5min":1.603,"15min":1.603},"last":0.83099999999999996}]}]},{"osd":10,"up_from":72,"seq":309237645354,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1650688,"data_stored":1105898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.495},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.499},{"interface":"front","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.312,"5min":0.308,"15min":0.308},"max":{"1min":0.69299999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82499999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.439,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.873,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.749}]},{"osd":3,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64100000000000001,"15min":0.66100000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72499999999999998,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71699999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.82999999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78900000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.48299999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92000000000000004,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46800000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.91300000000000003}]},{"osd":6,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.72399999999999998,"15min":0.754},"min":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92000000000000004,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.873},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90700000000000003,"5min":1.347,"15min":1.347},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.45500000000000002}]},{"osd":8,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77500000000000002,"15min":0.79400000000000004},"min":{"1min":0.42499999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94799999999999995,"5min":1.282,"15min":1.282},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78100000000000003,"15min":0.79800000000000004},"min":{"1min":0.54800000000000004,"5min":0.495,"15min":0.495},"max":{"1min":0.89300000000000002,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.85499999999999998}]},{"osd":9,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.79600000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93500000000000005,"5min":1.262,"15min":1.262},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.79300000000000004,"15min":0.82299999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89100000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.89800000000000002}]},{"osd":11,"last update":"Thu Jan 25 15:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95299999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76900000000000002,"15min":0.76100000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.97999999999999998,"5min":1.004,"15min":1.004},"last":0.98199999999999998}]}]},{"osd":9,"up_from":67,"seq":287762808878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":456219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.26800000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.436,"15min":0.46400000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.58999999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60899999999999999,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":0.875,"15min":0.875},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73999999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.60199999999999998,"15min":0.627},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68400000000000005,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.41999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.71199999999999997,"5min":1.012,"15min":1.012},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.495,"15min":0.52500000000000002},"min":{"1min":0.317,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68999999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.51800000000000002,"15min":0.54600000000000004},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.79100000000000004,"5min":0.876,"15min":0.876},"last":0.379}]},{"osd":4,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.314,"15min":0.314},"max":{"1min":0.78000000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.4419999999999999,"5min":0.82599999999999996,"15min":0.72299999999999998},"min":{"1min":0.39000000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":17.138999999999999,"5min":17.138999999999999,"15min":17.138999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.81899999999999995,"15min":0.73899999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72599999999999998,"5min":17.117000000000001,"15min":17.117000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":3.528,"5min":3.528,"15min":3.528},"last":0.629}]},{"osd":6,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.624,"15min":0.66700000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.96299999999999997,"5min":1.036,"15min":1.036},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.56799999999999995,"15min":0.60599999999999998},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94999999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.436}]},{"osd":7,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":0.83499999999999996,"15min":0.78800000000000003},"min":{"1min":0.45600000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":13.346,"5min":13.346,"15min":13.346},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.73899999999999999,"15min":0.78000000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93700000000000006,"5min":1.125,"15min":1.125},"last":0.45200000000000001}]},{"osd":8,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.67300000000000004,"15min":0.69499999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.88500000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.71799999999999997,"15min":0.751},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81100000000000005,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.60499999999999998}]},{"osd":10,"last update":"Thu Jan 25 15:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.66000000000000003,"15min":0.68400000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75600000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.70599999999999996,"15min":0.72799999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.57199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":8,"up_from":59,"seq":253403070515,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":966656,"data_stored":456575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.438,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69499999999999995,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68300000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.84399999999999997}]},{"osd":1,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.60299999999999998,"15min":0.58699999999999997},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94299999999999995,"5min":1.008,"15min":1.008},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59699999999999998,"15min":0.58599999999999997},"min":{"1min":0.46300000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.39700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.65500000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.47799999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78500000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.49099999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91800000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.63600000000000001,"15min":0.627},"min":{"1min":0.59099999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.876}]},{"osd":5,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.45700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.42799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80600000000000005,"5min":1.028,"15min":1.028},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.54600000000000004,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.51600000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86299999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.61199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88800000000000001,"5min":1.04,"15min":1.04},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.70899999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.995,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.75900000000000001}]},{"osd":9,"last update":"Thu Jan 25 15:01:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.67300000000000004,"15min":0.64300000000000002},"min":{"1min":0.59799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90900000000000003,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.69199999999999995,"15min":0.65800000000000003},"min":{"1min":0.68899999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.69199999999999995}]},{"osd":10,"last update":"Thu Jan 25 15:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.72399999999999998,"15min":0.68600000000000005},"min":{"1min":0.65500000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.73499999999999999,"15min":0.68999999999999995},"min":{"1min":0.71399999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.81599999999999995}]}]},{"osd":7,"up_from":52,"seq":223338299449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32708,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712444,"statfs":{"total":95995035648,"available":95961542656,"internally_reserved":0,"allocated":1568768,"data_stored":1049255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.53200000000000003,"15min":0.51900000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.40100000000000002},"min":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55100000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.29199999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.498}]},{"osd":2,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.68500000000000005,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84399999999999997,"5min":6.508,"15min":6.508},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.40400000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.47599999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.74399999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.71399999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59899999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64300000000000002,"15min":0.627},"min":{"1min":0.45300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.80600000000000005,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.626,"15min":0.62},"min":{"1min":0.41999999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82099999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67800000000000005,"15min":0.68400000000000005},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84799999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.44500000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.89700000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81699999999999995}]},{"osd":8,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69199999999999995,"15min":0.68400000000000005},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.79500000000000004,"15min":0.73299999999999998},"min":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.97099999999999997,"5min":6.5469999999999997,"15min":6.5469999999999997},"last":0.85599999999999998}]},{"osd":9,"last update":"Thu Jan 25 15:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.57199999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.84799999999999998,"5min":1.022,"15min":1.022},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91100000000000003,"5min":1.016,"15min":1.016},"last":0.76600000000000001}]},{"osd":10,"last update":"Thu Jan 25 15:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75700000000000001,"15min":0.77000000000000002},"min":{"1min":0.46600000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88900000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88300000000000001,"5min":1.087,"15min":1.087},"last":0.82799999999999996}]},{"osd":11,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.879},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.90800000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495678,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40432,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704720,"statfs":{"total":95995035648,"available":95953633280,"internally_reserved":0,"allocated":958464,"data_stored":455936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39900000000000002,"15min":0.377},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.437},{"interface":"front","average":{"1min":0.435,"5min":0.40400000000000003,"15min":0.377},"min":{"1min":0.27400000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.379}]},{"osd":1,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.39200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56299999999999994,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55000000000000004,"15min":0.52400000000000002},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.622},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89100000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.432,"15min":0.42399999999999999},"min":{"1min":0.29099999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48099999999999998,"15min":0.46700000000000003},"min":{"1min":0.315,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.61599999999999999,"15min":0.58799999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61599999999999999,"15min":0.59599999999999997},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 25 15:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65100000000000002,"15min":0.67800000000000005},"min":{"1min":0.442,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0309999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.67200000000000004,"15min":0.69399999999999995},"min":{"1min":0.46899999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":1.04,"15min":1.04},"last":0.71099999999999997}]},{"osd":8,"last update":"Thu Jan 25 15:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67700000000000005,"15min":0.70599999999999996},"min":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89900000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.75},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.52700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.60699999999999998}]},{"osd":9,"last update":"Thu Jan 25 15:01:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.65600000000000003,"15min":0.68300000000000005},"min":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.67000000000000004,"15min":0.70599999999999996},"min":{"1min":0.41799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98599999999999999,"5min":1.147,"15min":1.147},"last":0.69499999999999995}]},{"osd":10,"last update":"Thu Jan 25 15:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.51800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.212,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.58099999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.76500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":515429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.49099999999999999},"min":{"1min":0.39300000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82699999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.49299999999999999},"min":{"1min":0.36599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77100000000000002,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.747}]},{"osd":2,"last update":"Thu Jan 25 15:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.61199999999999999,"15min":0.51700000000000002},"min":{"1min":0.49399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.53300000000000003},"min":{"1min":0.42499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90800000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:00:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59499999999999997,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90300000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.56399999999999995,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78700000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 25 15:01:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.46999999999999997,"15min":0.40400000000000003},"min":{"1min":0.316,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.47299999999999998,"15min":0.41499999999999998},"min":{"1min":0.33600000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.315}]},{"osd":5,"last update":"Thu Jan 25 15:01:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.65600000000000003,"15min":0.59099999999999997},"min":{"1min":0.48699999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66400000000000003,"15min":0.58299999999999996},"min":{"1min":0.505,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 25 15:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63100000000000001,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94399999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.629},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65200000000000002,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 25 15:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.624,"15min":0.58799999999999997},"min":{"1min":0.41999999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97299999999999998,"5min":1.008,"15min":1.008},"last":0.436},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.68300000000000005,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.61299999999999999}]},{"osd":8,"last update":"Thu Jan 25 15:00:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.755,"15min":0.73499999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.69299999999999995,"15min":0.67500000000000004},"min":{"1min":0.63900000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64200000000000002}]},{"osd":9,"last update":"Thu Jan 25 15:01:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.74299999999999999,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.01,"5min":1.089,"15min":1.089},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.59599999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.85199999999999998}]},{"osd":10,"last update":"Thu Jan 25 15:01:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.53800000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80800000000000005,"15min":0.80600000000000005},"min":{"1min":0.58899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.79900000000000004}]},{"osd":11,"last update":"Thu Jan 25 15:00:56 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.873},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.73099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40452,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704700,"statfs":{"total":95995035648,"available":95953612800,"internally_reserved":0,"allocated":978944,"data_stored":457275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:01:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.5},"min":{"1min":0.38500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84299999999999997,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.434},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52500000000000002,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:01:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.51200000000000001},"min":{"1min":0.378,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72599999999999998,"5min":1.143,"15min":1.143},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.42899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72299999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:00:57 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55800000000000005,"15min":0.51600000000000001},"min":{"1min":0.38400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.70999999999999996,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55500000000000005,"15min":0.52700000000000002},"min":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.63900000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 25 15:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.56299999999999994,"15min":0.54700000000000004},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:01:14 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.502,"15min":0.52000000000000002},"min":{"1min":0.29199999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.94299999999999995,"5min":1.232,"15min":1.232},"last":0.317},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.50700000000000001},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.91000000000000003,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.498}]},{"osd":7,"last update":"Thu Jan 25 14:59:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57699999999999996}]},{"osd":8,"last update":"Thu Jan 25 15:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66300000000000003,"15min":0.67000000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.69899999999999995},"min":{"1min":0.47699999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.57199999999999995}]},{"osd":9,"last update":"Thu Jan 25 15:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.375,"5min":0.37,"15min":0.37},"max":{"1min":0.63,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.39600000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69699999999999995,"5min":1.052,"15min":1.052},"last":0.60099999999999998}]},{"osd":10,"last update":"Thu Jan 25 15:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.50700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.751,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.77400000000000002,"15min":0.74199999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.52500000000000002}]},{"osd":11,"last update":"Thu Jan 25 15:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1140000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72099999999999997,"15min":0.72399999999999998},"min":{"1min":0.58599999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.61499999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":970752,"data_stored":457908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:36 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.433,"5min":0.246,"15min":0.246},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.40600000000000003,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68500000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 25 15:01:36 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.52800000000000002},"min":{"1min":0.38400000000000001,"5min":0.34999999999999998,"15min":0.26500000000000001},"max":{"1min":0.878,"5min":0.879,"15min":0.879},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.58999999999999997,"15min":0.52600000000000002},"min":{"1min":0.51200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 25 15:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59699999999999998,"15min":0.54300000000000004},"min":{"1min":0.42799999999999999,"5min":0.373,"15min":0.28000000000000003},"max":{"1min":0.71299999999999997,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58699999999999997,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.29799999999999999},"max":{"1min":0.77600000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 25 15:00:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.624},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.751}]},{"osd":5,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.47499999999999998,"15min":0.41199999999999998},"min":{"1min":0.31900000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.82899999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.38},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.44900000000000001},"min":{"1min":0.34499999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.74199999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.432}]},{"osd":6,"last update":"Thu Jan 25 15:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82599999999999996,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.58199999999999996},"min":{"1min":0.40000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.878,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 25 14:59:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.76900000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67700000000000005,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.80500000000000005,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77500000000000002}]},{"osd":8,"last update":"Thu Jan 25 15:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.44900000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85299999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82099999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53300000000000003}]},{"osd":9,"last update":"Thu Jan 25 15:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.51900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.501},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69699999999999995,"15min":0.69199999999999995},"min":{"1min":0.55500000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89900000000000002,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67500000000000004}]},{"osd":10,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.70099999999999996,"15min":0.66700000000000004},"min":{"1min":0.61499999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93799999999999994,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.70599999999999996,"15min":0.66700000000000004},"min":{"1min":0.64500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64100000000000001}]},{"osd":11,"last update":"Thu Jan 25 15:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.69499999999999995}]}]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":455761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.34000000000000002},"min":{"1min":0.254,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.27200000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53700000000000003,"15min":0.51000000000000001},"min":{"1min":0.376,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54600000000000004,"15min":0.51000000000000001},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.753,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73899999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 25 15:01:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77900000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80000000000000004,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47999999999999998,"15min":0.46999999999999997},"min":{"1min":0.29999999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.51300000000000001,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.437}]},{"osd":7,"last update":"Thu Jan 25 15:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.45300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.63300000000000001,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82899999999999996,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68000000000000005}]},{"osd":8,"last update":"Thu Jan 25 14:59:53 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85899999999999999,"5min":0.872,"15min":0.872},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69599999999999995,"15min":0.69499999999999995},"min":{"1min":0.56799999999999995,"5min":0.5,"15min":0.5},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.61799999999999999}]},{"osd":9,"last update":"Thu Jan 25 15:01:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.64100000000000001,"15min":0.68300000000000005},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.753,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67700000000000005,"15min":0.71399999999999997},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.49299999999999999}]},{"osd":10,"last update":"Thu Jan 25 15:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64900000000000002}]},{"osd":11,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70399999999999996}]}]},{"osd":4,"up_from":33,"seq":141733920840,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":519389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48599999999999999,"15min":0.47699999999999998},"min":{"1min":0.38100000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.82199999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 25 15:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41399999999999998,"15min":0.39200000000000002},"min":{"1min":0.26500000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41999999999999998,"15min":0.40200000000000002},"min":{"1min":0.28000000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.68999999999999995,"5min":0.878,"15min":0.878},"last":0.378}]},{"osd":2,"last update":"Thu Jan 25 15:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.749,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.57599999999999996},"min":{"1min":0.41799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84599999999999997,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 25 15:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55700000000000005,"15min":0.51300000000000001},"min":{"1min":0.442,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55700000000000005,"15min":0.54200000000000004},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73899999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.46100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.39600000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 25 15:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.56399999999999995},"min":{"1min":0.46400000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81000000000000005,"5min":0.879,"15min":0.879},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.36499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90700000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 25 15:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58899999999999997,"15min":0.55300000000000005},"min":{"1min":0.35999999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":1.002,"15min":1.002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57399999999999995,"15min":0.53300000000000003},"min":{"1min":0.38900000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76800000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61599999999999999}]},{"osd":8,"last update":"Thu Jan 25 15:00:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.47699999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89400000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69899999999999995,"15min":0.67400000000000004},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96799999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.66100000000000003}]},{"osd":9,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.57099999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96699999999999997,"5min":1,"15min":1},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75700000000000001,"15min":0.76700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90200000000000002,"5min":1.044,"15min":1.044},"last":0.77300000000000002}]},{"osd":10,"last update":"Thu Jan 25 15:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89600000000000002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67800000000000005,"15min":0.68799999999999994},"min":{"1min":0.48199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81100000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64500000000000002}]},{"osd":11,"last update":"Thu Jan 25 15:00:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.754},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.70499999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757314,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32720,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712432,"statfs":{"total":95995035648,"available":95961530368,"internally_reserved":0,"allocated":1581056,"data_stored":1048933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71599999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.32500000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57199999999999995,"15min":0.53400000000000003},"min":{"1min":0.39800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78000000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.53900000000000003},"min":{"1min":0.41299999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71899999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.41299999999999998,"15min":0.39600000000000002},"min":{"1min":0.32600000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54600000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.375},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40200000000000002,"15min":0.38600000000000001},"min":{"1min":0.313,"5min":0.247,"15min":0.247},"max":{"1min":0.621,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.54400000000000004,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.751,"5min":0.873,"15min":0.873},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.35799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.505}]},{"osd":4,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58299999999999996,"15min":0.55300000000000005},"min":{"1min":0.497,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.60399999999999998,"15min":0.56599999999999995},"min":{"1min":0.42799999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.80100000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 25 15:01:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.58799999999999997},"min":{"1min":0.38500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.81699999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81399999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.436}]},{"osd":7,"last update":"Thu Jan 25 15:01:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.48799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89300000000000002,"5min":1.01,"15min":1.01},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.91600000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.63}]},{"osd":8,"last update":"Thu Jan 25 15:00:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83199999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79800000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.71599999999999997}]},{"osd":9,"last update":"Thu Jan 25 15:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66200000000000003,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84799999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.62},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.873,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.67600000000000005}]},{"osd":10,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.63300000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86899999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.59799999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88300000000000001,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.70699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:01:53.569 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:01:53.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.705+0000 7f5ab4b2c640 1 -- 172.21.15.170:0/1842165728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab0101f20 msgr2=0x7f5ab01023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:53.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.705+0000 7f5ab4b2c640 1 --2- 172.21.15.170:0/1842165728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab0101f20 0x7f5ab01023a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009900 tx=0x7f5aa402bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:53.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.705+0000 7f5ab4b2c640 1 -- 172.21.15.170:0/1842165728 shutdown_connections 2024-01-25T15:01:53.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.705+0000 7f5ab4b2c640 1 --2- 172.21.15.170:0/1842165728 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab01028e0 0x7f5ab0109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.705+0000 7f5ab4b2c640 1 --2- 172.21.15.170:0/1842165728 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab0101f20 0x7f5ab01023a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.705+0000 7f5ab4b2c640 1 --2- 172.21.15.170:0/1842165728 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ab0100d30 0x7f5ab0101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.705+0000 7f5ab4b2c640 1 -- 172.21.15.170:0/1842165728 >> 172.21.15.170:0/1842165728 conn(0x7f5ab00fc2a0 msgr2=0x7f5ab00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:53.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.705+0000 7f5ab4b2c640 1 -- 172.21.15.170:0/1842165728 shutdown_connections 2024-01-25T15:01:53.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.705+0000 7f5ab4b2c640 1 -- 172.21.15.170:0/1842165728 wait complete. 2024-01-25T15:01:53.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5ab4b2c640 1 Processor -- start 2024-01-25T15:01:53.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5ab4b2c640 1 -- start start 2024-01-25T15:01:53.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5ab4b2c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab0100d30 0x7f5ab0196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:53.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5ab4b2c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab0101f20 0x7f5ab01971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:53.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5ab4b2c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ab01028e0 0x7f5ab019e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:53.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5ab4b2c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab019e7a0 con 0x7f5ab0101f20 2024-01-25T15:01:53.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5ab4b2c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab019e910 con 0x7f5ab01028e0 2024-01-25T15:01:53.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5ab4b2c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab019ead0 con 0x7f5ab0100d30 2024-01-25T15:01:53.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5aadd9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab0101f20 0x7f5ab01971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:53.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5aadd9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab0101f20 0x7f5ab01971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36288/0 (socket says 172.21.15.170:36288) 2024-01-25T15:01:53.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5aadd9b640 1 -- 172.21.15.170:0/1999043790 learned_addr learned my addr 172.21.15.170:0/1999043790 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:53.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5aae59c640 1 --2- 172.21.15.170:0/1999043790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab0100d30 0x7f5ab0196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:53.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5aadd9b640 1 -- 172.21.15.170:0/1999043790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab0100d30 msgr2=0x7f5ab0196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:53.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5aadd9b640 1 --2- 172.21.15.170:0/1999043790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab0100d30 0x7f5ab0196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5aaed9d640 1 --2- 172.21.15.170:0/1999043790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ab01028e0 0x7f5ab019e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:53.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5aadd9b640 1 -- 172.21.15.170:0/1999043790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ab01028e0 msgr2=0x7f5ab019e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:53.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5aadd9b640 1 --2- 172.21.15.170:0/1999043790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ab01028e0 0x7f5ab019e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.706+0000 7f5aadd9b640 1 -- 172.21.15.170:0/1999043790 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa4009560 con 0x7f5ab0101f20 2024-01-25T15:01:53.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.707+0000 7f5aadd9b640 1 --2- 172.21.15.170:0/1999043790 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab0101f20 0x7f5ab01971d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009230 tx=0x7f5aa40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:53.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.707+0000 7f5a9f7fe640 1 -- 172.21.15.170:0/1999043790 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa40044e0 con 0x7f5ab0101f20 2024-01-25T15:01:53.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.707+0000 7f5a9f7fe640 1 -- 172.21.15.170:0/1999043790 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5aa40035f0 con 0x7f5ab0101f20 2024-01-25T15:01:53.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.707+0000 7f5a9f7fe640 1 -- 172.21.15.170:0/1999043790 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa403e6b0 con 0x7f5ab0101f20 2024-01-25T15:01:53.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.707+0000 7f5ab4b2c640 1 -- 172.21.15.170:0/1999043790 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab019ed50 con 0x7f5ab0101f20 2024-01-25T15:01:53.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.707+0000 7f5ab4b2c640 1 -- 172.21.15.170:0/1999043790 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab019f200 con 0x7f5ab0101f20 2024-01-25T15:01:53.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.708+0000 7f5ab4b2c640 1 -- 172.21.15.170:0/1999043790 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab01080d0 con 0x7f5ab0101f20 2024-01-25T15:01:53.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.709+0000 7f5a9f7fe640 1 -- 172.21.15.170:0/1999043790 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f5aa4003960 con 0x7f5ab0101f20 2024-01-25T15:01:53.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.709+0000 7f5a9f7fe640 1 --2- 172.21.15.170:0/1999043790 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5a980a1370 0x7f5a980a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:53.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.710+0000 7f5aae59c640 1 --2- 172.21.15.170:0/1999043790 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5a980a1370 0x7f5a980a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:53.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.710+0000 7f5a9f7fe640 1 -- 172.21.15.170:0/1999043790 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f5aa40ef6c0 con 0x7f5ab0101f20 2024-01-25T15:01:53.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.710+0000 7f5aae59c640 1 --2- 172.21.15.170:0/1999043790 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5a980a1370 0x7f5a980a3830 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0005db0 tx=0x7f5aa0005d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:53.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.714+0000 7f5a9f7fe640 1 -- 172.21.15.170:0/1999043790 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f5aa40b8b20 con 0x7f5ab0101f20 2024-01-25T15:01:53.885 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.884+0000 7f5ab4b2c640 1 -- 172.21.15.170:0/1999043790 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ab002cbf0 con 0x7f5a980a1370 2024-01-25T15:01:53.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.895+0000 7f5a9f7fe640 1 -- 172.21.15.170:0/1999043790 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344757 (secure 0 0 0) 0x7f5ab002cbf0 con 0x7f5a980a1370 2024-01-25T15:01:53.900 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:53.902 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2024-01-25T15:01:53.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.898+0000 7f5ab4b2c640 1 -- 172.21.15.170:0/1999043790 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5a980a1370 msgr2=0x7f5a980a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:53.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.898+0000 7f5ab4b2c640 1 --2- 172.21.15.170:0/1999043790 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5a980a1370 0x7f5a980a3830 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0005db0 tx=0x7f5aa0005d40 comp rx=0 tx=0).stop 2024-01-25T15:01:53.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.898+0000 7f5ab4b2c640 1 -- 172.21.15.170:0/1999043790 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab0101f20 msgr2=0x7f5ab01971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:53.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.898+0000 7f5ab4b2c640 1 --2- 172.21.15.170:0/1999043790 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab0101f20 0x7f5ab01971d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009230 tx=0x7f5aa40042f0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.898+0000 7f5ab4b2c640 1 -- 172.21.15.170:0/1999043790 shutdown_connections 2024-01-25T15:01:53.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.898+0000 7f5ab4b2c640 1 --2- 172.21.15.170:0/1999043790 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5a980a1370 0x7f5a980a3830 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.898+0000 7f5ab4b2c640 1 --2- 172.21.15.170:0/1999043790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ab01028e0 0x7f5ab019e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.898+0000 7f5ab4b2c640 1 --2- 172.21.15.170:0/1999043790 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5ab0101f20 0x7f5ab01971d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.898+0000 7f5ab4b2c640 1 --2- 172.21.15.170:0/1999043790 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5ab0100d30 0x7f5ab0196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:53.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.898+0000 7f5ab4b2c640 1 -- 172.21.15.170:0/1999043790 >> 172.21.15.170:0/1999043790 conn(0x7f5ab00fc2a0 msgr2=0x7f5ab01052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:53.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.898+0000 7f5ab4b2c640 1 -- 172.21.15.170:0/1999043790 shutdown_connections 2024-01-25T15:01:53.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:53.899+0000 7f5ab4b2c640 1 -- 172.21.15.170:0/1999043790 wait complete. 2024-01-25T15:01:53.910 INFO:teuthology.orchestra.run.smithi170.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2024-01-25T15:01:52.219739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656443,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1257,"num_read_kb":742,"num_write":424,"num_write_kb":3075,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1239089,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":848,"ondisk_log_size":848,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":395744,"kb_used_data":13312,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124546080,"statfs":{"total":1151940427776,"available":1151535185920,"internally_reserved":0,"allocated":13631488,"data_stored":7434889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":391492924},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":51,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002679"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.230737+0000","last_change":"2024-01-25T14:59:54.219084+0000","last_active":"2024-01-25T15:01:26.230737+0000","last_peered":"2024-01-25T15:01:26.230737+0000","last_clean":"2024-01-25T15:01:26.230737+0000","last_became_active":"2024-01-25T14:59:54.218780+0000","last_became_peered":"2024-01-25T14:59:54.218780+0000","last_unstale":"2024-01-25T15:01:26.230737+0000","last_undegraded":"2024-01-25T15:01:26.230737+0000","last_fullsized":"2024-01-25T15:01:26.230737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:05:50.441934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221600+0000","last_change":"2024-01-25T14:59:54.219130+0000","last_active":"2024-01-25T15:01:26.221600+0000","last_peered":"2024-01-25T15:01:26.221600+0000","last_clean":"2024-01-25T15:01:26.221600+0000","last_became_active":"2024-01-25T14:59:54.218744+0000","last_became_peered":"2024-01-25T14:59:54.218744+0000","last_unstale":"2024-01-25T15:01:26.221600+0000","last_undegraded":"2024-01-25T15:01:26.221600+0000","last_fullsized":"2024-01-25T15:01:26.221600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:59:35.424110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.232001+0000","last_change":"2024-01-25T14:59:54.218870+0000","last_active":"2024-01-25T15:01:26.232001+0000","last_peered":"2024-01-25T15:01:26.232001+0000","last_clean":"2024-01-25T15:01:26.232001+0000","last_became_active":"2024-01-25T14:59:54.218522+0000","last_became_peered":"2024-01-25T14:59:54.218522+0000","last_unstale":"2024-01-25T15:01:26.232001+0000","last_undegraded":"2024-01-25T15:01:26.232001+0000","last_fullsized":"2024-01-25T15:01:26.232001+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:00:05.038437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.217791+0000","last_change":"2024-01-25T14:59:54.218436+0000","last_active":"2024-01-25T15:01:26.217791+0000","last_peered":"2024-01-25T15:01:26.217791+0000","last_clean":"2024-01-25T15:01:26.217791+0000","last_became_active":"2024-01-25T14:59:54.217232+0000","last_became_peered":"2024-01-25T14:59:54.217232+0000","last_unstale":"2024-01-25T15:01:26.217791+0000","last_undegraded":"2024-01-25T15:01:26.217791+0000","last_fullsized":"2024-01-25T15:01:26.217791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:24:14.642794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221036+0000","last_change":"2024-01-25T14:59:54.219094+0000","last_active":"2024-01-25T15:01:26.221036+0000","last_peered":"2024-01-25T15:01:26.221036+0000","last_clean":"2024-01-25T15:01:26.221036+0000","last_became_active":"2024-01-25T14:59:54.218778+0000","last_became_peered":"2024-01-25T14:59:54.218778+0000","last_unstale":"2024-01-25T15:01:26.221036+0000","last_undegraded":"2024-01-25T15:01:26.221036+0000","last_fullsized":"2024-01-25T15:01:26.221036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:21.754098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.220371+0000","last_change":"2024-01-25T14:59:54.213243+0000","last_active":"2024-01-25T15:01:26.220371+0000","last_peered":"2024-01-25T15:01:26.220371+0000","last_clean":"2024-01-25T15:01:26.220371+0000","last_became_active":"2024-01-25T14:59:54.212891+0000","last_became_peered":"2024-01-25T14:59:54.212891+0000","last_unstale":"2024-01-25T15:01:26.220371+0000","last_undegraded":"2024-01-25T15:01:26.220371+0000","last_fullsized":"2024-01-25T15:01:26.220371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:52:45.505016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221723+0000","last_change":"2024-01-25T14:59:54.211851+0000","last_active":"2024-01-25T15:01:26.221723+0000","last_peered":"2024-01-25T15:01:26.221723+0000","last_clean":"2024-01-25T15:01:26.221723+0000","last_became_active":"2024-01-25T14:59:54.211298+0000","last_became_peered":"2024-01-25T14:59:54.211298+0000","last_unstale":"2024-01-25T15:01:26.221723+0000","last_undegraded":"2024-01-25T15:01:26.221723+0000","last_fullsized":"2024-01-25T15:01:26.221723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:05:36.636283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.222334+0000","last_change":"2024-01-25T14:59:54.217675+0000","last_active":"2024-01-25T15:01:26.222334+0000","last_peered":"2024-01-25T15:01:26.222334+0000","last_clean":"2024-01-25T15:01:26.222334+0000","last_became_active":"2024-01-25T14:59:54.217329+0000","last_became_peered":"2024-01-25T14:59:54.217329+0000","last_unstale":"2024-01-25T15:01:26.222334+0000","last_undegraded":"2024-01-25T15:01:26.222334+0000","last_fullsized":"2024-01-25T15:01:26.222334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:32:07.769974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.230192+0000","last_change":"2024-01-25T14:59:54.213030+0000","last_active":"2024-01-25T15:01:26.230192+0000","last_peered":"2024-01-25T15:01:26.230192+0000","last_clean":"2024-01-25T15:01:26.230192+0000","last_became_active":"2024-01-25T14:59:54.212687+0000","last_became_peered":"2024-01-25T14:59:54.212687+0000","last_unstale":"2024-01-25T15:01:26.230192+0000","last_undegraded":"2024-01-25T15:01:26.230192+0000","last_fullsized":"2024-01-25T15:01:26.230192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:47:29.562996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.220569+0000","last_change":"2024-01-25T15:00:57.284759+0000","last_active":"2024-01-25T15:01:26.220569+0000","last_peered":"2024-01-25T15:01:26.220569+0000","last_clean":"2024-01-25T15:01:26.220569+0000","last_became_active":"2024-01-25T15:00:57.284306+0000","last_became_peered":"2024-01-25T15:00:57.284306+0000","last_unstale":"2024-01-25T15:01:26.220569+0000","last_undegraded":"2024-01-25T15:01:26.220569+0000","last_fullsized":"2024-01-25T15:01:26.220569+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:56:49.173903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.231337+0000","last_change":"2024-01-25T14:59:54.216252+0000","last_active":"2024-01-25T15:01:26.231337+0000","last_peered":"2024-01-25T15:01:26.231337+0000","last_clean":"2024-01-25T15:01:26.231337+0000","last_became_active":"2024-01-25T14:59:54.215892+0000","last_became_peered":"2024-01-25T14:59:54.215892+0000","last_unstale":"2024-01-25T15:01:26.231337+0000","last_undegraded":"2024-01-25T15:01:26.231337+0000","last_fullsized":"2024-01-25T15:01:26.231337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:53:27.135926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.215703+0000","last_change":"2024-01-25T14:59:54.221212+0000","last_active":"2024-01-25T15:01:26.215703+0000","last_peered":"2024-01-25T15:01:26.215703+0000","last_clean":"2024-01-25T15:01:26.215703+0000","last_became_active":"2024-01-25T14:59:54.220516+0000","last_became_peered":"2024-01-25T14:59:54.220516+0000","last_unstale":"2024-01-25T15:01:26.215703+0000","last_undegraded":"2024-01-25T15:01:26.215703+0000","last_fullsized":"2024-01-25T15:01:26.215703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:00:57.398457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221443+0000","last_change":"2024-01-25T14:59:54.204088+0000","last_active":"2024-01-25T15:01:26.221443+0000","last_peered":"2024-01-25T15:01:26.221443+0000","last_clean":"2024-01-25T15:01:26.221443+0000","last_became_active":"2024-01-25T14:59:54.202895+0000","last_became_peered":"2024-01-25T14:59:54.202895+0000","last_unstale":"2024-01-25T15:01:26.221443+0000","last_undegraded":"2024-01-25T15:01:26.221443+0000","last_fullsized":"2024-01-25T15:01:26.221443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:15:37.693577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.227904+0000","last_change":"2024-01-25T14:59:54.226108+0000","last_active":"2024-01-25T15:01:26.227904+0000","last_peered":"2024-01-25T15:01:26.227904+0000","last_clean":"2024-01-25T15:01:26.227904+0000","last_became_active":"2024-01-25T14:59:54.225830+0000","last_became_peered":"2024-01-25T14:59:54.225830+0000","last_unstale":"2024-01-25T15:01:26.227904+0000","last_undegraded":"2024-01-25T15:01:26.227904+0000","last_fullsized":"2024-01-25T15:01:26.227904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:10:22.580434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226902+0000","last_change":"2024-01-25T14:59:54.224893+0000","last_active":"2024-01-25T15:01:26.226902+0000","last_peered":"2024-01-25T15:01:26.226902+0000","last_clean":"2024-01-25T15:01:26.226902+0000","last_became_active":"2024-01-25T14:59:54.224583+0000","last_became_peered":"2024-01-25T14:59:54.224583+0000","last_unstale":"2024-01-25T15:01:26.226902+0000","last_undegraded":"2024-01-25T15:01:26.226902+0000","last_fullsized":"2024-01-25T15:01:26.226902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:48:25.538489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.232195+0000","last_change":"2024-01-25T14:59:54.217030+0000","last_active":"2024-01-25T15:01:26.232195+0000","last_peered":"2024-01-25T15:01:26.232195+0000","last_clean":"2024-01-25T15:01:26.232195+0000","last_became_active":"2024-01-25T14:59:54.216732+0000","last_became_peered":"2024-01-25T14:59:54.216732+0000","last_unstale":"2024-01-25T15:01:26.232195+0000","last_undegraded":"2024-01-25T15:01:26.232195+0000","last_fullsized":"2024-01-25T15:01:26.232195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:58:36.072464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.230834+0000","last_change":"2024-01-25T14:59:54.223924+0000","last_active":"2024-01-25T15:01:26.230834+0000","last_peered":"2024-01-25T15:01:26.230834+0000","last_clean":"2024-01-25T15:01:26.230834+0000","last_became_active":"2024-01-25T14:59:54.223556+0000","last_became_peered":"2024-01-25T14:59:54.223556+0000","last_unstale":"2024-01-25T15:01:26.230834+0000","last_undegraded":"2024-01-25T15:01:26.230834+0000","last_fullsized":"2024-01-25T15:01:26.230834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:54:18.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.217329+0000","last_change":"2024-01-25T14:59:54.207125+0000","last_active":"2024-01-25T15:01:26.217329+0000","last_peered":"2024-01-25T15:01:26.217329+0000","last_clean":"2024-01-25T15:01:26.217329+0000","last_became_active":"2024-01-25T14:59:54.206630+0000","last_became_peered":"2024-01-25T14:59:54.206630+0000","last_unstale":"2024-01-25T15:01:26.217329+0000","last_undegraded":"2024-01-25T15:01:26.217329+0000","last_fullsized":"2024-01-25T15:01:26.217329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:10:12.685185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.220361+0000","last_change":"2024-01-25T14:59:54.210732+0000","last_active":"2024-01-25T15:01:26.220361+0000","last_peered":"2024-01-25T15:01:26.220361+0000","last_clean":"2024-01-25T15:01:26.220361+0000","last_became_active":"2024-01-25T14:59:54.210417+0000","last_became_peered":"2024-01-25T14:59:54.210417+0000","last_unstale":"2024-01-25T15:01:26.220361+0000","last_undegraded":"2024-01-25T15:01:26.220361+0000","last_fullsized":"2024-01-25T15:01:26.220361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:05:22.305485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'13","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:46.183148+0000","last_change":"2024-01-25T14:59:53.204680+0000","last_active":"2024-01-25T15:01:46.183148+0000","last_peered":"2024-01-25T15:01:46.183148+0000","last_clean":"2024-01-25T15:01:46.183148+0000","last_became_active":"2024-01-25T14:59:53.204327+0000","last_became_peered":"2024-01-25T14:59:53.204327+0000","last_unstale":"2024-01-25T15:01:46.183148+0000","last_undegraded":"2024-01-25T15:01:46.183148+0000","last_fullsized":"2024-01-25T15:01:46.183148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:32:16.333425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221365+0000","last_change":"2024-01-25T14:59:54.220501+0000","last_active":"2024-01-25T15:01:26.221365+0000","last_peered":"2024-01-25T15:01:26.221365+0000","last_clean":"2024-01-25T15:01:26.221365+0000","last_became_active":"2024-01-25T14:59:54.217150+0000","last_became_peered":"2024-01-25T14:59:54.217150+0000","last_unstale":"2024-01-25T15:01:26.221365+0000","last_undegraded":"2024-01-25T15:01:26.221365+0000","last_fullsized":"2024-01-25T15:01:26.221365+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:16:00.811698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284319+0000","last_change":"2024-01-25T14:59:53.209110+0000","last_active":"2024-01-25T15:00:57.284319+0000","last_peered":"2024-01-25T15:00:57.284319+0000","last_clean":"2024-01-25T15:00:57.284319+0000","last_became_active":"2024-01-25T14:59:53.208794+0000","last_became_peered":"2024-01-25T14:59:53.208794+0000","last_unstale":"2024-01-25T15:00:57.284319+0000","last_undegraded":"2024-01-25T15:00:57.284319+0000","last_fullsized":"2024-01-25T15:00:57.284319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:51:40.757062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.232260+0000","last_change":"2024-01-25T14:59:54.219303+0000","last_active":"2024-01-25T15:01:26.232260+0000","last_peered":"2024-01-25T15:01:26.232260+0000","last_clean":"2024-01-25T15:01:26.232260+0000","last_became_active":"2024-01-25T14:59:54.218814+0000","last_became_peered":"2024-01-25T14:59:54.218814+0000","last_unstale":"2024-01-25T15:01:26.232260+0000","last_undegraded":"2024-01-25T15:01:26.232260+0000","last_fullsized":"2024-01-25T15:01:26.232260+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:54:30.556998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'12","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278661+0000","last_change":"2024-01-25T14:59:53.209770+0000","last_active":"2024-01-25T15:00:57.278661+0000","last_peered":"2024-01-25T15:00:57.278661+0000","last_clean":"2024-01-25T15:00:57.278661+0000","last_became_active":"2024-01-25T14:59:53.209466+0000","last_became_peered":"2024-01-25T14:59:53.209466+0000","last_unstale":"2024-01-25T15:00:57.278661+0000","last_undegraded":"2024-01-25T15:00:57.278661+0000","last_fullsized":"2024-01-25T15:00:57.278661+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:58:11.391155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.230793+0000","last_change":"2024-01-25T14:59:54.201559+0000","last_active":"2024-01-25T15:01:26.230793+0000","last_peered":"2024-01-25T15:01:26.230793+0000","last_clean":"2024-01-25T15:01:26.230793+0000","last_became_active":"2024-01-25T14:59:54.201155+0000","last_became_peered":"2024-01-25T14:59:54.201155+0000","last_unstale":"2024-01-25T15:01:26.230793+0000","last_undegraded":"2024-01-25T15:01:26.230793+0000","last_fullsized":"2024-01-25T15:01:26.230793+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:29:15.444879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278742+0000","last_change":"2024-01-25T14:59:53.208457+0000","last_active":"2024-01-25T15:00:57.278742+0000","last_peered":"2024-01-25T15:00:57.278742+0000","last_clean":"2024-01-25T15:00:57.278742+0000","last_became_active":"2024-01-25T14:59:53.208166+0000","last_became_peered":"2024-01-25T14:59:53.208166+0000","last_unstale":"2024-01-25T15:00:57.278742+0000","last_undegraded":"2024-01-25T15:00:57.278742+0000","last_fullsized":"2024-01-25T15:00:57.278742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:29:22.580726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.228568+0000","last_change":"2024-01-25T14:59:54.212126+0000","last_active":"2024-01-25T15:01:26.228568+0000","last_peered":"2024-01-25T15:01:26.228568+0000","last_clean":"2024-01-25T15:01:26.228568+0000","last_became_active":"2024-01-25T14:59:54.211519+0000","last_became_peered":"2024-01-25T14:59:54.211519+0000","last_unstale":"2024-01-25T15:01:26.228568+0000","last_undegraded":"2024-01-25T15:01:26.228568+0000","last_fullsized":"2024-01-25T15:01:26.228568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:50:59.743852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"87'7","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:47.195469+0000","last_change":"2024-01-25T14:59:53.201803+0000","last_active":"2024-01-25T15:01:47.195469+0000","last_peered":"2024-01-25T15:01:47.195469+0000","last_clean":"2024-01-25T15:01:47.195469+0000","last_became_active":"2024-01-25T14:59:53.201464+0000","last_became_peered":"2024-01-25T14:59:53.201464+0000","last_unstale":"2024-01-25T15:01:47.195469+0000","last_undegraded":"2024-01-25T15:01:47.195469+0000","last_fullsized":"2024-01-25T15:01:47.195469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:36:03.922038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.227153+0000","last_change":"2024-01-25T14:59:54.207126+0000","last_active":"2024-01-25T15:01:26.227153+0000","last_peered":"2024-01-25T15:01:26.227153+0000","last_clean":"2024-01-25T15:01:26.227153+0000","last_became_active":"2024-01-25T14:59:54.206826+0000","last_became_peered":"2024-01-25T14:59:54.206826+0000","last_unstale":"2024-01-25T15:01:26.227153+0000","last_undegraded":"2024-01-25T15:01:26.227153+0000","last_fullsized":"2024-01-25T15:01:26.227153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:45:07.217919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281277+0000","last_change":"2024-01-25T14:59:53.200335+0000","last_active":"2024-01-25T15:00:57.281277+0000","last_peered":"2024-01-25T15:00:57.281277+0000","last_clean":"2024-01-25T15:00:57.281277+0000","last_became_active":"2024-01-25T14:59:53.200028+0000","last_became_peered":"2024-01-25T14:59:53.200028+0000","last_unstale":"2024-01-25T15:00:57.281277+0000","last_undegraded":"2024-01-25T15:00:57.281277+0000","last_fullsized":"2024-01-25T15:00:57.281277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:23:26.178260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.219277+0000","last_change":"2024-01-25T14:59:54.211048+0000","last_active":"2024-01-25T15:01:26.219277+0000","last_peered":"2024-01-25T15:01:26.219277+0000","last_clean":"2024-01-25T15:01:26.219277+0000","last_became_active":"2024-01-25T14:59:54.210724+0000","last_became_peered":"2024-01-25T14:59:54.210724+0000","last_unstale":"2024-01-25T15:01:26.219277+0000","last_undegraded":"2024-01-25T15:01:26.219277+0000","last_fullsized":"2024-01-25T15:01:26.219277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:59:40.171707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279454+0000","last_change":"2024-01-25T14:59:53.202235+0000","last_active":"2024-01-25T15:00:57.279454+0000","last_peered":"2024-01-25T15:00:57.279454+0000","last_clean":"2024-01-25T15:00:57.279454+0000","last_became_active":"2024-01-25T14:59:53.201933+0000","last_became_peered":"2024-01-25T14:59:53.201933+0000","last_unstale":"2024-01-25T15:00:57.279454+0000","last_undegraded":"2024-01-25T15:00:57.279454+0000","last_fullsized":"2024-01-25T15:00:57.279454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:40:23.725903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.220083+0000","last_change":"2024-01-25T14:59:54.205184+0000","last_active":"2024-01-25T15:01:26.220083+0000","last_peered":"2024-01-25T15:01:26.220083+0000","last_clean":"2024-01-25T15:01:26.220083+0000","last_became_active":"2024-01-25T14:59:54.204865+0000","last_became_peered":"2024-01-25T14:59:54.204865+0000","last_unstale":"2024-01-25T15:01:26.220083+0000","last_undegraded":"2024-01-25T15:01:26.220083+0000","last_fullsized":"2024-01-25T15:01:26.220083+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:07:25.559601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283603+0000","last_change":"2024-01-25T14:59:53.205021+0000","last_active":"2024-01-25T15:00:57.283603+0000","last_peered":"2024-01-25T15:00:57.283603+0000","last_clean":"2024-01-25T15:00:57.283603+0000","last_became_active":"2024-01-25T14:59:53.203925+0000","last_became_peered":"2024-01-25T14:59:53.203925+0000","last_unstale":"2024-01-25T15:00:57.283603+0000","last_undegraded":"2024-01-25T15:00:57.283603+0000","last_fullsized":"2024-01-25T15:00:57.283603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:20:43.003659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.218984+0000","last_change":"2024-01-25T14:59:54.207234+0000","last_active":"2024-01-25T15:01:26.218984+0000","last_peered":"2024-01-25T15:01:26.218984+0000","last_clean":"2024-01-25T15:01:26.218984+0000","last_became_active":"2024-01-25T14:59:54.206727+0000","last_became_peered":"2024-01-25T14:59:54.206727+0000","last_unstale":"2024-01-25T15:01:26.218984+0000","last_undegraded":"2024-01-25T15:01:26.218984+0000","last_fullsized":"2024-01-25T15:01:26.218984+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:29:08.678821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'5","reported_seq":242,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:47.194624+0000","last_change":"2024-01-25T14:59:53.204198+0000","last_active":"2024-01-25T15:01:47.194624+0000","last_peered":"2024-01-25T15:01:47.194624+0000","last_clean":"2024-01-25T15:01:47.194624+0000","last_became_active":"2024-01-25T14:59:53.203844+0000","last_became_peered":"2024-01-25T14:59:53.203844+0000","last_unstale":"2024-01-25T15:01:47.194624+0000","last_undegraded":"2024-01-25T15:01:47.194624+0000","last_fullsized":"2024-01-25T15:01:47.194624+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:30:23.735236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":218,"num_read_kb":218,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226081+0000","last_change":"2024-01-25T14:59:54.203318+0000","last_active":"2024-01-25T15:01:26.226081+0000","last_peered":"2024-01-25T15:01:26.226081+0000","last_clean":"2024-01-25T15:01:26.226081+0000","last_became_active":"2024-01-25T14:59:54.202971+0000","last_became_peered":"2024-01-25T14:59:54.202971+0000","last_unstale":"2024-01-25T15:01:26.226081+0000","last_undegraded":"2024-01-25T15:01:26.226081+0000","last_fullsized":"2024-01-25T15:01:26.226081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:57:59.454857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.300726+0000","last_change":"2024-01-25T15:00:57.300726+0000","last_active":"2024-01-25T15:00:57.300726+0000","last_peered":"2024-01-25T15:00:57.300726+0000","last_clean":"2024-01-25T15:00:57.300726+0000","last_became_active":"2024-01-25T15:00:57.288184+0000","last_became_peered":"2024-01-25T15:00:57.288184+0000","last_unstale":"2024-01-25T15:00:57.300726+0000","last_undegraded":"2024-01-25T15:00:57.300726+0000","last_fullsized":"2024-01-25T15:00:57.300726+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:17:00.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226739+0000","last_change":"2024-01-25T14:59:54.225131+0000","last_active":"2024-01-25T15:01:26.226739+0000","last_peered":"2024-01-25T15:01:26.226739+0000","last_clean":"2024-01-25T15:01:26.226739+0000","last_became_active":"2024-01-25T14:59:54.224786+0000","last_became_peered":"2024-01-25T14:59:54.224786+0000","last_unstale":"2024-01-25T15:01:26.226739+0000","last_undegraded":"2024-01-25T15:01:26.226739+0000","last_fullsized":"2024-01-25T15:01:26.226739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:25:07.426433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283977+0000","last_change":"2024-01-25T14:59:53.199834+0000","last_active":"2024-01-25T15:00:57.283977+0000","last_peered":"2024-01-25T15:00:57.283977+0000","last_clean":"2024-01-25T15:00:57.283977+0000","last_became_active":"2024-01-25T14:59:53.199545+0000","last_became_peered":"2024-01-25T14:59:53.199545+0000","last_unstale":"2024-01-25T15:00:57.283977+0000","last_undegraded":"2024-01-25T15:00:57.283977+0000","last_fullsized":"2024-01-25T15:00:57.283977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:38:08.973583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.232212+0000","last_change":"2024-01-25T14:59:54.214768+0000","last_active":"2024-01-25T15:01:26.232212+0000","last_peered":"2024-01-25T15:01:26.232212+0000","last_clean":"2024-01-25T15:01:26.232212+0000","last_became_active":"2024-01-25T14:59:54.214038+0000","last_became_peered":"2024-01-25T14:59:54.214038+0000","last_unstale":"2024-01-25T15:01:26.232212+0000","last_undegraded":"2024-01-25T15:01:26.232212+0000","last_fullsized":"2024-01-25T15:01:26.232212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:10:20.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'32","reported_seq":300,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:47.365698+0000","last_change":"2024-01-25T15:00:57.297320+0000","last_active":"2024-01-25T15:01:47.365698+0000","last_peered":"2024-01-25T15:01:47.365698+0000","last_clean":"2024-01-25T15:01:47.365698+0000","last_became_active":"2024-01-25T15:00:57.287208+0000","last_became_peered":"2024-01-25T15:00:57.287208+0000","last_unstale":"2024-01-25T15:01:47.365698+0000","last_undegraded":"2024-01-25T15:01:47.365698+0000","last_fullsized":"2024-01-25T15:01:47.365698+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:36:17.161523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58580,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":215,"num_read_kb":164,"num_write":34,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":58331,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.225776+0000","last_change":"2024-01-25T14:59:54.217069+0000","last_active":"2024-01-25T15:01:26.225776+0000","last_peered":"2024-01-25T15:01:26.225776+0000","last_clean":"2024-01-25T15:01:26.225776+0000","last_became_active":"2024-01-25T14:59:54.216749+0000","last_became_peered":"2024-01-25T14:59:54.216749+0000","last_unstale":"2024-01-25T15:01:26.225776+0000","last_undegraded":"2024-01-25T15:01:26.225776+0000","last_fullsized":"2024-01-25T15:01:26.225776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:31:00.903462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282050+0000","last_change":"2024-01-25T14:59:53.198852+0000","last_active":"2024-01-25T15:00:57.282050+0000","last_peered":"2024-01-25T15:00:57.282050+0000","last_clean":"2024-01-25T15:00:57.282050+0000","last_became_active":"2024-01-25T14:59:53.198532+0000","last_became_peered":"2024-01-25T14:59:53.198532+0000","last_unstale":"2024-01-25T15:00:57.282050+0000","last_undegraded":"2024-01-25T15:00:57.282050+0000","last_fullsized":"2024-01-25T15:00:57.282050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:03:43.251730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.217159+0000","last_change":"2024-01-25T14:59:54.209865+0000","last_active":"2024-01-25T15:01:26.217159+0000","last_peered":"2024-01-25T15:01:26.217159+0000","last_clean":"2024-01-25T15:01:26.217159+0000","last_became_active":"2024-01-25T14:59:54.209564+0000","last_became_peered":"2024-01-25T14:59:54.209564+0000","last_unstale":"2024-01-25T15:01:26.217159+0000","last_undegraded":"2024-01-25T15:01:26.217159+0000","last_fullsized":"2024-01-25T15:01:26.217159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:19:24.461651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283550+0000","last_change":"2024-01-25T14:59:53.207644+0000","last_active":"2024-01-25T15:00:57.283550+0000","last_peered":"2024-01-25T15:00:57.283550+0000","last_clean":"2024-01-25T15:00:57.283550+0000","last_became_active":"2024-01-25T14:59:53.207321+0000","last_became_peered":"2024-01-25T14:59:53.207321+0000","last_unstale":"2024-01-25T15:00:57.283550+0000","last_undegraded":"2024-01-25T15:00:57.283550+0000","last_fullsized":"2024-01-25T15:00:57.283550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:47:12.131711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.224293+0000","last_change":"2024-01-25T14:59:54.220548+0000","last_active":"2024-01-25T15:01:26.224293+0000","last_peered":"2024-01-25T15:01:26.224293+0000","last_clean":"2024-01-25T15:01:26.224293+0000","last_became_active":"2024-01-25T14:59:54.219743+0000","last_became_peered":"2024-01-25T14:59:54.219743+0000","last_unstale":"2024-01-25T15:01:26.224293+0000","last_undegraded":"2024-01-25T15:01:26.224293+0000","last_fullsized":"2024-01-25T15:01:26.224293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:46:12.085591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:50.189040+0000","last_change":"2024-01-25T14:59:53.201233+0000","last_active":"2024-01-25T15:01:50.189040+0000","last_peered":"2024-01-25T15:01:50.189040+0000","last_clean":"2024-01-25T15:01:50.189040+0000","last_became_active":"2024-01-25T14:59:53.200907+0000","last_became_peered":"2024-01-25T14:59:53.200907+0000","last_unstale":"2024-01-25T15:01:50.189040+0000","last_undegraded":"2024-01-25T15:01:50.189040+0000","last_fullsized":"2024-01-25T15:01:50.189040+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:30:59.640179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221042+0000","last_change":"2024-01-25T14:59:54.212617+0000","last_active":"2024-01-25T15:01:26.221042+0000","last_peered":"2024-01-25T15:01:26.221042+0000","last_clean":"2024-01-25T15:01:26.221042+0000","last_became_active":"2024-01-25T14:59:54.212328+0000","last_became_peered":"2024-01-25T14:59:54.212328+0000","last_unstale":"2024-01-25T15:01:26.221042+0000","last_undegraded":"2024-01-25T15:01:26.221042+0000","last_fullsized":"2024-01-25T15:01:26.221042+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:21:16.958894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278147+0000","last_change":"2024-01-25T14:59:53.202685+0000","last_active":"2024-01-25T15:00:57.278147+0000","last_peered":"2024-01-25T15:00:57.278147+0000","last_clean":"2024-01-25T15:00:57.278147+0000","last_became_active":"2024-01-25T14:59:53.201529+0000","last_became_peered":"2024-01-25T14:59:53.201529+0000","last_unstale":"2024-01-25T15:00:57.278147+0000","last_undegraded":"2024-01-25T15:00:57.278147+0000","last_fullsized":"2024-01-25T15:00:57.278147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:43:29.823959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.223899+0000","last_change":"2024-01-25T14:59:54.208724+0000","last_active":"2024-01-25T15:01:26.223899+0000","last_peered":"2024-01-25T15:01:26.223899+0000","last_clean":"2024-01-25T15:01:26.223899+0000","last_became_active":"2024-01-25T14:59:54.208392+0000","last_became_peered":"2024-01-25T14:59:54.208392+0000","last_unstale":"2024-01-25T15:01:26.223899+0000","last_undegraded":"2024-01-25T15:01:26.223899+0000","last_fullsized":"2024-01-25T15:01:26.223899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:37.285702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.291362+0000","last_change":"2024-01-25T15:00:57.290806+0000","last_active":"2024-01-25T15:00:57.291362+0000","last_peered":"2024-01-25T15:00:57.291362+0000","last_clean":"2024-01-25T15:00:57.291362+0000","last_became_active":"2024-01-25T15:00:57.285194+0000","last_became_peered":"2024-01-25T15:00:57.285194+0000","last_unstale":"2024-01-25T15:00:57.291362+0000","last_undegraded":"2024-01-25T15:00:57.291362+0000","last_fullsized":"2024-01-25T15:00:57.291362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:49:16.627616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.224447+0000","last_change":"2024-01-25T14:59:54.216918+0000","last_active":"2024-01-25T15:01:26.224447+0000","last_peered":"2024-01-25T15:01:26.224447+0000","last_clean":"2024-01-25T15:01:26.224447+0000","last_became_active":"2024-01-25T14:59:54.216283+0000","last_became_peered":"2024-01-25T14:59:54.216283+0000","last_unstale":"2024-01-25T15:01:26.224447+0000","last_undegraded":"2024-01-25T15:01:26.224447+0000","last_fullsized":"2024-01-25T15:01:26.224447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:15:11.192764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280876+0000","last_change":"2024-01-25T14:59:53.207266+0000","last_active":"2024-01-25T15:00:57.280876+0000","last_peered":"2024-01-25T15:00:57.280876+0000","last_clean":"2024-01-25T15:00:57.280876+0000","last_became_active":"2024-01-25T14:59:53.206820+0000","last_became_peered":"2024-01-25T14:59:53.206820+0000","last_unstale":"2024-01-25T15:00:57.280876+0000","last_undegraded":"2024-01-25T15:00:57.280876+0000","last_fullsized":"2024-01-25T15:00:57.280876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:29:02.371577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.215941+0000","last_change":"2024-01-25T14:59:54.210434+0000","last_active":"2024-01-25T15:01:26.215941+0000","last_peered":"2024-01-25T15:01:26.215941+0000","last_clean":"2024-01-25T15:01:26.215941+0000","last_became_active":"2024-01-25T14:59:54.210100+0000","last_became_peered":"2024-01-25T14:59:54.210100+0000","last_unstale":"2024-01-25T15:01:26.215941+0000","last_undegraded":"2024-01-25T15:01:26.215941+0000","last_fullsized":"2024-01-25T15:01:26.215941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:48:21.463712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":135,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:48.186230+0000","last_change":"2024-01-25T14:59:53.202938+0000","last_active":"2024-01-25T15:01:48.186230+0000","last_peered":"2024-01-25T15:01:48.186230+0000","last_clean":"2024-01-25T15:01:48.186230+0000","last_became_active":"2024-01-25T14:59:53.202638+0000","last_became_peered":"2024-01-25T14:59:53.202638+0000","last_unstale":"2024-01-25T15:01:48.186230+0000","last_undegraded":"2024-01-25T15:01:48.186230+0000","last_fullsized":"2024-01-25T15:01:48.186230+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.371375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.202039+0000","last_change":"2024-01-25T14:59:54.219778+0000","last_active":"2024-01-25T15:01:26.202039+0000","last_peered":"2024-01-25T15:01:26.202039+0000","last_clean":"2024-01-25T15:01:26.202039+0000","last_became_active":"2024-01-25T14:59:54.219385+0000","last_became_peered":"2024-01-25T14:59:54.219385+0000","last_unstale":"2024-01-25T15:01:26.202039+0000","last_undegraded":"2024-01-25T15:01:26.202039+0000","last_fullsized":"2024-01-25T15:01:26.202039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:49:27.929024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.224210+0000","last_change":"2024-01-25T14:59:54.209306+0000","last_active":"2024-01-25T15:01:26.224210+0000","last_peered":"2024-01-25T15:01:26.224210+0000","last_clean":"2024-01-25T15:01:26.224210+0000","last_became_active":"2024-01-25T14:59:54.208979+0000","last_became_peered":"2024-01-25T14:59:54.208979+0000","last_unstale":"2024-01-25T15:01:26.224210+0000","last_undegraded":"2024-01-25T15:01:26.224210+0000","last_fullsized":"2024-01-25T15:01:26.224210+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:23:46.763358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":136,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:47.184825+0000","last_change":"2024-01-25T14:59:53.200590+0000","last_active":"2024-01-25T15:01:47.184825+0000","last_peered":"2024-01-25T15:01:47.184825+0000","last_clean":"2024-01-25T15:01:47.184825+0000","last_became_active":"2024-01-25T14:59:53.200292+0000","last_became_peered":"2024-01-25T14:59:53.200292+0000","last_unstale":"2024-01-25T15:01:47.184825+0000","last_undegraded":"2024-01-25T15:01:47.184825+0000","last_fullsized":"2024-01-25T15:01:47.184825+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:02:05.135314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.222120+0000","last_change":"2024-01-25T14:59:54.217765+0000","last_active":"2024-01-25T15:01:26.222120+0000","last_peered":"2024-01-25T15:01:26.222120+0000","last_clean":"2024-01-25T15:01:26.222120+0000","last_became_active":"2024-01-25T14:59:54.217433+0000","last_became_peered":"2024-01-25T14:59:54.217433+0000","last_unstale":"2024-01-25T15:01:26.222120+0000","last_undegraded":"2024-01-25T15:01:26.222120+0000","last_fullsized":"2024-01-25T15:01:26.222120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:45:25.520091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279378+0000","last_change":"2024-01-25T14:59:53.197543+0000","last_active":"2024-01-25T15:00:57.279378+0000","last_peered":"2024-01-25T15:00:57.279378+0000","last_clean":"2024-01-25T15:00:57.279378+0000","last_became_active":"2024-01-25T14:59:53.197213+0000","last_became_peered":"2024-01-25T14:59:53.197213+0000","last_unstale":"2024-01-25T15:00:57.279378+0000","last_undegraded":"2024-01-25T15:00:57.279378+0000","last_fullsized":"2024-01-25T15:00:57.279378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:19:39.477948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282381+0000","last_change":"2024-01-25T14:58:41.034413+0000","last_active":"2024-01-25T15:00:57.282381+0000","last_peered":"2024-01-25T15:00:57.282381+0000","last_clean":"2024-01-25T15:00:57.282381+0000","last_became_active":"2024-01-25T14:58:41.033881+0000","last_became_peered":"2024-01-25T14:58:41.033881+0000","last_unstale":"2024-01-25T15:00:57.282381+0000","last_undegraded":"2024-01-25T15:00:57.282381+0000","last_fullsized":"2024-01-25T15:00:57.282381+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:55:22.974068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:55:22.974068+0000","last_clean_scrub_stamp":"2024-01-25T14:55:22.974068+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:05:30.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221753+0000","last_change":"2024-01-25T14:59:54.214713+0000","last_active":"2024-01-25T15:01:26.221753+0000","last_peered":"2024-01-25T15:01:26.221753+0000","last_clean":"2024-01-25T15:01:26.221753+0000","last_became_active":"2024-01-25T14:59:54.214348+0000","last_became_peered":"2024-01-25T14:59:54.214348+0000","last_unstale":"2024-01-25T15:01:26.221753+0000","last_undegraded":"2024-01-25T15:01:26.221753+0000","last_fullsized":"2024-01-25T15:01:26.221753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:11:46.134755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282443+0000","last_change":"2024-01-25T14:59:53.202970+0000","last_active":"2024-01-25T15:00:57.282443+0000","last_peered":"2024-01-25T15:00:57.282443+0000","last_clean":"2024-01-25T15:00:57.282443+0000","last_became_active":"2024-01-25T14:59:53.202680+0000","last_became_peered":"2024-01-25T14:59:53.202680+0000","last_unstale":"2024-01-25T15:00:57.282443+0000","last_undegraded":"2024-01-25T15:00:57.282443+0000","last_fullsized":"2024-01-25T15:00:57.282443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:28:12.628390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278506+0000","last_change":"2024-01-25T14:59:53.210040+0000","last_active":"2024-01-25T15:00:57.278506+0000","last_peered":"2024-01-25T15:00:57.278506+0000","last_clean":"2024-01-25T15:00:57.278506+0000","last_became_active":"2024-01-25T14:59:53.209636+0000","last_became_peered":"2024-01-25T14:59:53.209636+0000","last_unstale":"2024-01-25T15:00:57.278506+0000","last_undegraded":"2024-01-25T15:00:57.278506+0000","last_fullsized":"2024-01-25T15:00:57.278506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:22:45.268969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.211212+0000","last_change":"2024-01-25T14:59:54.203875+0000","last_active":"2024-01-25T15:01:26.211212+0000","last_peered":"2024-01-25T15:01:26.211212+0000","last_clean":"2024-01-25T15:01:26.211212+0000","last_became_active":"2024-01-25T14:59:54.203573+0000","last_became_peered":"2024-01-25T14:59:54.203573+0000","last_unstale":"2024-01-25T15:01:26.211212+0000","last_undegraded":"2024-01-25T15:01:26.211212+0000","last_fullsized":"2024-01-25T15:01:26.211212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:16:33.124186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'11","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.292768+0000","last_change":"2024-01-25T15:00:57.292346+0000","last_active":"2024-01-25T15:00:57.292768+0000","last_peered":"2024-01-25T15:00:57.292768+0000","last_clean":"2024-01-25T15:00:57.292768+0000","last_became_active":"2024-01-25T15:00:57.284921+0000","last_became_peered":"2024-01-25T15:00:57.284921+0000","last_unstale":"2024-01-25T15:00:57.292768+0000","last_undegraded":"2024-01-25T15:00:57.292768+0000","last_fullsized":"2024-01-25T15:00:57.292768+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:35:09.229129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.222766+0000","last_change":"2024-01-25T14:59:54.212444+0000","last_active":"2024-01-25T15:01:26.222766+0000","last_peered":"2024-01-25T15:01:26.222766+0000","last_clean":"2024-01-25T15:01:26.222766+0000","last_became_active":"2024-01-25T14:59:54.212090+0000","last_became_peered":"2024-01-25T14:59:54.212090+0000","last_unstale":"2024-01-25T15:01:26.222766+0000","last_undegraded":"2024-01-25T15:01:26.222766+0000","last_fullsized":"2024-01-25T15:01:26.222766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:27:26.416373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279589+0000","last_change":"2024-01-25T14:59:53.199984+0000","last_active":"2024-01-25T15:00:57.279589+0000","last_peered":"2024-01-25T15:00:57.279589+0000","last_clean":"2024-01-25T15:00:57.279589+0000","last_became_active":"2024-01-25T14:59:53.199674+0000","last_became_peered":"2024-01-25T14:59:53.199674+0000","last_unstale":"2024-01-25T15:00:57.279589+0000","last_undegraded":"2024-01-25T15:00:57.279589+0000","last_fullsized":"2024-01-25T15:00:57.279589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:22:01.521516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.228496+0000","last_change":"2024-01-25T14:59:54.224285+0000","last_active":"2024-01-25T15:01:26.228496+0000","last_peered":"2024-01-25T15:01:26.228496+0000","last_clean":"2024-01-25T15:01:26.228496+0000","last_became_active":"2024-01-25T14:59:54.223904+0000","last_became_peered":"2024-01-25T14:59:54.223904+0000","last_unstale":"2024-01-25T15:01:26.228496+0000","last_undegraded":"2024-01-25T15:01:26.228496+0000","last_fullsized":"2024-01-25T15:01:26.228496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:49:24.717733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284549+0000","last_change":"2024-01-25T14:59:53.203501+0000","last_active":"2024-01-25T15:00:57.284549+0000","last_peered":"2024-01-25T15:00:57.284549+0000","last_clean":"2024-01-25T15:00:57.284549+0000","last_became_active":"2024-01-25T14:59:53.203215+0000","last_became_peered":"2024-01-25T14:59:53.203215+0000","last_unstale":"2024-01-25T15:00:57.284549+0000","last_undegraded":"2024-01-25T15:00:57.284549+0000","last_fullsized":"2024-01-25T15:00:57.284549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:18:25.174639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.185770+0000","last_change":"2024-01-25T14:59:54.219575+0000","last_active":"2024-01-25T15:01:26.185770+0000","last_peered":"2024-01-25T15:01:26.185770+0000","last_clean":"2024-01-25T15:01:26.185770+0000","last_became_active":"2024-01-25T14:59:54.219170+0000","last_became_peered":"2024-01-25T14:59:54.219170+0000","last_unstale":"2024-01-25T15:01:26.185770+0000","last_undegraded":"2024-01-25T15:01:26.185770+0000","last_fullsized":"2024-01-25T15:01:26.185770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:41.940927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283084+0000","last_change":"2024-01-25T14:59:53.203864+0000","last_active":"2024-01-25T15:00:57.283084+0000","last_peered":"2024-01-25T15:00:57.283084+0000","last_clean":"2024-01-25T15:00:57.283084+0000","last_became_active":"2024-01-25T14:59:53.203564+0000","last_became_peered":"2024-01-25T14:59:53.203564+0000","last_unstale":"2024-01-25T15:00:57.283084+0000","last_undegraded":"2024-01-25T15:00:57.283084+0000","last_fullsized":"2024-01-25T15:00:57.283084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:03:21.776910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226178+0000","last_change":"2024-01-25T14:59:54.217014+0000","last_active":"2024-01-25T15:01:26.226178+0000","last_peered":"2024-01-25T15:01:26.226178+0000","last_clean":"2024-01-25T15:01:26.226178+0000","last_became_active":"2024-01-25T14:59:54.216673+0000","last_became_peered":"2024-01-25T14:59:54.216673+0000","last_unstale":"2024-01-25T15:01:26.226178+0000","last_undegraded":"2024-01-25T15:01:26.226178+0000","last_fullsized":"2024-01-25T15:01:26.226178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:46:31.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281990+0000","last_change":"2024-01-25T14:59:53.207297+0000","last_active":"2024-01-25T15:00:57.281990+0000","last_peered":"2024-01-25T15:00:57.281990+0000","last_clean":"2024-01-25T15:00:57.281990+0000","last_became_active":"2024-01-25T14:59:53.206968+0000","last_became_peered":"2024-01-25T14:59:53.206968+0000","last_unstale":"2024-01-25T15:00:57.281990+0000","last_undegraded":"2024-01-25T15:00:57.281990+0000","last_fullsized":"2024-01-25T15:00:57.281990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:01.679360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.225254+0000","last_change":"2024-01-25T14:59:54.218890+0000","last_active":"2024-01-25T15:01:26.225254+0000","last_peered":"2024-01-25T15:01:26.225254+0000","last_clean":"2024-01-25T15:01:26.225254+0000","last_became_active":"2024-01-25T14:59:54.218581+0000","last_became_peered":"2024-01-25T14:59:54.218581+0000","last_unstale":"2024-01-25T15:01:26.225254+0000","last_undegraded":"2024-01-25T15:01:26.225254+0000","last_fullsized":"2024-01-25T15:01:26.225254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:13:07.383270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278450+0000","last_change":"2024-01-25T14:59:53.208219+0000","last_active":"2024-01-25T15:00:57.278450+0000","last_peered":"2024-01-25T15:00:57.278450+0000","last_clean":"2024-01-25T15:00:57.278450+0000","last_became_active":"2024-01-25T14:59:53.207878+0000","last_became_peered":"2024-01-25T14:59:53.207878+0000","last_unstale":"2024-01-25T15:00:57.278450+0000","last_undegraded":"2024-01-25T15:00:57.278450+0000","last_fullsized":"2024-01-25T15:00:57.278450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:03.410383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.230836+0000","last_change":"2024-01-25T14:59:54.208996+0000","last_active":"2024-01-25T15:01:26.230836+0000","last_peered":"2024-01-25T15:01:26.230836+0000","last_clean":"2024-01-25T15:01:26.230836+0000","last_became_active":"2024-01-25T14:59:54.208658+0000","last_became_peered":"2024-01-25T14:59:54.208658+0000","last_unstale":"2024-01-25T15:01:26.230836+0000","last_undegraded":"2024-01-25T15:01:26.230836+0000","last_fullsized":"2024-01-25T15:01:26.230836+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:39:57.752381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'6","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:50.200224+0000","last_change":"2024-01-25T14:59:53.207106+0000","last_active":"2024-01-25T15:01:50.200224+0000","last_peered":"2024-01-25T15:01:50.200224+0000","last_clean":"2024-01-25T15:01:50.200224+0000","last_became_active":"2024-01-25T14:59:53.206688+0000","last_became_peered":"2024-01-25T14:59:53.206688+0000","last_unstale":"2024-01-25T15:01:50.200224+0000","last_undegraded":"2024-01-25T15:01:50.200224+0000","last_fullsized":"2024-01-25T15:01:50.200224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:30:03.019791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1478,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.231461+0000","last_change":"2024-01-25T14:59:54.208994+0000","last_active":"2024-01-25T15:01:26.231461+0000","last_peered":"2024-01-25T15:01:26.231461+0000","last_clean":"2024-01-25T15:01:26.231461+0000","last_became_active":"2024-01-25T14:59:54.208638+0000","last_became_peered":"2024-01-25T14:59:54.208638+0000","last_unstale":"2024-01-25T15:01:26.231461+0000","last_undegraded":"2024-01-25T15:01:26.231461+0000","last_fullsized":"2024-01-25T15:01:26.231461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:56.001501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283687+0000","last_change":"2024-01-25T14:59:53.207659+0000","last_active":"2024-01-25T15:00:57.283687+0000","last_peered":"2024-01-25T15:00:57.283687+0000","last_clean":"2024-01-25T15:00:57.283687+0000","last_became_active":"2024-01-25T14:59:53.207373+0000","last_became_peered":"2024-01-25T14:59:53.207373+0000","last_unstale":"2024-01-25T15:00:57.283687+0000","last_undegraded":"2024-01-25T15:00:57.283687+0000","last_fullsized":"2024-01-25T15:00:57.283687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:02:18.884192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.219871+0000","last_change":"2024-01-25T14:59:54.210415+0000","last_active":"2024-01-25T15:01:26.219871+0000","last_peered":"2024-01-25T15:01:26.219871+0000","last_clean":"2024-01-25T15:01:26.219871+0000","last_became_active":"2024-01-25T14:59:54.210097+0000","last_became_peered":"2024-01-25T14:59:54.210097+0000","last_unstale":"2024-01-25T15:01:26.219871+0000","last_undegraded":"2024-01-25T15:01:26.219871+0000","last_fullsized":"2024-01-25T15:01:26.219871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:43:18.764375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279899+0000","last_change":"2024-01-25T14:59:53.203526+0000","last_active":"2024-01-25T15:00:57.279899+0000","last_peered":"2024-01-25T15:00:57.279899+0000","last_clean":"2024-01-25T15:00:57.279899+0000","last_became_active":"2024-01-25T14:59:53.203223+0000","last_became_peered":"2024-01-25T14:59:53.203223+0000","last_unstale":"2024-01-25T15:00:57.279899+0000","last_undegraded":"2024-01-25T15:00:57.279899+0000","last_fullsized":"2024-01-25T15:00:57.279899+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:35:06.014547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226672+0000","last_change":"2024-01-25T14:59:54.219053+0000","last_active":"2024-01-25T15:01:26.226672+0000","last_peered":"2024-01-25T15:01:26.226672+0000","last_clean":"2024-01-25T15:01:26.226672+0000","last_became_active":"2024-01-25T14:59:54.218733+0000","last_became_peered":"2024-01-25T14:59:54.218733+0000","last_unstale":"2024-01-25T15:01:26.226672+0000","last_undegraded":"2024-01-25T15:01:26.226672+0000","last_fullsized":"2024-01-25T15:01:26.226672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:07:19.083352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.225238+0000","last_change":"2024-01-25T14:59:54.210644+0000","last_active":"2024-01-25T15:01:26.225238+0000","last_peered":"2024-01-25T15:01:26.225238+0000","last_clean":"2024-01-25T15:01:26.225238+0000","last_became_active":"2024-01-25T14:59:54.210333+0000","last_became_peered":"2024-01-25T14:59:54.210333+0000","last_unstale":"2024-01-25T15:01:26.225238+0000","last_undegraded":"2024-01-25T15:01:26.225238+0000","last_fullsized":"2024-01-25T15:01:26.225238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:25:06.201952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.216766+0000","last_change":"2024-01-25T15:00:57.286523+0000","last_active":"2024-01-25T15:01:26.216766+0000","last_peered":"2024-01-25T15:01:26.216766+0000","last_clean":"2024-01-25T15:01:26.216766+0000","last_became_active":"2024-01-25T15:00:57.286115+0000","last_became_peered":"2024-01-25T15:00:57.286115+0000","last_unstale":"2024-01-25T15:01:26.216766+0000","last_undegraded":"2024-01-25T15:01:26.216766+0000","last_fullsized":"2024-01-25T15:01:26.216766+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:53:47.571571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.200328+0000","last_change":"2024-01-25T14:59:54.218260+0000","last_active":"2024-01-25T15:01:26.200328+0000","last_peered":"2024-01-25T15:01:26.200328+0000","last_clean":"2024-01-25T15:01:26.200328+0000","last_became_active":"2024-01-25T14:59:54.217381+0000","last_became_peered":"2024-01-25T14:59:54.217381+0000","last_unstale":"2024-01-25T15:01:26.200328+0000","last_undegraded":"2024-01-25T15:01:26.200328+0000","last_fullsized":"2024-01-25T15:01:26.200328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:36:09.631749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226804+0000","last_change":"2024-01-25T14:59:54.224518+0000","last_active":"2024-01-25T15:01:26.226804+0000","last_peered":"2024-01-25T15:01:26.226804+0000","last_clean":"2024-01-25T15:01:26.226804+0000","last_became_active":"2024-01-25T14:59:54.224210+0000","last_became_peered":"2024-01-25T14:59:54.224210+0000","last_unstale":"2024-01-25T15:01:26.226804+0000","last_undegraded":"2024-01-25T15:01:26.226804+0000","last_fullsized":"2024-01-25T15:01:26.226804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:33:56.670077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.224130+0000","last_change":"2024-01-25T15:00:57.282096+0000","last_active":"2024-01-25T15:01:26.224130+0000","last_peered":"2024-01-25T15:01:26.224130+0000","last_clean":"2024-01-25T15:01:26.224130+0000","last_became_active":"2024-01-25T15:00:57.281725+0000","last_became_peered":"2024-01-25T15:00:57.281725+0000","last_unstale":"2024-01-25T15:01:26.224130+0000","last_undegraded":"2024-01-25T15:01:26.224130+0000","last_fullsized":"2024-01-25T15:01:26.224130+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:53:03.519667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.227701+0000","last_change":"2024-01-25T14:59:54.217690+0000","last_active":"2024-01-25T15:01:26.227701+0000","last_peered":"2024-01-25T15:01:26.227701+0000","last_clean":"2024-01-25T15:01:26.227701+0000","last_became_active":"2024-01-25T14:59:54.217361+0000","last_became_peered":"2024-01-25T14:59:54.217361+0000","last_unstale":"2024-01-25T15:01:26.227701+0000","last_undegraded":"2024-01-25T15:01:26.227701+0000","last_fullsized":"2024-01-25T15:01:26.227701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:30:15.893502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.212394+0000","last_change":"2024-01-25T14:59:54.205201+0000","last_active":"2024-01-25T15:01:26.212394+0000","last_peered":"2024-01-25T15:01:26.212394+0000","last_clean":"2024-01-25T15:01:26.212394+0000","last_became_active":"2024-01-25T14:59:54.204893+0000","last_became_peered":"2024-01-25T14:59:54.204893+0000","last_unstale":"2024-01-25T15:01:26.212394+0000","last_undegraded":"2024-01-25T15:01:26.212394+0000","last_fullsized":"2024-01-25T15:01:26.212394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:35:43.147029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221643+0000","last_change":"2024-01-25T14:59:54.210681+0000","last_active":"2024-01-25T15:01:26.221643+0000","last_peered":"2024-01-25T15:01:26.221643+0000","last_clean":"2024-01-25T15:01:26.221643+0000","last_became_active":"2024-01-25T14:59:54.210347+0000","last_became_peered":"2024-01-25T14:59:54.210347+0000","last_unstale":"2024-01-25T15:01:26.221643+0000","last_undegraded":"2024-01-25T15:01:26.221643+0000","last_fullsized":"2024-01-25T15:01:26.221643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:44:12.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221684+0000","last_change":"2024-01-25T14:59:54.210792+0000","last_active":"2024-01-25T15:01:26.221684+0000","last_peered":"2024-01-25T15:01:26.221684+0000","last_clean":"2024-01-25T15:01:26.221684+0000","last_became_active":"2024-01-25T14:59:54.210416+0000","last_became_peered":"2024-01-25T14:59:54.210416+0000","last_unstale":"2024-01-25T15:01:26.221684+0000","last_undegraded":"2024-01-25T15:01:26.221684+0000","last_fullsized":"2024-01-25T15:01:26.221684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:45.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.222916+0000","last_change":"2024-01-25T14:59:54.204547+0000","last_active":"2024-01-25T15:01:26.222916+0000","last_peered":"2024-01-25T15:01:26.222916+0000","last_clean":"2024-01-25T15:01:26.222916+0000","last_became_active":"2024-01-25T14:59:54.204215+0000","last_became_peered":"2024-01-25T14:59:54.204215+0000","last_unstale":"2024-01-25T15:01:26.222916+0000","last_undegraded":"2024-01-25T15:01:26.222916+0000","last_fullsized":"2024-01-25T15:01:26.222916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:34:04.413137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.232166+0000","last_change":"2024-01-25T14:59:54.211006+0000","last_active":"2024-01-25T15:01:26.232166+0000","last_peered":"2024-01-25T15:01:26.232166+0000","last_clean":"2024-01-25T15:01:26.232166+0000","last_became_active":"2024-01-25T14:59:54.210568+0000","last_became_peered":"2024-01-25T14:59:54.210568+0000","last_unstale":"2024-01-25T15:01:26.232166+0000","last_undegraded":"2024-01-25T15:01:26.232166+0000","last_fullsized":"2024-01-25T15:01:26.232166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:12:23.888827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.224809+0000","last_change":"2024-01-25T14:59:54.220485+0000","last_active":"2024-01-25T15:01:26.224809+0000","last_peered":"2024-01-25T15:01:26.224809+0000","last_clean":"2024-01-25T15:01:26.224809+0000","last_became_active":"2024-01-25T14:59:54.219547+0000","last_became_peered":"2024-01-25T14:59:54.219547+0000","last_unstale":"2024-01-25T15:01:26.224809+0000","last_undegraded":"2024-01-25T15:01:26.224809+0000","last_fullsized":"2024-01-25T15:01:26.224809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:43:49.858263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.228144+0000","last_change":"2024-01-25T14:59:54.217605+0000","last_active":"2024-01-25T15:01:26.228144+0000","last_peered":"2024-01-25T15:01:26.228144+0000","last_clean":"2024-01-25T15:01:26.228144+0000","last_became_active":"2024-01-25T14:59:54.217295+0000","last_became_peered":"2024-01-25T14:59:54.217295+0000","last_unstale":"2024-01-25T15:01:26.228144+0000","last_undegraded":"2024-01-25T15:01:26.228144+0000","last_fullsized":"2024-01-25T15:01:26.228144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:27:59.846434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65841,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1131,"num_read_kb":633,"num_write":241,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58353,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":569344,"data_stored":202535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383717,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":954368,"data_stored":456311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.69699999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":1.444,"15min":1.444},"last":0.66400000000000003}]},{"osd":1,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.53600000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93300000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.5,"15min":0.48199999999999998},"min":{"1min":0.40500000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.66300000000000003},"min":{"1min":0.58599999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.92700000000000005,"5min":1.079,"15min":1.079},"last":0.878},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61699999999999999,"15min":0.61099999999999999},"min":{"1min":0.496,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.86199999999999999}]},{"osd":5,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83999999999999997,"5min":1.387,"15min":1.387},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.42799999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.71999999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.58499999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97499999999999998,"5min":1.571,"15min":1.571},"last":0.751}]},{"osd":7,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.748,"15min":0.73399999999999999},"min":{"1min":0.72399999999999998,"5min":0.5,"15min":0.5},"max":{"1min":0.99099999999999999,"5min":1.129,"15min":1.129},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.70699999999999996,"15min":0.69799999999999995},"min":{"1min":0.55800000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91700000000000004,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.81799999999999995}]},{"osd":8,"last update":"Thu Jan 25 15:00:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.91400000000000003}]},{"osd":9,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75900000000000001,"15min":0.75800000000000001},"min":{"1min":0.65100000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94399999999999995,"5min":1.536,"15min":1.536},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.87,"5min":0.76600000000000001,"15min":0.749},"min":{"1min":0.71999999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.028,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97599999999999998}]},{"osd":10,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.67200000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92300000000000004,"5min":1.101,"15min":1.101},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79600000000000004,"15min":0.79500000000000004},"min":{"1min":0.60899999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.004,"5min":1.603,"15min":1.603},"last":0.83099999999999996}]}]},{"osd":10,"up_from":72,"seq":309237645354,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1650688,"data_stored":1105898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.495},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.499},{"interface":"front","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.312,"5min":0.308,"15min":0.308},"max":{"1min":0.69299999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82499999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.439,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.873,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.749}]},{"osd":3,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64100000000000001,"15min":0.66100000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72499999999999998,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71699999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.82999999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78900000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.48299999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92000000000000004,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46800000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.91300000000000003}]},{"osd":6,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.72399999999999998,"15min":0.754},"min":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92000000000000004,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.873},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90700000000000003,"5min":1.347,"15min":1.347},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.45500000000000002}]},{"osd":8,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77500000000000002,"15min":0.79400000000000004},"min":{"1min":0.42499999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94799999999999995,"5min":1.282,"15min":1.282},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78100000000000003,"15min":0.79800000000000004},"min":{"1min":0.54800000000000004,"5min":0.495,"15min":0.495},"max":{"1min":0.89300000000000002,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.85499999999999998}]},{"osd":9,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.79600000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93500000000000005,"5min":1.262,"15min":1.262},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.79300000000000004,"15min":0.82299999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89100000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.89800000000000002}]},{"osd":11,"last update":"Thu Jan 25 15:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95299999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76900000000000002,"15min":0.76100000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.97999999999999998,"5min":1.004,"15min":1.004},"last":0.98199999999999998}]}]},{"osd":9,"up_from":67,"seq":287762808878,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":456219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.26800000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.436,"15min":0.46400000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.58999999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60899999999999999,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":0.875,"15min":0.875},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73999999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.60199999999999998,"15min":0.627},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68400000000000005,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.41999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.71199999999999997,"5min":1.012,"15min":1.012},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.495,"15min":0.52500000000000002},"min":{"1min":0.317,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68999999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.51800000000000002,"15min":0.54600000000000004},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.79100000000000004,"5min":0.876,"15min":0.876},"last":0.379}]},{"osd":4,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.314,"15min":0.314},"max":{"1min":0.78000000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.4419999999999999,"5min":0.82599999999999996,"15min":0.72299999999999998},"min":{"1min":0.39000000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":17.138999999999999,"5min":17.138999999999999,"15min":17.138999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.81899999999999995,"15min":0.73899999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72599999999999998,"5min":17.117000000000001,"15min":17.117000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":3.528,"5min":3.528,"15min":3.528},"last":0.629}]},{"osd":6,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.624,"15min":0.66700000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.96299999999999997,"5min":1.036,"15min":1.036},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.56799999999999995,"15min":0.60599999999999998},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94999999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.436}]},{"osd":7,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":0.83499999999999996,"15min":0.78800000000000003},"min":{"1min":0.45600000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":13.346,"5min":13.346,"15min":13.346},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.73899999999999999,"15min":0.78000000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93700000000000006,"5min":1.125,"15min":1.125},"last":0.45200000000000001}]},{"osd":8,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.67300000000000004,"15min":0.69499999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.88500000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.71799999999999997,"15min":0.751},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81100000000000005,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.60499999999999998}]},{"osd":10,"last update":"Thu Jan 25 15:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.66000000000000003,"15min":0.68400000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75600000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.70599999999999996,"15min":0.72799999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.57199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]}]},{"osd":8,"up_from":59,"seq":253403070515,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":966656,"data_stored":456575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.438,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69499999999999995,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68300000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.84399999999999997}]},{"osd":1,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.60299999999999998,"15min":0.58699999999999997},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94299999999999995,"5min":1.008,"15min":1.008},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59699999999999998,"15min":0.58599999999999997},"min":{"1min":0.46300000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.39700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.65500000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.47799999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78500000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.74299999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.49099999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91800000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.63600000000000001,"15min":0.627},"min":{"1min":0.59099999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.876}]},{"osd":5,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.45700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.42799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80600000000000005,"5min":1.028,"15min":1.028},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.54600000000000004,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.51600000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86299999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.61199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88800000000000001,"5min":1.04,"15min":1.04},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.70899999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.995,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.75900000000000001}]},{"osd":9,"last update":"Thu Jan 25 15:01:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.67300000000000004,"15min":0.64300000000000002},"min":{"1min":0.59799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90900000000000003,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.69199999999999995,"15min":0.65800000000000003},"min":{"1min":0.68899999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.69199999999999995}]},{"osd":10,"last update":"Thu Jan 25 15:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.72399999999999998,"15min":0.68600000000000005},"min":{"1min":0.65500000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.73499999999999999,"15min":0.68999999999999995},"min":{"1min":0.71399999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.78800000000000003}]},{"osd":11,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.81599999999999995}]}]},{"osd":7,"up_from":52,"seq":223338299449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32708,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712444,"statfs":{"total":95995035648,"available":95961542656,"internally_reserved":0,"allocated":1568768,"data_stored":1049255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.53200000000000003,"15min":0.51900000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.40100000000000002},"min":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55100000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.29199999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.498}]},{"osd":2,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.68500000000000005,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84399999999999997,"5min":6.508,"15min":6.508},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.40400000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.47599999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.74399999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.71399999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59899999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64300000000000002,"15min":0.627},"min":{"1min":0.45300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.80600000000000005,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.626,"15min":0.62},"min":{"1min":0.41999999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82099999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67800000000000005,"15min":0.68400000000000005},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84799999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.44500000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.89700000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81699999999999995}]},{"osd":8,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69199999999999995,"15min":0.68400000000000005},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.79500000000000004,"15min":0.73299999999999998},"min":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.97099999999999997,"5min":6.5469999999999997,"15min":6.5469999999999997},"last":0.85599999999999998}]},{"osd":9,"last update":"Thu Jan 25 15:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.57199999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.84799999999999998,"5min":1.022,"15min":1.022},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91100000000000003,"5min":1.016,"15min":1.016},"last":0.76600000000000001}]},{"osd":10,"last update":"Thu Jan 25 15:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75700000000000001,"15min":0.77000000000000002},"min":{"1min":0.46600000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88900000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88300000000000001,"5min":1.087,"15min":1.087},"last":0.82799999999999996}]},{"osd":11,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.879},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.90800000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495678,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40432,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704720,"statfs":{"total":95995035648,"available":95953633280,"internally_reserved":0,"allocated":958464,"data_stored":455936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39900000000000002,"15min":0.377},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.437},{"interface":"front","average":{"1min":0.435,"5min":0.40400000000000003,"15min":0.377},"min":{"1min":0.27400000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.379}]},{"osd":1,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.39200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56299999999999994,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.52300000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55000000000000004,"15min":0.52400000000000002},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.622},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89100000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.72399999999999998}]},{"osd":3,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.432,"15min":0.42399999999999999},"min":{"1min":0.29099999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48099999999999998,"15min":0.46700000000000003},"min":{"1min":0.315,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.48199999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.61599999999999999,"15min":0.58799999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61599999999999999,"15min":0.59599999999999997},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.66100000000000003}]},{"osd":7,"last update":"Thu Jan 25 15:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65100000000000002,"15min":0.67800000000000005},"min":{"1min":0.442,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0309999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.67200000000000004,"15min":0.69399999999999995},"min":{"1min":0.46899999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":1.04,"15min":1.04},"last":0.71099999999999997}]},{"osd":8,"last update":"Thu Jan 25 15:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67700000000000005,"15min":0.70599999999999996},"min":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89900000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.75},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.52700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.60699999999999998}]},{"osd":9,"last update":"Thu Jan 25 15:01:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.65600000000000003,"15min":0.68300000000000005},"min":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.67000000000000004,"15min":0.70599999999999996},"min":{"1min":0.41799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98599999999999999,"5min":1.147,"15min":1.147},"last":0.69499999999999995}]},{"osd":10,"last update":"Thu Jan 25 15:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.51800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.212,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.58099999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.76500000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36332,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708820,"statfs":{"total":95995035648,"available":95957831680,"internally_reserved":0,"allocated":1019904,"data_stored":515429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.49099999999999999},"min":{"1min":0.39300000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82699999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.49299999999999999},"min":{"1min":0.36599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77100000000000002,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.747}]},{"osd":2,"last update":"Thu Jan 25 15:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.61199999999999999,"15min":0.51700000000000002},"min":{"1min":0.49399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.53300000000000003},"min":{"1min":0.42499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90800000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.59099999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:00:51 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59499999999999997,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90300000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.59199999999999997,"15min":0.55400000000000005},"min":{"1min":0.56399999999999995,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78700000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.70299999999999996}]},{"osd":4,"last update":"Thu Jan 25 15:01:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.46999999999999997,"15min":0.40400000000000003},"min":{"1min":0.316,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.47299999999999998,"15min":0.41499999999999998},"min":{"1min":0.33600000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.315}]},{"osd":5,"last update":"Thu Jan 25 15:01:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.65600000000000003,"15min":0.59099999999999997},"min":{"1min":0.48699999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66400000000000003,"15min":0.58299999999999996},"min":{"1min":0.505,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 25 15:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63100000000000001,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94399999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.629},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65200000000000002,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 25 15:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.624,"15min":0.58799999999999997},"min":{"1min":0.41999999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97299999999999998,"5min":1.008,"15min":1.008},"last":0.436},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.68300000000000005,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.61299999999999999}]},{"osd":8,"last update":"Thu Jan 25 15:00:51 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.755,"15min":0.73499999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.69299999999999995,"15min":0.67500000000000004},"min":{"1min":0.63900000000000001,"5min":0.503,"15min":0.503},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64200000000000002}]},{"osd":9,"last update":"Thu Jan 25 15:01:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.74299999999999999,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.01,"5min":1.089,"15min":1.089},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.59599999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.85199999999999998}]},{"osd":10,"last update":"Thu Jan 25 15:01:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.53800000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80800000000000005,"15min":0.80600000000000005},"min":{"1min":0.58899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.79900000000000004}]},{"osd":11,"last update":"Thu Jan 25 15:00:56 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.873},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.73099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40452,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704700,"statfs":{"total":95995035648,"available":95953612800,"internally_reserved":0,"allocated":978944,"data_stored":457275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:01:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.5},"min":{"1min":0.38500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84299999999999997,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.434},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52500000000000002,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:01:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.51200000000000001},"min":{"1min":0.378,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72599999999999998,"5min":1.143,"15min":1.143},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.42899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72299999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:00:57 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55800000000000005,"15min":0.51600000000000001},"min":{"1min":0.38400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.70999999999999996,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55500000000000005,"15min":0.52700000000000002},"min":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.63900000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 25 15:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.56299999999999994,"15min":0.54700000000000004},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:01:14 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.502,"15min":0.52000000000000002},"min":{"1min":0.29199999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.94299999999999995,"5min":1.232,"15min":1.232},"last":0.317},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.50700000000000001},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.91000000000000003,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.498}]},{"osd":7,"last update":"Thu Jan 25 14:59:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57699999999999996}]},{"osd":8,"last update":"Thu Jan 25 15:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66300000000000003,"15min":0.67000000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.69899999999999995},"min":{"1min":0.47699999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.57199999999999995}]},{"osd":9,"last update":"Thu Jan 25 15:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.375,"5min":0.37,"15min":0.37},"max":{"1min":0.63,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.39600000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69699999999999995,"5min":1.052,"15min":1.052},"last":0.60099999999999998}]},{"osd":10,"last update":"Thu Jan 25 15:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.50700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.751,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.77400000000000002,"15min":0.74199999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.52500000000000002}]},{"osd":11,"last update":"Thu Jan 25 15:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1140000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72099999999999997,"15min":0.72399999999999998},"min":{"1min":0.58599999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.61499999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":970752,"data_stored":457908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:36 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.433,"5min":0.246,"15min":0.246},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.40600000000000003,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68500000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 25 15:01:36 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.52800000000000002},"min":{"1min":0.38400000000000001,"5min":0.34999999999999998,"15min":0.26500000000000001},"max":{"1min":0.878,"5min":0.879,"15min":0.879},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.58999999999999997,"15min":0.52600000000000002},"min":{"1min":0.51200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 25 15:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59699999999999998,"15min":0.54300000000000004},"min":{"1min":0.42799999999999999,"5min":0.373,"15min":0.28000000000000003},"max":{"1min":0.71299999999999997,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58699999999999997,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.29799999999999999},"max":{"1min":0.77600000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 25 15:00:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.624},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.751}]},{"osd":5,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.47499999999999998,"15min":0.41199999999999998},"min":{"1min":0.31900000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.82899999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.38},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.44900000000000001},"min":{"1min":0.34499999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.74199999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.432}]},{"osd":6,"last update":"Thu Jan 25 15:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82599999999999996,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.58199999999999996},"min":{"1min":0.40000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.878,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 25 14:59:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.76900000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67700000000000005,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.80500000000000005,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77500000000000002}]},{"osd":8,"last update":"Thu Jan 25 15:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.44900000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85299999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82099999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53300000000000003}]},{"osd":9,"last update":"Thu Jan 25 15:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.51900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.501},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69699999999999995,"15min":0.69199999999999995},"min":{"1min":0.55500000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89900000000000002,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67500000000000004}]},{"osd":10,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.70099999999999996,"15min":0.66700000000000004},"min":{"1min":0.61499999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93799999999999994,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.70599999999999996,"15min":0.66700000000000004},"min":{"1min":0.64500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64100000000000001}]},{"osd":11,"last update":"Thu Jan 25 15:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.69499999999999995}]}]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":455761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.34000000000000002},"min":{"1min":0.254,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.27200000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53700000000000003,"15min":0.51000000000000001},"min":{"1min":0.376,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54600000000000004,"15min":0.51000000000000001},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.753,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73899999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 25 15:01:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77900000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80000000000000004,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47999999999999998,"15min":0.46999999999999997},"min":{"1min":0.29999999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.51300000000000001,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.437}]},{"osd":7,"last update":"Thu Jan 25 15:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.45300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.63300000000000001,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82899999999999996,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68000000000000005}]},{"osd":8,"last update":"Thu Jan 25 14:59:53 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85899999999999999,"5min":0.872,"15min":0.872},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69599999999999995,"15min":0.69499999999999995},"min":{"1min":0.56799999999999995,"5min":0.5,"15min":0.5},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.61799999999999999}]},{"osd":9,"last update":"Thu Jan 25 15:01:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.64100000000000001,"15min":0.68300000000000005},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.753,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67700000000000005,"15min":0.71399999999999997},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.49299999999999999}]},{"osd":10,"last update":"Thu Jan 25 15:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64900000000000002}]},{"osd":11,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70399999999999996}]}]},{"osd":4,"up_from":33,"seq":141733920840,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":519389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48599999999999999,"15min":0.47699999999999998},"min":{"1min":0.38100000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.82199999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 25 15:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41399999999999998,"15min":0.39200000000000002},"min":{"1min":0.26500000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41999999999999998,"15min":0.40200000000000002},"min":{"1min":0.28000000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.68999999999999995,"5min":0.878,"15min":0.878},"last":0.378}]},{"osd":2,"last update":"Thu Jan 25 15:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.749,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.57599999999999996},"min":{"1min":0.41799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84599999999999997,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 25 15:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55700000000000005,"15min":0.51300000000000001},"min":{"1min":0.442,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55700000000000005,"15min":0.54200000000000004},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73899999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.46100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.39600000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 25 15:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.56399999999999995},"min":{"1min":0.46400000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81000000000000005,"5min":0.879,"15min":0.879},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.36499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90700000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 25 15:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58899999999999997,"15min":0.55300000000000005},"min":{"1min":0.35999999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":1.002,"15min":1.002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57399999999999995,"15min":0.53300000000000003},"min":{"1min":0.38900000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76800000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61599999999999999}]},{"osd":8,"last update":"Thu Jan 25 15:00:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.47699999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89400000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69899999999999995,"15min":0.67400000000000004},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96799999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.66100000000000003}]},{"osd":9,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.57099999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96699999999999997,"5min":1,"15min":1},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75700000000000001,"15min":0.76700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90200000000000002,"5min":1.044,"15min":1.044},"last":0.77300000000000002}]},{"osd":10,"last update":"Thu Jan 25 15:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89600000000000002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67800000000000005,"15min":0.68799999999999994},"min":{"1min":0.48199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81100000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64500000000000002}]},{"osd":11,"last update":"Thu Jan 25 15:00:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.754},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.70499999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757314,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32720,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712432,"statfs":{"total":95995035648,"available":95961530368,"internally_reserved":0,"allocated":1581056,"data_stored":1048933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71599999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.32500000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57199999999999995,"15min":0.53400000000000003},"min":{"1min":0.39800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78000000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.53900000000000003},"min":{"1min":0.41299999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71899999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.41299999999999998,"15min":0.39600000000000002},"min":{"1min":0.32600000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54600000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.375},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40200000000000002,"15min":0.38600000000000001},"min":{"1min":0.313,"5min":0.247,"15min":0.247},"max":{"1min":0.621,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.54400000000000004,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.751,"5min":0.873,"15min":0.873},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.35799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.505}]},{"osd":4,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58299999999999996,"15min":0.55300000000000005},"min":{"1min":0.497,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.60399999999999998,"15min":0.56599999999999995},"min":{"1min":0.42799999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.80100000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 25 15:01:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.58799999999999997},"min":{"1min":0.38500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.81699999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81399999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.436}]},{"osd":7,"last update":"Thu Jan 25 15:01:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.48799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89300000000000002,"5min":1.01,"15min":1.01},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.91600000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.63}]},{"osd":8,"last update":"Thu Jan 25 15:00:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83199999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79800000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.71599999999999997}]},{"osd":9,"last update":"Thu Jan 25 15:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66200000000000003,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84799999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.62},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.873,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.67600000000000005}]},{"osd":10,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.63300000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86899999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.59799999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88300000000000001,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.70699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:01:53.917 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-01-25T15:01:53.917 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-25T15:01:54.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.052+0000 7f0b20b00640 1 -- 172.21.15.170:0/1010884943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b1c0ffc10 msgr2=0x7f0b1c100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:54.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.052+0000 7f0b20b00640 1 --2- 172.21.15.170:0/1010884943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b1c0ffc10 0x7f0b1c100030 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009900 tx=0x7f0b0c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:54.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.052+0000 7f0b20b00640 1 -- 172.21.15.170:0/1010884943 shutdown_connections 2024-01-25T15:01:54.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.052+0000 7f0b20b00640 1 --2- 172.21.15.170:0/1010884943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b1c100e00 0x7f0b1c101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.052+0000 7f0b20b00640 1 --2- 172.21.15.170:0/1010884943 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c1017c0 0x7f0b1c108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.052+0000 7f0b20b00640 1 --2- 172.21.15.170:0/1010884943 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b1c0ffc10 0x7f0b1c100030 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.052+0000 7f0b20b00640 1 -- 172.21.15.170:0/1010884943 >> 172.21.15.170:0/1010884943 conn(0x7f0b1c0fb180 msgr2=0x7f0b1c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:54.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.052+0000 7f0b20b00640 1 -- 172.21.15.170:0/1010884943 shutdown_connections 2024-01-25T15:01:54.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.052+0000 7f0b20b00640 1 -- 172.21.15.170:0/1010884943 wait complete. 2024-01-25T15:01:54.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b20b00640 1 Processor -- start 2024-01-25T15:01:54.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b20b00640 1 -- start start 2024-01-25T15:01:54.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b20b00640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c0ffc10 0x7f0b1c069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:54.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b20b00640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b1c100e00 0x7f0b1c19ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:54.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b20b00640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b1c1017c0 0x7f0b1c19e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:54.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b20b00640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c19e800 con 0x7f0b1c1017c0 2024-01-25T15:01:54.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b20b00640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c19e970 con 0x7f0b1c100e00 2024-01-25T15:01:54.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b20b00640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b1c19eb30 con 0x7f0b1c0ffc10 2024-01-25T15:01:54.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b1ad9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b1c1017c0 0x7f0b1c19e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:54.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b1ad9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b1c1017c0 0x7f0b1c19e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36306/0 (socket says 172.21.15.170:36306) 2024-01-25T15:01:54.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b1ad9d640 1 -- 172.21.15.170:0/487617795 learned_addr learned my addr 172.21.15.170:0/487617795 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:54.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b1a59c640 1 --2- 172.21.15.170:0/487617795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c0ffc10 0x7f0b1c069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:54.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b19d9b640 1 --2- 172.21.15.170:0/487617795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b1c100e00 0x7f0b1c19ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:54.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b1ad9d640 1 -- 172.21.15.170:0/487617795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c0ffc10 msgr2=0x7f0b1c069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:54.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b1ad9d640 1 --2- 172.21.15.170:0/487617795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c0ffc10 0x7f0b1c069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b1ad9d640 1 -- 172.21.15.170:0/487617795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b1c100e00 msgr2=0x7f0b1c19ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:54.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b1ad9d640 1 --2- 172.21.15.170:0/487617795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b1c100e00 0x7f0b1c19ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.053+0000 7f0b1ad9d640 1 -- 172.21.15.170:0/487617795 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0c009560 con 0x7f0b1c1017c0 2024-01-25T15:01:54.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.054+0000 7f0b1ad9d640 1 --2- 172.21.15.170:0/487617795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b1c1017c0 0x7f0b1c19e070 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400eaa0 tx=0x7f0b1400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:54.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.054+0000 7f0b0b7fe640 1 -- 172.21.15.170:0/487617795 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1400cdb0 con 0x7f0b1c1017c0 2024-01-25T15:01:54.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.054+0000 7f0b0b7fe640 1 -- 172.21.15.170:0/487617795 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b14005020 con 0x7f0b1c1017c0 2024-01-25T15:01:54.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.054+0000 7f0b20b00640 1 -- 172.21.15.170:0/487617795 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1c19ee10 con 0x7f0b1c1017c0 2024-01-25T15:01:54.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.054+0000 7f0b0b7fe640 1 -- 172.21.15.170:0/487617795 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b140116d0 con 0x7f0b1c1017c0 2024-01-25T15:01:54.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.054+0000 7f0b20b00640 1 -- 172.21.15.170:0/487617795 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1c19f2f0 con 0x7f0b1c1017c0 2024-01-25T15:01:54.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.055+0000 7f0b20b00640 1 -- 172.21.15.170:0/487617795 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1c106f30 con 0x7f0b1c1017c0 2024-01-25T15:01:54.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.056+0000 7f0b0b7fe640 1 -- 172.21.15.170:0/487617795 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f0b14005190 con 0x7f0b1c1017c0 2024-01-25T15:01:54.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.056+0000 7f0b0b7fe640 1 --2- 172.21.15.170:0/487617795 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0b040a1370 0x7f0b040a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:54.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.056+0000 7f0b1a59c640 1 --2- 172.21.15.170:0/487617795 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0b040a1370 0x7f0b040a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:54.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.056+0000 7f0b0b7fe640 1 -- 172.21.15.170:0/487617795 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f0b140cce10 con 0x7f0b1c1017c0 2024-01-25T15:01:54.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.057+0000 7f0b1a59c640 1 --2- 172.21.15.170:0/487617795 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0b040a1370 0x7f0b040a3830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c000c00 tx=0x7f0b0c02c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:54.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.061+0000 7f0b0b7fe640 1 -- 172.21.15.170:0/487617795 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f0b14096160 con 0x7f0b1c1017c0 2024-01-25T15:01:54.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.236+0000 7f0b20b00640 1 -- 172.21.15.170:0/487617795 --> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b1c02cbe0 con 0x7f0b040a1370 2024-01-25T15:01:54.247 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.246+0000 7f0b0b7fe640 1 -- 172.21.15.170:0/487617795 <== mgr.14152 v2:172.21.15.170:6800/3767785684 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344889 (secure 0 0 0) 0x7f0b1c02cbe0 con 0x7f0b040a1370 2024-01-25T15:01:54.251 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:54.253 INFO:teuthology.orchestra.run.smithi170.stderr:dumped all 2024-01-25T15:01:54.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.249+0000 7f0b20b00640 1 -- 172.21.15.170:0/487617795 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0b040a1370 msgr2=0x7f0b040a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:54.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.249+0000 7f0b20b00640 1 --2- 172.21.15.170:0/487617795 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0b040a1370 0x7f0b040a3830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c000c00 tx=0x7f0b0c02c5d0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.249+0000 7f0b20b00640 1 -- 172.21.15.170:0/487617795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b1c1017c0 msgr2=0x7f0b1c19e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:54.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.249+0000 7f0b20b00640 1 --2- 172.21.15.170:0/487617795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b1c1017c0 0x7f0b1c19e070 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400eaa0 tx=0x7f0b1400ef60 comp rx=0 tx=0).stop 2024-01-25T15:01:54.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.250+0000 7f0b20b00640 1 -- 172.21.15.170:0/487617795 shutdown_connections 2024-01-25T15:01:54.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.250+0000 7f0b20b00640 1 --2- 172.21.15.170:0/487617795 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f0b040a1370 0x7f0b040a3830 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.250+0000 7f0b20b00640 1 --2- 172.21.15.170:0/487617795 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0b1c100e00 0x7f0b1c19ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.250+0000 7f0b20b00640 1 --2- 172.21.15.170:0/487617795 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0b1c1017c0 0x7f0b1c19e070 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.250+0000 7f0b20b00640 1 --2- 172.21.15.170:0/487617795 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0b1c0ffc10 0x7f0b1c069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.250+0000 7f0b20b00640 1 -- 172.21.15.170:0/487617795 >> 172.21.15.170:0/487617795 conn(0x7f0b1c0fb180 msgr2=0x7f0b1c104100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:54.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.250+0000 7f0b20b00640 1 -- 172.21.15.170:0/487617795 shutdown_connections 2024-01-25T15:01:54.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.250+0000 7f0b20b00640 1 -- 172.21.15.170:0/487617795 wait complete. 2024-01-25T15:01:54.260 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:54 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2288427661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:54.262 INFO:teuthology.orchestra.run.smithi170.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2024-01-25T15:01:54.220131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661455,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1295,"num_read_kb":774,"num_write":434,"num_write_kb":3087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1239089,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":856,"ondisk_log_size":856,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":395752,"kb_used_data":13320,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124546072,"statfs":{"total":1151940427776,"available":1151535177728,"internally_reserved":0,"allocated":13639680,"data_stored":7446001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19140,"internal_metadata":391492924},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5320,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":83,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002582"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.230737+0000","last_change":"2024-01-25T14:59:54.219084+0000","last_active":"2024-01-25T15:01:26.230737+0000","last_peered":"2024-01-25T15:01:26.230737+0000","last_clean":"2024-01-25T15:01:26.230737+0000","last_became_active":"2024-01-25T14:59:54.218780+0000","last_became_peered":"2024-01-25T14:59:54.218780+0000","last_unstale":"2024-01-25T15:01:26.230737+0000","last_undegraded":"2024-01-25T15:01:26.230737+0000","last_fullsized":"2024-01-25T15:01:26.230737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:05:50.441934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221600+0000","last_change":"2024-01-25T14:59:54.219130+0000","last_active":"2024-01-25T15:01:26.221600+0000","last_peered":"2024-01-25T15:01:26.221600+0000","last_clean":"2024-01-25T15:01:26.221600+0000","last_became_active":"2024-01-25T14:59:54.218744+0000","last_became_peered":"2024-01-25T14:59:54.218744+0000","last_unstale":"2024-01-25T15:01:26.221600+0000","last_undegraded":"2024-01-25T15:01:26.221600+0000","last_fullsized":"2024-01-25T15:01:26.221600+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:59:35.424110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.232001+0000","last_change":"2024-01-25T14:59:54.218870+0000","last_active":"2024-01-25T15:01:26.232001+0000","last_peered":"2024-01-25T15:01:26.232001+0000","last_clean":"2024-01-25T15:01:26.232001+0000","last_became_active":"2024-01-25T14:59:54.218522+0000","last_became_peered":"2024-01-25T14:59:54.218522+0000","last_unstale":"2024-01-25T15:01:26.232001+0000","last_undegraded":"2024-01-25T15:01:26.232001+0000","last_fullsized":"2024-01-25T15:01:26.232001+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:00:05.038437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.217791+0000","last_change":"2024-01-25T14:59:54.218436+0000","last_active":"2024-01-25T15:01:26.217791+0000","last_peered":"2024-01-25T15:01:26.217791+0000","last_clean":"2024-01-25T15:01:26.217791+0000","last_became_active":"2024-01-25T14:59:54.217232+0000","last_became_peered":"2024-01-25T14:59:54.217232+0000","last_unstale":"2024-01-25T15:01:26.217791+0000","last_undegraded":"2024-01-25T15:01:26.217791+0000","last_fullsized":"2024-01-25T15:01:26.217791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:24:14.642794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221036+0000","last_change":"2024-01-25T14:59:54.219094+0000","last_active":"2024-01-25T15:01:26.221036+0000","last_peered":"2024-01-25T15:01:26.221036+0000","last_clean":"2024-01-25T15:01:26.221036+0000","last_became_active":"2024-01-25T14:59:54.218778+0000","last_became_peered":"2024-01-25T14:59:54.218778+0000","last_unstale":"2024-01-25T15:01:26.221036+0000","last_undegraded":"2024-01-25T15:01:26.221036+0000","last_fullsized":"2024-01-25T15:01:26.221036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:38:21.754098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.220371+0000","last_change":"2024-01-25T14:59:54.213243+0000","last_active":"2024-01-25T15:01:26.220371+0000","last_peered":"2024-01-25T15:01:26.220371+0000","last_clean":"2024-01-25T15:01:26.220371+0000","last_became_active":"2024-01-25T14:59:54.212891+0000","last_became_peered":"2024-01-25T14:59:54.212891+0000","last_unstale":"2024-01-25T15:01:26.220371+0000","last_undegraded":"2024-01-25T15:01:26.220371+0000","last_fullsized":"2024-01-25T15:01:26.220371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:52:45.505016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221723+0000","last_change":"2024-01-25T14:59:54.211851+0000","last_active":"2024-01-25T15:01:26.221723+0000","last_peered":"2024-01-25T15:01:26.221723+0000","last_clean":"2024-01-25T15:01:26.221723+0000","last_became_active":"2024-01-25T14:59:54.211298+0000","last_became_peered":"2024-01-25T14:59:54.211298+0000","last_unstale":"2024-01-25T15:01:26.221723+0000","last_undegraded":"2024-01-25T15:01:26.221723+0000","last_fullsized":"2024-01-25T15:01:26.221723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:05:36.636283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.222334+0000","last_change":"2024-01-25T14:59:54.217675+0000","last_active":"2024-01-25T15:01:26.222334+0000","last_peered":"2024-01-25T15:01:26.222334+0000","last_clean":"2024-01-25T15:01:26.222334+0000","last_became_active":"2024-01-25T14:59:54.217329+0000","last_became_peered":"2024-01-25T14:59:54.217329+0000","last_unstale":"2024-01-25T15:01:26.222334+0000","last_undegraded":"2024-01-25T15:01:26.222334+0000","last_fullsized":"2024-01-25T15:01:26.222334+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:32:07.769974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.230192+0000","last_change":"2024-01-25T14:59:54.213030+0000","last_active":"2024-01-25T15:01:26.230192+0000","last_peered":"2024-01-25T15:01:26.230192+0000","last_clean":"2024-01-25T15:01:26.230192+0000","last_became_active":"2024-01-25T14:59:54.212687+0000","last_became_peered":"2024-01-25T14:59:54.212687+0000","last_unstale":"2024-01-25T15:01:26.230192+0000","last_undegraded":"2024-01-25T15:01:26.230192+0000","last_fullsized":"2024-01-25T15:01:26.230192+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:47:29.562996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.220569+0000","last_change":"2024-01-25T15:00:57.284759+0000","last_active":"2024-01-25T15:01:26.220569+0000","last_peered":"2024-01-25T15:01:26.220569+0000","last_clean":"2024-01-25T15:01:26.220569+0000","last_became_active":"2024-01-25T15:00:57.284306+0000","last_became_peered":"2024-01-25T15:00:57.284306+0000","last_unstale":"2024-01-25T15:01:26.220569+0000","last_undegraded":"2024-01-25T15:01:26.220569+0000","last_fullsized":"2024-01-25T15:01:26.220569+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:56:49.173903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.231337+0000","last_change":"2024-01-25T14:59:54.216252+0000","last_active":"2024-01-25T15:01:26.231337+0000","last_peered":"2024-01-25T15:01:26.231337+0000","last_clean":"2024-01-25T15:01:26.231337+0000","last_became_active":"2024-01-25T14:59:54.215892+0000","last_became_peered":"2024-01-25T14:59:54.215892+0000","last_unstale":"2024-01-25T15:01:26.231337+0000","last_undegraded":"2024-01-25T15:01:26.231337+0000","last_fullsized":"2024-01-25T15:01:26.231337+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:53:27.135926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.215703+0000","last_change":"2024-01-25T14:59:54.221212+0000","last_active":"2024-01-25T15:01:26.215703+0000","last_peered":"2024-01-25T15:01:26.215703+0000","last_clean":"2024-01-25T15:01:26.215703+0000","last_became_active":"2024-01-25T14:59:54.220516+0000","last_became_peered":"2024-01-25T14:59:54.220516+0000","last_unstale":"2024-01-25T15:01:26.215703+0000","last_undegraded":"2024-01-25T15:01:26.215703+0000","last_fullsized":"2024-01-25T15:01:26.215703+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:00:57.398457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221443+0000","last_change":"2024-01-25T14:59:54.204088+0000","last_active":"2024-01-25T15:01:26.221443+0000","last_peered":"2024-01-25T15:01:26.221443+0000","last_clean":"2024-01-25T15:01:26.221443+0000","last_became_active":"2024-01-25T14:59:54.202895+0000","last_became_peered":"2024-01-25T14:59:54.202895+0000","last_unstale":"2024-01-25T15:01:26.221443+0000","last_undegraded":"2024-01-25T15:01:26.221443+0000","last_fullsized":"2024-01-25T15:01:26.221443+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:15:37.693577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.227904+0000","last_change":"2024-01-25T14:59:54.226108+0000","last_active":"2024-01-25T15:01:26.227904+0000","last_peered":"2024-01-25T15:01:26.227904+0000","last_clean":"2024-01-25T15:01:26.227904+0000","last_became_active":"2024-01-25T14:59:54.225830+0000","last_became_peered":"2024-01-25T14:59:54.225830+0000","last_unstale":"2024-01-25T15:01:26.227904+0000","last_undegraded":"2024-01-25T15:01:26.227904+0000","last_fullsized":"2024-01-25T15:01:26.227904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:10:22.580434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226902+0000","last_change":"2024-01-25T14:59:54.224893+0000","last_active":"2024-01-25T15:01:26.226902+0000","last_peered":"2024-01-25T15:01:26.226902+0000","last_clean":"2024-01-25T15:01:26.226902+0000","last_became_active":"2024-01-25T14:59:54.224583+0000","last_became_peered":"2024-01-25T14:59:54.224583+0000","last_unstale":"2024-01-25T15:01:26.226902+0000","last_undegraded":"2024-01-25T15:01:26.226902+0000","last_fullsized":"2024-01-25T15:01:26.226902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:48:25.538489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.232195+0000","last_change":"2024-01-25T14:59:54.217030+0000","last_active":"2024-01-25T15:01:26.232195+0000","last_peered":"2024-01-25T15:01:26.232195+0000","last_clean":"2024-01-25T15:01:26.232195+0000","last_became_active":"2024-01-25T14:59:54.216732+0000","last_became_peered":"2024-01-25T14:59:54.216732+0000","last_unstale":"2024-01-25T15:01:26.232195+0000","last_undegraded":"2024-01-25T15:01:26.232195+0000","last_fullsized":"2024-01-25T15:01:26.232195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:58:36.072464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.230834+0000","last_change":"2024-01-25T14:59:54.223924+0000","last_active":"2024-01-25T15:01:26.230834+0000","last_peered":"2024-01-25T15:01:26.230834+0000","last_clean":"2024-01-25T15:01:26.230834+0000","last_became_active":"2024-01-25T14:59:54.223556+0000","last_became_peered":"2024-01-25T14:59:54.223556+0000","last_unstale":"2024-01-25T15:01:26.230834+0000","last_undegraded":"2024-01-25T15:01:26.230834+0000","last_fullsized":"2024-01-25T15:01:26.230834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:54:18.247501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.217329+0000","last_change":"2024-01-25T14:59:54.207125+0000","last_active":"2024-01-25T15:01:26.217329+0000","last_peered":"2024-01-25T15:01:26.217329+0000","last_clean":"2024-01-25T15:01:26.217329+0000","last_became_active":"2024-01-25T14:59:54.206630+0000","last_became_peered":"2024-01-25T14:59:54.206630+0000","last_unstale":"2024-01-25T15:01:26.217329+0000","last_undegraded":"2024-01-25T15:01:26.217329+0000","last_fullsized":"2024-01-25T15:01:26.217329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:10:12.685185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.220361+0000","last_change":"2024-01-25T14:59:54.210732+0000","last_active":"2024-01-25T15:01:26.220361+0000","last_peered":"2024-01-25T15:01:26.220361+0000","last_clean":"2024-01-25T15:01:26.220361+0000","last_became_active":"2024-01-25T14:59:54.210417+0000","last_became_peered":"2024-01-25T14:59:54.210417+0000","last_unstale":"2024-01-25T15:01:26.220361+0000","last_undegraded":"2024-01-25T15:01:26.220361+0000","last_fullsized":"2024-01-25T15:01:26.220361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:05:22.305485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"87'14","reported_seq":147,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:51.189082+0000","last_change":"2024-01-25T14:59:53.204680+0000","last_active":"2024-01-25T15:01:51.189082+0000","last_peered":"2024-01-25T15:01:51.189082+0000","last_clean":"2024-01-25T15:01:51.189082+0000","last_became_active":"2024-01-25T14:59:53.204327+0000","last_became_peered":"2024-01-25T14:59:53.204327+0000","last_unstale":"2024-01-25T15:01:51.189082+0000","last_undegraded":"2024-01-25T15:01:51.189082+0000","last_fullsized":"2024-01-25T15:01:51.189082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:32:16.333425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221365+0000","last_change":"2024-01-25T14:59:54.220501+0000","last_active":"2024-01-25T15:01:26.221365+0000","last_peered":"2024-01-25T15:01:26.221365+0000","last_clean":"2024-01-25T15:01:26.221365+0000","last_became_active":"2024-01-25T14:59:54.217150+0000","last_became_peered":"2024-01-25T14:59:54.217150+0000","last_unstale":"2024-01-25T15:01:26.221365+0000","last_undegraded":"2024-01-25T15:01:26.221365+0000","last_fullsized":"2024-01-25T15:01:26.221365+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:16:00.811698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284319+0000","last_change":"2024-01-25T14:59:53.209110+0000","last_active":"2024-01-25T15:00:57.284319+0000","last_peered":"2024-01-25T15:00:57.284319+0000","last_clean":"2024-01-25T15:00:57.284319+0000","last_became_active":"2024-01-25T14:59:53.208794+0000","last_became_peered":"2024-01-25T14:59:53.208794+0000","last_unstale":"2024-01-25T15:00:57.284319+0000","last_undegraded":"2024-01-25T15:00:57.284319+0000","last_fullsized":"2024-01-25T15:00:57.284319+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:51:40.757062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.232260+0000","last_change":"2024-01-25T14:59:54.219303+0000","last_active":"2024-01-25T15:01:26.232260+0000","last_peered":"2024-01-25T15:01:26.232260+0000","last_clean":"2024-01-25T15:01:26.232260+0000","last_became_active":"2024-01-25T14:59:54.218814+0000","last_became_peered":"2024-01-25T14:59:54.218814+0000","last_unstale":"2024-01-25T15:01:26.232260+0000","last_undegraded":"2024-01-25T15:01:26.232260+0000","last_fullsized":"2024-01-25T15:01:26.232260+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:54:30.556998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"87'13","reported_seq":33,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278791+0000","last_change":"2024-01-25T14:59:53.209770+0000","last_active":"2024-01-25T15:00:57.278791+0000","last_peered":"2024-01-25T15:00:57.278791+0000","last_clean":"2024-01-25T15:00:57.278791+0000","last_became_active":"2024-01-25T14:59:53.209466+0000","last_became_peered":"2024-01-25T14:59:53.209466+0000","last_unstale":"2024-01-25T15:00:57.278791+0000","last_undegraded":"2024-01-25T15:00:57.278791+0000","last_fullsized":"2024-01-25T15:00:57.278791+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:58:11.391155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.230793+0000","last_change":"2024-01-25T14:59:54.201559+0000","last_active":"2024-01-25T15:01:26.230793+0000","last_peered":"2024-01-25T15:01:26.230793+0000","last_clean":"2024-01-25T15:01:26.230793+0000","last_became_active":"2024-01-25T14:59:54.201155+0000","last_became_peered":"2024-01-25T14:59:54.201155+0000","last_unstale":"2024-01-25T15:01:26.230793+0000","last_undegraded":"2024-01-25T15:01:26.230793+0000","last_fullsized":"2024-01-25T15:01:26.230793+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:29:15.444879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278742+0000","last_change":"2024-01-25T14:59:53.208457+0000","last_active":"2024-01-25T15:00:57.278742+0000","last_peered":"2024-01-25T15:00:57.278742+0000","last_clean":"2024-01-25T15:00:57.278742+0000","last_became_active":"2024-01-25T14:59:53.208166+0000","last_became_peered":"2024-01-25T14:59:53.208166+0000","last_unstale":"2024-01-25T15:00:57.278742+0000","last_undegraded":"2024-01-25T15:00:57.278742+0000","last_fullsized":"2024-01-25T15:00:57.278742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:29:22.580726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.228568+0000","last_change":"2024-01-25T14:59:54.212126+0000","last_active":"2024-01-25T15:01:26.228568+0000","last_peered":"2024-01-25T15:01:26.228568+0000","last_clean":"2024-01-25T15:01:26.228568+0000","last_became_active":"2024-01-25T14:59:54.211519+0000","last_became_peered":"2024-01-25T14:59:54.211519+0000","last_unstale":"2024-01-25T15:01:26.228568+0000","last_undegraded":"2024-01-25T15:01:26.228568+0000","last_fullsized":"2024-01-25T15:01:26.228568+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:50:59.743852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"87'7","reported_seq":146,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:52.203218+0000","last_change":"2024-01-25T14:59:53.201803+0000","last_active":"2024-01-25T15:01:52.203218+0000","last_peered":"2024-01-25T15:01:52.203218+0000","last_clean":"2024-01-25T15:01:52.203218+0000","last_became_active":"2024-01-25T14:59:53.201464+0000","last_became_peered":"2024-01-25T14:59:53.201464+0000","last_unstale":"2024-01-25T15:01:52.203218+0000","last_undegraded":"2024-01-25T15:01:52.203218+0000","last_fullsized":"2024-01-25T15:01:52.203218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:36:03.922038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":120,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.227153+0000","last_change":"2024-01-25T14:59:54.207126+0000","last_active":"2024-01-25T15:01:26.227153+0000","last_peered":"2024-01-25T15:01:26.227153+0000","last_clean":"2024-01-25T15:01:26.227153+0000","last_became_active":"2024-01-25T14:59:54.206826+0000","last_became_peered":"2024-01-25T14:59:54.206826+0000","last_unstale":"2024-01-25T15:01:26.227153+0000","last_undegraded":"2024-01-25T15:01:26.227153+0000","last_fullsized":"2024-01-25T15:01:26.227153+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:45:07.217919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281277+0000","last_change":"2024-01-25T14:59:53.200335+0000","last_active":"2024-01-25T15:00:57.281277+0000","last_peered":"2024-01-25T15:00:57.281277+0000","last_clean":"2024-01-25T15:00:57.281277+0000","last_became_active":"2024-01-25T14:59:53.200028+0000","last_became_peered":"2024-01-25T14:59:53.200028+0000","last_unstale":"2024-01-25T15:00:57.281277+0000","last_undegraded":"2024-01-25T15:00:57.281277+0000","last_fullsized":"2024-01-25T15:00:57.281277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:23:26.178260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.219277+0000","last_change":"2024-01-25T14:59:54.211048+0000","last_active":"2024-01-25T15:01:26.219277+0000","last_peered":"2024-01-25T15:01:26.219277+0000","last_clean":"2024-01-25T15:01:26.219277+0000","last_became_active":"2024-01-25T14:59:54.210724+0000","last_became_peered":"2024-01-25T14:59:54.210724+0000","last_unstale":"2024-01-25T15:01:26.219277+0000","last_undegraded":"2024-01-25T15:01:26.219277+0000","last_fullsized":"2024-01-25T15:01:26.219277+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:59:40.171707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279454+0000","last_change":"2024-01-25T14:59:53.202235+0000","last_active":"2024-01-25T15:00:57.279454+0000","last_peered":"2024-01-25T15:00:57.279454+0000","last_clean":"2024-01-25T15:00:57.279454+0000","last_became_active":"2024-01-25T14:59:53.201933+0000","last_became_peered":"2024-01-25T14:59:53.201933+0000","last_unstale":"2024-01-25T15:00:57.279454+0000","last_undegraded":"2024-01-25T15:00:57.279454+0000","last_fullsized":"2024-01-25T15:00:57.279454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:40:23.725903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.220083+0000","last_change":"2024-01-25T14:59:54.205184+0000","last_active":"2024-01-25T15:01:26.220083+0000","last_peered":"2024-01-25T15:01:26.220083+0000","last_clean":"2024-01-25T15:01:26.220083+0000","last_became_active":"2024-01-25T14:59:54.204865+0000","last_became_peered":"2024-01-25T14:59:54.204865+0000","last_unstale":"2024-01-25T15:01:26.220083+0000","last_undegraded":"2024-01-25T15:01:26.220083+0000","last_fullsized":"2024-01-25T15:01:26.220083+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:07:25.559601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283603+0000","last_change":"2024-01-25T14:59:53.205021+0000","last_active":"2024-01-25T15:00:57.283603+0000","last_peered":"2024-01-25T15:00:57.283603+0000","last_clean":"2024-01-25T15:00:57.283603+0000","last_became_active":"2024-01-25T14:59:53.203925+0000","last_became_peered":"2024-01-25T14:59:53.203925+0000","last_unstale":"2024-01-25T15:00:57.283603+0000","last_undegraded":"2024-01-25T15:00:57.283603+0000","last_fullsized":"2024-01-25T15:00:57.283603+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:20:43.003659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.218984+0000","last_change":"2024-01-25T14:59:54.207234+0000","last_active":"2024-01-25T15:01:26.218984+0000","last_peered":"2024-01-25T15:01:26.218984+0000","last_clean":"2024-01-25T15:01:26.218984+0000","last_became_active":"2024-01-25T14:59:54.206727+0000","last_became_peered":"2024-01-25T14:59:54.206727+0000","last_unstale":"2024-01-25T15:01:26.218984+0000","last_undegraded":"2024-01-25T15:01:26.218984+0000","last_fullsized":"2024-01-25T15:01:26.218984+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:29:08.678821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'6","reported_seq":253,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:52.202580+0000","last_change":"2024-01-25T14:59:53.204198+0000","last_active":"2024-01-25T15:01:52.202580+0000","last_peered":"2024-01-25T15:01:52.202580+0000","last_clean":"2024-01-25T15:01:52.202580+0000","last_became_active":"2024-01-25T14:59:53.203844+0000","last_became_peered":"2024-01-25T14:59:53.203844+0000","last_unstale":"2024-01-25T15:01:52.202580+0000","last_undegraded":"2024-01-25T15:01:52.202580+0000","last_fullsized":"2024-01-25T15:01:52.202580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:30:23.735236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":228,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226081+0000","last_change":"2024-01-25T14:59:54.203318+0000","last_active":"2024-01-25T15:01:26.226081+0000","last_peered":"2024-01-25T15:01:26.226081+0000","last_clean":"2024-01-25T15:01:26.226081+0000","last_became_active":"2024-01-25T14:59:54.202971+0000","last_became_peered":"2024-01-25T14:59:54.202971+0000","last_unstale":"2024-01-25T15:01:26.226081+0000","last_undegraded":"2024-01-25T15:01:26.226081+0000","last_fullsized":"2024-01-25T15:01:26.226081+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:57:59.454857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'4","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.300726+0000","last_change":"2024-01-25T15:00:57.300726+0000","last_active":"2024-01-25T15:00:57.300726+0000","last_peered":"2024-01-25T15:00:57.300726+0000","last_clean":"2024-01-25T15:00:57.300726+0000","last_became_active":"2024-01-25T15:00:57.288184+0000","last_became_peered":"2024-01-25T15:00:57.288184+0000","last_unstale":"2024-01-25T15:00:57.300726+0000","last_undegraded":"2024-01-25T15:00:57.300726+0000","last_fullsized":"2024-01-25T15:00:57.300726+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:17:00.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226739+0000","last_change":"2024-01-25T14:59:54.225131+0000","last_active":"2024-01-25T15:01:26.226739+0000","last_peered":"2024-01-25T15:01:26.226739+0000","last_clean":"2024-01-25T15:01:26.226739+0000","last_became_active":"2024-01-25T14:59:54.224786+0000","last_became_peered":"2024-01-25T14:59:54.224786+0000","last_unstale":"2024-01-25T15:01:26.226739+0000","last_undegraded":"2024-01-25T15:01:26.226739+0000","last_fullsized":"2024-01-25T15:01:26.226739+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:25:07.426433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283977+0000","last_change":"2024-01-25T14:59:53.199834+0000","last_active":"2024-01-25T15:00:57.283977+0000","last_peered":"2024-01-25T15:00:57.283977+0000","last_clean":"2024-01-25T15:00:57.283977+0000","last_became_active":"2024-01-25T14:59:53.199545+0000","last_became_peered":"2024-01-25T14:59:53.199545+0000","last_unstale":"2024-01-25T15:00:57.283977+0000","last_undegraded":"2024-01-25T15:00:57.283977+0000","last_fullsized":"2024-01-25T15:00:57.283977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:38:08.973583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.232212+0000","last_change":"2024-01-25T14:59:54.214768+0000","last_active":"2024-01-25T15:01:26.232212+0000","last_peered":"2024-01-25T15:01:26.232212+0000","last_clean":"2024-01-25T15:01:26.232212+0000","last_became_active":"2024-01-25T14:59:54.214038+0000","last_became_peered":"2024-01-25T14:59:54.214038+0000","last_unstale":"2024-01-25T15:01:26.232212+0000","last_undegraded":"2024-01-25T15:01:26.232212+0000","last_fullsized":"2024-01-25T15:01:26.232212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:10:20.162756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'36","reported_seq":317,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:52.375353+0000","last_change":"2024-01-25T15:00:57.297320+0000","last_active":"2024-01-25T15:01:52.375353+0000","last_peered":"2024-01-25T15:01:52.375353+0000","last_clean":"2024-01-25T15:01:52.375353+0000","last_became_active":"2024-01-25T15:00:57.287208+0000","last_became_peered":"2024-01-25T15:00:57.287208+0000","last_unstale":"2024-01-25T15:01:52.375353+0000","last_undegraded":"2024-01-25T15:01:52.375353+0000","last_fullsized":"2024-01-25T15:01:52.375353+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:36:17.161523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63592,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":228,"num_read_kb":176,"num_write":38,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":58331,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.225776+0000","last_change":"2024-01-25T14:59:54.217069+0000","last_active":"2024-01-25T15:01:26.225776+0000","last_peered":"2024-01-25T15:01:26.225776+0000","last_clean":"2024-01-25T15:01:26.225776+0000","last_became_active":"2024-01-25T14:59:54.216749+0000","last_became_peered":"2024-01-25T14:59:54.216749+0000","last_unstale":"2024-01-25T15:01:26.225776+0000","last_undegraded":"2024-01-25T15:01:26.225776+0000","last_fullsized":"2024-01-25T15:01:26.225776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:31:00.903462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'9","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282050+0000","last_change":"2024-01-25T14:59:53.198852+0000","last_active":"2024-01-25T15:00:57.282050+0000","last_peered":"2024-01-25T15:00:57.282050+0000","last_clean":"2024-01-25T15:00:57.282050+0000","last_became_active":"2024-01-25T14:59:53.198532+0000","last_became_peered":"2024-01-25T14:59:53.198532+0000","last_unstale":"2024-01-25T15:00:57.282050+0000","last_undegraded":"2024-01-25T15:00:57.282050+0000","last_fullsized":"2024-01-25T15:00:57.282050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:03:43.251730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.217159+0000","last_change":"2024-01-25T14:59:54.209865+0000","last_active":"2024-01-25T15:01:26.217159+0000","last_peered":"2024-01-25T15:01:26.217159+0000","last_clean":"2024-01-25T15:01:26.217159+0000","last_became_active":"2024-01-25T14:59:54.209564+0000","last_became_peered":"2024-01-25T14:59:54.209564+0000","last_unstale":"2024-01-25T15:01:26.217159+0000","last_undegraded":"2024-01-25T15:01:26.217159+0000","last_fullsized":"2024-01-25T15:01:26.217159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:19:24.461651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'5","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283550+0000","last_change":"2024-01-25T14:59:53.207644+0000","last_active":"2024-01-25T15:00:57.283550+0000","last_peered":"2024-01-25T15:00:57.283550+0000","last_clean":"2024-01-25T15:00:57.283550+0000","last_became_active":"2024-01-25T14:59:53.207321+0000","last_became_peered":"2024-01-25T14:59:53.207321+0000","last_unstale":"2024-01-25T15:00:57.283550+0000","last_undegraded":"2024-01-25T15:00:57.283550+0000","last_fullsized":"2024-01-25T15:00:57.283550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:47:12.131711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.224293+0000","last_change":"2024-01-25T14:59:54.220548+0000","last_active":"2024-01-25T15:01:26.224293+0000","last_peered":"2024-01-25T15:01:26.224293+0000","last_clean":"2024-01-25T15:01:26.224293+0000","last_became_active":"2024-01-25T14:59:54.219743+0000","last_became_peered":"2024-01-25T14:59:54.219743+0000","last_unstale":"2024-01-25T15:01:26.224293+0000","last_undegraded":"2024-01-25T15:01:26.224293+0000","last_fullsized":"2024-01-25T15:01:26.224293+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:46:12.085591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'5","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:50.189040+0000","last_change":"2024-01-25T14:59:53.201233+0000","last_active":"2024-01-25T15:01:50.189040+0000","last_peered":"2024-01-25T15:01:50.189040+0000","last_clean":"2024-01-25T15:01:50.189040+0000","last_became_active":"2024-01-25T14:59:53.200907+0000","last_became_peered":"2024-01-25T14:59:53.200907+0000","last_unstale":"2024-01-25T15:01:50.189040+0000","last_undegraded":"2024-01-25T15:01:50.189040+0000","last_fullsized":"2024-01-25T15:01:50.189040+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:30:59.640179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221042+0000","last_change":"2024-01-25T14:59:54.212617+0000","last_active":"2024-01-25T15:01:26.221042+0000","last_peered":"2024-01-25T15:01:26.221042+0000","last_clean":"2024-01-25T15:01:26.221042+0000","last_became_active":"2024-01-25T14:59:54.212328+0000","last_became_peered":"2024-01-25T14:59:54.212328+0000","last_unstale":"2024-01-25T15:01:26.221042+0000","last_undegraded":"2024-01-25T15:01:26.221042+0000","last_fullsized":"2024-01-25T15:01:26.221042+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:21:16.958894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'17","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278147+0000","last_change":"2024-01-25T14:59:53.202685+0000","last_active":"2024-01-25T15:00:57.278147+0000","last_peered":"2024-01-25T15:00:57.278147+0000","last_clean":"2024-01-25T15:00:57.278147+0000","last_became_active":"2024-01-25T14:59:53.201529+0000","last_became_peered":"2024-01-25T14:59:53.201529+0000","last_unstale":"2024-01-25T15:00:57.278147+0000","last_undegraded":"2024-01-25T15:00:57.278147+0000","last_fullsized":"2024-01-25T15:00:57.278147+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:43:29.823959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.223899+0000","last_change":"2024-01-25T14:59:54.208724+0000","last_active":"2024-01-25T15:01:26.223899+0000","last_peered":"2024-01-25T15:01:26.223899+0000","last_clean":"2024-01-25T15:01:26.223899+0000","last_became_active":"2024-01-25T14:59:54.208392+0000","last_became_peered":"2024-01-25T14:59:54.208392+0000","last_unstale":"2024-01-25T15:01:26.223899+0000","last_undegraded":"2024-01-25T15:01:26.223899+0000","last_fullsized":"2024-01-25T15:01:26.223899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:00:37.285702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.291362+0000","last_change":"2024-01-25T15:00:57.290806+0000","last_active":"2024-01-25T15:00:57.291362+0000","last_peered":"2024-01-25T15:00:57.291362+0000","last_clean":"2024-01-25T15:00:57.291362+0000","last_became_active":"2024-01-25T15:00:57.285194+0000","last_became_peered":"2024-01-25T15:00:57.285194+0000","last_unstale":"2024-01-25T15:00:57.291362+0000","last_undegraded":"2024-01-25T15:00:57.291362+0000","last_fullsized":"2024-01-25T15:00:57.291362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:49:16.627616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.224447+0000","last_change":"2024-01-25T14:59:54.216918+0000","last_active":"2024-01-25T15:01:26.224447+0000","last_peered":"2024-01-25T15:01:26.224447+0000","last_clean":"2024-01-25T15:01:26.224447+0000","last_became_active":"2024-01-25T14:59:54.216283+0000","last_became_peered":"2024-01-25T14:59:54.216283+0000","last_unstale":"2024-01-25T15:01:26.224447+0000","last_undegraded":"2024-01-25T15:01:26.224447+0000","last_fullsized":"2024-01-25T15:01:26.224447+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:15:11.192764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.280876+0000","last_change":"2024-01-25T14:59:53.207266+0000","last_active":"2024-01-25T15:00:57.280876+0000","last_peered":"2024-01-25T15:00:57.280876+0000","last_clean":"2024-01-25T15:00:57.280876+0000","last_became_active":"2024-01-25T14:59:53.206820+0000","last_became_peered":"2024-01-25T14:59:53.206820+0000","last_unstale":"2024-01-25T15:00:57.280876+0000","last_undegraded":"2024-01-25T15:00:57.280876+0000","last_fullsized":"2024-01-25T15:00:57.280876+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:29:02.371577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.215941+0000","last_change":"2024-01-25T14:59:54.210434+0000","last_active":"2024-01-25T15:01:26.215941+0000","last_peered":"2024-01-25T15:01:26.215941+0000","last_clean":"2024-01-25T15:01:26.215941+0000","last_became_active":"2024-01-25T14:59:54.210100+0000","last_became_peered":"2024-01-25T14:59:54.210100+0000","last_unstale":"2024-01-25T15:01:26.215941+0000","last_undegraded":"2024-01-25T15:01:26.215941+0000","last_fullsized":"2024-01-25T15:01:26.215941+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T19:48:21.463712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'5","reported_seq":135,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:48.186230+0000","last_change":"2024-01-25T14:59:53.202938+0000","last_active":"2024-01-25T15:01:48.186230+0000","last_peered":"2024-01-25T15:01:48.186230+0000","last_clean":"2024-01-25T15:01:48.186230+0000","last_became_active":"2024-01-25T14:59:53.202638+0000","last_became_peered":"2024-01-25T14:59:53.202638+0000","last_unstale":"2024-01-25T15:01:48.186230+0000","last_undegraded":"2024-01-25T15:01:48.186230+0000","last_fullsized":"2024-01-25T15:01:48.186230+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:49:00.371375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.202039+0000","last_change":"2024-01-25T14:59:54.219778+0000","last_active":"2024-01-25T15:01:26.202039+0000","last_peered":"2024-01-25T15:01:26.202039+0000","last_clean":"2024-01-25T15:01:26.202039+0000","last_became_active":"2024-01-25T14:59:54.219385+0000","last_became_peered":"2024-01-25T14:59:54.219385+0000","last_unstale":"2024-01-25T15:01:26.202039+0000","last_undegraded":"2024-01-25T15:01:26.202039+0000","last_fullsized":"2024-01-25T15:01:26.202039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:49:27.929024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.224651+0000","last_change":"2024-01-25T14:59:54.209306+0000","last_active":"2024-01-25T15:01:26.224651+0000","last_peered":"2024-01-25T15:01:26.224651+0000","last_clean":"2024-01-25T15:01:26.224651+0000","last_became_active":"2024-01-25T14:59:54.208979+0000","last_became_peered":"2024-01-25T14:59:54.208979+0000","last_unstale":"2024-01-25T15:01:26.224651+0000","last_undegraded":"2024-01-25T15:01:26.224651+0000","last_fullsized":"2024-01-25T15:01:26.224651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:23:46.763358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'5","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:52.190936+0000","last_change":"2024-01-25T14:59:53.200590+0000","last_active":"2024-01-25T15:01:52.190936+0000","last_peered":"2024-01-25T15:01:52.190936+0000","last_clean":"2024-01-25T15:01:52.190936+0000","last_became_active":"2024-01-25T14:59:53.200292+0000","last_became_peered":"2024-01-25T14:59:53.200292+0000","last_unstale":"2024-01-25T15:01:52.190936+0000","last_undegraded":"2024-01-25T15:01:52.190936+0000","last_fullsized":"2024-01-25T15:01:52.190936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:02:05.135314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.222120+0000","last_change":"2024-01-25T14:59:54.217765+0000","last_active":"2024-01-25T15:01:26.222120+0000","last_peered":"2024-01-25T15:01:26.222120+0000","last_clean":"2024-01-25T15:01:26.222120+0000","last_became_active":"2024-01-25T14:59:54.217433+0000","last_became_peered":"2024-01-25T14:59:54.217433+0000","last_unstale":"2024-01-25T15:01:26.222120+0000","last_undegraded":"2024-01-25T15:01:26.222120+0000","last_fullsized":"2024-01-25T15:01:26.222120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:45:25.520091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279378+0000","last_change":"2024-01-25T14:59:53.197543+0000","last_active":"2024-01-25T15:00:57.279378+0000","last_peered":"2024-01-25T15:00:57.279378+0000","last_clean":"2024-01-25T15:00:57.279378+0000","last_became_active":"2024-01-25T14:59:53.197213+0000","last_became_peered":"2024-01-25T14:59:53.197213+0000","last_unstale":"2024-01-25T15:00:57.279378+0000","last_undegraded":"2024-01-25T15:00:57.279378+0000","last_fullsized":"2024-01-25T15:00:57.279378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:19:39.477948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282381+0000","last_change":"2024-01-25T14:58:41.034413+0000","last_active":"2024-01-25T15:00:57.282381+0000","last_peered":"2024-01-25T15:00:57.282381+0000","last_clean":"2024-01-25T15:00:57.282381+0000","last_became_active":"2024-01-25T14:58:41.033881+0000","last_became_peered":"2024-01-25T14:58:41.033881+0000","last_unstale":"2024-01-25T15:00:57.282381+0000","last_undegraded":"2024-01-25T15:00:57.282381+0000","last_fullsized":"2024-01-25T15:00:57.282381+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:55:22.974068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:55:22.974068+0000","last_clean_scrub_stamp":"2024-01-25T14:55:22.974068+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:05:30.918277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221753+0000","last_change":"2024-01-25T14:59:54.214713+0000","last_active":"2024-01-25T15:01:26.221753+0000","last_peered":"2024-01-25T15:01:26.221753+0000","last_clean":"2024-01-25T15:01:26.221753+0000","last_became_active":"2024-01-25T14:59:54.214348+0000","last_became_peered":"2024-01-25T14:59:54.214348+0000","last_unstale":"2024-01-25T15:01:26.221753+0000","last_undegraded":"2024-01-25T15:01:26.221753+0000","last_fullsized":"2024-01-25T15:01:26.221753+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:11:46.134755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.282443+0000","last_change":"2024-01-25T14:59:53.202970+0000","last_active":"2024-01-25T15:00:57.282443+0000","last_peered":"2024-01-25T15:00:57.282443+0000","last_clean":"2024-01-25T15:00:57.282443+0000","last_became_active":"2024-01-25T14:59:53.202680+0000","last_became_peered":"2024-01-25T14:59:53.202680+0000","last_unstale":"2024-01-25T15:00:57.282443+0000","last_undegraded":"2024-01-25T15:00:57.282443+0000","last_fullsized":"2024-01-25T15:00:57.282443+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:28:12.628390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278506+0000","last_change":"2024-01-25T14:59:53.210040+0000","last_active":"2024-01-25T15:00:57.278506+0000","last_peered":"2024-01-25T15:00:57.278506+0000","last_clean":"2024-01-25T15:00:57.278506+0000","last_became_active":"2024-01-25T14:59:53.209636+0000","last_became_peered":"2024-01-25T14:59:53.209636+0000","last_unstale":"2024-01-25T15:00:57.278506+0000","last_undegraded":"2024-01-25T15:00:57.278506+0000","last_fullsized":"2024-01-25T15:00:57.278506+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:22:45.268969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.211212+0000","last_change":"2024-01-25T14:59:54.203875+0000","last_active":"2024-01-25T15:01:26.211212+0000","last_peered":"2024-01-25T15:01:26.211212+0000","last_clean":"2024-01-25T15:01:26.211212+0000","last_became_active":"2024-01-25T14:59:54.203573+0000","last_became_peered":"2024-01-25T14:59:54.203573+0000","last_unstale":"2024-01-25T15:01:26.211212+0000","last_undegraded":"2024-01-25T15:01:26.211212+0000","last_fullsized":"2024-01-25T15:01:26.211212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T23:16:33.124186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'12","reported_seq":47,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:30.041997+0000","last_change":"2024-01-25T15:00:57.292346+0000","last_active":"2024-01-25T15:01:30.041997+0000","last_peered":"2024-01-25T15:01:30.041997+0000","last_clean":"2024-01-25T15:01:30.041997+0000","last_became_active":"2024-01-25T15:00:57.284921+0000","last_became_peered":"2024-01-25T15:00:57.284921+0000","last_unstale":"2024-01-25T15:01:30.041997+0000","last_undegraded":"2024-01-25T15:01:30.041997+0000","last_fullsized":"2024-01-25T15:01:30.041997+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:35:09.229129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.222766+0000","last_change":"2024-01-25T14:59:54.212444+0000","last_active":"2024-01-25T15:01:26.222766+0000","last_peered":"2024-01-25T15:01:26.222766+0000","last_clean":"2024-01-25T15:01:26.222766+0000","last_became_active":"2024-01-25T14:59:54.212090+0000","last_became_peered":"2024-01-25T14:59:54.212090+0000","last_unstale":"2024-01-25T15:01:26.222766+0000","last_undegraded":"2024-01-25T15:01:26.222766+0000","last_fullsized":"2024-01-25T15:01:26.222766+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:27:26.416373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'7","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279589+0000","last_change":"2024-01-25T14:59:53.199984+0000","last_active":"2024-01-25T15:00:57.279589+0000","last_peered":"2024-01-25T15:00:57.279589+0000","last_clean":"2024-01-25T15:00:57.279589+0000","last_became_active":"2024-01-25T14:59:53.199674+0000","last_became_peered":"2024-01-25T14:59:53.199674+0000","last_unstale":"2024-01-25T15:00:57.279589+0000","last_undegraded":"2024-01-25T15:00:57.279589+0000","last_fullsized":"2024-01-25T15:00:57.279589+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:22:01.521516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.228496+0000","last_change":"2024-01-25T14:59:54.224285+0000","last_active":"2024-01-25T15:01:26.228496+0000","last_peered":"2024-01-25T15:01:26.228496+0000","last_clean":"2024-01-25T15:01:26.228496+0000","last_became_active":"2024-01-25T14:59:54.223904+0000","last_became_peered":"2024-01-25T14:59:54.223904+0000","last_unstale":"2024-01-25T15:01:26.228496+0000","last_undegraded":"2024-01-25T15:01:26.228496+0000","last_fullsized":"2024-01-25T15:01:26.228496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:49:24.717733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.284549+0000","last_change":"2024-01-25T14:59:53.203501+0000","last_active":"2024-01-25T15:00:57.284549+0000","last_peered":"2024-01-25T15:00:57.284549+0000","last_clean":"2024-01-25T15:00:57.284549+0000","last_became_active":"2024-01-25T14:59:53.203215+0000","last_became_peered":"2024-01-25T14:59:53.203215+0000","last_unstale":"2024-01-25T15:00:57.284549+0000","last_undegraded":"2024-01-25T15:00:57.284549+0000","last_fullsized":"2024-01-25T15:00:57.284549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:18:25.174639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.185770+0000","last_change":"2024-01-25T14:59:54.219575+0000","last_active":"2024-01-25T15:01:26.185770+0000","last_peered":"2024-01-25T15:01:26.185770+0000","last_clean":"2024-01-25T15:01:26.185770+0000","last_became_active":"2024-01-25T14:59:54.219170+0000","last_became_peered":"2024-01-25T14:59:54.219170+0000","last_unstale":"2024-01-25T15:01:26.185770+0000","last_undegraded":"2024-01-25T15:01:26.185770+0000","last_fullsized":"2024-01-25T15:01:26.185770+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:17:41.940927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'7","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283084+0000","last_change":"2024-01-25T14:59:53.203864+0000","last_active":"2024-01-25T15:00:57.283084+0000","last_peered":"2024-01-25T15:00:57.283084+0000","last_clean":"2024-01-25T15:00:57.283084+0000","last_became_active":"2024-01-25T14:59:53.203564+0000","last_became_peered":"2024-01-25T14:59:53.203564+0000","last_unstale":"2024-01-25T15:00:57.283084+0000","last_undegraded":"2024-01-25T15:00:57.283084+0000","last_fullsized":"2024-01-25T15:00:57.283084+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:03:21.776910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226178+0000","last_change":"2024-01-25T14:59:54.217014+0000","last_active":"2024-01-25T15:01:26.226178+0000","last_peered":"2024-01-25T15:01:26.226178+0000","last_clean":"2024-01-25T15:01:26.226178+0000","last_became_active":"2024-01-25T14:59:54.216673+0000","last_became_peered":"2024-01-25T14:59:54.216673+0000","last_unstale":"2024-01-25T15:01:26.226178+0000","last_undegraded":"2024-01-25T15:01:26.226178+0000","last_fullsized":"2024-01-25T15:01:26.226178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:46:31.238673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.281990+0000","last_change":"2024-01-25T14:59:53.207297+0000","last_active":"2024-01-25T15:00:57.281990+0000","last_peered":"2024-01-25T15:00:57.281990+0000","last_clean":"2024-01-25T15:00:57.281990+0000","last_became_active":"2024-01-25T14:59:53.206968+0000","last_became_peered":"2024-01-25T14:59:53.206968+0000","last_unstale":"2024-01-25T15:00:57.281990+0000","last_undegraded":"2024-01-25T15:00:57.281990+0000","last_fullsized":"2024-01-25T15:00:57.281990+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:44:01.679360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.225254+0000","last_change":"2024-01-25T14:59:54.218890+0000","last_active":"2024-01-25T15:01:26.225254+0000","last_peered":"2024-01-25T15:01:26.225254+0000","last_clean":"2024-01-25T15:01:26.225254+0000","last_became_active":"2024-01-25T14:59:54.218581+0000","last_became_peered":"2024-01-25T14:59:54.218581+0000","last_unstale":"2024-01-25T15:01:26.225254+0000","last_undegraded":"2024-01-25T15:01:26.225254+0000","last_fullsized":"2024-01-25T15:01:26.225254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:13:07.383270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.278450+0000","last_change":"2024-01-25T14:59:53.208219+0000","last_active":"2024-01-25T15:00:57.278450+0000","last_peered":"2024-01-25T15:00:57.278450+0000","last_clean":"2024-01-25T15:00:57.278450+0000","last_became_active":"2024-01-25T14:59:53.207878+0000","last_became_peered":"2024-01-25T14:59:53.207878+0000","last_unstale":"2024-01-25T15:00:57.278450+0000","last_undegraded":"2024-01-25T15:00:57.278450+0000","last_fullsized":"2024-01-25T15:00:57.278450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:13:03.410383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.230836+0000","last_change":"2024-01-25T14:59:54.208996+0000","last_active":"2024-01-25T15:01:26.230836+0000","last_peered":"2024-01-25T15:01:26.230836+0000","last_clean":"2024-01-25T15:01:26.230836+0000","last_became_active":"2024-01-25T14:59:54.208658+0000","last_became_peered":"2024-01-25T14:59:54.208658+0000","last_unstale":"2024-01-25T15:01:26.230836+0000","last_undegraded":"2024-01-25T15:01:26.230836+0000","last_fullsized":"2024-01-25T15:01:26.230836+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:39:57.752381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'6","reported_seq":140,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:50.200224+0000","last_change":"2024-01-25T14:59:53.207106+0000","last_active":"2024-01-25T15:01:50.200224+0000","last_peered":"2024-01-25T15:01:50.200224+0000","last_clean":"2024-01-25T15:01:50.200224+0000","last_became_active":"2024-01-25T14:59:53.206688+0000","last_became_peered":"2024-01-25T14:59:53.206688+0000","last_unstale":"2024-01-25T15:01:50.200224+0000","last_undegraded":"2024-01-25T15:01:50.200224+0000","last_fullsized":"2024-01-25T15:01:50.200224+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:30:03.019791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1478,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":115,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.231461+0000","last_change":"2024-01-25T14:59:54.208994+0000","last_active":"2024-01-25T15:01:26.231461+0000","last_peered":"2024-01-25T15:01:26.231461+0000","last_clean":"2024-01-25T15:01:26.231461+0000","last_became_active":"2024-01-25T14:59:54.208638+0000","last_became_peered":"2024-01-25T14:59:54.208638+0000","last_unstale":"2024-01-25T15:01:26.231461+0000","last_undegraded":"2024-01-25T15:01:26.231461+0000","last_fullsized":"2024-01-25T15:01:26.231461+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:18:56.001501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.283687+0000","last_change":"2024-01-25T14:59:53.207659+0000","last_active":"2024-01-25T15:00:57.283687+0000","last_peered":"2024-01-25T15:00:57.283687+0000","last_clean":"2024-01-25T15:00:57.283687+0000","last_became_active":"2024-01-25T14:59:53.207373+0000","last_became_peered":"2024-01-25T14:59:53.207373+0000","last_unstale":"2024-01-25T15:00:57.283687+0000","last_undegraded":"2024-01-25T15:00:57.283687+0000","last_fullsized":"2024-01-25T15:00:57.283687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:02:18.884192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.219871+0000","last_change":"2024-01-25T14:59:54.210415+0000","last_active":"2024-01-25T15:01:26.219871+0000","last_peered":"2024-01-25T15:01:26.219871+0000","last_clean":"2024-01-25T15:01:26.219871+0000","last_became_active":"2024-01-25T14:59:54.210097+0000","last_became_peered":"2024-01-25T14:59:54.210097+0000","last_unstale":"2024-01-25T15:01:26.219871+0000","last_undegraded":"2024-01-25T15:01:26.219871+0000","last_fullsized":"2024-01-25T15:01:26.219871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T15:43:18.764375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"85'5","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:00:57.279899+0000","last_change":"2024-01-25T14:59:53.203526+0000","last_active":"2024-01-25T15:00:57.279899+0000","last_peered":"2024-01-25T15:00:57.279899+0000","last_clean":"2024-01-25T15:00:57.279899+0000","last_became_active":"2024-01-25T14:59:53.203223+0000","last_became_peered":"2024-01-25T14:59:53.203223+0000","last_unstale":"2024-01-25T15:00:57.279899+0000","last_undegraded":"2024-01-25T15:00:57.279899+0000","last_fullsized":"2024-01-25T15:00:57.279899+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:52.177366+0000","last_clean_scrub_stamp":"2024-01-25T14:59:52.177366+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T01:35:06.014547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226672+0000","last_change":"2024-01-25T14:59:54.219053+0000","last_active":"2024-01-25T15:01:26.226672+0000","last_peered":"2024-01-25T15:01:26.226672+0000","last_clean":"2024-01-25T15:01:26.226672+0000","last_became_active":"2024-01-25T14:59:54.218733+0000","last_became_peered":"2024-01-25T14:59:54.218733+0000","last_unstale":"2024-01-25T15:01:26.226672+0000","last_undegraded":"2024-01-25T15:01:26.226672+0000","last_fullsized":"2024-01-25T15:01:26.226672+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T20:07:19.083352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.225238+0000","last_change":"2024-01-25T14:59:54.210644+0000","last_active":"2024-01-25T15:01:26.225238+0000","last_peered":"2024-01-25T15:01:26.225238+0000","last_clean":"2024-01-25T15:01:26.225238+0000","last_became_active":"2024-01-25T14:59:54.210333+0000","last_became_peered":"2024-01-25T14:59:54.210333+0000","last_unstale":"2024-01-25T15:01:26.225238+0000","last_undegraded":"2024-01-25T15:01:26.225238+0000","last_fullsized":"2024-01-25T15:01:26.225238+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:25:06.201952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.216766+0000","last_change":"2024-01-25T15:00:57.286523+0000","last_active":"2024-01-25T15:01:26.216766+0000","last_peered":"2024-01-25T15:01:26.216766+0000","last_clean":"2024-01-25T15:01:26.216766+0000","last_became_active":"2024-01-25T15:00:57.286115+0000","last_became_peered":"2024-01-25T15:00:57.286115+0000","last_unstale":"2024-01-25T15:01:26.216766+0000","last_undegraded":"2024-01-25T15:01:26.216766+0000","last_fullsized":"2024-01-25T15:01:26.216766+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:53:47.571571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.200328+0000","last_change":"2024-01-25T14:59:54.218260+0000","last_active":"2024-01-25T15:01:26.200328+0000","last_peered":"2024-01-25T15:01:26.200328+0000","last_clean":"2024-01-25T15:01:26.200328+0000","last_became_active":"2024-01-25T14:59:54.217381+0000","last_became_peered":"2024-01-25T14:59:54.217381+0000","last_unstale":"2024-01-25T15:01:26.200328+0000","last_undegraded":"2024-01-25T15:01:26.200328+0000","last_fullsized":"2024-01-25T15:01:26.200328+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:36:09.631749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.226804+0000","last_change":"2024-01-25T14:59:54.224518+0000","last_active":"2024-01-25T15:01:26.226804+0000","last_peered":"2024-01-25T15:01:26.226804+0000","last_clean":"2024-01-25T15:01:26.226804+0000","last_became_active":"2024-01-25T14:59:54.224210+0000","last_became_peered":"2024-01-25T14:59:54.224210+0000","last_unstale":"2024-01-25T15:01:26.226804+0000","last_undegraded":"2024-01-25T15:01:26.226804+0000","last_fullsized":"2024-01-25T15:01:26.226804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:33:56.670077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.224130+0000","last_change":"2024-01-25T15:00:57.282096+0000","last_active":"2024-01-25T15:01:26.224130+0000","last_peered":"2024-01-25T15:01:26.224130+0000","last_clean":"2024-01-25T15:01:26.224130+0000","last_became_active":"2024-01-25T15:00:57.281725+0000","last_became_peered":"2024-01-25T15:00:57.281725+0000","last_unstale":"2024-01-25T15:01:26.224130+0000","last_undegraded":"2024-01-25T15:01:26.224130+0000","last_fullsized":"2024-01-25T15:01:26.224130+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T18:53:03.519667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.227701+0000","last_change":"2024-01-25T14:59:54.217690+0000","last_active":"2024-01-25T15:01:26.227701+0000","last_peered":"2024-01-25T15:01:26.227701+0000","last_clean":"2024-01-25T15:01:26.227701+0000","last_became_active":"2024-01-25T14:59:54.217361+0000","last_became_peered":"2024-01-25T14:59:54.217361+0000","last_unstale":"2024-01-25T15:01:26.227701+0000","last_undegraded":"2024-01-25T15:01:26.227701+0000","last_fullsized":"2024-01-25T15:01:26.227701+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T17:30:15.893502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.212394+0000","last_change":"2024-01-25T14:59:54.205201+0000","last_active":"2024-01-25T15:01:26.212394+0000","last_peered":"2024-01-25T15:01:26.212394+0000","last_clean":"2024-01-25T15:01:26.212394+0000","last_became_active":"2024-01-25T14:59:54.204893+0000","last_became_peered":"2024-01-25T14:59:54.204893+0000","last_unstale":"2024-01-25T15:01:26.212394+0000","last_undegraded":"2024-01-25T15:01:26.212394+0000","last_fullsized":"2024-01-25T15:01:26.212394+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T22:35:43.147029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221643+0000","last_change":"2024-01-25T14:59:54.210681+0000","last_active":"2024-01-25T15:01:26.221643+0000","last_peered":"2024-01-25T15:01:26.221643+0000","last_clean":"2024-01-25T15:01:26.221643+0000","last_became_active":"2024-01-25T14:59:54.210347+0000","last_became_peered":"2024-01-25T14:59:54.210347+0000","last_unstale":"2024-01-25T15:01:26.221643+0000","last_undegraded":"2024-01-25T15:01:26.221643+0000","last_fullsized":"2024-01-25T15:01:26.221643+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T00:44:12.980933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.221684+0000","last_change":"2024-01-25T14:59:54.210792+0000","last_active":"2024-01-25T15:01:26.221684+0000","last_peered":"2024-01-25T15:01:26.221684+0000","last_clean":"2024-01-25T15:01:26.221684+0000","last_became_active":"2024-01-25T14:59:54.210416+0000","last_became_peered":"2024-01-25T14:59:54.210416+0000","last_unstale":"2024-01-25T15:01:26.221684+0000","last_undegraded":"2024-01-25T15:01:26.221684+0000","last_fullsized":"2024-01-25T15:01:26.221684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:07:45.070306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.222916+0000","last_change":"2024-01-25T14:59:54.204547+0000","last_active":"2024-01-25T15:01:26.222916+0000","last_peered":"2024-01-25T15:01:26.222916+0000","last_clean":"2024-01-25T15:01:26.222916+0000","last_became_active":"2024-01-25T14:59:54.204215+0000","last_became_peered":"2024-01-25T14:59:54.204215+0000","last_unstale":"2024-01-25T15:01:26.222916+0000","last_undegraded":"2024-01-25T15:01:26.222916+0000","last_fullsized":"2024-01-25T15:01:26.222916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T21:34:04.413137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.232166+0000","last_change":"2024-01-25T14:59:54.211006+0000","last_active":"2024-01-25T15:01:26.232166+0000","last_peered":"2024-01-25T15:01:26.232166+0000","last_clean":"2024-01-25T15:01:26.232166+0000","last_became_active":"2024-01-25T14:59:54.210568+0000","last_became_peered":"2024-01-25T14:59:54.210568+0000","last_unstale":"2024-01-25T15:01:26.232166+0000","last_undegraded":"2024-01-25T15:01:26.232166+0000","last_fullsized":"2024-01-25T15:01:26.232166+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:12:23.888827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.224809+0000","last_change":"2024-01-25T14:59:54.220485+0000","last_active":"2024-01-25T15:01:26.224809+0000","last_peered":"2024-01-25T15:01:26.224809+0000","last_clean":"2024-01-25T15:01:26.224809+0000","last_became_active":"2024-01-25T14:59:54.219547+0000","last_became_peered":"2024-01-25T14:59:54.219547+0000","last_unstale":"2024-01-25T15:01:26.224809+0000","last_undegraded":"2024-01-25T15:01:26.224809+0000","last_fullsized":"2024-01-25T15:01:26.224809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-27T02:43:49.858263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-01-25T15:01:26.228144+0000","last_change":"2024-01-25T14:59:54.217605+0000","last_active":"2024-01-25T15:01:26.228144+0000","last_peered":"2024-01-25T15:01:26.228144+0000","last_clean":"2024-01-25T15:01:26.228144+0000","last_became_active":"2024-01-25T14:59:54.217295+0000","last_became_peered":"2024-01-25T14:59:54.217295+0000","last_unstale":"2024-01-25T15:01:26.228144+0000","last_undegraded":"2024-01-25T15:01:26.228144+0000","last_fullsized":"2024-01-25T15:01:26.228144+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-25T14:59:53.182369+0000","last_clean_scrub_stamp":"2024-01-25T14:59:53.182369+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-26T16:27:59.846434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70853,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1169,"num_read_kb":665,"num_write":251,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58353,"num_keys_recovered":7,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":213339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":217,"ondisk_log_size":217,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383718,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":954368,"data_stored":456619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.69699999999999995,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.69699999999999995,"5min":1.444,"15min":1.444},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.64600000000000002,"15min":0.63},"min":{"1min":0.53600000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93300000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.58199999999999996,"15min":0.57499999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.5,"15min":0.48199999999999998},"min":{"1min":0.40500000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.67500000000000004,"15min":0.66300000000000003},"min":{"1min":0.58599999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.92700000000000005,"5min":1.079,"15min":1.079},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.61699999999999999,"15min":0.61099999999999999},"min":{"1min":0.496,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.79600000000000004}]},{"osd":5,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61599999999999999,"15min":0.61799999999999999},"min":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83999999999999997,"5min":1.387,"15min":1.387},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59199999999999997,"15min":0.58199999999999996},"min":{"1min":0.42799999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61699999999999999,"15min":0.626},"min":{"1min":0.44400000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.71999999999999997,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.58499999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.97499999999999998,"5min":1.571,"15min":1.571},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.748,"15min":0.73399999999999999},"min":{"1min":0.72399999999999998,"5min":0.5,"15min":0.5},"max":{"1min":0.99099999999999999,"5min":1.129,"15min":1.129},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.70699999999999996,"15min":0.69799999999999995},"min":{"1min":0.55800000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91700000000000004,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.71499999999999997}]},{"osd":8,"last update":"Thu Jan 25 15:00:56 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.65800000000000003}]},{"osd":9,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.75900000000000001,"15min":0.75800000000000001},"min":{"1min":0.65100000000000002,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.94399999999999995,"5min":1.536,"15min":1.536},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.87,"5min":0.76600000000000001,"15min":0.749},"min":{"1min":0.71999999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.028,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.93300000000000005}]},{"osd":10,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.748,"15min":0.74199999999999999},"min":{"1min":0.67200000000000004,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92300000000000004,"5min":1.101,"15min":1.101},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79600000000000004,"15min":0.79500000000000004},"min":{"1min":0.60899999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.004,"5min":1.603,"15min":1.603},"last":0.86499999999999999}]}]},{"osd":10,"up_from":72,"seq":309237645355,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28632,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716520,"statfs":{"total":95995035648,"available":95965716480,"internally_reserved":0,"allocated":1654784,"data_stored":1110910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.49199999999999999,"15min":0.495},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.312,"5min":0.308,"15min":0.308},"max":{"1min":0.69299999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.82499999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63900000000000001,"15min":0.63100000000000001},"min":{"1min":0.439,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.873,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.625}]},{"osd":3,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.64100000000000001,"15min":0.66100000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.72499999999999998,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71699999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.82999999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58299999999999996,"15min":0.59199999999999997},"min":{"1min":0.36299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78900000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66500000000000004,"15min":0.66200000000000003},"min":{"1min":0.48299999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92000000000000004,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.46800000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.72399999999999998,"15min":0.754},"min":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.92000000000000004,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72499999999999998,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90700000000000003,"5min":1.347,"15min":1.347},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 25 14:59:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.45500000000000002}]},{"osd":8,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.77500000000000002,"15min":0.79400000000000004},"min":{"1min":0.42499999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94799999999999995,"5min":1.282,"15min":1.282},"last":0.751},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.78100000000000003,"15min":0.79800000000000004},"min":{"1min":0.54800000000000004,"5min":0.495,"15min":0.495},"max":{"1min":0.89300000000000002,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.72199999999999998}]},{"osd":9,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.79600000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93500000000000005,"5min":1.262,"15min":1.262},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.79300000000000004,"15min":0.82299999999999995},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89100000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.77000000000000002}]},{"osd":11,"last update":"Thu Jan 25 15:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.78200000000000003,"15min":0.77600000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95299999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.76900000000000002,"15min":0.76100000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.97999999999999998,"5min":1.004,"15min":1.004},"last":0.81999999999999995}]}]},{"osd":9,"up_from":67,"seq":287762808879,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":456219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.43099999999999999,"15min":0.44900000000000001},"min":{"1min":0.26800000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.309},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.436,"15min":0.46400000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.58999999999999997,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60899999999999999,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.37,"15min":0.37},"max":{"1min":0.85399999999999998,"5min":0.875,"15min":0.875},"last":0.748},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.56000000000000005,"15min":0.57399999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73999999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.60199999999999998,"15min":0.627},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.68400000000000005,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.41999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.71199999999999997,"5min":1.012,"15min":1.012},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.495,"15min":0.52500000000000002},"min":{"1min":0.317,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68999999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.51800000000000002,"15min":0.54600000000000004},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.79100000000000004,"5min":0.876,"15min":0.876},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 25 15:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.314,"15min":0.314},"max":{"1min":0.78000000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.4419999999999999,"5min":0.82599999999999996,"15min":0.72299999999999998},"min":{"1min":0.39000000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":17.138999999999999,"5min":17.138999999999999,"15min":17.138999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.81899999999999995,"15min":0.73899999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72599999999999998,"5min":17.117000000000001,"15min":17.117000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.72299999999999998,"15min":0.73499999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":3.528,"5min":3.528,"15min":3.528},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.624,"15min":0.66700000000000004},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.96299999999999997,"5min":1.036,"15min":1.036},"last":0.432},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.56799999999999995,"15min":0.60599999999999998},"min":{"1min":0.35099999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94999999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.44800000000000001}]},{"osd":7,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":0.83499999999999996,"15min":0.78800000000000003},"min":{"1min":0.45600000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":13.346,"5min":13.346,"15min":13.346},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.73899999999999999,"15min":0.78000000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93700000000000006,"5min":1.125,"15min":1.125},"last":0.63}]},{"osd":8,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.67300000000000004,"15min":0.69499999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.88500000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.71799999999999997,"15min":0.751},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.81100000000000005,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.53700000000000003}]},{"osd":10,"last update":"Thu Jan 25 15:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.66000000000000003,"15min":0.68400000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75600000000000001,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.502},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.70599999999999996,"15min":0.72799999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.73499999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070516,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":966656,"data_stored":456575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.53700000000000003},"min":{"1min":0.438,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69499999999999995,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55800000000000005,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68300000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.60299999999999998,"15min":0.58699999999999997},"min":{"1min":0.44600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94299999999999995,"5min":1.008,"15min":1.008},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.59699999999999998,"15min":0.58599999999999997},"min":{"1min":0.46300000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.81899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.45100000000000001,"15min":0.45000000000000001},"min":{"1min":0.39700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.47699999999999998,"15min":0.47499999999999998},"min":{"1min":0.36799999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.65500000000000003,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.47799999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78500000000000003,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.628},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.45600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.49099999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.91800000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.63600000000000001,"15min":0.627},"min":{"1min":0.59099999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.876}]},{"osd":5,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.45700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.42799999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80600000000000005,"5min":1.028,"15min":1.028},"last":0.53500000000000003}]},{"osd":6,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.54600000000000004,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.51600000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.86299999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.61199999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88800000000000001,"5min":1.04,"15min":1.04},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.70899999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.995,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.66700000000000004}]},{"osd":9,"last update":"Thu Jan 25 15:01:14 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.67300000000000004,"15min":0.64300000000000002},"min":{"1min":0.59799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90900000000000003,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.69199999999999995,"15min":0.65800000000000003},"min":{"1min":0.68899999999999995,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.68200000000000005}]},{"osd":10,"last update":"Thu Jan 25 15:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.72399999999999998,"15min":0.68600000000000005},"min":{"1min":0.65500000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.73499999999999999,"15min":0.68999999999999995},"min":{"1min":0.71399999999999997,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.70299999999999996}]},{"osd":11,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.72899999999999998}]}]},{"osd":7,"up_from":52,"seq":223338299449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32708,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712444,"statfs":{"total":95995035648,"available":95961542656,"internally_reserved":0,"allocated":1568768,"data_stored":1049255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.53200000000000003,"15min":0.51900000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.40100000000000002},"min":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.55100000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.29199999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.498}]},{"osd":2,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.68500000000000005,"15min":0.64100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84399999999999997,"5min":6.508,"15min":6.508},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.56799999999999995},"min":{"1min":0.40400000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80500000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.47599999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.74399999999999999}]},{"osd":4,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.71399999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.32700000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59899999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64300000000000002,"15min":0.627},"min":{"1min":0.45300000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.80600000000000005,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.626,"15min":0.62},"min":{"1min":0.41999999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82099999999999995,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu Jan 25 15:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.67800000000000005,"15min":0.68400000000000005},"min":{"1min":0.50600000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.84799999999999998,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.44500000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.89700000000000002,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81699999999999995}]},{"osd":8,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69199999999999995,"15min":0.68400000000000005},"min":{"1min":0.434,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.79500000000000004,"15min":0.73299999999999998},"min":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.97099999999999997,"5min":6.5469999999999997,"15min":6.5469999999999997},"last":0.85599999999999998}]},{"osd":9,"last update":"Thu Jan 25 15:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.57199999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.84799999999999998,"5min":1.022,"15min":1.022},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.71499999999999997,"15min":0.71799999999999997},"min":{"1min":0.52100000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.91100000000000003,"5min":1.016,"15min":1.016},"last":0.76600000000000001}]},{"osd":10,"last update":"Thu Jan 25 15:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75700000000000001,"15min":0.77000000000000002},"min":{"1min":0.46600000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88900000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.72499999999999998,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88300000000000001,"5min":1.087,"15min":1.087},"last":0.82799999999999996}]},{"osd":11,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.879},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.90800000000000003}]}]},{"osd":6,"up_from":46,"seq":197568495679,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40432,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704720,"statfs":{"total":95995035648,"available":95953633280,"internally_reserved":0,"allocated":958464,"data_stored":456326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.39900000000000002,"15min":0.377},"min":{"1min":0.28299999999999997,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.40400000000000003,"15min":0.377},"min":{"1min":0.27400000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56599999999999995,"15min":0.55300000000000005},"min":{"1min":0.39200000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56299999999999994,"15min":0.54400000000000004},"min":{"1min":0.374,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.65300000000000002}]},{"osd":2,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55000000000000004,"15min":0.52400000000000002},"min":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57099999999999995,"15min":0.56399999999999995},"min":{"1min":0.374,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89100000000000001,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.432,"15min":0.42399999999999999},"min":{"1min":0.29099999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48099999999999998,"15min":0.46700000000000003},"min":{"1min":0.315,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.435}]},{"osd":4,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.39000000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.61599999999999999,"15min":0.58799999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 25 15:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61599999999999999,"15min":0.59599999999999997},"min":{"1min":0.436,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 25 15:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65100000000000002,"15min":0.67800000000000005},"min":{"1min":0.442,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0309999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.621,"5min":0.67200000000000004,"15min":0.69399999999999995},"min":{"1min":0.46899999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.87,"5min":1.04,"15min":1.04},"last":0.53500000000000003}]},{"osd":8,"last update":"Thu Jan 25 15:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.67700000000000005,"15min":0.70599999999999996},"min":{"1min":0.42299999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89900000000000002,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":0.5},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.52700000000000002,"5min":0.496,"15min":0.496},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.59899999999999998}]},{"osd":9,"last update":"Thu Jan 25 15:01:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.65600000000000003,"15min":0.68300000000000005},"min":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.67000000000000004,"15min":0.70599999999999996},"min":{"1min":0.41799999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98599999999999999,"5min":1.147,"15min":1.147},"last":0.41999999999999998}]},{"osd":10,"last update":"Thu Jan 25 15:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.67100000000000004,"15min":0.67800000000000005},"min":{"1min":0.51800000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.212,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71499999999999997,"15min":0.73099999999999998},"min":{"1min":0.58099999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.68799999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36336,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708816,"statfs":{"total":95995035648,"available":95957827584,"internally_reserved":0,"allocated":1024000,"data_stored":520831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.53800000000000003,"15min":0.49099999999999999},"min":{"1min":0.39300000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82699999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.49299999999999999},"min":{"1min":0.36599999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.77100000000000002,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 25 15:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.61199999999999999,"15min":0.51700000000000002},"min":{"1min":0.49399999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.53300000000000003},"min":{"1min":0.42499999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.90800000000000003,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.82199999999999995}]},{"osd":3,"last update":"Thu Jan 25 15:01:52 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61499999999999999,"15min":0.55100000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82499999999999996,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60699999999999998,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70099999999999996}]},{"osd":4,"last update":"Thu Jan 25 15:01:18 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.46999999999999997,"15min":0.40400000000000003},"min":{"1min":0.316,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.62},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.47299999999999998,"15min":0.41499999999999998},"min":{"1min":0.33600000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 25 15:01:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.65600000000000003,"15min":0.59099999999999997},"min":{"1min":0.48699999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.66400000000000003,"15min":0.58299999999999996},"min":{"1min":0.505,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.89000000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63100000000000001,"15min":0.59099999999999997},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94399999999999995,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65200000000000002,"15min":0.61399999999999999},"min":{"1min":0.47499999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.752}]},{"osd":7,"last update":"Thu Jan 25 15:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.624,"15min":0.58799999999999997},"min":{"1min":0.41999999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.97299999999999998,"5min":1.008,"15min":1.008},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.68300000000000005,"15min":0.64000000000000001},"min":{"1min":0.45800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.84199999999999997}]},{"osd":8,"last update":"Thu Jan 25 15:01:52 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.77100000000000002,"15min":0.73999999999999999},"min":{"1min":0.57699999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.70399999999999996,"15min":0.67900000000000005},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.77500000000000002}]},{"osd":9,"last update":"Thu Jan 25 15:01:18 2024","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.74299999999999999,"15min":0.73399999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.01,"5min":1.089,"15min":1.089},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.59599999999999997,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.997,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.80400000000000005}]},{"osd":10,"last update":"Thu Jan 25 15:01:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.53800000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.877},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80800000000000005,"15min":0.80600000000000005},"min":{"1min":0.58899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.93700000000000006}]},{"osd":11,"last update":"Thu Jan 25 15:00:56 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.91700000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40452,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704700,"statfs":{"total":95995035648,"available":95953612800,"internally_reserved":0,"allocated":978944,"data_stored":457275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 25 15:01:14 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54200000000000004,"15min":0.5},"min":{"1min":0.38500000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84299999999999997,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.434},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52500000000000002,"15min":0.50800000000000001},"min":{"1min":0.36199999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 25 15:01:33 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54000000000000004,"15min":0.51200000000000001},"min":{"1min":0.378,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72599999999999998,"5min":1.143,"15min":1.143},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.52700000000000002},"min":{"1min":0.42899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72299999999999998,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 25 15:00:57 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 25 15:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55800000000000005,"15min":0.51600000000000001},"min":{"1min":0.38400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.70999999999999996,"5min":1.3009999999999999,"15min":1.3009999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.55500000000000005,"15min":0.52700000000000002},"min":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.63900000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 25 15:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56599999999999995,"15min":0.54500000000000004},"min":{"1min":0.41299999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.56299999999999994,"15min":0.54700000000000004},"min":{"1min":0.42799999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.54300000000000004}]},{"osd":6,"last update":"Thu Jan 25 15:01:14 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.502,"15min":0.52000000000000002},"min":{"1min":0.29199999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.94299999999999995,"5min":1.232,"15min":1.232},"last":0.317},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52900000000000003,"15min":0.50700000000000001},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.91000000000000003,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.498}]},{"osd":7,"last update":"Thu Jan 25 14:59:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.57699999999999996}]},{"osd":8,"last update":"Thu Jan 25 15:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.66300000000000003,"15min":0.67000000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.68999999999999995,"15min":0.69899999999999995},"min":{"1min":0.47699999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.57199999999999995}]},{"osd":9,"last update":"Thu Jan 25 15:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.58799999999999997,"15min":0.60999999999999999},"min":{"1min":0.375,"5min":0.37,"15min":0.37},"max":{"1min":0.63,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.39600000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69699999999999995,"5min":1.052,"15min":1.052},"last":0.60099999999999998}]},{"osd":10,"last update":"Thu Jan 25 15:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.50700000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.751,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.77400000000000002,"15min":0.74199999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":4.6550000000000002,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":0.52500000000000002}]},{"osd":11,"last update":"Thu Jan 25 15:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71199999999999997,"15min":0.71399999999999997},"min":{"1min":0.53600000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1140000000000001,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.72099999999999997,"15min":0.72399999999999998},"min":{"1min":0.58599999999999997,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.61499999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":970752,"data_stored":457908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:36 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.51400000000000001,"15min":0.5},"min":{"1min":0.433,"5min":0.246,"15min":0.246},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.40600000000000003,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68500000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40600000000000003}]},{"osd":1,"last update":"Thu Jan 25 15:01:36 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.52800000000000002},"min":{"1min":0.38400000000000001,"5min":0.34999999999999998,"15min":0.26500000000000001},"max":{"1min":0.878,"5min":0.879,"15min":0.879},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.58999999999999997,"15min":0.52600000000000002},"min":{"1min":0.51200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 25 15:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59699999999999998,"15min":0.54300000000000004},"min":{"1min":0.42799999999999999,"5min":0.373,"15min":0.28000000000000003},"max":{"1min":0.71299999999999997,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58699999999999997,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34599999999999997,"15min":0.29799999999999999},"max":{"1min":0.77600000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 25 15:00:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.624},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.751}]},{"osd":5,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.47499999999999998,"15min":0.41199999999999998},"min":{"1min":0.31900000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.82899999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.38},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.44900000000000001},"min":{"1min":0.34499999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.74199999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.432}]},{"osd":6,"last update":"Thu Jan 25 15:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58899999999999997,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82599999999999996,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.58199999999999996},"min":{"1min":0.40000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.878,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 25 14:59:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.64000000000000001,"15min":0.64700000000000002},"min":{"1min":0.46000000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.76900000000000002,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.67700000000000005,"15min":0.68400000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.80500000000000005,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.77500000000000002}]},{"osd":8,"last update":"Thu Jan 25 15:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.61099999999999999,"15min":0.61399999999999999},"min":{"1min":0.44900000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.85299999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.42799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.82099999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53300000000000003}]},{"osd":9,"last update":"Thu Jan 25 15:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.67700000000000005,"15min":0.67500000000000004},"min":{"1min":0.51900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.501},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69699999999999995,"15min":0.69199999999999995},"min":{"1min":0.55500000000000005,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89900000000000002,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67500000000000004}]},{"osd":10,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.70099999999999996,"15min":0.66700000000000004},"min":{"1min":0.61499999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93799999999999994,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.70599999999999996,"15min":0.66700000000000004},"min":{"1min":0.64500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91800000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64100000000000001}]},{"osd":11,"last update":"Thu Jan 25 15:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.69499999999999995}]}]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":455761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.34000000000000002},"min":{"1min":0.254,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.375,"15min":0.35699999999999998},"min":{"1min":0.27200000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53700000000000003,"15min":0.51000000000000001},"min":{"1min":0.376,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.54600000000000004,"15min":0.51000000000000001},"min":{"1min":0.40100000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.54000000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.753,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73899999999999999,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 25 15:01:22 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.56499999999999995,"15min":0.55100000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.58799999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.77900000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 25 15:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.56200000000000006},"min":{"1min":0.41799999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80000000000000004,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47999999999999998,"15min":0.46999999999999997},"min":{"1min":0.29999999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.51300000000000001,"15min":0.48499999999999999},"min":{"1min":0.33200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.437}]},{"osd":7,"last update":"Thu Jan 25 15:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.45300000000000001,"5min":0.378,"15min":0.378},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.63300000000000001,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82899999999999996,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68000000000000005}]},{"osd":8,"last update":"Thu Jan 25 14:59:53 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85899999999999999,"5min":0.872,"15min":0.872},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69599999999999995,"15min":0.69499999999999995},"min":{"1min":0.56799999999999995,"5min":0.5,"15min":0.5},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.61799999999999999}]},{"osd":9,"last update":"Thu Jan 25 15:01:22 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.64100000000000001,"15min":0.68300000000000005},"min":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.753,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67700000000000005,"15min":0.71399999999999997},"min":{"1min":0.41499999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.49299999999999999}]},{"osd":10,"last update":"Thu Jan 25 15:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.70899999999999996,"15min":0.72499999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.64900000000000002}]},{"osd":11,"last update":"Thu Jan 25 15:00:55 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.70399999999999996}]}]},{"osd":4,"up_from":33,"seq":141733920840,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":519389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 14:59:21 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.48599999999999999,"15min":0.47699999999999998},"min":{"1min":0.38100000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.82199999999999995,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.57399999999999995}]},{"osd":1,"last update":"Thu Jan 25 15:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41399999999999998,"15min":0.39200000000000002},"min":{"1min":0.26500000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.41999999999999998,"15min":0.40200000000000002},"min":{"1min":0.28000000000000003,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.68999999999999995,"5min":0.878,"15min":0.878},"last":0.378}]},{"osd":2,"last update":"Thu Jan 25 15:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.41099999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.749,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.61599999999999999,"15min":0.57599999999999996},"min":{"1min":0.41799999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84599999999999997,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 25 15:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.55700000000000005,"15min":0.51300000000000001},"min":{"1min":0.442,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55700000000000005,"15min":0.54200000000000004},"min":{"1min":0.371,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73899999999999999,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.46300000000000002}]},{"osd":5,"last update":"Thu Jan 25 15:00:47 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.46100000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.39600000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 25 15:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60299999999999998,"15min":0.56399999999999995},"min":{"1min":0.46400000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.81000000000000005,"5min":0.879,"15min":0.879},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61699999999999999,"15min":0.59499999999999997},"min":{"1min":0.36499999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.90700000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 25 15:01:26 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58899999999999997,"15min":0.55300000000000005},"min":{"1min":0.35999999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.78000000000000003,"5min":1.002,"15min":1.002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57399999999999995,"15min":0.53300000000000003},"min":{"1min":0.38900000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76800000000000002,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.61599999999999999}]},{"osd":8,"last update":"Thu Jan 25 15:00:50 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.63700000000000001,"15min":0.61299999999999999},"min":{"1min":0.47699999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89400000000000002,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.69899999999999995,"15min":0.67400000000000004},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96799999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.66100000000000003}]},{"osd":9,"last update":"Thu Jan 25 15:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.751,"15min":0.75700000000000001},"min":{"1min":0.57099999999999995,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96699999999999997,"5min":1,"15min":1},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75700000000000001,"15min":0.76700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90200000000000002,"5min":1.044,"15min":1.044},"last":0.77300000000000002}]},{"osd":10,"last update":"Thu Jan 25 15:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.497,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89600000000000002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67800000000000005,"15min":0.68799999999999994},"min":{"1min":0.48199999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81100000000000005,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.64500000000000002}]},{"osd":11,"last update":"Thu Jan 25 15:00:53 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.754},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.70499999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32720,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712432,"statfs":{"total":95995035648,"available":95961530368,"internally_reserved":0,"allocated":1581056,"data_stored":1048933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51100000000000001,"15min":0.50900000000000001},"min":{"1min":0.33000000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71599999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.433},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.32500000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57199999999999995,"15min":0.53400000000000003},"min":{"1min":0.39800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78000000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55800000000000005,"15min":0.53900000000000003},"min":{"1min":0.41299999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71899999999999997,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.41299999999999998,"15min":0.39600000000000002},"min":{"1min":0.32600000000000001,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54600000000000004,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40200000000000002,"15min":0.38600000000000001},"min":{"1min":0.313,"5min":0.247,"15min":0.247},"max":{"1min":0.621,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.57799999999999996}]},{"osd":3,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.54400000000000004,"15min":0.53300000000000003},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.751,"5min":0.873,"15min":0.873},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53700000000000003,"15min":0.54400000000000004},"min":{"1min":0.35799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70499999999999996,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.71099999999999997}]},{"osd":4,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58299999999999996,"15min":0.55300000000000005},"min":{"1min":0.497,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.745,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.60399999999999998,"15min":0.56599999999999995},"min":{"1min":0.42799999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.80100000000000005,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 25 15:01:05 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.59099999999999997,"15min":0.58799999999999997},"min":{"1min":0.38500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.81699999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81399999999999995,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 25 15:01:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64700000000000002,"15min":0.63500000000000001},"min":{"1min":0.48799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89300000000000002,"5min":1.01,"15min":1.01},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63,"15min":0.61799999999999999},"min":{"1min":0.432,"5min":0.377,"15min":0.377},"max":{"1min":0.91600000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.79100000000000004}]},{"osd":8,"last update":"Thu Jan 25 15:00:53 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83199999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.627},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79800000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.77200000000000002}]},{"osd":9,"last update":"Thu Jan 25 15:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.66200000000000003,"15min":0.64700000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84799999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.873,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.73699999999999999}]},{"osd":10,"last update":"Thu Jan 25 15:01:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.63300000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86899999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.59799999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88300000000000001,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.75900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":64292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-25T15:01:54.268 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:01:54.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:54 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2288427661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:54.406 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.403+0000 7f65cba2b640 1 -- 172.21.15.170:0/1925655329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c40ffc10 msgr2=0x7f65c4100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:54.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.403+0000 7f65cba2b640 1 --2- 172.21.15.170:0/1925655329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c40ffc10 0x7f65c4100030 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009900 tx=0x7f65b402bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:54.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.403+0000 7f65cba2b640 1 -- 172.21.15.170:0/1925655329 shutdown_connections 2024-01-25T15:01:54.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.403+0000 7f65cba2b640 1 --2- 172.21.15.170:0/1925655329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65c4100e00 0x7f65c4101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.403+0000 7f65cba2b640 1 --2- 172.21.15.170:0/1925655329 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65c41017c0 0x7f65c4108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.403+0000 7f65cba2b640 1 --2- 172.21.15.170:0/1925655329 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c40ffc10 0x7f65c4100030 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.403+0000 7f65cba2b640 1 -- 172.21.15.170:0/1925655329 >> 172.21.15.170:0/1925655329 conn(0x7f65c40fb180 msgr2=0x7f65c40fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:54.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.404+0000 7f65cba2b640 1 -- 172.21.15.170:0/1925655329 shutdown_connections 2024-01-25T15:01:54.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.404+0000 7f65cba2b640 1 -- 172.21.15.170:0/1925655329 wait complete. 2024-01-25T15:01:54.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.404+0000 7f65cba2b640 1 Processor -- start 2024-01-25T15:01:54.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.404+0000 7f65cba2b640 1 -- start start 2024-01-25T15:01:54.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.404+0000 7f65cba2b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c40ffc10 0x7f65c40689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:54.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.404+0000 7f65cba2b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65c4100e00 0x7f65c419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:54.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.404+0000 7f65cba2b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65c41017c0 0x7f65c419e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:54.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.404+0000 7f65cba2b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c419e860 con 0x7f65c40ffc10 2024-01-25T15:01:54.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.404+0000 7f65cba2b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c419e9d0 con 0x7f65c4100e00 2024-01-25T15:01:54.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.404+0000 7f65cba2b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c419eb90 con 0x7f65c41017c0 2024-01-25T15:01:54.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.404+0000 7f65c97c7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c40ffc10 0x7f65c40689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:54.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.404+0000 7f65c97c7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c40ffc10 0x7f65c40689e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36326/0 (socket says 172.21.15.170:36326) 2024-01-25T15:01:54.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.404+0000 7f65c97c7640 1 -- 172.21.15.170:0/35198249 learned_addr learned my addr 172.21.15.170:0/35198249 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:54.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.404+0000 7f65c8fc6640 1 --2- 172.21.15.170:0/35198249 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65c4100e00 0x7f65c419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:54.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.405+0000 7f65c9fc8640 1 --2- 172.21.15.170:0/35198249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65c41017c0 0x7f65c419e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:54.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.405+0000 7f65c97c7640 1 -- 172.21.15.170:0/35198249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65c41017c0 msgr2=0x7f65c419e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:54.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.405+0000 7f65c97c7640 1 --2- 172.21.15.170:0/35198249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65c41017c0 0x7f65c419e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.405+0000 7f65c97c7640 1 -- 172.21.15.170:0/35198249 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65c4100e00 msgr2=0x7f65c419ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:54.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.405+0000 7f65c97c7640 1 --2- 172.21.15.170:0/35198249 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65c4100e00 0x7f65c419ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.405+0000 7f65c97c7640 1 -- 172.21.15.170:0/35198249 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b4009560 con 0x7f65c40ffc10 2024-01-25T15:01:54.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.405+0000 7f65c8fc6640 1 --2- 172.21.15.170:0/35198249 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65c4100e00 0x7f65c419ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:54.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.405+0000 7f65c97c7640 1 --2- 172.21.15.170:0/35198249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c40ffc10 0x7f65c40689e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009230 tx=0x7f65b4004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:54.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.405+0000 7f65c27fc640 1 -- 172.21.15.170:0/35198249 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b40043d0 con 0x7f65c40ffc10 2024-01-25T15:01:54.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.405+0000 7f65c27fc640 1 -- 172.21.15.170:0/35198249 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65b40054c0 con 0x7f65c40ffc10 2024-01-25T15:01:54.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.405+0000 7f65cba2b640 1 -- 172.21.15.170:0/35198249 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c419ee10 con 0x7f65c40ffc10 2024-01-25T15:01:54.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.405+0000 7f65c27fc640 1 -- 172.21.15.170:0/35198249 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b4003e60 con 0x7f65c40ffc10 2024-01-25T15:01:54.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.405+0000 7f65cba2b640 1 -- 172.21.15.170:0/35198249 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c419f290 con 0x7f65c40ffc10 2024-01-25T15:01:54.409 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.406+0000 7f65cba2b640 1 -- 172.21.15.170:0/35198249 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c4107020 con 0x7f65c40ffc10 2024-01-25T15:01:54.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.407+0000 7f65c27fc640 1 -- 172.21.15.170:0/35198249 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f65b40035f0 con 0x7f65c40ffc10 2024-01-25T15:01:54.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.408+0000 7f65c27fc640 1 --2- 172.21.15.170:0/35198249 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65ac0a1370 0x7f65ac0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:54.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.408+0000 7f65c8fc6640 1 --2- 172.21.15.170:0/35198249 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65ac0a1370 0x7f65ac0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:54.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.408+0000 7f65c27fc640 1 -- 172.21.15.170:0/35198249 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f65b40ef990 con 0x7f65c40ffc10 2024-01-25T15:01:54.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.408+0000 7f65c8fc6640 1 --2- 172.21.15.170:0/35198249 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65ac0a1370 0x7f65ac0a3830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f65b80058c0 tx=0x7f65b8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:54.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.411+0000 7f65c27fc640 1 -- 172.21.15.170:0/35198249 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f65b40b8df0 con 0x7f65c40ffc10 2024-01-25T15:01:54.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:54 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2288427661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:54.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.585+0000 7f65cba2b640 1 -- 172.21.15.170:0/35198249 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65c410b6f0 con 0x7f65c40ffc10 2024-01-25T15:01:54.587 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.586+0000 7f65c27fc640 1 -- 172.21.15.170:0/35198249 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22550 (secure 0 0 0) 0x7f65b4043090 con 0x7f65c40ffc10 2024-01-25T15:01:54.588 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:54.588 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":87,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T15:00:57.274280+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:01:54.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.588+0000 7f65cba2b640 1 -- 172.21.15.170:0/35198249 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65ac0a1370 msgr2=0x7f65ac0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:54.589 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.588+0000 7f65cba2b640 1 --2- 172.21.15.170:0/35198249 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65ac0a1370 0x7f65ac0a3830 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f65b80058c0 tx=0x7f65b8005850 comp rx=0 tx=0).stop 2024-01-25T15:01:54.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.588+0000 7f65cba2b640 1 -- 172.21.15.170:0/35198249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c40ffc10 msgr2=0x7f65c40689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:54.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.588+0000 7f65cba2b640 1 --2- 172.21.15.170:0/35198249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c40ffc10 0x7f65c40689e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009230 tx=0x7f65b4004f40 comp rx=0 tx=0).stop 2024-01-25T15:01:54.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.588+0000 7f65cba2b640 1 -- 172.21.15.170:0/35198249 shutdown_connections 2024-01-25T15:01:54.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.588+0000 7f65cba2b640 1 --2- 172.21.15.170:0/35198249 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65ac0a1370 0x7f65ac0a3830 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.588+0000 7f65cba2b640 1 --2- 172.21.15.170:0/35198249 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65c4100e00 0x7f65c419ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.588+0000 7f65cba2b640 1 --2- 172.21.15.170:0/35198249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65c41017c0 0x7f65c419e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.588+0000 7f65cba2b640 1 --2- 172.21.15.170:0/35198249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65c40ffc10 0x7f65c40689e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.588+0000 7f65cba2b640 1 -- 172.21.15.170:0/35198249 >> 172.21.15.170:0/35198249 conn(0x7f65c40fb180 msgr2=0x7f65c41041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:54.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.589+0000 7f65cba2b640 1 -- 172.21.15.170:0/35198249 shutdown_connections 2024-01-25T15:01:54.590 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.589+0000 7f65cba2b640 1 -- 172.21.15.170:0/35198249 wait complete. 2024-01-25T15:01:54.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T14:55:22.432727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T14:59:51.465304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T14:59:52.749298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:01:54.601 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:01:54.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.705+0000 7f0639b97640 1 -- 172.21.15.170:0/1964270074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0634100e00 msgr2=0x7f0634101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:54.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.705+0000 7f0639b97640 1 --2- 172.21.15.170:0/1964270074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0634100e00 0x7f0634101280 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0628009900 tx=0x7f062802bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:54.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.705+0000 7f0639b97640 1 -- 172.21.15.170:0/1964270074 shutdown_connections 2024-01-25T15:01:54.706 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.705+0000 7f0639b97640 1 --2- 172.21.15.170:0/1964270074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f06341017c0 0x7f0634108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.705+0000 7f0639b97640 1 --2- 172.21.15.170:0/1964270074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0634100e00 0x7f0634101280 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.705+0000 7f0639b97640 1 --2- 172.21.15.170:0/1964270074 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06340ffc10 0x7f0634100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.705+0000 7f0639b97640 1 -- 172.21.15.170:0/1964270074 >> 172.21.15.170:0/1964270074 conn(0x7f06340fb1a0 msgr2=0x7f06340fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:54.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.705+0000 7f0639b97640 1 -- 172.21.15.170:0/1964270074 shutdown_connections 2024-01-25T15:01:54.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.705+0000 7f0639b97640 1 -- 172.21.15.170:0/1964270074 wait complete. 2024-01-25T15:01:54.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.706+0000 7f0639b97640 1 Processor -- start 2024-01-25T15:01:54.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.706+0000 7f0639b97640 1 -- start start 2024-01-25T15:01:54.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.706+0000 7f0639b97640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06340ffc10 0x7f0634195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:54.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.706+0000 7f0639b97640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0634100e00 0x7f06341960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:54.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.706+0000 7f0639b97640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06341017c0 0x7f063419d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:54.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.706+0000 7f0639b97640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063419d660 con 0x7f06340ffc10 2024-01-25T15:01:54.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.706+0000 7f0639b97640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063419d7d0 con 0x7f06341017c0 2024-01-25T15:01:54.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.706+0000 7f0639b97640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063419d990 con 0x7f0634100e00 2024-01-25T15:01:54.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.706+0000 7f06337fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06340ffc10 0x7f0634195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:54.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.706+0000 7f06337fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06340ffc10 0x7f0634195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36352/0 (socket says 172.21.15.170:36352) 2024-01-25T15:01:54.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.706+0000 7f06337fe640 1 -- 172.21.15.170:0/4028713240 learned_addr learned my addr 172.21.15.170:0/4028713240 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:54.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.706+0000 7f0633fff640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06341017c0 0x7f063419d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:54.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.706+0000 7f0632ffd640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0634100e00 0x7f06341960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:54.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.707+0000 7f06337fe640 1 -- 172.21.15.170:0/4028713240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0634100e00 msgr2=0x7f06341960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:54.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.707+0000 7f06337fe640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0634100e00 0x7f06341960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.707+0000 7f06337fe640 1 -- 172.21.15.170:0/4028713240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06341017c0 msgr2=0x7f063419d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:54.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.707+0000 7f06337fe640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06341017c0 0x7f063419d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.707+0000 7f06337fe640 1 -- 172.21.15.170:0/4028713240 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0628009560 con 0x7f06340ffc10 2024-01-25T15:01:54.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.707+0000 7f0633fff640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06341017c0 0x7f063419d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:54.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.707+0000 7f0632ffd640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0634100e00 0x7f06341960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:54.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.707+0000 7f06337fe640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06340ffc10 0x7f0634195b70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f062400c970 tx=0x7f062400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:54.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.707+0000 7f0630ff9640 1 -- 172.21.15.170:0/4028713240 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0624007c10 con 0x7f06340ffc10 2024-01-25T15:01:54.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.707+0000 7f0639b97640 1 -- 172.21.15.170:0/4028713240 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063419dc70 con 0x7f06340ffc10 2024-01-25T15:01:54.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.707+0000 7f0630ff9640 1 -- 172.21.15.170:0/4028713240 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0624007d70 con 0x7f06340ffc10 2024-01-25T15:01:54.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.707+0000 7f0630ff9640 1 -- 172.21.15.170:0/4028713240 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062400f760 con 0x7f06340ffc10 2024-01-25T15:01:54.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.707+0000 7f0639b97640 1 -- 172.21.15.170:0/4028713240 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063419e1d0 con 0x7f06340ffc10 2024-01-25T15:01:54.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.708+0000 7f0639b97640 1 -- 172.21.15.170:0/4028713240 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0634106fb0 con 0x7f06340ffc10 2024-01-25T15:01:54.711 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.709+0000 7f0630ff9640 1 -- 172.21.15.170:0/4028713240 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f062400f980 con 0x7f06340ffc10 2024-01-25T15:01:54.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.710+0000 7f0630ff9640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f061c0a1370 0x7f061c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:54.712 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.710+0000 7f0632ffd640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f061c0a1370 0x7f061c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:54.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.710+0000 7f0630ff9640 1 -- 172.21.15.170:0/4028713240 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f0624013070 con 0x7f06340ffc10 2024-01-25T15:01:54.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.710+0000 7f0632ffd640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f061c0a1370 0x7f061c0a3830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0628036040 tx=0x7f0628000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:54.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.714+0000 7f0630ff9640 1 -- 172.21.15.170:0/4028713240 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f0624096420 con 0x7f06340ffc10 2024-01-25T15:01:54.886 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.885+0000 7f0639b97640 1 -- 172.21.15.170:0/4028713240 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f063410b4b0 con 0x7f06340ffc10 2024-01-25T15:01:54.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.886+0000 7f0630ff9640 1 -- 172.21.15.170:0/4028713240 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0624099a40 con 0x7f06340ffc10 2024-01-25T15:01:54.887 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 1 2024-01-25T15:01:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.888+0000 7f0639b97640 1 -- 172.21.15.170:0/4028713240 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f061c0a1370 msgr2=0x7f061c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.888+0000 7f0639b97640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f061c0a1370 0x7f061c0a3830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0628036040 tx=0x7f0628000bc0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.888+0000 7f0639b97640 1 -- 172.21.15.170:0/4028713240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06340ffc10 msgr2=0x7f0634195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:54.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.888+0000 7f0639b97640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06340ffc10 0x7f0634195b70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f062400c970 tx=0x7f062400ce30 comp rx=0 tx=0).stop 2024-01-25T15:01:54.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.888+0000 7f0639b97640 1 -- 172.21.15.170:0/4028713240 shutdown_connections 2024-01-25T15:01:54.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.888+0000 7f0639b97640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f061c0a1370 0x7f061c0a3830 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.888+0000 7f0639b97640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06341017c0 0x7f063419d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.888+0000 7f0639b97640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0634100e00 0x7f06341960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.888+0000 7f0639b97640 1 --2- 172.21.15.170:0/4028713240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f06340ffc10 0x7f0634195b70 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:54.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.888+0000 7f0639b97640 1 -- 172.21.15.170:0/4028713240 >> 172.21.15.170:0/4028713240 conn(0x7f06340fb1a0 msgr2=0x7f0634104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:54.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.888+0000 7f0639b97640 1 -- 172.21.15.170:0/4028713240 shutdown_connections 2024-01-25T15:01:54.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:54.888+0000 7f0639b97640 1 -- 172.21.15.170:0/4028713240 wait complete. 2024-01-25T15:01:54.900 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:01:55.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.004+0000 7fa17a333640 1 -- 172.21.15.170:0/4118680387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1740ffe80 msgr2=0x7fa174100300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.004+0000 7fa17a333640 1 --2- 172.21.15.170:0/4118680387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1740ffe80 0x7fa174100300 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa168009900 tx=0x7fa16802bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:55.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.004+0000 7fa17a333640 1 -- 172.21.15.170:0/4118680387 shutdown_connections 2024-01-25T15:01:55.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.004+0000 7fa17a333640 1 --2- 172.21.15.170:0/4118680387 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa174100840 0x7fa1741080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.007 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.004+0000 7fa17a333640 1 --2- 172.21.15.170:0/4118680387 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa1740ffe80 0x7fa174100300 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.004+0000 7fa17a333640 1 --2- 172.21.15.170:0/4118680387 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa174101230 0x7fa174101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.004+0000 7fa17a333640 1 -- 172.21.15.170:0/4118680387 >> 172.21.15.170:0/4118680387 conn(0x7fa1740fa8f0 msgr2=0x7fa1740fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:55.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.004+0000 7fa17a333640 1 -- 172.21.15.170:0/4118680387 shutdown_connections 2024-01-25T15:01:55.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.004+0000 7fa17a333640 1 -- 172.21.15.170:0/4118680387 wait complete. 2024-01-25T15:01:55.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.004+0000 7fa17a333640 1 Processor -- start 2024-01-25T15:01:55.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.004+0000 7fa17a333640 1 -- start start 2024-01-25T15:01:55.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa17a333640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1740ffe80 0x7fa174195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa17a333640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa174100840 0x7fa1741960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa17a333640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa174101230 0x7fa17419d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa17a333640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17419d660 con 0x7fa174101230 2024-01-25T15:01:55.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa17a333640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17419d7d0 con 0x7fa174100840 2024-01-25T15:01:55.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa17a333640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17419d990 con 0x7fa1740ffe80 2024-01-25T15:01:55.008 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa1788d0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa174101230 0x7fa17419d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa1788d0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa174101230 0x7fa17419d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36358/0 (socket says 172.21.15.170:36358) 2024-01-25T15:01:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa1788d0640 1 -- 172.21.15.170:0/3753401957 learned_addr learned my addr 172.21.15.170:0/3753401957 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa173fff640 1 --2- 172.21.15.170:0/3753401957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1740ffe80 0x7fa174195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa1737fe640 1 --2- 172.21.15.170:0/3753401957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa174100840 0x7fa1741960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa1788d0640 1 -- 172.21.15.170:0/3753401957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1740ffe80 msgr2=0x7fa174195b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa1788d0640 1 --2- 172.21.15.170:0/3753401957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1740ffe80 0x7fa174195b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa1788d0640 1 -- 172.21.15.170:0/3753401957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa174100840 msgr2=0x7fa1741960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa1788d0640 1 --2- 172.21.15.170:0/3753401957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa174100840 0x7fa1741960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa1788d0640 1 -- 172.21.15.170:0/3753401957 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168009560 con 0x7fa174101230 2024-01-25T15:01:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa1737fe640 1 --2- 172.21.15.170:0/3753401957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa174100840 0x7fa1741960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa1788d0640 1 --2- 172.21.15.170:0/3753401957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa174101230 0x7fa17419d120 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00eaa0 tx=0x7fa16c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa1717fa640 1 -- 172.21.15.170:0/3753401957 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c00cdb0 con 0x7fa174101230 2024-01-25T15:01:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.005+0000 7fa17a333640 1 -- 172.21.15.170:0/3753401957 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa17419dc70 con 0x7fa174101230 2024-01-25T15:01:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.006+0000 7fa1717fa640 1 -- 172.21.15.170:0/3753401957 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa16c005020 con 0x7fa174101230 2024-01-25T15:01:55.009 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.006+0000 7fa1717fa640 1 -- 172.21.15.170:0/3753401957 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0116d0 con 0x7fa174101230 2024-01-25T15:01:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.006+0000 7fa17a333640 1 -- 172.21.15.170:0/3753401957 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17419e1a0 con 0x7fa174101230 2024-01-25T15:01:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.007+0000 7fa17a333640 1 -- 172.21.15.170:0/3753401957 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa174107040 con 0x7fa174101230 2024-01-25T15:01:55.010 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.007+0000 7fa1717fa640 1 -- 172.21.15.170:0/3753401957 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fa16c005420 con 0x7fa174101230 2024-01-25T15:01:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.008+0000 7fa1717fa640 1 --2- 172.21.15.170:0/3753401957 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa15c0a1370 0x7fa15c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.008+0000 7fa173fff640 1 --2- 172.21.15.170:0/3753401957 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa15c0a1370 0x7fa15c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.008+0000 7fa1717fa640 1 -- 172.21.15.170:0/3753401957 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fa16c0cce80 con 0x7fa174101230 2024-01-25T15:01:55.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.008+0000 7fa173fff640 1 --2- 172.21.15.170:0/3753401957 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa15c0a1370 0x7fa15c0a3830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa1740690e0 tx=0x7fa164005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:55.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.012+0000 7fa1717fa640 1 -- 172.21.15.170:0/3753401957 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fa16c0961d0 con 0x7fa174101230 2024-01-25T15:01:55.191 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.190+0000 7fa17a333640 1 -- 172.21.15.170:0/3753401957 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa17410b6b0 con 0x7fa174101230 2024-01-25T15:01:55.192 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.191+0000 7fa1717fa640 1 -- 172.21.15.170:0/3753401957 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa16c01f0a0 con 0x7fa174101230 2024-01-25T15:01:55.192 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 32 2024-01-25T15:01:55.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.193+0000 7fa17a333640 1 -- 172.21.15.170:0/3753401957 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa15c0a1370 msgr2=0x7fa15c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.193+0000 7fa17a333640 1 --2- 172.21.15.170:0/3753401957 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa15c0a1370 0x7fa15c0a3830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa1740690e0 tx=0x7fa164005f90 comp rx=0 tx=0).stop 2024-01-25T15:01:55.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.193+0000 7fa17a333640 1 -- 172.21.15.170:0/3753401957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa174101230 msgr2=0x7fa17419d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.193+0000 7fa17a333640 1 --2- 172.21.15.170:0/3753401957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa174101230 0x7fa17419d120 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00eaa0 tx=0x7fa16c00ef60 comp rx=0 tx=0).stop 2024-01-25T15:01:55.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.193+0000 7fa17a333640 1 -- 172.21.15.170:0/3753401957 shutdown_connections 2024-01-25T15:01:55.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.193+0000 7fa17a333640 1 --2- 172.21.15.170:0/3753401957 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa15c0a1370 0x7fa15c0a3830 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.193+0000 7fa17a333640 1 --2- 172.21.15.170:0/3753401957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa174100840 0x7fa1741960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.193+0000 7fa17a333640 1 --2- 172.21.15.170:0/3753401957 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa174101230 0x7fa17419d120 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.193+0000 7fa17a333640 1 --2- 172.21.15.170:0/3753401957 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa1740ffe80 0x7fa174195b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.194 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.193+0000 7fa17a333640 1 -- 172.21.15.170:0/3753401957 >> 172.21.15.170:0/3753401957 conn(0x7fa1740fa8f0 msgr2=0x7fa174104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:55.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.193+0000 7fa17a333640 1 -- 172.21.15.170:0/3753401957 shutdown_connections 2024-01-25T15:01:55.195 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.193+0000 7fa17a333640 1 -- 172.21.15.170:0/3753401957 wait complete. 2024-01-25T15:01:55.204 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:55 smithi170 ceph-mon[31899]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:01:55.204 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:55 smithi170 ceph-mon[31899]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:01:55.204 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:55 smithi170 ceph-mon[31899]: pgmap v346: 97 pgs: 97 active+clean; 646 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-01-25T15:01:55.204 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:55 smithi170 ceph-mon[31899]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:01:55.205 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:55 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/35198249' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:55.205 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:55 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/4028713240' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:55.206 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:01:55.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.309+0000 7f2ff531d640 1 -- 172.21.15.170:0/2911642172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ff0100de0 msgr2=0x7f2ff0101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.309+0000 7f2ff531d640 1 --2- 172.21.15.170:0/2911642172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ff0100de0 0x7f2ff0101260 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009900 tx=0x7f2fd802bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:55.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.309+0000 7f2ff531d640 1 -- 172.21.15.170:0/2911642172 shutdown_connections 2024-01-25T15:01:55.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.309+0000 7f2ff531d640 1 --2- 172.21.15.170:0/2911642172 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ff01017a0 0x7f2ff0108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.309+0000 7f2ff531d640 1 --2- 172.21.15.170:0/2911642172 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ff0100de0 0x7f2ff0101260 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.309+0000 7f2ff531d640 1 --2- 172.21.15.170:0/2911642172 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ff00ffbf0 0x7f2ff0100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.309+0000 7f2ff531d640 1 -- 172.21.15.170:0/2911642172 >> 172.21.15.170:0/2911642172 conn(0x7f2ff00fb180 msgr2=0x7f2ff00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:55.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.309+0000 7f2ff531d640 1 -- 172.21.15.170:0/2911642172 shutdown_connections 2024-01-25T15:01:55.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.309+0000 7f2ff531d640 1 -- 172.21.15.170:0/2911642172 wait complete. 2024-01-25T15:01:55.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.309+0000 7f2ff531d640 1 Processor -- start 2024-01-25T15:01:55.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2ff531d640 1 -- start start 2024-01-25T15:01:55.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2ff531d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ff00ffbf0 0x7f2ff0196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2ff531d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ff0100de0 0x7f2ff0197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2ff531d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ff01017a0 0x7f2ff019e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2ff531d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff019e8b0 con 0x7f2ff0100de0 2024-01-25T15:01:55.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2ff531d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff019ea20 con 0x7f2ff00ffbf0 2024-01-25T15:01:55.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2ff531d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff019ebe0 con 0x7f2ff01017a0 2024-01-25T15:01:55.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2fe67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ff0100de0 0x7f2ff0197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2fe67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ff0100de0 0x7f2ff0197300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36372/0 (socket says 172.21.15.170:36372) 2024-01-25T15:01:55.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2fe67fc640 1 -- 172.21.15.170:0/336352897 learned_addr learned my addr 172.21.15.170:0/336352897 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:55.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2feeffd640 1 --2- 172.21.15.170:0/336352897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ff00ffbf0 0x7f2ff0196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2fef7fe640 1 --2- 172.21.15.170:0/336352897 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ff01017a0 0x7f2ff019e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2fe67fc640 1 -- 172.21.15.170:0/336352897 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ff01017a0 msgr2=0x7f2ff019e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2fe67fc640 1 --2- 172.21.15.170:0/336352897 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ff01017a0 0x7f2ff019e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2fe67fc640 1 -- 172.21.15.170:0/336352897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ff00ffbf0 msgr2=0x7f2ff0196dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2fe67fc640 1 --2- 172.21.15.170:0/336352897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ff00ffbf0 0x7f2ff0196dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2fe67fc640 1 -- 172.21.15.170:0/336352897 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd8009560 con 0x7f2ff0100de0 2024-01-25T15:01:55.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2fe67fc640 1 --2- 172.21.15.170:0/336352897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ff0100de0 0x7f2ff0197300 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009230 tx=0x7f2fd8004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:55.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.310+0000 7f2fecff9640 1 -- 172.21.15.170:0/336352897 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd80043d0 con 0x7f2ff0100de0 2024-01-25T15:01:55.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.311+0000 7f2fecff9640 1 -- 172.21.15.170:0/336352897 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2fd80054c0 con 0x7f2ff0100de0 2024-01-25T15:01:55.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.311+0000 7f2ff531d640 1 -- 172.21.15.170:0/336352897 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff019ee60 con 0x7f2ff0100de0 2024-01-25T15:01:55.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.311+0000 7f2fecff9640 1 -- 172.21.15.170:0/336352897 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd803e450 con 0x7f2ff0100de0 2024-01-25T15:01:55.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.311+0000 7f2ff531d640 1 -- 172.21.15.170:0/336352897 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff019f3b0 con 0x7f2ff0100de0 2024-01-25T15:01:55.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.312+0000 7f2ff531d640 1 -- 172.21.15.170:0/336352897 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff010b510 con 0x7f2ff0100de0 2024-01-25T15:01:55.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.313+0000 7f2fecff9640 1 -- 172.21.15.170:0/336352897 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f2fd80035f0 con 0x7f2ff0100de0 2024-01-25T15:01:55.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.313+0000 7f2fecff9640 1 --2- 172.21.15.170:0/336352897 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2fdc0a13f0 0x7f2fdc0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.313+0000 7f2feeffd640 1 --2- 172.21.15.170:0/336352897 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2fdc0a13f0 0x7f2fdc0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.313+0000 7f2fecff9640 1 -- 172.21.15.170:0/336352897 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f2fd80ef850 con 0x7f2ff0100de0 2024-01-25T15:01:55.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.314+0000 7f2feeffd640 1 --2- 172.21.15.170:0/336352897 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2fdc0a13f0 0x7f2fdc0a38b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0100c40 tx=0x7f2fe000b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:55.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.317+0000 7f2fecff9640 1 -- 172.21.15.170:0/336352897 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f2fd80b8cb0 con 0x7f2ff0100de0 2024-01-25T15:01:55.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:55 smithi186 ceph-mon[35697]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:01:55.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:55 smithi186 ceph-mon[35697]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:01:55.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:55 smithi186 ceph-mon[35697]: pgmap v346: 97 pgs: 97 active+clean; 646 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-01-25T15:01:55.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:55 smithi186 ceph-mon[35697]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:01:55.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:55 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/35198249' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:55.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:55 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/4028713240' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:55.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:55 smithi191 ceph-mon[36347]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:01:55.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:55 smithi191 ceph-mon[36347]: from='client.15411 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:01:55.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:55 smithi191 ceph-mon[36347]: pgmap v346: 97 pgs: 97 active+clean; 646 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-01-25T15:01:55.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:55 smithi191 ceph-mon[36347]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-01-25T15:01:55.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:55 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/35198249' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:55.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:55 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/4028713240' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:01:55.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.490+0000 7f2ff531d640 1 -- 172.21.15.170:0/336352897 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ff019f540 con 0x7f2ff0100de0 2024-01-25T15:01:55.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.490+0000 7f2fecff9640 1 -- 172.21.15.170:0/336352897 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2fd80430a0 con 0x7f2ff0100de0 2024-01-25T15:01:55.491 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 64 2024-01-25T15:01:55.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.492+0000 7f2ff531d640 1 -- 172.21.15.170:0/336352897 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2fdc0a13f0 msgr2=0x7f2fdc0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.493 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.492+0000 7f2ff531d640 1 --2- 172.21.15.170:0/336352897 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2fdc0a13f0 0x7f2fdc0a38b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0100c40 tx=0x7f2fe000b390 comp rx=0 tx=0).stop 2024-01-25T15:01:55.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.492+0000 7f2ff531d640 1 -- 172.21.15.170:0/336352897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ff0100de0 msgr2=0x7f2ff0197300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.492+0000 7f2ff531d640 1 --2- 172.21.15.170:0/336352897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ff0100de0 0x7f2ff0197300 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009230 tx=0x7f2fd8004ee0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.492+0000 7f2ff531d640 1 -- 172.21.15.170:0/336352897 shutdown_connections 2024-01-25T15:01:55.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.492+0000 7f2ff531d640 1 --2- 172.21.15.170:0/336352897 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2fdc0a13f0 0x7f2fdc0a38b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.492+0000 7f2ff531d640 1 --2- 172.21.15.170:0/336352897 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2ff01017a0 0x7f2ff019e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.492+0000 7f2ff531d640 1 --2- 172.21.15.170:0/336352897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2ff0100de0 0x7f2ff0197300 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.492+0000 7f2ff531d640 1 --2- 172.21.15.170:0/336352897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2ff00ffbf0 0x7f2ff0196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.492+0000 7f2ff531d640 1 -- 172.21.15.170:0/336352897 >> 172.21.15.170:0/336352897 conn(0x7f2ff00fb180 msgr2=0x7f2ff0067ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:55.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.492+0000 7f2ff531d640 1 -- 172.21.15.170:0/336352897 shutdown_connections 2024-01-25T15:01:55.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.493+0000 7f2ff531d640 1 -- 172.21.15.170:0/336352897 wait complete. 2024-01-25T15:01:55.505 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:01:55.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.605+0000 7f7bbd19e640 1 -- 172.21.15.170:0/1168956024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bb8106880 msgr2=0x7f7bb8108c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.605+0000 7f7bbd19e640 1 --2- 172.21.15.170:0/1168956024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bb8106880 0x7f7bb8108c70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009ca0 tx=0x7f7bb002c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.605+0000 7f7bbd19e640 1 -- 172.21.15.170:0/1168956024 shutdown_connections 2024-01-25T15:01:55.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.605+0000 7f7bbd19e640 1 --2- 172.21.15.170:0/1168956024 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7bb8103f50 0x7f7bb8106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.605+0000 7f7bbd19e640 1 --2- 172.21.15.170:0/1168956024 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bb8106880 0x7f7bb8108c70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.605+0000 7f7bbd19e640 1 --2- 172.21.15.170:0/1168956024 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bb8101620 0x7f7bb8103a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.605+0000 7f7bbd19e640 1 -- 172.21.15.170:0/1168956024 >> 172.21.15.170:0/1168956024 conn(0x7f7bb80fafd0 msgr2=0x7f7bb80fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:55.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.605+0000 7f7bbd19e640 1 -- 172.21.15.170:0/1168956024 shutdown_connections 2024-01-25T15:01:55.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.605+0000 7f7bbd19e640 1 -- 172.21.15.170:0/1168956024 wait complete. 2024-01-25T15:01:55.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.606+0000 7f7bbd19e640 1 Processor -- start 2024-01-25T15:01:55.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.606+0000 7f7bbd19e640 1 -- start start 2024-01-25T15:01:55.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.606+0000 7f7bbd19e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bb8101620 0x7f7bb8196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.606+0000 7f7bbd19e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bb8103f50 0x7f7bb8197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.606+0000 7f7bbd19e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7bb8106880 0x7f7bb819e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.606+0000 7f7bbd19e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb819e5c0 con 0x7f7bb8101620 2024-01-25T15:01:55.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.606+0000 7f7bbd19e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb819e730 con 0x7f7bb8106880 2024-01-25T15:01:55.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.606+0000 7f7bbd19e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb819e8f0 con 0x7f7bb8103f50 2024-01-25T15:01:55.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bb7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bb8101620 0x7f7bb8196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bb7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bb8101620 0x7f7bb8196ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42018/0 (socket says 172.21.15.170:42018) 2024-01-25T15:01:55.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bb7fff640 1 -- 172.21.15.170:0/3988108514 learned_addr learned my addr 172.21.15.170:0/3988108514 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:55.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bbc99d640 1 --2- 172.21.15.170:0/3988108514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7bb8106880 0x7f7bb819e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bb77fe640 1 --2- 172.21.15.170:0/3988108514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bb8103f50 0x7f7bb8197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bb7fff640 1 -- 172.21.15.170:0/3988108514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bb8103f50 msgr2=0x7f7bb8197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bb7fff640 1 --2- 172.21.15.170:0/3988108514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bb8103f50 0x7f7bb8197010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bb7fff640 1 -- 172.21.15.170:0/3988108514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7bb8106880 msgr2=0x7f7bb819e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bb7fff640 1 --2- 172.21.15.170:0/3988108514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7bb8106880 0x7f7bb819e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bb7fff640 1 -- 172.21.15.170:0/3988108514 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb0009900 con 0x7f7bb8101620 2024-01-25T15:01:55.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bb7fff640 1 --2- 172.21.15.170:0/3988108514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bb8101620 0x7f7bb8196ad0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c890 tx=0x7f7ba800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:55.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bb57fa640 1 -- 172.21.15.170:0/3988108514 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8004220 con 0x7f7bb8101620 2024-01-25T15:01:55.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bb57fa640 1 -- 172.21.15.170:0/3988108514 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ba8007e70 con 0x7f7bb8101620 2024-01-25T15:01:55.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bbd19e640 1 -- 172.21.15.170:0/3988108514 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb819ebd0 con 0x7f7bb8101620 2024-01-25T15:01:55.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bb57fa640 1 -- 172.21.15.170:0/3988108514 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8005690 con 0x7f7bb8101620 2024-01-25T15:01:55.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.607+0000 7f7bbd19e640 1 -- 172.21.15.170:0/3988108514 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb819f0e0 con 0x7f7bb8101620 2024-01-25T15:01:55.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.608+0000 7f7bbd19e640 1 -- 172.21.15.170:0/3988108514 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb80fcac0 con 0x7f7bb8101620 2024-01-25T15:01:55.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.609+0000 7f7bb57fa640 1 -- 172.21.15.170:0/3988108514 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f7ba80079b0 con 0x7f7bb8101620 2024-01-25T15:01:55.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.610+0000 7f7bb57fa640 1 --2- 172.21.15.170:0/3988108514 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7ba00a1370 0x7f7ba00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.610+0000 7f7bb57fa640 1 -- 172.21.15.170:0/3988108514 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f7ba80cc900 con 0x7f7bb8101620 2024-01-25T15:01:55.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.610+0000 7f7bb77fe640 1 --2- 172.21.15.170:0/3988108514 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7ba00a1370 0x7f7ba00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.610+0000 7f7bb77fe640 1 --2- 172.21.15.170:0/3988108514 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7ba00a1370 0x7f7ba00a3830 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8197fe0 tx=0x7f7bac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:55.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.614+0000 7f7bb57fa640 1 -- 172.21.15.170:0/3988108514 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f7ba8095d00 con 0x7f7bb8101620 2024-01-25T15:01:55.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.823+0000 7f7bbd19e640 1 -- 172.21.15.170:0/3988108514 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bb810c400 con 0x7f7bb8101620 2024-01-25T15:01:55.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.824+0000 7f7bb57fa640 1 -- 172.21.15.170:0/3988108514 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11411 (secure 0 0 0) 0x7f7ba8099320 con 0x7f7bb8101620 2024-01-25T15:01:55.825 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:55.825 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-25T14:59:53.534085+0000","modified":"2024-01-25T15:01:49.253000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24484,"mds_1":24479,"mds_2":24466,"mds_3":24418,"mds_4":24398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":4,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24479":{"gid":24479,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/2132502182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":2132502182},{"type":"v1","addr":"172.21.15.186:6839","nonce":2132502182}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:01:55.825 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 26 2024-01-25T15:01:55.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.826+0000 7f7bbd19e640 1 -- 172.21.15.170:0/3988108514 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7ba00a1370 msgr2=0x7f7ba00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.826+0000 7f7bbd19e640 1 --2- 172.21.15.170:0/3988108514 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7ba00a1370 0x7f7ba00a3830 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8197fe0 tx=0x7f7bac005f90 comp rx=0 tx=0).stop 2024-01-25T15:01:55.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.826+0000 7f7bbd19e640 1 -- 172.21.15.170:0/3988108514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bb8101620 msgr2=0x7f7bb8196ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.826+0000 7f7bbd19e640 1 --2- 172.21.15.170:0/3988108514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bb8101620 0x7f7bb8196ad0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c890 tx=0x7f7ba800cd50 comp rx=0 tx=0).stop 2024-01-25T15:01:55.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.826+0000 7f7bbd19e640 1 -- 172.21.15.170:0/3988108514 shutdown_connections 2024-01-25T15:01:55.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.826+0000 7f7bbd19e640 1 --2- 172.21.15.170:0/3988108514 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7ba00a1370 0x7f7ba00a3830 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.826+0000 7f7bbd19e640 1 --2- 172.21.15.170:0/3988108514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7bb8106880 0x7f7bb819e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.826+0000 7f7bbd19e640 1 --2- 172.21.15.170:0/3988108514 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7bb8103f50 0x7f7bb8197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.826+0000 7f7bbd19e640 1 --2- 172.21.15.170:0/3988108514 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7bb8101620 0x7f7bb8196ad0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.826+0000 7f7bbd19e640 1 -- 172.21.15.170:0/3988108514 >> 172.21.15.170:0/3988108514 conn(0x7f7bb80fafd0 msgr2=0x7f7bb8101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:55.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.826+0000 7f7bbd19e640 1 -- 172.21.15.170:0/3988108514 shutdown_connections 2024-01-25T15:01:55.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.826+0000 7f7bbd19e640 1 -- 172.21.15.170:0/3988108514 wait complete. 2024-01-25T15:01:55.839 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:01:55.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.940+0000 7fafa9c46640 1 -- 172.21.15.170:0/3277676074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa4100f70 msgr2=0x7fafa4107800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.940+0000 7fafa9c46640 1 --2- 172.21.15.170:0/3277676074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa4100f70 0x7fafa4107800 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7faf9c009ca0 tx=0x7faf9c02c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.940+0000 7fafa9c46640 1 -- 172.21.15.170:0/3277676074 shutdown_connections 2024-01-25T15:01:55.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.940+0000 7fafa9c46640 1 --2- 172.21.15.170:0/3277676074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa4100f70 0x7fafa4107800 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.940+0000 7fafa9c46640 1 --2- 172.21.15.170:0/3277676074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafa41005b0 0x7fafa4100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.940+0000 7fafa9c46640 1 --2- 172.21.15.170:0/3277676074 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa40ff3c0 0x7fafa40ff7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.940+0000 7fafa9c46640 1 -- 172.21.15.170:0/3277676074 >> 172.21.15.170:0/3277676074 conn(0x7fafa40fa930 msgr2=0x7fafa40fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:55.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.940+0000 7fafa9c46640 1 -- 172.21.15.170:0/3277676074 shutdown_connections 2024-01-25T15:01:55.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.940+0000 7fafa9c46640 1 -- 172.21.15.170:0/3277676074 wait complete. 2024-01-25T15:01:55.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa9c46640 1 Processor -- start 2024-01-25T15:01:55.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa9c46640 1 -- start start 2024-01-25T15:01:55.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa9c46640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa40ff3c0 0x7fafa40fc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa9c46640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa41005b0 0x7fafa419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa9c46640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafa4100f70 0x7fafa419dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa9c46640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa419e740 con 0x7fafa40ff3c0 2024-01-25T15:01:55.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa9c46640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa419e8b0 con 0x7fafa41005b0 2024-01-25T15:01:55.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa9c46640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa419ea70 con 0x7fafa4100f70 2024-01-25T15:01:55.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa40ff3c0 0x7fafa40fc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa40ff3c0 0x7fafa40fc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42028/0 (socket says 172.21.15.170:42028) 2024-01-25T15:01:55.944 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa37fe640 1 -- 172.21.15.170:0/442950436 learned_addr learned my addr 172.21.15.170:0/442950436 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:55.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa2ffd640 1 --2- 172.21.15.170:0/442950436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa41005b0 0x7fafa419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa3fff640 1 --2- 172.21.15.170:0/442950436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafa4100f70 0x7fafa419dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa37fe640 1 -- 172.21.15.170:0/442950436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafa4100f70 msgr2=0x7fafa419dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa37fe640 1 --2- 172.21.15.170:0/442950436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafa4100f70 0x7fafa419dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa37fe640 1 -- 172.21.15.170:0/442950436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa41005b0 msgr2=0x7fafa419b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:55.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa37fe640 1 --2- 172.21.15.170:0/442950436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa41005b0 0x7fafa419b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:55.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa37fe640 1 -- 172.21.15.170:0/442950436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c009900 con 0x7fafa40ff3c0 2024-01-25T15:01:55.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.941+0000 7fafa2ffd640 1 --2- 172.21.15.170:0/442950436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa41005b0 0x7fafa419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:55.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.942+0000 7fafa37fe640 1 --2- 172.21.15.170:0/442950436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa40ff3c0 0x7fafa40fc990 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7faf9400d770 tx=0x7faf9400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:55.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.942+0000 7fafa0ff9640 1 -- 172.21.15.170:0/442950436 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf94009c30 con 0x7fafa40ff3c0 2024-01-25T15:01:55.945 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.942+0000 7fafa0ff9640 1 -- 172.21.15.170:0/442950436 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf9400de80 con 0x7fafa40ff3c0 2024-01-25T15:01:55.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.942+0000 7fafa0ff9640 1 -- 172.21.15.170:0/442950436 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf94003e20 con 0x7fafa40ff3c0 2024-01-25T15:01:55.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.942+0000 7fafa9c46640 1 -- 172.21.15.170:0/442950436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa419ed50 con 0x7fafa40ff3c0 2024-01-25T15:01:55.946 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.942+0000 7fafa9c46640 1 -- 172.21.15.170:0/442950436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa419f1f0 con 0x7fafa40ff3c0 2024-01-25T15:01:55.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.943+0000 7fafa9c46640 1 -- 172.21.15.170:0/442950436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa410acb0 con 0x7fafa40ff3c0 2024-01-25T15:01:55.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.944+0000 7fafa0ff9640 1 -- 172.21.15.170:0/442950436 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7faf94003f80 con 0x7fafa40ff3c0 2024-01-25T15:01:55.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.945+0000 7fafa0ff9640 1 --2- 172.21.15.170:0/442950436 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faf8c0a13f0 0x7faf8c0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:55.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.945+0000 7fafa2ffd640 1 --2- 172.21.15.170:0/442950436 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faf8c0a13f0 0x7faf8c0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:55.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.945+0000 7fafa0ff9640 1 -- 172.21.15.170:0/442950436 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7faf940ccae0 con 0x7fafa40ff3c0 2024-01-25T15:01:55.947 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.945+0000 7fafa2ffd640 1 --2- 172.21.15.170:0/442950436 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faf8c0a13f0 0x7faf8c0a38b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fafa40fcf30 tx=0x7faf9800a5c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:55.949 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:55.948+0000 7fafa0ff9640 1 -- 172.21.15.170:0/442950436 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7faf94095eb0 con 0x7fafa40ff3c0 2024-01-25T15:01:56.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.121+0000 7fafa9c46640 1 -- 172.21.15.170:0/442950436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafa419f3e0 con 0x7fafa40ff3c0 2024-01-25T15:01:56.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.123+0000 7fafa0ff9640 1 -- 172.21.15.170:0/442950436 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22550 (secure 0 0 0) 0x7faf94017020 con 0x7fafa40ff3c0 2024-01-25T15:01:56.124 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:01:56.124 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":87,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T15:00:57.274280+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:01:56.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.125+0000 7fafa9c46640 1 -- 172.21.15.170:0/442950436 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faf8c0a13f0 msgr2=0x7faf8c0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.125+0000 7fafa9c46640 1 --2- 172.21.15.170:0/442950436 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faf8c0a13f0 0x7faf8c0a38b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fafa40fcf30 tx=0x7faf9800a5c0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.125+0000 7fafa9c46640 1 -- 172.21.15.170:0/442950436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa40ff3c0 msgr2=0x7fafa40fc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.125+0000 7fafa9c46640 1 --2- 172.21.15.170:0/442950436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa40ff3c0 0x7fafa40fc990 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7faf9400d770 tx=0x7faf9400dc30 comp rx=0 tx=0).stop 2024-01-25T15:01:56.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.125+0000 7fafa9c46640 1 -- 172.21.15.170:0/442950436 shutdown_connections 2024-01-25T15:01:56.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.125+0000 7fafa9c46640 1 --2- 172.21.15.170:0/442950436 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7faf8c0a13f0 0x7faf8c0a38b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.125+0000 7fafa9c46640 1 --2- 172.21.15.170:0/442950436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa41005b0 0x7fafa419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.125+0000 7fafa9c46640 1 --2- 172.21.15.170:0/442950436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fafa4100f70 0x7fafa419dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.125+0000 7fafa9c46640 1 --2- 172.21.15.170:0/442950436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fafa40ff3c0 0x7fafa40fc990 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.125+0000 7fafa9c46640 1 -- 172.21.15.170:0/442950436 >> 172.21.15.170:0/442950436 conn(0x7fafa40fa930 msgr2=0x7fafa4103c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:56.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.125+0000 7fafa9c46640 1 -- 172.21.15.170:0/442950436 shutdown_connections 2024-01-25T15:01:56.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.125+0000 7fafa9c46640 1 -- 172.21.15.170:0/442950436 wait complete. 2024-01-25T15:01:56.138 DEBUG:tasks.fwd_scrub:Yielding 2024-01-25T15:01:56.138 INFO:teuthology.run_tasks:Running task background_exec... 2024-01-25T15:01:56.149 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi170.front.sepia.ceph.com 2024-01-25T15:01:56.149 DEBUG:teuthology.orchestra.run.smithi170:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-01-25T15:01:56.149 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-01-25T15:01:56.150 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-01-25T15:01:56.150 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-01-25T15:01:56.152 INFO:teuthology.run_tasks:Running task workunit... 2024-01-25T15:01:56.164 INFO:tasks.workunit:Pulling workunits from ref 661946e7044723130c03627323f6a879a9848cb5 2024-01-25T15:01:56.165 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-01-25T15:01:56.165 INFO:tasks.workunit:timeout=6h 2024-01-25T15:01:56.165 INFO:tasks.workunit:cleanup=True 2024-01-25T15:01:56.165 DEBUG:teuthology.orchestra.run.smithi170:> stat -- /home/ubuntu/cephtest/mnt.0 2024-01-25T15:01:56.180 INFO:teuthology.orchestra.run.smithi170.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-01-25T15:01:56.180 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-01-25T15:01:56.181 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 77h/119d Inode: 1099511628283 Links: 2 2024-01-25T15:01:56.181 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-25T15:01:56.181 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-01-25T15:01:56.181 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-01-25 15:00:00.084571724 +0000 2024-01-25T15:01:56.181 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-01-25 15:00:00.084571724 +0000 2024-01-25T15:01:56.181 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-01-25 15:01:48.581682361 +0000 2024-01-25T15:01:56.181 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-01-25 15:00:00.084571724 +0000 2024-01-25T15:01:56.181 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-01-25T15:01:56.181 DEBUG:teuthology.orchestra.run.smithi170:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-01-25T15:01:56.256 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 661946e7044723130c03627323f6a879a9848cb5 2024-01-25T15:01:56.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.259+0000 7fefe08b6640 1 -- 172.21.15.170:0/184752445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc0ffbf0 msgr2=0x7fefdc100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.259+0000 7fefe08b6640 1 --2- 172.21.15.170:0/184752445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc0ffbf0 0x7fefdc100010 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fefcc009900 tx=0x7fefcc02bc30 comp rx=0 tx=0).stop 2024-01-25T15:01:56.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.260+0000 7fefe08b6640 1 -- 172.21.15.170:0/184752445 shutdown_connections 2024-01-25T15:01:56.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.260+0000 7fefe08b6640 1 --2- 172.21.15.170:0/184752445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefdc100de0 0x7fefdc101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.260+0000 7fefe08b6640 1 --2- 172.21.15.170:0/184752445 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefdc1017a0 0x7fefdc108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.260+0000 7fefe08b6640 1 --2- 172.21.15.170:0/184752445 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc0ffbf0 0x7fefdc100010 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.260+0000 7fefe08b6640 1 -- 172.21.15.170:0/184752445 >> 172.21.15.170:0/184752445 conn(0x7fefdc0fb180 msgr2=0x7fefdc0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:56.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.260+0000 7fefe08b6640 1 -- 172.21.15.170:0/184752445 shutdown_connections 2024-01-25T15:01:56.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.260+0000 7fefe08b6640 1 -- 172.21.15.170:0/184752445 wait complete. 2024-01-25T15:01:56.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.260+0000 7fefe08b6640 1 Processor -- start 2024-01-25T15:01:56.262 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.260+0000 7fefe08b6640 1 -- start start 2024-01-25T15:01:56.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.260+0000 7fefe08b6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefdc0ffbf0 0x7fefdc0689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.260+0000 7fefe08b6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc100de0 0x7fefdc19ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.260+0000 7fefe08b6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefdc1017a0 0x7fefdc19e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.260+0000 7fefe08b6640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc19e800 con 0x7fefdc100de0 2024-01-25T15:01:56.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.260+0000 7fefe08b6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc19e970 con 0x7fefdc1017a0 2024-01-25T15:01:56.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.260+0000 7fefe08b6640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc19eb30 con 0x7fefdc0ffbf0 2024-01-25T15:01:56.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefd3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc100de0 0x7fefdc19ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefd3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc100de0 0x7fefdc19ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42050/0 (socket says 172.21.15.170:42050) 2024-01-25T15:01:56.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefd3fff640 1 -- 172.21.15.170:0/2522202224 learned_addr learned my addr 172.21.15.170:0/2522202224 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:56.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefda59c640 1 --2- 172.21.15.170:0/2522202224 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefdc0ffbf0 0x7fefdc0689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.263 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefdad9d640 1 --2- 172.21.15.170:0/2522202224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefdc1017a0 0x7fefdc19e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefd3fff640 1 -- 172.21.15.170:0/2522202224 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefdc0ffbf0 msgr2=0x7fefdc0689e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefd3fff640 1 --2- 172.21.15.170:0/2522202224 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefdc0ffbf0 0x7fefdc0689e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefd3fff640 1 -- 172.21.15.170:0/2522202224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefdc1017a0 msgr2=0x7fefdc19e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefd3fff640 1 --2- 172.21.15.170:0/2522202224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefdc1017a0 0x7fefdc19e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefd3fff640 1 -- 172.21.15.170:0/2522202224 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc009560 con 0x7fefdc100de0 2024-01-25T15:01:56.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefdad9d640 1 --2- 172.21.15.170:0/2522202224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefdc1017a0 0x7fefdc19e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:56.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefd3fff640 1 --2- 172.21.15.170:0/2522202224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc100de0 0x7fefdc19ba30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fefc400d950 tx=0x7fefc400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:56.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefd37fe640 1 -- 172.21.15.170:0/2522202224 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4009c30 con 0x7fefdc100de0 2024-01-25T15:01:56.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefd37fe640 1 -- 172.21.15.170:0/2522202224 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefc4009d90 con 0x7fefdc100de0 2024-01-25T15:01:56.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefe08b6640 1 -- 172.21.15.170:0/2522202224 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefdc19ee10 con 0x7fefdc100de0 2024-01-25T15:01:56.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefd37fe640 1 -- 172.21.15.170:0/2522202224 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc400f740 con 0x7fefdc100de0 2024-01-25T15:01:56.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.261+0000 7fefe08b6640 1 -- 172.21.15.170:0/2522202224 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc19f290 con 0x7fefdc100de0 2024-01-25T15:01:56.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefe347f740 1 Processor -- start 2024-01-25T15:01:56.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefe347f740 1 -- start start 2024-01-25T15:01:56.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefe347f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b695490 0x556c1b6958b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefe347f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695e80 0x556c1b69a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefe347f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b69aff0 0x556c1b69d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefe347f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1b667c20 con 0x556c1b69aff0 2024-01-25T15:01:56.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefe347f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1b5fff80 con 0x556c1b695e80 2024-01-25T15:01:56.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefe347f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1b5fd670 con 0x556c1b695490 2024-01-25T15:01:56.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefd37fe640 1 -- 172.21.15.170:0/2522202224 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fefc4010a20 con 0x7fefdc100de0 2024-01-25T15:01:56.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefd3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b69aff0 0x556c1b69d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefd3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b69aff0 0x556c1b69d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42054/0 (socket says 172.21.15.170:42054) 2024-01-25T15:01:56.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefd3fff640 1 -- 172.21.15.170:0/497669977 learned_addr learned my addr 172.21.15.170:0/497669977 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:56.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefdad9d640 1 --2- 172.21.15.170:0/497669977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b695490 0x556c1b6958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefda59c640 1 --2- 172.21.15.170:0/497669977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695e80 0x556c1b69a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefd3fff640 1 -- 172.21.15.170:0/497669977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b695490 msgr2=0x556c1b6958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.264+0000 7fefd3fff640 1 --2- 172.21.15.170:0/497669977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b695490 0x556c1b6958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.265+0000 7fefd3fff640 1 -- 172.21.15.170:0/497669977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695e80 msgr2=0x556c1b69a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.265+0000 7fefd3fff640 1 --2- 172.21.15.170:0/497669977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695e80 0x556c1b69a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.265+0000 7fefd3fff640 1 -- 172.21.15.170:0/497669977 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c1b5f0d80 con 0x556c1b69aff0 2024-01-25T15:01:56.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.265+0000 7fefda59c640 1 --2- 172.21.15.170:0/497669977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695e80 0x556c1b69a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.265+0000 7fefd3fff640 1 --2- 172.21.15.170:0/497669977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b69aff0 0x556c1b69d480 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fefc40ca210 tx=0x7fefc40d2ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f4b4645b0bebc0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.265+0000 7fefd37fe640 1 --2- 172.21.15.170:0/2522202224 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fefc80a1370 0x7fefc80a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.265+0000 7fefdad9d640 1 --2- 172.21.15.170:0/2522202224 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fefc80a1370 0x7fefc80a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.265+0000 7fefd0ff9640 1 -- 172.21.15.170:0/497669977 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4095c40 con 0x556c1b69aff0 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.265+0000 7fefd37fe640 1 -- 172.21.15.170:0/2522202224 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fefc40cc8f0 con 0x7fefdc100de0 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.265+0000 7fefd0ff9640 1 -- 172.21.15.170:0/497669977 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefc40d26d0 con 0x556c1b69aff0 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.265+0000 7fefd0ff9640 1 -- 172.21.15.170:0/497669977 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc40071c0 con 0x556c1b69aff0 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.266+0000 7fefe347f740 1 -- 172.21.15.170:0/497669977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b69aff0 msgr2=0x556c1b69d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.266+0000 7fefdad9d640 1 --2- 172.21.15.170:0/2522202224 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fefc80a1370 0x7fefc80a3830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x556c1b6966e0 tx=0x7fefd4009800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.266+0000 7fefe347f740 1 --2- 172.21.15.170:0/497669977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b69aff0 0x556c1b69d480 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fefc40ca210 tx=0x7fefc40d2ef0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.266+0000 7fefe347f740 1 -- 172.21.15.170:0/497669977 shutdown_connections 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.266+0000 7fefe347f740 1 --2- 172.21.15.170:0/497669977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695e80 0x556c1b69a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.266+0000 7fefe347f740 1 --2- 172.21.15.170:0/497669977 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b69aff0 0x556c1b69d480 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.266+0000 7fefe347f740 1 --2- 172.21.15.170:0/497669977 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b695490 0x556c1b6958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.266+0000 7fefe347f740 1 -- 172.21.15.170:0/497669977 >> 172.21.15.170:0/497669977 conn(0x556c1b68c5f0 msgr2=0x556c1b68c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:56.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.266+0000 7fefe347f740 1 -- 172.21.15.170:0/497669977 shutdown_connections 2024-01-25T15:01:56.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.266+0000 7fefe347f740 1 -- 172.21.15.170:0/497669977 wait complete. 2024-01-25T15:01:56.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.266+0000 7fefe347f740 1 -- start start 2024-01-25T15:01:56.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.266+0000 7fefe347f740 1 Processor -- start 2024-01-25T15:01:56.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefe347f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695490 0x556c1b69f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefe347f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b69f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefe347f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b69aff0 0x556c1b6a6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefe347f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1b5f8f60 con 0x556c1b695e80 2024-01-25T15:01:56.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefe347f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1b5b20f0 con 0x556c1b695490 2024-01-25T15:01:56.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefe347f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1b5b1d90 con 0x556c1b69aff0 2024-01-25T15:01:56.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefe347f740 10 client.0 _ll_register_callbacks cb 0x556c1b597ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:56.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefd3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b69f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefd3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b69f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42058/0 (socket says 172.21.15.170:42058) 2024-01-25T15:01:56.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefd3fff640 1 -- 172.21.15.170:0/1587860725 learned_addr learned my addr 172.21.15.170:0/1587860725 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:56.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefdad9d640 1 --2- 172.21.15.170:0/1587860725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b69aff0 0x556c1b6a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefda59c640 1 --2- 172.21.15.170:0/1587860725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695490 0x556c1b69f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefd3fff640 1 -- 172.21.15.170:0/1587860725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b69aff0 msgr2=0x556c1b6a6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefd3fff640 1 --2- 172.21.15.170:0/1587860725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b69aff0 0x556c1b6a6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefd3fff640 1 -- 172.21.15.170:0/1587860725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695490 msgr2=0x556c1b69f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefd3fff640 1 --2- 172.21.15.170:0/1587860725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695490 0x556c1b69f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefd3fff640 1 -- 172.21.15.170:0/1587860725 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc19f290 con 0x556c1b695e80 2024-01-25T15:01:56.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefd3fff640 1 --2- 172.21.15.170:0/1587860725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b69f920 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fefc40ca350 tx=0x7fefc40ca240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d394c05cc7729b67 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:56.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:56.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefc1ffb640 1 -- 172.21.15.170:0/1587860725 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc40d26d0 con 0x556c1b695e80 2024-01-25T15:01:56.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefe347f740 1 -- 172.21.15.170:0/1587860725 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c1b5f1c70 con 0x556c1b695e80 2024-01-25T15:01:56.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.267+0000 7fefc1ffb640 1 -- 172.21.15.170:0/1587860725 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fefc409a000 con 0x556c1b695e80 2024-01-25T15:01:56.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.268+0000 7fefc1ffb640 1 -- 172.21.15.170:0/1587860725 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefc4095c40 con 0x556c1b695e80 2024-01-25T15:01:56.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.268+0000 7fefe347f740 10 client.15465 fetch_fsmap learned FSMap version 26 2024-01-25T15:01:56.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.268+0000 7fefe347f740 1 -- 172.21.15.170:0/1587860725 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556c1b5f75e0 con 0x556c1b695e80 2024-01-25T15:01:56.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.268+0000 7fefc1ffb640 1 -- 172.21.15.170:0/1587860725 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556c1b5f1c70 con 0x556c1b695e80 2024-01-25T15:01:56.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.268+0000 7fefc1ffb640 1 -- 172.21.15.170:0/1587860725 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fefc40ccd20 con 0x556c1b695e80 2024-01-25T15:01:56.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.268+0000 7fefe347f740 10 client.15465 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:01:56.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.268+0000 7fefe347f740 10 client.15465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:01:56.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.268+0000 7fefe347f740 20 client.15465 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:56.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.268+0000 7fefe347f740 1 --2- 172.21.15.170:0/1587860725 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x556c1b6ab170 0x556c1b6ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.268+0000 7fefe347f740 4 client.15465 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:01:56.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.268+0000 7fefe347f740 1 -- 172.21.15.170:0/1587860725 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c1b2f8860 con 0x556c1b6ab170 2024-01-25T15:01:56.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.268+0000 7fefda59c640 1 --2- 172.21.15.170:0/1587860725 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x556c1b6ab170 0x556c1b6ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.269+0000 7fefc1ffb640 10 client.15465 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:56.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.269+0000 7fefda59c640 1 --2- 172.21.15.170:0/1587860725 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x556c1b6ab170 0x556c1b6ad590 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c41ff70d0cbfe7c server_cookie=cd41cc590099ffc2 in_seq=0 out_seq=0 2024-01-25T15:01:56.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.269+0000 7fefc1ffb640 1 -- 172.21.15.170:0/1587860725 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556c1b2f8860 con 0x556c1b6ab170 2024-01-25T15:01:56.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.269+0000 7fefc1ffb640 10 client.15465 handle_command_reply: tid=0 2024-01-25T15:01:56.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.269+0000 7fefe347f740 1 client.15465 shutdown 2024-01-25T15:01:56.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.269+0000 7fefe347f740 1 -- 172.21.15.170:0/1587860725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 msgr2=0x556c1b69f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.269+0000 7fefe347f740 1 --2- 172.21.15.170:0/1587860725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b69f920 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fefc40ca350 tx=0x7fefc40ca240 comp rx=0 tx=0).stop 2024-01-25T15:01:56.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.269+0000 7fefe347f740 1 -- 172.21.15.170:0/1587860725 shutdown_connections 2024-01-25T15:01:56.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.269+0000 7fefe347f740 1 --2- 172.21.15.170:0/1587860725 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x556c1b6ab170 0x556c1b6ad590 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.270+0000 7fefe347f740 1 --2- 172.21.15.170:0/1587860725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b69aff0 0x556c1b6a6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.270+0000 7fefc1ffb640 0 client.15465 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:56.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.270+0000 7fefe347f740 1 --2- 172.21.15.170:0/1587860725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b69f920 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.270+0000 7fefe347f740 1 --2- 172.21.15.170:0/1587860725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695490 0x556c1b69f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.270+0000 7fefe347f740 1 -- 172.21.15.170:0/1587860725 >> 172.21.15.170:0/1587860725 conn(0x556c1b68c5f0 msgr2=0x556c1b68b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:56.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.270+0000 7fefe347f740 1 -- 172.21.15.170:0/1587860725 shutdown_connections 2024-01-25T15:01:56.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.270+0000 7fefe347f740 1 -- 172.21.15.170:0/1587860725 wait complete. 2024-01-25T15:01:56.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.270+0000 7fefe347f740 20 client.15465 trim_cache size 0 max 16384 2024-01-25T15:01:56.279 INFO:tasks.workunit.client.0.smithi170.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-01-25T15:01:56.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.285+0000 7fefe347f740 1 Processor -- start 2024-01-25T15:01:56.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.285+0000 7fefe347f740 1 -- start start 2024-01-25T15:01:56.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.285+0000 7fefe347f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b695490 0x556c1b687820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.285+0000 7fefe347f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b6a6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.285+0000 7fefe347f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b69aff0 0x556c1b6971c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.285+0000 7fefe347f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1b69add0 con 0x556c1b695e80 2024-01-25T15:01:56.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.285+0000 7fefe347f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1b576e60 con 0x556c1b69aff0 2024-01-25T15:01:56.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.285+0000 7fefe347f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1b68d040 con 0x556c1b695490 2024-01-25T15:01:56.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.285+0000 7fefd3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b6a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.285+0000 7fefd3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b6a6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42070/0 (socket says 172.21.15.170:42070) 2024-01-25T15:01:56.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.285+0000 7fefd3fff640 1 -- 172.21.15.170:0/340184680 learned_addr learned my addr 172.21.15.170:0/340184680 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:56.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.285+0000 7fefda59c640 1 --2- 172.21.15.170:0/340184680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b695490 0x556c1b687820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.285+0000 7fefdad9d640 1 --2- 172.21.15.170:0/340184680 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b69aff0 0x556c1b6971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.286+0000 7fefd3fff640 1 -- 172.21.15.170:0/340184680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b695490 msgr2=0x556c1b687820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.286+0000 7fefd3fff640 1 --2- 172.21.15.170:0/340184680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b695490 0x556c1b687820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.286+0000 7fefd3fff640 1 -- 172.21.15.170:0/340184680 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b69aff0 msgr2=0x556c1b6971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.286+0000 7fefd3fff640 1 --2- 172.21.15.170:0/340184680 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b69aff0 0x556c1b6971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.286+0000 7fefd3fff640 1 -- 172.21.15.170:0/340184680 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c1b593d80 con 0x556c1b695e80 2024-01-25T15:01:56.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.286+0000 7fefdad9d640 1 --2- 172.21.15.170:0/340184680 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b69aff0 0x556c1b6971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:56.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.286+0000 7fefd3fff640 1 --2- 172.21.15.170:0/340184680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b6a6920 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fefc4095e00 tx=0x7fefc400bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a99f3fbd873240 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:56.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.286+0000 7fefc3fff640 1 -- 172.21.15.170:0/340184680 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc40ca660 con 0x556c1b695e80 2024-01-25T15:01:56.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.286+0000 7fefc3fff640 1 -- 172.21.15.170:0/340184680 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefc4095c40 con 0x556c1b695e80 2024-01-25T15:01:56.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.286+0000 7fefc3fff640 1 -- 172.21.15.170:0/340184680 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4099900 con 0x556c1b695e80 2024-01-25T15:01:56.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 -- 172.21.15.170:0/340184680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 msgr2=0x556c1b6a6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 --2- 172.21.15.170:0/340184680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b6a6920 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fefc4095e00 tx=0x7fefc400bf60 comp rx=0 tx=0).stop 2024-01-25T15:01:56.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 -- 172.21.15.170:0/340184680 shutdown_connections 2024-01-25T15:01:56.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 --2- 172.21.15.170:0/340184680 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b69aff0 0x556c1b6971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 --2- 172.21.15.170:0/340184680 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b6a6920 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 --2- 172.21.15.170:0/340184680 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b695490 0x556c1b687820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 -- 172.21.15.170:0/340184680 >> 172.21.15.170:0/340184680 conn(0x556c1b68c5f0 msgr2=0x556c1b696710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:56.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 -- 172.21.15.170:0/340184680 shutdown_connections 2024-01-25T15:01:56.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 -- 172.21.15.170:0/340184680 wait complete. 2024-01-25T15:01:56.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 -- start start 2024-01-25T15:01:56.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 Processor -- start 2024-01-25T15:01:56.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695490 0x556c1b6a6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b6a6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b69aff0 0x556c1b6a4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1b6a4dd0 con 0x556c1b695e80 2024-01-25T15:01:56.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1b6a4f40 con 0x556c1b695490 2024-01-25T15:01:56.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1b6a5100 con 0x556c1b69aff0 2024-01-25T15:01:56.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefe347f740 10 client.0 _ll_register_callbacks cb 0x7fefc40d2400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:56.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefd3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b6a6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefd3fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b6a6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42084/0 (socket says 172.21.15.170:42084) 2024-01-25T15:01:56.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefd3fff640 1 -- 172.21.15.170:0/340891052 learned_addr learned my addr 172.21.15.170:0/340891052 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:56.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.287+0000 7fefdad9d640 1 --2- 172.21.15.170:0/340891052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b69aff0 0x556c1b6a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.293 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefda59c640 1 --2- 172.21.15.170:0/340891052 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695490 0x556c1b6a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefd3fff640 1 -- 172.21.15.170:0/340891052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b69aff0 msgr2=0x556c1b6a4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefd3fff640 1 --2- 172.21.15.170:0/340891052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b69aff0 0x556c1b6a4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefd3fff640 1 -- 172.21.15.170:0/340891052 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695490 msgr2=0x556c1b6a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefd3fff640 1 --2- 172.21.15.170:0/340891052 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695490 0x556c1b6a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefd3fff640 1 -- 172.21.15.170:0/340891052 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c1b5f75e0 con 0x556c1b695e80 2024-01-25T15:01:56.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefd3fff640 1 --2- 172.21.15.170:0/340891052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b6a6740 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fefc4099890 tx=0x7fefc4010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428e437d09a9c400 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:56.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:56.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefc1ffb640 1 -- 172.21.15.170:0/340891052 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc4014070 con 0x556c1b695e80 2024-01-25T15:01:56.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefc1ffb640 1 -- 172.21.15.170:0/340891052 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fefc40a1c90 con 0x556c1b695e80 2024-01-25T15:01:56.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefe347f740 1 -- 172.21.15.170:0/340891052 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c1b5f1f50 con 0x556c1b695e80 2024-01-25T15:01:56.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefc1ffb640 1 -- 172.21.15.170:0/340891052 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefc409dac0 con 0x556c1b695e80 2024-01-25T15:01:56.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefe347f740 10 client.15471 fetch_fsmap learned FSMap version 26 2024-01-25T15:01:56.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefe347f740 1 -- 172.21.15.170:0/340891052 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556c1b5b9990 con 0x556c1b695e80 2024-01-25T15:01:56.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefc1ffb640 1 -- 172.21.15.170:0/340891052 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556c1b5f1f50 con 0x556c1b695e80 2024-01-25T15:01:56.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefc1ffb640 1 -- 172.21.15.170:0/340891052 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fefc40b4030 con 0x556c1b695e80 2024-01-25T15:01:56.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefe347f740 10 client.15471 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:01:56.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefe347f740 10 client.15471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:01:56.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefe347f740 20 client.15471 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:56.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefe347f740 1 --2- 172.21.15.170:0/340891052 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x556c1b6ab170 0x556c1b7045e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefe347f740 4 client.15471 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-01-25T15:01:56.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.288+0000 7fefe347f740 1 -- 172.21.15.170:0/340891052 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x556c1b34beb0 con 0x556c1b6ab170 2024-01-25T15:01:56.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.289+0000 7fefda59c640 1 --2- 172.21.15.170:0/340891052 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x556c1b6ab170 0x556c1b7045e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.289+0000 7fefc1ffb640 10 client.15471 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:56.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.289+0000 7fefda59c640 1 --2- 172.21.15.170:0/340891052 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x556c1b6ab170 0x556c1b7045e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=287c0527aa7d60be server_cookie=c7d9a7bd25c3911e in_seq=0 out_seq=0 2024-01-25T15:01:56.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.290+0000 7fefc1ffb640 1 -- 172.21.15.170:0/340891052 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x556c1b34beb0 con 0x556c1b6ab170 2024-01-25T15:01:56.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.290+0000 7fefc1ffb640 10 client.15471 handle_command_reply: tid=0 2024-01-25T15:01:56.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.290+0000 7fefe347f740 1 client.15471 shutdown 2024-01-25T15:01:56.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.290+0000 7fefe347f740 1 -- 172.21.15.170:0/340891052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 msgr2=0x556c1b6a6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.290+0000 7fefe347f740 1 --2- 172.21.15.170:0/340891052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b6a6740 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fefc4099890 tx=0x7fefc4010cd0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.290+0000 7fefe347f740 1 -- 172.21.15.170:0/340891052 shutdown_connections 2024-01-25T15:01:56.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.290+0000 7fefe347f740 1 --2- 172.21.15.170:0/340891052 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x556c1b6ab170 0x556c1b7045e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.290+0000 7fefe347f740 1 --2- 172.21.15.170:0/340891052 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556c1b69aff0 0x556c1b6a4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.290+0000 7fefc1ffb640 0 client.15471 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:56.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.290+0000 7fefe347f740 1 --2- 172.21.15.170:0/340891052 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556c1b695e80 0x556c1b6a6740 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.290+0000 7fefe347f740 1 --2- 172.21.15.170:0/340891052 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556c1b695490 0x556c1b6a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.290+0000 7fefe347f740 1 -- 172.21.15.170:0/340891052 >> 172.21.15.170:0/340891052 conn(0x556c1b68c5f0 msgr2=0x556c1b687820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:56.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.290+0000 7fefe347f740 1 -- 172.21.15.170:0/340891052 shutdown_connections 2024-01-25T15:01:56.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.290+0000 7fefe347f740 1 -- 172.21.15.170:0/340891052 wait complete. 2024-01-25T15:01:56.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.290+0000 7fefe347f740 20 client.15471 trim_cache size 0 max 16384 2024-01-25T15:01:56.298 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:01:56.298 INFO:teuthology.orchestra.run.smithi170.stdout: "return_code": 0, 2024-01-25T15:01:56.298 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_tag": "76b74b7f-83fe-4835-a8f0-46d926f75912", 2024-01-25T15:01:56.298 INFO:teuthology.orchestra.run.smithi170.stdout: "mode": "asynchronous" 2024-01-25T15:01:56.298 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:01:56.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.291+0000 7fefe08b6640 1 -- 172.21.15.170:0/2522202224 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fefc80a1370 msgr2=0x7fefc80a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.291+0000 7fefe08b6640 1 --2- 172.21.15.170:0/2522202224 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fefc80a1370 0x7fefc80a3830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x556c1b6966e0 tx=0x7fefd4009800 comp rx=0 tx=0).stop 2024-01-25T15:01:56.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.291+0000 7fefe08b6640 1 -- 172.21.15.170:0/2522202224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc100de0 msgr2=0x7fefdc19ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.291+0000 7fefe08b6640 1 --2- 172.21.15.170:0/2522202224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc100de0 0x7fefdc19ba30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fefc400d950 tx=0x7fefc400de10 comp rx=0 tx=0).stop 2024-01-25T15:01:56.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.291+0000 7fefe08b6640 1 -- 172.21.15.170:0/2522202224 shutdown_connections 2024-01-25T15:01:56.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.291+0000 7fefe08b6640 1 --2- 172.21.15.170:0/2522202224 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fefc80a1370 0x7fefc80a3830 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.291+0000 7fefe08b6640 1 --2- 172.21.15.170:0/2522202224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fefdc1017a0 0x7fefdc19e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.291+0000 7fefe08b6640 1 --2- 172.21.15.170:0/2522202224 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fefdc100de0 0x7fefdc19ba30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.291+0000 7fefe08b6640 1 --2- 172.21.15.170:0/2522202224 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fefdc0ffbf0 0x7fefdc0689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.291+0000 7fefe08b6640 1 -- 172.21.15.170:0/2522202224 >> 172.21.15.170:0/2522202224 conn(0x7fefdc0fb180 msgr2=0x7fefdc1041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:56.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.291+0000 7fefe08b6640 1 -- 172.21.15.170:0/2522202224 shutdown_connections 2024-01-25T15:01:56.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.291+0000 7fefe08b6640 1 -- 172.21.15.170:0/2522202224 wait complete. 2024-01-25T15:01:56.306 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-25T15:01:56.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:56 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3753401957' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:56.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:56 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/336352897' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:56.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:56 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3988108514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:56.369 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:56 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3753401957' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:56.370 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:56 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/336352897' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:56.370 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:56 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3988108514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:56.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.450+0000 7f5f44b3f640 1 -- 172.21.15.170:0/467492061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f40106a70 msgr2=0x7f5f40108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.450+0000 7f5f44b3f640 1 --2- 172.21.15.170:0/467492061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f40106a70 0x7f5f40108e60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009ca0 tx=0x7f5f3802c0f0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.451+0000 7f5f44b3f640 1 -- 172.21.15.170:0/467492061 shutdown_connections 2024-01-25T15:01:56.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.451+0000 7f5f44b3f640 1 --2- 172.21.15.170:0/467492061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f40104140 0x7f5f40106530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.451+0000 7f5f44b3f640 1 --2- 172.21.15.170:0/467492061 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f40106a70 0x7f5f40108e60 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.451+0000 7f5f44b3f640 1 --2- 172.21.15.170:0/467492061 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f40101810 0x7f5f40103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.451+0000 7f5f44b3f640 1 -- 172.21.15.170:0/467492061 >> 172.21.15.170:0/467492061 conn(0x7f5f400fb180 msgr2=0x7f5f400fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:56.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.451+0000 7f5f44b3f640 1 -- 172.21.15.170:0/467492061 shutdown_connections 2024-01-25T15:01:56.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.451+0000 7f5f44b3f640 1 -- 172.21.15.170:0/467492061 wait complete. 2024-01-25T15:01:56.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.451+0000 7f5f44b3f640 1 Processor -- start 2024-01-25T15:01:56.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.451+0000 7f5f44b3f640 1 -- start start 2024-01-25T15:01:56.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.451+0000 7f5f44b3f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f40101810 0x7f5f40196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.451+0000 7f5f44b3f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f40104140 0x7f5f401971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.451+0000 7f5f44b3f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f40106a70 0x7f5f4019e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.451+0000 7f5f44b3f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4019e750 con 0x7f5f40101810 2024-01-25T15:01:56.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.451+0000 7f5f44b3f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4019e8c0 con 0x7f5f40104140 2024-01-25T15:01:56.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.451+0000 7f5f44b3f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4019ea80 con 0x7f5f40106a70 2024-01-25T15:01:56.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f3e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f40101810 0x7f5f40196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f3e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f40101810 0x7f5f40196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42100/0 (socket says 172.21.15.170:42100) 2024-01-25T15:01:56.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f3e59c640 1 -- 172.21.15.170:0/1283118307 learned_addr learned my addr 172.21.15.170:0/1283118307 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:56.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f37fff640 1 --2- 172.21.15.170:0/1283118307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f40104140 0x7f5f401971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f3ed9d640 1 --2- 172.21.15.170:0/1283118307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f40106a70 0x7f5f4019e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f3e59c640 1 -- 172.21.15.170:0/1283118307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f40106a70 msgr2=0x7f5f4019e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f3e59c640 1 --2- 172.21.15.170:0/1283118307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f40106a70 0x7f5f4019e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f3e59c640 1 -- 172.21.15.170:0/1283118307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f40104140 msgr2=0x7f5f401971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f3e59c640 1 --2- 172.21.15.170:0/1283118307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f40104140 0x7f5f401971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f3e59c640 1 -- 172.21.15.170:0/1283118307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f38009900 con 0x7f5f40101810 2024-01-25T15:01:56.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f37fff640 1 --2- 172.21.15.170:0/1283118307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f40104140 0x7f5f401971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:56.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f3e59c640 1 --2- 172.21.15.170:0/1283118307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f40101810 0x7f5f40196c70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000d770 tx=0x7f5f3000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:56.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f377fe640 1 -- 172.21.15.170:0/1283118307 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30009c30 con 0x7f5f40101810 2024-01-25T15:01:56.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f44b3f640 1 -- 172.21.15.170:0/1283118307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4019ed60 con 0x7f5f40101810 2024-01-25T15:01:56.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f377fe640 1 -- 172.21.15.170:0/1283118307 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f3000de80 con 0x7f5f40101810 2024-01-25T15:01:56.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f377fe640 1 -- 172.21.15.170:0/1283118307 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30004de0 con 0x7f5f40101810 2024-01-25T15:01:56.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.452+0000 7f5f44b3f640 1 -- 172.21.15.170:0/1283118307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4019f1c0 con 0x7f5f40101810 2024-01-25T15:01:56.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.455+0000 7f5f377fe640 1 -- 172.21.15.170:0/1283118307 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f5f30004f40 con 0x7f5f40101810 2024-01-25T15:01:56.463 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.455+0000 7f5f477e8740 1 Processor -- start 2024-01-25T15:01:56.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.455+0000 7f5f477e8740 1 -- start start 2024-01-25T15:01:56.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.455+0000 7f5f477e8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b49a50 0x562388b49e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.455+0000 7f5f477e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4a440 0x562388b4ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.455+0000 7f5f477e8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b4f5b0 0x562388b51a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.455+0000 7f5f477e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562388ab83b0 con 0x562388b4a440 2024-01-25T15:01:56.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.455+0000 7f5f477e8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562388ab5aa0 con 0x562388b4f5b0 2024-01-25T15:01:56.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.455+0000 7f5f477e8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562388ab1390 con 0x562388b49a50 2024-01-25T15:01:56.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.455+0000 7f5f3e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4a440 0x562388b4ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.455+0000 7f5f3e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4a440 0x562388b4ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42112/0 (socket says 172.21.15.170:42112) 2024-01-25T15:01:56.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.455+0000 7f5f3e59c640 1 -- 172.21.15.170:0/3285144372 learned_addr learned my addr 172.21.15.170:0/3285144372 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:56.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.455+0000 7f5f37fff640 1 --2- 172.21.15.170:0/3285144372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b4f5b0 0x562388b51a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.455+0000 7f5f377fe640 1 --2- 172.21.15.170:0/1283118307 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5f2c0a1370 0x7f5f2c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.455+0000 7f5f3ed9d640 1 --2- 172.21.15.170:0/3285144372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b49a50 0x562388b49e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.464 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.456+0000 7f5f3e59c640 1 -- 172.21.15.170:0/3285144372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b49a50 msgr2=0x562388b49e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.456+0000 7f5f3e59c640 1 --2- 172.21.15.170:0/3285144372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b49a50 0x562388b49e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.456+0000 7f5f3e59c640 1 -- 172.21.15.170:0/3285144372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b4f5b0 msgr2=0x562388b51a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.456+0000 7f5f3e59c640 1 --2- 172.21.15.170:0/3285144372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b4f5b0 0x562388b51a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.456+0000 7f5f377fe640 1 -- 172.21.15.170:0/1283118307 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f5f300cc880 con 0x7f5f40101810 2024-01-25T15:01:56.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.456+0000 7f5f3e59c640 1 -- 172.21.15.170:0/3285144372 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562388a73810 con 0x562388b4a440 2024-01-25T15:01:56.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.456+0000 7f5f3ed9d640 1 --2- 172.21.15.170:0/3285144372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b49a50 0x562388b49e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:01:56.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.456+0000 7f5f3ed9d640 1 --2- 172.21.15.170:0/1283118307 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5f2c0a1370 0x7f5f2c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.456+0000 7f5f3e59c640 1 --2- 172.21.15.170:0/3285144372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4a440 0x562388b4ef40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5f300ca1a0 tx=0x7f5f30099660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecfae2db629fab2b server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:56.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.456+0000 7f5f34ff9640 1 -- 172.21.15.170:0/3285144372 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300b90f0 con 0x562388b4a440 2024-01-25T15:01:56.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.456+0000 7f5f34ff9640 1 -- 172.21.15.170:0/3285144372 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f30097a70 con 0x562388b4a440 2024-01-25T15:01:56.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.456+0000 7f5f34ff9640 1 -- 172.21.15.170:0/3285144372 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300ca4b0 con 0x562388b4a440 2024-01-25T15:01:56.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.457+0000 7f5f477e8740 1 -- 172.21.15.170:0/3285144372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4a440 msgr2=0x562388b4ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.457+0000 7f5f477e8740 1 --2- 172.21.15.170:0/3285144372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4a440 0x562388b4ef40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5f300ca1a0 tx=0x7f5f30099660 comp rx=0 tx=0).stop 2024-01-25T15:01:56.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.457+0000 7f5f3ed9d640 1 --2- 172.21.15.170:0/1283118307 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5f2c0a1370 0x7f5f2c0a3830 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5f38006010 tx=0x7f5f3802e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:56.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.457+0000 7f5f477e8740 1 -- 172.21.15.170:0/3285144372 shutdown_connections 2024-01-25T15:01:56.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.457+0000 7f5f477e8740 1 --2- 172.21.15.170:0/3285144372 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b4f5b0 0x562388b51a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.457+0000 7f5f477e8740 1 --2- 172.21.15.170:0/3285144372 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4a440 0x562388b4ef40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.457+0000 7f5f477e8740 1 --2- 172.21.15.170:0/3285144372 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b49a50 0x562388b49e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.457+0000 7f5f477e8740 1 -- 172.21.15.170:0/3285144372 >> 172.21.15.170:0/3285144372 conn(0x562388b44fc0 msgr2=0x562388b453c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:56.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.457+0000 7f5f477e8740 1 -- 172.21.15.170:0/3285144372 shutdown_connections 2024-01-25T15:01:56.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.457+0000 7f5f477e8740 1 -- 172.21.15.170:0/3285144372 wait complete. 2024-01-25T15:01:56.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.457+0000 7f5f477e8740 1 -- start start 2024-01-25T15:01:56.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.457+0000 7f5f477e8740 1 Processor -- start 2024-01-25T15:01:56.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.457+0000 7f5f477e8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b49a50 0x562388b53a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.457+0000 7f5f477e8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4a440 0x562388b53f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.457+0000 7f5f477e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4f5b0 0x562388b5afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f477e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562388a6a780 con 0x562388b4f5b0 2024-01-25T15:01:56.466 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f477e8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562388a6a420 con 0x562388b49a50 2024-01-25T15:01:56.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f477e8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562388a2f420 con 0x562388b4a440 2024-01-25T15:01:56.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f477e8740 10 client.0 _ll_register_callbacks cb 0x562388a6cb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:56.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f3ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4f5b0 0x562388b5afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f3ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4f5b0 0x562388b5afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42122/0 (socket says 172.21.15.170:42122) 2024-01-25T15:01:56.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f3ed9d640 1 -- 172.21.15.170:0/276226882 learned_addr learned my addr 172.21.15.170:0/276226882 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:56.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f3e59c640 1 --2- 172.21.15.170:0/276226882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b49a50 0x562388b53a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f37fff640 1 --2- 172.21.15.170:0/276226882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4a440 0x562388b53f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f3ed9d640 1 -- 172.21.15.170:0/276226882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4a440 msgr2=0x562388b53f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f3ed9d640 1 --2- 172.21.15.170:0/276226882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4a440 0x562388b53f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f3ed9d640 1 -- 172.21.15.170:0/276226882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b49a50 msgr2=0x562388b53a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f3ed9d640 1 --2- 172.21.15.170:0/276226882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b49a50 0x562388b53a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f3ed9d640 1 -- 172.21.15.170:0/276226882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4019f1c0 con 0x562388b4f5b0 2024-01-25T15:01:56.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f3ed9d640 1 --2- 172.21.15.170:0/276226882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4f5b0 0x562388b5afa0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5f38033000 tx=0x7f5f380095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1d2fb783de1574 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:56.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:56.467 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f25ffb640 1 -- 172.21.15.170:0/276226882 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38003970 con 0x562388b4f5b0 2024-01-25T15:01:56.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f25ffb640 1 -- 172.21.15.170:0/276226882 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f5f38043070 con 0x562388b4f5b0 2024-01-25T15:01:56.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f477e8740 1 -- 172.21.15.170:0/276226882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562388a86240 con 0x562388b4f5b0 2024-01-25T15:01:56.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f25ffb640 1 -- 172.21.15.170:0/276226882 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f38003ad0 con 0x562388b4f5b0 2024-01-25T15:01:56.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f477e8740 10 client.15483 fetch_fsmap learned FSMap version 26 2024-01-25T15:01:56.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.458+0000 7f5f477e8740 1 -- 172.21.15.170:0/276226882 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562388aafa10 con 0x562388b4f5b0 2024-01-25T15:01:56.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.459+0000 7f5f25ffb640 1 -- 172.21.15.170:0/276226882 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562388a86240 con 0x562388b4f5b0 2024-01-25T15:01:56.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.459+0000 7f5f25ffb640 1 -- 172.21.15.170:0/276226882 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5f3804a420 con 0x562388b4f5b0 2024-01-25T15:01:56.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.459+0000 7f5f477e8740 10 client.15483 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:01:56.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.459+0000 7f5f477e8740 10 client.15483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:01:56.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.459+0000 7f5f477e8740 20 client.15483 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:56.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.459+0000 7f5f477e8740 1 --2- 172.21.15.170:0/276226882 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x562388b64120 0x562388b66540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.459+0000 7f5f477e8740 4 client.15483 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:01:56.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.459+0000 7f5f477e8740 1 -- 172.21.15.170:0/276226882 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562388a83b50 con 0x562388b64120 2024-01-25T15:01:56.468 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.459+0000 7f5f3e59c640 1 --2- 172.21.15.170:0/276226882 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x562388b64120 0x562388b66540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f25ffb640 10 client.15483 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:56.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f3e59c640 1 --2- 172.21.15.170:0/276226882 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x562388b64120 0x562388b66540 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa5e6c3490ace09f server_cookie=e6e5904ab7359403 in_seq=0 out_seq=0 2024-01-25T15:01:56.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f25ffb640 1 -- 172.21.15.170:0/276226882 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562388a83b50 con 0x562388b64120 2024-01-25T15:01:56.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f25ffb640 10 client.15483 handle_command_reply: tid=0 2024-01-25T15:01:56.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f477e8740 1 client.15483 shutdown 2024-01-25T15:01:56.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f477e8740 1 -- 172.21.15.170:0/276226882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4f5b0 msgr2=0x562388b5afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f477e8740 1 --2- 172.21.15.170:0/276226882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4f5b0 0x562388b5afa0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5f38033000 tx=0x7f5f380095c0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f477e8740 1 -- 172.21.15.170:0/276226882 shutdown_connections 2024-01-25T15:01:56.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f477e8740 1 --2- 172.21.15.170:0/276226882 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x562388b64120 0x562388b66540 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f477e8740 1 --2- 172.21.15.170:0/276226882 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4f5b0 0x562388b5afa0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f25ffb640 0 client.15483 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:56.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f477e8740 1 --2- 172.21.15.170:0/276226882 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4a440 0x562388b53f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.469 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f477e8740 1 --2- 172.21.15.170:0/276226882 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b49a50 0x562388b53a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f477e8740 1 -- 172.21.15.170:0/276226882 >> 172.21.15.170:0/276226882 conn(0x562388b44fc0 msgr2=0x562388b44240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:56.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f477e8740 1 -- 172.21.15.170:0/276226882 shutdown_connections 2024-01-25T15:01:56.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f477e8740 1 -- 172.21.15.170:0/276226882 wait complete. 2024-01-25T15:01:56.470 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.460+0000 7f5f477e8740 20 client.15483 trim_cache size 0 max 16384 2024-01-25T15:01:56.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.475+0000 7f5f477e8740 1 Processor -- start 2024-01-25T15:01:56.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.475+0000 7f5f477e8740 1 -- start start 2024-01-25T15:01:56.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.475+0000 7f5f477e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b49a50 0x562388b53a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.475+0000 7f5f477e8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4a440 0x562388b53f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.475+0000 7f5f477e8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b4f5b0 0x562388b5af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.475+0000 7f5f477e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562388b49610 con 0x562388b49a50 2024-01-25T15:01:56.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.475+0000 7f5f477e8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562388b62630 con 0x562388b4f5b0 2024-01-25T15:01:56.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.475+0000 7f5f477e8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562388a83b50 con 0x562388b4a440 2024-01-25T15:01:56.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.475+0000 7f5f3e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b49a50 0x562388b53a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.475+0000 7f5f3e59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b49a50 0x562388b53a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42134/0 (socket says 172.21.15.170:42134) 2024-01-25T15:01:56.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.475+0000 7f5f3e59c640 1 -- 172.21.15.170:0/750911115 learned_addr learned my addr 172.21.15.170:0/750911115 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:56.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f37fff640 1 --2- 172.21.15.170:0/750911115 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4a440 0x562388b53f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f3e59c640 1 -- 172.21.15.170:0/750911115 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4a440 msgr2=0x562388b53f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f3e59c640 1 --2- 172.21.15.170:0/750911115 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4a440 0x562388b53f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f3e59c640 1 -- 172.21.15.170:0/750911115 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b4f5b0 msgr2=0x562388b5af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f3e59c640 1 --2- 172.21.15.170:0/750911115 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b4f5b0 0x562388b5af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f3e59c640 1 -- 172.21.15.170:0/750911115 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562388a4c520 con 0x562388b49a50 2024-01-25T15:01:56.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f37fff640 1 --2- 172.21.15.170:0/750911115 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4a440 0x562388b53f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:01:56.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f3e59c640 1 --2- 172.21.15.170:0/750911115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b49a50 0x562388b53a00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5f30099590 tx=0x7f5f300d2530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8d706db56c3162 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:56.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f27fff640 1 -- 172.21.15.170:0/750911115 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300b1070 con 0x562388b49a50 2024-01-25T15:01:56.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f27fff640 1 -- 172.21.15.170:0/750911115 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f3009da50 con 0x562388b49a50 2024-01-25T15:01:56.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f27fff640 1 -- 172.21.15.170:0/750911115 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30097c30 con 0x562388b49a50 2024-01-25T15:01:56.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f477e8740 1 -- 172.21.15.170:0/750911115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b49a50 msgr2=0x562388b53a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f477e8740 1 --2- 172.21.15.170:0/750911115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b49a50 0x562388b53a00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5f30099590 tx=0x7f5f300d2530 comp rx=0 tx=0).stop 2024-01-25T15:01:56.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f477e8740 1 -- 172.21.15.170:0/750911115 shutdown_connections 2024-01-25T15:01:56.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f477e8740 1 --2- 172.21.15.170:0/750911115 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b4f5b0 0x562388b5af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f477e8740 1 --2- 172.21.15.170:0/750911115 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4a440 0x562388b53f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f477e8740 1 --2- 172.21.15.170:0/750911115 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b49a50 0x562388b53a00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f477e8740 1 -- 172.21.15.170:0/750911115 >> 172.21.15.170:0/750911115 conn(0x562388b44fc0 msgr2=0x562388b6aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:56.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f477e8740 1 -- 172.21.15.170:0/750911115 shutdown_connections 2024-01-25T15:01:56.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.476+0000 7f5f477e8740 1 -- 172.21.15.170:0/750911115 wait complete. 2024-01-25T15:01:56.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f477e8740 1 -- start start 2024-01-25T15:01:56.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f477e8740 1 Processor -- start 2024-01-25T15:01:56.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f477e8740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b49a50 0x562388b5a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f477e8740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4a440 0x562388b5af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f477e8740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4f5b0 0x562388b59080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f477e8740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x562388b59730 con 0x562388b4a440 2024-01-25T15:01:56.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f477e8740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x562388b598a0 con 0x562388b49a50 2024-01-25T15:01:56.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f477e8740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x562388b59a60 con 0x562388b4f5b0 2024-01-25T15:01:56.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f477e8740 10 client.0 _ll_register_callbacks cb 0x7f5f38037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:01:56.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f37fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4a440 0x562388b5af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f37fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4a440 0x562388b5af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42142/0 (socket says 172.21.15.170:42142) 2024-01-25T15:01:56.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f37fff640 1 -- 172.21.15.170:0/1026918108 learned_addr learned my addr 172.21.15.170:0/1026918108 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:01:56.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f3ed9d640 1 --2- 172.21.15.170:0/1026918108 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4f5b0 0x562388b59080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f3e59c640 1 --2- 172.21.15.170:0/1026918108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b49a50 0x562388b5a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f37fff640 1 -- 172.21.15.170:0/1026918108 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4f5b0 msgr2=0x562388b59080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f37fff640 1 --2- 172.21.15.170:0/1026918108 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4f5b0 0x562388b59080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f37fff640 1 -- 172.21.15.170:0/1026918108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b49a50 msgr2=0x562388b5a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:01:56.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f37fff640 1 --2- 172.21.15.170:0/1026918108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b49a50 0x562388b5a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.477+0000 7f5f37fff640 1 -- 172.21.15.170:0/1026918108 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562388a73810 con 0x562388b4a440 2024-01-25T15:01:56.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f37fff640 1 --2- 172.21.15.170:0/1026918108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4a440 0x562388b5af10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5f28005fd0 tx=0x7f5f28012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0bbc7e86dcfd5a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:01:56.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:01:56.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f25ffb640 1 -- 172.21.15.170:0/1026918108 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28017070 con 0x562388b4a440 2024-01-25T15:01:56.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f25ffb640 1 -- 172.21.15.170:0/1026918108 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f5f2800f9f0 con 0x562388b4a440 2024-01-25T15:01:56.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f477e8740 1 -- 172.21.15.170:0/1026918108 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562388aaa220 con 0x562388b4a440 2024-01-25T15:01:56.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f25ffb640 1 -- 172.21.15.170:0/1026918108 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f2800fbb0 con 0x562388b4a440 2024-01-25T15:01:56.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f477e8740 10 client.15489 fetch_fsmap learned FSMap version 26 2024-01-25T15:01:56.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f477e8740 1 -- 172.21.15.170:0/1026918108 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562388a72070 con 0x562388b4a440 2024-01-25T15:01:56.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f25ffb640 1 -- 172.21.15.170:0/1026918108 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562388aaa220 con 0x562388b4a440 2024-01-25T15:01:56.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f25ffb640 1 -- 172.21.15.170:0/1026918108 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5f28003a10 con 0x562388b4a440 2024-01-25T15:01:56.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f477e8740 10 client.15489 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:01:56.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f477e8740 10 client.15489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:01:56.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f477e8740 20 client.15489 populate_metadata read hostname 'smithi170' 2024-01-25T15:01:56.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f477e8740 1 --2- 172.21.15.170:0/1026918108 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x562388b64120 0x562388bbdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:01:56.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f477e8740 4 client.15489 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-25T15:01:56.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.478+0000 7f5f477e8740 1 -- 172.21.15.170:0/1026918108 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562388aa9f40 con 0x562388b64120 2024-01-25T15:01:56.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f3e59c640 1 --2- 172.21.15.170:0/1026918108 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x562388b64120 0x562388bbdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:01:56.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f3e59c640 1 --2- 172.21.15.170:0/1026918108 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x562388b64120 0x562388bbdbd0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54f151270a49c800 server_cookie=8d34940938f5c1fc in_seq=0 out_seq=0 2024-01-25T15:01:56.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f25ffb640 10 client.15489 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:56.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f25ffb640 1 -- 172.21.15.170:0/1026918108 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562388aa9f40 con 0x562388b64120 2024-01-25T15:01:56.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f25ffb640 10 client.15489 handle_command_reply: tid=0 2024-01-25T15:01:56.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f477e8740 1 client.15489 shutdown 2024-01-25T15:01:56.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f477e8740 1 -- 172.21.15.170:0/1026918108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4a440 msgr2=0x562388b5af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f477e8740 1 --2- 172.21.15.170:0/1026918108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4a440 0x562388b5af10 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5f28005fd0 tx=0x7f5f28012ef0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f477e8740 1 -- 172.21.15.170:0/1026918108 shutdown_connections 2024-01-25T15:01:56.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f477e8740 1 --2- 172.21.15.170:0/1026918108 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x562388b64120 0x562388bbdbd0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f477e8740 1 --2- 172.21.15.170:0/1026918108 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x562388b4f5b0 0x562388b59080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f477e8740 1 --2- 172.21.15.170:0/1026918108 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x562388b4a440 0x562388b5af10 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f25ffb640 0 client.15489 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:01:56.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f477e8740 1 --2- 172.21.15.170:0/1026918108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x562388b49a50 0x562388b5a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f477e8740 1 -- 172.21.15.170:0/1026918108 >> 172.21.15.170:0/1026918108 conn(0x562388b44fc0 msgr2=0x562388b4b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:56.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f477e8740 1 -- 172.21.15.170:0/1026918108 shutdown_connections 2024-01-25T15:01:56.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f477e8740 1 -- 172.21.15.170:0/1026918108 wait complete. 2024-01-25T15:01:56.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.479+0000 7f5f477e8740 20 client.15489 trim_cache size 0 max 16384 2024-01-25T15:01:56.488 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:01:56.488 INFO:teuthology.orchestra.run.smithi170.stdout: "status": "IDLE (waiting for more scrubs)", 2024-01-25T15:01:56.488 INFO:teuthology.orchestra.run.smithi170.stdout: "scrubs": { 2024-01-25T15:01:56.488 INFO:teuthology.orchestra.run.smithi170.stdout: "76b74b7f-83fe-4835-a8f0-46d926f75912": { 2024-01-25T15:01:56.488 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/", 2024-01-25T15:01:56.488 INFO:teuthology.orchestra.run.smithi170.stdout: "tag": "76b74b7f-83fe-4835-a8f0-46d926f75912", 2024-01-25T15:01:56.489 INFO:teuthology.orchestra.run.smithi170.stdout: "options": "recursive,force" 2024-01-25T15:01:56.489 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:01:56.489 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:01:56.489 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:01:56.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.480+0000 7f5f44b3f640 1 -- 172.21.15.170:0/1283118307 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5f2c0a1370 msgr2=0x7f5f2c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.480+0000 7f5f44b3f640 1 --2- 172.21.15.170:0/1283118307 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5f2c0a1370 0x7f5f2c0a3830 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5f38006010 tx=0x7f5f3802e040 comp rx=0 tx=0).stop 2024-01-25T15:01:56.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.480+0000 7f5f44b3f640 1 -- 172.21.15.170:0/1283118307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f40101810 msgr2=0x7f5f40196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:01:56.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.480+0000 7f5f44b3f640 1 --2- 172.21.15.170:0/1283118307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f40101810 0x7f5f40196c70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5f3000d770 tx=0x7f5f3000dc30 comp rx=0 tx=0).stop 2024-01-25T15:01:56.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.480+0000 7f5f44b3f640 1 -- 172.21.15.170:0/1283118307 shutdown_connections 2024-01-25T15:01:56.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.480+0000 7f5f44b3f640 1 --2- 172.21.15.170:0/1283118307 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f5f2c0a1370 0x7f5f2c0a3830 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.480+0000 7f5f44b3f640 1 --2- 172.21.15.170:0/1283118307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f40104140 0x7f5f401971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.480+0000 7f5f44b3f640 1 --2- 172.21.15.170:0/1283118307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f5f40106a70 0x7f5f4019e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.480+0000 7f5f44b3f640 1 --2- 172.21.15.170:0/1283118307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f5f40101810 0x7f5f40196c70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:01:56.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.480+0000 7f5f44b3f640 1 -- 172.21.15.170:0/1283118307 >> 172.21.15.170:0/1283118307 conn(0x7f5f400fb180 msgr2=0x7f5f40102170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:01:56.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.480+0000 7f5f44b3f640 1 -- 172.21.15.170:0/1283118307 shutdown_connections 2024-01-25T15:01:56.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:01:56.480+0000 7f5f44b3f640 1 -- 172.21.15.170:0/1283118307 wait complete. 2024-01-25T15:01:56.491 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:56 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3753401957' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:01:56.491 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:56 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/336352897' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:01:56.491 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:56 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3988108514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:01:56.492 INFO:tasks.cephfs.filesystem:scrub status for tag:76b74b7f-83fe-4835-a8f0-46d926f75912 - {'path': '/', 'tag': '76b74b7f-83fe-4835-a8f0-46d926f75912', 'options': 'recursive,force'} 2024-01-25T15:01:57.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:57 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/442950436' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:57.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:57 smithi170 ceph-mon[31899]: pgmap v347: 97 pgs: 97 active+clean; 646 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-01-25T15:01:57.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:57 smithi170 ceph-mon[31899]: scrub queued for path: / 2024-01-25T15:01:57.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:57 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:01:57.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:57 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:01:57.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:57 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:01:57.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:57 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/442950436' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:57.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:57 smithi191 ceph-mon[36347]: pgmap v347: 97 pgs: 97 active+clean; 646 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-01-25T15:01:57.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:57 smithi191 ceph-mon[36347]: scrub queued for path: / 2024-01-25T15:01:57.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:57 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:01:57.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:57 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:01:57.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:57 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:01:57.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:57 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/442950436' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:01:57.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:57 smithi186 ceph-mon[35697]: pgmap v347: 97 pgs: 97 active+clean; 646 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-01-25T15:01:57.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:57 smithi186 ceph-mon[35697]: scrub queued for path: / 2024-01-25T15:01:57.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:57 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:01:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:57 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:01:57.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:57 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:01:59.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:01:59 smithi186 ceph-mon[35697]: pgmap v348: 97 pgs: 97 active+clean; 655 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-01-25T15:01:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:01:59 smithi170 ceph-mon[31899]: pgmap v348: 97 pgs: 97 active+clean; 655 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-01-25T15:01:59.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:01:59 smithi191 ceph-mon[36347]: pgmap v348: 97 pgs: 97 active+clean; 655 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2024-01-25T15:02:00.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:00 smithi186 ceph-mon[35697]: scrub summary: idle 2024-01-25T15:02:00.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:00 smithi170 ceph-mon[31899]: scrub summary: idle 2024-01-25T15:02:00.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:00 smithi191 ceph-mon[36347]: scrub summary: idle 2024-01-25T15:02:01.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:01 smithi186 ceph-mon[35697]: pgmap v349: 97 pgs: 97 active+clean; 655 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-01-25T15:02:01.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:01 smithi170 ceph-mon[31899]: pgmap v349: 97 pgs: 97 active+clean; 655 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-01-25T15:02:01.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:01 smithi191 ceph-mon[36347]: pgmap v349: 97 pgs: 97 active+clean; 655 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 2.3 KiB/s wr, 11 op/s 2024-01-25T15:02:03.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:03 smithi186 ceph-mon[35697]: pgmap v350: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-01-25T15:02:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:03 smithi170 ceph-mon[31899]: pgmap v350: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-01-25T15:02:03.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:03 smithi191 ceph-mon[36347]: pgmap v350: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-01-25T15:02:05.607 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:05 smithi186 ceph-mon[35697]: pgmap v351: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-01-25T15:02:05.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:05 smithi170 ceph-mon[31899]: pgmap v351: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-01-25T15:02:05.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:05 smithi191 ceph-mon[36347]: pgmap v351: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.5 KiB/s wr, 13 op/s 2024-01-25T15:02:07.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:07 smithi186 ceph-mon[35697]: pgmap v352: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-01-25T15:02:07.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:07 smithi170 ceph-mon[31899]: pgmap v352: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-01-25T15:02:07.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:07 smithi191 ceph-mon[36347]: pgmap v352: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-01-25T15:02:09.296 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.293+0000 7f0418cc9640 1 -- 172.21.15.170:0/3741492189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0414100e00 msgr2=0x7f0414101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.293+0000 7f0418cc9640 1 --2- 172.21.15.170:0/3741492189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0414100e00 0x7f0414101280 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0408009900 tx=0x7f040802bc30 comp rx=0 tx=0).stop 2024-01-25T15:02:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.293+0000 7f0418cc9640 1 -- 172.21.15.170:0/3741492189 shutdown_connections 2024-01-25T15:02:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.293+0000 7f0418cc9640 1 --2- 172.21.15.170:0/3741492189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04141017c0 0x7f0414108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.293+0000 7f0418cc9640 1 --2- 172.21.15.170:0/3741492189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0414100e00 0x7f0414101280 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.293+0000 7f0418cc9640 1 --2- 172.21.15.170:0/3741492189 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04140ffc10 0x7f0414100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.293+0000 7f0418cc9640 1 -- 172.21.15.170:0/3741492189 >> 172.21.15.170:0/3741492189 conn(0x7f04140fb180 msgr2=0x7f04140fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.293+0000 7f0418cc9640 1 -- 172.21.15.170:0/3741492189 shutdown_connections 2024-01-25T15:02:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.293+0000 7f0418cc9640 1 -- 172.21.15.170:0/3741492189 wait complete. 2024-01-25T15:02:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.294+0000 7f0418cc9640 1 Processor -- start 2024-01-25T15:02:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.294+0000 7f0418cc9640 1 -- start start 2024-01-25T15:02:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.294+0000 7f0418cc9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04140ffc10 0x7f0414068f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.294+0000 7f0418cc9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0414100e00 0x7f041419b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.297 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.294+0000 7f0418cc9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04141017c0 0x7f041419df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.294+0000 7f0418cc9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041419e720 con 0x7f0414100e00 2024-01-25T15:02:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.294+0000 7f0418cc9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041419e890 con 0x7f04141017c0 2024-01-25T15:02:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.294+0000 7f0418cc9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041419ea50 con 0x7f04140ffc10 2024-01-25T15:02:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.294+0000 7f0411d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0414100e00 0x7f041419b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.294+0000 7f0411d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0414100e00 0x7f041419b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56352/0 (socket says 172.21.15.170:56352) 2024-01-25T15:02:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.294+0000 7f0411d9b640 1 -- 172.21.15.170:0/1868010129 learned_addr learned my addr 172.21.15.170:0/1868010129 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.295+0000 7f041259c640 1 --2- 172.21.15.170:0/1868010129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04140ffc10 0x7f0414068f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.295+0000 7f0412d9d640 1 --2- 172.21.15.170:0/1868010129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04141017c0 0x7f041419df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.295+0000 7f0411d9b640 1 -- 172.21.15.170:0/1868010129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04140ffc10 msgr2=0x7f0414068f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.295+0000 7f0411d9b640 1 --2- 172.21.15.170:0/1868010129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04140ffc10 0x7f0414068f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.295+0000 7f0411d9b640 1 -- 172.21.15.170:0/1868010129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04141017c0 msgr2=0x7f041419df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.295+0000 7f0411d9b640 1 --2- 172.21.15.170:0/1868010129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04141017c0 0x7f041419df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.298 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.295+0000 7f0411d9b640 1 -- 172.21.15.170:0/1868010129 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0408009560 con 0x7f0414100e00 2024-01-25T15:02:09.299 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.295+0000 7f041259c640 1 --2- 172.21.15.170:0/1868010129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04140ffc10 0x7f0414068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:09.299 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.295+0000 7f0411d9b640 1 --2- 172.21.15.170:0/1868010129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0414100e00 0x7f041419b920 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0408009230 tx=0x7f0408004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:09.299 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.295+0000 7f04037fe640 1 -- 172.21.15.170:0/1868010129 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04080042d0 con 0x7f0414100e00 2024-01-25T15:02:09.299 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.295+0000 7f0418cc9640 1 -- 172.21.15.170:0/1868010129 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041419ecd0 con 0x7f0414100e00 2024-01-25T15:02:09.299 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.295+0000 7f04037fe640 1 -- 172.21.15.170:0/1868010129 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0408004430 con 0x7f0414100e00 2024-01-25T15:02:09.299 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.295+0000 7f04037fe640 1 -- 172.21.15.170:0/1868010129 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408003cc0 con 0x7f0414100e00 2024-01-25T15:02:09.299 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.295+0000 7f0418cc9640 1 -- 172.21.15.170:0/1868010129 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041419f1d0 con 0x7f0414100e00 2024-01-25T15:02:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.297+0000 7f04037fe640 1 -- 172.21.15.170:0/1868010129 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f0408005000 con 0x7f0414100e00 2024-01-25T15:02:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.298+0000 7f041b964740 1 Processor -- start 2024-01-25T15:02:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.298+0000 7f041b964740 1 -- start start 2024-01-25T15:02:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.298+0000 7f04037fe640 1 --2- 172.21.15.170:0/1868010129 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f03fc0a1420 0x7f03fc0a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.298+0000 7f041b964740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf23272a0 0x55ecf23276c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.298+0000 7f041b964740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf2327c90 0x55ecf232c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.306 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.298+0000 7f041b964740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf232ce00 0x55ecf232f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.298+0000 7f041b964740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf2297070 con 0x55ecf23272a0 2024-01-25T15:02:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.298+0000 7f041b964740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf2294760 con 0x55ecf232ce00 2024-01-25T15:02:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.298+0000 7f041b964740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf2290050 con 0x55ecf2327c90 2024-01-25T15:02:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.298+0000 7f041259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf23272a0 0x55ecf23276c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.298+0000 7f0412d9d640 1 --2- 172.21.15.170:0/1868010129 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f03fc0a1420 0x7f03fc0a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.298+0000 7f041259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf23272a0 0x55ecf23276c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56356/0 (socket says 172.21.15.170:56356) 2024-01-25T15:02:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.298+0000 7f041259c640 1 -- 172.21.15.170:0/66793541 learned_addr learned my addr 172.21.15.170:0/66793541 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.298+0000 7f04037fe640 1 -- 172.21.15.170:0/1868010129 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f04080ef490 con 0x7f0414100e00 2024-01-25T15:02:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.298+0000 7f0411d9b640 1 --2- 172.21.15.170:0/66793541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf2327c90 0x55ecf232c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.299+0000 7f0412d9d640 1 --2- 172.21.15.170:0/66793541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf232ce00 0x55ecf232f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.299+0000 7f041259c640 1 -- 172.21.15.170:0/66793541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf2327c90 msgr2=0x55ecf232c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.299+0000 7f041259c640 1 --2- 172.21.15.170:0/66793541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf2327c90 0x55ecf232c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.307 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.299+0000 7f041259c640 1 -- 172.21.15.170:0/66793541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf232ce00 msgr2=0x55ecf232f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.299+0000 7f041259c640 1 --2- 172.21.15.170:0/66793541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf232ce00 0x55ecf232f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.299+0000 7f041259c640 1 -- 172.21.15.170:0/66793541 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ecf2287e70 con 0x55ecf23272a0 2024-01-25T15:02:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.299+0000 7f0412d9d640 1 --2- 172.21.15.170:0/66793541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf232ce00 0x55ecf232f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.299+0000 7f041259c640 1 --2- 172.21.15.170:0/66793541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf23272a0 0x55ecf23276c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0404009cf0 tx=0x7f04040117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12efeaec3e9142f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.299+0000 7f0412d9d640 1 --2- 172.21.15.170:0/1868010129 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f03fc0a1420 0x7f03fc0a38e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f040c005c40 tx=0x7f040c009b00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.299+0000 7f0400ff9640 1 -- 172.21.15.170:0/66793541 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0404012450 con 0x55ecf23272a0 2024-01-25T15:02:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.299+0000 7f0400ff9640 1 -- 172.21.15.170:0/66793541 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0404012a70 con 0x55ecf23272a0 2024-01-25T15:02:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.299+0000 7f0400ff9640 1 -- 172.21.15.170:0/66793541 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040400f9a0 con 0x55ecf23272a0 2024-01-25T15:02:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.300+0000 7f041b964740 1 -- 172.21.15.170:0/66793541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf23272a0 msgr2=0x55ecf23276c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.300+0000 7f041b964740 1 --2- 172.21.15.170:0/66793541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf23272a0 0x55ecf23276c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f0404009cf0 tx=0x7f04040117b0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.300+0000 7f041b964740 1 -- 172.21.15.170:0/66793541 shutdown_connections 2024-01-25T15:02:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.300+0000 7f041b964740 1 --2- 172.21.15.170:0/66793541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf232ce00 0x55ecf232f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.300+0000 7f041b964740 1 --2- 172.21.15.170:0/66793541 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf2327c90 0x55ecf232c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.308 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.300+0000 7f041b964740 1 --2- 172.21.15.170:0/66793541 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf23272a0 0x55ecf23276c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.300+0000 7f041b964740 1 -- 172.21.15.170:0/66793541 >> 172.21.15.170:0/66793541 conn(0x55ecf2322810 msgr2=0x55ecf2322c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.300+0000 7f041b964740 1 -- 172.21.15.170:0/66793541 shutdown_connections 2024-01-25T15:02:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.300+0000 7f041b964740 1 -- 172.21.15.170:0/66793541 wait complete. 2024-01-25T15:02:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.300+0000 7f041b964740 1 -- start start 2024-01-25T15:02:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.300+0000 7f041b964740 1 Processor -- start 2024-01-25T15:02:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f041b964740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf23272a0 0x55ecf2331130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f041b964740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf2327c90 0x55ecf2331670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f041b964740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf23386b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f041b964740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf22491e0 con 0x55ecf232ce00 2024-01-25T15:02:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f041b964740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf2248e80 con 0x55ecf2327c90 2024-01-25T15:02:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f041b964740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf220e0c0 con 0x55ecf23272a0 2024-01-25T15:02:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f041b964740 10 client.0 _ll_register_callbacks cb 0x55ecf2233ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f0412d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf23386b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f0412d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf23386b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56370/0 (socket says 172.21.15.170:56370) 2024-01-25T15:02:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f0412d9d640 1 -- 172.21.15.170:0/1681005583 learned_addr learned my addr 172.21.15.170:0/1681005583 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f041259c640 1 --2- 172.21.15.170:0/1681005583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf23272a0 0x55ecf2331130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f0411d9b640 1 --2- 172.21.15.170:0/1681005583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf2327c90 0x55ecf2331670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f0412d9d640 1 -- 172.21.15.170:0/1681005583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf23272a0 msgr2=0x55ecf2331130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f0412d9d640 1 --2- 172.21.15.170:0/1681005583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf23272a0 0x55ecf2331130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f0412d9d640 1 -- 172.21.15.170:0/1681005583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf2327c90 msgr2=0x55ecf2331670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f0412d9d640 1 --2- 172.21.15.170:0/1681005583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf2327c90 0x55ecf2331670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f0412d9d640 1 -- 172.21.15.170:0/1681005583 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0404009920 con 0x55ecf232ce00 2024-01-25T15:02:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f0412d9d640 1 --2- 172.21.15.170:0/1681005583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf23386b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f040c009e60 tx=0x7f040c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68bfc75e6ab2b24 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f03f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f03f9ffb640 1 -- 172.21.15.170:0/1681005583 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c004810 con 0x55ecf232ce00 2024-01-25T15:02:09.310 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f03f9ffb640 1 -- 172.21.15.170:0/1681005583 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f040c01b040 con 0x55ecf232ce00 2024-01-25T15:02:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f041b964740 1 -- 172.21.15.170:0/1681005583 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ecf2289040 con 0x55ecf232ce00 2024-01-25T15:02:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f03f9ffb640 1 -- 172.21.15.170:0/1681005583 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f040c00fc10 con 0x55ecf232ce00 2024-01-25T15:02:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f041b964740 10 client.15501 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.301+0000 7f041b964740 1 -- 172.21.15.170:0/1681005583 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ecf228e6d0 con 0x55ecf232ce00 2024-01-25T15:02:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.302+0000 7f03f9ffb640 1 -- 172.21.15.170:0/1681005583 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ecf2289040 con 0x55ecf232ce00 2024-01-25T15:02:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.302+0000 7f03f9ffb640 1 -- 172.21.15.170:0/1681005583 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f040c02b400 con 0x55ecf232ce00 2024-01-25T15:02:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.302+0000 7f041b964740 10 client.15501 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.302+0000 7f041b964740 10 client.15501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.302+0000 7f041b964740 20 client.15501 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.302+0000 7f041b964740 1 --2- 172.21.15.170:0/1681005583 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55ecf233d080 0x55ecf233f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.302+0000 7f041b964740 4 client.15501 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:02:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.302+0000 7f041b964740 1 -- 172.21.15.170:0/1681005583 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ecf2288d60 con 0x55ecf233d080 2024-01-25T15:02:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.302+0000 7f041259c640 1 --2- 172.21.15.170:0/1681005583 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55ecf233d080 0x55ecf233f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.311 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.302+0000 7f03f9ffb640 10 client.15501 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.302+0000 7f041259c640 1 --2- 172.21.15.170:0/1681005583 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55ecf233d080 0x55ecf233f4a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b30da26bbc2165a server_cookie=be27650ba01b29b6 in_seq=0 out_seq=0 2024-01-25T15:02:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.303+0000 7f03f9ffb640 1 -- 172.21.15.170:0/1681005583 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ecf2288d60 con 0x55ecf233d080 2024-01-25T15:02:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.303+0000 7f03f9ffb640 10 client.15501 handle_command_reply: tid=0 2024-01-25T15:02:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.303+0000 7f041b964740 1 client.15501 shutdown 2024-01-25T15:02:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.303+0000 7f041b964740 1 -- 172.21.15.170:0/1681005583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 msgr2=0x55ecf23386b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.303+0000 7f041b964740 1 --2- 172.21.15.170:0/1681005583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf23386b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f040c009e60 tx=0x7f040c004a40 comp rx=0 tx=0).stop 2024-01-25T15:02:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.303+0000 7f041b964740 1 -- 172.21.15.170:0/1681005583 shutdown_connections 2024-01-25T15:02:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.303+0000 7f041b964740 1 --2- 172.21.15.170:0/1681005583 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55ecf233d080 0x55ecf233f4a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.303+0000 7f041b964740 1 --2- 172.21.15.170:0/1681005583 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf2327c90 0x55ecf2331670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.303+0000 7f041b964740 1 --2- 172.21.15.170:0/1681005583 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf23386b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.303+0000 7f041b964740 1 --2- 172.21.15.170:0/1681005583 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf23272a0 0x55ecf2331130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.303+0000 7f041b964740 1 -- 172.21.15.170:0/1681005583 >> 172.21.15.170:0/1681005583 conn(0x55ecf2322810 msgr2=0x55ecf2321a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.303+0000 7f03f9ffb640 0 client.15501 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:09.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.303+0000 7f041b964740 1 -- 172.21.15.170:0/1681005583 shutdown_connections 2024-01-25T15:02:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.303+0000 7f041b964740 1 -- 172.21.15.170:0/1681005583 wait complete. 2024-01-25T15:02:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.303+0000 7f041b964740 20 client.15501 trim_cache size 0 max 16384 2024-01-25T15:02:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f041b964740 1 Processor -- start 2024-01-25T15:02:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f041b964740 1 -- start start 2024-01-25T15:02:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f041b964740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf23272a0 0x55ecf2331130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f041b964740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf2327c90 0x55ecf2331670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.323 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f041b964740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf2325a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f041b964740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf2323050 con 0x55ecf232ce00 2024-01-25T15:02:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f041b964740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf2288d60 con 0x55ecf23272a0 2024-01-25T15:02:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f041b964740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf2328520 con 0x55ecf2327c90 2024-01-25T15:02:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f0412d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf2325a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f0412d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf2325a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56384/0 (socket says 172.21.15.170:56384) 2024-01-25T15:02:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f0412d9d640 1 -- 172.21.15.170:0/1333013416 learned_addr learned my addr 172.21.15.170:0/1333013416 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f041259c640 1 --2- 172.21.15.170:0/1333013416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf23272a0 0x55ecf2331130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f0412d9d640 1 -- 172.21.15.170:0/1333013416 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf2327c90 msgr2=0x55ecf2331670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f0412d9d640 1 --2- 172.21.15.170:0/1333013416 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf2327c90 0x55ecf2331670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f0412d9d640 1 -- 172.21.15.170:0/1333013416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf23272a0 msgr2=0x55ecf2331130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f0412d9d640 1 --2- 172.21.15.170:0/1333013416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf23272a0 0x55ecf2331130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f0412d9d640 1 -- 172.21.15.170:0/1333013416 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ecf222b060 con 0x55ecf232ce00 2024-01-25T15:02:09.324 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f041259c640 1 --2- 172.21.15.170:0/1333013416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf23272a0 0x55ecf2331130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.317+0000 7f0412d9d640 1 --2- 172.21.15.170:0/1333013416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf2325a70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f040c012fd0 tx=0x7f040c003a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d915d68ef290b server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.318+0000 7f03fbfff640 1 -- 172.21.15.170:0/1333013416 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c003e50 con 0x55ecf232ce00 2024-01-25T15:02:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.318+0000 7f03fbfff640 1 -- 172.21.15.170:0/1333013416 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f040c004810 con 0x55ecf232ce00 2024-01-25T15:02:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.318+0000 7f03fbfff640 1 -- 172.21.15.170:0/1333013416 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c00fe70 con 0x55ecf232ce00 2024-01-25T15:02:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.318+0000 7f041b964740 1 -- 172.21.15.170:0/1333013416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 msgr2=0x55ecf2325a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.318+0000 7f041b964740 1 --2- 172.21.15.170:0/1333013416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf2325a70 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f040c012fd0 tx=0x7f040c003a20 comp rx=0 tx=0).stop 2024-01-25T15:02:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.318+0000 7f041b964740 1 -- 172.21.15.170:0/1333013416 shutdown_connections 2024-01-25T15:02:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.318+0000 7f041b964740 1 --2- 172.21.15.170:0/1333013416 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf2325a70 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.318+0000 7f041b964740 1 --2- 172.21.15.170:0/1333013416 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf2327c90 0x55ecf2331670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.318+0000 7f041b964740 1 --2- 172.21.15.170:0/1333013416 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf23272a0 0x55ecf2331130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.318+0000 7f041b964740 1 -- 172.21.15.170:0/1333013416 >> 172.21.15.170:0/1333013416 conn(0x55ecf2322810 msgr2=0x55ecf2343e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.318+0000 7f041b964740 1 -- 172.21.15.170:0/1333013416 shutdown_connections 2024-01-25T15:02:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.318+0000 7f041b964740 1 -- 172.21.15.170:0/1333013416 wait complete. 2024-01-25T15:02:09.325 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f041b964740 1 -- start start 2024-01-25T15:02:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f041b964740 1 Processor -- start 2024-01-25T15:02:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f041b964740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf23272a0 0x55ecf238fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f041b964740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf2327c90 0x55ecf238fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f041b964740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf2396fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f041b964740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf23974e0 con 0x55ecf232ce00 2024-01-25T15:02:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f041b964740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf2397620 con 0x55ecf2327c90 2024-01-25T15:02:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f041b964740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecf2397790 con 0x55ecf23272a0 2024-01-25T15:02:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f041b964740 10 client.0 _ll_register_callbacks cb 0x7f0404009690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f0412d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf2396fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f0412d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf2396fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56400/0 (socket says 172.21.15.170:56400) 2024-01-25T15:02:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f0412d9d640 1 -- 172.21.15.170:0/2905334990 learned_addr learned my addr 172.21.15.170:0/2905334990 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f041259c640 1 --2- 172.21.15.170:0/2905334990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf23272a0 0x55ecf238fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f0411d9b640 1 --2- 172.21.15.170:0/2905334990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf2327c90 0x55ecf238fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.326 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f0412d9d640 1 -- 172.21.15.170:0/2905334990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf23272a0 msgr2=0x55ecf238fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f0412d9d640 1 --2- 172.21.15.170:0/2905334990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf23272a0 0x55ecf238fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f0412d9d640 1 -- 172.21.15.170:0/2905334990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf2327c90 msgr2=0x55ecf238fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f0412d9d640 1 --2- 172.21.15.170:0/2905334990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf2327c90 0x55ecf238fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f0412d9d640 1 -- 172.21.15.170:0/2905334990 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ecf228e6d0 con 0x55ecf232ce00 2024-01-25T15:02:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f0412d9d640 1 --2- 172.21.15.170:0/2905334990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf2396fa0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f040c009730 tx=0x7f040c00fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6332990b90f2cdd2 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.319+0000 7f03f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.320+0000 7f03f9ffb640 1 -- 172.21.15.170:0/2905334990 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c004b90 con 0x55ecf232ce00 2024-01-25T15:02:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.320+0000 7f03f9ffb640 1 -- 172.21.15.170:0/2905334990 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f040c004cf0 con 0x55ecf232ce00 2024-01-25T15:02:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.320+0000 7f041b964740 1 -- 172.21.15.170:0/2905334990 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0404012a70 con 0x55ecf232ce00 2024-01-25T15:02:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.320+0000 7f03f9ffb640 1 -- 172.21.15.170:0/2905334990 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f040c034450 con 0x55ecf232ce00 2024-01-25T15:02:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.320+0000 7f041b964740 10 client.15507 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.320+0000 7f041b964740 1 -- 172.21.15.170:0/2905334990 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ecf2250a80 con 0x55ecf232ce00 2024-01-25T15:02:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.320+0000 7f03f9ffb640 1 -- 172.21.15.170:0/2905334990 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0404012a70 con 0x55ecf232ce00 2024-01-25T15:02:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.320+0000 7f03f9ffb640 1 -- 172.21.15.170:0/2905334990 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f040c04d550 con 0x55ecf232ce00 2024-01-25T15:02:09.327 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.320+0000 7f041b964740 10 client.15507 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.320+0000 7f041b964740 10 client.15507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.320+0000 7f041b964740 20 client.15507 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.320+0000 7f041b964740 1 --2- 172.21.15.170:0/2905334990 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55ecf2398d70 0x55ecf239b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.320+0000 7f041b964740 4 client.15507 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-25T15:02:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.320+0000 7f041b964740 1 -- 172.21.15.170:0/2905334990 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ecf1f8f600 con 0x55ecf2398d70 2024-01-25T15:02:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.320+0000 7f041259c640 1 --2- 172.21.15.170:0/2905334990 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55ecf2398d70 0x55ecf239b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.321+0000 7f041259c640 1 --2- 172.21.15.170:0/2905334990 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55ecf2398d70 0x55ecf239b190 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ac02b5331b8ae24 server_cookie=3569d37597ccfa8d in_seq=0 out_seq=0 2024-01-25T15:02:09.328 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.321+0000 7f03f9ffb640 10 client.15507 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.332+0000 7f03f9ffb640 1 -- 172.21.15.170:0/2905334990 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ecf1f8f600 con 0x55ecf2398d70 2024-01-25T15:02:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.332+0000 7f03f9ffb640 10 client.15507 handle_command_reply: tid=0 2024-01-25T15:02:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.332+0000 7f041b964740 1 client.15507 shutdown 2024-01-25T15:02:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f041b964740 1 -- 172.21.15.170:0/2905334990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 msgr2=0x55ecf2396fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f041b964740 1 --2- 172.21.15.170:0/2905334990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf2396fa0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f040c009730 tx=0x7f040c00fec0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.334 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f041b964740 1 -- 172.21.15.170:0/2905334990 shutdown_connections 2024-01-25T15:02:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f041b964740 1 --2- 172.21.15.170:0/2905334990 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55ecf2398d70 0x55ecf239b190 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f041b964740 1 --2- 172.21.15.170:0/2905334990 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55ecf2327c90 0x55ecf238fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f041b964740 1 --2- 172.21.15.170:0/2905334990 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55ecf232ce00 0x55ecf2396fa0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f03f9ffb640 0 client.15507 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f041b964740 1 --2- 172.21.15.170:0/2905334990 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55ecf23272a0 0x55ecf238fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f041b964740 1 -- 172.21.15.170:0/2905334990 >> 172.21.15.170:0/2905334990 conn(0x55ecf2322810 msgr2=0x55ecf2328e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f041b964740 1 -- 172.21.15.170:0/2905334990 shutdown_connections 2024-01-25T15:02:09.335 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f041b964740 1 -- 172.21.15.170:0/2905334990 wait complete. 2024-01-25T15:02:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f041b964740 20 client.15507 trim_cache size 0 max 16384 2024-01-25T15:02:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:{ 2024-01-25T15:02:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "message": "", 2024-01-25T15:02:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "return_code": 0 2024-01-25T15:02:09.336 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:} 2024-01-25T15:02:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f0418cc9640 1 -- 172.21.15.170:0/1868010129 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f03fc0a1420 msgr2=0x7f03fc0a38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f0418cc9640 1 --2- 172.21.15.170:0/1868010129 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f03fc0a1420 0x7f03fc0a38e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f040c005c40 tx=0x7f040c009b00 comp rx=0 tx=0).stop 2024-01-25T15:02:09.337 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f0418cc9640 1 -- 172.21.15.170:0/1868010129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0414100e00 msgr2=0x7f041419b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f0418cc9640 1 --2- 172.21.15.170:0/1868010129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0414100e00 0x7f041419b920 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0408009230 tx=0x7f0408004dd0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f0418cc9640 1 -- 172.21.15.170:0/1868010129 shutdown_connections 2024-01-25T15:02:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f0418cc9640 1 --2- 172.21.15.170:0/1868010129 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f03fc0a1420 0x7f03fc0a38e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f0418cc9640 1 --2- 172.21.15.170:0/1868010129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f04141017c0 0x7f041419df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f0418cc9640 1 --2- 172.21.15.170:0/1868010129 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0414100e00 0x7f041419b920 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f0418cc9640 1 --2- 172.21.15.170:0/1868010129 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f04140ffc10 0x7f0414068f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f0418cc9640 1 -- 172.21.15.170:0/1868010129 >> 172.21.15.170:0/1868010129 conn(0x7f04140fb180 msgr2=0x7f0414104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f0418cc9640 1 -- 172.21.15.170:0/1868010129 shutdown_connections 2024-01-25T15:02:09.338 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:09.333+0000 7f0418cc9640 1 -- 172.21.15.170:0/1868010129 wait complete. 2024-01-25T15:02:09.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:09 smithi186 ceph-mon[35697]: pgmap v353: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-01-25T15:02:09.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:09 smithi170 ceph-mon[31899]: pgmap v353: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-01-25T15:02:09.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:09 smithi191 ceph-mon[36347]: pgmap v353: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-01-25T15:02:10.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:10 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T15:02:10.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:10 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T15:02:10.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:10 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T15:02:11.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:11 smithi186 ceph-mon[35697]: pgmap v354: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-01-25T15:02:11.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:11 smithi170 ceph-mon[31899]: pgmap v354: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-01-25T15:02:11.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:11 smithi191 ceph-mon[36347]: pgmap v354: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-01-25T15:02:12.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T15:02:12.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T15:02:12.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:12 smithi191 ceph-mon[36347]: pgmap v355: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-01-25T15:02:12.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T15:02:12.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T15:02:12.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:12 smithi186 ceph-mon[35697]: pgmap v355: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-01-25T15:02:12.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T15:02:12.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T15:02:12.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:02:12.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:12 smithi170 ceph-mon[31899]: pgmap v355: 97 pgs: 97 active+clean; 656 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 597 B/s wr, 10 op/s 2024-01-25T15:02:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:15 smithi186 ceph-mon[35697]: pgmap v356: 97 pgs: 97 active+clean; 657 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.6 KiB/s wr, 15 op/s 2024-01-25T15:02:15.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:15 smithi170 ceph-mon[31899]: pgmap v356: 97 pgs: 97 active+clean; 657 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.6 KiB/s wr, 15 op/s 2024-01-25T15:02:15.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:15 smithi191 ceph-mon[36347]: pgmap v356: 97 pgs: 97 active+clean; 657 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.6 KiB/s wr, 15 op/s 2024-01-25T15:02:17.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:17 smithi186 ceph-mon[35697]: pgmap v357: 97 pgs: 97 active+clean; 657 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-01-25T15:02:17.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:17 smithi170 ceph-mon[31899]: pgmap v357: 97 pgs: 97 active+clean; 657 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-01-25T15:02:17.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:17 smithi191 ceph-mon[36347]: pgmap v357: 97 pgs: 97 active+clean; 657 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-01-25T15:02:19.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:19 smithi186 ceph-mon[35697]: pgmap v358: 97 pgs: 97 active+clean; 657 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 15 op/s 2024-01-25T15:02:19.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:19 smithi170 ceph-mon[31899]: pgmap v358: 97 pgs: 97 active+clean; 657 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 15 op/s 2024-01-25T15:02:19.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:19 smithi191 ceph-mon[36347]: pgmap v358: 97 pgs: 97 active+clean; 657 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.5 KiB/s wr, 15 op/s 2024-01-25T15:02:21.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:21 smithi186 ceph-mon[35697]: pgmap v359: 97 pgs: 97 active+clean; 657 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-01-25T15:02:21.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:21 smithi170 ceph-mon[31899]: pgmap v359: 97 pgs: 97 active+clean; 657 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-01-25T15:02:21.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:21 smithi191 ceph-mon[36347]: pgmap v359: 97 pgs: 97 active+clean; 657 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-01-25T15:02:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.431+0000 7f620ebe5640 1 -- 172.21.15.170:0/1477642897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62081069f0 msgr2=0x7f6208108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.431+0000 7f620ebe5640 1 --2- 172.21.15.170:0/1477642897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62081069f0 0x7f6208108e40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6200009ca0 tx=0x7f620002c0f0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.431+0000 7f620ebe5640 1 -- 172.21.15.170:0/1477642897 shutdown_connections 2024-01-25T15:02:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.431+0000 7f620ebe5640 1 --2- 172.21.15.170:0/1477642897 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62081069f0 0x7f6208108e40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.431+0000 7f620ebe5640 1 --2- 172.21.15.170:0/1477642897 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62081040c0 0x7f62081064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.431+0000 7f620ebe5640 1 --2- 172.21.15.170:0/1477642897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6208101790 0x7f6208103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.431+0000 7f620ebe5640 1 -- 172.21.15.170:0/1477642897 >> 172.21.15.170:0/1477642897 conn(0x7f62080fb180 msgr2=0x7f62080fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.431+0000 7f620ebe5640 1 -- 172.21.15.170:0/1477642897 shutdown_connections 2024-01-25T15:02:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.431+0000 7f620ebe5640 1 -- 172.21.15.170:0/1477642897 wait complete. 2024-01-25T15:02:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620ebe5640 1 Processor -- start 2024-01-25T15:02:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620ebe5640 1 -- start start 2024-01-25T15:02:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620ebe5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6208101790 0x7f6208196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620ebe5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62081040c0 0x7f6208197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620ebe5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62081069f0 0x7f620819e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620ebe5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620819e6e0 con 0x7f62081069f0 2024-01-25T15:02:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620ebe5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620819e850 con 0x7f6208101790 2024-01-25T15:02:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620ebe5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620819ea10 con 0x7f62081040c0 2024-01-25T15:02:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620d182640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62081069f0 0x7f620819e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620d182640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62081069f0 0x7f620819e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36448/0 (socket says 172.21.15.170:36448) 2024-01-25T15:02:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620d182640 1 -- 172.21.15.170:0/974996465 learned_addr learned my addr 172.21.15.170:0/974996465 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620c981640 1 --2- 172.21.15.170:0/974996465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6208101790 0x7f6208196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620d182640 1 -- 172.21.15.170:0/974996465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62081040c0 msgr2=0x7f6208197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f6207fff640 1 --2- 172.21.15.170:0/974996465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62081040c0 0x7f6208197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620d182640 1 --2- 172.21.15.170:0/974996465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62081040c0 0x7f6208197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620d182640 1 -- 172.21.15.170:0/974996465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6208101790 msgr2=0x7f6208196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620d182640 1 --2- 172.21.15.170:0/974996465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6208101790 0x7f6208196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620d182640 1 -- 172.21.15.170:0/974996465 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6200009900 con 0x7f62081069f0 2024-01-25T15:02:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620c981640 1 --2- 172.21.15.170:0/974996465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6208101790 0x7f6208196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:22.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.432+0000 7f620d182640 1 --2- 172.21.15.170:0/974996465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62081069f0 0x7f620819e1a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f620002c630 tx=0x7f62000329c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.433+0000 7f6205ffb640 1 -- 172.21.15.170:0/974996465 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200034e80 con 0x7f62081069f0 2024-01-25T15:02:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.433+0000 7f6205ffb640 1 -- 172.21.15.170:0/974996465 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6200032e90 con 0x7f62081069f0 2024-01-25T15:02:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.433+0000 7f620ebe5640 1 -- 172.21.15.170:0/974996465 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f620819ec90 con 0x7f62081069f0 2024-01-25T15:02:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.433+0000 7f6205ffb640 1 -- 172.21.15.170:0/974996465 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62000048a0 con 0x7f62081069f0 2024-01-25T15:02:22.437 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.433+0000 7f620ebe5640 1 -- 172.21.15.170:0/974996465 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f620819f190 con 0x7f62081069f0 2024-01-25T15:02:22.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.436+0000 7f6205ffb640 1 -- 172.21.15.170:0/974996465 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f620003b040 con 0x7f62081069f0 2024-01-25T15:02:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.436+0000 7f62117a9740 1 Processor -- start 2024-01-25T15:02:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.436+0000 7f62117a9740 1 -- start start 2024-01-25T15:02:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.436+0000 7f62117a9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69f2a0 0x557b5f69f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.436+0000 7f62117a9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69fc90 0x557b5f6a4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.436+0000 7f62117a9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f6a4e00 0x557b5f6a7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.436+0000 7f62117a9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f60f070 con 0x557b5f69fc90 2024-01-25T15:02:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.436+0000 7f62117a9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f60c760 con 0x557b5f69f2a0 2024-01-25T15:02:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.436+0000 7f62117a9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f608050 con 0x557b5f6a4e00 2024-01-25T15:02:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.436+0000 7f620c981640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69fc90 0x557b5f6a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.436+0000 7f620c981640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69fc90 0x557b5f6a4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36452/0 (socket says 172.21.15.170:36452) 2024-01-25T15:02:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.436+0000 7f620c981640 1 -- 172.21.15.170:0/3354670207 learned_addr learned my addr 172.21.15.170:0/3354670207 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:22.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.436+0000 7f6205ffb640 1 --2- 172.21.15.170:0/974996465 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f61f00a14a0 0x7f61f00a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.436+0000 7f6207fff640 1 --2- 172.21.15.170:0/3354670207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f6a4e00 0x557b5f6a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.437+0000 7f620d182640 1 --2- 172.21.15.170:0/974996465 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f61f00a14a0 0x7f61f00a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.437+0000 7f6207fff640 1 --2- 172.21.15.170:0/3354670207 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69f2a0 0x557b5f69f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.437+0000 7f620c981640 1 -- 172.21.15.170:0/3354670207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f6a4e00 msgr2=0x557b5f6a7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.437+0000 7f620c981640 1 --2- 172.21.15.170:0/3354670207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f6a4e00 0x557b5f6a7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.437+0000 7f620c981640 1 -- 172.21.15.170:0/3354670207 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69f2a0 msgr2=0x557b5f69f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.437+0000 7f620c981640 1 --2- 172.21.15.170:0/3354670207 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69f2a0 0x557b5f69f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.437+0000 7f620c981640 1 -- 172.21.15.170:0/3354670207 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b5f5ffe70 con 0x557b5f69fc90 2024-01-25T15:02:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.437+0000 7f6205ffb640 1 -- 172.21.15.170:0/974996465 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f62000ef310 con 0x7f62081069f0 2024-01-25T15:02:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.437+0000 7f620c981640 1 --2- 172.21.15.170:0/3354670207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69fc90 0x557b5f6a4790 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f61f800bd40 tx=0x7f61f800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12d21112efafb06 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.437+0000 7f620d182640 1 --2- 172.21.15.170:0/974996465 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f61f00a14a0 0x7f61f00a3960 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f62000bc3c0 tx=0x7f6200085040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.437+0000 7f61eeffd640 1 -- 172.21.15.170:0/3354670207 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f801a460 con 0x557b5f69fc90 2024-01-25T15:02:22.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.437+0000 7f61eeffd640 1 -- 172.21.15.170:0/3354670207 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61f801aa80 con 0x557b5f69fc90 2024-01-25T15:02:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.437+0000 7f61eeffd640 1 -- 172.21.15.170:0/3354670207 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8011a30 con 0x557b5f69fc90 2024-01-25T15:02:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.438+0000 7f62117a9740 1 -- 172.21.15.170:0/3354670207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69fc90 msgr2=0x557b5f6a4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.438+0000 7f62117a9740 1 --2- 172.21.15.170:0/3354670207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69fc90 0x557b5f6a4790 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f61f800bd40 tx=0x7f61f800f730 comp rx=0 tx=0).stop 2024-01-25T15:02:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.438+0000 7f62117a9740 1 -- 172.21.15.170:0/3354670207 shutdown_connections 2024-01-25T15:02:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.438+0000 7f62117a9740 1 --2- 172.21.15.170:0/3354670207 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f6a4e00 0x557b5f6a7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.438+0000 7f62117a9740 1 --2- 172.21.15.170:0/3354670207 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69fc90 0x557b5f6a4790 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.438+0000 7f62117a9740 1 --2- 172.21.15.170:0/3354670207 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69f2a0 0x557b5f69f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.438+0000 7f62117a9740 1 -- 172.21.15.170:0/3354670207 >> 172.21.15.170:0/3354670207 conn(0x557b5f69a810 msgr2=0x557b5f69ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.438+0000 7f62117a9740 1 -- 172.21.15.170:0/3354670207 shutdown_connections 2024-01-25T15:02:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.438+0000 7f62117a9740 1 -- 172.21.15.170:0/3354670207 wait complete. 2024-01-25T15:02:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.438+0000 7f62117a9740 1 -- start start 2024-01-25T15:02:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.438+0000 7f62117a9740 1 Processor -- start 2024-01-25T15:02:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f62117a9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f6a9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f62117a9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69fc90 0x557b5f6a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f62117a9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f6a4e00 0x557b5f6b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f62117a9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f5c11e0 con 0x557b5f69f2a0 2024-01-25T15:02:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f62117a9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f5c0e80 con 0x557b5f69fc90 2024-01-25T15:02:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f62117a9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f5860c0 con 0x557b5f6a4e00 2024-01-25T15:02:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f62117a9740 10 client.0 _ll_register_callbacks cb 0x557b5f5abac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f6207fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f6a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f6207fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f6a9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36464/0 (socket says 172.21.15.170:36464) 2024-01-25T15:02:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f6207fff640 1 -- 172.21.15.170:0/85554258 learned_addr learned my addr 172.21.15.170:0/85554258 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f6207fff640 1 --2- 172.21.15.170:0/85554258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f6a4e00 0x557b5f6b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f620c981640 1 --2- 172.21.15.170:0/85554258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69fc90 0x557b5f6a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f6207fff640 1 -- 172.21.15.170:0/85554258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f6a4e00 msgr2=0x557b5f6b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f6207fff640 1 --2- 172.21.15.170:0/85554258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f6a4e00 0x557b5f6b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f6207fff640 1 -- 172.21.15.170:0/85554258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69fc90 msgr2=0x557b5f6a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f6207fff640 1 --2- 172.21.15.170:0/85554258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69fc90 0x557b5f6a96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f6207fff640 1 -- 172.21.15.170:0/85554258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f800b9a0 con 0x557b5f69f2a0 2024-01-25T15:02:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f6207fff640 1 --2- 172.21.15.170:0/85554258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f6a9180 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f61fc013a40 tx=0x7f61fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59770c1d479dfb65 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.439+0000 7f61e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.440+0000 7f61e7fff640 1 -- 172.21.15.170:0/85554258 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc013110 con 0x557b5f69f2a0 2024-01-25T15:02:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.440+0000 7f61e7fff640 1 -- 172.21.15.170:0/85554258 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f61fc00db20 con 0x557b5f69f2a0 2024-01-25T15:02:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.440+0000 7f62117a9740 1 -- 172.21.15.170:0/85554258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b5f601040 con 0x557b5f69f2a0 2024-01-25T15:02:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.440+0000 7f61e7fff640 1 -- 172.21.15.170:0/85554258 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61fc013270 con 0x557b5f69f2a0 2024-01-25T15:02:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.440+0000 7f62117a9740 10 client.15519 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.440+0000 7f62117a9740 1 -- 172.21.15.170:0/85554258 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557b5f6066d0 con 0x557b5f69f2a0 2024-01-25T15:02:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.440+0000 7f61e7fff640 1 -- 172.21.15.170:0/85554258 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557b5f601040 con 0x557b5f69f2a0 2024-01-25T15:02:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.440+0000 7f61e7fff640 1 -- 172.21.15.170:0/85554258 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f61fc0103d0 con 0x557b5f69f2a0 2024-01-25T15:02:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.440+0000 7f62117a9740 10 client.15519 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.440+0000 7f62117a9740 10 client.15519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:22.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.440+0000 7f62117a9740 20 client.15519 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.440+0000 7f62117a9740 1 --2- 172.21.15.170:0/85554258 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x557b5f6b5090 0x557b5f6b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.440+0000 7f62117a9740 4 client.15519 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:02:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.440+0000 7f62117a9740 1 -- 172.21.15.170:0/85554258 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b5f600d60 con 0x557b5f6b5090 2024-01-25T15:02:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.440+0000 7f620c981640 1 --2- 172.21.15.170:0/85554258 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x557b5f6b5090 0x557b5f6b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.441+0000 7f61e7fff640 10 client.15519 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.441+0000 7f620c981640 1 --2- 172.21.15.170:0/85554258 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x557b5f6b5090 0x557b5f6b74d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2b6a1771d6d55e7 server_cookie=d60a8f13c64803d3 in_seq=0 out_seq=0 2024-01-25T15:02:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.442+0000 7f61e7fff640 1 -- 172.21.15.170:0/85554258 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557b5f600d60 con 0x557b5f6b5090 2024-01-25T15:02:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.442+0000 7f61e7fff640 10 client.15519 handle_command_reply: tid=0 2024-01-25T15:02:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.442+0000 7f62117a9740 1 client.15519 shutdown 2024-01-25T15:02:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.442+0000 7f62117a9740 1 -- 172.21.15.170:0/85554258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 msgr2=0x557b5f6a9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.442+0000 7f62117a9740 1 --2- 172.21.15.170:0/85554258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f6a9180 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f61fc013a40 tx=0x7f61fc004730 comp rx=0 tx=0).stop 2024-01-25T15:02:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.442+0000 7f62117a9740 1 -- 172.21.15.170:0/85554258 shutdown_connections 2024-01-25T15:02:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.442+0000 7f62117a9740 1 --2- 172.21.15.170:0/85554258 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x557b5f6b5090 0x557b5f6b74d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.442+0000 7f62117a9740 1 --2- 172.21.15.170:0/85554258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69fc90 0x557b5f6a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.442+0000 7f62117a9740 1 --2- 172.21.15.170:0/85554258 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f6a4e00 0x557b5f6b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.442+0000 7f61e7fff640 0 client.15519 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.442+0000 7f62117a9740 1 --2- 172.21.15.170:0/85554258 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f6a9180 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.442+0000 7f62117a9740 1 -- 172.21.15.170:0/85554258 >> 172.21.15.170:0/85554258 conn(0x557b5f69a810 msgr2=0x557b5f699a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.442+0000 7f62117a9740 1 -- 172.21.15.170:0/85554258 shutdown_connections 2024-01-25T15:02:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.442+0000 7f62117a9740 1 -- 172.21.15.170:0/85554258 wait complete. 2024-01-25T15:02:22.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.442+0000 7f62117a9740 20 client.15519 trim_cache size 0 max 16384 2024-01-25T15:02:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.455+0000 7f62117a9740 1 Processor -- start 2024-01-25T15:02:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.455+0000 7f62117a9740 1 -- start start 2024-01-25T15:02:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.455+0000 7f62117a9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f69da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.455+0000 7f62117a9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69fc90 0x557b5f6b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.455+0000 7f62117a9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f6a4e00 0x557b5f69dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.455+0000 7f62117a9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f69a1d0 con 0x557b5f69f2a0 2024-01-25T15:02:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.455+0000 7f62117a9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f600d60 con 0x557b5f69fc90 2024-01-25T15:02:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.455+0000 7f62117a9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f601040 con 0x557b5f6a4e00 2024-01-25T15:02:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.455+0000 7f6207fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f69da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.455+0000 7f6207fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f69da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36476/0 (socket says 172.21.15.170:36476) 2024-01-25T15:02:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.455+0000 7f6207fff640 1 -- 172.21.15.170:0/1843352318 learned_addr learned my addr 172.21.15.170:0/1843352318 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.455+0000 7f620c981640 1 --2- 172.21.15.170:0/1843352318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69fc90 0x557b5f6b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f6207fff640 1 -- 172.21.15.170:0/1843352318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f6a4e00 msgr2=0x557b5f69dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f6207fff640 1 --2- 172.21.15.170:0/1843352318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f6a4e00 0x557b5f69dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f6207fff640 1 -- 172.21.15.170:0/1843352318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69fc90 msgr2=0x557b5f6b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f6207fff640 1 --2- 172.21.15.170:0/1843352318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69fc90 0x557b5f6b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f6207fff640 1 -- 172.21.15.170:0/1843352318 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b5f5a3060 con 0x557b5f69f2a0 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f620c981640 1 --2- 172.21.15.170:0/1843352318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69fc90 0x557b5f6b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f6207fff640 1 --2- 172.21.15.170:0/1843352318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f69da70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f61fc013a10 tx=0x7f61fc00f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a820bb375cd24c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f61ee7fc640 1 -- 172.21.15.170:0/1843352318 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc013110 con 0x557b5f69f2a0 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f61ee7fc640 1 -- 172.21.15.170:0/1843352318 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61fc018070 con 0x557b5f69f2a0 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f61ee7fc640 1 -- 172.21.15.170:0/1843352318 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc010bb0 con 0x557b5f69f2a0 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f62117a9740 1 -- 172.21.15.170:0/1843352318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 msgr2=0x557b5f69da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f62117a9740 1 --2- 172.21.15.170:0/1843352318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f69da70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f61fc013a10 tx=0x7f61fc00f650 comp rx=0 tx=0).stop 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f62117a9740 1 -- 172.21.15.170:0/1843352318 shutdown_connections 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f62117a9740 1 --2- 172.21.15.170:0/1843352318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f69fc90 0x557b5f6b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f62117a9740 1 --2- 172.21.15.170:0/1843352318 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f6a4e00 0x557b5f69dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f62117a9740 1 --2- 172.21.15.170:0/1843352318 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f69da70 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f62117a9740 1 -- 172.21.15.170:0/1843352318 >> 172.21.15.170:0/1843352318 conn(0x557b5f69a810 msgr2=0x557b5f6a0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.456+0000 7f62117a9740 1 -- 172.21.15.170:0/1843352318 shutdown_connections 2024-01-25T15:02:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.457+0000 7f62117a9740 1 -- 172.21.15.170:0/1843352318 wait complete. 2024-01-25T15:02:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.457+0000 7f62117a9740 1 -- start start 2024-01-25T15:02:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.457+0000 7f62117a9740 1 Processor -- start 2024-01-25T15:02:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.457+0000 7f62117a9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f6af240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.457+0000 7f62117a9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f69fc90 0x557b5f6af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.457+0000 7f62117a9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f6a4e00 0x557b5f6afd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.457+0000 7f62117a9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f70b7a0 con 0x557b5f69f2a0 2024-01-25T15:02:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.457+0000 7f62117a9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f70b910 con 0x557b5f6a4e00 2024-01-25T15:02:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.457+0000 7f62117a9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f70bad0 con 0x557b5f69fc90 2024-01-25T15:02:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.457+0000 7f62117a9740 10 client.0 _ll_register_callbacks cb 0x7f61f800b500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.457+0000 7f6207fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f6af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.457+0000 7f6207fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f6af240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:36486/0 (socket says 172.21.15.170:36486) 2024-01-25T15:02:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.457+0000 7f6207fff640 1 -- 172.21.15.170:0/2810643345 learned_addr learned my addr 172.21.15.170:0/2810643345 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.457+0000 7f620c981640 1 --2- 172.21.15.170:0/2810643345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f69fc90 0x557b5f6af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.458+0000 7f6207fff640 1 --2- 172.21.15.170:0/2810643345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f6a4e00 0x557b5f6afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.458+0000 7f6207fff640 1 -- 172.21.15.170:0/2810643345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f69fc90 msgr2=0x557b5f6af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.458+0000 7f6207fff640 1 --2- 172.21.15.170:0/2810643345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f69fc90 0x557b5f6af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.458+0000 7f6207fff640 1 -- 172.21.15.170:0/2810643345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f6a4e00 msgr2=0x557b5f6afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.458+0000 7f6207fff640 1 --2- 172.21.15.170:0/2810643345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f6a4e00 0x557b5f6afd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.458+0000 7f6207fff640 1 -- 172.21.15.170:0/2810643345 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b5f6066d0 con 0x557b5f69f2a0 2024-01-25T15:02:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.458+0000 7f6207fff640 1 --2- 172.21.15.170:0/2810643345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f6af240 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f61fc010880 tx=0x7f61fc005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818a034711976a2 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.458+0000 7f61e7fff640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.458+0000 7f61e7fff640 1 -- 172.21.15.170:0/2810643345 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61fc010d60 con 0x557b5f69f2a0 2024-01-25T15:02:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.458+0000 7f61e7fff640 1 -- 172.21.15.170:0/2810643345 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f61fc000e40 con 0x557b5f69f2a0 2024-01-25T15:02:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.458+0000 7f62117a9740 1 -- 172.21.15.170:0/2810643345 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61f801aa80 con 0x557b5f69f2a0 2024-01-25T15:02:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.458+0000 7f61e7fff640 1 -- 172.21.15.170:0/2810643345 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61fc010ec0 con 0x557b5f69f2a0 2024-01-25T15:02:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.458+0000 7f62117a9740 10 client.15525 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.458+0000 7f62117a9740 1 -- 172.21.15.170:0/2810643345 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557b5f5c8a80 con 0x557b5f69f2a0 2024-01-25T15:02:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.458+0000 7f61e7fff640 1 -- 172.21.15.170:0/2810643345 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61f801aa80 con 0x557b5f69f2a0 2024-01-25T15:02:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.459+0000 7f61e7fff640 1 -- 172.21.15.170:0/2810643345 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f61fc0117a0 con 0x557b5f69f2a0 2024-01-25T15:02:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.459+0000 7f62117a9740 10 client.15525 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.459+0000 7f62117a9740 10 client.15525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.459+0000 7f62117a9740 20 client.15525 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.459+0000 7f62117a9740 1 --2- 172.21.15.170:0/2810643345 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x557b5f70d170 0x557b5f70f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.459+0000 7f62117a9740 4 client.15525 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-25T15:02:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.459+0000 7f62117a9740 1 -- 172.21.15.170:0/2810643345 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557b5f307600 con 0x557b5f70d170 2024-01-25T15:02:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.459+0000 7f620c981640 1 --2- 172.21.15.170:0/2810643345 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x557b5f70d170 0x557b5f70f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.459+0000 7f61e7fff640 10 client.15525 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.459+0000 7f620c981640 1 --2- 172.21.15.170:0/2810643345 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x557b5f70d170 0x557b5f70f590 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8346b70b221ea16 server_cookie=d3b2279fdbc9bde3 in_seq=0 out_seq=0 2024-01-25T15:02:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.463+0000 7f61e7fff640 1 -- 172.21.15.170:0/2810643345 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557b5f307600 con 0x557b5f70d170 2024-01-25T15:02:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.463+0000 7f61e7fff640 10 client.15525 handle_command_reply: tid=0 2024-01-25T15:02:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.463+0000 7f62117a9740 1 client.15525 shutdown 2024-01-25T15:02:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.463+0000 7f62117a9740 1 -- 172.21.15.170:0/2810643345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 msgr2=0x557b5f6af240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.463+0000 7f62117a9740 1 --2- 172.21.15.170:0/2810643345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f6af240 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f61fc010880 tx=0x7f61fc005b10 comp rx=0 tx=0).stop 2024-01-25T15:02:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.463+0000 7f62117a9740 1 -- 172.21.15.170:0/2810643345 shutdown_connections 2024-01-25T15:02:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.463+0000 7f62117a9740 1 --2- 172.21.15.170:0/2810643345 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x557b5f70d170 0x557b5f70f590 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.463+0000 7f62117a9740 1 --2- 172.21.15.170:0/2810643345 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x557b5f6a4e00 0x557b5f6afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.463+0000 7f62117a9740 1 --2- 172.21.15.170:0/2810643345 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x557b5f69fc90 0x557b5f6af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.463+0000 7f62117a9740 1 --2- 172.21.15.170:0/2810643345 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x557b5f69f2a0 0x557b5f6af240 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.463+0000 7f61e7fff640 0 client.15525 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.463+0000 7f62117a9740 1 -- 172.21.15.170:0/2810643345 >> 172.21.15.170:0/2810643345 conn(0x557b5f69a810 msgr2=0x557b5f6a4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.464+0000 7f62117a9740 1 -- 172.21.15.170:0/2810643345 shutdown_connections 2024-01-25T15:02:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.464+0000 7f62117a9740 1 -- 172.21.15.170:0/2810643345 wait complete. 2024-01-25T15:02:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.464+0000 7f62117a9740 20 client.15525 trim_cache size 0 max 16384 2024-01-25T15:02:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:{ 2024-01-25T15:02:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "message": "", 2024-01-25T15:02:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "return_code": 0 2024-01-25T15:02:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:} 2024-01-25T15:02:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.464+0000 7f620ebe5640 1 -- 172.21.15.170:0/974996465 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f61f00a14a0 msgr2=0x7f61f00a3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.464+0000 7f620ebe5640 1 --2- 172.21.15.170:0/974996465 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f61f00a14a0 0x7f61f00a3960 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f62000bc3c0 tx=0x7f6200085040 comp rx=0 tx=0).stop 2024-01-25T15:02:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.464+0000 7f620ebe5640 1 -- 172.21.15.170:0/974996465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62081069f0 msgr2=0x7f620819e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.464+0000 7f620ebe5640 1 --2- 172.21.15.170:0/974996465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62081069f0 0x7f620819e1a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f620002c630 tx=0x7f62000329c0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.464+0000 7f620ebe5640 1 -- 172.21.15.170:0/974996465 shutdown_connections 2024-01-25T15:02:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.464+0000 7f620ebe5640 1 --2- 172.21.15.170:0/974996465 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f61f00a14a0 0x7f61f00a3960 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.464+0000 7f620ebe5640 1 --2- 172.21.15.170:0/974996465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62081069f0 0x7f620819e1a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.464+0000 7f620ebe5640 1 --2- 172.21.15.170:0/974996465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62081040c0 0x7f6208197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.464+0000 7f620ebe5640 1 --2- 172.21.15.170:0/974996465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6208101790 0x7f6208196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.464+0000 7f620ebe5640 1 -- 172.21.15.170:0/974996465 >> 172.21.15.170:0/974996465 conn(0x7f62080fb180 msgr2=0x7f62081021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.464+0000 7f620ebe5640 1 -- 172.21.15.170:0/974996465 shutdown_connections 2024-01-25T15:02:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:22.464+0000 7f620ebe5640 1 -- 172.21.15.170:0/974996465 wait complete. 2024-01-25T15:02:23.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:23 smithi186 ceph-mon[35697]: pgmap v360: 97 pgs: 97 active+clean; 657 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-01-25T15:02:23.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:23 smithi170 ceph-mon[31899]: pgmap v360: 97 pgs: 97 active+clean; 657 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-01-25T15:02:23.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:23 smithi191 ceph-mon[36347]: pgmap v360: 97 pgs: 97 active+clean; 657 KiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.5 KiB/s wr, 13 op/s 2024-01-25T15:02:25.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:25 smithi186 ceph-mon[35697]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-01-25T15:02:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:25 smithi170 ceph-mon[31899]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-01-25T15:02:25.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:25 smithi191 ceph-mon[36347]: pgmap v361: 97 pgs: 97 active+clean; 657 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 14 op/s 2024-01-25T15:02:26.493 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-25T15:02:26.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.631+0000 7f416b815640 1 -- 172.21.15.170:0/1987298572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4164102960 msgr2=0x7f41641091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:26.650 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.631+0000 7f416b815640 1 --2- 172.21.15.170:0/1987298572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4164102960 0x7f41641091f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f415c009ca0 tx=0x7f415c02c0f0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.631+0000 7f416b815640 1 -- 172.21.15.170:0/1987298572 shutdown_connections 2024-01-25T15:02:26.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.631+0000 7f416b815640 1 --2- 172.21.15.170:0/1987298572 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4164102960 0x7f41641091f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.631+0000 7f416b815640 1 --2- 172.21.15.170:0/1987298572 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4164101fa0 0x7f4164102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.631+0000 7f416b815640 1 --2- 172.21.15.170:0/1987298572 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41640fefd0 0x7f41640ff3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.631+0000 7f416b815640 1 -- 172.21.15.170:0/1987298572 >> 172.21.15.170:0/1987298572 conn(0x7f41640fa900 msgr2=0x7f41640fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:26.651 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.631+0000 7f416b815640 1 -- 172.21.15.170:0/1987298572 shutdown_connections 2024-01-25T15:02:26.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.631+0000 7f416b815640 1 -- 172.21.15.170:0/1987298572 wait complete. 2024-01-25T15:02:26.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f416b815640 1 Processor -- start 2024-01-25T15:02:26.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f416b815640 1 -- start start 2024-01-25T15:02:26.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f416b815640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41640fefd0 0x7f4164196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f416b815640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4164101fa0 0x7f41641971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.652 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f416b815640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4164102960 0x7f416419e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f416b815640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416419e750 con 0x7f4164101fa0 2024-01-25T15:02:26.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f416b815640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416419e8c0 con 0x7f4164102960 2024-01-25T15:02:26.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f416b815640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f416419ea80 con 0x7f41640fefd0 2024-01-25T15:02:26.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f4168db0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4164101fa0 0x7f41641971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.653 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f4168db0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4164101fa0 0x7f41641971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53274/0 (socket says 172.21.15.170:53274) 2024-01-25T15:02:26.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f4168db0640 1 -- 172.21.15.170:0/1696332755 learned_addr learned my addr 172.21.15.170:0/1696332755 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:26.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f4169db2640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4164102960 0x7f416419e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f41695b1640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41640fefd0 0x7f4164196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f4168db0640 1 -- 172.21.15.170:0/1696332755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41640fefd0 msgr2=0x7f4164196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:26.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f4168db0640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41640fefd0 0x7f4164196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f4168db0640 1 -- 172.21.15.170:0/1696332755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4164102960 msgr2=0x7f416419e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:26.654 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f4168db0640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4164102960 0x7f416419e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f4168db0640 1 -- 172.21.15.170:0/1696332755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415c009900 con 0x7f4164101fa0 2024-01-25T15:02:26.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f4169db2640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4164102960 0x7f416419e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:26.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.632+0000 7f41695b1640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41640fefd0 0x7f4164196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:26.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.633+0000 7f4168db0640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4164101fa0 0x7f41641971b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f415400d950 tx=0x7f415400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:26.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.633+0000 7f415a7fc640 1 -- 172.21.15.170:0/1696332755 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154009a30 con 0x7f4164101fa0 2024-01-25T15:02:26.655 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.633+0000 7f415a7fc640 1 -- 172.21.15.170:0/1696332755 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4154009b90 con 0x7f4164101fa0 2024-01-25T15:02:26.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.633+0000 7f415a7fc640 1 -- 172.21.15.170:0/1696332755 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41540047a0 con 0x7f4164101fa0 2024-01-25T15:02:26.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.633+0000 7f416b815640 1 -- 172.21.15.170:0/1696332755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f416419ed60 con 0x7f4164101fa0 2024-01-25T15:02:26.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.633+0000 7f416b815640 1 -- 172.21.15.170:0/1696332755 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f416419f1c0 con 0x7f4164101fa0 2024-01-25T15:02:26.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.635+0000 7f415a7fc640 1 -- 172.21.15.170:0/1696332755 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f4154009d00 con 0x7f4164101fa0 2024-01-25T15:02:26.656 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.635+0000 7f416e3d9740 1 Processor -- start 2024-01-25T15:02:26.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.635+0000 7f416e3d9740 1 -- start start 2024-01-25T15:02:26.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f416e3d9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d0fea50 0x55de5d0fee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f416e3d9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0ff440 0x55de5d103f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f416e3d9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d1045b0 0x55de5d106a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f416e3d9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5d06d3b0 con 0x55de5d0fea50 2024-01-25T15:02:26.657 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f416e3d9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5d06aaa0 con 0x55de5d1045b0 2024-01-25T15:02:26.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f416e3d9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5d066390 con 0x55de5d0ff440 2024-01-25T15:02:26.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f4169db2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d0fea50 0x55de5d0fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f4169db2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d0fea50 0x55de5d0fee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53276/0 (socket says 172.21.15.170:53276) 2024-01-25T15:02:26.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f4169db2640 1 -- 172.21.15.170:0/2491548978 learned_addr learned my addr 172.21.15.170:0/2491548978 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:26.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f4168db0640 1 --2- 172.21.15.170:0/2491548978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d1045b0 0x55de5d106a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.658 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f415a7fc640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f41500a1370 0x7f41500a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f41695b1640 1 --2- 172.21.15.170:0/2491548978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0ff440 0x55de5d103f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f4169db2640 1 -- 172.21.15.170:0/2491548978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0ff440 msgr2=0x55de5d103f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:26.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f4169db2640 1 --2- 172.21.15.170:0/2491548978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0ff440 0x55de5d103f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f4169db2640 1 -- 172.21.15.170:0/2491548978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d1045b0 msgr2=0x55de5d106a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:26.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f4169db2640 1 --2- 172.21.15.170:0/2491548978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d1045b0 0x55de5d106a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.659 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f4169db2640 1 -- 172.21.15.170:0/2491548978 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de5d028810 con 0x55de5d0fea50 2024-01-25T15:02:26.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f41695b1640 1 --2- 172.21.15.170:0/2491548978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0ff440 0x55de5d103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:26.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f415a7fc640 1 -- 172.21.15.170:0/1696332755 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f41540cc8a0 con 0x7f4164101fa0 2024-01-25T15:02:26.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f4169db2640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f41500a1370 0x7f41500a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.636+0000 7f4169db2640 1 --2- 172.21.15.170:0/2491548978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d0fea50 0x55de5d0fee70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f415c0098d0 tx=0x7f415c0323c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4528251988cca56 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:26.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.637+0000 7f414f7fe640 1 -- 172.21.15.170:0/2491548978 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c032990 con 0x55de5d0fea50 2024-01-25T15:02:26.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.637+0000 7f414f7fe640 1 -- 172.21.15.170:0/2491548978 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f415c032af0 con 0x55de5d0fea50 2024-01-25T15:02:26.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.637+0000 7f414f7fe640 1 -- 172.21.15.170:0/2491548978 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c0042a0 con 0x55de5d0fea50 2024-01-25T15:02:26.660 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.638+0000 7f416e3d9740 1 -- 172.21.15.170:0/2491548978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d0fea50 msgr2=0x55de5d0fee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:26.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.638+0000 7f4169db2640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f41500a1370 0x7f41500a3830 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f415c006010 tx=0x7f415c04c000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:26.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.638+0000 7f416e3d9740 1 --2- 172.21.15.170:0/2491548978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d0fea50 0x55de5d0fee70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f415c0098d0 tx=0x7f415c0323c0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.638+0000 7f416e3d9740 1 -- 172.21.15.170:0/2491548978 shutdown_connections 2024-01-25T15:02:26.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.638+0000 7f416e3d9740 1 --2- 172.21.15.170:0/2491548978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d1045b0 0x55de5d106a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.638+0000 7f416e3d9740 1 --2- 172.21.15.170:0/2491548978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0ff440 0x55de5d103f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.638+0000 7f416e3d9740 1 --2- 172.21.15.170:0/2491548978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d0fea50 0x55de5d0fee70 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.638+0000 7f416e3d9740 1 -- 172.21.15.170:0/2491548978 >> 172.21.15.170:0/2491548978 conn(0x55de5d0f9fc0 msgr2=0x55de5d0fa3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:26.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.638+0000 7f416e3d9740 1 -- 172.21.15.170:0/2491548978 shutdown_connections 2024-01-25T15:02:26.661 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.638+0000 7f416e3d9740 1 -- 172.21.15.170:0/2491548978 wait complete. 2024-01-25T15:02:26.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.638+0000 7f416e3d9740 1 -- start start 2024-01-25T15:02:26.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.638+0000 7f416e3d9740 1 Processor -- start 2024-01-25T15:02:26.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f416e3d9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d0fea50 0x55de5d108c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f416e3d9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d0ff440 0x55de5d1091d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f416e3d9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d1045b0 0x55de5d110210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f416e3d9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5d01f780 con 0x55de5d0ff440 2024-01-25T15:02:26.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f416e3d9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5d01f420 con 0x55de5d0fea50 2024-01-25T15:02:26.662 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f416e3d9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5cfe4420 con 0x55de5d1045b0 2024-01-25T15:02:26.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f416e3d9740 10 client.0 _ll_register_callbacks cb 0x55de5d021b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:26.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f4168db0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d0ff440 0x55de5d1091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f4168db0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d0ff440 0x55de5d1091d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53280/0 (socket says 172.21.15.170:53280) 2024-01-25T15:02:26.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f4168db0640 1 -- 172.21.15.170:0/1568398649 learned_addr learned my addr 172.21.15.170:0/1568398649 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:26.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f41695b1640 1 --2- 172.21.15.170:0/1568398649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d0fea50 0x55de5d108c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f4169db2640 1 --2- 172.21.15.170:0/1568398649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d1045b0 0x55de5d110210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f4168db0640 1 -- 172.21.15.170:0/1568398649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d1045b0 msgr2=0x55de5d110210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:26.663 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f4168db0640 1 --2- 172.21.15.170:0/1568398649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d1045b0 0x55de5d110210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f4168db0640 1 -- 172.21.15.170:0/1568398649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d0fea50 msgr2=0x55de5d108c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:26.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f4168db0640 1 --2- 172.21.15.170:0/1568398649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d0fea50 0x55de5d108c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f4168db0640 1 -- 172.21.15.170:0/1568398649 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4164109a30 con 0x55de5d0ff440 2024-01-25T15:02:26.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f4169db2640 1 --2- 172.21.15.170:0/1568398649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d1045b0 0x55de5d110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:26.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f4168db0640 1 --2- 172.21.15.170:0/1568398649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d0ff440 0x55de5d1091d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4154096290 tx=0x7f41540994b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aee8bebfa8ee58e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:26.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f414cff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:26.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f414cff9640 1 -- 172.21.15.170:0/1568398649 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154099fb0 con 0x55de5d0ff440 2024-01-25T15:02:26.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f414cff9640 1 -- 172.21.15.170:0/1568398649 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f41540998b0 con 0x55de5d0ff440 2024-01-25T15:02:26.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.639+0000 7f416e3d9740 1 -- 172.21.15.170:0/1568398649 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de5d03b240 con 0x55de5d0ff440 2024-01-25T15:02:26.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.640+0000 7f414cff9640 1 -- 172.21.15.170:0/1568398649 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f415409da00 con 0x55de5d0ff440 2024-01-25T15:02:26.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.640+0000 7f416e3d9740 10 client.15537 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:26.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.640+0000 7f416e3d9740 1 -- 172.21.15.170:0/1568398649 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55de5d064a10 con 0x55de5d0ff440 2024-01-25T15:02:26.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.640+0000 7f414cff9640 1 -- 172.21.15.170:0/1568398649 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55de5d03b240 con 0x55de5d0ff440 2024-01-25T15:02:26.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.640+0000 7f414cff9640 1 -- 172.21.15.170:0/1568398649 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4154076070 con 0x55de5d0ff440 2024-01-25T15:02:26.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.640+0000 7f416e3d9740 10 client.15537 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:26.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.640+0000 7f416e3d9740 10 client.15537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:26.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.640+0000 7f416e3d9740 20 client.15537 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:26.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.640+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1568398649 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55de5d114f00 0x55de5d117320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.640+0000 7f416e3d9740 4 client.15537 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:02:26.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.640+0000 7f416e3d9740 1 -- 172.21.15.170:0/1568398649 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de5d038b50 con 0x55de5d114f00 2024-01-25T15:02:26.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.640+0000 7f41695b1640 1 --2- 172.21.15.170:0/1568398649 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55de5d114f00 0x55de5d117320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.641+0000 7f41695b1640 1 --2- 172.21.15.170:0/1568398649 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55de5d114f00 0x55de5d117320 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89db0f8f724b46ee server_cookie=b62cf387a99fc55f in_seq=0 out_seq=0 2024-01-25T15:02:26.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.641+0000 7f414cff9640 10 client.15537 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:26.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.641+0000 7f414cff9640 1 -- 172.21.15.170:0/1568398649 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55de5d038b50 con 0x55de5d114f00 2024-01-25T15:02:26.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.641+0000 7f414cff9640 10 client.15537 handle_command_reply: tid=0 2024-01-25T15:02:26.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.641+0000 7f416e3d9740 1 client.15537 shutdown 2024-01-25T15:02:26.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.642+0000 7f416e3d9740 1 -- 172.21.15.170:0/1568398649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d0ff440 msgr2=0x55de5d1091d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:26.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.642+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1568398649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d0ff440 0x55de5d1091d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4154096290 tx=0x7f41540994b0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.642+0000 7f416e3d9740 1 -- 172.21.15.170:0/1568398649 shutdown_connections 2024-01-25T15:02:26.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.642+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1568398649 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55de5d114f00 0x55de5d117320 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.642+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1568398649 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d1045b0 0x55de5d110210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.642+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1568398649 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d0ff440 0x55de5d1091d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.642+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1568398649 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d0fea50 0x55de5d108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.642+0000 7f414cff9640 0 client.15537 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:26.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.642+0000 7f416e3d9740 1 -- 172.21.15.170:0/1568398649 >> 172.21.15.170:0/1568398649 conn(0x55de5d0f9fc0 msgr2=0x55de5d0f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:26.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.642+0000 7f416e3d9740 1 -- 172.21.15.170:0/1568398649 shutdown_connections 2024-01-25T15:02:26.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.642+0000 7f416e3d9740 1 -- 172.21.15.170:0/1568398649 wait complete. 2024-01-25T15:02:26.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.642+0000 7f416e3d9740 20 client.15537 trim_cache size 0 max 16384 2024-01-25T15:02:26.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f416e3d9740 1 Processor -- start 2024-01-25T15:02:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f416e3d9740 1 -- start start 2024-01-25T15:02:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f416e3d9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0fea50 0x55de5d108c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f416e3d9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d0ff440 0x55de5d1091d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f416e3d9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d1045b0 0x55de5d1101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f416e3d9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5d03b240 con 0x55de5d1045b0 2024-01-25T15:02:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f416e3d9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5d0ff890 con 0x55de5d0ff440 2024-01-25T15:02:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f416e3d9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5d106f00 con 0x55de5d0fea50 2024-01-25T15:02:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f4169db2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d1045b0 0x55de5d1101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f4169db2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d1045b0 0x55de5d1101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53286/0 (socket says 172.21.15.170:53286) 2024-01-25T15:02:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f4169db2640 1 -- 172.21.15.170:0/1567390809 learned_addr learned my addr 172.21.15.170:0/1567390809 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f4168db0640 1 --2- 172.21.15.170:0/1567390809 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d0ff440 0x55de5d1091d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f4169db2640 1 -- 172.21.15.170:0/1567390809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0fea50 msgr2=0x55de5d108c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:26.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f4169db2640 1 --2- 172.21.15.170:0/1567390809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0fea50 0x55de5d108c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f4169db2640 1 -- 172.21.15.170:0/1567390809 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d0ff440 msgr2=0x55de5d1091d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:26.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f4169db2640 1 --2- 172.21.15.170:0/1567390809 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d0ff440 0x55de5d1091d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.662+0000 7f4169db2640 1 -- 172.21.15.170:0/1567390809 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de5d001520 con 0x55de5d1045b0 2024-01-25T15:02:26.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.663+0000 7f4169db2640 1 --2- 172.21.15.170:0/1567390809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d1045b0 0x55de5d1101d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f415c0098d0 tx=0x7f415c032d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f7e7d6b54f751e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:26.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.663+0000 7f414effd640 1 -- 172.21.15.170:0/1567390809 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c034440 con 0x55de5d1045b0 2024-01-25T15:02:26.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.663+0000 7f414effd640 1 -- 172.21.15.170:0/1567390809 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f415c004040 con 0x55de5d1045b0 2024-01-25T15:02:26.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.663+0000 7f414effd640 1 -- 172.21.15.170:0/1567390809 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c034c90 con 0x55de5d1045b0 2024-01-25T15:02:26.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.663+0000 7f416e3d9740 1 -- 172.21.15.170:0/1567390809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d1045b0 msgr2=0x55de5d1101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:26.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.663+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1567390809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d1045b0 0x55de5d1101d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f415c0098d0 tx=0x7f415c032d90 comp rx=0 tx=0).stop 2024-01-25T15:02:26.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.663+0000 7f416e3d9740 1 -- 172.21.15.170:0/1567390809 shutdown_connections 2024-01-25T15:02:26.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.663+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1567390809 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d0ff440 0x55de5d1091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.663+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1567390809 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d1045b0 0x55de5d1101d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.663+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1567390809 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0fea50 0x55de5d108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.663+0000 7f416e3d9740 1 -- 172.21.15.170:0/1567390809 >> 172.21.15.170:0/1567390809 conn(0x55de5d0f9fc0 msgr2=0x55de5d11bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:26.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.663+0000 7f416e3d9740 1 -- 172.21.15.170:0/1567390809 shutdown_connections 2024-01-25T15:02:26.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.663+0000 7f416e3d9740 1 -- 172.21.15.170:0/1567390809 wait complete. 2024-01-25T15:02:26.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.664+0000 7f416e3d9740 1 -- start start 2024-01-25T15:02:26.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.664+0000 7f416e3d9740 1 Processor -- start 2024-01-25T15:02:26.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.664+0000 7f416e3d9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d0fea50 0x55de5d10fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.664+0000 7f416e3d9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0ff440 0x55de5d110090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.664+0000 7f416e3d9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d1045b0 0x55de5d10e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.664+0000 7f416e3d9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5d10e810 con 0x55de5d1045b0 2024-01-25T15:02:26.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.664+0000 7f416e3d9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5d10e980 con 0x55de5d0fea50 2024-01-25T15:02:26.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.664+0000 7f416e3d9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5d10eb40 con 0x55de5d0ff440 2024-01-25T15:02:26.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.664+0000 7f416e3d9740 10 client.0 _ll_register_callbacks cb 0x7f4154005130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:26.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.664+0000 7f4169db2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d1045b0 0x55de5d10e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.679 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.664+0000 7f4169db2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d1045b0 0x55de5d10e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53296/0 (socket says 172.21.15.170:53296) 2024-01-25T15:02:26.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.664+0000 7f4169db2640 1 -- 172.21.15.170:0/1993552549 learned_addr learned my addr 172.21.15.170:0/1993552549 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:26.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.664+0000 7f41695b1640 1 --2- 172.21.15.170:0/1993552549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d0fea50 0x55de5d10fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.664+0000 7f4168db0640 1 --2- 172.21.15.170:0/1993552549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0ff440 0x55de5d110090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f4169db2640 1 -- 172.21.15.170:0/1993552549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0ff440 msgr2=0x55de5d110090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:26.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f4169db2640 1 --2- 172.21.15.170:0/1993552549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0ff440 0x55de5d110090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f4169db2640 1 -- 172.21.15.170:0/1993552549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d0fea50 msgr2=0x55de5d10fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:26.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f4169db2640 1 --2- 172.21.15.170:0/1993552549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d0fea50 0x55de5d10fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f4169db2640 1 -- 172.21.15.170:0/1993552549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415c050040 con 0x55de5d1045b0 2024-01-25T15:02:26.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f4168db0640 1 --2- 172.21.15.170:0/1993552549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0ff440 0x55de5d110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:26.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f4169db2640 1 --2- 172.21.15.170:0/1993552549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d1045b0 0x55de5d10e160 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f415c042040 tx=0x7f415c034550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3202bea3dc87637 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:26.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f414cff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:26.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f414cff9640 1 -- 172.21.15.170:0/1993552549 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415c004810 con 0x55de5d1045b0 2024-01-25T15:02:26.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f414cff9640 1 -- 172.21.15.170:0/1993552549 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f415c032790 con 0x55de5d1045b0 2024-01-25T15:02:26.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f416e3d9740 1 -- 172.21.15.170:0/1993552549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de5d08dc00 con 0x55de5d1045b0 2024-01-25T15:02:26.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f414cff9640 1 -- 172.21.15.170:0/1993552549 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f415c032950 con 0x55de5d1045b0 2024-01-25T15:02:26.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f416e3d9740 10 client.15543 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:26.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f416e3d9740 1 -- 172.21.15.170:0/1993552549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55de5d027070 con 0x55de5d1045b0 2024-01-25T15:02:26.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f414cff9640 1 -- 172.21.15.170:0/1993552549 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55de5d08dc00 con 0x55de5d1045b0 2024-01-25T15:02:26.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f414cff9640 1 -- 172.21.15.170:0/1993552549 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f415c053070 con 0x55de5d1045b0 2024-01-25T15:02:26.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f416e3d9740 10 client.15543 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:26.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f416e3d9740 10 client.15543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:26.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f416e3d9740 20 client.15543 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:26.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1993552549 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55de5d16c410 0x55de5d16e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f416e3d9740 4 client.15543 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-25T15:02:26.682 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.665+0000 7f416e3d9740 1 -- 172.21.15.170:0/1993552549 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55de5d05f220 con 0x55de5d16c410 2024-01-25T15:02:26.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f41695b1640 1 --2- 172.21.15.170:0/1993552549 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55de5d16c410 0x55de5d16e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f414cff9640 10 client.15543 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:26.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f41695b1640 1 --2- 172.21.15.170:0/1993552549 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55de5d16c410 0x55de5d16e800 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f366149b1811119b server_cookie=8277a2976eca9604 in_seq=0 out_seq=0 2024-01-25T15:02:26.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f414cff9640 1 -- 172.21.15.170:0/1993552549 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55de5d05f220 con 0x55de5d16c410 2024-01-25T15:02:26.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f414cff9640 10 client.15543 handle_command_reply: tid=0 2024-01-25T15:02:26.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f416e3d9740 1 client.15543 shutdown 2024-01-25T15:02:26.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f416e3d9740 1 -- 172.21.15.170:0/1993552549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d1045b0 msgr2=0x55de5d10e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:26.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1993552549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d1045b0 0x55de5d10e160 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f415c042040 tx=0x7f415c034550 comp rx=0 tx=0).stop 2024-01-25T15:02:26.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f416e3d9740 1 -- 172.21.15.170:0/1993552549 shutdown_connections 2024-01-25T15:02:26.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1993552549 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55de5d16c410 0x55de5d16e800 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1993552549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55de5d1045b0 0x55de5d10e160 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f414cff9640 0 client.15543 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:26.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1993552549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55de5d0ff440 0x55de5d110090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f416e3d9740 1 --2- 172.21.15.170:0/1993552549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55de5d0fea50 0x55de5d10fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.683 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f416e3d9740 1 -- 172.21.15.170:0/1993552549 >> 172.21.15.170:0/1993552549 conn(0x55de5d0f9fc0 msgr2=0x55de5d0fd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:26.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f416e3d9740 1 -- 172.21.15.170:0/1993552549 shutdown_connections 2024-01-25T15:02:26.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f416e3d9740 1 -- 172.21.15.170:0/1993552549 wait complete. 2024-01-25T15:02:26.684 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.666+0000 7f416e3d9740 20 client.15543 trim_cache size 0 max 16384 2024-01-25T15:02:26.684 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:02:26.685 INFO:teuthology.orchestra.run.smithi170.stdout: "status": "no active scrubs running", 2024-01-25T15:02:26.685 INFO:teuthology.orchestra.run.smithi170.stdout: "scrubs": {} 2024-01-25T15:02:26.685 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:02:26.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.667+0000 7f416b815640 1 -- 172.21.15.170:0/1696332755 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f41500a1370 msgr2=0x7f41500a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:26.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.667+0000 7f416b815640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f41500a1370 0x7f41500a3830 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f415c006010 tx=0x7f415c04c000 comp rx=0 tx=0).stop 2024-01-25T15:02:26.686 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.667+0000 7f416b815640 1 -- 172.21.15.170:0/1696332755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4164101fa0 msgr2=0x7f41641971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:26.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.667+0000 7f416b815640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4164101fa0 0x7f41641971b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f415400d950 tx=0x7f415400de10 comp rx=0 tx=0).stop 2024-01-25T15:02:26.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.667+0000 7f416b815640 1 -- 172.21.15.170:0/1696332755 shutdown_connections 2024-01-25T15:02:26.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.667+0000 7f416b815640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f41500a1370 0x7f41500a3830 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.667+0000 7f416b815640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4164102960 0x7f416419e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.667+0000 7f416b815640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4164101fa0 0x7f41641971b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.667+0000 7f416b815640 1 --2- 172.21.15.170:0/1696332755 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f41640fefd0 0x7f4164196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.667+0000 7f416b815640 1 -- 172.21.15.170:0/1696332755 >> 172.21.15.170:0/1696332755 conn(0x7f41640fa900 msgr2=0x7f41641052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:26.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.667+0000 7f416b815640 1 -- 172.21.15.170:0/1696332755 shutdown_connections 2024-01-25T15:02:26.687 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.667+0000 7f416b815640 1 -- 172.21.15.170:0/1696332755 wait complete. 2024-01-25T15:02:26.688 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-25T15:02:26.688 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:02:26.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.793+0000 7faa1726b640 1 -- 172.21.15.170:0/2229500169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa10106a30 msgr2=0x7faa10108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:26.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.793+0000 7faa1726b640 1 --2- 172.21.15.170:0/2229500169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa10106a30 0x7faa10108e40 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7faa08009ca0 tx=0x7faa0802c0f0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.793+0000 7faa1726b640 1 -- 172.21.15.170:0/2229500169 shutdown_connections 2024-01-25T15:02:26.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.793+0000 7faa1726b640 1 --2- 172.21.15.170:0/2229500169 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa10104100 0x7faa101064f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.793+0000 7faa1726b640 1 --2- 172.21.15.170:0/2229500169 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa10106a30 0x7faa10108e40 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.793+0000 7faa1726b640 1 --2- 172.21.15.170:0/2229500169 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa101017d0 0x7faa10103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.793+0000 7faa1726b640 1 -- 172.21.15.170:0/2229500169 >> 172.21.15.170:0/2229500169 conn(0x7faa100fb180 msgr2=0x7faa100fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:26.798 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.793+0000 7faa1726b640 1 -- 172.21.15.170:0/2229500169 shutdown_connections 2024-01-25T15:02:26.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.793+0000 7faa1726b640 1 -- 172.21.15.170:0/2229500169 wait complete. 2024-01-25T15:02:26.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.793+0000 7faa1726b640 1 Processor -- start 2024-01-25T15:02:26.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.793+0000 7faa1726b640 1 -- start start 2024-01-25T15:02:26.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa1726b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa101017d0 0x7faa10196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa1726b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa10104100 0x7faa101971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa1726b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa10106a30 0x7faa1019e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa1726b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1019e7b0 con 0x7faa10104100 2024-01-25T15:02:26.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa1726b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1019e920 con 0x7faa10106a30 2024-01-25T15:02:26.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa1726b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1019eae0 con 0x7faa101017d0 2024-01-25T15:02:26.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa14806640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa10104100 0x7faa101971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa14806640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa10104100 0x7faa101971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53312/0 (socket says 172.21.15.170:53312) 2024-01-25T15:02:26.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa14806640 1 -- 172.21.15.170:0/4268456170 learned_addr learned my addr 172.21.15.170:0/4268456170 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:26.799 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa15808640 1 --2- 172.21.15.170:0/4268456170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa10106a30 0x7faa1019e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa15007640 1 --2- 172.21.15.170:0/4268456170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa101017d0 0x7faa10196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa14806640 1 -- 172.21.15.170:0/4268456170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa101017d0 msgr2=0x7faa10196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:26.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa14806640 1 --2- 172.21.15.170:0/4268456170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa101017d0 0x7faa10196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa14806640 1 -- 172.21.15.170:0/4268456170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa10106a30 msgr2=0x7faa1019e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:26.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa14806640 1 --2- 172.21.15.170:0/4268456170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa10106a30 0x7faa1019e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:26.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa14806640 1 -- 172.21.15.170:0/4268456170 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa08009900 con 0x7faa10104100 2024-01-25T15:02:26.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa14806640 1 --2- 172.21.15.170:0/4268456170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa10104100 0x7faa101971e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7faa0000d770 tx=0x7faa0000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:26.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa067fc640 1 -- 172.21.15.170:0/4268456170 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00009c30 con 0x7faa10104100 2024-01-25T15:02:26.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa067fc640 1 -- 172.21.15.170:0/4268456170 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa0000de80 con 0x7faa10104100 2024-01-25T15:02:26.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa1726b640 1 -- 172.21.15.170:0/4268456170 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1019edc0 con 0x7faa10104100 2024-01-25T15:02:26.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa067fc640 1 -- 172.21.15.170:0/4268456170 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0000f620 con 0x7faa10104100 2024-01-25T15:02:26.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.794+0000 7faa1726b640 1 -- 172.21.15.170:0/4268456170 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1019f270 con 0x7faa10104100 2024-01-25T15:02:26.800 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.795+0000 7faa1726b640 1 -- 172.21.15.170:0/4268456170 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa100fcc70 con 0x7faa10104100 2024-01-25T15:02:26.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.796+0000 7faa067fc640 1 -- 172.21.15.170:0/4268456170 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7faa00005030 con 0x7faa10104100 2024-01-25T15:02:26.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.797+0000 7faa067fc640 1 --2- 172.21.15.170:0/4268456170 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa9fc0a1370 0x7fa9fc0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:26.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.797+0000 7faa15007640 1 --2- 172.21.15.170:0/4268456170 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa9fc0a1370 0x7fa9fc0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:26.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.797+0000 7faa067fc640 1 -- 172.21.15.170:0/4268456170 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7faa000cca30 con 0x7faa10104100 2024-01-25T15:02:26.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.798+0000 7faa15007640 1 --2- 172.21.15.170:0/4268456170 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa9fc0a1370 0x7fa9fc0a3830 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0058c0 tx=0x7faa0c00a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:26.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:26.801+0000 7faa067fc640 1 -- 172.21.15.170:0/4268456170 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7faa00095dd0 con 0x7faa10104100 2024-01-25T15:02:27.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.026+0000 7faa1726b640 1 -- 172.21.15.170:0/4268456170 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa1002cb80 con 0x7faa10104100 2024-01-25T15:02:27.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.026+0000 7faa067fc640 1 -- 172.21.15.170:0/4268456170 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11411 (secure 0 0 0) 0x7faa00021090 con 0x7faa10104100 2024-01-25T15:02:27.027 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:02:27.027 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-25T14:59:53.534085+0000","modified":"2024-01-25T15:01:49.253000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24484,"mds_1":24479,"mds_2":24466,"mds_3":24418,"mds_4":24398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":4,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24479":{"gid":24479,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/2132502182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":2132502182},{"type":"v1","addr":"172.21.15.186:6839","nonce":2132502182}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:02:27.028 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 26 2024-01-25T15:02:27.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.028+0000 7faa1726b640 1 -- 172.21.15.170:0/4268456170 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa9fc0a1370 msgr2=0x7fa9fc0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.028+0000 7faa1726b640 1 --2- 172.21.15.170:0/4268456170 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa9fc0a1370 0x7fa9fc0a3830 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0058c0 tx=0x7faa0c00a2d0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.028+0000 7faa1726b640 1 -- 172.21.15.170:0/4268456170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa10104100 msgr2=0x7faa101971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.028+0000 7faa1726b640 1 --2- 172.21.15.170:0/4268456170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa10104100 0x7faa101971e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7faa0000d770 tx=0x7faa0000dc30 comp rx=0 tx=0).stop 2024-01-25T15:02:27.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.029+0000 7faa1726b640 1 -- 172.21.15.170:0/4268456170 shutdown_connections 2024-01-25T15:02:27.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.029+0000 7faa1726b640 1 --2- 172.21.15.170:0/4268456170 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa9fc0a1370 0x7fa9fc0a3830 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.029+0000 7faa1726b640 1 --2- 172.21.15.170:0/4268456170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7faa10106a30 0x7faa1019e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.029+0000 7faa1726b640 1 --2- 172.21.15.170:0/4268456170 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7faa10104100 0x7faa101971e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.029+0000 7faa1726b640 1 --2- 172.21.15.170:0/4268456170 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7faa101017d0 0x7faa10196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.029+0000 7faa1726b640 1 -- 172.21.15.170:0/4268456170 >> 172.21.15.170:0/4268456170 conn(0x7faa100fb180 msgr2=0x7faa10102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.029+0000 7faa1726b640 1 -- 172.21.15.170:0/4268456170 shutdown_connections 2024-01-25T15:02:27.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.029+0000 7faa1726b640 1 -- 172.21.15.170:0/4268456170 wait complete. 2024-01-25T15:02:27.041 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-01-25T15:02:27.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.145+0000 7f4dad2bb640 1 -- 172.21.15.170:0/2280398760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4da81017d0 msgr2=0x7f4da8103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.145+0000 7f4dad2bb640 1 --2- 172.21.15.170:0/2280398760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4da81017d0 0x7f4da8103bc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009900 tx=0x7f4d9802bc30 comp rx=0 tx=0).stop 2024-01-25T15:02:27.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.145+0000 7f4dad2bb640 1 -- 172.21.15.170:0/2280398760 shutdown_connections 2024-01-25T15:02:27.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.145+0000 7f4dad2bb640 1 --2- 172.21.15.170:0/2280398760 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4da8104100 0x7f4da81064f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.145+0000 7f4dad2bb640 1 --2- 172.21.15.170:0/2280398760 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da8106a30 0x7f4da8108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.145+0000 7f4dad2bb640 1 --2- 172.21.15.170:0/2280398760 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4da81017d0 0x7f4da8103bc0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.145+0000 7f4dad2bb640 1 -- 172.21.15.170:0/2280398760 >> 172.21.15.170:0/2280398760 conn(0x7f4da80fb180 msgr2=0x7f4da80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.145+0000 7f4dad2bb640 1 -- 172.21.15.170:0/2280398760 shutdown_connections 2024-01-25T15:02:27.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.145+0000 7f4dad2bb640 1 -- 172.21.15.170:0/2280398760 wait complete. 2024-01-25T15:02:27.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.146+0000 7f4dad2bb640 1 Processor -- start 2024-01-25T15:02:27.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.146+0000 7f4dad2bb640 1 -- start start 2024-01-25T15:02:27.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.146+0000 7f4dad2bb640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da81017d0 0x7f4da8198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.146+0000 7f4dad2bb640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4da8104100 0x7f4da81994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.146+0000 7f4dad2bb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4da8106a30 0x7f4da81a0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.146+0000 7f4dad2bb640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da81a0a70 con 0x7f4da8106a30 2024-01-25T15:02:27.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.146+0000 7f4dad2bb640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da81a0be0 con 0x7f4da8104100 2024-01-25T15:02:27.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.146+0000 7f4dad2bb640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da81a0da0 con 0x7f4da81017d0 2024-01-25T15:02:27.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.146+0000 7f4da77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4da8106a30 0x7f4da81a0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.146+0000 7f4da77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4da8106a30 0x7f4da81a0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53324/0 (socket says 172.21.15.170:53324) 2024-01-25T15:02:27.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.146+0000 7f4da77fe640 1 -- 172.21.15.170:0/1108398535 learned_addr learned my addr 172.21.15.170:0/1108398535 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.147+0000 7f4da6ffd640 1 --2- 172.21.15.170:0/1108398535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da81017d0 0x7f4da8198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.147+0000 7f4da67fc640 1 --2- 172.21.15.170:0/1108398535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4da8104100 0x7f4da81994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.147+0000 7f4da77fe640 1 -- 172.21.15.170:0/1108398535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da81017d0 msgr2=0x7f4da8198f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.147+0000 7f4da77fe640 1 --2- 172.21.15.170:0/1108398535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da81017d0 0x7f4da8198f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.147+0000 7f4da77fe640 1 -- 172.21.15.170:0/1108398535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4da8104100 msgr2=0x7f4da81994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.147+0000 7f4da77fe640 1 --2- 172.21.15.170:0/1108398535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4da8104100 0x7f4da81994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.147+0000 7f4da77fe640 1 -- 172.21.15.170:0/1108398535 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d98009560 con 0x7f4da8106a30 2024-01-25T15:02:27.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.147+0000 7f4da77fe640 1 --2- 172.21.15.170:0/1108398535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4da8106a30 0x7f4da81a0530 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4da000eaa0 tx=0x7f4da000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.147+0000 7f4d8ffff640 1 -- 172.21.15.170:0/1108398535 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da000cdb0 con 0x7f4da8106a30 2024-01-25T15:02:27.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.147+0000 7f4d8ffff640 1 -- 172.21.15.170:0/1108398535 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4da0005020 con 0x7f4da8106a30 2024-01-25T15:02:27.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.147+0000 7f4d8ffff640 1 -- 172.21.15.170:0/1108398535 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da00116d0 con 0x7f4da8106a30 2024-01-25T15:02:27.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.147+0000 7f4dad2bb640 1 -- 172.21.15.170:0/1108398535 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da81a1080 con 0x7f4da8106a30 2024-01-25T15:02:27.151 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.147+0000 7f4dad2bb640 1 -- 172.21.15.170:0/1108398535 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da81a15e0 con 0x7f4da8106a30 2024-01-25T15:02:27.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.150+0000 7f4d8ffff640 1 -- 172.21.15.170:0/1108398535 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f4da0005190 con 0x7f4da8106a30 2024-01-25T15:02:27.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.150+0000 7f4dafe7e740 1 Processor -- start 2024-01-25T15:02:27.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.150+0000 7f4dafe7e740 1 -- start start 2024-01-25T15:02:27.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.150+0000 7f4dafe7e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb2f40 0x55df08eb3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.150+0000 7f4dafe7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb3930 0x55df08eb8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.150+0000 7f4dafe7e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb8aa0 0x55df08ebaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.150+0000 7f4dafe7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df08e21270 con 0x55df08eb3930 2024-01-25T15:02:27.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.150+0000 7f4dafe7e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df08e1e960 con 0x55df08eb8aa0 2024-01-25T15:02:27.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.150+0000 7f4dafe7e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df08e1a250 con 0x55df08eb2f40 2024-01-25T15:02:27.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4da6ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb3930 0x55df08eb8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4da6ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb3930 0x55df08eb8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53338/0 (socket says 172.21.15.170:53338) 2024-01-25T15:02:27.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4da6ffd640 1 -- 172.21.15.170:0/3975839395 learned_addr learned my addr 172.21.15.170:0/3975839395 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4d8ffff640 1 --2- 172.21.15.170:0/1108398535 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d900a13f0 0x7f4d900a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4da67fc640 1 --2- 172.21.15.170:0/3975839395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb8aa0 0x55df08ebaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4da67fc640 1 --2- 172.21.15.170:0/3975839395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb2f40 0x55df08eb3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4da77fe640 1 --2- 172.21.15.170:0/1108398535 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d900a13f0 0x7f4d900a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4da6ffd640 1 -- 172.21.15.170:0/3975839395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb2f40 msgr2=0x55df08eb3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4da6ffd640 1 --2- 172.21.15.170:0/3975839395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb2f40 0x55df08eb3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4da6ffd640 1 -- 172.21.15.170:0/3975839395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb8aa0 msgr2=0x55df08ebaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4da6ffd640 1 --2- 172.21.15.170:0/3975839395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb8aa0 0x55df08ebaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4da6ffd640 1 -- 172.21.15.170:0/3975839395 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df08ddc7f0 con 0x55df08eb3930 2024-01-25T15:02:27.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4d8ffff640 1 -- 172.21.15.170:0/1108398535 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f4da00cceb0 con 0x7f4da8106a30 2024-01-25T15:02:27.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4da6ffd640 1 --2- 172.21.15.170:0/3975839395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb3930 0x55df08eb8430 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4d98036040 tx=0x7f4d98004e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b41abf71c2d06a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4d8d7fa640 1 -- 172.21.15.170:0/3975839395 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9802cbc0 con 0x55df08eb3930 2024-01-25T15:02:27.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4da77fe640 1 --2- 172.21.15.170:0/1108398535 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d900a13f0 0x7f4d900a38b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4da00a1d20 tx=0x7f4da0000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4d8d7fa640 1 -- 172.21.15.170:0/3975839395 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d98004040 con 0x55df08eb3930 2024-01-25T15:02:27.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.151+0000 7f4d8d7fa640 1 -- 172.21.15.170:0/3975839395 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d98005560 con 0x55df08eb3930 2024-01-25T15:02:27.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.152+0000 7f4dafe7e740 1 -- 172.21.15.170:0/3975839395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb3930 msgr2=0x55df08eb8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.152+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/3975839395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb3930 0x55df08eb8430 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f4d98036040 tx=0x7f4d98004e80 comp rx=0 tx=0).stop 2024-01-25T15:02:27.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.152+0000 7f4dafe7e740 1 -- 172.21.15.170:0/3975839395 shutdown_connections 2024-01-25T15:02:27.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.152+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/3975839395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb8aa0 0x55df08ebaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.152+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/3975839395 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb3930 0x55df08eb8430 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.152+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/3975839395 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb2f40 0x55df08eb3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.152+0000 7f4dafe7e740 1 -- 172.21.15.170:0/3975839395 >> 172.21.15.170:0/3975839395 conn(0x55df08eae4b0 msgr2=0x55df08eae8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.152+0000 7f4dafe7e740 1 -- 172.21.15.170:0/3975839395 shutdown_connections 2024-01-25T15:02:27.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.152+0000 7f4dafe7e740 1 -- 172.21.15.170:0/3975839395 wait complete. 2024-01-25T15:02:27.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.152+0000 7f4dafe7e740 1 -- start start 2024-01-25T15:02:27.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.152+0000 7f4dafe7e740 1 Processor -- start 2024-01-25T15:02:27.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4dafe7e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb2f40 0x55df08ebd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4dafe7e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb3930 0x55df08ebd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4dafe7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4dafe7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df08dd3610 con 0x55df08eb8aa0 2024-01-25T15:02:27.160 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4dafe7e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df08dd32b0 con 0x55df08eb2f40 2024-01-25T15:02:27.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4dafe7e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df08d98400 con 0x55df08eb3930 2024-01-25T15:02:27.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4dafe7e740 10 client.0 _ll_register_callbacks cb 0x55df08e10ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:27.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4da67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4da67fc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb2f40 0x55df08ebd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4da67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53344/0 (socket says 172.21.15.170:53344) 2024-01-25T15:02:27.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4da67fc640 1 -- 172.21.15.170:0/2072312763 learned_addr learned my addr 172.21.15.170:0/2072312763 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4da6ffd640 1 --2- 172.21.15.170:0/2072312763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb3930 0x55df08ebd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4da67fc640 1 -- 172.21.15.170:0/2072312763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb3930 msgr2=0x55df08ebd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4da67fc640 1 --2- 172.21.15.170:0/2072312763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb3930 0x55df08ebd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4da67fc640 1 -- 172.21.15.170:0/2072312763 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb2f40 msgr2=0x55df08ebd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4da67fc640 1 --2- 172.21.15.170:0/2072312763 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb2f40 0x55df08ebd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4da67fc640 1 -- 172.21.15.170:0/2072312763 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da8109a00 con 0x55df08eb8aa0 2024-01-25T15:02:27.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4da67fc640 1 --2- 172.21.15.170:0/2072312763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec4620 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4da8068950 tx=0x7f4d9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b48c0319d6288b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4d8aff5640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:27.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4d8aff5640 1 -- 172.21.15.170:0/2072312763 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c012320 con 0x55df08eb8aa0 2024-01-25T15:02:27.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4d8aff5640 1 -- 172.21.15.170:0/2072312763 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f4d9c004020 con 0x55df08eb8aa0 2024-01-25T15:02:27.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.153+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2072312763 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55df08e130e0 con 0x55df08eb8aa0 2024-01-25T15:02:27.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.154+0000 7f4d8aff5640 1 -- 172.21.15.170:0/2072312763 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d9c0041e0 con 0x55df08eb8aa0 2024-01-25T15:02:27.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.154+0000 7f4dafe7e740 10 client.15561 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:27.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.154+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2072312763 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55df08e188d0 con 0x55df08eb8aa0 2024-01-25T15:02:27.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.154+0000 7f4d8aff5640 1 -- 172.21.15.170:0/2072312763 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55df08e130e0 con 0x55df08eb8aa0 2024-01-25T15:02:27.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.154+0000 7f4d8aff5640 1 -- 172.21.15.170:0/2072312763 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4d9c011440 con 0x55df08eb8aa0 2024-01-25T15:02:27.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.154+0000 7f4dafe7e740 10 client.15561 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:27.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.154+0000 7f4dafe7e740 10 client.15561 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-01-25T15:02:27.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.154+0000 7f4dafe7e740 20 client.15561 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:27.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.154+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/2072312763 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55df08ec8f20 0x55df08ecb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.154+0000 7f4dafe7e740 4 client.15561 mds_command: new command op to 24398 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:02:27.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.154+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2072312763 --> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df08e12e00 con 0x55df08ec8f20 2024-01-25T15:02:27.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.154+0000 7f4da6ffd640 1 --2- 172.21.15.170:0/2072312763 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55df08ec8f20 0x55df08ecb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.155+0000 7f4da6ffd640 1 --2- 172.21.15.170:0/2072312763 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55df08ec8f20 0x55df08ecb360 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=41e0d8a019d9c86c server_cookie=73ef56877c7818d5 in_seq=0 out_seq=0 2024-01-25T15:02:27.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.155+0000 7f4d8aff5640 10 client.15561 ms_handle_connect on v2:172.21.15.186:6832/1347511259 2024-01-25T15:02:27.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.156+0000 7f4d8aff5640 1 -- 172.21.15.170:0/2072312763 <== mds.4 v2:172.21.15.186:6832/1347511259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55df08e12e00 con 0x55df08ec8f20 2024-01-25T15:02:27.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.156+0000 7f4d8aff5640 10 client.15561 handle_command_reply: tid=0 2024-01-25T15:02:27.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.156+0000 7f4dafe7e740 1 client.15561 shutdown 2024-01-25T15:02:27.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.156+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2072312763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 msgr2=0x55df08ec4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.156+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/2072312763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec4620 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4da8068950 tx=0x7f4d9c0046c0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.156+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2072312763 shutdown_connections 2024-01-25T15:02:27.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.156+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/2072312763 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55df08ec8f20 0x55df08ecb360 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.156+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/2072312763 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec4620 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.156+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/2072312763 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb3930 0x55df08ebd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.156+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/2072312763 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb2f40 0x55df08ebd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.156+0000 7f4d8aff5640 0 client.15561 ms_handle_reset on v2:172.21.15.186:6832/1347511259 2024-01-25T15:02:27.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.156+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2072312763 >> 172.21.15.170:0/2072312763 conn(0x55df08eae4b0 msgr2=0x55df08ead7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.156+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2072312763 shutdown_connections 2024-01-25T15:02:27.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.156+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2072312763 wait complete. 2024-01-25T15:02:27.164 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.156+0000 7f4dafe7e740 20 client.15561 trim_cache size 0 max 16384 2024-01-25T15:02:27.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4dafe7e740 1 Processor -- start 2024-01-25T15:02:27.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4dafe7e740 1 -- start start 2024-01-25T15:02:27.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4dafe7e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb2f40 0x55df08ebd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4dafe7e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb3930 0x55df08ebd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4dafe7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4dafe7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df08e12e00 con 0x55df08eb8aa0 2024-01-25T15:02:27.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4dafe7e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df08e130e0 con 0x55df08eb3930 2024-01-25T15:02:27.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4dafe7e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df08ebe290 con 0x55df08eb2f40 2024-01-25T15:02:27.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4da67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4da67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53358/0 (socket says 172.21.15.170:53358) 2024-01-25T15:02:27.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4da67fc640 1 -- 172.21.15.170:0/852594012 learned_addr learned my addr 172.21.15.170:0/852594012 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4da6ffd640 1 --2- 172.21.15.170:0/852594012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb3930 0x55df08ebd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4da67fc640 1 -- 172.21.15.170:0/852594012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb2f40 msgr2=0x55df08ebd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4da67fc640 1 --2- 172.21.15.170:0/852594012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb2f40 0x55df08ebd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4da67fc640 1 -- 172.21.15.170:0/852594012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb3930 msgr2=0x55df08ebd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4da67fc640 1 --2- 172.21.15.170:0/852594012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb3930 0x55df08ebd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4da67fc640 1 -- 172.21.15.170:0/852594012 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df08db5500 con 0x55df08eb8aa0 2024-01-25T15:02:27.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4da67fc640 1 --2- 172.21.15.170:0/852594012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec45e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0118a0 tx=0x7f4d9c012f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b73e1493bfced3 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.168+0000 7f4d8cff9640 1 -- 172.21.15.170:0/852594012 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c00eb30 con 0x55df08eb8aa0 2024-01-25T15:02:27.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.169+0000 7f4d8cff9640 1 -- 172.21.15.170:0/852594012 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d9c019030 con 0x55df08eb8aa0 2024-01-25T15:02:27.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.169+0000 7f4d8cff9640 1 -- 172.21.15.170:0/852594012 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c0053b0 con 0x55df08eb8aa0 2024-01-25T15:02:27.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.169+0000 7f4dafe7e740 1 -- 172.21.15.170:0/852594012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 msgr2=0x55df08ec45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.169+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/852594012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec45e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0118a0 tx=0x7f4d9c012f50 comp rx=0 tx=0).stop 2024-01-25T15:02:27.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.169+0000 7f4dafe7e740 1 -- 172.21.15.170:0/852594012 shutdown_connections 2024-01-25T15:02:27.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.169+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/852594012 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb3930 0x55df08ebd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.169+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/852594012 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec45e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.169+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/852594012 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb2f40 0x55df08ebd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.169+0000 7f4dafe7e740 1 -- 172.21.15.170:0/852594012 >> 172.21.15.170:0/852594012 conn(0x55df08eae4b0 msgr2=0x55df08ea9680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.169+0000 7f4dafe7e740 1 -- 172.21.15.170:0/852594012 shutdown_connections 2024-01-25T15:02:27.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.169+0000 7f4dafe7e740 1 -- 172.21.15.170:0/852594012 wait complete. 2024-01-25T15:02:27.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.169+0000 7f4dafe7e740 1 -- start start 2024-01-25T15:02:27.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4dafe7e740 1 Processor -- start 2024-01-25T15:02:27.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4dafe7e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb2f40 0x55df08ec30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4dafe7e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb3930 0x55df08ec3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4dafe7e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4dafe7e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df08f1f540 con 0x55df08eb8aa0 2024-01-25T15:02:27.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4dafe7e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df08f1f6b0 con 0x55df08eb3930 2024-01-25T15:02:27.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4dafe7e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df08f1f870 con 0x55df08eb2f40 2024-01-25T15:02:27.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4dafe7e740 10 client.0 _ll_register_callbacks cb 0x7f4d98009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:27.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4da67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4da67fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53374/0 (socket says 172.21.15.170:53374) 2024-01-25T15:02:27.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4da67fc640 1 -- 172.21.15.170:0/2874123679 learned_addr learned my addr 172.21.15.170:0/2874123679 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4da6ffd640 1 --2- 172.21.15.170:0/2874123679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb3930 0x55df08ec3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4da67fc640 1 --2- 172.21.15.170:0/2874123679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb2f40 0x55df08ec30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4da67fc640 1 -- 172.21.15.170:0/2874123679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb2f40 msgr2=0x55df08ec30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4da67fc640 1 --2- 172.21.15.170:0/2874123679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb2f40 0x55df08ec30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4da67fc640 1 -- 172.21.15.170:0/2874123679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb3930 msgr2=0x55df08ec3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4da67fc640 1 --2- 172.21.15.170:0/2874123679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb3930 0x55df08ec3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4da67fc640 1 -- 172.21.15.170:0/2874123679 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df08e188d0 con 0x55df08eb8aa0 2024-01-25T15:02:27.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4da67fc640 1 --2- 172.21.15.170:0/2874123679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec3b40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c010410 tx=0x7f4d9c00e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce1ddfacde4fe4 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4d8aff5640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:27.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.170+0000 7f4d8aff5640 1 -- 172.21.15.170:0/2874123679 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c005130 con 0x55df08eb8aa0 2024-01-25T15:02:27.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.171+0000 7f4d8aff5640 1 -- 172.21.15.170:0/2874123679 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f4d9c000e40 con 0x55df08eb8aa0 2024-01-25T15:02:27.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.171+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2874123679 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d98004040 con 0x55df08eb8aa0 2024-01-25T15:02:27.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.171+0000 7f4d8aff5640 1 -- 172.21.15.170:0/2874123679 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d9c005290 con 0x55df08eb8aa0 2024-01-25T15:02:27.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.171+0000 7f4dafe7e740 10 client.15567 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:27.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.171+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2874123679 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55df08ddb050 con 0x55df08eb8aa0 2024-01-25T15:02:27.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.171+0000 7f4d8aff5640 1 -- 172.21.15.170:0/2874123679 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d98004040 con 0x55df08eb8aa0 2024-01-25T15:02:27.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.171+0000 7f4d8aff5640 1 -- 172.21.15.170:0/2874123679 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4d9c02b430 con 0x55df08eb8aa0 2024-01-25T15:02:27.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.171+0000 7f4dafe7e740 10 client.15567 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:27.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.171+0000 7f4dafe7e740 10 client.15567 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-01-25T15:02:27.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.171+0000 7f4dafe7e740 20 client.15567 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:27.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.171+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/2874123679 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55df08f20de0 0x55df08f23200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.171+0000 7f4dafe7e740 4 client.15567 mds_command: new command op to 24398 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:02:27.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.171+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2874123679 --> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55df08b197e0 con 0x55df08f20de0 2024-01-25T15:02:27.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.171+0000 7f4da6ffd640 1 --2- 172.21.15.170:0/2874123679 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55df08f20de0 0x55df08f23200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4da6ffd640 1 --2- 172.21.15.170:0/2874123679 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55df08f20de0 0x55df08f23200 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=665795ade6eaff85 server_cookie=8844f099ab0e7031 in_seq=0 out_seq=0 2024-01-25T15:02:27.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4d8aff5640 10 client.15567 ms_handle_connect on v2:172.21.15.186:6832/1347511259 2024-01-25T15:02:27.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4d8aff5640 1 -- 172.21.15.170:0/2874123679 <== mds.4 v2:172.21.15.186:6832/1347511259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55df08b197e0 con 0x55df08f20de0 2024-01-25T15:02:27.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4d8aff5640 10 client.15567 handle_command_reply: tid=0 2024-01-25T15:02:27.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4dafe7e740 1 client.15567 shutdown 2024-01-25T15:02:27.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2874123679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 msgr2=0x55df08ec3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/2874123679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec3b40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c010410 tx=0x7f4d9c00e7f0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2874123679 shutdown_connections 2024-01-25T15:02:27.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/2874123679 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55df08eb3930 0x55df08ec3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/2874123679 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55df08f20de0 0x55df08f23200 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/2874123679 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55df08eb8aa0 0x55df08ec3b40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4dafe7e740 1 --2- 172.21.15.170:0/2874123679 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55df08eb2f40 0x55df08ec30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4d8aff5640 0 client.15567 ms_handle_reset on v2:172.21.15.186:6832/1347511259 2024-01-25T15:02:27.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2874123679 >> 172.21.15.170:0/2874123679 conn(0x55df08eae4b0 msgr2=0x55df08eb4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2874123679 shutdown_connections 2024-01-25T15:02:27.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4dafe7e740 1 -- 172.21.15.170:0/2874123679 wait complete. 2024-01-25T15:02:27.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.172+0000 7f4dafe7e740 20 client.15567 trim_cache size 0 max 16384 2024-01-25T15:02:27.180 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:02:27.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.173+0000 7f4dad2bb640 1 -- 172.21.15.170:0/1108398535 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d900a13f0 msgr2=0x7f4d900a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.173+0000 7f4dad2bb640 1 --2- 172.21.15.170:0/1108398535 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d900a13f0 0x7f4d900a38b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4da00a1d20 tx=0x7f4da0000f40 comp rx=0 tx=0).stop 2024-01-25T15:02:27.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.173+0000 7f4dad2bb640 1 -- 172.21.15.170:0/1108398535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4da8106a30 msgr2=0x7f4da81a0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.173+0000 7f4dad2bb640 1 --2- 172.21.15.170:0/1108398535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4da8106a30 0x7f4da81a0530 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4da000eaa0 tx=0x7f4da000ef60 comp rx=0 tx=0).stop 2024-01-25T15:02:27.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.173+0000 7f4dad2bb640 1 -- 172.21.15.170:0/1108398535 shutdown_connections 2024-01-25T15:02:27.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.173+0000 7f4dad2bb640 1 --2- 172.21.15.170:0/1108398535 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f4d900a13f0 0x7f4d900a38b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.173+0000 7f4dad2bb640 1 --2- 172.21.15.170:0/1108398535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4da8104100 0x7f4da81994c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.173+0000 7f4dad2bb640 1 --2- 172.21.15.170:0/1108398535 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f4da8106a30 0x7f4da81a0530 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.173+0000 7f4dad2bb640 1 --2- 172.21.15.170:0/1108398535 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f4da81017d0 0x7f4da8198f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.173+0000 7f4dad2bb640 1 -- 172.21.15.170:0/1108398535 >> 172.21.15.170:0/1108398535 conn(0x7f4da80fb180 msgr2=0x7f4da8101090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.173+0000 7f4dad2bb640 1 -- 172.21.15.170:0/1108398535 shutdown_connections 2024-01-25T15:02:27.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.173+0000 7f4dad2bb640 1 -- 172.21.15.170:0/1108398535 wait complete. 2024-01-25T15:02:27.185 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-01-25T15:02:27.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.295+0000 7fb46b91d640 1 -- 172.21.15.170:0/1689006985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4640ffbf0 msgr2=0x7fb464100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.295+0000 7fb46b91d640 1 --2- 172.21.15.170:0/1689006985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4640ffbf0 0x7fb464100010 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb460009900 tx=0x7fb46002bc30 comp rx=0 tx=0).stop 2024-01-25T15:02:27.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.295+0000 7fb46b91d640 1 -- 172.21.15.170:0/1689006985 shutdown_connections 2024-01-25T15:02:27.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.295+0000 7fb46b91d640 1 --2- 172.21.15.170:0/1689006985 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4641017a0 0x7fb464108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.295+0000 7fb46b91d640 1 --2- 172.21.15.170:0/1689006985 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb464100de0 0x7fb464101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.295+0000 7fb46b91d640 1 --2- 172.21.15.170:0/1689006985 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb4640ffbf0 0x7fb464100010 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.296+0000 7fb46b91d640 1 -- 172.21.15.170:0/1689006985 >> 172.21.15.170:0/1689006985 conn(0x7fb4640fb180 msgr2=0x7fb4640fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.296+0000 7fb46b91d640 1 -- 172.21.15.170:0/1689006985 shutdown_connections 2024-01-25T15:02:27.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.296+0000 7fb46b91d640 1 -- 172.21.15.170:0/1689006985 wait complete. 2024-01-25T15:02:27.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.296+0000 7fb46b91d640 1 Processor -- start 2024-01-25T15:02:27.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.296+0000 7fb46b91d640 1 -- start start 2024-01-25T15:02:27.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.296+0000 7fb46b91d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4640ffbf0 0x7fb464195c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.296+0000 7fb46b91d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb464100de0 0x7fb464196170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.296+0000 7fb46b91d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4641017a0 0x7fb46419d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.296+0000 7fb46b91d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46419d710 con 0x7fb464100de0 2024-01-25T15:02:27.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.296+0000 7fb46b91d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46419d880 con 0x7fb4640ffbf0 2024-01-25T15:02:27.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.296+0000 7fb46b91d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46419da40 con 0x7fb4641017a0 2024-01-25T15:02:27.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb468eb8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb464100de0 0x7fb464196170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb468eb8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb464100de0 0x7fb464196170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53386/0 (socket says 172.21.15.170:53386) 2024-01-25T15:02:27.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb468eb8640 1 -- 172.21.15.170:0/2722402534 learned_addr learned my addr 172.21.15.170:0/2722402534 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb469eba640 1 --2- 172.21.15.170:0/2722402534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4641017a0 0x7fb46419d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb4696b9640 1 --2- 172.21.15.170:0/2722402534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4640ffbf0 0x7fb464195c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb468eb8640 1 -- 172.21.15.170:0/2722402534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4641017a0 msgr2=0x7fb46419d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb468eb8640 1 --2- 172.21.15.170:0/2722402534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4641017a0 0x7fb46419d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb468eb8640 1 -- 172.21.15.170:0/2722402534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4640ffbf0 msgr2=0x7fb464195c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb468eb8640 1 --2- 172.21.15.170:0/2722402534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4640ffbf0 0x7fb464195c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb468eb8640 1 -- 172.21.15.170:0/2722402534 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb460009560 con 0x7fb464100de0 2024-01-25T15:02:27.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb468eb8640 1 --2- 172.21.15.170:0/2722402534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb464100de0 0x7fb464196170 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb45400d950 tx=0x7fb45400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb45a7fc640 1 -- 172.21.15.170:0/2722402534 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454009a30 con 0x7fb464100de0 2024-01-25T15:02:27.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb45a7fc640 1 -- 172.21.15.170:0/2722402534 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb454009b90 con 0x7fb464100de0 2024-01-25T15:02:27.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb46b91d640 1 -- 172.21.15.170:0/2722402534 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46419dd20 con 0x7fb464100de0 2024-01-25T15:02:27.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb45a7fc640 1 -- 172.21.15.170:0/2722402534 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4540047a0 con 0x7fb464100de0 2024-01-25T15:02:27.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.297+0000 7fb46b91d640 1 -- 172.21.15.170:0/2722402534 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46419e1b0 con 0x7fb464100de0 2024-01-25T15:02:27.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.300+0000 7fb46e5b6740 1 Processor -- start 2024-01-25T15:02:27.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.300+0000 7fb46e5b6740 1 -- start start 2024-01-25T15:02:27.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.300+0000 7fb46e5b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d7a940 0x5570d6d79090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.300+0000 7fb46e5b6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d795d0 0x5570d6d79a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.300+0000 7fb46e5b6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d88200 0x5570d6d8a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.300+0000 7fb46e5b6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570d6cec270 con 0x5570d6d88200 2024-01-25T15:02:27.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.300+0000 7fb46e5b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570d6ce9960 con 0x5570d6d7a940 2024-01-25T15:02:27.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.300+0000 7fb46e5b6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570d6ce5250 con 0x5570d6d795d0 2024-01-25T15:02:27.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.300+0000 7fb45a7fc640 1 -- 172.21.15.170:0/2722402534 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fb454009d00 con 0x7fb464100de0 2024-01-25T15:02:27.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb469eba640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d7a940 0x5570d6d79090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb469eba640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d7a940 0x5570d6d79090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:37766/0 (socket says 172.21.15.170:37766) 2024-01-25T15:02:27.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb469eba640 1 -- 172.21.15.170:0/1955051978 learned_addr learned my addr 172.21.15.170:0/1955051978 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb4696b9640 1 --2- 172.21.15.170:0/1955051978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d795d0 0x5570d6d79a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb468eb8640 1 --2- 172.21.15.170:0/1955051978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d88200 0x5570d6d8a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb469eba640 1 -- 172.21.15.170:0/1955051978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d795d0 msgr2=0x5570d6d79a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb469eba640 1 --2- 172.21.15.170:0/1955051978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d795d0 0x5570d6d79a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb469eba640 1 -- 172.21.15.170:0/1955051978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d88200 msgr2=0x5570d6d8a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb469eba640 1 --2- 172.21.15.170:0/1955051978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d88200 0x5570d6d8a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb469eba640 1 -- 172.21.15.170:0/1955051978 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570d6ca77f0 con 0x5570d6d7a940 2024-01-25T15:02:27.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb468eb8640 1 --2- 172.21.15.170:0/1955051978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d88200 0x5570d6d8a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:27.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb469eba640 1 --2- 172.21.15.170:0/1955051978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d7a940 0x5570d6d79090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009f70 tx=0x7fb45c010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4aa50919875e0109 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb45a7fc640 1 --2- 172.21.15.170:0/2722402534 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb4500a1370 0x7fb4500a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb4696b9640 1 --2- 172.21.15.170:0/2722402534 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb4500a1370 0x7fb4500a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb45a7fc640 1 -- 172.21.15.170:0/2722402534 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fb4540cc7a0 con 0x7fb464100de0 2024-01-25T15:02:27.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.301+0000 7fb44f7fe640 1 -- 172.21.15.170:0/1955051978 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c004d20 con 0x5570d6d7a940 2024-01-25T15:02:27.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.302+0000 7fb44f7fe640 1 -- 172.21.15.170:0/1955051978 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb45c004e80 con 0x5570d6d7a940 2024-01-25T15:02:27.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.302+0000 7fb44f7fe640 1 -- 172.21.15.170:0/1955051978 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c012910 con 0x5570d6d7a940 2024-01-25T15:02:27.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.302+0000 7fb46e5b6740 1 -- 172.21.15.170:0/1955051978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d7a940 msgr2=0x5570d6d79090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.302+0000 7fb4696b9640 1 --2- 172.21.15.170:0/2722402534 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb4500a1370 0x7fb4500a3830 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb460000c00 tx=0x7fb46002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.302+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/1955051978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d7a940 0x5570d6d79090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009f70 tx=0x7fb45c010800 comp rx=0 tx=0).stop 2024-01-25T15:02:27.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.303+0000 7fb46e5b6740 1 -- 172.21.15.170:0/1955051978 shutdown_connections 2024-01-25T15:02:27.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.303+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/1955051978 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d88200 0x5570d6d8a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.303+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/1955051978 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d795d0 0x5570d6d79a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.303+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/1955051978 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d7a940 0x5570d6d79090 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.303+0000 7fb46e5b6740 1 -- 172.21.15.170:0/1955051978 >> 172.21.15.170:0/1955051978 conn(0x5570d6d7b6c0 msgr2=0x5570d6d7bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.303+0000 7fb46e5b6740 1 -- 172.21.15.170:0/1955051978 shutdown_connections 2024-01-25T15:02:27.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.303+0000 7fb46e5b6740 1 -- 172.21.15.170:0/1955051978 wait complete. 2024-01-25T15:02:27.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.303+0000 7fb46e5b6740 1 -- start start 2024-01-25T15:02:27.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.303+0000 7fb46e5b6740 1 Processor -- start 2024-01-25T15:02:27.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb46e5b6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d795d0 0x5570d6d8c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb46e5b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d7a940 0x5570d6d8caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb46e5b6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d88200 0x5570d6d93ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb46e5b6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570d6c9e610 con 0x5570d6d795d0 2024-01-25T15:02:27.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb46e5b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570d6c9e2b0 con 0x5570d6d7a940 2024-01-25T15:02:27.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb46e5b6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570d6c63400 con 0x5570d6d88200 2024-01-25T15:02:27.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb46e5b6740 10 client.0 _ll_register_callbacks cb 0x5570d6cdbee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:27.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb4696b9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d795d0 0x5570d6d8c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb4696b9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d795d0 0x5570d6d8c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53406/0 (socket says 172.21.15.170:53406) 2024-01-25T15:02:27.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb4696b9640 1 -- 172.21.15.170:0/453323233 learned_addr learned my addr 172.21.15.170:0/453323233 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb468eb8640 1 --2- 172.21.15.170:0/453323233 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d7a940 0x5570d6d8caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb469eba640 1 --2- 172.21.15.170:0/453323233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d88200 0x5570d6d93ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb4696b9640 1 -- 172.21.15.170:0/453323233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d88200 msgr2=0x5570d6d93ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb4696b9640 1 --2- 172.21.15.170:0/453323233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d88200 0x5570d6d93ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb4696b9640 1 -- 172.21.15.170:0/453323233 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d7a940 msgr2=0x5570d6d8caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb4696b9640 1 --2- 172.21.15.170:0/453323233 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d7a940 0x5570d6d8caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb4696b9640 1 -- 172.21.15.170:0/453323233 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c009bd0 con 0x5570d6d795d0 2024-01-25T15:02:27.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb469eba640 1 --2- 172.21.15.170:0/453323233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d88200 0x5570d6d93ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:27.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb4696b9640 1 --2- 172.21.15.170:0/453323233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d795d0 0x5570d6d8c560 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb460005ab0 tx=0x7fb460009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7966e5eebf6988dc server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb44cff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:27.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb44cff9640 1 -- 172.21.15.170:0/453323233 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4600054d0 con 0x5570d6d795d0 2024-01-25T15:02:27.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb44cff9640 1 -- 172.21.15.170:0/453323233 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fb460005630 con 0x5570d6d795d0 2024-01-25T15:02:27.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.304+0000 7fb46e5b6740 1 -- 172.21.15.170:0/453323233 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570d6cdde00 con 0x5570d6d795d0 2024-01-25T15:02:27.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.305+0000 7fb44cff9640 1 -- 172.21.15.170:0/453323233 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4600042c0 con 0x5570d6d795d0 2024-01-25T15:02:27.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.305+0000 7fb46e5b6740 10 client.15579 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:27.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.305+0000 7fb46e5b6740 1 -- 172.21.15.170:0/453323233 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5570d6ce38d0 con 0x5570d6d795d0 2024-01-25T15:02:27.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.305+0000 7fb44cff9640 1 -- 172.21.15.170:0/453323233 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5570d6cdde00 con 0x5570d6d795d0 2024-01-25T15:02:27.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.305+0000 7fb44cff9640 1 -- 172.21.15.170:0/453323233 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb46005e050 con 0x5570d6d795d0 2024-01-25T15:02:27.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.305+0000 7fb46e5b6740 10 client.15579 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:27.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.305+0000 7fb46e5b6740 10 client.15579 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-01-25T15:02:27.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.305+0000 7fb46e5b6740 20 client.15579 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:27.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.305+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/453323233 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5570d6d98470 0x5570d6d9a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.305+0000 7fb46e5b6740 4 client.15579 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:02:27.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.305+0000 7fb46e5b6740 1 -- 172.21.15.170:0/453323233 --> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5570d69e47e0 con 0x5570d6d98470 2024-01-25T15:02:27.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.305+0000 7fb468eb8640 1 --2- 172.21.15.170:0/453323233 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5570d6d98470 0x5570d6d9a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.306+0000 7fb44cff9640 10 client.15579 ms_handle_connect on v2:172.21.15.191:6832/274874056 2024-01-25T15:02:27.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.306+0000 7fb468eb8640 1 --2- 172.21.15.170:0/453323233 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5570d6d98470 0x5570d6d9a860 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=69e869218afc3d10 server_cookie=aa3b78a723f11114 in_seq=0 out_seq=0 2024-01-25T15:02:27.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.306+0000 7fb44cff9640 1 -- 172.21.15.170:0/453323233 <== mds.3 v2:172.21.15.191:6832/274874056 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5570d69e47e0 con 0x5570d6d98470 2024-01-25T15:02:27.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.306+0000 7fb44cff9640 10 client.15579 handle_command_reply: tid=0 2024-01-25T15:02:27.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.306+0000 7fb46e5b6740 1 client.15579 shutdown 2024-01-25T15:02:27.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.306+0000 7fb46e5b6740 1 -- 172.21.15.170:0/453323233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d795d0 msgr2=0x5570d6d8c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.306+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/453323233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d795d0 0x5570d6d8c560 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb460005ab0 tx=0x7fb460009260 comp rx=0 tx=0).stop 2024-01-25T15:02:27.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.306+0000 7fb46e5b6740 1 -- 172.21.15.170:0/453323233 shutdown_connections 2024-01-25T15:02:27.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.306+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/453323233 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5570d6d98470 0x5570d6d9a860 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.307+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/453323233 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d7a940 0x5570d6d8caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.307+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/453323233 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d88200 0x5570d6d93ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.307+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/453323233 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d795d0 0x5570d6d8c560 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.307+0000 7fb44cff9640 0 client.15579 ms_handle_reset on v2:172.21.15.191:6832/274874056 2024-01-25T15:02:27.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.307+0000 7fb46e5b6740 1 -- 172.21.15.170:0/453323233 >> 172.21.15.170:0/453323233 conn(0x5570d6d7b6c0 msgr2=0x5570d6d787f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.307+0000 7fb46e5b6740 1 -- 172.21.15.170:0/453323233 shutdown_connections 2024-01-25T15:02:27.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.307+0000 7fb46e5b6740 1 -- 172.21.15.170:0/453323233 wait complete. 2024-01-25T15:02:27.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.307+0000 7fb46e5b6740 20 client.15579 trim_cache size 0 max 16384 2024-01-25T15:02:27.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.320+0000 7fb46e5b6740 1 Processor -- start 2024-01-25T15:02:27.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.320+0000 7fb46e5b6740 1 -- start start 2024-01-25T15:02:27.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.320+0000 7fb46e5b6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d795d0 0x5570d6d8c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.320+0000 7fb46e5b6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d7a940 0x5570d6d93aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.320+0000 7fb46e5b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d88200 0x5570d6d8c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.320+0000 7fb46e5b6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570d6d75290 con 0x5570d6d7a940 2024-01-25T15:02:27.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.320+0000 7fb46e5b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570d69e47e0 con 0x5570d6d88200 2024-01-25T15:02:27.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.320+0000 7fb46e5b6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570d6cdde00 con 0x5570d6d795d0 2024-01-25T15:02:27.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.320+0000 7fb468eb8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d7a940 0x5570d6d93aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.320+0000 7fb468eb8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d7a940 0x5570d6d93aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53414/0 (socket says 172.21.15.170:53414) 2024-01-25T15:02:27.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.320+0000 7fb468eb8640 1 -- 172.21.15.170:0/933357878 learned_addr learned my addr 172.21.15.170:0/933357878 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.321+0000 7fb469eba640 1 --2- 172.21.15.170:0/933357878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d88200 0x5570d6d8c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.321+0000 7fb4696b9640 1 --2- 172.21.15.170:0/933357878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d795d0 0x5570d6d8c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.321+0000 7fb468eb8640 1 -- 172.21.15.170:0/933357878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d795d0 msgr2=0x5570d6d8c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.321+0000 7fb468eb8640 1 --2- 172.21.15.170:0/933357878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d795d0 0x5570d6d8c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.321+0000 7fb468eb8640 1 -- 172.21.15.170:0/933357878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d88200 msgr2=0x5570d6d8c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.321+0000 7fb468eb8640 1 --2- 172.21.15.170:0/933357878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d88200 0x5570d6d8c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.321+0000 7fb468eb8640 1 -- 172.21.15.170:0/933357878 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570d6c80500 con 0x5570d6d7a940 2024-01-25T15:02:27.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.321+0000 7fb468eb8640 1 --2- 172.21.15.170:0/933357878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d7a940 0x5570d6d93aa0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb454000c00 tx=0x7fb4540cec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65234f074da71d02 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.321+0000 7fb44effd640 1 -- 172.21.15.170:0/933357878 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454097990 con 0x5570d6d7a940 2024-01-25T15:02:27.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.321+0000 7fb44effd640 1 -- 172.21.15.170:0/933357878 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb454099eb0 con 0x5570d6d7a940 2024-01-25T15:02:27.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.321+0000 7fb44effd640 1 -- 172.21.15.170:0/933357878 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454095e30 con 0x5570d6d7a940 2024-01-25T15:02:27.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.322+0000 7fb46e5b6740 1 -- 172.21.15.170:0/933357878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d7a940 msgr2=0x5570d6d93aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.322+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/933357878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d7a940 0x5570d6d93aa0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb454000c00 tx=0x7fb4540cec50 comp rx=0 tx=0).stop 2024-01-25T15:02:27.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.322+0000 7fb46e5b6740 1 -- 172.21.15.170:0/933357878 shutdown_connections 2024-01-25T15:02:27.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.322+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/933357878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d88200 0x5570d6d8c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.322+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/933357878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d7a940 0x5570d6d93aa0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.322+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/933357878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d795d0 0x5570d6d8c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.322+0000 7fb46e5b6740 1 -- 172.21.15.170:0/933357878 >> 172.21.15.170:0/933357878 conn(0x5570d6d7b6c0 msgr2=0x5570d6d846a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.322+0000 7fb46e5b6740 1 -- 172.21.15.170:0/933357878 shutdown_connections 2024-01-25T15:02:27.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.322+0000 7fb46e5b6740 1 -- 172.21.15.170:0/933357878 wait complete. 2024-01-25T15:02:27.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.322+0000 7fb46e5b6740 1 -- start start 2024-01-25T15:02:27.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.322+0000 7fb46e5b6740 1 Processor -- start 2024-01-25T15:02:27.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.322+0000 7fb46e5b6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d795d0 0x5570d6d92480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.322+0000 7fb46e5b6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d7a940 0x5570d6d929c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb46e5b6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d88200 0x5570d6d92f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb46e5b6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570d6deea60 con 0x5570d6d88200 2024-01-25T15:02:27.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb46e5b6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570d6deebd0 con 0x5570d6d795d0 2024-01-25T15:02:27.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb46e5b6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570d6deed90 con 0x5570d6d7a940 2024-01-25T15:02:27.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb46e5b6740 10 client.0 _ll_register_callbacks cb 0x7fb45c009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:27.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb469eba640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d88200 0x5570d6d92f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb469eba640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d88200 0x5570d6d92f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53424/0 (socket says 172.21.15.170:53424) 2024-01-25T15:02:27.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb469eba640 1 -- 172.21.15.170:0/1852519359 learned_addr learned my addr 172.21.15.170:0/1852519359 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb4696b9640 1 --2- 172.21.15.170:0/1852519359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d795d0 0x5570d6d92480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb468eb8640 1 --2- 172.21.15.170:0/1852519359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d7a940 0x5570d6d929c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb469eba640 1 -- 172.21.15.170:0/1852519359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d7a940 msgr2=0x5570d6d929c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb469eba640 1 --2- 172.21.15.170:0/1852519359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d7a940 0x5570d6d929c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb469eba640 1 -- 172.21.15.170:0/1852519359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d795d0 msgr2=0x5570d6d92480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb469eba640 1 --2- 172.21.15.170:0/1852519359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d795d0 0x5570d6d92480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb469eba640 1 -- 172.21.15.170:0/1852519359 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46419e1b0 con 0x5570d6d88200 2024-01-25T15:02:27.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb469eba640 1 --2- 172.21.15.170:0/1852519359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d88200 0x5570d6d92f00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009f70 tx=0x7fb45c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ada1c929fc4d97 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb44cff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb44cff9640 1 -- 172.21.15.170:0/1852519359 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c01f040 con 0x5570d6d88200 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb44cff9640 1 -- 172.21.15.170:0/1852519359 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fb45c0054d0 con 0x5570d6d88200 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb46e5b6740 1 -- 172.21.15.170:0/1852519359 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570d6cde0e0 con 0x5570d6d88200 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb44cff9640 1 -- 172.21.15.170:0/1852519359 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb45c005690 con 0x5570d6d88200 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb46e5b6740 10 client.15585 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.323+0000 7fb46e5b6740 1 -- 172.21.15.170:0/1852519359 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5570d6ca6050 con 0x5570d6d88200 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.324+0000 7fb44cff9640 1 -- 172.21.15.170:0/1852519359 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5570d6cde0e0 con 0x5570d6d88200 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.324+0000 7fb44cff9640 1 -- 172.21.15.170:0/1852519359 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb45c01a410 con 0x5570d6d88200 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.324+0000 7fb46e5b6740 10 client.15585 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.324+0000 7fb46e5b6740 10 client.15585 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.324+0000 7fb46e5b6740 20 client.15585 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.324+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/1852519359 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5570d6df0850 0x5570d6df2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.324+0000 7fb46e5b6740 4 client.15585 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.324+0000 7fb46e5b6740 1 -- 172.21.15.170:0/1852519359 --> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5570d6a37e30 con 0x5570d6df0850 2024-01-25T15:02:27.330 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.324+0000 7fb4696b9640 1 --2- 172.21.15.170:0/1852519359 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5570d6df0850 0x5570d6df2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.324+0000 7fb44cff9640 10 client.15585 ms_handle_connect on v2:172.21.15.191:6832/274874056 2024-01-25T15:02:27.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.324+0000 7fb4696b9640 1 --2- 172.21.15.170:0/1852519359 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5570d6df0850 0x5570d6df2c70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f69f8125e9359618 server_cookie=a45a0e561760dca2 in_seq=0 out_seq=0 2024-01-25T15:02:27.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.325+0000 7fb44cff9640 1 -- 172.21.15.170:0/1852519359 <== mds.3 v2:172.21.15.191:6832/274874056 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5570d6a37e30 con 0x5570d6df0850 2024-01-25T15:02:27.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.325+0000 7fb44cff9640 10 client.15585 handle_command_reply: tid=0 2024-01-25T15:02:27.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.325+0000 7fb46e5b6740 1 client.15585 shutdown 2024-01-25T15:02:27.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.325+0000 7fb46e5b6740 1 -- 172.21.15.170:0/1852519359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d88200 msgr2=0x5570d6d92f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.325+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/1852519359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d88200 0x5570d6d92f00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009f70 tx=0x7fb45c003ba0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.325+0000 7fb46e5b6740 1 -- 172.21.15.170:0/1852519359 shutdown_connections 2024-01-25T15:02:27.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.325+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/1852519359 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x5570d6df0850 0x5570d6df2c70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.325+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/1852519359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5570d6d88200 0x5570d6d92f00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.325+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/1852519359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5570d6d7a940 0x5570d6d929c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.325+0000 7fb46e5b6740 1 --2- 172.21.15.170:0/1852519359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5570d6d795d0 0x5570d6d92480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.325+0000 7fb46e5b6740 1 -- 172.21.15.170:0/1852519359 >> 172.21.15.170:0/1852519359 conn(0x5570d6d7b6c0 msgr2=0x5570d6d8c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.325+0000 7fb44cff9640 0 client.15585 ms_handle_reset on v2:172.21.15.191:6832/274874056 2024-01-25T15:02:27.331 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.325+0000 7fb46e5b6740 1 -- 172.21.15.170:0/1852519359 shutdown_connections 2024-01-25T15:02:27.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.325+0000 7fb46e5b6740 1 -- 172.21.15.170:0/1852519359 wait complete. 2024-01-25T15:02:27.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.325+0000 7fb46e5b6740 20 client.15585 trim_cache size 0 max 16384 2024-01-25T15:02:27.332 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:02:27.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.326+0000 7fb46b91d640 1 -- 172.21.15.170:0/2722402534 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb4500a1370 msgr2=0x7fb4500a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.326+0000 7fb46b91d640 1 --2- 172.21.15.170:0/2722402534 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb4500a1370 0x7fb4500a3830 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb460000c00 tx=0x7fb46002c5d0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.326+0000 7fb46b91d640 1 -- 172.21.15.170:0/2722402534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb464100de0 msgr2=0x7fb464196170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.326+0000 7fb46b91d640 1 --2- 172.21.15.170:0/2722402534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb464100de0 0x7fb464196170 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb45400d950 tx=0x7fb45400de10 comp rx=0 tx=0).stop 2024-01-25T15:02:27.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.326+0000 7fb46b91d640 1 -- 172.21.15.170:0/2722402534 shutdown_connections 2024-01-25T15:02:27.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.326+0000 7fb46b91d640 1 --2- 172.21.15.170:0/2722402534 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fb4500a1370 0x7fb4500a3830 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.326+0000 7fb46b91d640 1 --2- 172.21.15.170:0/2722402534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fb4641017a0 0x7fb46419d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.326+0000 7fb46b91d640 1 --2- 172.21.15.170:0/2722402534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fb464100de0 0x7fb464196170 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.326+0000 7fb46b91d640 1 --2- 172.21.15.170:0/2722402534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4640ffbf0 0x7fb464195c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.326+0000 7fb46b91d640 1 -- 172.21.15.170:0/2722402534 >> 172.21.15.170:0/2722402534 conn(0x7fb4640fb180 msgr2=0x7fb4641041a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.326+0000 7fb46b91d640 1 -- 172.21.15.170:0/2722402534 shutdown_connections 2024-01-25T15:02:27.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.326+0000 7fb46b91d640 1 -- 172.21.15.170:0/2722402534 wait complete. 2024-01-25T15:02:27.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:27 smithi170 ceph-mon[31899]: pgmap v362: 97 pgs: 97 active+clean; 657 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-01-25T15:02:27.336 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:27 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/4268456170' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:02:27.337 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-01-25T15:02:27.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.442+0000 7f7065f05640 1 -- 172.21.15.170:0/1188948601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70600ffbf0 msgr2=0x7f7060100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.442+0000 7f7065f05640 1 --2- 172.21.15.170:0/1188948601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70600ffbf0 0x7f7060100010 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7050009900 tx=0x7f705002bc30 comp rx=0 tx=0).stop 2024-01-25T15:02:27.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.442+0000 7f7065f05640 1 -- 172.21.15.170:0/1188948601 shutdown_connections 2024-01-25T15:02:27.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.442+0000 7f7065f05640 1 --2- 172.21.15.170:0/1188948601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70601017a0 0x7f7060108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.442+0000 7f7065f05640 1 --2- 172.21.15.170:0/1188948601 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7060100de0 0x7f7060101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.442+0000 7f7065f05640 1 --2- 172.21.15.170:0/1188948601 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70600ffbf0 0x7f7060100010 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.442+0000 7f7065f05640 1 -- 172.21.15.170:0/1188948601 >> 172.21.15.170:0/1188948601 conn(0x7f70600fb180 msgr2=0x7f70600fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.443+0000 7f7065f05640 1 -- 172.21.15.170:0/1188948601 shutdown_connections 2024-01-25T15:02:27.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.443+0000 7f7065f05640 1 -- 172.21.15.170:0/1188948601 wait complete. 2024-01-25T15:02:27.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.443+0000 7f7065f05640 1 Processor -- start 2024-01-25T15:02:27.446 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.443+0000 7f7065f05640 1 -- start start 2024-01-25T15:02:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.443+0000 7f7065f05640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70600ffbf0 0x7f7060196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.443+0000 7f7065f05640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7060100de0 0x7f70601971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.443+0000 7f7065f05640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70601017a0 0x7f706019e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.443+0000 7f7065f05640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706019e7a0 con 0x7f70600ffbf0 2024-01-25T15:02:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.443+0000 7f7065f05640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706019e910 con 0x7f70601017a0 2024-01-25T15:02:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.443+0000 7f7065f05640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706019ead0 con 0x7f7060100de0 2024-01-25T15:02:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f705f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70600ffbf0 0x7f7060196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f705f7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70600ffbf0 0x7f7060196c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53428/0 (socket says 172.21.15.170:53428) 2024-01-25T15:02:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f705f7fe640 1 -- 172.21.15.170:0/4255307030 learned_addr learned my addr 172.21.15.170:0/4255307030 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f705effd640 1 --2- 172.21.15.170:0/4255307030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7060100de0 0x7f70601971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f705ffff640 1 --2- 172.21.15.170:0/4255307030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70601017a0 0x7f706019e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f705f7fe640 1 -- 172.21.15.170:0/4255307030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7060100de0 msgr2=0x7f70601971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f705f7fe640 1 --2- 172.21.15.170:0/4255307030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7060100de0 0x7f70601971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f705f7fe640 1 -- 172.21.15.170:0/4255307030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70601017a0 msgr2=0x7f706019e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.447 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f705f7fe640 1 --2- 172.21.15.170:0/4255307030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70601017a0 0x7f706019e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f705f7fe640 1 -- 172.21.15.170:0/4255307030 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7050009560 con 0x7f70600ffbf0 2024-01-25T15:02:27.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f705f7fe640 1 --2- 172.21.15.170:0/4255307030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70600ffbf0 0x7f7060196c90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7050009230 tx=0x7f7050004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f705cff9640 1 -- 172.21.15.170:0/4255307030 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70500043d0 con 0x7f70600ffbf0 2024-01-25T15:02:27.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f7065f05640 1 -- 172.21.15.170:0/4255307030 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706019ed50 con 0x7f70600ffbf0 2024-01-25T15:02:27.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f705cff9640 1 -- 172.21.15.170:0/4255307030 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70500054c0 con 0x7f70600ffbf0 2024-01-25T15:02:27.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f705cff9640 1 -- 172.21.15.170:0/4255307030 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050003dc0 con 0x7f70600ffbf0 2024-01-25T15:02:27.448 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.444+0000 7f7065f05640 1 -- 172.21.15.170:0/4255307030 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706019f1f0 con 0x7f70600ffbf0 2024-01-25T15:02:27.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f7068ba5740 1 Processor -- start 2024-01-25T15:02:27.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f7068ba5740 1 -- start start 2024-01-25T15:02:27.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f7068ba5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dddcf40 0x56365dddd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f7068ba5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddd930 0x56365dde2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f705cff9640 1 -- 172.21.15.170:0/4255307030 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f7050005000 con 0x7f70600ffbf0 2024-01-25T15:02:27.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f7068ba5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dde2aa0 0x56365dde4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f7068ba5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365dd4b270 con 0x56365dde2aa0 2024-01-25T15:02:27.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f7068ba5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365dd48960 con 0x56365dddd930 2024-01-25T15:02:27.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f7068ba5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365dd44250 con 0x56365dddcf40 2024-01-25T15:02:27.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f705effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dde2aa0 0x56365dde4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f705effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dde2aa0 0x56365dde4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53444/0 (socket says 172.21.15.170:53444) 2024-01-25T15:02:27.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f705effd640 1 -- 172.21.15.170:0/1145622712 learned_addr learned my addr 172.21.15.170:0/1145622712 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f705f7fe640 1 --2- 172.21.15.170:0/1145622712 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddd930 0x56365dde2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f705ffff640 1 --2- 172.21.15.170:0/1145622712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dddcf40 0x56365dddd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f705effd640 1 -- 172.21.15.170:0/1145622712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dddcf40 msgr2=0x56365dddd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f705effd640 1 --2- 172.21.15.170:0/1145622712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dddcf40 0x56365dddd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f705effd640 1 -- 172.21.15.170:0/1145622712 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddd930 msgr2=0x56365dde2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f705effd640 1 --2- 172.21.15.170:0/1145622712 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddd930 0x56365dde2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f705effd640 1 -- 172.21.15.170:0/1145622712 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56365dd067f0 con 0x56365dde2aa0 2024-01-25T15:02:27.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f705ffff640 1 --2- 172.21.15.170:0/1145622712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dddcf40 0x56365dddd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:27.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.447+0000 7f705f7fe640 1 --2- 172.21.15.170:0/1145622712 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddd930 0x56365dde2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:27.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.448+0000 7f705effd640 1 --2- 172.21.15.170:0/1145622712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dde2aa0 0x56365dde4f30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f705400aca0 tx=0x7f705400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d5d4675982209c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.448+0000 7f705cff9640 1 --2- 172.21.15.170:0/4255307030 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f70480a1370 0x7f70480a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.448+0000 7f7045ffb640 1 -- 172.21.15.170:0/1145622712 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054018640 con 0x56365dde2aa0 2024-01-25T15:02:27.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.448+0000 7f7045ffb640 1 -- 172.21.15.170:0/1145622712 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7054018c60 con 0x56365dde2aa0 2024-01-25T15:02:27.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.448+0000 7f705ffff640 1 --2- 172.21.15.170:0/4255307030 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f70480a1370 0x7f70480a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.448+0000 7f705cff9640 1 -- 172.21.15.170:0/4255307030 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f70500ef510 con 0x7f70600ffbf0 2024-01-25T15:02:27.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.448+0000 7f7045ffb640 1 -- 172.21.15.170:0/1145622712 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054010c40 con 0x56365dde2aa0 2024-01-25T15:02:27.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.449+0000 7f705ffff640 1 --2- 172.21.15.170:0/4255307030 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f70480a1370 0x7f70480a3830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x56365ddde190 tx=0x7f70580094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.449+0000 7f7068ba5740 1 -- 172.21.15.170:0/1145622712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dde2aa0 msgr2=0x56365dde4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.449+0000 7f7068ba5740 1 --2- 172.21.15.170:0/1145622712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dde2aa0 0x56365dde4f30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f705400aca0 tx=0x7f705400f790 comp rx=0 tx=0).stop 2024-01-25T15:02:27.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.449+0000 7f7068ba5740 1 -- 172.21.15.170:0/1145622712 shutdown_connections 2024-01-25T15:02:27.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.449+0000 7f7068ba5740 1 --2- 172.21.15.170:0/1145622712 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddd930 0x56365dde2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.449+0000 7f7068ba5740 1 --2- 172.21.15.170:0/1145622712 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dde2aa0 0x56365dde4f30 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.449+0000 7f7068ba5740 1 --2- 172.21.15.170:0/1145622712 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dddcf40 0x56365dddd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.449+0000 7f7068ba5740 1 -- 172.21.15.170:0/1145622712 >> 172.21.15.170:0/1145622712 conn(0x56365ddd84b0 msgr2=0x56365ddd88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.449+0000 7f7068ba5740 1 -- 172.21.15.170:0/1145622712 shutdown_connections 2024-01-25T15:02:27.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.449+0000 7f7068ba5740 1 -- 172.21.15.170:0/1145622712 wait complete. 2024-01-25T15:02:27.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.449+0000 7f7068ba5740 1 -- start start 2024-01-25T15:02:27.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.449+0000 7f7068ba5740 1 Processor -- start 2024-01-25T15:02:27.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f7068ba5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dddcf40 0x56365dde7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f7068ba5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddd930 0x56365dde7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f7068ba5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dde2aa0 0x56365ddee590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f7068ba5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365dcfd610 con 0x56365dde2aa0 2024-01-25T15:02:27.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f7068ba5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365dcfd2b0 con 0x56365dddd930 2024-01-25T15:02:27.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f7068ba5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365dcc2400 con 0x56365dddcf40 2024-01-25T15:02:27.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f7068ba5740 10 client.0 _ll_register_callbacks cb 0x56365dd3aee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:27.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f705ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dde2aa0 0x56365ddee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f705ffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dde2aa0 0x56365ddee590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53458/0 (socket says 172.21.15.170:53458) 2024-01-25T15:02:27.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f705ffff640 1 -- 172.21.15.170:0/2465078854 learned_addr learned my addr 172.21.15.170:0/2465078854 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f705effd640 1 --2- 172.21.15.170:0/2465078854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddd930 0x56365dde7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f705f7fe640 1 --2- 172.21.15.170:0/2465078854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dddcf40 0x56365dde7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f705ffff640 1 -- 172.21.15.170:0/2465078854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dddcf40 msgr2=0x56365dde7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f705ffff640 1 --2- 172.21.15.170:0/2465078854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dddcf40 0x56365dde7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f705ffff640 1 -- 172.21.15.170:0/2465078854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddd930 msgr2=0x56365dde7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f705ffff640 1 --2- 172.21.15.170:0/2465078854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddd930 0x56365dde7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f705ffff640 1 -- 172.21.15.170:0/2465078854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f705400a900 con 0x56365dde2aa0 2024-01-25T15:02:27.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f705f7fe640 1 --2- 172.21.15.170:0/2465078854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dddcf40 0x56365dde7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:27.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f705ffff640 1 --2- 172.21.15.170:0/2465078854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dde2aa0 0x56365ddee590 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f70580116a0 tx=0x7f7058004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7d8423b6e75fc1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f703effd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:27.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f703effd640 1 -- 172.21.15.170:0/2465078854 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7058004d20 con 0x56365dde2aa0 2024-01-25T15:02:27.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f7068ba5740 1 -- 172.21.15.170:0/2465078854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56365dd3d0e0 con 0x56365dde2aa0 2024-01-25T15:02:27.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.450+0000 7f703effd640 1 -- 172.21.15.170:0/2465078854 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f70580107a0 con 0x56365dde2aa0 2024-01-25T15:02:27.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.451+0000 7f703effd640 1 -- 172.21.15.170:0/2465078854 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7058004e80 con 0x56365dde2aa0 2024-01-25T15:02:27.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.451+0000 7f7068ba5740 10 client.15597 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:27.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.451+0000 7f7068ba5740 1 -- 172.21.15.170:0/2465078854 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56365dd428d0 con 0x56365dde2aa0 2024-01-25T15:02:27.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.451+0000 7f703effd640 1 -- 172.21.15.170:0/2465078854 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56365dd3d0e0 con 0x56365dde2aa0 2024-01-25T15:02:27.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.451+0000 7f703effd640 1 -- 172.21.15.170:0/2465078854 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7058005760 con 0x56365dde2aa0 2024-01-25T15:02:27.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.451+0000 7f7068ba5740 10 client.15597 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:27.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.451+0000 7f7068ba5740 10 client.15597 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-01-25T15:02:27.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.451+0000 7f7068ba5740 20 client.15597 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:27.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.451+0000 7f7068ba5740 1 --2- 172.21.15.170:0/2465078854 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x56365ddf2eb0 0x56365ddf52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.451+0000 7f7068ba5740 4 client.15597 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:02:27.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.451+0000 7f7068ba5740 1 -- 172.21.15.170:0/2465078854 --> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56365dd3ce00 con 0x56365ddf2eb0 2024-01-25T15:02:27.460 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.451+0000 7f705f7fe640 1 --2- 172.21.15.170:0/2465078854 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x56365ddf2eb0 0x56365ddf52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.452+0000 7f703effd640 10 client.15597 ms_handle_connect on v2:172.21.15.191:6836/719224494 2024-01-25T15:02:27.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.452+0000 7f705f7fe640 1 --2- 172.21.15.170:0/2465078854 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x56365ddf2eb0 0x56365ddf52f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4ace0b9e0f828900 server_cookie=6ebc3bac54f43f32 in_seq=0 out_seq=0 2024-01-25T15:02:27.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.452+0000 7f703effd640 1 -- 172.21.15.170:0/2465078854 <== mds.2 v2:172.21.15.191:6836/719224494 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56365dd3ce00 con 0x56365ddf2eb0 2024-01-25T15:02:27.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.452+0000 7f703effd640 10 client.15597 handle_command_reply: tid=0 2024-01-25T15:02:27.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.452+0000 7f7068ba5740 1 client.15597 shutdown 2024-01-25T15:02:27.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.453+0000 7f7068ba5740 1 -- 172.21.15.170:0/2465078854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dde2aa0 msgr2=0x56365ddee590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.453+0000 7f7068ba5740 1 --2- 172.21.15.170:0/2465078854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dde2aa0 0x56365ddee590 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f70580116a0 tx=0x7f7058004ab0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.453+0000 7f7068ba5740 1 -- 172.21.15.170:0/2465078854 shutdown_connections 2024-01-25T15:02:27.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.453+0000 7f7068ba5740 1 --2- 172.21.15.170:0/2465078854 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x56365ddf2eb0 0x56365ddf52f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.453+0000 7f7068ba5740 1 --2- 172.21.15.170:0/2465078854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddd930 0x56365dde7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.453+0000 7f703effd640 0 client.15597 ms_handle_reset on v2:172.21.15.191:6836/719224494 2024-01-25T15:02:27.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.453+0000 7f7068ba5740 1 --2- 172.21.15.170:0/2465078854 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dde2aa0 0x56365ddee590 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.453+0000 7f7068ba5740 1 --2- 172.21.15.170:0/2465078854 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dddcf40 0x56365dde7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.453+0000 7f7068ba5740 1 -- 172.21.15.170:0/2465078854 >> 172.21.15.170:0/2465078854 conn(0x56365ddd84b0 msgr2=0x56365ddd77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.461 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.453+0000 7f7068ba5740 1 -- 172.21.15.170:0/2465078854 shutdown_connections 2024-01-25T15:02:27.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.453+0000 7f7068ba5740 1 -- 172.21.15.170:0/2465078854 wait complete. 2024-01-25T15:02:27.462 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.453+0000 7f7068ba5740 20 client.15597 trim_cache size 0 max 16384 2024-01-25T15:02:27.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.476+0000 7f7068ba5740 1 Processor -- start 2024-01-25T15:02:27.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.476+0000 7f7068ba5740 1 -- start start 2024-01-25T15:02:27.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.476+0000 7f7068ba5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddcf40 0x56365ddd37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.476+0000 7f7068ba5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dddd930 0x56365ddee550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.476+0000 7f7068ba5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dde2aa0 0x56365ddd8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.476+0000 7f7068ba5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365dd3ce00 con 0x56365dddd930 2024-01-25T15:02:27.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.476+0000 7f7068ba5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365dd3d0e0 con 0x56365dddcf40 2024-01-25T15:02:27.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.476+0000 7f7068ba5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365ddd3d70 con 0x56365dde2aa0 2024-01-25T15:02:27.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.476+0000 7f705effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dddd930 0x56365ddee550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.476+0000 7f705effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dddd930 0x56365ddee550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53470/0 (socket says 172.21.15.170:53470) 2024-01-25T15:02:27.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.476+0000 7f705effd640 1 -- 172.21.15.170:0/432981309 learned_addr learned my addr 172.21.15.170:0/432981309 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.477+0000 7f705ffff640 1 --2- 172.21.15.170:0/432981309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dde2aa0 0x56365ddd8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.477+0000 7f705f7fe640 1 --2- 172.21.15.170:0/432981309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddcf40 0x56365ddd37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.477+0000 7f705effd640 1 -- 172.21.15.170:0/432981309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dde2aa0 msgr2=0x56365ddd8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.477+0000 7f705effd640 1 --2- 172.21.15.170:0/432981309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dde2aa0 0x56365ddd8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.477+0000 7f705effd640 1 -- 172.21.15.170:0/432981309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddcf40 msgr2=0x56365ddd37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.477+0000 7f705effd640 1 --2- 172.21.15.170:0/432981309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddcf40 0x56365ddd37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.477+0000 7f705effd640 1 -- 172.21.15.170:0/432981309 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56365dcdf500 con 0x56365dddd930 2024-01-25T15:02:27.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.477+0000 7f705ffff640 1 --2- 172.21.15.170:0/432981309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dde2aa0 0x56365ddd8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:27.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.477+0000 7f705effd640 1 --2- 172.21.15.170:0/432981309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dddd930 0x56365ddee550 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f705400a8d0 tx=0x7f70540050f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ca8eb88199117d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.477+0000 7f70457fa640 1 -- 172.21.15.170:0/432981309 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054005460 con 0x56365dddd930 2024-01-25T15:02:27.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.477+0000 7f70457fa640 1 -- 172.21.15.170:0/432981309 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70540055c0 con 0x56365dddd930 2024-01-25T15:02:27.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.477+0000 7f70457fa640 1 -- 172.21.15.170:0/432981309 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054004d00 con 0x56365dddd930 2024-01-25T15:02:27.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 -- 172.21.15.170:0/432981309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dddd930 msgr2=0x56365ddee550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 --2- 172.21.15.170:0/432981309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dddd930 0x56365ddee550 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f705400a8d0 tx=0x7f70540050f0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 -- 172.21.15.170:0/432981309 shutdown_connections 2024-01-25T15:02:27.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 --2- 172.21.15.170:0/432981309 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dde2aa0 0x56365ddd8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 --2- 172.21.15.170:0/432981309 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dddd930 0x56365ddee550 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 --2- 172.21.15.170:0/432981309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddcf40 0x56365ddd37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 -- 172.21.15.170:0/432981309 >> 172.21.15.170:0/432981309 conn(0x56365ddd84b0 msgr2=0x56365dde22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 -- 172.21.15.170:0/432981309 shutdown_connections 2024-01-25T15:02:27.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 -- 172.21.15.170:0/432981309 wait complete. 2024-01-25T15:02:27.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 -- start start 2024-01-25T15:02:27.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 Processor -- start 2024-01-25T15:02:27.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddcf40 0x56365ddee270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dddd930 0x56365ddec880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dde2aa0 0x56365ddecdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365dded300 con 0x56365dddd930 2024-01-25T15:02:27.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365dded440 con 0x56365dddcf40 2024-01-25T15:02:27.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.478+0000 7f7068ba5740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56365dded600 con 0x56365dde2aa0 2024-01-25T15:02:27.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f7068ba5740 10 client.0 _ll_register_callbacks cb 0x7f705400a6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:27.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f705effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dddd930 0x56365ddec880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f705effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dddd930 0x56365ddec880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53482/0 (socket says 172.21.15.170:53482) 2024-01-25T15:02:27.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f705effd640 1 -- 172.21.15.170:0/4125446478 learned_addr learned my addr 172.21.15.170:0/4125446478 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f705f7fe640 1 --2- 172.21.15.170:0/4125446478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddcf40 0x56365ddee270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f705ffff640 1 --2- 172.21.15.170:0/4125446478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dde2aa0 0x56365ddecdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f705effd640 1 -- 172.21.15.170:0/4125446478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dde2aa0 msgr2=0x56365ddecdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f705effd640 1 --2- 172.21.15.170:0/4125446478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dde2aa0 0x56365ddecdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f705effd640 1 -- 172.21.15.170:0/4125446478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddcf40 msgr2=0x56365ddee270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f705effd640 1 --2- 172.21.15.170:0/4125446478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddcf40 0x56365ddee270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f705effd640 1 -- 172.21.15.170:0/4125446478 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56365dd067f0 con 0x56365dddd930 2024-01-25T15:02:27.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f705effd640 1 --2- 172.21.15.170:0/4125446478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dddd930 0x56365ddec880 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f705400fc90 tx=0x7f7054004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235c03fa4ea54c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f703effd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:27.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f703effd640 1 -- 172.21.15.170:0/4125446478 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7054032070 con 0x56365dddd930 2024-01-25T15:02:27.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f703effd640 1 -- 172.21.15.170:0/4125446478 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f7054004660 con 0x56365dddd930 2024-01-25T15:02:27.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f7068ba5740 1 -- 172.21.15.170:0/4125446478 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7054018c60 con 0x56365dddd930 2024-01-25T15:02:27.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f703effd640 1 -- 172.21.15.170:0/4125446478 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7054018650 con 0x56365dddd930 2024-01-25T15:02:27.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f7068ba5740 10 client.15603 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:27.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.479+0000 7f7068ba5740 1 -- 172.21.15.170:0/4125446478 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56365dd05050 con 0x56365dddd930 2024-01-25T15:02:27.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.480+0000 7f703effd640 1 -- 172.21.15.170:0/4125446478 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7054018c60 con 0x56365dddd930 2024-01-25T15:02:27.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.480+0000 7f703effd640 1 -- 172.21.15.170:0/4125446478 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f705402ccf0 con 0x56365dddd930 2024-01-25T15:02:27.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.480+0000 7f7068ba5740 10 client.15603 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:27.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.480+0000 7f7068ba5740 10 client.15603 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-01-25T15:02:27.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.480+0000 7f7068ba5740 20 client.15603 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:27.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.480+0000 7f7068ba5740 1 --2- 172.21.15.170:0/4125446478 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x56365ddf2eb0 0x56365de4c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.480+0000 7f7068ba5740 4 client.15603 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:02:27.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.480+0000 7f7068ba5740 1 -- 172.21.15.170:0/4125446478 --> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56365da437e0 con 0x56365ddf2eb0 2024-01-25T15:02:27.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.480+0000 7f705f7fe640 1 --2- 172.21.15.170:0/4125446478 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x56365ddf2eb0 0x56365de4c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f705f7fe640 1 --2- 172.21.15.170:0/4125446478 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x56365ddf2eb0 0x56365de4c990 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fd006907d7e149f7 server_cookie=336d3ebf44b0d9e8 in_seq=0 out_seq=0 2024-01-25T15:02:27.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f703effd640 10 client.15603 ms_handle_connect on v2:172.21.15.191:6836/719224494 2024-01-25T15:02:27.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f703effd640 1 -- 172.21.15.170:0/4125446478 <== mds.2 v2:172.21.15.191:6836/719224494 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56365da437e0 con 0x56365ddf2eb0 2024-01-25T15:02:27.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f703effd640 10 client.15603 handle_command_reply: tid=0 2024-01-25T15:02:27.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f7068ba5740 1 client.15603 shutdown 2024-01-25T15:02:27.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f7068ba5740 1 -- 172.21.15.170:0/4125446478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dddd930 msgr2=0x56365ddec880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f7068ba5740 1 --2- 172.21.15.170:0/4125446478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dddd930 0x56365ddec880 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f705400fc90 tx=0x7f7054004cb0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f7068ba5740 1 -- 172.21.15.170:0/4125446478 shutdown_connections 2024-01-25T15:02:27.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f7068ba5740 1 --2- 172.21.15.170:0/4125446478 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x56365ddf2eb0 0x56365de4c990 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f7068ba5740 1 --2- 172.21.15.170:0/4125446478 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56365dde2aa0 0x56365ddecdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f7068ba5740 1 --2- 172.21.15.170:0/4125446478 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56365dddd930 0x56365ddec880 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f703effd640 0 client.15603 ms_handle_reset on v2:172.21.15.191:6836/719224494 2024-01-25T15:02:27.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f7068ba5740 1 --2- 172.21.15.170:0/4125446478 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56365dddcf40 0x56365ddee270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f7068ba5740 1 -- 172.21.15.170:0/4125446478 >> 172.21.15.170:0/4125446478 conn(0x56365ddd84b0 msgr2=0x56365dde1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f7068ba5740 1 -- 172.21.15.170:0/4125446478 shutdown_connections 2024-01-25T15:02:27.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f7068ba5740 1 -- 172.21.15.170:0/4125446478 wait complete. 2024-01-25T15:02:27.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f7068ba5740 20 client.15603 trim_cache size 0 max 16384 2024-01-25T15:02:27.489 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:02:27.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f7065f05640 1 -- 172.21.15.170:0/4255307030 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f70480a1370 msgr2=0x7f70480a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.481+0000 7f7065f05640 1 --2- 172.21.15.170:0/4255307030 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f70480a1370 0x7f70480a3830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x56365ddde190 tx=0x7f70580094f0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.482+0000 7f7065f05640 1 -- 172.21.15.170:0/4255307030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70600ffbf0 msgr2=0x7f7060196c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.482+0000 7f7065f05640 1 --2- 172.21.15.170:0/4255307030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70600ffbf0 0x7f7060196c90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7050009230 tx=0x7f7050004f40 comp rx=0 tx=0).stop 2024-01-25T15:02:27.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.482+0000 7f7065f05640 1 -- 172.21.15.170:0/4255307030 shutdown_connections 2024-01-25T15:02:27.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.482+0000 7f7065f05640 1 --2- 172.21.15.170:0/4255307030 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f70480a1370 0x7f70480a3830 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.482+0000 7f7065f05640 1 --2- 172.21.15.170:0/4255307030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70601017a0 0x7f706019e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.482+0000 7f7065f05640 1 --2- 172.21.15.170:0/4255307030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7060100de0 0x7f70601971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.482+0000 7f7065f05640 1 --2- 172.21.15.170:0/4255307030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f70600ffbf0 0x7f7060196c90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.482+0000 7f7065f05640 1 -- 172.21.15.170:0/4255307030 >> 172.21.15.170:0/4255307030 conn(0x7f70600fb180 msgr2=0x7f7060067e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.482+0000 7f7065f05640 1 -- 172.21.15.170:0/4255307030 shutdown_connections 2024-01-25T15:02:27.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.482+0000 7f7065f05640 1 -- 172.21.15.170:0/4255307030 wait complete. 2024-01-25T15:02:27.496 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-01-25T15:02:27.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.600+0000 7fe15b53e640 1 -- 172.21.15.170:0/1611024326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1541017a0 msgr2=0x7fe154108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.600+0000 7fe15b53e640 1 --2- 172.21.15.170:0/1611024326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1541017a0 0x7fe154108030 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009ca0 tx=0x7fe14c02c0f0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.601 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.600+0000 7fe15b53e640 1 -- 172.21.15.170:0/1611024326 shutdown_connections 2024-01-25T15:02:27.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.600+0000 7fe15b53e640 1 --2- 172.21.15.170:0/1611024326 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1541017a0 0x7fe154108030 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.600+0000 7fe15b53e640 1 --2- 172.21.15.170:0/1611024326 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe154100de0 0x7fe154101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.600+0000 7fe15b53e640 1 --2- 172.21.15.170:0/1611024326 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1540ffbf0 0x7fe154100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.600+0000 7fe15b53e640 1 -- 172.21.15.170:0/1611024326 >> 172.21.15.170:0/1611024326 conn(0x7fe1540fb180 msgr2=0x7fe1540fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.600+0000 7fe15b53e640 1 -- 172.21.15.170:0/1611024326 shutdown_connections 2024-01-25T15:02:27.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.600+0000 7fe15b53e640 1 -- 172.21.15.170:0/1611024326 wait complete. 2024-01-25T15:02:27.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe15b53e640 1 Processor -- start 2024-01-25T15:02:27.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe15b53e640 1 -- start start 2024-01-25T15:02:27.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe15b53e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1540ffbf0 0x7fe154195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe15b53e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe154100de0 0x7fe1541960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe15b53e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1541017a0 0x7fe15419d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe15b53e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15419d680 con 0x7fe154100de0 2024-01-25T15:02:27.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe15b53e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15419d7f0 con 0x7fe1541017a0 2024-01-25T15:02:27.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe15b53e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15419d9b0 con 0x7fe1540ffbf0 2024-01-25T15:02:27.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe158ad9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe154100de0 0x7fe1541960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe158ad9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe154100de0 0x7fe1541960d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53514/0 (socket says 172.21.15.170:53514) 2024-01-25T15:02:27.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe158ad9640 1 -- 172.21.15.170:0/2379584930 learned_addr learned my addr 172.21.15.170:0/2379584930 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe158ad9640 1 -- 172.21.15.170:0/2379584930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1540ffbf0 msgr2=0x7fe154195b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe158ad9640 1 --2- 172.21.15.170:0/2379584930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1540ffbf0 0x7fe154195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe158ad9640 1 -- 172.21.15.170:0/2379584930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1541017a0 msgr2=0x7fe15419d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe159adb640 1 --2- 172.21.15.170:0/2379584930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1541017a0 0x7fe15419d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe158ad9640 1 --2- 172.21.15.170:0/2379584930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1541017a0 0x7fe15419d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe158ad9640 1 -- 172.21.15.170:0/2379584930 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c009900 con 0x7fe154100de0 2024-01-25T15:02:27.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.601+0000 7fe159adb640 1 --2- 172.21.15.170:0/2379584930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1541017a0 0x7fe15419d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:27.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.602+0000 7fe158ad9640 1 --2- 172.21.15.170:0/2379584930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe154100de0 0x7fe1541960d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe14400d770 tx=0x7fe14400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.602+0000 7fe14a7fc640 1 -- 172.21.15.170:0/2379584930 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144009c30 con 0x7fe154100de0 2024-01-25T15:02:27.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.602+0000 7fe15b53e640 1 -- 172.21.15.170:0/2379584930 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15419dc90 con 0x7fe154100de0 2024-01-25T15:02:27.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.602+0000 7fe14a7fc640 1 -- 172.21.15.170:0/2379584930 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe14400de80 con 0x7fe154100de0 2024-01-25T15:02:27.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.602+0000 7fe14a7fc640 1 -- 172.21.15.170:0/2379584930 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe144004de0 con 0x7fe154100de0 2024-01-25T15:02:27.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.602+0000 7fe15b53e640 1 -- 172.21.15.170:0/2379584930 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15419e1a0 con 0x7fe154100de0 2024-01-25T15:02:27.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:27 smithi186 ceph-mon[35697]: pgmap v362: 97 pgs: 97 active+clean; 657 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-01-25T15:02:27.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:27 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/4268456170' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:02:27.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.604+0000 7fe14a7fc640 1 -- 172.21.15.170:0/2379584930 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fe144005020 con 0x7fe154100de0 2024-01-25T15:02:27.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.604+0000 7fe15e1d3740 1 Processor -- start 2024-01-25T15:02:27.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.604+0000 7fe15e1d3740 1 -- start start 2024-01-25T15:02:27.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe15e1d3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347150 0x55e088347570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe15e1d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e088347b40 0x55e08834c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe15e1d3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e08834ccb0 0x55e08834f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe15e1d3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0882b3270 con 0x55e088347b40 2024-01-25T15:02:27.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe15e1d3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0882b0960 con 0x55e088347150 2024-01-25T15:02:27.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe15e1d3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0882ac250 con 0x55e08834ccb0 2024-01-25T15:02:27.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe1592da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e088347b40 0x55e08834c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe1592da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e088347b40 0x55e08834c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53518/0 (socket says 172.21.15.170:53518) 2024-01-25T15:02:27.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe1592da640 1 -- 172.21.15.170:0/3633083289 learned_addr learned my addr 172.21.15.170:0/3633083289 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe159adb640 1 --2- 172.21.15.170:0/3633083289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347150 0x55e088347570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe14a7fc640 1 --2- 172.21.15.170:0/2379584930 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe1400a1370 0x7fe1400a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe158ad9640 1 --2- 172.21.15.170:0/3633083289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e08834ccb0 0x55e08834f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe159adb640 1 --2- 172.21.15.170:0/2379584930 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe1400a1370 0x7fe1400a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe1592da640 1 -- 172.21.15.170:0/3633083289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e08834ccb0 msgr2=0x55e08834f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe1592da640 1 --2- 172.21.15.170:0/3633083289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e08834ccb0 0x55e08834f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe1592da640 1 -- 172.21.15.170:0/3633083289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347150 msgr2=0x55e088347570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe1592da640 1 --2- 172.21.15.170:0/3633083289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347150 0x55e088347570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe1592da640 1 -- 172.21.15.170:0/3633083289 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e08826e7f0 con 0x55e088347b40 2024-01-25T15:02:27.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe158ad9640 1 --2- 172.21.15.170:0/3633083289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e08834ccb0 0x55e08834f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:27.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe14a7fc640 1 -- 172.21.15.170:0/2379584930 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fe1440cc750 con 0x7fe154100de0 2024-01-25T15:02:27.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.605+0000 7fe1592da640 1 --2- 172.21.15.170:0/3633083289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e088347b40 0x55e08834c640 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe15000bb60 tx=0x7fe15000d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc343c2e21e7ff2f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.606+0000 7fe159adb640 1 --2- 172.21.15.170:0/2379584930 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe1400a1370 0x7fe1400a3830 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe14c02c630 tx=0x7fe14c02c0f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.606+0000 7fe13f7fe640 1 -- 172.21.15.170:0/3633083289 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15000be50 con 0x55e088347b40 2024-01-25T15:02:27.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.606+0000 7fe13f7fe640 1 -- 172.21.15.170:0/3633083289 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe15000b640 con 0x55e088347b40 2024-01-25T15:02:27.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.606+0000 7fe13f7fe640 1 -- 172.21.15.170:0/3633083289 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150004ad0 con 0x55e088347b40 2024-01-25T15:02:27.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.606+0000 7fe15e1d3740 1 -- 172.21.15.170:0/3633083289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e088347b40 msgr2=0x55e08834c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.606+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/3633083289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e088347b40 0x55e08834c640 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe15000bb60 tx=0x7fe15000d6b0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.606+0000 7fe15e1d3740 1 -- 172.21.15.170:0/3633083289 shutdown_connections 2024-01-25T15:02:27.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.606+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/3633083289 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e08834ccb0 0x55e08834f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.606+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/3633083289 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e088347b40 0x55e08834c640 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.606+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/3633083289 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347150 0x55e088347570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.606+0000 7fe15e1d3740 1 -- 172.21.15.170:0/3633083289 >> 172.21.15.170:0/3633083289 conn(0x55e0883404b0 msgr2=0x55e0883408b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.606+0000 7fe15e1d3740 1 -- 172.21.15.170:0/3633083289 shutdown_connections 2024-01-25T15:02:27.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.606+0000 7fe15e1d3740 1 -- 172.21.15.170:0/3633083289 wait complete. 2024-01-25T15:02:27.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.607+0000 7fe15e1d3740 1 -- start start 2024-01-25T15:02:27.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.607+0000 7fe15e1d3740 1 Processor -- start 2024-01-25T15:02:27.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.607+0000 7fe15e1d3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347150 0x55e0883512d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.607+0000 7fe15e1d3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347b40 0x55e088351810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.607+0000 7fe15e1d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e08834ccb0 0x55e088358850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.607+0000 7fe15e1d3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e088265610 con 0x55e08834ccb0 2024-01-25T15:02:27.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.607+0000 7fe15e1d3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0882652b0 con 0x55e088347b40 2024-01-25T15:02:27.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.607+0000 7fe15e1d3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e08822a400 con 0x55e088347150 2024-01-25T15:02:27.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.607+0000 7fe15e1d3740 10 client.0 _ll_register_callbacks cb 0x55e0882a2ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:27.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.607+0000 7fe159adb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e08834ccb0 0x55e088358850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.607+0000 7fe159adb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e08834ccb0 0x55e088358850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53522/0 (socket says 172.21.15.170:53522) 2024-01-25T15:02:27.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.607+0000 7fe159adb640 1 -- 172.21.15.170:0/2528316338 learned_addr learned my addr 172.21.15.170:0/2528316338 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe1592da640 1 --2- 172.21.15.170:0/2528316338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347150 0x55e0883512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe158ad9640 1 --2- 172.21.15.170:0/2528316338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347b40 0x55e088351810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe159adb640 1 -- 172.21.15.170:0/2528316338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347150 msgr2=0x55e0883512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe159adb640 1 --2- 172.21.15.170:0/2528316338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347150 0x55e0883512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe159adb640 1 -- 172.21.15.170:0/2528316338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347b40 msgr2=0x55e088351810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe159adb640 1 --2- 172.21.15.170:0/2528316338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347b40 0x55e088351810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe159adb640 1 -- 172.21.15.170:0/2528316338 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15000b7c0 con 0x55e08834ccb0 2024-01-25T15:02:27.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe158ad9640 1 --2- 172.21.15.170:0/2528316338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347b40 0x55e088351810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:27.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe1592da640 1 --2- 172.21.15.170:0/2528316338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347150 0x55e0883512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:27.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe159adb640 1 --2- 172.21.15.170:0/2528316338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e08834ccb0 0x55e088358850 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe14c036000 tx=0x7fe14c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf2b7ae1227c34a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe13cff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:27.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe13cff9640 1 -- 172.21.15.170:0/2528316338 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c003d80 con 0x55e08834ccb0 2024-01-25T15:02:27.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe13cff9640 1 -- 172.21.15.170:0/2528316338 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fe14c048040 con 0x55e08834ccb0 2024-01-25T15:02:27.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe15e1d3740 1 -- 172.21.15.170:0/2528316338 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0882a4e00 con 0x55e08834ccb0 2024-01-25T15:02:27.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe13cff9640 1 -- 172.21.15.170:0/2528316338 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe14c004040 con 0x55e08834ccb0 2024-01-25T15:02:27.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe15e1d3740 10 client.15615 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:27.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe15e1d3740 1 -- 172.21.15.170:0/2528316338 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e0882aa8d0 con 0x55e08834ccb0 2024-01-25T15:02:27.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.608+0000 7fe13cff9640 1 -- 172.21.15.170:0/2528316338 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e0882a4e00 con 0x55e08834ccb0 2024-01-25T15:02:27.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.609+0000 7fe13cff9640 1 -- 172.21.15.170:0/2528316338 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe14c03e070 con 0x55e08834ccb0 2024-01-25T15:02:27.618 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.609+0000 7fe15e1d3740 10 client.15615 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:27.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.609+0000 7fe15e1d3740 10 client.15615 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-01-25T15:02:27.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.609+0000 7fe15e1d3740 20 client.15615 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:27.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.609+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/2528316338 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55e08835d0b0 0x55e08835f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.609+0000 7fe15e1d3740 4 client.15615 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:02:27.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.609+0000 7fe15e1d3740 1 -- 172.21.15.170:0/2528316338 --> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e087fab7e0 con 0x55e08835d0b0 2024-01-25T15:02:27.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.609+0000 7fe1592da640 1 --2- 172.21.15.170:0/2528316338 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55e08835d0b0 0x55e08835f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.609+0000 7fe13cff9640 10 client.15615 ms_handle_connect on v2:172.21.15.186:6838/2132502182 2024-01-25T15:02:27.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.609+0000 7fe1592da640 1 --2- 172.21.15.170:0/2528316338 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55e08835d0b0 0x55e08835f4f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6707b2c5b8b66f84 server_cookie=951c3d998db1bf5d in_seq=0 out_seq=0 2024-01-25T15:02:27.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.610+0000 7fe13cff9640 1 -- 172.21.15.170:0/2528316338 <== mds.1 v2:172.21.15.186:6838/2132502182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e087fab7e0 con 0x55e08835d0b0 2024-01-25T15:02:27.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.610+0000 7fe13cff9640 10 client.15615 handle_command_reply: tid=0 2024-01-25T15:02:27.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.610+0000 7fe15e1d3740 1 client.15615 shutdown 2024-01-25T15:02:27.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.610+0000 7fe15e1d3740 1 -- 172.21.15.170:0/2528316338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e08834ccb0 msgr2=0x55e088358850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.610+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/2528316338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e08834ccb0 0x55e088358850 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fe14c036000 tx=0x7fe14c0095c0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.619 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.610+0000 7fe15e1d3740 1 -- 172.21.15.170:0/2528316338 shutdown_connections 2024-01-25T15:02:27.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.610+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/2528316338 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55e08835d0b0 0x55e08835f4f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.610+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/2528316338 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347b40 0x55e088351810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.610+0000 7fe13cff9640 0 client.15615 ms_handle_reset on v2:172.21.15.186:6838/2132502182 2024-01-25T15:02:27.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.610+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/2528316338 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e08834ccb0 0x55e088358850 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.610+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/2528316338 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347150 0x55e0883512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.610+0000 7fe15e1d3740 1 -- 172.21.15.170:0/2528316338 >> 172.21.15.170:0/2528316338 conn(0x55e0883404b0 msgr2=0x55e08833f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.610+0000 7fe15e1d3740 1 -- 172.21.15.170:0/2528316338 shutdown_connections 2024-01-25T15:02:27.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.610+0000 7fe15e1d3740 1 -- 172.21.15.170:0/2528316338 wait complete. 2024-01-25T15:02:27.620 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.610+0000 7fe15e1d3740 20 client.15615 trim_cache size 0 max 16384 2024-01-25T15:02:27.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.622+0000 7fe15e1d3740 1 Processor -- start 2024-01-25T15:02:27.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.622+0000 7fe15e1d3740 1 -- start start 2024-01-25T15:02:27.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.622+0000 7fe15e1d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e088347150 0x55e08833b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.622+0000 7fe15e1d3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347b40 0x55e088348f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.622+0000 7fe15e1d3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e08834ccb0 0x55e0883494a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.622+0000 7fe15e1d3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e087fab7e0 con 0x55e088347150 2024-01-25T15:02:27.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.622+0000 7fe15e1d3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0882a4e00 con 0x55e08834ccb0 2024-01-25T15:02:27.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.622+0000 7fe15e1d3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e08833bd20 con 0x55e088347b40 2024-01-25T15:02:27.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.622+0000 7fe1592da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e088347150 0x55e08833b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.623+0000 7fe1592da640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e088347150 0x55e08833b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53532/0 (socket says 172.21.15.170:53532) 2024-01-25T15:02:27.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.623+0000 7fe1592da640 1 -- 172.21.15.170:0/1292455573 learned_addr learned my addr 172.21.15.170:0/1292455573 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.623+0000 7fe158ad9640 1 --2- 172.21.15.170:0/1292455573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347b40 0x55e088348f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.623+0000 7fe159adb640 1 --2- 172.21.15.170:0/1292455573 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e08834ccb0 0x55e0883494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.623+0000 7fe1592da640 1 -- 172.21.15.170:0/1292455573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347b40 msgr2=0x55e088348f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.623+0000 7fe1592da640 1 --2- 172.21.15.170:0/1292455573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347b40 0x55e088348f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.623+0000 7fe1592da640 1 -- 172.21.15.170:0/1292455573 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e08834ccb0 msgr2=0x55e0883494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.623+0000 7fe1592da640 1 --2- 172.21.15.170:0/1292455573 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e08834ccb0 0x55e0883494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.623+0000 7fe1592da640 1 -- 172.21.15.170:0/1292455573 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e088247500 con 0x55e088347150 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.623+0000 7fe1592da640 1 --2- 172.21.15.170:0/1292455573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e088347150 0x55e08833b7e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe15000bd70 tx=0x7fe150005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c5f2588e3f10ce server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.623+0000 7fe13effd640 1 -- 172.21.15.170:0/1292455573 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15001f040 con 0x55e088347150 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.623+0000 7fe13effd640 1 -- 172.21.15.170:0/1292455573 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1500258d0 con 0x55e088347150 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.623+0000 7fe13effd640 1 -- 172.21.15.170:0/1292455573 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150003850 con 0x55e088347150 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.624+0000 7fe15e1d3740 1 -- 172.21.15.170:0/1292455573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e088347150 msgr2=0x55e08833b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.624+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/1292455573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e088347150 0x55e08833b7e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fe15000bd70 tx=0x7fe150005cb0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.624+0000 7fe15e1d3740 1 -- 172.21.15.170:0/1292455573 shutdown_connections 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.624+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/1292455573 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e08834ccb0 0x55e0883494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.624+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/1292455573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347b40 0x55e088348f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.624+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/1292455573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e088347150 0x55e08833b7e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.624+0000 7fe15e1d3740 1 -- 172.21.15.170:0/1292455573 >> 172.21.15.170:0/1292455573 conn(0x55e0883404b0 msgr2=0x55e088340890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.624+0000 7fe15e1d3740 1 -- 172.21.15.170:0/1292455573 shutdown_connections 2024-01-25T15:02:27.630 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.624+0000 7fe15e1d3740 1 -- 172.21.15.170:0/1292455573 wait complete. 2024-01-25T15:02:27.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.624+0000 7fe15e1d3740 1 -- start start 2024-01-25T15:02:27.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.624+0000 7fe15e1d3740 1 Processor -- start 2024-01-25T15:02:27.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe15e1d3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347150 0x55e0883adf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe15e1d3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347b40 0x55e0883ae440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe15e1d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e08834ccb0 0x55e0883b5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe15e1d3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0883b59c0 con 0x55e08834ccb0 2024-01-25T15:02:27.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe15e1d3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0883b5b00 con 0x55e088347150 2024-01-25T15:02:27.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe15e1d3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0883b5c70 con 0x55e088347b40 2024-01-25T15:02:27.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe15e1d3740 10 client.0 _ll_register_callbacks cb 0x7fe15000b300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:27.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe159adb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e08834ccb0 0x55e0883b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe159adb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e08834ccb0 0x55e0883b5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53540/0 (socket says 172.21.15.170:53540) 2024-01-25T15:02:27.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe159adb640 1 -- 172.21.15.170:0/173853356 learned_addr learned my addr 172.21.15.170:0/173853356 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe1592da640 1 --2- 172.21.15.170:0/173853356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347150 0x55e0883adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.631 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe158ad9640 1 --2- 172.21.15.170:0/173853356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347b40 0x55e0883ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe159adb640 1 -- 172.21.15.170:0/173853356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347b40 msgr2=0x55e0883ae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe159adb640 1 --2- 172.21.15.170:0/173853356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347b40 0x55e0883ae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe159adb640 1 -- 172.21.15.170:0/173853356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347150 msgr2=0x55e0883adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe159adb640 1 --2- 172.21.15.170:0/173853356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347150 0x55e0883adf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe159adb640 1 -- 172.21.15.170:0/173853356 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e08826e7f0 con 0x55e08834ccb0 2024-01-25T15:02:27.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe159adb640 1 --2- 172.21.15.170:0/173853356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e08834ccb0 0x55e0883b5480 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe14c036000 tx=0x7fe14c009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e7946897e277337 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe13cff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:27.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.625+0000 7fe13cff9640 1 -- 172.21.15.170:0/173853356 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c003d80 con 0x55e08834ccb0 2024-01-25T15:02:27.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.626+0000 7fe13cff9640 1 -- 172.21.15.170:0/173853356 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fe14c034e40 con 0x55e08834ccb0 2024-01-25T15:02:27.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.626+0000 7fe15e1d3740 1 -- 172.21.15.170:0/173853356 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0882a50e0 con 0x55e08834ccb0 2024-01-25T15:02:27.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.626+0000 7fe13cff9640 1 -- 172.21.15.170:0/173853356 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe14c043b60 con 0x55e08834ccb0 2024-01-25T15:02:27.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.626+0000 7fe15e1d3740 10 client.15621 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:27.632 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.626+0000 7fe15e1d3740 1 -- 172.21.15.170:0/173853356 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e08826d050 con 0x55e08834ccb0 2024-01-25T15:02:27.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.626+0000 7fe13cff9640 1 -- 172.21.15.170:0/173853356 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe14c072020 con 0x55e08834ccb0 2024-01-25T15:02:27.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.626+0000 7fe13cff9640 1 -- 172.21.15.170:0/173853356 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe14c06c020 con 0x55e08834ccb0 2024-01-25T15:02:27.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.626+0000 7fe15e1d3740 10 client.15621 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:27.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.626+0000 7fe15e1d3740 10 client.15621 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-01-25T15:02:27.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.626+0000 7fe15e1d3740 20 client.15621 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:27.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.626+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/173853356 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55e0883b73f0 0x55e0883b9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.626+0000 7fe15e1d3740 4 client.15621 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:02:27.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.626+0000 7fe15e1d3740 1 -- 172.21.15.170:0/173853356 --> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e087ffee30 con 0x55e0883b73f0 2024-01-25T15:02:27.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.626+0000 7fe1592da640 1 --2- 172.21.15.170:0/173853356 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55e0883b73f0 0x55e0883b9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe13cff9640 10 client.15621 ms_handle_connect on v2:172.21.15.186:6838/2132502182 2024-01-25T15:02:27.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe1592da640 1 --2- 172.21.15.170:0/173853356 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55e0883b73f0 0x55e0883b9810 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3346c3de88b031b6 server_cookie=fa3bdbfef6e4e786 in_seq=0 out_seq=0 2024-01-25T15:02:27.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe13cff9640 1 -- 172.21.15.170:0/173853356 <== mds.1 v2:172.21.15.186:6838/2132502182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e087ffee30 con 0x55e0883b73f0 2024-01-25T15:02:27.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe13cff9640 10 client.15621 handle_command_reply: tid=0 2024-01-25T15:02:27.633 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe15e1d3740 1 client.15621 shutdown 2024-01-25T15:02:27.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe15e1d3740 1 -- 172.21.15.170:0/173853356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e08834ccb0 msgr2=0x55e0883b5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/173853356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e08834ccb0 0x55e0883b5480 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fe14c036000 tx=0x7fe14c009ba0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe15e1d3740 1 -- 172.21.15.170:0/173853356 shutdown_connections 2024-01-25T15:02:27.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/173853356 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55e0883b73f0 0x55e0883b9810 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/173853356 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e08834ccb0 0x55e0883b5480 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe13cff9640 0 client.15621 ms_handle_reset on v2:172.21.15.186:6838/2132502182 2024-01-25T15:02:27.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/173853356 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e088347b40 0x55e0883ae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe15e1d3740 1 --2- 172.21.15.170:0/173853356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e088347150 0x55e0883adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe15e1d3740 1 -- 172.21.15.170:0/173853356 >> 172.21.15.170:0/173853356 conn(0x55e0883404b0 msgr2=0x55e088351210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe15e1d3740 1 -- 172.21.15.170:0/173853356 shutdown_connections 2024-01-25T15:02:27.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe15e1d3740 1 -- 172.21.15.170:0/173853356 wait complete. 2024-01-25T15:02:27.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.627+0000 7fe15e1d3740 20 client.15621 trim_cache size 0 max 16384 2024-01-25T15:02:27.635 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:02:27.635 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.628+0000 7fe15b53e640 1 -- 172.21.15.170:0/2379584930 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe1400a1370 msgr2=0x7fe1400a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.628+0000 7fe15b53e640 1 --2- 172.21.15.170:0/2379584930 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe1400a1370 0x7fe1400a3830 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe14c02c630 tx=0x7fe14c02c0f0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.628+0000 7fe15b53e640 1 -- 172.21.15.170:0/2379584930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe154100de0 msgr2=0x7fe1541960d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.628+0000 7fe15b53e640 1 --2- 172.21.15.170:0/2379584930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe154100de0 0x7fe1541960d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe14400d770 tx=0x7fe14400dc30 comp rx=0 tx=0).stop 2024-01-25T15:02:27.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.628+0000 7fe15b53e640 1 -- 172.21.15.170:0/2379584930 shutdown_connections 2024-01-25T15:02:27.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.628+0000 7fe15b53e640 1 --2- 172.21.15.170:0/2379584930 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe1400a1370 0x7fe1400a3830 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.628+0000 7fe15b53e640 1 --2- 172.21.15.170:0/2379584930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1541017a0 0x7fe15419d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.628+0000 7fe15b53e640 1 --2- 172.21.15.170:0/2379584930 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe154100de0 0x7fe1541960d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.628+0000 7fe15b53e640 1 --2- 172.21.15.170:0/2379584930 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1540ffbf0 0x7fe154195b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.628+0000 7fe15b53e640 1 -- 172.21.15.170:0/2379584930 >> 172.21.15.170:0/2379584930 conn(0x7fe1540fb180 msgr2=0x7fe154104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.628+0000 7fe15b53e640 1 -- 172.21.15.170:0/2379584930 shutdown_connections 2024-01-25T15:02:27.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.628+0000 7fe15b53e640 1 -- 172.21.15.170:0/2379584930 wait complete. 2024-01-25T15:02:27.640 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-01-25T15:02:27.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:27 smithi191 ceph-mon[36347]: pgmap v362: 97 pgs: 97 active+clean; 657 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-01-25T15:02:27.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:27 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/4268456170' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:02:27.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.743+0000 7fd363b03640 1 -- 172.21.15.170:0/3318829707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd35c1040a0 msgr2=0x7fd35c106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.743+0000 7fd363b03640 1 --2- 172.21.15.170:0/3318829707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd35c1040a0 0x7fd35c106490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009860 tx=0x7fd34c02bb70 comp rx=0 tx=0).stop 2024-01-25T15:02:27.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd363b03640 1 -- 172.21.15.170:0/3318829707 shutdown_connections 2024-01-25T15:02:27.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd363b03640 1 --2- 172.21.15.170:0/3318829707 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd35c1069d0 0x7fd35c108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd363b03640 1 --2- 172.21.15.170:0/3318829707 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd35c1040a0 0x7fd35c106490 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd363b03640 1 --2- 172.21.15.170:0/3318829707 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd35c101770 0x7fd35c103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd363b03640 1 -- 172.21.15.170:0/3318829707 >> 172.21.15.170:0/3318829707 conn(0x7fd35c0fb180 msgr2=0x7fd35c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd363b03640 1 -- 172.21.15.170:0/3318829707 shutdown_connections 2024-01-25T15:02:27.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd363b03640 1 -- 172.21.15.170:0/3318829707 wait complete. 2024-01-25T15:02:27.747 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd363b03640 1 Processor -- start 2024-01-25T15:02:27.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd363b03640 1 -- start start 2024-01-25T15:02:27.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd363b03640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd35c101770 0x7fd35c196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd363b03640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd35c1040a0 0x7fd35c197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd363b03640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd35c1069d0 0x7fd35c19e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd363b03640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c19e830 con 0x7fd35c1040a0 2024-01-25T15:02:27.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd363b03640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c19e9a0 con 0x7fd35c101770 2024-01-25T15:02:27.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd363b03640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c19eb60 con 0x7fd35c1069d0 2024-01-25T15:02:27.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.744+0000 7fd36109e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd35c1040a0 0x7fd35c197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.745+0000 7fd36109e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd35c1040a0 0x7fd35c197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53550/0 (socket says 172.21.15.170:53550) 2024-01-25T15:02:27.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.745+0000 7fd36109e640 1 -- 172.21.15.170:0/1576473951 learned_addr learned my addr 172.21.15.170:0/1576473951 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.745+0000 7fd3620a0640 1 --2- 172.21.15.170:0/1576473951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd35c1069d0 0x7fd35c19e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.745+0000 7fd36189f640 1 --2- 172.21.15.170:0/1576473951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd35c101770 0x7fd35c196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.745+0000 7fd36109e640 1 -- 172.21.15.170:0/1576473951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd35c1069d0 msgr2=0x7fd35c19e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.745+0000 7fd36109e640 1 --2- 172.21.15.170:0/1576473951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd35c1069d0 0x7fd35c19e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.745+0000 7fd36109e640 1 -- 172.21.15.170:0/1576473951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd35c101770 msgr2=0x7fd35c196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.745+0000 7fd36109e640 1 --2- 172.21.15.170:0/1576473951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd35c101770 0x7fd35c196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.745+0000 7fd36109e640 1 -- 172.21.15.170:0/1576473951 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c009490 con 0x7fd35c1040a0 2024-01-25T15:02:27.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.745+0000 7fd36109e640 1 --2- 172.21.15.170:0/1576473951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd35c1040a0 0x7fd35c197290 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd34c034a00 tx=0x7fd34c034830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.745+0000 7fd352ffd640 1 -- 172.21.15.170:0/1576473951 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c005050 con 0x7fd35c1040a0 2024-01-25T15:02:27.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.745+0000 7fd363b03640 1 -- 172.21.15.170:0/1576473951 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35c19ede0 con 0x7fd35c1040a0 2024-01-25T15:02:27.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.745+0000 7fd352ffd640 1 -- 172.21.15.170:0/1576473951 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd34c005670 con 0x7fd35c1040a0 2024-01-25T15:02:27.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.745+0000 7fd352ffd640 1 -- 172.21.15.170:0/1576473951 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c004920 con 0x7fd35c1040a0 2024-01-25T15:02:27.749 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.745+0000 7fd363b03640 1 -- 172.21.15.170:0/1576473951 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35c19f220 con 0x7fd35c1040a0 2024-01-25T15:02:27.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.747+0000 7fd352ffd640 1 -- 172.21.15.170:0/1576473951 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7fd34c03b040 con 0x7fd35c1040a0 2024-01-25T15:02:27.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.748+0000 7fd3667a7740 1 Processor -- start 2024-01-25T15:02:27.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.748+0000 7fd3667a7740 1 -- start start 2024-01-25T15:02:27.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.748+0000 7fd352ffd640 1 --2- 172.21.15.170:0/1576473951 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd3480a1370 0x7fd3480a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.756 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.748+0000 7fd3667a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38acf40 0x5568e38ad360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.748+0000 7fd3667a7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38ad930 0x5568e38b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.748+0000 7fd3667a7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38b2aa0 0x5568e38b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.748+0000 7fd3667a7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e381b270 con 0x5568e38b2aa0 2024-01-25T15:02:27.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.748+0000 7fd3667a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e3818960 con 0x5568e38acf40 2024-01-25T15:02:27.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.748+0000 7fd3667a7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e3814250 con 0x5568e38ad930 2024-01-25T15:02:27.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.748+0000 7fd352ffd640 1 -- 172.21.15.170:0/1576473951 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fd34c0eea40 con 0x7fd35c1040a0 2024-01-25T15:02:27.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.748+0000 7fd3620a0640 1 --2- 172.21.15.170:0/1576473951 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd3480a1370 0x7fd3480a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd36189f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38acf40 0x5568e38ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd36189f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38acf40 0x5568e38ad360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:37928/0 (socket says 172.21.15.170:37928) 2024-01-25T15:02:27.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd36189f640 1 -- 172.21.15.170:0/920463793 learned_addr learned my addr 172.21.15.170:0/920463793 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd3620a0640 1 --2- 172.21.15.170:0/920463793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38b2aa0 0x5568e38b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd36109e640 1 --2- 172.21.15.170:0/920463793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38ad930 0x5568e38b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd36189f640 1 -- 172.21.15.170:0/920463793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38ad930 msgr2=0x5568e38b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.757 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd36189f640 1 --2- 172.21.15.170:0/920463793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38ad930 0x5568e38b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd36189f640 1 -- 172.21.15.170:0/920463793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38b2aa0 msgr2=0x5568e38b4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd36189f640 1 --2- 172.21.15.170:0/920463793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38b2aa0 0x5568e38b4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd36189f640 1 -- 172.21.15.170:0/920463793 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568e37d67f0 con 0x5568e38acf40 2024-01-25T15:02:27.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd36109e640 1 --2- 172.21.15.170:0/920463793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38ad930 0x5568e38b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:27.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd3620a0640 1 --2- 172.21.15.170:0/1576473951 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd3480a1370 0x7fd3480a3830 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd354009670 tx=0x7fd354009b50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd36189f640 1 --2- 172.21.15.170:0/920463793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38acf40 0x5568e38ad360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd358009f40 tx=0x7fd358010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64620b2db01132dd server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd347fff640 1 -- 172.21.15.170:0/920463793 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35801b660 con 0x5568e38acf40 2024-01-25T15:02:27.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd347fff640 1 -- 172.21.15.170:0/920463793 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd35801bc80 con 0x5568e38acf40 2024-01-25T15:02:27.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.749+0000 7fd347fff640 1 -- 172.21.15.170:0/920463793 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358012bc0 con 0x5568e38acf40 2024-01-25T15:02:27.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.750+0000 7fd3667a7740 1 -- 172.21.15.170:0/920463793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38acf40 msgr2=0x5568e38ad360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.750+0000 7fd3667a7740 1 --2- 172.21.15.170:0/920463793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38acf40 0x5568e38ad360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd358009f40 tx=0x7fd358010800 comp rx=0 tx=0).stop 2024-01-25T15:02:27.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.750+0000 7fd3667a7740 1 -- 172.21.15.170:0/920463793 shutdown_connections 2024-01-25T15:02:27.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.750+0000 7fd3667a7740 1 --2- 172.21.15.170:0/920463793 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38b2aa0 0x5568e38b4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.750+0000 7fd3667a7740 1 --2- 172.21.15.170:0/920463793 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38ad930 0x5568e38b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.758 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.750+0000 7fd3667a7740 1 --2- 172.21.15.170:0/920463793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38acf40 0x5568e38ad360 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.750+0000 7fd3667a7740 1 -- 172.21.15.170:0/920463793 >> 172.21.15.170:0/920463793 conn(0x5568e38a84b0 msgr2=0x5568e38a88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.750+0000 7fd3667a7740 1 -- 172.21.15.170:0/920463793 shutdown_connections 2024-01-25T15:02:27.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.750+0000 7fd3667a7740 1 -- 172.21.15.170:0/920463793 wait complete. 2024-01-25T15:02:27.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd3667a7740 1 -- start start 2024-01-25T15:02:27.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd3667a7740 1 Processor -- start 2024-01-25T15:02:27.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd3667a7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38acf40 0x5568e38b7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd3667a7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38ad930 0x5568e38b7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd3667a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38b2aa0 0x5568e38be6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd3667a7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e37cd610 con 0x5568e38ad930 2024-01-25T15:02:27.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd3667a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e37cd2b0 con 0x5568e38b2aa0 2024-01-25T15:02:27.759 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd3667a7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e3792400 con 0x5568e38acf40 2024-01-25T15:02:27.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd3667a7740 10 client.0 _ll_register_callbacks cb 0x5568e380aee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:27.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd36109e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38ad930 0x5568e38b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd36109e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38ad930 0x5568e38b7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53562/0 (socket says 172.21.15.170:53562) 2024-01-25T15:02:27.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd36109e640 1 -- 172.21.15.170:0/3534311666 learned_addr learned my addr 172.21.15.170:0/3534311666 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd3620a0640 1 --2- 172.21.15.170:0/3534311666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38b2aa0 0x5568e38be6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd36109e640 1 -- 172.21.15.170:0/3534311666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38acf40 msgr2=0x5568e38b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd36109e640 1 --2- 172.21.15.170:0/3534311666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38acf40 0x5568e38b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd36109e640 1 -- 172.21.15.170:0/3534311666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38b2aa0 msgr2=0x5568e38be6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd36109e640 1 --2- 172.21.15.170:0/3534311666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38b2aa0 0x5568e38be6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd36109e640 1 -- 172.21.15.170:0/3534311666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd358009ba0 con 0x5568e38ad930 2024-01-25T15:02:27.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.751+0000 7fd3620a0640 1 --2- 172.21.15.170:0/3534311666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38b2aa0 0x5568e38be6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:27.760 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd36109e640 1 --2- 172.21.15.170:0/3534311666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38ad930 0x5568e38b7670 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0bbaf0 tx=0x7fd34c0ec8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1c206c38bc6998 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd3457fa640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:27.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd3457fa640 1 -- 172.21.15.170:0/3534311666 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0bb250 con 0x5568e38ad930 2024-01-25T15:02:27.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd3457fa640 1 -- 172.21.15.170:0/3534311666 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fd34c0bc260 con 0x5568e38ad930 2024-01-25T15:02:27.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd3667a7740 1 -- 172.21.15.170:0/3534311666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568e380d0e0 con 0x5568e38ad930 2024-01-25T15:02:27.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd3457fa640 1 -- 172.21.15.170:0/3534311666 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd34c02c820 con 0x5568e38ad930 2024-01-25T15:02:27.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd3667a7740 10 client.15633 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:27.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd3667a7740 1 -- 172.21.15.170:0/3534311666 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5568e38128d0 con 0x5568e38ad930 2024-01-25T15:02:27.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd3457fa640 1 -- 172.21.15.170:0/3534311666 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5568e380d0e0 con 0x5568e38ad930 2024-01-25T15:02:27.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd3457fa640 1 -- 172.21.15.170:0/3534311666 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd34c0c3a60 con 0x5568e38ad930 2024-01-25T15:02:27.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd3667a7740 10 client.15633 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:27.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd3667a7740 10 client.15633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:27.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd3667a7740 20 client.15633 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:27.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd3667a7740 1 --2- 172.21.15.170:0/3534311666 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5568e38c2ba0 0x5568e38c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.761 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd3667a7740 4 client.15633 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:02:27.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd3667a7740 1 -- 172.21.15.170:0/3534311666 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568e380ce00 con 0x5568e38c2ba0 2024-01-25T15:02:27.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.752+0000 7fd36189f640 1 --2- 172.21.15.170:0/3534311666 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5568e38c2ba0 0x5568e38c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.753+0000 7fd3457fa640 10 client.15633 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:27.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.753+0000 7fd36189f640 1 --2- 172.21.15.170:0/3534311666 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5568e38c2ba0 0x5568e38c4fb0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81c94fca0807bf10 server_cookie=47af14214fea04aa in_seq=0 out_seq=0 2024-01-25T15:02:27.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.753+0000 7fd3457fa640 1 -- 172.21.15.170:0/3534311666 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5568e380ce00 con 0x5568e38c2ba0 2024-01-25T15:02:27.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.753+0000 7fd3457fa640 10 client.15633 handle_command_reply: tid=0 2024-01-25T15:02:27.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.754+0000 7fd3667a7740 1 client.15633 shutdown 2024-01-25T15:02:27.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.754+0000 7fd3667a7740 1 -- 172.21.15.170:0/3534311666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38ad930 msgr2=0x5568e38b7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.754+0000 7fd3667a7740 1 --2- 172.21.15.170:0/3534311666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38ad930 0x5568e38b7670 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0bbaf0 tx=0x7fd34c0ec8a0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.754+0000 7fd3667a7740 1 -- 172.21.15.170:0/3534311666 shutdown_connections 2024-01-25T15:02:27.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.754+0000 7fd3667a7740 1 --2- 172.21.15.170:0/3534311666 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5568e38c2ba0 0x5568e38c4fb0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.754+0000 7fd3667a7740 1 --2- 172.21.15.170:0/3534311666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38b2aa0 0x5568e38be6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.754+0000 7fd3457fa640 0 client.15633 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:27.762 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.754+0000 7fd3667a7740 1 --2- 172.21.15.170:0/3534311666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38ad930 0x5568e38b7670 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.754+0000 7fd3667a7740 1 --2- 172.21.15.170:0/3534311666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38acf40 0x5568e38b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.754+0000 7fd3667a7740 1 -- 172.21.15.170:0/3534311666 >> 172.21.15.170:0/3534311666 conn(0x5568e38a84b0 msgr2=0x5568e38a77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.754+0000 7fd3667a7740 1 -- 172.21.15.170:0/3534311666 shutdown_connections 2024-01-25T15:02:27.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.754+0000 7fd3667a7740 1 -- 172.21.15.170:0/3534311666 wait complete. 2024-01-25T15:02:27.763 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.754+0000 7fd3667a7740 20 client.15633 trim_cache size 0 max 16384 2024-01-25T15:02:27.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.766+0000 7fd3667a7740 1 Processor -- start 2024-01-25T15:02:27.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.766+0000 7fd3667a7740 1 -- start start 2024-01-25T15:02:27.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.766+0000 7fd3667a7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38a84b0 0x5568e38a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.766+0000 7fd3667a7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38acf40 0x5568e38be670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.766+0000 7fd3667a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38ad930 0x5568e38a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.766+0000 7fd3667a7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e38a8cf0 con 0x5568e38acf40 2024-01-25T15:02:27.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.766+0000 7fd3667a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e38a4290 con 0x5568e38ad930 2024-01-25T15:02:27.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.766+0000 7fd3667a7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e38b55f0 con 0x5568e38a84b0 2024-01-25T15:02:27.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.766+0000 7fd36109e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38acf40 0x5568e38be670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.774 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.766+0000 7fd36109e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38acf40 0x5568e38be670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53572/0 (socket says 172.21.15.170:53572) 2024-01-25T15:02:27.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.766+0000 7fd36109e640 1 -- 172.21.15.170:0/1319379642 learned_addr learned my addr 172.21.15.170:0/1319379642 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.767+0000 7fd36109e640 1 -- 172.21.15.170:0/1319379642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38a84b0 msgr2=0x5568e38a6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.767+0000 7fd36109e640 1 --2- 172.21.15.170:0/1319379642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38a84b0 0x5568e38a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.767+0000 7fd36109e640 1 -- 172.21.15.170:0/1319379642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38ad930 msgr2=0x5568e38a74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.767+0000 7fd3620a0640 1 --2- 172.21.15.170:0/1319379642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38ad930 0x5568e38a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.767+0000 7fd36109e640 1 --2- 172.21.15.170:0/1319379642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38ad930 0x5568e38a74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.767+0000 7fd36109e640 1 -- 172.21.15.170:0/1319379642 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568e37af500 con 0x5568e38acf40 2024-01-25T15:02:27.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.767+0000 7fd36109e640 1 --2- 172.21.15.170:0/1319379642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38acf40 0x5568e38be670 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0b8540 tx=0x7fd34c02ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a65e70dc6b35df7 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.767+0000 7fd3477fe640 1 -- 172.21.15.170:0/1319379642 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c02c820 con 0x5568e38acf40 2024-01-25T15:02:27.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.767+0000 7fd3477fe640 1 -- 172.21.15.170:0/1319379642 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd34c0bce90 con 0x5568e38acf40 2024-01-25T15:02:27.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.767+0000 7fd3477fe640 1 -- 172.21.15.170:0/1319379642 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c0bb2b0 con 0x5568e38acf40 2024-01-25T15:02:27.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.768+0000 7fd3667a7740 1 -- 172.21.15.170:0/1319379642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38acf40 msgr2=0x5568e38be670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.768+0000 7fd3667a7740 1 --2- 172.21.15.170:0/1319379642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38acf40 0x5568e38be670 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0b8540 tx=0x7fd34c02ccc0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.768+0000 7fd3667a7740 1 -- 172.21.15.170:0/1319379642 shutdown_connections 2024-01-25T15:02:27.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.768+0000 7fd3667a7740 1 --2- 172.21.15.170:0/1319379642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38ad930 0x5568e38a74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.768+0000 7fd3667a7740 1 --2- 172.21.15.170:0/1319379642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38acf40 0x5568e38be670 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.768+0000 7fd3667a7740 1 --2- 172.21.15.170:0/1319379642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38a84b0 0x5568e38a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.768+0000 7fd3667a7740 1 -- 172.21.15.170:0/1319379642 >> 172.21.15.170:0/1319379642 conn(0x5568e38ae710 msgr2=0x5568e38aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.768+0000 7fd3667a7740 1 -- 172.21.15.170:0/1319379642 shutdown_connections 2024-01-25T15:02:27.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.768+0000 7fd3667a7740 1 -- 172.21.15.170:0/1319379642 wait complete. 2024-01-25T15:02:27.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.768+0000 7fd3667a7740 1 -- start start 2024-01-25T15:02:27.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.768+0000 7fd3667a7740 1 Processor -- start 2024-01-25T15:02:27.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3667a7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38a84b0 0x5568e38bd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3667a7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38acf40 0x5568e38bde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3667a7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38ad930 0x5568e39191f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3667a7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e3919730 con 0x5568e38ad930 2024-01-25T15:02:27.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3667a7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e3919870 con 0x5568e38acf40 2024-01-25T15:02:27.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3667a7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568e3919a00 con 0x5568e38a84b0 2024-01-25T15:02:27.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3667a7740 10 client.0 _ll_register_callbacks cb 0x7fd358009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:27.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3620a0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38ad930 0x5568e39191f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3620a0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38ad930 0x5568e39191f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53576/0 (socket says 172.21.15.170:53576) 2024-01-25T15:02:27.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3620a0640 1 -- 172.21.15.170:0/2532568376 learned_addr learned my addr 172.21.15.170:0/2532568376 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:27.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd36189f640 1 --2- 172.21.15.170:0/2532568376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38a84b0 0x5568e38bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.777 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd36109e640 1 --2- 172.21.15.170:0/2532568376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38acf40 0x5568e38bde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3620a0640 1 -- 172.21.15.170:0/2532568376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38a84b0 msgr2=0x5568e38bd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3620a0640 1 --2- 172.21.15.170:0/2532568376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38a84b0 0x5568e38bd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3620a0640 1 -- 172.21.15.170:0/2532568376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38acf40 msgr2=0x5568e38bde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:27.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3620a0640 1 --2- 172.21.15.170:0/2532568376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38acf40 0x5568e38bde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3620a0640 1 -- 172.21.15.170:0/2532568376 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568e38128d0 con 0x5568e38ad930 2024-01-25T15:02:27.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3620a0640 1 --2- 172.21.15.170:0/2532568376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38ad930 0x5568e39191f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd354011760 tx=0x7fd354009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51de1a1051c58b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:27.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.769+0000 7fd3457fa640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:27.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.770+0000 7fd3457fa640 1 -- 172.21.15.170:0/2532568376 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354016040 con 0x5568e38ad930 2024-01-25T15:02:27.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.770+0000 7fd3457fa640 1 -- 172.21.15.170:0/2532568376 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fd354009e20 con 0x5568e38ad930 2024-01-25T15:02:27.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.770+0000 7fd3667a7740 1 -- 172.21.15.170:0/2532568376 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd35801bc80 con 0x5568e38ad930 2024-01-25T15:02:27.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.770+0000 7fd3457fa640 1 -- 172.21.15.170:0/2532568376 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd35401f9c0 con 0x5568e38ad930 2024-01-25T15:02:27.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.770+0000 7fd3667a7740 10 client.15639 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:27.778 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.770+0000 7fd3667a7740 1 -- 172.21.15.170:0/2532568376 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5568e37d5050 con 0x5568e38ad930 2024-01-25T15:02:27.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.770+0000 7fd3457fa640 1 -- 172.21.15.170:0/2532568376 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd35801bc80 con 0x5568e38ad930 2024-01-25T15:02:27.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.770+0000 7fd3457fa640 1 -- 172.21.15.170:0/2532568376 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd354010cd0 con 0x5568e38ad930 2024-01-25T15:02:27.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.770+0000 7fd3667a7740 10 client.15639 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:27.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.770+0000 7fd3667a7740 10 client.15639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:27.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.770+0000 7fd3667a7740 20 client.15639 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:27.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.770+0000 7fd3667a7740 1 --2- 172.21.15.170:0/2532568376 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5568e38b2aa0 0x5568e391d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:27.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.770+0000 7fd3667a7740 4 client.15639 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:02:27.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.770+0000 7fd3667a7740 1 -- 172.21.15.170:0/2532568376 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5568e35137e0 con 0x5568e38b2aa0 2024-01-25T15:02:27.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.770+0000 7fd36189f640 1 --2- 172.21.15.170:0/2532568376 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5568e38b2aa0 0x5568e391d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:27.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd36189f640 1 --2- 172.21.15.170:0/2532568376 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5568e38b2aa0 0x5568e391d590 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c33a7018d6444953 server_cookie=1b311942fc1ef3e9 in_seq=0 out_seq=0 2024-01-25T15:02:27.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3457fa640 10 client.15639 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:27.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3457fa640 1 -- 172.21.15.170:0/2532568376 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5568e35137e0 con 0x5568e38b2aa0 2024-01-25T15:02:27.779 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3457fa640 10 client.15639 handle_command_reply: tid=0 2024-01-25T15:02:27.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3667a7740 1 client.15639 shutdown 2024-01-25T15:02:27.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3667a7740 1 -- 172.21.15.170:0/2532568376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38ad930 msgr2=0x5568e39191f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3667a7740 1 --2- 172.21.15.170:0/2532568376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38ad930 0x5568e39191f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fd354011760 tx=0x7fd354009260 comp rx=0 tx=0).stop 2024-01-25T15:02:27.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3667a7740 1 -- 172.21.15.170:0/2532568376 shutdown_connections 2024-01-25T15:02:27.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3667a7740 1 --2- 172.21.15.170:0/2532568376 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5568e38b2aa0 0x5568e391d590 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3667a7740 1 --2- 172.21.15.170:0/2532568376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5568e38acf40 0x5568e38bde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3667a7740 1 --2- 172.21.15.170:0/2532568376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5568e38ad930 0x5568e39191f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.780 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3667a7740 1 --2- 172.21.15.170:0/2532568376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5568e38a84b0 0x5568e38bd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3457fa640 0 client.15639 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:27.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3667a7740 1 -- 172.21.15.170:0/2532568376 >> 172.21.15.170:0/2532568376 conn(0x5568e38ae710 msgr2=0x5568e38ab710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3667a7740 1 -- 172.21.15.170:0/2532568376 shutdown_connections 2024-01-25T15:02:27.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3667a7740 1 -- 172.21.15.170:0/2532568376 wait complete. 2024-01-25T15:02:27.781 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.771+0000 7fd3667a7740 20 client.15639 trim_cache size 0 max 16384 2024-01-25T15:02:27.781 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:02:27.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.772+0000 7fd363b03640 1 -- 172.21.15.170:0/1576473951 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd3480a1370 msgr2=0x7fd3480a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.772+0000 7fd363b03640 1 --2- 172.21.15.170:0/1576473951 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd3480a1370 0x7fd3480a3830 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd354009670 tx=0x7fd354009b50 comp rx=0 tx=0).stop 2024-01-25T15:02:27.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.772+0000 7fd363b03640 1 -- 172.21.15.170:0/1576473951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd35c1040a0 msgr2=0x7fd35c197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:27.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.772+0000 7fd363b03640 1 --2- 172.21.15.170:0/1576473951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd35c1040a0 0x7fd35c197290 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fd34c034a00 tx=0x7fd34c034830 comp rx=0 tx=0).stop 2024-01-25T15:02:27.782 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.772+0000 7fd363b03640 1 -- 172.21.15.170:0/1576473951 shutdown_connections 2024-01-25T15:02:27.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.772+0000 7fd363b03640 1 --2- 172.21.15.170:0/1576473951 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd3480a1370 0x7fd3480a3830 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.772+0000 7fd363b03640 1 --2- 172.21.15.170:0/1576473951 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd35c1069d0 0x7fd35c19e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.772+0000 7fd363b03640 1 --2- 172.21.15.170:0/1576473951 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd35c1040a0 0x7fd35c197290 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.772+0000 7fd363b03640 1 --2- 172.21.15.170:0/1576473951 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd35c101770 0x7fd35c196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:27.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.772+0000 7fd363b03640 1 -- 172.21.15.170:0/1576473951 >> 172.21.15.170:0/1576473951 conn(0x7fd35c0fb180 msgr2=0x7fd35c103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:27.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.772+0000 7fd363b03640 1 -- 172.21.15.170:0/1576473951 shutdown_connections 2024-01-25T15:02:27.783 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:27.772+0000 7fd363b03640 1 -- 172.21.15.170:0/1576473951 wait complete. 2024-01-25T15:02:28.784 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-01-25T15:02:28.785 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-01-25T15:02:28.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.891+0000 7f71e611a640 1 -- 172.21.15.170:0/3621368158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e0100de0 msgr2=0x7f71e0101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:28.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.891+0000 7f71e611a640 1 --2- 172.21.15.170:0/3621368158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e0100de0 0x7f71e0101260 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009900 tx=0x7f71d402bc30 comp rx=0 tx=0).stop 2024-01-25T15:02:28.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.891+0000 7f71e611a640 1 -- 172.21.15.170:0/3621368158 shutdown_connections 2024-01-25T15:02:28.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.891+0000 7f71e611a640 1 --2- 172.21.15.170:0/3621368158 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71e01017a0 0x7f71e0108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.891+0000 7f71e611a640 1 --2- 172.21.15.170:0/3621368158 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e0100de0 0x7f71e0101260 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.891+0000 7f71e611a640 1 --2- 172.21.15.170:0/3621368158 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71e00ffbf0 0x7f71e0100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.891+0000 7f71e611a640 1 -- 172.21.15.170:0/3621368158 >> 172.21.15.170:0/3621368158 conn(0x7f71e00fb180 msgr2=0x7f71e00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:28.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.891+0000 7f71e611a640 1 -- 172.21.15.170:0/3621368158 shutdown_connections 2024-01-25T15:02:28.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.891+0000 7f71e611a640 1 -- 172.21.15.170:0/3621368158 wait complete. 2024-01-25T15:02:28.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.892+0000 7f71e611a640 1 Processor -- start 2024-01-25T15:02:28.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.892+0000 7f71e611a640 1 -- start start 2024-01-25T15:02:28.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.892+0000 7f71e611a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71e00ffbf0 0x7f71e00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.892+0000 7f71e611a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e0100de0 0x7f71e019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.892+0000 7f71e611a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71e01017a0 0x7f71e019e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.892+0000 7f71e611a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e019e840 con 0x7f71e0100de0 2024-01-25T15:02:28.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.892+0000 7f71e611a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e019e9b0 con 0x7f71e00ffbf0 2024-01-25T15:02:28.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.892+0000 7f71e611a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e019eb70 con 0x7f71e01017a0 2024-01-25T15:02:28.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.892+0000 7f71deffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e0100de0 0x7f71e019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.892+0000 7f71deffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e0100de0 0x7f71e019ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53592/0 (socket says 172.21.15.170:53592) 2024-01-25T15:02:28.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.892+0000 7f71deffd640 1 -- 172.21.15.170:0/2274157244 learned_addr learned my addr 172.21.15.170:0/2274157244 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:28.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.892+0000 7f71df7fe640 1 --2- 172.21.15.170:0/2274157244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71e00ffbf0 0x7f71e00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.892+0000 7f71dffff640 1 --2- 172.21.15.170:0/2274157244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71e01017a0 0x7f71e019e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.893+0000 7f71deffd640 1 -- 172.21.15.170:0/2274157244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71e01017a0 msgr2=0x7f71e019e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:28.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.893+0000 7f71deffd640 1 --2- 172.21.15.170:0/2274157244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71e01017a0 0x7f71e019e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.893+0000 7f71deffd640 1 -- 172.21.15.170:0/2274157244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71e00ffbf0 msgr2=0x7f71e00689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:28.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.893+0000 7f71deffd640 1 --2- 172.21.15.170:0/2274157244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71e00ffbf0 0x7f71e00689c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.893+0000 7f71deffd640 1 -- 172.21.15.170:0/2274157244 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d4009560 con 0x7f71e0100de0 2024-01-25T15:02:28.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.893+0000 7f71deffd640 1 --2- 172.21.15.170:0/2274157244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e0100de0 0x7f71e019ba40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009230 tx=0x7f71d4004ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:28.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.893+0000 7f71dcff9640 1 -- 172.21.15.170:0/2274157244 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d40043d0 con 0x7f71e0100de0 2024-01-25T15:02:28.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.893+0000 7f71dcff9640 1 -- 172.21.15.170:0/2274157244 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71d40054c0 con 0x7f71e0100de0 2024-01-25T15:02:28.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.893+0000 7f71e611a640 1 -- 172.21.15.170:0/2274157244 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e019ed90 con 0x7f71e0100de0 2024-01-25T15:02:28.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.893+0000 7f71dcff9640 1 -- 172.21.15.170:0/2274157244 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d403e450 con 0x7f71e0100de0 2024-01-25T15:02:28.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.893+0000 7f71e611a640 1 -- 172.21.15.170:0/2274157244 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e019f240 con 0x7f71e0100de0 2024-01-25T15:02:28.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.895+0000 7f71dcff9640 1 -- 172.21.15.170:0/2274157244 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f71d40035f0 con 0x7f71e0100de0 2024-01-25T15:02:28.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.895+0000 7f71e8db7740 1 Processor -- start 2024-01-25T15:02:28.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71e8db7740 1 -- start start 2024-01-25T15:02:28.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71e8db7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129490 0x55d2111298b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71e8db7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d211129e80 0x55d21112e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71e8db7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d21112eff0 0x55d211131480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71e8db7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2110fbc20 con 0x55d211129e80 2024-01-25T15:02:28.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71e8db7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d211093f80 con 0x55d21112eff0 2024-01-25T15:02:28.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71e8db7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d211091670 con 0x55d211129490 2024-01-25T15:02:28.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71df7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d211129e80 0x55d21112e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71dcff9640 1 --2- 172.21.15.170:0/2274157244 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f71c80a1370 0x7f71c80a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71df7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d211129e80 0x55d21112e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53602/0 (socket says 172.21.15.170:53602) 2024-01-25T15:02:28.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71df7fe640 1 -- 172.21.15.170:0/4144408537 learned_addr learned my addr 172.21.15.170:0/4144408537 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:28.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71dffff640 1 --2- 172.21.15.170:0/4144408537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129490 0x55d2111298b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71deffd640 1 --2- 172.21.15.170:0/4144408537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d21112eff0 0x55d211131480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71dffff640 1 --2- 172.21.15.170:0/2274157244 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f71c80a1370 0x7f71c80a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71df7fe640 1 -- 172.21.15.170:0/4144408537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129490 msgr2=0x55d2111298b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:28.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71df7fe640 1 --2- 172.21.15.170:0/4144408537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129490 0x55d2111298b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71dcff9640 1 -- 172.21.15.170:0/2274157244 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f71d40ef500 con 0x7f71e0100de0 2024-01-25T15:02:28.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71df7fe640 1 -- 172.21.15.170:0/4144408537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d21112eff0 msgr2=0x55d211131480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:28.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71df7fe640 1 --2- 172.21.15.170:0/4144408537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d21112eff0 0x55d211131480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71df7fe640 1 -- 172.21.15.170:0/4144408537 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d211084d80 con 0x55d211129e80 2024-01-25T15:02:28.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.896+0000 7f71dffff640 1 --2- 172.21.15.170:0/2274157244 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f71c80a1370 0x7f71c80a3830 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55d21112a6e0 tx=0x7f71d8009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:28.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.897+0000 7f71df7fe640 1 --2- 172.21.15.170:0/4144408537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d211129e80 0x55d21112e980 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f71d000bcb0 tx=0x7f71d00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e150b0b36bc265fe server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:28.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.897+0000 7f71c5ffb640 1 -- 172.21.15.170:0/4144408537 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0005020 con 0x55d211129e80 2024-01-25T15:02:28.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.897+0000 7f71c5ffb640 1 -- 172.21.15.170:0/4144408537 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71d0015070 con 0x55d211129e80 2024-01-25T15:02:28.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.897+0000 7f71c5ffb640 1 -- 172.21.15.170:0/4144408537 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d00116a0 con 0x55d211129e80 2024-01-25T15:02:28.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.897+0000 7f71e8db7740 1 -- 172.21.15.170:0/4144408537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d211129e80 msgr2=0x55d21112e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:28.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.897+0000 7f71e8db7740 1 --2- 172.21.15.170:0/4144408537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d211129e80 0x55d21112e980 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f71d000bcb0 tx=0x7f71d00107a0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.906 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.897+0000 7f71e8db7740 1 -- 172.21.15.170:0/4144408537 shutdown_connections 2024-01-25T15:02:28.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.897+0000 7f71e8db7740 1 --2- 172.21.15.170:0/4144408537 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d21112eff0 0x55d211131480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.897+0000 7f71e8db7740 1 --2- 172.21.15.170:0/4144408537 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d211129e80 0x55d21112e980 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.897+0000 7f71e8db7740 1 --2- 172.21.15.170:0/4144408537 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129490 0x55d2111298b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.897+0000 7f71e8db7740 1 -- 172.21.15.170:0/4144408537 >> 172.21.15.170:0/4144408537 conn(0x55d2111205f0 msgr2=0x55d2111209f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:28.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.897+0000 7f71e8db7740 1 -- 172.21.15.170:0/4144408537 shutdown_connections 2024-01-25T15:02:28.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.898+0000 7f71e8db7740 1 -- 172.21.15.170:0/4144408537 wait complete. 2024-01-25T15:02:28.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.898+0000 7f71e8db7740 1 -- start start 2024-01-25T15:02:28.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.898+0000 7f71e8db7740 1 Processor -- start 2024-01-25T15:02:28.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.898+0000 7f71e8db7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129490 0x55d211133610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.898+0000 7f71e8db7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d211129e80 0x55d211133b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.898+0000 7f71e8db7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d21112eff0 0x55d21113ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.898+0000 7f71e8db7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21108cf60 con 0x55d21112eff0 2024-01-25T15:02:28.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.898+0000 7f71e8db7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2110460f0 con 0x55d211129e80 2024-01-25T15:02:28.907 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.898+0000 7f71e8db7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d211045d90 con 0x55d211129490 2024-01-25T15:02:28.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.898+0000 7f71e8db7740 10 client.0 _ll_register_callbacks cb 0x55d21102bff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:28.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.898+0000 7f71dffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d21112eff0 0x55d21113ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.898+0000 7f71dffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d21112eff0 0x55d21113ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53610/0 (socket says 172.21.15.170:53610) 2024-01-25T15:02:28.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.898+0000 7f71dffff640 1 -- 172.21.15.170:0/1804890042 learned_addr learned my addr 172.21.15.170:0/1804890042 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:28.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.898+0000 7f71df7fe640 1 --2- 172.21.15.170:0/1804890042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129490 0x55d211133610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71deffd640 1 --2- 172.21.15.170:0/1804890042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d211129e80 0x55d211133b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71dffff640 1 -- 172.21.15.170:0/1804890042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129490 msgr2=0x55d211133610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:28.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71dffff640 1 --2- 172.21.15.170:0/1804890042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129490 0x55d211133610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71dffff640 1 -- 172.21.15.170:0/1804890042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d211129e80 msgr2=0x55d211133b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:28.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71dffff640 1 --2- 172.21.15.170:0/1804890042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d211129e80 0x55d211133b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71dffff640 1 -- 172.21.15.170:0/1804890042 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d000b8e0 con 0x55d21112eff0 2024-01-25T15:02:28.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71dffff640 1 --2- 172.21.15.170:0/1804890042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d21112eff0 0x55d21113ab90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f71d800fb50 tx=0x7f71d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ace4371cc2438b2 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:28.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71beffd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:28.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71beffd640 1 -- 172.21.15.170:0/1804890042 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d801de60 con 0x55d21112eff0 2024-01-25T15:02:28.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71beffd640 1 -- 172.21.15.170:0/1804890042 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f71d8028400 con 0x55d21112eff0 2024-01-25T15:02:28.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71e8db7740 1 -- 172.21.15.170:0/1804890042 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d211085f50 con 0x55d21112eff0 2024-01-25T15:02:28.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71beffd640 1 -- 172.21.15.170:0/1804890042 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71d80285c0 con 0x55d21112eff0 2024-01-25T15:02:28.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71e8db7740 10 client.15651 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:28.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71e8db7740 1 -- 172.21.15.170:0/1804890042 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d21108b5e0 con 0x55d21112eff0 2024-01-25T15:02:28.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71beffd640 1 -- 172.21.15.170:0/1804890042 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d211085f50 con 0x55d21112eff0 2024-01-25T15:02:28.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71beffd640 1 -- 172.21.15.170:0/1804890042 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f71d8026030 con 0x55d21112eff0 2024-01-25T15:02:28.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71e8db7740 10 client.15651 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:28.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.899+0000 7f71e8db7740 10 client.15651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:28.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.900+0000 7f71e8db7740 20 client.15651 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:28.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.900+0000 7f71e8db7740 1 --2- 172.21.15.170:0/1804890042 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d21113f840 0x55d211141c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.900+0000 7f71e8db7740 4 client.15651 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:02:28.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.900+0000 7f71e8db7740 1 -- 172.21.15.170:0/1804890042 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d211085c70 con 0x55d21113f840 2024-01-25T15:02:28.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.900+0000 7f71df7fe640 1 --2- 172.21.15.170:0/1804890042 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d21113f840 0x55d211141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.900+0000 7f71beffd640 10 client.15651 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:28.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.900+0000 7f71df7fe640 1 --2- 172.21.15.170:0/1804890042 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d21113f840 0x55d211141c60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c12fe4ac59df745e server_cookie=7d641c10f94e98c7 in_seq=0 out_seq=0 2024-01-25T15:02:28.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.901+0000 7f71beffd640 1 -- 172.21.15.170:0/1804890042 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d211085c70 con 0x55d21113f840 2024-01-25T15:02:28.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.901+0000 7f71beffd640 10 client.15651 handle_command_reply: tid=0 2024-01-25T15:02:28.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.901+0000 7f71e8db7740 1 client.15651 shutdown 2024-01-25T15:02:28.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.901+0000 7f71e8db7740 1 -- 172.21.15.170:0/1804890042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d21112eff0 msgr2=0x55d21113ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:28.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.901+0000 7f71e8db7740 1 --2- 172.21.15.170:0/1804890042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d21112eff0 0x55d21113ab90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f71d800fb50 tx=0x7f71d8004a40 comp rx=0 tx=0).stop 2024-01-25T15:02:28.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.901+0000 7f71e8db7740 1 -- 172.21.15.170:0/1804890042 shutdown_connections 2024-01-25T15:02:28.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.901+0000 7f71e8db7740 1 --2- 172.21.15.170:0/1804890042 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d21113f840 0x55d211141c60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.901+0000 7f71e8db7740 1 --2- 172.21.15.170:0/1804890042 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d211129e80 0x55d211133b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.901+0000 7f71e8db7740 1 --2- 172.21.15.170:0/1804890042 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d21112eff0 0x55d21113ab90 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.901+0000 7f71beffd640 0 client.15651 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:28.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.901+0000 7f71e8db7740 1 --2- 172.21.15.170:0/1804890042 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129490 0x55d211133610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.901+0000 7f71e8db7740 1 -- 172.21.15.170:0/1804890042 >> 172.21.15.170:0/1804890042 conn(0x55d2111205f0 msgr2=0x55d21111f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:28.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.901+0000 7f71e8db7740 1 -- 172.21.15.170:0/1804890042 shutdown_connections 2024-01-25T15:02:28.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.901+0000 7f71e8db7740 1 -- 172.21.15.170:0/1804890042 wait complete. 2024-01-25T15:02:28.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.901+0000 7f71e8db7740 20 client.15651 trim_cache size 0 max 16384 2024-01-25T15:02:28.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71e8db7740 1 Processor -- start 2024-01-25T15:02:28.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71e8db7740 1 -- start start 2024-01-25T15:02:28.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71e8db7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d211129490 0x55d21112b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71e8db7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129e80 0x55d21112b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71e8db7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d21112eff0 0x55d21113ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71e8db7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21100ae60 con 0x55d21112eff0 2024-01-25T15:02:28.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71e8db7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21112ab50 con 0x55d211129490 2024-01-25T15:02:28.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71e8db7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d211132420 con 0x55d211129e80 2024-01-25T15:02:28.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71dffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d21112eff0 0x55d21113ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71dffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d21112eff0 0x55d21113ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53622/0 (socket says 172.21.15.170:53622) 2024-01-25T15:02:28.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71dffff640 1 -- 172.21.15.170:0/3103545705 learned_addr learned my addr 172.21.15.170:0/3103545705 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:28.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71deffd640 1 --2- 172.21.15.170:0/3103545705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129e80 0x55d21112b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71df7fe640 1 --2- 172.21.15.170:0/3103545705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d211129490 0x55d21112b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71dffff640 1 -- 172.21.15.170:0/3103545705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129e80 msgr2=0x55d21112b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:28.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71dffff640 1 --2- 172.21.15.170:0/3103545705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129e80 0x55d21112b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71dffff640 1 -- 172.21.15.170:0/3103545705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d211129490 msgr2=0x55d21112b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:28.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71dffff640 1 --2- 172.21.15.170:0/3103545705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d211129490 0x55d21112b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.917+0000 7f71dffff640 1 -- 172.21.15.170:0/3103545705 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d211027d80 con 0x55d21112eff0 2024-01-25T15:02:28.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.918+0000 7f71dffff640 1 --2- 172.21.15.170:0/3103545705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d21112eff0 0x55d21113ab50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f71d80099c0 tx=0x7f71d8009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656f1282a895d183 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:28.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.918+0000 7f71c57fa640 1 -- 172.21.15.170:0/3103545705 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d8034e30 con 0x55d21112eff0 2024-01-25T15:02:28.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.918+0000 7f71c57fa640 1 -- 172.21.15.170:0/3103545705 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71d8022070 con 0x55d21112eff0 2024-01-25T15:02:28.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.918+0000 7f71c57fa640 1 -- 172.21.15.170:0/3103545705 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d80346e0 con 0x55d21112eff0 2024-01-25T15:02:28.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.918+0000 7f71e8db7740 1 -- 172.21.15.170:0/3103545705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d21112eff0 msgr2=0x55d21113ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:28.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.918+0000 7f71e8db7740 1 --2- 172.21.15.170:0/3103545705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d21112eff0 0x55d21113ab50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f71d80099c0 tx=0x7f71d8009b90 comp rx=0 tx=0).stop 2024-01-25T15:02:28.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.918+0000 7f71e8db7740 1 -- 172.21.15.170:0/3103545705 shutdown_connections 2024-01-25T15:02:28.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.918+0000 7f71e8db7740 1 --2- 172.21.15.170:0/3103545705 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d21112eff0 0x55d21113ab50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.927 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.918+0000 7f71e8db7740 1 --2- 172.21.15.170:0/3103545705 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129e80 0x55d21112b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.918+0000 7f71e8db7740 1 --2- 172.21.15.170:0/3103545705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d211129490 0x55d21112b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.919+0000 7f71e8db7740 1 -- 172.21.15.170:0/3103545705 >> 172.21.15.170:0/3103545705 conn(0x55d2111205f0 msgr2=0x55d211133610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:28.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.919+0000 7f71e8db7740 1 -- 172.21.15.170:0/3103545705 shutdown_connections 2024-01-25T15:02:28.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.919+0000 7f71e8db7740 1 -- 172.21.15.170:0/3103545705 wait complete. 2024-01-25T15:02:28.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.919+0000 7f71e8db7740 1 -- start start 2024-01-25T15:02:28.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.919+0000 7f71e8db7740 1 Processor -- start 2024-01-25T15:02:28.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.919+0000 7f71e8db7740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d211129490 0x55d2111392c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.919+0000 7f71e8db7740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129e80 0x55d211139800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.919+0000 7f71e8db7740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d21112eff0 0x55d211139d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.919+0000 7f71e8db7740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21113aec0 con 0x55d211129490 2024-01-25T15:02:28.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.919+0000 7f71e8db7740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d21113b030 con 0x55d21112eff0 2024-01-25T15:02:28.928 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.919+0000 7f71e8db7740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d211195dd0 con 0x55d211129e80 2024-01-25T15:02:28.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.919+0000 7f71e8db7740 10 client.0 _ll_register_callbacks cb 0x7f71d000b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:28.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.919+0000 7f71df7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d211129490 0x55d2111392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.919+0000 7f71df7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d211129490 0x55d2111392c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53636/0 (socket says 172.21.15.170:53636) 2024-01-25T15:02:28.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.919+0000 7f71df7fe640 1 -- 172.21.15.170:0/2901497919 learned_addr learned my addr 172.21.15.170:0/2901497919 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:28.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71dffff640 1 --2- 172.21.15.170:0/2901497919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d21112eff0 0x55d211139d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71deffd640 1 --2- 172.21.15.170:0/2901497919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129e80 0x55d211139800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71df7fe640 1 -- 172.21.15.170:0/2901497919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129e80 msgr2=0x55d211139800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:28.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71df7fe640 1 --2- 172.21.15.170:0/2901497919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129e80 0x55d211139800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71df7fe640 1 -- 172.21.15.170:0/2901497919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d21112eff0 msgr2=0x55d211139d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:28.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71df7fe640 1 --2- 172.21.15.170:0/2901497919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d21112eff0 0x55d211139d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71df7fe640 1 -- 172.21.15.170:0/2901497919 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d21108b5e0 con 0x55d211129490 2024-01-25T15:02:28.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71dffff640 1 --2- 172.21.15.170:0/2901497919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d21112eff0 0x55d211139d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:28.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71deffd640 1 --2- 172.21.15.170:0/2901497919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129e80 0x55d211139800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:28.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71df7fe640 1 --2- 172.21.15.170:0/2901497919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d211129490 0x55d2111392c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f71d0011010 tx=0x7f71d0005f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189c36c08d2cb00a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:28.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71beffd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:28.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71beffd640 1 -- 172.21.15.170:0/2901497919 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0021050 con 0x55d211129490 2024-01-25T15:02:28.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71beffd640 1 -- 172.21.15.170:0/2901497919 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f71d0017070 con 0x55d211129490 2024-01-25T15:02:28.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71e8db7740 1 -- 172.21.15.170:0/2901497919 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71d0015070 con 0x55d211129490 2024-01-25T15:02:28.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71beffd640 1 -- 172.21.15.170:0/2901497919 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71d0005410 con 0x55d211129490 2024-01-25T15:02:28.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71e8db7740 10 client.15657 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:28.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71e8db7740 1 -- 172.21.15.170:0/2901497919 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d21104d990 con 0x55d211129490 2024-01-25T15:02:28.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71beffd640 1 -- 172.21.15.170:0/2901497919 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71d0015070 con 0x55d211129490 2024-01-25T15:02:28.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.920+0000 7f71beffd640 1 -- 172.21.15.170:0/2901497919 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f71d0028100 con 0x55d211129490 2024-01-25T15:02:28.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.921+0000 7f71e8db7740 10 client.15657 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:28.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.921+0000 7f71e8db7740 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:28.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.921+0000 7f71e8db7740 20 client.15657 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:28.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.921+0000 7f71e8db7740 1 --2- 172.21.15.170:0/2901497919 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d21113f840 0x55d211199910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:28.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.921+0000 7f71e8db7740 4 client.15657 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-01-25T15:02:28.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.921+0000 7f71e8db7740 1 -- 172.21.15.170:0/2901497919 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55d210d8c860 con 0x55d21113f840 2024-01-25T15:02:28.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.921+0000 7f71deffd640 1 --2- 172.21.15.170:0/2901497919 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d21113f840 0x55d211199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:28.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.921+0000 7f71beffd640 10 client.15657 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:28.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.921+0000 7f71deffd640 1 --2- 172.21.15.170:0/2901497919 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d21113f840 0x55d211199910 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d8d908f7be7a522 server_cookie=d7195688249f926 in_seq=0 out_seq=0 2024-01-25T15:02:28.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.922+0000 7f71beffd640 1 -- 172.21.15.170:0/2901497919 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55d210d8c860 con 0x55d21113f840 2024-01-25T15:02:28.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.922+0000 7f71beffd640 10 client.15657 handle_command_reply: tid=0 2024-01-25T15:02:28.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.922+0000 7f71e8db7740 1 client.15657 shutdown 2024-01-25T15:02:28.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.922+0000 7f71e8db7740 1 -- 172.21.15.170:0/2901497919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d211129490 msgr2=0x55d2111392c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:28.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.922+0000 7f71e8db7740 1 --2- 172.21.15.170:0/2901497919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d211129490 0x55d2111392c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f71d0011010 tx=0x7f71d0005f50 comp rx=0 tx=0).stop 2024-01-25T15:02:28.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.922+0000 7f71e8db7740 1 -- 172.21.15.170:0/2901497919 shutdown_connections 2024-01-25T15:02:28.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.922+0000 7f71e8db7740 1 --2- 172.21.15.170:0/2901497919 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d21113f840 0x55d211199910 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.922+0000 7f71e8db7740 1 --2- 172.21.15.170:0/2901497919 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d21112eff0 0x55d211139d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.922+0000 7f71e8db7740 1 --2- 172.21.15.170:0/2901497919 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d211129e80 0x55d211139800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.922+0000 7f71e8db7740 1 --2- 172.21.15.170:0/2901497919 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d211129490 0x55d2111392c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.922+0000 7f71e8db7740 1 -- 172.21.15.170:0/2901497919 >> 172.21.15.170:0/2901497919 conn(0x55d2111205f0 msgr2=0x55d2111335f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:28.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.922+0000 7f71beffd640 0 client.15657 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:28.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.923+0000 7f71e8db7740 1 -- 172.21.15.170:0/2901497919 shutdown_connections 2024-01-25T15:02:28.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.923+0000 7f71e8db7740 1 -- 172.21.15.170:0/2901497919 wait complete. 2024-01-25T15:02:28.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.923+0000 7f71e8db7740 20 client.15657 trim_cache size 0 max 16384 2024-01-25T15:02:28.932 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:02:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: "return_code": 0, 2024-01-25T15:02:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_tag": "818c6a98-2aca-4d6d-8412-3c3f7dc3b970", 2024-01-25T15:02:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: "mode": "asynchronous" 2024-01-25T15:02:28.933 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:02:28.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.923+0000 7f71e611a640 1 -- 172.21.15.170:0/2274157244 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f71c80a1370 msgr2=0x7f71c80a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:28.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.923+0000 7f71e611a640 1 --2- 172.21.15.170:0/2274157244 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f71c80a1370 0x7f71c80a3830 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55d21112a6e0 tx=0x7f71d8009600 comp rx=0 tx=0).stop 2024-01-25T15:02:28.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.923+0000 7f71e611a640 1 -- 172.21.15.170:0/2274157244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e0100de0 msgr2=0x7f71e019ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:28.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.923+0000 7f71e611a640 1 --2- 172.21.15.170:0/2274157244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e0100de0 0x7f71e019ba40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009230 tx=0x7f71d4004ee0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.923+0000 7f71e611a640 1 -- 172.21.15.170:0/2274157244 shutdown_connections 2024-01-25T15:02:28.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.923+0000 7f71e611a640 1 --2- 172.21.15.170:0/2274157244 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f71c80a1370 0x7f71c80a3830 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.923+0000 7f71e611a640 1 --2- 172.21.15.170:0/2274157244 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f71e01017a0 0x7f71e019e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.923+0000 7f71e611a640 1 --2- 172.21.15.170:0/2274157244 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f71e0100de0 0x7f71e019ba40 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.923+0000 7f71e611a640 1 --2- 172.21.15.170:0/2274157244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71e00ffbf0 0x7f71e00689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:28.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.923+0000 7f71e611a640 1 -- 172.21.15.170:0/2274157244 >> 172.21.15.170:0/2274157244 conn(0x7f71e00fb180 msgr2=0x7f71e0104180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:28.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.923+0000 7f71e611a640 1 -- 172.21.15.170:0/2274157244 shutdown_connections 2024-01-25T15:02:28.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:28.923+0000 7f71e611a640 1 -- 172.21.15.170:0/2274157244 wait complete. 2024-01-25T15:02:28.936 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-25T15:02:29.041 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.039+0000 7f699b161640 1 -- 172.21.15.170:0/2417285617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6994104170 msgr2=0x7f6994106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:29.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.039+0000 7f699b161640 1 --2- 172.21.15.170:0/2417285617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6994104170 0x7f6994106560 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6980009900 tx=0x7f698002bc30 comp rx=0 tx=0).stop 2024-01-25T15:02:29.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.039+0000 7f699b161640 1 -- 172.21.15.170:0/2417285617 shutdown_connections 2024-01-25T15:02:29.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.039+0000 7f699b161640 1 --2- 172.21.15.170:0/2417285617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6994106aa0 0x7f6994108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.039+0000 7f699b161640 1 --2- 172.21.15.170:0/2417285617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6994104170 0x7f6994106560 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.039+0000 7f699b161640 1 --2- 172.21.15.170:0/2417285617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6994101840 0x7f6994103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.039+0000 7f699b161640 1 -- 172.21.15.170:0/2417285617 >> 172.21.15.170:0/2417285617 conn(0x7f69940fb190 msgr2=0x7f69940fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:29.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.039+0000 7f699b161640 1 -- 172.21.15.170:0/2417285617 shutdown_connections 2024-01-25T15:02:29.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.039+0000 7f699b161640 1 -- 172.21.15.170:0/2417285617 wait complete. 2024-01-25T15:02:29.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.039+0000 7f699b161640 1 Processor -- start 2024-01-25T15:02:29.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f699b161640 1 -- start start 2024-01-25T15:02:29.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f699b161640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6994101840 0x7f6994196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f699b161640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6994104170 0x7f6994197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f699b161640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6994106aa0 0x7f699419e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f699b161640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699419e800 con 0x7f6994106aa0 2024-01-25T15:02:29.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f699b161640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699419e970 con 0x7f6994104170 2024-01-25T15:02:29.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f699b161640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699419eb30 con 0x7f6994101840 2024-01-25T15:02:29.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f69996fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6994106aa0 0x7f699419e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f69996fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6994106aa0 0x7f699419e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53654/0 (socket says 172.21.15.170:53654) 2024-01-25T15:02:29.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f69996fe640 1 -- 172.21.15.170:0/4063533371 learned_addr learned my addr 172.21.15.170:0/4063533371 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:29.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f6998efd640 1 --2- 172.21.15.170:0/4063533371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6994101840 0x7f6994196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f6993fff640 1 --2- 172.21.15.170:0/4063533371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6994104170 0x7f6994197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f69996fe640 1 -- 172.21.15.170:0/4063533371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6994101840 msgr2=0x7f6994196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:29.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f69996fe640 1 --2- 172.21.15.170:0/4063533371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6994101840 0x7f6994196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f69996fe640 1 -- 172.21.15.170:0/4063533371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6994104170 msgr2=0x7f6994197260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:29.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f69996fe640 1 --2- 172.21.15.170:0/4063533371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6994104170 0x7f6994197260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f69996fe640 1 -- 172.21.15.170:0/4063533371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6980009560 con 0x7f6994106aa0 2024-01-25T15:02:29.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f69996fe640 1 --2- 172.21.15.170:0/4063533371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6994106aa0 0x7f699419e290 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f698c00eb10 tx=0x7f698c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:29.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f6991ffb640 1 -- 172.21.15.170:0/4063533371 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c004b20 con 0x7f6994106aa0 2024-01-25T15:02:29.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.040+0000 7f699b161640 1 -- 172.21.15.170:0/4063533371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699419ee10 con 0x7f6994106aa0 2024-01-25T15:02:29.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.041+0000 7f6991ffb640 1 -- 172.21.15.170:0/4063533371 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f698c004c80 con 0x7f6994106aa0 2024-01-25T15:02:29.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.041+0000 7f6991ffb640 1 -- 172.21.15.170:0/4063533371 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c010690 con 0x7f6994106aa0 2024-01-25T15:02:29.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.041+0000 7f699b161640 1 -- 172.21.15.170:0/4063533371 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699419f230 con 0x7f6994106aa0 2024-01-25T15:02:29.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.043+0000 7f6991ffb640 1 -- 172.21.15.170:0/4063533371 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f698c005020 con 0x7f6994106aa0 2024-01-25T15:02:29.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.043+0000 7f699ddfe740 1 Processor -- start 2024-01-25T15:02:29.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.043+0000 7f699ddfe740 1 -- start start 2024-01-25T15:02:29.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.043+0000 7f699ddfe740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c535e60 0x560b3c536280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.043+0000 7f699ddfe740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c536850 0x560b3c53b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.043+0000 7f699ddfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c53b9c0 0x560b3c53de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.051 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.043+0000 7f699ddfe740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b3c4a03b0 con 0x560b3c536850 2024-01-25T15:02:29.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.043+0000 7f699ddfe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b3c49daa0 con 0x560b3c53b9c0 2024-01-25T15:02:29.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.043+0000 7f699ddfe740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b3c499390 con 0x560b3c535e60 2024-01-25T15:02:29.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f6998efd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c536850 0x560b3c53b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f6998efd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c536850 0x560b3c53b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53670/0 (socket says 172.21.15.170:53670) 2024-01-25T15:02:29.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f6998efd640 1 -- 172.21.15.170:0/616518779 learned_addr learned my addr 172.21.15.170:0/616518779 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:29.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f6991ffb640 1 --2- 172.21.15.170:0/4063533371 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f69840a1370 0x7f69840a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f6993fff640 1 --2- 172.21.15.170:0/616518779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c535e60 0x560b3c536280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f6993fff640 1 --2- 172.21.15.170:0/616518779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c53b9c0 0x560b3c53de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f6998efd640 1 -- 172.21.15.170:0/616518779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c535e60 msgr2=0x560b3c536280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:29.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f6998efd640 1 --2- 172.21.15.170:0/616518779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c535e60 0x560b3c536280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f6998efd640 1 -- 172.21.15.170:0/616518779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c53b9c0 msgr2=0x560b3c53de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:29.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f6998efd640 1 --2- 172.21.15.170:0/616518779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c53b9c0 0x560b3c53de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.052 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f6998efd640 1 -- 172.21.15.170:0/616518779 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b3c45b810 con 0x560b3c536850 2024-01-25T15:02:29.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f6993fff640 1 --2- 172.21.15.170:0/616518779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c535e60 0x560b3c536280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:29.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f69996fe640 1 --2- 172.21.15.170:0/4063533371 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f69840a1370 0x7f69840a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f6991ffb640 1 -- 172.21.15.170:0/4063533371 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f698c014070 con 0x7f6994106aa0 2024-01-25T15:02:29.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f6998efd640 1 --2- 172.21.15.170:0/616518779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c536850 0x560b3c53b350 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6988009ca0 tx=0x7f6988011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9df6acf8e53daf server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:29.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f697effd640 1 -- 172.21.15.170:0/616518779 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6988005220 con 0x560b3c536850 2024-01-25T15:02:29.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f697effd640 1 -- 172.21.15.170:0/616518779 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6988004c60 con 0x560b3c536850 2024-01-25T15:02:29.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f697effd640 1 -- 172.21.15.170:0/616518779 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6988019690 con 0x560b3c536850 2024-01-25T15:02:29.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.044+0000 7f69996fe640 1 --2- 172.21.15.170:0/4063533371 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f69840a1370 0x7f69840a3830 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f698c096c70 tx=0x7f698c0057a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:29.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.045+0000 7f699ddfe740 1 -- 172.21.15.170:0/616518779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c536850 msgr2=0x560b3c53b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:29.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.045+0000 7f699ddfe740 1 --2- 172.21.15.170:0/616518779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c536850 0x560b3c53b350 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6988009ca0 tx=0x7f6988011810 comp rx=0 tx=0).stop 2024-01-25T15:02:29.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.045+0000 7f699ddfe740 1 -- 172.21.15.170:0/616518779 shutdown_connections 2024-01-25T15:02:29.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.045+0000 7f699ddfe740 1 --2- 172.21.15.170:0/616518779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c53b9c0 0x560b3c53de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.053 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.045+0000 7f699ddfe740 1 --2- 172.21.15.170:0/616518779 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c536850 0x560b3c53b350 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.045+0000 7f699ddfe740 1 --2- 172.21.15.170:0/616518779 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c535e60 0x560b3c536280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.045+0000 7f699ddfe740 1 -- 172.21.15.170:0/616518779 >> 172.21.15.170:0/616518779 conn(0x560b3c52cfc0 msgr2=0x560b3c52d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:29.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.045+0000 7f699ddfe740 1 -- 172.21.15.170:0/616518779 shutdown_connections 2024-01-25T15:02:29.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.045+0000 7f699ddfe740 1 -- 172.21.15.170:0/616518779 wait complete. 2024-01-25T15:02:29.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.045+0000 7f699ddfe740 1 -- start start 2024-01-25T15:02:29.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f699ddfe740 1 Processor -- start 2024-01-25T15:02:29.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f699ddfe740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c535e60 0x560b3c53fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f699ddfe740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c536850 0x560b3c540530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f699ddfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c53b9c0 0x560b3c547570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f699ddfe740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b3c452780 con 0x560b3c535e60 2024-01-25T15:02:29.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f699ddfe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b3c452420 con 0x560b3c53b9c0 2024-01-25T15:02:29.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f699ddfe740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b3c417420 con 0x560b3c536850 2024-01-25T15:02:29.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f699ddfe740 10 client.0 _ll_register_callbacks cb 0x560b3c454b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:29.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f6993fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c535e60 0x560b3c53fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.054 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f6993fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c535e60 0x560b3c53fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53678/0 (socket says 172.21.15.170:53678) 2024-01-25T15:02:29.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f6993fff640 1 -- 172.21.15.170:0/360318659 learned_addr learned my addr 172.21.15.170:0/360318659 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:29.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f6998efd640 1 --2- 172.21.15.170:0/360318659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c536850 0x560b3c540530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f6993fff640 1 -- 172.21.15.170:0/360318659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c536850 msgr2=0x560b3c540530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:29.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f6993fff640 1 --2- 172.21.15.170:0/360318659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c536850 0x560b3c540530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f6993fff640 1 -- 172.21.15.170:0/360318659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c53b9c0 msgr2=0x560b3c547570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:29.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f6993fff640 1 --2- 172.21.15.170:0/360318659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c53b9c0 0x560b3c547570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f6993fff640 1 -- 172.21.15.170:0/360318659 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69880098d0 con 0x560b3c535e60 2024-01-25T15:02:29.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f6998efd640 1 --2- 172.21.15.170:0/360318659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c536850 0x560b3c540530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:29.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f6993fff640 1 --2- 172.21.15.170:0/360318659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c535e60 0x560b3c53fff0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f698002c6b0 tx=0x7f698002cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de020d8339a6382 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:29.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.046+0000 7f6973fff640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:29.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.047+0000 7f6973fff640 1 -- 172.21.15.170:0/360318659 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6980004990 con 0x560b3c535e60 2024-01-25T15:02:29.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.047+0000 7f6973fff640 1 -- 172.21.15.170:0/360318659 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f6980004040 con 0x560b3c535e60 2024-01-25T15:02:29.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.047+0000 7f699ddfe740 1 -- 172.21.15.170:0/360318659 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560b3c46e240 con 0x560b3c535e60 2024-01-25T15:02:29.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.047+0000 7f6973fff640 1 -- 172.21.15.170:0/360318659 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6980004af0 con 0x560b3c535e60 2024-01-25T15:02:29.055 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.047+0000 7f699ddfe740 10 client.15669 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:29.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.047+0000 7f699ddfe740 1 -- 172.21.15.170:0/360318659 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560b3c497a10 con 0x560b3c535e60 2024-01-25T15:02:29.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.047+0000 7f6973fff640 1 -- 172.21.15.170:0/360318659 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560b3c46e240 con 0x560b3c535e60 2024-01-25T15:02:29.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.047+0000 7f6973fff640 1 -- 172.21.15.170:0/360318659 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6980003710 con 0x560b3c535e60 2024-01-25T15:02:29.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.047+0000 7f699ddfe740 10 client.15669 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:29.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.047+0000 7f699ddfe740 10 client.15669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:29.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.047+0000 7f699ddfe740 20 client.15669 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:29.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.047+0000 7f699ddfe740 1 --2- 172.21.15.170:0/360318659 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x560b3c54c190 0x560b3c54e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.047+0000 7f699ddfe740 4 client.15669 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:02:29.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.047+0000 7f699ddfe740 1 -- 172.21.15.170:0/360318659 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560b3c46bb50 con 0x560b3c54c190 2024-01-25T15:02:29.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.047+0000 7f6998efd640 1 --2- 172.21.15.170:0/360318659 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x560b3c54c190 0x560b3c54e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.048+0000 7f6998efd640 1 --2- 172.21.15.170:0/360318659 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x560b3c54c190 0x560b3c54e580 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dfc5c4e6e2f8ca9 server_cookie=ade1ac95be8f2343 in_seq=0 out_seq=0 2024-01-25T15:02:29.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.048+0000 7f6973fff640 10 client.15669 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:29.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.048+0000 7f6973fff640 1 -- 172.21.15.170:0/360318659 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560b3c46bb50 con 0x560b3c54c190 2024-01-25T15:02:29.056 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.048+0000 7f6973fff640 10 client.15669 handle_command_reply: tid=0 2024-01-25T15:02:29.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.048+0000 7f699ddfe740 1 client.15669 shutdown 2024-01-25T15:02:29.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.048+0000 7f699ddfe740 1 -- 172.21.15.170:0/360318659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c535e60 msgr2=0x560b3c53fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:29.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.048+0000 7f699ddfe740 1 --2- 172.21.15.170:0/360318659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c535e60 0x560b3c53fff0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f698002c6b0 tx=0x7f698002cbf0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.049+0000 7f699ddfe740 1 -- 172.21.15.170:0/360318659 shutdown_connections 2024-01-25T15:02:29.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.049+0000 7f699ddfe740 1 --2- 172.21.15.170:0/360318659 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x560b3c54c190 0x560b3c54e580 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.049+0000 7f699ddfe740 1 --2- 172.21.15.170:0/360318659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c53b9c0 0x560b3c547570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.049+0000 7f699ddfe740 1 --2- 172.21.15.170:0/360318659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c536850 0x560b3c540530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.049+0000 7f6973fff640 0 client.15669 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:29.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.049+0000 7f699ddfe740 1 --2- 172.21.15.170:0/360318659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c535e60 0x560b3c53fff0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.049+0000 7f699ddfe740 1 -- 172.21.15.170:0/360318659 >> 172.21.15.170:0/360318659 conn(0x560b3c52cfc0 msgr2=0x560b3c52c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:29.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.049+0000 7f699ddfe740 1 -- 172.21.15.170:0/360318659 shutdown_connections 2024-01-25T15:02:29.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.049+0000 7f699ddfe740 1 -- 172.21.15.170:0/360318659 wait complete. 2024-01-25T15:02:29.057 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.049+0000 7f699ddfe740 20 client.15669 trim_cache size 0 max 16384 2024-01-25T15:02:29.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.064+0000 7f699ddfe740 1 Processor -- start 2024-01-25T15:02:29.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.064+0000 7f699ddfe740 1 -- start start 2024-01-25T15:02:29.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.064+0000 7f699ddfe740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c535e60 0x560b3c53fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.064+0000 7f699ddfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c536850 0x560b3c547530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.064+0000 7f699ddfe740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c53b9c0 0x560b3c540140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.064+0000 7f699ddfe740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b3c541060 con 0x560b3c53b9c0 2024-01-25T15:02:29.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.064+0000 7f699ddfe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b3c537850 con 0x560b3c536850 2024-01-25T15:02:29.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.064+0000 7f699ddfe740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b3c53b780 con 0x560b3c535e60 2024-01-25T15:02:29.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.064+0000 7f6993fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c53b9c0 0x560b3c540140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.064+0000 7f6993fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c53b9c0 0x560b3c540140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53680/0 (socket says 172.21.15.170:53680) 2024-01-25T15:02:29.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.064+0000 7f6993fff640 1 -- 172.21.15.170:0/1440901376 learned_addr learned my addr 172.21.15.170:0/1440901376 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:29.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.065+0000 7f6993fff640 1 --2- 172.21.15.170:0/1440901376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c535e60 0x560b3c53fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.065+0000 7f6998efd640 1 --2- 172.21.15.170:0/1440901376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c536850 0x560b3c547530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.065+0000 7f6993fff640 1 -- 172.21.15.170:0/1440901376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c535e60 msgr2=0x560b3c53fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:29.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.065+0000 7f6993fff640 1 --2- 172.21.15.170:0/1440901376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c535e60 0x560b3c53fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.065+0000 7f6993fff640 1 -- 172.21.15.170:0/1440901376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c536850 msgr2=0x560b3c547530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:29.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.065+0000 7f6993fff640 1 --2- 172.21.15.170:0/1440901376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c536850 0x560b3c547530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.065+0000 7f6993fff640 1 -- 172.21.15.170:0/1440901376 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b3c434520 con 0x560b3c53b9c0 2024-01-25T15:02:29.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.065+0000 7f6998efd640 1 --2- 172.21.15.170:0/1440901376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c536850 0x560b3c547530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:29.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.065+0000 7f6993fff640 1 --2- 172.21.15.170:0/1440901376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c53b9c0 0x560b3c540140 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f698002c400 tx=0x7f6980005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94a36a6496e6f01 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:29.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.065+0000 7f697e7fc640 1 -- 172.21.15.170:0/1440901376 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69800035f0 con 0x560b3c53b9c0 2024-01-25T15:02:29.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.065+0000 7f697e7fc640 1 -- 172.21.15.170:0/1440901376 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6980004460 con 0x560b3c53b9c0 2024-01-25T15:02:29.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.065+0000 7f697e7fc640 1 -- 172.21.15.170:0/1440901376 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6980005550 con 0x560b3c53b9c0 2024-01-25T15:02:29.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.066+0000 7f699ddfe740 1 -- 172.21.15.170:0/1440901376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c53b9c0 msgr2=0x560b3c540140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:29.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.066+0000 7f699ddfe740 1 --2- 172.21.15.170:0/1440901376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c53b9c0 0x560b3c540140 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f698002c400 tx=0x7f6980005fd0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.066+0000 7f699ddfe740 1 -- 172.21.15.170:0/1440901376 shutdown_connections 2024-01-25T15:02:29.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.066+0000 7f699ddfe740 1 --2- 172.21.15.170:0/1440901376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c536850 0x560b3c547530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.066+0000 7f699ddfe740 1 --2- 172.21.15.170:0/1440901376 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c53b9c0 0x560b3c540140 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.066+0000 7f699ddfe740 1 --2- 172.21.15.170:0/1440901376 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c535e60 0x560b3c53fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.066+0000 7f699ddfe740 1 -- 172.21.15.170:0/1440901376 >> 172.21.15.170:0/1440901376 conn(0x560b3c52cfc0 msgr2=0x560b3c537cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:29.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.066+0000 7f699ddfe740 1 -- 172.21.15.170:0/1440901376 shutdown_connections 2024-01-25T15:02:29.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.066+0000 7f699ddfe740 1 -- 172.21.15.170:0/1440901376 wait complete. 2024-01-25T15:02:29.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.066+0000 7f699ddfe740 1 -- start start 2024-01-25T15:02:29.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.066+0000 7f699ddfe740 1 Processor -- start 2024-01-25T15:02:29.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f699ddfe740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c535e60 0x560b3c546f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f699ddfe740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c536850 0x560b3c547460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f699ddfe740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c53b9c0 0x560b3c545530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f699ddfe740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b3c545c00 con 0x560b3c536850 2024-01-25T15:02:29.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f699ddfe740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b3c545d70 con 0x560b3c535e60 2024-01-25T15:02:29.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f699ddfe740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b3c545f30 con 0x560b3c53b9c0 2024-01-25T15:02:29.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f699ddfe740 10 client.0 _ll_register_callbacks cb 0x7f6988005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:29.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6998efd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c536850 0x560b3c547460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6998efd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c536850 0x560b3c547460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53692/0 (socket says 172.21.15.170:53692) 2024-01-25T15:02:29.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6998efd640 1 -- 172.21.15.170:0/2522239878 learned_addr learned my addr 172.21.15.170:0/2522239878 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:29.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6993fff640 1 --2- 172.21.15.170:0/2522239878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c535e60 0x560b3c546f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6993fff640 1 --2- 172.21.15.170:0/2522239878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c53b9c0 0x560b3c545530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6998efd640 1 -- 172.21.15.170:0/2522239878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c53b9c0 msgr2=0x560b3c545530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:29.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6998efd640 1 --2- 172.21.15.170:0/2522239878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c53b9c0 0x560b3c545530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6998efd640 1 -- 172.21.15.170:0/2522239878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c535e60 msgr2=0x560b3c546f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:29.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6998efd640 1 --2- 172.21.15.170:0/2522239878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c535e60 0x560b3c546f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6998efd640 1 -- 172.21.15.170:0/2522239878 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560b3c497a10 con 0x560b3c536850 2024-01-25T15:02:29.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6993fff640 1 --2- 172.21.15.170:0/2522239878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c53b9c0 0x560b3c545530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:29.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6998efd640 1 --2- 172.21.15.170:0/2522239878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c536850 0x560b3c547460 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6988005fd0 tx=0x7f6988009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b27bb602e8b047 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:29.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6973fff640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:29.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6973fff640 1 -- 172.21.15.170:0/2522239878 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6988029070 con 0x560b3c536850 2024-01-25T15:02:29.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6973fff640 1 -- 172.21.15.170:0/2522239878 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f6988019550 con 0x560b3c536850 2024-01-25T15:02:29.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f699ddfe740 1 -- 172.21.15.170:0/2522239878 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560b3c4c0c00 con 0x560b3c536850 2024-01-25T15:02:29.075 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f6973fff640 1 -- 172.21.15.170:0/2522239878 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f698802ad10 con 0x560b3c536850 2024-01-25T15:02:29.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f699ddfe740 10 client.15675 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:29.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.067+0000 7f699ddfe740 1 -- 172.21.15.170:0/2522239878 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560b3c45a070 con 0x560b3c536850 2024-01-25T15:02:29.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.068+0000 7f6973fff640 1 -- 172.21.15.170:0/2522239878 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560b3c4c0c00 con 0x560b3c536850 2024-01-25T15:02:29.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.068+0000 7f6973fff640 1 -- 172.21.15.170:0/2522239878 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6988021040 con 0x560b3c536850 2024-01-25T15:02:29.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.068+0000 7f699ddfe740 10 client.15675 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:29.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.068+0000 7f699ddfe740 10 client.15675 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:29.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.068+0000 7f699ddfe740 20 client.15675 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:29.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.068+0000 7f699ddfe740 1 --2- 172.21.15.170:0/2522239878 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x560b3c5a3ad0 0x560b3c5a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:29.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.068+0000 7f699ddfe740 4 client.15675 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-25T15:02:29.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.068+0000 7f699ddfe740 1 -- 172.21.15.170:0/2522239878 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560b3c492220 con 0x560b3c5a3ad0 2024-01-25T15:02:29.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.068+0000 7f6993fff640 1 --2- 172.21.15.170:0/2522239878 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x560b3c5a3ad0 0x560b3c5a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:29.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f6973fff640 10 client.15675 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:29.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f6993fff640 1 --2- 172.21.15.170:0/2522239878 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x560b3c5a3ad0 0x560b3c5a5ef0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae219fcd0a80d810 server_cookie=395fb5030f4b9a04 in_seq=0 out_seq=0 2024-01-25T15:02:29.076 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f6973fff640 1 -- 172.21.15.170:0/2522239878 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560b3c492220 con 0x560b3c5a3ad0 2024-01-25T15:02:29.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f6973fff640 10 client.15675 handle_command_reply: tid=0 2024-01-25T15:02:29.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f699ddfe740 1 client.15675 shutdown 2024-01-25T15:02:29.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f699ddfe740 1 -- 172.21.15.170:0/2522239878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c536850 msgr2=0x560b3c547460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:29.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f699ddfe740 1 --2- 172.21.15.170:0/2522239878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c536850 0x560b3c547460 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6988005fd0 tx=0x7f6988009f50 comp rx=0 tx=0).stop 2024-01-25T15:02:29.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f699ddfe740 1 -- 172.21.15.170:0/2522239878 shutdown_connections 2024-01-25T15:02:29.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f699ddfe740 1 --2- 172.21.15.170:0/2522239878 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x560b3c5a3ad0 0x560b3c5a5ef0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f699ddfe740 1 --2- 172.21.15.170:0/2522239878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x560b3c53b9c0 0x560b3c545530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f699ddfe740 1 --2- 172.21.15.170:0/2522239878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x560b3c536850 0x560b3c547460 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f6973fff640 0 client.15675 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:29.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f699ddfe740 1 --2- 172.21.15.170:0/2522239878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x560b3c535e60 0x560b3c546f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f699ddfe740 1 -- 172.21.15.170:0/2522239878 >> 172.21.15.170:0/2522239878 conn(0x560b3c52cfc0 msgr2=0x560b3c53fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:29.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f699ddfe740 1 -- 172.21.15.170:0/2522239878 shutdown_connections 2024-01-25T15:02:29.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f699ddfe740 1 -- 172.21.15.170:0/2522239878 wait complete. 2024-01-25T15:02:29.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.069+0000 7f699ddfe740 20 client.15675 trim_cache size 0 max 16384 2024-01-25T15:02:29.078 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:02:29.078 INFO:teuthology.orchestra.run.smithi170.stdout: "status": "IDLE (waiting for more scrubs)", 2024-01-25T15:02:29.078 INFO:teuthology.orchestra.run.smithi170.stdout: "scrubs": { 2024-01-25T15:02:29.078 INFO:teuthology.orchestra.run.smithi170.stdout: "818c6a98-2aca-4d6d-8412-3c3f7dc3b970": { 2024-01-25T15:02:29.078 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/", 2024-01-25T15:02:29.078 INFO:teuthology.orchestra.run.smithi170.stdout: "tag": "818c6a98-2aca-4d6d-8412-3c3f7dc3b970", 2024-01-25T15:02:29.078 INFO:teuthology.orchestra.run.smithi170.stdout: "options": "recursive,force" 2024-01-25T15:02:29.078 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:02:29.078 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:02:29.078 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:02:29.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.070+0000 7f699b161640 1 -- 172.21.15.170:0/4063533371 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f69840a1370 msgr2=0x7f69840a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:29.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.070+0000 7f699b161640 1 --2- 172.21.15.170:0/4063533371 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f69840a1370 0x7f69840a3830 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f698c096c70 tx=0x7f698c0057a0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.070+0000 7f699b161640 1 -- 172.21.15.170:0/4063533371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6994106aa0 msgr2=0x7f699419e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:29.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.070+0000 7f699b161640 1 --2- 172.21.15.170:0/4063533371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6994106aa0 0x7f699419e290 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f698c00eb10 tx=0x7f698c00c2d0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.070+0000 7f699b161640 1 -- 172.21.15.170:0/4063533371 shutdown_connections 2024-01-25T15:02:29.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.070+0000 7f699b161640 1 --2- 172.21.15.170:0/4063533371 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f69840a1370 0x7f69840a3830 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.070+0000 7f699b161640 1 --2- 172.21.15.170:0/4063533371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6994104170 0x7f6994197260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.070+0000 7f699b161640 1 --2- 172.21.15.170:0/4063533371 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6994106aa0 0x7f699419e290 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.070+0000 7f699b161640 1 --2- 172.21.15.170:0/4063533371 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6994101840 0x7f6994196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:29.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.070+0000 7f699b161640 1 -- 172.21.15.170:0/4063533371 >> 172.21.15.170:0/4063533371 conn(0x7f69940fb190 msgr2=0x7f6994102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:29.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.070+0000 7f699b161640 1 -- 172.21.15.170:0/4063533371 shutdown_connections 2024-01-25T15:02:29.080 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:29.070+0000 7f699b161640 1 -- 172.21.15.170:0/4063533371 wait complete. 2024-01-25T15:02:29.085 INFO:tasks.cephfs.filesystem:scrub status for tag:818c6a98-2aca-4d6d-8412-3c3f7dc3b970 - {'path': '/', 'tag': '818c6a98-2aca-4d6d-8412-3c3f7dc3b970', 'options': 'recursive,force'} 2024-01-25T15:02:29.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:29 smithi186 ceph-mon[35697]: pgmap v363: 97 pgs: 97 active+clean; 657 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-01-25T15:02:29.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:29 smithi186 ceph-mon[35697]: scrub queued for path: / 2024-01-25T15:02:29.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:29 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:02:29.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:29 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:02:29.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:29 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:02:29.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:29 smithi170 ceph-mon[31899]: pgmap v363: 97 pgs: 97 active+clean; 657 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-01-25T15:02:29.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:29 smithi170 ceph-mon[31899]: scrub queued for path: / 2024-01-25T15:02:29.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:29 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:02:29.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:29 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:02:29.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:29 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:02:29.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:29 smithi191 ceph-mon[36347]: pgmap v363: 97 pgs: 97 active+clean; 657 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 255 B/s wr, 11 op/s 2024-01-25T15:02:29.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:29 smithi191 ceph-mon[36347]: scrub queued for path: / 2024-01-25T15:02:29.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:29 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:02:29.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:29 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:02:29.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:29 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:02:30.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:30 smithi186 ceph-mon[35697]: scrub summary: idle 2024-01-25T15:02:30.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:30 smithi170 ceph-mon[31899]: scrub summary: idle 2024-01-25T15:02:30.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:30 smithi191 ceph-mon[36347]: scrub summary: idle 2024-01-25T15:02:31.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:31 smithi186 ceph-mon[35697]: pgmap v364: 97 pgs: 97 active+clean; 657 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-25T15:02:31.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:31 smithi170 ceph-mon[31899]: pgmap v364: 97 pgs: 97 active+clean; 657 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-25T15:02:31.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:31 smithi191 ceph-mon[36347]: pgmap v364: 97 pgs: 97 active+clean; 657 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-25T15:02:33.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:33 smithi186 ceph-mon[35697]: pgmap v365: 97 pgs: 97 active+clean; 657 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-25T15:02:33.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:33 smithi170 ceph-mon[31899]: pgmap v365: 97 pgs: 97 active+clean; 657 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-25T15:02:33.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:33 smithi191 ceph-mon[36347]: pgmap v365: 97 pgs: 97 active+clean; 657 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 10 op/s 2024-01-25T15:02:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.553+0000 7f3ba8925640 1 -- 172.21.15.170:0/2499390273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba40ffc10 msgr2=0x7f3ba4100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.553+0000 7f3ba8925640 1 --2- 172.21.15.170:0/2499390273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba40ffc10 0x7f3ba4100030 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009900 tx=0x7f3b9402bc30 comp rx=0 tx=0).stop 2024-01-25T15:02:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.553+0000 7f3ba8925640 1 -- 172.21.15.170:0/2499390273 shutdown_connections 2024-01-25T15:02:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.553+0000 7f3ba8925640 1 --2- 172.21.15.170:0/2499390273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ba41017c0 0x7f3ba4108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.553+0000 7f3ba8925640 1 --2- 172.21.15.170:0/2499390273 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ba4100e00 0x7f3ba4101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.553+0000 7f3ba8925640 1 --2- 172.21.15.170:0/2499390273 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba40ffc10 0x7f3ba4100030 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.553+0000 7f3ba8925640 1 -- 172.21.15.170:0/2499390273 >> 172.21.15.170:0/2499390273 conn(0x7f3ba40fb180 msgr2=0x7f3ba40fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.553+0000 7f3ba8925640 1 -- 172.21.15.170:0/2499390273 shutdown_connections 2024-01-25T15:02:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.553+0000 7f3ba8925640 1 -- 172.21.15.170:0/2499390273 wait complete. 2024-01-25T15:02:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.554+0000 7f3ba8925640 1 Processor -- start 2024-01-25T15:02:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.554+0000 7f3ba8925640 1 -- start start 2024-01-25T15:02:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.554+0000 7f3ba8925640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ba40ffc10 0x7f3ba4068ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.554+0000 7f3ba8925640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba4100e00 0x7f3ba419baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.554+0000 7f3ba8925640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ba41017c0 0x7f3ba419e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.554+0000 7f3ba8925640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba419e8c0 con 0x7f3ba4100e00 2024-01-25T15:02:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.554+0000 7f3ba8925640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba419ea30 con 0x7f3ba41017c0 2024-01-25T15:02:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.554+0000 7f3ba8925640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba419ebf0 con 0x7f3ba40ffc10 2024-01-25T15:02:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.554+0000 7f3ba1d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba4100e00 0x7f3ba419baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.554+0000 7f3ba1d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba4100e00 0x7f3ba419baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:46118/0 (socket says 172.21.15.170:46118) 2024-01-25T15:02:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.554+0000 7f3ba1d9b640 1 -- 172.21.15.170:0/4172179659 learned_addr learned my addr 172.21.15.170:0/4172179659 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.554+0000 7f3ba1d9b640 1 -- 172.21.15.170:0/4172179659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ba40ffc10 msgr2=0x7f3ba4068ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.555+0000 7f3ba259c640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ba40ffc10 0x7f3ba4068ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.555+0000 7f3ba2d9d640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ba41017c0 0x7f3ba419e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.555+0000 7f3ba1d9b640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ba40ffc10 0x7f3ba4068ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.555+0000 7f3ba1d9b640 1 -- 172.21.15.170:0/4172179659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ba41017c0 msgr2=0x7f3ba419e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.555+0000 7f3ba1d9b640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ba41017c0 0x7f3ba419e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.555+0000 7f3ba1d9b640 1 -- 172.21.15.170:0/4172179659 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b94009560 con 0x7f3ba4100e00 2024-01-25T15:02:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.555+0000 7f3ba259c640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ba40ffc10 0x7f3ba4068ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.555+0000 7f3ba2d9d640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ba41017c0 0x7f3ba419e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.555+0000 7f3ba1d9b640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba4100e00 0x7f3ba419baf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800b4a0 tx=0x7f3b9800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.555+0000 7f3b937fe640 1 -- 172.21.15.170:0/4172179659 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98010610 con 0x7f3ba4100e00 2024-01-25T15:02:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.555+0000 7f3b937fe640 1 -- 172.21.15.170:0/4172179659 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b98010c30 con 0x7f3ba4100e00 2024-01-25T15:02:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.555+0000 7f3ba8925640 1 -- 172.21.15.170:0/4172179659 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba419eed0 con 0x7f3ba4100e00 2024-01-25T15:02:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.555+0000 7f3b937fe640 1 -- 172.21.15.170:0/4172179659 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98017dd0 con 0x7f3ba4100e00 2024-01-25T15:02:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.555+0000 7f3ba8925640 1 -- 172.21.15.170:0/4172179659 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba419f380 con 0x7f3ba4100e00 2024-01-25T15:02:35.565 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.557+0000 7f3b937fe640 1 -- 172.21.15.170:0/4172179659 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f3b980173f0 con 0x7f3ba4100e00 2024-01-25T15:02:35.565 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.558+0000 7f3bab5c4740 1 Processor -- start 2024-01-25T15:02:35.565 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.558+0000 7f3bab5c4740 1 -- start start 2024-01-25T15:02:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.558+0000 7f3bab5c4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c8622a0 0x56318c8626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.558+0000 7f3bab5c4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c862c90 0x56318c867790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.558+0000 7f3bab5c4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c867e00 0x56318c86a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.558+0000 7f3bab5c4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318c7d2070 con 0x56318c867e00 2024-01-25T15:02:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.558+0000 7f3bab5c4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318c7cf760 con 0x56318c862c90 2024-01-25T15:02:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.558+0000 7f3bab5c4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318c7cb050 con 0x56318c8622a0 2024-01-25T15:02:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.558+0000 7f3ba1d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c867e00 0x56318c86a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.558+0000 7f3ba1d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c867e00 0x56318c86a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:46132/0 (socket says 172.21.15.170:46132) 2024-01-25T15:02:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.558+0000 7f3ba1d9b640 1 -- 172.21.15.170:0/859749751 learned_addr learned my addr 172.21.15.170:0/859749751 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.558+0000 7f3b937fe640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3b8c0a1420 0x7f3b8c0a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.558+0000 7f3ba259c640 1 --2- 172.21.15.170:0/859749751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c862c90 0x56318c867790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.558+0000 7f3ba2d9d640 1 --2- 172.21.15.170:0/859749751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c8622a0 0x56318c8626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.559+0000 7f3ba2d9d640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3b8c0a1420 0x7f3b8c0a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.559+0000 7f3b937fe640 1 -- 172.21.15.170:0/4172179659 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f3b980cc2d0 con 0x7f3ba4100e00 2024-01-25T15:02:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.559+0000 7f3ba1d9b640 1 -- 172.21.15.170:0/859749751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c8622a0 msgr2=0x56318c8626c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.559+0000 7f3ba1d9b640 1 --2- 172.21.15.170:0/859749751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c8622a0 0x56318c8626c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.559+0000 7f3ba1d9b640 1 -- 172.21.15.170:0/859749751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c862c90 msgr2=0x56318c867790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.559+0000 7f3ba1d9b640 1 --2- 172.21.15.170:0/859749751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c862c90 0x56318c867790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.559+0000 7f3ba1d9b640 1 -- 172.21.15.170:0/859749751 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56318c7c2e70 con 0x56318c867e00 2024-01-25T15:02:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.559+0000 7f3ba2d9d640 1 --2- 172.21.15.170:0/859749751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c8622a0 0x56318c8626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.559+0000 7f3ba1d9b640 1 --2- 172.21.15.170:0/859749751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c867e00 0x56318c86a290 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3b980c9d30 tx=0x7f3b9800bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341c27ce7882e5f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.559+0000 7f3ba2d9d640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3b8c0a1420 0x7f3b8c0a38e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x56318c8634f0 tx=0x7f3b9c008220 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.559+0000 7f3b90ff9640 1 -- 172.21.15.170:0/859749751 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98098d50 con 0x56318c867e00 2024-01-25T15:02:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.559+0000 7f3b90ff9640 1 -- 172.21.15.170:0/859749751 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b98099af0 con 0x56318c867e00 2024-01-25T15:02:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.559+0000 7f3b90ff9640 1 -- 172.21.15.170:0/859749751 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98097890 con 0x56318c867e00 2024-01-25T15:02:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.560+0000 7f3bab5c4740 1 -- 172.21.15.170:0/859749751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c867e00 msgr2=0x56318c86a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.560+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/859749751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c867e00 0x56318c86a290 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3b980c9d30 tx=0x7f3b9800bf90 comp rx=0 tx=0).stop 2024-01-25T15:02:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.560+0000 7f3bab5c4740 1 -- 172.21.15.170:0/859749751 shutdown_connections 2024-01-25T15:02:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.560+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/859749751 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c862c90 0x56318c867790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.560+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/859749751 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c867e00 0x56318c86a290 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.560+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/859749751 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c8622a0 0x56318c8626c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.560+0000 7f3bab5c4740 1 -- 172.21.15.170:0/859749751 >> 172.21.15.170:0/859749751 conn(0x56318c85d810 msgr2=0x56318c85dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.560+0000 7f3bab5c4740 1 -- 172.21.15.170:0/859749751 shutdown_connections 2024-01-25T15:02:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.560+0000 7f3bab5c4740 1 -- 172.21.15.170:0/859749751 wait complete. 2024-01-25T15:02:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.560+0000 7f3bab5c4740 1 -- start start 2024-01-25T15:02:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.560+0000 7f3bab5c4740 1 Processor -- start 2024-01-25T15:02:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3bab5c4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c8622a0 0x56318c86c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3bab5c4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c862c90 0x56318c86c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3bab5c4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c867e00 0x56318c873650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3bab5c4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318c7841e0 con 0x56318c8622a0 2024-01-25T15:02:35.568 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3bab5c4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318c783e80 con 0x56318c867e00 2024-01-25T15:02:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3bab5c4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318c7490c0 con 0x56318c862c90 2024-01-25T15:02:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3ba259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c8622a0 0x56318c86c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3bab5c4740 10 client.0 _ll_register_callbacks cb 0x56318c76eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3ba259c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c8622a0 0x56318c86c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:46144/0 (socket says 172.21.15.170:46144) 2024-01-25T15:02:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3ba259c640 1 -- 172.21.15.170:0/2218307835 learned_addr learned my addr 172.21.15.170:0/2218307835 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3ba2d9d640 1 --2- 172.21.15.170:0/2218307835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c867e00 0x56318c873650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3ba1d9b640 1 --2- 172.21.15.170:0/2218307835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c862c90 0x56318c86c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3ba259c640 1 -- 172.21.15.170:0/2218307835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c862c90 msgr2=0x56318c86c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3ba259c640 1 --2- 172.21.15.170:0/2218307835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c862c90 0x56318c86c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3ba259c640 1 -- 172.21.15.170:0/2218307835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c867e00 msgr2=0x56318c873650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3ba259c640 1 --2- 172.21.15.170:0/2218307835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c867e00 0x56318c873650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3ba259c640 1 -- 172.21.15.170:0/2218307835 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba419f380 con 0x56318c8622a0 2024-01-25T15:02:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3ba2d9d640 1 --2- 172.21.15.170:0/2218307835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c867e00 0x56318c873650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3ba259c640 1 --2- 172.21.15.170:0/2218307835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c8622a0 0x56318c86c0d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009900 tx=0x7f3b940048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ca6465dfe3478a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3b89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.561+0000 7f3b89ffb640 1 -- 172.21.15.170:0/2218307835 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94004b00 con 0x56318c8622a0 2024-01-25T15:02:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.562+0000 7f3b89ffb640 1 -- 172.21.15.170:0/2218307835 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f3b9402ce40 con 0x56318c8622a0 2024-01-25T15:02:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.562+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2218307835 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56318c7c4040 con 0x56318c8622a0 2024-01-25T15:02:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.562+0000 7f3b89ffb640 1 -- 172.21.15.170:0/2218307835 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b94004450 con 0x56318c8622a0 2024-01-25T15:02:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.562+0000 7f3bab5c4740 10 client.15687 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.562+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2218307835 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56318c7c96d0 con 0x56318c8622a0 2024-01-25T15:02:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.562+0000 7f3b89ffb640 1 -- 172.21.15.170:0/2218307835 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56318c7c4040 con 0x56318c8622a0 2024-01-25T15:02:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.562+0000 7f3b89ffb640 1 -- 172.21.15.170:0/2218307835 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3b9403c040 con 0x56318c8622a0 2024-01-25T15:02:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.562+0000 7f3bab5c4740 10 client.15687 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.562+0000 7f3bab5c4740 10 client.15687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.562+0000 7f3bab5c4740 20 client.15687 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.562+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/2218307835 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56318c877f80 0x56318c87a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.562+0000 7f3bab5c4740 4 client.15687 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:02:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.562+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2218307835 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56318c7c3d60 con 0x56318c877f80 2024-01-25T15:02:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.563+0000 7f3ba1d9b640 1 --2- 172.21.15.170:0/2218307835 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56318c877f80 0x56318c87a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.563+0000 7f3b89ffb640 10 client.15687 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.563+0000 7f3ba1d9b640 1 --2- 172.21.15.170:0/2218307835 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56318c877f80 0x56318c87a390 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af3c3e7c7b66866d server_cookie=f53c75c4d3dd19 in_seq=0 out_seq=0 2024-01-25T15:02:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.564+0000 7f3b89ffb640 1 -- 172.21.15.170:0/2218307835 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56318c7c3d60 con 0x56318c877f80 2024-01-25T15:02:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.564+0000 7f3b89ffb640 10 client.15687 handle_command_reply: tid=0 2024-01-25T15:02:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.564+0000 7f3bab5c4740 1 client.15687 shutdown 2024-01-25T15:02:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.564+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2218307835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c8622a0 msgr2=0x56318c86c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.564+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/2218307835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c8622a0 0x56318c86c0d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3b94009900 tx=0x7f3b940048d0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.564+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2218307835 shutdown_connections 2024-01-25T15:02:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.564+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/2218307835 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56318c877f80 0x56318c87a390 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.564+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/2218307835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c867e00 0x56318c873650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.564+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/2218307835 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c862c90 0x56318c86c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.564+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/2218307835 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c8622a0 0x56318c86c0d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.564+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2218307835 >> 172.21.15.170:0/2218307835 conn(0x56318c85d810 msgr2=0x56318c85ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.564+0000 7f3b89ffb640 0 client.15687 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.564+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2218307835 shutdown_connections 2024-01-25T15:02:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.564+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2218307835 wait complete. 2024-01-25T15:02:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.564+0000 7f3bab5c4740 20 client.15687 trim_cache size 0 max 16384 2024-01-25T15:02:35.582 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.577+0000 7f3bab5c4740 1 Processor -- start 2024-01-25T15:02:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.577+0000 7f3bab5c4740 1 -- start start 2024-01-25T15:02:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.577+0000 7f3bab5c4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c8622a0 0x56318c860a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.577+0000 7f3bab5c4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c862c90 0x56318c860fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.577+0000 7f3bab5c4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c867e00 0x56318c873570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.577+0000 7f3bab5c4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318c7c4040 con 0x56318c867e00 2024-01-25T15:02:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.577+0000 7f3bab5c4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318c8747b0 con 0x56318c8622a0 2024-01-25T15:02:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.577+0000 7f3bab5c4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318c877b20 con 0x56318c862c90 2024-01-25T15:02:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.577+0000 7f3ba2d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c867e00 0x56318c873570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.577+0000 7f3ba2d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c867e00 0x56318c873570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:46154/0 (socket says 172.21.15.170:46154) 2024-01-25T15:02:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.577+0000 7f3ba259c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c8622a0 0x56318c860a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.577+0000 7f3ba2d9d640 1 -- 172.21.15.170:0/1845353485 learned_addr learned my addr 172.21.15.170:0/1845353485 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.577+0000 7f3ba1d9b640 1 --2- 172.21.15.170:0/1845353485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c862c90 0x56318c860fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.578+0000 7f3ba2d9d640 1 -- 172.21.15.170:0/1845353485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c862c90 msgr2=0x56318c860fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.578+0000 7f3ba2d9d640 1 --2- 172.21.15.170:0/1845353485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c862c90 0x56318c860fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.578+0000 7f3ba2d9d640 1 -- 172.21.15.170:0/1845353485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c8622a0 msgr2=0x56318c860a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.578+0000 7f3ba2d9d640 1 --2- 172.21.15.170:0/1845353485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c8622a0 0x56318c860a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.578+0000 7f3ba2d9d640 1 -- 172.21.15.170:0/1845353485 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56318c766060 con 0x56318c867e00 2024-01-25T15:02:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.578+0000 7f3ba259c640 1 --2- 172.21.15.170:0/1845353485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c8622a0 0x56318c860a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:02:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.578+0000 7f3ba2d9d640 1 --2- 172.21.15.170:0/1845353485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c867e00 0x56318c873570 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c00a9b0 tx=0x7f3b9c0096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4536ff8026a5a898 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.578+0000 7f3b8bfff640 1 -- 172.21.15.170:0/1845353485 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c00c6f0 con 0x56318c867e00 2024-01-25T15:02:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.578+0000 7f3b8bfff640 1 -- 172.21.15.170:0/1845353485 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b9c021070 con 0x56318c867e00 2024-01-25T15:02:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.578+0000 7f3b8bfff640 1 -- 172.21.15.170:0/1845353485 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c01dc50 con 0x56318c867e00 2024-01-25T15:02:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 -- 172.21.15.170:0/1845353485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c867e00 msgr2=0x56318c873570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/1845353485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c867e00 0x56318c873570 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c00a9b0 tx=0x7f3b9c0096f0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 -- 172.21.15.170:0/1845353485 shutdown_connections 2024-01-25T15:02:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/1845353485 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c867e00 0x56318c873570 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/1845353485 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c862c90 0x56318c860fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/1845353485 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c8622a0 0x56318c860a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 -- 172.21.15.170:0/1845353485 >> 172.21.15.170:0/1845353485 conn(0x56318c85d810 msgr2=0x56318c863e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 -- 172.21.15.170:0/1845353485 shutdown_connections 2024-01-25T15:02:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 -- 172.21.15.170:0/1845353485 wait complete. 2024-01-25T15:02:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 -- start start 2024-01-25T15:02:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 Processor -- start 2024-01-25T15:02:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c8622a0 0x56318c8733c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c862c90 0x56318c8719d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c867e00 0x56318c871f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318c8724d0 con 0x56318c862c90 2024-01-25T15:02:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318c872640 con 0x56318c8622a0 2024-01-25T15:02:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.579+0000 7f3bab5c4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56318c872800 con 0x56318c867e00 2024-01-25T15:02:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3bab5c4740 10 client.0 _ll_register_callbacks cb 0x7f3b980957b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3ba1d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c862c90 0x56318c8719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3ba1d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c862c90 0x56318c8719d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:46170/0 (socket says 172.21.15.170:46170) 2024-01-25T15:02:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3ba1d9b640 1 -- 172.21.15.170:0/2712427718 learned_addr learned my addr 172.21.15.170:0/2712427718 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3ba259c640 1 --2- 172.21.15.170:0/2712427718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c8622a0 0x56318c8733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3ba2d9d640 1 --2- 172.21.15.170:0/2712427718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c867e00 0x56318c871f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3ba1d9b640 1 -- 172.21.15.170:0/2712427718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c867e00 msgr2=0x56318c871f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3ba1d9b640 1 --2- 172.21.15.170:0/2712427718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c867e00 0x56318c871f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3ba1d9b640 1 -- 172.21.15.170:0/2712427718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c8622a0 msgr2=0x56318c8733c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3ba1d9b640 1 --2- 172.21.15.170:0/2712427718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c8622a0 0x56318c8733c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3ba1d9b640 1 -- 172.21.15.170:0/2712427718 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56318c7c96d0 con 0x56318c862c90 2024-01-25T15:02:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3ba259c640 1 --2- 172.21.15.170:0/2712427718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c8622a0 0x56318c8733c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3ba1d9b640 1 --2- 172.21.15.170:0/2712427718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c862c90 0x56318c8719d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3b980c9d00 tx=0x7f3b980047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba06779715269cb server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3b89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3b89ffb640 1 -- 172.21.15.170:0/2712427718 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98098d50 con 0x56318c862c90 2024-01-25T15:02:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3b89ffb640 1 -- 172.21.15.170:0/2712427718 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f3b9809d540 con 0x56318c862c90 2024-01-25T15:02:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2712427718 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b98099af0 con 0x56318c862c90 2024-01-25T15:02:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3b89ffb640 1 -- 172.21.15.170:0/2712427718 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b980c9e70 con 0x56318c862c90 2024-01-25T15:02:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3bab5c4740 10 client.15693 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.580+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2712427718 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f3b9c00a670 con 0x56318c862c90 2024-01-25T15:02:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.581+0000 7f3b89ffb640 1 -- 172.21.15.170:0/2712427718 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b98099af0 con 0x56318c862c90 2024-01-25T15:02:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.581+0000 7f3b89ffb640 1 -- 172.21.15.170:0/2712427718 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3b980a12f0 con 0x56318c862c90 2024-01-25T15:02:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.581+0000 7f3bab5c4740 10 client.15693 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.581+0000 7f3bab5c4740 10 client.15693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.581+0000 7f3bab5c4740 20 client.15693 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.581+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/2712427718 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56318c8cf980 0x56318c8d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.581+0000 7f3bab5c4740 4 client.15693 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-25T15:02:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.581+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2712427718 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56318c4ca600 con 0x56318c8cf980 2024-01-25T15:02:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.581+0000 7f3ba259c640 1 --2- 172.21.15.170:0/2712427718 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56318c8cf980 0x56318c8d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.581+0000 7f3b89ffb640 10 client.15693 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.581+0000 7f3ba259c640 1 --2- 172.21.15.170:0/2712427718 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56318c8cf980 0x56318c8d1da0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=530e54efd79cb92b server_cookie=8d92d5418f948632 in_seq=0 out_seq=0 2024-01-25T15:02:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3b89ffb640 1 -- 172.21.15.170:0/2712427718 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56318c4ca600 con 0x56318c8cf980 2024-01-25T15:02:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3b89ffb640 10 client.15693 handle_command_reply: tid=0 2024-01-25T15:02:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3bab5c4740 1 client.15693 shutdown 2024-01-25T15:02:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2712427718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c862c90 msgr2=0x56318c8719d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/2712427718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c862c90 0x56318c8719d0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3b980c9d00 tx=0x7f3b980047d0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2712427718 shutdown_connections 2024-01-25T15:02:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/2712427718 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56318c8cf980 0x56318c8d1da0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/2712427718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56318c867e00 0x56318c871f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/2712427718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56318c862c90 0x56318c8719d0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3b89ffb640 0 client.15693 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3bab5c4740 1 --2- 172.21.15.170:0/2712427718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56318c8622a0 0x56318c8733c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2712427718 >> 172.21.15.170:0/2712427718 conn(0x56318c85d810 msgr2=0x56318c863e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2712427718 shutdown_connections 2024-01-25T15:02:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3bab5c4740 1 -- 172.21.15.170:0/2712427718 wait complete. 2024-01-25T15:02:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3bab5c4740 20 client.15693 trim_cache size 0 max 16384 2024-01-25T15:02:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:{ 2024-01-25T15:02:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "message": "", 2024-01-25T15:02:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "return_code": 0 2024-01-25T15:02:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:} 2024-01-25T15:02:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3ba8925640 1 -- 172.21.15.170:0/4172179659 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3b8c0a1420 msgr2=0x7f3b8c0a38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3ba8925640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3b8c0a1420 0x7f3b8c0a38e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x56318c8634f0 tx=0x7f3b9c008220 comp rx=0 tx=0).stop 2024-01-25T15:02:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3ba8925640 1 -- 172.21.15.170:0/4172179659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba4100e00 msgr2=0x7f3ba419baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.589+0000 7f3ba8925640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba4100e00 0x7f3ba419baf0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800b4a0 tx=0x7f3b9800b960 comp rx=0 tx=0).stop 2024-01-25T15:02:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.590+0000 7f3ba8925640 1 -- 172.21.15.170:0/4172179659 shutdown_connections 2024-01-25T15:02:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.590+0000 7f3ba8925640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3b8c0a1420 0x7f3b8c0a38e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.590+0000 7f3ba8925640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ba41017c0 0x7f3ba419e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.590+0000 7f3ba8925640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3ba4100e00 0x7f3ba419baf0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.590+0000 7f3ba8925640 1 --2- 172.21.15.170:0/4172179659 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3ba40ffc10 0x7f3ba4068ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.590+0000 7f3ba8925640 1 -- 172.21.15.170:0/4172179659 >> 172.21.15.170:0/4172179659 conn(0x7f3ba40fb180 msgr2=0x7f3ba41042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.590+0000 7f3ba8925640 1 -- 172.21.15.170:0/4172179659 shutdown_connections 2024-01-25T15:02:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:35.590+0000 7f3ba8925640 1 -- 172.21.15.170:0/4172179659 wait complete. 2024-01-25T15:02:35.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:35 smithi186 ceph-mon[35697]: pgmap v366: 97 pgs: 97 active+clean; 667 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-01-25T15:02:35.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:35 smithi170 ceph-mon[31899]: pgmap v366: 97 pgs: 97 active+clean; 667 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-01-25T15:02:35.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:35 smithi191 ceph-mon[36347]: pgmap v366: 97 pgs: 97 active+clean; 667 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.1 KiB/s wr, 12 op/s 2024-01-25T15:02:37.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:37 smithi186 ceph-mon[35697]: pgmap v367: 97 pgs: 97 active+clean; 667 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-01-25T15:02:37.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:37 smithi170 ceph-mon[31899]: pgmap v367: 97 pgs: 97 active+clean; 667 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-01-25T15:02:37.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:37 smithi191 ceph-mon[36347]: pgmap v367: 97 pgs: 97 active+clean; 667 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 853 B/s wr, 9 op/s 2024-01-25T15:02:39.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:39 smithi186 ceph-mon[35697]: pgmap v368: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-01-25T15:02:39.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:39 smithi170 ceph-mon[31899]: pgmap v368: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-01-25T15:02:39.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:39 smithi191 ceph-mon[36347]: pgmap v368: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-01-25T15:02:41.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:41 smithi186 ceph-mon[35697]: pgmap v369: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-01-25T15:02:41.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:41 smithi170 ceph-mon[31899]: pgmap v369: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-01-25T15:02:41.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:41 smithi191 ceph-mon[36347]: pgmap v369: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-01-25T15:02:43.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:43 smithi186 ceph-mon[35697]: pgmap v370: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-01-25T15:02:43.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:43 smithi170 ceph-mon[31899]: pgmap v370: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-01-25T15:02:43.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:43 smithi191 ceph-mon[36347]: pgmap v370: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-01-25T15:02:45.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:45 smithi186 ceph-mon[35697]: pgmap v371: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-01-25T15:02:45.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:45 smithi170 ceph-mon[31899]: pgmap v371: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-01-25T15:02:45.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:45 smithi191 ceph-mon[36347]: pgmap v371: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-01-25T15:02:47.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:47 smithi186 ceph-mon[35697]: pgmap v372: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-01-25T15:02:47.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:47 smithi170 ceph-mon[31899]: pgmap v372: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-01-25T15:02:47.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:47 smithi191 ceph-mon[36347]: pgmap v372: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 853 B/s wr, 10 op/s 2024-01-25T15:02:48.702 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.701+0000 7f2ba1890640 1 -- 172.21.15.170:0/416046635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b9c101f40 msgr2=0x7f2b9c1023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:48.702 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.701+0000 7f2ba1890640 1 --2- 172.21.15.170:0/416046635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b9c101f40 0x7f2b9c1023c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2b90009900 tx=0x7f2b9002bc50 comp rx=0 tx=0).stop 2024-01-25T15:02:48.702 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.701+0000 7f2ba1890640 1 -- 172.21.15.170:0/416046635 shutdown_connections 2024-01-25T15:02:48.702 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.701+0000 7f2ba1890640 1 --2- 172.21.15.170:0/416046635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b9c102900 0x7f2b9c109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.702 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.701+0000 7f2ba1890640 1 --2- 172.21.15.170:0/416046635 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b9c101f40 0x7f2b9c1023c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.702 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.701+0000 7f2ba1890640 1 --2- 172.21.15.170:0/416046635 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b9c100d50 0x7f2b9c101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.702 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.701+0000 7f2ba1890640 1 -- 172.21.15.170:0/416046635 >> 172.21.15.170:0/416046635 conn(0x7f2b9c0fc2c0 msgr2=0x7f2b9c0fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:48.702 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.701+0000 7f2ba1890640 1 -- 172.21.15.170:0/416046635 shutdown_connections 2024-01-25T15:02:48.702 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.701+0000 7f2ba1890640 1 -- 172.21.15.170:0/416046635 wait complete. 2024-01-25T15:02:48.702 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.701+0000 7f2ba1890640 1 Processor -- start 2024-01-25T15:02:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2ba1890640 1 -- start start 2024-01-25T15:02:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2ba1890640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b9c100d50 0x7f2b9c074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2ba1890640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b9c101f40 0x7f2b9c0730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2ba1890640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b9c102900 0x7f2b9c073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2ba1890640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c073d80 con 0x7f2b9c101f40 2024-01-25T15:02:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2ba1890640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c073ef0 con 0x7f2b9c100d50 2024-01-25T15:02:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2ba1890640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9c1a0c80 con 0x7f2b9c102900 2024-01-25T15:02:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2b9a7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b9c101f40 0x7f2b9c0730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2b9a7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b9c101f40 0x7f2b9c0730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50290/0 (socket says 172.21.15.170:50290) 2024-01-25T15:02:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2b9affd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b9c100d50 0x7f2b9c074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2b9a7fc640 1 -- 172.21.15.170:0/1904574240 learned_addr learned my addr 172.21.15.170:0/1904574240 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2b9b7fe640 1 --2- 172.21.15.170:0/1904574240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b9c102900 0x7f2b9c073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2b9affd640 1 -- 172.21.15.170:0/1904574240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b9c102900 msgr2=0x7f2b9c073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2b9affd640 1 --2- 172.21.15.170:0/1904574240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b9c102900 0x7f2b9c073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2b9affd640 1 -- 172.21.15.170:0/1904574240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b9c101f40 msgr2=0x7f2b9c0730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2b9affd640 1 --2- 172.21.15.170:0/1904574240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b9c101f40 0x7f2b9c0730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.702+0000 7f2b9affd640 1 -- 172.21.15.170:0/1904574240 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b90009560 con 0x7f2b9c100d50 2024-01-25T15:02:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.703+0000 7f2b9affd640 1 --2- 172.21.15.170:0/1904574240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b9c100d50 0x7f2b9c074aa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c970 tx=0x7f2b8c00ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.703+0000 7f2ba088e640 1 -- 172.21.15.170:0/1904574240 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c004220 con 0x7f2b9c100d50 2024-01-25T15:02:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.703+0000 7f2ba088e640 1 -- 172.21.15.170:0/1904574240 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b8c007e70 con 0x7f2b9c100d50 2024-01-25T15:02:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.703+0000 7f2ba088e640 1 -- 172.21.15.170:0/1904574240 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c003e90 con 0x7f2b9c100d50 2024-01-25T15:02:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.703+0000 7f2ba1890640 1 -- 172.21.15.170:0/1904574240 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9c1a0f30 con 0x7f2b9c100d50 2024-01-25T15:02:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.703+0000 7f2ba1890640 1 -- 172.21.15.170:0/1904574240 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9c1a1300 con 0x7f2b9c100d50 2024-01-25T15:02:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.705+0000 7f2ba088e640 1 -- 172.21.15.170:0/1904574240 <== mon.2 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 19) v1 ==== 135947+0+0 (secure 0 0 0) 0x7f2b8c0079b0 con 0x7f2b9c100d50 2024-01-25T15:02:48.706 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.706+0000 7f2ba088e640 1 --2- 172.21.15.170:0/1904574240 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b840a14a0 0x7f2b840a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.706+0000 7f2ba088e640 1 -- 172.21.15.170:0/1904574240 <== mon.2 v2:172.21.15.186:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f2b8c0cc850 con 0x7f2b9c100d50 2024-01-25T15:02:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.706+0000 7f2ba4454740 1 Processor -- start 2024-01-25T15:02:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.706+0000 7f2b9a7fc640 1 --2- 172.21.15.170:0/1904574240 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b840a14a0 0x7f2b840a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.706+0000 7f2ba4454740 1 -- start start 2024-01-25T15:02:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2ba4454740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef662a0 0x55762ef666c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2ba4454740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef66c90 0x55762ef6b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2ba4454740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef6be00 0x55762ef6e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2ba4454740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762eed6070 con 0x55762ef6be00 2024-01-25T15:02:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2ba4454740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762eed3760 con 0x55762ef662a0 2024-01-25T15:02:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2ba4454740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762eecf050 con 0x55762ef66c90 2024-01-25T15:02:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2b9affd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef662a0 0x55762ef666c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2b9b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef6be00 0x55762ef6e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2b9affd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef662a0 0x55762ef666c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:51824/0 (socket says 172.21.15.170:51824) 2024-01-25T15:02:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2b9b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef6be00 0x55762ef6e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50296/0 (socket says 172.21.15.170:50296) 2024-01-25T15:02:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2b9affd640 1 -- 172.21.15.170:0/1990402678 learned_addr learned my addr 172.21.15.170:0/1990402678 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2b9b7fe640 1 -- 172.21.15.170:0/1990402678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef66c90 msgr2=0x55762ef6b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:48.710 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2b9b7fe640 1 --2- 172.21.15.170:0/1990402678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef66c90 0x55762ef6b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.710 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2b9b7fe640 1 -- 172.21.15.170:0/1990402678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef662a0 msgr2=0x55762ef666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:48.710 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2b9b7fe640 1 --2- 172.21.15.170:0/1990402678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef662a0 0x55762ef666c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.710 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2b9b7fe640 1 -- 172.21.15.170:0/1990402678 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55762eec6e70 con 0x55762ef6be00 2024-01-25T15:02:48.710 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2b9a7fc640 1 --2- 172.21.15.170:0/1904574240 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b840a14a0 0x7f2b840a3960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c074810 tx=0x7f2b90004b70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:48.710 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2b9b7fe640 1 --2- 172.21.15.170:0/1990402678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef6be00 0x55762ef6e290 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009ed0 tx=0x7f2b940107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=583332acb1bc8e14 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:48.710 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.707+0000 7f2b81ffb640 1 -- 172.21.15.170:0/1990402678 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94003b70 con 0x55762ef6be00 2024-01-25T15:02:48.710 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.708+0000 7f2b81ffb640 1 -- 172.21.15.170:0/1990402678 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b94003cd0 con 0x55762ef6be00 2024-01-25T15:02:48.710 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.708+0000 7f2b81ffb640 1 -- 172.21.15.170:0/1990402678 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94011940 con 0x55762ef6be00 2024-01-25T15:02:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.708+0000 7f2ba4454740 1 -- 172.21.15.170:0/1990402678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef6be00 msgr2=0x55762ef6e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.708+0000 7f2ba4454740 1 --2- 172.21.15.170:0/1990402678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef6be00 0x55762ef6e290 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009ed0 tx=0x7f2b940107a0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.708+0000 7f2ba4454740 1 -- 172.21.15.170:0/1990402678 shutdown_connections 2024-01-25T15:02:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.708+0000 7f2ba4454740 1 --2- 172.21.15.170:0/1990402678 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef6be00 0x55762ef6e290 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.708+0000 7f2ba4454740 1 --2- 172.21.15.170:0/1990402678 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef66c90 0x55762ef6b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.708+0000 7f2ba4454740 1 --2- 172.21.15.170:0/1990402678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef662a0 0x55762ef666c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.708+0000 7f2ba4454740 1 -- 172.21.15.170:0/1990402678 >> 172.21.15.170:0/1990402678 conn(0x55762ef61810 msgr2=0x55762ef61c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.708+0000 7f2ba4454740 1 -- 172.21.15.170:0/1990402678 shutdown_connections 2024-01-25T15:02:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.708+0000 7f2ba4454740 1 -- 172.21.15.170:0/1990402678 wait complete. 2024-01-25T15:02:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.709+0000 7f2ba4454740 1 -- start start 2024-01-25T15:02:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.709+0000 7f2ba4454740 1 Processor -- start 2024-01-25T15:02:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.709+0000 7f2ba4454740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef662a0 0x55762ef78a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.709+0000 7f2ba4454740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef66c90 0x55762ef78f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.709+0000 7f2ba4454740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef6be00 0x55762ef7fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.709+0000 7f2ba4454740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762ee881e0 con 0x55762ef662a0 2024-01-25T15:02:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.709+0000 7f2ba4454740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762ee87e80 con 0x55762ef66c90 2024-01-25T15:02:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.709+0000 7f2ba4454740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762ee4d0c0 con 0x55762ef6be00 2024-01-25T15:02:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.709+0000 7f2b9affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef662a0 0x55762ef78a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.709+0000 7f2ba4454740 10 client.0 _ll_register_callbacks cb 0x55762ee72ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.709+0000 7f2b9affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef662a0 0x55762ef78a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50312/0 (socket says 172.21.15.170:50312) 2024-01-25T15:02:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.709+0000 7f2b9affd640 1 -- 172.21.15.170:0/1931103162 learned_addr learned my addr 172.21.15.170:0/1931103162 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.709+0000 7f2b9a7fc640 1 --2- 172.21.15.170:0/1931103162 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef66c90 0x55762ef78f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2b9b7fe640 1 --2- 172.21.15.170:0/1931103162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef6be00 0x55762ef7fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2b9affd640 1 -- 172.21.15.170:0/1931103162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef6be00 msgr2=0x55762ef7fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2b9affd640 1 --2- 172.21.15.170:0/1931103162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef6be00 0x55762ef7fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2b9affd640 1 -- 172.21.15.170:0/1931103162 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef66c90 msgr2=0x55762ef78f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2b9affd640 1 --2- 172.21.15.170:0/1931103162 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef66c90 0x55762ef78f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2b9affd640 1 -- 172.21.15.170:0/1931103162 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b94009bb0 con 0x55762ef662a0 2024-01-25T15:02:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2b9a7fc640 1 --2- 172.21.15.170:0/1931103162 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef66c90 0x55762ef78f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:02:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2b9b7fe640 1 --2- 172.21.15.170:0/1931103162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef6be00 0x55762ef7fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2b9affd640 1 --2- 172.21.15.170:0/1931103162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef662a0 0x55762ef78a50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0997f0 tx=0x7f2b8c0992d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff4b4b39535d178 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2b7affd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2b7affd640 1 -- 172.21.15.170:0/1931103162 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0b9070 con 0x55762ef662a0 2024-01-25T15:02:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2b7affd640 1 -- 172.21.15.170:0/1931103162 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f2b8c099860 con 0x55762ef662a0 2024-01-25T15:02:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2ba4454740 1 -- 172.21.15.170:0/1931103162 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55762eec8040 con 0x55762ef662a0 2024-01-25T15:02:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2b7affd640 1 -- 172.21.15.170:0/1931103162 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b8c09d9b0 con 0x55762ef662a0 2024-01-25T15:02:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2ba4454740 10 client.15705 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.710+0000 7f2ba4454740 1 -- 172.21.15.170:0/1931103162 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55762eecd6d0 con 0x55762ef662a0 2024-01-25T15:02:48.716 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.711+0000 7f2b7affd640 1 -- 172.21.15.170:0/1931103162 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55762eec8040 con 0x55762ef662a0 2024-01-25T15:02:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.711+0000 7f2b7affd640 1 -- 172.21.15.170:0/1931103162 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2b8c016030 con 0x55762ef662a0 2024-01-25T15:02:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.711+0000 7f2ba4454740 10 client.15705 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.711+0000 7f2ba4454740 10 client.15705 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.711+0000 7f2ba4454740 20 client.15705 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.711+0000 7f2ba4454740 1 --2- 172.21.15.170:0/1931103162 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55762ef84720 0x55762ef86b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.711+0000 7f2ba4454740 4 client.15705 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:02:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.711+0000 7f2ba4454740 1 -- 172.21.15.170:0/1931103162 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55762eec7d60 con 0x55762ef84720 2024-01-25T15:02:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.711+0000 7f2b9a7fc640 1 --2- 172.21.15.170:0/1931103162 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55762ef84720 0x55762ef86b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.712+0000 7f2b9a7fc640 1 --2- 172.21.15.170:0/1931103162 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55762ef84720 0x55762ef86b10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=643cdef79fb2c91b server_cookie=ca69e83eb47acc9 in_seq=0 out_seq=0 2024-01-25T15:02:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.712+0000 7f2b7affd640 10 client.15705 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.712+0000 7f2b7affd640 1 -- 172.21.15.170:0/1931103162 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55762eec7d60 con 0x55762ef84720 2024-01-25T15:02:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.712+0000 7f2b7affd640 10 client.15705 handle_command_reply: tid=0 2024-01-25T15:02:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.712+0000 7f2ba4454740 1 client.15705 shutdown 2024-01-25T15:02:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.712+0000 7f2ba4454740 1 -- 172.21.15.170:0/1931103162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef662a0 msgr2=0x55762ef78a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.712+0000 7f2ba4454740 1 --2- 172.21.15.170:0/1931103162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef662a0 0x55762ef78a50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0997f0 tx=0x7f2b8c0992d0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.712+0000 7f2ba4454740 1 -- 172.21.15.170:0/1931103162 shutdown_connections 2024-01-25T15:02:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.712+0000 7f2ba4454740 1 --2- 172.21.15.170:0/1931103162 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55762ef84720 0x55762ef86b10 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.713+0000 7f2ba4454740 1 --2- 172.21.15.170:0/1931103162 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef66c90 0x55762ef78f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.713+0000 7f2ba4454740 1 --2- 172.21.15.170:0/1931103162 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef6be00 0x55762ef7fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.713+0000 7f2ba4454740 1 --2- 172.21.15.170:0/1931103162 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef662a0 0x55762ef78a50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.713+0000 7f2ba4454740 1 -- 172.21.15.170:0/1931103162 >> 172.21.15.170:0/1931103162 conn(0x55762ef61810 msgr2=0x55762ef60a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.713+0000 7f2b7affd640 0 client.15705 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.713+0000 7f2ba4454740 1 -- 172.21.15.170:0/1931103162 shutdown_connections 2024-01-25T15:02:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.713+0000 7f2ba4454740 1 -- 172.21.15.170:0/1931103162 wait complete. 2024-01-25T15:02:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.713+0000 7f2ba4454740 20 client.15705 trim_cache size 0 max 16384 2024-01-25T15:02:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.738+0000 7f2ba4454740 1 Processor -- start 2024-01-25T15:02:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.738+0000 7f2ba4454740 1 -- start start 2024-01-25T15:02:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.738+0000 7f2ba4454740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef66c90 0x55762ef8b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.738+0000 7f2ba4454740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef6be00 0x55762ef7feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.738+0000 7f2ba4454740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef8b9d0 0x55762ef67f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.738+0000 7f2ba4454740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762ef6bbe0 con 0x55762ef66c90 2024-01-25T15:02:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.738+0000 7f2ba4454740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762ef62300 con 0x55762ef8b9d0 2024-01-25T15:02:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.738+0000 7f2ba4454740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762eec8040 con 0x55762ef6be00 2024-01-25T15:02:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.738+0000 7f2b9affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef66c90 0x55762ef8b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.739+0000 7f2b9affd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef66c90 0x55762ef8b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50328/0 (socket says 172.21.15.170:50328) 2024-01-25T15:02:48.742 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.739+0000 7f2b9affd640 1 -- 172.21.15.170:0/818675560 learned_addr learned my addr 172.21.15.170:0/818675560 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.739+0000 7f2b9a7fc640 1 --2- 172.21.15.170:0/818675560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef6be00 0x55762ef7feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.739+0000 7f2b9b7fe640 1 --2- 172.21.15.170:0/818675560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef8b9d0 0x55762ef67f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.739+0000 7f2b9affd640 1 -- 172.21.15.170:0/818675560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef6be00 msgr2=0x55762ef7feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.739+0000 7f2b9affd640 1 --2- 172.21.15.170:0/818675560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef6be00 0x55762ef7feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.739+0000 7f2b9affd640 1 -- 172.21.15.170:0/818675560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef8b9d0 msgr2=0x55762ef67f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.739+0000 7f2b9affd640 1 --2- 172.21.15.170:0/818675560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef8b9d0 0x55762ef67f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.739+0000 7f2b9affd640 1 -- 172.21.15.170:0/818675560 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55762ee6a060 con 0x55762ef66c90 2024-01-25T15:02:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.739+0000 7f2b9b7fe640 1 --2- 172.21.15.170:0/818675560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef8b9d0 0x55762ef67f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.739+0000 7f2b9affd640 1 --2- 172.21.15.170:0/818675560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef66c90 0x55762ef8b490 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0ccaf0 tx=0x7f2b8c097e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d7b0852fb0c2ee server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.739+0000 7f2b817fa640 1 -- 172.21.15.170:0/818675560 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0993a0 con 0x55762ef66c90 2024-01-25T15:02:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.739+0000 7f2b817fa640 1 -- 172.21.15.170:0/818675560 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2b8c082e90 con 0x55762ef66c90 2024-01-25T15:02:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.739+0000 7f2b817fa640 1 -- 172.21.15.170:0/818675560 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c003610 con 0x55762ef66c90 2024-01-25T15:02:48.743 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.740+0000 7f2ba4454740 1 -- 172.21.15.170:0/818675560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef66c90 msgr2=0x55762ef8b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.740+0000 7f2ba4454740 1 --2- 172.21.15.170:0/818675560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef66c90 0x55762ef8b490 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0ccaf0 tx=0x7f2b8c097e10 comp rx=0 tx=0).stop 2024-01-25T15:02:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.740+0000 7f2ba4454740 1 -- 172.21.15.170:0/818675560 shutdown_connections 2024-01-25T15:02:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.740+0000 7f2ba4454740 1 --2- 172.21.15.170:0/818675560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef8b9d0 0x55762ef67f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.740+0000 7f2ba4454740 1 --2- 172.21.15.170:0/818675560 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef6be00 0x55762ef7feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.740+0000 7f2ba4454740 1 --2- 172.21.15.170:0/818675560 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef66c90 0x55762ef8b490 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.740+0000 7f2ba4454740 1 -- 172.21.15.170:0/818675560 >> 172.21.15.170:0/818675560 conn(0x55762ef61810 msgr2=0x55762ef61bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.740+0000 7f2ba4454740 1 -- 172.21.15.170:0/818675560 shutdown_connections 2024-01-25T15:02:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.740+0000 7f2ba4454740 1 -- 172.21.15.170:0/818675560 wait complete. 2024-01-25T15:02:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.740+0000 7f2ba4454740 1 -- start start 2024-01-25T15:02:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2ba4454740 1 Processor -- start 2024-01-25T15:02:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2ba4454740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef66c90 0x55762ef7f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2ba4454740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef6be00 0x55762ef7fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2ba4454740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef8b9d0 0x55762ef7dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2ba4454740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762ef7e2d0 con 0x55762ef6be00 2024-01-25T15:02:48.745 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2ba4454740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762ef7e440 con 0x55762ef8b9d0 2024-01-25T15:02:48.745 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2ba4454740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762ef7e600 con 0x55762ef66c90 2024-01-25T15:02:48.745 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2b9a7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef6be00 0x55762ef7fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.745 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2b9a7fc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef6be00 0x55762ef7fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:50330/0 (socket says 172.21.15.170:50330) 2024-01-25T15:02:48.745 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2b9a7fc640 1 -- 172.21.15.170:0/3765327657 learned_addr learned my addr 172.21.15.170:0/3765327657 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:48.745 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2b9affd640 1 --2- 172.21.15.170:0/3765327657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef66c90 0x55762ef7f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.747 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2b9a7fc640 1 -- 172.21.15.170:0/3765327657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef66c90 msgr2=0x55762ef7f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:48.747 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2b9a7fc640 1 --2- 172.21.15.170:0/3765327657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef66c90 0x55762ef7f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.747 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2b9a7fc640 1 -- 172.21.15.170:0/3765327657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef8b9d0 msgr2=0x55762ef7dd10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-25T15:02:48.747 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2ba4454740 10 client.0 _ll_register_callbacks cb 0x7f2b940099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:48.747 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2b9a7fc640 1 --2- 172.21.15.170:0/3765327657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef8b9d0 0x55762ef7dd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.747 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2b9a7fc640 1 -- 172.21.15.170:0/3765327657 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55762eecd6d0 con 0x55762ef6be00 2024-01-25T15:02:48.747 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.741+0000 7f2ba4454740 1 -- 172.21.15.170:0/3765327657 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2b94003cd0 con 0x55762ef6be00 2024-01-25T15:02:48.747 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.742+0000 7f2b9a7fc640 1 --2- 172.21.15.170:0/3765327657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef6be00 0x55762ef7fc40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2b90005ab0 tx=0x7f2b9002bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1275d3c1216b4d60 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:48.747 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.742+0000 7f2b7affd640 10 client.15711 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:48.747 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.742+0000 7f2b7affd640 1 -- 172.21.15.170:0/3765327657 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b90053040 con 0x55762ef6be00 2024-01-25T15:02:48.747 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.742+0000 7f2b7affd640 1 -- 172.21.15.170:0/3765327657 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f2b90053bc0 con 0x55762ef6be00 2024-01-25T15:02:48.748 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.742+0000 7f2b7affd640 1 -- 172.21.15.170:0/3765327657 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b90046040 con 0x55762ef6be00 2024-01-25T15:02:48.748 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.742+0000 7f2ba4454740 10 client.15711 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:48.748 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.742+0000 7f2ba4454740 1 -- 172.21.15.170:0/3765327657 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({fsmap=26}) v3 -- 0x55762ee8fa80 con 0x55762ef6be00 2024-01-25T15:02:48.748 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.743+0000 7f2b7affd640 1 -- 172.21.15.170:0/3765327657 <== mon.0 v2:172.21.15.170:3300/0 4 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2b90059020 con 0x55762ef6be00 2024-01-25T15:02:48.748 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.743+0000 7f2ba4454740 10 client.15711 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:48.748 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.743+0000 7f2ba4454740 10 client.15711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:48.748 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.743+0000 7f2ba4454740 20 client.15711 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:48.748 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.743+0000 7f2ba4454740 1 --2- 172.21.15.170:0/3765327657 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55762efdbd50 0x55762efde170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:48.748 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.743+0000 7f2ba4454740 4 client.15711 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-25T15:02:48.748 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.743+0000 7f2ba4454740 1 -- 172.21.15.170:0/3765327657 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55762ebce600 con 0x55762efdbd50 2024-01-25T15:02:48.748 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.743+0000 7f2b9affd640 1 --2- 172.21.15.170:0/3765327657 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55762efdbd50 0x55762efde170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:48.748 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.743+0000 7f2b7affd640 10 client.15711 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:48.748 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.743+0000 7f2b9affd640 1 --2- 172.21.15.170:0/3765327657 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55762efdbd50 0x55762efde170 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74e97f6cc7b55cad server_cookie=180724ea99f50595 in_seq=0 out_seq=0 2024-01-25T15:02:48.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.747+0000 7f2b7affd640 1 -- 172.21.15.170:0/3765327657 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55762ebce600 con 0x55762efdbd50 2024-01-25T15:02:48.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.747+0000 7f2b7affd640 10 client.15711 handle_command_reply: tid=0 2024-01-25T15:02:48.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.747+0000 7f2ba4454740 1 client.15711 shutdown 2024-01-25T15:02:48.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.747+0000 7f2ba4454740 1 -- 172.21.15.170:0/3765327657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef6be00 msgr2=0x55762ef7fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:48.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.747+0000 7f2ba4454740 1 --2- 172.21.15.170:0/3765327657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef6be00 0x55762ef7fc40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2b90005ab0 tx=0x7f2b9002bc50 comp rx=0 tx=0).stop 2024-01-25T15:02:48.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.747+0000 7f2ba4454740 1 -- 172.21.15.170:0/3765327657 shutdown_connections 2024-01-25T15:02:48.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.747+0000 7f2ba4454740 1 --2- 172.21.15.170:0/3765327657 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55762efdbd50 0x55762efde170 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.747+0000 7f2ba4454740 1 --2- 172.21.15.170:0/3765327657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55762ef8b9d0 0x55762ef7dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.747+0000 7f2b7affd640 0 client.15711 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.747+0000 7f2ba4454740 1 --2- 172.21.15.170:0/3765327657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55762ef6be00 0x55762ef7fc40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.747+0000 7f2ba4454740 1 --2- 172.21.15.170:0/3765327657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55762ef66c90 0x55762ef7f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.747+0000 7f2ba4454740 1 -- 172.21.15.170:0/3765327657 >> 172.21.15.170:0/3765327657 conn(0x55762ef61810 msgr2=0x55762ef67f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.747+0000 7f2ba4454740 1 -- 172.21.15.170:0/3765327657 shutdown_connections 2024-01-25T15:02:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.747+0000 7f2ba4454740 1 -- 172.21.15.170:0/3765327657 wait complete. 2024-01-25T15:02:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.747+0000 7f2ba4454740 20 client.15711 trim_cache size 0 max 16384 2024-01-25T15:02:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:{ 2024-01-25T15:02:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "message": "", 2024-01-25T15:02:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "return_code": 0 2024-01-25T15:02:48.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:} 2024-01-25T15:02:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.748+0000 7f2ba1890640 1 -- 172.21.15.170:0/1904574240 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b840a14a0 msgr2=0x7f2b840a3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.748+0000 7f2ba1890640 1 --2- 172.21.15.170:0/1904574240 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b840a14a0 0x7f2b840a3960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c074810 tx=0x7f2b90004b70 comp rx=0 tx=0).stop 2024-01-25T15:02:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.748+0000 7f2ba1890640 1 -- 172.21.15.170:0/1904574240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b9c100d50 msgr2=0x7f2b9c074aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.748+0000 7f2ba1890640 1 --2- 172.21.15.170:0/1904574240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b9c100d50 0x7f2b9c074aa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00c970 tx=0x7f2b8c00ce30 comp rx=0 tx=0).stop 2024-01-25T15:02:48.752 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.748+0000 7f2ba1890640 1 -- 172.21.15.170:0/1904574240 shutdown_connections 2024-01-25T15:02:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.748+0000 7f2ba1890640 1 --2- 172.21.15.170:0/1904574240 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2b840a14a0 0x7f2b840a3960 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.748+0000 7f2ba1890640 1 --2- 172.21.15.170:0/1904574240 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2b9c102900 0x7f2b9c073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.748+0000 7f2ba1890640 1 --2- 172.21.15.170:0/1904574240 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2b9c101f40 0x7f2b9c0730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.748+0000 7f2ba1890640 1 --2- 172.21.15.170:0/1904574240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b9c100d50 0x7f2b9c074aa0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.748+0000 7f2ba1890640 1 -- 172.21.15.170:0/1904574240 >> 172.21.15.170:0/1904574240 conn(0x7f2b9c0fc2c0 msgr2=0x7f2b9c105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.748+0000 7f2ba1890640 1 -- 172.21.15.170:0/1904574240 shutdown_connections 2024-01-25T15:02:48.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:02:48.748+0000 7f2ba1890640 1 -- 172.21.15.170:0/1904574240 wait complete. 2024-01-25T15:02:49.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:49 smithi186 ceph-mon[35697]: pgmap v373: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 13 op/s 2024-01-25T15:02:49.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:49 smithi170 ceph-mon[31899]: pgmap v373: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 13 op/s 2024-01-25T15:02:49.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:49 smithi191 ceph-mon[36347]: pgmap v373: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 13 op/s 2024-01-25T15:02:51.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:51 smithi186 ceph-mon[35697]: pgmap v374: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:02:51.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:51 smithi170 ceph-mon[31899]: pgmap v374: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:02:51.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:51 smithi191 ceph-mon[36347]: pgmap v374: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-01-25T15:02:53.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:53 smithi186 ceph-mon[35697]: pgmap v375: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-25T15:02:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:53 smithi170 ceph-mon[31899]: pgmap v375: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-25T15:02:53.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:53 smithi191 ceph-mon[36347]: pgmap v375: 97 pgs: 97 active+clean; 668 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-01-25T15:02:55.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:55 smithi186 ceph-mon[35697]: pgmap v376: 97 pgs: 97 active+clean; 669 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-01-25T15:02:55.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:55 smithi170 ceph-mon[31899]: pgmap v376: 97 pgs: 97 active+clean; 669 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-01-25T15:02:55.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:55 smithi191 ceph-mon[36347]: pgmap v376: 97 pgs: 97 active+clean; 669 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 255 B/s wr, 11 op/s 2024-01-25T15:02:57.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:57 smithi186 ceph-mon[35697]: pgmap v377: 97 pgs: 97 active+clean; 669 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-01-25T15:02:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:57 smithi170 ceph-mon[31899]: pgmap v377: 97 pgs: 97 active+clean; 669 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-01-25T15:02:57.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:57 smithi191 ceph-mon[36347]: pgmap v377: 97 pgs: 97 active+clean; 669 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-01-25T15:02:59.086 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-25T15:02:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.249+0000 7f7b3bc56640 1 -- 172.21.15.170:0/2512249194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b34100de0 msgr2=0x7f7b34101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.249+0000 7f7b3bc56640 1 --2- 172.21.15.170:0/2512249194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b34100de0 0x7f7b34101260 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7b24009900 tx=0x7f7b2402bc30 comp rx=0 tx=0).stop 2024-01-25T15:02:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.249+0000 7f7b3bc56640 1 -- 172.21.15.170:0/2512249194 shutdown_connections 2024-01-25T15:02:59.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.249+0000 7f7b3bc56640 1 --2- 172.21.15.170:0/2512249194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b341017a0 0x7f7b34108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.249+0000 7f7b3bc56640 1 --2- 172.21.15.170:0/2512249194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b34100de0 0x7f7b34101260 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.249+0000 7f7b3bc56640 1 --2- 172.21.15.170:0/2512249194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b340ffbf0 0x7f7b34100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.249+0000 7f7b3bc56640 1 -- 172.21.15.170:0/2512249194 >> 172.21.15.170:0/2512249194 conn(0x7f7b340fb180 msgr2=0x7f7b340fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.250+0000 7f7b3bc56640 1 -- 172.21.15.170:0/2512249194 shutdown_connections 2024-01-25T15:02:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.250+0000 7f7b3bc56640 1 -- 172.21.15.170:0/2512249194 wait complete. 2024-01-25T15:02:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.250+0000 7f7b3bc56640 1 Processor -- start 2024-01-25T15:02:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.250+0000 7f7b3bc56640 1 -- start start 2024-01-25T15:02:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b3bc56640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b340ffbf0 0x7f7b340689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b3bc56640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b34100de0 0x7f7b3419de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b3bc56640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b341017a0 0x7f7b341a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b3bc56640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b341a0a30 con 0x7f7b340ffbf0 2024-01-25T15:02:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b399f2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b340ffbf0 0x7f7b340689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b3bc56640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b341a0ba0 con 0x7f7b341017a0 2024-01-25T15:02:59.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b399f2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b340ffbf0 0x7f7b340689c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53760/0 (socket says 172.21.15.170:53760) 2024-01-25T15:02:59.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b3bc56640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b341a0d60 con 0x7f7b34100de0 2024-01-25T15:02:59.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b399f2640 1 -- 172.21.15.170:0/189210549 learned_addr learned my addr 172.21.15.170:0/189210549 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:59.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b391f1640 1 --2- 172.21.15.170:0/189210549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b34100de0 0x7f7b3419de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b3a1f3640 1 --2- 172.21.15.170:0/189210549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b341017a0 0x7f7b341a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b399f2640 1 -- 172.21.15.170:0/189210549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b34100de0 msgr2=0x7f7b3419de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b399f2640 1 --2- 172.21.15.170:0/189210549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b34100de0 0x7f7b3419de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b399f2640 1 -- 172.21.15.170:0/189210549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b341017a0 msgr2=0x7f7b341a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b399f2640 1 --2- 172.21.15.170:0/189210549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b341017a0 0x7f7b341a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b399f2640 1 -- 172.21.15.170:0/189210549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b24009560 con 0x7f7b340ffbf0 2024-01-25T15:02:59.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.251+0000 7f7b399f2640 1 --2- 172.21.15.170:0/189210549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b340ffbf0 0x7f7b340689c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000d950 tx=0x7f7b3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.252+0000 7f7b2affd640 1 -- 172.21.15.170:0/189210549 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b30009c30 con 0x7f7b340ffbf0 2024-01-25T15:02:59.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.252+0000 7f7b2affd640 1 -- 172.21.15.170:0/189210549 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b30009d90 con 0x7f7b340ffbf0 2024-01-25T15:02:59.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.252+0000 7f7b2affd640 1 -- 172.21.15.170:0/189210549 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3000f6b0 con 0x7f7b340ffbf0 2024-01-25T15:02:59.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.252+0000 7f7b3bc56640 1 -- 172.21.15.170:0/189210549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b341a0fe0 con 0x7f7b340ffbf0 2024-01-25T15:02:59.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.252+0000 7f7b3bc56640 1 -- 172.21.15.170:0/189210549 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b341a13b0 con 0x7f7b340ffbf0 2024-01-25T15:02:59.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.255+0000 7f7b2affd640 1 -- 172.21.15.170:0/189210549 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f7b300109b0 con 0x7f7b340ffbf0 2024-01-25T15:02:59.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.255+0000 7f7b3e819740 1 Processor -- start 2024-01-25T15:02:59.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.255+0000 7f7b3e819740 1 -- start start 2024-01-25T15:02:59.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.256+0000 7f7b3e819740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3260 0x558cadff3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.256+0000 7f7b3e819740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3c50 0x558cadff8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.256+0000 7f7b3e819740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cadffb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.256+0000 7f7b3e819740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cadf593b0 con 0x558cadff8dc0 2024-01-25T15:02:59.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.256+0000 7f7b3e819740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cadf56aa0 con 0x558cadff3c50 2024-01-25T15:02:59.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.256+0000 7f7b3e819740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cadf52390 con 0x558cadff3260 2024-01-25T15:02:59.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.256+0000 7f7b3a1f3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3260 0x558cadff3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.256+0000 7f7b399f2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3c50 0x558cadff8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.256+0000 7f7b399f2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3c50 0x558cadff8750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:59162/0 (socket says 172.21.15.170:59162) 2024-01-25T15:02:59.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.256+0000 7f7b399f2640 1 -- 172.21.15.170:0/3593762826 learned_addr learned my addr 172.21.15.170:0/3593762826 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:59.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.256+0000 7f7b2affd640 1 --2- 172.21.15.170:0/189210549 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7b200a1310 0x7f7b200a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.256+0000 7f7b391f1640 1 --2- 172.21.15.170:0/3593762826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cadffb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.257+0000 7f7b2affd640 1 -- 172.21.15.170:0/189210549 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f7b300cc790 con 0x7f7b340ffbf0 2024-01-25T15:02:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.257+0000 7f7b3a1f3640 1 --2- 172.21.15.170:0/189210549 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7b200a1310 0x7f7b200a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.257+0000 7f7b391f1640 1 -- 172.21.15.170:0/3593762826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3260 msgr2=0x558cadff3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.257+0000 7f7b391f1640 1 --2- 172.21.15.170:0/3593762826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3260 0x558cadff3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.257+0000 7f7b391f1640 1 -- 172.21.15.170:0/3593762826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3c50 msgr2=0x558cadff8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.257+0000 7f7b391f1640 1 --2- 172.21.15.170:0/3593762826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3c50 0x558cadff8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.257+0000 7f7b391f1640 1 -- 172.21.15.170:0/3593762826 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cadf14810 con 0x558cadff8dc0 2024-01-25T15:02:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.257+0000 7f7b399f2640 1 --2- 172.21.15.170:0/3593762826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3c50 0x558cadff8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:02:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.257+0000 7f7b3a1f3640 1 --2- 172.21.15.170:0/189210549 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7b200a1310 0x7f7b200a37d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c005fd0 tx=0x7f7b2c009bb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.257+0000 7f7b391f1640 1 --2- 172.21.15.170:0/3593762826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cadffb250 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7b24036040 tx=0x7f7b2402c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e152cac87fbd185 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.258+0000 7f7b1ffff640 1 -- 172.21.15.170:0/3593762826 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2402caf0 con 0x558cadff8dc0 2024-01-25T15:02:59.259 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.258+0000 7f7b1ffff640 1 -- 172.21.15.170:0/3593762826 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b24004040 con 0x558cadff8dc0 2024-01-25T15:02:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.258+0000 7f7b1ffff640 1 -- 172.21.15.170:0/3593762826 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24003a50 con 0x558cadff8dc0 2024-01-25T15:02:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.259+0000 7f7b3e819740 1 -- 172.21.15.170:0/3593762826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 msgr2=0x558cadffb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.260 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.259+0000 7f7b3e819740 1 --2- 172.21.15.170:0/3593762826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cadffb250 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7b24036040 tx=0x7f7b2402c900 comp rx=0 tx=0).stop 2024-01-25T15:02:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.259+0000 7f7b3e819740 1 -- 172.21.15.170:0/3593762826 shutdown_connections 2024-01-25T15:02:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.259+0000 7f7b3e819740 1 --2- 172.21.15.170:0/3593762826 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3c50 0x558cadff8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.259+0000 7f7b3e819740 1 --2- 172.21.15.170:0/3593762826 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cadffb250 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.259+0000 7f7b3e819740 1 --2- 172.21.15.170:0/3593762826 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3260 0x558cadff3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.259+0000 7f7b3e819740 1 -- 172.21.15.170:0/3593762826 >> 172.21.15.170:0/3593762826 conn(0x558cadfee7d0 msgr2=0x558cadfeebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.260+0000 7f7b3e819740 1 -- 172.21.15.170:0/3593762826 shutdown_connections 2024-01-25T15:02:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.260+0000 7f7b3e819740 1 -- 172.21.15.170:0/3593762826 wait complete. 2024-01-25T15:02:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.260+0000 7f7b3e819740 1 -- start start 2024-01-25T15:02:59.261 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.260+0000 7f7b3e819740 1 Processor -- start 2024-01-25T15:02:59.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.261+0000 7f7b3e819740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3260 0x558cadffd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.261+0000 7f7b3e819740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3c50 0x558cadffd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.264 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.261+0000 7f7b3e819740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cae004a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.261+0000 7f7b3e819740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cadf0b780 con 0x558cadff8dc0 2024-01-25T15:02:59.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.261+0000 7f7b3a1f3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cae004a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.261+0000 7f7b3a1f3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cae004a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53770/0 (socket says 172.21.15.170:53770) 2024-01-25T15:02:59.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.261+0000 7f7b3a1f3640 1 -- 172.21.15.170:0/1022653011 learned_addr learned my addr 172.21.15.170:0/1022653011 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:59.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.261+0000 7f7b399f2640 1 --2- 172.21.15.170:0/1022653011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3260 0x558cadffd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.261+0000 7f7b391f1640 1 --2- 172.21.15.170:0/1022653011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3c50 0x558cadffd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.261+0000 7f7b3e819740 1 -- 172.21.15.170:0/1022653011 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cadf0b420 con 0x558cadff3260 2024-01-25T15:02:59.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.261+0000 7f7b3e819740 1 -- 172.21.15.170:0/1022653011 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x558caded0420 con 0x558cadff3c50 2024-01-25T15:02:59.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.262+0000 7f7b399f2640 1 -- 172.21.15.170:0/1022653011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3c50 msgr2=0x558cadffd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.262+0000 7f7b399f2640 1 --2- 172.21.15.170:0/1022653011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3c50 0x558cadffd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.262+0000 7f7b399f2640 1 -- 172.21.15.170:0/1022653011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 msgr2=0x558cae004a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.262+0000 7f7b399f2640 1 --2- 172.21.15.170:0/1022653011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cae004a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.262+0000 7f7b399f2640 1 -- 172.21.15.170:0/1022653011 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b34108930 con 0x558cadff3260 2024-01-25T15:02:59.265 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.262+0000 7f7b3a1f3640 1 --2- 172.21.15.170:0/1022653011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cae004a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:02:59.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.262+0000 7f7b399f2640 1 --2- 172.21.15.170:0/1022653011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3260 0x558cadffd480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b300ca630 tx=0x7f7b30095df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3b814d745e36465 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.262+0000 7f7b1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-01-25T15:02:59.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.262+0000 7f7b1d7fa640 1 -- 172.21.15.170:0/1022653011 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300999b0 con 0x558cadff3260 2024-01-25T15:02:59.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.262+0000 7f7b1d7fa640 1 -- 172.21.15.170:0/1022653011 <== mon.2 v2:172.21.15.186:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f7b3009da50 con 0x558cadff3260 2024-01-25T15:02:59.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.262+0000 7f7b3e819740 10 client.0 _ll_register_callbacks cb 0x558cadf0db90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:59.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.263+0000 7f7b3e819740 1 -- 172.21.15.170:0/1022653011 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558cadf27240 con 0x558cadff3260 2024-01-25T15:02:59.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.263+0000 7f7b1d7fa640 1 -- 172.21.15.170:0/1022653011 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b300a1c90 con 0x558cadff3260 2024-01-25T15:02:59.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.263+0000 7f7b3e819740 10 client.25073 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:59.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.263+0000 7f7b3e819740 1 -- 172.21.15.170:0/1022653011 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({fsmap=26}) v3 -- 0x558cadf50a10 con 0x558cadff3260 2024-01-25T15:02:59.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.263+0000 7f7b1d7fa640 1 -- 172.21.15.170:0/1022653011 <== mon.2 v2:172.21.15.186:3300/0 4 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7b300960c0 con 0x558cadff3260 2024-01-25T15:02:59.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.263+0000 7f7b3e819740 10 client.25073 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:59.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.263+0000 7f7b3e819740 10 client.25073 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:59.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.264+0000 7f7b3e819740 20 client.25073 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:59.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.264+0000 7f7b3e819740 1 --2- 172.21.15.170:0/1022653011 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558cae009380 0x558cae00b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.266 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.264+0000 7f7b3e819740 4 client.25073 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:02:59.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.264+0000 7f7b3e819740 1 -- 172.21.15.170:0/1022653011 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558cadf24b50 con 0x558cae009380 2024-01-25T15:02:59.267 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.264+0000 7f7b391f1640 1 --2- 172.21.15.170:0/1022653011 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558cae009380 0x558cae00b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.264+0000 7f7b391f1640 1 --2- 172.21.15.170:0/1022653011 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558cae009380 0x558cae00b840 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=953de4b64fefe4e2 server_cookie=f736ab10ef5af5a1 in_seq=0 out_seq=0 2024-01-25T15:02:59.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.264+0000 7f7b1d7fa640 10 client.25073 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:59.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.265+0000 7f7b1d7fa640 1 -- 172.21.15.170:0/1022653011 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558cadf24b50 con 0x558cae009380 2024-01-25T15:02:59.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.265+0000 7f7b1d7fa640 10 client.25073 handle_command_reply: tid=0 2024-01-25T15:02:59.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.265+0000 7f7b3e819740 1 client.25073 shutdown 2024-01-25T15:02:59.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.265+0000 7f7b3e819740 1 -- 172.21.15.170:0/1022653011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3260 msgr2=0x558cadffd480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.265+0000 7f7b3e819740 1 --2- 172.21.15.170:0/1022653011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3260 0x558cadffd480 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b300ca630 tx=0x7f7b30095df0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.265+0000 7f7b3e819740 1 -- 172.21.15.170:0/1022653011 shutdown_connections 2024-01-25T15:02:59.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.265+0000 7f7b3e819740 1 --2- 172.21.15.170:0/1022653011 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558cae009380 0x558cae00b840 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.265+0000 7f7b3e819740 1 --2- 172.21.15.170:0/1022653011 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cae004a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.265+0000 7f7b1d7fa640 0 client.25073 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:59.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.265+0000 7f7b3e819740 1 --2- 172.21.15.170:0/1022653011 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3c50 0x558cadffd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.266+0000 7f7b3e819740 1 --2- 172.21.15.170:0/1022653011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3260 0x558cadffd480 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.266+0000 7f7b3e819740 1 -- 172.21.15.170:0/1022653011 >> 172.21.15.170:0/1022653011 conn(0x558cadfee7d0 msgr2=0x558cadfe5240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.266+0000 7f7b3e819740 1 -- 172.21.15.170:0/1022653011 shutdown_connections 2024-01-25T15:02:59.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.266+0000 7f7b3e819740 1 -- 172.21.15.170:0/1022653011 wait complete. 2024-01-25T15:02:59.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.266+0000 7f7b3e819740 20 client.25073 trim_cache size 0 max 16384 2024-01-25T15:02:59.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.296+0000 7f7b3e819740 1 Processor -- start 2024-01-25T15:02:59.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.296+0000 7f7b3e819740 1 -- start start 2024-01-25T15:02:59.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.296+0000 7f7b3e819740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3260 0x558cae0101e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.296+0000 7f7b3e819740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3c50 0x558cae004990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.296+0000 7f7b3e819740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cadff51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.296+0000 7f7b3e819740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cadf24b50 con 0x558cadff8dc0 2024-01-25T15:02:59.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.296+0000 7f7b3e819740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cadfe1a90 con 0x558cadff3260 2024-01-25T15:02:59.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.296+0000 7f7b3e819740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cadffe1b0 con 0x558cadff3c50 2024-01-25T15:02:59.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.296+0000 7f7b3a1f3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cadff51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.296+0000 7f7b3a1f3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cadff51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53776/0 (socket says 172.21.15.170:53776) 2024-01-25T15:02:59.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.296+0000 7f7b3a1f3640 1 -- 172.21.15.170:0/2249503452 learned_addr learned my addr 172.21.15.170:0/2249503452 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:59.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.296+0000 7f7b399f2640 1 --2- 172.21.15.170:0/2249503452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3260 0x558cae0101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.296+0000 7f7b391f1640 1 --2- 172.21.15.170:0/2249503452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3c50 0x558cae004990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.297+0000 7f7b399f2640 1 -- 172.21.15.170:0/2249503452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3c50 msgr2=0x558cae004990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.297+0000 7f7b399f2640 1 --2- 172.21.15.170:0/2249503452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3c50 0x558cae004990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.297+0000 7f7b399f2640 1 -- 172.21.15.170:0/2249503452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 msgr2=0x558cadff51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.297+0000 7f7b399f2640 1 --2- 172.21.15.170:0/2249503452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cadff51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.297+0000 7f7b399f2640 1 -- 172.21.15.170:0/2249503452 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cadeed520 con 0x558cadff3260 2024-01-25T15:02:59.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.297+0000 7f7b3a1f3640 1 --2- 172.21.15.170:0/2249503452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cadff51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:02:59.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.297+0000 7f7b399f2640 1 --2- 172.21.15.170:0/2249503452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3260 0x558cae0101e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b30005d80 tx=0x7f7b30021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f0a52e60169730a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.297+0000 7f7b1f7fe640 1 -- 172.21.15.170:0/2249503452 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300a1c90 con 0x558cadff3260 2024-01-25T15:02:59.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.297+0000 7f7b1f7fe640 1 -- 172.21.15.170:0/2249503452 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558cadf27240 con 0x558cadff3260 2024-01-25T15:02:59.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.297+0000 7f7b1f7fe640 1 -- 172.21.15.170:0/2249503452 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300a18a0 con 0x558cadff3260 2024-01-25T15:02:59.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.298+0000 7f7b3e819740 1 -- 172.21.15.170:0/2249503452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3260 msgr2=0x558cae0101e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.298+0000 7f7b3e819740 1 --2- 172.21.15.170:0/2249503452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3260 0x558cae0101e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7b30005d80 tx=0x7f7b30021000 comp rx=0 tx=0).stop 2024-01-25T15:02:59.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.298+0000 7f7b3e819740 1 -- 172.21.15.170:0/2249503452 shutdown_connections 2024-01-25T15:02:59.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.298+0000 7f7b3e819740 1 --2- 172.21.15.170:0/2249503452 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff8dc0 0x558cadff51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.298+0000 7f7b3e819740 1 --2- 172.21.15.170:0/2249503452 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3c50 0x558cae004990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.298+0000 7f7b3e819740 1 --2- 172.21.15.170:0/2249503452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff3260 0x558cae0101e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.298+0000 7f7b3e819740 1 -- 172.21.15.170:0/2249503452 >> 172.21.15.170:0/2249503452 conn(0x558cadfee7d0 msgr2=0x558cadfeebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.298+0000 7f7b3e819740 1 -- 172.21.15.170:0/2249503452 shutdown_connections 2024-01-25T15:02:59.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.299+0000 7f7b3e819740 1 -- 172.21.15.170:0/2249503452 wait complete. 2024-01-25T15:02:59.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.299+0000 7f7b3e819740 1 -- start start 2024-01-25T15:02:59.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.299+0000 7f7b3e819740 1 Processor -- start 2024-01-25T15:02:59.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b3e819740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3260 0x558cae0041a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b3e819740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff3c50 0x558cae0046e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b391f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff3c50 0x558cae0046e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b399f2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3260 0x558cae0041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b391f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff3c50 0x558cae0046e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53782/0 (socket says 172.21.15.170:53782) 2024-01-25T15:02:59.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b399f2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3260 0x558cae0041a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:41814/0 (socket says 172.21.15.170:41814) 2024-01-25T15:02:59.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b399f2640 1 -- 172.21.15.170:0/2022516307 learned_addr learned my addr 172.21.15.170:0/2022516307 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:59.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b3e819740 1 --2- 172.21.15.170:0/2022516307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff8dc0 0x558cae0027b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b3e819740 1 -- 172.21.15.170:0/2022516307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cae002cf0 con 0x558cadff3c50 2024-01-25T15:02:59.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b3e819740 1 -- 172.21.15.170:0/2022516307 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cae002e60 con 0x558cadff8dc0 2024-01-25T15:02:59.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b3e819740 1 -- 172.21.15.170:0/2022516307 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cae002fd0 con 0x558cadff3260 2024-01-25T15:02:59.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b3a1f3640 1 --2- 172.21.15.170:0/2022516307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff8dc0 0x558cae0027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b3e819740 10 client.0 _ll_register_callbacks cb 0x7f7b30010c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:59.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b391f1640 1 -- 172.21.15.170:0/2022516307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3260 msgr2=0x558cae0041a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b391f1640 1 --2- 172.21.15.170:0/2022516307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3260 0x558cae0041a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b391f1640 1 -- 172.21.15.170:0/2022516307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff8dc0 msgr2=0x558cae0027b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b391f1640 1 --2- 172.21.15.170:0/2022516307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff8dc0 0x558cae0027b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b391f1640 1 -- 172.21.15.170:0/2022516307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2c00fa40 con 0x558cadff3c50 2024-01-25T15:02:59.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b399f2640 1 --2- 172.21.15.170:0/2022516307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3260 0x558cae0041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:02:59.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b391f1640 1 --2- 172.21.15.170:0/2022516307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff3c50 0x558cae0046e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7b24006010 tx=0x7f7b24005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c64888d67179d4 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.300+0000 7f7b1d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:59.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.303+0000 7f7b1d7fa640 1 -- 172.21.15.170:0/2022516307 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2404f040 con 0x558cadff3c50 2024-01-25T15:02:59.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.303+0000 7f7b1d7fa640 1 -- 172.21.15.170:0/2022516307 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f7b24004a50 con 0x558cadff3c50 2024-01-25T15:02:59.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.303+0000 7f7b3e819740 1 -- 172.21.15.170:0/2022516307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558cadf79c00 con 0x558cadff3c50 2024-01-25T15:02:59.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.303+0000 7f7b1d7fa640 1 -- 172.21.15.170:0/2022516307 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b24051b70 con 0x558cadff3c50 2024-01-25T15:02:59.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.303+0000 7f7b3e819740 10 client.15729 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:59.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.303+0000 7f7b3e819740 1 -- 172.21.15.170:0/2022516307 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558cadf50a10 con 0x558cadff3c50 2024-01-25T15:02:59.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.304+0000 7f7b1d7fa640 1 -- 172.21.15.170:0/2022516307 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b24060020 con 0x558cadff3c50 2024-01-25T15:02:59.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.304+0000 7f7b1d7fa640 1 -- 172.21.15.170:0/2022516307 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7b2403c050 con 0x558cadff3c50 2024-01-25T15:02:59.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.305+0000 7f7b3e819740 10 client.15729 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:59.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.305+0000 7f7b3e819740 10 client.15729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:02:59.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.305+0000 7f7b3e819740 20 client.15729 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:59.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.305+0000 7f7b3e819740 1 --2- 172.21.15.170:0/2022516307 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558cae009380 0x558cae062860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.305+0000 7f7b3e819740 4 client.15729 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-25T15:02:59.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.305+0000 7f7b3e819740 1 -- 172.21.15.170:0/2022516307 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558cadf79c00 con 0x558cae009380 2024-01-25T15:02:59.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.305+0000 7f7b399f2640 1 --2- 172.21.15.170:0/2022516307 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558cae009380 0x558cae062860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.305+0000 7f7b399f2640 1 --2- 172.21.15.170:0/2022516307 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558cae009380 0x558cae062860 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5eed2666cb38cde server_cookie=c02b625bbfe2968e in_seq=0 out_seq=0 2024-01-25T15:02:59.307 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.305+0000 7f7b1d7fa640 10 client.15729 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.306+0000 7f7b1d7fa640 1 -- 172.21.15.170:0/2022516307 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558cadf79c00 con 0x558cae009380 2024-01-25T15:02:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.306+0000 7f7b1d7fa640 10 client.15729 handle_command_reply: tid=0 2024-01-25T15:02:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.306+0000 7f7b3e819740 1 client.15729 shutdown 2024-01-25T15:02:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.306+0000 7f7b3e819740 1 -- 172.21.15.170:0/2022516307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff3c50 msgr2=0x558cae0046e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.306+0000 7f7b3e819740 1 --2- 172.21.15.170:0/2022516307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff3c50 0x558cae0046e0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7b24006010 tx=0x7f7b24005c00 comp rx=0 tx=0).stop 2024-01-25T15:02:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.306+0000 7f7b3e819740 1 -- 172.21.15.170:0/2022516307 shutdown_connections 2024-01-25T15:02:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.306+0000 7f7b3e819740 1 --2- 172.21.15.170:0/2022516307 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558cae009380 0x558cae062860 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.306+0000 7f7b3e819740 1 --2- 172.21.15.170:0/2022516307 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558cadff8dc0 0x558cae0027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.306+0000 7f7b1d7fa640 0 client.15729 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:02:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.306+0000 7f7b3e819740 1 --2- 172.21.15.170:0/2022516307 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558cadff3c50 0x558cae0046e0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.306+0000 7f7b3e819740 1 --2- 172.21.15.170:0/2022516307 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558cadff3260 0x558cae0041a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.306+0000 7f7b3e819740 1 -- 172.21.15.170:0/2022516307 >> 172.21.15.170:0/2022516307 conn(0x558cadfee7d0 msgr2=0x558cae0101e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.306+0000 7f7b3e819740 1 -- 172.21.15.170:0/2022516307 shutdown_connections 2024-01-25T15:02:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.306+0000 7f7b3e819740 1 -- 172.21.15.170:0/2022516307 wait complete. 2024-01-25T15:02:59.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.306+0000 7f7b3e819740 20 client.15729 trim_cache size 0 max 16384 2024-01-25T15:02:59.309 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:02:59.309 INFO:teuthology.orchestra.run.smithi170.stdout: "status": "no active scrubs running", 2024-01-25T15:02:59.309 INFO:teuthology.orchestra.run.smithi170.stdout: "scrubs": {} 2024-01-25T15:02:59.309 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:02:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.307+0000 7f7b3bc56640 1 -- 172.21.15.170:0/189210549 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7b200a1310 msgr2=0x7f7b200a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.307+0000 7f7b3bc56640 1 --2- 172.21.15.170:0/189210549 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7b200a1310 0x7f7b200a37d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c005fd0 tx=0x7f7b2c009bb0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.307+0000 7f7b3bc56640 1 -- 172.21.15.170:0/189210549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b340ffbf0 msgr2=0x7f7b340689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.307+0000 7f7b3bc56640 1 --2- 172.21.15.170:0/189210549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b340ffbf0 0x7f7b340689c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7b3000d950 tx=0x7f7b3000de10 comp rx=0 tx=0).stop 2024-01-25T15:02:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.307+0000 7f7b3bc56640 1 -- 172.21.15.170:0/189210549 shutdown_connections 2024-01-25T15:02:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.307+0000 7f7b3bc56640 1 --2- 172.21.15.170:0/189210549 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7b200a1310 0x7f7b200a37d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.307+0000 7f7b3bc56640 1 --2- 172.21.15.170:0/189210549 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b341017a0 0x7f7b341a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.307+0000 7f7b3bc56640 1 --2- 172.21.15.170:0/189210549 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7b34100de0 0x7f7b3419de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.307+0000 7f7b3bc56640 1 --2- 172.21.15.170:0/189210549 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7b340ffbf0 0x7f7b340689c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.307+0000 7f7b3bc56640 1 -- 172.21.15.170:0/189210549 >> 172.21.15.170:0/189210549 conn(0x7f7b340fb180 msgr2=0x7f7b34104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.307+0000 7f7b3bc56640 1 -- 172.21.15.170:0/189210549 shutdown_connections 2024-01-25T15:02:59.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.307+0000 7f7b3bc56640 1 -- 172.21.15.170:0/189210549 wait complete. 2024-01-25T15:02:59.322 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-25T15:02:59.323 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:02:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:59 smithi170 ceph-mon[31899]: pgmap v378: 97 pgs: 97 active+clean; 669 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-25T15:02:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:02:59 smithi170 ceph-mon[31899]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-01-25T15:02:59.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.451+0000 7fad21133640 1 -- 172.21.15.170:0/3306010132 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad1c1069f0 msgr2=0x7fad1c108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.451+0000 7fad21133640 1 --2- 172.21.15.170:0/3306010132 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad1c1069f0 0x7fad1c108e40 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fad14009ca0 tx=0x7fad1402c0f0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.451+0000 7fad21133640 1 -- 172.21.15.170:0/3306010132 shutdown_connections 2024-01-25T15:02:59.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.451+0000 7fad21133640 1 --2- 172.21.15.170:0/3306010132 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad1c1040c0 0x7fad1c1064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.451+0000 7fad21133640 1 --2- 172.21.15.170:0/3306010132 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad1c1069f0 0x7fad1c108e40 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.451+0000 7fad21133640 1 --2- 172.21.15.170:0/3306010132 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad1c101790 0x7fad1c103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.451+0000 7fad21133640 1 -- 172.21.15.170:0/3306010132 >> 172.21.15.170:0/3306010132 conn(0x7fad1c0fb180 msgr2=0x7fad1c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.451+0000 7fad21133640 1 -- 172.21.15.170:0/3306010132 shutdown_connections 2024-01-25T15:02:59.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.451+0000 7fad21133640 1 -- 172.21.15.170:0/3306010132 wait complete. 2024-01-25T15:02:59.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.452+0000 7fad21133640 1 Processor -- start 2024-01-25T15:02:59.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.452+0000 7fad21133640 1 -- start start 2024-01-25T15:02:59.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.452+0000 7fad21133640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad1c101790 0x7fad1c101100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.452+0000 7fad21133640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad1c1040c0 0x7fad1c0ff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.452+0000 7fad21133640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad1c1069f0 0x7fad1c0ffc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.453+0000 7fad21133640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c1003e0 con 0x7fad1c1040c0 2024-01-25T15:02:59.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.453+0000 7fad21133640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c100550 con 0x7fad1c101790 2024-01-25T15:02:59.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.453+0000 7fad21133640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c1a0ce0 con 0x7fad1c1069f0 2024-01-25T15:02:59.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.453+0000 7fad1a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad1c1040c0 0x7fad1c0ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.453+0000 7fad1a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad1c1040c0 0x7fad1c0ff740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53794/0 (socket says 172.21.15.170:53794) 2024-01-25T15:02:59.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.453+0000 7fad1a59c640 1 -- 172.21.15.170:0/3561055718 learned_addr learned my addr 172.21.15.170:0/3561055718 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:59.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.453+0000 7fad1ad9d640 1 --2- 172.21.15.170:0/3561055718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad1c101790 0x7fad1c101100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.453+0000 7fad1a59c640 1 -- 172.21.15.170:0/3561055718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad1c1069f0 msgr2=0x7fad1c0ffc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.453+0000 7fad1a59c640 1 --2- 172.21.15.170:0/3561055718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad1c1069f0 0x7fad1c0ffc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.453+0000 7fad1a59c640 1 -- 172.21.15.170:0/3561055718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad1c101790 msgr2=0x7fad1c101100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.453+0000 7fad1a59c640 1 --2- 172.21.15.170:0/3561055718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad1c101790 0x7fad1c101100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.453+0000 7fad1a59c640 1 -- 172.21.15.170:0/3561055718 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad10009490 con 0x7fad1c1040c0 2024-01-25T15:02:59.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.453+0000 7fad1a59c640 1 --2- 172.21.15.170:0/3561055718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad1c1040c0 0x7fad1c0ff740 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fad1000e9d0 tx=0x7fad1000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.453+0000 7fad03fff640 1 -- 172.21.15.170:0/3561055718 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1000cde0 con 0x7fad1c1040c0 2024-01-25T15:02:59.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.454+0000 7fad21133640 1 -- 172.21.15.170:0/3561055718 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad14009900 con 0x7fad1c1040c0 2024-01-25T15:02:59.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.454+0000 7fad03fff640 1 -- 172.21.15.170:0/3561055718 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad100035f0 con 0x7fad1c1040c0 2024-01-25T15:02:59.457 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.454+0000 7fad03fff640 1 -- 172.21.15.170:0/3561055718 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad100044e0 con 0x7fad1c1040c0 2024-01-25T15:02:59.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.454+0000 7fad21133640 1 -- 172.21.15.170:0/3561055718 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1c1a12e0 con 0x7fad1c1040c0 2024-01-25T15:02:59.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.455+0000 7fad21133640 1 -- 172.21.15.170:0/3561055718 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1c0fcc70 con 0x7fad1c1040c0 2024-01-25T15:02:59.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.456+0000 7fad03fff640 1 -- 172.21.15.170:0/3561055718 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fad10003a40 con 0x7fad1c1040c0 2024-01-25T15:02:59.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.457+0000 7fad03fff640 1 --2- 172.21.15.170:0/3561055718 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fad040a12e0 0x7fad040a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.458 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.457+0000 7fad03fff640 1 -- 172.21.15.170:0/3561055718 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fad10014070 con 0x7fad1c1040c0 2024-01-25T15:02:59.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.457+0000 7fad1ad9d640 1 --2- 172.21.15.170:0/3561055718 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fad040a12e0 0x7fad040a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.457+0000 7fad1ad9d640 1 --2- 172.21.15.170:0/3561055718 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fad040a12e0 0x7fad040a37a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009bd0 tx=0x7fad0c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.465 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.465+0000 7fad03fff640 1 -- 172.21.15.170:0/3561055718 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fad10096640 con 0x7fad1c1040c0 2024-01-25T15:02:59.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:59 smithi186 ceph-mon[35697]: pgmap v378: 97 pgs: 97 active+clean; 669 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-25T15:02:59.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:02:59 smithi186 ceph-mon[35697]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-01-25T15:02:59.695 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.695+0000 7fad21133640 1 -- 172.21.15.170:0/3561055718 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad1c10c5d0 con 0x7fad1c1040c0 2024-01-25T15:02:59.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.696+0000 7fad03fff640 1 -- 172.21.15.170:0/3561055718 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11411 (secure 0 0 0) 0x7fad1c10c5d0 con 0x7fad1c1040c0 2024-01-25T15:02:59.697 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:02:59.697 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-25T14:59:53.534085+0000","modified":"2024-01-25T15:01:49.253000+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24484,"mds_1":24479,"mds_2":24466,"mds_3":24418,"mds_4":24398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":4,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24479":{"gid":24479,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/2132502182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":2132502182},{"type":"v1","addr":"172.21.15.186:6839","nonce":2132502182}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:02:59.697 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 26 2024-01-25T15:02:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.699+0000 7fad21133640 1 -- 172.21.15.170:0/3561055718 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fad040a12e0 msgr2=0x7fad040a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.699+0000 7fad21133640 1 --2- 172.21.15.170:0/3561055718 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fad040a12e0 0x7fad040a37a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009bd0 tx=0x7fad0c005f90 comp rx=0 tx=0).stop 2024-01-25T15:02:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.699+0000 7fad21133640 1 -- 172.21.15.170:0/3561055718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad1c1040c0 msgr2=0x7fad1c0ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.699+0000 7fad21133640 1 --2- 172.21.15.170:0/3561055718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad1c1040c0 0x7fad1c0ff740 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fad1000e9d0 tx=0x7fad1000ee90 comp rx=0 tx=0).stop 2024-01-25T15:02:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.699+0000 7fad21133640 1 -- 172.21.15.170:0/3561055718 shutdown_connections 2024-01-25T15:02:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.699+0000 7fad21133640 1 --2- 172.21.15.170:0/3561055718 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fad040a12e0 0x7fad040a37a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.699+0000 7fad21133640 1 --2- 172.21.15.170:0/3561055718 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fad1c1069f0 0x7fad1c0ffc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.699+0000 7fad21133640 1 --2- 172.21.15.170:0/3561055718 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fad1c1040c0 0x7fad1c0ff740 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.699+0000 7fad21133640 1 --2- 172.21.15.170:0/3561055718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad1c101790 0x7fad1c101100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.699+0000 7fad21133640 1 -- 172.21.15.170:0/3561055718 >> 172.21.15.170:0/3561055718 conn(0x7fad1c0fb180 msgr2=0x7fad1c1020f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.699+0000 7fad21133640 1 -- 172.21.15.170:0/3561055718 shutdown_connections 2024-01-25T15:02:59.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.699+0000 7fad21133640 1 -- 172.21.15.170:0/3561055718 wait complete. 2024-01-25T15:02:59.715 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-01-25T15:02:59.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:59 smithi191 ceph-mon[36347]: pgmap v378: 97 pgs: 97 active+clean; 669 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-25T15:02:59.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:02:59 smithi191 ceph-mon[36347]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-01-25T15:02:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.821+0000 7fdb8f82b640 1 -- 172.21.15.170:0/4143129246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb88101770 msgr2=0x7fdb88103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.821+0000 7fdb8f82b640 1 --2- 172.21.15.170:0/4143129246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb88101770 0x7fdb88103b60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009900 tx=0x7fdb8402bc30 comp rx=0 tx=0).stop 2024-01-25T15:02:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.821+0000 7fdb8f82b640 1 -- 172.21.15.170:0/4143129246 shutdown_connections 2024-01-25T15:02:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.821+0000 7fdb8f82b640 1 --2- 172.21.15.170:0/4143129246 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb881040a0 0x7fdb88106490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.821+0000 7fdb8f82b640 1 --2- 172.21.15.170:0/4143129246 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb881069d0 0x7fdb88108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.821+0000 7fdb8f82b640 1 --2- 172.21.15.170:0/4143129246 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb88101770 0x7fdb88103b60 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.821+0000 7fdb8f82b640 1 -- 172.21.15.170:0/4143129246 >> 172.21.15.170:0/4143129246 conn(0x7fdb880fb180 msgr2=0x7fdb880fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.822 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.821+0000 7fdb8f82b640 1 -- 172.21.15.170:0/4143129246 shutdown_connections 2024-01-25T15:02:59.823 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.821+0000 7fdb8f82b640 1 -- 172.21.15.170:0/4143129246 wait complete. 2024-01-25T15:02:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.822+0000 7fdb8f82b640 1 Processor -- start 2024-01-25T15:02:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.822+0000 7fdb8f82b640 1 -- start start 2024-01-25T15:02:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.822+0000 7fdb8f82b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb88101770 0x7fdb88196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.822+0000 7fdb8f82b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb881040a0 0x7fdb88197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.822+0000 7fdb8f82b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb881069d0 0x7fdb8819e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.824 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.822+0000 7fdb8cdc6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb881040a0 0x7fdb88197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.822+0000 7fdb8cdc6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb881040a0 0x7fdb88197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53808/0 (socket says 172.21.15.170:53808) 2024-01-25T15:02:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.822+0000 7fdb8cdc6640 1 -- 172.21.15.170:0/3238054313 learned_addr learned my addr 172.21.15.170:0/3238054313 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.822+0000 7fdb8f82b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8819e840 con 0x7fdb881040a0 2024-01-25T15:02:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.822+0000 7fdb8f82b640 1 -- 172.21.15.170:0/3238054313 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8819e9b0 con 0x7fdb88101770 2024-01-25T15:02:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.822+0000 7fdb8f82b640 1 -- 172.21.15.170:0/3238054313 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8819eb70 con 0x7fdb881069d0 2024-01-25T15:02:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.822+0000 7fdb8d5c7640 1 --2- 172.21.15.170:0/3238054313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb88101770 0x7fdb88196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.822+0000 7fdb8ddc8640 1 --2- 172.21.15.170:0/3238054313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb881069d0 0x7fdb8819e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.823+0000 7fdb8cdc6640 1 -- 172.21.15.170:0/3238054313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb881069d0 msgr2=0x7fdb8819e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.823+0000 7fdb8cdc6640 1 --2- 172.21.15.170:0/3238054313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb881069d0 0x7fdb8819e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.823+0000 7fdb8cdc6640 1 -- 172.21.15.170:0/3238054313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb88101770 msgr2=0x7fdb88196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.823+0000 7fdb8cdc6640 1 --2- 172.21.15.170:0/3238054313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb88101770 0x7fdb88196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.823+0000 7fdb8cdc6640 1 -- 172.21.15.170:0/3238054313 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb78009490 con 0x7fdb881040a0 2024-01-25T15:02:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.823+0000 7fdb8cdc6640 1 --2- 172.21.15.170:0/3238054313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb881040a0 0x7fdb88197290 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800e9a0 tx=0x7fdb7800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.825 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.823+0000 7fdb7e7fc640 1 -- 172.21.15.170:0/3238054313 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7800cd80 con 0x7fdb881040a0 2024-01-25T15:02:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.823+0000 7fdb8f82b640 1 -- 172.21.15.170:0/3238054313 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb84009560 con 0x7fdb881040a0 2024-01-25T15:02:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.823+0000 7fdb8f82b640 1 -- 172.21.15.170:0/3238054313 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8819f1d0 con 0x7fdb881040a0 2024-01-25T15:02:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.823+0000 7fdb7e7fc640 1 -- 172.21.15.170:0/3238054313 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb780035f0 con 0x7fdb881040a0 2024-01-25T15:02:59.826 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.823+0000 7fdb7e7fc640 1 -- 172.21.15.170:0/3238054313 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb780044e0 con 0x7fdb881040a0 2024-01-25T15:02:59.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.826+0000 7fdb923ec740 1 Processor -- start 2024-01-25T15:02:59.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.826+0000 7fdb923ec740 1 -- start start 2024-01-25T15:02:59.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.826+0000 7fdb923ec740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f337350 0x563f4f337770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.827 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.826+0000 7fdb923ec740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f33c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.826+0000 7fdb923ec740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f33ceb0 0x563f4f33f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.826+0000 7fdb923ec740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4f2a1270 con 0x563f4f337d40 2024-01-25T15:02:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.826+0000 7fdb923ec740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4f29e960 con 0x563f4f33ceb0 2024-01-25T15:02:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.826+0000 7fdb923ec740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4f29a250 con 0x563f4f337350 2024-01-25T15:02:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.826+0000 7fdb8d5c7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f33c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.826+0000 7fdb8d5c7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f33c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53820/0 (socket says 172.21.15.170:53820) 2024-01-25T15:02:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.826+0000 7fdb8d5c7640 1 -- 172.21.15.170:0/2229506194 learned_addr learned my addr 172.21.15.170:0/2229506194 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.827+0000 7fdb7e7fc640 1 -- 172.21.15.170:0/3238054313 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fdb78010690 con 0x7fdb881040a0 2024-01-25T15:02:59.828 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.827+0000 7fdb8ddc8640 1 --2- 172.21.15.170:0/2229506194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f337350 0x563f4f337770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.827+0000 7fdb8d5c7640 1 -- 172.21.15.170:0/2229506194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f337350 msgr2=0x563f4f337770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.827+0000 7fdb8d5c7640 1 --2- 172.21.15.170:0/2229506194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f337350 0x563f4f337770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.827+0000 7fdb8d5c7640 1 -- 172.21.15.170:0/2229506194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f33ceb0 msgr2=0x563f4f33f340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-25T15:02:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.827+0000 7fdb8d5c7640 1 --2- 172.21.15.170:0/2229506194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f33ceb0 0x563f4f33f340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.827+0000 7fdb8d5c7640 1 -- 172.21.15.170:0/2229506194 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f4f25c7f0 con 0x563f4f337d40 2024-01-25T15:02:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.827+0000 7fdb8d5c7640 1 --2- 172.21.15.170:0/2229506194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f33c840 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdb84005ab0 tx=0x7fdb84005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9072346035a785 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.831 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.827+0000 7fdb737fe640 1 -- 172.21.15.170:0/2229506194 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8402cac0 con 0x563f4f337d40 2024-01-25T15:02:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.827+0000 7fdb737fe640 1 -- 172.21.15.170:0/2229506194 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb8402cc20 con 0x563f4f337d40 2024-01-25T15:02:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.827+0000 7fdb737fe640 1 -- 172.21.15.170:0/2229506194 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb840039b0 con 0x563f4f337d40 2024-01-25T15:02:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.828+0000 7fdb7e7fc640 1 --2- 172.21.15.170:0/3238054313 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdb740a1360 0x7fdb740a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.828+0000 7fdb8ddc8640 1 --2- 172.21.15.170:0/3238054313 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdb740a1360 0x7fdb740a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.828+0000 7fdb923ec740 1 -- 172.21.15.170:0/2229506194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 msgr2=0x563f4f33c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.828+0000 7fdb923ec740 1 --2- 172.21.15.170:0/2229506194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f33c840 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fdb84005ab0 tx=0x7fdb84005be0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.828+0000 7fdb7e7fc640 1 -- 172.21.15.170:0/3238054313 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fdb78014070 con 0x7fdb881040a0 2024-01-25T15:02:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.828+0000 7fdb8ddc8640 1 --2- 172.21.15.170:0/3238054313 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdb740a1360 0x7fdb740a3820 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x563f4f3385a0 tx=0x7fdb80009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 1 -- 172.21.15.170:0/2229506194 shutdown_connections 2024-01-25T15:02:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 1 --2- 172.21.15.170:0/2229506194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f33ceb0 0x563f4f33f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 1 --2- 172.21.15.170:0/2229506194 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f33c840 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.832 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 1 --2- 172.21.15.170:0/2229506194 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f337350 0x563f4f337770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 1 -- 172.21.15.170:0/2229506194 >> 172.21.15.170:0/2229506194 conn(0x563f4f32e4b0 msgr2=0x563f4f32e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 1 -- 172.21.15.170:0/2229506194 shutdown_connections 2024-01-25T15:02:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 1 -- 172.21.15.170:0/2229506194 wait complete. 2024-01-25T15:02:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 1 -- start start 2024-01-25T15:02:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 1 Processor -- start 2024-01-25T15:02:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f337350 0x563f4f33a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f33a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f33b960 0x563f4f33bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4f253610 con 0x563f4f337d40 2024-01-25T15:02:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4f2532b0 con 0x563f4f337350 2024-01-25T15:02:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4f218400 con 0x563f4f33b960 2024-01-25T15:02:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.829+0000 7fdb923ec740 10 client.0 _ll_register_callbacks cb 0x563f4f290ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb8cdc6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f33a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb8cdc6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f33a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53826/0 (socket says 172.21.15.170:53826) 2024-01-25T15:02:59.833 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb8cdc6640 1 -- 172.21.15.170:0/1019448605 learned_addr learned my addr 172.21.15.170:0/1019448605 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb8d5c7640 1 --2- 172.21.15.170:0/1019448605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f337350 0x563f4f33a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb8ddc8640 1 --2- 172.21.15.170:0/1019448605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f33b960 0x563f4f33bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb8cdc6640 1 -- 172.21.15.170:0/1019448605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f33b960 msgr2=0x563f4f33bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb8cdc6640 1 --2- 172.21.15.170:0/1019448605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f33b960 0x563f4f33bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb8cdc6640 1 -- 172.21.15.170:0/1019448605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f337350 msgr2=0x563f4f33a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb8cdc6640 1 --2- 172.21.15.170:0/1019448605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f337350 0x563f4f33a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb8cdc6640 1 -- 172.21.15.170:0/1019448605 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb88109a00 con 0x563f4f337d40 2024-01-25T15:02:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb8d5c7640 1 --2- 172.21.15.170:0/1019448605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f337350 0x563f4f33a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:02:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb8cdc6640 1 --2- 172.21.15.170:0/1019448605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f33a9c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdb780a1e80 tx=0x7fdb78099a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c60f0abef2e468a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb70ff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:02:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb70ff9640 1 -- 172.21.15.170:0/1019448605 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb780caea0 con 0x563f4f337d40 2024-01-25T15:02:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb70ff9640 1 -- 172.21.15.170:0/1019448605 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fdb780a23b0 con 0x563f4f337d40 2024-01-25T15:02:59.834 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb923ec740 1 -- 172.21.15.170:0/1019448605 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f4f292e00 con 0x563f4f337d40 2024-01-25T15:02:59.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb70ff9640 1 -- 172.21.15.170:0/1019448605 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb78003a40 con 0x563f4f337d40 2024-01-25T15:02:59.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb923ec740 10 client.15747 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:59.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.830+0000 7fdb923ec740 1 -- 172.21.15.170:0/1019448605 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563f4f2988d0 con 0x563f4f337d40 2024-01-25T15:02:59.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.831+0000 7fdb70ff9640 1 -- 172.21.15.170:0/1019448605 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb7807c020 con 0x563f4f337d40 2024-01-25T15:02:59.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.831+0000 7fdb70ff9640 1 -- 172.21.15.170:0/1019448605 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdb7801f060 con 0x563f4f337d40 2024-01-25T15:02:59.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.831+0000 7fdb923ec740 10 client.15747 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.831+0000 7fdb923ec740 10 client.15747 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-01-25T15:02:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.831+0000 7fdb923ec740 20 client.15747 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.831+0000 7fdb923ec740 1 --2- 172.21.15.170:0/1019448605 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f4f3495a0 0x563f4f34b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.831+0000 7fdb923ec740 4 client.15747 mds_command: new command op to 24398 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:02:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.831+0000 7fdb923ec740 1 -- 172.21.15.170:0/1019448605 --> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f4ef997e0 con 0x563f4f3495a0 2024-01-25T15:02:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.831+0000 7fdb8d5c7640 1 --2- 172.21.15.170:0/1019448605 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f4f3495a0 0x563f4f34b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.832+0000 7fdb70ff9640 10 client.15747 ms_handle_connect on v2:172.21.15.186:6832/1347511259 2024-01-25T15:02:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.832+0000 7fdb8d5c7640 1 --2- 172.21.15.170:0/1019448605 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f4f3495a0 0x563f4f34b9c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dbb700ce2853590e server_cookie=7cdc7f60eced3d5c in_seq=0 out_seq=0 2024-01-25T15:02:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.832+0000 7fdb70ff9640 1 -- 172.21.15.170:0/1019448605 <== mds.4 v2:172.21.15.186:6832/1347511259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563f4ef997e0 con 0x563f4f3495a0 2024-01-25T15:02:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.832+0000 7fdb70ff9640 10 client.15747 handle_command_reply: tid=0 2024-01-25T15:02:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.832+0000 7fdb923ec740 1 client.15747 shutdown 2024-01-25T15:02:59.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.833+0000 7fdb923ec740 1 -- 172.21.15.170:0/1019448605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 msgr2=0x563f4f33a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.833+0000 7fdb923ec740 1 --2- 172.21.15.170:0/1019448605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f33a9c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdb780a1e80 tx=0x7fdb78099a70 comp rx=0 tx=0).stop 2024-01-25T15:02:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.833+0000 7fdb923ec740 1 -- 172.21.15.170:0/1019448605 shutdown_connections 2024-01-25T15:02:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.833+0000 7fdb923ec740 1 --2- 172.21.15.170:0/1019448605 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f4f3495a0 0x563f4f34b9c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.833+0000 7fdb923ec740 1 --2- 172.21.15.170:0/1019448605 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f33b960 0x563f4f33bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.833+0000 7fdb923ec740 1 --2- 172.21.15.170:0/1019448605 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f33a9c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.833+0000 7fdb70ff9640 0 client.15747 ms_handle_reset on v2:172.21.15.186:6832/1347511259 2024-01-25T15:02:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.833+0000 7fdb923ec740 1 --2- 172.21.15.170:0/1019448605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f337350 0x563f4f33a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.833+0000 7fdb923ec740 1 -- 172.21.15.170:0/1019448605 >> 172.21.15.170:0/1019448605 conn(0x563f4f32e4b0 msgr2=0x563f4f32d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.833+0000 7fdb923ec740 1 -- 172.21.15.170:0/1019448605 shutdown_connections 2024-01-25T15:02:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.833+0000 7fdb923ec740 1 -- 172.21.15.170:0/1019448605 wait complete. 2024-01-25T15:02:59.841 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.833+0000 7fdb923ec740 20 client.15747 trim_cache size 0 max 16384 2024-01-25T15:02:59.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.855+0000 7fdb923ec740 1 Processor -- start 2024-01-25T15:02:59.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.855+0000 7fdb923ec740 1 -- start start 2024-01-25T15:02:59.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb923ec740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337350 0x563f4f33a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb923ec740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f337d40 0x563f4f33a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb923ec740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f33b960 0x563f4f338b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb923ec740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4f329be0 con 0x563f4f337350 2024-01-25T15:02:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb923ec740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4f32ecf0 con 0x563f4f337d40 2024-01-25T15:02:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb923ec740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4f320650 con 0x563f4f33b960 2024-01-25T15:02:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb8d5c7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337350 0x563f4f33a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb8d5c7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337350 0x563f4f33a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53832/0 (socket says 172.21.15.170:53832) 2024-01-25T15:02:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb8d5c7640 1 -- 172.21.15.170:0/185218193 learned_addr learned my addr 172.21.15.170:0/185218193 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb8cdc6640 1 --2- 172.21.15.170:0/185218193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f337d40 0x563f4f33a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb8ddc8640 1 --2- 172.21.15.170:0/185218193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f33b960 0x563f4f338b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb8d5c7640 1 -- 172.21.15.170:0/185218193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f33b960 msgr2=0x563f4f338b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb8d5c7640 1 --2- 172.21.15.170:0/185218193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f33b960 0x563f4f338b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb8d5c7640 1 -- 172.21.15.170:0/185218193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f337d40 msgr2=0x563f4f33a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb8d5c7640 1 --2- 172.21.15.170:0/185218193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f337d40 0x563f4f33a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb8d5c7640 1 -- 172.21.15.170:0/185218193 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f4f235500 con 0x563f4f337350 2024-01-25T15:02:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.856+0000 7fdb8d5c7640 1 --2- 172.21.15.170:0/185218193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337350 0x563f4f33a480 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009900 tx=0x7fdb84041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4bd8c82fdb51193 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.857+0000 7fdb72ffd640 1 -- 172.21.15.170:0/185218193 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8402cc20 con 0x563f4f337350 2024-01-25T15:02:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.857+0000 7fdb72ffd640 1 -- 172.21.15.170:0/185218193 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb84004500 con 0x563f4f337350 2024-01-25T15:02:59.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.857+0000 7fdb72ffd640 1 -- 172.21.15.170:0/185218193 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb84003850 con 0x563f4f337350 2024-01-25T15:02:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.857+0000 7fdb923ec740 1 -- 172.21.15.170:0/185218193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337350 msgr2=0x563f4f33a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.857+0000 7fdb923ec740 1 --2- 172.21.15.170:0/185218193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337350 0x563f4f33a480 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009900 tx=0x7fdb84041040 comp rx=0 tx=0).stop 2024-01-25T15:02:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.858+0000 7fdb923ec740 1 -- 172.21.15.170:0/185218193 shutdown_connections 2024-01-25T15:02:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.858+0000 7fdb923ec740 1 --2- 172.21.15.170:0/185218193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f337d40 0x563f4f33a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.858+0000 7fdb923ec740 1 --2- 172.21.15.170:0/185218193 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f33b960 0x563f4f338b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.858+0000 7fdb923ec740 1 --2- 172.21.15.170:0/185218193 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337350 0x563f4f33a480 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.858+0000 7fdb923ec740 1 -- 172.21.15.170:0/185218193 >> 172.21.15.170:0/185218193 conn(0x563f4f32e4b0 msgr2=0x563f4f333e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.858+0000 7fdb923ec740 1 -- 172.21.15.170:0/185218193 shutdown_connections 2024-01-25T15:02:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.858+0000 7fdb923ec740 1 -- 172.21.15.170:0/185218193 wait complete. 2024-01-25T15:02:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.858+0000 7fdb923ec740 1 -- start start 2024-01-25T15:02:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.858+0000 7fdb923ec740 1 Processor -- start 2024-01-25T15:02:59.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.858+0000 7fdb923ec740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f337350 0x563f4f343a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb923ec740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f343f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb8d5c7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f337350 0x563f4f343a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb8d5c7640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f337350 0x563f4f343a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:41888/0 (socket says 172.21.15.170:41888) 2024-01-25T15:02:59.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb8cdc6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f343f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb8cdc6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f343f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53848/0 (socket says 172.21.15.170:53848) 2024-01-25T15:02:59.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb8d5c7640 1 -- 172.21.15.170:0/1856531645 learned_addr learned my addr 172.21.15.170:0/1856531645 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:59.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb923ec740 1 --2- 172.21.15.170:0/1856531645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f33b960 0x563f4f344df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb923ec740 1 -- 172.21.15.170:0/1856531645 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4f345330 con 0x563f4f337d40 2024-01-25T15:02:59.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb923ec740 1 -- 172.21.15.170:0/1856531645 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4f3454a0 con 0x563f4f33b960 2024-01-25T15:02:59.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb923ec740 1 -- 172.21.15.170:0/1856531645 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f4f345660 con 0x563f4f337350 2024-01-25T15:02:59.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb923ec740 10 client.0 _ll_register_callbacks cb 0x7fdb800093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:59.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb8ddc8640 1 --2- 172.21.15.170:0/1856531645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f33b960 0x563f4f344df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb8d5c7640 1 -- 172.21.15.170:0/1856531645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f33b960 msgr2=0x563f4f344df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb8d5c7640 1 --2- 172.21.15.170:0/1856531645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f33b960 0x563f4f344df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb8d5c7640 1 -- 172.21.15.170:0/1856531645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 msgr2=0x563f4f343f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb8d5c7640 1 --2- 172.21.15.170:0/1856531645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f343f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb8d5c7640 1 -- 172.21.15.170:0/1856531645 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f4f25c7f0 con 0x563f4f337350 2024-01-25T15:02:59.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb923ec740 1 -- 172.21.15.170:0/1856531645 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f4efece30 con 0x563f4f337350 2024-01-25T15:02:59.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.859+0000 7fdb8cdc6640 1 --2- 172.21.15.170:0/1856531645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f343f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:02:59.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.860+0000 7fdb8d5c7640 1 --2- 172.21.15.170:0/1856531645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f337350 0x563f4f343a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdb8402c170 tx=0x7fdb84005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4163d0fefaf9c8a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.860+0000 7fdb70ff9640 10 client.25126 ms_handle_connect on v2:172.21.15.191:3300/0 2024-01-25T15:02:59.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.860+0000 7fdb70ff9640 1 -- 172.21.15.170:0/1856531645 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb840534c0 con 0x563f4f337350 2024-01-25T15:02:59.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.860+0000 7fdb70ff9640 1 -- 172.21.15.170:0/1856531645 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fdb84050070 con 0x563f4f337350 2024-01-25T15:02:59.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.860+0000 7fdb70ff9640 1 -- 172.21.15.170:0/1856531645 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb84004040 con 0x563f4f337350 2024-01-25T15:02:59.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.860+0000 7fdb923ec740 10 client.25126 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:59.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.860+0000 7fdb923ec740 1 -- 172.21.15.170:0/1856531645 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({fsmap=26}) v3 -- 0x563f4f25b050 con 0x563f4f337350 2024-01-25T15:02:59.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.860+0000 7fdb70ff9640 1 -- 172.21.15.170:0/1856531645 <== mon.1 v2:172.21.15.191:3300/0 4 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdb8403c050 con 0x563f4f337350 2024-01-25T15:02:59.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.860+0000 7fdb923ec740 10 client.25126 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:59.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.860+0000 7fdb923ec740 10 client.25126 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-01-25T15:02:59.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.860+0000 7fdb923ec740 20 client.25126 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:59.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.860+0000 7fdb923ec740 1 --2- 172.21.15.170:0/1856531645 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f4f3495a0 0x563f4f3a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.860+0000 7fdb923ec740 4 client.25126 mds_command: new command op to 24398 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:02:59.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.860+0000 7fdb923ec740 1 -- 172.21.15.170:0/1856531645 --> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563f4f3a2f40 con 0x563f4f3495a0 2024-01-25T15:02:59.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.861+0000 7fdb8cdc6640 1 --2- 172.21.15.170:0/1856531645 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f4f3495a0 0x563f4f3a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.861+0000 7fdb70ff9640 10 client.25126 ms_handle_connect on v2:172.21.15.186:6832/1347511259 2024-01-25T15:02:59.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.861+0000 7fdb8cdc6640 1 --2- 172.21.15.170:0/1856531645 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f4f3495a0 0x563f4f3a26d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d274ee2d2bb1485f server_cookie=3af7e0bb63a7a87c in_seq=0 out_seq=0 2024-01-25T15:02:59.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.861+0000 7fdb70ff9640 1 -- 172.21.15.170:0/1856531645 <== mds.4 v2:172.21.15.186:6832/1347511259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563f4f3a2f40 con 0x563f4f3495a0 2024-01-25T15:02:59.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.861+0000 7fdb70ff9640 10 client.25126 handle_command_reply: tid=0 2024-01-25T15:02:59.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.861+0000 7fdb923ec740 1 client.25126 shutdown 2024-01-25T15:02:59.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.862+0000 7fdb923ec740 1 -- 172.21.15.170:0/1856531645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f337350 msgr2=0x563f4f343a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.862+0000 7fdb923ec740 1 --2- 172.21.15.170:0/1856531645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f337350 0x563f4f343a50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdb8402c170 tx=0x7fdb84005dd0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.862+0000 7fdb923ec740 1 -- 172.21.15.170:0/1856531645 shutdown_connections 2024-01-25T15:02:59.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.862+0000 7fdb923ec740 1 --2- 172.21.15.170:0/1856531645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x563f4f33b960 0x563f4f344df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.862+0000 7fdb923ec740 1 --2- 172.21.15.170:0/1856531645 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x563f4f3495a0 0x563f4f3a26d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.862+0000 7fdb923ec740 1 --2- 172.21.15.170:0/1856531645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x563f4f337d40 0x563f4f343f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.862+0000 7fdb70ff9640 0 client.25126 ms_handle_reset on v2:172.21.15.186:6832/1347511259 2024-01-25T15:02:59.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.862+0000 7fdb923ec740 1 --2- 172.21.15.170:0/1856531645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x563f4f337350 0x563f4f343a50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.862+0000 7fdb923ec740 1 -- 172.21.15.170:0/1856531645 >> 172.21.15.170:0/1856531645 conn(0x563f4f32e4b0 msgr2=0x563f4f333e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.862+0000 7fdb923ec740 1 -- 172.21.15.170:0/1856531645 shutdown_connections 2024-01-25T15:02:59.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.862+0000 7fdb923ec740 1 -- 172.21.15.170:0/1856531645 wait complete. 2024-01-25T15:02:59.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.862+0000 7fdb923ec740 20 client.25126 trim_cache size 0 max 16384 2024-01-25T15:02:59.868 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:02:59.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.862+0000 7fdb8f82b640 1 -- 172.21.15.170:0/3238054313 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdb740a1360 msgr2=0x7fdb740a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.862+0000 7fdb8f82b640 1 --2- 172.21.15.170:0/3238054313 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdb740a1360 0x7fdb740a3820 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x563f4f3385a0 tx=0x7fdb80009500 comp rx=0 tx=0).stop 2024-01-25T15:02:59.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.863+0000 7fdb8f82b640 1 -- 172.21.15.170:0/3238054313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb881040a0 msgr2=0x7fdb88197290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.863+0000 7fdb8f82b640 1 --2- 172.21.15.170:0/3238054313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb881040a0 0x7fdb88197290 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800e9a0 tx=0x7fdb7800ee60 comp rx=0 tx=0).stop 2024-01-25T15:02:59.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.863+0000 7fdb8f82b640 1 -- 172.21.15.170:0/3238054313 shutdown_connections 2024-01-25T15:02:59.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.863+0000 7fdb8f82b640 1 --2- 172.21.15.170:0/3238054313 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdb740a1360 0x7fdb740a3820 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.863+0000 7fdb8f82b640 1 --2- 172.21.15.170:0/3238054313 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdb881069d0 0x7fdb8819e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.863+0000 7fdb8f82b640 1 --2- 172.21.15.170:0/3238054313 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdb881040a0 0x7fdb88197290 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.863+0000 7fdb8f82b640 1 --2- 172.21.15.170:0/3238054313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb88101770 0x7fdb88196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.863+0000 7fdb8f82b640 1 -- 172.21.15.170:0/3238054313 >> 172.21.15.170:0/3238054313 conn(0x7fdb880fb180 msgr2=0x7fdb88102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.863+0000 7fdb8f82b640 1 -- 172.21.15.170:0/3238054313 shutdown_connections 2024-01-25T15:02:59.870 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.863+0000 7fdb8f82b640 1 -- 172.21.15.170:0/3238054313 wait complete. 2024-01-25T15:02:59.877 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-01-25T15:02:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 -- 172.21.15.170:0/751344216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa474101790 msgr2=0x7fa474103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 --2- 172.21.15.170:0/751344216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa474101790 0x7fa474103b80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fa464009900 tx=0x7fa46402bc30 comp rx=0 tx=0).stop 2024-01-25T15:02:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 -- 172.21.15.170:0/751344216 shutdown_connections 2024-01-25T15:02:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 --2- 172.21.15.170:0/751344216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4741069f0 0x7fa474108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 --2- 172.21.15.170:0/751344216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4741040c0 0x7fa4741064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 --2- 172.21.15.170:0/751344216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa474101790 0x7fa474103b80 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 -- 172.21.15.170:0/751344216 >> 172.21.15.170:0/751344216 conn(0x7fa4740fb180 msgr2=0x7fa4740fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 -- 172.21.15.170:0/751344216 shutdown_connections 2024-01-25T15:02:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 -- 172.21.15.170:0/751344216 wait complete. 2024-01-25T15:02:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 Processor -- start 2024-01-25T15:02:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 -- start start 2024-01-25T15:02:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa474101790 0x7fa474101100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4741040c0 0x7fa4740ff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4741069f0 0x7fa4740ffc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4741003e0 con 0x7fa474101790 2024-01-25T15:02:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa474100550 con 0x7fa4741069f0 2024-01-25T15:02:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa479fc4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4741a0dc0 con 0x7fa4741040c0 2024-01-25T15:02:59.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa4737fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa474101790 0x7fa474101100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa4737fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa474101790 0x7fa474101100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53874/0 (socket says 172.21.15.170:53874) 2024-01-25T15:02:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa4737fe640 1 -- 172.21.15.170:0/1882103432 learned_addr learned my addr 172.21.15.170:0/1882103432 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa472ffd640 1 --2- 172.21.15.170:0/1882103432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4741040c0 0x7fa4740ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.982+0000 7fa473fff640 1 --2- 172.21.15.170:0/1882103432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4741069f0 0x7fa4740ffc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.984+0000 7fa4737fe640 1 -- 172.21.15.170:0/1882103432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4741040c0 msgr2=0x7fa4740ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.984+0000 7fa4737fe640 1 --2- 172.21.15.170:0/1882103432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4741040c0 0x7fa4740ff740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.984+0000 7fa4737fe640 1 -- 172.21.15.170:0/1882103432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4741069f0 msgr2=0x7fa4740ffc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.984+0000 7fa4737fe640 1 --2- 172.21.15.170:0/1882103432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4741069f0 0x7fa4740ffc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.984+0000 7fa4737fe640 1 -- 172.21.15.170:0/1882103432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa464009560 con 0x7fa474101790 2024-01-25T15:02:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.984+0000 7fa473fff640 1 --2- 172.21.15.170:0/1882103432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4741069f0 0x7fa4740ffc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:02:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.984+0000 7fa4737fe640 1 --2- 172.21.15.170:0/1882103432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa474101790 0x7fa474101100 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa464006010 tx=0x7fa464004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.984+0000 7fa470ff9640 1 -- 172.21.15.170:0/1882103432 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464004350 con 0x7fa474101790 2024-01-25T15:02:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.984+0000 7fa479fc4640 1 -- 172.21.15.170:0/1882103432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4741a1010 con 0x7fa474101790 2024-01-25T15:02:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.984+0000 7fa470ff9640 1 -- 172.21.15.170:0/1882103432 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4640044b0 con 0x7fa474101790 2024-01-25T15:02:59.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.984+0000 7fa470ff9640 1 -- 172.21.15.170:0/1882103432 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464003d60 con 0x7fa474101790 2024-01-25T15:02:59.987 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.984+0000 7fa479fc4640 1 -- 172.21.15.170:0/1882103432 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4741a1520 con 0x7fa474101790 2024-01-25T15:02:59.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.986+0000 7fa470ff9640 1 -- 172.21.15.170:0/1882103432 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fa464005000 con 0x7fa474101790 2024-01-25T15:02:59.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.986+0000 7fa470ff9640 1 --2- 172.21.15.170:0/1882103432 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa45c0a12e0 0x7fa45c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.986+0000 7fa47cb87740 1 Processor -- start 2024-01-25T15:02:59.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.986+0000 7fa47cb87740 1 -- start start 2024-01-25T15:02:59.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.986+0000 7fa472ffd640 1 --2- 172.21.15.170:0/1882103432 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa45c0a12e0 0x7fa45c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.986+0000 7fa47cb87740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a69f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.986+0000 7fa47cb87740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69f930 0x56281a6a4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.992 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.986+0000 7fa47cb87740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a6a4aa0 0x56281a6a6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.986+0000 7fa47cb87740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281a60d270 con 0x56281a69f930 2024-01-25T15:02:59.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.986+0000 7fa47cb87740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281a60a960 con 0x56281a69ef40 2024-01-25T15:02:59.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.986+0000 7fa47cb87740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281a606250 con 0x56281a6a4aa0 2024-01-25T15:02:59.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.986+0000 7fa470ff9640 1 -- 172.21.15.170:0/1882103432 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fa4640eee70 con 0x7fa474101790 2024-01-25T15:02:59.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.988+0000 7fa4737fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a69f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.988+0000 7fa4737fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a69f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:59266/0 (socket says 172.21.15.170:59266) 2024-01-25T15:02:59.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.988+0000 7fa4737fe640 1 -- 172.21.15.170:0/2301292234 learned_addr learned my addr 172.21.15.170:0/2301292234 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:59.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.988+0000 7fa473fff640 1 --2- 172.21.15.170:0/2301292234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a6a4aa0 0x56281a6a6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.988+0000 7fa472ffd640 1 --2- 172.21.15.170:0/2301292234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69f930 0x56281a6a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.988+0000 7fa4737fe640 1 -- 172.21.15.170:0/2301292234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a6a4aa0 msgr2=0x56281a6a6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.988+0000 7fa4737fe640 1 --2- 172.21.15.170:0/2301292234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a6a4aa0 0x56281a6a6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.988+0000 7fa4737fe640 1 -- 172.21.15.170:0/2301292234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69f930 msgr2=0x56281a6a4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.988+0000 7fa4737fe640 1 --2- 172.21.15.170:0/2301292234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69f930 0x56281a6a4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.993 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.988+0000 7fa4737fe640 1 -- 172.21.15.170:0/2301292234 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56281a5c87f0 con 0x56281a69ef40 2024-01-25T15:02:59.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.988+0000 7fa472ffd640 1 --2- 172.21.15.170:0/2301292234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69f930 0x56281a6a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:02:59.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.988+0000 7fa472ffd640 1 --2- 172.21.15.170:0/1882103432 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa45c0a12e0 0x7fa45c0a37a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa474100e70 tx=0x7fa468014950 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.988+0000 7fa4737fe640 1 --2- 172.21.15.170:0/2301292234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a69f360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4640b84e0 tx=0x7fa4640bb940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ebb50739c52b9d6 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.988+0000 7fa459ffb640 1 -- 172.21.15.170:0/2301292234 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4640c0130 con 0x56281a69ef40 2024-01-25T15:02:59.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.988+0000 7fa459ffb640 1 -- 172.21.15.170:0/2301292234 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4640c4370 con 0x56281a69ef40 2024-01-25T15:02:59.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.989+0000 7fa459ffb640 1 -- 172.21.15.170:0/2301292234 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa464003710 con 0x56281a69ef40 2024-01-25T15:02:59.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.989+0000 7fa47cb87740 1 -- 172.21.15.170:0/2301292234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 msgr2=0x56281a69f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.989+0000 7fa47cb87740 1 --2- 172.21.15.170:0/2301292234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a69f360 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa4640b84e0 tx=0x7fa4640bb940 comp rx=0 tx=0).stop 2024-01-25T15:02:59.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.989+0000 7fa47cb87740 1 -- 172.21.15.170:0/2301292234 shutdown_connections 2024-01-25T15:02:59.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.989+0000 7fa47cb87740 1 --2- 172.21.15.170:0/2301292234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a6a4aa0 0x56281a6a6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.989+0000 7fa47cb87740 1 --2- 172.21.15.170:0/2301292234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69f930 0x56281a6a4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.989+0000 7fa47cb87740 1 --2- 172.21.15.170:0/2301292234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a69f360 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.989+0000 7fa47cb87740 1 -- 172.21.15.170:0/2301292234 >> 172.21.15.170:0/2301292234 conn(0x56281a69a4b0 msgr2=0x56281a69a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:02:59.994 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.989+0000 7fa47cb87740 1 -- 172.21.15.170:0/2301292234 shutdown_connections 2024-01-25T15:02:59.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.989+0000 7fa47cb87740 1 -- 172.21.15.170:0/2301292234 wait complete. 2024-01-25T15:02:59.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.990+0000 7fa47cb87740 1 -- start start 2024-01-25T15:02:59.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.990+0000 7fa47cb87740 1 Processor -- start 2024-01-25T15:02:59.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.990+0000 7fa47cb87740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a6a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.990+0000 7fa47cb87740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a69f930 0x56281a6a9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.990+0000 7fa47cb87740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a6a4aa0 0x56281a6b0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.990+0000 7fa47cb87740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281a5bf610 con 0x56281a6a4aa0 2024-01-25T15:02:59.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.990+0000 7fa47cb87740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281a5bf2b0 con 0x56281a69ef40 2024-01-25T15:02:59.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.990+0000 7fa47cb87740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281a584400 con 0x56281a69f930 2024-01-25T15:02:59.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.990+0000 7fa47cb87740 10 client.0 _ll_register_callbacks cb 0x56281a5fcee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:02:59.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.990+0000 7fa473fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a6a4aa0 0x56281a6b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.990+0000 7fa4737fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a6a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.990+0000 7fa4737fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a6a8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:59282/0 (socket says 172.21.15.170:59282) 2024-01-25T15:02:59.995 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.990+0000 7fa4737fe640 1 -- 172.21.15.170:0/1341832088 learned_addr learned my addr 172.21.15.170:0/1341832088 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:02:59.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.990+0000 7fa473fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a6a4aa0 0x56281a6b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53896/0 (socket says 172.21.15.170:53896) 2024-01-25T15:02:59.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.990+0000 7fa472ffd640 1 --2- 172.21.15.170:0/1341832088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a69f930 0x56281a6a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.991+0000 7fa4737fe640 1 -- 172.21.15.170:0/1341832088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a69f930 msgr2=0x56281a6a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.991+0000 7fa4737fe640 1 --2- 172.21.15.170:0/1341832088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a69f930 0x56281a6a9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.991+0000 7fa4737fe640 1 -- 172.21.15.170:0/1341832088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a6a4aa0 msgr2=0x56281a6b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:02:59.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.991+0000 7fa4737fe640 1 --2- 172.21.15.170:0/1341832088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a6a4aa0 0x56281a6b0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.991+0000 7fa4737fe640 1 -- 172.21.15.170:0/1341832088 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4741a1520 con 0x56281a69ef40 2024-01-25T15:02:59.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.991+0000 7fa4737fe640 1 --2- 172.21.15.170:0/1341832088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a6a8df0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa4640ee040 tx=0x7fa4640bb700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cae6d149c3d47c5c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:02:59.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.991+0000 7fa452ffd640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-01-25T15:02:59.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.991+0000 7fa452ffd640 1 -- 172.21.15.170:0/1341832088 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4640036f0 con 0x56281a69ef40 2024-01-25T15:02:59.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.991+0000 7fa452ffd640 1 -- 172.21.15.170:0/1341832088 <== mon.2 v2:172.21.15.186:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fa4640ba120 con 0x56281a69ef40 2024-01-25T15:02:59.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.991+0000 7fa47cb87740 1 -- 172.21.15.170:0/1341832088 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56281a5ff0e0 con 0x56281a69ef40 2024-01-25T15:02:59.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.991+0000 7fa452ffd640 1 -- 172.21.15.170:0/1341832088 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4640c0130 con 0x56281a69ef40 2024-01-25T15:02:59.996 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.991+0000 7fa47cb87740 10 client.25106 fetch_fsmap learned FSMap version 26 2024-01-25T15:02:59.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.991+0000 7fa47cb87740 1 -- 172.21.15.170:0/1341832088 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56281a6048d0 con 0x56281a69ef40 2024-01-25T15:02:59.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.991+0000 7fa452ffd640 1 -- 172.21.15.170:0/1341832088 <== mon.2 v2:172.21.15.186:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4640aa030 con 0x56281a69ef40 2024-01-25T15:02:59.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.992+0000 7fa452ffd640 1 -- 172.21.15.170:0/1341832088 <== mon.2 v2:172.21.15.186:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa46403c070 con 0x56281a69ef40 2024-01-25T15:02:59.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.992+0000 7fa47cb87740 10 client.25106 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:02:59.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.992+0000 7fa47cb87740 10 client.25106 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-01-25T15:02:59.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.992+0000 7fa47cb87740 20 client.25106 populate_metadata read hostname 'smithi170' 2024-01-25T15:02:59.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.992+0000 7fa47cb87740 1 --2- 172.21.15.170:0/1341832088 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x56281a6b4800 0x56281a6b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:02:59.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.992+0000 7fa47cb87740 4 client.25106 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:02:59.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.992+0000 7fa47cb87740 1 -- 172.21.15.170:0/1341832088 --> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56281a5fee00 con 0x56281a6b4800 2024-01-25T15:02:59.997 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.992+0000 7fa472ffd640 1 --2- 172.21.15.170:0/1341832088 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x56281a6b4800 0x56281a6b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:02:59.998 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.993+0000 7fa452ffd640 10 client.25106 ms_handle_connect on v2:172.21.15.191:6832/274874056 2024-01-25T15:02:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.993+0000 7fa472ffd640 1 --2- 172.21.15.170:0/1341832088 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x56281a6b4800 0x56281a6b6bf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e0cb1bb469e6d6bf server_cookie=508003bbc6eba184 in_seq=0 out_seq=0 2024-01-25T15:02:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.993+0000 7fa452ffd640 1 -- 172.21.15.170:0/1341832088 <== mds.3 v2:172.21.15.191:6832/274874056 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56281a5fee00 con 0x56281a6b4800 2024-01-25T15:02:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.994+0000 7fa452ffd640 10 client.25106 handle_command_reply: tid=0 2024-01-25T15:02:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.994+0000 7fa47cb87740 1 client.25106 shutdown 2024-01-25T15:02:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.994+0000 7fa47cb87740 1 -- 172.21.15.170:0/1341832088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 msgr2=0x56281a6a8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:02:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.994+0000 7fa47cb87740 1 --2- 172.21.15.170:0/1341832088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a6a8df0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa4640ee040 tx=0x7fa4640bb700 comp rx=0 tx=0).stop 2024-01-25T15:02:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.994+0000 7fa47cb87740 1 -- 172.21.15.170:0/1341832088 shutdown_connections 2024-01-25T15:02:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.994+0000 7fa47cb87740 1 --2- 172.21.15.170:0/1341832088 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x56281a6b4800 0x56281a6b6bf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.994+0000 7fa47cb87740 1 --2- 172.21.15.170:0/1341832088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a6a4aa0 0x56281a6b0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.994+0000 7fa47cb87740 1 --2- 172.21.15.170:0/1341832088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a69f930 0x56281a6a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.994+0000 7fa47cb87740 1 --2- 172.21.15.170:0/1341832088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a6a8df0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:02:59.999 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.994+0000 7fa47cb87740 1 -- 172.21.15.170:0/1341832088 >> 172.21.15.170:0/1341832088 conn(0x56281a69a4b0 msgr2=0x56281a6997f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.994+0000 7fa452ffd640 0 client.25106 ms_handle_reset on v2:172.21.15.191:6832/274874056 2024-01-25T15:03:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.994+0000 7fa47cb87740 1 -- 172.21.15.170:0/1341832088 shutdown_connections 2024-01-25T15:03:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.994+0000 7fa47cb87740 1 -- 172.21.15.170:0/1341832088 wait complete. 2024-01-25T15:03:00.000 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:02:59.994+0000 7fa47cb87740 20 client.25106 trim_cache size 0 max 16384 2024-01-25T15:03:00.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.005+0000 7fa47cb87740 1 Processor -- start 2024-01-25T15:03:00.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.005+0000 7fa47cb87740 1 -- start start 2024-01-25T15:03:00.011 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa47cb87740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a6a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa47cb87740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69f930 0x56281a6b0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa47cb87740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a6a4aa0 0x56281a6a1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa47cb87740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281a696290 con 0x56281a69f930 2024-01-25T15:03:00.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa47cb87740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281a5fee00 con 0x56281a69ef40 2024-01-25T15:03:00.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa47cb87740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281a6a8870 con 0x56281a6a4aa0 2024-01-25T15:03:00.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa472ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69f930 0x56281a6b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa472ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69f930 0x56281a6b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53906/0 (socket says 172.21.15.170:53906) 2024-01-25T15:03:00.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa472ffd640 1 -- 172.21.15.170:0/3546015734 learned_addr learned my addr 172.21.15.170:0/3546015734 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa4737fe640 1 --2- 172.21.15.170:0/3546015734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a6a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa472ffd640 1 -- 172.21.15.170:0/3546015734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a6a4aa0 msgr2=0x56281a6a1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa473fff640 1 --2- 172.21.15.170:0/3546015734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a6a4aa0 0x56281a6a1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.012 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa472ffd640 1 --2- 172.21.15.170:0/3546015734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a6a4aa0 0x56281a6a1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa472ffd640 1 -- 172.21.15.170:0/3546015734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 msgr2=0x56281a6a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa472ffd640 1 --2- 172.21.15.170:0/3546015734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a6a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa472ffd640 1 -- 172.21.15.170:0/3546015734 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56281a5a1500 con 0x56281a69f930 2024-01-25T15:03:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa473fff640 1 --2- 172.21.15.170:0/3546015734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a6a4aa0 0x56281a6a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:03:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.006+0000 7fa472ffd640 1 --2- 172.21.15.170:0/3546015734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69f930 0x56281a6b0300 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x56281a69fd30 tx=0x7fa468016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5db17b5ae79c457 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.007+0000 7fa4597fa640 1 -- 172.21.15.170:0/3546015734 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46800b830 con 0x56281a69f930 2024-01-25T15:03:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.007+0000 7fa4597fa640 1 -- 172.21.15.170:0/3546015734 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa46801a070 con 0x56281a69f930 2024-01-25T15:03:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.007+0000 7fa4597fa640 1 -- 172.21.15.170:0/3546015734 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468005280 con 0x56281a69f930 2024-01-25T15:03:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.007+0000 7fa47cb87740 1 -- 172.21.15.170:0/3546015734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69f930 msgr2=0x56281a6b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.007+0000 7fa47cb87740 1 --2- 172.21.15.170:0/3546015734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69f930 0x56281a6b0300 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x56281a69fd30 tx=0x7fa468016040 comp rx=0 tx=0).stop 2024-01-25T15:03:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.007+0000 7fa47cb87740 1 -- 172.21.15.170:0/3546015734 shutdown_connections 2024-01-25T15:03:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.007+0000 7fa47cb87740 1 --2- 172.21.15.170:0/3546015734 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a6a4aa0 0x56281a6a1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.013 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.007+0000 7fa47cb87740 1 --2- 172.21.15.170:0/3546015734 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69f930 0x56281a6b0300 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.007+0000 7fa47cb87740 1 --2- 172.21.15.170:0/3546015734 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a69ef40 0x56281a6a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.007+0000 7fa47cb87740 1 -- 172.21.15.170:0/3546015734 >> 172.21.15.170:0/3546015734 conn(0x56281a69a4b0 msgr2=0x56281a6bb520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.007+0000 7fa47cb87740 1 -- 172.21.15.170:0/3546015734 shutdown_connections 2024-01-25T15:03:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.007+0000 7fa47cb87740 1 -- 172.21.15.170:0/3546015734 wait complete. 2024-01-25T15:03:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.008+0000 7fa47cb87740 1 -- start start 2024-01-25T15:03:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.008+0000 7fa47cb87740 1 Processor -- start 2024-01-25T15:03:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.008+0000 7fa47cb87740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69ef40 0x56281a6aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.008+0000 7fa47cb87740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a69f930 0x56281a6ae520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.008+0000 7fa47cb87740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a6a4aa0 0x56281a6aea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.008+0000 7fa47cb87740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281a6b0700 con 0x56281a69ef40 2024-01-25T15:03:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.008+0000 7fa47cb87740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281a6aefd0 con 0x56281a6a4aa0 2024-01-25T15:03:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.008+0000 7fa47cb87740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281a6af190 con 0x56281a69f930 2024-01-25T15:03:00.014 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.008+0000 7fa4737fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69ef40 0x56281a6aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.008+0000 7fa47cb87740 10 client.0 _ll_register_callbacks cb 0x7fa46c009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.008+0000 7fa4737fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69ef40 0x56281a6aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53918/0 (socket says 172.21.15.170:53918) 2024-01-25T15:03:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.008+0000 7fa4737fe640 1 -- 172.21.15.170:0/4002152334 learned_addr learned my addr 172.21.15.170:0/4002152334 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.008+0000 7fa472ffd640 1 --2- 172.21.15.170:0/4002152334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a69f930 0x56281a6ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.009+0000 7fa473fff640 1 --2- 172.21.15.170:0/4002152334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a6a4aa0 0x56281a6aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.009+0000 7fa4737fe640 1 -- 172.21.15.170:0/4002152334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a69f930 msgr2=0x56281a6ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.009+0000 7fa4737fe640 1 --2- 172.21.15.170:0/4002152334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a69f930 0x56281a6ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.009+0000 7fa4737fe640 1 -- 172.21.15.170:0/4002152334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a6a4aa0 msgr2=0x56281a6aea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.009+0000 7fa4737fe640 1 --2- 172.21.15.170:0/4002152334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a6a4aa0 0x56281a6aea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.009+0000 7fa4737fe640 1 -- 172.21.15.170:0/4002152334 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4680105d0 con 0x56281a69ef40 2024-01-25T15:03:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.009+0000 7fa473fff640 1 --2- 172.21.15.170:0/4002152334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a6a4aa0 0x56281a6aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:03:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.009+0000 7fa4737fe640 1 --2- 172.21.15.170:0/4002152334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69ef40 0x56281a6aff10 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa4640ec9f0 tx=0x7fa4640bbdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=512e42c7238c7c64 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.009+0000 7fa452ffd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:00.015 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.009+0000 7fa452ffd640 1 -- 172.21.15.170:0/4002152334 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4640bb770 con 0x56281a69ef40 2024-01-25T15:03:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.009+0000 7fa452ffd640 1 -- 172.21.15.170:0/4002152334 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fa4640ba120 con 0x56281a69ef40 2024-01-25T15:03:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.009+0000 7fa47cb87740 1 -- 172.21.15.170:0/4002152334 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4640c4370 con 0x56281a69ef40 2024-01-25T15:03:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.009+0000 7fa452ffd640 1 -- 172.21.15.170:0/4002152334 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4640c0130 con 0x56281a69ef40 2024-01-25T15:03:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.009+0000 7fa47cb87740 10 client.15771 fetch_fsmap learned FSMap version 26 2024-01-25T15:03:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.009+0000 7fa47cb87740 1 -- 172.21.15.170:0/4002152334 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56281a5c7050 con 0x56281a69ef40 2024-01-25T15:03:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.010+0000 7fa452ffd640 1 -- 172.21.15.170:0/4002152334 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4640c4370 con 0x56281a69ef40 2024-01-25T15:03:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.010+0000 7fa452ffd640 1 -- 172.21.15.170:0/4002152334 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa46403c040 con 0x56281a69ef40 2024-01-25T15:03:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.010+0000 7fa47cb87740 10 client.15771 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:03:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.010+0000 7fa47cb87740 10 client.15771 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-01-25T15:03:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.010+0000 7fa47cb87740 20 client.15771 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.010+0000 7fa47cb87740 1 --2- 172.21.15.170:0/4002152334 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x56281a70bd80 0x56281a70e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.010+0000 7fa47cb87740 4 client.15771 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:03:00.016 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.010+0000 7fa47cb87740 1 -- 172.21.15.170:0/4002152334 --> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56281a3057e0 con 0x56281a70bd80 2024-01-25T15:03:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.010+0000 7fa472ffd640 1 --2- 172.21.15.170:0/4002152334 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x56281a70bd80 0x56281a70e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.010+0000 7fa452ffd640 10 client.15771 ms_handle_connect on v2:172.21.15.191:6832/274874056 2024-01-25T15:03:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.010+0000 7fa472ffd640 1 --2- 172.21.15.170:0/4002152334 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x56281a70bd80 0x56281a70e170 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=338c9799d83858b1 server_cookie=68ac5a93742d5cc0 in_seq=0 out_seq=0 2024-01-25T15:03:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.011+0000 7fa452ffd640 1 -- 172.21.15.170:0/4002152334 <== mds.3 v2:172.21.15.191:6832/274874056 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56281a3057e0 con 0x56281a70bd80 2024-01-25T15:03:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.011+0000 7fa452ffd640 10 client.15771 handle_command_reply: tid=0 2024-01-25T15:03:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.011+0000 7fa47cb87740 1 client.15771 shutdown 2024-01-25T15:03:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.011+0000 7fa47cb87740 1 -- 172.21.15.170:0/4002152334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69ef40 msgr2=0x56281a6aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.011+0000 7fa47cb87740 1 --2- 172.21.15.170:0/4002152334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69ef40 0x56281a6aff10 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa4640ec9f0 tx=0x7fa4640bbdb0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.011+0000 7fa47cb87740 1 -- 172.21.15.170:0/4002152334 shutdown_connections 2024-01-25T15:03:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.011+0000 7fa47cb87740 1 --2- 172.21.15.170:0/4002152334 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x56281a70bd80 0x56281a70e170 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.011+0000 7fa47cb87740 1 --2- 172.21.15.170:0/4002152334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56281a6a4aa0 0x56281a6aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.011+0000 7fa47cb87740 1 --2- 172.21.15.170:0/4002152334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56281a69f930 0x56281a6ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.011+0000 7fa47cb87740 1 --2- 172.21.15.170:0/4002152334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56281a69ef40 0x56281a6aff10 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.011+0000 7fa47cb87740 1 -- 172.21.15.170:0/4002152334 >> 172.21.15.170:0/4002152334 conn(0x56281a69a4b0 msgr2=0x56281a6a0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.017 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.011+0000 7fa452ffd640 0 client.15771 ms_handle_reset on v2:172.21.15.191:6832/274874056 2024-01-25T15:03:00.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.011+0000 7fa47cb87740 1 -- 172.21.15.170:0/4002152334 shutdown_connections 2024-01-25T15:03:00.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.011+0000 7fa47cb87740 1 -- 172.21.15.170:0/4002152334 wait complete. 2024-01-25T15:03:00.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.011+0000 7fa47cb87740 20 client.15771 trim_cache size 0 max 16384 2024-01-25T15:03:00.018 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:03:00.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.012+0000 7fa479fc4640 1 -- 172.21.15.170:0/1882103432 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa45c0a12e0 msgr2=0x7fa45c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.012+0000 7fa479fc4640 1 --2- 172.21.15.170:0/1882103432 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa45c0a12e0 0x7fa45c0a37a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa474100e70 tx=0x7fa468014950 comp rx=0 tx=0).stop 2024-01-25T15:03:00.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.012+0000 7fa479fc4640 1 -- 172.21.15.170:0/1882103432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa474101790 msgr2=0x7fa474101100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.012+0000 7fa479fc4640 1 --2- 172.21.15.170:0/1882103432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa474101790 0x7fa474101100 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa464006010 tx=0x7fa464004e50 comp rx=0 tx=0).stop 2024-01-25T15:03:00.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.012+0000 7fa479fc4640 1 -- 172.21.15.170:0/1882103432 shutdown_connections 2024-01-25T15:03:00.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.012+0000 7fa479fc4640 1 --2- 172.21.15.170:0/1882103432 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa45c0a12e0 0x7fa45c0a37a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.012+0000 7fa479fc4640 1 --2- 172.21.15.170:0/1882103432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa4741069f0 0x7fa4740ffc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.012+0000 7fa479fc4640 1 --2- 172.21.15.170:0/1882103432 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa4741040c0 0x7fa4740ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.012+0000 7fa479fc4640 1 --2- 172.21.15.170:0/1882103432 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa474101790 0x7fa474101100 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.012+0000 7fa479fc4640 1 -- 172.21.15.170:0/1882103432 >> 172.21.15.170:0/1882103432 conn(0x7fa4740fb180 msgr2=0x7fa474103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.012+0000 7fa479fc4640 1 -- 172.21.15.170:0/1882103432 shutdown_connections 2024-01-25T15:03:00.020 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.012+0000 7fa479fc4640 1 -- 172.21.15.170:0/1882103432 wait complete. 2024-01-25T15:03:00.022 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-01-25T15:03:00.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.145+0000 7f6029d1d640 1 -- 172.21.15.170:0/2940770147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60241040a0 msgr2=0x7f6024106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.145+0000 7f6029d1d640 1 --2- 172.21.15.170:0/2940770147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60241040a0 0x7f6024106490 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6018009860 tx=0x7f601802bb70 comp rx=0 tx=0).stop 2024-01-25T15:03:00.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.145+0000 7f6029d1d640 1 -- 172.21.15.170:0/2940770147 shutdown_connections 2024-01-25T15:03:00.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.145+0000 7f6029d1d640 1 --2- 172.21.15.170:0/2940770147 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60241040a0 0x7f6024106490 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.145+0000 7f6029d1d640 1 --2- 172.21.15.170:0/2940770147 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f60241069d0 0x7f6024108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.145+0000 7f6029d1d640 1 --2- 172.21.15.170:0/2940770147 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6024101770 0x7f6024103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.145+0000 7f6029d1d640 1 -- 172.21.15.170:0/2940770147 >> 172.21.15.170:0/2940770147 conn(0x7f60240fb180 msgr2=0x7f60240fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.145+0000 7f6029d1d640 1 -- 172.21.15.170:0/2940770147 shutdown_connections 2024-01-25T15:03:00.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.145+0000 7f6029d1d640 1 -- 172.21.15.170:0/2940770147 wait complete. 2024-01-25T15:03:00.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.146+0000 7f6029d1d640 1 Processor -- start 2024-01-25T15:03:00.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.146+0000 7f6029d1d640 1 -- start start 2024-01-25T15:03:00.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.146+0000 7f6029d1d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6024101770 0x7f6024101090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.146+0000 7f6029d1d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60241040a0 0x7f60240ff720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.146+0000 7f6029d1d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60241069d0 0x7f60240ffc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.146+0000 7f6029d1d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60241003f0 con 0x7f60241069d0 2024-01-25T15:03:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.146+0000 7f6029d1d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6024100560 con 0x7f60241040a0 2024-01-25T15:03:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.146+0000 7f6029d1d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60241a0db0 con 0x7f6024101770 2024-01-25T15:03:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.146+0000 7f6023fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60241069d0 0x7f60240ffc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.146+0000 7f6022ffd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60241040a0 0x7f60240ff720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.146+0000 7f6022ffd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60241040a0 0x7f60240ff720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:59316/0 (socket says 172.21.15.170:59316) 2024-01-25T15:03:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.146+0000 7f6023fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60241069d0 0x7f60240ffc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53930/0 (socket says 172.21.15.170:53930) 2024-01-25T15:03:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.146+0000 7f6022ffd640 1 -- 172.21.15.170:0/3013024656 learned_addr learned my addr 172.21.15.170:0/3013024656 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.146+0000 7f60237fe640 1 --2- 172.21.15.170:0/3013024656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6024101770 0x7f6024101090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.147+0000 7f60237fe640 1 -- 172.21.15.170:0/3013024656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60241040a0 msgr2=0x7f60240ff720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.147+0000 7f60237fe640 1 --2- 172.21.15.170:0/3013024656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60241040a0 0x7f60240ff720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.147+0000 7f60237fe640 1 -- 172.21.15.170:0/3013024656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60241069d0 msgr2=0x7f60240ffc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.147+0000 7f60237fe640 1 --2- 172.21.15.170:0/3013024656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60241069d0 0x7f60240ffc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.147+0000 7f60237fe640 1 -- 172.21.15.170:0/3013024656 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6014009560 con 0x7f6024101770 2024-01-25T15:03:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.147+0000 7f6023fff640 1 --2- 172.21.15.170:0/3013024656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60241069d0 0x7f60240ffc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:00.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.147+0000 7f60237fe640 1 --2- 172.21.15.170:0/3013024656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6024101770 0x7f6024101090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f601400e9c0 tx=0x7f601400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.147+0000 7f6020ff9640 1 -- 172.21.15.170:0/3013024656 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400cd80 con 0x7f6024101770 2024-01-25T15:03:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.147+0000 7f6029d1d640 1 -- 172.21.15.170:0/3013024656 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6018009490 con 0x7f6024101770 2024-01-25T15:03:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.148+0000 7f6029d1d640 1 -- 172.21.15.170:0/3013024656 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60241a12f0 con 0x7f6024101770 2024-01-25T15:03:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.148+0000 7f6020ff9640 1 -- 172.21.15.170:0/3013024656 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60140035f0 con 0x7f6024101770 2024-01-25T15:03:00.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.148+0000 7f6020ff9640 1 -- 172.21.15.170:0/3013024656 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400cee0 con 0x7f6024101770 2024-01-25T15:03:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.150+0000 7f602c9b9740 1 Processor -- start 2024-01-25T15:03:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.150+0000 7f602c9b9740 1 -- start start 2024-01-25T15:03:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.150+0000 7f602c9b9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb83f20 0x55b65bb84340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.150+0000 7f602c9b9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb84910 0x55b65bb89410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.150+0000 7f602c9b9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb89a80 0x55b65bb8bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.150+0000 7f602c9b9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65baf2270 con 0x55b65bb84910 2024-01-25T15:03:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.150+0000 7f602c9b9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65baef960 con 0x55b65bb83f20 2024-01-25T15:03:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.150+0000 7f602c9b9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65baeb250 con 0x55b65bb89a80 2024-01-25T15:03:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.151+0000 7f6022ffd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb89a80 0x55b65bb8bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.151+0000 7f6022ffd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb89a80 0x55b65bb8bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:41972/0 (socket says 172.21.15.170:41972) 2024-01-25T15:03:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.151+0000 7f6022ffd640 1 -- 172.21.15.170:0/1488731548 learned_addr learned my addr 172.21.15.170:0/1488731548 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.155 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.151+0000 7f6023fff640 1 --2- 172.21.15.170:0/1488731548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb83f20 0x55b65bb84340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.151+0000 7f6020ff9640 1 -- 172.21.15.170:0/3013024656 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f6014004000 con 0x7f6024101770 2024-01-25T15:03:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.151+0000 7f6022ffd640 1 -- 172.21.15.170:0/1488731548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb83f20 msgr2=0x55b65bb84340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.151+0000 7f6022ffd640 1 --2- 172.21.15.170:0/1488731548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb83f20 0x55b65bb84340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.151+0000 7f6022ffd640 1 -- 172.21.15.170:0/1488731548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb84910 msgr2=0x55b65bb89410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.151+0000 7f60237fe640 1 --2- 172.21.15.170:0/1488731548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb84910 0x55b65bb89410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.151+0000 7f6022ffd640 1 --2- 172.21.15.170:0/1488731548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb84910 0x55b65bb89410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.151+0000 7f6022ffd640 1 -- 172.21.15.170:0/1488731548 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b65baad7f0 con 0x55b65bb89a80 2024-01-25T15:03:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.151+0000 7f60237fe640 1 --2- 172.21.15.170:0/1488731548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb84910 0x55b65bb89410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:03:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.151+0000 7f6020ff9640 1 --2- 172.21.15.170:0/3013024656 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f600c0a12e0 0x7f600c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.151+0000 7f6022ffd640 1 --2- 172.21.15.170:0/1488731548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb89a80 0x55b65bb8bf10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6018034a00 tx=0x7f6018005b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc17bb19839cefff server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.152+0000 7f6023fff640 1 --2- 172.21.15.170:0/3013024656 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f600c0a12e0 0x7f600c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.152+0000 7f6020ff9640 1 -- 172.21.15.170:0/3013024656 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f6014014070 con 0x7f6024101770 2024-01-25T15:03:00.156 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.152+0000 7f6009ffb640 1 -- 172.21.15.170:0/1488731548 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018034bd0 con 0x55b65bb89a80 2024-01-25T15:03:00.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.152+0000 7f6009ffb640 1 -- 172.21.15.170:0/1488731548 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6018034d30 con 0x55b65bb89a80 2024-01-25T15:03:00.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.152+0000 7f6009ffb640 1 -- 172.21.15.170:0/1488731548 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018005280 con 0x55b65bb89a80 2024-01-25T15:03:00.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 -- 172.21.15.170:0/1488731548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb89a80 msgr2=0x55b65bb8bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 --2- 172.21.15.170:0/1488731548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb89a80 0x55b65bb8bf10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6018034a00 tx=0x7f6018005b20 comp rx=0 tx=0).stop 2024-01-25T15:03:00.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f6023fff640 1 --2- 172.21.15.170:0/3013024656 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f600c0a12e0 0x7f600c0a37a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55b65bb85170 tx=0x7f601c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 -- 172.21.15.170:0/1488731548 shutdown_connections 2024-01-25T15:03:00.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 --2- 172.21.15.170:0/1488731548 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb89a80 0x55b65bb8bf10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 --2- 172.21.15.170:0/1488731548 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb84910 0x55b65bb89410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 --2- 172.21.15.170:0/1488731548 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb83f20 0x55b65bb84340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 -- 172.21.15.170:0/1488731548 >> 172.21.15.170:0/1488731548 conn(0x55b65bb7f490 msgr2=0x55b65bb7f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 -- 172.21.15.170:0/1488731548 shutdown_connections 2024-01-25T15:03:00.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 -- 172.21.15.170:0/1488731548 wait complete. 2024-01-25T15:03:00.157 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 -- start start 2024-01-25T15:03:00.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 Processor -- start 2024-01-25T15:03:00.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb8e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb84910 0x55b65bb8e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb89a80 0x55b65bb95620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65baa4610 con 0x55b65bb89a80 2024-01-25T15:03:00.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65baa42b0 con 0x55b65bb84910 2024-01-25T15:03:00.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.153+0000 7f602c9b9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65ba69400 con 0x55b65bb83f20 2024-01-25T15:03:00.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f602c9b9740 10 client.0 _ll_register_callbacks cb 0x55b65bae1ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:00.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f6023fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb89a80 0x55b65bb95620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f6023fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb89a80 0x55b65bb95620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53948/0 (socket says 172.21.15.170:53948) 2024-01-25T15:03:00.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f6023fff640 1 -- 172.21.15.170:0/880416906 learned_addr learned my addr 172.21.15.170:0/880416906 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f60237fe640 1 --2- 172.21.15.170:0/880416906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb8e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f6022ffd640 1 --2- 172.21.15.170:0/880416906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb84910 0x55b65bb8e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f6023fff640 1 -- 172.21.15.170:0/880416906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 msgr2=0x55b65bb8e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.158 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f6023fff640 1 --2- 172.21.15.170:0/880416906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb8e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f6023fff640 1 -- 172.21.15.170:0/880416906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb84910 msgr2=0x55b65bb8e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f6023fff640 1 --2- 172.21.15.170:0/880416906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb84910 0x55b65bb8e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f6023fff640 1 -- 172.21.15.170:0/880416906 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6024109a00 con 0x55b65bb89a80 2024-01-25T15:03:00.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f60237fe640 1 --2- 172.21.15.170:0/880416906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb8e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:00.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f6022ffd640 1 --2- 172.21.15.170:0/880416906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb84910 0x55b65bb8e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:00.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f6023fff640 1 --2- 172.21.15.170:0/880416906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb89a80 0x55b65bb95620 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f601c0127c0 tx=0x7f601c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6049a1af0306f499 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f6002ffd640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:00.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.154+0000 7f6002ffd640 1 -- 172.21.15.170:0/880416906 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c017070 con 0x55b65bb89a80 2024-01-25T15:03:00.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.155+0000 7f6002ffd640 1 -- 172.21.15.170:0/880416906 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f601c011c60 con 0x55b65bb89a80 2024-01-25T15:03:00.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.155+0000 7f602c9b9740 1 -- 172.21.15.170:0/880416906 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b65bae40e0 con 0x55b65bb89a80 2024-01-25T15:03:00.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.155+0000 7f6002ffd640 1 -- 172.21.15.170:0/880416906 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f601c011e20 con 0x55b65bb89a80 2024-01-25T15:03:00.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.155+0000 7f602c9b9740 10 client.15780 fetch_fsmap learned FSMap version 26 2024-01-25T15:03:00.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.155+0000 7f602c9b9740 1 -- 172.21.15.170:0/880416906 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b65bae98d0 con 0x55b65bb89a80 2024-01-25T15:03:00.159 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.155+0000 7f6002ffd640 1 -- 172.21.15.170:0/880416906 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b65bae40e0 con 0x55b65bb89a80 2024-01-25T15:03:00.161 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.156+0000 7f6002ffd640 1 -- 172.21.15.170:0/880416906 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f601c032050 con 0x55b65bb89a80 2024-01-25T15:03:00.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.156+0000 7f602c9b9740 10 client.15780 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:03:00.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.156+0000 7f602c9b9740 10 client.15780 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-01-25T15:03:00.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.156+0000 7f602c9b9740 20 client.15780 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:00.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.156+0000 7f602c9b9740 1 --2- 172.21.15.170:0/880416906 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55b65bb99f50 0x55b65bb9c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.156+0000 7f602c9b9740 4 client.15780 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:00.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.156+0000 7f602c9b9740 1 -- 172.21.15.170:0/880416906 --> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b65bae3e00 con 0x55b65bb99f50 2024-01-25T15:03:00.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.156+0000 7f60237fe640 1 --2- 172.21.15.170:0/880416906 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55b65bb99f50 0x55b65bb9c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.157+0000 7f60237fe640 1 --2- 172.21.15.170:0/880416906 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55b65bb99f50 0x55b65bb9c370 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6a45e496fc2f0de7 server_cookie=f03ac1d782311758 in_seq=0 out_seq=0 2024-01-25T15:03:00.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.157+0000 7f6002ffd640 10 client.15780 ms_handle_connect on v2:172.21.15.191:6836/719224494 2024-01-25T15:03:00.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.157+0000 7f6002ffd640 1 -- 172.21.15.170:0/880416906 <== mds.2 v2:172.21.15.191:6836/719224494 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b65bae3e00 con 0x55b65bb99f50 2024-01-25T15:03:00.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.157+0000 7f6002ffd640 10 client.15780 handle_command_reply: tid=0 2024-01-25T15:03:00.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.158+0000 7f602c9b9740 1 client.15780 shutdown 2024-01-25T15:03:00.162 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.158+0000 7f602c9b9740 1 -- 172.21.15.170:0/880416906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb89a80 msgr2=0x55b65bb95620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.158+0000 7f602c9b9740 1 --2- 172.21.15.170:0/880416906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb89a80 0x55b65bb95620 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f601c0127c0 tx=0x7f601c004ab0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.158+0000 7f602c9b9740 1 -- 172.21.15.170:0/880416906 shutdown_connections 2024-01-25T15:03:00.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.158+0000 7f602c9b9740 1 --2- 172.21.15.170:0/880416906 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55b65bb99f50 0x55b65bb9c370 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.158+0000 7f602c9b9740 1 --2- 172.21.15.170:0/880416906 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb84910 0x55b65bb8e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.158+0000 7f602c9b9740 1 --2- 172.21.15.170:0/880416906 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb89a80 0x55b65bb95620 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.158+0000 7f6002ffd640 0 client.15780 ms_handle_reset on v2:172.21.15.191:6836/719224494 2024-01-25T15:03:00.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.158+0000 7f602c9b9740 1 --2- 172.21.15.170:0/880416906 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb8e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.158+0000 7f602c9b9740 1 -- 172.21.15.170:0/880416906 >> 172.21.15.170:0/880416906 conn(0x55b65bb7f490 msgr2=0x55b65bb7e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.158+0000 7f602c9b9740 1 -- 172.21.15.170:0/880416906 shutdown_connections 2024-01-25T15:03:00.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.158+0000 7f602c9b9740 1 -- 172.21.15.170:0/880416906 wait complete. 2024-01-25T15:03:00.163 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.158+0000 7f602c9b9740 20 client.15780 trim_cache size 0 max 16384 2024-01-25T15:03:00.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f602c9b9740 1 Processor -- start 2024-01-25T15:03:00.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f602c9b9740 1 -- start start 2024-01-25T15:03:00.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f602c9b9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb8e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f602c9b9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb84910 0x55b65bb8e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f602c9b9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb89a80 0x55b65bb955e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f6023fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb89a80 0x55b65bb955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f6023fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb89a80 0x55b65bb955e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53964/0 (socket says 172.21.15.170:53964) 2024-01-25T15:03:00.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f6023fff640 1 -- 172.21.15.170:0/2889674994 learned_addr learned my addr 172.21.15.170:0/2889674994 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f602c9b9740 1 -- 172.21.15.170:0/2889674994 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65bae3e00 con 0x55b65bb89a80 2024-01-25T15:03:00.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f602c9b9740 1 -- 172.21.15.170:0/2889674994 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65bae40e0 con 0x55b65bb84910 2024-01-25T15:03:00.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f602c9b9740 1 -- 172.21.15.170:0/2889674994 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65bb7b270 con 0x55b65bb83f20 2024-01-25T15:03:00.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f60237fe640 1 --2- 172.21.15.170:0/2889674994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb8e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f6022ffd640 1 --2- 172.21.15.170:0/2889674994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb84910 0x55b65bb8e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f6023fff640 1 -- 172.21.15.170:0/2889674994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 msgr2=0x55b65bb8e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f6023fff640 1 --2- 172.21.15.170:0/2889674994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb8e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f6023fff640 1 -- 172.21.15.170:0/2889674994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb84910 msgr2=0x55b65bb8e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f6023fff640 1 --2- 172.21.15.170:0/2889674994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb84910 0x55b65bb8e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f6023fff640 1 -- 172.21.15.170:0/2889674994 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b65ba86500 con 0x55b65bb89a80 2024-01-25T15:03:00.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.170+0000 7f60237fe640 1 --2- 172.21.15.170:0/2889674994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb8e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:03:00.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.171+0000 7f6023fff640 1 --2- 172.21.15.170:0/2889674994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb89a80 0x55b65bb955e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f601c005c40 tx=0x7f601c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7675bd0efdc91517 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.171+0000 7f60097fa640 1 -- 172.21.15.170:0/2889674994 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c00f910 con 0x55b65bb89a80 2024-01-25T15:03:00.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.171+0000 7f60097fa640 1 -- 172.21.15.170:0/2889674994 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f601c029900 con 0x55b65bb89a80 2024-01-25T15:03:00.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.171+0000 7f60097fa640 1 -- 172.21.15.170:0/2889674994 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c01f9b0 con 0x55b65bb89a80 2024-01-25T15:03:00.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.172+0000 7f602c9b9740 1 -- 172.21.15.170:0/2889674994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb89a80 msgr2=0x55b65bb955e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.177 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.172+0000 7f602c9b9740 1 --2- 172.21.15.170:0/2889674994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb89a80 0x55b65bb955e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f601c005c40 tx=0x7f601c005f90 comp rx=0 tx=0).stop 2024-01-25T15:03:00.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.172+0000 7f602c9b9740 1 -- 172.21.15.170:0/2889674994 shutdown_connections 2024-01-25T15:03:00.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.172+0000 7f602c9b9740 1 --2- 172.21.15.170:0/2889674994 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb84910 0x55b65bb8e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.172+0000 7f602c9b9740 1 --2- 172.21.15.170:0/2889674994 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb89a80 0x55b65bb955e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.172+0000 7f602c9b9740 1 --2- 172.21.15.170:0/2889674994 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb8e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.172+0000 7f602c9b9740 1 -- 172.21.15.170:0/2889674994 >> 172.21.15.170:0/2889674994 conn(0x55b65bb7f490 msgr2=0x55b65bb85e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.172+0000 7f602c9b9740 1 -- 172.21.15.170:0/2889674994 shutdown_connections 2024-01-25T15:03:00.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.172+0000 7f602c9b9740 1 -- 172.21.15.170:0/2889674994 wait complete. 2024-01-25T15:03:00.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.172+0000 7f602c9b9740 1 -- start start 2024-01-25T15:03:00.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.172+0000 7f602c9b9740 1 Processor -- start 2024-01-25T15:03:00.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f602c9b9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb952c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f602c9b9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb84910 0x55b65bb938d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f602c9b9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb89a80 0x55b65bb93e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f602c9b9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65bb94350 con 0x55b65bb84910 2024-01-25T15:03:00.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f602c9b9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65bb944c0 con 0x55b65bb89a80 2024-01-25T15:03:00.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f602c9b9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b65bb94680 con 0x55b65bb83f20 2024-01-25T15:03:00.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f602c9b9740 10 client.0 _ll_register_callbacks cb 0x7f6014005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:00.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f6022ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb84910 0x55b65bb938d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f6023fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb89a80 0x55b65bb93e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f60237fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb952c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f6023fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb89a80 0x55b65bb93e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:59356/0 (socket says 172.21.15.170:59356) 2024-01-25T15:03:00.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f60237fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb952c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:42006/0 (socket says 172.21.15.170:42006) 2024-01-25T15:03:00.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f6023fff640 1 -- 172.21.15.170:0/648166832 learned_addr learned my addr 172.21.15.170:0/648166832 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f60237fe640 1 -- 172.21.15.170:0/648166832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb89a80 msgr2=0x55b65bb93e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f60237fe640 1 --2- 172.21.15.170:0/648166832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb89a80 0x55b65bb93e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f60237fe640 1 -- 172.21.15.170:0/648166832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb84910 msgr2=0x55b65bb938d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f60237fe640 1 --2- 172.21.15.170:0/648166832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb84910 0x55b65bb938d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f60237fe640 1 -- 172.21.15.170:0/648166832 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b65bae98d0 con 0x55b65bb83f20 2024-01-25T15:03:00.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f6023fff640 1 --2- 172.21.15.170:0/648166832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb89a80 0x55b65bb93e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:00.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.173+0000 7f6022ffd640 1 --2- 172.21.15.170:0/648166832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb84910 0x55b65bb938d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:00.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f60237fe640 1 --2- 172.21.15.170:0/648166832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb952c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f60140caae0 tx=0x7f601409a190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c82349d2e8fdadc6 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f6002ffd640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-01-25T15:03:00.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f6002ffd640 1 -- 172.21.15.170:0/648166832 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60140044e0 con 0x55b65bb83f20 2024-01-25T15:03:00.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f602c9b9740 1 -- 172.21.15.170:0/648166832 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6018034d30 con 0x55b65bb83f20 2024-01-25T15:03:00.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f6002ffd640 1 -- 172.21.15.170:0/648166832 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f6014098470 con 0x55b65bb83f20 2024-01-25T15:03:00.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f6002ffd640 1 -- 172.21.15.170:0/648166832 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6014003a20 con 0x55b65bb83f20 2024-01-25T15:03:00.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f602c9b9740 10 client.25159 fetch_fsmap learned FSMap version 26 2024-01-25T15:03:00.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f602c9b9740 1 -- 172.21.15.170:0/648166832 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b65baac050 con 0x55b65bb83f20 2024-01-25T15:03:00.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f6002ffd640 1 -- 172.21.15.170:0/648166832 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60140b8030 con 0x55b65bb83f20 2024-01-25T15:03:00.180 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f6002ffd640 1 -- 172.21.15.170:0/648166832 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f601401f060 con 0x55b65bb83f20 2024-01-25T15:03:00.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f602c9b9740 10 client.25159 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:03:00.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f602c9b9740 10 client.25159 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-01-25T15:03:00.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f602c9b9740 20 client.25159 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:00.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f602c9b9740 1 --2- 172.21.15.170:0/648166832 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55b65bbf1c20 0x55b65bbf4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f602c9b9740 4 client.25159 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:03:00.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.174+0000 7f602c9b9740 1 -- 172.21.15.170:0/648166832 --> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b65b7ea7e0 con 0x55b65bbf1c20 2024-01-25T15:03:00.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.175+0000 7f6022ffd640 1 --2- 172.21.15.170:0/648166832 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55b65bbf1c20 0x55b65bbf4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.175+0000 7f6022ffd640 1 --2- 172.21.15.170:0/648166832 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55b65bbf1c20 0x55b65bbf4010 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3689b6db3c61e931 server_cookie=8bba57ec3edd8916 in_seq=0 out_seq=0 2024-01-25T15:03:00.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.175+0000 7f6002ffd640 10 client.25159 ms_handle_connect on v2:172.21.15.191:6836/719224494 2024-01-25T15:03:00.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.175+0000 7f6002ffd640 1 -- 172.21.15.170:0/648166832 <== mds.2 v2:172.21.15.191:6836/719224494 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b65b7ea7e0 con 0x55b65bbf1c20 2024-01-25T15:03:00.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.175+0000 7f6002ffd640 10 client.25159 handle_command_reply: tid=0 2024-01-25T15:03:00.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.175+0000 7f602c9b9740 1 client.25159 shutdown 2024-01-25T15:03:00.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.175+0000 7f602c9b9740 1 -- 172.21.15.170:0/648166832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 msgr2=0x55b65bb952c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.175+0000 7f602c9b9740 1 --2- 172.21.15.170:0/648166832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb952c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f60140caae0 tx=0x7f601409a190 comp rx=0 tx=0).stop 2024-01-25T15:03:00.181 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.175+0000 7f602c9b9740 1 -- 172.21.15.170:0/648166832 shutdown_connections 2024-01-25T15:03:00.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.175+0000 7f602c9b9740 1 --2- 172.21.15.170:0/648166832 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55b65bbf1c20 0x55b65bbf4010 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.175+0000 7f602c9b9740 1 --2- 172.21.15.170:0/648166832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b65bb89a80 0x55b65bb93e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.175+0000 7f602c9b9740 1 --2- 172.21.15.170:0/648166832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b65bb84910 0x55b65bb938d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.175+0000 7f6002ffd640 0 client.25159 ms_handle_reset on v2:172.21.15.191:6836/719224494 2024-01-25T15:03:00.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.175+0000 7f602c9b9740 1 --2- 172.21.15.170:0/648166832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b65bb83f20 0x55b65bb952c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.175+0000 7f602c9b9740 1 -- 172.21.15.170:0/648166832 >> 172.21.15.170:0/648166832 conn(0x55b65bb7f490 msgr2=0x55b65bb85e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.176+0000 7f602c9b9740 1 -- 172.21.15.170:0/648166832 shutdown_connections 2024-01-25T15:03:00.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.176+0000 7f602c9b9740 1 -- 172.21.15.170:0/648166832 wait complete. 2024-01-25T15:03:00.182 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.176+0000 7f602c9b9740 20 client.25159 trim_cache size 0 max 16384 2024-01-25T15:03:00.182 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:03:00.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.176+0000 7f6029d1d640 1 -- 172.21.15.170:0/3013024656 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f600c0a12e0 msgr2=0x7f600c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.176+0000 7f6029d1d640 1 --2- 172.21.15.170:0/3013024656 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f600c0a12e0 0x7f600c0a37a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55b65bb85170 tx=0x7f601c009500 comp rx=0 tx=0).stop 2024-01-25T15:03:00.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.176+0000 7f6029d1d640 1 -- 172.21.15.170:0/3013024656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6024101770 msgr2=0x7f6024101090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.176+0000 7f6029d1d640 1 --2- 172.21.15.170:0/3013024656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6024101770 0x7f6024101090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f601400e9c0 tx=0x7f601400ee80 comp rx=0 tx=0).stop 2024-01-25T15:03:00.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.176+0000 7f6029d1d640 1 -- 172.21.15.170:0/3013024656 shutdown_connections 2024-01-25T15:03:00.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.176+0000 7f6029d1d640 1 --2- 172.21.15.170:0/3013024656 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f600c0a12e0 0x7f600c0a37a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.183 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.176+0000 7f6029d1d640 1 --2- 172.21.15.170:0/3013024656 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f60241040a0 0x7f60240ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.176+0000 7f6029d1d640 1 --2- 172.21.15.170:0/3013024656 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f60241069d0 0x7f60240ffc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.176+0000 7f6029d1d640 1 --2- 172.21.15.170:0/3013024656 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6024101770 0x7f6024101090 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.176+0000 7f6029d1d640 1 -- 172.21.15.170:0/3013024656 >> 172.21.15.170:0/3013024656 conn(0x7f60240fb180 msgr2=0x7f60241035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.176+0000 7f6029d1d640 1 -- 172.21.15.170:0/3013024656 shutdown_connections 2024-01-25T15:03:00.184 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.176+0000 7f6029d1d640 1 -- 172.21.15.170:0/3013024656 wait complete. 2024-01-25T15:03:00.187 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-01-25T15:03:00.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.293+0000 7f31b7725640 1 -- 172.21.15.170:0/4033114956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b0101770 msgr2=0x7f31b0103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.293+0000 7f31b7725640 1 --2- 172.21.15.170:0/4033114956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b0101770 0x7f31b0103b60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009900 tx=0x7f31ac02bc30 comp rx=0 tx=0).stop 2024-01-25T15:03:00.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.293+0000 7f31b7725640 1 -- 172.21.15.170:0/4033114956 shutdown_connections 2024-01-25T15:03:00.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.293+0000 7f31b7725640 1 --2- 172.21.15.170:0/4033114956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31b01069d0 0x7f31b0108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.293+0000 7f31b7725640 1 --2- 172.21.15.170:0/4033114956 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31b01040a0 0x7f31b0106490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.293+0000 7f31b7725640 1 --2- 172.21.15.170:0/4033114956 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b0101770 0x7f31b0103b60 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.293+0000 7f31b7725640 1 -- 172.21.15.170:0/4033114956 >> 172.21.15.170:0/4033114956 conn(0x7f31b00fb180 msgr2=0x7f31b00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.293+0000 7f31b7725640 1 -- 172.21.15.170:0/4033114956 shutdown_connections 2024-01-25T15:03:00.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.293+0000 7f31b7725640 1 -- 172.21.15.170:0/4033114956 wait complete. 2024-01-25T15:03:00.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.294+0000 7f31b7725640 1 Processor -- start 2024-01-25T15:03:00.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.294+0000 7f31b7725640 1 -- start start 2024-01-25T15:03:00.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.294+0000 7f31b7725640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31b0101770 0x7f31b0196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.294+0000 7f31b7725640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31b01040a0 0x7f31b01972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.294+0000 7f31b7725640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b01069d0 0x7f31b019e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.294+0000 7f31b7725640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b019e8a0 con 0x7f31b01069d0 2024-01-25T15:03:00.296 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.294+0000 7f31b7725640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b019ea10 con 0x7f31b0101770 2024-01-25T15:03:00.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.294+0000 7f31b7725640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b019ebd0 con 0x7f31b01040a0 2024-01-25T15:03:00.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.294+0000 7f31b5cc2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b01069d0 0x7f31b019e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.294+0000 7f31b5cc2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b01069d0 0x7f31b019e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53994/0 (socket says 172.21.15.170:53994) 2024-01-25T15:03:00.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.294+0000 7f31b5cc2640 1 -- 172.21.15.170:0/1049582642 learned_addr learned my addr 172.21.15.170:0/1049582642 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.294+0000 7f31b54c1640 1 --2- 172.21.15.170:0/1049582642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31b0101770 0x7f31b0196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.294+0000 7f31b4cc0640 1 --2- 172.21.15.170:0/1049582642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31b01040a0 0x7f31b01972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.295+0000 7f31b5cc2640 1 -- 172.21.15.170:0/1049582642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31b01040a0 msgr2=0x7f31b01972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.295+0000 7f31b5cc2640 1 --2- 172.21.15.170:0/1049582642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31b01040a0 0x7f31b01972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.295+0000 7f31b5cc2640 1 -- 172.21.15.170:0/1049582642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31b0101770 msgr2=0x7f31b0196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.295+0000 7f31b5cc2640 1 --2- 172.21.15.170:0/1049582642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31b0101770 0x7f31b0196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.295+0000 7f31b5cc2640 1 -- 172.21.15.170:0/1049582642 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ac009560 con 0x7f31b01069d0 2024-01-25T15:03:00.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.295+0000 7f31b5cc2640 1 --2- 172.21.15.170:0/1049582642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b01069d0 0x7f31b019e360 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009fd0 tx=0x7f31a800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.295+0000 7f31a67fc640 1 -- 172.21.15.170:0/1049582642 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a800bea0 con 0x7f31b01069d0 2024-01-25T15:03:00.297 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.295+0000 7f31a67fc640 1 -- 172.21.15.170:0/1049582642 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31a8009940 con 0x7f31b01069d0 2024-01-25T15:03:00.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.295+0000 7f31b7725640 1 -- 172.21.15.170:0/1049582642 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b019eeb0 con 0x7f31b01069d0 2024-01-25T15:03:00.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.295+0000 7f31a67fc640 1 -- 172.21.15.170:0/1049582642 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a80106c0 con 0x7f31b01069d0 2024-01-25T15:03:00.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.295+0000 7f31b7725640 1 -- 172.21.15.170:0/1049582642 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b019f380 con 0x7f31b01069d0 2024-01-25T15:03:00.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.298+0000 7f31ba3c3740 1 Processor -- start 2024-01-25T15:03:00.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.299+0000 7f31a67fc640 1 -- 172.21.15.170:0/1049582642 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f31a80041b0 con 0x7f31b01069d0 2024-01-25T15:03:00.298 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.299+0000 7f31ba3c3740 1 -- start start 2024-01-25T15:03:00.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.299+0000 7f31ba3c3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e265b350 0x55c1e265b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.299+0000 7f31ba3c3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265bd40 0x55c1e2660840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.299+0000 7f31ba3c3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e2660eb0 0x55c1e2663340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.299+0000 7f31ba3c3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e25c5270 con 0x55c1e265bd40 2024-01-25T15:03:00.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.299+0000 7f31ba3c3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e25c2960 con 0x55c1e2660eb0 2024-01-25T15:03:00.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.299+0000 7f31ba3c3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e25be250 con 0x55c1e265b350 2024-01-25T15:03:00.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.299+0000 7f31a67fc640 1 --2- 172.21.15.170:0/1049582642 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f319c0a1360 0x7f319c0a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.299+0000 7f31b4cc0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e265b350 0x55c1e265b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.299+0000 7f31b4cc0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e265b350 0x55c1e265b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:42020/0 (socket says 172.21.15.170:42020) 2024-01-25T15:03:00.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.299+0000 7f31b4cc0640 1 -- 172.21.15.170:0/1292690253 learned_addr learned my addr 172.21.15.170:0/1292690253 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.299+0000 7f31b54c1640 1 --2- 172.21.15.170:0/1292690253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265bd40 0x55c1e2660840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.299+0000 7f31a67fc640 1 -- 172.21.15.170:0/1049582642 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f31a80cc6e0 con 0x7f31b01069d0 2024-01-25T15:03:00.300 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.300+0000 7f31b5cc2640 1 --2- 172.21.15.170:0/1049582642 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f319c0a1360 0x7f319c0a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.300+0000 7f31b4cc0640 1 --2- 172.21.15.170:0/1292690253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e2660eb0 0x55c1e2663340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.300+0000 7f31b54c1640 1 -- 172.21.15.170:0/1292690253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e265b350 msgr2=0x55c1e265b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.300+0000 7f31b54c1640 1 --2- 172.21.15.170:0/1292690253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e265b350 0x55c1e265b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.300+0000 7f31b54c1640 1 -- 172.21.15.170:0/1292690253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e2660eb0 msgr2=0x55c1e2663340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.300+0000 7f31b54c1640 1 --2- 172.21.15.170:0/1292690253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e2660eb0 0x55c1e2663340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.300+0000 7f31b54c1640 1 -- 172.21.15.170:0/1292690253 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1e25807f0 con 0x55c1e265bd40 2024-01-25T15:03:00.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.300+0000 7f31b4cc0640 1 --2- 172.21.15.170:0/1292690253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e2660eb0 0x55c1e2663340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:03:00.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.300+0000 7f31b54c1640 1 --2- 172.21.15.170:0/1292690253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265bd40 0x55c1e2660840 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009230 tx=0x7f31ac004f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3bd3475c6b0388 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.300+0000 7f319b7fe640 1 -- 172.21.15.170:0/1292690253 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac02cac0 con 0x55c1e265bd40 2024-01-25T15:03:00.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.300+0000 7f31b5cc2640 1 --2- 172.21.15.170:0/1049582642 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f319c0a1360 0x7f319c0a3820 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f31a80a16b0 tx=0x7f31a800b910 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.300+0000 7f319b7fe640 1 -- 172.21.15.170:0/1292690253 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31ac02cc20 con 0x55c1e265bd40 2024-01-25T15:03:00.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.300+0000 7f319b7fe640 1 -- 172.21.15.170:0/1292690253 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0053c0 con 0x55c1e265bd40 2024-01-25T15:03:00.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.301+0000 7f31ba3c3740 1 -- 172.21.15.170:0/1292690253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265bd40 msgr2=0x55c1e2660840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.301+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/1292690253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265bd40 0x55c1e2660840 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009230 tx=0x7f31ac004f20 comp rx=0 tx=0).stop 2024-01-25T15:03:00.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.301+0000 7f31ba3c3740 1 -- 172.21.15.170:0/1292690253 shutdown_connections 2024-01-25T15:03:00.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.301+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/1292690253 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e2660eb0 0x55c1e2663340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.301+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/1292690253 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265bd40 0x55c1e2660840 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.301+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/1292690253 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e265b350 0x55c1e265b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.302+0000 7f31ba3c3740 1 -- 172.21.15.170:0/1292690253 >> 172.21.15.170:0/1292690253 conn(0x55c1e26568c0 msgr2=0x55c1e2656cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.302+0000 7f31ba3c3740 1 -- 172.21.15.170:0/1292690253 shutdown_connections 2024-01-25T15:03:00.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.302+0000 7f31ba3c3740 1 -- 172.21.15.170:0/1292690253 wait complete. 2024-01-25T15:03:00.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.302+0000 7f31ba3c3740 1 -- start start 2024-01-25T15:03:00.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.302+0000 7f31ba3c3740 1 Processor -- start 2024-01-25T15:03:00.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31ba3c3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e265b350 0x55c1e2665530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31ba3c3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 0x55c1e2665a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31ba3c3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e2660eb0 0x55c1e266cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31b54c1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 0x55c1e2665a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31ba3c3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e2577610 con 0x55c1e2660eb0 2024-01-25T15:03:00.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31ba3c3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e25772b0 con 0x55c1e265bd40 2024-01-25T15:03:00.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31ba3c3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e253c400 con 0x55c1e265b350 2024-01-25T15:03:00.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31b4cc0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e265b350 0x55c1e2665530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31b4cc0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e265b350 0x55c1e2665530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:42022/0 (socket says 172.21.15.170:42022) 2024-01-25T15:03:00.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31b54c1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 0x55c1e2665a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:59392/0 (socket says 172.21.15.170:59392) 2024-01-25T15:03:00.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31b4cc0640 1 -- 172.21.15.170:0/3983396674 learned_addr learned my addr 172.21.15.170:0/3983396674 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31b4cc0640 1 --2- 172.21.15.170:0/3983396674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e2660eb0 0x55c1e266cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31ba3c3740 10 client.0 _ll_register_callbacks cb 0x55c1e25b4ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:00.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31b4cc0640 1 -- 172.21.15.170:0/3983396674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 msgr2=0x55c1e2665a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31b4cc0640 1 --2- 172.21.15.170:0/3983396674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 0x55c1e2665a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31b4cc0640 1 -- 172.21.15.170:0/3983396674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e2660eb0 msgr2=0x55c1e266cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31b4cc0640 1 --2- 172.21.15.170:0/3983396674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e2660eb0 0x55c1e266cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.303+0000 7f31b4cc0640 1 -- 172.21.15.170:0/3983396674 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b0109a00 con 0x55c1e265b350 2024-01-25T15:03:00.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.304+0000 7f31b4cc0640 1 --2- 172.21.15.170:0/3983396674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e265b350 0x55c1e2665530 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f31a0012a90 tx=0x7f31a000b8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10119798a5a92db7 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.304+0000 7f3198ff9640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-01-25T15:03:00.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.305+0000 7f3198ff9640 1 -- 172.21.15.170:0/3983396674 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0010aa0 con 0x55c1e265b350 2024-01-25T15:03:00.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.305+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3983396674 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1e25b6e00 con 0x55c1e265b350 2024-01-25T15:03:00.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.305+0000 7f3198ff9640 1 -- 172.21.15.170:0/3983396674 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f31a0010c00 con 0x55c1e265b350 2024-01-25T15:03:00.306 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:00 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3561055718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:03:00.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.309+0000 7f3198ff9640 1 -- 172.21.15.170:0/3983396674 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31a0010dc0 con 0x55c1e265b350 2024-01-25T15:03:00.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.309+0000 7f31ba3c3740 10 client.25171 fetch_fsmap learned FSMap version 26 2024-01-25T15:03:00.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.309+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3983396674 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c1e25bc8d0 con 0x55c1e265b350 2024-01-25T15:03:00.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.309+0000 7f3198ff9640 1 -- 172.21.15.170:0/3983396674 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c1e25b6e00 con 0x55c1e265b350 2024-01-25T15:03:00.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.309+0000 7f3198ff9640 1 -- 172.21.15.170:0/3983396674 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f31a00047a0 con 0x55c1e265b350 2024-01-25T15:03:00.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.310+0000 7f31ba3c3740 10 client.25171 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:03:00.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.310+0000 7f31ba3c3740 10 client.25171 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-01-25T15:03:00.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.310+0000 7f31ba3c3740 20 client.25171 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:00.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.310+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/3983396674 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55c1e2671280 0x55c1e26736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.310+0000 7f31ba3c3740 4 client.25171 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:00.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.310+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3983396674 --> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c1e22bd7e0 con 0x55c1e2671280 2024-01-25T15:03:00.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.310+0000 7f31b54c1640 1 --2- 172.21.15.170:0/3983396674 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55c1e2671280 0x55c1e26736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.310+0000 7f3198ff9640 10 client.25171 ms_handle_connect on v2:172.21.15.186:6838/2132502182 2024-01-25T15:03:00.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.310+0000 7f31b54c1640 1 --2- 172.21.15.170:0/3983396674 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55c1e2671280 0x55c1e26736c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bee97b9429bd8772 server_cookie=b0da7050e6a0ad03 in_seq=0 out_seq=0 2024-01-25T15:03:00.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.311+0000 7f3198ff9640 1 -- 172.21.15.170:0/3983396674 <== mds.1 v2:172.21.15.186:6838/2132502182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c1e22bd7e0 con 0x55c1e2671280 2024-01-25T15:03:00.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.311+0000 7f3198ff9640 10 client.25171 handle_command_reply: tid=0 2024-01-25T15:03:00.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.311+0000 7f31ba3c3740 1 client.25171 shutdown 2024-01-25T15:03:00.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.311+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3983396674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e265b350 msgr2=0x55c1e2665530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.311+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/3983396674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e265b350 0x55c1e2665530 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f31a0012a90 tx=0x7f31a000b8c0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.311+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3983396674 shutdown_connections 2024-01-25T15:03:00.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.311+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/3983396674 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55c1e2671280 0x55c1e26736c0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.311+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/3983396674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 0x55c1e2665a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.311+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/3983396674 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e2660eb0 0x55c1e266cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.311+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/3983396674 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e265b350 0x55c1e2665530 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.311+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3983396674 >> 172.21.15.170:0/3983396674 conn(0x55c1e26568c0 msgr2=0x55c1e2657b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.311+0000 7f3198ff9640 0 client.25171 ms_handle_reset on v2:172.21.15.186:6838/2132502182 2024-01-25T15:03:00.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.312+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3983396674 shutdown_connections 2024-01-25T15:03:00.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.312+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3983396674 wait complete. 2024-01-25T15:03:00.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.312+0000 7f31ba3c3740 20 client.25171 trim_cache size 0 max 16384 2024-01-25T15:03:00.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31ba3c3740 1 Processor -- start 2024-01-25T15:03:00.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31ba3c3740 1 -- start start 2024-01-25T15:03:00.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31ba3c3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265b350 0x55c1e264d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31ba3c3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 0x55c1e266ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31ba3c3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e2660eb0 0x55c1e2656ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31ba3c3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e25b6e30 con 0x55c1e265b350 2024-01-25T15:03:00.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31ba3c3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e2663730 con 0x55c1e265bd40 2024-01-25T15:03:00.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31ba3c3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e264df10 con 0x55c1e2660eb0 2024-01-25T15:03:00.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31b4cc0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265b350 0x55c1e264d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31b4cc0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265b350 0x55c1e264d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54038/0 (socket says 172.21.15.170:54038) 2024-01-25T15:03:00.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31b4cc0640 1 -- 172.21.15.170:0/2670505792 learned_addr learned my addr 172.21.15.170:0/2670505792 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31b54c1640 1 --2- 172.21.15.170:0/2670505792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 0x55c1e266ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31b4cc0640 1 -- 172.21.15.170:0/2670505792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e2660eb0 msgr2=0x55c1e2656ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31b4cc0640 1 --2- 172.21.15.170:0/2670505792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e2660eb0 0x55c1e2656ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31b4cc0640 1 -- 172.21.15.170:0/2670505792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 msgr2=0x55c1e266ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31b4cc0640 1 --2- 172.21.15.170:0/2670505792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 0x55c1e266ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.335+0000 7f31b4cc0640 1 -- 172.21.15.170:0/2670505792 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1e2559500 con 0x55c1e265b350 2024-01-25T15:03:00.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.336+0000 7f31b4cc0640 1 --2- 172.21.15.170:0/2670505792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265b350 0x55c1e264d680 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f31a0005fb0 tx=0x7f31a0012940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f16ef4e394ddc3 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.336+0000 7f319affd640 1 -- 172.21.15.170:0/2670505792 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a000b390 con 0x55c1e265b350 2024-01-25T15:03:00.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.336+0000 7f319affd640 1 -- 172.21.15.170:0/2670505792 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31a00035f0 con 0x55c1e265b350 2024-01-25T15:03:00.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.336+0000 7f319affd640 1 -- 172.21.15.170:0/2670505792 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0004290 con 0x55c1e265b350 2024-01-25T15:03:00.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.337+0000 7f31ba3c3740 1 -- 172.21.15.170:0/2670505792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265b350 msgr2=0x55c1e264d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.337+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/2670505792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265b350 0x55c1e264d680 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f31a0005fb0 tx=0x7f31a0012940 comp rx=0 tx=0).stop 2024-01-25T15:03:00.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.337+0000 7f31ba3c3740 1 -- 172.21.15.170:0/2670505792 shutdown_connections 2024-01-25T15:03:00.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.337+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/2670505792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 0x55c1e266ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.337+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/2670505792 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e2660eb0 0x55c1e2656ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.337+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/2670505792 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265b350 0x55c1e264d680 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.337+0000 7f31ba3c3740 1 -- 172.21.15.170:0/2670505792 >> 172.21.15.170:0/2670505792 conn(0x55c1e26568c0 msgr2=0x55c1e265c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.337+0000 7f31ba3c3740 1 -- 172.21.15.170:0/2670505792 shutdown_connections 2024-01-25T15:03:00.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.337+0000 7f31ba3c3740 1 -- 172.21.15.170:0/2670505792 wait complete. 2024-01-25T15:03:00.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.337+0000 7f31ba3c3740 1 -- start start 2024-01-25T15:03:00.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.337+0000 7f31ba3c3740 1 Processor -- start 2024-01-25T15:03:00.344 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.338+0000 7f31ba3c3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265b350 0x55c1e266c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.338+0000 7f31ba3c3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 0x55c1e266b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.338+0000 7f31ba3c3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e2660eb0 0x55c1e266b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.338+0000 7f31b4cc0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265b350 0x55c1e266c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.338+0000 7f31ba3c3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e266bde0 con 0x55c1e265b350 2024-01-25T15:03:00.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.338+0000 7f31ba3c3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e266bf50 con 0x55c1e265bd40 2024-01-25T15:03:00.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.338+0000 7f31b4cc0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265b350 0x55c1e266c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54040/0 (socket says 172.21.15.170:54040) 2024-01-25T15:03:00.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.338+0000 7f31ba3c3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1e26c77d0 con 0x55c1e2660eb0 2024-01-25T15:03:00.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.338+0000 7f31b4cc0640 1 -- 172.21.15.170:0/3885630878 learned_addr learned my addr 172.21.15.170:0/3885630878 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.338+0000 7f31b54c1640 1 --2- 172.21.15.170:0/3885630878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 0x55c1e266b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.338+0000 7f31ba3c3740 10 client.0 _ll_register_callbacks cb 0x7f31ac005e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:00.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.338+0000 7f31b4cc0640 1 -- 172.21.15.170:0/3885630878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e2660eb0 msgr2=0x55c1e266b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.338+0000 7f31b4cc0640 1 --2- 172.21.15.170:0/3885630878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e2660eb0 0x55c1e266b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.345 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.338+0000 7f31b4cc0640 1 -- 172.21.15.170:0/3885630878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 msgr2=0x55c1e266b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.338+0000 7f31b4cc0640 1 --2- 172.21.15.170:0/3885630878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 0x55c1e266b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.339+0000 7f31b4cc0640 1 -- 172.21.15.170:0/3885630878 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c1e25bc8d0 con 0x55c1e265b350 2024-01-25T15:03:00.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.339+0000 7f31b4cc0640 1 --2- 172.21.15.170:0/3885630878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265b350 0x55c1e266c9b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f31a00125b0 tx=0x7f31a000bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd3dc92891e6256 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.339+0000 7f3198ff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:00.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.339+0000 7f3198ff9640 1 -- 172.21.15.170:0/3885630878 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0003760 con 0x55c1e265b350 2024-01-25T15:03:00.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.339+0000 7f3198ff9640 1 -- 172.21.15.170:0/3885630878 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f31a0000e40 con 0x55c1e265b350 2024-01-25T15:03:00.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.339+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3885630878 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1e25b70e0 con 0x55c1e265b350 2024-01-25T15:03:00.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.339+0000 7f3198ff9640 1 -- 172.21.15.170:0/3885630878 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31a00038c0 con 0x55c1e265b350 2024-01-25T15:03:00.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.339+0000 7f31ba3c3740 10 client.15804 fetch_fsmap learned FSMap version 26 2024-01-25T15:03:00.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.339+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3885630878 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c1e257f050 con 0x55c1e265b350 2024-01-25T15:03:00.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.340+0000 7f3198ff9640 1 -- 172.21.15.170:0/3885630878 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c1e25b70e0 con 0x55c1e265b350 2024-01-25T15:03:00.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.340+0000 7f3198ff9640 1 -- 172.21.15.170:0/3885630878 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f31a0031070 con 0x55c1e265b350 2024-01-25T15:03:00.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.340+0000 7f31ba3c3740 10 client.15804 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:03:00.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.340+0000 7f31ba3c3740 10 client.15804 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-01-25T15:03:00.346 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.340+0000 7f31ba3c3740 20 client.15804 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:00.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.340+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/3885630878 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55c1e26c8e20 0x55c1e26cb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.341+0000 7f31ba3c3740 4 client.15804 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:03:00.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.341+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3885630878 --> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c1e2310e30 con 0x55c1e26c8e20 2024-01-25T15:03:00.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.341+0000 7f31b54c1640 1 --2- 172.21.15.170:0/3885630878 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55c1e26c8e20 0x55c1e26cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.341+0000 7f3198ff9640 10 client.15804 ms_handle_connect on v2:172.21.15.186:6838/2132502182 2024-01-25T15:03:00.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.341+0000 7f31b54c1640 1 --2- 172.21.15.170:0/3885630878 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55c1e26c8e20 0x55c1e26cb210 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e33d6d2c1ea2cdf2 server_cookie=1f06ef6a84855769 in_seq=0 out_seq=0 2024-01-25T15:03:00.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.341+0000 7f3198ff9640 1 -- 172.21.15.170:0/3885630878 <== mds.1 v2:172.21.15.186:6838/2132502182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c1e2310e30 con 0x55c1e26c8e20 2024-01-25T15:03:00.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.341+0000 7f3198ff9640 10 client.15804 handle_command_reply: tid=0 2024-01-25T15:03:00.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.342+0000 7f31ba3c3740 1 client.15804 shutdown 2024-01-25T15:03:00.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.342+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3885630878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265b350 msgr2=0x55c1e266c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.342+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/3885630878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265b350 0x55c1e266c9b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f31a00125b0 tx=0x7f31a000bc60 comp rx=0 tx=0).stop 2024-01-25T15:03:00.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.342+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3885630878 shutdown_connections 2024-01-25T15:03:00.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.342+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/3885630878 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55c1e26c8e20 0x55c1e26cb210 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.342+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/3885630878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c1e265bd40 0x55c1e266b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.347 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.342+0000 7f3198ff9640 0 client.15804 ms_handle_reset on v2:172.21.15.186:6838/2132502182 2024-01-25T15:03:00.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.342+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/3885630878 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c1e2660eb0 0x55c1e266b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.342+0000 7f31ba3c3740 1 --2- 172.21.15.170:0/3885630878 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c1e265b350 0x55c1e266c9b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.342+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3885630878 >> 172.21.15.170:0/3885630878 conn(0x55c1e26568c0 msgr2=0x55c1e264d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.342+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3885630878 shutdown_connections 2024-01-25T15:03:00.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.342+0000 7f31ba3c3740 1 -- 172.21.15.170:0/3885630878 wait complete. 2024-01-25T15:03:00.348 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.342+0000 7f31ba3c3740 20 client.15804 trim_cache size 0 max 16384 2024-01-25T15:03:00.348 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:03:00.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.343+0000 7f31b7725640 1 -- 172.21.15.170:0/1049582642 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f319c0a1360 msgr2=0x7f319c0a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.343+0000 7f31b7725640 1 --2- 172.21.15.170:0/1049582642 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f319c0a1360 0x7f319c0a3820 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f31a80a16b0 tx=0x7f31a800b910 comp rx=0 tx=0).stop 2024-01-25T15:03:00.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.343+0000 7f31b7725640 1 -- 172.21.15.170:0/1049582642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b01069d0 msgr2=0x7f31b019e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.343+0000 7f31b7725640 1 --2- 172.21.15.170:0/1049582642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b01069d0 0x7f31b019e360 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009fd0 tx=0x7f31a800b260 comp rx=0 tx=0).stop 2024-01-25T15:03:00.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.343+0000 7f31b7725640 1 -- 172.21.15.170:0/1049582642 shutdown_connections 2024-01-25T15:03:00.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.343+0000 7f31b7725640 1 --2- 172.21.15.170:0/1049582642 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f319c0a1360 0x7f319c0a3820 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.343+0000 7f31b7725640 1 --2- 172.21.15.170:0/1049582642 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f31b01069d0 0x7f31b019e360 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.349 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.343+0000 7f31b7725640 1 --2- 172.21.15.170:0/1049582642 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f31b01040a0 0x7f31b01972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.343+0000 7f31b7725640 1 --2- 172.21.15.170:0/1049582642 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f31b0101770 0x7f31b0196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.343+0000 7f31b7725640 1 -- 172.21.15.170:0/1049582642 >> 172.21.15.170:0/1049582642 conn(0x7f31b00fb180 msgr2=0x7f31b01021f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.343+0000 7f31b7725640 1 -- 172.21.15.170:0/1049582642 shutdown_connections 2024-01-25T15:03:00.350 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.343+0000 7f31b7725640 1 -- 172.21.15.170:0/1049582642 wait complete. 2024-01-25T15:03:00.358 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-01-25T15:03:00.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.471+0000 7eff32e15640 1 -- 172.21.15.170:0/2704533048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff2c0fff20 msgr2=0x7eff2c100380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.471+0000 7eff32e15640 1 --2- 172.21.15.170:0/2704533048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff2c0fff20 0x7eff2c100380 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7eff18009900 tx=0x7eff1802bc30 comp rx=0 tx=0).stop 2024-01-25T15:03:00.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.471+0000 7eff32e15640 1 -- 172.21.15.170:0/2704533048 shutdown_connections 2024-01-25T15:03:00.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.471+0000 7eff32e15640 1 --2- 172.21.15.170:0/2704533048 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff2c1008c0 0x7eff2c100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.471+0000 7eff32e15640 1 --2- 172.21.15.170:0/2704533048 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff2c0fff20 0x7eff2c100380 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.471+0000 7eff32e15640 1 --2- 172.21.15.170:0/2704533048 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff2c0ff5c0 0x7eff2c0ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.471+0000 7eff32e15640 1 -- 172.21.15.170:0/2704533048 >> 172.21.15.170:0/2704533048 conn(0x7eff2c0fb180 msgr2=0x7eff2c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.471+0000 7eff32e15640 1 -- 172.21.15.170:0/2704533048 shutdown_connections 2024-01-25T15:03:00.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.471+0000 7eff32e15640 1 -- 172.21.15.170:0/2704533048 wait complete. 2024-01-25T15:03:00.474 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff32e15640 1 Processor -- start 2024-01-25T15:03:00.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff32e15640 1 -- start start 2024-01-25T15:03:00.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff32e15640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff2c0ff5c0 0x7eff2c198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff32e15640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff2c0fff20 0x7eff2c199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff32e15640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff2c1008c0 0x7eff2c1a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff32e15640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c1a09e0 con 0x7eff2c0ff5c0 2024-01-25T15:03:00.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff32e15640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c1a0b50 con 0x7eff2c1008c0 2024-01-25T15:03:00.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff32e15640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c1a0d10 con 0x7eff2c0fff20 2024-01-25T15:03:00.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff30bb1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff2c0ff5c0 0x7eff2c198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff30bb1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff2c0ff5c0 0x7eff2c198ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54054/0 (socket says 172.21.15.170:54054) 2024-01-25T15:03:00.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff30bb1640 1 -- 172.21.15.170:0/1786530330 learned_addr learned my addr 172.21.15.170:0/1786530330 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff313b2640 1 --2- 172.21.15.170:0/1786530330 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff2c1008c0 0x7eff2c1a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff2bfff640 1 --2- 172.21.15.170:0/1786530330 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff2c0fff20 0x7eff2c199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff30bb1640 1 -- 172.21.15.170:0/1786530330 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff2c0fff20 msgr2=0x7eff2c199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff30bb1640 1 --2- 172.21.15.170:0/1786530330 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff2c0fff20 0x7eff2c199430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.475 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff30bb1640 1 -- 172.21.15.170:0/1786530330 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff2c1008c0 msgr2=0x7eff2c1a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff30bb1640 1 --2- 172.21.15.170:0/1786530330 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff2c1008c0 0x7eff2c1a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff30bb1640 1 -- 172.21.15.170:0/1786530330 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff24009840 con 0x7eff2c0ff5c0 2024-01-25T15:03:00.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.472+0000 7eff313b2640 1 --2- 172.21.15.170:0/1786530330 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff2c1008c0 0x7eff2c1a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:00.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.473+0000 7eff30bb1640 1 --2- 172.21.15.170:0/1786530330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff2c0ff5c0 0x7eff2c198ef0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7eff2000e9f0 tx=0x7eff2000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.473+0000 7eff29ffb640 1 -- 172.21.15.170:0/1786530330 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20009720 con 0x7eff2c0ff5c0 2024-01-25T15:03:00.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.473+0000 7eff29ffb640 1 -- 172.21.15.170:0/1786530330 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff200054e0 con 0x7eff2c0ff5c0 2024-01-25T15:03:00.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.473+0000 7eff32e15640 1 -- 172.21.15.170:0/1786530330 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff18009560 con 0x7eff2c0ff5c0 2024-01-25T15:03:00.476 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.473+0000 7eff29ffb640 1 -- 172.21.15.170:0/1786530330 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20010430 con 0x7eff2c0ff5c0 2024-01-25T15:03:00.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.473+0000 7eff32e15640 1 -- 172.21.15.170:0/1786530330 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2c1a1280 con 0x7eff2c0ff5c0 2024-01-25T15:03:00.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.476+0000 7eff359db740 1 Processor -- start 2024-01-25T15:03:00.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.476+0000 7eff359db740 1 -- start start 2024-01-25T15:03:00.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.476+0000 7eff359db740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e2f40 0x5615847e3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.476+0000 7eff359db740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e3930 0x5615847e8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.476+0000 7eff359db740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e8aa0 0x5615847eaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.476+0000 7eff359db740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561584751270 con 0x5615847e2f40 2024-01-25T15:03:00.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.476+0000 7eff359db740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56158474e960 con 0x5615847e8aa0 2024-01-25T15:03:00.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.476+0000 7eff359db740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56158474a250 con 0x5615847e3930 2024-01-25T15:03:00.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.476+0000 7eff313b2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e2f40 0x5615847e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.476+0000 7eff313b2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e2f40 0x5615847e3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54066/0 (socket says 172.21.15.170:54066) 2024-01-25T15:03:00.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.476+0000 7eff313b2640 1 -- 172.21.15.170:0/2526818862 learned_addr learned my addr 172.21.15.170:0/2526818862 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.476+0000 7eff2bfff640 1 --2- 172.21.15.170:0/2526818862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e8aa0 0x5615847eaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.477+0000 7eff29ffb640 1 -- 172.21.15.170:0/1786530330 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7eff20004ff0 con 0x7eff2c0ff5c0 2024-01-25T15:03:00.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.477+0000 7eff313b2640 1 -- 172.21.15.170:0/2526818862 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e3930 msgr2=0x5615847e8430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-25T15:03:00.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.477+0000 7eff313b2640 1 --2- 172.21.15.170:0/2526818862 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e3930 0x5615847e8430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.477+0000 7eff313b2640 1 -- 172.21.15.170:0/2526818862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e8aa0 msgr2=0x5615847eaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.477+0000 7eff313b2640 1 --2- 172.21.15.170:0/2526818862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e8aa0 0x5615847eaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.477+0000 7eff313b2640 1 -- 172.21.15.170:0/2526818862 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56158470c7f0 con 0x5615847e2f40 2024-01-25T15:03:00.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.477+0000 7eff29ffb640 1 --2- 172.21.15.170:0/1786530330 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7eff1c0a1360 0x7eff1c0a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.478+0000 7eff30bb1640 1 --2- 172.21.15.170:0/1786530330 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7eff1c0a1360 0x7eff1c0a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.478+0000 7eff313b2640 1 --2- 172.21.15.170:0/2526818862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e2f40 0x5615847e3360 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7eff2400e910 tx=0x7eff2400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b3f896c83d9730 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.478+0000 7eff16ffd640 1 -- 172.21.15.170:0/2526818862 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24011da0 con 0x5615847e2f40 2024-01-25T15:03:00.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.478+0000 7eff29ffb640 1 -- 172.21.15.170:0/1786530330 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7eff20014070 con 0x7eff2c0ff5c0 2024-01-25T15:03:00.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.478+0000 7eff16ffd640 1 -- 172.21.15.170:0/2526818862 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff24003e30 con 0x5615847e2f40 2024-01-25T15:03:00.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.478+0000 7eff16ffd640 1 -- 172.21.15.170:0/2526818862 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24019430 con 0x5615847e2f40 2024-01-25T15:03:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.479+0000 7eff359db740 1 -- 172.21.15.170:0/2526818862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e2f40 msgr2=0x5615847e3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.479+0000 7eff359db740 1 --2- 172.21.15.170:0/2526818862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e2f40 0x5615847e3360 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7eff2400e910 tx=0x7eff2400edd0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.479+0000 7eff30bb1640 1 --2- 172.21.15.170:0/1786530330 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7eff1c0a1360 0x7eff1c0a3820 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff2001c000 tx=0x7eff2006d1b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.479+0000 7eff359db740 1 -- 172.21.15.170:0/2526818862 shutdown_connections 2024-01-25T15:03:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.479+0000 7eff359db740 1 --2- 172.21.15.170:0/2526818862 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e8aa0 0x5615847eaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.479+0000 7eff359db740 1 --2- 172.21.15.170:0/2526818862 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e3930 0x5615847e8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.479+0000 7eff359db740 1 --2- 172.21.15.170:0/2526818862 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e2f40 0x5615847e3360 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.479+0000 7eff359db740 1 -- 172.21.15.170:0/2526818862 >> 172.21.15.170:0/2526818862 conn(0x5615847de4b0 msgr2=0x5615847de8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.479+0000 7eff359db740 1 -- 172.21.15.170:0/2526818862 shutdown_connections 2024-01-25T15:03:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.479+0000 7eff359db740 1 -- 172.21.15.170:0/2526818862 wait complete. 2024-01-25T15:03:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.479+0000 7eff359db740 1 -- start start 2024-01-25T15:03:00.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.479+0000 7eff359db740 1 Processor -- start 2024-01-25T15:03:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff359db740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e2f40 0x5615847ed120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff359db740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e3930 0x5615847ed660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff359db740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e8aa0 0x5615847f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff359db740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561584703610 con 0x5615847e3930 2024-01-25T15:03:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff359db740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615847032b0 con 0x5615847e2f40 2024-01-25T15:03:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff359db740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615846c8400 con 0x5615847e8aa0 2024-01-25T15:03:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff2bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e3930 0x5615847ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff313b2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e2f40 0x5615847ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff2bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e3930 0x5615847ed660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54082/0 (socket says 172.21.15.170:54082) 2024-01-25T15:03:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff2bfff640 1 -- 172.21.15.170:0/998968025 learned_addr learned my addr 172.21.15.170:0/998968025 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff359db740 10 client.0 _ll_register_callbacks cb 0x561584740ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff2bfff640 1 -- 172.21.15.170:0/998968025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e8aa0 msgr2=0x5615847f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff2bfff640 1 --2- 172.21.15.170:0/998968025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e8aa0 0x5615847f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff2bfff640 1 -- 172.21.15.170:0/998968025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e2f40 msgr2=0x5615847ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff2bfff640 1 --2- 172.21.15.170:0/998968025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e2f40 0x5615847ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.480+0000 7eff2bfff640 1 -- 172.21.15.170:0/998968025 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2400e5c0 con 0x5615847e3930 2024-01-25T15:03:00.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.481+0000 7eff2bfff640 1 --2- 172.21.15.170:0/998968025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e3930 0x5615847ed660 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7eff1802c6b0 tx=0x7eff180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8feabcf2b88d14c3 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.481+0000 7eff0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:00.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.481+0000 7eff0bfff640 1 -- 172.21.15.170:0/998968025 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff18004dd0 con 0x5615847e3930 2024-01-25T15:03:00.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.481+0000 7eff0bfff640 1 -- 172.21.15.170:0/998968025 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7eff18045070 con 0x5615847e3930 2024-01-25T15:03:00.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.481+0000 7eff359db740 1 -- 172.21.15.170:0/998968025 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5615847430e0 con 0x5615847e3930 2024-01-25T15:03:00.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.481+0000 7eff0bfff640 1 -- 172.21.15.170:0/998968025 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff18004250 con 0x5615847e3930 2024-01-25T15:03:00.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.481+0000 7eff359db740 10 client.15816 fetch_fsmap learned FSMap version 26 2024-01-25T15:03:00.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.481+0000 7eff359db740 1 -- 172.21.15.170:0/998968025 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5615847488d0 con 0x5615847e3930 2024-01-25T15:03:00.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.482+0000 7eff0bfff640 1 -- 172.21.15.170:0/998968025 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5615847430e0 con 0x5615847e3930 2024-01-25T15:03:00.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.482+0000 7eff0bfff640 1 -- 172.21.15.170:0/998968025 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7eff1803c040 con 0x5615847e3930 2024-01-25T15:03:00.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.482+0000 7eff359db740 10 client.15816 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:03:00.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.482+0000 7eff359db740 10 client.15816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:00.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.482+0000 7eff359db740 20 client.15816 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:00.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.482+0000 7eff359db740 1 --2- 172.21.15.170:0/998968025 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5615847f9000 0x5615847fb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.482+0000 7eff359db740 4 client.15816 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:00.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.482+0000 7eff359db740 1 -- 172.21.15.170:0/998968025 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561584742e00 con 0x5615847f9000 2024-01-25T15:03:00.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.482+0000 7eff313b2640 1 --2- 172.21.15.170:0/998968025 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5615847f9000 0x5615847fb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.483+0000 7eff313b2640 1 --2- 172.21.15.170:0/998968025 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5615847f9000 0x5615847fb420 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dfd39d43fcad557 server_cookie=9f0f0517a9f52fa3 in_seq=0 out_seq=0 2024-01-25T15:03:00.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.483+0000 7eff0bfff640 10 client.15816 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:00.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.483+0000 7eff0bfff640 1 -- 172.21.15.170:0/998968025 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561584742e00 con 0x5615847f9000 2024-01-25T15:03:00.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.483+0000 7eff0bfff640 10 client.15816 handle_command_reply: tid=0 2024-01-25T15:03:00.488 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.483+0000 7eff359db740 1 client.15816 shutdown 2024-01-25T15:03:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.484+0000 7eff359db740 1 -- 172.21.15.170:0/998968025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e3930 msgr2=0x5615847ed660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.484+0000 7eff359db740 1 --2- 172.21.15.170:0/998968025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e3930 0x5615847ed660 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7eff1802c6b0 tx=0x7eff180048f0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.484+0000 7eff359db740 1 -- 172.21.15.170:0/998968025 shutdown_connections 2024-01-25T15:03:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.484+0000 7eff359db740 1 --2- 172.21.15.170:0/998968025 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5615847f9000 0x5615847fb420 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.484+0000 7eff0bfff640 0 client.15816 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.484+0000 7eff359db740 1 --2- 172.21.15.170:0/998968025 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e8aa0 0x5615847f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.484+0000 7eff359db740 1 --2- 172.21.15.170:0/998968025 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e3930 0x5615847ed660 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.484+0000 7eff359db740 1 --2- 172.21.15.170:0/998968025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e2f40 0x5615847ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.484+0000 7eff359db740 1 -- 172.21.15.170:0/998968025 >> 172.21.15.170:0/998968025 conn(0x5615847de4b0 msgr2=0x5615847dd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.484+0000 7eff359db740 1 -- 172.21.15.170:0/998968025 shutdown_connections 2024-01-25T15:03:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.484+0000 7eff359db740 1 -- 172.21.15.170:0/998968025 wait complete. 2024-01-25T15:03:00.489 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.484+0000 7eff359db740 20 client.15816 trim_cache size 0 max 16384 2024-01-25T15:03:00.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.495+0000 7eff359db740 1 Processor -- start 2024-01-25T15:03:00.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.495+0000 7eff359db740 1 -- start start 2024-01-25T15:03:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff359db740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e2f40 0x5615847ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff359db740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e3930 0x5615847f4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff359db740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e8aa0 0x5615847ed620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff359db740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615847d9d80 con 0x5615847e2f40 2024-01-25T15:03:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff359db740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615847e4020 con 0x5615847e8aa0 2024-01-25T15:03:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff359db740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615847f7570 con 0x5615847e3930 2024-01-25T15:03:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff313b2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e2f40 0x5615847ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff313b2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e2f40 0x5615847ed0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54098/0 (socket says 172.21.15.170:54098) 2024-01-25T15:03:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff313b2640 1 -- 172.21.15.170:0/1796601554 learned_addr learned my addr 172.21.15.170:0/1796601554 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff313b2640 1 -- 172.21.15.170:0/1796601554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e3930 msgr2=0x5615847f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff2bfff640 1 --2- 172.21.15.170:0/1796601554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e3930 0x5615847f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff313b2640 1 --2- 172.21.15.170:0/1796601554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e3930 0x5615847f4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff313b2640 1 -- 172.21.15.170:0/1796601554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e8aa0 msgr2=0x5615847ed620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff313b2640 1 --2- 172.21.15.170:0/1796601554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e8aa0 0x5615847ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff313b2640 1 -- 172.21.15.170:0/1796601554 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615846e5500 con 0x5615847e2f40 2024-01-25T15:03:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.496+0000 7eff313b2640 1 --2- 172.21.15.170:0/1796601554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e2f40 0x5615847ed0e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7eff2401b040 tx=0x7eff240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862caa8da4320a93 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.497+0000 7eff167fc640 1 -- 172.21.15.170:0/1796601554 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24003970 con 0x5615847e2f40 2024-01-25T15:03:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.497+0000 7eff167fc640 1 -- 172.21.15.170:0/1796601554 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff24004de0 con 0x5615847e2f40 2024-01-25T15:03:00.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.497+0000 7eff167fc640 1 -- 172.21.15.170:0/1796601554 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24005040 con 0x5615847e2f40 2024-01-25T15:03:00.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.497+0000 7eff359db740 1 -- 172.21.15.170:0/1796601554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e2f40 msgr2=0x5615847ed0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.497+0000 7eff359db740 1 --2- 172.21.15.170:0/1796601554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e2f40 0x5615847ed0e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7eff2401b040 tx=0x7eff240046c0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.497+0000 7eff359db740 1 -- 172.21.15.170:0/1796601554 shutdown_connections 2024-01-25T15:03:00.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.497+0000 7eff359db740 1 --2- 172.21.15.170:0/1796601554 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e8aa0 0x5615847ed620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.497+0000 7eff359db740 1 --2- 172.21.15.170:0/1796601554 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e3930 0x5615847f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.497+0000 7eff359db740 1 --2- 172.21.15.170:0/1796601554 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e2f40 0x5615847ed0e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.497+0000 7eff359db740 1 -- 172.21.15.170:0/1796601554 >> 172.21.15.170:0/1796601554 conn(0x5615847de4b0 msgr2=0x5615847de890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.497+0000 7eff359db740 1 -- 172.21.15.170:0/1796601554 shutdown_connections 2024-01-25T15:03:00.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.497+0000 7eff359db740 1 -- 172.21.15.170:0/1796601554 wait complete. 2024-01-25T15:03:00.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.498+0000 7eff359db740 1 -- start start 2024-01-25T15:03:00.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.498+0000 7eff359db740 1 Processor -- start 2024-01-25T15:03:00.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.498+0000 7eff359db740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e2f40 0x5615847f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.498+0000 7eff359db740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e3930 0x5615847f3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.504 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.498+0000 7eff359db740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e8aa0 0x5615847f3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.498+0000 7eff359db740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56158484f650 con 0x5615847e8aa0 2024-01-25T15:03:00.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.498+0000 7eff359db740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56158484f7c0 con 0x5615847e3930 2024-01-25T15:03:00.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.498+0000 7eff359db740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56158484f980 con 0x5615847e2f40 2024-01-25T15:03:00.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.498+0000 7eff359db740 10 client.0 _ll_register_callbacks cb 0x7eff2400e490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:00.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.498+0000 7eff313b2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e8aa0 0x5615847f3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.498+0000 7eff313b2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e8aa0 0x5615847f3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54100/0 (socket says 172.21.15.170:54100) 2024-01-25T15:03:00.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.498+0000 7eff313b2640 1 -- 172.21.15.170:0/1424815895 learned_addr learned my addr 172.21.15.170:0/1424815895 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:00.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.498+0000 7eff2bfff640 1 --2- 172.21.15.170:0/1424815895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e3930 0x5615847f3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.498+0000 7eff313b2640 1 --2- 172.21.15.170:0/1424815895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e2f40 0x5615847f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.499+0000 7eff313b2640 1 -- 172.21.15.170:0/1424815895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e2f40 msgr2=0x5615847f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.499+0000 7eff313b2640 1 --2- 172.21.15.170:0/1424815895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e2f40 0x5615847f30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.499+0000 7eff313b2640 1 -- 172.21.15.170:0/1424815895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e3930 msgr2=0x5615847f3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:00.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.499+0000 7eff313b2640 1 --2- 172.21.15.170:0/1424815895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e3930 0x5615847f3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.505 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.499+0000 7eff313b2640 1 -- 172.21.15.170:0/1424815895 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56158470c7f0 con 0x5615847e8aa0 2024-01-25T15:03:00.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.499+0000 7eff313b2640 1 --2- 172.21.15.170:0/1424815895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e8aa0 0x5615847f3b40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7eff240047d0 tx=0x7eff24033040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ebb0052733c78e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:00.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.499+0000 7eff0bfff640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:00.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.499+0000 7eff0bfff640 1 -- 172.21.15.170:0/1424815895 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff24036070 con 0x5615847e8aa0 2024-01-25T15:03:00.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.499+0000 7eff0bfff640 1 -- 172.21.15.170:0/1424815895 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7eff24003970 con 0x5615847e8aa0 2024-01-25T15:03:00.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.499+0000 7eff359db740 1 -- 172.21.15.170:0/1424815895 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff24003e30 con 0x5615847e8aa0 2024-01-25T15:03:00.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.499+0000 7eff0bfff640 1 -- 172.21.15.170:0/1424815895 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff24003b30 con 0x5615847e8aa0 2024-01-25T15:03:00.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.499+0000 7eff359db740 10 client.15822 fetch_fsmap learned FSMap version 26 2024-01-25T15:03:00.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.499+0000 7eff359db740 1 -- 172.21.15.170:0/1424815895 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56158470b050 con 0x5615847e8aa0 2024-01-25T15:03:00.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.499+0000 7eff0bfff640 1 -- 172.21.15.170:0/1424815895 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff24029070 con 0x5615847e8aa0 2024-01-25T15:03:00.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.500+0000 7eff0bfff640 1 -- 172.21.15.170:0/1424815895 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7eff2403b030 con 0x5615847e8aa0 2024-01-25T15:03:00.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.500+0000 7eff359db740 10 client.15822 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:03:00.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.500+0000 7eff359db740 10 client.15822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:00.506 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.500+0000 7eff359db740 20 client.15822 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:00.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.500+0000 7eff359db740 1 --2- 172.21.15.170:0/1424815895 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5615847f9000 0x561584853230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:00.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.500+0000 7eff359db740 4 client.15822 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:03:00.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.500+0000 7eff359db740 1 -- 172.21.15.170:0/1424815895 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7eff24003e30 con 0x5615847f9000 2024-01-25T15:03:00.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.500+0000 7eff2bfff640 1 --2- 172.21.15.170:0/1424815895 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5615847f9000 0x561584853230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:00.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.500+0000 7eff0bfff640 10 client.15822 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:00.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.500+0000 7eff2bfff640 1 --2- 172.21.15.170:0/1424815895 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5615847f9000 0x561584853230 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9942a7d16959e64 server_cookie=df4882f025fa608b in_seq=0 out_seq=0 2024-01-25T15:03:00.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.501+0000 7eff0bfff640 1 -- 172.21.15.170:0/1424815895 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7eff24003e30 con 0x5615847f9000 2024-01-25T15:03:00.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.501+0000 7eff0bfff640 10 client.15822 handle_command_reply: tid=0 2024-01-25T15:03:00.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.501+0000 7eff359db740 1 client.15822 shutdown 2024-01-25T15:03:00.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.501+0000 7eff359db740 1 -- 172.21.15.170:0/1424815895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e8aa0 msgr2=0x5615847f3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.501+0000 7eff359db740 1 --2- 172.21.15.170:0/1424815895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e8aa0 0x5615847f3b40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7eff240047d0 tx=0x7eff24033040 comp rx=0 tx=0).stop 2024-01-25T15:03:00.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.501+0000 7eff359db740 1 -- 172.21.15.170:0/1424815895 shutdown_connections 2024-01-25T15:03:00.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.501+0000 7eff359db740 1 --2- 172.21.15.170:0/1424815895 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5615847f9000 0x561584853230 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.501+0000 7eff0bfff640 0 client.15822 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:00.507 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.501+0000 7eff359db740 1 --2- 172.21.15.170:0/1424815895 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5615847e3930 0x5615847f3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.501+0000 7eff359db740 1 --2- 172.21.15.170:0/1424815895 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5615847e8aa0 0x5615847f3b40 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.501+0000 7eff359db740 1 --2- 172.21.15.170:0/1424815895 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5615847e2f40 0x5615847f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.501+0000 7eff359db740 1 -- 172.21.15.170:0/1424815895 >> 172.21.15.170:0/1424815895 conn(0x5615847de4b0 msgr2=0x5615847ed0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.501+0000 7eff359db740 1 -- 172.21.15.170:0/1424815895 shutdown_connections 2024-01-25T15:03:00.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.501+0000 7eff359db740 1 -- 172.21.15.170:0/1424815895 wait complete. 2024-01-25T15:03:00.508 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.501+0000 7eff359db740 20 client.15822 trim_cache size 0 max 16384 2024-01-25T15:03:00.508 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:03:00.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.502+0000 7eff32e15640 1 -- 172.21.15.170:0/1786530330 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7eff1c0a1360 msgr2=0x7eff1c0a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.509 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.502+0000 7eff32e15640 1 --2- 172.21.15.170:0/1786530330 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7eff1c0a1360 0x7eff1c0a3820 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7eff2001c000 tx=0x7eff2006d1b0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.502+0000 7eff32e15640 1 -- 172.21.15.170:0/1786530330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff2c0ff5c0 msgr2=0x7eff2c198ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:00.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.502+0000 7eff32e15640 1 --2- 172.21.15.170:0/1786530330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff2c0ff5c0 0x7eff2c198ef0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7eff2000e9f0 tx=0x7eff2000edf0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.502+0000 7eff32e15640 1 -- 172.21.15.170:0/1786530330 shutdown_connections 2024-01-25T15:03:00.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.502+0000 7eff32e15640 1 --2- 172.21.15.170:0/1786530330 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7eff1c0a1360 0x7eff1c0a3820 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.502+0000 7eff32e15640 1 --2- 172.21.15.170:0/1786530330 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff2c1008c0 0x7eff2c1a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.502+0000 7eff32e15640 1 --2- 172.21.15.170:0/1786530330 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7eff2c0fff20 0x7eff2c199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.502+0000 7eff32e15640 1 --2- 172.21.15.170:0/1786530330 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7eff2c0ff5c0 0x7eff2c198ef0 secure :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7eff2000e9f0 tx=0x7eff2000edf0 comp rx=0 tx=0).stop 2024-01-25T15:03:00.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.502+0000 7eff32e15640 1 -- 172.21.15.170:0/1786530330 >> 172.21.15.170:0/1786530330 conn(0x7eff2c0fb180 msgr2=0x7eff2c0fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:00.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.502+0000 7eff32e15640 1 -- 172.21.15.170:0/1786530330 shutdown_connections 2024-01-25T15:03:00.510 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:00.502+0000 7eff32e15640 1 -- 172.21.15.170:0/1786530330 wait complete. 2024-01-25T15:03:00.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:00 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3561055718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:03:00.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:00 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3561055718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:03:01.513 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-01-25T15:03:01.514 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-01-25T15:03:01.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:01 smithi186 ceph-mon[35697]: pgmap v379: 97 pgs: 97 active+clean; 669 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 10 op/s 2024-01-25T15:03:01.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.621+0000 7f459b778640 1 -- 172.21.15.170:0/2296316071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45940ff5c0 msgr2=0x7f45940ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.621+0000 7f459b778640 1 --2- 172.21.15.170:0/2296316071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45940ff5c0 0x7f45940ff9e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f4590009900 tx=0x7f459002bc30 comp rx=0 tx=0).stop 2024-01-25T15:03:01.625 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.621+0000 7f459b778640 1 -- 172.21.15.170:0/2296316071 shutdown_connections 2024-01-25T15:03:01.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.621+0000 7f459b778640 1 --2- 172.21.15.170:0/2296316071 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45941008c0 0x7f4594100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.621+0000 7f459b778640 1 --2- 172.21.15.170:0/2296316071 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45940fff20 0x7f4594100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.621+0000 7f459b778640 1 --2- 172.21.15.170:0/2296316071 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45940ff5c0 0x7f45940ff9e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.621+0000 7f459b778640 1 -- 172.21.15.170:0/2296316071 >> 172.21.15.170:0/2296316071 conn(0x7f45940fb180 msgr2=0x7f45940fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.621+0000 7f459b778640 1 -- 172.21.15.170:0/2296316071 shutdown_connections 2024-01-25T15:03:01.626 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.621+0000 7f459b778640 1 -- 172.21.15.170:0/2296316071 wait complete. 2024-01-25T15:03:01.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.622+0000 7f459b778640 1 Processor -- start 2024-01-25T15:03:01.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.622+0000 7f459b778640 1 -- start start 2024-01-25T15:03:01.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.622+0000 7f459b778640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45940ff5c0 0x7f4594198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.622+0000 7f459b778640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45940fff20 0x7f4594199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.622+0000 7f459b778640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45941008c0 0x7f45941a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.627 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.622+0000 7f459b778640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45941a0930 con 0x7f45940fff20 2024-01-25T15:03:01.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.622+0000 7f459b778640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45941a0aa0 con 0x7f45941008c0 2024-01-25T15:03:01.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.622+0000 7f459b778640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45941a0c60 con 0x7f45940ff5c0 2024-01-25T15:03:01.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.622+0000 7f4598d13640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45940fff20 0x7f4594199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.622+0000 7f4598d13640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45940fff20 0x7f4594199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54110/0 (socket says 172.21.15.170:54110) 2024-01-25T15:03:01.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.622+0000 7f4598d13640 1 -- 172.21.15.170:0/2482396319 learned_addr learned my addr 172.21.15.170:0/2482396319 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:01.628 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.623+0000 7f4599514640 1 --2- 172.21.15.170:0/2482396319 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45940ff5c0 0x7f4594198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.629 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.623+0000 7f4599d15640 1 --2- 172.21.15.170:0/2482396319 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45941008c0 0x7f45941a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.629 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:01 smithi170 ceph-mon[31899]: pgmap v379: 97 pgs: 97 active+clean; 669 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 10 op/s 2024-01-25T15:03:01.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.623+0000 7f4598d13640 1 -- 172.21.15.170:0/2482396319 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45940ff5c0 msgr2=0x7f4594198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.623+0000 7f4598d13640 1 --2- 172.21.15.170:0/2482396319 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45940ff5c0 0x7f4594198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.623+0000 7f4598d13640 1 -- 172.21.15.170:0/2482396319 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45941008c0 msgr2=0x7f45941a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.623+0000 7f4598d13640 1 --2- 172.21.15.170:0/2482396319 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45941008c0 0x7f45941a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.623+0000 7f4598d13640 1 -- 172.21.15.170:0/2482396319 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4590009560 con 0x7f45940fff20 2024-01-25T15:03:01.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.623+0000 7f4598d13640 1 --2- 172.21.15.170:0/2482396319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45940fff20 0x7f4594199380 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f458400c920 tx=0x7f458400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.623+0000 7f458a7fc640 1 -- 172.21.15.170:0/2482396319 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584007c70 con 0x7f45940fff20 2024-01-25T15:03:01.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.623+0000 7f459b778640 1 -- 172.21.15.170:0/2482396319 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45941a0f40 con 0x7f45940fff20 2024-01-25T15:03:01.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.623+0000 7f458a7fc640 1 -- 172.21.15.170:0/2482396319 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4584007dd0 con 0x7f45940fff20 2024-01-25T15:03:01.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.623+0000 7f458a7fc640 1 -- 172.21.15.170:0/2482396319 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584018860 con 0x7f45940fff20 2024-01-25T15:03:01.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.623+0000 7f459b778640 1 -- 172.21.15.170:0/2482396319 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45941a1410 con 0x7f45940fff20 2024-01-25T15:03:01.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.626+0000 7f458a7fc640 1 -- 172.21.15.170:0/2482396319 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f458400fa80 con 0x7f45940fff20 2024-01-25T15:03:01.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.626+0000 7f458a7fc640 1 --2- 172.21.15.170:0/2482396319 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f45800a12e0 0x7f45800a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.626+0000 7f458a7fc640 1 -- 172.21.15.170:0/2482396319 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f45840ccc30 con 0x7f45940fff20 2024-01-25T15:03:01.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.626+0000 7f4599514640 1 --2- 172.21.15.170:0/2482396319 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f45800a12e0 0x7f45800a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.627+0000 7f4599514640 1 --2- 172.21.15.170:0/2482396319 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f45800a12e0 0x7f45800a37a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4590005ab0 tx=0x7f459002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.627+0000 7f459e415740 1 Processor -- start 2024-01-25T15:03:01.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.627+0000 7f459e415740 1 -- start start 2024-01-25T15:03:01.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.627+0000 7f459e415740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759ac080 0x559b759ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.627+0000 7f459e415740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759aca70 0x559b759b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.627+0000 7f459e415740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759b1be0 0x559b759b4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.627+0000 7f459e415740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b75982c20 con 0x559b759b1be0 2024-01-25T15:03:01.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.627+0000 7f459e415740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b7591af80 con 0x559b759aca70 2024-01-25T15:03:01.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.627+0000 7f459e415740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b75918670 con 0x559b759ac080 2024-01-25T15:03:01.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f4599d15640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759b1be0 0x559b759b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f4598d13640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759aca70 0x559b759b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f4598d13640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759aca70 0x559b759b1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:59480/0 (socket says 172.21.15.170:59480) 2024-01-25T15:03:01.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f4599d15640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759b1be0 0x559b759b4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54124/0 (socket says 172.21.15.170:54124) 2024-01-25T15:03:01.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f4598d13640 1 -- 172.21.15.170:0/4251728821 learned_addr learned my addr 172.21.15.170:0/4251728821 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:01.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f4599514640 1 --2- 172.21.15.170:0/4251728821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759ac080 0x559b759ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f4598d13640 1 -- 172.21.15.170:0/4251728821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759ac080 msgr2=0x559b759ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f4598d13640 1 --2- 172.21.15.170:0/4251728821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759ac080 0x559b759ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f4598d13640 1 -- 172.21.15.170:0/4251728821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759b1be0 msgr2=0x559b759b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f4598d13640 1 --2- 172.21.15.170:0/4251728821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759b1be0 0x559b759b4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f4598d13640 1 -- 172.21.15.170:0/4251728821 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b7590bd80 con 0x559b759aca70 2024-01-25T15:03:01.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f4599d15640 1 --2- 172.21.15.170:0/4251728821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759b1be0 0x559b759b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:01.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f4598d13640 1 --2- 172.21.15.170:0/4251728821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759aca70 0x559b759b1570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f45840a1c00 tx=0x7f4584007f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=962d170b7bd5f169 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f457f7fe640 1 -- 172.21.15.170:0/4251728821 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45840a2130 con 0x559b759aca70 2024-01-25T15:03:01.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f457f7fe640 1 -- 172.21.15.170:0/4251728821 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4584097ee0 con 0x559b759aca70 2024-01-25T15:03:01.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.628+0000 7f457f7fe640 1 -- 172.21.15.170:0/4251728821 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45840b24d0 con 0x559b759aca70 2024-01-25T15:03:01.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.629+0000 7f459e415740 1 -- 172.21.15.170:0/4251728821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759aca70 msgr2=0x559b759b1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.629+0000 7f459e415740 1 --2- 172.21.15.170:0/4251728821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759aca70 0x559b759b1570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f45840a1c00 tx=0x7f4584007f40 comp rx=0 tx=0).stop 2024-01-25T15:03:01.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.629+0000 7f459e415740 1 -- 172.21.15.170:0/4251728821 shutdown_connections 2024-01-25T15:03:01.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.629+0000 7f459e415740 1 --2- 172.21.15.170:0/4251728821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759aca70 0x559b759b1570 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.629+0000 7f459e415740 1 --2- 172.21.15.170:0/4251728821 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759b1be0 0x559b759b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.629+0000 7f459e415740 1 --2- 172.21.15.170:0/4251728821 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759ac080 0x559b759ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.629+0000 7f459e415740 1 -- 172.21.15.170:0/4251728821 >> 172.21.15.170:0/4251728821 conn(0x559b759a75f0 msgr2=0x559b759a79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.630+0000 7f459e415740 1 -- 172.21.15.170:0/4251728821 shutdown_connections 2024-01-25T15:03:01.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.630+0000 7f459e415740 1 -- 172.21.15.170:0/4251728821 wait complete. 2024-01-25T15:03:01.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.630+0000 7f459e415740 1 -- start start 2024-01-25T15:03:01.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.630+0000 7f459e415740 1 Processor -- start 2024-01-25T15:03:01.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f459e415740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759ac080 0x559b759b6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f459e415740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759aca70 0x559b759b6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f459e415740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759b1be0 0x559b759bd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f459e415740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b75913f60 con 0x559b759aca70 2024-01-25T15:03:01.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f4598d13640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759aca70 0x559b759b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f4598d13640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759aca70 0x559b759b6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54132/0 (socket says 172.21.15.170:54132) 2024-01-25T15:03:01.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f4598d13640 1 -- 172.21.15.170:0/1358865770 learned_addr learned my addr 172.21.15.170:0/1358865770 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:01.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f459e415740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b758cd0f0 con 0x559b759b1be0 2024-01-25T15:03:01.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f459e415740 1 -- 172.21.15.170:0/1358865770 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b758ccd90 con 0x559b759ac080 2024-01-25T15:03:01.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f4599d15640 1 --2- 172.21.15.170:0/1358865770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759b1be0 0x559b759bd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f459e415740 10 client.0 _ll_register_callbacks cb 0x559b758b2ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:01.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f4599514640 1 --2- 172.21.15.170:0/1358865770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759ac080 0x559b759b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f4598d13640 1 -- 172.21.15.170:0/1358865770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759ac080 msgr2=0x559b759b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f4598d13640 1 --2- 172.21.15.170:0/1358865770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759ac080 0x559b759b6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f4598d13640 1 -- 172.21.15.170:0/1358865770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759b1be0 msgr2=0x559b759bd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f4598d13640 1 --2- 172.21.15.170:0/1358865770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759b1be0 0x559b759bd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f4598d13640 1 -- 172.21.15.170:0/1358865770 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45941a1410 con 0x559b759aca70 2024-01-25T15:03:01.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.631+0000 7f4599d15640 1 --2- 172.21.15.170:0/1358865770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759b1be0 0x559b759bd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:03:01.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.632+0000 7f4598d13640 1 --2- 172.21.15.170:0/1358865770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759aca70 0x559b759b6870 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f45840caad0 tx=0x7f4584099ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ea6bc234e91de3 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.632+0000 7f457cff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:01.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.632+0000 7f457cff9640 1 -- 172.21.15.170:0/1358865770 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45840a2130 con 0x559b759aca70 2024-01-25T15:03:01.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.632+0000 7f457cff9640 1 -- 172.21.15.170:0/1358865770 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f45840b2460 con 0x559b759aca70 2024-01-25T15:03:01.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.632+0000 7f459e415740 1 -- 172.21.15.170:0/1358865770 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b7590cf50 con 0x559b759aca70 2024-01-25T15:03:01.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.632+0000 7f457cff9640 1 -- 172.21.15.170:0/1358865770 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4584095b90 con 0x559b759aca70 2024-01-25T15:03:01.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.632+0000 7f459e415740 10 client.15834 fetch_fsmap learned FSMap version 26 2024-01-25T15:03:01.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.632+0000 7f459e415740 1 -- 172.21.15.170:0/1358865770 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559b759125e0 con 0x559b759aca70 2024-01-25T15:03:01.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.632+0000 7f457cff9640 1 -- 172.21.15.170:0/1358865770 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559b7590cf50 con 0x559b759aca70 2024-01-25T15:03:01.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.632+0000 7f457cff9640 1 -- 172.21.15.170:0/1358865770 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4584016020 con 0x559b759aca70 2024-01-25T15:03:01.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.632+0000 7f459e415740 10 client.15834 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:03:01.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.632+0000 7f459e415740 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:01.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.632+0000 7f459e415740 20 client.15834 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:01.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.632+0000 7f459e415740 1 --2- 172.21.15.170:0/1358865770 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559b759c1f70 0x559b759c4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.632+0000 7f459e415740 4 client.15834 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:01.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.633+0000 7f459e415740 1 -- 172.21.15.170:0/1358865770 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b7590cc70 con 0x559b759c1f70 2024-01-25T15:03:01.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.633+0000 7f4599514640 1 --2- 172.21.15.170:0/1358865770 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559b759c1f70 0x559b759c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.633+0000 7f457cff9640 10 client.15834 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:01.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.633+0000 7f4599514640 1 --2- 172.21.15.170:0/1358865770 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559b759c1f70 0x559b759c4360 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd00861ea6cc1525 server_cookie=52a93d7f7f6560be in_seq=0 out_seq=0 2024-01-25T15:03:01.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.634+0000 7f457cff9640 1 -- 172.21.15.170:0/1358865770 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559b7590cc70 con 0x559b759c1f70 2024-01-25T15:03:01.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.634+0000 7f457cff9640 10 client.15834 handle_command_reply: tid=0 2024-01-25T15:03:01.646 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.634+0000 7f459e415740 1 client.15834 shutdown 2024-01-25T15:03:01.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.634+0000 7f459e415740 1 -- 172.21.15.170:0/1358865770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759aca70 msgr2=0x559b759b6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.634+0000 7f459e415740 1 --2- 172.21.15.170:0/1358865770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759aca70 0x559b759b6870 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f45840caad0 tx=0x7f4584099ca0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.634+0000 7f459e415740 1 -- 172.21.15.170:0/1358865770 shutdown_connections 2024-01-25T15:03:01.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.634+0000 7f459e415740 1 --2- 172.21.15.170:0/1358865770 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559b759c1f70 0x559b759c4360 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.634+0000 7f459e415740 1 --2- 172.21.15.170:0/1358865770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759b1be0 0x559b759bd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.634+0000 7f457cff9640 0 client.15834 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:01.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.634+0000 7f459e415740 1 --2- 172.21.15.170:0/1358865770 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759aca70 0x559b759b6870 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.634+0000 7f459e415740 1 --2- 172.21.15.170:0/1358865770 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759ac080 0x559b759b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.634+0000 7f459e415740 1 -- 172.21.15.170:0/1358865770 >> 172.21.15.170:0/1358865770 conn(0x559b759a75f0 msgr2=0x559b759a6990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.635+0000 7f459e415740 1 -- 172.21.15.170:0/1358865770 shutdown_connections 2024-01-25T15:03:01.647 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.635+0000 7f459e415740 1 -- 172.21.15.170:0/1358865770 wait complete. 2024-01-25T15:03:01.648 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.635+0000 7f459e415740 20 client.15834 trim_cache size 0 max 16384 2024-01-25T15:03:01.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.664+0000 7f459e415740 1 Processor -- start 2024-01-25T15:03:01.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.664+0000 7f459e415740 1 -- start start 2024-01-25T15:03:01.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.664+0000 7f459e415740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759ac080 0x559b759b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.666 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.664+0000 7f459e415740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759aca70 0x559b759bd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.664+0000 7f459e415740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759b1be0 0x559b759b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.664+0000 7f459e415740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b75891e60 con 0x559b759b1be0 2024-01-25T15:03:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.664+0000 7f459e415740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b7590cc70 con 0x559b759aca70 2024-01-25T15:03:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.664+0000 7f459e415740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b7590cf50 con 0x559b759ac080 2024-01-25T15:03:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.664+0000 7f4599d15640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759b1be0 0x559b759b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.664+0000 7f4599d15640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759b1be0 0x559b759b52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54142/0 (socket says 172.21.15.170:54142) 2024-01-25T15:03:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.665+0000 7f4599d15640 1 -- 172.21.15.170:0/820719738 learned_addr learned my addr 172.21.15.170:0/820719738 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.665+0000 7f4599514640 1 --2- 172.21.15.170:0/820719738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759ac080 0x559b759b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.665+0000 7f4598d13640 1 --2- 172.21.15.170:0/820719738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759aca70 0x559b759bd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.665+0000 7f4599d15640 1 -- 172.21.15.170:0/820719738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759ac080 msgr2=0x559b759b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.665+0000 7f4599d15640 1 --2- 172.21.15.170:0/820719738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759ac080 0x559b759b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.665+0000 7f4599d15640 1 -- 172.21.15.170:0/820719738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759aca70 msgr2=0x559b759bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.667 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.665+0000 7f4599d15640 1 --2- 172.21.15.170:0/820719738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759aca70 0x559b759bd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.665+0000 7f4599d15640 1 -- 172.21.15.170:0/820719738 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b758aed80 con 0x559b759b1be0 2024-01-25T15:03:01.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.665+0000 7f4599d15640 1 --2- 172.21.15.170:0/820719738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759b1be0 0x559b759b52f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f458c009e40 tx=0x7f458c013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9813fccf3027aa05 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.665+0000 7f457effd640 1 -- 172.21.15.170:0/820719738 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c004d20 con 0x559b759b1be0 2024-01-25T15:03:01.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.665+0000 7f457effd640 1 -- 172.21.15.170:0/820719738 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f458c004e80 con 0x559b759b1be0 2024-01-25T15:03:01.668 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.665+0000 7f457effd640 1 -- 172.21.15.170:0/820719738 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c0054c0 con 0x559b759b1be0 2024-01-25T15:03:01.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.666+0000 7f459e415740 1 -- 172.21.15.170:0/820719738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759b1be0 msgr2=0x559b759b52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.666+0000 7f459e415740 1 --2- 172.21.15.170:0/820719738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759b1be0 0x559b759b52f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f458c009e40 tx=0x7f458c013830 comp rx=0 tx=0).stop 2024-01-25T15:03:01.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.666+0000 7f459e415740 1 -- 172.21.15.170:0/820719738 shutdown_connections 2024-01-25T15:03:01.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.666+0000 7f459e415740 1 --2- 172.21.15.170:0/820719738 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759aca70 0x559b759bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.666+0000 7f459e415740 1 --2- 172.21.15.170:0/820719738 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759b1be0 0x559b759b52f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.666+0000 7f459e415740 1 --2- 172.21.15.170:0/820719738 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759ac080 0x559b759b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.673 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.666+0000 7f459e415740 1 -- 172.21.15.170:0/820719738 >> 172.21.15.170:0/820719738 conn(0x559b759a75f0 msgr2=0x559b759ae040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.667+0000 7f459e415740 1 -- 172.21.15.170:0/820719738 shutdown_connections 2024-01-25T15:03:01.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.667+0000 7f459e415740 1 -- 172.21.15.170:0/820719738 wait complete. 2024-01-25T15:03:01.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.667+0000 7f459e415740 1 -- start start 2024-01-25T15:03:01.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.667+0000 7f459e415740 1 Processor -- start 2024-01-25T15:03:01.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.667+0000 7f459e415740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759ac080 0x559b759bc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.667+0000 7f459e415740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759aca70 0x559b759bc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f459e415740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759b1be0 0x559b759bcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f4599514640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759ac080 0x559b759bc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f4599514640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759ac080 0x559b759bc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54152/0 (socket says 172.21.15.170:54152) 2024-01-25T15:03:01.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f4599514640 1 -- 172.21.15.170:0/2711982706 learned_addr learned my addr 172.21.15.170:0/2711982706 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:01.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f459e415740 1 -- 172.21.15.170:0/2711982706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b75a18580 con 0x559b759ac080 2024-01-25T15:03:01.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f459e415740 1 -- 172.21.15.170:0/2711982706 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b75a186f0 con 0x559b759b1be0 2024-01-25T15:03:01.674 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f459e415740 1 -- 172.21.15.170:0/2711982706 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b75a188b0 con 0x559b759aca70 2024-01-25T15:03:01.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f459e415740 10 client.0 _ll_register_callbacks cb 0x7f45840960e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:01.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f4598d13640 1 --2- 172.21.15.170:0/2711982706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759aca70 0x559b759bc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f4599d15640 1 --2- 172.21.15.170:0/2711982706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759b1be0 0x559b759bcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f4599514640 1 -- 172.21.15.170:0/2711982706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759aca70 msgr2=0x559b759bc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f4599514640 1 --2- 172.21.15.170:0/2711982706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759aca70 0x559b759bc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f4599514640 1 -- 172.21.15.170:0/2711982706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759b1be0 msgr2=0x559b759bcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f4599514640 1 --2- 172.21.15.170:0/2711982706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759b1be0 0x559b759bcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f4599514640 1 -- 172.21.15.170:0/2711982706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458c009af0 con 0x559b759ac080 2024-01-25T15:03:01.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f4599d15640 1 --2- 172.21.15.170:0/2711982706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759b1be0 0x559b759bcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:01.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f4599514640 1 --2- 172.21.15.170:0/2711982706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759ac080 0x559b759bc2c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4590006010 tx=0x7f459002bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be5647ed2be64c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.668+0000 7f457cff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:01.675 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.669+0000 7f457cff9640 1 -- 172.21.15.170:0/2711982706 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4590055040 con 0x559b759ac080 2024-01-25T15:03:01.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.669+0000 7f457cff9640 1 -- 172.21.15.170:0/2711982706 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f4590047040 con 0x559b759ac080 2024-01-25T15:03:01.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.669+0000 7f459e415740 1 -- 172.21.15.170:0/2711982706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b75613860 con 0x559b759ac080 2024-01-25T15:03:01.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.669+0000 7f457cff9640 1 -- 172.21.15.170:0/2711982706 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45900043d0 con 0x559b759ac080 2024-01-25T15:03:01.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.669+0000 7f459e415740 10 client.15840 fetch_fsmap learned FSMap version 26 2024-01-25T15:03:01.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.669+0000 7f459e415740 1 -- 172.21.15.170:0/2711982706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559b758d4990 con 0x559b759ac080 2024-01-25T15:03:01.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.669+0000 7f457cff9640 1 -- 172.21.15.170:0/2711982706 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559b75613860 con 0x559b759ac080 2024-01-25T15:03:01.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.669+0000 7f457cff9640 1 -- 172.21.15.170:0/2711982706 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4590003a60 con 0x559b759ac080 2024-01-25T15:03:01.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.669+0000 7f459e415740 10 client.15840 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:03:01.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.669+0000 7f459e415740 10 client.15840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:01.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.669+0000 7f459e415740 20 client.15840 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:01.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.669+0000 7f459e415740 1 --2- 172.21.15.170:0/2711982706 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559b759c1f70 0x559b75a1c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.670+0000 7f459e415740 4 client.15840 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-01-25T15:03:01.676 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.670+0000 7f459e415740 1 -- 172.21.15.170:0/2711982706 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x559b75666eb0 con 0x559b759c1f70 2024-01-25T15:03:01.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.670+0000 7f4598d13640 1 --2- 172.21.15.170:0/2711982706 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559b759c1f70 0x559b75a1c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.670+0000 7f457cff9640 10 client.15840 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:01.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.670+0000 7f4598d13640 1 --2- 172.21.15.170:0/2711982706 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559b759c1f70 0x559b75a1c3e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d91cf5e09435abe server_cookie=9f54bffcecc0651c in_seq=0 out_seq=0 2024-01-25T15:03:01.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.671+0000 7f457cff9640 1 -- 172.21.15.170:0/2711982706 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559b75666eb0 con 0x559b759c1f70 2024-01-25T15:03:01.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.671+0000 7f457cff9640 10 client.15840 handle_command_reply: tid=0 2024-01-25T15:03:01.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.671+0000 7f459e415740 1 client.15840 shutdown 2024-01-25T15:03:01.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.671+0000 7f459e415740 1 -- 172.21.15.170:0/2711982706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759ac080 msgr2=0x559b759bc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.671+0000 7f459e415740 1 --2- 172.21.15.170:0/2711982706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759ac080 0x559b759bc2c0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4590006010 tx=0x7f459002bc30 comp rx=0 tx=0).stop 2024-01-25T15:03:01.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.672+0000 7f459e415740 1 -- 172.21.15.170:0/2711982706 shutdown_connections 2024-01-25T15:03:01.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.672+0000 7f459e415740 1 --2- 172.21.15.170:0/2711982706 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559b759c1f70 0x559b75a1c3e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.672+0000 7f459e415740 1 --2- 172.21.15.170:0/2711982706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559b759b1be0 0x559b759bcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.672+0000 7f457cff9640 0 client.15840 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:01.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.672+0000 7f459e415740 1 --2- 172.21.15.170:0/2711982706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559b759aca70 0x559b759bc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.672+0000 7f459e415740 1 --2- 172.21.15.170:0/2711982706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559b759ac080 0x559b759bc2c0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.677 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.672+0000 7f459e415740 1 -- 172.21.15.170:0/2711982706 >> 172.21.15.170:0/2711982706 conn(0x559b759a75f0 msgr2=0x559b759b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.672+0000 7f459e415740 1 -- 172.21.15.170:0/2711982706 shutdown_connections 2024-01-25T15:03:01.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.672+0000 7f459e415740 1 -- 172.21.15.170:0/2711982706 wait complete. 2024-01-25T15:03:01.678 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.672+0000 7f459e415740 20 client.15840 trim_cache size 0 max 16384 2024-01-25T15:03:01.678 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:03:01.678 INFO:teuthology.orchestra.run.smithi170.stdout: "return_code": 0, 2024-01-25T15:03:01.678 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_tag": "5fd9a81a-e44b-48d6-a6d6-89d14068bbfd", 2024-01-25T15:03:01.678 INFO:teuthology.orchestra.run.smithi170.stdout: "mode": "asynchronous" 2024-01-25T15:03:01.678 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:03:01.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.673+0000 7f459b778640 1 -- 172.21.15.170:0/2482396319 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f45800a12e0 msgr2=0x7f45800a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.673+0000 7f459b778640 1 --2- 172.21.15.170:0/2482396319 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f45800a12e0 0x7f45800a37a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4590005ab0 tx=0x7f459002c5d0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.673+0000 7f459b778640 1 -- 172.21.15.170:0/2482396319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45940fff20 msgr2=0x7f4594199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.673+0000 7f459b778640 1 --2- 172.21.15.170:0/2482396319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45940fff20 0x7f4594199380 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f458400c920 tx=0x7f458400cde0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.673+0000 7f459b778640 1 -- 172.21.15.170:0/2482396319 shutdown_connections 2024-01-25T15:03:01.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.673+0000 7f459b778640 1 --2- 172.21.15.170:0/2482396319 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f45800a12e0 0x7f45800a37a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.673+0000 7f459b778640 1 --2- 172.21.15.170:0/2482396319 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f45941008c0 0x7f45941a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.673+0000 7f459b778640 1 --2- 172.21.15.170:0/2482396319 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f45940fff20 0x7f4594199380 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.680 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.673+0000 7f459b778640 1 --2- 172.21.15.170:0/2482396319 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f45940ff5c0 0x7f4594198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.673+0000 7f459b778640 1 -- 172.21.15.170:0/2482396319 >> 172.21.15.170:0/2482396319 conn(0x7f45940fb180 msgr2=0x7f45940fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.673+0000 7f459b778640 1 -- 172.21.15.170:0/2482396319 shutdown_connections 2024-01-25T15:03:01.681 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.674+0000 7f459b778640 1 -- 172.21.15.170:0/2482396319 wait complete. 2024-01-25T15:03:01.691 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-25T15:03:01.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:01 smithi191 ceph-mon[36347]: pgmap v379: 97 pgs: 97 active+clean; 669 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 511 B/s wr, 10 op/s 2024-01-25T15:03:01.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.800+0000 7f685f39e640 1 -- 172.21.15.170:0/1723310030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6858101680 msgr2=0x7f6858107f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.800+0000 7f685f39e640 1 --2- 172.21.15.170:0/1723310030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6858101680 0x7f6858107f10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6850009ca0 tx=0x7f685002c0f0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.800+0000 7f685f39e640 1 -- 172.21.15.170:0/1723310030 shutdown_connections 2024-01-25T15:03:01.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.800+0000 7f685f39e640 1 --2- 172.21.15.170:0/1723310030 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6858101680 0x7f6858107f10 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.800+0000 7f685f39e640 1 --2- 172.21.15.170:0/1723310030 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6858100cc0 0x7f6858101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.800+0000 7f685f39e640 1 --2- 172.21.15.170:0/1723310030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68580ffad0 0x7f68580ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.800+0000 7f685f39e640 1 -- 172.21.15.170:0/1723310030 >> 172.21.15.170:0/1723310030 conn(0x7f68580fb060 msgr2=0x7f68580fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.801 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.800+0000 7f685f39e640 1 -- 172.21.15.170:0/1723310030 shutdown_connections 2024-01-25T15:03:01.802 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.800+0000 7f685f39e640 1 -- 172.21.15.170:0/1723310030 wait complete. 2024-01-25T15:03:01.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.801+0000 7f685f39e640 1 Processor -- start 2024-01-25T15:03:01.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.801+0000 7f685f39e640 1 -- start start 2024-01-25T15:03:01.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.801+0000 7f685f39e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68580ffad0 0x7f685819d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.803 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.801+0000 7f685f39e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6858100cc0 0x7f685819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.801+0000 7f685f39e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6858101680 0x7f68581a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.801+0000 7f685f39e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68581a4c70 con 0x7f68580ffad0 2024-01-25T15:03:01.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.801+0000 7f685f39e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68581a4de0 con 0x7f6858101680 2024-01-25T15:03:01.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.801+0000 7f685f39e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68581a4fa0 con 0x7f6858100cc0 2024-01-25T15:03:01.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.801+0000 7f685e39c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68580ffad0 0x7f685819d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.802+0000 7f685e39c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68580ffad0 0x7f685819d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54168/0 (socket says 172.21.15.170:54168) 2024-01-25T15:03:01.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.802+0000 7f685e39c640 1 -- 172.21.15.170:0/2514370767 learned_addr learned my addr 172.21.15.170:0/2514370767 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:01.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.802+0000 7f685db9b640 1 --2- 172.21.15.170:0/2514370767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6858100cc0 0x7f685819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.802+0000 7f685eb9d640 1 --2- 172.21.15.170:0/2514370767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6858101680 0x7f68581a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.802+0000 7f685e39c640 1 -- 172.21.15.170:0/2514370767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6858100cc0 msgr2=0x7f685819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.802+0000 7f685e39c640 1 --2- 172.21.15.170:0/2514370767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6858100cc0 0x7f685819d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.802+0000 7f685e39c640 1 -- 172.21.15.170:0/2514370767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6858101680 msgr2=0x7f68581a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.802+0000 7f685e39c640 1 --2- 172.21.15.170:0/2514370767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6858101680 0x7f68581a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.802+0000 7f685e39c640 1 -- 172.21.15.170:0/2514370767 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6850009900 con 0x7f68580ffad0 2024-01-25T15:03:01.804 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.802+0000 7f685e39c640 1 --2- 172.21.15.170:0/2514370767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68580ffad0 0x7f685819d180 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f685400e9c0 tx=0x7f685400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.802+0000 7f684f7fe640 1 -- 172.21.15.170:0/2514370767 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854009700 con 0x7f68580ffad0 2024-01-25T15:03:01.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.802+0000 7f684f7fe640 1 -- 172.21.15.170:0/2514370767 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68540044e0 con 0x7f68580ffad0 2024-01-25T15:03:01.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.802+0000 7f684f7fe640 1 -- 172.21.15.170:0/2514370767 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854010430 con 0x7f68580ffad0 2024-01-25T15:03:01.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.802+0000 7f685f39e640 1 -- 172.21.15.170:0/2514370767 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68581a5280 con 0x7f68580ffad0 2024-01-25T15:03:01.805 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.802+0000 7f685f39e640 1 -- 172.21.15.170:0/2514370767 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68581a5740 con 0x7f68580ffad0 2024-01-25T15:03:01.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.806+0000 7f68631be740 1 Processor -- start 2024-01-25T15:03:01.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.806+0000 7f684f7fe640 1 -- 172.21.15.170:0/2514370767 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f6854003f60 con 0x7f68580ffad0 2024-01-25T15:03:01.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.806+0000 7f68631be740 1 -- start start 2024-01-25T15:03:01.808 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.806+0000 7f68631be740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f704bf0 0x56257f705010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.806+0000 7f68631be740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f7055e0 0x56257f70a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.806+0000 7f68631be740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f70a750 0x56257f70cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.806+0000 7f68631be740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56257f6733b0 con 0x56257f7055e0 2024-01-25T15:03:01.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.806+0000 7f68631be740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56257f670aa0 con 0x56257f70a750 2024-01-25T15:03:01.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.806+0000 7f68631be740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56257f66c390 con 0x56257f704bf0 2024-01-25T15:03:01.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.807+0000 7f685db9b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f70a750 0x56257f70cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.807+0000 7f685e39c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f7055e0 0x56257f70a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.807+0000 7f685db9b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f70a750 0x56257f70cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:59524/0 (socket says 172.21.15.170:59524) 2024-01-25T15:03:01.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.807+0000 7f685db9b640 1 -- 172.21.15.170:0/3056909056 learned_addr learned my addr 172.21.15.170:0/3056909056 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:01.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.807+0000 7f685eb9d640 1 --2- 172.21.15.170:0/3056909056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f704bf0 0x56257f705010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.807+0000 7f684f7fe640 1 --2- 172.21.15.170:0/2514370767 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f68440a1360 0x7f68440a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.809 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.807+0000 7f685db9b640 1 -- 172.21.15.170:0/3056909056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f704bf0 msgr2=0x56257f705010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.807+0000 7f685db9b640 1 --2- 172.21.15.170:0/3056909056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f704bf0 0x56257f705010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.807+0000 7f685db9b640 1 -- 172.21.15.170:0/3056909056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f7055e0 msgr2=0x56257f70a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.807+0000 7f685db9b640 1 --2- 172.21.15.170:0/3056909056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f7055e0 0x56257f70a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.807+0000 7f685db9b640 1 -- 172.21.15.170:0/3056909056 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56257f62e810 con 0x56257f70a750 2024-01-25T15:03:01.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.807+0000 7f685eb9d640 1 --2- 172.21.15.170:0/3056909056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f704bf0 0x56257f705010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:03:01.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.807+0000 7f684f7fe640 1 -- 172.21.15.170:0/2514370767 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f6854014070 con 0x7f68580ffad0 2024-01-25T15:03:01.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.807+0000 7f685e39c640 1 --2- 172.21.15.170:0/3056909056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f7055e0 0x56257f70a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:01.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.808+0000 7f685eb9d640 1 --2- 172.21.15.170:0/2514370767 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f68440a1360 0x7f68440a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.808+0000 7f685db9b640 1 --2- 172.21.15.170:0/3056909056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f70a750 0x56257f70cbe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6848009ca0 tx=0x7f6848011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ad4be999f094a49 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.810 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.808+0000 7f684cbfe640 1 -- 172.21.15.170:0/3056909056 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848005220 con 0x56257f70a750 2024-01-25T15:03:01.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.808+0000 7f685eb9d640 1 --2- 172.21.15.170:0/2514370767 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f68440a1360 0x7f68440a3820 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f685002c630 tx=0x7f685002e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.808+0000 7f684cbfe640 1 -- 172.21.15.170:0/3056909056 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6848004c60 con 0x56257f70a750 2024-01-25T15:03:01.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.808+0000 7f684cbfe640 1 -- 172.21.15.170:0/3056909056 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68480197a0 con 0x56257f70a750 2024-01-25T15:03:01.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.809+0000 7f68631be740 1 -- 172.21.15.170:0/3056909056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f70a750 msgr2=0x56257f70cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.809+0000 7f68631be740 1 --2- 172.21.15.170:0/3056909056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f70a750 0x56257f70cbe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6848009ca0 tx=0x7f6848011810 comp rx=0 tx=0).stop 2024-01-25T15:03:01.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.809+0000 7f68631be740 1 -- 172.21.15.170:0/3056909056 shutdown_connections 2024-01-25T15:03:01.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.809+0000 7f68631be740 1 --2- 172.21.15.170:0/3056909056 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f70a750 0x56257f70cbe0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.809+0000 7f68631be740 1 --2- 172.21.15.170:0/3056909056 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f7055e0 0x56257f70a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.809+0000 7f68631be740 1 --2- 172.21.15.170:0/3056909056 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f704bf0 0x56257f705010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.815 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.809+0000 7f68631be740 1 -- 172.21.15.170:0/3056909056 >> 172.21.15.170:0/3056909056 conn(0x56257f700160 msgr2=0x56257f700560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.809+0000 7f68631be740 1 -- 172.21.15.170:0/3056909056 shutdown_connections 2024-01-25T15:03:01.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.809+0000 7f68631be740 1 -- 172.21.15.170:0/3056909056 wait complete. 2024-01-25T15:03:01.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.809+0000 7f68631be740 1 -- start start 2024-01-25T15:03:01.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.809+0000 7f68631be740 1 Processor -- start 2024-01-25T15:03:01.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f68631be740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f704bf0 0x56257f70ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f68631be740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f7055e0 0x56257f70f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f68631be740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f70a750 0x56257f7162d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f68631be740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56257f625780 con 0x56257f704bf0 2024-01-25T15:03:01.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f68631be740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56257f625420 con 0x56257f70a750 2024-01-25T15:03:01.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f68631be740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56257f5ea420 con 0x56257f7055e0 2024-01-25T15:03:01.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f68631be740 10 client.0 _ll_register_callbacks cb 0x56257f627b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:01.816 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f685e39c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f704bf0 0x56257f70ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f685e39c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f704bf0 0x56257f70ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54184/0 (socket says 172.21.15.170:54184) 2024-01-25T15:03:01.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f685e39c640 1 -- 172.21.15.170:0/1291325641 learned_addr learned my addr 172.21.15.170:0/1291325641 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:01.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f685eb9d640 1 --2- 172.21.15.170:0/1291325641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f70a750 0x56257f7162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f685db9b640 1 --2- 172.21.15.170:0/1291325641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f7055e0 0x56257f70f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f685e39c640 1 -- 172.21.15.170:0/1291325641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f7055e0 msgr2=0x56257f70f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f685e39c640 1 --2- 172.21.15.170:0/1291325641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f7055e0 0x56257f70f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f685e39c640 1 -- 172.21.15.170:0/1291325641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f70a750 msgr2=0x56257f7162d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f685e39c640 1 --2- 172.21.15.170:0/1291325641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f70a750 0x56257f7162d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.810+0000 7f685e39c640 1 -- 172.21.15.170:0/1291325641 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68480098d0 con 0x56257f704bf0 2024-01-25T15:03:01.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.811+0000 7f685e39c640 1 --2- 172.21.15.170:0/1291325641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f704bf0 0x56257f70ed50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f685400c6a0 tx=0x7f68540d0370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7da346e6deb10ee server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.811+0000 7f6841ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:01.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.811+0000 7f6841ffb640 1 -- 172.21.15.170:0/1291325641 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854099a30 con 0x56257f704bf0 2024-01-25T15:03:01.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.811+0000 7f68631be740 1 -- 172.21.15.170:0/1291325641 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56257f641240 con 0x56257f704bf0 2024-01-25T15:03:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.811+0000 7f6841ffb640 1 -- 172.21.15.170:0/1291325641 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f685400cd80 con 0x56257f704bf0 2024-01-25T15:03:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.811+0000 7f6841ffb640 1 -- 172.21.15.170:0/1291325641 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f685409a7d0 con 0x56257f704bf0 2024-01-25T15:03:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.811+0000 7f68631be740 10 client.15852 fetch_fsmap learned FSMap version 26 2024-01-25T15:03:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.811+0000 7f68631be740 1 -- 172.21.15.170:0/1291325641 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56257f66aa10 con 0x56257f704bf0 2024-01-25T15:03:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.812+0000 7f6841ffb640 1 -- 172.21.15.170:0/1291325641 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56257f641240 con 0x56257f704bf0 2024-01-25T15:03:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.812+0000 7f6841ffb640 1 -- 172.21.15.170:0/1291325641 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f68540afd20 con 0x56257f704bf0 2024-01-25T15:03:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.812+0000 7f68631be740 10 client.15852 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:03:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.812+0000 7f68631be740 10 client.15852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.812+0000 7f68631be740 20 client.15852 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.812+0000 7f68631be740 1 --2- 172.21.15.170:0/1291325641 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56257f71af60 0x56257f71d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.812+0000 7f68631be740 4 client.15852 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.812+0000 7f68631be740 1 -- 172.21.15.170:0/1291325641 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56257f63eb50 con 0x56257f71af60 2024-01-25T15:03:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.812+0000 7f685db9b640 1 --2- 172.21.15.170:0/1291325641 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56257f71af60 0x56257f71d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.813+0000 7f685db9b640 1 --2- 172.21.15.170:0/1291325641 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56257f71af60 0x56257f71d370 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=748c47fe7965cadc server_cookie=6896c8bce4507129 in_seq=0 out_seq=0 2024-01-25T15:03:01.818 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.813+0000 7f6841ffb640 10 client.15852 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.813+0000 7f6841ffb640 1 -- 172.21.15.170:0/1291325641 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56257f63eb50 con 0x56257f71af60 2024-01-25T15:03:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.813+0000 7f6841ffb640 10 client.15852 handle_command_reply: tid=0 2024-01-25T15:03:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.813+0000 7f68631be740 1 client.15852 shutdown 2024-01-25T15:03:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.814+0000 7f68631be740 1 -- 172.21.15.170:0/1291325641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f704bf0 msgr2=0x56257f70ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.814+0000 7f68631be740 1 --2- 172.21.15.170:0/1291325641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f704bf0 0x56257f70ed50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f685400c6a0 tx=0x7f68540d0370 comp rx=0 tx=0).stop 2024-01-25T15:03:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.814+0000 7f68631be740 1 -- 172.21.15.170:0/1291325641 shutdown_connections 2024-01-25T15:03:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.814+0000 7f68631be740 1 --2- 172.21.15.170:0/1291325641 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56257f71af60 0x56257f71d370 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.814+0000 7f68631be740 1 --2- 172.21.15.170:0/1291325641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f70a750 0x56257f7162d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.814+0000 7f68631be740 1 --2- 172.21.15.170:0/1291325641 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f7055e0 0x56257f70f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.814+0000 7f68631be740 1 --2- 172.21.15.170:0/1291325641 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f704bf0 0x56257f70ed50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.814+0000 7f68631be740 1 -- 172.21.15.170:0/1291325641 >> 172.21.15.170:0/1291325641 conn(0x56257f700160 msgr2=0x56257f6ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.814+0000 7f6841ffb640 0 client.15852 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:01.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.814+0000 7f68631be740 1 -- 172.21.15.170:0/1291325641 shutdown_connections 2024-01-25T15:03:01.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.814+0000 7f68631be740 1 -- 172.21.15.170:0/1291325641 wait complete. 2024-01-25T15:03:01.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.814+0000 7f68631be740 20 client.15852 trim_cache size 0 max 16384 2024-01-25T15:03:01.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.843+0000 7f68631be740 1 Processor -- start 2024-01-25T15:03:01.844 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.843+0000 7f68631be740 1 -- start start 2024-01-25T15:03:01.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f68631be740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f704bf0 0x56257f705cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f68631be740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f7055e0 0x56257f706210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f68631be740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f70a750 0x56257f716290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f68631be740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56257f641240 con 0x56257f704bf0 2024-01-25T15:03:01.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f68631be740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56257f6fffd0 con 0x56257f7055e0 2024-01-25T15:03:01.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f68631be740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56257f70a4e0 con 0x56257f70a750 2024-01-25T15:03:01.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f685e39c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f704bf0 0x56257f705cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f685db9b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f7055e0 0x56257f706210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f685e39c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f704bf0 0x56257f705cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54190/0 (socket says 172.21.15.170:54190) 2024-01-25T15:03:01.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f685e39c640 1 -- 172.21.15.170:0/1106602982 learned_addr learned my addr 172.21.15.170:0/1106602982 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:01.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f685eb9d640 1 --2- 172.21.15.170:0/1106602982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f70a750 0x56257f716290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f685db9b640 1 -- 172.21.15.170:0/1106602982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f70a750 msgr2=0x56257f716290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f685db9b640 1 --2- 172.21.15.170:0/1106602982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f70a750 0x56257f716290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f685db9b640 1 -- 172.21.15.170:0/1106602982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f704bf0 msgr2=0x56257f705cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f685db9b640 1 --2- 172.21.15.170:0/1106602982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f704bf0 0x56257f705cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f685db9b640 1 -- 172.21.15.170:0/1106602982 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56257f607520 con 0x56257f7055e0 2024-01-25T15:03:01.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.844+0000 7f685db9b640 1 --2- 172.21.15.170:0/1106602982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f7055e0 0x56257f706210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6848011d10 tx=0x7f6848009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2874084f91cbc246 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.845+0000 7f6843fff640 1 -- 172.21.15.170:0/1106602982 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848029070 con 0x56257f7055e0 2024-01-25T15:03:01.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.845+0000 7f6843fff640 1 -- 172.21.15.170:0/1106602982 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6848019640 con 0x56257f7055e0 2024-01-25T15:03:01.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.845+0000 7f6843fff640 1 -- 172.21.15.170:0/1106602982 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848005040 con 0x56257f7055e0 2024-01-25T15:03:01.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.845+0000 7f68631be740 1 -- 172.21.15.170:0/1106602982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f7055e0 msgr2=0x56257f706210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.845+0000 7f68631be740 1 --2- 172.21.15.170:0/1106602982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f7055e0 0x56257f706210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6848011d10 tx=0x7f6848009310 comp rx=0 tx=0).stop 2024-01-25T15:03:01.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.845+0000 7f68631be740 1 -- 172.21.15.170:0/1106602982 shutdown_connections 2024-01-25T15:03:01.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.845+0000 7f68631be740 1 --2- 172.21.15.170:0/1106602982 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f7055e0 0x56257f706210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.845+0000 7f68631be740 1 --2- 172.21.15.170:0/1106602982 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f70a750 0x56257f716290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.845+0000 7f68631be740 1 --2- 172.21.15.170:0/1106602982 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f704bf0 0x56257f705cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.845+0000 7f68631be740 1 -- 172.21.15.170:0/1106602982 >> 172.21.15.170:0/1106602982 conn(0x56257f700160 msgr2=0x56257f721d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f68631be740 1 -- 172.21.15.170:0/1106602982 shutdown_connections 2024-01-25T15:03:01.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f68631be740 1 -- 172.21.15.170:0/1106602982 wait complete. 2024-01-25T15:03:01.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f68631be740 1 -- start start 2024-01-25T15:03:01.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f68631be740 1 Processor -- start 2024-01-25T15:03:01.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f68631be740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f704bf0 0x56257f714070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f68631be740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f7055e0 0x56257f7145b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f68631be740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f70a750 0x56257f7155c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f68631be740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56257f715b00 con 0x56257f70a750 2024-01-25T15:03:01.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f68631be740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56257f715c70 con 0x56257f7055e0 2024-01-25T15:03:01.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f68631be740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56257f715e30 con 0x56257f704bf0 2024-01-25T15:03:01.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f685db9b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f7055e0 0x56257f7145b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f685db9b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f7055e0 0x56257f7145b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:59542/0 (socket says 172.21.15.170:59542) 2024-01-25T15:03:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f685db9b640 1 -- 172.21.15.170:0/429585505 learned_addr learned my addr 172.21.15.170:0/429585505 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f685eb9d640 1 --2- 172.21.15.170:0/429585505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f70a750 0x56257f7155c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f68631be740 10 client.0 _ll_register_callbacks cb 0x7f6854003880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.846+0000 7f685e39c640 1 --2- 172.21.15.170:0/429585505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f704bf0 0x56257f714070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.847+0000 7f685db9b640 1 -- 172.21.15.170:0/429585505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f704bf0 msgr2=0x56257f714070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.847+0000 7f685db9b640 1 --2- 172.21.15.170:0/429585505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f704bf0 0x56257f714070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.847+0000 7f685db9b640 1 -- 172.21.15.170:0/429585505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f70a750 msgr2=0x56257f7155c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.847+0000 7f685db9b640 1 --2- 172.21.15.170:0/429585505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f70a750 0x56257f7155c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.847+0000 7f685db9b640 1 -- 172.21.15.170:0/429585505 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56257f62e810 con 0x56257f7055e0 2024-01-25T15:03:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.847+0000 7f685e39c640 1 --2- 172.21.15.170:0/429585505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f704bf0 0x56257f714070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:03:01.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.847+0000 7f685eb9d640 1 --2- 172.21.15.170:0/429585505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f70a750 0x56257f7155c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.847+0000 7f685db9b640 1 --2- 172.21.15.170:0/429585505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f7055e0 0x56257f7145b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6848005e00 tx=0x7f684802be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32799849501458d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.847+0000 7f6841ffb640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-01-25T15:03:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.847+0000 7f6841ffb640 1 -- 172.21.15.170:0/429585505 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848029040 con 0x56257f7055e0 2024-01-25T15:03:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.847+0000 7f6841ffb640 1 -- 172.21.15.170:0/429585505 <== mon.2 v2:172.21.15.186:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f68480050c0 con 0x56257f7055e0 2024-01-25T15:03:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.847+0000 7f68631be740 1 -- 172.21.15.170:0/429585505 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56257f71d740 con 0x56257f7055e0 2024-01-25T15:03:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.847+0000 7f6841ffb640 1 -- 172.21.15.170:0/429585505 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6848005280 con 0x56257f7055e0 2024-01-25T15:03:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.847+0000 7f68631be740 10 client.25193 fetch_fsmap learned FSMap version 26 2024-01-25T15:03:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.847+0000 7f68631be740 1 -- 172.21.15.170:0/429585505 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56257f62d070 con 0x56257f7055e0 2024-01-25T15:03:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.848+0000 7f6841ffb640 1 -- 172.21.15.170:0/429585505 <== mon.2 v2:172.21.15.186:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f684802b790 con 0x56257f7055e0 2024-01-25T15:03:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.848+0000 7f6841ffb640 1 -- 172.21.15.170:0/429585505 <== mon.2 v2:172.21.15.186:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6848021040 con 0x56257f7055e0 2024-01-25T15:03:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.848+0000 7f68631be740 10 client.25193 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:03:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.848+0000 7f68631be740 10 client.25193 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.848+0000 7f68631be740 20 client.25193 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.848+0000 7f68631be740 1 --2- 172.21.15.170:0/429585505 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56257f7721e0 0x56257f774600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.853 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.848+0000 7f68631be740 4 client.25193 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-25T15:03:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.848+0000 7f68631be740 1 -- 172.21.15.170:0/429585505 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56257f71d740 con 0x56257f7721e0 2024-01-25T15:03:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.848+0000 7f685e39c640 1 --2- 172.21.15.170:0/429585505 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56257f7721e0 0x56257f774600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f6841ffb640 10 client.25193 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f685e39c640 1 --2- 172.21.15.170:0/429585505 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56257f7721e0 0x56257f774600 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f655d14c1eec32c8 server_cookie=903cb693c2fce247 in_seq=0 out_seq=0 2024-01-25T15:03:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f6841ffb640 1 -- 172.21.15.170:0/429585505 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56257f71d740 con 0x56257f7721e0 2024-01-25T15:03:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f6841ffb640 10 client.25193 handle_command_reply: tid=0 2024-01-25T15:03:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f68631be740 1 client.25193 shutdown 2024-01-25T15:03:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f68631be740 1 -- 172.21.15.170:0/429585505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f7055e0 msgr2=0x56257f7145b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f68631be740 1 --2- 172.21.15.170:0/429585505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f7055e0 0x56257f7145b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6848005e00 tx=0x7f684802be90 comp rx=0 tx=0).stop 2024-01-25T15:03:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f68631be740 1 -- 172.21.15.170:0/429585505 shutdown_connections 2024-01-25T15:03:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f68631be740 1 --2- 172.21.15.170:0/429585505 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56257f7721e0 0x56257f774600 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f68631be740 1 --2- 172.21.15.170:0/429585505 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56257f7055e0 0x56257f7145b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f6841ffb640 0 client.25193 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f68631be740 1 --2- 172.21.15.170:0/429585505 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56257f70a750 0x56257f7155c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.854 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f68631be740 1 --2- 172.21.15.170:0/429585505 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56257f704bf0 0x56257f714070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f68631be740 1 -- 172.21.15.170:0/429585505 >> 172.21.15.170:0/429585505 conn(0x56257f700160 msgr2=0x56257f705cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f68631be740 1 -- 172.21.15.170:0/429585505 shutdown_connections 2024-01-25T15:03:01.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f68631be740 1 -- 172.21.15.170:0/429585505 wait complete. 2024-01-25T15:03:01.855 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.849+0000 7f68631be740 20 client.25193 trim_cache size 0 max 16384 2024-01-25T15:03:01.855 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:03:01.855 INFO:teuthology.orchestra.run.smithi170.stdout: "status": "IDLE (waiting for more scrubs)", 2024-01-25T15:03:01.855 INFO:teuthology.orchestra.run.smithi170.stdout: "scrubs": { 2024-01-25T15:03:01.855 INFO:teuthology.orchestra.run.smithi170.stdout: "5fd9a81a-e44b-48d6-a6d6-89d14068bbfd": { 2024-01-25T15:03:01.855 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/", 2024-01-25T15:03:01.855 INFO:teuthology.orchestra.run.smithi170.stdout: "tag": "5fd9a81a-e44b-48d6-a6d6-89d14068bbfd", 2024-01-25T15:03:01.855 INFO:teuthology.orchestra.run.smithi170.stdout: "options": "recursive,force" 2024-01-25T15:03:01.856 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:03:01.856 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:03:01.856 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:03:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.850+0000 7f685f39e640 1 -- 172.21.15.170:0/2514370767 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f68440a1360 msgr2=0x7f68440a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.850+0000 7f685f39e640 1 --2- 172.21.15.170:0/2514370767 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f68440a1360 0x7f68440a3820 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f685002c630 tx=0x7f685002e040 comp rx=0 tx=0).stop 2024-01-25T15:03:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.850+0000 7f685f39e640 1 -- 172.21.15.170:0/2514370767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68580ffad0 msgr2=0x7f685819d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.850+0000 7f685f39e640 1 --2- 172.21.15.170:0/2514370767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68580ffad0 0x7f685819d180 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f685400e9c0 tx=0x7f685400ee80 comp rx=0 tx=0).stop 2024-01-25T15:03:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.850+0000 7f685f39e640 1 -- 172.21.15.170:0/2514370767 shutdown_connections 2024-01-25T15:03:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.850+0000 7f685f39e640 1 --2- 172.21.15.170:0/2514370767 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f68440a1360 0x7f68440a3820 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.850+0000 7f685f39e640 1 --2- 172.21.15.170:0/2514370767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6858101680 0x7f68581a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.850+0000 7f685f39e640 1 --2- 172.21.15.170:0/2514370767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6858100cc0 0x7f685819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.850+0000 7f685f39e640 1 --2- 172.21.15.170:0/2514370767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68580ffad0 0x7f685819d180 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.850+0000 7f685f39e640 1 -- 172.21.15.170:0/2514370767 >> 172.21.15.170:0/2514370767 conn(0x7f68580fb060 msgr2=0x7f685810ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.850+0000 7f685f39e640 1 -- 172.21.15.170:0/2514370767 shutdown_connections 2024-01-25T15:03:01.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:01.850+0000 7f685f39e640 1 -- 172.21.15.170:0/2514370767 wait complete. 2024-01-25T15:03:01.862 INFO:tasks.cephfs.filesystem:scrub status for tag:5fd9a81a-e44b-48d6-a6d6-89d14068bbfd - {'path': '/', 'tag': '5fd9a81a-e44b-48d6-a6d6-89d14068bbfd', 'options': 'recursive,force'} 2024-01-25T15:03:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.872+0000 7fc46c490640 1 -- 172.21.15.170:0/482754899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4640ffc30 msgr2=0x7fc464100050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.872+0000 7fc46c490640 1 --2- 172.21.15.170:0/482754899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4640ffc30 0x7fc464100050 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc460009900 tx=0x7fc46002bc30 comp rx=0 tx=0).stop 2024-01-25T15:03:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.872+0000 7fc46c490640 1 -- 172.21.15.170:0/482754899 shutdown_connections 2024-01-25T15:03:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.872+0000 7fc46c490640 1 --2- 172.21.15.170:0/482754899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4641017e0 0x7fc464108070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.872+0000 7fc46c490640 1 --2- 172.21.15.170:0/482754899 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc464100e20 0x7fc4641012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.872+0000 7fc46c490640 1 --2- 172.21.15.170:0/482754899 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4640ffc30 0x7fc464100050 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.872+0000 7fc46c490640 1 -- 172.21.15.170:0/482754899 >> 172.21.15.170:0/482754899 conn(0x7fc4640fb180 msgr2=0x7fc4640fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.872+0000 7fc46c490640 1 -- 172.21.15.170:0/482754899 shutdown_connections 2024-01-25T15:03:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.872+0000 7fc46c490640 1 -- 172.21.15.170:0/482754899 wait complete. 2024-01-25T15:03:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.873+0000 7fc46c490640 1 Processor -- start 2024-01-25T15:03:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.873+0000 7fc46c490640 1 -- start start 2024-01-25T15:03:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.873+0000 7fc46c490640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4640ffc30 0x7fc464069a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.873+0000 7fc46c490640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc464100e20 0x7fc46419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.873+0000 7fc46c490640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4641017e0 0x7fc46419e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.873+0000 7fc46c490640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46419e7a0 con 0x7fc4641017e0 2024-01-25T15:03:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.873+0000 7fc46c490640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46419e910 con 0x7fc4640ffc30 2024-01-25T15:03:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.873+0000 7fc46c490640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46419ead0 con 0x7fc464100e20 2024-01-25T15:03:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.873+0000 7fc46aa2d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4641017e0 0x7fc46419e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc46aa2d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4641017e0 0x7fc46419e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54208/0 (socket says 172.21.15.170:54208) 2024-01-25T15:03:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc46aa2d640 1 -- 172.21.15.170:0/3052972746 learned_addr learned my addr 172.21.15.170:0/3052972746 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc469a2b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc464100e20 0x7fc46419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc46a22c640 1 --2- 172.21.15.170:0/3052972746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4640ffc30 0x7fc464069a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc46aa2d640 1 -- 172.21.15.170:0/3052972746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc464100e20 msgr2=0x7fc46419ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc46aa2d640 1 --2- 172.21.15.170:0/3052972746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc464100e20 0x7fc46419ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc46aa2d640 1 -- 172.21.15.170:0/3052972746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4640ffc30 msgr2=0x7fc464069a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc46aa2d640 1 --2- 172.21.15.170:0/3052972746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4640ffc30 0x7fc464069a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc46aa2d640 1 -- 172.21.15.170:0/3052972746 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c009840 con 0x7fc4641017e0 2024-01-25T15:03:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc469a2b640 1 --2- 172.21.15.170:0/3052972746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc464100e20 0x7fc46419ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc46aa2d640 1 --2- 172.21.15.170:0/3052972746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4641017e0 0x7fc46419e010 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00efd0 tx=0x7fc45c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc45b7fe640 1 -- 172.21.15.170:0/3052972746 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c009b40 con 0x7fc4641017e0 2024-01-25T15:03:01.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc46c490640 1 -- 172.21.15.170:0/3052972746 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc460009560 con 0x7fc4641017e0 2024-01-25T15:03:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc45b7fe640 1 -- 172.21.15.170:0/3052972746 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc45c003b70 con 0x7fc4641017e0 2024-01-25T15:03:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc45b7fe640 1 -- 172.21.15.170:0/3052972746 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c010850 con 0x7fc4641017e0 2024-01-25T15:03:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.874+0000 7fc46c490640 1 -- 172.21.15.170:0/3052972746 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46419f0e0 con 0x7fc4641017e0 2024-01-25T15:03:01.878 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.877+0000 7fc45b7fe640 1 -- 172.21.15.170:0/3052972746 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fc45c010a50 con 0x7fc4641017e0 2024-01-25T15:03:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.878+0000 7fc46f04e740 1 Processor -- start 2024-01-25T15:03:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.878+0000 7fc46f04e740 1 -- start start 2024-01-25T15:03:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.878+0000 7fc46f04e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55914373b2a0 0x55914373b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.879 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.878+0000 7fc46f04e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55914373bc90 0x559143740790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.880 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.878+0000 7fc46f04e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559143740e00 0x559143743290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.878+0000 7fc46f04e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591436ab070 con 0x55914373b2a0 2024-01-25T15:03:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.878+0000 7fc46f04e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591436a8760 con 0x55914373bc90 2024-01-25T15:03:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.878+0000 7fc46f04e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591436a4050 con 0x559143740e00 2024-01-25T15:03:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.878+0000 7fc469a2b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55914373b2a0 0x55914373b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.878+0000 7fc469a2b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55914373b2a0 0x55914373b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54212/0 (socket says 172.21.15.170:54212) 2024-01-25T15:03:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.878+0000 7fc469a2b640 1 -- 172.21.15.170:0/644467657 learned_addr learned my addr 172.21.15.170:0/644467657 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.878+0000 7fc46a22c640 1 --2- 172.21.15.170:0/644467657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55914373bc90 0x559143740790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.879+0000 7fc469a2b640 1 --2- 172.21.15.170:0/644467657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559143740e00 0x559143743290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.879+0000 7fc45b7fe640 1 --2- 172.21.15.170:0/3052972746 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc4500a1380 0x7fc4500a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.879+0000 7fc469a2b640 1 -- 172.21.15.170:0/644467657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559143740e00 msgr2=0x559143743290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.879+0000 7fc469a2b640 1 --2- 172.21.15.170:0/644467657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559143740e00 0x559143743290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.879+0000 7fc469a2b640 1 -- 172.21.15.170:0/644467657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55914373bc90 msgr2=0x559143740790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.879+0000 7fc469a2b640 1 --2- 172.21.15.170:0/644467657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55914373bc90 0x559143740790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.879+0000 7fc469a2b640 1 -- 172.21.15.170:0/644467657 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55914369be70 con 0x55914373b2a0 2024-01-25T15:03:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.879+0000 7fc46aa2d640 1 --2- 172.21.15.170:0/3052972746 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc4500a1380 0x7fc4500a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.879+0000 7fc45b7fe640 1 -- 172.21.15.170:0/3052972746 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fc45c014070 con 0x7fc4641017e0 2024-01-25T15:03:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.879+0000 7fc469a2b640 1 --2- 172.21.15.170:0/644467657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55914373b2a0 0x55914373b6c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc45400e4f0 tx=0x7fc454017c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd3f780e2eee943 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.880+0000 7fc46aa2d640 1 --2- 172.21.15.170:0/3052972746 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc4500a1380 0x7fc4500a3840 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0a1cf0 tx=0x7fc45c065490 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.880+0000 7fc458bfe640 1 -- 172.21.15.170:0/644467657 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454004230 con 0x55914373b2a0 2024-01-25T15:03:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.880+0000 7fc458bfe640 1 -- 172.21.15.170:0/644467657 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc454004390 con 0x55914373b2a0 2024-01-25T15:03:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.880+0000 7fc458bfe640 1 -- 172.21.15.170:0/644467657 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45400d800 con 0x55914373b2a0 2024-01-25T15:03:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.880+0000 7fc46f04e740 1 -- 172.21.15.170:0/644467657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55914373b2a0 msgr2=0x55914373b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.880+0000 7fc46f04e740 1 --2- 172.21.15.170:0/644467657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55914373b2a0 0x55914373b6c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc45400e4f0 tx=0x7fc454017c80 comp rx=0 tx=0).stop 2024-01-25T15:03:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.880+0000 7fc46f04e740 1 -- 172.21.15.170:0/644467657 shutdown_connections 2024-01-25T15:03:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.880+0000 7fc46f04e740 1 --2- 172.21.15.170:0/644467657 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55914373bc90 0x559143740790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.880+0000 7fc46f04e740 1 --2- 172.21.15.170:0/644467657 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559143740e00 0x559143743290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.880+0000 7fc46f04e740 1 --2- 172.21.15.170:0/644467657 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55914373b2a0 0x55914373b6c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.880+0000 7fc46f04e740 1 -- 172.21.15.170:0/644467657 >> 172.21.15.170:0/644467657 conn(0x559143736810 msgr2=0x559143736c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.881+0000 7fc46f04e740 1 -- 172.21.15.170:0/644467657 shutdown_connections 2024-01-25T15:03:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.881+0000 7fc46f04e740 1 -- 172.21.15.170:0/644467657 wait complete. 2024-01-25T15:03:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.881+0000 7fc46f04e740 1 -- start start 2024-01-25T15:03:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.881+0000 7fc46f04e740 1 Processor -- start 2024-01-25T15:03:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.881+0000 7fc46f04e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55914373b2a0 0x55914373dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.881+0000 7fc46f04e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55914373bc90 0x55914373e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.881+0000 7fc46f04e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559143740e00 0x55914373f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.881+0000 7fc46f04e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55914365d1e0 con 0x559143740e00 2024-01-25T15:03:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.881+0000 7fc46f04e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55914365ce80 con 0x55914373bc90 2024-01-25T15:03:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.881+0000 7fc46f04e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591436220c0 con 0x55914373b2a0 2024-01-25T15:03:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.881+0000 7fc46f04e740 10 client.0 _ll_register_callbacks cb 0x559143647ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.881+0000 7fc469a2b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559143740e00 0x55914373f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.881+0000 7fc469a2b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559143740e00 0x55914373f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54216/0 (socket says 172.21.15.170:54216) 2024-01-25T15:03:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.881+0000 7fc469a2b640 1 -- 172.21.15.170:0/2200698334 learned_addr learned my addr 172.21.15.170:0/2200698334 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.881+0000 7fc469a2b640 1 --2- 172.21.15.170:0/2200698334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55914373b2a0 0x55914373dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.882+0000 7fc46a22c640 1 --2- 172.21.15.170:0/2200698334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55914373bc90 0x55914373e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.882+0000 7fc469a2b640 1 -- 172.21.15.170:0/2200698334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55914373b2a0 msgr2=0x55914373dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.882+0000 7fc469a2b640 1 --2- 172.21.15.170:0/2200698334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55914373b2a0 0x55914373dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.882+0000 7fc469a2b640 1 -- 172.21.15.170:0/2200698334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55914373bc90 msgr2=0x55914373e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.882+0000 7fc469a2b640 1 --2- 172.21.15.170:0/2200698334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55914373bc90 0x55914373e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.882+0000 7fc469a2b640 1 -- 172.21.15.170:0/2200698334 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc454009d70 con 0x559143740e00 2024-01-25T15:03:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.882+0000 7fc469a2b640 1 --2- 172.21.15.170:0/2200698334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559143740e00 0x55914373f500 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc45401a040 tx=0x7fc454009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3854768c0114a58c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.882+0000 7fc44dffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.882+0000 7fc44dffb640 1 -- 172.21.15.170:0/2200698334 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4540037f0 con 0x559143740e00 2024-01-25T15:03:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.882+0000 7fc44dffb640 1 -- 172.21.15.170:0/2200698334 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fc454005710 con 0x559143740e00 2024-01-25T15:03:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.882+0000 7fc46f04e740 1 -- 172.21.15.170:0/2200698334 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55914369d040 con 0x559143740e00 2024-01-25T15:03:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.882+0000 7fc44dffb640 1 -- 172.21.15.170:0/2200698334 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc454003950 con 0x559143740e00 2024-01-25T15:03:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.882+0000 7fc46f04e740 10 client.15870 fetch_fsmap learned FSMap version 26 2024-01-25T15:03:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.882+0000 7fc46f04e740 1 -- 172.21.15.170:0/2200698334 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5591436a26d0 con 0x559143740e00 2024-01-25T15:03:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.883+0000 7fc44dffb640 1 -- 172.21.15.170:0/2200698334 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55914369d040 con 0x559143740e00 2024-01-25T15:03:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.883+0000 7fc44dffb640 1 -- 172.21.15.170:0/2200698334 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc454026430 con 0x559143740e00 2024-01-25T15:03:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.883+0000 7fc46f04e740 10 client.15870 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:03:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.883+0000 7fc46f04e740 10 client.15870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.883+0000 7fc46f04e740 20 client.15870 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.883+0000 7fc46f04e740 1 --2- 172.21.15.170:0/2200698334 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559143750ee0 0x5591437532d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.883+0000 7fc46f04e740 4 client.15870 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.883+0000 7fc46f04e740 1 -- 172.21.15.170:0/2200698334 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55914369cd60 con 0x559143750ee0 2024-01-25T15:03:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.884+0000 7fc46a22c640 1 --2- 172.21.15.170:0/2200698334 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559143750ee0 0x5591437532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.884+0000 7fc44dffb640 10 client.15870 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.884+0000 7fc46a22c640 1 --2- 172.21.15.170:0/2200698334 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559143750ee0 0x5591437532d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4ad0c3e274d009f server_cookie=e332cc702b50238f in_seq=0 out_seq=0 2024-01-25T15:03:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.884+0000 7fc44dffb640 1 -- 172.21.15.170:0/2200698334 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55914369cd60 con 0x559143750ee0 2024-01-25T15:03:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.884+0000 7fc44dffb640 10 client.15870 handle_command_reply: tid=0 2024-01-25T15:03:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.884+0000 7fc46f04e740 1 client.15870 shutdown 2024-01-25T15:03:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.885+0000 7fc46f04e740 1 -- 172.21.15.170:0/2200698334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559143740e00 msgr2=0x55914373f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.885+0000 7fc46f04e740 1 --2- 172.21.15.170:0/2200698334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559143740e00 0x55914373f500 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc45401a040 tx=0x7fc454009260 comp rx=0 tx=0).stop 2024-01-25T15:03:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.885+0000 7fc46f04e740 1 -- 172.21.15.170:0/2200698334 shutdown_connections 2024-01-25T15:03:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.885+0000 7fc46f04e740 1 --2- 172.21.15.170:0/2200698334 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559143750ee0 0x5591437532d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.885+0000 7fc44dffb640 0 client.15870 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.885+0000 7fc46f04e740 1 --2- 172.21.15.170:0/2200698334 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55914373bc90 0x55914373e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.885+0000 7fc46f04e740 1 --2- 172.21.15.170:0/2200698334 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559143740e00 0x55914373f500 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.885+0000 7fc46f04e740 1 --2- 172.21.15.170:0/2200698334 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55914373b2a0 0x55914373dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.885+0000 7fc46f04e740 1 -- 172.21.15.170:0/2200698334 >> 172.21.15.170:0/2200698334 conn(0x559143736810 msgr2=0x559143735a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.885+0000 7fc46f04e740 1 -- 172.21.15.170:0/2200698334 shutdown_connections 2024-01-25T15:03:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.885+0000 7fc46f04e740 1 -- 172.21.15.170:0/2200698334 wait complete. 2024-01-25T15:03:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.885+0000 7fc46f04e740 20 client.15870 trim_cache size 0 max 16384 2024-01-25T15:03:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.898+0000 7fc46f04e740 1 Processor -- start 2024-01-25T15:03:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.898+0000 7fc46f04e740 1 -- start start 2024-01-25T15:03:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.898+0000 7fc46f04e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55914373b2a0 0x55914373c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.898+0000 7fc46f04e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55914373bc90 0x55914373cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.898+0000 7fc46f04e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559143740e00 0x5591437578d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.901 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.898+0000 7fc46f04e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591437320e0 con 0x559143740e00 2024-01-25T15:03:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.898+0000 7fc46f04e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55914373ba90 con 0x55914373bc90 2024-01-25T15:03:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.898+0000 7fc46f04e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55914373b680 con 0x55914373b2a0 2024-01-25T15:03:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.898+0000 7fc469a2b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559143740e00 0x5591437578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.898+0000 7fc469a2b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559143740e00 0x5591437578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54218/0 (socket says 172.21.15.170:54218) 2024-01-25T15:03:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.898+0000 7fc469a2b640 1 -- 172.21.15.170:0/916772782 learned_addr learned my addr 172.21.15.170:0/916772782 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.898+0000 7fc46a22c640 1 --2- 172.21.15.170:0/916772782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55914373bc90 0x55914373cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.898+0000 7fc469a2b640 1 --2- 172.21.15.170:0/916772782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55914373b2a0 0x55914373c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.899+0000 7fc469a2b640 1 -- 172.21.15.170:0/916772782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55914373b2a0 msgr2=0x55914373c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.899+0000 7fc469a2b640 1 --2- 172.21.15.170:0/916772782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55914373b2a0 0x55914373c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.899+0000 7fc469a2b640 1 -- 172.21.15.170:0/916772782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55914373bc90 msgr2=0x55914373cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.899+0000 7fc469a2b640 1 --2- 172.21.15.170:0/916772782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55914373bc90 0x55914373cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.899+0000 7fc469a2b640 1 -- 172.21.15.170:0/916772782 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55914363f060 con 0x559143740e00 2024-01-25T15:03:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.899+0000 7fc469a2b640 1 --2- 172.21.15.170:0/916772782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559143740e00 0x5591437578d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc454026c70 tx=0x7fc454005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c57200d6696dd2f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.902 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.899+0000 7fc44ffff640 1 -- 172.21.15.170:0/916772782 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454048070 con 0x559143740e00 2024-01-25T15:03:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.899+0000 7fc44ffff640 1 -- 172.21.15.170:0/916772782 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc454005cd0 con 0x559143740e00 2024-01-25T15:03:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.899+0000 7fc44ffff640 1 -- 172.21.15.170:0/916772782 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454003d10 con 0x559143740e00 2024-01-25T15:03:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.900+0000 7fc46f04e740 1 -- 172.21.15.170:0/916772782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559143740e00 msgr2=0x5591437578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.900+0000 7fc46f04e740 1 --2- 172.21.15.170:0/916772782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559143740e00 0x5591437578d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fc454026c70 tx=0x7fc454005660 comp rx=0 tx=0).stop 2024-01-25T15:03:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.900+0000 7fc46f04e740 1 -- 172.21.15.170:0/916772782 shutdown_connections 2024-01-25T15:03:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.900+0000 7fc46f04e740 1 --2- 172.21.15.170:0/916772782 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55914373bc90 0x55914373cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.900+0000 7fc46f04e740 1 --2- 172.21.15.170:0/916772782 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559143740e00 0x5591437578d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.900+0000 7fc46f04e740 1 --2- 172.21.15.170:0/916772782 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55914373b2a0 0x55914373c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.900+0000 7fc46f04e740 1 -- 172.21.15.170:0/916772782 >> 172.21.15.170:0/916772782 conn(0x559143736810 msgr2=0x5591437446f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.900+0000 7fc46f04e740 1 -- 172.21.15.170:0/916772782 shutdown_connections 2024-01-25T15:03:01.903 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.900+0000 7fc46f04e740 1 -- 172.21.15.170:0/916772782 wait complete. 2024-01-25T15:03:01.906 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.901+0000 7fc46f04e740 1 -- start start 2024-01-25T15:03:01.906 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.901+0000 7fc46f04e740 1 Processor -- start 2024-01-25T15:03:01.906 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.901+0000 7fc46f04e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55914373b2a0 0x5591437a1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.906 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.901+0000 7fc46f04e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55914373bc90 0x5591437a3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.901+0000 7fc46f04e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559143740e00 0x5591437a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.901+0000 7fc46f04e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591437a65f0 con 0x55914373b2a0 2024-01-25T15:03:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.901+0000 7fc46f04e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591437a6760 con 0x559143740e00 2024-01-25T15:03:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.901+0000 7fc46f04e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591437a6920 con 0x55914373bc90 2024-01-25T15:03:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.901+0000 7fc469a2b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55914373b2a0 0x5591437a1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.901+0000 7fc46f04e740 10 client.0 _ll_register_callbacks cb 0x7fc454017bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.901+0000 7fc469a2b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55914373b2a0 0x5591437a1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54230/0 (socket says 172.21.15.170:54230) 2024-01-25T15:03:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.901+0000 7fc469a2b640 1 -- 172.21.15.170:0/71961545 learned_addr learned my addr 172.21.15.170:0/71961545 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.902+0000 7fc469a2b640 1 --2- 172.21.15.170:0/71961545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559143740e00 0x5591437a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.902+0000 7fc46a22c640 1 --2- 172.21.15.170:0/71961545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55914373bc90 0x5591437a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.902+0000 7fc469a2b640 1 -- 172.21.15.170:0/71961545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55914373bc90 msgr2=0x5591437a3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.902+0000 7fc469a2b640 1 --2- 172.21.15.170:0/71961545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55914373bc90 0x5591437a3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.902+0000 7fc469a2b640 1 -- 172.21.15.170:0/71961545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559143740e00 msgr2=0x5591437a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:01.907 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.902+0000 7fc469a2b640 1 --2- 172.21.15.170:0/71961545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559143740e00 0x5591437a5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.902+0000 7fc469a2b640 1 -- 172.21.15.170:0/71961545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591436a26d0 con 0x55914373b2a0 2024-01-25T15:03:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.902+0000 7fc469a2b640 1 --2- 172.21.15.170:0/71961545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55914373b2a0 0x5591437a1410 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc454026a60 tx=0x7fc454026430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f0af47c344e84e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.902+0000 7fc44dffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.902+0000 7fc44dffb640 1 -- 172.21.15.170:0/71961545 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc454048070 con 0x55914373b2a0 2024-01-25T15:03:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.902+0000 7fc44dffb640 1 -- 172.21.15.170:0/71961545 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fc454000e40 con 0x55914373b2a0 2024-01-25T15:03:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.902+0000 7fc46f04e740 1 -- 172.21.15.170:0/71961545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc454004390 con 0x55914373b2a0 2024-01-25T15:03:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.902+0000 7fc44dffb640 1 -- 172.21.15.170:0/71961545 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc454005250 con 0x55914373b2a0 2024-01-25T15:03:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.902+0000 7fc46f04e740 10 client.15876 fetch_fsmap learned FSMap version 26 2024-01-25T15:03:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.902+0000 7fc46f04e740 1 -- 172.21.15.170:0/71961545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559143664a80 con 0x55914373b2a0 2024-01-25T15:03:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.903+0000 7fc44dffb640 1 -- 172.21.15.170:0/71961545 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc454004390 con 0x55914373b2a0 2024-01-25T15:03:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.903+0000 7fc44dffb640 1 -- 172.21.15.170:0/71961545 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc4540035f0 con 0x55914373b2a0 2024-01-25T15:03:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.903+0000 7fc46f04e740 10 client.15876 fetch_fsmap finished waiting for FSMap version 26 2024-01-25T15:03:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.903+0000 7fc46f04e740 10 client.15876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:01.908 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.903+0000 7fc46f04e740 20 client.15876 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.903+0000 7fc46f04e740 1 --2- 172.21.15.170:0/71961545 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559143750ee0 0x5591437a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.903+0000 7fc46f04e740 4 client.15876 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-25T15:03:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.903+0000 7fc46f04e740 1 -- 172.21.15.170:0/71961545 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5591433a3600 con 0x559143750ee0 2024-01-25T15:03:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.903+0000 7fc46a22c640 1 --2- 172.21.15.170:0/71961545 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559143750ee0 0x5591437a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.904+0000 7fc44dffb640 10 client.15876 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:01.909 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.904+0000 7fc46a22c640 1 --2- 172.21.15.170:0/71961545 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559143750ee0 0x5591437a9eb0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=614a2960929e036f server_cookie=1b18e06010025932 in_seq=0 out_seq=0 2024-01-25T15:03:01.910 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.909+0000 7fc44dffb640 1 -- 172.21.15.170:0/71961545 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5591433a3600 con 0x559143750ee0 2024-01-25T15:03:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.909+0000 7fc44dffb640 10 client.15876 handle_command_reply: tid=0 2024-01-25T15:03:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.909+0000 7fc46f04e740 1 client.15876 shutdown 2024-01-25T15:03:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.909+0000 7fc46f04e740 1 -- 172.21.15.170:0/71961545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55914373b2a0 msgr2=0x5591437a1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.909+0000 7fc46f04e740 1 --2- 172.21.15.170:0/71961545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55914373b2a0 0x5591437a1410 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fc454026a60 tx=0x7fc454026430 comp rx=0 tx=0).stop 2024-01-25T15:03:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.909+0000 7fc46f04e740 1 -- 172.21.15.170:0/71961545 shutdown_connections 2024-01-25T15:03:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.909+0000 7fc46f04e740 1 --2- 172.21.15.170:0/71961545 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559143750ee0 0x5591437a9eb0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.909+0000 7fc46f04e740 1 --2- 172.21.15.170:0/71961545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559143740e00 0x5591437a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.909+0000 7fc44dffb640 0 client.15876 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.909+0000 7fc46f04e740 1 --2- 172.21.15.170:0/71961545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55914373bc90 0x5591437a3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.910+0000 7fc46f04e740 1 --2- 172.21.15.170:0/71961545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55914373b2a0 0x5591437a1410 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.910+0000 7fc46f04e740 1 -- 172.21.15.170:0/71961545 >> 172.21.15.170:0/71961545 conn(0x559143736810 msgr2=0x55914373c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.911 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.910+0000 7fc46f04e740 1 -- 172.21.15.170:0/71961545 shutdown_connections 2024-01-25T15:03:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.910+0000 7fc46f04e740 1 -- 172.21.15.170:0/71961545 wait complete. 2024-01-25T15:03:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.910+0000 7fc46f04e740 20 client.15876 trim_cache size 0 max 16384 2024-01-25T15:03:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:{ 2024-01-25T15:03:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "message": "", 2024-01-25T15:03:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "return_code": 0 2024-01-25T15:03:01.912 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:} 2024-01-25T15:03:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.910+0000 7fc46c490640 1 -- 172.21.15.170:0/3052972746 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc4500a1380 msgr2=0x7fc4500a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.910+0000 7fc46c490640 1 --2- 172.21.15.170:0/3052972746 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc4500a1380 0x7fc4500a3840 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0a1cf0 tx=0x7fc45c065490 comp rx=0 tx=0).stop 2024-01-25T15:03:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.910+0000 7fc46c490640 1 -- 172.21.15.170:0/3052972746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4641017e0 msgr2=0x7fc46419e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.910+0000 7fc46c490640 1 --2- 172.21.15.170:0/3052972746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4641017e0 0x7fc46419e010 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00efd0 tx=0x7fc45c00c6a0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.910+0000 7fc46c490640 1 -- 172.21.15.170:0/3052972746 shutdown_connections 2024-01-25T15:03:01.913 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.910+0000 7fc46c490640 1 --2- 172.21.15.170:0/3052972746 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fc4500a1380 0x7fc4500a3840 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.910+0000 7fc46c490640 1 --2- 172.21.15.170:0/3052972746 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fc4641017e0 0x7fc46419e010 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.910+0000 7fc46c490640 1 --2- 172.21.15.170:0/3052972746 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fc464100e20 0x7fc46419ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.910+0000 7fc46c490640 1 --2- 172.21.15.170:0/3052972746 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc4640ffc30 0x7fc464069a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.910+0000 7fc46c490640 1 -- 172.21.15.170:0/3052972746 >> 172.21.15.170:0/3052972746 conn(0x7fc4640fb180 msgr2=0x7fc4641041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.911+0000 7fc46c490640 1 -- 172.21.15.170:0/3052972746 shutdown_connections 2024-01-25T15:03:01.914 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:01.911+0000 7fc46c490640 1 -- 172.21.15.170:0/3052972746 wait complete. 2024-01-25T15:03:02.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:02 smithi186 ceph-mon[35697]: scrub queued for path: / 2024-01-25T15:03:02.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:02 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:02.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:02 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:02.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:02 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:02.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:02 smithi170 ceph-mon[31899]: scrub queued for path: / 2024-01-25T15:03:02.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:02 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:02.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:02 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:02.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:02 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:02.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:02 smithi191 ceph-mon[36347]: scrub queued for path: / 2024-01-25T15:03:02.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:02 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:02.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:02 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:02.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:02 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:03.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:03 smithi186 ceph-mon[35697]: pgmap v380: 97 pgs: 97 active+clean; 669 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-01-25T15:03:03.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:03 smithi170 ceph-mon[31899]: pgmap v380: 97 pgs: 97 active+clean; 669 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-01-25T15:03:03.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:03 smithi191 ceph-mon[36347]: pgmap v380: 97 pgs: 97 active+clean; 669 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 511 B/s wr, 10 op/s 2024-01-25T15:03:05.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:05 smithi186 ceph-mon[35697]: pgmap v381: 97 pgs: 97 active+clean; 670 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 853 B/s wr, 13 op/s 2024-01-25T15:03:05.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:05 smithi186 ceph-mon[35697]: scrub summary: idle 2024-01-25T15:03:05.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:05 smithi170 ceph-mon[31899]: pgmap v381: 97 pgs: 97 active+clean; 670 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 853 B/s wr, 13 op/s 2024-01-25T15:03:05.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:05 smithi170 ceph-mon[31899]: scrub summary: idle 2024-01-25T15:03:05.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:05 smithi191 ceph-mon[36347]: pgmap v381: 97 pgs: 97 active+clean; 670 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 853 B/s wr, 13 op/s 2024-01-25T15:03:05.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:05 smithi191 ceph-mon[36347]: scrub summary: idle 2024-01-25T15:03:07.112 INFO:tasks.workunit.client.0.smithi170.stderr:Note: switching to '661946e7044723130c03627323f6a879a9848cb5'. 2024-01-25T15:03:07.112 INFO:tasks.workunit.client.0.smithi170.stderr: 2024-01-25T15:03:07.113 INFO:tasks.workunit.client.0.smithi170.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-01-25T15:03:07.113 INFO:tasks.workunit.client.0.smithi170.stderr:changes and commit them, and you can discard any commits you make in this 2024-01-25T15:03:07.113 INFO:tasks.workunit.client.0.smithi170.stderr:state without impacting any branches by switching back to a branch. 2024-01-25T15:03:07.113 INFO:tasks.workunit.client.0.smithi170.stderr: 2024-01-25T15:03:07.113 INFO:tasks.workunit.client.0.smithi170.stderr:If you want to create a new branch to retain commits you create, you may 2024-01-25T15:03:07.113 INFO:tasks.workunit.client.0.smithi170.stderr:do so (now or later) by using -c with the switch command. Example: 2024-01-25T15:03:07.113 INFO:tasks.workunit.client.0.smithi170.stderr: 2024-01-25T15:03:07.113 INFO:tasks.workunit.client.0.smithi170.stderr: git switch -c 2024-01-25T15:03:07.113 INFO:tasks.workunit.client.0.smithi170.stderr: 2024-01-25T15:03:07.113 INFO:tasks.workunit.client.0.smithi170.stderr:Or undo this operation with: 2024-01-25T15:03:07.113 INFO:tasks.workunit.client.0.smithi170.stderr: 2024-01-25T15:03:07.113 INFO:tasks.workunit.client.0.smithi170.stderr: git switch - 2024-01-25T15:03:07.113 INFO:tasks.workunit.client.0.smithi170.stderr: 2024-01-25T15:03:07.114 INFO:tasks.workunit.client.0.smithi170.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-01-25T15:03:07.114 INFO:tasks.workunit.client.0.smithi170.stderr: 2024-01-25T15:03:07.114 INFO:tasks.workunit.client.0.smithi170.stderr:HEAD is now at 661946e7044 Merge PR #53901 into wip-vshankar-testing-20240125.044502 2024-01-25T15:03:07.115 DEBUG:teuthology.orchestra.run.smithi170:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-01-25T15:03:07.184 INFO:tasks.workunit.client.0.smithi170.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-01-25T15:03:07.186 INFO:tasks.workunit.client.0.smithi170.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-25T15:03:07.186 INFO:tasks.workunit.client.0.smithi170.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-01-25T15:03:07.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:07 smithi186 ceph-mon[35697]: pgmap v382: 97 pgs: 97 active+clean; 670 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 597 B/s wr, 11 op/s 2024-01-25T15:03:07.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:07 smithi170 ceph-mon[31899]: pgmap v382: 97 pgs: 97 active+clean; 670 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 597 B/s wr, 11 op/s 2024-01-25T15:03:07.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:07 smithi191 ceph-mon[36347]: pgmap v382: 97 pgs: 97 active+clean; 670 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 597 B/s wr, 11 op/s 2024-01-25T15:03:07.921 INFO:tasks.workunit.client.0.smithi170.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-01-25T15:03:07.991 INFO:tasks.workunit.client.0.smithi170.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-01-25T15:03:08.031 INFO:tasks.workunit.client.0.smithi170.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-01-25T15:03:08.032 INFO:tasks.workunit.client.0.smithi170.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-25T15:03:08.032 INFO:tasks.workunit.client.0.smithi170.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-01-25T15:03:08.070 INFO:tasks.workunit.client.0.smithi170.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-01-25T15:03:08.074 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T15:03:08.074 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-01-25T15:03:08.129 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-01-25T15:03:08.130 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-01-25T15:03:08.130 DEBUG:teuthology.orchestra.run.smithi170:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=661946e7044723130c03627323f6a879a9848cb5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-01-25T15:03:08.190 INFO:tasks.workunit.client.0.smithi170.stderr:+ mkdir -p fsstress 2024-01-25T15:03:08.192 INFO:tasks.workunit.client.0.smithi170.stderr:+ pushd fsstress 2024-01-25T15:03:08.192 INFO:tasks.workunit.client.0.smithi170.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-01-25T15:03:08.192 INFO:tasks.workunit.client.0.smithi170.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-01-25T15:03:08.847 INFO:tasks.workunit.client.0.smithi170.stderr:+ tar xzf ltp-full.tgz 2024-01-25T15:03:09.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:09 smithi186 ceph-mon[35697]: pgmap v383: 97 pgs: 97 active+clean; 670 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 597 B/s wr, 13 op/s 2024-01-25T15:03:09.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:09 smithi170 ceph-mon[31899]: pgmap v383: 97 pgs: 97 active+clean; 670 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 597 B/s wr, 13 op/s 2024-01-25T15:03:09.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:09 smithi191 ceph-mon[36347]: pgmap v383: 97 pgs: 97 active+clean; 670 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 597 B/s wr, 13 op/s 2024-01-25T15:03:11.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:11 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:11.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:11 smithi186 ceph-mon[35697]: pgmap v384: 97 pgs: 97 active+clean; 670 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-25T15:03:11.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:11 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:11.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:11 smithi170 ceph-mon[31899]: pgmap v384: 97 pgs: 97 active+clean; 670 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-25T15:03:11.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:11 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:11.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:11 smithi191 ceph-mon[36347]: pgmap v384: 97 pgs: 97 active+clean; 670 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 11 op/s 2024-01-25T15:03:12.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:12 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T15:03:12.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:12 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T15:03:12.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:12 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T15:03:13.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:13 smithi186 ceph-mon[35697]: pgmap v385: 97 pgs: 97 active+clean; 921 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-01-25T15:03:13.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:13 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:03:13.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:13 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:03:13.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:13 smithi170 ceph-mon[31899]: pgmap v385: 97 pgs: 97 active+clean; 921 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-01-25T15:03:13.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:13 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:03:13.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:13 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:03:13.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:13 smithi191 ceph-mon[36347]: pgmap v385: 97 pgs: 97 active+clean; 921 KiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 KiB/s wr, 12 op/s 2024-01-25T15:03:13.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:13 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:03:13.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:13 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:03:14.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T15:03:14.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T15:03:14.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:03:14.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T15:03:14.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T15:03:14.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:03:14.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T15:03:14.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T15:03:14.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:03:15.003 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.000+0000 7f973b831640 1 -- 172.21.15.170:0/199676832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97340ffc30 msgr2=0x7f9734100050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.000+0000 7f973b831640 1 --2- 172.21.15.170:0/199676832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97340ffc30 0x7f9734100050 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f972c009900 tx=0x7f972c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:03:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.000+0000 7f973b831640 1 -- 172.21.15.170:0/199676832 shutdown_connections 2024-01-25T15:03:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.000+0000 7f973b831640 1 --2- 172.21.15.170:0/199676832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97341017e0 0x7f9734108070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.000+0000 7f973b831640 1 --2- 172.21.15.170:0/199676832 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9734100e20 0x7f97341012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.000+0000 7f973b831640 1 --2- 172.21.15.170:0/199676832 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97340ffc30 0x7f9734100050 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.000+0000 7f973b831640 1 -- 172.21.15.170:0/199676832 >> 172.21.15.170:0/199676832 conn(0x7f97340fb1a0 msgr2=0x7f97340fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.000+0000 7f973b831640 1 -- 172.21.15.170:0/199676832 shutdown_connections 2024-01-25T15:03:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.000+0000 7f973b831640 1 -- 172.21.15.170:0/199676832 wait complete. 2024-01-25T15:03:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.001+0000 7f973b831640 1 Processor -- start 2024-01-25T15:03:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.001+0000 7f973b831640 1 -- start start 2024-01-25T15:03:15.004 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.001+0000 7f973b831640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97340ffc30 0x7f9734195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.001+0000 7f973b831640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9734100e20 0x7f9734196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.001+0000 7f973b831640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97341017e0 0x7f973419d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.001+0000 7f973b831640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973419d620 con 0x7f97341017e0 2024-01-25T15:03:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.001+0000 7f973b831640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973419d790 con 0x7f9734100e20 2024-01-25T15:03:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.001+0000 7f973b831640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973419d950 con 0x7f97340ffc30 2024-01-25T15:03:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.001+0000 7f9739dce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97341017e0 0x7f973419d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.001+0000 7f97395cd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97340ffc30 0x7f9734195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.001+0000 7f9739dce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97341017e0 0x7f973419d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42880/0 (socket says 172.21.15.170:42880) 2024-01-25T15:03:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.001+0000 7f97395cd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97340ffc30 0x7f9734195b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:41820/0 (socket says 172.21.15.170:41820) 2024-01-25T15:03:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.001+0000 7f9739dce640 1 -- 172.21.15.170:0/3054130413 learned_addr learned my addr 172.21.15.170:0/3054130413 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.001+0000 7f9738dcc640 1 --2- 172.21.15.170:0/3054130413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9734100e20 0x7f9734196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.005 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.002+0000 7f9739dce640 1 -- 172.21.15.170:0/3054130413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97340ffc30 msgr2=0x7f9734195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.002+0000 7f9739dce640 1 --2- 172.21.15.170:0/3054130413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97340ffc30 0x7f9734195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.002+0000 7f9739dce640 1 -- 172.21.15.170:0/3054130413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9734100e20 msgr2=0x7f9734196070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.002+0000 7f9739dce640 1 --2- 172.21.15.170:0/3054130413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9734100e20 0x7f9734196070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.002+0000 7f9739dce640 1 -- 172.21.15.170:0/3054130413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c009560 con 0x7f97341017e0 2024-01-25T15:03:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.002+0000 7f97395cd640 1 --2- 172.21.15.170:0/3054130413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97340ffc30 0x7f9734195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.002+0000 7f9739dce640 1 --2- 172.21.15.170:0/3054130413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97341017e0 0x7f973419d0e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f973000eb10 tx=0x7f973000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.002+0000 7f972a7fc640 1 -- 172.21.15.170:0/3054130413 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730004b20 con 0x7f97341017e0 2024-01-25T15:03:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.002+0000 7f972a7fc640 1 -- 172.21.15.170:0/3054130413 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9730004c80 con 0x7f97341017e0 2024-01-25T15:03:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.002+0000 7f973b831640 1 -- 172.21.15.170:0/3054130413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973419dc30 con 0x7f97341017e0 2024-01-25T15:03:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.002+0000 7f972a7fc640 1 -- 172.21.15.170:0/3054130413 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730010690 con 0x7f97341017e0 2024-01-25T15:03:15.006 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.002+0000 7f973b831640 1 -- 172.21.15.170:0/3054130413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973419e0f0 con 0x7f97341017e0 2024-01-25T15:03:15.013 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.004+0000 7f972a7fc640 1 -- 172.21.15.170:0/3054130413 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f9730005020 con 0x7f97341017e0 2024-01-25T15:03:15.013 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f973e3fb740 1 Processor -- start 2024-01-25T15:03:15.013 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f973e3fb740 1 -- start start 2024-01-25T15:03:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f973e3fb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b0c2a0 0x559c82b0c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f972a7fc640 1 --2- 172.21.15.170:0/3054130413 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f97200a1380 0x7f97200a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f973e3fb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0cc90 0x559c82b11790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f973e3fb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b11e00 0x559c82b14290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f973e3fb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c82a7c070 con 0x559c82b0c2a0 2024-01-25T15:03:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f973e3fb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c82a79760 con 0x559c82b11e00 2024-01-25T15:03:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f973e3fb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c82a75050 con 0x559c82b0cc90 2024-01-25T15:03:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f9738dcc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b0c2a0 0x559c82b0c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f9738dcc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b0c2a0 0x559c82b0c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42896/0 (socket says 172.21.15.170:42896) 2024-01-25T15:03:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f9738dcc640 1 -- 172.21.15.170:0/845661256 learned_addr learned my addr 172.21.15.170:0/845661256 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f97395cd640 1 --2- 172.21.15.170:0/3054130413 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f97200a1380 0x7f97200a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f972a7fc640 1 -- 172.21.15.170:0/3054130413 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f9730014070 con 0x7f97341017e0 2024-01-25T15:03:15.014 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f9739dce640 1 --2- 172.21.15.170:0/845661256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b11e00 0x559c82b14290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f9738dcc640 1 --2- 172.21.15.170:0/845661256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0cc90 0x559c82b11790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f9738dcc640 1 -- 172.21.15.170:0/845661256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0cc90 msgr2=0x559c82b11790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f9738dcc640 1 --2- 172.21.15.170:0/845661256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0cc90 0x559c82b11790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f9738dcc640 1 -- 172.21.15.170:0/845661256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b11e00 msgr2=0x559c82b14290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f9738dcc640 1 --2- 172.21.15.170:0/845661256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b11e00 0x559c82b14290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.005+0000 7f9738dcc640 1 -- 172.21.15.170:0/845661256 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c82a6ce70 con 0x559c82b0c2a0 2024-01-25T15:03:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.006+0000 7f9739dce640 1 --2- 172.21.15.170:0/845661256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b11e00 0x559c82b14290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:03:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.006+0000 7f9738dcc640 1 --2- 172.21.15.170:0/845661256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b0c2a0 0x559c82b0c6c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9724009710 tx=0x7f9724009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ad1ebcc2c86548 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.006+0000 7f97395cd640 1 --2- 172.21.15.170:0/3054130413 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f97200a1380 0x7f97200a3840 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f972c000c00 tx=0x7f972c02c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.006+0000 7f971f7fe640 1 -- 172.21.15.170:0/845661256 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724004050 con 0x559c82b0c2a0 2024-01-25T15:03:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.006+0000 7f971f7fe640 1 -- 172.21.15.170:0/845661256 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f97240035f0 con 0x559c82b0c2a0 2024-01-25T15:03:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.006+0000 7f971f7fe640 1 -- 172.21.15.170:0/845661256 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972400f760 con 0x559c82b0c2a0 2024-01-25T15:03:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.006+0000 7f973e3fb740 1 -- 172.21.15.170:0/845661256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b0c2a0 msgr2=0x559c82b0c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.006+0000 7f973e3fb740 1 --2- 172.21.15.170:0/845661256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b0c2a0 0x559c82b0c6c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9724009710 tx=0x7f9724009830 comp rx=0 tx=0).stop 2024-01-25T15:03:15.015 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 1 -- 172.21.15.170:0/845661256 shutdown_connections 2024-01-25T15:03:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 1 --2- 172.21.15.170:0/845661256 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b11e00 0x559c82b14290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 1 --2- 172.21.15.170:0/845661256 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0cc90 0x559c82b11790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 1 --2- 172.21.15.170:0/845661256 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b0c2a0 0x559c82b0c6c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 1 -- 172.21.15.170:0/845661256 >> 172.21.15.170:0/845661256 conn(0x559c82b07810 msgr2=0x559c82b07c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 1 -- 172.21.15.170:0/845661256 shutdown_connections 2024-01-25T15:03:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 1 -- 172.21.15.170:0/845661256 wait complete. 2024-01-25T15:03:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 1 -- start start 2024-01-25T15:03:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 1 Processor -- start 2024-01-25T15:03:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0c2a0 0x559c82b161c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0cc90 0x559c82b16700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b1d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.016 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c82a2e1e0 con 0x559c82b11e00 2024-01-25T15:03:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c82a2de80 con 0x559c82b0cc90 2024-01-25T15:03:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c829f30c0 con 0x559c82b0c2a0 2024-01-25T15:03:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f973e3fb740 10 client.0 _ll_register_callbacks cb 0x559c82a18ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f9739dce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b1d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.007+0000 7f97395cd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0c2a0 0x559c82b161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f97395cd640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0c2a0 0x559c82b161c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:41842/0 (socket says 172.21.15.170:41842) 2024-01-25T15:03:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f97395cd640 1 -- 172.21.15.170:0/304708759 learned_addr learned my addr 172.21.15.170:0/304708759 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f9739dce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b1d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42900/0 (socket says 172.21.15.170:42900) 2024-01-25T15:03:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f9738dcc640 1 --2- 172.21.15.170:0/304708759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0cc90 0x559c82b16700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f97395cd640 1 -- 172.21.15.170:0/304708759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0cc90 msgr2=0x559c82b16700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f97395cd640 1 --2- 172.21.15.170:0/304708759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0cc90 0x559c82b16700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f97395cd640 1 -- 172.21.15.170:0/304708759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 msgr2=0x559c82b1d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:15.017 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f97395cd640 1 --2- 172.21.15.170:0/304708759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b1d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f97395cd640 1 -- 172.21.15.170:0/304708759 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9724009d70 con 0x559c82b0c2a0 2024-01-25T15:03:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f9738dcc640 1 --2- 172.21.15.170:0/304708759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0cc90 0x559c82b16700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:03:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f9739dce640 1 --2- 172.21.15.170:0/304708759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b1d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f97395cd640 1 --2- 172.21.15.170:0/304708759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0c2a0 0x559c82b161c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f972c006010 tx=0x7f972c009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9b7490ed960869d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f971cff9640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-01-25T15:03:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f971cff9640 1 -- 172.21.15.170:0/304708759 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0044c0 con 0x559c82b0c2a0 2024-01-25T15:03:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f973e3fb740 1 -- 172.21.15.170:0/304708759 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c82a6e040 con 0x559c82b0c2a0 2024-01-25T15:03:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f971cff9640 1 -- 172.21.15.170:0/304708759 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f972c045070 con 0x559c82b0c2a0 2024-01-25T15:03:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f971cff9640 1 -- 172.21.15.170:0/304708759 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f972c005210 con 0x559c82b0c2a0 2024-01-25T15:03:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f973e3fb740 10 client.25237 fetch_fsmap learned FSMap version 27 2024-01-25T15:03:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f973e3fb740 1 -- 172.21.15.170:0/304708759 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559c82a736d0 con 0x559c82b0c2a0 2024-01-25T15:03:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.008+0000 7f971cff9640 1 -- 172.21.15.170:0/304708759 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559c82a6e040 con 0x559c82b0c2a0 2024-01-25T15:03:15.018 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.009+0000 7f971cff9640 1 -- 172.21.15.170:0/304708759 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f972c03f440 con 0x559c82b0c2a0 2024-01-25T15:03:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.009+0000 7f973e3fb740 10 client.25237 fetch_fsmap finished waiting for FSMap version 27 2024-01-25T15:03:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.009+0000 7f973e3fb740 10 client.25237 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.009+0000 7f973e3fb740 20 client.25237 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.009+0000 7f973e3fb740 1 --2- 172.21.15.170:0/304708759 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559c82b22100 0x559c82b24540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.009+0000 7f973e3fb740 4 client.25237 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.009+0000 7f973e3fb740 1 -- 172.21.15.170:0/304708759 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c82a6dd60 con 0x559c82b22100 2024-01-25T15:03:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.009+0000 7f9738dcc640 1 --2- 172.21.15.170:0/304708759 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559c82b22100 0x559c82b24540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.009+0000 7f9738dcc640 1 --2- 172.21.15.170:0/304708759 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559c82b22100 0x559c82b24540 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cac04e3503c4083 server_cookie=184c123c73529590 in_seq=0 out_seq=0 2024-01-25T15:03:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.009+0000 7f971cff9640 10 client.25237 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.011+0000 7f971cff9640 1 -- 172.21.15.170:0/304708759 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559c82a6dd60 con 0x559c82b22100 2024-01-25T15:03:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.011+0000 7f971cff9640 10 client.25237 handle_command_reply: tid=0 2024-01-25T15:03:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.011+0000 7f973e3fb740 1 client.25237 shutdown 2024-01-25T15:03:15.019 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.011+0000 7f973e3fb740 1 -- 172.21.15.170:0/304708759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0c2a0 msgr2=0x559c82b161c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.011+0000 7f973e3fb740 1 --2- 172.21.15.170:0/304708759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0c2a0 0x559c82b161c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f972c006010 tx=0x7f972c009260 comp rx=0 tx=0).stop 2024-01-25T15:03:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.011+0000 7f973e3fb740 1 -- 172.21.15.170:0/304708759 shutdown_connections 2024-01-25T15:03:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.011+0000 7f973e3fb740 1 --2- 172.21.15.170:0/304708759 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559c82b22100 0x559c82b24540 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.011+0000 7f973e3fb740 1 --2- 172.21.15.170:0/304708759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0cc90 0x559c82b16700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.011+0000 7f973e3fb740 1 --2- 172.21.15.170:0/304708759 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b1d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.011+0000 7f973e3fb740 1 --2- 172.21.15.170:0/304708759 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0c2a0 0x559c82b161c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.011+0000 7f971cff9640 0 client.25237 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.011+0000 7f973e3fb740 1 -- 172.21.15.170:0/304708759 >> 172.21.15.170:0/304708759 conn(0x559c82b07810 msgr2=0x559c82b06a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.011+0000 7f973e3fb740 1 -- 172.21.15.170:0/304708759 shutdown_connections 2024-01-25T15:03:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.011+0000 7f973e3fb740 1 -- 172.21.15.170:0/304708759 wait complete. 2024-01-25T15:03:15.020 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.011+0000 7f973e3fb740 20 client.25237 trim_cache size 0 max 16384 2024-01-25T15:03:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f973e3fb740 1 Processor -- start 2024-01-25T15:03:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f973e3fb740 1 -- start start 2024-01-25T15:03:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f973e3fb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0c2a0 0x559c82b0dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f973e3fb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0cc90 0x559c82b0e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.029 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f973e3fb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b15dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f973e3fb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c82b0be60 con 0x559c82b11e00 2024-01-25T15:03:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f973e3fb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c82b14950 con 0x559c82b0cc90 2024-01-25T15:03:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f973e3fb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c82a6dd60 con 0x559c82b0c2a0 2024-01-25T15:03:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f9739dce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b15dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f9739dce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b15dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42906/0 (socket says 172.21.15.170:42906) 2024-01-25T15:03:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f9739dce640 1 -- 172.21.15.170:0/3191615539 learned_addr learned my addr 172.21.15.170:0/3191615539 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f97395cd640 1 --2- 172.21.15.170:0/3191615539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0c2a0 0x559c82b0dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f9738dcc640 1 --2- 172.21.15.170:0/3191615539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0cc90 0x559c82b0e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f9739dce640 1 -- 172.21.15.170:0/3191615539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0c2a0 msgr2=0x559c82b0dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f9739dce640 1 --2- 172.21.15.170:0/3191615539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0c2a0 0x559c82b0dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f9739dce640 1 -- 172.21.15.170:0/3191615539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0cc90 msgr2=0x559c82b0e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.024+0000 7f9739dce640 1 --2- 172.21.15.170:0/3191615539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0cc90 0x559c82b0e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.025+0000 7f9739dce640 1 -- 172.21.15.170:0/3191615539 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c82a10060 con 0x559c82b11e00 2024-01-25T15:03:15.030 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.025+0000 7f9739dce640 1 --2- 172.21.15.170:0/3191615539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b15dd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f973000cf90 tx=0x7f9730009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301e943f0eb3cbde server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.025+0000 7f971effd640 1 -- 172.21.15.170:0/3191615539 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973009e160 con 0x559c82b11e00 2024-01-25T15:03:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.025+0000 7f971effd640 1 -- 172.21.15.170:0/3191615539 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f973009a8f0 con 0x559c82b11e00 2024-01-25T15:03:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.025+0000 7f971effd640 1 -- 172.21.15.170:0/3191615539 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730098620 con 0x559c82b11e00 2024-01-25T15:03:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.025+0000 7f973e3fb740 1 -- 172.21.15.170:0/3191615539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 msgr2=0x559c82b15dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.025+0000 7f973e3fb740 1 --2- 172.21.15.170:0/3191615539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b15dd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f973000cf90 tx=0x7f9730009a70 comp rx=0 tx=0).stop 2024-01-25T15:03:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.025+0000 7f973e3fb740 1 -- 172.21.15.170:0/3191615539 shutdown_connections 2024-01-25T15:03:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.025+0000 7f973e3fb740 1 --2- 172.21.15.170:0/3191615539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0cc90 0x559c82b0e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.025+0000 7f973e3fb740 1 --2- 172.21.15.170:0/3191615539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b15dd0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.025+0000 7f973e3fb740 1 --2- 172.21.15.170:0/3191615539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0c2a0 0x559c82b0dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.025+0000 7f973e3fb740 1 -- 172.21.15.170:0/3191615539 >> 172.21.15.170:0/3191615539 conn(0x559c82b07810 msgr2=0x559c82b28ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.025+0000 7f973e3fb740 1 -- 172.21.15.170:0/3191615539 shutdown_connections 2024-01-25T15:03:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.025+0000 7f973e3fb740 1 -- 172.21.15.170:0/3191615539 wait complete. 2024-01-25T15:03:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f973e3fb740 1 -- start start 2024-01-25T15:03:15.031 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f973e3fb740 1 Processor -- start 2024-01-25T15:03:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f973e3fb740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0c2a0 0x559c82b72870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f973e3fb740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0cc90 0x559c82b72db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f973e3fb740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b79ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f973e3fb740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c82b79ff0 con 0x559c82b11e00 2024-01-25T15:03:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f973e3fb740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c82b7a130 con 0x559c82b0c2a0 2024-01-25T15:03:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f973e3fb740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c82b7a2c0 con 0x559c82b0cc90 2024-01-25T15:03:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f973e3fb740 10 client.0 _ll_register_callbacks cb 0x7f9724009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f9739dce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b79ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f9739dce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b79ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:42914/0 (socket says 172.21.15.170:42914) 2024-01-25T15:03:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f9739dce640 1 -- 172.21.15.170:0/3487356814 learned_addr learned my addr 172.21.15.170:0/3487356814 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f9738dcc640 1 --2- 172.21.15.170:0/3487356814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0cc90 0x559c82b72db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f97395cd640 1 --2- 172.21.15.170:0/3487356814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0c2a0 0x559c82b72870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f9739dce640 1 -- 172.21.15.170:0/3487356814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0cc90 msgr2=0x559c82b72db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:15.032 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f9739dce640 1 --2- 172.21.15.170:0/3487356814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0cc90 0x559c82b72db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f9739dce640 1 -- 172.21.15.170:0/3487356814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0c2a0 msgr2=0x559c82b72870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f9739dce640 1 --2- 172.21.15.170:0/3487356814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0c2a0 0x559c82b72870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.026+0000 7f9739dce640 1 -- 172.21.15.170:0/3487356814 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973419e0f0 con 0x559c82b11e00 2024-01-25T15:03:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f9739dce640 1 --2- 172.21.15.170:0/3487356814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b79ab0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9730005ba0 tx=0x7f97300a2580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=262b961b5669df41 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f971cff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f971cff9640 1 -- 172.21.15.170:0/3487356814 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973009e340 con 0x559c82b11e00 2024-01-25T15:03:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f971cff9640 1 -- 172.21.15.170:0/3487356814 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f97300b81b0 con 0x559c82b11e00 2024-01-25T15:03:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f973e3fb740 1 -- 172.21.15.170:0/3487356814 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f97240035f0 con 0x559c82b11e00 2024-01-25T15:03:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f971cff9640 1 -- 172.21.15.170:0/3487356814 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97300b8370 con 0x559c82b11e00 2024-01-25T15:03:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f973e3fb740 10 client.15894 fetch_fsmap learned FSMap version 27 2024-01-25T15:03:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f973e3fb740 1 -- 172.21.15.170:0/3487356814 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559c82a35a80 con 0x559c82b11e00 2024-01-25T15:03:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f971cff9640 1 -- 172.21.15.170:0/3487356814 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f97300c9080 con 0x559c82b11e00 2024-01-25T15:03:15.033 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f971cff9640 1 -- 172.21.15.170:0/3487356814 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 27) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f973001f060 con 0x559c82b11e00 2024-01-25T15:03:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f973e3fb740 10 client.15894 fetch_fsmap finished waiting for FSMap version 27 2024-01-25T15:03:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f973e3fb740 10 client.15894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f973e3fb740 20 client.15894 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f973e3fb740 1 --2- 172.21.15.170:0/3487356814 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559c82b7bb90 0x559c82b7dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f973e3fb740 4 client.15894 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-25T15:03:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f973e3fb740 1 -- 172.21.15.170:0/3487356814 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559c82774600 con 0x559c82b7bb90 2024-01-25T15:03:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.027+0000 7f97395cd640 1 --2- 172.21.15.170:0/3487356814 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559c82b7bb90 0x559c82b7dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.028+0000 7f97395cd640 1 --2- 172.21.15.170:0/3487356814 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559c82b7bb90 0x559c82b7dfb0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b06737e1cf88209 server_cookie=f0b35cecdc69ec8b in_seq=0 out_seq=0 2024-01-25T15:03:15.034 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:15.028+0000 7f971cff9640 10 client.15894 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:15.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:15 smithi186 ceph-mon[35697]: pgmap v386: 97 pgs: 97 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 1.0 MiB/s wr, 83 op/s 2024-01-25T15:03:15.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:15 smithi170 ceph-mon[31899]: pgmap v386: 97 pgs: 97 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 1.0 MiB/s wr, 83 op/s 2024-01-25T15:03:15.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:15 smithi191 ceph-mon[36347]: pgmap v386: 97 pgs: 97 active+clean; 12 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 1.0 MiB/s wr, 83 op/s 2024-01-25T15:03:17.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:17 smithi186 ceph-mon[35697]: pgmap v387: 97 pgs: 97 active+clean; 28 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 2.5 MiB/s wr, 234 op/s 2024-01-25T15:03:17.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:17 smithi170 ceph-mon[31899]: pgmap v387: 97 pgs: 97 active+clean; 28 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 2.5 MiB/s wr, 234 op/s 2024-01-25T15:03:17.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:17 smithi191 ceph-mon[36347]: pgmap v387: 97 pgs: 97 active+clean; 28 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 2.5 MiB/s wr, 234 op/s 2024-01-25T15:03:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.589+0000 7f971cff9640 1 -- 172.21.15.170:0/3487356814 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559c82774600 con 0x559c82b7bb90 2024-01-25T15:03:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.589+0000 7f971cff9640 10 client.15894 handle_command_reply: tid=0 2024-01-25T15:03:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.589+0000 7f973e3fb740 1 client.15894 shutdown 2024-01-25T15:03:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.589+0000 7f973e3fb740 1 -- 172.21.15.170:0/3487356814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 msgr2=0x559c82b79ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.589+0000 7f973e3fb740 1 --2- 172.21.15.170:0/3487356814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b79ab0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9730005ba0 tx=0x7f97300a2580 comp rx=0 tx=0).stop 2024-01-25T15:03:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.589+0000 7f973e3fb740 1 -- 172.21.15.170:0/3487356814 shutdown_connections 2024-01-25T15:03:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.589+0000 7f973e3fb740 1 --2- 172.21.15.170:0/3487356814 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x559c82b7bb90 0x559c82b7dfb0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:18.591 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.589+0000 7f973e3fb740 1 --2- 172.21.15.170:0/3487356814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x559c82b11e00 0x559c82b79ab0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.589+0000 7f971cff9640 0 client.15894 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.589+0000 7f973e3fb740 1 --2- 172.21.15.170:0/3487356814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x559c82b0cc90 0x559c82b72db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.589+0000 7f973e3fb740 1 --2- 172.21.15.170:0/3487356814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559c82b0c2a0 0x559c82b72870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.589+0000 7f973e3fb740 1 -- 172.21.15.170:0/3487356814 >> 172.21.15.170:0/3487356814 conn(0x559c82b07810 msgr2=0x559c82b0dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.589+0000 7f973e3fb740 1 -- 172.21.15.170:0/3487356814 shutdown_connections 2024-01-25T15:03:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.590+0000 7f973e3fb740 1 -- 172.21.15.170:0/3487356814 wait complete. 2024-01-25T15:03:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.590+0000 7f973e3fb740 20 client.15894 trim_cache size 0 max 16384 2024-01-25T15:03:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:{ 2024-01-25T15:03:18.592 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "message": "", 2024-01-25T15:03:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "return_code": 0 2024-01-25T15:03:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:} 2024-01-25T15:03:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.590+0000 7f973b831640 1 -- 172.21.15.170:0/3054130413 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f97200a1380 msgr2=0x7f97200a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:18.593 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.590+0000 7f973b831640 1 --2- 172.21.15.170:0/3054130413 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f97200a1380 0x7f97200a3840 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f972c000c00 tx=0x7f972c02c5d0 comp rx=0 tx=0).stop 2024-01-25T15:03:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.590+0000 7f973b831640 1 -- 172.21.15.170:0/3054130413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97341017e0 msgr2=0x7f973419d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.590+0000 7f973b831640 1 --2- 172.21.15.170:0/3054130413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97341017e0 0x7f973419d0e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f973000eb10 tx=0x7f973000c2d0 comp rx=0 tx=0).stop 2024-01-25T15:03:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.590+0000 7f973b831640 1 -- 172.21.15.170:0/3054130413 shutdown_connections 2024-01-25T15:03:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.590+0000 7f973b831640 1 --2- 172.21.15.170:0/3054130413 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f97200a1380 0x7f97200a3840 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.590+0000 7f973b831640 1 --2- 172.21.15.170:0/3054130413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9734100e20 0x7f9734196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.590+0000 7f973b831640 1 --2- 172.21.15.170:0/3054130413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f97341017e0 0x7f973419d0e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.590+0000 7f973b831640 1 --2- 172.21.15.170:0/3054130413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f97340ffc30 0x7f9734195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.590+0000 7f973b831640 1 -- 172.21.15.170:0/3054130413 >> 172.21.15.170:0/3054130413 conn(0x7f97340fb1a0 msgr2=0x7f9734104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.590+0000 7f973b831640 1 -- 172.21.15.170:0/3054130413 shutdown_connections 2024-01-25T15:03:18.594 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:18.590+0000 7f973b831640 1 -- 172.21.15.170:0/3054130413 wait complete. 2024-01-25T15:03:19.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:19 smithi186 ceph-mon[35697]: pgmap v388: 97 pgs: 97 active+clean; 46 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 470 op/s 2024-01-25T15:03:19.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:19 smithi170 ceph-mon[31899]: pgmap v388: 97 pgs: 97 active+clean; 46 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 470 op/s 2024-01-25T15:03:19.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:19 smithi191 ceph-mon[36347]: pgmap v388: 97 pgs: 97 active+clean; 46 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 470 op/s 2024-01-25T15:03:21.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:21 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:21.355 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:21 smithi186 ceph-mon[35697]: pgmap v389: 97 pgs: 97 active+clean; 52 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 1.13k op/s 2024-01-25T15:03:21.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:21 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:21.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:21 smithi170 ceph-mon[31899]: pgmap v389: 97 pgs: 97 active+clean; 52 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 1.13k op/s 2024-01-25T15:03:21.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:21 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:21.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:21 smithi191 ceph-mon[36347]: pgmap v389: 97 pgs: 97 active+clean; 52 MiB data, 599 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 1.13k op/s 2024-01-25T15:03:23.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:23 smithi186 ceph-mon[35697]: pgmap v390: 97 pgs: 97 active+clean; 57 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.6 MiB/s wr, 1.38k op/s 2024-01-25T15:03:23.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:23 smithi170 ceph-mon[31899]: pgmap v390: 97 pgs: 97 active+clean; 57 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.6 MiB/s wr, 1.38k op/s 2024-01-25T15:03:23.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:23 smithi191 ceph-mon[36347]: pgmap v390: 97 pgs: 97 active+clean; 57 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.6 MiB/s wr, 1.38k op/s 2024-01-25T15:03:25.425 INFO:tasks.workunit.client.0.smithi170.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-01-25T15:03:25.427 INFO:tasks.workunit.client.0.smithi170.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-01-25T15:03:25.427 INFO:tasks.workunit.client.0.smithi170.stderr:+ make 2024-01-25T15:03:25.463 INFO:tasks.workunit.client.0.smithi170.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-01-25T15:03:25.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:25 smithi186 ceph-mon[35697]: pgmap v391: 97 pgs: 97 active+clean; 55 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.1 MiB/s wr, 1.46k op/s 2024-01-25T15:03:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:25 smithi170 ceph-mon[31899]: pgmap v391: 97 pgs: 97 active+clean; 55 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.1 MiB/s wr, 1.46k op/s 2024-01-25T15:03:25.708 INFO:tasks.workunit.client.0.smithi170.stderr:++ readlink -f fsstress 2024-01-25T15:03:25.709 INFO:tasks.workunit.client.0.smithi170.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-01-25T15:03:25.709 INFO:tasks.workunit.client.0.smithi170.stderr:+ popd 2024-01-25T15:03:25.710 INFO:tasks.workunit.client.0.smithi170.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-01-25T15:03:25.710 INFO:tasks.workunit.client.0.smithi170.stdout:~/cephtest/mnt.0/client.0/tmp 2024-01-25T15:03:25.710 INFO:tasks.workunit.client.0.smithi170.stderr:+ popd 2024-01-25T15:03:25.711 INFO:tasks.workunit.client.0.smithi170.stderr:++ mktemp -d -p . 2024-01-25T15:03:25.712 INFO:tasks.workunit.client.0.smithi170.stderr:+ T=./tmp.rygrP0nesr 2024-01-25T15:03:25.712 INFO:tasks.workunit.client.0.smithi170.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.rygrP0nesr -l 1 -n 1000 -p 10 -v 2024-01-25T15:03:25.713 INFO:tasks.workunit.client.0.smithi170.stdout:seed = 1706598028 2024-01-25T15:03:25.717 INFO:tasks.workunit.client.0.smithi170.stdout:0/0: mknod c0 0 2024-01-25T15:03:25.717 INFO:tasks.workunit.client.0.smithi170.stdout:2/0: dread - no filename 2024-01-25T15:03:25.718 INFO:tasks.workunit.client.0.smithi170.stdout:2/1: readlink - no filename 2024-01-25T15:03:25.718 INFO:tasks.workunit.client.0.smithi170.stdout:2/2: unlink - no file 2024-01-25T15:03:25.718 INFO:tasks.workunit.client.0.smithi170.stdout:2/3: dwrite - no filename 2024-01-25T15:03:25.718 INFO:tasks.workunit.client.0.smithi170.stdout:2/4: dwrite - no filename 2024-01-25T15:03:25.718 INFO:tasks.workunit.client.0.smithi170.stdout:2/5: rename - no filename 2024-01-25T15:03:25.721 INFO:tasks.workunit.client.0.smithi170.stdout:1/0: mkdir d0 0 2024-01-25T15:03:25.721 INFO:tasks.workunit.client.0.smithi170.stdout:1/1: truncate - no filename 2024-01-25T15:03:25.721 INFO:tasks.workunit.client.0.smithi170.stdout:1/2: chown d0 61877 1 2024-01-25T15:03:25.721 INFO:tasks.workunit.client.0.smithi170.stdout:0/1: creat f1 x:0 0 0 2024-01-25T15:03:25.721 INFO:tasks.workunit.client.0.smithi170.stdout:0/2: chown c0 430934311 1 2024-01-25T15:03:25.721 INFO:tasks.workunit.client.0.smithi170.stdout:0/3: creat f2 x:0 0 0 2024-01-25T15:03:25.722 INFO:tasks.workunit.client.0.smithi170.stdout:3/0: truncate - no filename 2024-01-25T15:03:25.722 INFO:tasks.workunit.client.0.smithi170.stdout:3/1: dread - no filename 2024-01-25T15:03:25.722 INFO:tasks.workunit.client.0.smithi170.stdout:3/2: truncate - no filename 2024-01-25T15:03:25.722 INFO:tasks.workunit.client.0.smithi170.stdout:3/3: dread - no filename 2024-01-25T15:03:25.722 INFO:tasks.workunit.client.0.smithi170.stdout:3/4: write - no filename 2024-01-25T15:03:25.722 INFO:tasks.workunit.client.0.smithi170.stdout:3/5: write - no filename 2024-01-25T15:03:25.723 INFO:tasks.workunit.client.0.smithi170.stdout:3/6: link - no file 2024-01-25T15:03:25.723 INFO:tasks.workunit.client.0.smithi170.stdout:3/7: truncate - no filename 2024-01-25T15:03:25.723 INFO:tasks.workunit.client.0.smithi170.stdout:2/6: symlink l0 0 2024-01-25T15:03:25.723 INFO:tasks.workunit.client.0.smithi170.stdout:2/7: chown l0 929135 1 2024-01-25T15:03:25.723 INFO:tasks.workunit.client.0.smithi170.stdout:2/8: write - no filename 2024-01-25T15:03:25.723 INFO:tasks.workunit.client.0.smithi170.stdout:1/3: creat d0/f1 x:0 0 0 2024-01-25T15:03:25.727 INFO:tasks.workunit.client.0.smithi170.stdout:0/4: symlink l3 0 2024-01-25T15:03:25.727 INFO:tasks.workunit.client.0.smithi170.stdout:0/5: dread - f1 zero size 2024-01-25T15:03:25.727 INFO:tasks.workunit.client.0.smithi170.stdout:0/6: write f2 [55624,23039] 0 2024-01-25T15:03:25.727 INFO:tasks.workunit.client.0.smithi170.stdout:0/7: truncate f1 329850 0 2024-01-25T15:03:25.728 INFO:tasks.workunit.client.0.smithi170.stdout:0/8: creat f4 x:0 0 0 2024-01-25T15:03:25.728 INFO:tasks.workunit.client.0.smithi170.stdout:0/9: dread f1 [0,4194304] 0 2024-01-25T15:03:25.728 INFO:tasks.workunit.client.0.smithi170.stdout:0/10: write f1 [1085332,30176] 0 2024-01-25T15:03:25.728 INFO:tasks.workunit.client.0.smithi170.stdout:0/11: stat f2 0 2024-01-25T15:03:25.728 INFO:tasks.workunit.client.0.smithi170.stdout:0/12: write f2 [448949,109244] 0 2024-01-25T15:03:25.729 INFO:tasks.workunit.client.0.smithi170.stdout:3/8: mknod c0 0 2024-01-25T15:03:25.729 INFO:tasks.workunit.client.0.smithi170.stdout:3/9: chown c0 18310157 1 2024-01-25T15:03:25.729 INFO:tasks.workunit.client.0.smithi170.stdout:3/10: fdatasync - no filename 2024-01-25T15:03:25.729 INFO:tasks.workunit.client.0.smithi170.stdout:0/13: write f1 [317045,19303] 0 2024-01-25T15:03:25.729 INFO:tasks.workunit.client.0.smithi170.stdout:2/9: link l0 l1 0 2024-01-25T15:03:25.729 INFO:tasks.workunit.client.0.smithi170.stdout:2/10: read - no filename 2024-01-25T15:03:25.730 INFO:tasks.workunit.client.0.smithi170.stdout:1/4: mkdir d0/d2 0 2024-01-25T15:03:25.730 INFO:tasks.workunit.client.0.smithi170.stdout:5/0: fsync - no filename 2024-01-25T15:03:25.730 INFO:tasks.workunit.client.0.smithi170.stdout:5/1: write - no filename 2024-01-25T15:03:25.730 INFO:tasks.workunit.client.0.smithi170.stdout:4/0: creat f0 x:0 0 0 2024-01-25T15:03:25.730 INFO:tasks.workunit.client.0.smithi170.stdout:3/11: symlink l1 0 2024-01-25T15:03:25.732 INFO:tasks.workunit.client.0.smithi170.stdout:0/14: rename l3 to l5 0 2024-01-25T15:03:25.732 INFO:tasks.workunit.client.0.smithi170.stdout:2/11: link l0 l2 0 2024-01-25T15:03:25.732 INFO:tasks.workunit.client.0.smithi170.stdout:6/0: link - no file 2024-01-25T15:03:25.733 INFO:tasks.workunit.client.0.smithi170.stdout:5/2: mknod c0 0 2024-01-25T15:03:25.733 INFO:tasks.workunit.client.0.smithi170.stdout:5/3: dread - no filename 2024-01-25T15:03:25.733 INFO:tasks.workunit.client.0.smithi170.stdout:4/1: symlink l1 0 2024-01-25T15:03:25.733 INFO:tasks.workunit.client.0.smithi170.stdout:4/2: write f0 [850166,79762] 0 2024-01-25T15:03:25.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:25 smithi191 ceph-mon[36347]: pgmap v391: 97 pgs: 97 active+clean; 55 MiB data, 606 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.1 MiB/s wr, 1.46k op/s 2024-01-25T15:03:25.734 INFO:tasks.workunit.client.0.smithi170.stdout:3/12: link l1 l2 0 2024-01-25T15:03:25.734 INFO:tasks.workunit.client.0.smithi170.stdout:3/13: truncate - no filename 2024-01-25T15:03:25.735 INFO:tasks.workunit.client.0.smithi170.stdout:2/12: rename l1 to l3 0 2024-01-25T15:03:25.735 INFO:tasks.workunit.client.0.smithi170.stdout:2/13: chown l3 7897 1 2024-01-25T15:03:25.737 INFO:tasks.workunit.client.0.smithi170.stdout:0/15: dread f2 [0,4194304] 0 2024-01-25T15:03:25.738 INFO:tasks.workunit.client.0.smithi170.stdout:6/1: creat f0 x:0 0 0 2024-01-25T15:03:25.738 INFO:tasks.workunit.client.0.smithi170.stdout:6/2: readlink - no filename 2024-01-25T15:03:25.739 INFO:tasks.workunit.client.0.smithi170.stdout:5/4: mknod c1 0 2024-01-25T15:03:25.739 INFO:tasks.workunit.client.0.smithi170.stdout:5/5: dread - no filename 2024-01-25T15:03:25.740 INFO:tasks.workunit.client.0.smithi170.stdout:5/6: fdatasync - no filename 2024-01-25T15:03:25.740 INFO:tasks.workunit.client.0.smithi170.stdout:5/7: chown c0 614979633 1 2024-01-25T15:03:25.740 INFO:tasks.workunit.client.0.smithi170.stdout:3/14: mkdir d3 0 2024-01-25T15:03:25.741 INFO:tasks.workunit.client.0.smithi170.stdout:2/14: mknod c4 0 2024-01-25T15:03:25.742 INFO:tasks.workunit.client.0.smithi170.stdout:8/0: write - no filename 2024-01-25T15:03:25.742 INFO:tasks.workunit.client.0.smithi170.stdout:8/1: link - no file 2024-01-25T15:03:25.743 INFO:tasks.workunit.client.0.smithi170.stdout:8/2: unlink - no file 2024-01-25T15:03:25.744 INFO:tasks.workunit.client.0.smithi170.stdout:7/0: symlink l0 0 2024-01-25T15:03:25.746 INFO:tasks.workunit.client.0.smithi170.stdout:0/16: rename f4 to f6 0 2024-01-25T15:03:25.748 INFO:tasks.workunit.client.0.smithi170.stdout:6/3: link f0 f1 0 2024-01-25T15:03:25.748 INFO:tasks.workunit.client.0.smithi170.stdout:6/4: fdatasync f0 0 2024-01-25T15:03:25.750 INFO:tasks.workunit.client.0.smithi170.stdout:5/8: creat f2 x:0 0 0 2024-01-25T15:03:25.750 INFO:tasks.workunit.client.0.smithi170.stdout:5/9: read - f2 zero size 2024-01-25T15:03:25.751 INFO:tasks.workunit.client.0.smithi170.stdout:1/5: fsync d0/f1 0 2024-01-25T15:03:25.751 INFO:tasks.workunit.client.0.smithi170.stdout:3/15: mknod d3/c4 0 2024-01-25T15:03:25.755 INFO:tasks.workunit.client.0.smithi170.stdout:8/3: creat f0 x:0 0 0 2024-01-25T15:03:25.757 INFO:tasks.workunit.client.0.smithi170.stdout:7/1: rename l0 to l1 0 2024-01-25T15:03:25.757 INFO:tasks.workunit.client.0.smithi170.stdout:7/2: chown l1 4 1 2024-01-25T15:03:25.757 INFO:tasks.workunit.client.0.smithi170.stdout:7/3: write - no filename 2024-01-25T15:03:25.757 INFO:tasks.workunit.client.0.smithi170.stdout:7/4: dwrite - no filename 2024-01-25T15:03:25.759 INFO:tasks.workunit.client.0.smithi170.stdout:5/10: link c0 c3 0 2024-01-25T15:03:25.760 INFO:tasks.workunit.client.0.smithi170.stdout:1/6: rmdir d0/d2 0 2024-01-25T15:03:25.760 INFO:tasks.workunit.client.0.smithi170.stdout:1/7: truncate d0/f1 6258 0 2024-01-25T15:03:25.762 INFO:tasks.workunit.client.0.smithi170.stdout:3/16: creat d3/f5 x:0 0 0 2024-01-25T15:03:25.762 INFO:tasks.workunit.client.0.smithi170.stdout:3/17: write d3/f5 [347735,82339] 0 2024-01-25T15:03:25.762 INFO:tasks.workunit.client.0.smithi170.stdout:3/18: rename d3 to d3/d6 22 2024-01-25T15:03:25.764 INFO:tasks.workunit.client.0.smithi170.stdout:9/0: mknod c0 0 2024-01-25T15:03:25.764 INFO:tasks.workunit.client.0.smithi170.stdout:9/1: dwrite - no filename 2024-01-25T15:03:25.764 INFO:tasks.workunit.client.0.smithi170.stdout:9/2: readlink - no filename 2024-01-25T15:03:25.764 INFO:tasks.workunit.client.0.smithi170.stdout:9/3: fdatasync - no filename 2024-01-25T15:03:25.764 INFO:tasks.workunit.client.0.smithi170.stdout:9/4: dwrite - no filename 2024-01-25T15:03:25.765 INFO:tasks.workunit.client.0.smithi170.stdout:7/5: creat f2 x:0 0 0 2024-01-25T15:03:25.765 INFO:tasks.workunit.client.0.smithi170.stdout:7/6: dread - f2 zero size 2024-01-25T15:03:25.770 INFO:tasks.workunit.client.0.smithi170.stdout:4/3: dwrite f0 [0,4194304] 0 2024-01-25T15:03:25.770 INFO:tasks.workunit.client.0.smithi170.stdout:1/8: symlink d0/l3 0 2024-01-25T15:03:25.772 INFO:tasks.workunit.client.0.smithi170.stdout:9/5: creat f1 x:0 0 0 2024-01-25T15:03:25.772 INFO:tasks.workunit.client.0.smithi170.stdout:9/6: write f1 [554483,20733] 0 2024-01-25T15:03:25.772 INFO:tasks.workunit.client.0.smithi170.stdout:9/7: chown c0 2933236 1 2024-01-25T15:03:25.772 INFO:tasks.workunit.client.0.smithi170.stdout:9/8: chown c0 31 1 2024-01-25T15:03:25.772 INFO:tasks.workunit.client.0.smithi170.stdout:9/9: write f1 [835240,82777] 0 2024-01-25T15:03:25.777 INFO:tasks.workunit.client.0.smithi170.stdout:2/15: rename l3 to l5 0 2024-01-25T15:03:25.777 INFO:tasks.workunit.client.0.smithi170.stdout:2/16: chown c4 0 1 2024-01-25T15:03:25.784 INFO:tasks.workunit.client.0.smithi170.stdout:2/17: creat f6 x:0 0 0 2024-01-25T15:03:25.791 INFO:tasks.workunit.client.0.smithi170.stdout:2/18: symlink l7 0 2024-01-25T15:03:25.791 INFO:tasks.workunit.client.0.smithi170.stdout:2/19: stat l7 0 2024-01-25T15:03:25.792 INFO:tasks.workunit.client.0.smithi170.stdout:2/20: stat c4 0 2024-01-25T15:03:25.792 INFO:tasks.workunit.client.0.smithi170.stdout:2/21: dread - f6 zero size 2024-01-25T15:03:25.792 INFO:tasks.workunit.client.0.smithi170.stdout:2/22: creat f8 x:0 0 0 2024-01-25T15:03:25.877 INFO:tasks.workunit.client.0.smithi170.stdout:9/10: write f1 [173494,70015] 0 2024-01-25T15:03:25.880 INFO:tasks.workunit.client.0.smithi170.stdout:9/11: rename f1 to f2 0 2024-01-25T15:03:25.886 INFO:tasks.workunit.client.0.smithi170.stdout:9/12: symlink l3 0 2024-01-25T15:03:25.886 INFO:tasks.workunit.client.0.smithi170.stdout:9/13: readlink l3 0 2024-01-25T15:03:25.887 INFO:tasks.workunit.client.0.smithi170.stdout:9/14: chown f2 124832 1 2024-01-25T15:03:26.051 INFO:tasks.workunit.client.0.smithi170.stdout:0/17: dread f1 [0,4194304] 0 2024-01-25T15:03:26.208 INFO:tasks.workunit.client.0.smithi170.stdout:8/4: dwrite f0 [0,4194304] 0 2024-01-25T15:03:26.208 INFO:tasks.workunit.client.0.smithi170.stdout:8/5: stat f0 0 2024-01-25T15:03:26.208 INFO:tasks.workunit.client.0.smithi170.stdout:8/6: chown f0 2 1 2024-01-25T15:03:26.209 INFO:tasks.workunit.client.0.smithi170.stdout:8/7: fdatasync f0 0 2024-01-25T15:03:26.225 INFO:tasks.workunit.client.0.smithi170.stdout:3/19: getdents d3 0 2024-01-25T15:03:26.229 INFO:tasks.workunit.client.0.smithi170.stdout:7/7: getdents . 0 2024-01-25T15:03:26.231 INFO:tasks.workunit.client.0.smithi170.stdout:1/9: rmdir d0 39 2024-01-25T15:03:26.290 INFO:tasks.workunit.client.0.smithi170.stdout:9/15: getdents . 0 2024-01-25T15:03:26.314 INFO:tasks.workunit.client.0.smithi170.stdout:5/11: dwrite f2 [0,4194304] 0 2024-01-25T15:03:26.314 INFO:tasks.workunit.client.0.smithi170.stdout:5/12: fdatasync f2 0 2024-01-25T15:03:26.352 INFO:tasks.workunit.client.0.smithi170.stdout:4/4: dwrite f0 [0,4194304] 0 2024-01-25T15:03:26.411 INFO:tasks.workunit.client.0.smithi170.stdout:5/13: write f2 [2188340,29032] 0 2024-01-25T15:03:26.518 INFO:tasks.workunit.client.0.smithi170.stdout:7/8: dwrite f2 [0,4194304] 0 2024-01-25T15:03:26.537 INFO:tasks.workunit.client.0.smithi170.stdout:2/23: dwrite f8 [0,4194304] 0 2024-01-25T15:03:26.537 INFO:tasks.workunit.client.0.smithi170.stdout:2/24: creat f9 x:0 0 0 2024-01-25T15:03:26.561 INFO:tasks.workunit.client.0.smithi170.stdout:4/5: dwrite f0 [0,4194304] 0 2024-01-25T15:03:26.561 INFO:tasks.workunit.client.0.smithi170.stdout:4/6: creat f2 x:0 0 0 2024-01-25T15:03:26.891 INFO:tasks.workunit.client.0.smithi170.stdout:0/18: mknod c7 0 2024-01-25T15:03:26.912 INFO:tasks.workunit.client.0.smithi170.stdout:0/19: dwrite f6 [0,4194304] 0 2024-01-25T15:03:26.912 INFO:tasks.workunit.client.0.smithi170.stdout:0/20: write f2 [674607,65856] 0 2024-01-25T15:03:27.598 INFO:tasks.workunit.client.0.smithi170.stdout:3/20: unlink d3/f5 0 2024-01-25T15:03:27.598 INFO:tasks.workunit.client.0.smithi170.stdout:3/21: write - no filename 2024-01-25T15:03:27.598 INFO:tasks.workunit.client.0.smithi170.stdout:3/22: dread - no filename 2024-01-25T15:03:27.599 INFO:tasks.workunit.client.0.smithi170.stdout:3/23: chown d3 303 1 2024-01-25T15:03:27.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:27 smithi186 ceph-mon[35697]: pgmap v392: 97 pgs: 97 active+clean; 61 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 1.40k op/s 2024-01-25T15:03:27.607 INFO:tasks.workunit.client.0.smithi170.stdout:1/10: creat d0/f4 x:0 0 0 2024-01-25T15:03:27.607 INFO:tasks.workunit.client.0.smithi170.stdout:1/11: write d0/f1 [891793,31609] 0 2024-01-25T15:03:27.608 INFO:tasks.workunit.client.0.smithi170.stdout:1/12: creat d0/f5 x:0 0 0 2024-01-25T15:03:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:27 smithi170 ceph-mon[31899]: pgmap v392: 97 pgs: 97 active+clean; 61 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 1.40k op/s 2024-01-25T15:03:27.635 INFO:tasks.workunit.client.0.smithi170.stdout:1/13: dwrite d0/f5 [0,4194304] 0 2024-01-25T15:03:27.635 INFO:tasks.workunit.client.0.smithi170.stdout:1/14: write d0/f1 [1461986,47901] 0 2024-01-25T15:03:27.654 INFO:tasks.workunit.client.0.smithi170.stdout:1/15: dwrite d0/f4 [0,4194304] 0 2024-01-25T15:03:27.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:27 smithi191 ceph-mon[36347]: pgmap v392: 97 pgs: 97 active+clean; 61 MiB data, 608 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.7 MiB/s wr, 1.40k op/s 2024-01-25T15:03:27.881 INFO:tasks.workunit.client.0.smithi170.stdout:9/16: creat f4 x:0 0 0 2024-01-25T15:03:27.882 INFO:tasks.workunit.client.0.smithi170.stdout:9/17: rmdir - no directory 2024-01-25T15:03:28.463 INFO:tasks.workunit.client.0.smithi170.stdout:5/14: rename c0 to c4 0 2024-01-25T15:03:28.913 INFO:tasks.workunit.client.0.smithi170.stdout:7/9: creat f3 x:0 0 0 2024-01-25T15:03:28.914 INFO:tasks.workunit.client.0.smithi170.stdout:7/10: write f3 [19672,21775] 0 2024-01-25T15:03:28.914 INFO:tasks.workunit.client.0.smithi170.stdout:7/11: chown f2 1365 1 2024-01-25T15:03:28.958 INFO:tasks.workunit.client.0.smithi170.stdout:2/25: symlink la 0 2024-01-25T15:03:28.958 INFO:tasks.workunit.client.0.smithi170.stdout:2/26: read - f9 zero size 2024-01-25T15:03:28.958 INFO:tasks.workunit.client.0.smithi170.stdout:2/27: fdatasync f6 0 2024-01-25T15:03:28.958 INFO:tasks.workunit.client.0.smithi170.stdout:2/28: fsync f6 0 2024-01-25T15:03:28.986 INFO:tasks.workunit.client.0.smithi170.stdout:4/7: symlink l3 0 2024-01-25T15:03:29.156 INFO:tasks.workunit.client.0.smithi170.stdout:0/21: mkdir d8 0 2024-01-25T15:03:29.157 INFO:tasks.workunit.client.0.smithi170.stdout:0/22: fsync f2 0 2024-01-25T15:03:29.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:29 smithi186 ceph-mon[35697]: pgmap v393: 97 pgs: 97 active+clean; 78 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.3 MiB/s wr, 1.38k op/s 2024-01-25T15:03:29.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:29 smithi170 ceph-mon[31899]: pgmap v393: 97 pgs: 97 active+clean; 78 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.3 MiB/s wr, 1.38k op/s 2024-01-25T15:03:29.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:29 smithi191 ceph-mon[36347]: pgmap v393: 97 pgs: 97 active+clean; 78 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.3 MiB/s wr, 1.38k op/s 2024-01-25T15:03:29.728 INFO:tasks.workunit.client.0.smithi170.stdout:3/24: creat d3/f7 x:0 0 0 2024-01-25T15:03:29.728 INFO:tasks.workunit.client.0.smithi170.stdout:3/25: chown d3/c4 118181957 1 2024-01-25T15:03:29.731 INFO:tasks.workunit.client.0.smithi170.stdout:9/18: mkdir d5 0 2024-01-25T15:03:29.733 INFO:tasks.workunit.client.0.smithi170.stdout:5/15: mkdir d5 0 2024-01-25T15:03:29.733 INFO:tasks.workunit.client.0.smithi170.stdout:5/16: chown c1 26623 1 2024-01-25T15:03:29.734 INFO:tasks.workunit.client.0.smithi170.stdout:7/12: mknod c4 0 2024-01-25T15:03:29.734 INFO:tasks.workunit.client.0.smithi170.stdout:7/13: write f3 [731781,49656] 0 2024-01-25T15:03:29.735 INFO:tasks.workunit.client.0.smithi170.stdout:7/14: write f3 [604793,2743] 0 2024-01-25T15:03:29.736 INFO:tasks.workunit.client.0.smithi170.stdout:2/29: mknod cb 0 2024-01-25T15:03:29.736 INFO:tasks.workunit.client.0.smithi170.stdout:2/30: write f6 [160753,68687] 0 2024-01-25T15:03:29.740 INFO:tasks.workunit.client.0.smithi170.stdout:0/23: mkdir d8/d9 0 2024-01-25T15:03:29.740 INFO:tasks.workunit.client.0.smithi170.stdout:0/24: fsync f1 0 2024-01-25T15:03:29.740 INFO:tasks.workunit.client.0.smithi170.stdout:3/26: mkdir d3/d8 0 2024-01-25T15:03:29.742 INFO:tasks.workunit.client.0.smithi170.stdout:1/16: unlink d0/f4 0 2024-01-25T15:03:29.742 INFO:tasks.workunit.client.0.smithi170.stdout:1/17: creat d0/f6 x:0 0 0 2024-01-25T15:03:29.742 INFO:tasks.workunit.client.0.smithi170.stdout:1/18: fdatasync d0/f5 0 2024-01-25T15:03:29.743 INFO:tasks.workunit.client.0.smithi170.stdout:5/17: dread f2 [0,4194304] 0 2024-01-25T15:03:29.743 INFO:tasks.workunit.client.0.smithi170.stdout:5/18: write f2 [1747820,40013] 0 2024-01-25T15:03:29.743 INFO:tasks.workunit.client.0.smithi170.stdout:9/19: symlink d5/l6 0 2024-01-25T15:03:29.745 INFO:tasks.workunit.client.0.smithi170.stdout:5/19: creat d5/f6 x:0 0 0 2024-01-25T15:03:29.745 INFO:tasks.workunit.client.0.smithi170.stdout:5/20: fdatasync d5/f6 0 2024-01-25T15:03:29.745 INFO:tasks.workunit.client.0.smithi170.stdout:5/21: stat c1 0 2024-01-25T15:03:29.746 INFO:tasks.workunit.client.0.smithi170.stdout:5/22: link f2 d5/f7 0 2024-01-25T15:03:29.747 INFO:tasks.workunit.client.0.smithi170.stdout:5/23: write d5/f7 [1010926,100971] 0 2024-01-25T15:03:29.747 INFO:tasks.workunit.client.0.smithi170.stdout:0/25: dread f1 [0,4194304] 0 2024-01-25T15:03:29.748 INFO:tasks.workunit.client.0.smithi170.stdout:5/24: rename d5/f6 to d5/f8 0 2024-01-25T15:03:29.750 INFO:tasks.workunit.client.0.smithi170.stdout:0/26: creat d8/fa x:0 0 0 2024-01-25T15:03:29.752 INFO:tasks.workunit.client.0.smithi170.stdout:5/25: symlink d5/l9 0 2024-01-25T15:03:29.762 INFO:tasks.workunit.client.0.smithi170.stdout:5/26: dread d5/f7 [0,4194304] 0 2024-01-25T15:03:29.765 INFO:tasks.workunit.client.0.smithi170.stdout:9/20: dread f2 [0,4194304] 0 2024-01-25T15:03:29.765 INFO:tasks.workunit.client.0.smithi170.stdout:9/21: truncate f4 651467 0 2024-01-25T15:03:29.769 INFO:tasks.workunit.client.0.smithi170.stdout:2/31: dwrite f8 [0,4194304] 0 2024-01-25T15:03:29.772 INFO:tasks.workunit.client.0.smithi170.stdout:2/32: mknod cc 0 2024-01-25T15:03:29.772 INFO:tasks.workunit.client.0.smithi170.stdout:2/33: symlink ld 0 2024-01-25T15:03:29.773 INFO:tasks.workunit.client.0.smithi170.stdout:2/34: mknod ce 0 2024-01-25T15:03:29.774 INFO:tasks.workunit.client.0.smithi170.stdout:2/35: rmdir - no directory 2024-01-25T15:03:29.775 INFO:tasks.workunit.client.0.smithi170.stdout:7/15: dwrite f2 [0,4194304] 0 2024-01-25T15:03:29.775 INFO:tasks.workunit.client.0.smithi170.stdout:1/19: write d0/f5 [3617704,106189] 0 2024-01-25T15:03:29.777 INFO:tasks.workunit.client.0.smithi170.stdout:3/27: dwrite d3/f7 [0,4194304] 0 2024-01-25T15:03:29.777 INFO:tasks.workunit.client.0.smithi170.stdout:3/28: fdatasync d3/f7 0 2024-01-25T15:03:29.777 INFO:tasks.workunit.client.0.smithi170.stdout:3/29: readlink l1 0 2024-01-25T15:03:29.778 INFO:tasks.workunit.client.0.smithi170.stdout:7/16: symlink l5 0 2024-01-25T15:03:29.779 INFO:tasks.workunit.client.0.smithi170.stdout:1/20: rename d0/l3 to d0/l7 0 2024-01-25T15:03:29.786 INFO:tasks.workunit.client.0.smithi170.stdout:3/30: rename l1 to d3/l9 0 2024-01-25T15:03:29.786 INFO:tasks.workunit.client.0.smithi170.stdout:3/31: creat d3/fa x:0 0 0 2024-01-25T15:03:29.786 INFO:tasks.workunit.client.0.smithi170.stdout:9/22: dwrite f2 [0,4194304] 0 2024-01-25T15:03:29.786 INFO:tasks.workunit.client.0.smithi170.stdout:7/17: mknod c6 0 2024-01-25T15:03:29.788 INFO:tasks.workunit.client.0.smithi170.stdout:1/21: symlink d0/l8 0 2024-01-25T15:03:29.788 INFO:tasks.workunit.client.0.smithi170.stdout:1/22: write d0/f5 [3238902,85058] 0 2024-01-25T15:03:29.788 INFO:tasks.workunit.client.0.smithi170.stdout:1/23: write d0/f6 [512364,113047] 0 2024-01-25T15:03:29.788 INFO:tasks.workunit.client.0.smithi170.stdout:1/24: fdatasync d0/f1 0 2024-01-25T15:03:29.788 INFO:tasks.workunit.client.0.smithi170.stdout:1/25: creat d0/f9 x:0 0 0 2024-01-25T15:03:29.790 INFO:tasks.workunit.client.0.smithi170.stdout:3/32: rename d3/c4 to d3/cb 0 2024-01-25T15:03:29.793 INFO:tasks.workunit.client.0.smithi170.stdout:9/23: mknod d5/c7 0 2024-01-25T15:03:29.797 INFO:tasks.workunit.client.0.smithi170.stdout:1/26: rename d0/l8 to d0/la 0 2024-01-25T15:03:29.797 INFO:tasks.workunit.client.0.smithi170.stdout:1/27: chown d0/f5 53 1 2024-01-25T15:03:29.798 INFO:tasks.workunit.client.0.smithi170.stdout:3/33: mknod d3/cc 0 2024-01-25T15:03:29.798 INFO:tasks.workunit.client.0.smithi170.stdout:3/34: creat d3/fd x:0 0 0 2024-01-25T15:03:29.798 INFO:tasks.workunit.client.0.smithi170.stdout:3/35: dread - d3/fa zero size 2024-01-25T15:03:29.801 INFO:tasks.workunit.client.0.smithi170.stdout:1/28: unlink d0/f6 0 2024-01-25T15:03:29.801 INFO:tasks.workunit.client.0.smithi170.stdout:1/29: readlink d0/la 0 2024-01-25T15:03:29.807 INFO:tasks.workunit.client.0.smithi170.stdout:1/30: dread d0/f1 [0,4194304] 0 2024-01-25T15:03:29.807 INFO:tasks.workunit.client.0.smithi170.stdout:1/31: creat d0/fb x:0 0 0 2024-01-25T15:03:29.809 INFO:tasks.workunit.client.0.smithi170.stdout:1/32: unlink d0/f1 0 2024-01-25T15:03:29.817 INFO:tasks.workunit.client.0.smithi170.stdout:1/33: dread d0/f5 [0,4194304] 0 2024-01-25T15:03:29.836 INFO:tasks.workunit.client.0.smithi170.stdout:2/36: write f8 [4376801,102967] 0 2024-01-25T15:03:29.836 INFO:tasks.workunit.client.0.smithi170.stdout:2/37: creat ff x:0 0 0 2024-01-25T15:03:29.839 INFO:tasks.workunit.client.0.smithi170.stdout:2/38: mkdir d10 0 2024-01-25T15:03:29.839 INFO:tasks.workunit.client.0.smithi170.stdout:2/39: mknod d10/c11 0 2024-01-25T15:03:30.175 INFO:tasks.workunit.client.0.smithi170.stdout:0/27: fsync d8/fa 0 2024-01-25T15:03:30.175 INFO:tasks.workunit.client.0.smithi170.stdout:5/27: rmdir d5 39 2024-01-25T15:03:30.177 INFO:tasks.workunit.client.0.smithi170.stdout:0/28: symlink d8/lb 0 2024-01-25T15:03:30.177 INFO:tasks.workunit.client.0.smithi170.stdout:0/29: chown d8/d9 2669 1 2024-01-25T15:03:30.178 INFO:tasks.workunit.client.0.smithi170.stdout:0/30: write f2 [616491,16769] 0 2024-01-25T15:03:30.178 INFO:tasks.workunit.client.0.smithi170.stdout:0/31: write f1 [1619730,61067] 0 2024-01-25T15:03:30.179 INFO:tasks.workunit.client.0.smithi170.stdout:0/32: truncate f2 1672869 0 2024-01-25T15:03:30.185 INFO:tasks.workunit.client.0.smithi170.stdout:9/24: truncate f2 1702334 0 2024-01-25T15:03:30.191 INFO:tasks.workunit.client.0.smithi170.stdout:3/36: getdents d3 0 2024-01-25T15:03:30.191 INFO:tasks.workunit.client.0.smithi170.stdout:3/37: dread - d3/fd zero size 2024-01-25T15:03:30.191 INFO:tasks.workunit.client.0.smithi170.stdout:3/38: chown d3/cc 1 1 2024-01-25T15:03:30.194 INFO:tasks.workunit.client.0.smithi170.stdout:3/39: unlink d3/cb 0 2024-01-25T15:03:30.195 INFO:tasks.workunit.client.0.smithi170.stdout:3/40: write d3/fd [674096,49653] 0 2024-01-25T15:03:30.196 INFO:tasks.workunit.client.0.smithi170.stdout:1/34: rmdir d0 39 2024-01-25T15:03:30.199 INFO:tasks.workunit.client.0.smithi170.stdout:1/35: mknod d0/cc 0 2024-01-25T15:03:30.202 INFO:tasks.workunit.client.0.smithi170.stdout:1/36: creat d0/fd x:0 0 0 2024-01-25T15:03:30.202 INFO:tasks.workunit.client.0.smithi170.stdout:1/37: truncate d0/f9 997911 0 2024-01-25T15:03:30.202 INFO:tasks.workunit.client.0.smithi170.stdout:1/38: creat d0/fe x:0 0 0 2024-01-25T15:03:30.202 INFO:tasks.workunit.client.0.smithi170.stdout:1/39: creat d0/ff x:0 0 0 2024-01-25T15:03:30.202 INFO:tasks.workunit.client.0.smithi170.stdout:1/40: dread - d0/fb zero size 2024-01-25T15:03:30.202 INFO:tasks.workunit.client.0.smithi170.stdout:1/41: write d0/ff [994237,95204] 0 2024-01-25T15:03:30.202 INFO:tasks.workunit.client.0.smithi170.stdout:2/40: getdents d10 0 2024-01-25T15:03:30.202 INFO:tasks.workunit.client.0.smithi170.stdout:2/41: chown l2 187277581 1 2024-01-25T15:03:30.202 INFO:tasks.workunit.client.0.smithi170.stdout:2/42: stat d10 0 2024-01-25T15:03:30.202 INFO:tasks.workunit.client.0.smithi170.stdout:2/43: getdents d10 0 2024-01-25T15:03:30.202 INFO:tasks.workunit.client.0.smithi170.stdout:2/44: write f6 [1108921,73000] 0 2024-01-25T15:03:30.202 INFO:tasks.workunit.client.0.smithi170.stdout:2/45: write f6 [204973,75883] 0 2024-01-25T15:03:30.202 INFO:tasks.workunit.client.0.smithi170.stdout:2/46: write ff [489494,29642] 0 2024-01-25T15:03:30.203 INFO:tasks.workunit.client.0.smithi170.stdout:2/47: write f6 [555327,93607] 0 2024-01-25T15:03:30.208 INFO:tasks.workunit.client.0.smithi170.stdout:5/28: dwrite d5/f8 [0,4194304] 0 2024-01-25T15:03:30.208 INFO:tasks.workunit.client.0.smithi170.stdout:0/33: dwrite d8/fa [0,4194304] 0 2024-01-25T15:03:30.208 INFO:tasks.workunit.client.0.smithi170.stdout:0/34: fsync f6 0 2024-01-25T15:03:30.209 INFO:tasks.workunit.client.0.smithi170.stdout:2/48: creat d10/f12 x:0 0 0 2024-01-25T15:03:30.213 INFO:tasks.workunit.client.0.smithi170.stdout:5/29: mknod d5/ca 0 2024-01-25T15:03:30.216 INFO:tasks.workunit.client.0.smithi170.stdout:3/41: write d3/f7 [914577,68613] 0 2024-01-25T15:03:30.216 INFO:tasks.workunit.client.0.smithi170.stdout:2/49: unlink l5 0 2024-01-25T15:03:30.217 INFO:tasks.workunit.client.0.smithi170.stdout:5/30: creat d5/fb x:0 0 0 2024-01-25T15:03:30.217 INFO:tasks.workunit.client.0.smithi170.stdout:5/31: write d5/f7 [1833508,11863] 0 2024-01-25T15:03:30.220 INFO:tasks.workunit.client.0.smithi170.stdout:2/50: fsync f8 0 2024-01-25T15:03:30.221 INFO:tasks.workunit.client.0.smithi170.stdout:5/32: mknod d5/cc 0 2024-01-25T15:03:30.221 INFO:tasks.workunit.client.0.smithi170.stdout:5/33: creat d5/fd x:0 0 0 2024-01-25T15:03:30.221 INFO:tasks.workunit.client.0.smithi170.stdout:5/34: write d5/f7 [387043,40331] 0 2024-01-25T15:03:30.221 INFO:tasks.workunit.client.0.smithi170.stdout:5/35: creat d5/fe x:0 0 0 2024-01-25T15:03:30.221 INFO:tasks.workunit.client.0.smithi170.stdout:5/36: chown c1 64535823 1 2024-01-25T15:03:30.223 INFO:tasks.workunit.client.0.smithi170.stdout:3/42: creat d3/d8/fe x:0 0 0 2024-01-25T15:03:30.223 INFO:tasks.workunit.client.0.smithi170.stdout:3/43: creat d3/d8/ff x:0 0 0 2024-01-25T15:03:30.226 INFO:tasks.workunit.client.0.smithi170.stdout:5/37: rename d5/f8 to d5/ff 0 2024-01-25T15:03:30.226 INFO:tasks.workunit.client.0.smithi170.stdout:5/38: write d5/fb [640969,102947] 0 2024-01-25T15:03:30.226 INFO:tasks.workunit.client.0.smithi170.stdout:5/39: readlink d5/l9 0 2024-01-25T15:03:30.226 INFO:tasks.workunit.client.0.smithi170.stdout:5/40: write d5/f7 [3273240,68042] 0 2024-01-25T15:03:30.227 INFO:tasks.workunit.client.0.smithi170.stdout:3/44: dread - d3/fa zero size 2024-01-25T15:03:30.227 INFO:tasks.workunit.client.0.smithi170.stdout:3/45: write d3/d8/ff [229271,100732] 0 2024-01-25T15:03:30.228 INFO:tasks.workunit.client.0.smithi170.stdout:5/41: mkdir d5/d10 0 2024-01-25T15:03:30.230 INFO:tasks.workunit.client.0.smithi170.stdout:0/35: dwrite f1 [0,4194304] 0 2024-01-25T15:03:30.230 INFO:tasks.workunit.client.0.smithi170.stdout:0/36: rename d8/d9 to d8/d9/dc 22 2024-01-25T15:03:30.241 INFO:tasks.workunit.client.0.smithi170.stdout:0/37: read f6 [2370911,115775] 0 2024-01-25T15:03:30.243 INFO:tasks.workunit.client.0.smithi170.stdout:0/38: symlink d8/d9/ld 0 2024-01-25T15:03:30.245 INFO:tasks.workunit.client.0.smithi170.stdout:0/39: link d8/fa d8/d9/fe 0 2024-01-25T15:03:30.245 INFO:tasks.workunit.client.0.smithi170.stdout:0/40: chown d8 252834 1 2024-01-25T15:03:30.249 INFO:tasks.workunit.client.0.smithi170.stdout:6/5: sync 2024-01-25T15:03:30.249 INFO:tasks.workunit.client.0.smithi170.stdout:4/8: sync 2024-01-25T15:03:30.249 INFO:tasks.workunit.client.0.smithi170.stdout:8/8: sync 2024-01-25T15:03:30.249 INFO:tasks.workunit.client.0.smithi170.stdout:6/6: write f1 [68217,88155] 0 2024-01-25T15:03:30.251 INFO:tasks.workunit.client.0.smithi170.stdout:4/9: mknod c4 0 2024-01-25T15:03:30.251 INFO:tasks.workunit.client.0.smithi170.stdout:4/10: rmdir - no directory 2024-01-25T15:03:30.252 INFO:tasks.workunit.client.0.smithi170.stdout:6/7: mkdir d2 0 2024-01-25T15:03:30.252 INFO:tasks.workunit.client.0.smithi170.stdout:0/41: dread f6 [0,4194304] 0 2024-01-25T15:03:30.252 INFO:tasks.workunit.client.0.smithi170.stdout:0/42: creat d8/ff x:0 0 0 2024-01-25T15:03:30.254 INFO:tasks.workunit.client.0.smithi170.stdout:2/51: dwrite f6 [0,4194304] 0 2024-01-25T15:03:30.254 INFO:tasks.workunit.client.0.smithi170.stdout:2/52: write ff [1529868,6980] 0 2024-01-25T15:03:30.254 INFO:tasks.workunit.client.0.smithi170.stdout:2/53: chown cb 248 1 2024-01-25T15:03:30.261 INFO:tasks.workunit.client.0.smithi170.stdout:5/42: dwrite d5/fb [0,4194304] 0 2024-01-25T15:03:30.273 INFO:tasks.workunit.client.0.smithi170.stdout:4/11: dread f0 [0,4194304] 0 2024-01-25T15:03:30.273 INFO:tasks.workunit.client.0.smithi170.stdout:4/12: write f2 [890183,29088] 0 2024-01-25T15:03:30.287 INFO:tasks.workunit.client.0.smithi170.stdout:2/54: dwrite f8 [0,4194304] 0 2024-01-25T15:03:30.287 INFO:tasks.workunit.client.0.smithi170.stdout:2/55: chown f8 122755992 1 2024-01-25T15:03:30.288 INFO:tasks.workunit.client.0.smithi170.stdout:8/9: dwrite f0 [0,4194304] 0 2024-01-25T15:03:30.293 INFO:tasks.workunit.client.0.smithi170.stdout:7/18: sync 2024-01-25T15:03:30.293 INFO:tasks.workunit.client.0.smithi170.stdout:7/19: creat f7 x:0 0 0 2024-01-25T15:03:30.299 INFO:tasks.workunit.client.0.smithi170.stdout:7/20: mkdir d8 0 2024-01-25T15:03:30.299 INFO:tasks.workunit.client.0.smithi170.stdout:7/21: chown c4 166 1 2024-01-25T15:03:30.299 INFO:tasks.workunit.client.0.smithi170.stdout:7/22: chown c6 504 1 2024-01-25T15:03:30.304 INFO:tasks.workunit.client.0.smithi170.stdout:1/42: getdents d0 0 2024-01-25T15:03:30.305 INFO:tasks.workunit.client.0.smithi170.stdout:6/8: dwrite f0 [0,4194304] 0 2024-01-25T15:03:30.306 INFO:tasks.workunit.client.0.smithi170.stdout:7/23: link f7 d8/f9 0 2024-01-25T15:03:30.313 INFO:tasks.workunit.client.0.smithi170.stdout:1/43: mknod d0/c10 0 2024-01-25T15:03:30.315 INFO:tasks.workunit.client.0.smithi170.stdout:2/56: rmdir d10 39 2024-01-25T15:03:30.315 INFO:tasks.workunit.client.0.smithi170.stdout:2/57: fsync f8 0 2024-01-25T15:03:30.318 INFO:tasks.workunit.client.0.smithi170.stdout:7/24: creat d8/fa x:0 0 0 2024-01-25T15:03:30.318 INFO:tasks.workunit.client.0.smithi170.stdout:7/25: fdatasync f3 0 2024-01-25T15:03:30.318 INFO:tasks.workunit.client.0.smithi170.stdout:7/26: stat d8/fa 0 2024-01-25T15:03:30.318 INFO:tasks.workunit.client.0.smithi170.stdout:7/27: chown l1 25 1 2024-01-25T15:03:30.322 INFO:tasks.workunit.client.0.smithi170.stdout:2/58: creat d10/f13 x:0 0 0 2024-01-25T15:03:30.324 INFO:tasks.workunit.client.0.smithi170.stdout:7/28: link c4 d8/cb 0 2024-01-25T15:03:30.324 INFO:tasks.workunit.client.0.smithi170.stdout:7/29: truncate f7 982717 0 2024-01-25T15:03:30.326 INFO:tasks.workunit.client.0.smithi170.stdout:8/10: dwrite f0 [0,4194304] 0 2024-01-25T15:03:30.326 INFO:tasks.workunit.client.0.smithi170.stdout:8/11: creat f1 x:0 0 0 2024-01-25T15:03:30.326 INFO:tasks.workunit.client.0.smithi170.stdout:8/12: fdatasync f0 0 2024-01-25T15:03:30.327 INFO:tasks.workunit.client.0.smithi170.stdout:8/13: chown f0 20539 1 2024-01-25T15:03:30.327 INFO:tasks.workunit.client.0.smithi170.stdout:9/25: dwrite f2 [0,4194304] 0 2024-01-25T15:03:30.327 INFO:tasks.workunit.client.0.smithi170.stdout:9/26: write f4 [706288,50446] 0 2024-01-25T15:03:30.330 INFO:tasks.workunit.client.0.smithi170.stdout:6/9: dwrite f0 [0,4194304] 0 2024-01-25T15:03:30.332 INFO:tasks.workunit.client.0.smithi170.stdout:9/27: creat d5/f8 x:0 0 0 2024-01-25T15:03:30.335 INFO:tasks.workunit.client.0.smithi170.stdout:8/14: unlink f1 0 2024-01-25T15:03:30.335 INFO:tasks.workunit.client.0.smithi170.stdout:3/46: fsync d3/d8/ff 0 2024-01-25T15:03:30.336 INFO:tasks.workunit.client.0.smithi170.stdout:6/10: creat d2/f3 x:0 0 0 2024-01-25T15:03:30.336 INFO:tasks.workunit.client.0.smithi170.stdout:6/11: creat d2/f4 x:0 0 0 2024-01-25T15:03:30.337 INFO:tasks.workunit.client.0.smithi170.stdout:3/47: read d3/fd [427704,48801] 0 2024-01-25T15:03:30.339 INFO:tasks.workunit.client.0.smithi170.stdout:8/15: link f0 f2 0 2024-01-25T15:03:30.342 INFO:tasks.workunit.client.0.smithi170.stdout:8/16: mkdir d3 0 2024-01-25T15:03:30.343 INFO:tasks.workunit.client.0.smithi170.stdout:7/30: write f2 [2128397,118239] 0 2024-01-25T15:03:30.344 INFO:tasks.workunit.client.0.smithi170.stdout:7/31: creat d8/fc x:0 0 0 2024-01-25T15:03:30.350 INFO:tasks.workunit.client.0.smithi170.stdout:0/43: truncate f2 436460 0 2024-01-25T15:03:30.350 INFO:tasks.workunit.client.0.smithi170.stdout:9/28: dwrite d5/f8 [0,4194304] 0 2024-01-25T15:03:30.362 INFO:tasks.workunit.client.0.smithi170.stdout:7/32: fsync d8/f9 0 2024-01-25T15:03:30.363 INFO:tasks.workunit.client.0.smithi170.stdout:1/44: getdents d0 0 2024-01-25T15:03:30.363 INFO:tasks.workunit.client.0.smithi170.stdout:1/45: truncate d0/fb 843855 0 2024-01-25T15:03:30.363 INFO:tasks.workunit.client.0.smithi170.stdout:1/46: dread - d0/fe zero size 2024-01-25T15:03:30.363 INFO:tasks.workunit.client.0.smithi170.stdout:1/47: readlink d0/la 0 2024-01-25T15:03:30.363 INFO:tasks.workunit.client.0.smithi170.stdout:3/48: dwrite d3/d8/fe [0,4194304] 0 2024-01-25T15:03:30.364 INFO:tasks.workunit.client.0.smithi170.stdout:7/33: mkdir d8/dd 0 2024-01-25T15:03:30.364 INFO:tasks.workunit.client.0.smithi170.stdout:7/34: creat d8/fe x:0 0 0 2024-01-25T15:03:30.364 INFO:tasks.workunit.client.0.smithi170.stdout:7/35: creat d8/ff x:0 0 0 2024-01-25T15:03:30.369 INFO:tasks.workunit.client.0.smithi170.stdout:0/44: dwrite d8/ff [0,4194304] 0 2024-01-25T15:03:30.369 INFO:tasks.workunit.client.0.smithi170.stdout:2/59: getdents d10 0 2024-01-25T15:03:30.369 INFO:tasks.workunit.client.0.smithi170.stdout:2/60: read - f9 zero size 2024-01-25T15:03:30.372 INFO:tasks.workunit.client.0.smithi170.stdout:7/36: mknod d8/c10 0 2024-01-25T15:03:30.374 INFO:tasks.workunit.client.0.smithi170.stdout:3/49: write d3/d8/fe [2722544,69276] 0 2024-01-25T15:03:30.374 INFO:tasks.workunit.client.0.smithi170.stdout:3/50: write d3/fd [1680831,13931] 0 2024-01-25T15:03:30.375 INFO:tasks.workunit.client.0.smithi170.stdout:3/51: write d3/fd [2412498,110859] 0 2024-01-25T15:03:30.376 INFO:tasks.workunit.client.0.smithi170.stdout:0/45: mkdir d8/d10 0 2024-01-25T15:03:30.379 INFO:tasks.workunit.client.0.smithi170.stdout:2/61: rename ld to d10/l14 0 2024-01-25T15:03:30.381 INFO:tasks.workunit.client.0.smithi170.stdout:2/62: read ff [1011837,74397] 0 2024-01-25T15:03:30.381 INFO:tasks.workunit.client.0.smithi170.stdout:2/63: fsync f8 0 2024-01-25T15:03:30.381 INFO:tasks.workunit.client.0.smithi170.stdout:2/64: chown ce 0 1 2024-01-25T15:03:30.381 INFO:tasks.workunit.client.0.smithi170.stdout:7/37: rmdir d8/dd 0 2024-01-25T15:03:30.383 INFO:tasks.workunit.client.0.smithi170.stdout:6/12: truncate f1 1771849 0 2024-01-25T15:03:30.390 INFO:tasks.workunit.client.0.smithi170.stdout:8/17: truncate f0 1682218 0 2024-01-25T15:03:30.390 INFO:tasks.workunit.client.0.smithi170.stdout:7/38: mknod d8/c11 0 2024-01-25T15:03:30.394 INFO:tasks.workunit.client.0.smithi170.stdout:2/65: link cb d10/c15 0 2024-01-25T15:03:30.399 INFO:tasks.workunit.client.0.smithi170.stdout:9/29: truncate d5/f8 627634 0 2024-01-25T15:03:30.400 INFO:tasks.workunit.client.0.smithi170.stdout:3/52: rename d3/d8 to d3/d10 0 2024-01-25T15:03:30.401 INFO:tasks.workunit.client.0.smithi170.stdout:3/53: write d3/f7 [735046,82811] 0 2024-01-25T15:03:30.402 INFO:tasks.workunit.client.0.smithi170.stdout:2/66: mkdir d10/d16 0 2024-01-25T15:03:30.403 INFO:tasks.workunit.client.0.smithi170.stdout:9/30: symlink d5/l9 0 2024-01-25T15:03:30.407 INFO:tasks.workunit.client.0.smithi170.stdout:2/67: truncate d10/f13 637149 0 2024-01-25T15:03:30.407 INFO:tasks.workunit.client.0.smithi170.stdout:9/31: truncate f4 514849 0 2024-01-25T15:03:30.407 INFO:tasks.workunit.client.0.smithi170.stdout:9/32: creat d5/fa x:0 0 0 2024-01-25T15:03:30.409 INFO:tasks.workunit.client.0.smithi170.stdout:6/13: dwrite d2/f4 [0,4194304] 0 2024-01-25T15:03:30.409 INFO:tasks.workunit.client.0.smithi170.stdout:6/14: creat d2/f5 x:0 0 0 2024-01-25T15:03:30.409 INFO:tasks.workunit.client.0.smithi170.stdout:3/54: mknod d3/c11 0 2024-01-25T15:03:30.411 INFO:tasks.workunit.client.0.smithi170.stdout:0/46: write d8/fa [219109,96346] 0 2024-01-25T15:03:30.416 INFO:tasks.workunit.client.0.smithi170.stdout:7/39: dwrite d8/ff [0,4194304] 0 2024-01-25T15:03:30.423 INFO:tasks.workunit.client.0.smithi170.stdout:7/40: rmdir d8 39 2024-01-25T15:03:30.426 INFO:tasks.workunit.client.0.smithi170.stdout:7/41: creat d8/f12 x:0 0 0 2024-01-25T15:03:30.426 INFO:tasks.workunit.client.0.smithi170.stdout:7/42: creat d8/f13 x:0 0 0 2024-01-25T15:03:30.427 INFO:tasks.workunit.client.0.smithi170.stdout:7/43: write f3 [769583,40149] 0 2024-01-25T15:03:30.427 INFO:tasks.workunit.client.0.smithi170.stdout:2/68: write f8 [1065429,59154] 0 2024-01-25T15:03:30.428 INFO:tasks.workunit.client.0.smithi170.stdout:3/55: dwrite d3/fa [0,4194304] 0 2024-01-25T15:03:30.430 INFO:tasks.workunit.client.0.smithi170.stdout:5/43: sync 2024-01-25T15:03:30.430 INFO:tasks.workunit.client.0.smithi170.stdout:5/44: chown d5/f7 219 1 2024-01-25T15:03:30.433 INFO:tasks.workunit.client.0.smithi170.stdout:7/44: unlink d8/ff 0 2024-01-25T15:03:30.433 INFO:tasks.workunit.client.0.smithi170.stdout:7/45: dread - d8/f12 zero size 2024-01-25T15:03:30.433 INFO:tasks.workunit.client.0.smithi170.stdout:7/46: dread - d8/fe zero size 2024-01-25T15:03:30.435 INFO:tasks.workunit.client.0.smithi170.stdout:2/69: write d10/f12 [644908,37999] 0 2024-01-25T15:03:30.440 INFO:tasks.workunit.client.0.smithi170.stdout:0/47: dread d8/fa [0,4194304] 0 2024-01-25T15:03:30.442 INFO:tasks.workunit.client.0.smithi170.stdout:0/48: unlink f1 0 2024-01-25T15:03:30.443 INFO:tasks.workunit.client.0.smithi170.stdout:2/70: symlink d10/l17 0 2024-01-25T15:03:30.443 INFO:tasks.workunit.client.0.smithi170.stdout:2/71: write d10/f13 [737280,1862] 0 2024-01-25T15:03:30.445 INFO:tasks.workunit.client.0.smithi170.stdout:2/72: creat d10/f18 x:0 0 0 2024-01-25T15:03:30.447 INFO:tasks.workunit.client.0.smithi170.stdout:6/15: dwrite f1 [0,4194304] 0 2024-01-25T15:03:30.447 INFO:tasks.workunit.client.0.smithi170.stdout:6/16: truncate d2/f5 872162 0 2024-01-25T15:03:30.447 INFO:tasks.workunit.client.0.smithi170.stdout:2/73: creat d10/d16/f19 x:0 0 0 2024-01-25T15:03:30.447 INFO:tasks.workunit.client.0.smithi170.stdout:2/74: chown d10/l17 254402 1 2024-01-25T15:03:30.452 INFO:tasks.workunit.client.0.smithi170.stdout:3/56: dread d3/f7 [0,4194304] 0 2024-01-25T15:03:30.452 INFO:tasks.workunit.client.0.smithi170.stdout:6/17: link f0 d2/f6 0 2024-01-25T15:03:30.452 INFO:tasks.workunit.client.0.smithi170.stdout:7/47: dread f2 [0,4194304] 0 2024-01-25T15:03:30.455 INFO:tasks.workunit.client.0.smithi170.stdout:3/57: rmdir d3 39 2024-01-25T15:03:30.458 INFO:tasks.workunit.client.0.smithi170.stdout:7/48: rmdir d8 39 2024-01-25T15:03:30.458 INFO:tasks.workunit.client.0.smithi170.stdout:7/49: fdatasync d8/f13 0 2024-01-25T15:03:30.459 INFO:tasks.workunit.client.0.smithi170.stdout:3/58: creat d3/f12 x:0 0 0 2024-01-25T15:03:30.460 INFO:tasks.workunit.client.0.smithi170.stdout:0/49: dread d8/ff [0,4194304] 0 2024-01-25T15:03:30.460 INFO:tasks.workunit.client.0.smithi170.stdout:7/50: link d8/cb d8/c14 0 2024-01-25T15:03:30.462 INFO:tasks.workunit.client.0.smithi170.stdout:9/33: dwrite f4 [0,4194304] 0 2024-01-25T15:03:30.465 INFO:tasks.workunit.client.0.smithi170.stdout:9/34: symlink d5/lb 0 2024-01-25T15:03:30.465 INFO:tasks.workunit.client.0.smithi170.stdout:9/35: truncate d5/f8 999005 0 2024-01-25T15:03:30.466 INFO:tasks.workunit.client.0.smithi170.stdout:9/36: write f4 [4385445,35811] 0 2024-01-25T15:03:30.470 INFO:tasks.workunit.client.0.smithi170.stdout:2/75: dwrite f8 [4194304,4194304] 0 2024-01-25T15:03:30.470 INFO:tasks.workunit.client.0.smithi170.stdout:2/76: creat d10/d16/f1a x:0 0 0 2024-01-25T15:03:30.470 INFO:tasks.workunit.client.0.smithi170.stdout:5/45: write d5/ff [3359763,114836] 0 2024-01-25T15:03:30.471 INFO:tasks.workunit.client.0.smithi170.stdout:6/18: write f0 [1199368,82136] 0 2024-01-25T15:03:30.473 INFO:tasks.workunit.client.0.smithi170.stdout:6/19: mkdir d2/d7 0 2024-01-25T15:03:30.481 INFO:tasks.workunit.client.0.smithi170.stdout:3/59: dread d3/d10/fe [0,4194304] 0 2024-01-25T15:03:30.482 INFO:tasks.workunit.client.0.smithi170.stdout:0/50: dread f2 [0,4194304] 0 2024-01-25T15:03:30.485 INFO:tasks.workunit.client.0.smithi170.stdout:0/51: mknod d8/d10/c11 0 2024-01-25T15:03:30.486 INFO:tasks.workunit.client.0.smithi170.stdout:0/52: rename d8/lb to d8/d9/l12 0 2024-01-25T15:03:30.487 INFO:tasks.workunit.client.0.smithi170.stdout:0/53: mknod d8/d10/c13 0 2024-01-25T15:03:30.488 INFO:tasks.workunit.client.0.smithi170.stdout:0/54: symlink d8/d9/l14 0 2024-01-25T15:03:30.488 INFO:tasks.workunit.client.0.smithi170.stdout:0/55: fdatasync f6 0 2024-01-25T15:03:30.492 INFO:tasks.workunit.client.0.smithi170.stdout:9/37: dwrite f4 [0,4194304] 0 2024-01-25T15:03:30.492 INFO:tasks.workunit.client.0.smithi170.stdout:7/51: dwrite d8/f13 [0,4194304] 0 2024-01-25T15:03:30.499 INFO:tasks.workunit.client.0.smithi170.stdout:5/46: dwrite d5/f7 [0,4194304] 0 2024-01-25T15:03:30.499 INFO:tasks.workunit.client.0.smithi170.stdout:5/47: chown c1 35817523 1 2024-01-25T15:03:30.499 INFO:tasks.workunit.client.0.smithi170.stdout:5/48: fdatasync f2 0 2024-01-25T15:03:30.501 INFO:tasks.workunit.client.0.smithi170.stdout:0/56: dread d8/d9/fe [0,4194304] 0 2024-01-25T15:03:30.502 INFO:tasks.workunit.client.0.smithi170.stdout:0/57: chown d8/ff 1 1 2024-01-25T15:03:30.502 INFO:tasks.workunit.client.0.smithi170.stdout:0/58: write d8/d9/fe [1546225,48766] 0 2024-01-25T15:03:30.502 INFO:tasks.workunit.client.0.smithi170.stdout:5/49: rename d5/fb to d5/f11 0 2024-01-25T15:03:30.502 INFO:tasks.workunit.client.0.smithi170.stdout:5/50: read - d5/fd zero size 2024-01-25T15:03:30.502 INFO:tasks.workunit.client.0.smithi170.stdout:5/51: chown d5/fe 78727025 1 2024-01-25T15:03:30.503 INFO:tasks.workunit.client.0.smithi170.stdout:0/59: creat d8/d10/f15 x:0 0 0 2024-01-25T15:03:30.504 INFO:tasks.workunit.client.0.smithi170.stdout:0/60: truncate d8/ff 704600 0 2024-01-25T15:03:30.504 INFO:tasks.workunit.client.0.smithi170.stdout:0/61: write d8/fa [1181152,17816] 0 2024-01-25T15:03:30.505 INFO:tasks.workunit.client.0.smithi170.stdout:0/62: creat d8/d9/f16 x:0 0 0 2024-01-25T15:03:30.507 INFO:tasks.workunit.client.0.smithi170.stdout:0/63: symlink d8/l17 0 2024-01-25T15:03:30.509 INFO:tasks.workunit.client.0.smithi170.stdout:0/64: mkdir d8/d18 0 2024-01-25T15:03:30.509 INFO:tasks.workunit.client.0.smithi170.stdout:0/65: creat d8/f19 x:0 0 0 2024-01-25T15:03:30.509 INFO:tasks.workunit.client.0.smithi170.stdout:0/66: fsync f2 0 2024-01-25T15:03:30.510 INFO:tasks.workunit.client.0.smithi170.stdout:6/20: dwrite d2/f4 [4194304,4194304] 0 2024-01-25T15:03:30.510 INFO:tasks.workunit.client.0.smithi170.stdout:6/21: creat d2/f8 x:0 0 0 2024-01-25T15:03:30.517 INFO:tasks.workunit.client.0.smithi170.stdout:6/22: mknod d2/c9 0 2024-01-25T15:03:30.518 INFO:tasks.workunit.client.0.smithi170.stdout:7/52: dwrite d8/fc [0,4194304] 0 2024-01-25T15:03:30.519 INFO:tasks.workunit.client.0.smithi170.stdout:7/53: chown c4 283 1 2024-01-25T15:03:30.519 INFO:tasks.workunit.client.0.smithi170.stdout:6/23: rename d2/c9 to d2/d7/ca 0 2024-01-25T15:03:30.520 INFO:tasks.workunit.client.0.smithi170.stdout:9/38: dread f4 [0,4194304] 0 2024-01-25T15:03:30.520 INFO:tasks.workunit.client.0.smithi170.stdout:9/39: truncate d5/f8 1368963 0 2024-01-25T15:03:30.521 INFO:tasks.workunit.client.0.smithi170.stdout:7/54: mknod d8/c15 0 2024-01-25T15:03:30.521 INFO:tasks.workunit.client.0.smithi170.stdout:7/55: chown d8/cb 433333 1 2024-01-25T15:03:30.522 INFO:tasks.workunit.client.0.smithi170.stdout:0/67: dread d8/d9/fe [0,4194304] 0 2024-01-25T15:03:30.522 INFO:tasks.workunit.client.0.smithi170.stdout:6/24: symlink d2/lb 0 2024-01-25T15:03:30.523 INFO:tasks.workunit.client.0.smithi170.stdout:9/40: mkdir d5/dc 0 2024-01-25T15:03:30.523 INFO:tasks.workunit.client.0.smithi170.stdout:9/41: chown d5 7 1 2024-01-25T15:03:30.524 INFO:tasks.workunit.client.0.smithi170.stdout:7/56: rmdir d8 39 2024-01-25T15:03:30.524 INFO:tasks.workunit.client.0.smithi170.stdout:5/52: dwrite d5/ff [4194304,4194304] 0 2024-01-25T15:03:30.525 INFO:tasks.workunit.client.0.smithi170.stdout:5/53: dread - d5/fe zero size 2024-01-25T15:03:30.525 INFO:tasks.workunit.client.0.smithi170.stdout:9/42: creat d5/dc/fd x:0 0 0 2024-01-25T15:03:30.528 INFO:tasks.workunit.client.0.smithi170.stdout:7/57: creat d8/f16 x:0 0 0 2024-01-25T15:03:30.528 INFO:tasks.workunit.client.0.smithi170.stdout:7/58: readlink l1 0 2024-01-25T15:03:30.530 INFO:tasks.workunit.client.0.smithi170.stdout:5/54: rename f2 to d5/d10/f12 0 2024-01-25T15:03:30.530 INFO:tasks.workunit.client.0.smithi170.stdout:5/55: chown d5/ca 20 1 2024-01-25T15:03:30.530 INFO:tasks.workunit.client.0.smithi170.stdout:5/56: chown c1 8839 1 2024-01-25T15:03:30.531 INFO:tasks.workunit.client.0.smithi170.stdout:5/57: creat d5/f13 x:0 0 0 2024-01-25T15:03:30.532 INFO:tasks.workunit.client.0.smithi170.stdout:7/59: rename d8/fa to d8/f17 0 2024-01-25T15:03:30.534 INFO:tasks.workunit.client.0.smithi170.stdout:4/13: sync 2024-01-25T15:03:30.536 INFO:tasks.workunit.client.0.smithi170.stdout:7/60: rename d8/f9 to d8/f18 0 2024-01-25T15:03:30.536 INFO:tasks.workunit.client.0.smithi170.stdout:7/61: creat d8/f19 x:0 0 0 2024-01-25T15:03:30.537 INFO:tasks.workunit.client.0.smithi170.stdout:4/14: unlink f0 0 2024-01-25T15:03:30.541 INFO:tasks.workunit.client.0.smithi170.stdout:5/58: write d5/d10/f12 [2443260,10007] 0 2024-01-25T15:03:30.541 INFO:tasks.workunit.client.0.smithi170.stdout:7/62: mknod d8/c1a 0 2024-01-25T15:03:30.541 INFO:tasks.workunit.client.0.smithi170.stdout:7/63: dread - d8/f19 zero size 2024-01-25T15:03:30.543 INFO:tasks.workunit.client.0.smithi170.stdout:5/59: creat d5/d10/f14 x:0 0 0 2024-01-25T15:03:30.543 INFO:tasks.workunit.client.0.smithi170.stdout:5/60: creat d5/f15 x:0 0 0 2024-01-25T15:03:30.544 INFO:tasks.workunit.client.0.smithi170.stdout:4/15: dread f2 [0,4194304] 0 2024-01-25T15:03:30.544 INFO:tasks.workunit.client.0.smithi170.stdout:4/16: truncate f2 1346687 0 2024-01-25T15:03:30.548 INFO:tasks.workunit.client.0.smithi170.stdout:5/61: link d5/f7 d5/f16 0 2024-01-25T15:03:30.551 INFO:tasks.workunit.client.0.smithi170.stdout:5/62: unlink d5/ff 0 2024-01-25T15:03:30.556 INFO:tasks.workunit.client.0.smithi170.stdout:0/68: dwrite d8/d9/fe [0,4194304] 0 2024-01-25T15:03:30.558 INFO:tasks.workunit.client.0.smithi170.stdout:0/69: symlink d8/d9/l1a 0 2024-01-25T15:03:30.558 INFO:tasks.workunit.client.0.smithi170.stdout:0/70: dread - d8/d9/f16 zero size 2024-01-25T15:03:30.562 INFO:tasks.workunit.client.0.smithi170.stdout:7/64: write d8/fc [270094,122246] 0 2024-01-25T15:03:30.562 INFO:tasks.workunit.client.0.smithi170.stdout:7/65: creat d8/f1b x:0 0 0 2024-01-25T15:03:30.562 INFO:tasks.workunit.client.0.smithi170.stdout:7/66: write d8/f19 [165059,3804] 0 2024-01-25T15:03:30.562 INFO:tasks.workunit.client.0.smithi170.stdout:7/67: readlink l1 0 2024-01-25T15:03:30.562 INFO:tasks.workunit.client.0.smithi170.stdout:7/68: chown d8/f1b 0 1 2024-01-25T15:03:30.565 INFO:tasks.workunit.client.0.smithi170.stdout:6/25: dwrite d2/f4 [8388608,4194304] 0 2024-01-25T15:03:30.565 INFO:tasks.workunit.client.0.smithi170.stdout:6/26: write f1 [4393574,107225] 0 2024-01-25T15:03:30.565 INFO:tasks.workunit.client.0.smithi170.stdout:9/43: dwrite d5/dc/fd [0,4194304] 0 2024-01-25T15:03:30.565 INFO:tasks.workunit.client.0.smithi170.stdout:9/44: creat d5/dc/fe x:0 0 0 2024-01-25T15:03:30.568 INFO:tasks.workunit.client.0.smithi170.stdout:4/17: dwrite f2 [0,4194304] 0 2024-01-25T15:03:30.568 INFO:tasks.workunit.client.0.smithi170.stdout:4/18: fdatasync f2 0 2024-01-25T15:03:30.568 INFO:tasks.workunit.client.0.smithi170.stdout:4/19: chown l1 2078607 1 2024-01-25T15:03:30.568 INFO:tasks.workunit.client.0.smithi170.stdout:6/27: fsync d2/f6 0 2024-01-25T15:03:30.575 INFO:tasks.workunit.client.0.smithi170.stdout:9/45: mkdir d5/df 0 2024-01-25T15:03:30.578 INFO:tasks.workunit.client.0.smithi170.stdout:0/71: dwrite d8/ff [0,4194304] 0 2024-01-25T15:03:30.579 INFO:tasks.workunit.client.0.smithi170.stdout:9/46: truncate f2 2434894 0 2024-01-25T15:03:30.579 INFO:tasks.workunit.client.0.smithi170.stdout:9/47: fdatasync d5/fa 0 2024-01-25T15:03:30.580 INFO:tasks.workunit.client.0.smithi170.stdout:7/69: getdents d8 0 2024-01-25T15:03:30.584 INFO:tasks.workunit.client.0.smithi170.stdout:7/70: unlink d8/cb 0 2024-01-25T15:03:30.584 INFO:tasks.workunit.client.0.smithi170.stdout:3/60: sync 2024-01-25T15:03:30.584 INFO:tasks.workunit.client.0.smithi170.stdout:1/48: sync 2024-01-25T15:03:30.584 INFO:tasks.workunit.client.0.smithi170.stdout:2/77: sync 2024-01-25T15:03:30.584 INFO:tasks.workunit.client.0.smithi170.stdout:3/61: dread - d3/f12 zero size 2024-01-25T15:03:30.584 INFO:tasks.workunit.client.0.smithi170.stdout:1/49: write d0/fe [305361,32778] 0 2024-01-25T15:03:30.584 INFO:tasks.workunit.client.0.smithi170.stdout:2/78: write f6 [4866874,113399] 0 2024-01-25T15:03:30.585 INFO:tasks.workunit.client.0.smithi170.stdout:1/50: truncate d0/fd 922984 0 2024-01-25T15:03:30.585 INFO:tasks.workunit.client.0.smithi170.stdout:7/71: creat d8/f1c x:0 0 0 2024-01-25T15:03:30.585 INFO:tasks.workunit.client.0.smithi170.stdout:8/18: sync 2024-01-25T15:03:30.586 INFO:tasks.workunit.client.0.smithi170.stdout:3/62: mkdir d3/d10/d13 0 2024-01-25T15:03:30.587 INFO:tasks.workunit.client.0.smithi170.stdout:3/63: read d3/d10/ff [155290,55655] 0 2024-01-25T15:03:30.587 INFO:tasks.workunit.client.0.smithi170.stdout:3/64: fsync d3/d10/fe 0 2024-01-25T15:03:30.588 INFO:tasks.workunit.client.0.smithi170.stdout:7/72: creat d8/f1d x:0 0 0 2024-01-25T15:03:30.591 INFO:tasks.workunit.client.0.smithi170.stdout:4/20: write f2 [4918716,76476] 0 2024-01-25T15:03:30.604 INFO:tasks.workunit.client.0.smithi170.stdout:6/28: dwrite d2/f4 [4194304,4194304] 0 2024-01-25T15:03:30.604 INFO:tasks.workunit.client.0.smithi170.stdout:6/29: write d2/f5 [1088771,110946] 0 2024-01-25T15:03:30.607 INFO:tasks.workunit.client.0.smithi170.stdout:9/48: dwrite d5/f8 [0,4194304] 0 2024-01-25T15:03:30.608 INFO:tasks.workunit.client.0.smithi170.stdout:0/72: dwrite f2 [0,4194304] 0 2024-01-25T15:03:30.608 INFO:tasks.workunit.client.0.smithi170.stdout:0/73: creat d8/d10/f1b x:0 0 0 2024-01-25T15:03:30.608 INFO:tasks.workunit.client.0.smithi170.stdout:0/74: stat c0 0 2024-01-25T15:03:30.636 INFO:tasks.workunit.client.0.smithi170.stdout:0/75: dwrite d8/f19 [0,4194304] 0 2024-01-25T15:03:30.636 INFO:tasks.workunit.client.0.smithi170.stdout:0/76: write d8/d9/f16 [202020,26894] 0 2024-01-25T15:03:30.638 INFO:tasks.workunit.client.0.smithi170.stdout:4/21: dwrite f2 [0,4194304] 0 2024-01-25T15:03:30.638 INFO:tasks.workunit.client.0.smithi170.stdout:4/22: chown f2 430812070 1 2024-01-25T15:03:30.638 INFO:tasks.workunit.client.0.smithi170.stdout:6/30: dwrite d2/f3 [0,4194304] 0 2024-01-25T15:03:30.660 INFO:tasks.workunit.client.0.smithi170.stdout:4/23: dwrite f2 [0,4194304] 0 2024-01-25T15:03:30.799 INFO:tasks.workunit.client.0.smithi170.stdout:2/79: mkdir d10/d1b 0 2024-01-25T15:03:30.799 INFO:tasks.workunit.client.0.smithi170.stdout:3/65: rename d3/f7 to d3/d10/f14 0 2024-01-25T15:03:30.799 INFO:tasks.workunit.client.0.smithi170.stdout:2/80: write f9 [343184,35790] 0 2024-01-25T15:03:30.799 INFO:tasks.workunit.client.0.smithi170.stdout:7/73: truncate d8/f16 994912 0 2024-01-25T15:03:30.800 INFO:tasks.workunit.client.0.smithi170.stdout:9/49: mknod d5/c10 0 2024-01-25T15:03:30.800 INFO:tasks.workunit.client.0.smithi170.stdout:9/50: truncate f4 4839140 0 2024-01-25T15:03:30.800 INFO:tasks.workunit.client.0.smithi170.stdout:9/51: chown c0 164863 1 2024-01-25T15:03:30.800 INFO:tasks.workunit.client.0.smithi170.stdout:9/52: creat d5/f11 x:0 0 0 2024-01-25T15:03:30.800 INFO:tasks.workunit.client.0.smithi170.stdout:0/77: symlink d8/d18/l1c 0 2024-01-25T15:03:30.800 INFO:tasks.workunit.client.0.smithi170.stdout:6/31: mknod d2/cc 0 2024-01-25T15:03:30.800 INFO:tasks.workunit.client.0.smithi170.stdout:4/24: rename c4 to c5 0 2024-01-25T15:03:30.800 INFO:tasks.workunit.client.0.smithi170.stdout:2/81: mknod d10/d16/c1c 0 2024-01-25T15:03:30.801 INFO:tasks.workunit.client.0.smithi170.stdout:7/74: creat d8/f1e x:0 0 0 2024-01-25T15:03:30.802 INFO:tasks.workunit.client.0.smithi170.stdout:9/53: mkdir d5/df/d12 0 2024-01-25T15:03:30.802 INFO:tasks.workunit.client.0.smithi170.stdout:9/54: fsync d5/fa 0 2024-01-25T15:03:30.802 INFO:tasks.workunit.client.0.smithi170.stdout:9/55: stat d5/c10 0 2024-01-25T15:03:30.802 INFO:tasks.workunit.client.0.smithi170.stdout:9/56: fsync d5/dc/fd 0 2024-01-25T15:03:30.802 INFO:tasks.workunit.client.0.smithi170.stdout:0/78: mknod d8/c1d 0 2024-01-25T15:03:30.803 INFO:tasks.workunit.client.0.smithi170.stdout:4/25: mkdir d6 0 2024-01-25T15:03:30.804 INFO:tasks.workunit.client.0.smithi170.stdout:2/82: creat d10/d1b/f1d x:0 0 0 2024-01-25T15:03:30.804 INFO:tasks.workunit.client.0.smithi170.stdout:7/75: creat d8/f1f x:0 0 0 2024-01-25T15:03:30.805 INFO:tasks.workunit.client.0.smithi170.stdout:0/79: symlink d8/d9/l1e 0 2024-01-25T15:03:30.806 INFO:tasks.workunit.client.0.smithi170.stdout:4/26: mkdir d6/d7 0 2024-01-25T15:03:30.807 INFO:tasks.workunit.client.0.smithi170.stdout:4/27: truncate f2 1075006 0 2024-01-25T15:03:30.808 INFO:tasks.workunit.client.0.smithi170.stdout:2/83: mkdir d10/d1e 0 2024-01-25T15:03:30.809 INFO:tasks.workunit.client.0.smithi170.stdout:7/76: mkdir d8/d20 0 2024-01-25T15:03:30.810 INFO:tasks.workunit.client.0.smithi170.stdout:2/84: mknod d10/d1e/c1f 0 2024-01-25T15:03:30.810 INFO:tasks.workunit.client.0.smithi170.stdout:3/66: dread d3/fa [0,4194304] 0 2024-01-25T15:03:30.810 INFO:tasks.workunit.client.0.smithi170.stdout:3/67: chown d3/d10/d13 1 1 2024-01-25T15:03:30.812 INFO:tasks.workunit.client.0.smithi170.stdout:2/85: creat d10/d1e/f20 x:0 0 0 2024-01-25T15:03:30.813 INFO:tasks.workunit.client.0.smithi170.stdout:3/68: symlink d3/d10/d13/l15 0 2024-01-25T15:03:30.813 INFO:tasks.workunit.client.0.smithi170.stdout:3/69: write d3/f12 [544208,18886] 0 2024-01-25T15:03:30.815 INFO:tasks.workunit.client.0.smithi170.stdout:3/70: creat d3/d10/f16 x:0 0 0 2024-01-25T15:03:30.817 INFO:tasks.workunit.client.0.smithi170.stdout:2/86: link l2 d10/l21 0 2024-01-25T15:03:30.818 INFO:tasks.workunit.client.0.smithi170.stdout:0/80: read d8/d9/fe [3827212,87668] 0 2024-01-25T15:03:30.819 INFO:tasks.workunit.client.0.smithi170.stdout:2/87: symlink d10/d1e/l22 0 2024-01-25T15:03:30.819 INFO:tasks.workunit.client.0.smithi170.stdout:2/88: chown d10/d1b/f1d 15 1 2024-01-25T15:03:30.820 INFO:tasks.workunit.client.0.smithi170.stdout:2/89: dread f9 [0,4194304] 0 2024-01-25T15:03:30.821 INFO:tasks.workunit.client.0.smithi170.stdout:2/90: truncate d10/f13 339074 0 2024-01-25T15:03:30.821 INFO:tasks.workunit.client.0.smithi170.stdout:2/91: chown f9 5430492 1 2024-01-25T15:03:30.826 INFO:tasks.workunit.client.0.smithi170.stdout:2/92: dread ff [0,4194304] 0 2024-01-25T15:03:30.826 INFO:tasks.workunit.client.0.smithi170.stdout:2/93: write d10/d1b/f1d [417467,128399] 0 2024-01-25T15:03:30.826 INFO:tasks.workunit.client.0.smithi170.stdout:2/94: creat d10/d16/f23 x:0 0 0 2024-01-25T15:03:30.829 INFO:tasks.workunit.client.0.smithi170.stdout:2/95: unlink l0 0 2024-01-25T15:03:30.831 INFO:tasks.workunit.client.0.smithi170.stdout:0/81: dread f2 [0,4194304] 0 2024-01-25T15:03:30.833 INFO:tasks.workunit.client.0.smithi170.stdout:4/28: dread f2 [0,4194304] 0 2024-01-25T15:03:30.835 INFO:tasks.workunit.client.0.smithi170.stdout:4/29: dread f2 [0,4194304] 0 2024-01-25T15:03:30.839 INFO:tasks.workunit.client.0.smithi170.stdout:2/96: write f8 [5470538,76348] 0 2024-01-25T15:03:30.840 INFO:tasks.workunit.client.0.smithi170.stdout:4/30: write f2 [962241,78287] 0 2024-01-25T15:03:30.840 INFO:tasks.workunit.client.0.smithi170.stdout:4/31: write f2 [161977,5053] 0 2024-01-25T15:03:30.840 INFO:tasks.workunit.client.0.smithi170.stdout:4/32: chown l3 5392762 1 2024-01-25T15:03:30.841 INFO:tasks.workunit.client.0.smithi170.stdout:4/33: rmdir d6 39 2024-01-25T15:03:30.842 INFO:tasks.workunit.client.0.smithi170.stdout:2/97: mkdir d10/d1b/d24 0 2024-01-25T15:03:30.842 INFO:tasks.workunit.client.0.smithi170.stdout:2/98: readlink l7 0 2024-01-25T15:03:30.842 INFO:tasks.workunit.client.0.smithi170.stdout:4/34: creat d6/f8 x:0 0 0 2024-01-25T15:03:30.844 INFO:tasks.workunit.client.0.smithi170.stdout:4/35: creat d6/d7/f9 x:0 0 0 2024-01-25T15:03:30.844 INFO:tasks.workunit.client.0.smithi170.stdout:4/36: write d6/f8 [891245,12365] 0 2024-01-25T15:03:30.844 INFO:tasks.workunit.client.0.smithi170.stdout:4/37: creat d6/d7/fa x:0 0 0 2024-01-25T15:03:30.844 INFO:tasks.workunit.client.0.smithi170.stdout:4/38: dread - d6/d7/fa zero size 2024-01-25T15:03:30.844 INFO:tasks.workunit.client.0.smithi170.stdout:4/39: readlink l3 0 2024-01-25T15:03:30.848 INFO:tasks.workunit.client.0.smithi170.stdout:4/40: rmdir d6 39 2024-01-25T15:03:30.870 INFO:tasks.workunit.client.0.smithi170.stdout:4/41: fdatasync f2 0 2024-01-25T15:03:30.870 INFO:tasks.workunit.client.0.smithi170.stdout:4/42: dread - d6/d7/fa zero size 2024-01-25T15:03:30.875 INFO:tasks.workunit.client.0.smithi170.stdout:7/77: dwrite f2 [0,4194304] 0 2024-01-25T15:03:30.875 INFO:tasks.workunit.client.0.smithi170.stdout:7/78: dread - d8/f1d zero size 2024-01-25T15:03:30.876 INFO:tasks.workunit.client.0.smithi170.stdout:2/99: dread d10/f13 [0,4194304] 0 2024-01-25T15:03:30.877 INFO:tasks.workunit.client.0.smithi170.stdout:5/63: sync 2024-01-25T15:03:30.877 INFO:tasks.workunit.client.0.smithi170.stdout:1/51: sync 2024-01-25T15:03:30.877 INFO:tasks.workunit.client.0.smithi170.stdout:8/19: sync 2024-01-25T15:03:30.877 INFO:tasks.workunit.client.0.smithi170.stdout:8/20: chown d3 686114 1 2024-01-25T15:03:30.877 INFO:tasks.workunit.client.0.smithi170.stdout:8/21: readlink - no filename 2024-01-25T15:03:30.885 INFO:tasks.workunit.client.0.smithi170.stdout:2/100: stat d10/c11 0 2024-01-25T15:03:30.886 INFO:tasks.workunit.client.0.smithi170.stdout:1/52: creat d0/f11 x:0 0 0 2024-01-25T15:03:30.886 INFO:tasks.workunit.client.0.smithi170.stdout:1/53: creat d0/f12 x:0 0 0 2024-01-25T15:03:30.887 INFO:tasks.workunit.client.0.smithi170.stdout:1/54: chown d0/la 27855 1 2024-01-25T15:03:30.887 INFO:tasks.workunit.client.0.smithi170.stdout:7/79: symlink d8/l21 0 2024-01-25T15:03:30.888 INFO:tasks.workunit.client.0.smithi170.stdout:2/101: link d10/d1b/f1d d10/d1b/f25 0 2024-01-25T15:03:30.889 INFO:tasks.workunit.client.0.smithi170.stdout:1/55: symlink d0/l13 0 2024-01-25T15:03:30.894 INFO:tasks.workunit.client.0.smithi170.stdout:7/80: dread - d8/fe zero size 2024-01-25T15:03:30.894 INFO:tasks.workunit.client.0.smithi170.stdout:7/81: chown d8/f1c 11935 1 2024-01-25T15:03:30.903 INFO:tasks.workunit.client.0.smithi170.stdout:1/56: dread d0/fb [0,4194304] 0 2024-01-25T15:03:30.904 INFO:tasks.workunit.client.0.smithi170.stdout:4/43: dwrite f2 [0,4194304] 0 2024-01-25T15:03:30.904 INFO:tasks.workunit.client.0.smithi170.stdout:1/57: symlink d0/l14 0 2024-01-25T15:03:30.904 INFO:tasks.workunit.client.0.smithi170.stdout:1/58: creat d0/f15 x:0 0 0 2024-01-25T15:03:30.905 INFO:tasks.workunit.client.0.smithi170.stdout:1/59: readlink d0/l14 0 2024-01-25T15:03:30.905 INFO:tasks.workunit.client.0.smithi170.stdout:4/44: symlink d6/d7/lb 0 2024-01-25T15:03:30.906 INFO:tasks.workunit.client.0.smithi170.stdout:5/64: dwrite d5/fd [0,4194304] 0 2024-01-25T15:03:30.906 INFO:tasks.workunit.client.0.smithi170.stdout:5/65: creat d5/d10/f17 x:0 0 0 2024-01-25T15:03:30.906 INFO:tasks.workunit.client.0.smithi170.stdout:1/60: truncate d0/f9 695382 0 2024-01-25T15:03:30.907 INFO:tasks.workunit.client.0.smithi170.stdout:1/61: chown d0/fe 0 1 2024-01-25T15:03:30.907 INFO:tasks.workunit.client.0.smithi170.stdout:1/62: fdatasync d0/fb 0 2024-01-25T15:03:30.907 INFO:tasks.workunit.client.0.smithi170.stdout:4/45: creat d6/fc x:0 0 0 2024-01-25T15:03:30.907 INFO:tasks.workunit.client.0.smithi170.stdout:4/46: truncate f2 4557212 0 2024-01-25T15:03:30.907 INFO:tasks.workunit.client.0.smithi170.stdout:4/47: creat d6/fd x:0 0 0 2024-01-25T15:03:30.908 INFO:tasks.workunit.client.0.smithi170.stdout:4/48: stat d6/d7/lb 0 2024-01-25T15:03:30.908 INFO:tasks.workunit.client.0.smithi170.stdout:4/49: fdatasync f2 0 2024-01-25T15:03:30.910 INFO:tasks.workunit.client.0.smithi170.stdout:5/66: symlink d5/d10/l18 0 2024-01-25T15:03:30.910 INFO:tasks.workunit.client.0.smithi170.stdout:5/67: fdatasync d5/f11 0 2024-01-25T15:03:30.910 INFO:tasks.workunit.client.0.smithi170.stdout:1/63: dread d0/ff [0,4194304] 0 2024-01-25T15:03:30.910 INFO:tasks.workunit.client.0.smithi170.stdout:1/64: write d0/ff [1789371,46192] 0 2024-01-25T15:03:30.912 INFO:tasks.workunit.client.0.smithi170.stdout:4/50: symlink d6/le 0 2024-01-25T15:03:30.916 INFO:tasks.workunit.client.0.smithi170.stdout:8/22: dwrite f2 [0,4194304] 0 2024-01-25T15:03:30.918 INFO:tasks.workunit.client.0.smithi170.stdout:8/23: creat d3/f4 x:0 0 0 2024-01-25T15:03:30.930 INFO:tasks.workunit.client.0.smithi170.stdout:8/24: dread f2 [0,4194304] 0 2024-01-25T15:03:30.935 INFO:tasks.workunit.client.0.smithi170.stdout:8/25: write f2 [209210,74292] 0 2024-01-25T15:03:30.937 INFO:tasks.workunit.client.0.smithi170.stdout:8/26: fsync f2 0 2024-01-25T15:03:30.939 INFO:tasks.workunit.client.0.smithi170.stdout:2/102: dwrite ff [0,4194304] 0 2024-01-25T15:03:30.941 INFO:tasks.workunit.client.0.smithi170.stdout:2/103: rmdir d10/d1b/d24 0 2024-01-25T15:03:30.943 INFO:tasks.workunit.client.0.smithi170.stdout:2/104: rmdir d10/d1e 39 2024-01-25T15:03:30.945 INFO:tasks.workunit.client.0.smithi170.stdout:2/105: unlink d10/d16/f1a 0 2024-01-25T15:03:30.946 INFO:tasks.workunit.client.0.smithi170.stdout:2/106: read d10/f13 [37607,48164] 0 2024-01-25T15:03:30.947 INFO:tasks.workunit.client.0.smithi170.stdout:2/107: dread f9 [0,4194304] 0 2024-01-25T15:03:30.947 INFO:tasks.workunit.client.0.smithi170.stdout:2/108: read - d10/d1e/f20 zero size 2024-01-25T15:03:30.949 INFO:tasks.workunit.client.0.smithi170.stdout:7/82: dwrite d8/f19 [0,4194304] 0 2024-01-25T15:03:30.949 INFO:tasks.workunit.client.0.smithi170.stdout:2/109: creat d10/d1e/f26 x:0 0 0 2024-01-25T15:03:30.949 INFO:tasks.workunit.client.0.smithi170.stdout:5/68: dwrite d5/fe [0,4194304] 0 2024-01-25T15:03:30.949 INFO:tasks.workunit.client.0.smithi170.stdout:4/51: dwrite d6/d7/fa [0,4194304] 0 2024-01-25T15:03:30.949 INFO:tasks.workunit.client.0.smithi170.stdout:1/65: dwrite d0/fe [0,4194304] 0 2024-01-25T15:03:30.949 INFO:tasks.workunit.client.0.smithi170.stdout:1/66: creat d0/f16 x:0 0 0 2024-01-25T15:03:30.957 INFO:tasks.workunit.client.0.smithi170.stdout:4/52: symlink d6/d7/lf 0 2024-01-25T15:03:30.961 INFO:tasks.workunit.client.0.smithi170.stdout:5/69: write d5/f11 [1225081,104788] 0 2024-01-25T15:03:30.963 INFO:tasks.workunit.client.0.smithi170.stdout:8/27: truncate f2 3859328 0 2024-01-25T15:03:30.965 INFO:tasks.workunit.client.0.smithi170.stdout:5/70: link d5/f7 d5/d10/f19 0 2024-01-25T15:03:30.966 INFO:tasks.workunit.client.0.smithi170.stdout:2/110: getdents d10/d1b 0 2024-01-25T15:03:30.968 INFO:tasks.workunit.client.0.smithi170.stdout:8/28: rename d3/f4 to d3/f5 0 2024-01-25T15:03:30.971 INFO:tasks.workunit.client.0.smithi170.stdout:2/111: symlink d10/l27 0 2024-01-25T15:03:30.973 INFO:tasks.workunit.client.0.smithi170.stdout:2/112: mknod d10/c28 0 2024-01-25T15:03:30.974 INFO:tasks.workunit.client.0.smithi170.stdout:2/113: write f9 [328522,31380] 0 2024-01-25T15:03:30.974 INFO:tasks.workunit.client.0.smithi170.stdout:2/114: chown d10/c28 22 1 2024-01-25T15:03:30.975 INFO:tasks.workunit.client.0.smithi170.stdout:2/115: rename d10/l27 to d10/l29 0 2024-01-25T15:03:30.977 INFO:tasks.workunit.client.0.smithi170.stdout:1/67: getdents d0 0 2024-01-25T15:03:30.977 INFO:tasks.workunit.client.0.smithi170.stdout:1/68: write d0/fb [1728630,9774] 0 2024-01-25T15:03:30.977 INFO:tasks.workunit.client.0.smithi170.stdout:1/69: truncate d0/fb 2121601 0 2024-01-25T15:03:30.977 INFO:tasks.workunit.client.0.smithi170.stdout:9/57: sync 2024-01-25T15:03:30.977 INFO:tasks.workunit.client.0.smithi170.stdout:0/82: sync 2024-01-25T15:03:30.977 INFO:tasks.workunit.client.0.smithi170.stdout:6/32: sync 2024-01-25T15:03:30.978 INFO:tasks.workunit.client.0.smithi170.stdout:3/71: sync 2024-01-25T15:03:30.978 INFO:tasks.workunit.client.0.smithi170.stdout:0/83: stat d8/l17 0 2024-01-25T15:03:30.979 INFO:tasks.workunit.client.0.smithi170.stdout:5/71: getdents d5/d10 0 2024-01-25T15:03:30.980 INFO:tasks.workunit.client.0.smithi170.stdout:1/70: mknod d0/c17 0 2024-01-25T15:03:30.982 INFO:tasks.workunit.client.0.smithi170.stdout:6/33: mkdir d2/d7/dd 0 2024-01-25T15:03:30.983 INFO:tasks.workunit.client.0.smithi170.stdout:3/72: creat d3/f17 x:0 0 0 2024-01-25T15:03:30.984 INFO:tasks.workunit.client.0.smithi170.stdout:0/84: symlink d8/d10/l1f 0 2024-01-25T15:03:30.986 INFO:tasks.workunit.client.0.smithi170.stdout:8/29: unlink f2 0 2024-01-25T15:03:30.987 INFO:tasks.workunit.client.0.smithi170.stdout:5/72: creat d5/d10/f1a x:0 0 0 2024-01-25T15:03:30.988 INFO:tasks.workunit.client.0.smithi170.stdout:1/71: rmdir d0 39 2024-01-25T15:03:30.989 INFO:tasks.workunit.client.0.smithi170.stdout:9/58: rmdir d5/dc 39 2024-01-25T15:03:30.991 INFO:tasks.workunit.client.0.smithi170.stdout:6/34: symlink d2/d7/dd/le 0 2024-01-25T15:03:30.991 INFO:tasks.workunit.client.0.smithi170.stdout:3/73: creat d3/f18 x:0 0 0 2024-01-25T15:03:30.992 INFO:tasks.workunit.client.0.smithi170.stdout:6/35: rmdir d2/d7 39 2024-01-25T15:03:30.992 INFO:tasks.workunit.client.0.smithi170.stdout:6/36: write d2/f8 [866168,12328] 0 2024-01-25T15:03:30.992 INFO:tasks.workunit.client.0.smithi170.stdout:6/37: rename d2/d7 to d2/d7/df 22 2024-01-25T15:03:30.993 INFO:tasks.workunit.client.0.smithi170.stdout:3/74: creat d3/d10/d13/f19 x:0 0 0 2024-01-25T15:03:30.993 INFO:tasks.workunit.client.0.smithi170.stdout:8/30: truncate f0 2988447 0 2024-01-25T15:03:30.993 INFO:tasks.workunit.client.0.smithi170.stdout:8/31: chown d3/f5 44356373 1 2024-01-25T15:03:30.993 INFO:tasks.workunit.client.0.smithi170.stdout:8/32: write d3/f5 [887075,79458] 0 2024-01-25T15:03:30.994 INFO:tasks.workunit.client.0.smithi170.stdout:1/72: mkdir d0/d18 0 2024-01-25T15:03:30.996 INFO:tasks.workunit.client.0.smithi170.stdout:1/73: truncate d0/fe 111271 0 2024-01-25T15:03:30.996 INFO:tasks.workunit.client.0.smithi170.stdout:1/74: chown d0 1814 1 2024-01-25T15:03:30.996 INFO:tasks.workunit.client.0.smithi170.stdout:1/75: dread - d0/f15 zero size 2024-01-25T15:03:31.006 INFO:tasks.workunit.client.0.smithi170.stdout:6/38: dread d2/f3 [0,4194304] 0 2024-01-25T15:03:31.010 INFO:tasks.workunit.client.0.smithi170.stdout:9/59: dread d5/dc/fd [0,4194304] 0 2024-01-25T15:03:31.010 INFO:tasks.workunit.client.0.smithi170.stdout:2/116: dwrite f9 [0,4194304] 0 2024-01-25T15:03:31.013 INFO:tasks.workunit.client.0.smithi170.stdout:9/60: rename d5/c7 to d5/dc/c13 0 2024-01-25T15:03:31.015 INFO:tasks.workunit.client.0.smithi170.stdout:2/117: rename d10/d1e/c1f to d10/d16/c2a 0 2024-01-25T15:03:31.024 INFO:tasks.workunit.client.0.smithi170.stdout:5/73: dwrite d5/f13 [0,4194304] 0 2024-01-25T15:03:31.031 INFO:tasks.workunit.client.0.smithi170.stdout:2/118: dread f6 [0,4194304] 0 2024-01-25T15:03:31.033 INFO:tasks.workunit.client.0.smithi170.stdout:2/119: dread d10/d1b/f25 [0,4194304] 0 2024-01-25T15:03:31.034 INFO:tasks.workunit.client.0.smithi170.stdout:1/76: dwrite d0/f16 [0,4194304] 0 2024-01-25T15:03:31.034 INFO:tasks.workunit.client.0.smithi170.stdout:2/120: symlink d10/d1e/l2b 0 2024-01-25T15:03:31.034 INFO:tasks.workunit.client.0.smithi170.stdout:2/121: dread - d10/d1e/f26 zero size 2024-01-25T15:03:31.035 INFO:tasks.workunit.client.0.smithi170.stdout:3/75: dwrite d3/f12 [0,4194304] 0 2024-01-25T15:03:31.035 INFO:tasks.workunit.client.0.smithi170.stdout:3/76: write d3/f18 [327496,16395] 0 2024-01-25T15:03:31.036 INFO:tasks.workunit.client.0.smithi170.stdout:0/85: dwrite d8/f19 [0,4194304] 0 2024-01-25T15:03:31.039 INFO:tasks.workunit.client.0.smithi170.stdout:1/77: mknod d0/d18/c19 0 2024-01-25T15:03:31.042 INFO:tasks.workunit.client.0.smithi170.stdout:9/61: dwrite d5/dc/fd [0,4194304] 0 2024-01-25T15:03:31.042 INFO:tasks.workunit.client.0.smithi170.stdout:9/62: chown d5 0 1 2024-01-25T15:03:31.042 INFO:tasks.workunit.client.0.smithi170.stdout:9/63: creat d5/f14 x:0 0 0 2024-01-25T15:03:31.043 INFO:tasks.workunit.client.0.smithi170.stdout:8/33: truncate f0 1331951 0 2024-01-25T15:03:31.043 INFO:tasks.workunit.client.0.smithi170.stdout:8/34: write d3/f5 [1379065,61938] 0 2024-01-25T15:03:31.047 INFO:tasks.workunit.client.0.smithi170.stdout:8/35: symlink d3/l6 0 2024-01-25T15:03:31.062 INFO:tasks.workunit.client.0.smithi170.stdout:2/122: dwrite d10/d1e/f20 [0,4194304] 0 2024-01-25T15:03:31.063 INFO:tasks.workunit.client.0.smithi170.stdout:3/77: dwrite d3/f17 [0,4194304] 0 2024-01-25T15:03:31.063 INFO:tasks.workunit.client.0.smithi170.stdout:3/78: write d3/d10/ff [1218049,96659] 0 2024-01-25T15:03:31.065 INFO:tasks.workunit.client.0.smithi170.stdout:1/78: dwrite d0/f16 [0,4194304] 0 2024-01-25T15:03:31.065 INFO:tasks.workunit.client.0.smithi170.stdout:1/79: chown d0/fe 24235 1 2024-01-25T15:03:31.065 INFO:tasks.workunit.client.0.smithi170.stdout:2/123: stat d10/l17 0 2024-01-25T15:03:31.067 INFO:tasks.workunit.client.0.smithi170.stdout:0/86: dwrite f2 [0,4194304] 0 2024-01-25T15:03:31.068 INFO:tasks.workunit.client.0.smithi170.stdout:8/36: dread d3/f5 [0,4194304] 0 2024-01-25T15:03:31.068 INFO:tasks.workunit.client.0.smithi170.stdout:8/37: write f0 [1242769,117788] 0 2024-01-25T15:03:31.069 INFO:tasks.workunit.client.0.smithi170.stdout:1/80: dread d0/fd [0,4194304] 0 2024-01-25T15:03:31.069 INFO:tasks.workunit.client.0.smithi170.stdout:2/124: symlink d10/d1e/l2c 0 2024-01-25T15:03:31.070 INFO:tasks.workunit.client.0.smithi170.stdout:0/87: creat d8/d18/f20 x:0 0 0 2024-01-25T15:03:31.071 INFO:tasks.workunit.client.0.smithi170.stdout:0/88: chown d8/d9/l1a 7 1 2024-01-25T15:03:31.071 INFO:tasks.workunit.client.0.smithi170.stdout:9/64: dwrite d5/f8 [4194304,4194304] 0 2024-01-25T15:03:31.071 INFO:tasks.workunit.client.0.smithi170.stdout:8/38: dread d3/f5 [0,4194304] 0 2024-01-25T15:03:31.071 INFO:tasks.workunit.client.0.smithi170.stdout:8/39: write f0 [1381170,113111] 0 2024-01-25T15:03:31.076 INFO:tasks.workunit.client.0.smithi170.stdout:9/65: creat d5/df/f15 x:0 0 0 2024-01-25T15:03:31.078 INFO:tasks.workunit.client.0.smithi170.stdout:2/125: symlink d10/l2d 0 2024-01-25T15:03:31.078 INFO:tasks.workunit.client.0.smithi170.stdout:2/126: creat d10/d1e/f2e x:0 0 0 2024-01-25T15:03:31.082 INFO:tasks.workunit.client.0.smithi170.stdout:7/83: sync 2024-01-25T15:03:31.082 INFO:tasks.workunit.client.0.smithi170.stdout:8/40: mkdir d3/d7 0 2024-01-25T15:03:31.085 INFO:tasks.workunit.client.0.smithi170.stdout:2/127: read d10/d1b/f1d [374011,116576] 0 2024-01-25T15:03:31.087 INFO:tasks.workunit.client.0.smithi170.stdout:7/84: creat d8/d20/f22 x:0 0 0 2024-01-25T15:03:31.087 INFO:tasks.workunit.client.0.smithi170.stdout:7/85: readlink l1 0 2024-01-25T15:03:31.093 INFO:tasks.workunit.client.0.smithi170.stdout:2/128: mknod d10/c2f 0 2024-01-25T15:03:31.094 INFO:tasks.workunit.client.0.smithi170.stdout:3/79: dread d3/f12 [0,4194304] 0 2024-01-25T15:03:31.094 INFO:tasks.workunit.client.0.smithi170.stdout:3/80: readlink d3/d10/d13/l15 0 2024-01-25T15:03:31.096 INFO:tasks.workunit.client.0.smithi170.stdout:7/86: rename d8/c11 to d8/c23 0 2024-01-25T15:03:31.096 INFO:tasks.workunit.client.0.smithi170.stdout:1/81: dwrite d0/ff [0,4194304] 0 2024-01-25T15:03:31.097 INFO:tasks.workunit.client.0.smithi170.stdout:7/87: creat d8/f24 x:0 0 0 2024-01-25T15:03:31.097 INFO:tasks.workunit.client.0.smithi170.stdout:7/88: readlink d8/l21 0 2024-01-25T15:03:31.099 INFO:tasks.workunit.client.0.smithi170.stdout:2/129: getdents d10/d1e 0 2024-01-25T15:03:31.100 INFO:tasks.workunit.client.0.smithi170.stdout:2/130: readlink l2 0 2024-01-25T15:03:31.100 INFO:tasks.workunit.client.0.smithi170.stdout:0/89: dwrite d8/f19 [0,4194304] 0 2024-01-25T15:03:31.102 INFO:tasks.workunit.client.0.smithi170.stdout:7/89: symlink d8/d20/l25 0 2024-01-25T15:03:31.104 INFO:tasks.workunit.client.0.smithi170.stdout:9/66: dwrite d5/dc/fe [0,4194304] 0 2024-01-25T15:03:31.104 INFO:tasks.workunit.client.0.smithi170.stdout:9/67: write d5/fa [79340,1386] 0 2024-01-25T15:03:31.105 INFO:tasks.workunit.client.0.smithi170.stdout:2/131: unlink d10/l2d 0 2024-01-25T15:03:31.106 INFO:tasks.workunit.client.0.smithi170.stdout:1/82: read d0/fb [1248070,4539] 0 2024-01-25T15:03:31.107 INFO:tasks.workunit.client.0.smithi170.stdout:7/90: rename f3 to d8/d20/f26 0 2024-01-25T15:03:31.112 INFO:tasks.workunit.client.0.smithi170.stdout:1/83: rename d0/d18/c19 to d0/d18/c1a 0 2024-01-25T15:03:31.113 INFO:tasks.workunit.client.0.smithi170.stdout:2/132: mknod d10/c30 0 2024-01-25T15:03:31.117 INFO:tasks.workunit.client.0.smithi170.stdout:2/133: rename d10/c15 to d10/d1b/c31 0 2024-01-25T15:03:31.118 INFO:tasks.workunit.client.0.smithi170.stdout:9/68: dread d5/f8 [0,4194304] 0 2024-01-25T15:03:31.121 INFO:tasks.workunit.client.0.smithi170.stdout:2/134: rmdir d10/d1e 39 2024-01-25T15:03:31.121 INFO:tasks.workunit.client.0.smithi170.stdout:2/135: stat d10/d1e/f26 0 2024-01-25T15:03:31.121 INFO:tasks.workunit.client.0.smithi170.stdout:0/90: dread d8/fa [0,4194304] 0 2024-01-25T15:03:31.121 INFO:tasks.workunit.client.0.smithi170.stdout:0/91: write f2 [4652567,62289] 0 2024-01-25T15:03:31.122 INFO:tasks.workunit.client.0.smithi170.stdout:9/69: mkdir d5/df/d16 0 2024-01-25T15:03:31.138 INFO:tasks.workunit.client.0.smithi170.stdout:0/92: read f2 [2541216,113072] 0 2024-01-25T15:03:31.138 INFO:tasks.workunit.client.0.smithi170.stdout:3/81: dwrite d3/d10/d13/f19 [0,4194304] 0 2024-01-25T15:03:31.140 INFO:tasks.workunit.client.0.smithi170.stdout:0/93: symlink d8/d9/l21 0 2024-01-25T15:03:31.140 INFO:tasks.workunit.client.0.smithi170.stdout:3/82: readlink d3/l9 0 2024-01-25T15:03:31.141 INFO:tasks.workunit.client.0.smithi170.stdout:1/84: dwrite d0/fd [0,4194304] 0 2024-01-25T15:03:31.142 INFO:tasks.workunit.client.0.smithi170.stdout:2/136: dread d10/d1e/f20 [0,4194304] 0 2024-01-25T15:03:31.142 INFO:tasks.workunit.client.0.smithi170.stdout:3/83: rename d3/f18 to d3/d10/f1a 0 2024-01-25T15:03:31.144 INFO:tasks.workunit.client.0.smithi170.stdout:1/85: chown d0/f9 1374523 1 2024-01-25T15:03:31.144 INFO:tasks.workunit.client.0.smithi170.stdout:1/86: truncate d0/fd 4398039 0 2024-01-25T15:03:31.152 INFO:tasks.workunit.client.0.smithi170.stdout:2/137: write f9 [1028201,49411] 0 2024-01-25T15:03:31.152 INFO:tasks.workunit.client.0.smithi170.stdout:2/138: read - d10/d16/f19 zero size 2024-01-25T15:03:31.153 INFO:tasks.workunit.client.0.smithi170.stdout:2/139: mkdir d10/d1e/d32 0 2024-01-25T15:03:31.155 INFO:tasks.workunit.client.0.smithi170.stdout:2/140: mkdir d10/d1e/d33 0 2024-01-25T15:03:31.155 INFO:tasks.workunit.client.0.smithi170.stdout:2/141: write d10/d1e/f26 [755752,81785] 0 2024-01-25T15:03:31.156 INFO:tasks.workunit.client.0.smithi170.stdout:1/87: write d0/f16 [1292390,39473] 0 2024-01-25T15:03:31.158 INFO:tasks.workunit.client.0.smithi170.stdout:2/142: rename d10/d16/c1c to d10/d16/c34 0 2024-01-25T15:03:31.158 INFO:tasks.workunit.client.0.smithi170.stdout:2/143: chown f6 911015 1 2024-01-25T15:03:31.159 INFO:tasks.workunit.client.0.smithi170.stdout:2/144: truncate d10/f12 1595264 0 2024-01-25T15:03:31.159 INFO:tasks.workunit.client.0.smithi170.stdout:7/91: dwrite d8/fc [0,4194304] 0 2024-01-25T15:03:31.160 INFO:tasks.workunit.client.0.smithi170.stdout:7/92: chown d8/fc 428 1 2024-01-25T15:03:31.163 INFO:tasks.workunit.client.0.smithi170.stdout:1/88: rename d0/d18 to d0/d1b 0 2024-01-25T15:03:31.164 INFO:tasks.workunit.client.0.smithi170.stdout:9/70: dwrite d5/df/f15 [0,4194304] 0 2024-01-25T15:03:31.166 INFO:tasks.workunit.client.0.smithi170.stdout:7/93: write d8/f12 [505673,118500] 0 2024-01-25T15:03:31.169 INFO:tasks.workunit.client.0.smithi170.stdout:9/71: symlink d5/df/d16/l17 0 2024-01-25T15:03:31.169 INFO:tasks.workunit.client.0.smithi170.stdout:9/72: dread - d5/f11 zero size 2024-01-25T15:03:31.169 INFO:tasks.workunit.client.0.smithi170.stdout:9/73: read - d5/f14 zero size 2024-01-25T15:03:31.170 INFO:tasks.workunit.client.0.smithi170.stdout:9/74: mkdir d5/df/d12/d18 0 2024-01-25T15:03:31.171 INFO:tasks.workunit.client.0.smithi170.stdout:9/75: stat d5/dc/fd 0 2024-01-25T15:03:31.171 INFO:tasks.workunit.client.0.smithi170.stdout:9/76: chown d5/lb 268600 1 2024-01-25T15:03:31.171 INFO:tasks.workunit.client.0.smithi170.stdout:9/77: write f2 [3101471,3294] 0 2024-01-25T15:03:31.171 INFO:tasks.workunit.client.0.smithi170.stdout:7/94: rmdir d8 39 2024-01-25T15:03:31.172 INFO:tasks.workunit.client.0.smithi170.stdout:3/84: dwrite d3/fd [0,4194304] 0 2024-01-25T15:03:31.172 INFO:tasks.workunit.client.0.smithi170.stdout:9/78: creat d5/df/d16/f19 x:0 0 0 2024-01-25T15:03:31.173 INFO:tasks.workunit.client.0.smithi170.stdout:9/79: chown l3 64305 1 2024-01-25T15:03:31.173 INFO:tasks.workunit.client.0.smithi170.stdout:9/80: truncate d5/f11 99462 0 2024-01-25T15:03:31.174 INFO:tasks.workunit.client.0.smithi170.stdout:0/94: dwrite d8/f19 [4194304,4194304] 0 2024-01-25T15:03:31.174 INFO:tasks.workunit.client.0.smithi170.stdout:3/85: mkdir d3/d10/d13/d1b 0 2024-01-25T15:03:31.175 INFO:tasks.workunit.client.0.smithi170.stdout:0/95: link d8/d9/l1e d8/d10/l22 0 2024-01-25T15:03:31.177 INFO:tasks.workunit.client.0.smithi170.stdout:0/96: link d8/d10/c13 d8/c23 0 2024-01-25T15:03:31.178 INFO:tasks.workunit.client.0.smithi170.stdout:3/86: mkdir d3/d1c 0 2024-01-25T15:03:31.181 INFO:tasks.workunit.client.0.smithi170.stdout:0/97: rmdir d8/d18 39 2024-01-25T15:03:31.182 INFO:tasks.workunit.client.0.smithi170.stdout:1/89: dwrite d0/f9 [0,4194304] 0 2024-01-25T15:03:31.182 INFO:tasks.workunit.client.0.smithi170.stdout:1/90: truncate d0/fe 130661 0 2024-01-25T15:03:31.185 INFO:tasks.workunit.client.0.smithi170.stdout:2/145: truncate f9 3893072 0 2024-01-25T15:03:31.187 INFO:tasks.workunit.client.0.smithi170.stdout:0/98: mknod d8/d10/c24 0 2024-01-25T15:03:31.189 INFO:tasks.workunit.client.0.smithi170.stdout:1/91: chown d0/l14 114207 1 2024-01-25T15:03:31.190 INFO:tasks.workunit.client.0.smithi170.stdout:2/146: stat d10/d16/c2a 0 2024-01-25T15:03:31.190 INFO:tasks.workunit.client.0.smithi170.stdout:2/147: chown d10/f13 722269607 1 2024-01-25T15:03:31.190 INFO:tasks.workunit.client.0.smithi170.stdout:2/148: chown f8 9038 1 2024-01-25T15:03:31.190 INFO:tasks.workunit.client.0.smithi170.stdout:2/149: creat d10/d16/f35 x:0 0 0 2024-01-25T15:03:31.192 INFO:tasks.workunit.client.0.smithi170.stdout:0/99: mknod d8/d9/c25 0 2024-01-25T15:03:31.196 INFO:tasks.workunit.client.0.smithi170.stdout:2/150: creat d10/d1b/f36 x:0 0 0 2024-01-25T15:03:31.199 INFO:tasks.workunit.client.0.smithi170.stdout:3/87: rmdir d3 39 2024-01-25T15:03:31.200 INFO:tasks.workunit.client.0.smithi170.stdout:4/53: sync 2024-01-25T15:03:31.200 INFO:tasks.workunit.client.0.smithi170.stdout:8/41: sync 2024-01-25T15:03:31.200 INFO:tasks.workunit.client.0.smithi170.stdout:5/74: sync 2024-01-25T15:03:31.200 INFO:tasks.workunit.client.0.smithi170.stdout:6/39: sync 2024-01-25T15:03:31.200 INFO:tasks.workunit.client.0.smithi170.stdout:5/75: creat d5/f1b x:0 0 0 2024-01-25T15:03:31.200 INFO:tasks.workunit.client.0.smithi170.stdout:5/76: write d5/f7 [833984,35327] 0 2024-01-25T15:03:31.201 INFO:tasks.workunit.client.0.smithi170.stdout:3/88: truncate d3/d10/d13/f19 3225457 0 2024-01-25T15:03:31.201 INFO:tasks.workunit.client.0.smithi170.stdout:3/89: chown d3/d10/fe 6853 1 2024-01-25T15:03:31.201 INFO:tasks.workunit.client.0.smithi170.stdout:3/90: write d3/d10/f16 [106024,129780] 0 2024-01-25T15:03:31.203 INFO:tasks.workunit.client.0.smithi170.stdout:8/42: rename d3/l6 to d3/d7/l8 0 2024-01-25T15:03:31.203 INFO:tasks.workunit.client.0.smithi170.stdout:8/43: chown f0 51303 1 2024-01-25T15:03:31.203 INFO:tasks.workunit.client.0.smithi170.stdout:8/44: fsync d3/f5 0 2024-01-25T15:03:31.205 INFO:tasks.workunit.client.0.smithi170.stdout:5/77: unlink d5/ca 0 2024-01-25T15:03:31.207 INFO:tasks.workunit.client.0.smithi170.stdout:1/92: write d0/ff [1172570,68808] 0 2024-01-25T15:03:31.207 INFO:tasks.workunit.client.0.smithi170.stdout:9/81: dwrite d5/df/f15 [0,4194304] 0 2024-01-25T15:03:31.207 INFO:tasks.workunit.client.0.smithi170.stdout:9/82: chown d5/dc 152 1 2024-01-25T15:03:31.207 INFO:tasks.workunit.client.0.smithi170.stdout:9/83: write d5/df/d16/f19 [1002921,114526] 0 2024-01-25T15:03:31.207 INFO:tasks.workunit.client.0.smithi170.stdout:9/84: chown c0 105151814 1 2024-01-25T15:03:31.207 INFO:tasks.workunit.client.0.smithi170.stdout:9/85: fdatasync d5/dc/fe 0 2024-01-25T15:03:31.208 INFO:tasks.workunit.client.0.smithi170.stdout:7/95: dwrite d8/f18 [0,4194304] 0 2024-01-25T15:03:31.208 INFO:tasks.workunit.client.0.smithi170.stdout:6/40: rename f1 to d2/f10 0 2024-01-25T15:03:31.209 INFO:tasks.workunit.client.0.smithi170.stdout:5/78: creat d5/d10/f1c x:0 0 0 2024-01-25T15:03:31.209 INFO:tasks.workunit.client.0.smithi170.stdout:5/79: truncate d5/f1b 372055 0 2024-01-25T15:03:31.211 INFO:tasks.workunit.client.0.smithi170.stdout:1/93: creat d0/d1b/f1c x:0 0 0 2024-01-25T15:03:31.211 INFO:tasks.workunit.client.0.smithi170.stdout:1/94: dread - d0/f15 zero size 2024-01-25T15:03:31.212 INFO:tasks.workunit.client.0.smithi170.stdout:8/45: dread d3/f5 [0,4194304] 0 2024-01-25T15:03:31.215 INFO:tasks.workunit.client.0.smithi170.stdout:7/96: unlink d8/f19 0 2024-01-25T15:03:31.228 INFO:tasks.workunit.client.0.smithi170.stdout:5/80: link c4 d5/c1d 0 2024-01-25T15:03:31.230 INFO:tasks.workunit.client.0.smithi170.stdout:4/54: dwrite f2 [0,4194304] 0 2024-01-25T15:03:31.230 INFO:tasks.workunit.client.0.smithi170.stdout:3/91: dread d3/d10/fe [0,4194304] 0 2024-01-25T15:03:31.230 INFO:tasks.workunit.client.0.smithi170.stdout:1/95: creat d0/f1d x:0 0 0 2024-01-25T15:03:31.230 INFO:tasks.workunit.client.0.smithi170.stdout:2/151: dwrite d10/f13 [0,4194304] 0 2024-01-25T15:03:31.231 INFO:tasks.workunit.client.0.smithi170.stdout:7/97: symlink d8/d20/l27 0 2024-01-25T15:03:31.231 INFO:tasks.workunit.client.0.smithi170.stdout:1/96: dread d0/fe [0,4194304] 0 2024-01-25T15:03:31.234 INFO:tasks.workunit.client.0.smithi170.stdout:3/92: creat d3/d10/d13/f1d x:0 0 0 2024-01-25T15:03:31.239 INFO:tasks.workunit.client.0.smithi170.stdout:2/152: dread d10/d1e/f20 [0,4194304] 0 2024-01-25T15:03:31.239 INFO:tasks.workunit.client.0.smithi170.stdout:1/97: unlink d0/d1b/c1a 0 2024-01-25T15:03:31.239 INFO:tasks.workunit.client.0.smithi170.stdout:1/98: dread - d0/f1d zero size 2024-01-25T15:03:31.241 INFO:tasks.workunit.client.0.smithi170.stdout:5/81: link d5/d10/f12 d5/f1e 0 2024-01-25T15:03:31.243 INFO:tasks.workunit.client.0.smithi170.stdout:3/93: mkdir d3/d10/d1e 0 2024-01-25T15:03:31.243 INFO:tasks.workunit.client.0.smithi170.stdout:3/94: truncate d3/fd 4664479 0 2024-01-25T15:03:31.243 INFO:tasks.workunit.client.0.smithi170.stdout:3/95: creat d3/d10/d13/f1f x:0 0 0 2024-01-25T15:03:31.245 INFO:tasks.workunit.client.0.smithi170.stdout:1/99: dread d0/f16 [0,4194304] 0 2024-01-25T15:03:31.245 INFO:tasks.workunit.client.0.smithi170.stdout:7/98: mknod d8/c28 0 2024-01-25T15:03:31.245 INFO:tasks.workunit.client.0.smithi170.stdout:1/100: dread - d0/d1b/f1c zero size 2024-01-25T15:03:31.245 INFO:tasks.workunit.client.0.smithi170.stdout:9/86: dwrite f4 [0,4194304] 0 2024-01-25T15:03:31.245 INFO:tasks.workunit.client.0.smithi170.stdout:9/87: creat d5/df/f1a x:0 0 0 2024-01-25T15:03:31.245 INFO:tasks.workunit.client.0.smithi170.stdout:6/41: dwrite d2/f5 [0,4194304] 0 2024-01-25T15:03:31.245 INFO:tasks.workunit.client.0.smithi170.stdout:6/42: readlink d2/lb 0 2024-01-25T15:03:31.247 INFO:tasks.workunit.client.0.smithi170.stdout:3/96: dread d3/d10/ff [0,4194304] 0 2024-01-25T15:03:31.248 INFO:tasks.workunit.client.0.smithi170.stdout:2/153: link d10/d16/f35 d10/f37 0 2024-01-25T15:03:31.251 INFO:tasks.workunit.client.0.smithi170.stdout:7/99: creat d8/d20/f29 x:0 0 0 2024-01-25T15:03:31.254 INFO:tasks.workunit.client.0.smithi170.stdout:6/43: symlink d2/l11 0 2024-01-25T15:03:31.258 INFO:tasks.workunit.client.0.smithi170.stdout:8/46: dwrite d3/f5 [0,4194304] 0 2024-01-25T15:03:31.259 INFO:tasks.workunit.client.0.smithi170.stdout:4/55: dwrite d6/fd [0,4194304] 0 2024-01-25T15:03:31.259 INFO:tasks.workunit.client.0.smithi170.stdout:4/56: dread - d6/fc zero size 2024-01-25T15:03:31.259 INFO:tasks.workunit.client.0.smithi170.stdout:1/101: rename d0/cc to d0/d1b/c1e 0 2024-01-25T15:03:31.260 INFO:tasks.workunit.client.0.smithi170.stdout:9/88: read f2 [148828,125889] 0 2024-01-25T15:03:31.264 INFO:tasks.workunit.client.0.smithi170.stdout:8/47: unlink d3/f5 0 2024-01-25T15:03:31.265 INFO:tasks.workunit.client.0.smithi170.stdout:6/44: write d2/f4 [10702768,26926] 0 2024-01-25T15:03:31.266 INFO:tasks.workunit.client.0.smithi170.stdout:3/97: dread d3/fd [0,4194304] 0 2024-01-25T15:03:31.266 INFO:tasks.workunit.client.0.smithi170.stdout:4/57: mknod d6/c10 0 2024-01-25T15:03:31.266 INFO:tasks.workunit.client.0.smithi170.stdout:4/58: write d6/d7/fa [5179920,127992] 0 2024-01-25T15:03:31.266 INFO:tasks.workunit.client.0.smithi170.stdout:4/59: chown d6/d7/lf 1487 1 2024-01-25T15:03:31.266 INFO:tasks.workunit.client.0.smithi170.stdout:4/60: dread - d6/d7/f9 zero size 2024-01-25T15:03:31.267 INFO:tasks.workunit.client.0.smithi170.stdout:4/61: dread f2 [4194304,4194304] 0 2024-01-25T15:03:31.268 INFO:tasks.workunit.client.0.smithi170.stdout:5/82: dwrite d5/d10/f17 [0,4194304] 0 2024-01-25T15:03:31.268 INFO:tasks.workunit.client.0.smithi170.stdout:1/102: rename d0/f16 to d0/d1b/f1f 0 2024-01-25T15:03:31.268 INFO:tasks.workunit.client.0.smithi170.stdout:1/103: stat d0/d1b/f1c 0 2024-01-25T15:03:31.273 INFO:tasks.workunit.client.0.smithi170.stdout:9/89: read f4 [1988623,5716] 0 2024-01-25T15:03:31.273 INFO:tasks.workunit.client.0.smithi170.stdout:7/100: unlink d8/f1b 0 2024-01-25T15:03:31.273 INFO:tasks.workunit.client.0.smithi170.stdout:8/48: getdents d3/d7 0 2024-01-25T15:03:31.273 INFO:tasks.workunit.client.0.smithi170.stdout:8/49: stat d3 0 2024-01-25T15:03:31.273 INFO:tasks.workunit.client.0.smithi170.stdout:8/50: creat d3/f9 x:0 0 0 2024-01-25T15:03:31.274 INFO:tasks.workunit.client.0.smithi170.stdout:6/45: truncate d2/f10 3529843 0 2024-01-25T15:03:31.276 INFO:tasks.workunit.client.0.smithi170.stdout:3/98: creat d3/d10/d1e/f20 x:0 0 0 2024-01-25T15:03:31.277 INFO:tasks.workunit.client.0.smithi170.stdout:4/62: unlink d6/fc 0 2024-01-25T15:03:31.280 INFO:tasks.workunit.client.0.smithi170.stdout:4/63: write d6/f8 [548328,21015] 0 2024-01-25T15:03:31.280 INFO:tasks.workunit.client.0.smithi170.stdout:4/64: dread - d6/d7/f9 zero size 2024-01-25T15:03:31.280 INFO:tasks.workunit.client.0.smithi170.stdout:2/154: dwrite d10/f18 [0,4194304] 0 2024-01-25T15:03:31.280 INFO:tasks.workunit.client.0.smithi170.stdout:2/155: dread - d10/f37 zero size 2024-01-25T15:03:31.280 INFO:tasks.workunit.client.0.smithi170.stdout:2/156: write d10/d1b/f36 [506174,103455] 0 2024-01-25T15:03:31.282 INFO:tasks.workunit.client.0.smithi170.stdout:9/90: mkdir d5/df/d12/d1b 0 2024-01-25T15:03:31.288 INFO:tasks.workunit.client.0.smithi170.stdout:8/51: creat d3/d7/fa x:0 0 0 2024-01-25T15:03:31.288 INFO:tasks.workunit.client.0.smithi170.stdout:3/99: mkdir d3/d10/d1e/d21 0 2024-01-25T15:03:31.292 INFO:tasks.workunit.client.0.smithi170.stdout:4/65: mkdir d6/d11 0 2024-01-25T15:03:31.296 INFO:tasks.workunit.client.0.smithi170.stdout:5/83: rmdir d5 39 2024-01-25T15:03:31.298 INFO:tasks.workunit.client.0.smithi170.stdout:1/104: mkdir d0/d20 0 2024-01-25T15:03:31.298 INFO:tasks.workunit.client.0.smithi170.stdout:1/105: truncate d0/fb 2188690 0 2024-01-25T15:03:31.298 INFO:tasks.workunit.client.0.smithi170.stdout:2/157: rmdir d10/d1b 39 2024-01-25T15:03:31.300 INFO:tasks.workunit.client.0.smithi170.stdout:5/84: rmdir d5 39 2024-01-25T15:03:31.300 INFO:tasks.workunit.client.0.smithi170.stdout:5/85: chown d5/d10 8077368 1 2024-01-25T15:03:31.300 INFO:tasks.workunit.client.0.smithi170.stdout:5/86: write d5/f13 [4668504,40964] 0 2024-01-25T15:03:31.300 INFO:tasks.workunit.client.0.smithi170.stdout:5/87: chown d5/f13 823 1 2024-01-25T15:03:31.305 INFO:tasks.workunit.client.0.smithi170.stdout:1/106: mknod d0/c21 0 2024-01-25T15:03:31.305 INFO:tasks.workunit.client.0.smithi170.stdout:1/107: chown d0/fe 1616 1 2024-01-25T15:03:31.305 INFO:tasks.workunit.client.0.smithi170.stdout:6/46: dread d2/f10 [0,4194304] 0 2024-01-25T15:03:31.306 INFO:tasks.workunit.client.0.smithi170.stdout:1/108: symlink d0/d1b/l22 0 2024-01-25T15:03:31.306 INFO:tasks.workunit.client.0.smithi170.stdout:1/109: rename d0 to d0/d1b/d23 22 2024-01-25T15:03:31.308 INFO:tasks.workunit.client.0.smithi170.stdout:6/47: symlink d2/d7/dd/l12 0 2024-01-25T15:03:31.308 INFO:tasks.workunit.client.0.smithi170.stdout:6/48: fdatasync d2/f3 0 2024-01-25T15:03:31.308 INFO:tasks.workunit.client.0.smithi170.stdout:4/66: dread d6/d7/fa [4194304,4194304] 0 2024-01-25T15:03:31.308 INFO:tasks.workunit.client.0.smithi170.stdout:4/67: truncate d6/f8 1443264 0 2024-01-25T15:03:31.311 INFO:tasks.workunit.client.0.smithi170.stdout:1/110: unlink d0/f15 0 2024-01-25T15:03:31.311 INFO:tasks.workunit.client.0.smithi170.stdout:1/111: dread - d0/f1d zero size 2024-01-25T15:03:31.312 INFO:tasks.workunit.client.0.smithi170.stdout:6/49: truncate d2/f10 822056 0 2024-01-25T15:03:31.314 INFO:tasks.workunit.client.0.smithi170.stdout:1/112: readlink d0/la 0 2024-01-25T15:03:31.314 INFO:tasks.workunit.client.0.smithi170.stdout:1/113: chown d0/f9 24077661 1 2024-01-25T15:03:31.314 INFO:tasks.workunit.client.0.smithi170.stdout:1/114: fsync d0/d1b/f1c 0 2024-01-25T15:03:31.317 INFO:tasks.workunit.client.0.smithi170.stdout:1/115: symlink d0/l24 0 2024-01-25T15:03:31.318 INFO:tasks.workunit.client.0.smithi170.stdout:1/116: mknod d0/d1b/c25 0 2024-01-25T15:03:31.329 INFO:tasks.workunit.client.0.smithi170.stdout:8/52: dwrite d3/d7/fa [0,4194304] 0 2024-01-25T15:03:31.329 INFO:tasks.workunit.client.0.smithi170.stdout:9/91: dwrite d5/f8 [4194304,4194304] 0 2024-01-25T15:03:31.329 INFO:tasks.workunit.client.0.smithi170.stdout:9/92: dread - d5/f14 zero size 2024-01-25T15:03:31.329 INFO:tasks.workunit.client.0.smithi170.stdout:9/93: chown d5/df/d16 8941048 1 2024-01-25T15:03:31.330 INFO:tasks.workunit.client.0.smithi170.stdout:3/100: dwrite d3/d10/d13/f1d [0,4194304] 0 2024-01-25T15:03:31.333 INFO:tasks.workunit.client.0.smithi170.stdout:3/101: dread d3/d10/ff [0,4194304] 0 2024-01-25T15:03:31.333 INFO:tasks.workunit.client.0.smithi170.stdout:2/158: dwrite d10/f12 [0,4194304] 0 2024-01-25T15:03:31.334 INFO:tasks.workunit.client.0.smithi170.stdout:5/88: write d5/d10/f17 [212010,107818] 0 2024-01-25T15:03:31.335 INFO:tasks.workunit.client.0.smithi170.stdout:8/53: getdents d3 0 2024-01-25T15:03:31.337 INFO:tasks.workunit.client.0.smithi170.stdout:3/102: mknod d3/d10/d13/d1b/c22 0 2024-01-25T15:03:31.342 INFO:tasks.workunit.client.0.smithi170.stdout:1/117: read d0/f9 [2640948,39810] 0 2024-01-25T15:03:31.342 INFO:tasks.workunit.client.0.smithi170.stdout:8/54: creat d3/fb x:0 0 0 2024-01-25T15:03:31.343 INFO:tasks.workunit.client.0.smithi170.stdout:8/55: chown d3 3985 1 2024-01-25T15:03:31.343 INFO:tasks.workunit.client.0.smithi170.stdout:8/56: chown f0 0 1 2024-01-25T15:03:31.344 INFO:tasks.workunit.client.0.smithi170.stdout:2/159: getdents d10 0 2024-01-25T15:03:31.344 INFO:tasks.workunit.client.0.smithi170.stdout:2/160: read d10/d1b/f25 [82372,27900] 0 2024-01-25T15:03:31.344 INFO:tasks.workunit.client.0.smithi170.stdout:4/68: dwrite d6/d7/fa [0,4194304] 0 2024-01-25T15:03:31.344 INFO:tasks.workunit.client.0.smithi170.stdout:6/50: dwrite d2/f8 [0,4194304] 0 2024-01-25T15:03:31.348 INFO:tasks.workunit.client.0.smithi170.stdout:2/161: rmdir d10/d1e/d33 0 2024-01-25T15:03:31.351 INFO:tasks.workunit.client.0.smithi170.stdout:1/118: dread d0/ff [0,4194304] 0 2024-01-25T15:03:31.355 INFO:tasks.workunit.client.0.smithi170.stdout:9/94: dwrite d5/f14 [0,4194304] 0 2024-01-25T15:03:31.356 INFO:tasks.workunit.client.0.smithi170.stdout:6/51: creat d2/d7/dd/f13 x:0 0 0 2024-01-25T15:03:31.357 INFO:tasks.workunit.client.0.smithi170.stdout:2/162: creat d10/d1e/d32/f38 x:0 0 0 2024-01-25T15:03:31.358 INFO:tasks.workunit.client.0.smithi170.stdout:1/119: creat d0/d20/f26 x:0 0 0 2024-01-25T15:03:31.358 INFO:tasks.workunit.client.0.smithi170.stdout:1/120: fsync d0/f9 0 2024-01-25T15:03:31.359 INFO:tasks.workunit.client.0.smithi170.stdout:4/69: dread d6/fd [0,4194304] 0 2024-01-25T15:03:31.363 INFO:tasks.workunit.client.0.smithi170.stdout:9/95: creat d5/dc/f1c x:0 0 0 2024-01-25T15:03:31.363 INFO:tasks.workunit.client.0.smithi170.stdout:9/96: fsync d5/df/f1a 0 2024-01-25T15:03:31.366 INFO:tasks.workunit.client.0.smithi170.stdout:6/52: symlink d2/d7/dd/l14 0 2024-01-25T15:03:31.368 INFO:tasks.workunit.client.0.smithi170.stdout:9/97: symlink d5/df/d16/l1d 0 2024-01-25T15:03:31.369 INFO:tasks.workunit.client.0.smithi170.stdout:6/53: dread d2/f10 [0,4194304] 0 2024-01-25T15:03:31.370 INFO:tasks.workunit.client.0.smithi170.stdout:1/121: rename d0/l7 to d0/d20/l27 0 2024-01-25T15:03:31.370 INFO:tasks.workunit.client.0.smithi170.stdout:9/98: mkdir d5/d1e 0 2024-01-25T15:03:31.371 INFO:tasks.workunit.client.0.smithi170.stdout:6/54: symlink d2/d7/l15 0 2024-01-25T15:03:31.371 INFO:tasks.workunit.client.0.smithi170.stdout:6/55: write d2/f5 [4374406,14554] 0 2024-01-25T15:03:31.372 INFO:tasks.workunit.client.0.smithi170.stdout:3/103: dwrite d3/d10/ff [0,4194304] 0 2024-01-25T15:03:31.372 INFO:tasks.workunit.client.0.smithi170.stdout:2/163: write d10/f12 [3733542,89975] 0 2024-01-25T15:03:31.372 INFO:tasks.workunit.client.0.smithi170.stdout:8/57: dwrite d3/f9 [0,4194304] 0 2024-01-25T15:03:31.372 INFO:tasks.workunit.client.0.smithi170.stdout:1/122: mkdir d0/d20/d28 0 2024-01-25T15:03:31.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:31 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:31.375 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:31 smithi170 ceph-mon[31899]: pgmap v394: 97 pgs: 97 active+clean; 133 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.3 MiB/s wr, 1.46k op/s 2024-01-25T15:03:31.377 INFO:tasks.workunit.client.0.smithi170.stdout:4/70: dread f2 [0,4194304] 0 2024-01-25T15:03:31.377 INFO:tasks.workunit.client.0.smithi170.stdout:1/123: creat d0/d20/d28/f29 x:0 0 0 2024-01-25T15:03:31.378 INFO:tasks.workunit.client.0.smithi170.stdout:8/58: link d3/d7/fa d3/d7/fc 0 2024-01-25T15:03:31.380 INFO:tasks.workunit.client.0.smithi170.stdout:1/124: mkdir d0/d20/d28/d2a 0 2024-01-25T15:03:31.381 INFO:tasks.workunit.client.0.smithi170.stdout:4/71: getdents d6 0 2024-01-25T15:03:31.384 INFO:tasks.workunit.client.0.smithi170.stdout:9/99: dread d5/f14 [0,4194304] 0 2024-01-25T15:03:31.385 INFO:tasks.workunit.client.0.smithi170.stdout:4/72: creat d6/d11/f12 x:0 0 0 2024-01-25T15:03:31.385 INFO:tasks.workunit.client.0.smithi170.stdout:4/73: chown d6/d11 443844851 1 2024-01-25T15:03:31.385 INFO:tasks.workunit.client.0.smithi170.stdout:8/59: dread f0 [0,4194304] 0 2024-01-25T15:03:31.386 INFO:tasks.workunit.client.0.smithi170.stdout:1/125: getdents d0 0 2024-01-25T15:03:31.386 INFO:tasks.workunit.client.0.smithi170.stdout:1/126: creat d0/d20/f2b x:0 0 0 2024-01-25T15:03:31.386 INFO:tasks.workunit.client.0.smithi170.stdout:1/127: write d0/f11 [995275,42887] 0 2024-01-25T15:03:31.386 INFO:tasks.workunit.client.0.smithi170.stdout:1/128: fsync d0/f5 0 2024-01-25T15:03:31.386 INFO:tasks.workunit.client.0.smithi170.stdout:1/129: truncate d0/f12 282175 0 2024-01-25T15:03:31.386 INFO:tasks.workunit.client.0.smithi170.stdout:1/130: stat d0/d1b/c25 0 2024-01-25T15:03:31.395 INFO:tasks.workunit.client.0.smithi170.stdout:0/100: sync 2024-01-25T15:03:31.395 INFO:tasks.workunit.client.0.smithi170.stdout:7/101: sync 2024-01-25T15:03:31.395 INFO:tasks.workunit.client.0.smithi170.stdout:0/101: creat d8/d9/f26 x:0 0 0 2024-01-25T15:03:31.396 INFO:tasks.workunit.client.0.smithi170.stdout:7/102: mkdir d8/d20/d2a 0 2024-01-25T15:03:31.401 INFO:tasks.workunit.client.0.smithi170.stdout:2/164: dwrite f8 [0,4194304] 0 2024-01-25T15:03:31.406 INFO:tasks.workunit.client.0.smithi170.stdout:6/56: dwrite d2/f8 [0,4194304] 0 2024-01-25T15:03:31.409 INFO:tasks.workunit.client.0.smithi170.stdout:6/57: symlink d2/l16 0 2024-01-25T15:03:31.410 INFO:tasks.workunit.client.0.smithi170.stdout:6/58: creat d2/f17 x:0 0 0 2024-01-25T15:03:31.410 INFO:tasks.workunit.client.0.smithi170.stdout:6/59: dread - d2/f17 zero size 2024-01-25T15:03:31.413 INFO:tasks.workunit.client.0.smithi170.stdout:6/60: link d2/f8 d2/d7/f18 0 2024-01-25T15:03:31.414 INFO:tasks.workunit.client.0.smithi170.stdout:0/102: dread d8/d9/fe [0,4194304] 0 2024-01-25T15:03:31.414 INFO:tasks.workunit.client.0.smithi170.stdout:0/103: read - d8/d9/f26 zero size 2024-01-25T15:03:31.415 INFO:tasks.workunit.client.0.smithi170.stdout:3/104: dwrite d3/d10/d13/f1d [0,4194304] 0 2024-01-25T15:03:31.415 INFO:tasks.workunit.client.0.smithi170.stdout:3/105: fdatasync d3/d10/d13/f1f 0 2024-01-25T15:03:31.415 INFO:tasks.workunit.client.0.smithi170.stdout:4/74: dwrite d6/f8 [0,4194304] 0 2024-01-25T15:03:31.415 INFO:tasks.workunit.client.0.smithi170.stdout:4/75: fsync d6/fd 0 2024-01-25T15:03:31.415 INFO:tasks.workunit.client.0.smithi170.stdout:8/60: dwrite d3/fb [0,4194304] 0 2024-01-25T15:03:31.415 INFO:tasks.workunit.client.0.smithi170.stdout:8/61: stat f0 0 2024-01-25T15:03:31.417 INFO:tasks.workunit.client.0.smithi170.stdout:3/106: creat d3/d10/f23 x:0 0 0 2024-01-25T15:03:31.417 INFO:tasks.workunit.client.0.smithi170.stdout:3/107: dread - d3/d10/d1e/f20 zero size 2024-01-25T15:03:31.419 INFO:tasks.workunit.client.0.smithi170.stdout:0/104: getdents d8 0 2024-01-25T15:03:31.419 INFO:tasks.workunit.client.0.smithi170.stdout:6/61: dread d2/f3 [0,4194304] 0 2024-01-25T15:03:31.422 INFO:tasks.workunit.client.0.smithi170.stdout:8/62: creat d3/fd x:0 0 0 2024-01-25T15:03:31.425 INFO:tasks.workunit.client.0.smithi170.stdout:8/63: link d3/fb d3/d7/fe 0 2024-01-25T15:03:31.425 INFO:tasks.workunit.client.0.smithi170.stdout:8/64: chown d3/d7/fe 918 1 2024-01-25T15:03:31.425 INFO:tasks.workunit.client.0.smithi170.stdout:8/65: write d3/f9 [4316999,3248] 0 2024-01-25T15:03:31.435 INFO:tasks.workunit.client.0.smithi170.stdout:7/103: dwrite d8/d20/f26 [0,4194304] 0 2024-01-25T15:03:31.439 INFO:tasks.workunit.client.0.smithi170.stdout:0/105: dread d8/d9/fe [0,4194304] 0 2024-01-25T15:03:31.447 INFO:tasks.workunit.client.0.smithi170.stdout:9/100: dwrite d5/df/d16/f19 [0,4194304] 0 2024-01-25T15:03:31.447 INFO:tasks.workunit.client.0.smithi170.stdout:4/76: dwrite d6/d7/f9 [0,4194304] 0 2024-01-25T15:03:31.448 INFO:tasks.workunit.client.0.smithi170.stdout:3/108: dwrite d3/d10/f14 [4194304,4194304] 0 2024-01-25T15:03:31.448 INFO:tasks.workunit.client.0.smithi170.stdout:3/109: stat l2 0 2024-01-25T15:03:31.449 INFO:tasks.workunit.client.0.smithi170.stdout:2/165: dwrite d10/f12 [0,4194304] 0 2024-01-25T15:03:31.452 INFO:tasks.workunit.client.0.smithi170.stdout:4/77: unlink d6/d7/lb 0 2024-01-25T15:03:31.452 INFO:tasks.workunit.client.0.smithi170.stdout:4/78: readlink d6/le 0 2024-01-25T15:03:31.452 INFO:tasks.workunit.client.0.smithi170.stdout:4/79: truncate d6/d11/f12 405691 0 2024-01-25T15:03:31.452 INFO:tasks.workunit.client.0.smithi170.stdout:4/80: write d6/d11/f12 [997049,120608] 0 2024-01-25T15:03:31.453 INFO:tasks.workunit.client.0.smithi170.stdout:9/101: truncate d5/dc/fe 1164506 0 2024-01-25T15:03:31.455 INFO:tasks.workunit.client.0.smithi170.stdout:7/104: write d8/f13 [2869967,84196] 0 2024-01-25T15:03:31.456 INFO:tasks.workunit.client.0.smithi170.stdout:3/110: creat d3/d1c/f24 x:0 0 0 2024-01-25T15:03:31.456 INFO:tasks.workunit.client.0.smithi170.stdout:3/111: creat d3/d10/d13/f25 x:0 0 0 2024-01-25T15:03:31.456 INFO:tasks.workunit.client.0.smithi170.stdout:3/112: truncate d3/d10/d13/f25 734134 0 2024-01-25T15:03:31.458 INFO:tasks.workunit.client.0.smithi170.stdout:2/166: mknod d10/d1b/c39 0 2024-01-25T15:03:31.459 INFO:tasks.workunit.client.0.smithi170.stdout:4/81: mknod d6/d11/c13 0 2024-01-25T15:03:31.460 INFO:tasks.workunit.client.0.smithi170.stdout:9/102: link f2 d5/df/d12/d18/f1f 0 2024-01-25T15:03:31.461 INFO:tasks.workunit.client.0.smithi170.stdout:9/103: truncate d5/dc/f1c 421408 0 2024-01-25T15:03:31.461 INFO:tasks.workunit.client.0.smithi170.stdout:7/105: symlink d8/d20/d2a/l2b 0 2024-01-25T15:03:31.462 INFO:tasks.workunit.client.0.smithi170.stdout:3/113: mkdir d3/d10/d1e/d21/d26 0 2024-01-25T15:03:31.462 INFO:tasks.workunit.client.0.smithi170.stdout:3/114: truncate d3/d10/f16 987564 0 2024-01-25T15:03:31.463 INFO:tasks.workunit.client.0.smithi170.stdout:4/82: creat d6/d7/f14 x:0 0 0 2024-01-25T15:03:31.464 INFO:tasks.workunit.client.0.smithi170.stdout:4/83: mknod d6/d11/c15 0 2024-01-25T15:03:31.464 INFO:tasks.workunit.client.0.smithi170.stdout:6/62: dwrite d2/f4 [0,4194304] 0 2024-01-25T15:03:31.465 INFO:tasks.workunit.client.0.smithi170.stdout:7/106: mknod d8/c2c 0 2024-01-25T15:03:31.467 INFO:tasks.workunit.client.0.smithi170.stdout:8/66: dwrite f0 [0,4194304] 0 2024-01-25T15:03:31.467 INFO:tasks.workunit.client.0.smithi170.stdout:6/63: mkdir d2/d7/dd/d19 0 2024-01-25T15:03:31.469 INFO:tasks.workunit.client.0.smithi170.stdout:7/107: creat d8/d20/d2a/f2d x:0 0 0 2024-01-25T15:03:31.469 INFO:tasks.workunit.client.0.smithi170.stdout:7/108: truncate d8/f24 181760 0 2024-01-25T15:03:31.469 INFO:tasks.workunit.client.0.smithi170.stdout:7/109: creat d8/d20/f2e x:0 0 0 2024-01-25T15:03:31.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:31 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:31.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:31 smithi191 ceph-mon[36347]: pgmap v394: 97 pgs: 97 active+clean; 133 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.3 MiB/s wr, 1.46k op/s 2024-01-25T15:03:31.487 INFO:tasks.workunit.client.0.smithi170.stdout:4/84: write f2 [275606,88518] 0 2024-01-25T15:03:31.488 INFO:tasks.workunit.client.0.smithi170.stdout:3/115: dwrite d3/f12 [0,4194304] 0 2024-01-25T15:03:31.492 INFO:tasks.workunit.client.0.smithi170.stdout:2/167: write d10/f13 [3816755,67126] 0 2024-01-25T15:03:31.492 INFO:tasks.workunit.client.0.smithi170.stdout:3/116: mknod d3/d10/d13/c27 0 2024-01-25T15:03:31.492 INFO:tasks.workunit.client.0.smithi170.stdout:3/117: chown d3/f17 1 1 2024-01-25T15:03:31.492 INFO:tasks.workunit.client.0.smithi170.stdout:3/118: chown d3/d10/d13/f1f 48483 1 2024-01-25T15:03:31.494 INFO:tasks.workunit.client.0.smithi170.stdout:2/168: rename d10/d1e/l2b to d10/d1e/l3a 0 2024-01-25T15:03:31.495 INFO:tasks.workunit.client.0.smithi170.stdout:2/169: creat d10/d16/f3b x:0 0 0 2024-01-25T15:03:31.496 INFO:tasks.workunit.client.0.smithi170.stdout:3/119: rmdir d3 39 2024-01-25T15:03:31.499 INFO:tasks.workunit.client.0.smithi170.stdout:3/120: mknod d3/d10/d13/d1b/c28 0 2024-01-25T15:03:31.501 INFO:tasks.workunit.client.0.smithi170.stdout:3/121: rmdir d3/d10/d1e/d21/d26 0 2024-01-25T15:03:31.502 INFO:tasks.workunit.client.0.smithi170.stdout:5/89: sync 2024-01-25T15:03:31.502 INFO:tasks.workunit.client.0.smithi170.stdout:5/90: fsync d5/d10/f1a 0 2024-01-25T15:03:31.502 INFO:tasks.workunit.client.0.smithi170.stdout:5/91: write d5/f1e [90283,122669] 0 2024-01-25T15:03:31.502 INFO:tasks.workunit.client.0.smithi170.stdout:8/67: write d3/f9 [1836530,59668] 0 2024-01-25T15:03:31.504 INFO:tasks.workunit.client.0.smithi170.stdout:9/104: dwrite d5/f14 [0,4194304] 0 2024-01-25T15:03:31.504 INFO:tasks.workunit.client.0.smithi170.stdout:9/105: creat d5/df/f20 x:0 0 0 2024-01-25T15:03:31.504 INFO:tasks.workunit.client.0.smithi170.stdout:9/106: fsync d5/dc/fe 0 2024-01-25T15:03:31.504 INFO:tasks.workunit.client.0.smithi170.stdout:5/92: link c3 d5/c1f 0 2024-01-25T15:03:31.504 INFO:tasks.workunit.client.0.smithi170.stdout:5/93: write d5/f15 [918019,15387] 0 2024-01-25T15:03:31.505 INFO:tasks.workunit.client.0.smithi170.stdout:9/107: read d5/f11 [54495,5922] 0 2024-01-25T15:03:31.505 INFO:tasks.workunit.client.0.smithi170.stdout:9/108: write d5/df/d12/d18/f1f [2322901,70471] 0 2024-01-25T15:03:31.507 INFO:tasks.workunit.client.0.smithi170.stdout:9/109: mkdir d5/d1e/d21 0 2024-01-25T15:03:31.507 INFO:tasks.workunit.client.0.smithi170.stdout:9/110: stat d5/df/f1a 0 2024-01-25T15:03:31.507 INFO:tasks.workunit.client.0.smithi170.stdout:6/64: dwrite d2/f3 [0,4194304] 0 2024-01-25T15:03:31.509 INFO:tasks.workunit.client.0.smithi170.stdout:6/65: symlink d2/d7/l1a 0 2024-01-25T15:03:31.512 INFO:tasks.workunit.client.0.smithi170.stdout:2/170: dread ff [0,4194304] 0 2024-01-25T15:03:31.512 INFO:tasks.workunit.client.0.smithi170.stdout:3/122: write d3/d10/ff [654139,42260] 0 2024-01-25T15:03:31.514 INFO:tasks.workunit.client.0.smithi170.stdout:4/85: dwrite d6/d7/fa [0,4194304] 0 2024-01-25T15:03:31.514 INFO:tasks.workunit.client.0.smithi170.stdout:6/66: dread d2/f6 [0,4194304] 0 2024-01-25T15:03:31.514 INFO:tasks.workunit.client.0.smithi170.stdout:6/67: chown d2/d7 991 1 2024-01-25T15:03:31.514 INFO:tasks.workunit.client.0.smithi170.stdout:8/68: read f0 [1420663,27071] 0 2024-01-25T15:03:31.514 INFO:tasks.workunit.client.0.smithi170.stdout:7/110: dwrite d8/f13 [4194304,4194304] 0 2024-01-25T15:03:31.517 INFO:tasks.workunit.client.0.smithi170.stdout:3/123: mkdir d3/d10/d13/d1b/d29 0 2024-01-25T15:03:31.517 INFO:tasks.workunit.client.0.smithi170.stdout:3/124: fsync d3/fa 0 2024-01-25T15:03:31.518 INFO:tasks.workunit.client.0.smithi170.stdout:4/86: symlink d6/l16 0 2024-01-25T15:03:31.519 INFO:tasks.workunit.client.0.smithi170.stdout:6/68: mkdir d2/d7/d1b 0 2024-01-25T15:03:31.529 INFO:tasks.workunit.client.0.smithi170.stdout:4/87: rename d6/d11/f12 to d6/d7/f17 0 2024-01-25T15:03:31.529 INFO:tasks.workunit.client.0.smithi170.stdout:6/69: link f0 d2/d7/f1c 0 2024-01-25T15:03:31.529 INFO:tasks.workunit.client.0.smithi170.stdout:7/111: mkdir d8/d2f 0 2024-01-25T15:03:31.529 INFO:tasks.workunit.client.0.smithi170.stdout:7/112: readlink d8/d20/l25 0 2024-01-25T15:03:31.529 INFO:tasks.workunit.client.0.smithi170.stdout:7/113: creat d8/d20/f30 x:0 0 0 2024-01-25T15:03:31.530 INFO:tasks.workunit.client.0.smithi170.stdout:3/125: mkdir d3/d2a 0 2024-01-25T15:03:31.531 INFO:tasks.workunit.client.0.smithi170.stdout:4/88: mkdir d6/d18 0 2024-01-25T15:03:31.533 INFO:tasks.workunit.client.0.smithi170.stdout:6/70: rename d2/d7/l1a to d2/d7/d1b/l1d 0 2024-01-25T15:03:31.533 INFO:tasks.workunit.client.0.smithi170.stdout:6/71: read - d2/d7/dd/f13 zero size 2024-01-25T15:03:31.533 INFO:tasks.workunit.client.0.smithi170.stdout:6/72: chown d2/f17 56931 1 2024-01-25T15:03:31.535 INFO:tasks.workunit.client.0.smithi170.stdout:7/114: unlink d8/d20/l27 0 2024-01-25T15:03:31.535 INFO:tasks.workunit.client.0.smithi170.stdout:2/171: dwrite d10/f18 [0,4194304] 0 2024-01-25T15:03:31.538 INFO:tasks.workunit.client.0.smithi170.stdout:7/115: unlink d8/c28 0 2024-01-25T15:03:31.541 INFO:tasks.workunit.client.0.smithi170.stdout:3/126: rmdir d3/d10 39 2024-01-25T15:03:31.544 INFO:tasks.workunit.client.0.smithi170.stdout:4/89: write d6/f8 [959908,24672] 0 2024-01-25T15:03:31.544 INFO:tasks.workunit.client.0.smithi170.stdout:3/127: truncate d3/f12 704283 0 2024-01-25T15:03:31.546 INFO:tasks.workunit.client.0.smithi170.stdout:3/128: mkdir d3/d1c/d2b 0 2024-01-25T15:03:31.547 INFO:tasks.workunit.client.0.smithi170.stdout:5/94: dwrite d5/f15 [0,4194304] 0 2024-01-25T15:03:31.549 INFO:tasks.workunit.client.0.smithi170.stdout:3/129: rename d3/fd to d3/d10/d13/d1b/f2c 0 2024-01-25T15:03:31.549 INFO:tasks.workunit.client.0.smithi170.stdout:3/130: write d3/d10/f16 [1232474,26720] 0 2024-01-25T15:03:31.549 INFO:tasks.workunit.client.0.smithi170.stdout:1/131: sync 2024-01-25T15:03:31.550 INFO:tasks.workunit.client.0.smithi170.stdout:1/132: chown d0/fb 43 1 2024-01-25T15:03:31.550 INFO:tasks.workunit.client.0.smithi170.stdout:1/133: rename d0 to d0/d1b/d2c 22 2024-01-25T15:03:31.550 INFO:tasks.workunit.client.0.smithi170.stdout:1/134: stat d0/d20/d28 0 2024-01-25T15:03:31.551 INFO:tasks.workunit.client.0.smithi170.stdout:5/95: chown d5/d10/l18 132231981 1 2024-01-25T15:03:31.551 INFO:tasks.workunit.client.0.smithi170.stdout:5/96: readlink d5/d10/l18 0 2024-01-25T15:03:31.553 INFO:tasks.workunit.client.0.smithi170.stdout:2/172: dread d10/f12 [0,4194304] 0 2024-01-25T15:03:31.554 INFO:tasks.workunit.client.0.smithi170.stdout:1/135: link d0/c10 d0/d20/c2d 0 2024-01-25T15:03:31.554 INFO:tasks.workunit.client.0.smithi170.stdout:1/136: write d0/d20/d28/f29 [335203,109102] 0 2024-01-25T15:03:31.556 INFO:tasks.workunit.client.0.smithi170.stdout:5/97: creat d5/d10/f20 x:0 0 0 2024-01-25T15:03:31.556 INFO:tasks.workunit.client.0.smithi170.stdout:5/98: readlink d5/d10/l18 0 2024-01-25T15:03:31.557 INFO:tasks.workunit.client.0.smithi170.stdout:7/116: getdents d8/d20 0 2024-01-25T15:03:31.559 INFO:tasks.workunit.client.0.smithi170.stdout:2/173: mknod d10/d1b/c3c 0 2024-01-25T15:03:31.559 INFO:tasks.workunit.client.0.smithi170.stdout:2/174: fdatasync f8 0 2024-01-25T15:03:31.559 INFO:tasks.workunit.client.0.smithi170.stdout:2/175: fsync d10/f18 0 2024-01-25T15:03:31.559 INFO:tasks.workunit.client.0.smithi170.stdout:3/131: dread d3/d10/f14 [0,4194304] 0 2024-01-25T15:03:31.560 INFO:tasks.workunit.client.0.smithi170.stdout:2/176: dread d10/d1b/f25 [0,4194304] 0 2024-01-25T15:03:31.563 INFO:tasks.workunit.client.0.smithi170.stdout:1/137: dread d0/fb [0,4194304] 0 2024-01-25T15:03:31.563 INFO:tasks.workunit.client.0.smithi170.stdout:1/138: fsync d0/fb 0 2024-01-25T15:03:31.564 INFO:tasks.workunit.client.0.smithi170.stdout:6/73: dwrite d2/f3 [0,4194304] 0 2024-01-25T15:03:31.564 INFO:tasks.workunit.client.0.smithi170.stdout:2/177: symlink d10/l3d 0 2024-01-25T15:03:31.564 INFO:tasks.workunit.client.0.smithi170.stdout:2/178: readlink d10/d1e/l3a 0 2024-01-25T15:03:31.566 INFO:tasks.workunit.client.0.smithi170.stdout:1/139: mkdir d0/d2e 0 2024-01-25T15:03:31.567 INFO:tasks.workunit.client.0.smithi170.stdout:1/140: dread d0/f12 [0,4194304] 0 2024-01-25T15:03:31.568 INFO:tasks.workunit.client.0.smithi170.stdout:7/117: rename d8/f16 to d8/f31 0 2024-01-25T15:03:31.568 INFO:tasks.workunit.client.0.smithi170.stdout:7/118: read - d8/d20/f2e zero size 2024-01-25T15:03:31.569 INFO:tasks.workunit.client.0.smithi170.stdout:2/179: mkdir d10/d1e/d32/d3e 0 2024-01-25T15:03:31.571 INFO:tasks.workunit.client.0.smithi170.stdout:1/141: link d0/fb d0/f2f 0 2024-01-25T15:03:31.571 INFO:tasks.workunit.client.0.smithi170.stdout:1/142: write d0/d20/f2b [531614,112929] 0 2024-01-25T15:03:31.572 INFO:tasks.workunit.client.0.smithi170.stdout:1/143: readlink d0/l13 0 2024-01-25T15:03:31.573 INFO:tasks.workunit.client.0.smithi170.stdout:2/180: rename d10/d1e/l22 to d10/l3f 0 2024-01-25T15:03:31.573 INFO:tasks.workunit.client.0.smithi170.stdout:5/99: getdents d5/d10 0 2024-01-25T15:03:31.573 INFO:tasks.workunit.client.0.smithi170.stdout:5/100: write d5/f1b [1357994,59592] 0 2024-01-25T15:03:31.576 INFO:tasks.workunit.client.0.smithi170.stdout:1/144: symlink d0/d20/d28/d2a/l30 0 2024-01-25T15:03:31.576 INFO:tasks.workunit.client.0.smithi170.stdout:1/145: truncate d0/d1b/f1f 5065713 0 2024-01-25T15:03:31.576 INFO:tasks.workunit.client.0.smithi170.stdout:2/181: symlink d10/d16/l40 0 2024-01-25T15:03:31.576 INFO:tasks.workunit.client.0.smithi170.stdout:5/101: creat d5/d10/f21 x:0 0 0 2024-01-25T15:03:31.578 INFO:tasks.workunit.client.0.smithi170.stdout:6/74: dread d2/f8 [0,4194304] 0 2024-01-25T15:03:31.578 INFO:tasks.workunit.client.0.smithi170.stdout:6/75: truncate d2/d7/f1c 840017 0 2024-01-25T15:03:31.578 INFO:tasks.workunit.client.0.smithi170.stdout:6/76: truncate d2/d7/f18 5045267 0 2024-01-25T15:03:31.579 INFO:tasks.workunit.client.0.smithi170.stdout:6/77: symlink d2/d7/l1e 0 2024-01-25T15:03:31.580 INFO:tasks.workunit.client.0.smithi170.stdout:4/90: dwrite d6/d7/f17 [0,4194304] 0 2024-01-25T15:03:31.580 INFO:tasks.workunit.client.0.smithi170.stdout:4/91: write d6/d7/f14 [168784,62571] 0 2024-01-25T15:03:31.580 INFO:tasks.workunit.client.0.smithi170.stdout:6/78: creat d2/d7/d1b/f1f x:0 0 0 2024-01-25T15:03:31.583 INFO:tasks.workunit.client.0.smithi170.stdout:4/92: symlink d6/d11/l19 0 2024-01-25T15:03:31.583 INFO:tasks.workunit.client.0.smithi170.stdout:4/93: creat d6/d7/f1a x:0 0 0 2024-01-25T15:03:31.584 INFO:tasks.workunit.client.0.smithi170.stdout:6/79: creat d2/d7/dd/d19/f20 x:0 0 0 2024-01-25T15:03:31.585 INFO:tasks.workunit.client.0.smithi170.stdout:6/80: mknod d2/c21 0 2024-01-25T15:03:31.587 INFO:tasks.workunit.client.0.smithi170.stdout:1/146: dread d0/f5 [0,4194304] 0 2024-01-25T15:03:31.587 INFO:tasks.workunit.client.0.smithi170.stdout:3/132: dwrite d3/d10/d13/f1f [0,4194304] 0 2024-01-25T15:03:31.587 INFO:tasks.workunit.client.0.smithi170.stdout:1/147: chown d0/c10 3566300 1 2024-01-25T15:03:31.590 INFO:tasks.workunit.client.0.smithi170.stdout:4/94: dread d6/f8 [0,4194304] 0 2024-01-25T15:03:31.590 INFO:tasks.workunit.client.0.smithi170.stdout:1/148: creat d0/d2e/f31 x:0 0 0 2024-01-25T15:03:31.590 INFO:tasks.workunit.client.0.smithi170.stdout:1/149: write d0/d2e/f31 [448413,70988] 0 2024-01-25T15:03:31.591 INFO:tasks.workunit.client.0.smithi170.stdout:6/81: write d2/d7/f18 [1563828,36607] 0 2024-01-25T15:03:31.591 INFO:tasks.workunit.client.0.smithi170.stdout:6/82: truncate d2/f17 447792 0 2024-01-25T15:03:31.591 INFO:tasks.workunit.client.0.smithi170.stdout:6/83: dread - d2/d7/dd/f13 zero size 2024-01-25T15:03:31.592 INFO:tasks.workunit.client.0.smithi170.stdout:4/95: mkdir d6/d7/d1b 0 2024-01-25T15:03:31.593 INFO:tasks.workunit.client.0.smithi170.stdout:1/150: mknod d0/d20/d28/c32 0 2024-01-25T15:03:31.594 INFO:tasks.workunit.client.0.smithi170.stdout:7/119: dwrite f7 [0,4194304] 0 2024-01-25T15:03:31.594 INFO:tasks.workunit.client.0.smithi170.stdout:7/120: write d8/f1e [871153,15736] 0 2024-01-25T15:03:31.594 INFO:tasks.workunit.client.0.smithi170.stdout:7/121: fdatasync f2 0 2024-01-25T15:03:31.594 INFO:tasks.workunit.client.0.smithi170.stdout:7/122: truncate d8/f12 1306811 0 2024-01-25T15:03:31.594 INFO:tasks.workunit.client.0.smithi170.stdout:6/84: mknod d2/d7/dd/d19/c22 0 2024-01-25T15:03:31.594 INFO:tasks.workunit.client.0.smithi170.stdout:4/96: mknod d6/c1c 0 2024-01-25T15:03:31.595 INFO:tasks.workunit.client.0.smithi170.stdout:7/123: fsync d8/f17 0 2024-01-25T15:03:31.596 INFO:tasks.workunit.client.0.smithi170.stdout:7/124: read d8/f31 [418540,101998] 0 2024-01-25T15:03:31.596 INFO:tasks.workunit.client.0.smithi170.stdout:7/125: readlink d8/d20/l25 0 2024-01-25T15:03:31.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:31 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:31.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:31 smithi186 ceph-mon[35697]: pgmap v394: 97 pgs: 97 active+clean; 133 MiB data, 825 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.3 MiB/s wr, 1.46k op/s 2024-01-25T15:03:31.604 INFO:tasks.workunit.client.0.smithi170.stdout:2/182: dwrite ff [0,4194304] 0 2024-01-25T15:03:31.605 INFO:tasks.workunit.client.0.smithi170.stdout:2/183: write d10/f37 [942074,78809] 0 2024-01-25T15:03:31.606 INFO:tasks.workunit.client.0.smithi170.stdout:1/151: dread d0/ff [0,4194304] 0 2024-01-25T15:03:31.608 INFO:tasks.workunit.client.0.smithi170.stdout:7/126: dread d8/f18 [0,4194304] 0 2024-01-25T15:03:31.611 INFO:tasks.workunit.client.0.smithi170.stdout:2/184: mkdir d10/d1e/d32/d3e/d41 0 2024-01-25T15:03:31.612 INFO:tasks.workunit.client.0.smithi170.stdout:6/85: rename d2/d7/dd to d2/d7/d23 0 2024-01-25T15:03:31.613 INFO:tasks.workunit.client.0.smithi170.stdout:1/152: creat d0/f33 x:0 0 0 2024-01-25T15:03:31.613 INFO:tasks.workunit.client.0.smithi170.stdout:1/153: dread - d0/d20/f26 zero size 2024-01-25T15:03:31.613 INFO:tasks.workunit.client.0.smithi170.stdout:1/154: fdatasync d0/fb 0 2024-01-25T15:03:31.613 INFO:tasks.workunit.client.0.smithi170.stdout:1/155: dread - d0/f1d zero size 2024-01-25T15:03:31.614 INFO:tasks.workunit.client.0.smithi170.stdout:7/127: creat d8/d2f/f32 x:0 0 0 2024-01-25T15:03:31.614 INFO:tasks.workunit.client.0.smithi170.stdout:7/128: write d8/f12 [1866770,25552] 0 2024-01-25T15:03:31.615 INFO:tasks.workunit.client.0.smithi170.stdout:4/97: write d6/fd [2194913,105583] 0 2024-01-25T15:03:31.615 INFO:tasks.workunit.client.0.smithi170.stdout:4/98: write f2 [790721,79605] 0 2024-01-25T15:03:31.615 INFO:tasks.workunit.client.0.smithi170.stdout:1/156: mknod d0/d20/d28/d2a/c34 0 2024-01-25T15:03:31.615 INFO:tasks.workunit.client.0.smithi170.stdout:1/157: creat d0/d20/d28/f35 x:0 0 0 2024-01-25T15:03:31.617 INFO:tasks.workunit.client.0.smithi170.stdout:4/99: fdatasync d6/fd 0 2024-01-25T15:03:31.620 INFO:tasks.workunit.client.0.smithi170.stdout:1/158: truncate d0/f12 268055 0 2024-01-25T15:03:31.620 INFO:tasks.workunit.client.0.smithi170.stdout:1/159: creat d0/d20/d28/f36 x:0 0 0 2024-01-25T15:03:31.621 INFO:tasks.workunit.client.0.smithi170.stdout:7/129: symlink d8/l33 0 2024-01-25T15:03:31.621 INFO:tasks.workunit.client.0.smithi170.stdout:7/130: creat d8/d20/d2a/f34 x:0 0 0 2024-01-25T15:03:31.621 INFO:tasks.workunit.client.0.smithi170.stdout:7/131: dread - d8/f1d zero size 2024-01-25T15:03:31.623 INFO:tasks.workunit.client.0.smithi170.stdout:3/133: dwrite d3/d10/f14 [0,4194304] 0 2024-01-25T15:03:31.626 INFO:tasks.workunit.client.0.smithi170.stdout:6/86: dread d2/f4 [4194304,4194304] 0 2024-01-25T15:03:31.626 INFO:tasks.workunit.client.0.smithi170.stdout:5/102: dwrite d5/f1b [0,4194304] 0 2024-01-25T15:03:31.628 INFO:tasks.workunit.client.0.smithi170.stdout:4/100: dread d6/d7/f14 [0,4194304] 0 2024-01-25T15:03:31.628 INFO:tasks.workunit.client.0.smithi170.stdout:4/101: write d6/d7/fa [6254506,14721] 0 2024-01-25T15:03:31.631 INFO:tasks.workunit.client.0.smithi170.stdout:5/103: symlink d5/l22 0 2024-01-25T15:03:31.632 INFO:tasks.workunit.client.0.smithi170.stdout:6/87: rmdir d2/d7/d23 39 2024-01-25T15:03:31.632 INFO:tasks.workunit.client.0.smithi170.stdout:6/88: dread - d2/d7/d23/f13 zero size 2024-01-25T15:03:31.635 INFO:tasks.workunit.client.0.smithi170.stdout:0/106: sync 2024-01-25T15:03:31.635 INFO:tasks.workunit.client.0.smithi170.stdout:0/107: chown d8/d9/f26 120171113 1 2024-01-25T15:03:31.635 INFO:tasks.workunit.client.0.smithi170.stdout:0/108: write d8/d9/f26 [767838,105621] 0 2024-01-25T15:03:31.635 INFO:tasks.workunit.client.0.smithi170.stdout:0/109: chown d8/fa 225 1 2024-01-25T15:03:31.636 INFO:tasks.workunit.client.0.smithi170.stdout:2/185: dwrite d10/d16/f23 [0,4194304] 0 2024-01-25T15:03:31.639 INFO:tasks.workunit.client.0.smithi170.stdout:3/134: dread d3/d10/d13/f1f [0,4194304] 0 2024-01-25T15:03:31.639 INFO:tasks.workunit.client.0.smithi170.stdout:3/135: write d3/d1c/f24 [1027886,44818] 0 2024-01-25T15:03:31.642 INFO:tasks.workunit.client.0.smithi170.stdout:1/160: dwrite d0/f9 [0,4194304] 0 2024-01-25T15:03:31.642 INFO:tasks.workunit.client.0.smithi170.stdout:1/161: write d0/f12 [498826,128373] 0 2024-01-25T15:03:31.642 INFO:tasks.workunit.client.0.smithi170.stdout:0/110: truncate d8/ff 2865443 0 2024-01-25T15:03:31.643 INFO:tasks.workunit.client.0.smithi170.stdout:5/104: write d5/fd [694694,44944] 0 2024-01-25T15:03:31.643 INFO:tasks.workunit.client.0.smithi170.stdout:2/186: mkdir d10/d16/d42 0 2024-01-25T15:03:31.643 INFO:tasks.workunit.client.0.smithi170.stdout:2/187: write d10/f13 [4452203,9897] 0 2024-01-25T15:03:31.644 INFO:tasks.workunit.client.0.smithi170.stdout:2/188: truncate d10/d16/f3b 495692 0 2024-01-25T15:03:31.644 INFO:tasks.workunit.client.0.smithi170.stdout:2/189: write d10/d1e/d32/f38 [369708,90329] 0 2024-01-25T15:03:31.644 INFO:tasks.workunit.client.0.smithi170.stdout:3/136: getdents d3/d10/d1e 0 2024-01-25T15:03:31.646 INFO:tasks.workunit.client.0.smithi170.stdout:7/132: rename d8/d2f to d8/d20/d2a/d35 0 2024-01-25T15:03:31.646 INFO:tasks.workunit.client.0.smithi170.stdout:4/102: dread d6/fd [0,4194304] 0 2024-01-25T15:03:31.646 INFO:tasks.workunit.client.0.smithi170.stdout:4/103: chown d6/fd 1275112 1 2024-01-25T15:03:31.647 INFO:tasks.workunit.client.0.smithi170.stdout:4/104: chown d6/d7/d1b 1 1 2024-01-25T15:03:31.647 INFO:tasks.workunit.client.0.smithi170.stdout:0/111: getdents d8/d18 0 2024-01-25T15:03:31.648 INFO:tasks.workunit.client.0.smithi170.stdout:5/105: creat d5/d10/f23 x:0 0 0 2024-01-25T15:03:31.649 INFO:tasks.workunit.client.0.smithi170.stdout:3/137: mkdir d3/d1c/d2d 0 2024-01-25T15:03:31.649 INFO:tasks.workunit.client.0.smithi170.stdout:3/138: fdatasync d3/f17 0 2024-01-25T15:03:31.649 INFO:tasks.workunit.client.0.smithi170.stdout:3/139: chown d3/d10/d1e 363 1 2024-01-25T15:03:31.650 INFO:tasks.workunit.client.0.smithi170.stdout:2/190: rename d10/l14 to d10/d1e/l43 0 2024-01-25T15:03:31.650 INFO:tasks.workunit.client.0.smithi170.stdout:7/133: symlink d8/d20/d2a/l36 0 2024-01-25T15:03:31.651 INFO:tasks.workunit.client.0.smithi170.stdout:0/112: mknod d8/c27 0 2024-01-25T15:03:31.651 INFO:tasks.workunit.client.0.smithi170.stdout:5/106: write d5/d10/f20 [409383,4795] 0 2024-01-25T15:03:31.652 INFO:tasks.workunit.client.0.smithi170.stdout:3/140: symlink d3/d10/d13/d1b/l2e 0 2024-01-25T15:03:31.653 INFO:tasks.workunit.client.0.smithi170.stdout:2/191: mknod d10/d1e/d32/d3e/c44 0 2024-01-25T15:03:31.654 INFO:tasks.workunit.client.0.smithi170.stdout:7/134: unlink d8/l21 0 2024-01-25T15:03:31.655 INFO:tasks.workunit.client.0.smithi170.stdout:0/113: rename d8/d18/l1c to d8/d9/l28 0 2024-01-25T15:03:31.657 INFO:tasks.workunit.client.0.smithi170.stdout:5/107: getdents d5 0 2024-01-25T15:03:31.657 INFO:tasks.workunit.client.0.smithi170.stdout:8/69: sync 2024-01-25T15:03:31.657 INFO:tasks.workunit.client.0.smithi170.stdout:9/111: sync 2024-01-25T15:03:31.658 INFO:tasks.workunit.client.0.smithi170.stdout:7/135: truncate d8/f12 1884913 0 2024-01-25T15:03:31.660 INFO:tasks.workunit.client.0.smithi170.stdout:3/141: rename d3/c11 to d3/d1c/d2d/c2f 0 2024-01-25T15:03:31.660 INFO:tasks.workunit.client.0.smithi170.stdout:3/142: write d3/d10/ff [4958367,96506] 0 2024-01-25T15:03:31.661 INFO:tasks.workunit.client.0.smithi170.stdout:0/114: unlink d8/d10/l1f 0 2024-01-25T15:03:31.663 INFO:tasks.workunit.client.0.smithi170.stdout:2/192: dread f8 [4194304,4194304] 0 2024-01-25T15:03:31.663 INFO:tasks.workunit.client.0.smithi170.stdout:6/89: dwrite d2/f17 [0,4194304] 0 2024-01-25T15:03:31.663 INFO:tasks.workunit.client.0.smithi170.stdout:5/108: creat d5/f24 x:0 0 0 2024-01-25T15:03:31.663 INFO:tasks.workunit.client.0.smithi170.stdout:1/162: dwrite d0/d20/d28/f36 [0,4194304] 0 2024-01-25T15:03:31.664 INFO:tasks.workunit.client.0.smithi170.stdout:9/112: write d5/dc/fe [679757,11702] 0 2024-01-25T15:03:31.664 INFO:tasks.workunit.client.0.smithi170.stdout:8/70: mknod d3/d7/cf 0 2024-01-25T15:03:31.664 INFO:tasks.workunit.client.0.smithi170.stdout:8/71: write f0 [3060160,120824] 0 2024-01-25T15:03:31.665 INFO:tasks.workunit.client.0.smithi170.stdout:8/72: creat d3/d7/f10 x:0 0 0 2024-01-25T15:03:31.666 INFO:tasks.workunit.client.0.smithi170.stdout:7/136: creat d8/d20/d2a/d35/f37 x:0 0 0 2024-01-25T15:03:31.669 INFO:tasks.workunit.client.0.smithi170.stdout:3/143: creat d3/d10/d1e/f30 x:0 0 0 2024-01-25T15:03:31.672 INFO:tasks.workunit.client.0.smithi170.stdout:2/193: write d10/f12 [1208447,106908] 0 2024-01-25T15:03:31.673 INFO:tasks.workunit.client.0.smithi170.stdout:4/105: dwrite d6/d7/f14 [0,4194304] 0 2024-01-25T15:03:31.674 INFO:tasks.workunit.client.0.smithi170.stdout:0/115: dread d8/d9/f26 [0,4194304] 0 2024-01-25T15:03:31.674 INFO:tasks.workunit.client.0.smithi170.stdout:0/116: write d8/fa [4599407,71246] 0 2024-01-25T15:03:31.676 INFO:tasks.workunit.client.0.smithi170.stdout:1/163: symlink d0/d2e/l37 0 2024-01-25T15:03:31.676 INFO:tasks.workunit.client.0.smithi170.stdout:1/164: chown d0/d1b/c1e 2792 1 2024-01-25T15:03:31.676 INFO:tasks.workunit.client.0.smithi170.stdout:1/165: chown d0/la 51 1 2024-01-25T15:03:31.677 INFO:tasks.workunit.client.0.smithi170.stdout:9/113: link d5/df/f15 d5/df/d12/f22 0 2024-01-25T15:03:31.679 INFO:tasks.workunit.client.0.smithi170.stdout:6/90: write d2/f5 [3460707,19090] 0 2024-01-25T15:03:31.680 INFO:tasks.workunit.client.0.smithi170.stdout:3/144: mknod d3/d10/d13/d1b/d29/c31 0 2024-01-25T15:03:31.681 INFO:tasks.workunit.client.0.smithi170.stdout:2/194: mknod d10/d1e/d32/d3e/d41/c45 0 2024-01-25T15:03:31.681 INFO:tasks.workunit.client.0.smithi170.stdout:2/195: readlink d10/l29 0 2024-01-25T15:03:31.681 INFO:tasks.workunit.client.0.smithi170.stdout:2/196: fdatasync f9 0 2024-01-25T15:03:31.685 INFO:tasks.workunit.client.0.smithi170.stdout:0/117: unlink d8/d9/f26 0 2024-01-25T15:03:31.685 INFO:tasks.workunit.client.0.smithi170.stdout:0/118: creat d8/d9/f29 x:0 0 0 2024-01-25T15:03:31.685 INFO:tasks.workunit.client.0.smithi170.stdout:5/109: read d5/f15 [1092171,128359] 0 2024-01-25T15:03:31.685 INFO:tasks.workunit.client.0.smithi170.stdout:9/114: truncate f4 628903 0 2024-01-25T15:03:31.686 INFO:tasks.workunit.client.0.smithi170.stdout:7/137: dwrite d8/d20/d2a/f34 [0,4194304] 0 2024-01-25T15:03:31.692 INFO:tasks.workunit.client.0.smithi170.stdout:8/73: symlink d3/l11 0 2024-01-25T15:03:31.692 INFO:tasks.workunit.client.0.smithi170.stdout:3/145: symlink d3/d10/d13/d1b/l32 0 2024-01-25T15:03:31.692 INFO:tasks.workunit.client.0.smithi170.stdout:3/146: chown d3/d10/fe 38083 1 2024-01-25T15:03:31.692 INFO:tasks.workunit.client.0.smithi170.stdout:8/74: creat d3/d7/f12 x:0 0 0 2024-01-25T15:03:31.692 INFO:tasks.workunit.client.0.smithi170.stdout:6/91: rename d2/f8 to d2/d7/d23/d19/f24 0 2024-01-25T15:03:31.692 INFO:tasks.workunit.client.0.smithi170.stdout:6/92: write d2/d7/d23/d19/f20 [643464,130247] 0 2024-01-25T15:03:31.692 INFO:tasks.workunit.client.0.smithi170.stdout:4/106: getdents d6/d7 0 2024-01-25T15:03:31.692 INFO:tasks.workunit.client.0.smithi170.stdout:4/107: stat l3 0 2024-01-25T15:03:31.694 INFO:tasks.workunit.client.0.smithi170.stdout:1/166: rmdir d0/d2e 39 2024-01-25T15:03:31.698 INFO:tasks.workunit.client.0.smithi170.stdout:9/115: creat d5/df/d12/d18/f23 x:0 0 0 2024-01-25T15:03:31.701 INFO:tasks.workunit.client.0.smithi170.stdout:4/108: dread d6/d7/f14 [0,4194304] 0 2024-01-25T15:03:31.707 INFO:tasks.workunit.client.0.smithi170.stdout:0/119: rename d8/l17 to d8/d10/l2a 0 2024-01-25T15:03:31.707 INFO:tasks.workunit.client.0.smithi170.stdout:0/120: read - d8/d10/f15 zero size 2024-01-25T15:03:31.709 INFO:tasks.workunit.client.0.smithi170.stdout:6/93: getdents d2/d7/d23/d19 0 2024-01-25T15:03:31.710 INFO:tasks.workunit.client.0.smithi170.stdout:6/94: fsync d2/d7/f1c 0 2024-01-25T15:03:31.711 INFO:tasks.workunit.client.0.smithi170.stdout:9/116: creat d5/d1e/f24 x:0 0 0 2024-01-25T15:03:31.712 INFO:tasks.workunit.client.0.smithi170.stdout:4/109: rmdir d6/d18 0 2024-01-25T15:03:31.713 INFO:tasks.workunit.client.0.smithi170.stdout:8/75: symlink d3/l13 0 2024-01-25T15:03:31.713 INFO:tasks.workunit.client.0.smithi170.stdout:8/76: chown d3/d7/fc 4984550 1 2024-01-25T15:03:31.713 INFO:tasks.workunit.client.0.smithi170.stdout:8/77: fdatasync d3/f9 0 2024-01-25T15:03:31.715 INFO:tasks.workunit.client.0.smithi170.stdout:0/121: link f2 d8/d10/f2b 0 2024-01-25T15:03:31.715 INFO:tasks.workunit.client.0.smithi170.stdout:3/147: write d3/d10/d13/f1f [4113835,53587] 0 2024-01-25T15:03:31.716 INFO:tasks.workunit.client.0.smithi170.stdout:6/95: mkdir d2/d7/d1b/d25 0 2024-01-25T15:03:31.716 INFO:tasks.workunit.client.0.smithi170.stdout:6/96: write d2/d7/d23/f13 [1026026,103340] 0 2024-01-25T15:03:31.716 INFO:tasks.workunit.client.0.smithi170.stdout:3/148: dread d3/d10/d13/f25 [0,4194304] 0 2024-01-25T15:03:31.716 INFO:tasks.workunit.client.0.smithi170.stdout:5/110: mknod d5/d10/c25 0 2024-01-25T15:03:31.717 INFO:tasks.workunit.client.0.smithi170.stdout:4/110: mknod d6/d11/c1d 0 2024-01-25T15:03:31.717 INFO:tasks.workunit.client.0.smithi170.stdout:4/111: getdents d6/d7 0 2024-01-25T15:03:31.717 INFO:tasks.workunit.client.0.smithi170.stdout:1/167: dread d0/fd [0,4194304] 0 2024-01-25T15:03:31.717 INFO:tasks.workunit.client.0.smithi170.stdout:4/112: write d6/f8 [4116739,12475] 0 2024-01-25T15:03:31.717 INFO:tasks.workunit.client.0.smithi170.stdout:1/168: fdatasync d0/f33 0 2024-01-25T15:03:31.717 INFO:tasks.workunit.client.0.smithi170.stdout:4/113: chown d6/d7/f14 536477210 1 2024-01-25T15:03:31.717 INFO:tasks.workunit.client.0.smithi170.stdout:4/114: chown l1 2896 1 2024-01-25T15:03:31.717 INFO:tasks.workunit.client.0.smithi170.stdout:4/115: read d6/fd [1364819,5878] 0 2024-01-25T15:03:31.718 INFO:tasks.workunit.client.0.smithi170.stdout:7/138: dwrite d8/f1c [0,4194304] 0 2024-01-25T15:03:31.718 INFO:tasks.workunit.client.0.smithi170.stdout:0/122: rename l5 to d8/l2c 0 2024-01-25T15:03:31.718 INFO:tasks.workunit.client.0.smithi170.stdout:0/123: fdatasync d8/d18/f20 0 2024-01-25T15:03:31.718 INFO:tasks.workunit.client.0.smithi170.stdout:0/124: chown f6 446 1 2024-01-25T15:03:31.719 INFO:tasks.workunit.client.0.smithi170.stdout:3/149: mknod d3/d10/d13/d1b/d29/c33 0 2024-01-25T15:03:31.721 INFO:tasks.workunit.client.0.smithi170.stdout:2/197: dwrite d10/f13 [0,4194304] 0 2024-01-25T15:03:31.721 INFO:tasks.workunit.client.0.smithi170.stdout:2/198: write d10/d1b/f36 [607485,46668] 0 2024-01-25T15:03:31.721 INFO:tasks.workunit.client.0.smithi170.stdout:1/169: unlink d0/d20/d28/f35 0 2024-01-25T15:03:31.721 INFO:tasks.workunit.client.0.smithi170.stdout:1/170: write d0/d20/f2b [1284330,79229] 0 2024-01-25T15:03:31.724 INFO:tasks.workunit.client.0.smithi170.stdout:7/139: mknod d8/d20/d2a/d35/c38 0 2024-01-25T15:03:31.724 INFO:tasks.workunit.client.0.smithi170.stdout:9/117: dread f2 [0,4194304] 0 2024-01-25T15:03:31.725 INFO:tasks.workunit.client.0.smithi170.stdout:0/125: mkdir d8/d10/d2d 0 2024-01-25T15:03:31.727 INFO:tasks.workunit.client.0.smithi170.stdout:3/150: creat d3/d10/d13/f34 x:0 0 0 2024-01-25T15:03:31.730 INFO:tasks.workunit.client.0.smithi170.stdout:5/111: rename d5/d10/f23 to d5/d10/f26 0 2024-01-25T15:03:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.730+0000 7f2f90e07640 1 -- 172.21.15.170:0/2506513521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f8c0736f0 msgr2=0x7f2f8c073b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.730+0000 7f2f90e07640 1 --2- 172.21.15.170:0/2506513521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f8c0736f0 0x7f2f8c073b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009900 tx=0x7f2f8002bcd0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.730+0000 7f2f90e07640 1 -- 172.21.15.170:0/2506513521 shutdown_connections 2024-01-25T15:03:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.730+0000 7f2f90e07640 1 --2- 172.21.15.170:0/2506513521 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f8c108bd0 0x7f2f8c10b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.730+0000 7f2f90e07640 1 --2- 172.21.15.170:0/2506513521 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f8c0736f0 0x7f2f8c073b50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.732 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.730+0000 7f2f90e07640 1 --2- 172.21.15.170:0/2506513521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c074cd0 0x7f2f8c073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.730+0000 7f2f90e07640 1 -- 172.21.15.170:0/2506513521 >> 172.21.15.170:0/2506513521 conn(0x7f2f8c0fc2b0 msgr2=0x7f2f8c0fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.731+0000 7f2f90e07640 1 -- 172.21.15.170:0/2506513521 shutdown_connections 2024-01-25T15:03:31.733 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.731+0000 7f2f90e07640 1 -- 172.21.15.170:0/2506513521 wait complete. 2024-01-25T15:03:31.734 INFO:tasks.workunit.client.0.smithi170.stdout:1/171: truncate d0/d20/d28/f36 3157349 0 2024-01-25T15:03:31.734 INFO:tasks.workunit.client.0.smithi170.stdout:8/78: dread d3/d7/fe [0,4194304] 0 2024-01-25T15:03:31.734 INFO:tasks.workunit.client.0.smithi170.stdout:6/97: getdents d2/d7/d1b 0 2024-01-25T15:03:31.734 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.733+0000 7f2f90e07640 1 Processor -- start 2024-01-25T15:03:31.734 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.733+0000 7f2f90e07640 1 -- start start 2024-01-25T15:03:31.734 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.733+0000 7f2f90e07640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f8c0736f0 0x7f2f8c06f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.734 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.733+0000 7f2f90e07640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f8c074cd0 0x7f2f8c06fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.734+0000 7f2f90e07640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c108bd0 0x7f2f8c1ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.734+0000 7f2f90e07640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c104770 con 0x7f2f8c0736f0 2024-01-25T15:03:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.734+0000 7f2f90e07640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c1048e0 con 0x7f2f8c108bd0 2024-01-25T15:03:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.734+0000 7f2f90e07640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c072a50 con 0x7f2f8c074cd0 2024-01-25T15:03:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.734+0000 7f2f8ad9d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c108bd0 0x7f2f8c1ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.734+0000 7f2f89d9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f8c074cd0 0x7f2f8c06fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.735 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.734+0000 7f2f89d9b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f8c074cd0 0x7f2f8c06fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:51338/0 (socket says 172.21.15.170:51338) 2024-01-25T15:03:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.734+0000 7f2f89d9b640 1 -- 172.21.15.170:0/713340238 learned_addr learned my addr 172.21.15.170:0/713340238 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:31.736 INFO:tasks.workunit.client.0.smithi170.stdout:7/140: symlink d8/d20/d2a/l39 0 2024-01-25T15:03:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.735+0000 7f2f89d9b640 1 -- 172.21.15.170:0/713340238 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c108bd0 msgr2=0x7f2f8c1ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:31.736 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.735+0000 7f2f89d9b640 1 --2- 172.21.15.170:0/713340238 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c108bd0 0x7f2f8c1ad860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.736+0000 7f2f89d9b640 1 -- 172.21.15.170:0/713340238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f8c0736f0 msgr2=0x7f2f8c06f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.736+0000 7f2f89d9b640 1 --2- 172.21.15.170:0/713340238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f8c0736f0 0x7f2f8c06f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.737 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.736+0000 7f2f89d9b640 1 -- 172.21.15.170:0/713340238 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f84009840 con 0x7f2f8c074cd0 2024-01-25T15:03:31.737 INFO:tasks.workunit.client.0.smithi170.stdout:9/118: mknod d5/d1e/d21/c25 0 2024-01-25T15:03:31.737 INFO:tasks.workunit.client.0.smithi170.stdout:9/119: read d5/df/d12/d18/f1f [1465064,111204] 0 2024-01-25T15:03:31.739 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.737+0000 7f2f89d9b640 1 --2- 172.21.15.170:0/713340238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f8c074cd0 0x7f2f8c06fa00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009230 tx=0x7f2f80004dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:31.739 INFO:tasks.workunit.client.0.smithi170.stdout:0/126: truncate d8/f19 3920734 0 2024-01-25T15:03:31.739 INFO:tasks.workunit.client.0.smithi170.stdout:0/127: chown d8/d9/c25 21103054 1 2024-01-25T15:03:31.739 INFO:tasks.workunit.client.0.smithi170.stdout:0/128: truncate d8/d9/f16 898700 0 2024-01-25T15:03:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.738+0000 7f2f7b7fe640 1 -- 172.21.15.170:0/713340238 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8002dbc0 con 0x7f2f8c074cd0 2024-01-25T15:03:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.738+0000 7f2f90e07640 1 -- 172.21.15.170:0/713340238 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f80009560 con 0x7f2f8c074cd0 2024-01-25T15:03:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.738+0000 7f2f90e07640 1 -- 172.21.15.170:0/713340238 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c1adf80 con 0x7f2f8c074cd0 2024-01-25T15:03:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.739+0000 7f2f7b7fe640 1 -- 172.21.15.170:0/713340238 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f8002dd20 con 0x7f2f8c074cd0 2024-01-25T15:03:31.740 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.739+0000 7f2f7b7fe640 1 -- 172.21.15.170:0/713340238 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80003ba0 con 0x7f2f8c074cd0 2024-01-25T15:03:31.742 INFO:tasks.workunit.client.0.smithi170.stdout:1/172: dread d0/ff [0,4194304] 0 2024-01-25T15:03:31.742 INFO:tasks.workunit.client.0.smithi170.stdout:1/173: creat d0/d20/d28/f38 x:0 0 0 2024-01-25T15:03:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.743+0000 7f2f7b7fe640 1 -- 172.21.15.170:0/713340238 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f2f80003d00 con 0x7f2f8c074cd0 2024-01-25T15:03:31.743 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.743+0000 7f2f939c9740 1 Processor -- start 2024-01-25T15:03:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.743+0000 7f2f939c9740 1 -- start start 2024-01-25T15:03:31.744 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.743+0000 7f2f939c9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d32a0 0x55c67e9d36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.743+0000 7f2f939c9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d3c90 0x55c67e9d8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.743+0000 7f2f939c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d8e00 0x55c67e9db290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.743+0000 7f2f939c9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e943070 con 0x55c67e9d3c90 2024-01-25T15:03:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.743+0000 7f2f939c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e940760 con 0x55c67e9d8e00 2024-01-25T15:03:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.744+0000 7f2f939c9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e93c050 con 0x55c67e9d32a0 2024-01-25T15:03:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.744+0000 7f2f8ad9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d32a0 0x55c67e9d36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.744+0000 7f2f8ad9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d32a0 0x55c67e9d36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:51346/0 (socket says 172.21.15.170:51346) 2024-01-25T15:03:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.744+0000 7f2f8ad9d640 1 -- 172.21.15.170:0/3826122276 learned_addr learned my addr 172.21.15.170:0/3826122276 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:31.745 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.744+0000 7f2f89d9b640 1 --2- 172.21.15.170:0/3826122276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d8e00 0x55c67e9db290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.746 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.744+0000 7f2f8ad9d640 1 -- 172.21.15.170:0/3826122276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d8e00 msgr2=0x55c67e9db290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:31.746 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.744+0000 7f2f8ad9d640 1 --2- 172.21.15.170:0/3826122276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d8e00 0x55c67e9db290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.746 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.744+0000 7f2f8ad9d640 1 -- 172.21.15.170:0/3826122276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d3c90 msgr2=0x55c67e9d8790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-25T15:03:31.746 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.744+0000 7f2f8ad9d640 1 --2- 172.21.15.170:0/3826122276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d3c90 0x55c67e9d8790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.746 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.744+0000 7f2f8ad9d640 1 -- 172.21.15.170:0/3826122276 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c67e933e70 con 0x55c67e9d32a0 2024-01-25T15:03:31.747 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.744+0000 7f2f8ad9d640 1 --2- 172.21.15.170:0/3826122276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d32a0 0x55c67e9d36c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f840115b0 tx=0x7f2f84011a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15997655c5ea8eab server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:31.747 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.745+0000 7f2f78ff9640 1 -- 172.21.15.170:0/3826122276 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84004d20 con 0x55c67e9d32a0 2024-01-25T15:03:31.747 INFO:tasks.workunit.client.0.smithi170.stdout:2/199: dwrite d10/d16/f23 [0,4194304] 0 2024-01-25T15:03:31.747 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.745+0000 7f2f78ff9640 1 -- 172.21.15.170:0/3826122276 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f84004e80 con 0x55c67e9d32a0 2024-01-25T15:03:31.747 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.745+0000 7f2f78ff9640 1 -- 172.21.15.170:0/3826122276 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400f8c0 con 0x55c67e9d32a0 2024-01-25T15:03:31.748 INFO:tasks.workunit.client.0.smithi170.stdout:2/200: truncate d10/d1e/f2e 426077 0 2024-01-25T15:03:31.748 INFO:tasks.workunit.client.0.smithi170.stdout:2/201: truncate d10/d1e/f26 1073597 0 2024-01-25T15:03:31.748 INFO:tasks.workunit.client.0.smithi170.stdout:2/202: stat d10/d16/f19 0 2024-01-25T15:03:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.745+0000 7f2f7b7fe640 1 --2- 172.21.15.170:0/713340238 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2f740a14f0 0x7f2f740a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.745+0000 7f2f7b7fe640 1 -- 172.21.15.170:0/713340238 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f2f800ef150 con 0x7f2f8c074cd0 2024-01-25T15:03:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.745+0000 7f2f8a59c640 1 --2- 172.21.15.170:0/713340238 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2f740a14f0 0x7f2f740a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.746+0000 7f2f939c9740 1 -- 172.21.15.170:0/3826122276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d32a0 msgr2=0x55c67e9d36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.746+0000 7f2f939c9740 1 --2- 172.21.15.170:0/3826122276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d32a0 0x55c67e9d36c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f840115b0 tx=0x7f2f84011a70 comp rx=0 tx=0).stop 2024-01-25T15:03:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.746+0000 7f2f939c9740 1 -- 172.21.15.170:0/3826122276 shutdown_connections 2024-01-25T15:03:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.746+0000 7f2f939c9740 1 --2- 172.21.15.170:0/3826122276 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d8e00 0x55c67e9db290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.746+0000 7f2f939c9740 1 --2- 172.21.15.170:0/3826122276 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d3c90 0x55c67e9d8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.746+0000 7f2f939c9740 1 --2- 172.21.15.170:0/3826122276 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d32a0 0x55c67e9d36c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.746+0000 7f2f939c9740 1 -- 172.21.15.170:0/3826122276 >> 172.21.15.170:0/3826122276 conn(0x55c67e9ce810 msgr2=0x55c67e9cec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.746+0000 7f2f8a59c640 1 --2- 172.21.15.170:0/713340238 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2f740a14f0 0x7f2f740a39b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55c67e9d4090 tx=0x7f2f7c005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.746+0000 7f2f939c9740 1 -- 172.21.15.170:0/3826122276 shutdown_connections 2024-01-25T15:03:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.746+0000 7f2f939c9740 1 -- 172.21.15.170:0/3826122276 wait complete. 2024-01-25T15:03:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.746+0000 7f2f939c9740 1 -- start start 2024-01-25T15:03:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.747+0000 7f2f939c9740 1 Processor -- start 2024-01-25T15:03:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.747+0000 7f2f939c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d32a0 0x55c67e9ee280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.747+0000 7f2f939c9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d3c90 0x55c67e9ee7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.751 INFO:tasks.workunit.client.0.smithi170.stdout:4/116: dwrite d6/d7/f9 [0,4194304] 0 2024-01-25T15:03:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.747+0000 7f2f939c9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d8e00 0x55c67e9f5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.747+0000 7f2f939c9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e8f51e0 con 0x55c67e9d8e00 2024-01-25T15:03:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.747+0000 7f2f939c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e8f4e80 con 0x55c67e9d32a0 2024-01-25T15:03:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.747+0000 7f2f939c9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e8ba0c0 con 0x55c67e9d3c90 2024-01-25T15:03:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.747+0000 7f2f939c9740 10 client.0 _ll_register_callbacks cb 0x55c67e8dfac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.747+0000 7f2f8a59c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d32a0 0x55c67e9ee280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.747+0000 7f2f8ad9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d8e00 0x55c67e9f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.747+0000 7f2f8ad9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d8e00 0x55c67e9f5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53972/0 (socket says 172.21.15.170:53972) 2024-01-25T15:03:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.747+0000 7f2f8a59c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d32a0 0x55c67e9ee280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:38002/0 (socket says 172.21.15.170:38002) 2024-01-25T15:03:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.747+0000 7f2f8ad9d640 1 -- 172.21.15.170:0/1676098134 learned_addr learned my addr 172.21.15.170:0/1676098134 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.747+0000 7f2f89d9b640 1 --2- 172.21.15.170:0/1676098134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d3c90 0x55c67e9ee7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.748+0000 7f2f8a59c640 1 -- 172.21.15.170:0/1676098134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d3c90 msgr2=0x55c67e9ee7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.748+0000 7f2f8a59c640 1 --2- 172.21.15.170:0/1676098134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d3c90 0x55c67e9ee7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.748+0000 7f2f8a59c640 1 -- 172.21.15.170:0/1676098134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d8e00 msgr2=0x55c67e9f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.748+0000 7f2f8a59c640 1 --2- 172.21.15.170:0/1676098134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d8e00 0x55c67e9f5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.748+0000 7f2f8a59c640 1 -- 172.21.15.170:0/1676098134 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f84009e20 con 0x55c67e9d32a0 2024-01-25T15:03:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.748+0000 7f2f8ad9d640 1 --2- 172.21.15.170:0/1676098134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d8e00 0x55c67e9f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.748+0000 7f2f8a59c640 1 --2- 172.21.15.170:0/1676098134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d32a0 0x55c67e9ee280 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55c67e9d4700 tx=0x7f2f7c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c827704809deaa9c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.748+0000 7f2f71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-01-25T15:03:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.748+0000 7f2f71ffb640 1 -- 172.21.15.170:0/1676098134 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c00e880 con 0x55c67e9d32a0 2024-01-25T15:03:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.748+0000 7f2f71ffb640 1 -- 172.21.15.170:0/1676098134 <== mon.2 v2:172.21.15.186:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f2f7c017040 con 0x55c67e9d32a0 2024-01-25T15:03:31.754 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.749+0000 7f2f939c9740 1 -- 172.21.15.170:0/1676098134 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c67e934d60 con 0x55c67e9d32a0 2024-01-25T15:03:31.754 INFO:tasks.workunit.client.0.smithi170.stdout:9/120: mknod d5/df/d12/d18/c26 0 2024-01-25T15:03:31.754 INFO:tasks.workunit.client.0.smithi170.stdout:9/121: dread - d5/d1e/f24 zero size 2024-01-25T15:03:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.749+0000 7f2f71ffb640 1 -- 172.21.15.170:0/1676098134 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f7c00e9e0 con 0x55c67e9d32a0 2024-01-25T15:03:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.749+0000 7f2f939c9740 10 client.25232 fetch_fsmap learned FSMap version 29 2024-01-25T15:03:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.749+0000 7f2f939c9740 1 -- 172.21.15.170:0/1676098134 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c67e93a6d0 con 0x55c67e9d32a0 2024-01-25T15:03:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.749+0000 7f2f71ffb640 1 -- 172.21.15.170:0/1676098134 <== mon.2 v2:172.21.15.186:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c67e934d60 con 0x55c67e9d32a0 2024-01-25T15:03:31.755 INFO:tasks.workunit.client.0.smithi170.stdout:5/112: mknod d5/d10/c27 0 2024-01-25T15:03:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.749+0000 7f2f71ffb640 1 -- 172.21.15.170:0/1676098134 <== mon.2 v2:172.21.15.186:3300/0 5 ==== fsmap(e 29) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f2f7c025ca0 con 0x55c67e9d32a0 2024-01-25T15:03:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.749+0000 7f2f939c9740 10 client.25232 fetch_fsmap finished waiting for FSMap version 29 2024-01-25T15:03:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.749+0000 7f2f939c9740 10 client.25232 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.749+0000 7f2f939c9740 20 client.25232 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.749+0000 7f2f939c9740 1 --2- 172.21.15.170:0/1676098134 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55c67e9fa080 0x55c67e9fc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.749+0000 7f2f939c9740 4 client.25232 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.749+0000 7f2f939c9740 1 -- 172.21.15.170:0/1676098134 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c67e63b600 con 0x55c67e9fa080 2024-01-25T15:03:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.750+0000 7f2f89d9b640 1 --2- 172.21.15.170:0/1676098134 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55c67e9fa080 0x55c67e9fc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.750+0000 7f2f71ffb640 10 client.25232 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.750+0000 7f2f89d9b640 1 --2- 172.21.15.170:0/1676098134 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55c67e9fa080 0x55c67e9fc4a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9301ab5159289c65 server_cookie=dff44b8f3f4bbc31 in_seq=0 out_seq=0 2024-01-25T15:03:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.752+0000 7f2f71ffb640 1 -- 172.21.15.170:0/1676098134 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c67e63b600 con 0x55c67e9fa080 2024-01-25T15:03:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.752+0000 7f2f71ffb640 10 client.25232 handle_command_reply: tid=0 2024-01-25T15:03:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.752+0000 7f2f939c9740 1 client.25232 shutdown 2024-01-25T15:03:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.753+0000 7f2f939c9740 1 -- 172.21.15.170:0/1676098134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d32a0 msgr2=0x55c67e9ee280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.753+0000 7f2f939c9740 1 --2- 172.21.15.170:0/1676098134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d32a0 0x55c67e9ee280 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55c67e9d4700 tx=0x7f2f7c0046c0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.753+0000 7f2f939c9740 1 -- 172.21.15.170:0/1676098134 shutdown_connections 2024-01-25T15:03:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.753+0000 7f2f939c9740 1 --2- 172.21.15.170:0/1676098134 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55c67e9fa080 0x55c67e9fc4a0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.753+0000 7f2f71ffb640 0 client.25232 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.753+0000 7f2f939c9740 1 --2- 172.21.15.170:0/1676098134 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d8e00 0x55c67e9f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.753+0000 7f2f939c9740 1 --2- 172.21.15.170:0/1676098134 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d3c90 0x55c67e9ee7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.753+0000 7f2f939c9740 1 --2- 172.21.15.170:0/1676098134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d32a0 0x55c67e9ee280 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.753+0000 7f2f939c9740 1 -- 172.21.15.170:0/1676098134 >> 172.21.15.170:0/1676098134 conn(0x55c67e9ce810 msgr2=0x55c67e9cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.753+0000 7f2f939c9740 1 -- 172.21.15.170:0/1676098134 shutdown_connections 2024-01-25T15:03:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.753+0000 7f2f939c9740 1 -- 172.21.15.170:0/1676098134 wait complete. 2024-01-25T15:03:31.758 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.753+0000 7f2f939c9740 20 client.25232 trim_cache size 0 max 16384 2024-01-25T15:03:31.759 INFO:tasks.workunit.client.0.smithi170.stdout:7/141: rmdir d8/d20/d2a 39 2024-01-25T15:03:31.759 INFO:tasks.workunit.client.0.smithi170.stdout:9/122: dread d5/f8 [0,4194304] 0 2024-01-25T15:03:31.759 INFO:tasks.workunit.client.0.smithi170.stdout:8/79: dwrite d3/d7/fe [0,4194304] 0 2024-01-25T15:03:31.759 INFO:tasks.workunit.client.0.smithi170.stdout:8/80: chown d3/fd 406568 1 2024-01-25T15:03:31.759 INFO:tasks.workunit.client.0.smithi170.stdout:8/81: chown d3/fd 38690367 1 2024-01-25T15:03:31.760 INFO:tasks.workunit.client.0.smithi170.stdout:2/203: creat d10/d1e/d32/d3e/f46 x:0 0 0 2024-01-25T15:03:31.760 INFO:tasks.workunit.client.0.smithi170.stdout:2/204: creat d10/d1e/d32/d3e/f47 x:0 0 0 2024-01-25T15:03:31.760 INFO:tasks.workunit.client.0.smithi170.stdout:2/205: stat d10/c2f 0 2024-01-25T15:03:31.761 INFO:tasks.workunit.client.0.smithi170.stdout:2/206: dread d10/d1b/f1d [0,4194304] 0 2024-01-25T15:03:31.762 INFO:tasks.workunit.client.0.smithi170.stdout:9/123: dread f4 [0,4194304] 0 2024-01-25T15:03:31.763 INFO:tasks.workunit.client.0.smithi170.stdout:0/129: rmdir d8/d9 39 2024-01-25T15:03:31.763 INFO:tasks.workunit.client.0.smithi170.stdout:0/130: dread - d8/d18/f20 zero size 2024-01-25T15:03:31.763 INFO:tasks.workunit.client.0.smithi170.stdout:0/131: chown c7 8166 1 2024-01-25T15:03:31.765 INFO:tasks.workunit.client.0.smithi170.stdout:1/174: dwrite d0/f1d [0,4194304] 0 2024-01-25T15:03:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.773+0000 7f2f939c9740 1 Processor -- start 2024-01-25T15:03:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.773+0000 7f2f939c9740 1 -- start start 2024-01-25T15:03:31.775 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f939c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d32a0 0x55c67e9d4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f939c9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d3c90 0x55c67e9d5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f939c9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d8e00 0x55c67e9f5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f939c9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e9ca2e0 con 0x55c67e9d3c90 2024-01-25T15:03:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f939c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e9ce680 con 0x55c67e9d32a0 2024-01-25T15:03:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f89d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d3c90 0x55c67e9d5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f89d9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d3c90 0x55c67e9d5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53974/0 (socket says 172.21.15.170:53974) 2024-01-25T15:03:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f8a59c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d32a0 0x55c67e9d4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f89d9b640 1 -- 172.21.15.170:0/2277091451 learned_addr learned my addr 172.21.15.170:0/2277091451 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f939c9740 1 -- 172.21.15.170:0/2277091451 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e9d40c0 con 0x55c67e9d8e00 2024-01-25T15:03:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f8ad9d640 1 --2- 172.21.15.170:0/2277091451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d8e00 0x55c67e9f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f8a59c640 1 -- 172.21.15.170:0/2277091451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d8e00 msgr2=0x55c67e9f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f8a59c640 1 --2- 172.21.15.170:0/2277091451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d8e00 0x55c67e9f5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.776 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f8a59c640 1 -- 172.21.15.170:0/2277091451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d3c90 msgr2=0x55c67e9d5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f8a59c640 1 --2- 172.21.15.170:0/2277091451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d3c90 0x55c67e9d5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f8a59c640 1 -- 172.21.15.170:0/2277091451 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c67e8d7060 con 0x55c67e9d32a0 2024-01-25T15:03:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f89d9b640 1 --2- 172.21.15.170:0/2277091451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d3c90 0x55c67e9d5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f8ad9d640 1 --2- 172.21.15.170:0/2277091451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d8e00 0x55c67e9f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:03:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.774+0000 7f2f8a59c640 1 --2- 172.21.15.170:0/2277091451 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d32a0 0x55c67e9d4ed0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c011040 tx=0x7f2f7c00fe70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee12a6a6dcaf679d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.775+0000 7f2f73fff640 1 -- 172.21.15.170:0/2277091451 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c004220 con 0x55c67e9d32a0 2024-01-25T15:03:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.775+0000 7f2f73fff640 1 -- 172.21.15.170:0/2277091451 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f7c032070 con 0x55c67e9d32a0 2024-01-25T15:03:31.777 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.775+0000 7f2f73fff640 1 -- 172.21.15.170:0/2277091451 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c004b10 con 0x55c67e9d32a0 2024-01-25T15:03:31.779 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 -- 172.21.15.170:0/2277091451 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d32a0 msgr2=0x55c67e9d4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 --2- 172.21.15.170:0/2277091451 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d32a0 0x55c67e9d4ed0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c011040 tx=0x7f2f7c00fe70 comp rx=0 tx=0).stop 2024-01-25T15:03:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 -- 172.21.15.170:0/2277091451 shutdown_connections 2024-01-25T15:03:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 --2- 172.21.15.170:0/2277091451 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d8e00 0x55c67e9f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 --2- 172.21.15.170:0/2277091451 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d3c90 0x55c67e9d5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 --2- 172.21.15.170:0/2277091451 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d32a0 0x55c67e9d4ed0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 -- 172.21.15.170:0/2277091451 >> 172.21.15.170:0/2277091451 conn(0x55c67e9ce810 msgr2=0x55c67ea00e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 -- 172.21.15.170:0/2277091451 shutdown_connections 2024-01-25T15:03:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 -- 172.21.15.170:0/2277091451 wait complete. 2024-01-25T15:03:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 -- start start 2024-01-25T15:03:31.780 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 Processor -- start 2024-01-25T15:03:31.781 INFO:tasks.workunit.client.0.smithi170.stdout:7/142: creat d8/f3a x:0 0 0 2024-01-25T15:03:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d32a0 0x55c67e9f3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d3c90 0x55c67e9f3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.782 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d8e00 0x55c67e9f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e9f5150 con 0x55c67e9d32a0 2024-01-25T15:03:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e9f52c0 con 0x55c67e9d8e00 2024-01-25T15:03:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c67e9f5480 con 0x55c67e9d3c90 2024-01-25T15:03:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.776+0000 7f2f939c9740 10 client.0 _ll_register_callbacks cb 0x7f2f84009cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.777+0000 7f2f8a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d32a0 0x55c67e9f3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.777+0000 7f2f8ad9d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d8e00 0x55c67e9f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.777+0000 7f2f8a59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d32a0 0x55c67e9f3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:53988/0 (socket says 172.21.15.170:53988) 2024-01-25T15:03:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.777+0000 7f2f8a59c640 1 -- 172.21.15.170:0/3916362248 learned_addr learned my addr 172.21.15.170:0/3916362248 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.777+0000 7f2f89d9b640 1 --2- 172.21.15.170:0/3916362248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d3c90 0x55c67e9f3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.777+0000 7f2f8a59c640 1 -- 172.21.15.170:0/3916362248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d3c90 msgr2=0x55c67e9f3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.777+0000 7f2f8a59c640 1 --2- 172.21.15.170:0/3916362248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d3c90 0x55c67e9f3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.777+0000 7f2f8a59c640 1 -- 172.21.15.170:0/3916362248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d8e00 msgr2=0x55c67e9f4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:31.783 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.777+0000 7f2f8a59c640 1 --2- 172.21.15.170:0/3916362248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d8e00 0x55c67e9f4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.777+0000 7f2f8a59c640 1 -- 172.21.15.170:0/3916362248 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c1adf80 con 0x55c67e9d32a0 2024-01-25T15:03:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.777+0000 7f2f8a59c640 1 --2- 172.21.15.170:0/3916362248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d32a0 0x55c67e9f3710 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00cd40 tx=0x7f2f7c0052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daaceffeb4d04d82 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.777+0000 7f2f71ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.777+0000 7f2f71ffb640 1 -- 172.21.15.170:0/3916362248 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c004a10 con 0x55c67e9d32a0 2024-01-25T15:03:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.777+0000 7f2f71ffb640 1 -- 172.21.15.170:0/3916362248 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f2f7c004b70 con 0x55c67e9d32a0 2024-01-25T15:03:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.777+0000 7f2f939c9740 1 -- 172.21.15.170:0/3916362248 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c67e935040 con 0x55c67e9d32a0 2024-01-25T15:03:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.778+0000 7f2f71ffb640 1 -- 172.21.15.170:0/3916362248 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f7c004d50 con 0x55c67e9d32a0 2024-01-25T15:03:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.778+0000 7f2f939c9740 10 client.15906 fetch_fsmap learned FSMap version 29 2024-01-25T15:03:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.778+0000 7f2f939c9740 1 -- 172.21.15.170:0/3916362248 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c67e93a6d0 con 0x55c67e9d32a0 2024-01-25T15:03:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.778+0000 7f2f71ffb640 1 -- 172.21.15.170:0/3916362248 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c67e935040 con 0x55c67e9d32a0 2024-01-25T15:03:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.778+0000 7f2f71ffb640 1 -- 172.21.15.170:0/3916362248 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 29) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f2f7c04b050 con 0x55c67e9d32a0 2024-01-25T15:03:31.784 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.778+0000 7f2f939c9740 10 client.15906 fetch_fsmap finished waiting for FSMap version 29 2024-01-25T15:03:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.778+0000 7f2f939c9740 10 client.15906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.778+0000 7f2f939c9740 20 client.15906 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.778+0000 7f2f939c9740 1 --2- 172.21.15.170:0/3916362248 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55c67e9fa080 0x55c67ea53440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.778+0000 7f2f939c9740 4 client.15906 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-25T15:03:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.778+0000 7f2f939c9740 1 -- 172.21.15.170:0/3916362248 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c67e68ec50 con 0x55c67e9fa080 2024-01-25T15:03:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.779+0000 7f2f89d9b640 1 --2- 172.21.15.170:0/3916362248 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55c67e9fa080 0x55c67ea53440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.779+0000 7f2f71ffb640 10 client.15906 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:31.785 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:31.779+0000 7f2f89d9b640 1 --2- 172.21.15.170:0/3916362248 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55c67e9fa080 0x55c67ea53440 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b6fdccaac541eaa server_cookie=193bed4075baf1ae in_seq=0 out_seq=0 2024-01-25T15:03:31.786 INFO:tasks.workunit.client.0.smithi170.stdout:2/207: creat d10/d16/d42/f48 x:0 0 0 2024-01-25T15:03:31.786 INFO:tasks.workunit.client.0.smithi170.stdout:8/82: dwrite d3/d7/fc [0,4194304] 0 2024-01-25T15:03:31.786 INFO:tasks.workunit.client.0.smithi170.stdout:9/124: mkdir d5/d1e/d21/d27 0 2024-01-25T15:03:31.786 INFO:tasks.workunit.client.0.smithi170.stdout:6/98: truncate d2/d7/d23/d19/f20 379793 0 2024-01-25T15:03:31.786 INFO:tasks.workunit.client.0.smithi170.stdout:1/175: mknod d0/d1b/c39 0 2024-01-25T15:03:31.787 INFO:tasks.workunit.client.0.smithi170.stdout:5/113: write d5/fe [2632547,62277] 0 2024-01-25T15:03:31.789 INFO:tasks.workunit.client.0.smithi170.stdout:1/176: mkdir d0/d20/d3a 0 2024-01-25T15:03:31.791 INFO:tasks.workunit.client.0.smithi170.stdout:8/83: rmdir d3 39 2024-01-25T15:03:31.791 INFO:tasks.workunit.client.0.smithi170.stdout:2/208: dread f8 [4194304,4194304] 0 2024-01-25T15:03:31.791 INFO:tasks.workunit.client.0.smithi170.stdout:8/84: chown d3/l11 29188 1 2024-01-25T15:03:31.791 INFO:tasks.workunit.client.0.smithi170.stdout:2/209: rename d10/d1e/d32 to d10/d1e/d32/d3e/d49 22 2024-01-25T15:03:31.791 INFO:tasks.workunit.client.0.smithi170.stdout:2/210: dread - d10/d16/d42/f48 zero size 2024-01-25T15:03:31.792 INFO:tasks.workunit.client.0.smithi170.stdout:6/99: truncate d2/d7/d23/f13 763326 0 2024-01-25T15:03:31.793 INFO:tasks.workunit.client.0.smithi170.stdout:1/177: creat d0/d2e/f3b x:0 0 0 2024-01-25T15:03:31.795 INFO:tasks.workunit.client.0.smithi170.stdout:8/85: unlink d3/d7/fc 0 2024-01-25T15:03:31.795 INFO:tasks.workunit.client.0.smithi170.stdout:5/114: symlink d5/d10/l28 0 2024-01-25T15:03:31.796 INFO:tasks.workunit.client.0.smithi170.stdout:9/125: dread d5/f14 [0,4194304] 0 2024-01-25T15:03:31.797 INFO:tasks.workunit.client.0.smithi170.stdout:9/126: chown d5/df/d16 3 1 2024-01-25T15:03:31.797 INFO:tasks.workunit.client.0.smithi170.stdout:6/100: mknod d2/d7/c26 0 2024-01-25T15:03:31.797 INFO:tasks.workunit.client.0.smithi170.stdout:6/101: chown d2/d7/d23/d19/f20 12482 1 2024-01-25T15:03:31.797 INFO:tasks.workunit.client.0.smithi170.stdout:6/102: chown d2/d7/d23/l12 18199 1 2024-01-25T15:03:31.797 INFO:tasks.workunit.client.0.smithi170.stdout:5/115: readlink d5/l9 0 2024-01-25T15:03:31.798 INFO:tasks.workunit.client.0.smithi170.stdout:6/103: rmdir d2/d7/d1b 39 2024-01-25T15:03:31.800 INFO:tasks.workunit.client.0.smithi170.stdout:6/104: getdents d2/d7/d23 0 2024-01-25T15:03:31.801 INFO:tasks.workunit.client.0.smithi170.stdout:5/116: link c4 d5/c29 0 2024-01-25T15:03:31.802 INFO:tasks.workunit.client.0.smithi170.stdout:8/86: dread d3/f9 [0,4194304] 0 2024-01-25T15:03:31.803 INFO:tasks.workunit.client.0.smithi170.stdout:8/87: mknod d3/d7/c14 0 2024-01-25T15:03:31.804 INFO:tasks.workunit.client.0.smithi170.stdout:0/132: dwrite d8/d9/f29 [0,4194304] 0 2024-01-25T15:03:31.804 INFO:tasks.workunit.client.0.smithi170.stdout:7/143: dwrite d8/f31 [0,4194304] 0 2024-01-25T15:03:31.804 INFO:tasks.workunit.client.0.smithi170.stdout:5/117: mkdir d5/d2a 0 2024-01-25T15:03:31.806 INFO:tasks.workunit.client.0.smithi170.stdout:8/88: creat d3/d7/f15 x:0 0 0 2024-01-25T15:03:31.806 INFO:tasks.workunit.client.0.smithi170.stdout:8/89: creat d3/d7/f16 x:0 0 0 2024-01-25T15:03:31.806 INFO:tasks.workunit.client.0.smithi170.stdout:8/90: fdatasync f0 0 2024-01-25T15:03:31.806 INFO:tasks.workunit.client.0.smithi170.stdout:8/91: rename d3 to d3/d7/d17 22 2024-01-25T15:03:31.810 INFO:tasks.workunit.client.0.smithi170.stdout:2/211: write d10/f18 [4082601,114192] 0 2024-01-25T15:03:31.811 INFO:tasks.workunit.client.0.smithi170.stdout:7/144: mkdir d8/d20/d3b 0 2024-01-25T15:03:31.811 INFO:tasks.workunit.client.0.smithi170.stdout:7/145: chown d8/f18 80226 1 2024-01-25T15:03:31.811 INFO:tasks.workunit.client.0.smithi170.stdout:7/146: chown d8/d20/d2a/d35/f37 542 1 2024-01-25T15:03:31.812 INFO:tasks.workunit.client.0.smithi170.stdout:5/118: creat d5/d2a/f2b x:0 0 0 2024-01-25T15:03:31.816 INFO:tasks.workunit.client.0.smithi170.stdout:2/212: unlink d10/d1e/l2c 0 2024-01-25T15:03:31.817 INFO:tasks.workunit.client.0.smithi170.stdout:6/105: rmdir d2 39 2024-01-25T15:03:31.820 INFO:tasks.workunit.client.0.smithi170.stdout:6/106: mknod d2/d7/d23/d19/c27 0 2024-01-25T15:03:31.820 INFO:tasks.workunit.client.0.smithi170.stdout:7/147: write d8/d20/d2a/f34 [4005117,117527] 0 2024-01-25T15:03:31.820 INFO:tasks.workunit.client.0.smithi170.stdout:9/127: write d5/df/f15 [923202,56207] 0 2024-01-25T15:03:31.821 INFO:tasks.workunit.client.0.smithi170.stdout:2/213: write d10/d1b/f36 [186008,35983] 0 2024-01-25T15:03:31.821 INFO:tasks.workunit.client.0.smithi170.stdout:1/178: dwrite d0/fb [0,4194304] 0 2024-01-25T15:03:31.821 INFO:tasks.workunit.client.0.smithi170.stdout:1/179: dread - d0/d20/d28/f38 zero size 2024-01-25T15:03:31.821 INFO:tasks.workunit.client.0.smithi170.stdout:1/180: chown d0/c21 0 1 2024-01-25T15:03:31.821 INFO:tasks.workunit.client.0.smithi170.stdout:6/107: mkdir d2/d7/d1b/d28 0 2024-01-25T15:03:31.821 INFO:tasks.workunit.client.0.smithi170.stdout:6/108: fdatasync d2/d7/d1b/f1f 0 2024-01-25T15:03:31.824 INFO:tasks.workunit.client.0.smithi170.stdout:2/214: dread d10/d1b/f1d [0,4194304] 0 2024-01-25T15:03:31.824 INFO:tasks.workunit.client.0.smithi170.stdout:2/215: creat d10/d16/d42/f4a x:0 0 0 2024-01-25T15:03:31.824 INFO:tasks.workunit.client.0.smithi170.stdout:2/216: read d10/d1b/f25 [310330,65218] 0 2024-01-25T15:03:31.824 INFO:tasks.workunit.client.0.smithi170.stdout:2/217: fsync d10/f13 0 2024-01-25T15:03:31.824 INFO:tasks.workunit.client.0.smithi170.stdout:2/218: creat d10/d1e/d32/f4b x:0 0 0 2024-01-25T15:03:31.827 INFO:tasks.workunit.client.0.smithi170.stdout:0/133: dwrite d8/f19 [4194304,4194304] 0 2024-01-25T15:03:31.827 INFO:tasks.workunit.client.0.smithi170.stdout:7/148: dread d8/f24 [0,4194304] 0 2024-01-25T15:03:31.829 INFO:tasks.workunit.client.0.smithi170.stdout:5/119: dread d5/fd [0,4194304] 0 2024-01-25T15:03:31.837 INFO:tasks.workunit.client.0.smithi170.stdout:2/219: write d10/f13 [2089081,37198] 0 2024-01-25T15:03:31.859 INFO:tasks.workunit.client.0.smithi170.stdout:8/92: dwrite f0 [0,4194304] 0 2024-01-25T15:03:31.861 INFO:tasks.workunit.client.0.smithi170.stdout:9/128: dwrite d5/fa [0,4194304] 0 2024-01-25T15:03:31.861 INFO:tasks.workunit.client.0.smithi170.stdout:0/134: dwrite d8/fa [0,4194304] 0 2024-01-25T15:03:31.861 INFO:tasks.workunit.client.0.smithi170.stdout:0/135: chown d8/d18/f20 27527920 1 2024-01-25T15:03:31.861 INFO:tasks.workunit.client.0.smithi170.stdout:9/129: rename d5/df to d5/df/d12/d28 22 2024-01-25T15:03:31.863 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-25T15:03:31.872 INFO:tasks.workunit.client.0.smithi170.stdout:9/130: dread d5/dc/fd [0,4194304] 0 2024-01-25T15:03:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.970+0000 7f28fe80e640 1 -- 172.21.15.170:0/1700030768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28f8101fa0 msgr2=0x7f28f8102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.970+0000 7f28fe80e640 1 --2- 172.21.15.170:0/1700030768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28f8101fa0 0x7f28f8102420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009900 tx=0x7f28e802bc30 comp rx=0 tx=0).stop 2024-01-25T15:03:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.970+0000 7f28fe80e640 1 -- 172.21.15.170:0/1700030768 shutdown_connections 2024-01-25T15:03:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.970+0000 7f28fe80e640 1 --2- 172.21.15.170:0/1700030768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28f8101fa0 0x7f28f8102420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.970+0000 7f28fe80e640 1 --2- 172.21.15.170:0/1700030768 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28f8102960 0x7f28f81091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.973 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.970+0000 7f28fe80e640 1 --2- 172.21.15.170:0/1700030768 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f80fefd0 0x7f28f80ff3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.970+0000 7f28fe80e640 1 -- 172.21.15.170:0/1700030768 >> 172.21.15.170:0/1700030768 conn(0x7f28f80fa900 msgr2=0x7f28f80fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.970+0000 7f28fe80e640 1 -- 172.21.15.170:0/1700030768 shutdown_connections 2024-01-25T15:03:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.970+0000 7f28fe80e640 1 -- 172.21.15.170:0/1700030768 wait complete. 2024-01-25T15:03:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fe80e640 1 Processor -- start 2024-01-25T15:03:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fe80e640 1 -- start start 2024-01-25T15:03:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fe80e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28f80fefd0 0x7f28f8196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fe80e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28f8101fa0 0x7f28f8197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fe80e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f8102960 0x7f28f819e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fe80e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f819e7d0 con 0x7f28f8102960 2024-01-25T15:03:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fe80e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f819e940 con 0x7f28f80fefd0 2024-01-25T15:03:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fe80e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f819eb00 con 0x7f28f8101fa0 2024-01-25T15:03:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fcdab640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f8102960 0x7f28f819e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fcdab640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f8102960 0x7f28f819e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54000/0 (socket says 172.21.15.170:54000) 2024-01-25T15:03:31.974 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fcdab640 1 -- 172.21.15.170:0/1422660351 learned_addr learned my addr 172.21.15.170:0/1422660351 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:31.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28f7fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28f80fefd0 0x7f28f8196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28f77fe640 1 --2- 172.21.15.170:0/1422660351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28f8101fa0 0x7f28f8197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fcdab640 1 -- 172.21.15.170:0/1422660351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28f8101fa0 msgr2=0x7f28f8197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:31.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fcdab640 1 --2- 172.21.15.170:0/1422660351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28f8101fa0 0x7f28f8197200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fcdab640 1 -- 172.21.15.170:0/1422660351 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28f80fefd0 msgr2=0x7f28f8196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:31.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fcdab640 1 --2- 172.21.15.170:0/1422660351 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28f80fefd0 0x7f28f8196cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.971+0000 7f28fcdab640 1 -- 172.21.15.170:0/1422660351 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e0009490 con 0x7f28f8102960 2024-01-25T15:03:31.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.972+0000 7f28fcdab640 1 --2- 172.21.15.170:0/1422660351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f8102960 0x7f28f819e260 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f28f000eb10 tx=0x7f28f000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:31.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.972+0000 7f28f57fa640 1 -- 172.21.15.170:0/1422660351 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f0004b20 con 0x7f28f8102960 2024-01-25T15:03:31.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.972+0000 7f28f57fa640 1 -- 172.21.15.170:0/1422660351 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28f0004c80 con 0x7f28f8102960 2024-01-25T15:03:31.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.972+0000 7f28fe80e640 1 -- 172.21.15.170:0/1422660351 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e8009560 con 0x7f28f8102960 2024-01-25T15:03:31.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.972+0000 7f28f57fa640 1 -- 172.21.15.170:0/1422660351 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f0010690 con 0x7f28f8102960 2024-01-25T15:03:31.975 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.972+0000 7f28fe80e640 1 -- 172.21.15.170:0/1422660351 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f819f130 con 0x7f28f8102960 2024-01-25T15:03:31.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.974+0000 7f28f57fa640 1 -- 172.21.15.170:0/1422660351 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f28f0005020 con 0x7f28f8102960 2024-01-25T15:03:31.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.974+0000 7f29013d3740 1 Processor -- start 2024-01-25T15:03:31.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.974+0000 7f28f57fa640 1 --2- 172.21.15.170:0/1422660351 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f28e40a12e0 0x7f28e40a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.974+0000 7f29013d3740 1 -- start start 2024-01-25T15:03:31.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.974+0000 7f28f77fe640 1 --2- 172.21.15.170:0/1422660351 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f28e40a12e0 0x7f28e40a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.974+0000 7f29013d3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565367681a50 0x565367681e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.974+0000 7f29013d3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367682440 0x565367686f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.974+0000 7f28f57fa640 1 -- 172.21.15.170:0/1422660351 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f28f0014070 con 0x7f28f8102960 2024-01-25T15:03:31.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.974+0000 7f29013d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653676875b0 0x565367689a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.974+0000 7f29013d3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653675f03b0 con 0x5653676875b0 2024-01-25T15:03:31.981 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.974+0000 7f29013d3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653675edaa0 con 0x565367682440 2024-01-25T15:03:31.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.974+0000 7f29013d3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653675e9390 con 0x565367681a50 2024-01-25T15:03:31.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28f7fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565367681a50 0x565367681e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28fcdab640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653676875b0 0x565367689a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28fcdab640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653676875b0 0x565367689a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54016/0 (socket says 172.21.15.170:54016) 2024-01-25T15:03:31.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28f7fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565367681a50 0x565367681e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:51402/0 (socket says 172.21.15.170:51402) 2024-01-25T15:03:31.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28fcdab640 1 -- 172.21.15.170:0/3950883072 learned_addr learned my addr 172.21.15.170:0/3950883072 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:31.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28f77fe640 1 --2- 172.21.15.170:0/3950883072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367682440 0x565367686f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28f7fff640 1 -- 172.21.15.170:0/3950883072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367682440 msgr2=0x565367686f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:31.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28f7fff640 1 --2- 172.21.15.170:0/3950883072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367682440 0x565367686f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28f7fff640 1 -- 172.21.15.170:0/3950883072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653676875b0 msgr2=0x565367689a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:31.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28f7fff640 1 --2- 172.21.15.170:0/3950883072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653676875b0 0x565367689a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28f7fff640 1 -- 172.21.15.170:0/3950883072 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653675ab810 con 0x565367681a50 2024-01-25T15:03:31.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28fcdab640 1 --2- 172.21.15.170:0/3950883072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653676875b0 0x565367689a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:31.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28f77fe640 1 --2- 172.21.15.170:0/1422660351 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f28e40a12e0 0x7f28e40a37a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f28e8005ab0 tx=0x7f28e802c880 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:31.982 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28f7fff640 1 --2- 172.21.15.170:0/3950883072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565367681a50 0x565367681e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f28f80690e0 tx=0x7f28e0011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c315c3bf8778ec74 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:31.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28ee7fc640 1 -- 172.21.15.170:0/3950883072 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0004250 con 0x565367681a50 2024-01-25T15:03:31.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28ee7fc640 1 -- 172.21.15.170:0/3950883072 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28e00043b0 con 0x565367681a50 2024-01-25T15:03:31.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.975+0000 7f28ee7fc640 1 -- 172.21.15.170:0/3950883072 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0004ca0 con 0x565367681a50 2024-01-25T15:03:31.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.976+0000 7f29013d3740 1 -- 172.21.15.170:0/3950883072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565367681a50 msgr2=0x565367681e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:31.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.976+0000 7f29013d3740 1 --2- 172.21.15.170:0/3950883072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565367681a50 0x565367681e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f28f80690e0 tx=0x7f28e0011810 comp rx=0 tx=0).stop 2024-01-25T15:03:31.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.976+0000 7f29013d3740 1 -- 172.21.15.170:0/3950883072 shutdown_connections 2024-01-25T15:03:31.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.976+0000 7f29013d3740 1 --2- 172.21.15.170:0/3950883072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367682440 0x565367686f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.976+0000 7f29013d3740 1 --2- 172.21.15.170:0/3950883072 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653676875b0 0x565367689a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.976+0000 7f29013d3740 1 --2- 172.21.15.170:0/3950883072 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565367681a50 0x565367681e70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.976+0000 7f29013d3740 1 -- 172.21.15.170:0/3950883072 >> 172.21.15.170:0/3950883072 conn(0x56536767cfc0 msgr2=0x56536767d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:31.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.976+0000 7f29013d3740 1 -- 172.21.15.170:0/3950883072 shutdown_connections 2024-01-25T15:03:31.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.976+0000 7f29013d3740 1 -- 172.21.15.170:0/3950883072 wait complete. 2024-01-25T15:03:31.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.976+0000 7f29013d3740 1 -- start start 2024-01-25T15:03:31.983 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.976+0000 7f29013d3740 1 Processor -- start 2024-01-25T15:03:31.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f29013d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565367681a50 0x56536768bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f29013d3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367682440 0x56536768c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f29013d3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5653676875b0 0x565367693120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f29013d3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653675a2780 con 0x565367681a50 2024-01-25T15:03:31.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f29013d3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653675a2420 con 0x565367682440 2024-01-25T15:03:31.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f29013d3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x565367567420 con 0x5653676875b0 2024-01-25T15:03:31.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f29013d3740 10 client.0 _ll_register_callbacks cb 0x5653675a4b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:31.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28f7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565367681a50 0x56536768bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28fcdab640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5653676875b0 0x565367693120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28f7fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565367681a50 0x56536768bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54030/0 (socket says 172.21.15.170:54030) 2024-01-25T15:03:31.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28fcdab640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5653676875b0 0x565367693120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:51418/0 (socket says 172.21.15.170:51418) 2024-01-25T15:03:31.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28f7fff640 1 -- 172.21.15.170:0/2806002420 learned_addr learned my addr 172.21.15.170:0/2806002420 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:31.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28f77fe640 1 --2- 172.21.15.170:0/2806002420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367682440 0x56536768c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.984 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28f7fff640 1 -- 172.21.15.170:0/2806002420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5653676875b0 msgr2=0x565367693120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:31.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28f7fff640 1 --2- 172.21.15.170:0/2806002420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5653676875b0 0x565367693120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28f7fff640 1 -- 172.21.15.170:0/2806002420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367682440 msgr2=0x56536768c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:31.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28f7fff640 1 --2- 172.21.15.170:0/2806002420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367682440 0x56536768c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:31.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28f7fff640 1 -- 172.21.15.170:0/2806002420 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e00099e0 con 0x565367681a50 2024-01-25T15:03:31.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28fcdab640 1 --2- 172.21.15.170:0/2806002420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5653676875b0 0x565367693120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:31.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28f7fff640 1 --2- 172.21.15.170:0/2806002420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565367681a50 0x56536768bba0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f28e001b040 tx=0x7f28e00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1087bc703ce65e6 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:31.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:31.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28d77fe640 1 -- 172.21.15.170:0/2806002420 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0003ea0 con 0x565367681a50 2024-01-25T15:03:31.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f28d77fe640 1 -- 172.21.15.170:0/2806002420 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f28e0023430 con 0x565367681a50 2024-01-25T15:03:31.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.977+0000 7f29013d3740 1 -- 172.21.15.170:0/2806002420 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653675be240 con 0x565367681a50 2024-01-25T15:03:31.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.978+0000 7f28d77fe640 1 -- 172.21.15.170:0/2806002420 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28e00235f0 con 0x565367681a50 2024-01-25T15:03:31.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.978+0000 7f29013d3740 10 client.15918 fetch_fsmap learned FSMap version 29 2024-01-25T15:03:31.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.978+0000 7f29013d3740 1 -- 172.21.15.170:0/2806002420 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5653675e7a10 con 0x565367681a50 2024-01-25T15:03:31.985 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.978+0000 7f28d77fe640 1 -- 172.21.15.170:0/2806002420 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5653675be240 con 0x565367681a50 2024-01-25T15:03:31.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.978+0000 7f28d77fe640 1 -- 172.21.15.170:0/2806002420 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 29) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f28e0021040 con 0x565367681a50 2024-01-25T15:03:31.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.978+0000 7f29013d3740 10 client.15918 fetch_fsmap finished waiting for FSMap version 29 2024-01-25T15:03:31.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.978+0000 7f29013d3740 10 client.15918 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:31.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.978+0000 7f29013d3740 20 client.15918 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:31.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.978+0000 7f29013d3740 1 --2- 172.21.15.170:0/2806002420 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x565367697d40 0x56536769a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:31.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.978+0000 7f29013d3740 4 client.15918 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:31.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.978+0000 7f29013d3740 1 -- 172.21.15.170:0/2806002420 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653675bbb50 con 0x565367697d40 2024-01-25T15:03:31.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.978+0000 7f28f77fe640 1 --2- 172.21.15.170:0/2806002420 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x565367697d40 0x56536769a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:31.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.978+0000 7f28d77fe640 10 client.15918 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:31.986 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:31.978+0000 7f28f77fe640 1 --2- 172.21.15.170:0/2806002420 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x565367697d40 0x56536769a160 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc5be01df640f112 server_cookie=101058c50228126 in_seq=0 out_seq=0 2024-01-25T15:03:32.200 INFO:tasks.workunit.client.0.smithi170.stdout:1/181: mknod d0/d2e/c3c 0 2024-01-25T15:03:32.200 INFO:tasks.workunit.client.0.smithi170.stdout:1/182: creat d0/f3d x:0 0 0 2024-01-25T15:03:32.206 INFO:tasks.workunit.client.0.smithi170.stdout:6/109: creat d2/d7/d23/d19/f29 x:0 0 0 2024-01-25T15:03:32.206 INFO:tasks.workunit.client.0.smithi170.stdout:6/110: chown d2/d7/d1b/f1f 35 1 2024-01-25T15:03:32.206 INFO:tasks.workunit.client.0.smithi170.stdout:6/111: truncate f0 1602274 0 2024-01-25T15:03:32.214 INFO:tasks.workunit.client.0.smithi170.stdout:7/149: link d8/d20/d2a/f2d d8/d20/d3b/f3c 0 2024-01-25T15:03:32.214 INFO:tasks.workunit.client.0.smithi170.stdout:2/220: mknod d10/d1b/c4c 0 2024-01-25T15:03:32.214 INFO:tasks.workunit.client.0.smithi170.stdout:2/221: chown d10/f12 354755371 1 2024-01-25T15:03:32.220 INFO:tasks.workunit.client.0.smithi170.stdout:6/112: dread d2/d7/d23/d19/f24 [0,4194304] 0 2024-01-25T15:03:32.220 INFO:tasks.workunit.client.0.smithi170.stdout:6/113: fdatasync d2/d7/f18 0 2024-01-25T15:03:32.222 INFO:tasks.workunit.client.0.smithi170.stdout:1/183: dread d0/f2f [0,4194304] 0 2024-01-25T15:03:32.250 INFO:tasks.workunit.client.0.smithi170.stdout:0/136: truncate d8/d9/f16 490134 0 2024-01-25T15:03:32.250 INFO:tasks.workunit.client.0.smithi170.stdout:0/137: write d8/d10/f2b [3278689,74451] 0 2024-01-25T15:03:32.250 INFO:tasks.workunit.client.0.smithi170.stdout:0/138: readlink d8/d9/l1e 0 2024-01-25T15:03:32.250 INFO:tasks.workunit.client.0.smithi170.stdout:0/139: creat d8/d10/f2e x:0 0 0 2024-01-25T15:03:32.250 INFO:tasks.workunit.client.0.smithi170.stdout:0/140: readlink d8/d9/l21 0 2024-01-25T15:03:32.277 INFO:tasks.workunit.client.0.smithi170.stdout:7/150: read d8/f31 [113675,20428] 0 2024-01-25T15:03:32.290 INFO:tasks.workunit.client.0.smithi170.stdout:7/151: dread d8/f18 [0,4194304] 0 2024-01-25T15:03:32.352 INFO:tasks.workunit.client.0.smithi170.stdout:5/120: mkdir d5/d10/d2c 0 2024-01-25T15:03:32.357 INFO:tasks.workunit.client.0.smithi170.stdout:6/114: rmdir d2/d7/d1b/d25 0 2024-01-25T15:03:32.362 INFO:tasks.workunit.client.0.smithi170.stdout:8/93: symlink d3/l18 0 2024-01-25T15:03:32.362 INFO:tasks.workunit.client.0.smithi170.stdout:8/94: dread - d3/d7/f12 zero size 2024-01-25T15:03:32.372 INFO:tasks.workunit.client.0.smithi170.stdout:0/141: mkdir d8/d10/d2d/d2f 0 2024-01-25T15:03:32.372 INFO:tasks.workunit.client.0.smithi170.stdout:0/142: stat d8/d9/l21 0 2024-01-25T15:03:32.376 INFO:tasks.workunit.client.0.smithi170.stdout:5/121: readlink d5/l22 0 2024-01-25T15:03:32.388 INFO:tasks.workunit.client.0.smithi170.stdout:6/115: mkdir d2/d7/d23/d19/d2a 0 2024-01-25T15:03:32.394 INFO:tasks.workunit.client.0.smithi170.stdout:8/95: symlink d3/d7/l19 0 2024-01-25T15:03:32.394 INFO:tasks.workunit.client.0.smithi170.stdout:5/122: write d5/f7 [2230308,42475] 0 2024-01-25T15:03:32.396 INFO:tasks.workunit.client.0.smithi170.stdout:5/123: creat d5/d10/d2c/f2d x:0 0 0 2024-01-25T15:03:32.397 INFO:tasks.workunit.client.0.smithi170.stdout:6/116: truncate d2/f4 1048350 0 2024-01-25T15:03:32.404 INFO:tasks.workunit.client.0.smithi170.stdout:6/117: symlink d2/d7/d1b/d28/l2b 0 2024-01-25T15:03:32.404 INFO:tasks.workunit.client.0.smithi170.stdout:6/118: fdatasync d2/d7/d23/f13 0 2024-01-25T15:03:32.404 INFO:tasks.workunit.client.0.smithi170.stdout:6/119: chown d2/f3 188344125 1 2024-01-25T15:03:32.412 INFO:tasks.workunit.client.0.smithi170.stdout:5/124: link d5/f11 d5/d10/d2c/f2e 0 2024-01-25T15:03:32.412 INFO:tasks.workunit.client.0.smithi170.stdout:5/125: write d5/d2a/f2b [488703,54636] 0 2024-01-25T15:03:32.418 INFO:tasks.workunit.client.0.smithi170.stdout:6/120: unlink d2/lb 0 2024-01-25T15:03:32.422 INFO:tasks.workunit.client.0.smithi170.stdout:5/126: mknod d5/d10/c2f 0 2024-01-25T15:03:32.426 INFO:tasks.workunit.client.0.smithi170.stdout:5/127: mknod d5/c30 0 2024-01-25T15:03:32.957 INFO:tasks.workunit.client.0.smithi170.stdout:7/152: dwrite f7 [0,4194304] 0 2024-01-25T15:03:32.978 INFO:tasks.workunit.client.0.smithi170.stdout:7/153: dwrite d8/d20/d2a/d35/f32 [0,4194304] 0 2024-01-25T15:03:32.982 INFO:tasks.workunit.client.0.smithi170.stdout:7/154: unlink d8/fe 0 2024-01-25T15:03:32.982 INFO:tasks.workunit.client.0.smithi170.stdout:7/155: chown d8/f1c 116715 1 2024-01-25T15:03:32.996 INFO:tasks.workunit.client.0.smithi170.stdout:8/96: dwrite d3/d7/f10 [0,4194304] 0 2024-01-25T15:03:32.999 INFO:tasks.workunit.client.0.smithi170.stdout:8/97: truncate d3/d7/fe 872120 0 2024-01-25T15:03:33.002 INFO:tasks.workunit.client.0.smithi170.stdout:8/98: mknod d3/d7/c1a 0 2024-01-25T15:03:33.002 INFO:tasks.workunit.client.0.smithi170.stdout:8/99: truncate d3/d7/f16 699467 0 2024-01-25T15:03:33.004 INFO:tasks.workunit.client.0.smithi170.stdout:8/100: unlink d3/d7/cf 0 2024-01-25T15:03:33.012 INFO:tasks.workunit.client.0.smithi170.stdout:3/151: sync 2024-01-25T15:03:33.012 INFO:tasks.workunit.client.0.smithi170.stdout:0/143: dwrite f2 [0,4194304] 0 2024-01-25T15:03:33.017 INFO:tasks.workunit.client.0.smithi170.stdout:0/144: mknod d8/c30 0 2024-01-25T15:03:33.017 INFO:tasks.workunit.client.0.smithi170.stdout:0/145: chown d8/d9/f16 176 1 2024-01-25T15:03:33.017 INFO:tasks.workunit.client.0.smithi170.stdout:0/146: stat c0 0 2024-01-25T15:03:33.046 INFO:tasks.workunit.client.0.smithi170.stdout:0/147: dread d8/d9/f29 [0,4194304] 0 2024-01-25T15:03:33.046 INFO:tasks.workunit.client.0.smithi170.stdout:0/148: chown d8/c1d 36 1 2024-01-25T15:03:33.047 INFO:tasks.workunit.client.0.smithi170.stdout:0/149: mknod d8/d18/c31 0 2024-01-25T15:03:33.067 INFO:tasks.workunit.client.0.smithi170.stdout:0/150: dwrite d8/d10/f1b [0,4194304] 0 2024-01-25T15:03:33.090 INFO:tasks.workunit.client.0.smithi170.stdout:0/151: dwrite d8/d10/f15 [0,4194304] 0 2024-01-25T15:03:33.094 INFO:tasks.workunit.client.0.smithi170.stdout:8/101: dread d3/f9 [0,4194304] 0 2024-01-25T15:03:33.108 INFO:tasks.workunit.client.0.smithi170.stdout:8/102: mknod d3/c1b 0 2024-01-25T15:03:33.109 INFO:tasks.workunit.client.0.smithi170.stdout:8/103: symlink d3/l1c 0 2024-01-25T15:03:33.110 INFO:tasks.workunit.client.0.smithi170.stdout:8/104: symlink d3/d7/l1d 0 2024-01-25T15:03:33.110 INFO:tasks.workunit.client.0.smithi170.stdout:8/105: fdatasync d3/fd 0 2024-01-25T15:03:33.118 INFO:tasks.workunit.client.0.smithi170.stdout:8/106: read f0 [1688826,61333] 0 2024-01-25T15:03:33.120 INFO:tasks.workunit.client.0.smithi170.stdout:8/107: mkdir d3/d7/d1e 0 2024-01-25T15:03:33.122 INFO:tasks.workunit.client.0.smithi170.stdout:8/108: mknod d3/d7/c1f 0 2024-01-25T15:03:33.122 INFO:tasks.workunit.client.0.smithi170.stdout:8/109: write f0 [4537900,118278] 0 2024-01-25T15:03:33.122 INFO:tasks.workunit.client.0.smithi170.stdout:8/110: write d3/d7/f15 [863265,35656] 0 2024-01-25T15:03:33.122 INFO:tasks.workunit.client.0.smithi170.stdout:8/111: write d3/fd [853105,55555] 0 2024-01-25T15:03:33.122 INFO:tasks.workunit.client.0.smithi170.stdout:8/112: creat d3/d7/d1e/f20 x:0 0 0 2024-01-25T15:03:33.126 INFO:tasks.workunit.client.0.smithi170.stdout:4/117: sync 2024-01-25T15:03:33.148 INFO:tasks.workunit.client.0.smithi170.stdout:4/118: dwrite f2 [4194304,4194304] 0 2024-01-25T15:03:33.168 INFO:tasks.workunit.client.0.smithi170.stdout:4/119: creat d6/d7/d1b/f1e x:0 0 0 2024-01-25T15:03:33.170 INFO:tasks.workunit.client.0.smithi170.stdout:4/120: unlink d6/c1c 0 2024-01-25T15:03:33.170 INFO:tasks.workunit.client.0.smithi170.stdout:4/121: stat l1 0 2024-01-25T15:03:33.184 INFO:tasks.workunit.client.0.smithi170.stdout:4/122: symlink d6/l1f 0 2024-01-25T15:03:33.195 INFO:tasks.workunit.client.0.smithi170.stdout:4/123: read d6/d7/f9 [72957,67754] 0 2024-01-25T15:03:33.207 INFO:tasks.workunit.client.0.smithi170.stdout:4/124: link c5 d6/c20 0 2024-01-25T15:03:33.219 INFO:tasks.workunit.client.0.smithi170.stdout:4/125: dread d6/d7/f17 [0,4194304] 0 2024-01-25T15:03:33.220 INFO:tasks.workunit.client.0.smithi170.stdout:4/126: stat d6/c20 0 2024-01-25T15:03:33.221 INFO:tasks.workunit.client.0.smithi170.stdout:4/127: mknod d6/c21 0 2024-01-25T15:03:33.226 INFO:tasks.workunit.client.0.smithi170.stdout:4/128: rename d6/c10 to d6/c22 0 2024-01-25T15:03:33.230 INFO:tasks.workunit.client.0.smithi170.stdout:4/129: link d6/d11/c13 d6/d11/c23 0 2024-01-25T15:03:33.238 INFO:tasks.workunit.client.0.smithi170.stdout:4/130: dread d6/d7/fa [0,4194304] 0 2024-01-25T15:03:33.238 INFO:tasks.workunit.client.0.smithi170.stdout:4/131: creat d6/d11/f24 x:0 0 0 2024-01-25T15:03:33.249 INFO:tasks.workunit.client.0.smithi170.stdout:5/128: getdents d5/d10/d2c 0 2024-01-25T15:03:33.249 INFO:tasks.workunit.client.0.smithi170.stdout:5/129: stat d5/d10 0 2024-01-25T15:03:33.252 INFO:tasks.workunit.client.0.smithi170.stdout:7/156: creat d8/d20/d2a/f3d x:0 0 0 2024-01-25T15:03:33.255 INFO:tasks.workunit.client.0.smithi170.stdout:7/157: mknod d8/d20/d2a/c3e 0 2024-01-25T15:03:33.255 INFO:tasks.workunit.client.0.smithi170.stdout:7/158: fdatasync d8/d20/d3b/f3c 0 2024-01-25T15:03:33.257 INFO:tasks.workunit.client.0.smithi170.stdout:7/159: unlink d8/f18 0 2024-01-25T15:03:33.258 INFO:tasks.workunit.client.0.smithi170.stdout:7/160: symlink d8/d20/d2a/l3f 0 2024-01-25T15:03:33.259 INFO:tasks.workunit.client.0.smithi170.stdout:7/161: dread - d8/f3a zero size 2024-01-25T15:03:33.269 INFO:tasks.workunit.client.0.smithi170.stdout:5/130: dwrite d5/f24 [0,4194304] 0 2024-01-25T15:03:33.273 INFO:tasks.workunit.client.0.smithi170.stdout:5/131: creat d5/d10/d2c/f31 x:0 0 0 2024-01-25T15:03:33.278 INFO:tasks.workunit.client.0.smithi170.stdout:1/184: symlink d0/d20/l3e 0 2024-01-25T15:03:33.280 INFO:tasks.workunit.client.0.smithi170.stdout:9/131: rename d5/df/d12/d18/f1f to d5/f29 0 2024-01-25T15:03:33.282 INFO:tasks.workunit.client.0.smithi170.stdout:6/121: rename d2/d7/d1b/l1d to d2/d7/l2c 0 2024-01-25T15:03:33.283 INFO:tasks.workunit.client.0.smithi170.stdout:6/122: write d2/d7/f1c [984038,36621] 0 2024-01-25T15:03:33.283 INFO:tasks.workunit.client.0.smithi170.stdout:6/123: write d2/f6 [1830403,122585] 0 2024-01-25T15:03:33.284 INFO:tasks.workunit.client.0.smithi170.stdout:0/152: rename d8/d10/c24 to d8/c32 0 2024-01-25T15:03:33.284 INFO:tasks.workunit.client.0.smithi170.stdout:0/153: dread - d8/d10/f2e zero size 2024-01-25T15:03:33.284 INFO:tasks.workunit.client.0.smithi170.stdout:0/154: readlink d8/d10/l22 0 2024-01-25T15:03:33.284 INFO:tasks.workunit.client.0.smithi170.stdout:0/155: readlink d8/d10/l22 0 2024-01-25T15:03:33.286 INFO:tasks.workunit.client.0.smithi170.stdout:6/124: creat d2/d7/d23/f2d x:0 0 0 2024-01-25T15:03:33.287 INFO:tasks.workunit.client.0.smithi170.stdout:8/113: rename d3/l13 to d3/d7/d1e/l21 0 2024-01-25T15:03:33.289 INFO:tasks.workunit.client.0.smithi170.stdout:2/222: link l2 d10/d1e/l4d 0 2024-01-25T15:03:33.290 INFO:tasks.workunit.client.0.smithi170.stdout:4/132: rename d6/f8 to d6/d11/f25 0 2024-01-25T15:03:33.291 INFO:tasks.workunit.client.0.smithi170.stdout:2/223: creat d10/d1e/f4e x:0 0 0 2024-01-25T15:03:33.291 INFO:tasks.workunit.client.0.smithi170.stdout:2/224: readlink d10/l3d 0 2024-01-25T15:03:33.294 INFO:tasks.workunit.client.0.smithi170.stdout:5/132: dwrite d5/d10/f21 [0,4194304] 0 2024-01-25T15:03:33.294 INFO:tasks.workunit.client.0.smithi170.stdout:7/162: rename d8/d20/l25 to d8/l40 0 2024-01-25T15:03:33.303 INFO:tasks.workunit.client.0.smithi170.stdout:1/185: rename d0/d2e/c3c to d0/d20/c3f 0 2024-01-25T15:03:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.302+0000 7f2f71ffb640 1 -- 172.21.15.170:0/3916362248 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c67e68ec50 con 0x55c67e9fa080 2024-01-25T15:03:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f71ffb640 10 client.15906 handle_command_reply: tid=0 2024-01-25T15:03:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f939c9740 1 client.15906 shutdown 2024-01-25T15:03:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f939c9740 1 -- 172.21.15.170:0/3916362248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d32a0 msgr2=0x55c67e9f3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f939c9740 1 --2- 172.21.15.170:0/3916362248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d32a0 0x55c67e9f3710 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00cd40 tx=0x7f2f7c0052d0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f939c9740 1 -- 172.21.15.170:0/3916362248 shutdown_connections 2024-01-25T15:03:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f939c9740 1 --2- 172.21.15.170:0/3916362248 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55c67e9fa080 0x55c67ea53440 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f939c9740 1 --2- 172.21.15.170:0/3916362248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c67e9d8e00 0x55c67e9f4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f939c9740 1 --2- 172.21.15.170:0/3916362248 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c67e9d3c90 0x55c67e9f3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f939c9740 1 --2- 172.21.15.170:0/3916362248 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c67e9d32a0 0x55c67e9f3710 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f71ffb640 0 client.15906 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f939c9740 1 -- 172.21.15.170:0/3916362248 >> 172.21.15.170:0/3916362248 conn(0x55c67e9ce810 msgr2=0x55c67e9d1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f939c9740 1 -- 172.21.15.170:0/3916362248 shutdown_connections 2024-01-25T15:03:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f939c9740 1 -- 172.21.15.170:0/3916362248 wait complete. 2024-01-25T15:03:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f939c9740 20 client.15906 trim_cache size 0 max 16384 2024-01-25T15:03:33.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f28d77fe640 1 -- 172.21.15.170:0/2806002420 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5653675bbb50 con 0x565367697d40 2024-01-25T15:03:33.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f28d77fe640 10 client.15918 handle_command_reply: tid=0 2024-01-25T15:03:33.306 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f29013d3740 1 client.15918 shutdown 2024-01-25T15:03:33.306 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:{ 2024-01-25T15:03:33.306 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "message": "", 2024-01-25T15:03:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "return_code": 0 2024-01-25T15:03:33.307 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:} 2024-01-25T15:03:33.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f29013d3740 1 -- 172.21.15.170:0/2806002420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565367681a50 msgr2=0x56536768bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f29013d3740 1 --2- 172.21.15.170:0/2806002420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565367681a50 0x56536768bba0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f28e001b040 tx=0x7f28e00038a0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f29013d3740 1 -- 172.21.15.170:0/2806002420 shutdown_connections 2024-01-25T15:03:33.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f29013d3740 1 --2- 172.21.15.170:0/2806002420 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x565367697d40 0x56536769a160 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f29013d3740 1 --2- 172.21.15.170:0/2806002420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367682440 0x56536768c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f29013d3740 1 --2- 172.21.15.170:0/2806002420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5653676875b0 0x565367693120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f29013d3740 1 --2- 172.21.15.170:0/2806002420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565367681a50 0x56536768bba0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f28d77fe640 0 client.15918 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:33.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f29013d3740 1 -- 172.21.15.170:0/2806002420 >> 172.21.15.170:0/2806002420 conn(0x56536767cfc0 msgr2=0x56536767c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:33.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f29013d3740 1 -- 172.21.15.170:0/2806002420 shutdown_connections 2024-01-25T15:03:33.308 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f29013d3740 1 -- 172.21.15.170:0/2806002420 wait complete. 2024-01-25T15:03:33.309 INFO:tasks.workunit.client.0.smithi170.stdout:7/163: creat d8/d20/d2a/d35/f41 x:0 0 0 2024-01-25T15:03:33.309 INFO:tasks.workunit.client.0.smithi170.stdout:7/164: stat c6 0 2024-01-25T15:03:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f90e07640 1 -- 172.21.15.170:0/713340238 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2f740a14f0 msgr2=0x7f2f740a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f90e07640 1 --2- 172.21.15.170:0/713340238 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2f740a14f0 0x7f2f740a39b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55c67e9d4090 tx=0x7f2f7c005c70 comp rx=0 tx=0).stop 2024-01-25T15:03:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f90e07640 1 -- 172.21.15.170:0/713340238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f8c074cd0 msgr2=0x7f2f8c06fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.303+0000 7f2f90e07640 1 --2- 172.21.15.170:0/713340238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f8c074cd0 0x7f2f8c06fa00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009230 tx=0x7f2f80004dd0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.310 INFO:tasks.workunit.client.0.smithi170.stdout:7/165: chown d8/d20/d2a/d35/f32 229 1 2024-01-25T15:03:33.310 INFO:tasks.workunit.client.0.smithi170.stdout:7/166: write d8/d20/d2a/d35/f37 [722922,32764] 0 2024-01-25T15:03:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.304+0000 7f2f90e07640 1 -- 172.21.15.170:0/713340238 shutdown_connections 2024-01-25T15:03:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.304+0000 7f2f90e07640 1 --2- 172.21.15.170:0/713340238 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f2f740a14f0 0x7f2f740a39b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.304+0000 7f29013d3740 20 client.15918 trim_cache size 0 max 16384 2024-01-25T15:03:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.304+0000 7f2f90e07640 1 --2- 172.21.15.170:0/713340238 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2f8c108bd0 0x7f2f8c1ad860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.304+0000 7f2f90e07640 1 --2- 172.21.15.170:0/713340238 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f2f8c074cd0 0x7f2f8c06fa00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.304+0000 7f2f90e07640 1 --2- 172.21.15.170:0/713340238 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2f8c0736f0 0x7f2f8c06f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.304+0000 7f2f90e07640 1 -- 172.21.15.170:0/713340238 >> 172.21.15.170:0/713340238 conn(0x7f2f8c0fc2b0 msgr2=0x7f2f8c104b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.304+0000 7f2f90e07640 1 -- 172.21.15.170:0/713340238 shutdown_connections 2024-01-25T15:03:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:33.304+0000 7f2f90e07640 1 -- 172.21.15.170:0/713340238 wait complete. 2024-01-25T15:03:33.313 INFO:tasks.workunit.client.0.smithi170.stdout:5/133: truncate d5/f16 1289145 0 2024-01-25T15:03:33.313 INFO:tasks.workunit.client.0.smithi170.stdout:9/132: rename d5/fa to d5/d1e/f2a 0 2024-01-25T15:03:33.313 INFO:tasks.workunit.client.0.smithi170.stdout:9/133: creat d5/df/d16/f2b x:0 0 0 2024-01-25T15:03:33.313 INFO:tasks.workunit.client.0.smithi170.stdout:6/125: dwrite d2/f4 [0,4194304] 0 2024-01-25T15:03:33.313 INFO:tasks.workunit.client.0.smithi170.stdout:7/167: dread d8/f31 [0,4194304] 0 2024-01-25T15:03:33.313 INFO:tasks.workunit.client.0.smithi170.stdout:7/168: dread - d8/d20/d3b/f3c zero size 2024-01-25T15:03:33.314 INFO:tasks.workunit.client.0.smithi170.stdout:7/169: readlink d8/d20/d2a/l36 0 2024-01-25T15:03:33.314 INFO:tasks.workunit.client.0.smithi170.stdout:1/186: creat d0/d20/d3a/f40 x:0 0 0 2024-01-25T15:03:33.314 INFO:tasks.workunit.client.0.smithi170.stdout:1/187: creat d0/f41 x:0 0 0 2024-01-25T15:03:33.314 INFO:tasks.workunit.client.0.smithi170.stdout:0/156: rename d8/c1d to d8/d10/d2d/d2f/c33 0 2024-01-25T15:03:33.314 INFO:tasks.workunit.client.0.smithi170.stdout:7/170: creat d8/f42 x:0 0 0 2024-01-25T15:03:33.320 INFO:tasks.workunit.client.0.smithi170.stdout:6/126: rename d2/f5 to d2/d7/f2e 0 2024-01-25T15:03:33.320 INFO:tasks.workunit.client.0.smithi170.stdout:6/127: chown d2/d7/l2c 28890 1 2024-01-25T15:03:33.321 INFO:tasks.workunit.client.0.smithi170.stdout:0/157: symlink d8/d10/l34 0 2024-01-25T15:03:33.322 INFO:tasks.workunit.client.0.smithi170.stdout:7/171: mknod d8/d20/d2a/d35/c43 0 2024-01-25T15:03:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.322+0000 7f29013d3740 1 Processor -- start 2024-01-25T15:03:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.322+0000 7f29013d3740 1 -- start start 2024-01-25T15:03:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.322+0000 7f29013d3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367681a50 0x565367683900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.322+0000 7f29013d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565367682440 0x565367683e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.322+0000 7f29013d3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5653676875b0 0x565367693040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f29013d3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x565367678a90 con 0x565367682440 2024-01-25T15:03:33.324 INFO:tasks.workunit.client.0.smithi170.stdout:0/158: symlink d8/d10/d2d/d2f/l35 0 2024-01-25T15:03:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f29013d3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x565367694610 con 0x565367681a50 2024-01-25T15:03:33.324 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f29013d3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x565367682820 con 0x5653676875b0 2024-01-25T15:03:33.324 INFO:tasks.workunit.client.0.smithi170.stdout:0/159: creat d8/d10/f36 x:0 0 0 2024-01-25T15:03:33.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f28fcdab640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5653676875b0 0x565367693040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f28f7fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367681a50 0x565367683900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f28fcdab640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5653676875b0 0x565367693040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:51426/0 (socket says 172.21.15.170:51426) 2024-01-25T15:03:33.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f28fcdab640 1 -- 172.21.15.170:0/2288505556 learned_addr learned my addr 172.21.15.170:0/2288505556 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:33.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f28f7fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367681a50 0x565367683900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:38054/0 (socket says 172.21.15.170:38054) 2024-01-25T15:03:33.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f28f77fe640 1 --2- 172.21.15.170:0/2288505556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565367682440 0x565367683e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f28f77fe640 1 -- 172.21.15.170:0/2288505556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5653676875b0 msgr2=0x565367693040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:33.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f28f77fe640 1 --2- 172.21.15.170:0/2288505556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5653676875b0 0x565367693040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f28f77fe640 1 -- 172.21.15.170:0/2288505556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367681a50 msgr2=0x565367683900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:33.332 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f28f77fe640 1 --2- 172.21.15.170:0/2288505556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367681a50 0x565367683900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f28f77fe640 1 -- 172.21.15.170:0/2288505556 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565367584520 con 0x565367682440 2024-01-25T15:03:33.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f28f7fff640 1 --2- 172.21.15.170:0/2288505556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367681a50 0x565367683900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:33.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f28fcdab640 1 --2- 172.21.15.170:0/2288505556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5653676875b0 0x565367693040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:33.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.323+0000 7f28f77fe640 1 --2- 172.21.15.170:0/2288505556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565367682440 0x565367683e40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009230 tx=0x7f28e8043040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af9b8a335ac7e17 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:33.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.324+0000 7f28edffb640 1 -- 172.21.15.170:0/2288505556 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8004040 con 0x565367682440 2024-01-25T15:03:33.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.324+0000 7f28edffb640 1 -- 172.21.15.170:0/2288505556 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28e8005000 con 0x565367682440 2024-01-25T15:03:33.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.324+0000 7f28edffb640 1 -- 172.21.15.170:0/2288505556 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e80038d0 con 0x565367682440 2024-01-25T15:03:33.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.325+0000 7f29013d3740 1 -- 172.21.15.170:0/2288505556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565367682440 msgr2=0x565367683e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.325+0000 7f29013d3740 1 --2- 172.21.15.170:0/2288505556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565367682440 0x565367683e40 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009230 tx=0x7f28e8043040 comp rx=0 tx=0).stop 2024-01-25T15:03:33.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.325+0000 7f29013d3740 1 -- 172.21.15.170:0/2288505556 shutdown_connections 2024-01-25T15:03:33.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.325+0000 7f29013d3740 1 --2- 172.21.15.170:0/2288505556 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5653676875b0 0x565367693040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.325+0000 7f29013d3740 1 --2- 172.21.15.170:0/2288505556 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x565367682440 0x565367683e40 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.325+0000 7f29013d3740 1 --2- 172.21.15.170:0/2288505556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367681a50 0x565367683900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.325+0000 7f29013d3740 1 -- 172.21.15.170:0/2288505556 >> 172.21.15.170:0/2288505556 conn(0x56536767cfc0 msgr2=0x565367682b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:33.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.325+0000 7f29013d3740 1 -- 172.21.15.170:0/2288505556 shutdown_connections 2024-01-25T15:03:33.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.325+0000 7f29013d3740 1 -- 172.21.15.170:0/2288505556 wait complete. 2024-01-25T15:03:33.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.325+0000 7f29013d3740 1 -- start start 2024-01-25T15:03:33.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.326+0000 7f29013d3740 1 Processor -- start 2024-01-25T15:03:33.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.326+0000 7f29013d3740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367681a50 0x565367692c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.326+0000 7f29013d3740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565367682440 0x565367691230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.326+0000 7f29013d3740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653676875b0 0x565367691770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.326+0000 7f29013d3740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653676ec4f0 con 0x5653676875b0 2024-01-25T15:03:33.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.326+0000 7f29013d3740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x565367693190 con 0x565367681a50 2024-01-25T15:03:33.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.326+0000 7f29013d3740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x565367693350 con 0x565367682440 2024-01-25T15:03:33.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.326+0000 7f29013d3740 10 client.0 _ll_register_callbacks cb 0x7f28f0005ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:33.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.326+0000 7f28f7fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367681a50 0x565367692c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.326+0000 7f28f77fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565367682440 0x565367691230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.326+0000 7f28f7fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367681a50 0x565367692c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:38062/0 (socket says 172.21.15.170:38062) 2024-01-25T15:03:33.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.326+0000 7f28f7fff640 1 -- 172.21.15.170:0/1401069493 learned_addr learned my addr 172.21.15.170:0/1401069493 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:33.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.327+0000 7f28fcdab640 1 --2- 172.21.15.170:0/1401069493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653676875b0 0x565367691770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.327+0000 7f28f7fff640 1 -- 172.21.15.170:0/1401069493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565367682440 msgr2=0x565367691230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:33.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.327+0000 7f28f7fff640 1 --2- 172.21.15.170:0/1401069493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565367682440 0x565367691230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.327+0000 7f28f7fff640 1 -- 172.21.15.170:0/1401069493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653676875b0 msgr2=0x565367691770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:33.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.327+0000 7f28f7fff640 1 --2- 172.21.15.170:0/1401069493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653676875b0 0x565367691770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.327+0000 7f28f7fff640 1 -- 172.21.15.170:0/1401069493 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653675e7a10 con 0x565367681a50 2024-01-25T15:03:33.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.327+0000 7f28fcdab640 1 --2- 172.21.15.170:0/1401069493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653676875b0 0x565367691770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:03:33.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.327+0000 7f28f7fff640 1 --2- 172.21.15.170:0/1401069493 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367681a50 0x565367692c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28e0011d10 tx=0x7f28e0004590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20163c91276c5920 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:33.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.327+0000 7f28d77fe640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-01-25T15:03:33.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.327+0000 7f28d77fe640 1 -- 172.21.15.170:0/1401069493 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0019ac0 con 0x565367681a50 2024-01-25T15:03:33.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.327+0000 7f28d77fe640 1 -- 172.21.15.170:0/1401069493 <== mon.2 v2:172.21.15.186:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f28e0003ca0 con 0x565367681a50 2024-01-25T15:03:33.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.327+0000 7f29013d3740 1 -- 172.21.15.170:0/1401069493 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565367610c00 con 0x565367681a50 2024-01-25T15:03:33.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.327+0000 7f28d77fe640 1 -- 172.21.15.170:0/1401069493 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28e0003e60 con 0x565367681a50 2024-01-25T15:03:33.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.327+0000 7f29013d3740 10 client.25256 fetch_fsmap learned FSMap version 29 2024-01-25T15:03:33.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.327+0000 7f29013d3740 1 -- 172.21.15.170:0/1401069493 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f28e8009560 con 0x565367681a50 2024-01-25T15:03:33.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.328+0000 7f28d77fe640 1 -- 172.21.15.170:0/1401069493 <== mon.2 v2:172.21.15.186:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x565367610c00 con 0x565367681a50 2024-01-25T15:03:33.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.328+0000 7f28d77fe640 1 -- 172.21.15.170:0/1401069493 <== mon.2 v2:172.21.15.186:3300/0 5 ==== fsmap(e 29) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f28e0004a60 con 0x565367681a50 2024-01-25T15:03:33.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.328+0000 7f29013d3740 10 client.25256 fetch_fsmap finished waiting for FSMap version 29 2024-01-25T15:03:33.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.328+0000 7f29013d3740 10 client.25256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:33.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.328+0000 7f29013d3740 20 client.25256 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:33.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.328+0000 7f29013d3740 1 --2- 172.21.15.170:0/1401069493 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5653676ed5c0 0x5653676ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.328+0000 7f29013d3740 4 client.25256 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-25T15:03:33.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.328+0000 7f29013d3740 1 -- 172.21.15.170:0/1401069493 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5653675e2220 con 0x5653676ed5c0 2024-01-25T15:03:33.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.328+0000 7f28f77fe640 1 --2- 172.21.15.170:0/1401069493 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5653676ed5c0 0x5653676ef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.329+0000 7f28d77fe640 10 client.25256 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:33.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.329+0000 7f28f77fe640 1 --2- 172.21.15.170:0/1401069493 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5653676ed5c0 0x5653676ef9e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfa28b37923cb7f3 server_cookie=f19f246fc7a9a25b in_seq=0 out_seq=0 2024-01-25T15:03:33.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.329+0000 7f28d77fe640 1 -- 172.21.15.170:0/1401069493 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5653675e2220 con 0x5653676ed5c0 2024-01-25T15:03:33.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.329+0000 7f28d77fe640 10 client.25256 handle_command_reply: tid=0 2024-01-25T15:03:33.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.329+0000 7f29013d3740 1 client.25256 shutdown 2024-01-25T15:03:33.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.329+0000 7f29013d3740 1 -- 172.21.15.170:0/1401069493 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367681a50 msgr2=0x565367692c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.329+0000 7f29013d3740 1 --2- 172.21.15.170:0/1401069493 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367681a50 0x565367692c20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f28e0011d10 tx=0x7f28e0004590 comp rx=0 tx=0).stop 2024-01-25T15:03:33.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.330+0000 7f29013d3740 1 -- 172.21.15.170:0/1401069493 shutdown_connections 2024-01-25T15:03:33.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.330+0000 7f29013d3740 1 --2- 172.21.15.170:0/1401069493 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5653676ed5c0 0x5653676ef9e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.330+0000 7f29013d3740 1 --2- 172.21.15.170:0/1401069493 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5653676875b0 0x565367691770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.330+0000 7f28d77fe640 0 client.25256 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:33.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.330+0000 7f29013d3740 1 --2- 172.21.15.170:0/1401069493 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x565367682440 0x565367691230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.330+0000 7f29013d3740 1 --2- 172.21.15.170:0/1401069493 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x565367681a50 0x565367692c20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.330+0000 7f29013d3740 1 -- 172.21.15.170:0/1401069493 >> 172.21.15.170:0/1401069493 conn(0x56536767cfc0 msgr2=0x565367682b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:33.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.330+0000 7f29013d3740 1 -- 172.21.15.170:0/1401069493 shutdown_connections 2024-01-25T15:03:33.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.330+0000 7f29013d3740 1 -- 172.21.15.170:0/1401069493 wait complete. 2024-01-25T15:03:33.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.330+0000 7f29013d3740 20 client.25256 trim_cache size 0 max 16384 2024-01-25T15:03:33.338 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:03:33.338 INFO:teuthology.orchestra.run.smithi170.stdout: "status": "no active scrubs running", 2024-01-25T15:03:33.338 INFO:teuthology.orchestra.run.smithi170.stdout: "scrubs": {} 2024-01-25T15:03:33.338 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:03:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.331+0000 7f28fe80e640 1 -- 172.21.15.170:0/1422660351 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f28e40a12e0 msgr2=0x7f28e40a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.331+0000 7f28fe80e640 1 --2- 172.21.15.170:0/1422660351 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f28e40a12e0 0x7f28e40a37a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f28e8005ab0 tx=0x7f28e802c880 comp rx=0 tx=0).stop 2024-01-25T15:03:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.331+0000 7f28fe80e640 1 -- 172.21.15.170:0/1422660351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f8102960 msgr2=0x7f28f819e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.331+0000 7f28fe80e640 1 --2- 172.21.15.170:0/1422660351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f8102960 0x7f28f819e260 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f28f000eb10 tx=0x7f28f000c2d0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.331+0000 7f28fe80e640 1 -- 172.21.15.170:0/1422660351 shutdown_connections 2024-01-25T15:03:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.331+0000 7f28fe80e640 1 --2- 172.21.15.170:0/1422660351 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f28e40a12e0 0x7f28e40a37a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.331+0000 7f28fe80e640 1 --2- 172.21.15.170:0/1422660351 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f28f8102960 0x7f28f819e260 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.331+0000 7f28fe80e640 1 --2- 172.21.15.170:0/1422660351 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f28f8101fa0 0x7f28f8197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.331+0000 7f28fe80e640 1 --2- 172.21.15.170:0/1422660351 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28f80fefd0 0x7f28f8196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.331+0000 7f28fe80e640 1 -- 172.21.15.170:0/1422660351 >> 172.21.15.170:0/1422660351 conn(0x7f28f80fa900 msgr2=0x7f28f81052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.331+0000 7f28fe80e640 1 -- 172.21.15.170:0/1422660351 shutdown_connections 2024-01-25T15:03:33.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.331+0000 7f28fe80e640 1 -- 172.21.15.170:0/1422660351 wait complete. 2024-01-25T15:03:33.344 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-25T15:03:33.344 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:03:33.347 INFO:tasks.workunit.client.0.smithi170.stdout:7/172: dwrite d8/d20/d2a/d35/f41 [0,4194304] 0 2024-01-25T15:03:33.347 INFO:tasks.workunit.client.0.smithi170.stdout:7/173: creat d8/d20/d2a/d35/f44 x:0 0 0 2024-01-25T15:03:33.347 INFO:tasks.workunit.client.0.smithi170.stdout:7/174: truncate d8/d20/d2a/d35/f44 127681 0 2024-01-25T15:03:33.348 INFO:tasks.workunit.client.0.smithi170.stdout:6/128: dwrite d2/d7/d23/f13 [0,4194304] 0 2024-01-25T15:03:33.348 INFO:tasks.workunit.client.0.smithi170.stdout:6/129: read d2/d7/f1c [531619,112072] 0 2024-01-25T15:03:33.351 INFO:tasks.workunit.client.0.smithi170.stdout:6/130: mkdir d2/d7/d23/d19/d2f 0 2024-01-25T15:03:33.353 INFO:tasks.workunit.client.0.smithi170.stdout:7/175: rmdir d8/d20/d2a 39 2024-01-25T15:03:33.353 INFO:tasks.workunit.client.0.smithi170.stdout:7/176: fdatasync d8/f13 0 2024-01-25T15:03:33.353 INFO:tasks.workunit.client.0.smithi170.stdout:7/177: stat d8/f17 0 2024-01-25T15:03:33.354 INFO:tasks.workunit.client.0.smithi170.stdout:7/178: mkdir d8/d20/d45 0 2024-01-25T15:03:33.356 INFO:tasks.workunit.client.0.smithi170.stdout:6/131: dread f0 [0,4194304] 0 2024-01-25T15:03:33.356 INFO:tasks.workunit.client.0.smithi170.stdout:6/132: chown d2/d7/d1b/f1f 30809433 1 2024-01-25T15:03:33.357 INFO:tasks.workunit.client.0.smithi170.stdout:7/179: dread d8/d20/d2a/d35/f37 [0,4194304] 0 2024-01-25T15:03:33.357 INFO:tasks.workunit.client.0.smithi170.stdout:6/133: link d2/d7/d1b/d28/l2b d2/d7/d23/l30 0 2024-01-25T15:03:33.358 INFO:tasks.workunit.client.0.smithi170.stdout:7/180: rename d8/d20/d2a/f2d to d8/d20/d45/f46 0 2024-01-25T15:03:33.358 INFO:tasks.workunit.client.0.smithi170.stdout:7/181: truncate d8/d20/d2a/d35/f32 4892913 0 2024-01-25T15:03:33.359 INFO:tasks.workunit.client.0.smithi170.stdout:6/134: truncate d2/d7/f2e 1734646 0 2024-01-25T15:03:33.360 INFO:tasks.workunit.client.0.smithi170.stdout:7/182: symlink d8/d20/d45/l47 0 2024-01-25T15:03:33.360 INFO:tasks.workunit.client.0.smithi170.stdout:6/135: mknod d2/d7/c31 0 2024-01-25T15:03:33.361 INFO:tasks.workunit.client.0.smithi170.stdout:7/183: rmdir d8/d20/d2a/d35 39 2024-01-25T15:03:33.361 INFO:tasks.workunit.client.0.smithi170.stdout:6/136: write d2/f10 [1098291,99259] 0 2024-01-25T15:03:33.362 INFO:tasks.workunit.client.0.smithi170.stdout:7/184: symlink d8/d20/d45/l48 0 2024-01-25T15:03:33.369 INFO:tasks.workunit.client.0.smithi170.stdout:6/137: dread d2/d7/f1c [0,4194304] 0 2024-01-25T15:03:33.371 INFO:tasks.workunit.client.0.smithi170.stdout:6/138: rename d2/f6 to d2/d7/d23/d19/d2f/f32 0 2024-01-25T15:03:33.374 INFO:tasks.workunit.client.0.smithi170.stdout:6/139: mknod d2/c33 0 2024-01-25T15:03:33.386 INFO:tasks.workunit.client.0.smithi170.stdout:7/185: dwrite d8/d20/d2a/d35/f32 [4194304,4194304] 0 2024-01-25T15:03:33.397 INFO:tasks.workunit.client.0.smithi170.stdout:7/186: dread d8/fc [0,4194304] 0 2024-01-25T15:03:33.397 INFO:tasks.workunit.client.0.smithi170.stdout:6/140: dwrite d2/d7/d23/f2d [0,4194304] 0 2024-01-25T15:03:33.397 INFO:tasks.workunit.client.0.smithi170.stdout:6/141: fsync d2/d7/d23/f13 0 2024-01-25T15:03:33.398 INFO:tasks.workunit.client.0.smithi170.stdout:7/187: chown d8/c1a 1 1 2024-01-25T15:03:33.403 INFO:tasks.workunit.client.0.smithi170.stdout:7/188: unlink d8/f13 0 2024-01-25T15:03:33.404 INFO:tasks.workunit.client.0.smithi170.stdout:7/189: getdents d8/d20/d3b 0 2024-01-25T15:03:33.406 INFO:tasks.workunit.client.0.smithi170.stdout:7/190: rmdir d8/d20/d45 39 2024-01-25T15:03:33.406 INFO:tasks.workunit.client.0.smithi170.stdout:7/191: readlink l5 0 2024-01-25T15:03:33.407 INFO:tasks.workunit.client.0.smithi170.stdout:7/192: creat d8/d20/d2a/d35/f49 x:0 0 0 2024-01-25T15:03:33.410 INFO:tasks.workunit.client.0.smithi170.stdout:7/193: creat d8/d20/d45/f4a x:0 0 0 2024-01-25T15:03:33.422 INFO:tasks.workunit.client.0.smithi170.stdout:6/142: dwrite d2/d7/d23/d19/d2f/f32 [0,4194304] 0 2024-01-25T15:03:33.422 INFO:tasks.workunit.client.0.smithi170.stdout:6/143: fsync d2/f10 0 2024-01-25T15:03:33.424 INFO:tasks.workunit.client.0.smithi170.stdout:6/144: unlink d2/l11 0 2024-01-25T15:03:33.427 INFO:tasks.workunit.client.0.smithi170.stdout:6/145: link d2/d7/d1b/d28/l2b d2/d7/d23/d19/l34 0 2024-01-25T15:03:33.451 INFO:tasks.workunit.client.0.smithi170.stdout:6/146: dwrite f0 [0,4194304] 0 2024-01-25T15:03:33.462 INFO:tasks.workunit.client.0.smithi170.stdout:6/147: dread d2/d7/d23/f2d [0,4194304] 0 2024-01-25T15:03:33.463 INFO:tasks.workunit.client.0.smithi170.stdout:6/148: rmdir d2/d7/d23/d19/d2f 39 2024-01-25T15:03:33.464 INFO:tasks.workunit.client.0.smithi170.stdout:6/149: unlink d2/d7/d23/f13 0 2024-01-25T15:03:33.465 INFO:tasks.workunit.client.0.smithi170.stdout:6/150: mknod d2/d7/d23/c35 0 2024-01-25T15:03:33.466 INFO:tasks.workunit.client.0.smithi170.stdout:6/151: link d2/c21 d2/d7/c36 0 2024-01-25T15:03:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.475+0000 7f445130d640 1 -- 172.21.15.170:0/475002815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f444c0ffc10 msgr2=0x7f444c100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.475+0000 7f445130d640 1 --2- 172.21.15.170:0/475002815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f444c0ffc10 0x7f444c100030 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f443c009900 tx=0x7f443c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:03:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.475+0000 7f445130d640 1 -- 172.21.15.170:0/475002815 shutdown_connections 2024-01-25T15:03:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.475+0000 7f445130d640 1 --2- 172.21.15.170:0/475002815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f444c1017c0 0x7f444c108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.475+0000 7f445130d640 1 --2- 172.21.15.170:0/475002815 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f444c100e00 0x7f444c101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f445130d640 1 --2- 172.21.15.170:0/475002815 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f444c0ffc10 0x7f444c100030 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f445130d640 1 -- 172.21.15.170:0/475002815 >> 172.21.15.170:0/475002815 conn(0x7f444c0fb180 msgr2=0x7f444c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f445130d640 1 -- 172.21.15.170:0/475002815 shutdown_connections 2024-01-25T15:03:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f445130d640 1 -- 172.21.15.170:0/475002815 wait complete. 2024-01-25T15:03:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f445130d640 1 Processor -- start 2024-01-25T15:03:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f445130d640 1 -- start start 2024-01-25T15:03:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f445130d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f444c0ffc10 0x7f444c198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f445130d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f444c100e00 0x7f444c199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f445130d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f444c1017c0 0x7f444c1a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f445130d640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c1a0a10 con 0x7f444c100e00 2024-01-25T15:03:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f445130d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c1a0b80 con 0x7f444c0ffc10 2024-01-25T15:03:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f445130d640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444c1a0d40 con 0x7f444c1017c0 2024-01-25T15:03:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f4443fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f444c100e00 0x7f444c199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f444affd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f444c0ffc10 0x7f444c198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.479 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f4443fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f444c100e00 0x7f444c199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54072/0 (socket says 172.21.15.170:54072) 2024-01-25T15:03:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.476+0000 7f4443fff640 1 -- 172.21.15.170:0/534194234 learned_addr learned my addr 172.21.15.170:0/534194234 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.477+0000 7f444b7fe640 1 --2- 172.21.15.170:0/534194234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f444c1017c0 0x7f444c1a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.477+0000 7f4443fff640 1 -- 172.21.15.170:0/534194234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f444c1017c0 msgr2=0x7f444c1a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.477+0000 7f4443fff640 1 --2- 172.21.15.170:0/534194234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f444c1017c0 0x7f444c1a04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.477+0000 7f4443fff640 1 -- 172.21.15.170:0/534194234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f444c0ffc10 msgr2=0x7f444c198f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.477+0000 7f4443fff640 1 --2- 172.21.15.170:0/534194234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f444c0ffc10 0x7f444c198f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.477+0000 7f4443fff640 1 -- 172.21.15.170:0/534194234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c009560 con 0x7f444c100e00 2024-01-25T15:03:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.477+0000 7f444affd640 1 --2- 172.21.15.170:0/534194234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f444c0ffc10 0x7f444c198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.477+0000 7f4443fff640 1 --2- 172.21.15.170:0/534194234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f444c100e00 0x7f444c199460 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f443400e9f0 tx=0x7f443400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.477+0000 7f4448ff9640 1 -- 172.21.15.170:0/534194234 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434009720 con 0x7f444c100e00 2024-01-25T15:03:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.477+0000 7f4448ff9640 1 -- 172.21.15.170:0/534194234 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f443400cd80 con 0x7f444c100e00 2024-01-25T15:03:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.477+0000 7f445130d640 1 -- 172.21.15.170:0/534194234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444c1a0fc0 con 0x7f444c100e00 2024-01-25T15:03:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.477+0000 7f4448ff9640 1 -- 172.21.15.170:0/534194234 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434010430 con 0x7f444c100e00 2024-01-25T15:03:33.480 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.477+0000 7f445130d640 1 -- 172.21.15.170:0/534194234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f444c1a1450 con 0x7f444c100e00 2024-01-25T15:03:33.481 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.478+0000 7f445130d640 1 -- 172.21.15.170:0/534194234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444c10b4c0 con 0x7f444c100e00 2024-01-25T15:03:33.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.480+0000 7f4448ff9640 1 -- 172.21.15.170:0/534194234 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f4434005000 con 0x7f444c100e00 2024-01-25T15:03:33.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.480+0000 7f4448ff9640 1 --2- 172.21.15.170:0/534194234 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f44380a12e0 0x7f44380a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.480+0000 7f4448ff9640 1 -- 172.21.15.170:0/534194234 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f4434014070 con 0x7f444c100e00 2024-01-25T15:03:33.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.480+0000 7f444affd640 1 --2- 172.21.15.170:0/534194234 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f44380a12e0 0x7f44380a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.481+0000 7f444affd640 1 --2- 172.21.15.170:0/534194234 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f44380a12e0 0x7f44380a37a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f443c000c00 tx=0x7f443c02c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:33.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.484+0000 7f4448ff9640 1 -- 172.21.15.170:0/534194234 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f44340964b0 con 0x7f444c100e00 2024-01-25T15:03:33.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:33 smithi186 ceph-mon[35697]: pgmap v395: 97 pgs: 97 active+clean; 182 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 17 MiB/s wr, 860 op/s 2024-01-25T15:03:33.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:33 smithi170 ceph-mon[31899]: pgmap v395: 97 pgs: 97 active+clean; 182 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 17 MiB/s wr, 860 op/s 2024-01-25T15:03:33.696 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.695+0000 7f445130d640 1 -- 172.21.15.170:0/534194234 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f444c1a16a0 con 0x7f444c100e00 2024-01-25T15:03:33.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.696+0000 7f4448ff9640 1 -- 172.21.15.170:0/534194234 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+11425 (secure 0 0 0) 0x7f4434099ad0 con 0x7f444c100e00 2024-01-25T15:03:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:03:33.697 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-25T14:59:53.534085+0000","modified":"2024-01-25T15:03:29.608347+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24484,"mds_1":24479,"mds_2":24466,"mds_3":24418,"mds_4":24398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":4,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24479":{"gid":24479,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.186:6839/2132502182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":2132502182},{"type":"v1","addr":"172.21.15.186:6839","nonce":2132502182}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:03:33.697 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 29 2024-01-25T15:03:33.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.698+0000 7f445130d640 1 -- 172.21.15.170:0/534194234 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f44380a12e0 msgr2=0x7f44380a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.698+0000 7f445130d640 1 --2- 172.21.15.170:0/534194234 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f44380a12e0 0x7f44380a37a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f443c000c00 tx=0x7f443c02c5d0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.698+0000 7f445130d640 1 -- 172.21.15.170:0/534194234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f444c100e00 msgr2=0x7f444c199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.698+0000 7f445130d640 1 --2- 172.21.15.170:0/534194234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f444c100e00 0x7f444c199460 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f443400e9f0 tx=0x7f443400edf0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.698+0000 7f445130d640 1 -- 172.21.15.170:0/534194234 shutdown_connections 2024-01-25T15:03:33.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.698+0000 7f445130d640 1 --2- 172.21.15.170:0/534194234 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f44380a12e0 0x7f44380a37a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.699 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.698+0000 7f445130d640 1 --2- 172.21.15.170:0/534194234 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f444c1017c0 0x7f444c1a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.698+0000 7f445130d640 1 --2- 172.21.15.170:0/534194234 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f444c100e00 0x7f444c199460 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.698+0000 7f445130d640 1 --2- 172.21.15.170:0/534194234 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f444c0ffc10 0x7f444c198f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.698+0000 7f445130d640 1 -- 172.21.15.170:0/534194234 >> 172.21.15.170:0/534194234 conn(0x7f444c0fb180 msgr2=0x7f444c067e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:33.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.698+0000 7f445130d640 1 -- 172.21.15.170:0/534194234 shutdown_connections 2024-01-25T15:03:33.700 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.698+0000 7f445130d640 1 -- 172.21.15.170:0/534194234 wait complete. 2024-01-25T15:03:33.710 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-01-25T15:03:33.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:33 smithi191 ceph-mon[36347]: pgmap v395: 97 pgs: 97 active+clean; 182 MiB data, 1004 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 17 MiB/s wr, 860 op/s 2024-01-25T15:03:33.851 INFO:tasks.workunit.client.0.smithi170.stdout:9/134: sync 2024-01-25T15:03:33.852 INFO:tasks.workunit.client.0.smithi170.stdout:1/188: sync 2024-01-25T15:03:33.852 INFO:tasks.workunit.client.0.smithi170.stdout:5/134: sync 2024-01-25T15:03:33.852 INFO:tasks.workunit.client.0.smithi170.stdout:2/225: sync 2024-01-25T15:03:33.852 INFO:tasks.workunit.client.0.smithi170.stdout:1/189: fsync d0/f33 0 2024-01-25T15:03:33.852 INFO:tasks.workunit.client.0.smithi170.stdout:1/190: readlink d0/d2e/l37 0 2024-01-25T15:03:33.852 INFO:tasks.workunit.client.0.smithi170.stdout:4/133: sync 2024-01-25T15:03:33.852 INFO:tasks.workunit.client.0.smithi170.stdout:9/135: creat d5/dc/f2c x:0 0 0 2024-01-25T15:03:33.852 INFO:tasks.workunit.client.0.smithi170.stdout:6/152: sync 2024-01-25T15:03:33.852 INFO:tasks.workunit.client.0.smithi170.stdout:3/152: sync 2024-01-25T15:03:33.852 INFO:tasks.workunit.client.0.smithi170.stdout:0/160: sync 2024-01-25T15:03:33.852 INFO:tasks.workunit.client.0.smithi170.stdout:6/153: fsync d2/d7/d23/d19/f20 0 2024-01-25T15:03:33.853 INFO:tasks.workunit.client.0.smithi170.stdout:8/114: sync 2024-01-25T15:03:33.853 INFO:tasks.workunit.client.0.smithi170.stdout:8/115: stat d3/l1c 0 2024-01-25T15:03:33.853 INFO:tasks.workunit.client.0.smithi170.stdout:8/116: chown d3 1013546403 1 2024-01-25T15:03:33.853 INFO:tasks.workunit.client.0.smithi170.stdout:8/117: dread - d3/d7/f12 zero size 2024-01-25T15:03:33.853 INFO:tasks.workunit.client.0.smithi170.stdout:8/118: chown d3/d7/d1e 224583082 1 2024-01-25T15:03:33.853 INFO:tasks.workunit.client.0.smithi170.stdout:8/119: fdatasync d3/d7/f16 0 2024-01-25T15:03:33.853 INFO:tasks.workunit.client.0.smithi170.stdout:7/194: sync 2024-01-25T15:03:33.853 INFO:tasks.workunit.client.0.smithi170.stdout:3/153: write d3/d10/f1a [8167,38445] 0 2024-01-25T15:03:33.853 INFO:tasks.workunit.client.0.smithi170.stdout:1/191: symlink d0/d2e/l42 0 2024-01-25T15:03:33.854 INFO:tasks.workunit.client.0.smithi170.stdout:7/195: mknod d8/d20/c4b 0 2024-01-25T15:03:33.856 INFO:tasks.workunit.client.0.smithi170.stdout:8/120: write d3/fb [69774,92332] 0 2024-01-25T15:03:33.856 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.855+0000 7feace743640 1 -- 172.21.15.170:0/3390652472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feac8102a20 msgr2=0x7feac81092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.857 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.855+0000 7feace743640 1 --2- 172.21.15.170:0/3390652472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feac8102a20 0x7feac81092b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7feac0009ca0 tx=0x7feac002c0f0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.857 INFO:tasks.workunit.client.0.smithi170.stdout:4/134: creat d6/f26 x:0 0 0 2024-01-25T15:03:33.857 INFO:tasks.workunit.client.0.smithi170.stdout:9/136: mkdir d5/d1e/d21/d27/d2d 0 2024-01-25T15:03:33.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.856+0000 7feace743640 1 -- 172.21.15.170:0/3390652472 shutdown_connections 2024-01-25T15:03:33.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.856+0000 7feace743640 1 --2- 172.21.15.170:0/3390652472 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feac8102060 0x7feac81024e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.856+0000 7feace743640 1 --2- 172.21.15.170:0/3390652472 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feac8102a20 0x7feac81092b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.856+0000 7feace743640 1 --2- 172.21.15.170:0/3390652472 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feac80feff0 0x7feac80ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.856+0000 7feace743640 1 -- 172.21.15.170:0/3390652472 >> 172.21.15.170:0/3390652472 conn(0x7feac80fa900 msgr2=0x7feac80fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:33.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.856+0000 7feace743640 1 -- 172.21.15.170:0/3390652472 shutdown_connections 2024-01-25T15:03:33.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.856+0000 7feace743640 1 -- 172.21.15.170:0/3390652472 wait complete. 2024-01-25T15:03:33.858 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.857+0000 7feace743640 1 Processor -- start 2024-01-25T15:03:33.858 INFO:tasks.workunit.client.0.smithi170.stdout:1/192: unlink d0/f11 0 2024-01-25T15:03:33.859 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.857+0000 7feace743640 1 -- start start 2024-01-25T15:03:33.859 INFO:tasks.workunit.client.0.smithi170.stdout:7/196: truncate f2 253793 0 2024-01-25T15:03:33.859 INFO:tasks.workunit.client.0.smithi170.stdout:7/197: fsync d8/d20/d3b/f3c 0 2024-01-25T15:03:33.859 INFO:tasks.workunit.client.0.smithi170.stdout:7/198: dread - d8/d20/f2e zero size 2024-01-25T15:03:33.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feace743640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feac80feff0 0x7feac8194a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feace743640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feac8102060 0x7feac8194f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feace743640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feac8102a20 0x7feac819bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feace743640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac819c510 con 0x7feac8102060 2024-01-25T15:03:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feace743640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac819c680 con 0x7feac8102a20 2024-01-25T15:03:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feace743640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac819c840 con 0x7feac80feff0 2024-01-25T15:03:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feac77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feac8102060 0x7feac8194f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feac77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feac8102060 0x7feac8194f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54088/0 (socket says 172.21.15.170:54088) 2024-01-25T15:03:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feac77fe640 1 -- 172.21.15.170:0/4152977272 learned_addr learned my addr 172.21.15.170:0/4152977272 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feaccce0640 1 --2- 172.21.15.170:0/4152977272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feac8102a20 0x7feac819bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feac7fff640 1 --2- 172.21.15.170:0/4152977272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feac80feff0 0x7feac8194a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feac77fe640 1 -- 172.21.15.170:0/4152977272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feac80feff0 msgr2=0x7feac8194a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feac77fe640 1 --2- 172.21.15.170:0/4152977272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feac80feff0 0x7feac8194a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feac77fe640 1 -- 172.21.15.170:0/4152977272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feac8102a20 msgr2=0x7feac819bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feac77fe640 1 --2- 172.21.15.170:0/4152977272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feac8102a20 0x7feac819bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.858+0000 7feac77fe640 1 -- 172.21.15.170:0/4152977272 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac0009900 con 0x7feac8102060 2024-01-25T15:03:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.859+0000 7feac77fe640 1 --2- 172.21.15.170:0/4152977272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feac8102060 0x7feac8194f60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7feabc00b590 tx=0x7feabc00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:33.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.859+0000 7feac57fa640 1 -- 172.21.15.170:0/4152977272 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc008500 con 0x7feac8102060 2024-01-25T15:03:33.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.859+0000 7feac57fa640 1 -- 172.21.15.170:0/4152977272 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feabc008b20 con 0x7feac8102060 2024-01-25T15:03:33.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.859+0000 7feac57fa640 1 -- 172.21.15.170:0/4152977272 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc01ec40 con 0x7feac8102060 2024-01-25T15:03:33.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.859+0000 7feace743640 1 -- 172.21.15.170:0/4152977272 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac819cb20 con 0x7feac8102060 2024-01-25T15:03:33.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.859+0000 7feace743640 1 -- 172.21.15.170:0/4152977272 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac819cfe0 con 0x7feac8102060 2024-01-25T15:03:33.864 INFO:tasks.workunit.client.0.smithi170.stdout:8/121: mkdir d3/d7/d22 0 2024-01-25T15:03:33.864 INFO:tasks.workunit.client.0.smithi170.stdout:9/137: rename d5/df/d12/d1b to d5/df/d2e 0 2024-01-25T15:03:33.864 INFO:tasks.workunit.client.0.smithi170.stdout:9/138: chown d5/f14 0 1 2024-01-25T15:03:33.864 INFO:tasks.workunit.client.0.smithi170.stdout:5/135: dread d5/f15 [0,4194304] 0 2024-01-25T15:03:33.864 INFO:tasks.workunit.client.0.smithi170.stdout:5/136: write d5/f11 [925893,59339] 0 2024-01-25T15:03:33.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.862+0000 7feac57fa640 1 -- 172.21.15.170:0/4152977272 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7feabc008c90 con 0x7feac8102060 2024-01-25T15:03:33.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.862+0000 7feac57fa640 1 --2- 172.21.15.170:0/4152977272 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feab00a12e0 0x7feab00a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.862+0000 7feac57fa640 1 -- 172.21.15.170:0/4152977272 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7feabc0d4f50 con 0x7feac8102060 2024-01-25T15:03:33.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.862+0000 7feac7fff640 1 --2- 172.21.15.170:0/4152977272 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feab00a12e0 0x7feab00a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.863+0000 7fead13e4740 1 Processor -- start 2024-01-25T15:03:33.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.863+0000 7fead13e4740 1 -- start start 2024-01-25T15:03:33.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.863+0000 7fead13e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c004269f40 0x55c00426a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.863+0000 7fead13e4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00426f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.863+0000 7feac7fff640 1 --2- 172.21.15.170:0/4152977272 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feab00a12e0 0x7feab00a37a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feab8005d00 tx=0x7feab8005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.863+0000 7feac7fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c004269f40 0x55c00426a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.863+0000 7feac7fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c004269f40 0x55c00426a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:38118/0 (socket says 172.21.15.170:38118) 2024-01-25T15:03:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.864+0000 7feac77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00426f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.864+0000 7feac7fff640 1 -- 172.21.15.170:0/3852292222 learned_addr learned my addr 172.21.15.170:0/3852292222 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.864+0000 7fead13e4740 1 --2- 172.21.15.170:0/3852292222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c00426faa0 0x55c004271f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.864+0000 7fead13e4740 1 -- 172.21.15.170:0/3852292222 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0041d8270 con 0x55c00426a930 2024-01-25T15:03:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.864+0000 7fead13e4740 1 -- 172.21.15.170:0/3852292222 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0041d5960 con 0x55c004269f40 2024-01-25T15:03:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.864+0000 7fead13e4740 1 -- 172.21.15.170:0/3852292222 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0041d1250 con 0x55c00426faa0 2024-01-25T15:03:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.864+0000 7feac77fe640 1 -- 172.21.15.170:0/3852292222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c00426faa0 msgr2=0x55c004271f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.864+0000 7feac77fe640 1 --2- 172.21.15.170:0/3852292222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c00426faa0 0x55c004271f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.864+0000 7feac77fe640 1 -- 172.21.15.170:0/3852292222 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c004269f40 msgr2=0x55c00426a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.864+0000 7feac77fe640 1 --2- 172.21.15.170:0/3852292222 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c004269f40 0x55c00426a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.868 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.864+0000 7feac77fe640 1 -- 172.21.15.170:0/3852292222 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0041937f0 con 0x55c00426a930 2024-01-25T15:03:33.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.864+0000 7feac77fe640 1 --2- 172.21.15.170:0/3852292222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00426f430 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7feabc00bf50 tx=0x7feabc00d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658d4e70a9fdee6e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:33.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.864+0000 7feaae7fc640 1 -- 172.21.15.170:0/3852292222 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc0a20c0 con 0x55c00426a930 2024-01-25T15:03:33.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.864+0000 7feaae7fc640 1 -- 172.21.15.170:0/3852292222 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feabc0a6210 con 0x55c00426a930 2024-01-25T15:03:33.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.864+0000 7feaae7fc640 1 -- 172.21.15.170:0/3852292222 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc0aa1c0 con 0x55c00426a930 2024-01-25T15:03:33.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.865+0000 7fead13e4740 1 -- 172.21.15.170:0/3852292222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 msgr2=0x55c00426f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.865+0000 7fead13e4740 1 --2- 172.21.15.170:0/3852292222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00426f430 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7feabc00bf50 tx=0x7feabc00d350 comp rx=0 tx=0).stop 2024-01-25T15:03:33.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.865+0000 7fead13e4740 1 -- 172.21.15.170:0/3852292222 shutdown_connections 2024-01-25T15:03:33.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.865+0000 7fead13e4740 1 --2- 172.21.15.170:0/3852292222 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c00426faa0 0x55c004271f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.865+0000 7fead13e4740 1 --2- 172.21.15.170:0/3852292222 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00426f430 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.865+0000 7fead13e4740 1 --2- 172.21.15.170:0/3852292222 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c004269f40 0x55c00426a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.865+0000 7fead13e4740 1 -- 172.21.15.170:0/3852292222 >> 172.21.15.170:0/3852292222 conn(0x55c0042654b0 msgr2=0x55c0042658b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:33.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.865+0000 7fead13e4740 1 -- 172.21.15.170:0/3852292222 shutdown_connections 2024-01-25T15:03:33.869 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.865+0000 7fead13e4740 1 -- 172.21.15.170:0/3852292222 wait complete. 2024-01-25T15:03:33.870 INFO:tasks.workunit.client.0.smithi170.stdout:1/193: unlink d0/la 0 2024-01-25T15:03:33.870 INFO:tasks.workunit.client.0.smithi170.stdout:1/194: stat d0/f5 0 2024-01-25T15:03:33.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.866+0000 7fead13e4740 1 -- start start 2024-01-25T15:03:33.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.866+0000 7fead13e4740 1 Processor -- start 2024-01-25T15:03:33.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.866+0000 7fead13e4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c004269f40 0x55c004274120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.871 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.866+0000 7fead13e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c00426a930 0x55c004274660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.866+0000 7fead13e4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426faa0 0x55c00427b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.866+0000 7fead13e4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00418a610 con 0x55c00426faa0 2024-01-25T15:03:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.866+0000 7fead13e4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00418a2b0 con 0x55c00426a930 2024-01-25T15:03:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.866+0000 7fead13e4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00414f400 con 0x55c004269f40 2024-01-25T15:03:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.867+0000 7fead13e4740 10 client.0 _ll_register_callbacks cb 0x55c0041c7ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.867+0000 7feaccce0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426faa0 0x55c00427b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.867+0000 7feaccce0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426faa0 0x55c00427b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54094/0 (socket says 172.21.15.170:54094) 2024-01-25T15:03:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.867+0000 7feaccce0640 1 -- 172.21.15.170:0/653894197 learned_addr learned my addr 172.21.15.170:0/653894197 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.867+0000 7feaccce0640 1 -- 172.21.15.170:0/653894197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c004269f40 msgr2=0x55c004274120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.867+0000 7feaccce0640 1 --2- 172.21.15.170:0/653894197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c004269f40 0x55c004274120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.867+0000 7feaccce0640 1 -- 172.21.15.170:0/653894197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c00426a930 msgr2=0x55c004274660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.867+0000 7feaccce0640 1 --2- 172.21.15.170:0/653894197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c00426a930 0x55c004274660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.872 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.867+0000 7feaccce0640 1 -- 172.21.15.170:0/653894197 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac819cfe0 con 0x55c00426faa0 2024-01-25T15:03:33.873 INFO:tasks.workunit.client.0.smithi170.stdout:7/199: mknod d8/d20/d2a/c4c 0 2024-01-25T15:03:33.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.867+0000 7feaccce0640 1 --2- 172.21.15.170:0/653894197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426faa0 0x55c00427b6a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7feac002c700 tx=0x7feac0005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7dbca6a7e364cc server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:33.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.867+0000 7feaa77fe640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:33.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.868+0000 7feaa77fe640 1 -- 172.21.15.170:0/653894197 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0032790 con 0x55c00426faa0 2024-01-25T15:03:33.874 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.868+0000 7feaa77fe640 1 -- 172.21.15.170:0/653894197 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7feac00328f0 con 0x55c00426faa0 2024-01-25T15:03:33.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.868+0000 7fead13e4740 1 -- 172.21.15.170:0/653894197 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0041ca0e0 con 0x55c00426faa0 2024-01-25T15:03:33.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.868+0000 7feaa77fe640 1 -- 172.21.15.170:0/653894197 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7feac0032ad0 con 0x55c00426faa0 2024-01-25T15:03:33.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.868+0000 7fead13e4740 10 client.15942 fetch_fsmap learned FSMap version 29 2024-01-25T15:03:33.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.868+0000 7fead13e4740 1 -- 172.21.15.170:0/653894197 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c0041cf8d0 con 0x55c00426faa0 2024-01-25T15:03:33.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.868+0000 7feaa77fe640 1 -- 172.21.15.170:0/653894197 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c0041ca0e0 con 0x55c00426faa0 2024-01-25T15:03:33.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.868+0000 7feaa77fe640 1 -- 172.21.15.170:0/653894197 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 29) v1 ==== 7914+0+0 (secure 0 0 0) 0x7feac0004140 con 0x55c00426faa0 2024-01-25T15:03:33.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.868+0000 7fead13e4740 10 client.15942 fetch_fsmap finished waiting for FSMap version 29 2024-01-25T15:03:33.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.868+0000 7fead13e4740 10 client.15942 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-01-25T15:03:33.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.868+0000 7fead13e4740 20 client.15942 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:33.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.868+0000 7fead13e4740 1 --2- 172.21.15.170:0/653894197 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55c004280080 0x55c0042824a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.869+0000 7fead13e4740 4 client.15942 mds_command: new command op to 24398 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:33.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.869+0000 7fead13e4740 1 -- 172.21.15.170:0/653894197 --> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0041c9e00 con 0x55c004280080 2024-01-25T15:03:33.875 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.869+0000 7feac7fff640 1 --2- 172.21.15.170:0/653894197 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55c004280080 0x55c0042824a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.876 INFO:tasks.workunit.client.0.smithi170.stdout:9/139: link d5/d1e/d21/c25 d5/d1e/c2f 0 2024-01-25T15:03:33.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.870+0000 7feaa77fe640 10 client.15942 ms_handle_connect on v2:172.21.15.186:6832/1347511259 2024-01-25T15:03:33.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.870+0000 7feac7fff640 1 --2- 172.21.15.170:0/653894197 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55c004280080 0x55c0042824a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dfcc09e79a100b1d server_cookie=57007db8667b20ac in_seq=0 out_seq=0 2024-01-25T15:03:33.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.871+0000 7feaa77fe640 1 -- 172.21.15.170:0/653894197 <== mds.4 v2:172.21.15.186:6832/1347511259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c0041c9e00 con 0x55c004280080 2024-01-25T15:03:33.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.871+0000 7feaa77fe640 10 client.15942 handle_command_reply: tid=0 2024-01-25T15:03:33.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.872+0000 7fead13e4740 1 client.15942 shutdown 2024-01-25T15:03:33.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.872+0000 7fead13e4740 1 -- 172.21.15.170:0/653894197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426faa0 msgr2=0x55c00427b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.872+0000 7fead13e4740 1 --2- 172.21.15.170:0/653894197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426faa0 0x55c00427b6a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7feac002c700 tx=0x7feac0005ef0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.872+0000 7fead13e4740 1 -- 172.21.15.170:0/653894197 shutdown_connections 2024-01-25T15:03:33.877 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.872+0000 7fead13e4740 1 --2- 172.21.15.170:0/653894197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c00426a930 0x55c004274660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.872+0000 7fead13e4740 1 --2- 172.21.15.170:0/653894197 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55c004280080 0x55c0042824a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.872+0000 7fead13e4740 1 --2- 172.21.15.170:0/653894197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426faa0 0x55c00427b6a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.872+0000 7fead13e4740 1 --2- 172.21.15.170:0/653894197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c004269f40 0x55c004274120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.872+0000 7fead13e4740 1 -- 172.21.15.170:0/653894197 >> 172.21.15.170:0/653894197 conn(0x55c0042654b0 msgr2=0x55c0042647f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:33.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.872+0000 7feaa77fe640 0 client.15942 ms_handle_reset on v2:172.21.15.186:6832/1347511259 2024-01-25T15:03:33.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.872+0000 7fead13e4740 1 -- 172.21.15.170:0/653894197 shutdown_connections 2024-01-25T15:03:33.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.872+0000 7fead13e4740 1 -- 172.21.15.170:0/653894197 wait complete. 2024-01-25T15:03:33.878 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.872+0000 7fead13e4740 20 client.15942 trim_cache size 0 max 16384 2024-01-25T15:03:33.879 INFO:tasks.workunit.client.0.smithi170.stdout:7/200: mkdir d8/d20/d3b/d4d 0 2024-01-25T15:03:33.879 INFO:tasks.workunit.client.0.smithi170.stdout:4/135: dread d6/fd [0,4194304] 0 2024-01-25T15:03:33.879 INFO:tasks.workunit.client.0.smithi170.stdout:7/201: truncate d8/f24 214854 0 2024-01-25T15:03:33.879 INFO:tasks.workunit.client.0.smithi170.stdout:7/202: chown d8/c1a 961 1 2024-01-25T15:03:33.879 INFO:tasks.workunit.client.0.smithi170.stdout:9/140: link d5/df/d12/f22 d5/dc/f30 0 2024-01-25T15:03:33.879 INFO:tasks.workunit.client.0.smithi170.stdout:2/226: dwrite ff [0,4194304] 0 2024-01-25T15:03:33.879 INFO:tasks.workunit.client.0.smithi170.stdout:9/141: rmdir d5/d1e/d21/d27/d2d 0 2024-01-25T15:03:33.879 INFO:tasks.workunit.client.0.smithi170.stdout:9/142: creat d5/df/d12/d18/f31 x:0 0 0 2024-01-25T15:03:33.879 INFO:tasks.workunit.client.0.smithi170.stdout:9/143: truncate d5/df/d12/f22 4871369 0 2024-01-25T15:03:33.881 INFO:tasks.workunit.client.0.smithi170.stdout:2/227: link ce d10/d1e/d32/d3e/c4f 0 2024-01-25T15:03:33.881 INFO:tasks.workunit.client.0.smithi170.stdout:2/228: write d10/f18 [5119992,113963] 0 2024-01-25T15:03:33.885 INFO:tasks.workunit.client.0.smithi170.stdout:2/229: mknod d10/d16/d42/c50 0 2024-01-25T15:03:33.886 INFO:tasks.workunit.client.0.smithi170.stdout:3/154: write d3/d10/f14 [46421,51588] 0 2024-01-25T15:03:33.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.886+0000 7fead13e4740 1 Processor -- start 2024-01-25T15:03:33.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.886+0000 7fead13e4740 1 -- start start 2024-01-25T15:03:33.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.886+0000 7fead13e4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c004269f40 0x55c00426be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.886+0000 7fead13e4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00426c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.886+0000 7fead13e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c00426faa0 0x55c00427b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.886+0000 7fead13e4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0042720c0 con 0x55c00426a930 2024-01-25T15:03:33.888 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.886+0000 7fead13e4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00426ba40 con 0x55c00426faa0 2024-01-25T15:03:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.886+0000 7fead13e4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c004265cf0 con 0x55c004269f40 2024-01-25T15:03:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.886+0000 7feac77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00426c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.887+0000 7feac77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00426c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54104/0 (socket says 172.21.15.170:54104) 2024-01-25T15:03:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.887+0000 7feac77fe640 1 -- 172.21.15.170:0/1782420623 learned_addr learned my addr 172.21.15.170:0/1782420623 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.887+0000 7feaccce0640 1 --2- 172.21.15.170:0/1782420623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c00426faa0 0x55c00427b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.887+0000 7feac77fe640 1 -- 172.21.15.170:0/1782420623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c004269f40 msgr2=0x55c00426be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.887+0000 7feac77fe640 1 --2- 172.21.15.170:0/1782420623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c004269f40 0x55c00426be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.887+0000 7feac77fe640 1 -- 172.21.15.170:0/1782420623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c00426faa0 msgr2=0x55c00427b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.887+0000 7feac77fe640 1 --2- 172.21.15.170:0/1782420623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c00426faa0 0x55c00427b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.887+0000 7feac77fe640 1 -- 172.21.15.170:0/1782420623 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c00416c500 con 0x55c00426a930 2024-01-25T15:03:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.887+0000 7feac77fe640 1 --2- 172.21.15.170:0/1782420623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00426c3c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7feabc09eb30 tx=0x7feabc01e500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac21912eef01c257 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.887+0000 7feaadffb640 1 -- 172.21.15.170:0/1782420623 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc0a20c0 con 0x55c00426a930 2024-01-25T15:03:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.887+0000 7feaadffb640 1 -- 172.21.15.170:0/1782420623 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feabc0aa450 con 0x55c00426a930 2024-01-25T15:03:33.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.887+0000 7feaadffb640 1 -- 172.21.15.170:0/1782420623 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc0aa220 con 0x55c00426a930 2024-01-25T15:03:33.890 INFO:tasks.workunit.client.0.smithi170.stdout:6/154: dwrite d2/f17 [4194304,4194304] 0 2024-01-25T15:03:33.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.888+0000 7fead13e4740 1 -- 172.21.15.170:0/1782420623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 msgr2=0x55c00426c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.888+0000 7fead13e4740 1 --2- 172.21.15.170:0/1782420623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00426c3c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7feabc09eb30 tx=0x7feabc01e500 comp rx=0 tx=0).stop 2024-01-25T15:03:33.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.888+0000 7fead13e4740 1 -- 172.21.15.170:0/1782420623 shutdown_connections 2024-01-25T15:03:33.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.888+0000 7fead13e4740 1 --2- 172.21.15.170:0/1782420623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c00426faa0 0x55c00427b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.888+0000 7fead13e4740 1 --2- 172.21.15.170:0/1782420623 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00426c3c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.888+0000 7fead13e4740 1 --2- 172.21.15.170:0/1782420623 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c004269f40 0x55c00426be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.888+0000 7fead13e4740 1 -- 172.21.15.170:0/1782420623 >> 172.21.15.170:0/1782420623 conn(0x55c0042654b0 msgr2=0x55c0042606f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:33.891 INFO:tasks.workunit.client.0.smithi170.stdout:3/155: link d3/d10/d13/f19 d3/d1c/d2d/f35 0 2024-01-25T15:03:33.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.888+0000 7fead13e4740 1 -- 172.21.15.170:0/1782420623 shutdown_connections 2024-01-25T15:03:33.894 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.888+0000 7fead13e4740 1 -- 172.21.15.170:0/1782420623 wait complete. 2024-01-25T15:03:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.888+0000 7fead13e4740 1 -- start start 2024-01-25T15:03:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7fead13e4740 1 Processor -- start 2024-01-25T15:03:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7fead13e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c004269f40 0x55c00427b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7fead13e4740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00427b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7fead13e4740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c00426faa0 0x55c0042796d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7fead13e4740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c004279dd0 con 0x55c00426a930 2024-01-25T15:03:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7fead13e4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c004279f40 con 0x55c004269f40 2024-01-25T15:03:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7fead13e4740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00427a100 con 0x55c00426faa0 2024-01-25T15:03:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7fead13e4740 10 client.0 _ll_register_callbacks cb 0x7feabc01e430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7feac77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00427b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7feac77fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00427b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54114/0 (socket says 172.21.15.170:54114) 2024-01-25T15:03:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7feac77fe640 1 -- 172.21.15.170:0/3329699901 learned_addr learned my addr 172.21.15.170:0/3329699901 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7feaccce0640 1 --2- 172.21.15.170:0/3329699901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c00426faa0 0x55c0042796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.895 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7feac7fff640 1 --2- 172.21.15.170:0/3329699901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c004269f40 0x55c00427b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7feac77fe640 1 -- 172.21.15.170:0/3329699901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c00426faa0 msgr2=0x55c0042796d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7feac77fe640 1 --2- 172.21.15.170:0/3329699901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c00426faa0 0x55c0042796d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7feac77fe640 1 -- 172.21.15.170:0/3329699901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c004269f40 msgr2=0x55c00427b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.889+0000 7feac77fe640 1 --2- 172.21.15.170:0/3329699901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c004269f40 0x55c00427b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.890+0000 7feac77fe640 1 -- 172.21.15.170:0/3329699901 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c0041937f0 con 0x55c00426a930 2024-01-25T15:03:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.890+0000 7feac7fff640 1 --2- 172.21.15.170:0/3329699901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c004269f40 0x55c00427b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:03:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.890+0000 7feac77fe640 1 --2- 172.21.15.170:0/3329699901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00427b600 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7feabc0a1dc0 tx=0x7feabc01e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c16d5f12e3fcf5 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.890+0000 7feaa77fe640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.890+0000 7feaa77fe640 1 -- 172.21.15.170:0/3329699901 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc008860 con 0x55c00426a930 2024-01-25T15:03:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.890+0000 7feaa77fe640 1 -- 172.21.15.170:0/3329699901 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7feabc0a20c0 con 0x55c00426a930 2024-01-25T15:03:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.890+0000 7fead13e4740 1 -- 172.21.15.170:0/3329699901 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feabc0a6210 con 0x55c00426a930 2024-01-25T15:03:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.890+0000 7feaa77fe640 1 -- 172.21.15.170:0/3329699901 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7feabc0089c0 con 0x55c00426a930 2024-01-25T15:03:33.896 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.890+0000 7fead13e4740 10 client.15948 fetch_fsmap learned FSMap version 29 2024-01-25T15:03:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.890+0000 7fead13e4740 1 -- 172.21.15.170:0/3329699901 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55c004192050 con 0x55c00426a930 2024-01-25T15:03:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.890+0000 7feaa77fe640 1 -- 172.21.15.170:0/3329699901 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feabc0a6210 con 0x55c00426a930 2024-01-25T15:03:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.891+0000 7feaa77fe640 1 -- 172.21.15.170:0/3329699901 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 29) v1 ==== 7914+0+0 (secure 0 0 0) 0x7feabc0a6f50 con 0x55c00426a930 2024-01-25T15:03:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.891+0000 7fead13e4740 10 client.15948 fetch_fsmap finished waiting for FSMap version 29 2024-01-25T15:03:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.891+0000 7fead13e4740 10 client.15948 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-01-25T15:03:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.891+0000 7fead13e4740 20 client.15948 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.891+0000 7fead13e4740 1 --2- 172.21.15.170:0/3329699901 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55c0042d7540 0x55c0042d9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.891+0000 7fead13e4740 4 client.15948 mds_command: new command op to 24398 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:03:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.891+0000 7fead13e4740 1 -- 172.21.15.170:0/3329699901 --> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c003ed07e0 con 0x55c0042d7540 2024-01-25T15:03:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.892+0000 7feac7fff640 1 --2- 172.21.15.170:0/3329699901 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55c0042d7540 0x55c0042d9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.892+0000 7feaa77fe640 10 client.15948 ms_handle_connect on v2:172.21.15.186:6832/1347511259 2024-01-25T15:03:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.892+0000 7feac7fff640 1 --2- 172.21.15.170:0/3329699901 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55c0042d7540 0x55c0042d9930 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ac24d13e99ba3555 server_cookie=65f2978f9bafeecc in_seq=0 out_seq=0 2024-01-25T15:03:33.897 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.892+0000 7feaa77fe640 1 -- 172.21.15.170:0/3329699901 <== mds.4 v2:172.21.15.186:6832/1347511259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c003ed07e0 con 0x55c0042d7540 2024-01-25T15:03:33.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.892+0000 7feaa77fe640 10 client.15948 handle_command_reply: tid=0 2024-01-25T15:03:33.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.892+0000 7fead13e4740 1 client.15948 shutdown 2024-01-25T15:03:33.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.892+0000 7fead13e4740 1 -- 172.21.15.170:0/3329699901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 msgr2=0x55c00427b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.892+0000 7fead13e4740 1 --2- 172.21.15.170:0/3329699901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00427b600 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7feabc0a1dc0 tx=0x7feabc01e6e0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.898 INFO:tasks.workunit.client.0.smithi170.stdout:7/203: write d8/f1c [4036503,98451] 0 2024-01-25T15:03:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7fead13e4740 1 -- 172.21.15.170:0/3329699901 shutdown_connections 2024-01-25T15:03:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7fead13e4740 1 --2- 172.21.15.170:0/3329699901 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x55c0042d7540 0x55c0042d9930 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7fead13e4740 1 --2- 172.21.15.170:0/3329699901 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55c00426faa0 0x55c0042796d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7fead13e4740 1 --2- 172.21.15.170:0/3329699901 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55c00426a930 0x55c00427b600 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7feaa77fe640 0 client.15948 ms_handle_reset on v2:172.21.15.186:6832/1347511259 2024-01-25T15:03:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7fead13e4740 1 --2- 172.21.15.170:0/3329699901 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55c004269f40 0x55c00427b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7fead13e4740 1 -- 172.21.15.170:0/3329699901 >> 172.21.15.170:0/3329699901 conn(0x55c0042654b0 msgr2=0x55c00426be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7fead13e4740 1 -- 172.21.15.170:0/3329699901 shutdown_connections 2024-01-25T15:03:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7fead13e4740 1 -- 172.21.15.170:0/3329699901 wait complete. 2024-01-25T15:03:33.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7fead13e4740 20 client.15948 trim_cache size 0 max 16384 2024-01-25T15:03:33.899 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:03:33.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7feace743640 1 -- 172.21.15.170:0/4152977272 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feab00a12e0 msgr2=0x7feab00a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7feace743640 1 --2- 172.21.15.170:0/4152977272 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feab00a12e0 0x7feab00a37a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feab8005d00 tx=0x7feab8005c50 comp rx=0 tx=0).stop 2024-01-25T15:03:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7feace743640 1 -- 172.21.15.170:0/4152977272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feac8102060 msgr2=0x7feac8194f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7feace743640 1 --2- 172.21.15.170:0/4152977272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feac8102060 0x7feac8194f60 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7feabc00b590 tx=0x7feabc00ba50 comp rx=0 tx=0).stop 2024-01-25T15:03:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7feace743640 1 -- 172.21.15.170:0/4152977272 shutdown_connections 2024-01-25T15:03:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7feace743640 1 --2- 172.21.15.170:0/4152977272 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7feab00a12e0 0x7feab00a37a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7feace743640 1 --2- 172.21.15.170:0/4152977272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feac8102a20 0x7feac819bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7feace743640 1 --2- 172.21.15.170:0/4152977272 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7feac8102060 0x7feac8194f60 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7feace743640 1 --2- 172.21.15.170:0/4152977272 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7feac80feff0 0x7feac8194a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7feace743640 1 -- 172.21.15.170:0/4152977272 >> 172.21.15.170:0/4152977272 conn(0x7feac80fa900 msgr2=0x7feac8105360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7feace743640 1 -- 172.21.15.170:0/4152977272 shutdown_connections 2024-01-25T15:03:33.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:33.893+0000 7feace743640 1 -- 172.21.15.170:0/4152977272 wait complete. 2024-01-25T15:03:33.902 INFO:tasks.workunit.client.0.smithi170.stdout:3/156: creat d3/d10/d13/f36 x:0 0 0 2024-01-25T15:03:33.902 INFO:tasks.workunit.client.0.smithi170.stdout:6/155: getdents d2/d7/d23 0 2024-01-25T15:03:33.902 INFO:tasks.workunit.client.0.smithi170.stdout:9/144: fsync d5/df/d12/f22 0 2024-01-25T15:03:33.902 INFO:tasks.workunit.client.0.smithi170.stdout:6/156: write d2/d7/d23/d19/f20 [230732,118931] 0 2024-01-25T15:03:33.902 INFO:tasks.workunit.client.0.smithi170.stdout:9/145: mknod d5/d1e/c32 0 2024-01-25T15:03:33.902 INFO:tasks.workunit.client.0.smithi170.stdout:9/146: fdatasync d5/df/f1a 0 2024-01-25T15:03:33.902 INFO:tasks.workunit.client.0.smithi170.stdout:9/147: chown d5/dc/fd 74126779 1 2024-01-25T15:03:33.903 INFO:tasks.workunit.client.0.smithi170.stdout:6/157: unlink d2/d7/d23/le 0 2024-01-25T15:03:33.904 INFO:tasks.workunit.client.0.smithi170.stdout:1/195: dwrite d0/f12 [0,4194304] 0 2024-01-25T15:03:33.907 INFO:tasks.workunit.client.0.smithi170.stdout:7/204: rename d8/f24 to d8/f4e 0 2024-01-25T15:03:33.907 INFO:tasks.workunit.client.0.smithi170.stdout:4/136: dwrite d6/f26 [0,4194304] 0 2024-01-25T15:03:33.908 INFO:tasks.workunit.client.0.smithi170.stdout:7/205: mknod d8/d20/c4f 0 2024-01-25T15:03:33.909 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-01-25T15:03:33.910 INFO:tasks.workunit.client.0.smithi170.stdout:2/230: truncate d10/f18 4496857 0 2024-01-25T15:03:33.915 INFO:tasks.workunit.client.0.smithi170.stdout:3/157: write d3/d10/d13/f1d [3162686,22260] 0 2024-01-25T15:03:33.915 INFO:tasks.workunit.client.0.smithi170.stdout:3/158: creat d3/d10/d13/f37 x:0 0 0 2024-01-25T15:03:33.915 INFO:tasks.workunit.client.0.smithi170.stdout:3/159: write d3/d10/ff [3630074,18998] 0 2024-01-25T15:03:33.918 INFO:tasks.workunit.client.0.smithi170.stdout:3/160: mkdir d3/d10/d13/d1b/d29/d38 0 2024-01-25T15:03:33.919 INFO:tasks.workunit.client.0.smithi170.stdout:7/206: dread d8/d20/d2a/f34 [0,4194304] 0 2024-01-25T15:03:33.921 INFO:tasks.workunit.client.0.smithi170.stdout:3/161: symlink d3/d10/d1e/l39 0 2024-01-25T15:03:33.923 INFO:tasks.workunit.client.0.smithi170.stdout:7/207: creat d8/d20/d3b/f50 x:0 0 0 2024-01-25T15:03:33.926 INFO:tasks.workunit.client.0.smithi170.stdout:3/162: mknod d3/d1c/d2b/c3a 0 2024-01-25T15:03:33.926 INFO:tasks.workunit.client.0.smithi170.stdout:7/208: stat d8/c10 0 2024-01-25T15:03:33.928 INFO:tasks.workunit.client.0.smithi170.stdout:7/209: mknod d8/d20/d2a/d35/c51 0 2024-01-25T15:03:33.929 INFO:tasks.workunit.client.0.smithi170.stdout:7/210: rmdir d8/d20/d2a 39 2024-01-25T15:03:33.930 INFO:tasks.workunit.client.0.smithi170.stdout:7/211: creat d8/f52 x:0 0 0 2024-01-25T15:03:33.932 INFO:tasks.workunit.client.0.smithi170.stdout:7/212: rename d8/c23 to d8/d20/d2a/d35/c53 0 2024-01-25T15:03:33.935 INFO:tasks.workunit.client.0.smithi170.stdout:7/213: mknod d8/d20/d2a/d35/c54 0 2024-01-25T15:03:33.943 INFO:tasks.workunit.client.0.smithi170.stdout:9/148: dwrite f2 [0,4194304] 0 2024-01-25T15:03:33.943 INFO:tasks.workunit.client.0.smithi170.stdout:9/149: readlink d5/lb 0 2024-01-25T15:03:33.944 INFO:tasks.workunit.client.0.smithi170.stdout:9/150: symlink d5/d1e/l33 0 2024-01-25T15:03:33.945 INFO:tasks.workunit.client.0.smithi170.stdout:6/158: dwrite d2/d7/f2e [0,4194304] 0 2024-01-25T15:03:33.946 INFO:tasks.workunit.client.0.smithi170.stdout:6/159: mkdir d2/d7/d23/d19/d2f/d37 0 2024-01-25T15:03:33.946 INFO:tasks.workunit.client.0.smithi170.stdout:9/151: dread d5/dc/fe [0,4194304] 0 2024-01-25T15:03:33.946 INFO:tasks.workunit.client.0.smithi170.stdout:6/160: chown d2/c33 26968164 1 2024-01-25T15:03:33.946 INFO:tasks.workunit.client.0.smithi170.stdout:6/161: getdents d2/d7/d23/d19/d2a 0 2024-01-25T15:03:33.946 INFO:tasks.workunit.client.0.smithi170.stdout:6/162: chown d2/f17 48 1 2024-01-25T15:03:33.948 INFO:tasks.workunit.client.0.smithi170.stdout:6/163: link d2/d7/l15 d2/d7/d23/d19/d2a/l38 0 2024-01-25T15:03:33.951 INFO:tasks.workunit.client.0.smithi170.stdout:1/196: dwrite d0/f2f [0,4194304] 0 2024-01-25T15:03:33.952 INFO:tasks.workunit.client.0.smithi170.stdout:4/137: dwrite d6/d7/f1a [0,4194304] 0 2024-01-25T15:03:33.952 INFO:tasks.workunit.client.0.smithi170.stdout:2/231: dwrite d10/d16/f3b [0,4194304] 0 2024-01-25T15:03:33.956 INFO:tasks.workunit.client.0.smithi170.stdout:3/163: dwrite d3/d10/f1a [0,4194304] 0 2024-01-25T15:03:33.959 INFO:tasks.workunit.client.0.smithi170.stdout:4/138: rename d6/l16 to d6/d7/l27 0 2024-01-25T15:03:33.959 INFO:tasks.workunit.client.0.smithi170.stdout:9/152: write d5/dc/fd [3109690,35175] 0 2024-01-25T15:03:33.962 INFO:tasks.workunit.client.0.smithi170.stdout:3/164: truncate d3/d10/d13/f1f 3226223 0 2024-01-25T15:03:33.962 INFO:tasks.workunit.client.0.smithi170.stdout:3/165: dread - d3/d10/d13/f34 zero size 2024-01-25T15:03:33.962 INFO:tasks.workunit.client.0.smithi170.stdout:3/166: write d3/d10/d13/f1d [2858411,122536] 0 2024-01-25T15:03:33.963 INFO:tasks.workunit.client.0.smithi170.stdout:4/139: mkdir d6/d28 0 2024-01-25T15:03:33.963 INFO:tasks.workunit.client.0.smithi170.stdout:4/140: stat d6/c21 0 2024-01-25T15:03:33.964 INFO:tasks.workunit.client.0.smithi170.stdout:2/232: dread d10/f13 [0,4194304] 0 2024-01-25T15:03:33.964 INFO:tasks.workunit.client.0.smithi170.stdout:2/233: fsync d10/d16/d42/f48 0 2024-01-25T15:03:33.964 INFO:tasks.workunit.client.0.smithi170.stdout:2/234: write d10/d16/d42/f48 [603670,57333] 0 2024-01-25T15:03:33.964 INFO:tasks.workunit.client.0.smithi170.stdout:2/235: fsync d10/d1e/f26 0 2024-01-25T15:03:33.964 INFO:tasks.workunit.client.0.smithi170.stdout:2/236: chown d10/d16/f3b 5 1 2024-01-25T15:03:33.965 INFO:tasks.workunit.client.0.smithi170.stdout:9/153: mkdir d5/d1e/d21/d34 0 2024-01-25T15:03:33.965 INFO:tasks.workunit.client.0.smithi170.stdout:9/154: write d5/dc/fe [69074,59013] 0 2024-01-25T15:03:33.966 INFO:tasks.workunit.client.0.smithi170.stdout:4/141: link c5 d6/d7/d1b/c29 0 2024-01-25T15:03:33.967 INFO:tasks.workunit.client.0.smithi170.stdout:2/237: symlink d10/l51 0 2024-01-25T15:03:33.968 INFO:tasks.workunit.client.0.smithi170.stdout:9/155: mkdir d5/df/d16/d35 0 2024-01-25T15:03:33.968 INFO:tasks.workunit.client.0.smithi170.stdout:9/156: creat d5/dc/f36 x:0 0 0 2024-01-25T15:03:33.968 INFO:tasks.workunit.client.0.smithi170.stdout:3/167: write d3/f12 [434668,67446] 0 2024-01-25T15:03:33.969 INFO:tasks.workunit.client.0.smithi170.stdout:4/142: mknod d6/d7/d1b/c2a 0 2024-01-25T15:03:33.969 INFO:tasks.workunit.client.0.smithi170.stdout:7/214: dwrite d8/d20/d45/f46 [0,4194304] 0 2024-01-25T15:03:33.969 INFO:tasks.workunit.client.0.smithi170.stdout:2/238: creat d10/f52 x:0 0 0 2024-01-25T15:03:33.971 INFO:tasks.workunit.client.0.smithi170.stdout:9/157: fdatasync d5/dc/fd 0 2024-01-25T15:03:33.974 INFO:tasks.workunit.client.0.smithi170.stdout:7/215: mkdir d8/d20/d2a/d35/d55 0 2024-01-25T15:03:33.976 INFO:tasks.workunit.client.0.smithi170.stdout:6/164: dwrite d2/d7/d23/d19/f29 [0,4194304] 0 2024-01-25T15:03:33.976 INFO:tasks.workunit.client.0.smithi170.stdout:3/168: mkdir d3/d3b 0 2024-01-25T15:03:33.976 INFO:tasks.workunit.client.0.smithi170.stdout:3/169: stat d3/d1c/d2d/f35 0 2024-01-25T15:03:33.977 INFO:tasks.workunit.client.0.smithi170.stdout:4/143: rmdir d6/d11 39 2024-01-25T15:03:33.978 INFO:tasks.workunit.client.0.smithi170.stdout:7/216: symlink d8/d20/l56 0 2024-01-25T15:03:33.982 INFO:tasks.workunit.client.0.smithi170.stdout:6/165: rename d2/c33 to d2/d7/d1b/d28/c39 0 2024-01-25T15:03:33.984 INFO:tasks.workunit.client.0.smithi170.stdout:3/170: unlink d3/d10/d13/f37 0 2024-01-25T15:03:33.984 INFO:tasks.workunit.client.0.smithi170.stdout:3/171: write d3/d10/d13/f1f [2599188,127042] 0 2024-01-25T15:03:33.984 INFO:tasks.workunit.client.0.smithi170.stdout:1/197: dwrite d0/d20/f2b [0,4194304] 0 2024-01-25T15:03:33.987 INFO:tasks.workunit.client.0.smithi170.stdout:6/166: mknod d2/d7/d23/d19/d2f/c3a 0 2024-01-25T15:03:33.987 INFO:tasks.workunit.client.0.smithi170.stdout:6/167: chown d2/d7/d23/c35 734345255 1 2024-01-25T15:03:33.990 INFO:tasks.workunit.client.0.smithi170.stdout:3/172: rename d3/d10/d13/f19 to d3/d1c/f3c 0 2024-01-25T15:03:33.993 INFO:tasks.workunit.client.0.smithi170.stdout:4/144: dread d6/d7/f17 [0,4194304] 0 2024-01-25T15:03:33.994 INFO:tasks.workunit.client.0.smithi170.stdout:2/239: dwrite d10/d16/d42/f4a [0,4194304] 0 2024-01-25T15:03:33.996 INFO:tasks.workunit.client.0.smithi170.stdout:3/173: symlink d3/d10/d13/d1b/d29/d38/l3d 0 2024-01-25T15:03:33.998 INFO:tasks.workunit.client.0.smithi170.stdout:7/217: truncate d8/d20/d3b/f3c 1007556 0 2024-01-25T15:03:33.999 INFO:tasks.workunit.client.0.smithi170.stdout:4/145: symlink d6/d28/l2b 0 2024-01-25T15:03:34.001 INFO:tasks.workunit.client.0.smithi170.stdout:9/158: dwrite d5/df/d16/f2b [0,4194304] 0 2024-01-25T15:03:34.001 INFO:tasks.workunit.client.0.smithi170.stdout:2/240: dread d10/f37 [0,4194304] 0 2024-01-25T15:03:34.001 INFO:tasks.workunit.client.0.smithi170.stdout:9/159: write d5/df/f15 [1630951,123639] 0 2024-01-25T15:03:34.006 INFO:tasks.workunit.client.0.smithi170.stdout:6/168: dread f0 [0,4194304] 0 2024-01-25T15:03:34.007 INFO:tasks.workunit.client.0.smithi170.stdout:7/218: symlink d8/d20/d3b/d4d/l57 0 2024-01-25T15:03:34.009 INFO:tasks.workunit.client.0.smithi170.stdout:4/146: mknod d6/d28/c2c 0 2024-01-25T15:03:34.009 INFO:tasks.workunit.client.0.smithi170.stdout:4/147: write d6/d11/f25 [4792845,130802] 0 2024-01-25T15:03:34.009 INFO:tasks.workunit.client.0.smithi170.stdout:4/148: stat d6/d11/f25 0 2024-01-25T15:03:34.009 INFO:tasks.workunit.client.0.smithi170.stdout:4/149: stat d6/d7/d1b/f1e 0 2024-01-25T15:03:34.013 INFO:tasks.workunit.client.0.smithi170.stdout:1/198: dwrite d0/d20/f2b [0,4194304] 0 2024-01-25T15:03:34.013 INFO:tasks.workunit.client.0.smithi170.stdout:1/199: creat d0/d1b/f43 x:0 0 0 2024-01-25T15:03:34.014 INFO:tasks.workunit.client.0.smithi170.stdout:1/200: creat d0/d20/d3a/f44 x:0 0 0 2024-01-25T15:03:34.026 INFO:tasks.workunit.client.0.smithi170.stdout:4/150: write d6/d7/f17 [3597267,82139] 0 2024-01-25T15:03:34.028 INFO:tasks.workunit.client.0.smithi170.stdout:7/219: symlink d8/l58 0 2024-01-25T15:03:34.029 INFO:tasks.workunit.client.0.smithi170.stdout:7/220: chown d8/d20/d45/l48 4 1 2024-01-25T15:03:34.029 INFO:tasks.workunit.client.0.smithi170.stdout:7/221: stat d8/c1a 0 2024-01-25T15:03:34.029 INFO:tasks.workunit.client.0.smithi170.stdout:7/222: write d8/d20/d45/f4a [25002,3404] 0 2024-01-25T15:03:34.031 INFO:tasks.workunit.client.0.smithi170.stdout:4/151: rename d6/d11/f25 to d6/f2d 0 2024-01-25T15:03:34.032 INFO:tasks.workunit.client.0.smithi170.stdout:9/160: read f2 [3553029,15314] 0 2024-01-25T15:03:34.033 INFO:tasks.workunit.client.0.smithi170.stdout:1/201: write d0/fb [1401474,129444] 0 2024-01-25T15:03:34.034 INFO:tasks.workunit.client.0.smithi170.stdout:1/202: readlink d0/d20/l3e 0 2024-01-25T15:03:34.034 INFO:tasks.workunit.client.0.smithi170.stdout:1/203: creat d0/d1b/f45 x:0 0 0 2024-01-25T15:03:34.034 INFO:tasks.workunit.client.0.smithi170.stdout:1/204: chown d0/d2e/l37 215 1 2024-01-25T15:03:34.035 INFO:tasks.workunit.client.0.smithi170.stdout:9/161: unlink d5/d1e/c32 0 2024-01-25T15:03:34.035 INFO:tasks.workunit.client.0.smithi170.stdout:9/162: write d5/dc/fe [334104,98272] 0 2024-01-25T15:03:34.035 INFO:tasks.workunit.client.0.smithi170.stdout:3/174: dwrite d3/d10/fe [0,4194304] 0 2024-01-25T15:03:34.035 INFO:tasks.workunit.client.0.smithi170.stdout:3/175: write d3/d10/d13/f25 [1393471,74434] 0 2024-01-25T15:03:34.036 INFO:tasks.workunit.client.0.smithi170.stdout:3/176: write d3/d10/d13/f36 [675134,79525] 0 2024-01-25T15:03:34.038 INFO:tasks.workunit.client.0.smithi170.stdout:9/163: fdatasync d5/df/f15 0 2024-01-25T15:03:34.038 INFO:tasks.workunit.client.0.smithi170.stdout:6/169: dwrite d2/d7/f2e [0,4194304] 0 2024-01-25T15:03:34.038 INFO:tasks.workunit.client.0.smithi170.stdout:0/161: sync 2024-01-25T15:03:34.042 INFO:tasks.workunit.client.0.smithi170.stdout:6/170: rename d2/d7/d23/l14 to d2/d7/d23/l3b 0 2024-01-25T15:03:34.042 INFO:tasks.workunit.client.0.smithi170.stdout:6/171: getdents d2/d7/d23/d19/d2f/d37 0 2024-01-25T15:03:34.042 INFO:tasks.workunit.client.0.smithi170.stdout:6/172: write d2/d7/f1c [4925988,121276] 0 2024-01-25T15:03:34.042 INFO:tasks.workunit.client.0.smithi170.stdout:6/173: write d2/d7/f18 [2060470,84494] 0 2024-01-25T15:03:34.044 INFO:tasks.workunit.client.0.smithi170.stdout:2/241: dwrite d10/f13 [0,4194304] 0 2024-01-25T15:03:34.044 INFO:tasks.workunit.client.0.smithi170.stdout:2/242: creat d10/d1e/f53 x:0 0 0 2024-01-25T15:03:34.045 INFO:tasks.workunit.client.0.smithi170.stdout:4/152: dread d6/f2d [0,4194304] 0 2024-01-25T15:03:34.045 INFO:tasks.workunit.client.0.smithi170.stdout:0/162: rmdir d8/d10/d2d/d2f 39 2024-01-25T15:03:34.046 INFO:tasks.workunit.client.0.smithi170.stdout:6/174: mknod d2/c3c 0 2024-01-25T15:03:34.046 INFO:tasks.workunit.client.0.smithi170.stdout:3/177: write d3/d10/f14 [6411719,42318] 0 2024-01-25T15:03:34.049 INFO:tasks.workunit.client.0.smithi170.stdout:2/243: mkdir d10/d16/d54 0 2024-01-25T15:03:34.050 INFO:tasks.workunit.client.0.smithi170.stdout:4/153: getdents d6/d7 0 2024-01-25T15:03:34.052 INFO:tasks.workunit.client.0.smithi170.stdout:0/163: creat d8/d10/d2d/d2f/f37 x:0 0 0 2024-01-25T15:03:34.053 INFO:tasks.workunit.client.0.smithi170.stdout:6/175: symlink d2/d7/d23/d19/d2a/l3d 0 2024-01-25T15:03:34.054 INFO:tasks.workunit.client.0.smithi170.stdout:2/244: mknod d10/d1e/d32/d3e/c55 0 2024-01-25T15:03:34.055 INFO:tasks.workunit.client.0.smithi170.stdout:4/154: creat d6/d11/f2e x:0 0 0 2024-01-25T15:03:34.055 INFO:tasks.workunit.client.0.smithi170.stdout:4/155: write d6/d7/d1b/f1e [606349,104088] 0 2024-01-25T15:03:34.055 INFO:tasks.workunit.client.0.smithi170.stdout:4/156: chown d6/d11 119 1 2024-01-25T15:03:34.056 INFO:tasks.workunit.client.0.smithi170.stdout:0/164: creat d8/f38 x:0 0 0 2024-01-25T15:03:34.056 INFO:tasks.workunit.client.0.smithi170.stdout:0/165: write d8/d9/f16 [1238001,81472] 0 2024-01-25T15:03:34.056 INFO:tasks.workunit.client.0.smithi170.stdout:0/166: truncate d8/d10/d2d/d2f/f37 106833 0 2024-01-25T15:03:34.056 INFO:tasks.workunit.client.0.smithi170.stdout:0/167: fsync d8/d10/f15 0 2024-01-25T15:03:34.057 INFO:tasks.workunit.client.0.smithi170.stdout:0/168: stat d8/ff 0 2024-01-25T15:03:34.057 INFO:tasks.workunit.client.0.smithi170.stdout:3/178: mknod d3/c3e 0 2024-01-25T15:03:34.057 INFO:tasks.workunit.client.0.smithi170.stdout:3/179: write d3/d10/d1e/f20 [463076,89086] 0 2024-01-25T15:03:34.057 INFO:tasks.workunit.client.0.smithi170.stdout:2/245: link d10/d1e/d32/f4b d10/d1b/f56 0 2024-01-25T15:03:34.059 INFO:tasks.workunit.client.0.smithi170.stdout:0/169: mkdir d8/d18/d39 0 2024-01-25T15:03:34.060 INFO:tasks.workunit.client.0.smithi170.stdout:0/170: mkdir d8/d3a 0 2024-01-25T15:03:34.061 INFO:tasks.workunit.client.0.smithi170.stdout:0/171: creat d8/d18/f3b x:0 0 0 2024-01-25T15:03:34.061 INFO:tasks.workunit.client.0.smithi170.stdout:0/172: chown d8 21 1 2024-01-25T15:03:34.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.064+0000 7fe5d42c2640 1 -- 172.21.15.170:0/2852944091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5cc100e20 msgr2=0x7fe5cc1012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.064+0000 7fe5d42c2640 1 --2- 172.21.15.170:0/2852944091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5cc100e20 0x7fe5cc1012a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009900 tx=0x7fe5bc02bc30 comp rx=0 tx=0).stop 2024-01-25T15:03:34.065 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.064+0000 7fe5d42c2640 1 -- 172.21.15.170:0/2852944091 shutdown_connections 2024-01-25T15:03:34.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.064+0000 7fe5d42c2640 1 --2- 172.21.15.170:0/2852944091 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5cc1017e0 0x7fe5cc108070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.064+0000 7fe5d42c2640 1 --2- 172.21.15.170:0/2852944091 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5cc100e20 0x7fe5cc1012a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.064+0000 7fe5d42c2640 1 --2- 172.21.15.170:0/2852944091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5cc0ffc30 0x7fe5cc100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.064+0000 7fe5d42c2640 1 -- 172.21.15.170:0/2852944091 >> 172.21.15.170:0/2852944091 conn(0x7fe5cc0fb1a0 msgr2=0x7fe5cc0fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.064+0000 7fe5d42c2640 1 -- 172.21.15.170:0/2852944091 shutdown_connections 2024-01-25T15:03:34.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.064+0000 7fe5d42c2640 1 -- 172.21.15.170:0/2852944091 wait complete. 2024-01-25T15:03:34.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.065+0000 7fe5d42c2640 1 Processor -- start 2024-01-25T15:03:34.066 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.065+0000 7fe5d42c2640 1 -- start start 2024-01-25T15:03:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.065+0000 7fe5d42c2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5cc0ffc30 0x7fe5cc069b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.065+0000 7fe5d42c2640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5cc100e20 0x7fe5cc19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.065+0000 7fe5d42c2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5cc1017e0 0x7fe5cc19e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.065+0000 7fe5d42c2640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc19e8b0 con 0x7fe5cc1017e0 2024-01-25T15:03:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.065+0000 7fe5d42c2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc19ea20 con 0x7fe5cc0ffc30 2024-01-25T15:03:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.065+0000 7fe5d42c2640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5cc19ebe0 con 0x7fe5cc100e20 2024-01-25T15:03:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.065+0000 7fe5d285f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5cc1017e0 0x7fe5cc19e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.068 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.065+0000 7fe5d285f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5cc1017e0 0x7fe5cc19e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54134/0 (socket says 172.21.15.170:54134) 2024-01-25T15:03:34.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.065+0000 7fe5d285f640 1 -- 172.21.15.170:0/266441836 learned_addr learned my addr 172.21.15.170:0/266441836 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.066+0000 7fe5d205e640 1 --2- 172.21.15.170:0/266441836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5cc0ffc30 0x7fe5cc069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.066+0000 7fe5d285f640 1 -- 172.21.15.170:0/266441836 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5cc100e20 msgr2=0x7fe5cc19bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.066+0000 7fe5d285f640 1 --2- 172.21.15.170:0/266441836 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5cc100e20 0x7fe5cc19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.066+0000 7fe5d285f640 1 -- 172.21.15.170:0/266441836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5cc0ffc30 msgr2=0x7fe5cc069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.066+0000 7fe5d285f640 1 --2- 172.21.15.170:0/266441836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5cc0ffc30 0x7fe5cc069b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.066+0000 7fe5d285f640 1 -- 172.21.15.170:0/266441836 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5bc009560 con 0x7fe5cc1017e0 2024-01-25T15:03:34.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.066+0000 7fe5d285f640 1 --2- 172.21.15.170:0/266441836 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5cc1017e0 0x7fe5cc19e0d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400eb10 tx=0x7fe5c400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.066+0000 7fe5c37fe640 1 -- 172.21.15.170:0/266441836 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4004b20 con 0x7fe5cc1017e0 2024-01-25T15:03:34.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.066+0000 7fe5c37fe640 1 -- 172.21.15.170:0/266441836 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5c4004c80 con 0x7fe5cc1017e0 2024-01-25T15:03:34.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.066+0000 7fe5c37fe640 1 -- 172.21.15.170:0/266441836 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c4010690 con 0x7fe5cc1017e0 2024-01-25T15:03:34.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.066+0000 7fe5d42c2640 1 -- 172.21.15.170:0/266441836 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5cc19ee60 con 0x7fe5cc1017e0 2024-01-25T15:03:34.069 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.066+0000 7fe5d42c2640 1 -- 172.21.15.170:0/266441836 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5cc19f2f0 con 0x7fe5cc1017e0 2024-01-25T15:03:34.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.069+0000 7fe5c37fe640 1 -- 172.21.15.170:0/266441836 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fe5c4005020 con 0x7fe5cc1017e0 2024-01-25T15:03:34.070 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.070+0000 7fe5d6b22740 1 Processor -- start 2024-01-25T15:03:34.071 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.070+0000 7fe5d6b22740 1 -- start start 2024-01-25T15:03:34.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.070+0000 7fe5d6b22740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b0f40 0x55a38a2b1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.072 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.070+0000 7fe5d6b22740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2b1930 0x55a38a2b6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.070+0000 7fe5d6b22740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b6aa0 0x55a38a2b8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.070+0000 7fe5d6b22740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a38a21f270 con 0x55a38a2b0f40 2024-01-25T15:03:34.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.070+0000 7fe5d6b22740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a38a21c960 con 0x55a38a2b6aa0 2024-01-25T15:03:34.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.070+0000 7fe5d6b22740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a38a218250 con 0x55a38a2b1930 2024-01-25T15:03:34.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.070+0000 7fe5c37fe640 1 --2- 172.21.15.170:0/266441836 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe5b80a12e0 0x7fe5b80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.070+0000 7fe5d185d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b0f40 0x55a38a2b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.070+0000 7fe5d185d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b0f40 0x55a38a2b1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54140/0 (socket says 172.21.15.170:54140) 2024-01-25T15:03:34.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.070+0000 7fe5d185d640 1 -- 172.21.15.170:0/1474628685 learned_addr learned my addr 172.21.15.170:0/1474628685 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.071+0000 7fe5d285f640 1 --2- 172.21.15.170:0/266441836 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe5b80a12e0 0x7fe5b80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.073 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.071+0000 7fe5d185d640 1 -- 172.21.15.170:0/1474628685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2b1930 msgr2=0x55a38a2b6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.071+0000 7fe5d185d640 1 --2- 172.21.15.170:0/1474628685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2b1930 0x55a38a2b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.071+0000 7fe5c37fe640 1 -- 172.21.15.170:0/266441836 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fe5c4014070 con 0x7fe5cc1017e0 2024-01-25T15:03:34.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.071+0000 7fe5d185d640 1 -- 172.21.15.170:0/1474628685 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b6aa0 msgr2=0x55a38a2b8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.071+0000 7fe5d185d640 1 --2- 172.21.15.170:0/1474628685 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b6aa0 0x55a38a2b8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.071+0000 7fe5d185d640 1 -- 172.21.15.170:0/1474628685 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a38a1da7f0 con 0x55a38a2b0f40 2024-01-25T15:03:34.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.071+0000 7fe5d285f640 1 --2- 172.21.15.170:0/266441836 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe5b80a12e0 0x7fe5b80a37a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40049d0 tx=0x7fe5c40c47e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.071+0000 7fe5d185d640 1 --2- 172.21.15.170:0/1474628685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b0f40 0x55a38a2b1360 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc005ab0 tx=0x7fe5bc005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc772440b2230a1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.071+0000 7fe5c0bfe640 1 -- 172.21.15.170:0/1474628685 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc02ca80 con 0x55a38a2b0f40 2024-01-25T15:03:34.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.071+0000 7fe5c0bfe640 1 -- 172.21.15.170:0/1474628685 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5bc02cbe0 con 0x55a38a2b0f40 2024-01-25T15:03:34.074 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.071+0000 7fe5c0bfe640 1 -- 172.21.15.170:0/1474628685 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0052f0 con 0x55a38a2b0f40 2024-01-25T15:03:34.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.072+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1474628685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b0f40 msgr2=0x55a38a2b1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.072+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/1474628685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b0f40 0x55a38a2b1360 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc005ab0 tx=0x7fe5bc005de0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.072+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1474628685 shutdown_connections 2024-01-25T15:03:34.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.072+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/1474628685 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b6aa0 0x55a38a2b8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.072+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/1474628685 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2b1930 0x55a38a2b6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.072+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/1474628685 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b0f40 0x55a38a2b1360 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.072+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1474628685 >> 172.21.15.170:0/1474628685 conn(0x55a38a2ac4b0 msgr2=0x55a38a2ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.077 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.072+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1474628685 shutdown_connections 2024-01-25T15:03:34.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.072+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1474628685 wait complete. 2024-01-25T15:03:34.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d6b22740 1 -- start start 2024-01-25T15:03:34.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d6b22740 1 Processor -- start 2024-01-25T15:03:34.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d6b22740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b0f40 0x55a38a2bb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d6b22740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2b1930 0x55a38a2bb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d6b22740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b6aa0 0x55a38a2c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d6b22740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a38a1d1610 con 0x55a38a2b0f40 2024-01-25T15:03:34.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d6b22740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a38a1d12b0 con 0x55a38a2b6aa0 2024-01-25T15:03:34.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d6b22740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a38a196400 con 0x55a38a2b1930 2024-01-25T15:03:34.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d6b22740 10 client.0 _ll_register_callbacks cb 0x55a38a20eee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:34.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d185d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b0f40 0x55a38a2bb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d185d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b0f40 0x55a38a2bb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54150/0 (socket says 172.21.15.170:54150) 2024-01-25T15:03:34.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d185d640 1 -- 172.21.15.170:0/244450711 learned_addr learned my addr 172.21.15.170:0/244450711 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.078 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d205e640 1 --2- 172.21.15.170:0/244450711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2b1930 0x55a38a2bb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d185d640 1 --2- 172.21.15.170:0/244450711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b6aa0 0x55a38a2c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d185d640 1 -- 172.21.15.170:0/244450711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2b1930 msgr2=0x55a38a2bb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d185d640 1 --2- 172.21.15.170:0/244450711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2b1930 0x55a38a2bb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d185d640 1 -- 172.21.15.170:0/244450711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b6aa0 msgr2=0x55a38a2c26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d185d640 1 --2- 172.21.15.170:0/244450711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b6aa0 0x55a38a2c26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.073+0000 7fe5d185d640 1 -- 172.21.15.170:0/244450711 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5cc108970 con 0x55a38a2b0f40 2024-01-25T15:03:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.074+0000 7fe5d185d640 1 --2- 172.21.15.170:0/244450711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b0f40 0x55a38a2bb150 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc02c170 tx=0x7fe5bc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3e5482d34389950 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.074+0000 7fe5b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.074+0000 7fe5b5ffb640 1 -- 172.21.15.170:0/244450711 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc005600 con 0x55a38a2b0f40 2024-01-25T15:03:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.074+0000 7fe5b5ffb640 1 -- 172.21.15.170:0/244450711 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fe5bc034440 con 0x55a38a2b0f40 2024-01-25T15:03:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.074+0000 7fe5d6b22740 1 -- 172.21.15.170:0/244450711 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a38a2110e0 con 0x55a38a2b0f40 2024-01-25T15:03:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.074+0000 7fe5b5ffb640 1 -- 172.21.15.170:0/244450711 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5bc034600 con 0x55a38a2b0f40 2024-01-25T15:03:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.074+0000 7fe5d6b22740 10 client.15960 fetch_fsmap learned FSMap version 29 2024-01-25T15:03:34.079 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.074+0000 7fe5d6b22740 1 -- 172.21.15.170:0/244450711 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55a38a2168d0 con 0x55a38a2b0f40 2024-01-25T15:03:34.080 INFO:tasks.workunit.client.0.smithi170.stdout:4/157: write d6/f26 [1232984,85439] 0 2024-01-25T15:03:34.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.074+0000 7fe5b5ffb640 1 -- 172.21.15.170:0/244450711 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a38a2110e0 con 0x55a38a2b0f40 2024-01-25T15:03:34.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.074+0000 7fe5b5ffb640 1 -- 172.21.15.170:0/244450711 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 29) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe5bc03f6c0 con 0x55a38a2b0f40 2024-01-25T15:03:34.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.074+0000 7fe5d6b22740 10 client.15960 fetch_fsmap finished waiting for FSMap version 29 2024-01-25T15:03:34.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.074+0000 7fe5d6b22740 10 client.15960 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-01-25T15:03:34.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.074+0000 7fe5d6b22740 20 client.15960 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:34.082 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.074+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/244450711 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55a38a2c6ca0 0x55a38a2c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.074+0000 7fe5d6b22740 4 client.15960 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.075+0000 7fe5d6b22740 1 -- 172.21.15.170:0/244450711 --> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a38a210e00 con 0x55a38a2c6ca0 2024-01-25T15:03:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.075+0000 7fe5d205e640 1 --2- 172.21.15.170:0/244450711 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55a38a2c6ca0 0x55a38a2c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.076+0000 7fe5d205e640 1 --2- 172.21.15.170:0/244450711 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55a38a2c6ca0 0x55a38a2c9090 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=66ec51262dd798cd server_cookie=8506390ba2ffb3d1 in_seq=0 out_seq=0 2024-01-25T15:03:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.076+0000 7fe5b5ffb640 10 client.15960 ms_handle_connect on v2:172.21.15.191:6832/274874056 2024-01-25T15:03:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.077+0000 7fe5b5ffb640 1 -- 172.21.15.170:0/244450711 <== mds.3 v2:172.21.15.191:6832/274874056 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a38a210e00 con 0x55a38a2c6ca0 2024-01-25T15:03:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.077+0000 7fe5b5ffb640 10 client.15960 handle_command_reply: tid=0 2024-01-25T15:03:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.077+0000 7fe5d6b22740 1 client.15960 shutdown 2024-01-25T15:03:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.077+0000 7fe5d6b22740 1 -- 172.21.15.170:0/244450711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b0f40 msgr2=0x55a38a2bb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.077+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/244450711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b0f40 0x55a38a2bb150 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc02c170 tx=0x7fe5bc005fd0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.077+0000 7fe5d6b22740 1 -- 172.21.15.170:0/244450711 shutdown_connections 2024-01-25T15:03:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.077+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/244450711 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55a38a2c6ca0 0x55a38a2c9090 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.083 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.077+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/244450711 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b6aa0 0x55a38a2c26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.077+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/244450711 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2b1930 0x55a38a2bb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.077+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/244450711 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b0f40 0x55a38a2bb150 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.077+0000 7fe5d6b22740 1 -- 172.21.15.170:0/244450711 >> 172.21.15.170:0/244450711 conn(0x55a38a2ac4b0 msgr2=0x55a38a2ab7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.077+0000 7fe5b5ffb640 0 client.15960 ms_handle_reset on v2:172.21.15.191:6832/274874056 2024-01-25T15:03:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.077+0000 7fe5d6b22740 1 -- 172.21.15.170:0/244450711 shutdown_connections 2024-01-25T15:03:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.077+0000 7fe5d6b22740 1 -- 172.21.15.170:0/244450711 wait complete. 2024-01-25T15:03:34.084 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.077+0000 7fe5d6b22740 20 client.15960 trim_cache size 0 max 16384 2024-01-25T15:03:34.085 INFO:tasks.workunit.client.0.smithi170.stdout:2/246: dread f8 [0,4194304] 0 2024-01-25T15:03:34.085 INFO:tasks.workunit.client.0.smithi170.stdout:3/180: dwrite d3/d10/ff [0,4194304] 0 2024-01-25T15:03:34.085 INFO:tasks.workunit.client.0.smithi170.stdout:2/247: mknod d10/d16/d42/c57 0 2024-01-25T15:03:34.085 INFO:tasks.workunit.client.0.smithi170.stdout:2/248: truncate d10/d1e/f26 587609 0 2024-01-25T15:03:34.085 INFO:tasks.workunit.client.0.smithi170.stdout:2/249: stat d10/d16/f3b 0 2024-01-25T15:03:34.085 INFO:tasks.workunit.client.0.smithi170.stdout:7/223: dwrite d8/f4e [0,4194304] 0 2024-01-25T15:03:34.086 INFO:tasks.workunit.client.0.smithi170.stdout:0/173: write d8/f19 [5313797,114475] 0 2024-01-25T15:03:34.086 INFO:tasks.workunit.client.0.smithi170.stdout:9/164: dwrite d5/f11 [0,4194304] 0 2024-01-25T15:03:34.090 INFO:tasks.workunit.client.0.smithi170.stdout:7/224: write d8/f12 [1140850,68720] 0 2024-01-25T15:03:34.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d6b22740 1 Processor -- start 2024-01-25T15:03:34.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d6b22740 1 -- start start 2024-01-25T15:03:34.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d6b22740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b1930 0x55a38a2b9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d6b22740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b6aa0 0x55a38a2ba180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d6b22740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2b3590 0x55a38a2c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d6b22740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a38a2bac00 con 0x55a38a2b6aa0 2024-01-25T15:03:34.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d6b22740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a38a2b2930 con 0x55a38a2b1930 2024-01-25T15:03:34.095 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d6b22740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a38a210e00 con 0x55a38a2b3590 2024-01-25T15:03:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d205e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b6aa0 0x55a38a2ba180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d205e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b6aa0 0x55a38a2ba180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54156/0 (socket says 172.21.15.170:54156) 2024-01-25T15:03:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d205e640 1 -- 172.21.15.170:0/1481563429 learned_addr learned my addr 172.21.15.170:0/1481563429 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d205e640 1 -- 172.21.15.170:0/1481563429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2b3590 msgr2=0x55a38a2c2660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-25T15:03:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d205e640 1 --2- 172.21.15.170:0/1481563429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2b3590 0x55a38a2c2660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d205e640 1 -- 172.21.15.170:0/1481563429 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b1930 msgr2=0x55a38a2b9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d205e640 1 --2- 172.21.15.170:0/1481563429 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b1930 0x55a38a2b9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.093+0000 7fe5d205e640 1 -- 172.21.15.170:0/1481563429 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a38a1b3500 con 0x55a38a2b6aa0 2024-01-25T15:03:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.094+0000 7fe5d205e640 1 --2- 172.21.15.170:0/1481563429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b6aa0 0x55a38a2ba180 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x55a38a2b1d30 tx=0x7fe5c800b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45902fbb641bcb01 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.094+0000 7fe5b7fff640 1 -- 172.21.15.170:0/1481563429 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8017040 con 0x55a38a2b6aa0 2024-01-25T15:03:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.094+0000 7fe5b7fff640 1 -- 172.21.15.170:0/1481563429 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5c80132d0 con 0x55a38a2b6aa0 2024-01-25T15:03:34.096 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.094+0000 7fe5b7fff640 1 -- 172.21.15.170:0/1481563429 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8011440 con 0x55a38a2b6aa0 2024-01-25T15:03:34.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.095+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1481563429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b6aa0 msgr2=0x55a38a2ba180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.095+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/1481563429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b6aa0 0x55a38a2ba180 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x55a38a2b1d30 tx=0x7fe5c800b3d0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.095+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1481563429 shutdown_connections 2024-01-25T15:03:34.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.095+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/1481563429 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2b3590 0x55a38a2c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.099 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.095+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/1481563429 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b6aa0 0x55a38a2ba180 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.095+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/1481563429 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b1930 0x55a38a2b9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.095+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1481563429 >> 172.21.15.170:0/1481563429 conn(0x55a38a2ac4b0 msgr2=0x55a38a2b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.095+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1481563429 shutdown_connections 2024-01-25T15:03:34.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.095+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1481563429 wait complete. 2024-01-25T15:03:34.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.096+0000 7fe5d6b22740 1 -- start start 2024-01-25T15:03:34.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.096+0000 7fe5d6b22740 1 Processor -- start 2024-01-25T15:03:34.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.096+0000 7fe5d6b22740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b1930 0x55a38a2c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.096+0000 7fe5d6b22740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b6aa0 0x55a38a2c0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.096+0000 7fe5d6b22740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2c0ea0 0x55a38a2c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.096+0000 7fe5d6b22740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a38a2c29b0 con 0x55a38a2b1930 2024-01-25T15:03:34.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.096+0000 7fe5d6b22740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a38a31d160 con 0x55a38a2b6aa0 2024-01-25T15:03:34.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.096+0000 7fe5d6b22740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a38a31d2a0 con 0x55a38a2c0ea0 2024-01-25T15:03:34.100 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.096+0000 7fe5d6b22740 10 client.0 _ll_register_callbacks cb 0x7fe5c40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:34.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.096+0000 7fe5d185d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b1930 0x55a38a2c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.096+0000 7fe5d185d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b1930 0x55a38a2c2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54158/0 (socket says 172.21.15.170:54158) 2024-01-25T15:03:34.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.096+0000 7fe5d185d640 1 -- 172.21.15.170:0/1263345965 learned_addr learned my addr 172.21.15.170:0/1263345965 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.096+0000 7fe5d205e640 1 --2- 172.21.15.170:0/1263345965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b6aa0 0x55a38a2c0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.097+0000 7fe5d185d640 1 -- 172.21.15.170:0/1263345965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2c0ea0 msgr2=0x55a38a2c1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.097+0000 7fe5d185d640 1 --2- 172.21.15.170:0/1263345965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2c0ea0 0x55a38a2c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.097+0000 7fe5d185d640 1 -- 172.21.15.170:0/1263345965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b6aa0 msgr2=0x55a38a2c0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.097+0000 7fe5d185d640 1 --2- 172.21.15.170:0/1263345965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b6aa0 0x55a38a2c0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.097+0000 7fe5d185d640 1 -- 172.21.15.170:0/1263345965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c800b850 con 0x55a38a2b1930 2024-01-25T15:03:34.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.097+0000 7fe5d185d640 1 --2- 172.21.15.170:0/1263345965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b1930 0x55a38a2c2350 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc02cd70 tx=0x7fe5bc040f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661fab1b39b7f7cd server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.097+0000 7fe5b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:34.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.097+0000 7fe5b5ffb640 1 -- 172.21.15.170:0/1263345965 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc03fc40 con 0x55a38a2b1930 2024-01-25T15:03:34.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.097+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1263345965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe5bc02cbe0 con 0x55a38a2b1930 2024-01-25T15:03:34.101 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.097+0000 7fe5b5ffb640 1 -- 172.21.15.170:0/1263345965 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fe5bc004a70 con 0x55a38a2b1930 2024-01-25T15:03:34.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.098+0000 7fe5b5ffb640 1 -- 172.21.15.170:0/1263345965 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5bc02c2b0 con 0x55a38a2b1930 2024-01-25T15:03:34.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.098+0000 7fe5d6b22740 10 client.15966 fetch_fsmap learned FSMap version 29 2024-01-25T15:03:34.102 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.098+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1263345965 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55a38a1d9050 con 0x55a38a2b1930 2024-01-25T15:03:34.102 INFO:tasks.workunit.client.0.smithi170.stdout:3/181: dread d3/d1c/d2d/f35 [0,4194304] 0 2024-01-25T15:03:34.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.098+0000 7fe5b5ffb640 1 -- 172.21.15.170:0/1263345965 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5bc02cbe0 con 0x55a38a2b1930 2024-01-25T15:03:34.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.099+0000 7fe5b5ffb640 1 -- 172.21.15.170:0/1263345965 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 29) v1 ==== 7914+0+0 (secure 0 0 0) 0x7fe5bc0035f0 con 0x55a38a2b1930 2024-01-25T15:03:34.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.099+0000 7fe5d6b22740 10 client.15966 fetch_fsmap finished waiting for FSMap version 29 2024-01-25T15:03:34.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.099+0000 7fe5d6b22740 10 client.15966 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-01-25T15:03:34.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.099+0000 7fe5d6b22740 20 client.15966 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:34.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.099+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/1263345965 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55a38a31e980 0x55a38a320da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.099+0000 7fe5d6b22740 4 client.15966 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:03:34.103 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.099+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1263345965 --> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a389f177e0 con 0x55a38a31e980 2024-01-25T15:03:34.104 INFO:tasks.workunit.client.0.smithi170.stdout:2/250: dread d10/f13 [0,4194304] 0 2024-01-25T15:03:34.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.101+0000 7fe5d205e640 1 --2- 172.21.15.170:0/1263345965 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55a38a31e980 0x55a38a320da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.101+0000 7fe5b5ffb640 10 client.15966 ms_handle_connect on v2:172.21.15.191:6832/274874056 2024-01-25T15:03:34.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.101+0000 7fe5d205e640 1 --2- 172.21.15.170:0/1263345965 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55a38a31e980 0x55a38a320da0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cbf669108d0131f9 server_cookie=7ed8ff06b53c1762 in_seq=0 out_seq=0 2024-01-25T15:03:34.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.102+0000 7fe5b5ffb640 1 -- 172.21.15.170:0/1263345965 <== mds.3 v2:172.21.15.191:6832/274874056 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a389f177e0 con 0x55a38a31e980 2024-01-25T15:03:34.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.102+0000 7fe5b5ffb640 10 client.15966 handle_command_reply: tid=0 2024-01-25T15:03:34.105 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.102+0000 7fe5d6b22740 1 client.15966 shutdown 2024-01-25T15:03:34.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.102+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1263345965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b1930 msgr2=0x55a38a2c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.102+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/1263345965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b1930 0x55a38a2c2350 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc02cd70 tx=0x7fe5bc040f90 comp rx=0 tx=0).stop 2024-01-25T15:03:34.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.102+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1263345965 shutdown_connections 2024-01-25T15:03:34.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.102+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/1263345965 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x55a38a31e980 0x55a38a320da0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.102+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/1263345965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55a38a2b6aa0 0x55a38a2c0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.102+0000 7fe5b5ffb640 0 client.15966 ms_handle_reset on v2:172.21.15.191:6832/274874056 2024-01-25T15:03:34.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.102+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/1263345965 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55a38a2c0ea0 0x55a38a2c1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.102+0000 7fe5d6b22740 1 --2- 172.21.15.170:0/1263345965 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55a38a2b1930 0x55a38a2c2350 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.102+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1263345965 >> 172.21.15.170:0/1263345965 conn(0x55a38a2ac4b0 msgr2=0x55a38a2b9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.102+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1263345965 shutdown_connections 2024-01-25T15:03:34.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.102+0000 7fe5d6b22740 1 -- 172.21.15.170:0/1263345965 wait complete. 2024-01-25T15:03:34.106 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.102+0000 7fe5d6b22740 20 client.15966 trim_cache size 0 max 16384 2024-01-25T15:03:34.107 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:03:34.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.103+0000 7fe5d42c2640 1 -- 172.21.15.170:0/266441836 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe5b80a12e0 msgr2=0x7fe5b80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.103+0000 7fe5d42c2640 1 --2- 172.21.15.170:0/266441836 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe5b80a12e0 0x7fe5b80a37a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40049d0 tx=0x7fe5c40c47e0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.103+0000 7fe5d42c2640 1 -- 172.21.15.170:0/266441836 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5cc1017e0 msgr2=0x7fe5cc19e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.103+0000 7fe5d42c2640 1 --2- 172.21.15.170:0/266441836 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5cc1017e0 0x7fe5cc19e0d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe5c400eb10 tx=0x7fe5c400c2d0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.103+0000 7fe5d42c2640 1 -- 172.21.15.170:0/266441836 shutdown_connections 2024-01-25T15:03:34.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.103+0000 7fe5d42c2640 1 --2- 172.21.15.170:0/266441836 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe5b80a12e0 0x7fe5b80a37a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.103+0000 7fe5d42c2640 1 --2- 172.21.15.170:0/266441836 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe5cc1017e0 0x7fe5cc19e0d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.103+0000 7fe5d42c2640 1 --2- 172.21.15.170:0/266441836 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe5cc100e20 0x7fe5cc19bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.103+0000 7fe5d42c2640 1 --2- 172.21.15.170:0/266441836 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5cc0ffc30 0x7fe5cc069b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.103+0000 7fe5d42c2640 1 -- 172.21.15.170:0/266441836 >> 172.21.15.170:0/266441836 conn(0x7fe5cc0fb1a0 msgr2=0x7fe5cc104210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.108 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.103+0000 7fe5d42c2640 1 -- 172.21.15.170:0/266441836 shutdown_connections 2024-01-25T15:03:34.109 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.103+0000 7fe5d42c2640 1 -- 172.21.15.170:0/266441836 wait complete. 2024-01-25T15:03:34.109 INFO:tasks.workunit.client.0.smithi170.stdout:9/165: creat d5/f37 x:0 0 0 2024-01-25T15:03:34.109 INFO:tasks.workunit.client.0.smithi170.stdout:7/225: dwrite d8/f52 [0,4194304] 0 2024-01-25T15:03:34.109 INFO:tasks.workunit.client.0.smithi170.stdout:7/226: creat d8/d20/d45/f59 x:0 0 0 2024-01-25T15:03:34.110 INFO:tasks.workunit.client.0.smithi170.stdout:9/166: symlink d5/df/d16/d35/l38 0 2024-01-25T15:03:34.110 INFO:tasks.workunit.client.0.smithi170.stdout:9/167: fdatasync d5/df/f1a 0 2024-01-25T15:03:34.112 INFO:tasks.workunit.client.0.smithi170.stdout:3/182: symlink d3/l3f 0 2024-01-25T15:03:34.116 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-01-25T15:03:34.117 INFO:tasks.workunit.client.0.smithi170.stdout:2/251: write d10/d16/f3b [4102591,114614] 0 2024-01-25T15:03:34.117 INFO:tasks.workunit.client.0.smithi170.stdout:2/252: creat d10/d1e/f58 x:0 0 0 2024-01-25T15:03:34.118 INFO:tasks.workunit.client.0.smithi170.stdout:7/227: creat d8/d20/d2a/f5a x:0 0 0 2024-01-25T15:03:34.118 INFO:tasks.workunit.client.0.smithi170.stdout:7/228: truncate d8/d20/d2a/d35/f44 1154787 0 2024-01-25T15:03:34.121 INFO:tasks.workunit.client.0.smithi170.stdout:2/253: mknod d10/d1e/d32/d3e/d41/c59 0 2024-01-25T15:03:34.123 INFO:tasks.workunit.client.0.smithi170.stdout:3/183: mknod d3/c40 0 2024-01-25T15:03:34.123 INFO:tasks.workunit.client.0.smithi170.stdout:3/184: readlink d3/d10/d13/d1b/l32 0 2024-01-25T15:03:34.125 INFO:tasks.workunit.client.0.smithi170.stdout:7/229: mkdir d8/d5b 0 2024-01-25T15:03:34.125 INFO:tasks.workunit.client.0.smithi170.stdout:7/230: write d8/f1f [1037966,51386] 0 2024-01-25T15:03:34.125 INFO:tasks.workunit.client.0.smithi170.stdout:7/231: dread - d8/d20/d45/f59 zero size 2024-01-25T15:03:34.125 INFO:tasks.workunit.client.0.smithi170.stdout:9/168: dread d5/f11 [0,4194304] 0 2024-01-25T15:03:34.125 INFO:tasks.workunit.client.0.smithi170.stdout:9/169: fsync d5/f14 0 2024-01-25T15:03:34.125 INFO:tasks.workunit.client.0.smithi170.stdout:9/170: write d5/df/f1a [351124,79055] 0 2024-01-25T15:03:34.126 INFO:tasks.workunit.client.0.smithi170.stdout:3/185: mkdir d3/d10/d1e/d21/d41 0 2024-01-25T15:03:34.128 INFO:tasks.workunit.client.0.smithi170.stdout:0/174: dwrite d8/d10/f15 [4194304,4194304] 0 2024-01-25T15:03:34.128 INFO:tasks.workunit.client.0.smithi170.stdout:0/175: write d8/ff [3145288,101148] 0 2024-01-25T15:03:34.128 INFO:tasks.workunit.client.0.smithi170.stdout:4/158: dwrite d6/d7/f9 [0,4194304] 0 2024-01-25T15:03:34.131 INFO:tasks.workunit.client.0.smithi170.stdout:3/186: unlink d3/d10/d13/d1b/f2c 0 2024-01-25T15:03:34.131 INFO:tasks.workunit.client.0.smithi170.stdout:7/232: mknod d8/c5c 0 2024-01-25T15:03:34.131 INFO:tasks.workunit.client.0.smithi170.stdout:7/233: chown d8/d20/d2a/f5a 62152183 1 2024-01-25T15:03:34.136 INFO:tasks.workunit.client.0.smithi170.stdout:4/159: link d6/c20 d6/d28/c2f 0 2024-01-25T15:03:34.137 INFO:tasks.workunit.client.0.smithi170.stdout:7/234: creat d8/f5d x:0 0 0 2024-01-25T15:03:34.139 INFO:tasks.workunit.client.0.smithi170.stdout:4/160: rename d6/f2d to d6/d11/f30 0 2024-01-25T15:03:34.140 INFO:tasks.workunit.client.0.smithi170.stdout:4/161: stat d6/d7/l27 0 2024-01-25T15:03:34.145 INFO:tasks.workunit.client.0.smithi170.stdout:7/235: dread d8/d20/d2a/f34 [0,4194304] 0 2024-01-25T15:03:34.147 INFO:tasks.workunit.client.0.smithi170.stdout:7/236: truncate f7 5057344 0 2024-01-25T15:03:34.148 INFO:tasks.workunit.client.0.smithi170.stdout:7/237: chown d8/f3a 49 1 2024-01-25T15:03:34.148 INFO:tasks.workunit.client.0.smithi170.stdout:7/238: chown c4 63 1 2024-01-25T15:03:34.149 INFO:tasks.workunit.client.0.smithi170.stdout:4/162: dread d6/d7/f14 [0,4194304] 0 2024-01-25T15:03:34.149 INFO:tasks.workunit.client.0.smithi170.stdout:7/239: mknod d8/d20/d45/c5e 0 2024-01-25T15:03:34.151 INFO:tasks.workunit.client.0.smithi170.stdout:2/254: dwrite d10/d1e/d32/f38 [0,4194304] 0 2024-01-25T15:03:34.151 INFO:tasks.workunit.client.0.smithi170.stdout:2/255: chown ce 165 1 2024-01-25T15:03:34.151 INFO:tasks.workunit.client.0.smithi170.stdout:2/256: chown d10/d16/f23 595173 1 2024-01-25T15:03:34.151 INFO:tasks.workunit.client.0.smithi170.stdout:4/163: mkdir d6/d7/d31 0 2024-01-25T15:03:34.151 INFO:tasks.workunit.client.0.smithi170.stdout:2/257: write d10/d1b/f36 [1009167,67080] 0 2024-01-25T15:03:34.152 INFO:tasks.workunit.client.0.smithi170.stdout:9/171: dwrite d5/df/d12/d18/f31 [0,4194304] 0 2024-01-25T15:03:34.152 INFO:tasks.workunit.client.0.smithi170.stdout:9/172: chown d5/df/d16/f19 27450154 1 2024-01-25T15:03:34.153 INFO:tasks.workunit.client.0.smithi170.stdout:7/240: rename d8/d20/d2a/l39 to d8/d5b/l5f 0 2024-01-25T15:03:34.156 INFO:tasks.workunit.client.0.smithi170.stdout:0/176: dwrite d8/d10/f2b [4194304,4194304] 0 2024-01-25T15:03:34.156 INFO:tasks.workunit.client.0.smithi170.stdout:4/164: stat d6/d28/c2f 0 2024-01-25T15:03:34.158 INFO:tasks.workunit.client.0.smithi170.stdout:2/258: symlink d10/d16/d54/l5a 0 2024-01-25T15:03:34.158 INFO:tasks.workunit.client.0.smithi170.stdout:2/259: write d10/d1b/f56 [241255,44860] 0 2024-01-25T15:03:34.161 INFO:tasks.workunit.client.0.smithi170.stdout:9/173: rename d5/f11 to d5/df/d2e/f39 0 2024-01-25T15:03:34.166 INFO:tasks.workunit.client.0.smithi170.stdout:2/260: dread d10/d16/f23 [0,4194304] 0 2024-01-25T15:03:34.167 INFO:tasks.workunit.client.0.smithi170.stdout:2/261: chown d10/d1b/f56 51199715 1 2024-01-25T15:03:34.171 INFO:tasks.workunit.client.0.smithi170.stdout:0/177: truncate d8/fa 943035 0 2024-01-25T15:03:34.171 INFO:tasks.workunit.client.0.smithi170.stdout:4/165: truncate d6/f26 3904286 0 2024-01-25T15:03:34.171 INFO:tasks.workunit.client.0.smithi170.stdout:9/174: symlink d5/d1e/l3a 0 2024-01-25T15:03:34.171 INFO:tasks.workunit.client.0.smithi170.stdout:9/175: truncate f4 1406772 0 2024-01-25T15:03:34.171 INFO:tasks.workunit.client.0.smithi170.stdout:9/176: fdatasync d5/d1e/f2a 0 2024-01-25T15:03:34.172 INFO:tasks.workunit.client.0.smithi170.stdout:0/178: read d8/d9/f16 [234382,109224] 0 2024-01-25T15:03:34.172 INFO:tasks.workunit.client.0.smithi170.stdout:7/241: link d8/c14 d8/d20/d2a/d35/d55/c60 0 2024-01-25T15:03:34.175 INFO:tasks.workunit.client.0.smithi170.stdout:7/242: mkdir d8/d20/d2a/d61 0 2024-01-25T15:03:34.176 INFO:tasks.workunit.client.0.smithi170.stdout:7/243: mknod d8/d5b/c62 0 2024-01-25T15:03:34.185 INFO:tasks.workunit.client.0.smithi170.stdout:9/177: dread d5/df/d12/d18/f31 [0,4194304] 0 2024-01-25T15:03:34.185 INFO:tasks.workunit.client.0.smithi170.stdout:9/178: dread - d5/df/f20 zero size 2024-01-25T15:03:34.194 INFO:tasks.workunit.client.0.smithi170.stdout:5/137: sync 2024-01-25T15:03:34.194 INFO:tasks.workunit.client.0.smithi170.stdout:8/122: sync 2024-01-25T15:03:34.194 INFO:tasks.workunit.client.0.smithi170.stdout:1/205: sync 2024-01-25T15:03:34.194 INFO:tasks.workunit.client.0.smithi170.stdout:6/176: sync 2024-01-25T15:03:34.195 INFO:tasks.workunit.client.0.smithi170.stdout:8/123: dread d3/d7/f16 [0,4194304] 0 2024-01-25T15:03:34.196 INFO:tasks.workunit.client.0.smithi170.stdout:8/124: write d3/f9 [2928436,24951] 0 2024-01-25T15:03:34.196 INFO:tasks.workunit.client.0.smithi170.stdout:8/125: write d3/fb [854938,99673] 0 2024-01-25T15:03:34.196 INFO:tasks.workunit.client.0.smithi170.stdout:5/138: symlink d5/d10/d2c/l32 0 2024-01-25T15:03:34.196 INFO:tasks.workunit.client.0.smithi170.stdout:5/139: chown d5/d2a 755581 1 2024-01-25T15:03:34.196 INFO:tasks.workunit.client.0.smithi170.stdout:5/140: truncate d5/f7 1603394 0 2024-01-25T15:03:34.196 INFO:tasks.workunit.client.0.smithi170.stdout:7/244: dread d8/d20/d2a/d35/f41 [0,4194304] 0 2024-01-25T15:03:34.197 INFO:tasks.workunit.client.0.smithi170.stdout:7/245: fsync d8/f1c 0 2024-01-25T15:03:34.197 INFO:tasks.workunit.client.0.smithi170.stdout:7/246: chown d8/d20/d2a/d35/c51 4 1 2024-01-25T15:03:34.197 INFO:tasks.workunit.client.0.smithi170.stdout:6/177: symlink d2/d7/d23/d19/l3e 0 2024-01-25T15:03:34.197 INFO:tasks.workunit.client.0.smithi170.stdout:2/262: dwrite d10/d1e/f20 [0,4194304] 0 2024-01-25T15:03:34.198 INFO:tasks.workunit.client.0.smithi170.stdout:2/263: write d10/f52 [475431,130171] 0 2024-01-25T15:03:34.199 INFO:tasks.workunit.client.0.smithi170.stdout:8/126: mkdir d3/d7/d22/d23 0 2024-01-25T15:03:34.199 INFO:tasks.workunit.client.0.smithi170.stdout:8/127: write d3/f9 [3251059,74852] 0 2024-01-25T15:03:34.199 INFO:tasks.workunit.client.0.smithi170.stdout:5/141: fsync d5/f1b 0 2024-01-25T15:03:34.201 INFO:tasks.workunit.client.0.smithi170.stdout:9/179: dread d5/df/f15 [0,4194304] 0 2024-01-25T15:03:34.201 INFO:tasks.workunit.client.0.smithi170.stdout:7/247: creat d8/d20/d2a/d61/f63 x:0 0 0 2024-01-25T15:03:34.203 INFO:tasks.workunit.client.0.smithi170.stdout:2/264: mknod d10/d1b/c5b 0 2024-01-25T15:03:34.203 INFO:tasks.workunit.client.0.smithi170.stdout:2/265: fsync d10/d1e/f53 0 2024-01-25T15:03:34.203 INFO:tasks.workunit.client.0.smithi170.stdout:2/266: chown d10/d1e/f53 1161987429 1 2024-01-25T15:03:34.204 INFO:tasks.workunit.client.0.smithi170.stdout:4/166: dwrite d6/d7/f14 [0,4194304] 0 2024-01-25T15:03:34.204 INFO:tasks.workunit.client.0.smithi170.stdout:4/167: truncate d6/d7/fa 6301084 0 2024-01-25T15:03:34.204 INFO:tasks.workunit.client.0.smithi170.stdout:4/168: truncate d6/d7/f17 4707577 0 2024-01-25T15:03:34.204 INFO:tasks.workunit.client.0.smithi170.stdout:5/142: fdatasync d5/f1e 0 2024-01-25T15:03:34.204 INFO:tasks.workunit.client.0.smithi170.stdout:5/143: creat d5/d10/d2c/f33 x:0 0 0 2024-01-25T15:03:34.206 INFO:tasks.workunit.client.0.smithi170.stdout:9/180: truncate d5/dc/fe 619032 0 2024-01-25T15:03:34.206 INFO:tasks.workunit.client.0.smithi170.stdout:4/169: dread d6/d7/d1b/f1e [0,4194304] 0 2024-01-25T15:03:34.206 INFO:tasks.workunit.client.0.smithi170.stdout:4/170: chown d6/c20 2717708 1 2024-01-25T15:03:34.206 INFO:tasks.workunit.client.0.smithi170.stdout:6/178: write f0 [1205545,30678] 0 2024-01-25T15:03:34.206 INFO:tasks.workunit.client.0.smithi170.stdout:6/179: chown d2 3782732 1 2024-01-25T15:03:34.208 INFO:tasks.workunit.client.0.smithi170.stdout:7/248: mknod d8/d20/d3b/d4d/c64 0 2024-01-25T15:03:34.209 INFO:tasks.workunit.client.0.smithi170.stdout:2/267: rmdir d10/d1b 39 2024-01-25T15:03:34.213 INFO:tasks.workunit.client.0.smithi170.stdout:5/144: mkdir d5/d10/d2c/d34 0 2024-01-25T15:03:34.215 INFO:tasks.workunit.client.0.smithi170.stdout:9/181: creat d5/df/f3b x:0 0 0 2024-01-25T15:03:34.215 INFO:tasks.workunit.client.0.smithi170.stdout:9/182: chown d5/d1e/d21/d34 1021 1 2024-01-25T15:03:34.216 INFO:tasks.workunit.client.0.smithi170.stdout:6/180: creat d2/d7/d23/d19/d2f/d37/f3f x:0 0 0 2024-01-25T15:03:34.216 INFO:tasks.workunit.client.0.smithi170.stdout:6/181: chown d2/d7/d23/d19/l34 5 1 2024-01-25T15:03:34.216 INFO:tasks.workunit.client.0.smithi170.stdout:2/268: write d10/d16/f23 [2576916,52583] 0 2024-01-25T15:03:34.216 INFO:tasks.workunit.client.0.smithi170.stdout:7/249: truncate d8/d20/d2a/d35/f44 61706 0 2024-01-25T15:03:34.220 INFO:tasks.workunit.client.0.smithi170.stdout:1/206: dwrite d0/d2e/f31 [0,4194304] 0 2024-01-25T15:03:34.222 INFO:tasks.workunit.client.0.smithi170.stdout:2/269: mkdir d10/d1e/d32/d3e/d5c 0 2024-01-25T15:03:34.227 INFO:tasks.workunit.client.0.smithi170.stdout:8/128: write d3/d7/fa [2029609,91338] 0 2024-01-25T15:03:34.227 INFO:tasks.workunit.client.0.smithi170.stdout:0/179: dwrite d8/d10/d2d/d2f/f37 [0,4194304] 0 2024-01-25T15:03:34.227 INFO:tasks.workunit.client.0.smithi170.stdout:0/180: fdatasync d8/f19 0 2024-01-25T15:03:34.227 INFO:tasks.workunit.client.0.smithi170.stdout:0/181: readlink d8/d10/d2d/d2f/l35 0 2024-01-25T15:03:34.227 INFO:tasks.workunit.client.0.smithi170.stdout:0/182: truncate d8/d18/f3b 14092 0 2024-01-25T15:03:34.229 INFO:tasks.workunit.client.0.smithi170.stdout:7/250: truncate d8/d20/d2a/d35/f44 513456 0 2024-01-25T15:03:34.229 INFO:tasks.workunit.client.0.smithi170.stdout:6/182: read d2/d7/f2e [3980846,22720] 0 2024-01-25T15:03:34.230 INFO:tasks.workunit.client.0.smithi170.stdout:2/270: symlink d10/d16/d42/l5d 0 2024-01-25T15:03:34.232 INFO:tasks.workunit.client.0.smithi170.stdout:5/145: rename d5/d10/d2c/f33 to d5/d10/f35 0 2024-01-25T15:03:34.232 INFO:tasks.workunit.client.0.smithi170.stdout:5/146: dread - d5/d10/f26 zero size 2024-01-25T15:03:34.237 INFO:tasks.workunit.client.0.smithi170.stdout:6/183: dread d2/d7/f18 [0,4194304] 0 2024-01-25T15:03:34.237 INFO:tasks.workunit.client.0.smithi170.stdout:6/184: read d2/d7/d23/d19/f24 [3941460,53463] 0 2024-01-25T15:03:34.237 INFO:tasks.workunit.client.0.smithi170.stdout:6/185: read - d2/d7/d23/d19/d2f/d37/f3f zero size 2024-01-25T15:03:34.237 INFO:tasks.workunit.client.0.smithi170.stdout:8/129: mknod d3/d7/d22/d23/c24 0 2024-01-25T15:03:34.237 INFO:tasks.workunit.client.0.smithi170.stdout:0/183: mknod d8/d10/d2d/c3c 0 2024-01-25T15:03:34.239 INFO:tasks.workunit.client.0.smithi170.stdout:1/207: getdents d0/d1b 0 2024-01-25T15:03:34.239 INFO:tasks.workunit.client.0.smithi170.stdout:1/208: creat d0/f46 x:0 0 0 2024-01-25T15:03:34.239 INFO:tasks.workunit.client.0.smithi170.stdout:1/209: fsync d0/f3d 0 2024-01-25T15:03:34.239 INFO:tasks.workunit.client.0.smithi170.stdout:1/210: dread - d0/d1b/f43 zero size 2024-01-25T15:03:34.240 INFO:tasks.workunit.client.0.smithi170.stdout:2/271: mkdir d10/d1e/d5e 0 2024-01-25T15:03:34.247 INFO:tasks.workunit.client.0.smithi170.stdout:9/183: dwrite d5/dc/fd [0,4194304] 0 2024-01-25T15:03:34.252 INFO:tasks.workunit.client.0.smithi170.stdout:7/251: rename d8/fc to d8/d20/d2a/d35/f65 0 2024-01-25T15:03:34.253 INFO:tasks.workunit.client.0.smithi170.stdout:7/252: write d8/d20/f30 [1042294,88443] 0 2024-01-25T15:03:34.253 INFO:tasks.workunit.client.0.smithi170.stdout:7/253: creat d8/d20/d2a/d35/f66 x:0 0 0 2024-01-25T15:03:34.253 INFO:tasks.workunit.client.0.smithi170.stdout:9/184: dread d5/f14 [0,4194304] 0 2024-01-25T15:03:34.254 INFO:tasks.workunit.client.0.smithi170.stdout:6/186: creat d2/f40 x:0 0 0 2024-01-25T15:03:34.255 INFO:tasks.workunit.client.0.smithi170.stdout:8/130: mkdir d3/d7/d22/d23/d25 0 2024-01-25T15:03:34.258 INFO:tasks.workunit.client.0.smithi170.stdout:1/211: write d0/d2e/f31 [3440073,50906] 0 2024-01-25T15:03:34.259 INFO:tasks.workunit.client.0.smithi170.stdout:0/184: dread d8/d10/d2d/d2f/f37 [0,4194304] 0 2024-01-25T15:03:34.259 INFO:tasks.workunit.client.0.smithi170.stdout:2/272: unlink d10/d16/d42/c50 0 2024-01-25T15:03:34.259 INFO:tasks.workunit.client.0.smithi170.stdout:0/185: stat d8/c30 0 2024-01-25T15:03:34.259 INFO:tasks.workunit.client.0.smithi170.stdout:5/147: symlink d5/d10/l36 0 2024-01-25T15:03:34.260 INFO:tasks.workunit.client.0.smithi170.stdout:9/185: mkdir d5/df/d16/d35/d3c 0 2024-01-25T15:03:34.265 INFO:tasks.workunit.client.0.smithi170.stdout:5/148: dread d5/fd [0,4194304] 0 2024-01-25T15:03:34.265 INFO:tasks.workunit.client.0.smithi170.stdout:8/131: rename d3/d7/l1d to d3/d7/d22/d23/l26 0 2024-01-25T15:03:34.265 INFO:tasks.workunit.client.0.smithi170.stdout:1/212: mknod d0/d1b/c47 0 2024-01-25T15:03:34.265 INFO:tasks.workunit.client.0.smithi170.stdout:6/187: dread d2/d7/d23/d19/f29 [0,4194304] 0 2024-01-25T15:03:34.266 INFO:tasks.workunit.client.0.smithi170.stdout:0/186: link d8/d9/l12 d8/d3a/l3d 0 2024-01-25T15:03:34.266 INFO:tasks.workunit.client.0.smithi170.stdout:9/186: creat d5/d1e/d21/d34/f3d x:0 0 0 2024-01-25T15:03:34.268 INFO:tasks.workunit.client.0.smithi170.stdout:2/273: rename d10/d16/d54 to d10/d1b/d5f 0 2024-01-25T15:03:34.269 INFO:tasks.workunit.client.0.smithi170.stdout:5/149: mknod d5/d2a/c37 0 2024-01-25T15:03:34.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.270+0000 7f7ac8189640 1 -- 172.21.15.170:0/1705018419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac0101180 msgr2=0x7f7ac01015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.270+0000 7f7ac8189640 1 --2- 172.21.15.170:0/1705018419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac0101180 0x7f7ac01015a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009930 tx=0x7f7abc02bc30 comp rx=0 tx=0).stop 2024-01-25T15:03:34.271 INFO:tasks.workunit.client.0.smithi170.stdout:1/213: mknod d0/d20/d28/d2a/c48 0 2024-01-25T15:03:34.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.270+0000 7f7ac8189640 1 -- 172.21.15.170:0/1705018419 shutdown_connections 2024-01-25T15:03:34.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.270+0000 7f7ac8189640 1 --2- 172.21.15.170:0/1705018419 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ac0100870 0x7f7ac0108110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.271 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.270+0000 7f7ac8189640 1 --2- 172.21.15.170:0/1705018419 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ac00ffeb0 0x7f7ac0100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.270+0000 7f7ac8189640 1 --2- 172.21.15.170:0/1705018419 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac0101180 0x7f7ac01015a0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.270+0000 7f7ac8189640 1 -- 172.21.15.170:0/1705018419 >> 172.21.15.170:0/1705018419 conn(0x7f7ac00fa8e0 msgr2=0x7f7ac00fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.270+0000 7f7ac8189640 1 -- 172.21.15.170:0/1705018419 shutdown_connections 2024-01-25T15:03:34.272 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.270+0000 7f7ac8189640 1 -- 172.21.15.170:0/1705018419 wait complete. 2024-01-25T15:03:34.272 INFO:tasks.workunit.client.0.smithi170.stdout:6/188: rmdir d2/d7/d1b/d28 39 2024-01-25T15:03:34.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.270+0000 7f7ac8189640 1 Processor -- start 2024-01-25T15:03:34.273 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac8189640 1 -- start start 2024-01-25T15:03:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac8189640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ac00ffeb0 0x7f7ac0196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac8189640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ac0100870 0x7f7ac0197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac8189640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac0101180 0x7f7ac019e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac8189640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac019e840 con 0x7f7ac0101180 2024-01-25T15:03:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac8189640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac019e9b0 con 0x7f7ac00ffeb0 2024-01-25T15:03:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac8189640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac019eb70 con 0x7f7ac0100870 2024-01-25T15:03:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac6726640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac0101180 0x7f7ac019e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac6726640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac0101180 0x7f7ac019e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54162/0 (socket says 172.21.15.170:54162) 2024-01-25T15:03:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac6726640 1 -- 172.21.15.170:0/1936000179 learned_addr learned my addr 172.21.15.170:0/1936000179 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac5724640 1 --2- 172.21.15.170:0/1936000179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ac0100870 0x7f7ac0197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.274 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac5f25640 1 --2- 172.21.15.170:0/1936000179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ac00ffeb0 0x7f7ac0196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.275 INFO:tasks.workunit.client.0.smithi170.stdout:0/187: mkdir d8/d3e 0 2024-01-25T15:03:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac6726640 1 -- 172.21.15.170:0/1936000179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ac0100870 msgr2=0x7f7ac0197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac6726640 1 --2- 172.21.15.170:0/1936000179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ac0100870 0x7f7ac0197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac6726640 1 -- 172.21.15.170:0/1936000179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ac00ffeb0 msgr2=0x7f7ac0196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac6726640 1 --2- 172.21.15.170:0/1936000179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ac00ffeb0 0x7f7ac0196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac6726640 1 -- 172.21.15.170:0/1936000179 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc009560 con 0x7f7ac0101180 2024-01-25T15:03:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ac6726640 1 --2- 172.21.15.170:0/1936000179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac0101180 0x7f7ac019e300 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800eaa0 tx=0x7f7ab800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ab6ffd640 1 -- 172.21.15.170:0/1936000179 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800cdb0 con 0x7f7ac0101180 2024-01-25T15:03:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.271+0000 7f7ab6ffd640 1 -- 172.21.15.170:0/1936000179 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ab8005020 con 0x7f7ac0101180 2024-01-25T15:03:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.272+0000 7f7ac8189640 1 -- 172.21.15.170:0/1936000179 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac019ee50 con 0x7f7ac0101180 2024-01-25T15:03:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.272+0000 7f7ab6ffd640 1 -- 172.21.15.170:0/1936000179 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab80116d0 con 0x7f7ac0101180 2024-01-25T15:03:34.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.272+0000 7f7ac8189640 1 -- 172.21.15.170:0/1936000179 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac019f280 con 0x7f7ac0101180 2024-01-25T15:03:34.277 INFO:tasks.workunit.client.0.smithi170.stdout:9/187: mkdir d5/d1e/d21/d34/d3e 0 2024-01-25T15:03:34.277 INFO:tasks.workunit.client.0.smithi170.stdout:2/274: unlink d10/d16/d42/f4a 0 2024-01-25T15:03:34.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.274+0000 7f7acae28740 1 Processor -- start 2024-01-25T15:03:34.278 INFO:tasks.workunit.client.0.smithi170.stdout:1/214: link d0/d20/c2d d0/d2e/c49 0 2024-01-25T15:03:34.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.275+0000 7f7ab6ffd640 1 -- 172.21.15.170:0/1936000179 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f7ab8005190 con 0x7f7ac0101180 2024-01-25T15:03:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.275+0000 7f7acae28740 1 -- start start 2024-01-25T15:03:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.275+0000 7f7acae28740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7350 0x5642d96a7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.275+0000 7f7acae28740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96a7d40 0x5642d96ac840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.275+0000 7f7acae28740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96aceb0 0x5642d96af340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7acae28740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d9611270 con 0x5642d96a7350 2024-01-25T15:03:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7acae28740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d960e960 con 0x5642d96a7d40 2024-01-25T15:03:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7acae28740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d960a250 con 0x5642d96aceb0 2024-01-25T15:03:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7ac5f25640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96a7d40 0x5642d96ac840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7ac5724640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7350 0x5642d96a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7ac5f25640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96a7d40 0x5642d96ac840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:38250/0 (socket says 172.21.15.170:38250) 2024-01-25T15:03:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7ac5f25640 1 -- 172.21.15.170:0/1962112561 learned_addr learned my addr 172.21.15.170:0/1962112561 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.280 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7ac5724640 1 --2- 172.21.15.170:0/1962112561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96aceb0 0x5642d96af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7ac5724640 1 -- 172.21.15.170:0/1962112561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96aceb0 msgr2=0x5642d96af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7ac5724640 1 --2- 172.21.15.170:0/1962112561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96aceb0 0x5642d96af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7ac5724640 1 -- 172.21.15.170:0/1962112561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96a7d40 msgr2=0x5642d96ac840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7ac5724640 1 --2- 172.21.15.170:0/1962112561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96a7d40 0x5642d96ac840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7ac5724640 1 -- 172.21.15.170:0/1962112561 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642d95cc7f0 con 0x5642d96a7350 2024-01-25T15:03:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7ab6ffd640 1 --2- 172.21.15.170:0/1936000179 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7aac0a12e0 0x7f7aac0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7ac5724640 1 --2- 172.21.15.170:0/1962112561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7350 0x5642d96a7770 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0198260 tx=0x7f7ab0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef936079ab23556 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.276+0000 7f7ac5f25640 1 --2- 172.21.15.170:0/1936000179 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7aac0a12e0 0x7f7aac0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.281 INFO:tasks.workunit.client.0.smithi170.stdout:6/189: symlink d2/d7/l41 0 2024-01-25T15:03:34.281 INFO:tasks.workunit.client.0.smithi170.stdout:0/188: mknod d8/d10/d2d/d2f/c3f 0 2024-01-25T15:03:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.277+0000 7f7aabfff640 1 -- 172.21.15.170:0/1962112561 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0004250 con 0x5642d96a7350 2024-01-25T15:03:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.277+0000 7f7aabfff640 1 -- 172.21.15.170:0/1962112561 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ab00043b0 con 0x5642d96a7350 2024-01-25T15:03:34.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.277+0000 7f7aabfff640 1 -- 172.21.15.170:0/1962112561 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00118c0 con 0x5642d96a7350 2024-01-25T15:03:34.282 INFO:tasks.workunit.client.0.smithi170.stdout:5/150: symlink d5/d10/l38 0 2024-01-25T15:03:34.283 INFO:tasks.workunit.client.0.smithi170.stdout:8/132: dread d3/d7/f10 [0,4194304] 0 2024-01-25T15:03:34.283 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.277+0000 7f7ab6ffd640 1 -- 172.21.15.170:0/1936000179 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f7ab80cccf0 con 0x7f7ac0101180 2024-01-25T15:03:34.283 INFO:tasks.workunit.client.0.smithi170.stdout:1/215: mkdir d0/d20/d28/d2a/d4a 0 2024-01-25T15:03:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.278+0000 7f7acae28740 1 -- 172.21.15.170:0/1962112561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7350 msgr2=0x5642d96a7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.278+0000 7f7acae28740 1 --2- 172.21.15.170:0/1962112561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7350 0x5642d96a7770 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0198260 tx=0x7f7ab0005850 comp rx=0 tx=0).stop 2024-01-25T15:03:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.278+0000 7f7ac5f25640 1 --2- 172.21.15.170:0/1936000179 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7aac0a12e0 0x7f7aac0a37a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x5642d96a87b0 tx=0x7f7abc02c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.278+0000 7f7acae28740 1 -- 172.21.15.170:0/1962112561 shutdown_connections 2024-01-25T15:03:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.278+0000 7f7acae28740 1 --2- 172.21.15.170:0/1962112561 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96a7d40 0x5642d96ac840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.278+0000 7f7acae28740 1 --2- 172.21.15.170:0/1962112561 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96aceb0 0x5642d96af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.284 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.278+0000 7f7acae28740 1 --2- 172.21.15.170:0/1962112561 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7350 0x5642d96a7770 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.285 INFO:tasks.workunit.client.0.smithi170.stdout:8/133: dread d3/d7/f16 [0,4194304] 0 2024-01-25T15:03:34.285 INFO:tasks.workunit.client.0.smithi170.stdout:8/134: fsync d3/f9 0 2024-01-25T15:03:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.278+0000 7f7acae28740 1 -- 172.21.15.170:0/1962112561 >> 172.21.15.170:0/1962112561 conn(0x5642d969e4b0 msgr2=0x5642d969e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.278+0000 7f7acae28740 1 -- 172.21.15.170:0/1962112561 shutdown_connections 2024-01-25T15:03:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.278+0000 7f7acae28740 1 -- 172.21.15.170:0/1962112561 wait complete. 2024-01-25T15:03:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.278+0000 7f7acae28740 1 -- start start 2024-01-25T15:03:34.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.279+0000 7f7acae28740 1 Processor -- start 2024-01-25T15:03:34.286 INFO:tasks.workunit.client.0.smithi170.stdout:6/190: rename d2/c3c to d2/d7/d1b/c42 0 2024-01-25T15:03:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.279+0000 7f7acae28740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7350 0x5642d96b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.279+0000 7f7acae28740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7d40 0x5642d96b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.279+0000 7f7acae28740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96aceb0 0x5642d96b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.279+0000 7f7acae28740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d95c3610 con 0x5642d96a7d40 2024-01-25T15:03:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.279+0000 7f7acae28740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d95c32b0 con 0x5642d96aceb0 2024-01-25T15:03:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.279+0000 7f7acae28740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d9588400 con 0x5642d96a7350 2024-01-25T15:03:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.279+0000 7f7acae28740 10 client.0 _ll_register_callbacks cb 0x5642d9600ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.279+0000 7f7ac5724640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7d40 0x5642d96b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.279+0000 7f7ac5724640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7d40 0x5642d96b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54186/0 (socket says 172.21.15.170:54186) 2024-01-25T15:03:34.287 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.279+0000 7f7ac5724640 1 -- 172.21.15.170:0/31047461 learned_addr learned my addr 172.21.15.170:0/31047461 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.288 INFO:tasks.workunit.client.0.smithi170.stdout:0/189: symlink d8/d3a/l40 0 2024-01-25T15:03:34.288 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.279+0000 7f7ac5f25640 1 --2- 172.21.15.170:0/31047461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7350 0x5642d96b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.279+0000 7f7ac6726640 1 --2- 172.21.15.170:0/31047461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96aceb0 0x5642d96b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.280+0000 7f7ac5724640 1 -- 172.21.15.170:0/31047461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7350 msgr2=0x5642d96b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.280+0000 7f7ac5724640 1 --2- 172.21.15.170:0/31047461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7350 0x5642d96b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.280+0000 7f7ac5724640 1 -- 172.21.15.170:0/31047461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96aceb0 msgr2=0x5642d96b8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.280+0000 7f7ac5724640 1 --2- 172.21.15.170:0/31047461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96aceb0 0x5642d96b8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.280+0000 7f7ac5724640 1 -- 172.21.15.170:0/31047461 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab0009d90 con 0x5642d96a7d40 2024-01-25T15:03:34.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.280+0000 7f7ac6726640 1 --2- 172.21.15.170:0/31047461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96aceb0 0x5642d96b8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:34.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.280+0000 7f7ac5724640 1 --2- 172.21.15.170:0/31047461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7d40 0x5642d96b1b00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a010 tx=0x7f7ab0003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174ce68e9635ea3e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.289 INFO:tasks.workunit.client.0.smithi170.stdout:1/216: mkdir d0/d1b/d4b 0 2024-01-25T15:03:34.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.280+0000 7f7aa97fa640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:34.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.280+0000 7f7aa97fa640 1 -- 172.21.15.170:0/31047461 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab0011640 con 0x5642d96a7d40 2024-01-25T15:03:34.290 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.280+0000 7f7aa97fa640 1 -- 172.21.15.170:0/31047461 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f7ab00117a0 con 0x5642d96a7d40 2024-01-25T15:03:34.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.280+0000 7f7acae28740 1 -- 172.21.15.170:0/31047461 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642d96030e0 con 0x5642d96a7d40 2024-01-25T15:03:34.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.280+0000 7f7aa97fa640 1 -- 172.21.15.170:0/31047461 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ab0011960 con 0x5642d96a7d40 2024-01-25T15:03:34.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.280+0000 7f7acae28740 10 client.15978 fetch_fsmap learned FSMap version 29 2024-01-25T15:03:34.291 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.280+0000 7f7acae28740 1 -- 172.21.15.170:0/31047461 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5642d96088d0 con 0x5642d96a7d40 2024-01-25T15:03:34.291 INFO:tasks.workunit.client.0.smithi170.stdout:8/135: symlink d3/d7/d22/d23/d25/l27 0 2024-01-25T15:03:34.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.280+0000 7f7aa97fa640 1 -- 172.21.15.170:0/31047461 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5642d96030e0 con 0x5642d96a7d40 2024-01-25T15:03:34.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.281+0000 7f7aa97fa640 1 -- 172.21.15.170:0/31047461 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 29) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f7ab001fb40 con 0x5642d96a7d40 2024-01-25T15:03:34.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.281+0000 7f7acae28740 10 client.15978 fetch_fsmap finished waiting for FSMap version 29 2024-01-25T15:03:34.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.281+0000 7f7acae28740 10 client.15978 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-01-25T15:03:34.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.281+0000 7f7acae28740 20 client.15978 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:34.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.281+0000 7f7acae28740 1 --2- 172.21.15.170:0/31047461 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5642d96bd3a0 0x5642d96bf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.281+0000 7f7acae28740 4 client.15978 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:34.292 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.281+0000 7f7acae28740 1 -- 172.21.15.170:0/31047461 --> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5642d9602e00 con 0x5642d96bd3a0 2024-01-25T15:03:34.293 INFO:tasks.workunit.client.0.smithi170.stdout:2/275: read d10/f13 [1539017,84087] 0 2024-01-25T15:03:34.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.281+0000 7f7ac5f25640 1 --2- 172.21.15.170:0/31047461 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5642d96bd3a0 0x5642d96bf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.281+0000 7f7aa97fa640 10 client.15978 ms_handle_connect on v2:172.21.15.191:6836/719224494 2024-01-25T15:03:34.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.281+0000 7f7ac5f25640 1 --2- 172.21.15.170:0/31047461 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5642d96bd3a0 0x5642d96bf7c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d6dd7e04738627b0 server_cookie=bd2e2d55d08eec1a in_seq=0 out_seq=0 2024-01-25T15:03:34.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.282+0000 7f7aa97fa640 1 -- 172.21.15.170:0/31047461 <== mds.2 v2:172.21.15.191:6836/719224494 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5642d9602e00 con 0x5642d96bd3a0 2024-01-25T15:03:34.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.282+0000 7f7aa97fa640 10 client.15978 handle_command_reply: tid=0 2024-01-25T15:03:34.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.282+0000 7f7acae28740 1 client.15978 shutdown 2024-01-25T15:03:34.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.282+0000 7f7acae28740 1 -- 172.21.15.170:0/31047461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7d40 msgr2=0x5642d96b1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.282+0000 7f7acae28740 1 --2- 172.21.15.170:0/31047461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7d40 0x5642d96b1b00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7ab000a010 tx=0x7f7ab0003910 comp rx=0 tx=0).stop 2024-01-25T15:03:34.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.282+0000 7f7acae28740 1 -- 172.21.15.170:0/31047461 shutdown_connections 2024-01-25T15:03:34.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.282+0000 7f7acae28740 1 --2- 172.21.15.170:0/31047461 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5642d96bd3a0 0x5642d96bf7c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.282+0000 7f7acae28740 1 --2- 172.21.15.170:0/31047461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96aceb0 0x5642d96b8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.282+0000 7f7acae28740 1 --2- 172.21.15.170:0/31047461 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7d40 0x5642d96b1b00 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.282+0000 7f7acae28740 1 --2- 172.21.15.170:0/31047461 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7350 0x5642d96b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.282+0000 7f7aa97fa640 0 client.15978 ms_handle_reset on v2:172.21.15.191:6836/719224494 2024-01-25T15:03:34.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.282+0000 7f7acae28740 1 -- 172.21.15.170:0/31047461 >> 172.21.15.170:0/31047461 conn(0x5642d969e4b0 msgr2=0x5642d969d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.283+0000 7f7acae28740 1 -- 172.21.15.170:0/31047461 shutdown_connections 2024-01-25T15:03:34.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.283+0000 7f7acae28740 1 -- 172.21.15.170:0/31047461 wait complete. 2024-01-25T15:03:34.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.283+0000 7f7acae28740 20 client.15978 trim_cache size 0 max 16384 2024-01-25T15:03:34.296 INFO:tasks.workunit.client.0.smithi170.stdout:5/151: rename d5/d10/c2f to d5/d10/d2c/c39 0 2024-01-25T15:03:34.296 INFO:tasks.workunit.client.0.smithi170.stdout:6/191: mkdir d2/d7/d23/d19/d2a/d43 0 2024-01-25T15:03:34.296 INFO:tasks.workunit.client.0.smithi170.stdout:0/190: symlink d8/d10/l41 0 2024-01-25T15:03:34.296 INFO:tasks.workunit.client.0.smithi170.stdout:6/192: read d2/f10 [2151362,87329] 0 2024-01-25T15:03:34.296 INFO:tasks.workunit.client.0.smithi170.stdout:0/191: creat d8/f42 x:0 0 0 2024-01-25T15:03:34.296 INFO:tasks.workunit.client.0.smithi170.stdout:0/192: chown d8/ff 13 1 2024-01-25T15:03:34.296 INFO:tasks.workunit.client.0.smithi170.stdout:3/187: sync 2024-01-25T15:03:34.296 INFO:tasks.workunit.client.0.smithi170.stdout:1/217: dread d0/fb [0,4194304] 0 2024-01-25T15:03:34.298 INFO:tasks.workunit.client.0.smithi170.stdout:6/193: mkdir d2/d7/d23/d19/d2a/d43/d44 0 2024-01-25T15:03:34.298 INFO:tasks.workunit.client.0.smithi170.stdout:6/194: write d2/f10 [3780756,80733] 0 2024-01-25T15:03:34.298 INFO:tasks.workunit.client.0.smithi170.stdout:0/193: symlink d8/d10/d2d/d2f/l43 0 2024-01-25T15:03:34.304 INFO:tasks.workunit.client.0.smithi170.stdout:8/136: dread d3/f9 [0,4194304] 0 2024-01-25T15:03:34.304 INFO:tasks.workunit.client.0.smithi170.stdout:3/188: mkdir d3/d10/d13/d1b/d29/d38/d42 0 2024-01-25T15:03:34.304 INFO:tasks.workunit.client.0.smithi170.stdout:3/189: truncate d3/d10/d1e/f30 32994 0 2024-01-25T15:03:34.304 INFO:tasks.workunit.client.0.smithi170.stdout:3/190: write d3/d10/f23 [387111,88598] 0 2024-01-25T15:03:34.305 INFO:tasks.workunit.client.0.smithi170.stdout:8/137: mkdir d3/d7/d28 0 2024-01-25T15:03:34.306 INFO:tasks.workunit.client.0.smithi170.stdout:8/138: dread - d3/d7/f12 zero size 2024-01-25T15:03:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.308+0000 7f7acae28740 1 Processor -- start 2024-01-25T15:03:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.308+0000 7f7acae28740 1 -- start start 2024-01-25T15:03:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.309+0000 7f7acae28740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96a7350 0x5642d96b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.309 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.309+0000 7f7acae28740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7d40 0x5642d96b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.309+0000 7f7acae28740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96aceb0 0x5642d96b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.309+0000 7f7acae28740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d969efa0 con 0x5642d96aceb0 2024-01-25T15:03:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.309+0000 7f7acae28740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d9602e00 con 0x5642d96a7350 2024-01-25T15:03:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.309+0000 7f7acae28740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d96030e0 con 0x5642d96a7d40 2024-01-25T15:03:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.309+0000 7f7ac5f25640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96a7350 0x5642d96b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.309+0000 7f7ac5f25640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96a7350 0x5642d96b15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:38274/0 (socket says 172.21.15.170:38274) 2024-01-25T15:03:34.310 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.309+0000 7f7ac5f25640 1 -- 172.21.15.170:0/2135062860 learned_addr learned my addr 172.21.15.170:0/2135062860 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.309+0000 7f7ac5724640 1 --2- 172.21.15.170:0/2135062860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7d40 0x5642d96b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.310+0000 7f7ac5f25640 1 -- 172.21.15.170:0/2135062860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7d40 msgr2=0x5642d96b8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.310+0000 7f7ac5f25640 1 --2- 172.21.15.170:0/2135062860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7d40 0x5642d96b8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.310+0000 7f7ac5f25640 1 -- 172.21.15.170:0/2135062860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96aceb0 msgr2=0x5642d96b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.310+0000 7f7ac5f25640 1 --2- 172.21.15.170:0/2135062860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96aceb0 0x5642d96b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.310+0000 7f7ac5f25640 1 -- 172.21.15.170:0/2135062860 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642d95a5500 con 0x5642d96a7350 2024-01-25T15:03:34.311 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.311+0000 7f7ac5f25640 1 --2- 172.21.15.170:0/2135062860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96a7350 0x5642d96b15c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009230 tx=0x7f7abc042000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27a383a0219f9835 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.311+0000 7f7aab7fe640 1 -- 172.21.15.170:0/2135062860 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc051040 con 0x5642d96a7350 2024-01-25T15:03:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.311+0000 7f7aab7fe640 1 -- 172.21.15.170:0/2135062860 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7abc044070 con 0x5642d96a7350 2024-01-25T15:03:34.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.311+0000 7f7aab7fe640 1 -- 172.21.15.170:0/2135062860 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc005260 con 0x5642d96a7350 2024-01-25T15:03:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.312+0000 7f7acae28740 1 -- 172.21.15.170:0/2135062860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96a7350 msgr2=0x5642d96b15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.312+0000 7f7acae28740 1 --2- 172.21.15.170:0/2135062860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96a7350 0x5642d96b15c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009230 tx=0x7f7abc042000 comp rx=0 tx=0).stop 2024-01-25T15:03:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.312+0000 7f7acae28740 1 -- 172.21.15.170:0/2135062860 shutdown_connections 2024-01-25T15:03:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.312+0000 7f7acae28740 1 --2- 172.21.15.170:0/2135062860 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96aceb0 0x5642d96b1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.312+0000 7f7acae28740 1 --2- 172.21.15.170:0/2135062860 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7d40 0x5642d96b8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.312+0000 7f7acae28740 1 --2- 172.21.15.170:0/2135062860 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96a7350 0x5642d96b15c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.312+0000 7f7acae28740 1 -- 172.21.15.170:0/2135062860 >> 172.21.15.170:0/2135062860 conn(0x5642d969e4b0 msgr2=0x5642d969e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.312+0000 7f7acae28740 1 -- 172.21.15.170:0/2135062860 shutdown_connections 2024-01-25T15:03:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.312+0000 7f7acae28740 1 -- 172.21.15.170:0/2135062860 wait complete. 2024-01-25T15:03:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.312+0000 7f7acae28740 1 -- start start 2024-01-25T15:03:34.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.313+0000 7f7acae28740 1 Processor -- start 2024-01-25T15:03:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.313+0000 7f7acae28740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7350 0x5642d96b89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.313+0000 7f7acae28740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7d40 0x5642d96b7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.313+0000 7f7acae28740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96aceb0 0x5642d96b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.313+0000 7f7acae28740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d96b7bd0 con 0x5642d96a7d40 2024-01-25T15:03:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.313+0000 7f7acae28740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d96b7d40 con 0x5642d96aceb0 2024-01-25T15:03:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.313+0000 7f7acae28740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d96b7f00 con 0x5642d96a7350 2024-01-25T15:03:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.313+0000 7f7acae28740 10 client.0 _ll_register_callbacks cb 0x7f7ab0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.313+0000 7f7ac5724640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7d40 0x5642d96b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.313+0000 7f7ac5724640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7d40 0x5642d96b7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54202/0 (socket says 172.21.15.170:54202) 2024-01-25T15:03:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.314+0000 7f7ac5724640 1 -- 172.21.15.170:0/3064290783 learned_addr learned my addr 172.21.15.170:0/3064290783 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.314+0000 7f7ac5f25640 1 --2- 172.21.15.170:0/3064290783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7350 0x5642d96b89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.314+0000 7f7ac5724640 1 -- 172.21.15.170:0/3064290783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7350 msgr2=0x5642d96b89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.314+0000 7f7ac5724640 1 --2- 172.21.15.170:0/3064290783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7350 0x5642d96b89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.314+0000 7f7ac5724640 1 -- 172.21.15.170:0/3064290783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96aceb0 msgr2=0x5642d96b75c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-25T15:03:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.314+0000 7f7ac5724640 1 --2- 172.21.15.170:0/3064290783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96aceb0 0x5642d96b75c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.314+0000 7f7ac5724640 1 -- 172.21.15.170:0/3064290783 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac00feda0 con 0x5642d96a7d40 2024-01-25T15:03:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.314+0000 7f7ac5f25640 1 --2- 172.21.15.170:0/3064290783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7350 0x5642d96b89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:03:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.314+0000 7f7ac5724640 1 --2- 172.21.15.170:0/3064290783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7d40 0x5642d96b7080 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0003630 tx=0x7f7ab0003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b193c45cf2351d39 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.314+0000 7f7aa97fa640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.314+0000 7f7aa97fa640 1 -- 172.21.15.170:0/3064290783 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00286d0 con 0x5642d96a7d40 2024-01-25T15:03:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.314+0000 7f7acae28740 1 -- 172.21.15.170:0/3064290783 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7ab00043b0 con 0x5642d96a7d40 2024-01-25T15:03:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.314+0000 7f7aa97fa640 1 -- 172.21.15.170:0/3064290783 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f7ab0000e40 con 0x5642d96a7d40 2024-01-25T15:03:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.315+0000 7f7aa97fa640 1 -- 172.21.15.170:0/3064290783 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ab0003980 con 0x5642d96a7d40 2024-01-25T15:03:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.315+0000 7f7acae28740 10 client.15981 fetch_fsmap learned FSMap version 29 2024-01-25T15:03:34.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.315+0000 7f7acae28740 1 -- 172.21.15.170:0/3064290783 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5642d95cb050 con 0x5642d96a7d40 2024-01-25T15:03:34.319 INFO:tasks.workunit.client.0.smithi170.stdout:2/276: dwrite f6 [0,4194304] 0 2024-01-25T15:03:34.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.315+0000 7f7aa97fa640 1 -- 172.21.15.170:0/3064290783 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ab0044020 con 0x5642d96a7d40 2024-01-25T15:03:34.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.315+0000 7f7aa97fa640 1 -- 172.21.15.170:0/3064290783 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 29) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f7ab0005070 con 0x5642d96a7d40 2024-01-25T15:03:34.319 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.315+0000 7f7acae28740 10 client.15981 fetch_fsmap finished waiting for FSMap version 29 2024-01-25T15:03:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.315+0000 7f7acae28740 10 client.15981 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-01-25T15:03:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.315+0000 7f7acae28740 20 client.15981 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.315+0000 7f7acae28740 1 --2- 172.21.15.170:0/3064290783 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5642d9714f40 0x5642d9717360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.315+0000 7f7acae28740 4 client.15981 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:03:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.315+0000 7f7acae28740 1 -- 172.21.15.170:0/3064290783 --> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5642d93097e0 con 0x5642d9714f40 2024-01-25T15:03:34.320 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.316+0000 7f7ac5f25640 1 --2- 172.21.15.170:0/3064290783 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5642d9714f40 0x5642d9717360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.320 INFO:tasks.workunit.client.0.smithi170.stdout:2/277: symlink d10/d1e/d32/l60 0 2024-01-25T15:03:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.317+0000 7f7ac5f25640 1 --2- 172.21.15.170:0/3064290783 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5642d9714f40 0x5642d9717360 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f10321ba452df8d server_cookie=dce502c38aa04a15 in_seq=0 out_seq=0 2024-01-25T15:03:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.317+0000 7f7aa97fa640 10 client.15981 ms_handle_connect on v2:172.21.15.191:6836/719224494 2024-01-25T15:03:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.317+0000 7f7aa97fa640 1 -- 172.21.15.170:0/3064290783 <== mds.2 v2:172.21.15.191:6836/719224494 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5642d93097e0 con 0x5642d9714f40 2024-01-25T15:03:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.317+0000 7f7aa97fa640 10 client.15981 handle_command_reply: tid=0 2024-01-25T15:03:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.317+0000 7f7acae28740 1 client.15981 shutdown 2024-01-25T15:03:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.318+0000 7f7acae28740 1 -- 172.21.15.170:0/3064290783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7d40 msgr2=0x5642d96b7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.321 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.318+0000 7f7acae28740 1 --2- 172.21.15.170:0/3064290783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7d40 0x5642d96b7080 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0003630 tx=0x7f7ab0003f40 comp rx=0 tx=0).stop 2024-01-25T15:03:34.322 INFO:tasks.workunit.client.0.smithi170.stdout:2/278: link d10/d16/f3b d10/d1e/d5e/f61 0 2024-01-25T15:03:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.318+0000 7f7acae28740 1 -- 172.21.15.170:0/3064290783 shutdown_connections 2024-01-25T15:03:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.318+0000 7f7acae28740 1 --2- 172.21.15.170:0/3064290783 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x5642d9714f40 0x5642d9717360 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.318+0000 7f7acae28740 1 --2- 172.21.15.170:0/3064290783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5642d96aceb0 0x5642d96b75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.318+0000 7f7acae28740 1 --2- 172.21.15.170:0/3064290783 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5642d96a7d40 0x5642d96b7080 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.318+0000 7f7aa97fa640 0 client.15981 ms_handle_reset on v2:172.21.15.191:6836/719224494 2024-01-25T15:03:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.318+0000 7f7acae28740 1 --2- 172.21.15.170:0/3064290783 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5642d96a7350 0x5642d96b89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.322 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.318+0000 7f7acae28740 1 -- 172.21.15.170:0/3064290783 >> 172.21.15.170:0/3064290783 conn(0x5642d969e4b0 msgr2=0x5642d96b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.318+0000 7f7acae28740 1 -- 172.21.15.170:0/3064290783 shutdown_connections 2024-01-25T15:03:34.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.318+0000 7f7acae28740 1 -- 172.21.15.170:0/3064290783 wait complete. 2024-01-25T15:03:34.323 INFO:tasks.workunit.client.0.smithi170.stdout:1/218: dwrite d0/f2f [0,4194304] 0 2024-01-25T15:03:34.323 INFO:tasks.workunit.client.0.smithi170.stdout:5/152: dwrite d5/f7 [0,4194304] 0 2024-01-25T15:03:34.323 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.319+0000 7f7acae28740 20 client.15981 trim_cache size 0 max 16384 2024-01-25T15:03:34.323 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:03:34.324 INFO:tasks.workunit.client.0.smithi170.stdout:3/191: getdents d3/d10/d13/d1b/d29/d38 0 2024-01-25T15:03:34.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.320+0000 7f7ac8189640 1 -- 172.21.15.170:0/1936000179 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7aac0a12e0 msgr2=0x7f7aac0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.320+0000 7f7ac8189640 1 --2- 172.21.15.170:0/1936000179 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7aac0a12e0 0x7f7aac0a37a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x5642d96a87b0 tx=0x7f7abc02c5d0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.320+0000 7f7ac8189640 1 -- 172.21.15.170:0/1936000179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac0101180 msgr2=0x7f7ac019e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.320+0000 7f7ac8189640 1 --2- 172.21.15.170:0/1936000179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac0101180 0x7f7ac019e300 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800eaa0 tx=0x7f7ab800ef60 comp rx=0 tx=0).stop 2024-01-25T15:03:34.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.320+0000 7f7ac8189640 1 -- 172.21.15.170:0/1936000179 shutdown_connections 2024-01-25T15:03:34.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.320+0000 7f7ac8189640 1 --2- 172.21.15.170:0/1936000179 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7aac0a12e0 0x7f7aac0a37a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.320+0000 7f7ac8189640 1 --2- 172.21.15.170:0/1936000179 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7ac0101180 0x7f7ac019e300 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.320+0000 7f7ac8189640 1 --2- 172.21.15.170:0/1936000179 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7ac0100870 0x7f7ac0197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.320+0000 7f7ac8189640 1 --2- 172.21.15.170:0/1936000179 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ac00ffeb0 0x7f7ac0196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.325 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.320+0000 7f7ac8189640 1 -- 172.21.15.170:0/1936000179 >> 172.21.15.170:0/1936000179 conn(0x7f7ac00fa8e0 msgr2=0x7f7ac0104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.326 INFO:tasks.workunit.client.0.smithi170.stdout:2/279: dread d10/d1b/f25 [0,4194304] 0 2024-01-25T15:03:34.326 INFO:tasks.workunit.client.0.smithi170.stdout:5/153: mkdir d5/d10/d2c/d3a 0 2024-01-25T15:03:34.326 INFO:tasks.workunit.client.0.smithi170.stdout:5/154: dread - d5/d10/d2c/f31 zero size 2024-01-25T15:03:34.326 INFO:tasks.workunit.client.0.smithi170.stdout:5/155: fdatasync d5/d10/d2c/f2d 0 2024-01-25T15:03:34.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.320+0000 7f7ac8189640 1 -- 172.21.15.170:0/1936000179 shutdown_connections 2024-01-25T15:03:34.326 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.320+0000 7f7ac8189640 1 -- 172.21.15.170:0/1936000179 wait complete. 2024-01-25T15:03:34.327 INFO:tasks.workunit.client.0.smithi170.stdout:3/192: truncate d3/f17 2650827 0 2024-01-25T15:03:34.327 INFO:tasks.workunit.client.0.smithi170.stdout:5/156: mknod d5/d2a/c3b 0 2024-01-25T15:03:34.327 INFO:tasks.workunit.client.0.smithi170.stdout:3/193: getdents d3 0 2024-01-25T15:03:34.327 INFO:tasks.workunit.client.0.smithi170.stdout:5/157: unlink d5/d10/f20 0 2024-01-25T15:03:34.327 INFO:tasks.workunit.client.0.smithi170.stdout:5/158: chown d5/f1e 203 1 2024-01-25T15:03:34.328 INFO:tasks.workunit.client.0.smithi170.stdout:5/159: symlink d5/d10/d2c/l3c 0 2024-01-25T15:03:34.330 INFO:tasks.workunit.client.0.smithi170.stdout:1/219: dread d0/d20/d28/f36 [0,4194304] 0 2024-01-25T15:03:34.330 INFO:tasks.workunit.client.0.smithi170.stdout:1/220: chown d0/d2e 2982 1 2024-01-25T15:03:34.330 INFO:tasks.workunit.client.0.smithi170.stdout:1/221: dread - d0/d20/d3a/f44 zero size 2024-01-25T15:03:34.330 INFO:tasks.workunit.client.0.smithi170.stdout:5/160: mkdir d5/d10/d2c/d3a/d3d 0 2024-01-25T15:03:34.332 INFO:tasks.workunit.client.0.smithi170.stdout:1/222: truncate d0/d1b/f1f 4733949 0 2024-01-25T15:03:34.332 INFO:tasks.workunit.client.0.smithi170.stdout:1/223: chown d0/d20/d3a 3047 1 2024-01-25T15:03:34.335 INFO:tasks.workunit.client.0.smithi170.stdout:1/224: unlink d0/d1b/f45 0 2024-01-25T15:03:34.337 INFO:tasks.workunit.client.0.smithi170.stdout:3/194: dread d3/d10/f1a [0,4194304] 0 2024-01-25T15:03:34.338 INFO:tasks.workunit.client.0.smithi170.stdout:3/195: rmdir d3/d10/d1e 39 2024-01-25T15:03:34.338 INFO:tasks.workunit.client.0.smithi170.stdout:3/196: truncate d3/d10/d1e/f20 657189 0 2024-01-25T15:03:34.339 INFO:tasks.workunit.client.0.smithi170.stdout:3/197: symlink d3/d2a/l43 0 2024-01-25T15:03:34.342 INFO:tasks.workunit.client.0.smithi170.stdout:3/198: read d3/d10/d1e/f30 [18597,40755] 0 2024-01-25T15:03:34.342 INFO:tasks.workunit.client.0.smithi170.stdout:5/161: dread d5/d10/f17 [0,4194304] 0 2024-01-25T15:03:34.342 INFO:tasks.workunit.client.0.smithi170.stdout:3/199: write d3/d10/d1e/f20 [895182,51264] 0 2024-01-25T15:03:34.342 INFO:tasks.workunit.client.0.smithi170.stdout:5/162: creat d5/d2a/f3e x:0 0 0 2024-01-25T15:03:34.343 INFO:tasks.workunit.client.0.smithi170.stdout:5/163: write d5/d10/d2c/f31 [617894,79998] 0 2024-01-25T15:03:34.344 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-01-25T15:03:34.345 INFO:tasks.workunit.client.0.smithi170.stdout:3/200: symlink d3/d10/d1e/d21/d41/l44 0 2024-01-25T15:03:34.346 INFO:tasks.workunit.client.0.smithi170.stdout:3/201: mknod d3/d1c/c45 0 2024-01-25T15:03:34.346 INFO:tasks.workunit.client.0.smithi170.stdout:3/202: fsync d3/d10/ff 0 2024-01-25T15:03:34.346 INFO:tasks.workunit.client.0.smithi170.stdout:3/203: chown d3/fa 289 1 2024-01-25T15:03:34.347 INFO:tasks.workunit.client.0.smithi170.stdout:0/194: dwrite d8/f42 [0,4194304] 0 2024-01-25T15:03:34.348 INFO:tasks.workunit.client.0.smithi170.stdout:3/204: link d3/d10/d13/c27 d3/d10/d13/d1b/d29/c46 0 2024-01-25T15:03:34.348 INFO:tasks.workunit.client.0.smithi170.stdout:3/205: chown d3/d10/d13/c27 3206028 1 2024-01-25T15:03:34.348 INFO:tasks.workunit.client.0.smithi170.stdout:3/206: readlink d3/d2a/l43 0 2024-01-25T15:03:34.349 INFO:tasks.workunit.client.0.smithi170.stdout:1/225: read d0/f1d [995381,70403] 0 2024-01-25T15:03:34.349 INFO:tasks.workunit.client.0.smithi170.stdout:0/195: truncate d8/f19 5162598 0 2024-01-25T15:03:34.349 INFO:tasks.workunit.client.0.smithi170.stdout:0/196: chown d8/f42 854 1 2024-01-25T15:03:34.349 INFO:tasks.workunit.client.0.smithi170.stdout:0/197: write d8/ff [3830761,6154] 0 2024-01-25T15:03:34.349 INFO:tasks.workunit.client.0.smithi170.stdout:0/198: chown d8/d9/ld 3 1 2024-01-25T15:03:34.349 INFO:tasks.workunit.client.0.smithi170.stdout:3/207: symlink d3/d10/d13/l47 0 2024-01-25T15:03:34.350 INFO:tasks.workunit.client.0.smithi170.stdout:8/139: dwrite d3/d7/f16 [0,4194304] 0 2024-01-25T15:03:34.351 INFO:tasks.workunit.client.0.smithi170.stdout:6/195: dwrite d2/f40 [0,4194304] 0 2024-01-25T15:03:34.352 INFO:tasks.workunit.client.0.smithi170.stdout:2/280: dwrite d10/f18 [0,4194304] 0 2024-01-25T15:03:34.352 INFO:tasks.workunit.client.0.smithi170.stdout:2/281: read d10/f12 [2886193,16493] 0 2024-01-25T15:03:34.352 INFO:tasks.workunit.client.0.smithi170.stdout:1/226: unlink d0/l14 0 2024-01-25T15:03:34.354 INFO:tasks.workunit.client.0.smithi170.stdout:3/208: dread d3/d10/d1e/f20 [0,4194304] 0 2024-01-25T15:03:34.354 INFO:tasks.workunit.client.0.smithi170.stdout:3/209: write d3/d10/d1e/f30 [105995,109891] 0 2024-01-25T15:03:34.363 INFO:tasks.workunit.client.0.smithi170.stdout:6/196: creat d2/d7/d23/d19/d2f/f45 x:0 0 0 2024-01-25T15:03:34.363 INFO:tasks.workunit.client.0.smithi170.stdout:6/197: read - d2/d7/d23/d19/d2f/d37/f3f zero size 2024-01-25T15:03:34.364 INFO:tasks.workunit.client.0.smithi170.stdout:6/198: rmdir d2/d7/d1b/d28 39 2024-01-25T15:03:34.366 INFO:tasks.workunit.client.0.smithi170.stdout:0/199: write d8/f42 [5113045,109567] 0 2024-01-25T15:03:34.367 INFO:tasks.workunit.client.0.smithi170.stdout:6/199: mknod d2/d7/d23/d19/d2f/c46 0 2024-01-25T15:03:34.372 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:34 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/534194234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:03:34.373 INFO:tasks.workunit.client.0.smithi170.stdout:3/210: write d3/d10/fe [8076,36669] 0 2024-01-25T15:03:34.377 INFO:tasks.workunit.client.0.smithi170.stdout:3/211: truncate d3/d10/d13/f1d 1441775 0 2024-01-25T15:03:34.378 INFO:tasks.workunit.client.0.smithi170.stdout:3/212: creat d3/d1c/d2d/f48 x:0 0 0 2024-01-25T15:03:34.379 INFO:tasks.workunit.client.0.smithi170.stdout:6/200: dread d2/f3 [0,4194304] 0 2024-01-25T15:03:34.380 INFO:tasks.workunit.client.0.smithi170.stdout:6/201: write d2/d7/d23/d19/d2f/d37/f3f [954402,25435] 0 2024-01-25T15:03:34.380 INFO:tasks.workunit.client.0.smithi170.stdout:6/202: write d2/d7/d23/d19/f20 [935351,49225] 0 2024-01-25T15:03:34.381 INFO:tasks.workunit.client.0.smithi170.stdout:6/203: mknod d2/d7/d23/d19/d2f/d37/c47 0 2024-01-25T15:03:34.381 INFO:tasks.workunit.client.0.smithi170.stdout:6/204: write d2/d7/f2e [2056280,50963] 0 2024-01-25T15:03:34.381 INFO:tasks.workunit.client.0.smithi170.stdout:0/200: read d8/d10/f15 [5333989,117703] 0 2024-01-25T15:03:34.381 INFO:tasks.workunit.client.0.smithi170.stdout:2/282: dwrite d10/d16/f19 [0,4194304] 0 2024-01-25T15:03:34.381 INFO:tasks.workunit.client.0.smithi170.stdout:2/283: write d10/d1e/d32/d3e/f46 [1028035,110821] 0 2024-01-25T15:03:34.382 INFO:tasks.workunit.client.0.smithi170.stdout:6/205: creat d2/d7/d23/d19/d2a/d43/d44/f48 x:0 0 0 2024-01-25T15:03:34.387 INFO:tasks.workunit.client.0.smithi170.stdout:0/201: mknod d8/d10/d2d/c44 0 2024-01-25T15:03:34.387 INFO:tasks.workunit.client.0.smithi170.stdout:0/202: truncate d8/d9/f16 2263844 0 2024-01-25T15:03:34.388 INFO:tasks.workunit.client.0.smithi170.stdout:2/284: mkdir d10/d1e/d32/d62 0 2024-01-25T15:03:34.389 INFO:tasks.workunit.client.0.smithi170.stdout:6/206: creat d2/d7/d1b/d28/f49 x:0 0 0 2024-01-25T15:03:34.389 INFO:tasks.workunit.client.0.smithi170.stdout:6/207: chown d2/d7/d23 234370 1 2024-01-25T15:03:34.389 INFO:tasks.workunit.client.0.smithi170.stdout:6/208: fdatasync d2/f40 0 2024-01-25T15:03:34.390 INFO:tasks.workunit.client.0.smithi170.stdout:0/203: mknod d8/d10/c45 0 2024-01-25T15:03:34.392 INFO:tasks.workunit.client.0.smithi170.stdout:0/204: link d8/d10/f2e d8/d9/f46 0 2024-01-25T15:03:34.393 INFO:tasks.workunit.client.0.smithi170.stdout:0/205: chown d8/d9/l21 309957 1 2024-01-25T15:03:34.393 INFO:tasks.workunit.client.0.smithi170.stdout:0/206: symlink d8/d18/d39/l47 0 2024-01-25T15:03:34.395 INFO:tasks.workunit.client.0.smithi170.stdout:0/207: unlink d8/f19 0 2024-01-25T15:03:34.395 INFO:tasks.workunit.client.0.smithi170.stdout:0/208: read d8/d10/f15 [6214980,3851] 0 2024-01-25T15:03:34.396 INFO:tasks.workunit.client.0.smithi170.stdout:4/171: sync 2024-01-25T15:03:34.397 INFO:tasks.workunit.client.0.smithi170.stdout:4/172: mknod d6/d7/d1b/c32 0 2024-01-25T15:03:34.397 INFO:tasks.workunit.client.0.smithi170.stdout:4/173: fdatasync f2 0 2024-01-25T15:03:34.397 INFO:tasks.workunit.client.0.smithi170.stdout:4/174: creat d6/d7/d1b/f33 x:0 0 0 2024-01-25T15:03:34.402 INFO:tasks.workunit.client.0.smithi170.stdout:6/209: dread d2/f40 [0,4194304] 0 2024-01-25T15:03:34.404 INFO:tasks.workunit.client.0.smithi170.stdout:6/210: creat d2/d7/f4a x:0 0 0 2024-01-25T15:03:34.404 INFO:tasks.workunit.client.0.smithi170.stdout:6/211: mknod d2/d7/d23/d19/d2a/c4b 0 2024-01-25T15:03:34.406 INFO:tasks.workunit.client.0.smithi170.stdout:6/212: mknod d2/c4c 0 2024-01-25T15:03:34.407 INFO:tasks.workunit.client.0.smithi170.stdout:6/213: symlink d2/d7/d23/d19/d2f/d37/l4d 0 2024-01-25T15:03:34.407 INFO:tasks.workunit.client.0.smithi170.stdout:6/214: chown d2/d7/d23/d19/d2f 519367 1 2024-01-25T15:03:34.408 INFO:tasks.workunit.client.0.smithi170.stdout:0/209: write d8/d9/f29 [4064190,22720] 0 2024-01-25T15:03:34.413 INFO:tasks.workunit.client.0.smithi170.stdout:0/210: dread f6 [0,4194304] 0 2024-01-25T15:03:34.414 INFO:tasks.workunit.client.0.smithi170.stdout:0/211: mknod d8/d3a/c48 0 2024-01-25T15:03:34.418 INFO:tasks.workunit.client.0.smithi170.stdout:6/215: getdents d2/d7/d23/d19/d2a 0 2024-01-25T15:03:34.420 INFO:tasks.workunit.client.0.smithi170.stdout:6/216: symlink d2/d7/d23/d19/l4e 0 2024-01-25T15:03:34.420 INFO:tasks.workunit.client.0.smithi170.stdout:6/217: write d2/d7/f2e [3929174,110205] 0 2024-01-25T15:03:34.420 INFO:tasks.workunit.client.0.smithi170.stdout:6/218: creat d2/f4f x:0 0 0 2024-01-25T15:03:34.420 INFO:tasks.workunit.client.0.smithi170.stdout:4/175: dwrite d6/d7/d1b/f1e [0,4194304] 0 2024-01-25T15:03:34.422 INFO:tasks.workunit.client.0.smithi170.stdout:0/212: write d8/d10/d2d/d2f/f37 [799005,59032] 0 2024-01-25T15:03:34.425 INFO:tasks.workunit.client.0.smithi170.stdout:0/213: symlink d8/d3e/l49 0 2024-01-25T15:03:34.425 INFO:tasks.workunit.client.0.smithi170.stdout:0/214: fdatasync d8/fa 0 2024-01-25T15:03:34.430 INFO:tasks.workunit.client.0.smithi170.stdout:4/176: rename d6/d11 to d6/d7/d34 0 2024-01-25T15:03:34.430 INFO:tasks.workunit.client.0.smithi170.stdout:4/177: stat d6/d28/c2f 0 2024-01-25T15:03:34.440 INFO:tasks.workunit.client.0.smithi170.stdout:0/215: dread d8/d10/f15 [4194304,4194304] 0 2024-01-25T15:03:34.440 INFO:tasks.workunit.client.0.smithi170.stdout:0/216: truncate d8/d10/f2e 233407 0 2024-01-25T15:03:34.441 INFO:tasks.workunit.client.0.smithi170.stdout:4/178: dread d6/d7/d34/f30 [0,4194304] 0 2024-01-25T15:03:34.441 INFO:tasks.workunit.client.0.smithi170.stdout:6/219: dwrite d2/d7/d23/d19/d2a/d43/d44/f48 [0,4194304] 0 2024-01-25T15:03:34.441 INFO:tasks.workunit.client.0.smithi170.stdout:4/179: readlink d6/l1f 0 2024-01-25T15:03:34.441 INFO:tasks.workunit.client.0.smithi170.stdout:6/220: chown d2/l16 77 1 2024-01-25T15:03:34.441 INFO:tasks.workunit.client.0.smithi170.stdout:6/221: read d2/d7/d23/d19/f20 [585526,66042] 0 2024-01-25T15:03:34.441 INFO:tasks.workunit.client.0.smithi170.stdout:6/222: write d2/d7/d23/d19/d2f/f32 [3064492,62548] 0 2024-01-25T15:03:34.441 INFO:tasks.workunit.client.0.smithi170.stdout:6/223: creat d2/d7/d23/d19/d2f/d37/f50 x:0 0 0 2024-01-25T15:03:34.441 INFO:tasks.workunit.client.0.smithi170.stdout:6/224: getdents d2/d7/d23/d19/d2a 0 2024-01-25T15:03:34.441 INFO:tasks.workunit.client.0.smithi170.stdout:0/217: rename d8/d10/d2d/d2f/l35 to d8/d3a/l4a 0 2024-01-25T15:03:34.441 INFO:tasks.workunit.client.0.smithi170.stdout:0/218: creat d8/d10/f4b x:0 0 0 2024-01-25T15:03:34.441 INFO:tasks.workunit.client.0.smithi170.stdout:4/180: unlink d6/c20 0 2024-01-25T15:03:34.441 INFO:tasks.workunit.client.0.smithi170.stdout:4/181: chown f2 70984 1 2024-01-25T15:03:34.442 INFO:tasks.workunit.client.0.smithi170.stdout:6/225: creat d2/d7/d23/d19/d2a/d43/f51 x:0 0 0 2024-01-25T15:03:34.442 INFO:tasks.workunit.client.0.smithi170.stdout:6/226: write d2/d7/f18 [4987289,48434] 0 2024-01-25T15:03:34.444 INFO:tasks.workunit.client.0.smithi170.stdout:0/219: symlink d8/d18/l4c 0 2024-01-25T15:03:34.445 INFO:tasks.workunit.client.0.smithi170.stdout:6/227: mknod d2/d7/d1b/d28/c52 0 2024-01-25T15:03:34.445 INFO:tasks.workunit.client.0.smithi170.stdout:6/228: readlink d2/d7/l15 0 2024-01-25T15:03:34.446 INFO:tasks.workunit.client.0.smithi170.stdout:0/220: unlink d8/c27 0 2024-01-25T15:03:34.446 INFO:tasks.workunit.client.0.smithi170.stdout:0/221: dread - d8/f38 zero size 2024-01-25T15:03:34.446 INFO:tasks.workunit.client.0.smithi170.stdout:0/222: creat d8/d18/f4d x:0 0 0 2024-01-25T15:03:34.447 INFO:tasks.workunit.client.0.smithi170.stdout:0/223: symlink d8/d18/d39/l4e 0 2024-01-25T15:03:34.449 INFO:tasks.workunit.client.0.smithi170.stdout:4/182: write d6/d7/f14 [184249,52605] 0 2024-01-25T15:03:34.451 INFO:tasks.workunit.client.0.smithi170.stdout:0/224: dread d8/d9/fe [0,4194304] 0 2024-01-25T15:03:34.451 INFO:tasks.workunit.client.0.smithi170.stdout:4/183: truncate d6/d7/f9 1698046 0 2024-01-25T15:03:34.458 INFO:tasks.workunit.client.0.smithi170.stdout:0/225: rename d8/d18/d39 to d8/d10/d2d/d2f/d4f 0 2024-01-25T15:03:34.459 INFO:tasks.workunit.client.0.smithi170.stdout:0/226: readlink d8/d10/d2d/d2f/d4f/l4e 0 2024-01-25T15:03:34.459 INFO:tasks.workunit.client.0.smithi170.stdout:0/227: fsync d8/d9/f16 0 2024-01-25T15:03:34.460 INFO:tasks.workunit.client.0.smithi170.stdout:6/229: dread d2/d7/d23/d19/d2f/f32 [0,4194304] 0 2024-01-25T15:03:34.461 INFO:tasks.workunit.client.0.smithi170.stdout:6/230: fdatasync d2/d7/d23/d19/d2f/d37/f50 0 2024-01-25T15:03:34.461 INFO:tasks.workunit.client.0.smithi170.stdout:6/231: write d2/d7/d23/d19/d2f/d37/f3f [1045771,77238] 0 2024-01-25T15:03:34.461 INFO:tasks.workunit.client.0.smithi170.stdout:6/232: rename d2 to d2/d7/d23/d53 22 2024-01-25T15:03:34.463 INFO:tasks.workunit.client.0.smithi170.stdout:0/228: dread f6 [0,4194304] 0 2024-01-25T15:03:34.465 INFO:tasks.workunit.client.0.smithi170.stdout:0/229: truncate d8/d10/f15 5764297 0 2024-01-25T15:03:34.465 INFO:tasks.workunit.client.0.smithi170.stdout:0/230: fsync d8/d9/fe 0 2024-01-25T15:03:34.475 INFO:tasks.workunit.client.0.smithi170.stdout:4/184: dwrite d6/d7/f1a [0,4194304] 0 2024-01-25T15:03:34.475 INFO:tasks.workunit.client.0.smithi170.stdout:4/185: write d6/f26 [3233103,48858] 0 2024-01-25T15:03:34.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.481+0000 7f7c53fff640 1 -- 172.21.15.170:0/3038702749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c54100cf0 msgr2=0x7f7c54101170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.481+0000 7f7c53fff640 1 --2- 172.21.15.170:0/3038702749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c54100cf0 0x7f7c54101170 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009900 tx=0x7f7c3c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:03:34.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.481+0000 7f7c53fff640 1 -- 172.21.15.170:0/3038702749 shutdown_connections 2024-01-25T15:03:34.482 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.481+0000 7f7c53fff640 1 --2- 172.21.15.170:0/3038702749 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c541016b0 0x7f7c54107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.481+0000 7f7c53fff640 1 --2- 172.21.15.170:0/3038702749 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c54100cf0 0x7f7c54101170 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.481+0000 7f7c53fff640 1 --2- 172.21.15.170:0/3038702749 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c540ffb00 0x7f7c540fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.481+0000 7f7c53fff640 1 -- 172.21.15.170:0/3038702749 >> 172.21.15.170:0/3038702749 conn(0x7f7c540fb070 msgr2=0x7f7c540fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.481+0000 7f7c53fff640 1 -- 172.21.15.170:0/3038702749 shutdown_connections 2024-01-25T15:03:34.483 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.481+0000 7f7c53fff640 1 -- 172.21.15.170:0/3038702749 wait complete. 2024-01-25T15:03:34.483 INFO:tasks.workunit.client.0.smithi170.stdout:6/233: dwrite d2/d7/d23/d19/d2f/d37/f50 [0,4194304] 0 2024-01-25T15:03:34.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.482+0000 7f7c53fff640 1 Processor -- start 2024-01-25T15:03:34.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.482+0000 7f7c53fff640 1 -- start start 2024-01-25T15:03:34.484 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.482+0000 7f7c53fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c540ffb00 0x7f7c5410a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.482+0000 7f7c53fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c54100cf0 0x7f7c54108a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.482+0000 7f7c53fff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c541016b0 0x7f7c54108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.483+0000 7f7c53fff640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c541096a0 con 0x7f7c540ffb00 2024-01-25T15:03:34.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.483+0000 7f7c53fff640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54109810 con 0x7f7c54100cf0 2024-01-25T15:03:34.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.483+0000 7f7c53fff640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c541a0bc0 con 0x7f7c541016b0 2024-01-25T15:03:34.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.483+0000 7f7c52ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c540ffb00 0x7f7c5410a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.483+0000 7f7c52ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c540ffb00 0x7f7c5410a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54214/0 (socket says 172.21.15.170:54214) 2024-01-25T15:03:34.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.483+0000 7f7c52ffd640 1 -- 172.21.15.170:0/910191465 learned_addr learned my addr 172.21.15.170:0/910191465 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.483+0000 7f7c4bfff640 1 --2- 172.21.15.170:0/910191465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c54100cf0 0x7f7c54108a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.485 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.483+0000 7f7c52ffd640 1 -- 172.21.15.170:0/910191465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c541016b0 msgr2=0x7f7c54108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.483+0000 7f7c52ffd640 1 --2- 172.21.15.170:0/910191465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c541016b0 0x7f7c54108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.483+0000 7f7c52ffd640 1 -- 172.21.15.170:0/910191465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c54100cf0 msgr2=0x7f7c54108a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.483+0000 7f7c52ffd640 1 --2- 172.21.15.170:0/910191465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c54100cf0 0x7f7c54108a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.486 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.483+0000 7f7c52ffd640 1 -- 172.21.15.170:0/910191465 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3c009560 con 0x7f7c540ffb00 2024-01-25T15:03:34.486 INFO:tasks.workunit.client.0.smithi170.stdout:7/254: sync 2024-01-25T15:03:34.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.483+0000 7f7c52ffd640 1 --2- 172.21.15.170:0/910191465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c540ffb00 0x7f7c5410a3c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400e9f0 tx=0x7f7c4400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.484+0000 7f7c50ff9640 1 -- 172.21.15.170:0/910191465 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44009700 con 0x7f7c540ffb00 2024-01-25T15:03:34.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.484+0000 7f7c50ff9640 1 -- 172.21.15.170:0/910191465 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c440044e0 con 0x7f7c540ffb00 2024-01-25T15:03:34.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.484+0000 7f7c53fff640 1 -- 172.21.15.170:0/910191465 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c541a0e70 con 0x7f7c540ffb00 2024-01-25T15:03:34.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.484+0000 7f7c53fff640 1 -- 172.21.15.170:0/910191465 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c541a12f0 con 0x7f7c540ffb00 2024-01-25T15:03:34.487 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.484+0000 7f7c50ff9640 1 -- 172.21.15.170:0/910191465 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c44010430 con 0x7f7c540ffb00 2024-01-25T15:03:34.487 INFO:tasks.workunit.client.0.smithi170.stdout:6/234: getdents d2/d7 0 2024-01-25T15:03:34.489 INFO:tasks.workunit.client.0.smithi170.stdout:4/186: write f2 [8058112,56092] 0 2024-01-25T15:03:34.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.489+0000 7f7c50ff9640 1 -- 172.21.15.170:0/910191465 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f7c4400cd80 con 0x7f7c540ffb00 2024-01-25T15:03:34.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.489+0000 7f7c5c1c2740 1 Processor -- start 2024-01-25T15:03:34.490 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.489+0000 7f7c5c1c2740 1 -- start start 2024-01-25T15:03:34.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.490+0000 7f7c5c1c2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed783130 0x55aaed783550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.490+0000 7f7c5c1c2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 0x55aaed788620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.490+0000 7f7c5c1c2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed788c90 0x55aaed78b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.491 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.490+0000 7f7c5c1c2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaed6f1270 con 0x55aaed788c90 2024-01-25T15:03:34.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.490+0000 7f7c5c1c2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaed6ee960 con 0x55aaed783b20 2024-01-25T15:03:34.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.490+0000 7f7c5c1c2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaed6ea250 con 0x55aaed783130 2024-01-25T15:03:34.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.490+0000 7f7c4bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed788c90 0x55aaed78b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.490+0000 7f7c4bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed788c90 0x55aaed78b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54224/0 (socket says 172.21.15.170:54224) 2024-01-25T15:03:34.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.490+0000 7f7c4bfff640 1 -- 172.21.15.170:0/3528227444 learned_addr learned my addr 172.21.15.170:0/3528227444 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.490+0000 7f7c50ff9640 1 --2- 172.21.15.170:0/910191465 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7c400a13e0 0x7f7c400a38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.491+0000 7f7c4bfff640 1 -- 172.21.15.170:0/3528227444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed783130 msgr2=0x55aaed783550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.491+0000 7f7c4bfff640 1 --2- 172.21.15.170:0/3528227444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed783130 0x55aaed783550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.491+0000 7f7c4bfff640 1 -- 172.21.15.170:0/3528227444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 msgr2=0x55aaed788620 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-01-25T15:03:34.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.491+0000 7f7c4bfff640 1 --2- 172.21.15.170:0/3528227444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 0x55aaed788620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.491+0000 7f7c4bfff640 1 -- 172.21.15.170:0/3528227444 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aaed6ac7f0 con 0x55aaed788c90 2024-01-25T15:03:34.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.491+0000 7f7c50ff9640 1 -- 172.21.15.170:0/910191465 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f7c44014070 con 0x7f7c540ffb00 2024-01-25T15:03:34.492 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.491+0000 7f7c4bfff640 1 --2- 172.21.15.170:0/3528227444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed788c90 0x55aaed78b120 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c02c7e0 tx=0x7f7c3c004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d9b2991955b677 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.491+0000 7f7c537fe640 1 --2- 172.21.15.170:0/910191465 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7c400a13e0 0x7f7c400a38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.491+0000 7f7c497fa640 1 -- 172.21.15.170:0/3528227444 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c02c900 con 0x55aaed788c90 2024-01-25T15:03:34.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.491+0000 7f7c497fa640 1 -- 172.21.15.170:0/3528227444 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c3c02ca60 con 0x55aaed788c90 2024-01-25T15:03:34.494 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.491+0000 7f7c497fa640 1 -- 172.21.15.170:0/3528227444 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0052f0 con 0x55aaed788c90 2024-01-25T15:03:34.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.492+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/3528227444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed788c90 msgr2=0x55aaed78b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.492+0000 7f7c537fe640 1 --2- 172.21.15.170:0/910191465 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7c400a13e0 0x7f7c400a38a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c009810 tx=0x7f7c4c009760 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.492+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/3528227444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed788c90 0x55aaed78b120 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c02c7e0 tx=0x7f7c3c004dd0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.492+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/3528227444 shutdown_connections 2024-01-25T15:03:34.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.492+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/3528227444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 0x55aaed788620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.492+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/3528227444 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed788c90 0x55aaed78b120 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.492+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/3528227444 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed783130 0x55aaed783550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.492+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/3528227444 >> 172.21.15.170:0/3528227444 conn(0x55aaed77e6a0 msgr2=0x55aaed77eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.492+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/3528227444 shutdown_connections 2024-01-25T15:03:34.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.492+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/3528227444 wait complete. 2024-01-25T15:03:34.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.493+0000 7f7c5c1c2740 1 -- start start 2024-01-25T15:03:34.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.493+0000 7f7c5c1c2740 1 Processor -- start 2024-01-25T15:03:34.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.493+0000 7f7c5c1c2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed783130 0x55aaed78d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.493+0000 7f7c5c1c2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 0x55aaed78d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.495 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.493+0000 7f7c5c1c2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed788c90 0x55aaed794830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.493+0000 7f7c5c1c2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaed6a3610 con 0x55aaed788c90 2024-01-25T15:03:34.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.493+0000 7f7c5c1c2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaed6a32b0 con 0x55aaed783b20 2024-01-25T15:03:34.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.493+0000 7f7c5c1c2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaed668400 con 0x55aaed783130 2024-01-25T15:03:34.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.493+0000 7f7c5c1c2740 10 client.0 _ll_register_callbacks cb 0x55aaed6e0ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:34.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.493+0000 7f7c4bfff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 0x55aaed78d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.493+0000 7f7c4bfff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 0x55aaed78d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:38310/0 (socket says 172.21.15.170:38310) 2024-01-25T15:03:34.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.494+0000 7f7c4bfff640 1 -- 172.21.15.170:0/1097994216 learned_addr learned my addr 172.21.15.170:0/1097994216 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.494+0000 7f7c537fe640 1 --2- 172.21.15.170:0/1097994216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed788c90 0x55aaed794830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.494+0000 7f7c52ffd640 1 --2- 172.21.15.170:0/1097994216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed783130 0x55aaed78d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.496 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.494+0000 7f7c52ffd640 1 -- 172.21.15.170:0/1097994216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 msgr2=0x55aaed78d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.494+0000 7f7c52ffd640 1 --2- 172.21.15.170:0/1097994216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 0x55aaed78d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.494+0000 7f7c52ffd640 1 -- 172.21.15.170:0/1097994216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed788c90 msgr2=0x55aaed794830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.494+0000 7f7c52ffd640 1 --2- 172.21.15.170:0/1097994216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed788c90 0x55aaed794830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.497 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.494+0000 7f7c52ffd640 1 -- 172.21.15.170:0/1097994216 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c54068d60 con 0x55aaed783130 2024-01-25T15:03:34.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.494+0000 7f7c537fe640 1 --2- 172.21.15.170:0/1097994216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed788c90 0x55aaed794830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:34.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.494+0000 7f7c4bfff640 1 --2- 172.21.15.170:0/1097994216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 0x55aaed78d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:34.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.494+0000 7f7c52ffd640 1 --2- 172.21.15.170:0/1097994216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed783130 0x55aaed78d2b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55aaed784590 tx=0x7f7c440999d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9082a62ba0ceaad9 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.494+0000 7f7c3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-01-25T15:03:34.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.494+0000 7f7c3a7fc640 1 -- 172.21.15.170:0/1097994216 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440a2340 con 0x55aaed783130 2024-01-25T15:03:34.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.494+0000 7f7c3a7fc640 1 -- 172.21.15.170:0/1097994216 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f7c440994a0 con 0x55aaed783130 2024-01-25T15:03:34.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.494+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/1097994216 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aaed6e30e0 con 0x55aaed783130 2024-01-25T15:03:34.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.495+0000 7f7c3a7fc640 1 -- 172.21.15.170:0/1097994216 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c44099660 con 0x55aaed783130 2024-01-25T15:03:34.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.496+0000 7f7c5c1c2740 10 client.25321 fetch_fsmap learned FSMap version 30 2024-01-25T15:03:34.498 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.496+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/1097994216 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55aaed6e88d0 con 0x55aaed783130 2024-01-25T15:03:34.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.497+0000 7f7c3a7fc640 1 -- 172.21.15.170:0/1097994216 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c440a6080 con 0x55aaed783130 2024-01-25T15:03:34.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.497+0000 7f7c3a7fc640 1 -- 172.21.15.170:0/1097994216 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 30) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f7c4401f060 con 0x55aaed783130 2024-01-25T15:03:34.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.497+0000 7f7c5c1c2740 10 client.25321 fetch_fsmap finished waiting for FSMap version 30 2024-01-25T15:03:34.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.497+0000 7f7c5c1c2740 10 client.25321 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-01-25T15:03:34.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.497+0000 7f7c5c1c2740 20 client.25321 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:34.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.497+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/1097994216 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55aaed799190 0x55aaed79b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.499 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.497+0000 7f7c5c1c2740 4 client.25321 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:34.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.497+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/1097994216 --> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aaed6e30e0 con 0x55aaed799190 2024-01-25T15:03:34.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.498+0000 7f7c4bfff640 1 --2- 172.21.15.170:0/1097994216 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55aaed799190 0x55aaed79b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.499+0000 7f7c4bfff640 1 --2- 172.21.15.170:0/1097994216 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55aaed799190 0x55aaed79b5e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c6ec1c2f52af8f1e server_cookie=ca9cc4b0c9fa8cd6 in_seq=0 out_seq=0 2024-01-25T15:03:34.500 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.499+0000 7f7c3a7fc640 10 client.25321 ms_handle_connect on v2:172.21.15.186:6838/2132502182 2024-01-25T15:03:34.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.500+0000 7f7c3a7fc640 1 -- 172.21.15.170:0/1097994216 <== mds.1 v2:172.21.15.186:6838/2132502182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55aaed6e30e0 con 0x55aaed799190 2024-01-25T15:03:34.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.500+0000 7f7c3a7fc640 10 client.25321 handle_command_reply: tid=0 2024-01-25T15:03:34.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.501+0000 7f7c5c1c2740 1 client.25321 shutdown 2024-01-25T15:03:34.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.501+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/1097994216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed783130 msgr2=0x55aaed78d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.501+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/1097994216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed783130 0x55aaed78d2b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55aaed784590 tx=0x7f7c440999d0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.501+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/1097994216 shutdown_connections 2024-01-25T15:03:34.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.501+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/1097994216 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55aaed799190 0x55aaed79b5e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.501+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/1097994216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 0x55aaed78d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.501+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/1097994216 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed788c90 0x55aaed794830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.501+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/1097994216 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed783130 0x55aaed78d2b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.502 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.501+0000 7f7c3a7fc640 0 client.25321 ms_handle_reset on v2:172.21.15.186:6838/2132502182 2024-01-25T15:03:34.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.501+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/1097994216 >> 172.21.15.170:0/1097994216 conn(0x55aaed77e6a0 msgr2=0x55aaed77d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.501+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/1097994216 shutdown_connections 2024-01-25T15:03:34.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.501+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/1097994216 wait complete. 2024-01-25T15:03:34.503 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.501+0000 7f7c5c1c2740 20 client.25321 trim_cache size 0 max 16384 2024-01-25T15:03:34.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.513+0000 7f7c5c1c2740 1 Processor -- start 2024-01-25T15:03:34.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.513+0000 7f7c5c1c2740 1 -- start start 2024-01-25T15:03:34.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.513+0000 7f7c5c1c2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed783130 0x55aaed78cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.513+0000 7f7c5c1c2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed783b20 0x55aaed7947f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.513+0000 7f7c5c1c2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed788c90 0x55aaed78d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.513+0000 7f7c5c1c2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaed77f0f0 con 0x55aaed783b20 2024-01-25T15:03:34.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.513+0000 7f7c5c1c2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaed78e320 con 0x55aaed788c90 2024-01-25T15:03:34.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.513+0000 7f7c5c1c2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaed797720 con 0x55aaed783130 2024-01-25T15:03:34.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.513+0000 7f7c4bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed783b20 0x55aaed7947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.517 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.513+0000 7f7c4bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed783b20 0x55aaed7947f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54240/0 (socket says 172.21.15.170:54240) 2024-01-25T15:03:34.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.513+0000 7f7c4bfff640 1 -- 172.21.15.170:0/1750909936 learned_addr learned my addr 172.21.15.170:0/1750909936 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.513+0000 7f7c52ffd640 1 --2- 172.21.15.170:0/1750909936 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed783130 0x55aaed78cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.514+0000 7f7c537fe640 1 --2- 172.21.15.170:0/1750909936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed788c90 0x55aaed78d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.514+0000 7f7c4bfff640 1 -- 172.21.15.170:0/1750909936 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed783130 msgr2=0x55aaed78cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.514+0000 7f7c4bfff640 1 --2- 172.21.15.170:0/1750909936 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed783130 0x55aaed78cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.514+0000 7f7c4bfff640 1 -- 172.21.15.170:0/1750909936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed788c90 msgr2=0x55aaed78d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.514+0000 7f7c4bfff640 1 --2- 172.21.15.170:0/1750909936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed788c90 0x55aaed78d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.514+0000 7f7c4bfff640 1 -- 172.21.15.170:0/1750909936 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aaed685500 con 0x55aaed783b20 2024-01-25T15:03:34.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.514+0000 7f7c4bfff640 1 --2- 172.21.15.170:0/1750909936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed783b20 0x55aaed7947f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c004650 tx=0x7f7c3c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd409dd64576396a server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.514+0000 7f7c48ff9640 1 -- 172.21.15.170:0/1750909936 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c04f040 con 0x55aaed783b20 2024-01-25T15:03:34.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.514+0000 7f7c48ff9640 1 -- 172.21.15.170:0/1750909936 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c3c051040 con 0x55aaed783b20 2024-01-25T15:03:34.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.514+0000 7f7c48ff9640 1 -- 172.21.15.170:0/1750909936 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c04a450 con 0x55aaed783b20 2024-01-25T15:03:34.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/1750909936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed783b20 msgr2=0x55aaed7947f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/1750909936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed783b20 0x55aaed7947f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c004650 tx=0x7f7c3c000bc0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/1750909936 shutdown_connections 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/1750909936 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed788c90 0x55aaed78d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/1750909936 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed783b20 0x55aaed7947f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/1750909936 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed783130 0x55aaed78cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/1750909936 >> 172.21.15.170:0/1750909936 conn(0x55aaed77e6a0 msgr2=0x55aaed785040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/1750909936 shutdown_connections 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/1750909936 wait complete. 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 -- start start 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 Processor -- start 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed783130 0x55aaed794590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 0x55aaed792c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed788c90 0x55aaed793180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaed793710 con 0x55aaed783130 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaed793880 con 0x55aaed783b20 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaed793a40 con 0x55aaed788c90 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.515+0000 7f7c5c1c2740 10 client.0 _ll_register_callbacks cb 0x7f7c44005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:34.519 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c52ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed783130 0x55aaed794590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c4bfff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 0x55aaed792c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c52ffd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed783130 0x55aaed794590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54244/0 (socket says 172.21.15.170:54244) 2024-01-25T15:03:34.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c52ffd640 1 -- 172.21.15.170:0/3896725833 learned_addr learned my addr 172.21.15.170:0/3896725833 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.520 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c537fe640 1 --2- 172.21.15.170:0/3896725833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed788c90 0x55aaed793180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.520 INFO:tasks.workunit.client.0.smithi170.stdout:7/255: dwrite d8/f5d [0,4194304] 0 2024-01-25T15:03:34.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c52ffd640 1 -- 172.21.15.170:0/3896725833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed788c90 msgr2=0x55aaed793180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c52ffd640 1 --2- 172.21.15.170:0/3896725833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed788c90 0x55aaed793180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c52ffd640 1 -- 172.21.15.170:0/3896725833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 msgr2=0x55aaed792c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c52ffd640 1 --2- 172.21.15.170:0/3896725833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 0x55aaed792c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c52ffd640 1 -- 172.21.15.170:0/3896725833 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aaed6ac7f0 con 0x55aaed783130 2024-01-25T15:03:34.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c4bfff640 1 --2- 172.21.15.170:0/3896725833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 0x55aaed792c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:34.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c52ffd640 1 --2- 172.21.15.170:0/3896725833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed783130 0x55aaed794590 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400c6a0 tx=0x7f7c44003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797b7454ca38e46d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c3a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:34.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c3a7fc640 1 -- 172.21.15.170:0/3896725833 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c440a9070 con 0x55aaed783130 2024-01-25T15:03:34.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/3896725833 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c3c02ca60 con 0x55aaed783130 2024-01-25T15:03:34.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c3a7fc640 1 -- 172.21.15.170:0/3896725833 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f7c440a2340 con 0x55aaed783130 2024-01-25T15:03:34.523 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c3a7fc640 1 -- 172.21.15.170:0/3896725833 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c44099d80 con 0x55aaed783130 2024-01-25T15:03:34.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c5c1c2740 10 client.15999 fetch_fsmap learned FSMap version 30 2024-01-25T15:03:34.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/3896725833 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55aaed6ab050 con 0x55aaed783130 2024-01-25T15:03:34.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.516+0000 7f7c3a7fc640 1 -- 172.21.15.170:0/3896725833 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c3c02ca60 con 0x55aaed783130 2024-01-25T15:03:34.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.517+0000 7f7c3a7fc640 1 -- 172.21.15.170:0/3896725833 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f7c440ac020 con 0x55aaed783130 2024-01-25T15:03:34.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.517+0000 7f7c5c1c2740 10 client.15999 fetch_fsmap finished waiting for FSMap version 30 2024-01-25T15:03:34.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.517+0000 7f7c5c1c2740 10 client.15999 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-01-25T15:03:34.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.517+0000 7f7c5c1c2740 20 client.15999 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:34.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.517+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/3896725833 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55aaed7f0a20 0x55aaed7f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.517+0000 7f7c5c1c2740 4 client.15999 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:03:34.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.517+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/3896725833 --> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55aaed6e2e00 con 0x55aaed7f0a20 2024-01-25T15:03:34.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.517+0000 7f7c4bfff640 1 --2- 172.21.15.170:0/3896725833 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55aaed7f0a20 0x55aaed7f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.517+0000 7f7c4bfff640 1 --2- 172.21.15.170:0/3896725833 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55aaed7f0a20 0x55aaed7f2e10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5561efb5cbfacaca server_cookie=99e3811966d5c744 in_seq=0 out_seq=0 2024-01-25T15:03:34.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.517+0000 7f7c3a7fc640 10 client.15999 ms_handle_connect on v2:172.21.15.186:6838/2132502182 2024-01-25T15:03:34.524 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.517+0000 7f7c3a7fc640 1 -- 172.21.15.170:0/3896725833 <== mds.1 v2:172.21.15.186:6838/2132502182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55aaed6e2e00 con 0x55aaed7f0a20 2024-01-25T15:03:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.517+0000 7f7c3a7fc640 10 client.15999 handle_command_reply: tid=0 2024-01-25T15:03:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.517+0000 7f7c5c1c2740 1 client.15999 shutdown 2024-01-25T15:03:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.517+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/3896725833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed783130 msgr2=0x55aaed794590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.517+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/3896725833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed783130 0x55aaed794590 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400c6a0 tx=0x7f7c44003820 comp rx=0 tx=0).stop 2024-01-25T15:03:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/3896725833 shutdown_connections 2024-01-25T15:03:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/3896725833 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55aaed7f0a20 0x55aaed7f2e10 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/3896725833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55aaed783b20 0x55aaed792c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/3896725833 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55aaed788c90 0x55aaed793180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c5c1c2740 1 --2- 172.21.15.170:0/3896725833 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55aaed783130 0x55aaed794590 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/3896725833 >> 172.21.15.170:0/3896725833 conn(0x55aaed77e6a0 msgr2=0x55aaed78cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c3a7fc640 0 client.15999 ms_handle_reset on v2:172.21.15.186:6838/2132502182 2024-01-25T15:03:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/3896725833 shutdown_connections 2024-01-25T15:03:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c5c1c2740 1 -- 172.21.15.170:0/3896725833 wait complete. 2024-01-25T15:03:34.525 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c5c1c2740 20 client.15999 trim_cache size 0 max 16384 2024-01-25T15:03:34.526 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:03:34.526 INFO:tasks.workunit.client.0.smithi170.stdout:6/235: dwrite d2/f3 [0,4194304] 0 2024-01-25T15:03:34.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c53fff640 1 -- 172.21.15.170:0/910191465 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7c400a13e0 msgr2=0x7f7c400a38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c53fff640 1 --2- 172.21.15.170:0/910191465 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7c400a13e0 0x7f7c400a38a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c009810 tx=0x7f7c4c009760 comp rx=0 tx=0).stop 2024-01-25T15:03:34.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c53fff640 1 -- 172.21.15.170:0/910191465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c540ffb00 msgr2=0x7f7c5410a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.526 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c53fff640 1 --2- 172.21.15.170:0/910191465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c540ffb00 0x7f7c5410a3c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7c4400e9f0 tx=0x7f7c4400eeb0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.527 INFO:tasks.workunit.client.0.smithi170.stdout:7/256: creat d8/d20/d2a/d35/d55/f67 x:0 0 0 2024-01-25T15:03:34.527 INFO:tasks.workunit.client.0.smithi170.stdout:7/257: dread - d8/d20/d2a/d35/f49 zero size 2024-01-25T15:03:34.527 INFO:tasks.workunit.client.0.smithi170.stdout:7/258: chown d8/c5c 1436606797 1 2024-01-25T15:03:34.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c53fff640 1 -- 172.21.15.170:0/910191465 shutdown_connections 2024-01-25T15:03:34.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c53fff640 1 --2- 172.21.15.170:0/910191465 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f7c400a13e0 0x7f7c400a38a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.527 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c53fff640 1 --2- 172.21.15.170:0/910191465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c54100cf0 0x7f7c54108a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c53fff640 1 --2- 172.21.15.170:0/910191465 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f7c541016b0 0x7f7c54108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c53fff640 1 --2- 172.21.15.170:0/910191465 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f7c540ffb00 0x7f7c5410a3c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c53fff640 1 -- 172.21.15.170:0/910191465 >> 172.21.15.170:0/910191465 conn(0x7f7c540fb070 msgr2=0x7f7c54104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c53fff640 1 -- 172.21.15.170:0/910191465 shutdown_connections 2024-01-25T15:03:34.528 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.518+0000 7f7c53fff640 1 -- 172.21.15.170:0/910191465 wait complete. 2024-01-25T15:03:34.529 INFO:tasks.workunit.client.0.smithi170.stdout:7/259: truncate d8/f52 1413263 0 2024-01-25T15:03:34.529 INFO:tasks.workunit.client.0.smithi170.stdout:7/260: write d8/d20/d45/f4a [276539,48645] 0 2024-01-25T15:03:34.529 INFO:tasks.workunit.client.0.smithi170.stdout:7/261: readlink l1 0 2024-01-25T15:03:34.529 INFO:tasks.workunit.client.0.smithi170.stdout:7/262: chown d8/d20/d3b/f3c 0 1 2024-01-25T15:03:34.529 INFO:tasks.workunit.client.0.smithi170.stdout:4/187: dwrite d6/d7/f9 [0,4194304] 0 2024-01-25T15:03:34.529 INFO:tasks.workunit.client.0.smithi170.stdout:4/188: truncate d6/d7/f17 3308847 0 2024-01-25T15:03:34.530 INFO:tasks.workunit.client.0.smithi170.stdout:4/189: mknod d6/d7/d34/c35 0 2024-01-25T15:03:34.530 INFO:tasks.workunit.client.0.smithi170.stdout:4/190: write d6/d7/f14 [570404,90167] 0 2024-01-25T15:03:34.530 INFO:tasks.workunit.client.0.smithi170.stdout:4/191: write d6/f26 [3683894,112004] 0 2024-01-25T15:03:34.530 INFO:tasks.workunit.client.0.smithi170.stdout:4/192: creat d6/d7/d1b/f36 x:0 0 0 2024-01-25T15:03:34.530 INFO:tasks.workunit.client.0.smithi170.stdout:7/263: dread d8/d20/d2a/d35/f41 [0,4194304] 0 2024-01-25T15:03:34.532 INFO:tasks.workunit.client.0.smithi170.stdout:7/264: mkdir d8/d20/d45/d68 0 2024-01-25T15:03:34.532 INFO:tasks.workunit.client.0.smithi170.stdout:7/265: creat d8/d20/d2a/d35/d55/f69 x:0 0 0 2024-01-25T15:03:34.533 INFO:tasks.workunit.client.0.smithi170.stdout:7/266: creat d8/d20/d3b/f6a x:0 0 0 2024-01-25T15:03:34.534 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-01-25T15:03:34.535 INFO:tasks.workunit.client.0.smithi170.stdout:9/188: sync 2024-01-25T15:03:34.536 INFO:tasks.workunit.client.0.smithi170.stdout:9/189: symlink d5/df/d12/d18/l3f 0 2024-01-25T15:03:34.542 INFO:tasks.workunit.client.0.smithi170.stdout:7/267: dread d8/f1c [0,4194304] 0 2024-01-25T15:03:34.542 INFO:tasks.workunit.client.0.smithi170.stdout:7/268: stat d8/d20/d2a/d61 0 2024-01-25T15:03:34.543 INFO:tasks.workunit.client.0.smithi170.stdout:7/269: mknod d8/d5b/c6b 0 2024-01-25T15:03:34.543 INFO:tasks.workunit.client.0.smithi170.stdout:7/270: read - d8/d20/d3b/f50 zero size 2024-01-25T15:03:34.544 INFO:tasks.workunit.client.0.smithi170.stdout:7/271: rmdir d8/d5b 39 2024-01-25T15:03:34.545 INFO:tasks.workunit.client.0.smithi170.stdout:6/236: dwrite d2/d7/d23/d19/d2f/f32 [0,4194304] 0 2024-01-25T15:03:34.545 INFO:tasks.workunit.client.0.smithi170.stdout:7/272: mknod d8/d20/d45/c6c 0 2024-01-25T15:03:34.545 INFO:tasks.workunit.client.0.smithi170.stdout:7/273: chown d8/d20/d2a/c3e 0 1 2024-01-25T15:03:34.546 INFO:tasks.workunit.client.0.smithi170.stdout:4/193: fsync d6/d7/d1b/f36 0 2024-01-25T15:03:34.546 INFO:tasks.workunit.client.0.smithi170.stdout:4/194: fdatasync d6/d7/f17 0 2024-01-25T15:03:34.549 INFO:tasks.workunit.client.0.smithi170.stdout:6/237: truncate d2/d7/d23/d19/d2f/d37/f3f 2493 0 2024-01-25T15:03:34.550 INFO:tasks.workunit.client.0.smithi170.stdout:4/195: mkdir d6/d37 0 2024-01-25T15:03:34.552 INFO:tasks.workunit.client.0.smithi170.stdout:4/196: truncate d6/d7/fa 4056674 0 2024-01-25T15:03:34.553 INFO:tasks.workunit.client.0.smithi170.stdout:1/227: sync 2024-01-25T15:03:34.553 INFO:tasks.workunit.client.0.smithi170.stdout:3/213: sync 2024-01-25T15:03:34.553 INFO:tasks.workunit.client.0.smithi170.stdout:1/228: dread - d0/d1b/f1c zero size 2024-01-25T15:03:34.553 INFO:tasks.workunit.client.0.smithi170.stdout:8/140: sync 2024-01-25T15:03:34.554 INFO:tasks.workunit.client.0.smithi170.stdout:5/164: sync 2024-01-25T15:03:34.554 INFO:tasks.workunit.client.0.smithi170.stdout:2/285: sync 2024-01-25T15:03:34.556 INFO:tasks.workunit.client.0.smithi170.stdout:0/231: sync 2024-01-25T15:03:34.556 INFO:tasks.workunit.client.0.smithi170.stdout:1/229: creat d0/d20/d28/f4c x:0 0 0 2024-01-25T15:03:34.556 INFO:tasks.workunit.client.0.smithi170.stdout:1/230: dread - d0/d20/d28/f38 zero size 2024-01-25T15:03:34.556 INFO:tasks.workunit.client.0.smithi170.stdout:1/231: chown d0/f33 0 1 2024-01-25T15:03:34.557 INFO:tasks.workunit.client.0.smithi170.stdout:8/141: mknod d3/d7/d22/d23/d25/c29 0 2024-01-25T15:03:34.557 INFO:tasks.workunit.client.0.smithi170.stdout:8/142: stat d3/d7/c14 0 2024-01-25T15:03:34.557 INFO:tasks.workunit.client.0.smithi170.stdout:8/143: chown d3/d7/d22 3997134 1 2024-01-25T15:03:34.557 INFO:tasks.workunit.client.0.smithi170.stdout:8/144: write d3/d7/f12 [85561,56947] 0 2024-01-25T15:03:34.557 INFO:tasks.workunit.client.0.smithi170.stdout:8/145: stat d3/d7/d22 0 2024-01-25T15:03:34.557 INFO:tasks.workunit.client.0.smithi170.stdout:8/146: readlink d3/l11 0 2024-01-25T15:03:34.557 INFO:tasks.workunit.client.0.smithi170.stdout:2/286: mkdir d10/d1e/d32/d63 0 2024-01-25T15:03:34.561 INFO:tasks.workunit.client.0.smithi170.stdout:6/238: write d2/f17 [2056138,87461] 0 2024-01-25T15:03:34.561 INFO:tasks.workunit.client.0.smithi170.stdout:0/232: symlink d8/d10/l50 0 2024-01-25T15:03:34.562 INFO:tasks.workunit.client.0.smithi170.stdout:1/232: rmdir d0/d1b/d4b 0 2024-01-25T15:03:34.564 INFO:tasks.workunit.client.0.smithi170.stdout:8/147: rename d3/d7/fa to d3/d7/f2a 0 2024-01-25T15:03:34.565 INFO:tasks.workunit.client.0.smithi170.stdout:2/287: truncate d10/d16/f35 998621 0 2024-01-25T15:03:34.566 INFO:tasks.workunit.client.0.smithi170.stdout:9/190: dwrite d5/f8 [4194304,4194304] 0 2024-01-25T15:03:34.567 INFO:tasks.workunit.client.0.smithi170.stdout:6/239: rename d2/d7/d23/d19/c22 to d2/d7/d23/d19/d2a/c54 0 2024-01-25T15:03:34.570 INFO:tasks.workunit.client.0.smithi170.stdout:1/233: dread d0/f1d [0,4194304] 0 2024-01-25T15:03:34.570 INFO:tasks.workunit.client.0.smithi170.stdout:1/234: chown d0/f41 285430 1 2024-01-25T15:03:34.571 INFO:tasks.workunit.client.0.smithi170.stdout:5/165: write d5/f1b [185152,86130] 0 2024-01-25T15:03:34.573 INFO:tasks.workunit.client.0.smithi170.stdout:8/148: dread d3/d7/fe [0,4194304] 0 2024-01-25T15:03:34.576 INFO:tasks.workunit.client.0.smithi170.stdout:9/191: symlink d5/l40 0 2024-01-25T15:03:34.577 INFO:tasks.workunit.client.0.smithi170.stdout:9/192: readlink l3 0 2024-01-25T15:03:34.577 INFO:tasks.workunit.client.0.smithi170.stdout:9/193: readlink d5/df/d12/d18/l3f 0 2024-01-25T15:03:34.577 INFO:tasks.workunit.client.0.smithi170.stdout:9/194: stat d5/df/d2e 0 2024-01-25T15:03:34.577 INFO:tasks.workunit.client.0.smithi170.stdout:1/235: rename d0/f1d to d0/d20/f4d 0 2024-01-25T15:03:34.580 INFO:tasks.workunit.client.0.smithi170.stdout:8/149: rename d3/l1c to d3/d7/d22/d23/l2b 0 2024-01-25T15:03:34.580 INFO:tasks.workunit.client.0.smithi170.stdout:8/150: write d3/d7/f16 [4423663,87008] 0 2024-01-25T15:03:34.580 INFO:tasks.workunit.client.0.smithi170.stdout:8/151: fdatasync d3/d7/f10 0 2024-01-25T15:03:34.580 INFO:tasks.workunit.client.0.smithi170.stdout:6/240: dread d2/d7/d23/d19/f24 [0,4194304] 0 2024-01-25T15:03:34.581 INFO:tasks.workunit.client.0.smithi170.stdout:9/195: mknod d5/d1e/d21/d34/d3e/c41 0 2024-01-25T15:03:34.581 INFO:tasks.workunit.client.0.smithi170.stdout:9/196: dread - d5/df/f20 zero size 2024-01-25T15:03:34.583 INFO:tasks.workunit.client.0.smithi170.stdout:1/236: link d0/l24 d0/d20/d28/d2a/l4e 0 2024-01-25T15:03:34.587 INFO:tasks.workunit.client.0.smithi170.stdout:0/233: dwrite d8/d9/fe [0,4194304] 0 2024-01-25T15:03:34.588 INFO:tasks.workunit.client.0.smithi170.stdout:0/234: write d8/d9/f29 [3872298,119917] 0 2024-01-25T15:03:34.588 INFO:tasks.workunit.client.0.smithi170.stdout:0/235: chown d8/fa 2126955 1 2024-01-25T15:03:34.588 INFO:tasks.workunit.client.0.smithi170.stdout:4/197: dwrite d6/d7/f9 [4194304,4194304] 0 2024-01-25T15:03:34.590 INFO:tasks.workunit.client.0.smithi170.stdout:6/241: creat d2/d7/d23/d19/d2a/f55 x:0 0 0 2024-01-25T15:03:34.591 INFO:tasks.workunit.client.0.smithi170.stdout:9/197: rmdir d5/df/d16/d35 39 2024-01-25T15:03:34.591 INFO:tasks.workunit.client.0.smithi170.stdout:9/198: fsync d5/df/f15 0 2024-01-25T15:03:34.593 INFO:tasks.workunit.client.0.smithi170.stdout:6/242: symlink d2/d7/d1b/l56 0 2024-01-25T15:03:34.593 INFO:tasks.workunit.client.0.smithi170.stdout:6/243: write d2/d7/d23/d19/d2f/f45 [179928,98968] 0 2024-01-25T15:03:34.596 INFO:tasks.workunit.client.0.smithi170.stdout:8/152: write d3/d7/f10 [2716945,5985] 0 2024-01-25T15:03:34.597 INFO:tasks.workunit.client.0.smithi170.stdout:7/274: dwrite d8/d20/d3b/f3c [0,4194304] 0 2024-01-25T15:03:34.600 INFO:tasks.workunit.client.0.smithi170.stdout:4/198: dread d6/d7/d34/f30 [0,4194304] 0 2024-01-25T15:03:34.600 INFO:tasks.workunit.client.0.smithi170.stdout:8/153: symlink d3/d7/d22/l2c 0 2024-01-25T15:03:34.601 INFO:tasks.workunit.client.0.smithi170.stdout:6/244: write d2/d7/d23/d19/f29 [2549995,39445] 0 2024-01-25T15:03:34.602 INFO:tasks.workunit.client.0.smithi170.stdout:7/275: rename d8/d20/f26 to d8/d20/d3b/d4d/f6d 0 2024-01-25T15:03:34.602 INFO:tasks.workunit.client.0.smithi170.stdout:4/199: rename d6 to d6/d28/d38 22 2024-01-25T15:03:34.603 INFO:tasks.workunit.client.0.smithi170.stdout:8/154: creat d3/d7/d22/d23/d25/f2d x:0 0 0 2024-01-25T15:03:34.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:34 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/534194234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:03:34.605 INFO:tasks.workunit.client.0.smithi170.stdout:4/200: symlink d6/l39 0 2024-01-25T15:03:34.606 INFO:tasks.workunit.client.0.smithi170.stdout:7/276: mkdir d8/d20/d2a/d35/d55/d6e 0 2024-01-25T15:03:34.606 INFO:tasks.workunit.client.0.smithi170.stdout:7/277: write d8/d20/d45/f59 [549338,39297] 0 2024-01-25T15:03:34.607 INFO:tasks.workunit.client.0.smithi170.stdout:7/278: truncate d8/f52 1706366 0 2024-01-25T15:03:34.607 INFO:tasks.workunit.client.0.smithi170.stdout:8/155: symlink d3/d7/d22/d23/l2e 0 2024-01-25T15:03:34.611 INFO:tasks.workunit.client.0.smithi170.stdout:4/201: rename d6/d7/d1b/c29 to d6/d7/d1b/c3a 0 2024-01-25T15:03:34.612 INFO:tasks.workunit.client.0.smithi170.stdout:2/288: dwrite d10/d16/f19 [0,4194304] 0 2024-01-25T15:03:34.613 INFO:tasks.workunit.client.0.smithi170.stdout:7/279: mknod d8/d20/d3b/d4d/c6f 0 2024-01-25T15:03:34.617 INFO:tasks.workunit.client.0.smithi170.stdout:5/166: dwrite d5/d10/f26 [0,4194304] 0 2024-01-25T15:03:34.618 INFO:tasks.workunit.client.0.smithi170.stdout:8/156: dread d3/fb [0,4194304] 0 2024-01-25T15:03:34.624 INFO:tasks.workunit.client.0.smithi170.stdout:8/157: rename d3/d7/fe to d3/d7/f2f 0 2024-01-25T15:03:34.625 INFO:tasks.workunit.client.0.smithi170.stdout:8/158: chown d3/d7/d1e/l21 4900 1 2024-01-25T15:03:34.626 INFO:tasks.workunit.client.0.smithi170.stdout:8/159: rename d3/l18 to d3/d7/d22/l30 0 2024-01-25T15:03:34.627 INFO:tasks.workunit.client.0.smithi170.stdout:8/160: readlink d3/d7/d1e/l21 0 2024-01-25T15:03:34.628 INFO:tasks.workunit.client.0.smithi170.stdout:5/167: dread d5/d10/f26 [0,4194304] 0 2024-01-25T15:03:34.628 INFO:tasks.workunit.client.0.smithi170.stdout:8/161: unlink d3/fb 0 2024-01-25T15:03:34.630 INFO:tasks.workunit.client.0.smithi170.stdout:5/168: unlink d5/l9 0 2024-01-25T15:03:34.630 INFO:tasks.workunit.client.0.smithi170.stdout:5/169: readlink d5/d10/l36 0 2024-01-25T15:03:34.635 INFO:tasks.workunit.client.0.smithi170.stdout:8/162: symlink d3/d7/d1e/l31 0 2024-01-25T15:03:34.637 INFO:tasks.workunit.client.0.smithi170.stdout:8/163: mknod d3/d7/c32 0 2024-01-25T15:03:34.637 INFO:tasks.workunit.client.0.smithi170.stdout:1/237: dwrite d0/f12 [0,4194304] 0 2024-01-25T15:03:34.637 INFO:tasks.workunit.client.0.smithi170.stdout:8/164: chown d3/f9 94585212 1 2024-01-25T15:03:34.637 INFO:tasks.workunit.client.0.smithi170.stdout:1/238: readlink d0/l13 0 2024-01-25T15:03:34.638 INFO:tasks.workunit.client.0.smithi170.stdout:8/165: dread - d3/d7/d1e/f20 zero size 2024-01-25T15:03:34.638 INFO:tasks.workunit.client.0.smithi170.stdout:2/289: dwrite d10/d1e/f2e [0,4194304] 0 2024-01-25T15:03:34.639 INFO:tasks.workunit.client.0.smithi170.stdout:9/199: dwrite d5/df/d16/f2b [4194304,4194304] 0 2024-01-25T15:03:34.639 INFO:tasks.workunit.client.0.smithi170.stdout:0/236: dwrite d8/f38 [0,4194304] 0 2024-01-25T15:03:34.639 INFO:tasks.workunit.client.0.smithi170.stdout:1/239: getdents d0/d20 0 2024-01-25T15:03:34.639 INFO:tasks.workunit.client.0.smithi170.stdout:1/240: dread - d0/d20/d28/f38 zero size 2024-01-25T15:03:34.640 INFO:tasks.workunit.client.0.smithi170.stdout:6/245: dwrite d2/d7/d23/d19/d2a/f55 [0,4194304] 0 2024-01-25T15:03:34.640 INFO:tasks.workunit.client.0.smithi170.stdout:6/246: write d2/d7/d23/d19/d2f/f45 [1224162,65297] 0 2024-01-25T15:03:34.640 INFO:tasks.workunit.client.0.smithi170.stdout:6/247: readlink d2/d7/d23/d19/l34 0 2024-01-25T15:03:34.640 INFO:tasks.workunit.client.0.smithi170.stdout:6/248: readlink d2/d7/l2c 0 2024-01-25T15:03:34.643 INFO:tasks.workunit.client.0.smithi170.stdout:8/166: link d3/d7/f12 d3/d7/d22/d23/f33 0 2024-01-25T15:03:34.654 INFO:tasks.workunit.client.0.smithi170.stdout:2/290: symlink d10/d1e/l64 0 2024-01-25T15:03:34.660 INFO:tasks.workunit.client.0.smithi170.stdout:5/170: dwrite d5/d10/f1c [0,4194304] 0 2024-01-25T15:03:34.660 INFO:tasks.workunit.client.0.smithi170.stdout:5/171: fdatasync d5/fe 0 2024-01-25T15:03:34.660 INFO:tasks.workunit.client.0.smithi170.stdout:5/172: write d5/d2a/f3e [181467,14551] 0 2024-01-25T15:03:34.665 INFO:tasks.workunit.client.0.smithi170.stdout:9/200: mkdir d5/dc/d42 0 2024-01-25T15:03:34.671 INFO:tasks.workunit.client.0.smithi170.stdout:1/241: mknod d0/d2e/c4f 0 2024-01-25T15:03:34.671 INFO:tasks.workunit.client.0.smithi170.stdout:0/237: dwrite d8/d9/f29 [0,4194304] 0 2024-01-25T15:03:34.671 INFO:tasks.workunit.client.0.smithi170.stdout:0/238: readlink d8/d10/l34 0 2024-01-25T15:03:34.672 INFO:tasks.workunit.client.0.smithi170.stdout:0/239: chown d8/d10/l34 25176 1 2024-01-25T15:03:34.688 INFO:tasks.workunit.client.0.smithi170.stdout:2/291: rename cb to d10/d1e/d32/c65 0 2024-01-25T15:03:34.694 INFO:tasks.workunit.client.0.smithi170.stdout:9/201: dwrite d5/dc/f2c [0,4194304] 0 2024-01-25T15:03:34.695 INFO:tasks.workunit.client.0.smithi170.stdout:1/242: unlink d0/d20/d28/d2a/l4e 0 2024-01-25T15:03:34.695 INFO:tasks.workunit.client.0.smithi170.stdout:1/243: write d0/d2e/f3b [799967,131053] 0 2024-01-25T15:03:34.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.696+0000 7f8e063a4640 1 -- 172.21.15.170:0/699638449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e000ff5c0 msgr2=0x7f8e000ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.697 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.696+0000 7f8e063a4640 1 --2- 172.21.15.170:0/699638449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e000ff5c0 0x7f8e000ff9e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8df0009860 tx=0x7f8df002bb70 comp rx=0 tx=0).stop 2024-01-25T15:03:34.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.696+0000 7f8e063a4640 1 -- 172.21.15.170:0/699638449 shutdown_connections 2024-01-25T15:03:34.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.696+0000 7f8e063a4640 1 --2- 172.21.15.170:0/699638449 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e001008c0 0x7f8e00100d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.696+0000 7f8e063a4640 1 --2- 172.21.15.170:0/699638449 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e000fff20 0x7f8e00100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.696+0000 7f8e063a4640 1 --2- 172.21.15.170:0/699638449 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e000ff5c0 0x7f8e000ff9e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.696+0000 7f8e063a4640 1 -- 172.21.15.170:0/699638449 >> 172.21.15.170:0/699638449 conn(0x7f8e000fb180 msgr2=0x7f8e000fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.696+0000 7f8e063a4640 1 -- 172.21.15.170:0/699638449 shutdown_connections 2024-01-25T15:03:34.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.696+0000 7f8e063a4640 1 -- 172.21.15.170:0/699638449 wait complete. 2024-01-25T15:03:34.698 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.697+0000 7f8e063a4640 1 Processor -- start 2024-01-25T15:03:34.698 INFO:tasks.workunit.client.0.smithi170.stdout:6/249: rmdir d2/d7/d23/d19/d2f/d37 39 2024-01-25T15:03:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.697+0000 7f8e063a4640 1 -- start start 2024-01-25T15:03:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.697+0000 7f8e063a4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e000ff5c0 0x7f8e00198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.697+0000 7f8e063a4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e000fff20 0x7f8e00199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.697+0000 7f8e063a4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e001008c0 0x7f8e001a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.697+0000 7f8e063a4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e001a09f0 con 0x7f8e000fff20 2024-01-25T15:03:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.697+0000 7f8e063a4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e001a0b60 con 0x7f8e001008c0 2024-01-25T15:03:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.697+0000 7f8e063a4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e001a0d20 con 0x7f8e000ff5c0 2024-01-25T15:03:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.697+0000 7f8dff7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e000fff20 0x7f8e00199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.697+0000 7f8dfffff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e000ff5c0 0x7f8e00198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.697+0000 7f8dff7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e000fff20 0x7f8e00199440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54258/0 (socket says 172.21.15.170:54258) 2024-01-25T15:03:34.701 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.697+0000 7f8dff7fe640 1 -- 172.21.15.170:0/1881690511 learned_addr learned my addr 172.21.15.170:0/1881690511 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.698+0000 7f8dff7fe640 1 -- 172.21.15.170:0/1881690511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e000ff5c0 msgr2=0x7f8e00198f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.698+0000 7f8dff7fe640 1 --2- 172.21.15.170:0/1881690511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e000ff5c0 0x7f8e00198f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.698+0000 7f8dff7fe640 1 -- 172.21.15.170:0/1881690511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e001008c0 msgr2=0x7f8e001a04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.698+0000 7f8e04941640 1 --2- 172.21.15.170:0/1881690511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e001008c0 0x7f8e001a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.698+0000 7f8dff7fe640 1 --2- 172.21.15.170:0/1881690511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e001008c0 0x7f8e001a04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.698+0000 7f8dff7fe640 1 -- 172.21.15.170:0/1881690511 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df0009490 con 0x7f8e000fff20 2024-01-25T15:03:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.698+0000 7f8dff7fe640 1 --2- 172.21.15.170:0/1881690511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e000fff20 0x7f8e00199440 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8df400e9c0 tx=0x7f8df400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.698+0000 7f8dfd7fa640 1 -- 172.21.15.170:0/1881690511 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df400ccc0 con 0x7f8e000fff20 2024-01-25T15:03:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.698+0000 7f8dfd7fa640 1 -- 172.21.15.170:0/1881690511 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8df400ce20 con 0x7f8e000fff20 2024-01-25T15:03:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.698+0000 7f8e063a4640 1 -- 172.21.15.170:0/1881690511 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e001a0fa0 con 0x7f8e000fff20 2024-01-25T15:03:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.698+0000 7f8dfd7fa640 1 -- 172.21.15.170:0/1881690511 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df4010430 con 0x7f8e000fff20 2024-01-25T15:03:34.702 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.698+0000 7f8e063a4640 1 -- 172.21.15.170:0/1881690511 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e001a1480 con 0x7f8e000fff20 2024-01-25T15:03:34.703 INFO:tasks.workunit.client.0.smithi170.stdout:8/167: getdents d3/d7/d1e 0 2024-01-25T15:03:34.703 INFO:tasks.workunit.client.0.smithi170.stdout:8/168: write d3/fd [1227823,108694] 0 2024-01-25T15:03:34.703 INFO:tasks.workunit.client.0.smithi170.stdout:0/240: dwrite d8/d10/f4b [0,4194304] 0 2024-01-25T15:03:34.703 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.700+0000 7f8dfd7fa640 1 -- 172.21.15.170:0/1881690511 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f8df4004f10 con 0x7f8e000fff20 2024-01-25T15:03:34.704 INFO:tasks.workunit.client.0.smithi170.stdout:5/173: mkdir d5/d10/d3f 0 2024-01-25T15:03:34.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.701+0000 7f8dfd7fa640 1 --2- 172.21.15.170:0/1881690511 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8de80a12e0 0x7f8de80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.701+0000 7f8e08f67740 1 Processor -- start 2024-01-25T15:03:34.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.701+0000 7f8e08f67740 1 -- start start 2024-01-25T15:03:34.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.701+0000 7f8dfffff640 1 --2- 172.21.15.170:0/1881690511 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8de80a12e0 0x7f8de80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.701+0000 7f8dfd7fa640 1 -- 172.21.15.170:0/1881690511 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f8df4014070 con 0x7f8e000fff20 2024-01-25T15:03:34.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.701+0000 7f8e08f67740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2e7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.707 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.701+0000 7f8e08f67740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 0x55858c2ec430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.701+0000 7f8e08f67740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 0x55858c2eef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.701+0000 7f8e08f67740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858c255270 con 0x55858c2e6f40 2024-01-25T15:03:34.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.701+0000 7f8e08f67740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858c252960 con 0x55858c2e7930 2024-01-25T15:03:34.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.701+0000 7f8e08f67740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858c24e250 con 0x55858c2ecaa0 2024-01-25T15:03:34.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8dfffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2e7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8dfffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2e7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54272/0 (socket says 172.21.15.170:54272) 2024-01-25T15:03:34.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8dfffff640 1 -- 172.21.15.170:0/1382445928 learned_addr learned my addr 172.21.15.170:0/1382445928 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8e04941640 1 --2- 172.21.15.170:0/1382445928 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 0x55858c2eef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8dff7fe640 1 --2- 172.21.15.170:0/1382445928 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 0x55858c2ec430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8dfffff640 1 --2- 172.21.15.170:0/1881690511 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8de80a12e0 0x7f8de80a37a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8df0037040 tx=0x7f8df0034db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.708 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8e04941640 1 -- 172.21.15.170:0/1382445928 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 msgr2=0x55858c2ec430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8e04941640 1 --2- 172.21.15.170:0/1382445928 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 0x55858c2ec430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8e04941640 1 -- 172.21.15.170:0/1382445928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 msgr2=0x55858c2e7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8e04941640 1 --2- 172.21.15.170:0/1382445928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2e7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8e04941640 1 -- 172.21.15.170:0/1382445928 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55858c2107f0 con 0x55858c2ecaa0 2024-01-25T15:03:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8dfffff640 1 --2- 172.21.15.170:0/1382445928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2e7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8dff7fe640 1 --2- 172.21.15.170:0/1382445928 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 0x55858c2ec430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:03:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8e04941640 1 --2- 172.21.15.170:0/1382445928 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 0x55858c2eef30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009da0 tx=0x7f8df800e6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e5cb5c7b7d34b34 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8de67fc640 1 -- 172.21.15.170:0/1382445928 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8004b20 con 0x55858c2ecaa0 2024-01-25T15:03:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.702+0000 7f8de67fc640 1 -- 172.21.15.170:0/1382445928 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8df8004c80 con 0x55858c2ecaa0 2024-01-25T15:03:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.703+0000 7f8de67fc640 1 -- 172.21.15.170:0/1382445928 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df80116d0 con 0x55858c2ecaa0 2024-01-25T15:03:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.703+0000 7f8e08f67740 1 -- 172.21.15.170:0/1382445928 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 msgr2=0x55858c2eef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.709 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.703+0000 7f8e08f67740 1 --2- 172.21.15.170:0/1382445928 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 0x55858c2eef30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009da0 tx=0x7f8df800e6c0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.703+0000 7f8e08f67740 1 -- 172.21.15.170:0/1382445928 shutdown_connections 2024-01-25T15:03:34.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.703+0000 7f8e08f67740 1 --2- 172.21.15.170:0/1382445928 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 0x55858c2ec430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.703+0000 7f8e08f67740 1 --2- 172.21.15.170:0/1382445928 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 0x55858c2eef30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.703+0000 7f8e08f67740 1 --2- 172.21.15.170:0/1382445928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2e7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.710 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.703+0000 7f8e08f67740 1 -- 172.21.15.170:0/1382445928 >> 172.21.15.170:0/1382445928 conn(0x55858c2e24b0 msgr2=0x55858c2e28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.710 INFO:tasks.workunit.client.0.smithi170.stdout:9/202: symlink d5/df/d16/l43 0 2024-01-25T15:03:34.711 INFO:tasks.workunit.client.0.smithi170.stdout:9/203: fsync d5/df/d16/f2b 0 2024-01-25T15:03:34.711 INFO:tasks.workunit.client.0.smithi170.stdout:9/204: readlink d5/lb 0 2024-01-25T15:03:34.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.704+0000 7f8e08f67740 1 -- 172.21.15.170:0/1382445928 shutdown_connections 2024-01-25T15:03:34.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.704+0000 7f8e08f67740 1 -- 172.21.15.170:0/1382445928 wait complete. 2024-01-25T15:03:34.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.704+0000 7f8e08f67740 1 -- start start 2024-01-25T15:03:34.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.704+0000 7f8e08f67740 1 Processor -- start 2024-01-25T15:03:34.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.704+0000 7f8e08f67740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2f10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.704+0000 7f8e08f67740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 0x55858c2f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.713 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.704+0000 7f8e08f67740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 0x55858c2f8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.704+0000 7f8e08f67740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858c207610 con 0x55858c2e6f40 2024-01-25T15:03:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.704+0000 7f8e08f67740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858c2072b0 con 0x55858c2e7930 2024-01-25T15:03:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.704+0000 7f8e08f67740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858c1cc400 con 0x55858c2ecaa0 2024-01-25T15:03:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.705+0000 7f8e08f67740 10 client.0 _ll_register_callbacks cb 0x55858c244ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.705+0000 7f8dfffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2f10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.705+0000 7f8e04941640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 0x55858c2f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.705+0000 7f8dfffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2f10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54276/0 (socket says 172.21.15.170:54276) 2024-01-25T15:03:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.705+0000 7f8dfffff640 1 -- 172.21.15.170:0/2765096692 learned_addr learned my addr 172.21.15.170:0/2765096692 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.705+0000 7f8dff7fe640 1 --2- 172.21.15.170:0/2765096692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 0x55858c2f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.705+0000 7f8dfffff640 1 -- 172.21.15.170:0/2765096692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 msgr2=0x55858c2f8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.714 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.705+0000 7f8dfffff640 1 --2- 172.21.15.170:0/2765096692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 0x55858c2f8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.705+0000 7f8dfffff640 1 -- 172.21.15.170:0/2765096692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 msgr2=0x55858c2f15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.705+0000 7f8dfffff640 1 --2- 172.21.15.170:0/2765096692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 0x55858c2f15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.705+0000 7f8dfffff640 1 -- 172.21.15.170:0/2765096692 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df8009a00 con 0x55858c2e6f40 2024-01-25T15:03:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.705+0000 7f8dff7fe640 1 --2- 172.21.15.170:0/2765096692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 0x55858c2f15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.705+0000 7f8dfffff640 1 --2- 172.21.15.170:0/2765096692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2f10a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8df002c0b0 tx=0x7f8df002bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce01c43474184f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.705+0000 7f8ddf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:34.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.705+0000 7f8ddf7fe640 1 -- 172.21.15.170:0/2765096692 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df002c710 con 0x55858c2e6f40 2024-01-25T15:03:34.715 INFO:tasks.workunit.client.0.smithi170.stdout:6/250: symlink d2/d7/d23/d19/d2f/l57 0 2024-01-25T15:03:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.706+0000 7f8ddf7fe640 1 -- 172.21.15.170:0/2765096692 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f8df002c870 con 0x55858c2e6f40 2024-01-25T15:03:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.706+0000 7f8e08f67740 1 -- 172.21.15.170:0/2765096692 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55858c2470e0 con 0x55858c2e6f40 2024-01-25T15:03:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.706+0000 7f8ddf7fe640 1 -- 172.21.15.170:0/2765096692 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8df002ca30 con 0x55858c2e6f40 2024-01-25T15:03:34.717 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.706+0000 7f8e08f67740 10 client.16011 fetch_fsmap learned FSMap version 30 2024-01-25T15:03:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.706+0000 7f8e08f67740 1 -- 172.21.15.170:0/2765096692 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55858c24c8d0 con 0x55858c2e6f40 2024-01-25T15:03:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.706+0000 7f8ddf7fe640 1 -- 172.21.15.170:0/2765096692 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55858c2470e0 con 0x55858c2e6f40 2024-01-25T15:03:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.706+0000 7f8ddf7fe640 1 -- 172.21.15.170:0/2765096692 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f8df00326e0 con 0x55858c2e6f40 2024-01-25T15:03:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.706+0000 7f8e08f67740 10 client.16011 fetch_fsmap finished waiting for FSMap version 30 2024-01-25T15:03:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.706+0000 7f8e08f67740 10 client.16011 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.706+0000 7f8e08f67740 20 client.16011 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.706+0000 7f8e08f67740 1 --2- 172.21.15.170:0/2765096692 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55858c2fcfa0 0x55858c2ff3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.706+0000 7f8e08f67740 4 client.16011 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.706+0000 7f8e08f67740 1 -- 172.21.15.170:0/2765096692 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55858c246e00 con 0x55858c2fcfa0 2024-01-25T15:03:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.707+0000 7f8dff7fe640 1 --2- 172.21.15.170:0/2765096692 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55858c2fcfa0 0x55858c2ff3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.707+0000 7f8ddf7fe640 10 client.16011 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:34.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.707+0000 7f8dff7fe640 1 --2- 172.21.15.170:0/2765096692 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55858c2fcfa0 0x55858c2ff3e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4064ae7e22663312 server_cookie=e71866d649b0fb0a in_seq=0 out_seq=0 2024-01-25T15:03:34.719 INFO:tasks.workunit.client.0.smithi170.stdout:0/241: dread d8/d10/f1b [0,4194304] 0 2024-01-25T15:03:34.719 INFO:tasks.workunit.client.0.smithi170.stdout:0/242: creat d8/d10/d2d/d2f/f51 x:0 0 0 2024-01-25T15:03:34.719 INFO:tasks.workunit.client.0.smithi170.stdout:0/243: write d8/d18/f20 [710220,87710] 0 2024-01-25T15:03:34.719 INFO:tasks.workunit.client.0.smithi170.stdout:2/292: dwrite d10/d1e/f20 [0,4194304] 0 2024-01-25T15:03:34.720 INFO:tasks.workunit.client.0.smithi170.stdout:0/244: chown d8/d10/d2d/d2f/f37 16150039 1 2024-01-25T15:03:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.710+0000 7f8ddf7fe640 1 -- 172.21.15.170:0/2765096692 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55858c246e00 con 0x55858c2fcfa0 2024-01-25T15:03:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.710+0000 7f8ddf7fe640 10 client.16011 handle_command_reply: tid=0 2024-01-25T15:03:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.710+0000 7f8e08f67740 1 client.16011 shutdown 2024-01-25T15:03:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.711+0000 7f8e08f67740 1 -- 172.21.15.170:0/2765096692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 msgr2=0x55858c2f10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.711+0000 7f8e08f67740 1 --2- 172.21.15.170:0/2765096692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2f10a0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8df002c0b0 tx=0x7f8df002bb70 comp rx=0 tx=0).stop 2024-01-25T15:03:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.711+0000 7f8e08f67740 1 -- 172.21.15.170:0/2765096692 shutdown_connections 2024-01-25T15:03:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.711+0000 7f8e08f67740 1 --2- 172.21.15.170:0/2765096692 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55858c2fcfa0 0x55858c2ff3e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.711+0000 7f8e08f67740 1 --2- 172.21.15.170:0/2765096692 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 0x55858c2f15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.711+0000 7f8ddf7fe640 0 client.16011 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:34.721 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.711+0000 7f8e08f67740 1 --2- 172.21.15.170:0/2765096692 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 0x55858c2f8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.711+0000 7f8e08f67740 1 --2- 172.21.15.170:0/2765096692 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2f10a0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.711+0000 7f8e08f67740 1 -- 172.21.15.170:0/2765096692 >> 172.21.15.170:0/2765096692 conn(0x55858c2e24b0 msgr2=0x55858c2e17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.711+0000 7f8e08f67740 1 -- 172.21.15.170:0/2765096692 shutdown_connections 2024-01-25T15:03:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.711+0000 7f8e08f67740 1 -- 172.21.15.170:0/2765096692 wait complete. 2024-01-25T15:03:34.722 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.711+0000 7f8e08f67740 20 client.16011 trim_cache size 0 max 16384 2024-01-25T15:03:34.723 INFO:tasks.workunit.client.0.smithi170.stdout:9/205: rename d5/dc/fe to d5/dc/d42/f44 0 2024-01-25T15:03:34.723 INFO:tasks.workunit.client.0.smithi170.stdout:1/244: getdents d0 0 2024-01-25T15:03:34.723 INFO:tasks.workunit.client.0.smithi170.stdout:8/169: mkdir d3/d7/d22/d23/d25/d34 0 2024-01-25T15:03:34.723 INFO:tasks.workunit.client.0.smithi170.stdout:3/214: sync 2024-01-25T15:03:34.724 INFO:tasks.workunit.client.0.smithi170.stdout:6/251: dread d2/d7/d23/d19/d2f/d37/f50 [0,4194304] 0 2024-01-25T15:03:34.724 INFO:tasks.workunit.client.0.smithi170.stdout:6/252: creat d2/d7/d23/d19/d2a/d43/f58 x:0 0 0 2024-01-25T15:03:34.724 INFO:tasks.workunit.client.0.smithi170.stdout:2/293: stat d10/d1e/d32/d3e/c4f 0 2024-01-25T15:03:34.724 INFO:tasks.workunit.client.0.smithi170.stdout:9/206: creat d5/df/d16/d35/d3c/f45 x:0 0 0 2024-01-25T15:03:34.724 INFO:tasks.workunit.client.0.smithi170.stdout:5/174: link d5/d10/f14 d5/f40 0 2024-01-25T15:03:34.724 INFO:tasks.workunit.client.0.smithi170.stdout:0/245: dread d8/f42 [0,4194304] 0 2024-01-25T15:03:34.724 INFO:tasks.workunit.client.0.smithi170.stdout:3/215: dread d3/d10/f23 [0,4194304] 0 2024-01-25T15:03:34.727 INFO:tasks.workunit.client.0.smithi170.stdout:6/253: rename d2/d7/d23/d19/d2f/f45 to d2/d7/d23/d19/d2a/d43/f59 0 2024-01-25T15:03:34.728 INFO:tasks.workunit.client.0.smithi170.stdout:2/294: creat d10/d1e/d32/f66 x:0 0 0 2024-01-25T15:03:34.728 INFO:tasks.workunit.client.0.smithi170.stdout:5/175: mkdir d5/d10/d2c/d3a/d41 0 2024-01-25T15:03:34.728 INFO:tasks.workunit.client.0.smithi170.stdout:0/246: mknod d8/d9/c52 0 2024-01-25T15:03:34.728 INFO:tasks.workunit.client.0.smithi170.stdout:7/280: sync 2024-01-25T15:03:34.728 INFO:tasks.workunit.client.0.smithi170.stdout:4/202: sync 2024-01-25T15:03:34.728 INFO:tasks.workunit.client.0.smithi170.stdout:2/295: link d10/d1e/d32/c65 d10/c67 0 2024-01-25T15:03:34.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.728+0000 7f8e08f67740 1 Processor -- start 2024-01-25T15:03:34.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.728+0000 7f8e08f67740 1 -- start start 2024-01-25T15:03:34.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.728+0000 7f8e08f67740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2e8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.728+0000 7f8e08f67740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2e7930 0x55858c2e9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.728+0000 7f8e08f67740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2ecaa0 0x55858c2f85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.728+0000 7f8e08f67740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858c2ddfb0 con 0x55858c2e6f40 2024-01-25T15:03:34.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.728+0000 7f8e08f67740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858c2e2350 con 0x55858c2ecaa0 2024-01-25T15:03:34.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.728+0000 7f8e08f67740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858c2f9780 con 0x55858c2e7930 2024-01-25T15:03:34.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.729+0000 7f8dfffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2e8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.729+0000 7f8dfffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2e8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54288/0 (socket says 172.21.15.170:54288) 2024-01-25T15:03:34.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.729+0000 7f8dfffff640 1 -- 172.21.15.170:0/2894528603 learned_addr learned my addr 172.21.15.170:0/2894528603 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.729+0000 7f8dfffff640 1 -- 172.21.15.170:0/2894528603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2e7930 msgr2=0x55858c2e9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.729+0000 7f8dfffff640 1 --2- 172.21.15.170:0/2894528603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2e7930 0x55858c2e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.729+0000 7f8e04941640 1 --2- 172.21.15.170:0/2894528603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2ecaa0 0x55858c2f85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.729+0000 7f8dfffff640 1 -- 172.21.15.170:0/2894528603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2ecaa0 msgr2=0x55858c2f85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.729+0000 7f8dfffff640 1 --2- 172.21.15.170:0/2894528603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2ecaa0 0x55858c2f85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.729+0000 7f8dfffff640 1 -- 172.21.15.170:0/2894528603 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55858c1e9500 con 0x55858c2e6f40 2024-01-25T15:03:34.732 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.729+0000 7f8e04941640 1 --2- 172.21.15.170:0/2894528603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2ecaa0 0x55858c2f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:03:34.732 INFO:tasks.workunit.client.0.smithi170.stdout:0/247: mkdir d8/d10/d2d/d53 0 2024-01-25T15:03:34.732 INFO:tasks.workunit.client.0.smithi170.stdout:0/248: fsync d8/d18/f4d 0 2024-01-25T15:03:34.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.729+0000 7f8dfffff640 1 --2- 172.21.15.170:0/2894528603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2e8df0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8df0033000 tx=0x7f8df0034f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc331e5baf52fae5 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.729+0000 7f8de5ffb640 1 -- 172.21.15.170:0/2894528603 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0032e80 con 0x55858c2e6f40 2024-01-25T15:03:34.733 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.730+0000 7f8de5ffb640 1 -- 172.21.15.170:0/2894528603 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8df00096b0 con 0x55858c2e6f40 2024-01-25T15:03:34.733 INFO:tasks.workunit.client.0.smithi170.stdout:4/203: getdents d6/d7/d34 0 2024-01-25T15:03:34.734 INFO:tasks.workunit.client.0.smithi170.stdout:4/204: write d6/d7/f14 [1004224,3833] 0 2024-01-25T15:03:34.734 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.730+0000 7f8de5ffb640 1 -- 172.21.15.170:0/2894528603 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df00035f0 con 0x55858c2e6f40 2024-01-25T15:03:34.734 INFO:tasks.workunit.client.0.smithi170.stdout:4/205: creat d6/d7/d1b/f3b x:0 0 0 2024-01-25T15:03:34.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.731+0000 7f8e08f67740 1 -- 172.21.15.170:0/2894528603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 msgr2=0x55858c2e8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.735 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.731+0000 7f8e08f67740 1 --2- 172.21.15.170:0/2894528603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2e8df0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8df0033000 tx=0x7f8df0034f40 comp rx=0 tx=0).stop 2024-01-25T15:03:34.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:34 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/534194234' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:03:34.735 INFO:tasks.workunit.client.0.smithi170.stdout:7/281: rename d8/c14 to d8/d20/d3b/d4d/c70 0 2024-01-25T15:03:34.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.731+0000 7f8e08f67740 1 -- 172.21.15.170:0/2894528603 shutdown_connections 2024-01-25T15:03:34.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.731+0000 7f8e08f67740 1 --2- 172.21.15.170:0/2894528603 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2ecaa0 0x55858c2f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.731+0000 7f8e08f67740 1 --2- 172.21.15.170:0/2894528603 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2e7930 0x55858c2e9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.731+0000 7f8e08f67740 1 --2- 172.21.15.170:0/2894528603 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2e8df0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.736 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.731+0000 7f8e08f67740 1 -- 172.21.15.170:0/2894528603 >> 172.21.15.170:0/2894528603 conn(0x55858c2e24b0 msgr2=0x55858c2e8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.736 INFO:tasks.workunit.client.0.smithi170.stdout:7/282: write d8/f12 [649370,52607] 0 2024-01-25T15:03:34.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.731+0000 7f8e08f67740 1 -- 172.21.15.170:0/2894528603 shutdown_connections 2024-01-25T15:03:34.737 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.731+0000 7f8e08f67740 1 -- 172.21.15.170:0/2894528603 wait complete. 2024-01-25T15:03:34.737 INFO:tasks.workunit.client.0.smithi170.stdout:0/249: symlink d8/l54 0 2024-01-25T15:03:34.737 INFO:tasks.workunit.client.0.smithi170.stdout:0/250: dread - d8/d10/f36 zero size 2024-01-25T15:03:34.738 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.732+0000 7f8e08f67740 1 -- start start 2024-01-25T15:03:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.732+0000 7f8e08f67740 1 Processor -- start 2024-01-25T15:03:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.733+0000 7f8e08f67740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2f8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.733+0000 7f8e08f67740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 0x55858c2f85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.733+0000 7f8e08f67740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 0x55858c2f66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.733+0000 7f8e08f67740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858c2f6df0 con 0x55858c2e6f40 2024-01-25T15:03:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.733+0000 7f8e08f67740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858c2f6f60 con 0x55858c2e7930 2024-01-25T15:03:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.733+0000 7f8e08f67740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55858c2f7120 con 0x55858c2ecaa0 2024-01-25T15:03:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.733+0000 7f8e08f67740 10 client.0 _ll_register_callbacks cb 0x7f8df8009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.733+0000 7f8e04941640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 0x55858c2f66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.739 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.733+0000 7f8dfffff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2f8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.740 INFO:tasks.workunit.client.0.smithi170.stdout:7/283: dread d8/d20/d45/f4a [0,4194304] 0 2024-01-25T15:03:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.733+0000 7f8e04941640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 0x55858c2f66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:51692/0 (socket says 172.21.15.170:51692) 2024-01-25T15:03:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.733+0000 7f8e04941640 1 -- 172.21.15.170:0/3372356567 learned_addr learned my addr 172.21.15.170:0/3372356567 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.733+0000 7f8dfffff640 1 --2- 172.21.15.170:0/3372356567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2f8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:54304/0 (socket says 172.21.15.170:54304) 2024-01-25T15:03:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.733+0000 7f8dff7fe640 1 --2- 172.21.15.170:0/3372356567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 0x55858c2f85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.734+0000 7f8e04941640 1 -- 172.21.15.170:0/3372356567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 msgr2=0x55858c2f85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.734+0000 7f8e04941640 1 --2- 172.21.15.170:0/3372356567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 0x55858c2f85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.734+0000 7f8e04941640 1 -- 172.21.15.170:0/3372356567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 msgr2=0x55858c2f8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.734+0000 7f8e04941640 1 --2- 172.21.15.170:0/3372356567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2f8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.741 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.734+0000 7f8e04941640 1 -- 172.21.15.170:0/3372356567 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55858c24c8d0 con 0x55858c2ecaa0 2024-01-25T15:03:34.742 INFO:tasks.workunit.client.0.smithi170.stdout:5/176: rename d5/d10/f12 to d5/d10/f42 0 2024-01-25T15:03:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.734+0000 7f8e04941640 1 --2- 172.21.15.170:0/3372356567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 0x55858c2f66f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55858c2e3420 tx=0x7f8df80057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8805f4c25e185f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.734+0000 7f8ddf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-01-25T15:03:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.734+0000 7f8ddf7fe640 1 -- 172.21.15.170:0/3372356567 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8021050 con 0x55858c2ecaa0 2024-01-25T15:03:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.734+0000 7f8e08f67740 1 -- 172.21.15.170:0/3372356567 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8df8004c80 con 0x55858c2ecaa0 2024-01-25T15:03:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.734+0000 7f8ddf7fe640 1 -- 172.21.15.170:0/3372356567 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f8df80049e0 con 0x55858c2ecaa0 2024-01-25T15:03:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.734+0000 7f8ddf7fe640 1 -- 172.21.15.170:0/3372356567 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8df8004df0 con 0x55858c2ecaa0 2024-01-25T15:03:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.734+0000 7f8e08f67740 10 client.25342 fetch_fsmap learned FSMap version 30 2024-01-25T15:03:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.734+0000 7f8e08f67740 1 -- 172.21.15.170:0/3372356567 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55858c20f050 con 0x55858c2ecaa0 2024-01-25T15:03:34.743 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.735+0000 7f8ddf7fe640 1 -- 172.21.15.170:0/3372356567 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8df8035020 con 0x55858c2ecaa0 2024-01-25T15:03:34.744 INFO:tasks.workunit.client.0.smithi170.stdout:7/284: dread f2 [0,4194304] 0 2024-01-25T15:03:34.744 INFO:tasks.workunit.client.0.smithi170.stdout:1/245: dwrite d0/ff [0,4194304] 0 2024-01-25T15:03:34.744 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.736+0000 7f8ddf7fe640 1 -- 172.21.15.170:0/3372356567 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 30) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f8df800c070 con 0x55858c2ecaa0 2024-01-25T15:03:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.736+0000 7f8e08f67740 10 client.25342 fetch_fsmap finished waiting for FSMap version 30 2024-01-25T15:03:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.736+0000 7f8e08f67740 10 client.25342 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.736+0000 7f8e08f67740 20 client.25342 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.736+0000 7f8e08f67740 1 --2- 172.21.15.170:0/3372356567 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55858c354a20 0x55858c356e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.736+0000 7f8e08f67740 4 client.25342 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:03:34.745 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.736+0000 7f8e08f67740 1 -- 172.21.15.170:0/3372356567 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55858bf4d7e0 con 0x55858c354a20 2024-01-25T15:03:34.745 INFO:tasks.workunit.client.0.smithi170.stdout:8/170: dread d3/d7/f10 [0,4194304] 0 2024-01-25T15:03:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.737+0000 7f8dfffff640 1 --2- 172.21.15.170:0/3372356567 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55858c354a20 0x55858c356e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:34.746 INFO:tasks.workunit.client.0.smithi170.stdout:5/177: truncate d5/d10/f17 480410 0 2024-01-25T15:03:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.738+0000 7f8dfffff640 1 --2- 172.21.15.170:0/3372356567 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55858c354a20 0x55858c356e10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80c7067091d5bda8 server_cookie=ce511422a0c0dd97 in_seq=0 out_seq=0 2024-01-25T15:03:34.746 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.738+0000 7f8ddf7fe640 10 client.25342 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:34.747 INFO:tasks.workunit.client.0.smithi170.stdout:7/285: mkdir d8/d20/d45/d68/d71 0 2024-01-25T15:03:34.747 INFO:tasks.workunit.client.0.smithi170.stdout:1/246: mkdir d0/d50 0 2024-01-25T15:03:34.747 INFO:tasks.workunit.client.0.smithi170.stdout:1/247: readlink d0/d2e/l42 0 2024-01-25T15:03:34.747 INFO:tasks.workunit.client.0.smithi170.stdout:1/248: write d0/f41 [79306,122793] 0 2024-01-25T15:03:34.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.745+0000 7f8ddf7fe640 1 -- 172.21.15.170:0/3372356567 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55858bf4d7e0 con 0x55858c354a20 2024-01-25T15:03:34.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.745+0000 7f8ddf7fe640 10 client.25342 handle_command_reply: tid=0 2024-01-25T15:03:34.748 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.745+0000 7f8e08f67740 1 client.25342 shutdown 2024-01-25T15:03:34.748 INFO:tasks.workunit.client.0.smithi170.stdout:9/207: dwrite d5/df/f20 [0,4194304] 0 2024-01-25T15:03:34.748 INFO:tasks.workunit.client.0.smithi170.stdout:9/208: truncate d5/d1e/d21/d34/f3d 513712 0 2024-01-25T15:03:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.745+0000 7f8e08f67740 1 -- 172.21.15.170:0/3372356567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 msgr2=0x55858c2f66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.745+0000 7f8e08f67740 1 --2- 172.21.15.170:0/3372356567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 0x55858c2f66f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55858c2e3420 tx=0x7f8df80057c0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.745+0000 7f8e08f67740 1 -- 172.21.15.170:0/3372356567 shutdown_connections 2024-01-25T15:03:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.745+0000 7f8e08f67740 1 --2- 172.21.15.170:0/3372356567 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55858c354a20 0x55858c356e10 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.746+0000 7f8ddf7fe640 0 client.25342 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.746+0000 7f8e08f67740 1 --2- 172.21.15.170:0/3372356567 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55858c2e7930 0x55858c2f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.746+0000 7f8e08f67740 1 --2- 172.21.15.170:0/3372356567 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55858c2ecaa0 0x55858c2f66f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.746+0000 7f8e08f67740 1 --2- 172.21.15.170:0/3372356567 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55858c2e6f40 0x55858c2f8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.746+0000 7f8e08f67740 1 -- 172.21.15.170:0/3372356567 >> 172.21.15.170:0/3372356567 conn(0x55858c2e24b0 msgr2=0x55858c2e8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.750 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.746+0000 7f8e08f67740 1 -- 172.21.15.170:0/3372356567 shutdown_connections 2024-01-25T15:03:34.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.746+0000 7f8e08f67740 1 -- 172.21.15.170:0/3372356567 wait complete. 2024-01-25T15:03:34.751 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.746+0000 7f8e08f67740 20 client.25342 trim_cache size 0 max 16384 2024-01-25T15:03:34.751 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:03:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.747+0000 7f8e063a4640 1 -- 172.21.15.170:0/1881690511 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8de80a12e0 msgr2=0x7f8de80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.747+0000 7f8e063a4640 1 --2- 172.21.15.170:0/1881690511 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8de80a12e0 0x7f8de80a37a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8df0037040 tx=0x7f8df0034db0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.747+0000 7f8e063a4640 1 -- 172.21.15.170:0/1881690511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e000fff20 msgr2=0x7f8e00199440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.747+0000 7f8e063a4640 1 --2- 172.21.15.170:0/1881690511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e000fff20 0x7f8e00199440 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f8df400e9c0 tx=0x7f8df400ee80 comp rx=0 tx=0).stop 2024-01-25T15:03:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.747+0000 7f8e063a4640 1 -- 172.21.15.170:0/1881690511 shutdown_connections 2024-01-25T15:03:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.747+0000 7f8e063a4640 1 --2- 172.21.15.170:0/1881690511 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f8de80a12e0 0x7f8de80a37a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.752 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.747+0000 7f8e063a4640 1 --2- 172.21.15.170:0/1881690511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e001008c0 0x7f8e001a04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.747+0000 7f8e063a4640 1 --2- 172.21.15.170:0/1881690511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f8e000fff20 0x7f8e00199440 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.747+0000 7f8e063a4640 1 --2- 172.21.15.170:0/1881690511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f8e000ff5c0 0x7f8e00198f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:34.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.747+0000 7f8e063a4640 1 -- 172.21.15.170:0/1881690511 >> 172.21.15.170:0/1881690511 conn(0x7f8e000fb180 msgr2=0x7f8e000fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:34.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.747+0000 7f8e063a4640 1 -- 172.21.15.170:0/1881690511 shutdown_connections 2024-01-25T15:03:34.753 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:34.747+0000 7f8e063a4640 1 -- 172.21.15.170:0/1881690511 wait complete. 2024-01-25T15:03:34.753 INFO:tasks.workunit.client.0.smithi170.stdout:1/249: symlink d0/d20/d28/d2a/d4a/l51 0 2024-01-25T15:03:34.757 INFO:tasks.workunit.client.0.smithi170.stdout:5/178: rmdir d5/d10/d2c 39 2024-01-25T15:03:34.759 INFO:tasks.workunit.client.0.smithi170.stdout:7/286: getdents d8/d20/d2a/d35 0 2024-01-25T15:03:34.759 INFO:tasks.workunit.client.0.smithi170.stdout:7/287: write d8/f17 [61683,95883] 0 2024-01-25T15:03:34.762 INFO:tasks.workunit.client.0.smithi170.stdout:6/254: dread d2/f40 [0,4194304] 0 2024-01-25T15:03:34.762 INFO:tasks.workunit.client.0.smithi170.stdout:6/255: chown d2/d7/d23/d19/l4e 193 1 2024-01-25T15:03:34.764 INFO:tasks.workunit.client.0.smithi170.stdout:9/209: rename d5/df/d12 to d5/d1e/d21/d46 0 2024-01-25T15:03:34.768 INFO:tasks.workunit.client.0.smithi170.stdout:9/210: unlink d5/d1e/d21/c25 0 2024-01-25T15:03:34.768 INFO:tasks.workunit.client.0.smithi170.stdout:9/211: creat d5/d1e/d21/d34/f47 x:0 0 0 2024-01-25T15:03:34.768 INFO:tasks.workunit.client.0.smithi170.stdout:3/216: dwrite d3/d10/fe [0,4194304] 0 2024-01-25T15:03:34.768 INFO:tasks.workunit.client.0.smithi170.stdout:2/296: dwrite ff [0,4194304] 0 2024-01-25T15:03:34.770 INFO:tasks.workunit.client.0.smithi170.stdout:7/288: rename d8/d20/d2a/l3f to d8/d20/d45/d68/d71/l72 0 2024-01-25T15:03:34.773 INFO:tasks.workunit.client.0.smithi170.stdout:0/251: dwrite d8/d10/d2d/d2f/f37 [0,4194304] 0 2024-01-25T15:03:34.775 INFO:tasks.workunit.client.0.smithi170.stdout:9/212: symlink d5/d1e/d21/d46/d18/l48 0 2024-01-25T15:03:34.775 INFO:tasks.workunit.client.0.smithi170.stdout:3/217: rmdir d3/d1c/d2b 39 2024-01-25T15:03:34.777 INFO:tasks.workunit.client.0.smithi170.stdout:2/297: rename d10/d1e/d32/d3e/c55 to d10/d16/d42/c68 0 2024-01-25T15:03:34.778 INFO:tasks.workunit.client.0.smithi170.stdout:2/298: chown d10/d1e/l64 723 1 2024-01-25T15:03:34.778 INFO:tasks.workunit.client.0.smithi170.stdout:2/299: write d10/d1e/f53 [123231,61414] 0 2024-01-25T15:03:34.778 INFO:tasks.workunit.client.0.smithi170.stdout:0/252: mknod d8/d10/d2d/d2f/c55 0 2024-01-25T15:03:34.778 INFO:tasks.workunit.client.0.smithi170.stdout:0/253: readlink d8/d10/d2d/d2f/d4f/l4e 0 2024-01-25T15:03:34.779 INFO:tasks.workunit.client.0.smithi170.stdout:9/213: mkdir d5/df/d49 0 2024-01-25T15:03:34.779 INFO:tasks.workunit.client.0.smithi170.stdout:3/218: truncate d3/d10/f1a 3486788 0 2024-01-25T15:03:34.779 INFO:tasks.workunit.client.0.smithi170.stdout:3/219: readlink d3/d10/d1e/d21/d41/l44 0 2024-01-25T15:03:34.780 INFO:tasks.workunit.client.0.smithi170.stdout:3/220: getdents d3/d3b 0 2024-01-25T15:03:34.781 INFO:tasks.workunit.client.0.smithi170.stdout:2/300: creat d10/d1e/d32/d63/f69 x:0 0 0 2024-01-25T15:03:34.782 INFO:tasks.workunit.client.0.smithi170.stdout:9/214: symlink d5/d1e/d21/d27/l4a 0 2024-01-25T15:03:34.783 INFO:tasks.workunit.client.0.smithi170.stdout:5/179: dread d5/f11 [0,4194304] 0 2024-01-25T15:03:34.783 INFO:tasks.workunit.client.0.smithi170.stdout:5/180: getdents d5/d10/d2c/d3a/d41 0 2024-01-25T15:03:34.783 INFO:tasks.workunit.client.0.smithi170.stdout:5/181: write d5/f1b [3707050,60346] 0 2024-01-25T15:03:34.783 INFO:tasks.workunit.client.0.smithi170.stdout:5/182: chown d5/d10/f42 0 1 2024-01-25T15:03:34.783 INFO:tasks.workunit.client.0.smithi170.stdout:3/221: rename d3/c40 to d3/d10/d13/d1b/d29/c49 0 2024-01-25T15:03:34.783 INFO:tasks.workunit.client.0.smithi170.stdout:3/222: chown d3/d10/d13/d1b/l32 126329 1 2024-01-25T15:03:34.783 INFO:tasks.workunit.client.0.smithi170.stdout:3/223: fsync d3/d10/d13/f36 0 2024-01-25T15:03:34.784 INFO:tasks.workunit.client.0.smithi170.stdout:5/183: truncate d5/d2a/f3e 43607 0 2024-01-25T15:03:34.784 INFO:tasks.workunit.client.0.smithi170.stdout:2/301: dread d10/d1b/f25 [0,4194304] 0 2024-01-25T15:03:34.784 INFO:tasks.workunit.client.0.smithi170.stdout:3/224: mkdir d3/d10/d1e/d21/d41/d4a 0 2024-01-25T15:03:34.785 INFO:tasks.workunit.client.0.smithi170.stdout:5/184: mkdir d5/d10/d2c/d3a/d3d/d43 0 2024-01-25T15:03:34.787 INFO:tasks.workunit.client.0.smithi170.stdout:1/250: dwrite d0/d20/f4d [0,4194304] 0 2024-01-25T15:03:34.787 INFO:tasks.workunit.client.0.smithi170.stdout:2/302: rename d10/d1b/c39 to d10/d16/d42/c6a 0 2024-01-25T15:03:34.789 INFO:tasks.workunit.client.0.smithi170.stdout:4/206: dwrite d6/d7/f17 [0,4194304] 0 2024-01-25T15:03:34.789 INFO:tasks.workunit.client.0.smithi170.stdout:3/225: mkdir d3/d10/d1e/d21/d41/d4b 0 2024-01-25T15:03:34.789 INFO:tasks.workunit.client.0.smithi170.stdout:4/207: fdatasync d6/d7/d34/f30 0 2024-01-25T15:03:34.789 INFO:tasks.workunit.client.0.smithi170.stdout:3/226: write d3/d10/d1e/f30 [106076,73845] 0 2024-01-25T15:03:34.790 INFO:tasks.workunit.client.0.smithi170.stdout:3/227: stat d3/d10/d13/f36 0 2024-01-25T15:03:34.790 INFO:tasks.workunit.client.0.smithi170.stdout:5/185: creat d5/d10/d2c/d3a/d41/f44 x:0 0 0 2024-01-25T15:03:34.792 INFO:tasks.workunit.client.0.smithi170.stdout:8/171: dwrite d3/d7/d1e/f20 [0,4194304] 0 2024-01-25T15:03:34.793 INFO:tasks.workunit.client.0.smithi170.stdout:7/289: dwrite d8/d20/f22 [0,4194304] 0 2024-01-25T15:03:34.793 INFO:tasks.workunit.client.0.smithi170.stdout:7/290: stat d8/f1f 0 2024-01-25T15:03:34.793 INFO:tasks.workunit.client.0.smithi170.stdout:1/251: creat d0/d50/f52 x:0 0 0 2024-01-25T15:03:34.793 INFO:tasks.workunit.client.0.smithi170.stdout:1/252: fdatasync d0/fd 0 2024-01-25T15:03:34.794 INFO:tasks.workunit.client.0.smithi170.stdout:4/208: mknod d6/d28/c3c 0 2024-01-25T15:03:34.797 INFO:tasks.workunit.client.0.smithi170.stdout:3/228: creat d3/f4c x:0 0 0 2024-01-25T15:03:34.804 INFO:tasks.workunit.client.0.smithi170.stdout:9/215: dwrite f4 [0,4194304] 0 2024-01-25T15:03:34.807 INFO:tasks.workunit.client.0.smithi170.stdout:5/186: truncate d5/d2a/f3e 353832 0 2024-01-25T15:03:34.813 INFO:tasks.workunit.client.0.smithi170.stdout:7/291: mkdir d8/d20/d73 0 2024-01-25T15:03:34.813 INFO:tasks.workunit.client.0.smithi170.stdout:7/292: readlink d8/d20/d2a/l2b 0 2024-01-25T15:03:34.814 INFO:tasks.workunit.client.0.smithi170.stdout:1/253: rmdir d0/d20/d28/d2a 39 2024-01-25T15:03:34.814 INFO:tasks.workunit.client.0.smithi170.stdout:1/254: creat d0/d20/d3a/f53 x:0 0 0 2024-01-25T15:03:34.814 INFO:tasks.workunit.client.0.smithi170.stdout:1/255: readlink d0/d20/d28/d2a/d4a/l51 0 2024-01-25T15:03:34.814 INFO:tasks.workunit.client.0.smithi170.stdout:7/293: dread d8/f17 [0,4194304] 0 2024-01-25T15:03:34.817 INFO:tasks.workunit.client.0.smithi170.stdout:4/209: unlink d6/fd 0 2024-01-25T15:03:34.818 INFO:tasks.workunit.client.0.smithi170.stdout:3/229: creat d3/d2a/f4d x:0 0 0 2024-01-25T15:03:34.819 INFO:tasks.workunit.client.0.smithi170.stdout:9/216: creat d5/df/d49/f4b x:0 0 0 2024-01-25T15:03:34.821 INFO:tasks.workunit.client.0.smithi170.stdout:1/256: rename d0/f9 to d0/d20/d3a/f54 0 2024-01-25T15:03:34.822 INFO:tasks.workunit.client.0.smithi170.stdout:1/257: fdatasync d0/fe 0 2024-01-25T15:03:34.822 INFO:tasks.workunit.client.0.smithi170.stdout:1/258: stat d0/f33 0 2024-01-25T15:03:34.822 INFO:tasks.workunit.client.0.smithi170.stdout:1/259: write d0/fe [264617,60547] 0 2024-01-25T15:03:34.822 INFO:tasks.workunit.client.0.smithi170.stdout:3/230: creat d3/d10/d13/d1b/d29/d38/f4e x:0 0 0 2024-01-25T15:03:34.825 INFO:tasks.workunit.client.0.smithi170.stdout:1/260: link d0/d20/d28/c32 d0/d20/d28/c55 0 2024-01-25T15:03:34.828 INFO:tasks.workunit.client.0.smithi170.stdout:1/261: mkdir d0/d20/d28/d2a/d4a/d56 0 2024-01-25T15:03:34.841 INFO:tasks.workunit.client.0.smithi170.stdout:8/172: dwrite d3/d7/f16 [0,4194304] 0 2024-01-25T15:03:34.841 INFO:tasks.workunit.client.0.smithi170.stdout:8/173: fdatasync d3/d7/d1e/f20 0 2024-01-25T15:03:34.841 INFO:tasks.workunit.client.0.smithi170.stdout:8/174: chown d3/d7/d22/d23/l2e 134594 1 2024-01-25T15:03:34.845 INFO:tasks.workunit.client.0.smithi170.stdout:7/294: dwrite d8/d20/d2a/d35/d55/f67 [0,4194304] 0 2024-01-25T15:03:34.847 INFO:tasks.workunit.client.0.smithi170.stdout:7/295: fsync d8/d20/f2e 0 2024-01-25T15:03:34.847 INFO:tasks.workunit.client.0.smithi170.stdout:7/296: readlink d8/d20/d2a/l36 0 2024-01-25T15:03:34.847 INFO:tasks.workunit.client.0.smithi170.stdout:7/297: chown d8/d20/d2a/d35/f37 24634 1 2024-01-25T15:03:34.849 INFO:tasks.workunit.client.0.smithi170.stdout:4/210: dwrite f2 [0,4194304] 0 2024-01-25T15:03:34.849 INFO:tasks.workunit.client.0.smithi170.stdout:3/231: dwrite d3/d10/d13/d1b/d29/d38/f4e [0,4194304] 0 2024-01-25T15:03:34.849 INFO:tasks.workunit.client.0.smithi170.stdout:3/232: write d3/d10/f23 [425340,19921] 0 2024-01-25T15:03:34.853 INFO:tasks.workunit.client.0.smithi170.stdout:7/298: dread d8/f12 [0,4194304] 0 2024-01-25T15:03:34.853 INFO:tasks.workunit.client.0.smithi170.stdout:7/299: fsync d8/d20/d2a/f5a 0 2024-01-25T15:03:34.857 INFO:tasks.workunit.client.0.smithi170.stdout:9/217: dwrite d5/d1e/d21/d34/f3d [0,4194304] 0 2024-01-25T15:03:34.861 INFO:tasks.workunit.client.0.smithi170.stdout:9/218: mknod d5/d1e/d21/c4c 0 2024-01-25T15:03:34.863 INFO:tasks.workunit.client.0.smithi170.stdout:9/219: unlink d5/df/d49/f4b 0 2024-01-25T15:03:34.863 INFO:tasks.workunit.client.0.smithi170.stdout:9/220: read d5/dc/f30 [1670508,120056] 0 2024-01-25T15:03:34.863 INFO:tasks.workunit.client.0.smithi170.stdout:4/211: dread d6/f26 [0,4194304] 0 2024-01-25T15:03:34.863 INFO:tasks.workunit.client.0.smithi170.stdout:4/212: fsync f2 0 2024-01-25T15:03:34.864 INFO:tasks.workunit.client.0.smithi170.stdout:9/221: mknod d5/d1e/d21/d46/d18/c4d 0 2024-01-25T15:03:34.866 INFO:tasks.workunit.client.0.smithi170.stdout:3/233: dread d3/d10/fe [0,4194304] 0 2024-01-25T15:03:34.866 INFO:tasks.workunit.client.0.smithi170.stdout:4/213: rename d6/d7/d34/c35 to d6/d7/d34/c3d 0 2024-01-25T15:03:34.868 INFO:tasks.workunit.client.0.smithi170.stdout:9/222: rename d5/dc/f1c to d5/df/d16/d35/d3c/f4e 0 2024-01-25T15:03:34.869 INFO:tasks.workunit.client.0.smithi170.stdout:3/234: truncate d3/d10/f14 8190356 0 2024-01-25T15:03:34.869 INFO:tasks.workunit.client.0.smithi170.stdout:3/235: write d3/d10/f16 [177263,89150] 0 2024-01-25T15:03:34.870 INFO:tasks.workunit.client.0.smithi170.stdout:4/214: mknod d6/c3e 0 2024-01-25T15:03:34.871 INFO:tasks.workunit.client.0.smithi170.stdout:9/223: truncate d5/f8 7590913 0 2024-01-25T15:03:34.873 INFO:tasks.workunit.client.0.smithi170.stdout:3/236: mkdir d3/d3b/d4f 0 2024-01-25T15:03:34.874 INFO:tasks.workunit.client.0.smithi170.stdout:3/237: rmdir d3/d10 39 2024-01-25T15:03:34.875 INFO:tasks.workunit.client.0.smithi170.stdout:3/238: mknod d3/d3b/d4f/c50 0 2024-01-25T15:03:34.875 INFO:tasks.workunit.client.0.smithi170.stdout:3/239: chown d3/d10/d1e/d21/d41/d4b 52 1 2024-01-25T15:03:34.885 INFO:tasks.workunit.client.0.smithi170.stdout:9/224: write d5/df/d16/f19 [2639376,91136] 0 2024-01-25T15:03:34.885 INFO:tasks.workunit.client.0.smithi170.stdout:9/225: chown d5/df/d49 1711854366 1 2024-01-25T15:03:34.886 INFO:tasks.workunit.client.0.smithi170.stdout:9/226: dread - d5/d1e/f24 zero size 2024-01-25T15:03:34.887 INFO:tasks.workunit.client.0.smithi170.stdout:9/227: symlink d5/dc/d42/l4f 0 2024-01-25T15:03:34.888 INFO:tasks.workunit.client.0.smithi170.stdout:9/228: rmdir d5/df/d2e 39 2024-01-25T15:03:34.888 INFO:tasks.workunit.client.0.smithi170.stdout:9/229: read f2 [1597693,102544] 0 2024-01-25T15:03:34.889 INFO:tasks.workunit.client.0.smithi170.stdout:9/230: symlink d5/d1e/d21/d27/l50 0 2024-01-25T15:03:34.889 INFO:tasks.workunit.client.0.smithi170.stdout:9/231: fsync d5/df/d2e/f39 0 2024-01-25T15:03:34.890 INFO:tasks.workunit.client.0.smithi170.stdout:9/232: truncate f4 1600594 0 2024-01-25T15:03:34.891 INFO:tasks.workunit.client.0.smithi170.stdout:9/233: symlink d5/df/d16/l51 0 2024-01-25T15:03:34.892 INFO:tasks.workunit.client.0.smithi170.stdout:9/234: mkdir d5/df/d16/d52 0 2024-01-25T15:03:34.902 INFO:tasks.workunit.client.0.smithi170.stdout:4/215: dwrite f2 [4194304,4194304] 0 2024-01-25T15:03:34.903 INFO:tasks.workunit.client.0.smithi170.stdout:6/256: sync 2024-01-25T15:03:34.905 INFO:tasks.workunit.client.0.smithi170.stdout:6/257: rename d2/d7/d1b/d28/c39 to d2/d7/d1b/c5a 0 2024-01-25T15:03:34.905 INFO:tasks.workunit.client.0.smithi170.stdout:6/258: dread - d2/d7/d1b/d28/f49 zero size 2024-01-25T15:03:34.906 INFO:tasks.workunit.client.0.smithi170.stdout:6/259: symlink d2/d7/d23/d19/d2a/d43/d44/l5b 0 2024-01-25T15:03:34.908 INFO:tasks.workunit.client.0.smithi170.stdout:9/235: write d5/df/d16/f2b [6113814,35136] 0 2024-01-25T15:03:34.908 INFO:tasks.workunit.client.0.smithi170.stdout:3/240: dwrite d3/d10/d13/d1b/d29/d38/f4e [0,4194304] 0 2024-01-25T15:03:34.908 INFO:tasks.workunit.client.0.smithi170.stdout:3/241: readlink d3/d10/d13/d1b/l2e 0 2024-01-25T15:03:34.908 INFO:tasks.workunit.client.0.smithi170.stdout:6/260: link d2/d7/l15 d2/d7/d23/l5c 0 2024-01-25T15:03:34.909 INFO:tasks.workunit.client.0.smithi170.stdout:4/216: dread d6/d7/f14 [0,4194304] 0 2024-01-25T15:03:34.910 INFO:tasks.workunit.client.0.smithi170.stdout:9/236: mknod d5/df/d2e/c53 0 2024-01-25T15:03:34.910 INFO:tasks.workunit.client.0.smithi170.stdout:9/237: stat d5/d1e/d21/d46/d18 0 2024-01-25T15:03:34.914 INFO:tasks.workunit.client.0.smithi170.stdout:3/242: dread d3/d10/d13/f25 [0,4194304] 0 2024-01-25T15:03:34.916 INFO:tasks.workunit.client.0.smithi170.stdout:9/238: dread d5/f14 [0,4194304] 0 2024-01-25T15:03:34.916 INFO:tasks.workunit.client.0.smithi170.stdout:9/239: dread - d5/d1e/d21/d34/f47 zero size 2024-01-25T15:03:34.918 INFO:tasks.workunit.client.0.smithi170.stdout:9/240: symlink d5/d1e/d21/d46/d18/l54 0 2024-01-25T15:03:34.918 INFO:tasks.workunit.client.0.smithi170.stdout:6/261: dread d2/f40 [0,4194304] 0 2024-01-25T15:03:34.918 INFO:tasks.workunit.client.0.smithi170.stdout:6/262: chown d2/c21 14 1 2024-01-25T15:03:34.919 INFO:tasks.workunit.client.0.smithi170.stdout:9/241: creat d5/d1e/d21/d46/f55 x:0 0 0 2024-01-25T15:03:34.920 INFO:tasks.workunit.client.0.smithi170.stdout:6/263: mkdir d2/d7/d23/d19/d2f/d5d 0 2024-01-25T15:03:34.921 INFO:tasks.workunit.client.0.smithi170.stdout:9/242: mkdir d5/df/d16/d35/d3c/d56 0 2024-01-25T15:03:34.923 INFO:tasks.workunit.client.0.smithi170.stdout:9/243: creat d5/d1e/f57 x:0 0 0 2024-01-25T15:03:34.925 INFO:tasks.workunit.client.0.smithi170.stdout:9/244: link d5/df/d16/d35/d3c/f45 d5/df/d16/d35/f58 0 2024-01-25T15:03:34.926 INFO:tasks.workunit.client.0.smithi170.stdout:9/245: chown d5/d1e/d21/d46/d18/l48 31 1 2024-01-25T15:03:34.932 INFO:tasks.workunit.client.0.smithi170.stdout:4/217: dwrite d6/f26 [0,4194304] 0 2024-01-25T15:03:34.933 INFO:tasks.workunit.client.0.smithi170.stdout:4/218: creat d6/d7/d31/f3f x:0 0 0 2024-01-25T15:03:34.933 INFO:tasks.workunit.client.0.smithi170.stdout:4/219: truncate d6/d7/d1b/f33 648652 0 2024-01-25T15:03:34.952 INFO:tasks.workunit.client.0.smithi170.stdout:9/246: dwrite d5/df/f3b [0,4194304] 0 2024-01-25T15:03:34.953 INFO:tasks.workunit.client.0.smithi170.stdout:3/243: dwrite d3/d10/ff [0,4194304] 0 2024-01-25T15:03:34.953 INFO:tasks.workunit.client.0.smithi170.stdout:3/244: chown d3/d1c/d2d/f48 323 1 2024-01-25T15:03:34.953 INFO:tasks.workunit.client.0.smithi170.stdout:3/245: truncate d3/d2a/f4d 661559 0 2024-01-25T15:03:34.953 INFO:tasks.workunit.client.0.smithi170.stdout:3/246: fdatasync d3/d10/d13/f1d 0 2024-01-25T15:03:34.953 INFO:tasks.workunit.client.0.smithi170.stdout:6/264: dwrite d2/d7/f2e [0,4194304] 0 2024-01-25T15:03:34.953 INFO:tasks.workunit.client.0.smithi170.stdout:6/265: readlink d2/d7/d23/d19/l4e 0 2024-01-25T15:03:34.955 INFO:tasks.workunit.client.0.smithi170.stdout:6/266: link d2/d7/d23/d19/d2a/d43/f59 d2/d7/d23/d19/f5e 0 2024-01-25T15:03:34.955 INFO:tasks.workunit.client.0.smithi170.stdout:6/267: readlink d2/d7/d23/d19/d2a/l38 0 2024-01-25T15:03:34.955 INFO:tasks.workunit.client.0.smithi170.stdout:6/268: chown d2/d7/d1b/f1f 78451 1 2024-01-25T15:03:34.959 INFO:tasks.workunit.client.0.smithi170.stdout:3/247: write d3/d10/f1a [1796619,79128] 0 2024-01-25T15:03:34.959 INFO:tasks.workunit.client.0.smithi170.stdout:3/248: fdatasync d3/d10/d13/f34 0 2024-01-25T15:03:34.959 INFO:tasks.workunit.client.0.smithi170.stdout:3/249: fsync d3/fa 0 2024-01-25T15:03:34.960 INFO:tasks.workunit.client.0.smithi170.stdout:4/220: dwrite f2 [0,4194304] 0 2024-01-25T15:03:34.961 INFO:tasks.workunit.client.0.smithi170.stdout:3/250: dread d3/d1c/f24 [0,4194304] 0 2024-01-25T15:03:34.963 INFO:tasks.workunit.client.0.smithi170.stdout:3/251: rename d3/d10/d13/d1b/l2e to d3/d1c/d2d/l51 0 2024-01-25T15:03:34.967 INFO:tasks.workunit.client.0.smithi170.stdout:4/221: write d6/d7/fa [3588694,21508] 0 2024-01-25T15:03:34.968 INFO:tasks.workunit.client.0.smithi170.stdout:4/222: creat d6/d37/f40 x:0 0 0 2024-01-25T15:03:34.968 INFO:tasks.workunit.client.0.smithi170.stdout:4/223: creat d6/d7/d1b/f41 x:0 0 0 2024-01-25T15:03:34.972 INFO:tasks.workunit.client.0.smithi170.stdout:4/224: mknod d6/d7/d1b/c42 0 2024-01-25T15:03:34.976 INFO:tasks.workunit.client.0.smithi170.stdout:6/269: dwrite d2/d7/d23/d19/d2f/d37/f50 [0,4194304] 0 2024-01-25T15:03:34.977 INFO:tasks.workunit.client.0.smithi170.stdout:3/252: dread d3/f17 [0,4194304] 0 2024-01-25T15:03:34.979 INFO:tasks.workunit.client.0.smithi170.stdout:6/270: link d2/c4c d2/d7/d1b/d28/c5f 0 2024-01-25T15:03:34.980 INFO:tasks.workunit.client.0.smithi170.stdout:6/271: unlink d2/l16 0 2024-01-25T15:03:34.981 INFO:tasks.workunit.client.0.smithi170.stdout:6/272: truncate d2/d7/f18 249453 0 2024-01-25T15:03:34.983 INFO:tasks.workunit.client.0.smithi170.stdout:6/273: mkdir d2/d7/d23/d19/d60 0 2024-01-25T15:03:34.983 INFO:tasks.workunit.client.0.smithi170.stdout:6/274: readlink d2/d7/d23/l12 0 2024-01-25T15:03:34.985 INFO:tasks.workunit.client.0.smithi170.stdout:6/275: write d2/d7/d23/d19/d2a/d43/f59 [913324,82896] 0 2024-01-25T15:03:34.992 INFO:tasks.workunit.client.0.smithi170.stdout:5/187: sync 2024-01-25T15:03:34.993 INFO:tasks.workunit.client.0.smithi170.stdout:0/254: sync 2024-01-25T15:03:34.993 INFO:tasks.workunit.client.0.smithi170.stdout:2/303: sync 2024-01-25T15:03:34.993 INFO:tasks.workunit.client.0.smithi170.stdout:0/255: readlink d8/d18/l4c 0 2024-01-25T15:03:34.995 INFO:tasks.workunit.client.0.smithi170.stdout:0/256: creat d8/d9/f56 x:0 0 0 2024-01-25T15:03:34.995 INFO:tasks.workunit.client.0.smithi170.stdout:0/257: write d8/d9/f16 [2274019,90358] 0 2024-01-25T15:03:34.996 INFO:tasks.workunit.client.0.smithi170.stdout:2/304: creat d10/d1e/d32/d3e/f6b x:0 0 0 2024-01-25T15:03:34.997 INFO:tasks.workunit.client.0.smithi170.stdout:0/258: rmdir d8/d3a 39 2024-01-25T15:03:34.997 INFO:tasks.workunit.client.0.smithi170.stdout:6/276: read d2/f4 [3759645,24447] 0 2024-01-25T15:03:34.998 INFO:tasks.workunit.client.0.smithi170.stdout:6/277: mknod d2/d7/d23/d19/d2f/d5d/c61 0 2024-01-25T15:03:34.998 INFO:tasks.workunit.client.0.smithi170.stdout:6/278: chown d2/d7/d23/d19/f29 1721878 1 2024-01-25T15:03:34.998 INFO:tasks.workunit.client.0.smithi170.stdout:6/279: write d2/d7/d1b/f1f [183692,6609] 0 2024-01-25T15:03:35.000 INFO:tasks.workunit.client.0.smithi170.stdout:6/280: rmdir d2/d7/d23/d19/d2a/d43/d44 39 2024-01-25T15:03:35.001 INFO:tasks.workunit.client.0.smithi170.stdout:6/281: link d2/d7/d23/d19/d2a/d43/f59 d2/d7/d23/d19/d2f/d37/f62 0 2024-01-25T15:03:35.002 INFO:tasks.workunit.client.0.smithi170.stdout:4/225: dwrite d6/d7/d1b/f36 [0,4194304] 0 2024-01-25T15:03:35.002 INFO:tasks.workunit.client.0.smithi170.stdout:4/226: dread - d6/d37/f40 zero size 2024-01-25T15:03:35.002 INFO:tasks.workunit.client.0.smithi170.stdout:4/227: readlink l1 0 2024-01-25T15:03:35.002 INFO:tasks.workunit.client.0.smithi170.stdout:4/228: readlink l1 0 2024-01-25T15:03:35.002 INFO:tasks.workunit.client.0.smithi170.stdout:4/229: creat d6/d7/d31/f43 x:0 0 0 2024-01-25T15:03:35.003 INFO:tasks.workunit.client.0.smithi170.stdout:6/282: mknod d2/d7/d1b/d28/c63 0 2024-01-25T15:03:35.004 INFO:tasks.workunit.client.0.smithi170.stdout:3/253: dwrite d3/d10/d13/f25 [0,4194304] 0 2024-01-25T15:03:35.007 INFO:tasks.workunit.client.0.smithi170.stdout:4/230: symlink d6/d7/d31/l44 0 2024-01-25T15:03:35.007 INFO:tasks.workunit.client.0.smithi170.stdout:4/231: fdatasync d6/d7/d31/f3f 0 2024-01-25T15:03:35.010 INFO:tasks.workunit.client.0.smithi170.stdout:4/232: rmdir d6/d7 39 2024-01-25T15:03:35.012 INFO:tasks.workunit.client.0.smithi170.stdout:4/233: rename d6/d7/fa to d6/d28/f45 0 2024-01-25T15:03:35.012 INFO:tasks.workunit.client.0.smithi170.stdout:4/234: truncate d6/f26 5152283 0 2024-01-25T15:03:35.012 INFO:tasks.workunit.client.0.smithi170.stdout:4/235: chown d6/d7/d34/f30 103249 1 2024-01-25T15:03:35.013 INFO:tasks.workunit.client.0.smithi170.stdout:4/236: rmdir d6/d37 39 2024-01-25T15:03:35.013 INFO:tasks.workunit.client.0.smithi170.stdout:4/237: chown d6/d28/l2b 85788789 1 2024-01-25T15:03:35.013 INFO:tasks.workunit.client.0.smithi170.stdout:6/283: dread d2/f3 [0,4194304] 0 2024-01-25T15:03:35.015 INFO:tasks.workunit.client.0.smithi170.stdout:0/259: read d8/fa [1002624,23298] 0 2024-01-25T15:03:35.015 INFO:tasks.workunit.client.0.smithi170.stdout:0/260: fdatasync d8/f42 0 2024-01-25T15:03:35.020 INFO:tasks.workunit.client.0.smithi170.stdout:5/188: dwrite d5/d10/f35 [0,4194304] 0 2024-01-25T15:03:35.020 INFO:tasks.workunit.client.0.smithi170.stdout:2/305: dwrite d10/d1b/f25 [0,4194304] 0 2024-01-25T15:03:35.020 INFO:tasks.workunit.client.0.smithi170.stdout:6/284: fdatasync d2/d7/d23/d19/d2f/d37/f62 0 2024-01-25T15:03:35.020 INFO:tasks.workunit.client.0.smithi170.stdout:6/285: fdatasync d2/d7/d23/f2d 0 2024-01-25T15:03:35.023 INFO:tasks.workunit.client.0.smithi170.stdout:3/254: dread d3/d10/d13/d1b/d29/d38/f4e [0,4194304] 0 2024-01-25T15:03:35.025 INFO:tasks.workunit.client.0.smithi170.stdout:0/261: write d8/d10/f1b [2687445,129669] 0 2024-01-25T15:03:35.025 INFO:tasks.workunit.client.0.smithi170.stdout:0/262: write d8/d10/f1b [1636574,60626] 0 2024-01-25T15:03:35.025 INFO:tasks.workunit.client.0.smithi170.stdout:0/263: chown d8/d9/l1e 18342 1 2024-01-25T15:03:35.026 INFO:tasks.workunit.client.0.smithi170.stdout:5/189: mkdir d5/d10/d2c/d45 0 2024-01-25T15:03:35.027 INFO:tasks.workunit.client.0.smithi170.stdout:2/306: symlink d10/d16/d42/l6c 0 2024-01-25T15:03:35.028 INFO:tasks.workunit.client.0.smithi170.stdout:3/255: mkdir d3/d10/d52 0 2024-01-25T15:03:35.028 INFO:tasks.workunit.client.0.smithi170.stdout:5/190: stat d5/d10/l18 0 2024-01-25T15:03:35.029 INFO:tasks.workunit.client.0.smithi170.stdout:2/307: symlink d10/d16/d42/l6d 0 2024-01-25T15:03:35.029 INFO:tasks.workunit.client.0.smithi170.stdout:2/308: write d10/d16/f35 [1252930,122638] 0 2024-01-25T15:03:35.029 INFO:tasks.workunit.client.0.smithi170.stdout:5/191: symlink d5/d10/d2c/l46 0 2024-01-25T15:03:35.030 INFO:tasks.workunit.client.0.smithi170.stdout:2/309: symlink d10/l6e 0 2024-01-25T15:03:35.031 INFO:tasks.workunit.client.0.smithi170.stdout:2/310: symlink d10/d16/d42/l6f 0 2024-01-25T15:03:35.038 INFO:tasks.workunit.client.0.smithi170.stdout:5/192: dread d5/f15 [0,4194304] 0 2024-01-25T15:03:35.039 INFO:tasks.workunit.client.0.smithi170.stdout:5/193: rename d5/d10/c25 to d5/d10/d2c/d3a/d3d/c47 0 2024-01-25T15:03:35.041 INFO:tasks.workunit.client.0.smithi170.stdout:5/194: creat d5/d10/d2c/d45/f48 x:0 0 0 2024-01-25T15:03:35.041 INFO:tasks.workunit.client.0.smithi170.stdout:5/195: stat d5/d10 0 2024-01-25T15:03:35.043 INFO:tasks.workunit.client.0.smithi170.stdout:0/264: dread f2 [0,4194304] 0 2024-01-25T15:03:35.043 INFO:tasks.workunit.client.0.smithi170.stdout:5/196: rmdir d5/d10/d2c/d3a/d3d/d43 0 2024-01-25T15:03:35.051 INFO:tasks.workunit.client.0.smithi170.stdout:3/256: write d3/d10/fe [3792272,107575] 0 2024-01-25T15:03:35.051 INFO:tasks.workunit.client.0.smithi170.stdout:4/238: dwrite d6/d7/d1b/f41 [0,4194304] 0 2024-01-25T15:03:35.052 INFO:tasks.workunit.client.0.smithi170.stdout:0/265: link d8/d9/l1e d8/d18/l57 0 2024-01-25T15:03:35.052 INFO:tasks.workunit.client.0.smithi170.stdout:0/266: write d8/d9/f46 [60143,49150] 0 2024-01-25T15:03:35.054 INFO:tasks.workunit.client.0.smithi170.stdout:5/197: truncate d5/d10/f42 1298895 0 2024-01-25T15:03:35.054 INFO:tasks.workunit.client.0.smithi170.stdout:5/198: write d5/d10/f17 [872274,126117] 0 2024-01-25T15:03:35.061 INFO:tasks.workunit.client.0.smithi170.stdout:2/311: dwrite d10/d1e/d5e/f61 [4194304,4194304] 0 2024-01-25T15:03:35.076 INFO:tasks.workunit.client.0.smithi170.stdout:3/257: mkdir d3/d2a/d53 0 2024-01-25T15:03:35.079 INFO:tasks.workunit.client.0.smithi170.stdout:4/239: dwrite d6/d7/d34/f2e [0,4194304] 0 2024-01-25T15:03:35.081 INFO:tasks.workunit.client.0.smithi170.stdout:0/267: dwrite d8/d18/f20 [0,4194304] 0 2024-01-25T15:03:35.086 INFO:tasks.workunit.client.0.smithi170.stdout:3/258: mknod d3/d1c/d2b/c54 0 2024-01-25T15:03:35.089 INFO:tasks.workunit.client.0.smithi170.stdout:5/199: mknod d5/d10/d2c/d3a/d41/c49 0 2024-01-25T15:03:35.089 INFO:tasks.workunit.client.0.smithi170.stdout:3/259: fsync d3/d10/fe 0 2024-01-25T15:03:35.092 INFO:tasks.workunit.client.0.smithi170.stdout:4/240: mkdir d6/d7/d31/d46 0 2024-01-25T15:03:35.096 INFO:tasks.workunit.client.0.smithi170.stdout:0/268: write d8/d10/f4b [4066127,34224] 0 2024-01-25T15:03:35.098 INFO:tasks.workunit.client.0.smithi170.stdout:3/260: symlink d3/d1c/l55 0 2024-01-25T15:03:35.099 INFO:tasks.workunit.client.0.smithi170.stdout:0/269: mkdir d8/d10/d2d/d58 0 2024-01-25T15:03:35.101 INFO:tasks.workunit.client.0.smithi170.stdout:5/200: link d5/f13 d5/d2a/f4a 0 2024-01-25T15:03:35.101 INFO:tasks.workunit.client.0.smithi170.stdout:5/201: write d5/d2a/f3e [611713,28274] 0 2024-01-25T15:03:35.103 INFO:tasks.workunit.client.0.smithi170.stdout:8/175: sync 2024-01-25T15:03:35.103 INFO:tasks.workunit.client.0.smithi170.stdout:7/300: sync 2024-01-25T15:03:35.103 INFO:tasks.workunit.client.0.smithi170.stdout:1/262: sync 2024-01-25T15:03:35.103 INFO:tasks.workunit.client.0.smithi170.stdout:7/301: truncate d8/d20/d2a/d61/f63 87043 0 2024-01-25T15:03:35.103 INFO:tasks.workunit.client.0.smithi170.stdout:1/263: dread - d0/d20/d3a/f44 zero size 2024-01-25T15:03:35.103 INFO:tasks.workunit.client.0.smithi170.stdout:9/247: sync 2024-01-25T15:03:35.103 INFO:tasks.workunit.client.0.smithi170.stdout:4/241: write d6/d7/d1b/f36 [3999436,110511] 0 2024-01-25T15:03:35.104 INFO:tasks.workunit.client.0.smithi170.stdout:4/242: fdatasync f2 0 2024-01-25T15:03:35.104 INFO:tasks.workunit.client.0.smithi170.stdout:4/243: fsync f2 0 2024-01-25T15:03:35.104 INFO:tasks.workunit.client.0.smithi170.stdout:3/261: rename d3/f12 to d3/d10/d13/d1b/d29/f56 0 2024-01-25T15:03:35.105 INFO:tasks.workunit.client.0.smithi170.stdout:5/202: symlink d5/d10/d2c/d3a/d3d/l4b 0 2024-01-25T15:03:35.108 INFO:tasks.workunit.client.0.smithi170.stdout:1/264: mkdir d0/d20/d28/d2a/d57 0 2024-01-25T15:03:35.109 INFO:tasks.workunit.client.0.smithi170.stdout:7/302: symlink d8/d20/d2a/d61/l74 0 2024-01-25T15:03:35.109 INFO:tasks.workunit.client.0.smithi170.stdout:7/303: write d8/f5d [4657747,17995] 0 2024-01-25T15:03:35.112 INFO:tasks.workunit.client.0.smithi170.stdout:4/244: dread d6/d7/d1b/f1e [0,4194304] 0 2024-01-25T15:03:35.113 INFO:tasks.workunit.client.0.smithi170.stdout:9/248: dread d5/dc/f2c [0,4194304] 0 2024-01-25T15:03:35.113 INFO:tasks.workunit.client.0.smithi170.stdout:5/203: creat d5/d10/d2c/d3a/f4c x:0 0 0 2024-01-25T15:03:35.115 INFO:tasks.workunit.client.0.smithi170.stdout:8/176: creat d3/d7/d28/f35 x:0 0 0 2024-01-25T15:03:35.117 INFO:tasks.workunit.client.0.smithi170.stdout:1/265: rename d0/d20/d28/d2a/d4a/l51 to d0/d20/d28/d2a/d4a/d56/l58 0 2024-01-25T15:03:35.122 INFO:tasks.workunit.client.0.smithi170.stdout:8/177: symlink d3/d7/d22/d23/d25/l36 0 2024-01-25T15:03:35.122 INFO:tasks.workunit.client.0.smithi170.stdout:8/178: chown d3/d7/f10 181813001 1 2024-01-25T15:03:35.122 INFO:tasks.workunit.client.0.smithi170.stdout:0/270: dwrite d8/d9/f16 [0,4194304] 0 2024-01-25T15:03:35.126 INFO:tasks.workunit.client.0.smithi170.stdout:5/204: symlink d5/d10/d2c/d3a/d41/l4d 0 2024-01-25T15:03:35.130 INFO:tasks.workunit.client.0.smithi170.stdout:9/249: dread d5/df/d16/f19 [0,4194304] 0 2024-01-25T15:03:35.130 INFO:tasks.workunit.client.0.smithi170.stdout:9/250: write d5/d1e/d21/d34/f47 [163219,82184] 0 2024-01-25T15:03:35.136 INFO:tasks.workunit.client.0.smithi170.stdout:3/262: chown d3/d10/d13/d1b/d29/d38/f4e 32588 1 2024-01-25T15:03:35.141 INFO:tasks.workunit.client.0.smithi170.stdout:7/304: rmdir d8 39 2024-01-25T15:03:35.141 INFO:tasks.workunit.client.0.smithi170.stdout:7/305: fdatasync d8/d20/f30 0 2024-01-25T15:03:35.143 INFO:tasks.workunit.client.0.smithi170.stdout:5/205: dread d5/d10/f1c [0,4194304] 0 2024-01-25T15:03:35.145 INFO:tasks.workunit.client.0.smithi170.stdout:8/179: rename d3/d7/l19 to d3/d7/d28/l37 0 2024-01-25T15:03:35.146 INFO:tasks.workunit.client.0.smithi170.stdout:3/263: getdents d3/d10/d1e/d21 0 2024-01-25T15:03:35.151 INFO:tasks.workunit.client.0.smithi170.stdout:5/206: link d5/d10/d2c/f2e d5/d10/d2c/d34/f4e 0 2024-01-25T15:03:35.151 INFO:tasks.workunit.client.0.smithi170.stdout:4/245: dwrite d6/d7/d34/f30 [0,4194304] 0 2024-01-25T15:03:35.151 INFO:tasks.workunit.client.0.smithi170.stdout:1/266: dwrite d0/d20/d3a/f44 [0,4194304] 0 2024-01-25T15:03:35.152 INFO:tasks.workunit.client.0.smithi170.stdout:0/271: dwrite d8/d10/d2d/d2f/f51 [0,4194304] 0 2024-01-25T15:03:35.152 INFO:tasks.workunit.client.0.smithi170.stdout:7/306: mknod d8/d20/d2a/d35/d55/d6e/c75 0 2024-01-25T15:03:35.153 INFO:tasks.workunit.client.0.smithi170.stdout:7/307: fsync d8/d20/d2a/f34 0 2024-01-25T15:03:35.154 INFO:tasks.workunit.client.0.smithi170.stdout:3/264: symlink d3/d10/d13/d1b/d29/l57 0 2024-01-25T15:03:35.154 INFO:tasks.workunit.client.0.smithi170.stdout:3/265: write d3/d10/d13/f1f [2512354,57841] 0 2024-01-25T15:03:35.158 INFO:tasks.workunit.client.0.smithi170.stdout:9/251: dwrite d5/df/f1a [0,4194304] 0 2024-01-25T15:03:35.158 INFO:tasks.workunit.client.0.smithi170.stdout:5/207: creat d5/d10/d3f/f4f x:0 0 0 2024-01-25T15:03:35.165 INFO:tasks.workunit.client.0.smithi170.stdout:8/180: dread d3/d7/f2a [0,4194304] 0 2024-01-25T15:03:35.180 INFO:tasks.workunit.client.0.smithi170.stdout:7/308: dwrite d8/f17 [0,4194304] 0 2024-01-25T15:03:35.183 INFO:tasks.workunit.client.0.smithi170.stdout:0/272: mkdir d8/d10/d2d/d2f/d4f/d59 0 2024-01-25T15:03:35.184 INFO:tasks.workunit.client.0.smithi170.stdout:5/208: creat d5/d10/f50 x:0 0 0 2024-01-25T15:03:35.185 INFO:tasks.workunit.client.0.smithi170.stdout:1/267: dwrite d0/d50/f52 [0,4194304] 0 2024-01-25T15:03:35.186 INFO:tasks.workunit.client.0.smithi170.stdout:2/312: link d10/l6e d10/d1e/d32/d62/l70 0 2024-01-25T15:03:35.187 INFO:tasks.workunit.client.0.smithi170.stdout:8/181: unlink d3/d7/d28/l37 0 2024-01-25T15:03:35.191 INFO:tasks.workunit.client.0.smithi170.stdout:3/266: dwrite d3/d10/d13/f25 [0,4194304] 0 2024-01-25T15:03:35.192 INFO:tasks.workunit.client.0.smithi170.stdout:7/309: link d8/d20/d2a/d35/c38 d8/d20/d2a/d61/c76 0 2024-01-25T15:03:35.193 INFO:tasks.workunit.client.0.smithi170.stdout:6/286: sync 2024-01-25T15:03:35.193 INFO:tasks.workunit.client.0.smithi170.stdout:6/287: readlink d2/d7/l2c 0 2024-01-25T15:03:35.193 INFO:tasks.workunit.client.0.smithi170.stdout:6/288: chown d2/d7/d1b/f1f 66405 1 2024-01-25T15:03:35.193 INFO:tasks.workunit.client.0.smithi170.stdout:6/289: dread - d2/d7/f4a zero size 2024-01-25T15:03:35.194 INFO:tasks.workunit.client.0.smithi170.stdout:3/267: dread d3/d10/d1e/f20 [0,4194304] 0 2024-01-25T15:03:35.194 INFO:tasks.workunit.client.0.smithi170.stdout:3/268: write d3/d1c/f24 [1165931,4719] 0 2024-01-25T15:03:35.194 INFO:tasks.workunit.client.0.smithi170.stdout:0/273: mkdir d8/d10/d5a 0 2024-01-25T15:03:35.194 INFO:tasks.workunit.client.0.smithi170.stdout:0/274: stat d8/d10/l34 0 2024-01-25T15:03:35.194 INFO:tasks.workunit.client.0.smithi170.stdout:7/310: truncate d8/d20/d2a/d35/d55/f67 1843977 0 2024-01-25T15:03:35.194 INFO:tasks.workunit.client.0.smithi170.stdout:7/311: chown d8/d20/d3b/f50 710768396 1 2024-01-25T15:03:35.194 INFO:tasks.workunit.client.0.smithi170.stdout:6/290: dread d2/d7/d23/d19/f20 [0,4194304] 0 2024-01-25T15:03:35.195 INFO:tasks.workunit.client.0.smithi170.stdout:5/209: truncate d5/fe 1299992 0 2024-01-25T15:03:35.195 INFO:tasks.workunit.client.0.smithi170.stdout:5/210: fdatasync d5/f15 0 2024-01-25T15:03:35.195 INFO:tasks.workunit.client.0.smithi170.stdout:6/291: dread d2/d7/f18 [0,4194304] 0 2024-01-25T15:03:35.198 INFO:tasks.workunit.client.0.smithi170.stdout:4/246: getdents d6/d28 0 2024-01-25T15:03:35.205 INFO:tasks.workunit.client.0.smithi170.stdout:6/292: dread d2/f40 [0,4194304] 0 2024-01-25T15:03:35.205 INFO:tasks.workunit.client.0.smithi170.stdout:1/268: rename d0/d20/l3e to d0/d2e/l59 0 2024-01-25T15:03:35.205 INFO:tasks.workunit.client.0.smithi170.stdout:0/275: mknod d8/d10/d5a/c5b 0 2024-01-25T15:03:35.208 INFO:tasks.workunit.client.0.smithi170.stdout:3/269: dread d3/d10/ff [0,4194304] 0 2024-01-25T15:03:35.209 INFO:tasks.workunit.client.0.smithi170.stdout:6/293: link d2/d7/d23/d19/f20 d2/d7/d1b/f64 0 2024-01-25T15:03:35.211 INFO:tasks.workunit.client.0.smithi170.stdout:8/182: dwrite d3/d7/d22/d23/d25/f2d [0,4194304] 0 2024-01-25T15:03:35.212 INFO:tasks.workunit.client.0.smithi170.stdout:2/313: rename d10/d16/f35 to d10/d1e/f71 0 2024-01-25T15:03:35.215 INFO:tasks.workunit.client.0.smithi170.stdout:0/276: rmdir d8/d10/d2d/d2f/d4f 39 2024-01-25T15:03:35.215 INFO:tasks.workunit.client.0.smithi170.stdout:6/294: link d2/cc d2/d7/d23/c65 0 2024-01-25T15:03:35.219 INFO:tasks.workunit.client.0.smithi170.stdout:3/270: dread d3/d10/f1a [0,4194304] 0 2024-01-25T15:03:35.220 INFO:tasks.workunit.client.0.smithi170.stdout:7/312: rename d8/f12 to d8/d20/d2a/d61/f77 0 2024-01-25T15:03:35.220 INFO:tasks.workunit.client.0.smithi170.stdout:6/295: dread d2/d7/d23/d19/d2f/d37/f62 [0,4194304] 0 2024-01-25T15:03:35.220 INFO:tasks.workunit.client.0.smithi170.stdout:6/296: fsync d2/d7/d23/d19/d2a/d43/f58 0 2024-01-25T15:03:35.220 INFO:tasks.workunit.client.0.smithi170.stdout:2/314: symlink d10/d16/l72 0 2024-01-25T15:03:35.222 INFO:tasks.workunit.client.0.smithi170.stdout:5/211: rename d5/d10/d2c/d3a to d5/d10/d2c/d51 0 2024-01-25T15:03:35.224 INFO:tasks.workunit.client.0.smithi170.stdout:0/277: rename d8/d10/d2d/d2f/f51 to d8/d10/d2d/d58/f5c 0 2024-01-25T15:03:35.225 INFO:tasks.workunit.client.0.smithi170.stdout:5/212: read d5/d10/f42 [100667,65890] 0 2024-01-25T15:03:35.225 INFO:tasks.workunit.client.0.smithi170.stdout:6/297: creat d2/d7/d23/d19/d2a/d43/d44/f66 x:0 0 0 2024-01-25T15:03:35.234 INFO:tasks.workunit.client.0.smithi170.stdout:4/247: dwrite d6/d28/f45 [0,4194304] 0 2024-01-25T15:03:35.237 INFO:tasks.workunit.client.0.smithi170.stdout:5/213: link d5/d10/d2c/d45/f48 d5/d2a/f52 0 2024-01-25T15:03:35.240 INFO:tasks.workunit.client.0.smithi170.stdout:6/298: unlink d2/d7/d23/d19/d2f/d37/f50 0 2024-01-25T15:03:35.241 INFO:tasks.workunit.client.0.smithi170.stdout:2/315: mkdir d10/d1e/d5e/d73 0 2024-01-25T15:03:35.242 INFO:tasks.workunit.client.0.smithi170.stdout:6/299: symlink d2/d7/l67 0 2024-01-25T15:03:35.242 INFO:tasks.workunit.client.0.smithi170.stdout:2/316: mkdir d10/d1e/d32/d62/d74 0 2024-01-25T15:03:35.246 INFO:tasks.workunit.client.0.smithi170.stdout:6/300: dread d2/d7/d1b/f64 [0,4194304] 0 2024-01-25T15:03:35.246 INFO:tasks.workunit.client.0.smithi170.stdout:6/301: fdatasync d2/d7/d23/d19/d2a/d43/d44/f66 0 2024-01-25T15:03:35.246 INFO:tasks.workunit.client.0.smithi170.stdout:1/269: dwrite d0/d20/d3a/f53 [0,4194304] 0 2024-01-25T15:03:35.246 INFO:tasks.workunit.client.0.smithi170.stdout:1/270: creat d0/d20/d3a/f5a x:0 0 0 2024-01-25T15:03:35.248 INFO:tasks.workunit.client.0.smithi170.stdout:3/271: dwrite d3/d10/d13/f25 [0,4194304] 0 2024-01-25T15:03:35.250 INFO:tasks.workunit.client.0.smithi170.stdout:3/272: mkdir d3/d10/d13/d1b/d29/d38/d58 0 2024-01-25T15:03:35.253 INFO:tasks.workunit.client.0.smithi170.stdout:8/183: dwrite d3/d7/f2a [0,4194304] 0 2024-01-25T15:03:35.253 INFO:tasks.workunit.client.0.smithi170.stdout:8/184: chown d3 28589573 1 2024-01-25T15:03:35.257 INFO:tasks.workunit.client.0.smithi170.stdout:8/185: symlink d3/d7/d1e/l38 0 2024-01-25T15:03:35.260 INFO:tasks.workunit.client.0.smithi170.stdout:5/214: getdents d5/d2a 0 2024-01-25T15:03:35.262 INFO:tasks.workunit.client.0.smithi170.stdout:8/186: mknod d3/d7/c39 0 2024-01-25T15:03:35.262 INFO:tasks.workunit.client.0.smithi170.stdout:8/187: chown d3/d7/d28/f35 137063 1 2024-01-25T15:03:35.263 INFO:tasks.workunit.client.0.smithi170.stdout:4/248: dwrite f2 [0,4194304] 0 2024-01-25T15:03:35.264 INFO:tasks.workunit.client.0.smithi170.stdout:5/215: creat d5/d2a/f53 x:0 0 0 2024-01-25T15:03:35.264 INFO:tasks.workunit.client.0.smithi170.stdout:5/216: write d5/d10/d3f/f4f [300767,120393] 0 2024-01-25T15:03:35.264 INFO:tasks.workunit.client.0.smithi170.stdout:5/217: fdatasync d5/d10/f42 0 2024-01-25T15:03:35.265 INFO:tasks.workunit.client.0.smithi170.stdout:5/218: fdatasync d5/d10/f35 0 2024-01-25T15:03:35.268 INFO:tasks.workunit.client.0.smithi170.stdout:2/317: getdents d10/d1e/d5e 0 2024-01-25T15:03:35.268 INFO:tasks.workunit.client.0.smithi170.stdout:2/318: write d10/d1e/f4e [245625,38278] 0 2024-01-25T15:03:35.268 INFO:tasks.workunit.client.0.smithi170.stdout:2/319: chown d10/d1e/d32/d3e/d41 336 1 2024-01-25T15:03:35.269 INFO:tasks.workunit.client.0.smithi170.stdout:2/320: fsync d10/d1b/f36 0 2024-01-25T15:03:35.269 INFO:tasks.workunit.client.0.smithi170.stdout:4/249: mknod d6/d7/d34/c47 0 2024-01-25T15:03:35.272 INFO:tasks.workunit.client.0.smithi170.stdout:8/188: mkdir d3/d7/d3a 0 2024-01-25T15:03:35.272 INFO:tasks.workunit.client.0.smithi170.stdout:8/189: chown d3/d7/f10 336007445 1 2024-01-25T15:03:35.272 INFO:tasks.workunit.client.0.smithi170.stdout:8/190: write d3/d7/d28/f35 [226224,67977] 0 2024-01-25T15:03:35.272 INFO:tasks.workunit.client.0.smithi170.stdout:8/191: write d3/f9 [5027924,30681] 0 2024-01-25T15:03:35.272 INFO:tasks.workunit.client.0.smithi170.stdout:8/192: chown d3/d7/d22/d23/d25/c29 1526122899 1 2024-01-25T15:03:35.274 INFO:tasks.workunit.client.0.smithi170.stdout:4/250: symlink d6/d7/d31/l48 0 2024-01-25T15:03:35.275 INFO:tasks.workunit.client.0.smithi170.stdout:4/251: creat d6/f49 x:0 0 0 2024-01-25T15:03:35.275 INFO:tasks.workunit.client.0.smithi170.stdout:5/219: mkdir d5/d54 0 2024-01-25T15:03:35.276 INFO:tasks.workunit.client.0.smithi170.stdout:5/220: write d5/d10/f17 [446620,124373] 0 2024-01-25T15:03:35.276 INFO:tasks.workunit.client.0.smithi170.stdout:8/193: link d3/d7/d22/l2c d3/d7/d3a/l3b 0 2024-01-25T15:03:35.278 INFO:tasks.workunit.client.0.smithi170.stdout:6/302: dwrite d2/d7/d23/d19/f5e [0,4194304] 0 2024-01-25T15:03:35.279 INFO:tasks.workunit.client.0.smithi170.stdout:8/194: link d3/d7/d28/f35 d3/d7/d22/d23/d25/f3c 0 2024-01-25T15:03:35.280 INFO:tasks.workunit.client.0.smithi170.stdout:3/273: dwrite d3/d2a/f4d [0,4194304] 0 2024-01-25T15:03:35.281 INFO:tasks.workunit.client.0.smithi170.stdout:7/313: rename d8/d20/d2a/d35/f66 to d8/d20/d3b/d4d/f78 0 2024-01-25T15:03:35.286 INFO:tasks.workunit.client.0.smithi170.stdout:3/274: symlink d3/d2a/d53/l59 0 2024-01-25T15:03:35.289 INFO:tasks.workunit.client.0.smithi170.stdout:0/278: rename d8/d3a/l3d to d8/d10/d5a/l5d 0 2024-01-25T15:03:35.292 INFO:tasks.workunit.client.0.smithi170.stdout:4/252: rename d6/d7/lf to d6/d7/d31/l4a 0 2024-01-25T15:03:35.294 INFO:tasks.workunit.client.0.smithi170.stdout:4/253: dread d6/d7/d1b/f33 [0,4194304] 0 2024-01-25T15:03:35.295 INFO:tasks.workunit.client.0.smithi170.stdout:8/195: write d3/d7/d22/d23/d25/f2d [2811134,28770] 0 2024-01-25T15:03:35.295 INFO:tasks.workunit.client.0.smithi170.stdout:0/279: mknod d8/d10/d2d/d2f/d4f/d59/c5e 0 2024-01-25T15:03:35.295 INFO:tasks.workunit.client.0.smithi170.stdout:0/280: chown d8/d10/f2b 219093 1 2024-01-25T15:03:35.297 INFO:tasks.workunit.client.0.smithi170.stdout:8/196: truncate d3/d7/f2f 456848 0 2024-01-25T15:03:35.298 INFO:tasks.workunit.client.0.smithi170.stdout:3/275: dread d3/d10/d13/f1f [0,4194304] 0 2024-01-25T15:03:35.298 INFO:tasks.workunit.client.0.smithi170.stdout:8/197: write d3/d7/f12 [1064398,49396] 0 2024-01-25T15:03:35.300 INFO:tasks.workunit.client.0.smithi170.stdout:3/276: truncate d3/fa 1300473 0 2024-01-25T15:03:35.302 INFO:tasks.workunit.client.0.smithi170.stdout:3/277: mkdir d3/d10/d1e/d5a 0 2024-01-25T15:03:35.307 INFO:tasks.workunit.client.0.smithi170.stdout:6/303: dwrite d2/d7/f18 [0,4194304] 0 2024-01-25T15:03:35.308 INFO:tasks.workunit.client.0.smithi170.stdout:5/221: dwrite d5/d10/f21 [0,4194304] 0 2024-01-25T15:03:35.310 INFO:tasks.workunit.client.0.smithi170.stdout:4/254: dread d6/d7/d34/f2e [0,4194304] 0 2024-01-25T15:03:35.310 INFO:tasks.workunit.client.0.smithi170.stdout:6/304: mknod d2/d7/d23/d19/d2a/c68 0 2024-01-25T15:03:35.310 INFO:tasks.workunit.client.0.smithi170.stdout:6/305: readlink d2/d7/d23/l3b 0 2024-01-25T15:03:35.310 INFO:tasks.workunit.client.0.smithi170.stdout:6/306: readlink d2/d7/l2c 0 2024-01-25T15:03:35.313 INFO:tasks.workunit.client.0.smithi170.stdout:5/222: symlink d5/d54/l55 0 2024-01-25T15:03:35.320 INFO:tasks.workunit.client.0.smithi170.stdout:4/255: mknod d6/d7/d34/c4b 0 2024-01-25T15:03:35.321 INFO:tasks.workunit.client.0.smithi170.stdout:5/223: write d5/d10/d2c/d51/d41/f44 [730425,91534] 0 2024-01-25T15:03:35.321 INFO:tasks.workunit.client.0.smithi170.stdout:5/224: chown d5/fe 155890811 1 2024-01-25T15:03:35.323 INFO:tasks.workunit.client.0.smithi170.stdout:5/225: mkdir d5/d10/d2c/d45/d56 0 2024-01-25T15:03:35.323 INFO:tasks.workunit.client.0.smithi170.stdout:5/226: write d5/d10/d2c/f31 [753596,29646] 0 2024-01-25T15:03:35.324 INFO:tasks.workunit.client.0.smithi170.stdout:5/227: mkdir d5/d10/d2c/d51/d3d/d57 0 2024-01-25T15:03:35.326 INFO:tasks.workunit.client.0.smithi170.stdout:5/228: mkdir d5/d58 0 2024-01-25T15:03:35.328 INFO:tasks.workunit.client.0.smithi170.stdout:5/229: unlink d5/d54/l55 0 2024-01-25T15:03:35.329 INFO:tasks.workunit.client.0.smithi170.stdout:7/314: rename d8/d20/d3b/d4d/c64 to d8/d20/d2a/d35/d55/c79 0 2024-01-25T15:03:35.329 INFO:tasks.workunit.client.0.smithi170.stdout:7/315: chown d8/d20/d2a/d35/f49 3399997 1 2024-01-25T15:03:35.329 INFO:tasks.workunit.client.0.smithi170.stdout:5/230: stat d5/c1d 0 2024-01-25T15:03:35.330 INFO:tasks.workunit.client.0.smithi170.stdout:7/316: mknod d8/d20/d2a/c7a 0 2024-01-25T15:03:35.332 INFO:tasks.workunit.client.0.smithi170.stdout:5/231: unlink d5/f24 0 2024-01-25T15:03:35.332 INFO:tasks.workunit.client.0.smithi170.stdout:0/281: dwrite f6 [0,4194304] 0 2024-01-25T15:03:35.333 INFO:tasks.workunit.client.0.smithi170.stdout:8/198: rename d3/d7/c32 to d3/d7/d22/d23/d25/c3d 0 2024-01-25T15:03:35.333 INFO:tasks.workunit.client.0.smithi170.stdout:8/199: chown d3/d7/c39 184 1 2024-01-25T15:03:35.334 INFO:tasks.workunit.client.0.smithi170.stdout:8/200: write d3/d7/d22/d23/f33 [1618370,90905] 0 2024-01-25T15:03:35.334 INFO:tasks.workunit.client.0.smithi170.stdout:3/278: dwrite d3/d10/f23 [0,4194304] 0 2024-01-25T15:03:35.334 INFO:tasks.workunit.client.0.smithi170.stdout:5/232: truncate d5/d10/f1c 2415332 0 2024-01-25T15:03:35.338 INFO:tasks.workunit.client.0.smithi170.stdout:7/317: read d8/f52 [1496324,76299] 0 2024-01-25T15:03:35.338 INFO:tasks.workunit.client.0.smithi170.stdout:7/318: readlink d8/d20/d2a/l2b 0 2024-01-25T15:03:35.338 INFO:tasks.workunit.client.0.smithi170.stdout:0/282: rmdir d8/d10/d2d/d2f/d4f 39 2024-01-25T15:03:35.340 INFO:tasks.workunit.client.0.smithi170.stdout:4/256: dwrite d6/d37/f40 [0,4194304] 0 2024-01-25T15:03:35.340 INFO:tasks.workunit.client.0.smithi170.stdout:4/257: chown d6/f26 3561 1 2024-01-25T15:03:35.340 INFO:tasks.workunit.client.0.smithi170.stdout:8/201: symlink d3/d7/d22/d23/d25/l3e 0 2024-01-25T15:03:35.340 INFO:tasks.workunit.client.0.smithi170.stdout:8/202: stat d3/d7/d22/d23/d25/l3e 0 2024-01-25T15:03:35.343 INFO:tasks.workunit.client.0.smithi170.stdout:3/279: mkdir d3/d10/d13/d5b 0 2024-01-25T15:03:35.343 INFO:tasks.workunit.client.0.smithi170.stdout:3/280: chown d3/d10/d13/d5b 40 1 2024-01-25T15:03:35.343 INFO:tasks.workunit.client.0.smithi170.stdout:3/281: chown d3/d10/d1e/f20 72 1 2024-01-25T15:03:35.344 INFO:tasks.workunit.client.0.smithi170.stdout:0/283: mkdir d8/d10/d2d/d2f/d4f/d5f 0 2024-01-25T15:03:35.347 INFO:tasks.workunit.client.0.smithi170.stdout:4/258: rename d6/le to d6/d7/l4c 0 2024-01-25T15:03:35.347 INFO:tasks.workunit.client.0.smithi170.stdout:4/259: creat d6/d7/d31/f4d x:0 0 0 2024-01-25T15:03:35.347 INFO:tasks.workunit.client.0.smithi170.stdout:8/203: creat d3/d7/d3a/f3f x:0 0 0 2024-01-25T15:03:35.353 INFO:tasks.workunit.client.0.smithi170.stdout:3/282: mkdir d3/d1c/d2b/d5c 0 2024-01-25T15:03:35.354 INFO:tasks.workunit.client.0.smithi170.stdout:0/284: creat d8/d10/d2d/d53/f60 x:0 0 0 2024-01-25T15:03:35.355 INFO:tasks.workunit.client.0.smithi170.stdout:7/319: dread d8/f17 [0,4194304] 0 2024-01-25T15:03:35.355 INFO:tasks.workunit.client.0.smithi170.stdout:5/233: dwrite d5/d10/d2c/d45/f48 [0,4194304] 0 2024-01-25T15:03:35.355 INFO:tasks.workunit.client.0.smithi170.stdout:7/320: fsync d8/d20/d3b/f6a 0 2024-01-25T15:03:35.357 INFO:tasks.workunit.client.0.smithi170.stdout:3/283: creat d3/d10/d52/f5d x:0 0 0 2024-01-25T15:03:35.357 INFO:tasks.workunit.client.0.smithi170.stdout:3/284: stat d3/d10/d13/f34 0 2024-01-25T15:03:35.357 INFO:tasks.workunit.client.0.smithi170.stdout:9/252: sync 2024-01-25T15:03:35.357 INFO:tasks.workunit.client.0.smithi170.stdout:0/285: creat d8/d3e/f61 x:0 0 0 2024-01-25T15:03:35.360 INFO:tasks.workunit.client.0.smithi170.stdout:4/260: write d6/d7/f9 [8315678,105861] 0 2024-01-25T15:03:35.360 INFO:tasks.workunit.client.0.smithi170.stdout:4/261: chown d6/d7/d1b/f36 560454315 1 2024-01-25T15:03:35.360 INFO:tasks.workunit.client.0.smithi170.stdout:5/234: creat d5/d10/f59 x:0 0 0 2024-01-25T15:03:35.362 INFO:tasks.workunit.client.0.smithi170.stdout:7/321: unlink d8/c2c 0 2024-01-25T15:03:35.363 INFO:tasks.workunit.client.0.smithi170.stdout:7/322: truncate d8/f31 4646404 0 2024-01-25T15:03:35.364 INFO:tasks.workunit.client.0.smithi170.stdout:3/285: symlink d3/d10/d13/l5e 0 2024-01-25T15:03:35.367 INFO:tasks.workunit.client.0.smithi170.stdout:9/253: mkdir d5/df/d16/d35/d3c/d56/d59 0 2024-01-25T15:03:35.369 INFO:tasks.workunit.client.0.smithi170.stdout:7/323: creat d8/d20/d45/d68/f7b x:0 0 0 2024-01-25T15:03:35.370 INFO:tasks.workunit.client.0.smithi170.stdout:8/204: dwrite d3/f9 [4194304,4194304] 0 2024-01-25T15:03:35.371 INFO:tasks.workunit.client.0.smithi170.stdout:9/254: rename d5/d1e/d21/d46/f22 to d5/df/d16/d35/f5a 0 2024-01-25T15:03:35.372 INFO:tasks.workunit.client.0.smithi170.stdout:9/255: write d5/d1e/d21/d46/d18/f31 [4839651,105312] 0 2024-01-25T15:03:35.372 INFO:tasks.workunit.client.0.smithi170.stdout:9/256: chown d5/d1e/f24 110210 1 2024-01-25T15:03:35.372 INFO:tasks.workunit.client.0.smithi170.stdout:9/257: creat d5/d1e/d21/d34/f5b x:0 0 0 2024-01-25T15:03:35.372 INFO:tasks.workunit.client.0.smithi170.stdout:7/324: truncate d8/d20/d2a/d61/f77 1629097 0 2024-01-25T15:03:35.376 INFO:tasks.workunit.client.0.smithi170.stdout:9/258: creat d5/dc/d42/f5c x:0 0 0 2024-01-25T15:03:35.376 INFO:tasks.workunit.client.0.smithi170.stdout:9/259: chown d5/df/f3b 82983 1 2024-01-25T15:03:35.376 INFO:tasks.workunit.client.0.smithi170.stdout:9/260: dread - d5/d1e/d21/d46/d18/f23 zero size 2024-01-25T15:03:35.376 INFO:tasks.workunit.client.0.smithi170.stdout:4/262: mknod d6/d28/c4e 0 2024-01-25T15:03:35.377 INFO:tasks.workunit.client.0.smithi170.stdout:4/263: mkdir d6/d28/d4f 0 2024-01-25T15:03:35.377 INFO:tasks.workunit.client.0.smithi170.stdout:4/264: fdatasync d6/d37/f40 0 2024-01-25T15:03:35.378 INFO:tasks.workunit.client.0.smithi170.stdout:4/265: mknod d6/d7/d34/c50 0 2024-01-25T15:03:35.379 INFO:tasks.workunit.client.0.smithi170.stdout:4/266: dread - d6/d7/d31/f3f zero size 2024-01-25T15:03:35.379 INFO:tasks.workunit.client.0.smithi170.stdout:4/267: fsync d6/d7/d31/f3f 0 2024-01-25T15:03:35.391 INFO:tasks.workunit.client.0.smithi170.stdout:5/235: dwrite d5/d10/d2c/f2d [0,4194304] 0 2024-01-25T15:03:35.391 INFO:tasks.workunit.client.0.smithi170.stdout:5/236: chown d5/d10/d2c/c39 3813973 1 2024-01-25T15:03:35.392 INFO:tasks.workunit.client.0.smithi170.stdout:9/261: dread d5/df/f1a [0,4194304] 0 2024-01-25T15:03:35.392 INFO:tasks.workunit.client.0.smithi170.stdout:9/262: write d5/dc/fd [4916207,12250] 0 2024-01-25T15:03:35.394 INFO:tasks.workunit.client.0.smithi170.stdout:7/325: write d8/d20/d2a/d35/f65 [594140,61339] 0 2024-01-25T15:03:35.394 INFO:tasks.workunit.client.0.smithi170.stdout:3/286: dwrite d3/d10/d13/f36 [0,4194304] 0 2024-01-25T15:03:35.394 INFO:tasks.workunit.client.0.smithi170.stdout:5/237: getdents d5/d10/d3f 0 2024-01-25T15:03:35.394 INFO:tasks.workunit.client.0.smithi170.stdout:5/238: chown d5/fe 16 1 2024-01-25T15:03:35.396 INFO:tasks.workunit.client.0.smithi170.stdout:3/287: getdents d3/d3b/d4f 0 2024-01-25T15:03:35.396 INFO:tasks.workunit.client.0.smithi170.stdout:3/288: creat d3/d2a/f5f x:0 0 0 2024-01-25T15:03:35.398 INFO:tasks.workunit.client.0.smithi170.stdout:7/326: link d8/d20/d2a/f34 d8/d20/d45/d68/f7c 0 2024-01-25T15:03:35.399 INFO:tasks.workunit.client.0.smithi170.stdout:5/239: dread d5/d10/d3f/f4f [0,4194304] 0 2024-01-25T15:03:35.400 INFO:tasks.workunit.client.0.smithi170.stdout:3/289: rename d3/d10/d13/d1b/d29/c31 to d3/d10/d1e/d21/c60 0 2024-01-25T15:03:35.401 INFO:tasks.workunit.client.0.smithi170.stdout:3/290: unlink d3/d10/d13/d1b/d29/f56 0 2024-01-25T15:03:35.403 INFO:tasks.workunit.client.0.smithi170.stdout:9/263: read d5/f8 [3212435,87052] 0 2024-01-25T15:03:35.403 INFO:tasks.workunit.client.0.smithi170.stdout:9/264: write d5/df/d16/f2b [7289741,17972] 0 2024-01-25T15:03:35.403 INFO:tasks.workunit.client.0.smithi170.stdout:3/291: unlink d3/d1c/f3c 0 2024-01-25T15:03:35.405 INFO:tasks.workunit.client.0.smithi170.stdout:3/292: symlink d3/d10/d13/d5b/l61 0 2024-01-25T15:03:35.405 INFO:tasks.workunit.client.0.smithi170.stdout:8/205: dwrite d3/d7/f2a [0,4194304] 0 2024-01-25T15:03:35.406 INFO:tasks.workunit.client.0.smithi170.stdout:4/268: dwrite d6/d7/f14 [4194304,4194304] 0 2024-01-25T15:03:35.411 INFO:tasks.workunit.client.0.smithi170.stdout:9/265: rmdir d5/df 39 2024-01-25T15:03:35.411 INFO:tasks.workunit.client.0.smithi170.stdout:9/266: stat d5/df/d16/d35/f58 0 2024-01-25T15:03:35.411 INFO:tasks.workunit.client.0.smithi170.stdout:9/267: write d5/d1e/d21/d46/d18/f23 [454764,100610] 0 2024-01-25T15:03:35.411 INFO:tasks.workunit.client.0.smithi170.stdout:9/268: read - d5/d1e/d21/d46/f55 zero size 2024-01-25T15:03:35.412 INFO:tasks.workunit.client.0.smithi170.stdout:8/206: symlink d3/d7/d1e/l40 0 2024-01-25T15:03:35.412 INFO:tasks.workunit.client.0.smithi170.stdout:8/207: chown d3/c1b 2 1 2024-01-25T15:03:35.415 INFO:tasks.workunit.client.0.smithi170.stdout:4/269: rmdir d6/d7/d34 39 2024-01-25T15:03:35.415 INFO:tasks.workunit.client.0.smithi170.stdout:4/270: write d6/d7/d31/f43 [292073,91766] 0 2024-01-25T15:03:35.418 INFO:tasks.workunit.client.0.smithi170.stdout:5/240: dwrite d5/f15 [4194304,4194304] 0 2024-01-25T15:03:35.418 INFO:tasks.workunit.client.0.smithi170.stdout:5/241: write d5/f7 [711699,21239] 0 2024-01-25T15:03:35.421 INFO:tasks.workunit.client.0.smithi170.stdout:4/271: dread d6/d7/d31/f43 [0,4194304] 0 2024-01-25T15:03:35.424 INFO:tasks.workunit.client.0.smithi170.stdout:8/208: mkdir d3/d7/d22/d23/d25/d41 0 2024-01-25T15:03:35.425 INFO:tasks.workunit.client.0.smithi170.stdout:8/209: write d3/d7/d22/d23/f33 [1200642,99092] 0 2024-01-25T15:03:35.429 INFO:tasks.workunit.client.0.smithi170.stdout:5/242: getdents d5/d10/d2c 0 2024-01-25T15:03:35.431 INFO:tasks.workunit.client.0.smithi170.stdout:9/269: rmdir d5/d1e/d21 39 2024-01-25T15:03:35.431 INFO:tasks.workunit.client.0.smithi170.stdout:9/270: dread - d5/f37 zero size 2024-01-25T15:03:35.434 INFO:tasks.workunit.client.0.smithi170.stdout:4/272: mknod d6/d7/d1b/c51 0 2024-01-25T15:03:35.436 INFO:tasks.workunit.client.0.smithi170.stdout:8/210: creat d3/f42 x:0 0 0 2024-01-25T15:03:35.436 INFO:tasks.workunit.client.0.smithi170.stdout:8/211: write d3/d7/f2f [1495491,98209] 0 2024-01-25T15:03:35.437 INFO:tasks.workunit.client.0.smithi170.stdout:5/243: creat d5/d10/f5a x:0 0 0 2024-01-25T15:03:35.437 INFO:tasks.workunit.client.0.smithi170.stdout:5/244: fdatasync d5/f15 0 2024-01-25T15:03:35.438 INFO:tasks.workunit.client.0.smithi170.stdout:5/245: readlink d5/d10/l36 0 2024-01-25T15:03:35.440 INFO:tasks.workunit.client.0.smithi170.stdout:5/246: creat d5/d10/d2c/d45/d56/f5b x:0 0 0 2024-01-25T15:03:35.440 INFO:tasks.workunit.client.0.smithi170.stdout:5/247: fdatasync d5/d10/f26 0 2024-01-25T15:03:35.440 INFO:tasks.workunit.client.0.smithi170.stdout:5/248: stat d5/d10/d2c 0 2024-01-25T15:03:35.440 INFO:tasks.workunit.client.0.smithi170.stdout:5/249: dread - d5/d10/f14 zero size 2024-01-25T15:03:35.440 INFO:tasks.workunit.client.0.smithi170.stdout:5/250: read d5/f16 [1197798,69895] 0 2024-01-25T15:03:35.440 INFO:tasks.workunit.client.0.smithi170.stdout:5/251: dread - d5/d10/f50 zero size 2024-01-25T15:03:35.441 INFO:tasks.workunit.client.0.smithi170.stdout:8/212: read d3/fd [449570,114174] 0 2024-01-25T15:03:35.441 INFO:tasks.workunit.client.0.smithi170.stdout:5/252: creat d5/d10/f5c x:0 0 0 2024-01-25T15:03:35.442 INFO:tasks.workunit.client.0.smithi170.stdout:8/213: getdents d3/d7/d22 0 2024-01-25T15:03:35.442 INFO:tasks.workunit.client.0.smithi170.stdout:8/214: creat d3/d7/d28/f43 x:0 0 0 2024-01-25T15:03:35.444 INFO:tasks.workunit.client.0.smithi170.stdout:8/215: creat d3/d7/d1e/f44 x:0 0 0 2024-01-25T15:03:35.444 INFO:tasks.workunit.client.0.smithi170.stdout:8/216: creat d3/d7/d1e/f45 x:0 0 0 2024-01-25T15:03:35.446 INFO:tasks.workunit.client.0.smithi170.stdout:4/273: dread d6/d7/f14 [4194304,4194304] 0 2024-01-25T15:03:35.446 INFO:tasks.workunit.client.0.smithi170.stdout:4/274: write d6/d7/d34/f30 [4887115,115070] 0 2024-01-25T15:03:35.446 INFO:tasks.workunit.client.0.smithi170.stdout:8/217: fdatasync d3/d7/f12 0 2024-01-25T15:03:35.450 INFO:tasks.workunit.client.0.smithi170.stdout:7/327: rename d8/d5b to d8/d20/d2a/d35/d55/d7d 0 2024-01-25T15:03:35.451 INFO:tasks.workunit.client.0.smithi170.stdout:1/271: sync 2024-01-25T15:03:35.452 INFO:tasks.workunit.client.0.smithi170.stdout:7/328: mknod d8/d20/d2a/d61/c7e 0 2024-01-25T15:03:35.452 INFO:tasks.workunit.client.0.smithi170.stdout:9/271: dwrite d5/f29 [4194304,4194304] 0 2024-01-25T15:03:35.454 INFO:tasks.workunit.client.0.smithi170.stdout:5/253: rename d5/d2a/c3b to d5/d10/d2c/d45/d56/c5d 0 2024-01-25T15:03:35.456 INFO:tasks.workunit.client.0.smithi170.stdout:7/329: symlink d8/d20/d2a/d35/l7f 0 2024-01-25T15:03:35.457 INFO:tasks.workunit.client.0.smithi170.stdout:7/330: mknod d8/d20/d2a/d35/d55/d6e/c80 0 2024-01-25T15:03:35.459 INFO:tasks.workunit.client.0.smithi170.stdout:7/331: mkdir d8/d20/d2a/d35/d55/d6e/d81 0 2024-01-25T15:03:35.459 INFO:tasks.workunit.client.0.smithi170.stdout:7/332: chown d8/d20/d2a/d35/d55/d6e/d81 97838 1 2024-01-25T15:03:35.465 INFO:tasks.workunit.client.0.smithi170.stdout:5/254: truncate d5/d10/f1c 1135102 0 2024-01-25T15:03:35.465 INFO:tasks.workunit.client.0.smithi170.stdout:5/255: chown d5/d10/d3f 445 1 2024-01-25T15:03:35.466 INFO:tasks.workunit.client.0.smithi170.stdout:5/256: mkdir d5/d10/d2c/d45/d5e 0 2024-01-25T15:03:35.468 INFO:tasks.workunit.client.0.smithi170.stdout:5/257: fdatasync d5/d2a/f2b 0 2024-01-25T15:03:35.469 INFO:tasks.workunit.client.0.smithi170.stdout:5/258: creat d5/d10/d2c/f5f x:0 0 0 2024-01-25T15:03:35.472 INFO:tasks.workunit.client.0.smithi170.stdout:9/272: write d5/d1e/f2a [2753321,105954] 0 2024-01-25T15:03:35.472 INFO:tasks.workunit.client.0.smithi170.stdout:5/259: truncate d5/d10/f42 178083 0 2024-01-25T15:03:35.476 INFO:tasks.workunit.client.0.smithi170.stdout:5/260: dread d5/d10/d2c/f31 [0,4194304] 0 2024-01-25T15:03:35.476 INFO:tasks.workunit.client.0.smithi170.stdout:5/261: read - d5/d10/d2c/d45/d56/f5b zero size 2024-01-25T15:03:35.476 INFO:tasks.workunit.client.0.smithi170.stdout:5/262: chown d5/d10/f35 0 1 2024-01-25T15:03:35.476 INFO:tasks.workunit.client.0.smithi170.stdout:5/263: getdents d5/d10/d2c/d51/d3d/d57 0 2024-01-25T15:03:35.476 INFO:tasks.workunit.client.0.smithi170.stdout:9/273: symlink d5/l5d 0 2024-01-25T15:03:35.477 INFO:tasks.workunit.client.0.smithi170.stdout:9/274: fdatasync f2 0 2024-01-25T15:03:35.477 INFO:tasks.workunit.client.0.smithi170.stdout:9/275: rmdir d5/df/d16/d35/d3c 39 2024-01-25T15:03:35.478 INFO:tasks.workunit.client.0.smithi170.stdout:5/264: mknod d5/d2a/c60 0 2024-01-25T15:03:35.483 INFO:tasks.workunit.client.0.smithi170.stdout:7/333: dwrite d8/d20/f2e [0,4194304] 0 2024-01-25T15:03:35.483 INFO:tasks.workunit.client.0.smithi170.stdout:1/272: dwrite d0/f33 [0,4194304] 0 2024-01-25T15:03:35.484 INFO:tasks.workunit.client.0.smithi170.stdout:9/276: chown d5/d1e/d21/d46/d18/l3f 32 1 2024-01-25T15:03:35.484 INFO:tasks.workunit.client.0.smithi170.stdout:9/277: write d5/df/f1a [5225488,91364] 0 2024-01-25T15:03:35.489 INFO:tasks.workunit.client.0.smithi170.stdout:1/273: truncate d0/d20/f2b 2615550 0 2024-01-25T15:03:35.499 INFO:tasks.workunit.client.0.smithi170.stdout:9/278: dread d5/d1e/f2a [0,4194304] 0 2024-01-25T15:03:35.499 INFO:tasks.workunit.client.0.smithi170.stdout:8/218: rename d3 to d3/d7/d3a/d46 22 2024-01-25T15:03:35.499 INFO:tasks.workunit.client.0.smithi170.stdout:4/275: rename d6/d7/d1b/f33 to d6/d28/f52 0 2024-01-25T15:03:35.501 INFO:tasks.workunit.client.0.smithi170.stdout:9/279: mkdir d5/df/d16/d35/d3c/d56/d59/d5e 0 2024-01-25T15:03:35.502 INFO:tasks.workunit.client.0.smithi170.stdout:8/219: mkdir d3/d7/d28/d47 0 2024-01-25T15:03:35.503 INFO:tasks.workunit.client.0.smithi170.stdout:4/276: truncate f2 4358396 0 2024-01-25T15:03:35.505 INFO:tasks.workunit.client.0.smithi170.stdout:9/280: rename d5/d1e/d21/d46/f55 to d5/df/d16/d35/d3c/f5f 0 2024-01-25T15:03:35.506 INFO:tasks.workunit.client.0.smithi170.stdout:8/220: mkdir d3/d7/d22/d23/d48 0 2024-01-25T15:03:35.508 INFO:tasks.workunit.client.0.smithi170.stdout:9/281: rename d5/df/d2e/c53 to d5/d1e/d21/d34/d3e/c60 0 2024-01-25T15:03:35.509 INFO:tasks.workunit.client.0.smithi170.stdout:9/282: write d5/d1e/f2a [3565376,120996] 0 2024-01-25T15:03:35.509 INFO:tasks.workunit.client.0.smithi170.stdout:8/221: mknod d3/d7/d22/d23/c49 0 2024-01-25T15:03:35.511 INFO:tasks.workunit.client.0.smithi170.stdout:8/222: rename d3/d7/d1e/f20 to d3/d7/d22/d23/f4a 0 2024-01-25T15:03:35.516 INFO:tasks.workunit.client.0.smithi170.stdout:7/334: dwrite d8/d20/f29 [0,4194304] 0 2024-01-25T15:03:35.517 INFO:tasks.workunit.client.0.smithi170.stdout:5/265: dwrite d5/d10/d2c/d51/f4c [0,4194304] 0 2024-01-25T15:03:35.520 INFO:tasks.workunit.client.0.smithi170.stdout:7/335: unlink d8/c10 0 2024-01-25T15:03:35.520 INFO:tasks.workunit.client.0.smithi170.stdout:7/336: truncate d8/d20/d3b/f3c 5206751 0 2024-01-25T15:03:35.520 INFO:tasks.workunit.client.0.smithi170.stdout:7/337: stat f2 0 2024-01-25T15:03:35.521 INFO:tasks.workunit.client.0.smithi170.stdout:7/338: mknod d8/d20/d2a/d35/d55/d6e/d81/c82 0 2024-01-25T15:03:35.524 INFO:tasks.workunit.client.0.smithi170.stdout:5/266: dread d5/d2a/f3e [0,4194304] 0 2024-01-25T15:03:35.527 INFO:tasks.workunit.client.0.smithi170.stdout:1/274: dwrite d0/f5 [0,4194304] 0 2024-01-25T15:03:35.528 INFO:tasks.workunit.client.0.smithi170.stdout:4/277: dwrite d6/d37/f40 [0,4194304] 0 2024-01-25T15:03:35.532 INFO:tasks.workunit.client.0.smithi170.stdout:8/223: dread d3/d7/f12 [0,4194304] 0 2024-01-25T15:03:35.533 INFO:tasks.workunit.client.0.smithi170.stdout:9/283: dwrite f2 [0,4194304] 0 2024-01-25T15:03:35.533 INFO:tasks.workunit.client.0.smithi170.stdout:7/339: symlink d8/d20/d3b/d4d/l83 0 2024-01-25T15:03:35.534 INFO:tasks.workunit.client.0.smithi170.stdout:7/340: creat d8/d20/d45/d68/f84 x:0 0 0 2024-01-25T15:03:35.535 INFO:tasks.workunit.client.0.smithi170.stdout:8/224: creat d3/d7/d28/d47/f4b x:0 0 0 2024-01-25T15:03:35.535 INFO:tasks.workunit.client.0.smithi170.stdout:8/225: creat d3/d7/d28/d47/f4c x:0 0 0 2024-01-25T15:03:35.535 INFO:tasks.workunit.client.0.smithi170.stdout:5/267: write d5/d2a/f52 [3904438,17489] 0 2024-01-25T15:03:35.535 INFO:tasks.workunit.client.0.smithi170.stdout:5/268: write d5/d10/d2c/f31 [1238155,119157] 0 2024-01-25T15:03:35.536 INFO:tasks.workunit.client.0.smithi170.stdout:9/284: symlink d5/df/d2e/l61 0 2024-01-25T15:03:35.536 INFO:tasks.workunit.client.0.smithi170.stdout:9/285: fdatasync d5/d1e/f2a 0 2024-01-25T15:03:35.537 INFO:tasks.workunit.client.0.smithi170.stdout:5/269: dread d5/d2a/f3e [0,4194304] 0 2024-01-25T15:03:35.537 INFO:tasks.workunit.client.0.smithi170.stdout:5/270: write d5/d10/d2c/f2d [5048415,59467] 0 2024-01-25T15:03:35.537 INFO:tasks.workunit.client.0.smithi170.stdout:5/271: chown d5/d10/d2c/d45/d56 8016 1 2024-01-25T15:03:35.539 INFO:tasks.workunit.client.0.smithi170.stdout:8/226: symlink d3/d7/d22/d23/d25/d34/l4d 0 2024-01-25T15:03:35.539 INFO:tasks.workunit.client.0.smithi170.stdout:4/278: dread d6/d37/f40 [0,4194304] 0 2024-01-25T15:03:35.540 INFO:tasks.workunit.client.0.smithi170.stdout:4/279: chown f2 14569 1 2024-01-25T15:03:35.541 INFO:tasks.workunit.client.0.smithi170.stdout:9/286: dread d5/f14 [0,4194304] 0 2024-01-25T15:03:35.544 INFO:tasks.workunit.client.0.smithi170.stdout:5/272: mknod d5/d10/d2c/c61 0 2024-01-25T15:03:35.546 INFO:tasks.workunit.client.0.smithi170.stdout:6/307: sync 2024-01-25T15:03:35.547 INFO:tasks.workunit.client.0.smithi170.stdout:2/321: sync 2024-01-25T15:03:35.548 INFO:tasks.workunit.client.0.smithi170.stdout:0/286: sync 2024-01-25T15:03:35.548 INFO:tasks.workunit.client.0.smithi170.stdout:3/293: sync 2024-01-25T15:03:35.549 INFO:tasks.workunit.client.0.smithi170.stdout:9/287: creat d5/df/d2e/f62 x:0 0 0 2024-01-25T15:03:35.553 INFO:tasks.workunit.client.0.smithi170.stdout:2/322: creat d10/d1b/f75 x:0 0 0 2024-01-25T15:03:35.554 INFO:tasks.workunit.client.0.smithi170.stdout:8/227: dread d3/d7/d22/d23/f4a [0,4194304] 0 2024-01-25T15:03:35.555 INFO:tasks.workunit.client.0.smithi170.stdout:0/287: creat d8/d10/d2d/d58/f62 x:0 0 0 2024-01-25T15:03:35.558 INFO:tasks.workunit.client.0.smithi170.stdout:3/294: rename d3/d10/d1e/f30 to d3/d1c/d2b/f62 0 2024-01-25T15:03:35.559 INFO:tasks.workunit.client.0.smithi170.stdout:9/288: getdents d5/d1e/d21/d46/d18 0 2024-01-25T15:03:35.560 INFO:tasks.workunit.client.0.smithi170.stdout:5/273: truncate d5/d2a/f52 899396 0 2024-01-25T15:03:35.560 INFO:tasks.workunit.client.0.smithi170.stdout:5/274: fdatasync d5/f15 0 2024-01-25T15:03:35.561 INFO:tasks.workunit.client.0.smithi170.stdout:0/288: truncate d8/d10/d2d/d2f/f37 3615074 0 2024-01-25T15:03:35.562 INFO:tasks.workunit.client.0.smithi170.stdout:3/295: mkdir d3/d10/d1e/d21/d41/d4b/d63 0 2024-01-25T15:03:35.563 INFO:tasks.workunit.client.0.smithi170.stdout:2/323: dread d10/d1e/f71 [0,4194304] 0 2024-01-25T15:03:35.564 INFO:tasks.workunit.client.0.smithi170.stdout:3/296: dread - d3/d1c/d2d/f48 zero size 2024-01-25T15:03:35.565 INFO:tasks.workunit.client.0.smithi170.stdout:5/275: symlink d5/d2a/l62 0 2024-01-25T15:03:35.565 INFO:tasks.workunit.client.0.smithi170.stdout:4/280: dread d6/d7/f1a [0,4194304] 0 2024-01-25T15:03:35.565 INFO:tasks.workunit.client.0.smithi170.stdout:4/281: truncate d6/d7/d1b/f3b 312887 0 2024-01-25T15:03:35.566 INFO:tasks.workunit.client.0.smithi170.stdout:3/297: rmdir d3/d10/d1e/d5a 0 2024-01-25T15:03:35.566 INFO:tasks.workunit.client.0.smithi170.stdout:3/298: dread - d3/d10/d52/f5d zero size 2024-01-25T15:03:35.568 INFO:tasks.workunit.client.0.smithi170.stdout:5/276: unlink d5/d10/f17 0 2024-01-25T15:03:35.569 INFO:tasks.workunit.client.0.smithi170.stdout:3/299: getdents d3/d10/d13/d5b 0 2024-01-25T15:03:35.569 INFO:tasks.workunit.client.0.smithi170.stdout:3/300: write d3/d2a/f5f [900574,45972] 0 2024-01-25T15:03:35.569 INFO:tasks.workunit.client.0.smithi170.stdout:3/301: chown d3/d10/ff 50970194 1 2024-01-25T15:03:35.572 INFO:tasks.workunit.client.0.smithi170.stdout:7/341: dwrite d8/f4e [0,4194304] 0 2024-01-25T15:03:35.578 INFO:tasks.workunit.client.0.smithi170.stdout:6/308: dwrite f0 [4194304,4194304] 0 2024-01-25T15:03:35.580 INFO:tasks.workunit.client.0.smithi170.stdout:6/309: rename d2/d7/d23/d19/d2f/d5d/c61 to d2/d7/c69 0 2024-01-25T15:03:35.582 INFO:tasks.workunit.client.0.smithi170.stdout:6/310: rmdir d2/d7 39 2024-01-25T15:03:35.582 INFO:tasks.workunit.client.0.smithi170.stdout:6/311: creat d2/d7/d23/d19/f6a x:0 0 0 2024-01-25T15:03:35.583 INFO:tasks.workunit.client.0.smithi170.stdout:6/312: mkdir d2/d7/d23/d19/d2a/d6b 0 2024-01-25T15:03:35.584 INFO:tasks.workunit.client.0.smithi170.stdout:6/313: symlink d2/d7/d23/d19/d2a/d6b/l6c 0 2024-01-25T15:03:35.600 INFO:tasks.workunit.client.0.smithi170.stdout:6/314: write f0 [5157073,127612] 0 2024-01-25T15:03:35.600 INFO:tasks.workunit.client.0.smithi170.stdout:6/315: dread - d2/f4f zero size 2024-01-25T15:03:35.602 INFO:tasks.workunit.client.0.smithi170.stdout:9/289: dwrite d5/df/d16/d35/d3c/f4e [0,4194304] 0 2024-01-25T15:03:35.602 INFO:tasks.workunit.client.0.smithi170.stdout:0/289: dwrite d8/d10/d2d/d2f/f37 [0,4194304] 0 2024-01-25T15:03:35.602 INFO:tasks.workunit.client.0.smithi170.stdout:3/302: dwrite d3/d2a/f4d [0,4194304] 0 2024-01-25T15:03:35.602 INFO:tasks.workunit.client.0.smithi170.stdout:4/282: dwrite d6/d7/f17 [4194304,4194304] 0 2024-01-25T15:03:35.602 INFO:tasks.workunit.client.0.smithi170.stdout:4/283: chown d6/d28 4042760 1 2024-01-25T15:03:35.602 INFO:tasks.workunit.client.0.smithi170.stdout:7/342: dwrite d8/f52 [0,4194304] 0 2024-01-25T15:03:35.602 INFO:tasks.workunit.client.0.smithi170.stdout:6/316: mknod d2/d7/d23/d19/d2f/c6d 0 2024-01-25T15:03:35.603 INFO:tasks.workunit.client.0.smithi170.stdout:6/317: fdatasync d2/d7/d23/d19/f29 0 2024-01-25T15:03:35.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:35 smithi186 ceph-mon[35697]: pgmap v396: 97 pgs: 97 active+clean; 394 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 MiB/s rd, 50 MiB/s wr, 1.29k op/s 2024-01-25T15:03:35.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:35 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:35.606 INFO:tasks.workunit.client.0.smithi170.stdout:9/290: mkdir d5/d1e/d21/d63 0 2024-01-25T15:03:35.606 INFO:tasks.workunit.client.0.smithi170.stdout:7/343: creat d8/d20/d2a/d35/d55/f85 x:0 0 0 2024-01-25T15:03:35.608 INFO:tasks.workunit.client.0.smithi170.stdout:3/303: unlink d3/c3e 0 2024-01-25T15:03:35.611 INFO:tasks.workunit.client.0.smithi170.stdout:9/291: creat d5/d1e/d21/d46/f64 x:0 0 0 2024-01-25T15:03:35.613 INFO:tasks.workunit.client.0.smithi170.stdout:7/344: symlink d8/d20/l86 0 2024-01-25T15:03:35.613 INFO:tasks.workunit.client.0.smithi170.stdout:2/324: link d10/d1e/f20 d10/d1e/d32/d3e/d5c/f76 0 2024-01-25T15:03:35.614 INFO:tasks.workunit.client.0.smithi170.stdout:3/304: getdents d3/d10/d1e/d21/d41/d4b 0 2024-01-25T15:03:35.614 INFO:tasks.workunit.client.0.smithi170.stdout:3/305: creat d3/d10/d52/f64 x:0 0 0 2024-01-25T15:03:35.615 INFO:tasks.workunit.client.0.smithi170.stdout:9/292: creat d5/df/d16/d35/f65 x:0 0 0 2024-01-25T15:03:35.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:35 smithi170 ceph-mon[31899]: pgmap v396: 97 pgs: 97 active+clean; 394 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 MiB/s rd, 50 MiB/s wr, 1.29k op/s 2024-01-25T15:03:35.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:35 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:35.624 INFO:tasks.workunit.client.0.smithi170.stdout:7/345: creat d8/d20/d2a/f87 x:0 0 0 2024-01-25T15:03:35.624 INFO:tasks.workunit.client.0.smithi170.stdout:7/346: readlink d8/d20/d45/d68/d71/l72 0 2024-01-25T15:03:35.624 INFO:tasks.workunit.client.0.smithi170.stdout:7/347: chown f7 20581071 1 2024-01-25T15:03:35.625 INFO:tasks.workunit.client.0.smithi170.stdout:7/348: fdatasync d8/f1e 0 2024-01-25T15:03:35.626 INFO:tasks.workunit.client.0.smithi170.stdout:3/306: rename d3/d10/d13/f25 to d3/d10/d13/f65 0 2024-01-25T15:03:35.626 INFO:tasks.workunit.client.0.smithi170.stdout:3/307: write d3/d10/d13/f1d [1474071,31932] 0 2024-01-25T15:03:35.627 INFO:tasks.workunit.client.0.smithi170.stdout:9/293: mknod d5/df/d16/c66 0 2024-01-25T15:03:35.629 INFO:tasks.workunit.client.0.smithi170.stdout:2/325: dread d10/f13 [0,4194304] 0 2024-01-25T15:03:35.630 INFO:tasks.workunit.client.0.smithi170.stdout:6/318: dwrite d2/d7/d23/d19/d2a/d43/d44/f66 [0,4194304] 0 2024-01-25T15:03:35.630 INFO:tasks.workunit.client.0.smithi170.stdout:2/326: dread d10/d1b/f56 [0,4194304] 0 2024-01-25T15:03:35.630 INFO:tasks.workunit.client.0.smithi170.stdout:2/327: chown d10/d1e/f20 5561 1 2024-01-25T15:03:35.632 INFO:tasks.workunit.client.0.smithi170.stdout:6/319: link d2/d7/c31 d2/d7/d1b/c6e 0 2024-01-25T15:03:35.633 INFO:tasks.workunit.client.0.smithi170.stdout:2/328: mknod d10/d16/c77 0 2024-01-25T15:03:35.634 INFO:tasks.workunit.client.0.smithi170.stdout:6/320: creat d2/d7/d23/d19/d2f/d5d/f6f x:0 0 0 2024-01-25T15:03:35.635 INFO:tasks.workunit.client.0.smithi170.stdout:6/321: mknod d2/d7/d23/d19/d2f/d37/c70 0 2024-01-25T15:03:35.635 INFO:tasks.workunit.client.0.smithi170.stdout:6/322: chown d2/d7/l15 24781 1 2024-01-25T15:03:35.635 INFO:tasks.workunit.client.0.smithi170.stdout:6/323: dread - d2/d7/d23/d19/d2a/d43/f58 zero size 2024-01-25T15:03:35.635 INFO:tasks.workunit.client.0.smithi170.stdout:6/324: chown d2/d7/d23/l30 11588241 1 2024-01-25T15:03:35.636 INFO:tasks.workunit.client.0.smithi170.stdout:6/325: link d2/d7/d23/d19/d2f/c6d d2/d7/d23/d19/d2f/c71 0 2024-01-25T15:03:35.637 INFO:tasks.workunit.client.0.smithi170.stdout:7/349: write d8/f52 [2122785,47694] 0 2024-01-25T15:03:35.638 INFO:tasks.workunit.client.0.smithi170.stdout:7/350: symlink d8/d20/d2a/d35/d55/d6e/d81/l88 0 2024-01-25T15:03:35.640 INFO:tasks.workunit.client.0.smithi170.stdout:7/351: creat d8/d20/d2a/d35/d55/d6e/f89 x:0 0 0 2024-01-25T15:03:35.640 INFO:tasks.workunit.client.0.smithi170.stdout:7/352: fdatasync d8/d20/d2a/d35/f37 0 2024-01-25T15:03:35.641 INFO:tasks.workunit.client.0.smithi170.stdout:4/284: dwrite d6/d7/d1b/f1e [0,4194304] 0 2024-01-25T15:03:35.642 INFO:tasks.workunit.client.0.smithi170.stdout:0/290: dwrite d8/d18/f4d [0,4194304] 0 2024-01-25T15:03:35.642 INFO:tasks.workunit.client.0.smithi170.stdout:7/353: link d8/d20/d2a/f34 d8/d20/d45/d68/d71/f8a 0 2024-01-25T15:03:35.646 INFO:tasks.workunit.client.0.smithi170.stdout:4/285: unlink d6/d7/d1b/f36 0 2024-01-25T15:03:35.648 INFO:tasks.workunit.client.0.smithi170.stdout:3/308: dread d3/d2a/f4d [0,4194304] 0 2024-01-25T15:03:35.648 INFO:tasks.workunit.client.0.smithi170.stdout:3/309: readlink d3/l3f 0 2024-01-25T15:03:35.648 INFO:tasks.workunit.client.0.smithi170.stdout:4/286: truncate d6/d28/f45 2867517 0 2024-01-25T15:03:35.648 INFO:tasks.workunit.client.0.smithi170.stdout:0/291: truncate d8/d10/f15 594314 0 2024-01-25T15:03:35.648 INFO:tasks.workunit.client.0.smithi170.stdout:0/292: write d8/d3e/f61 [1005946,79280] 0 2024-01-25T15:03:35.649 INFO:tasks.workunit.client.0.smithi170.stdout:0/293: creat d8/d10/d2d/d53/f63 x:0 0 0 2024-01-25T15:03:35.650 INFO:tasks.workunit.client.0.smithi170.stdout:7/354: symlink d8/d20/d45/d68/l8b 0 2024-01-25T15:03:35.652 INFO:tasks.workunit.client.0.smithi170.stdout:3/310: creat d3/d10/d13/d5b/f66 x:0 0 0 2024-01-25T15:03:35.652 INFO:tasks.workunit.client.0.smithi170.stdout:3/311: stat d3/d10/d13/d1b/d29 0 2024-01-25T15:03:35.653 INFO:tasks.workunit.client.0.smithi170.stdout:9/294: dwrite d5/df/d16/d35/f65 [0,4194304] 0 2024-01-25T15:03:35.653 INFO:tasks.workunit.client.0.smithi170.stdout:9/295: write d5/dc/f2c [4256916,87904] 0 2024-01-25T15:03:35.654 INFO:tasks.workunit.client.0.smithi170.stdout:7/355: mkdir d8/d20/d45/d68/d71/d8c 0 2024-01-25T15:03:35.656 INFO:tasks.workunit.client.0.smithi170.stdout:3/312: mknod d3/d10/d13/d1b/c67 0 2024-01-25T15:03:35.656 INFO:tasks.workunit.client.0.smithi170.stdout:3/313: chown d3/d10/d13/d5b 246319534 1 2024-01-25T15:03:35.656 INFO:tasks.workunit.client.0.smithi170.stdout:3/314: dread - d3/d10/d52/f5d zero size 2024-01-25T15:03:35.656 INFO:tasks.workunit.client.0.smithi170.stdout:3/315: creat d3/f68 x:0 0 0 2024-01-25T15:03:35.656 INFO:tasks.workunit.client.0.smithi170.stdout:3/316: chown d3/d2a 4410 1 2024-01-25T15:03:35.656 INFO:tasks.workunit.client.0.smithi170.stdout:3/317: stat d3/f4c 0 2024-01-25T15:03:35.656 INFO:tasks.workunit.client.0.smithi170.stdout:9/296: dread d5/dc/d42/f44 [0,4194304] 0 2024-01-25T15:03:35.656 INFO:tasks.workunit.client.0.smithi170.stdout:9/297: fdatasync f4 0 2024-01-25T15:03:35.656 INFO:tasks.workunit.client.0.smithi170.stdout:2/329: dwrite d10/d1e/d32/f4b [0,4194304] 0 2024-01-25T15:03:35.659 INFO:tasks.workunit.client.0.smithi170.stdout:7/356: rename d8/f1d to d8/d20/d3b/f8d 0 2024-01-25T15:03:35.659 INFO:tasks.workunit.client.0.smithi170.stdout:7/357: chown l1 2997 1 2024-01-25T15:03:35.661 INFO:tasks.workunit.client.0.smithi170.stdout:0/294: read f6 [3691987,42613] 0 2024-01-25T15:03:35.662 INFO:tasks.workunit.client.0.smithi170.stdout:6/326: rmdir d2/d7/d23/d19/d2f/d37 39 2024-01-25T15:03:35.665 INFO:tasks.workunit.client.0.smithi170.stdout:9/298: dread d5/d1e/d21/d34/f3d [0,4194304] 0 2024-01-25T15:03:35.666 INFO:tasks.workunit.client.0.smithi170.stdout:2/330: getdents d10/d1b/d5f 0 2024-01-25T15:03:35.666 INFO:tasks.workunit.client.0.smithi170.stdout:2/331: chown d10/d1e/f4e 3998 1 2024-01-25T15:03:35.666 INFO:tasks.workunit.client.0.smithi170.stdout:2/332: write f8 [6422222,40575] 0 2024-01-25T15:03:35.669 INFO:tasks.workunit.client.0.smithi170.stdout:9/299: rename d5/c10 to d5/df/d16/d35/c67 0 2024-01-25T15:03:35.670 INFO:tasks.workunit.client.0.smithi170.stdout:6/327: dread d2/d7/f1c [4194304,4194304] 0 2024-01-25T15:03:35.674 INFO:tasks.workunit.client.0.smithi170.stdout:0/295: rmdir d8/d10 39 2024-01-25T15:03:35.675 INFO:tasks.workunit.client.0.smithi170.stdout:9/300: symlink d5/df/d16/d35/d3c/l68 0 2024-01-25T15:03:35.675 INFO:tasks.workunit.client.0.smithi170.stdout:9/301: fdatasync d5/df/d16/d35/f65 0 2024-01-25T15:03:35.676 INFO:tasks.workunit.client.0.smithi170.stdout:2/333: dread d10/d1b/f56 [0,4194304] 0 2024-01-25T15:03:35.676 INFO:tasks.workunit.client.0.smithi170.stdout:6/328: symlink d2/d7/d23/l72 0 2024-01-25T15:03:35.681 INFO:tasks.workunit.client.0.smithi170.stdout:6/329: mkdir d2/d7/d23/d19/d2f/d73 0 2024-01-25T15:03:35.681 INFO:tasks.workunit.client.0.smithi170.stdout:1/275: sync 2024-01-25T15:03:35.683 INFO:tasks.workunit.client.0.smithi170.stdout:6/330: truncate d2/f17 4741091 0 2024-01-25T15:03:35.685 INFO:tasks.workunit.client.0.smithi170.stdout:1/276: mkdir d0/d20/d28/d2a/d4a/d56/d5b 0 2024-01-25T15:03:35.685 INFO:tasks.workunit.client.0.smithi170.stdout:1/277: truncate d0/f46 538379 0 2024-01-25T15:03:35.685 INFO:tasks.workunit.client.0.smithi170.stdout:1/278: chown d0/d20/d3a/f53 52120 1 2024-01-25T15:03:35.687 INFO:tasks.workunit.client.0.smithi170.stdout:6/331: mkdir d2/d7/d23/d19/d2f/d74 0 2024-01-25T15:03:35.688 INFO:tasks.workunit.client.0.smithi170.stdout:3/318: getdents d3/d10/d13/d1b/d29/d38 0 2024-01-25T15:03:35.688 INFO:tasks.workunit.client.0.smithi170.stdout:3/319: chown d3/d2a/f4d 1222 1 2024-01-25T15:03:35.688 INFO:tasks.workunit.client.0.smithi170.stdout:3/320: getdents d3/d10/d1e/d21/d41/d4a 0 2024-01-25T15:03:35.689 INFO:tasks.workunit.client.0.smithi170.stdout:6/332: truncate d2/d7/f2e 2580408 0 2024-01-25T15:03:35.689 INFO:tasks.workunit.client.0.smithi170.stdout:6/333: truncate d2/d7/d1b/f1f 620890 0 2024-01-25T15:03:35.691 INFO:tasks.workunit.client.0.smithi170.stdout:1/279: rmdir d0/d2e 39 2024-01-25T15:03:35.691 INFO:tasks.workunit.client.0.smithi170.stdout:1/280: chown d0/f12 895 1 2024-01-25T15:03:35.691 INFO:tasks.workunit.client.0.smithi170.stdout:1/281: stat d0/d1b/l22 0 2024-01-25T15:03:35.691 INFO:tasks.workunit.client.0.smithi170.stdout:1/282: fdatasync d0/d2e/f3b 0 2024-01-25T15:03:35.691 INFO:tasks.workunit.client.0.smithi170.stdout:1/283: rename d0/d20 to d0/d20/d28/d5c 22 2024-01-25T15:03:35.691 INFO:tasks.workunit.client.0.smithi170.stdout:1/284: fdatasync d0/d20/d28/f29 0 2024-01-25T15:03:35.692 INFO:tasks.workunit.client.0.smithi170.stdout:6/334: mknod d2/d7/d23/d19/c75 0 2024-01-25T15:03:35.692 INFO:tasks.workunit.client.0.smithi170.stdout:6/335: creat d2/d7/d1b/d28/f76 x:0 0 0 2024-01-25T15:03:35.694 INFO:tasks.workunit.client.0.smithi170.stdout:1/285: mknod d0/d20/d28/d2a/c5d 0 2024-01-25T15:03:35.694 INFO:tasks.workunit.client.0.smithi170.stdout:3/321: dread d3/d10/ff [0,4194304] 0 2024-01-25T15:03:35.694 INFO:tasks.workunit.client.0.smithi170.stdout:3/322: write d3/d1c/d2b/f62 [431527,17215] 0 2024-01-25T15:03:35.698 INFO:tasks.workunit.client.0.smithi170.stdout:1/286: creat d0/d20/d28/d2a/f5e x:0 0 0 2024-01-25T15:03:35.698 INFO:tasks.workunit.client.0.smithi170.stdout:1/287: write d0/d1b/f1c [530633,127120] 0 2024-01-25T15:03:35.698 INFO:tasks.workunit.client.0.smithi170.stdout:1/288: chown d0/f5 2 1 2024-01-25T15:03:35.699 INFO:tasks.workunit.client.0.smithi170.stdout:1/289: mknod d0/d20/d28/d2a/d4a/d56/d5b/c5f 0 2024-01-25T15:03:35.702 INFO:tasks.workunit.client.0.smithi170.stdout:1/290: mkdir d0/d20/d3a/d60 0 2024-01-25T15:03:35.702 INFO:tasks.workunit.client.0.smithi170.stdout:1/291: stat d0/ff 0 2024-01-25T15:03:35.702 INFO:tasks.workunit.client.0.smithi170.stdout:3/323: write d3/fa [1079645,112947] 0 2024-01-25T15:03:35.705 INFO:tasks.workunit.client.0.smithi170.stdout:1/292: link d0/d1b/c39 d0/d20/d28/d2a/d4a/d56/d5b/c61 0 2024-01-25T15:03:35.705 INFO:tasks.workunit.client.0.smithi170.stdout:6/336: dread d2/d7/d23/d19/f24 [0,4194304] 0 2024-01-25T15:03:35.706 INFO:tasks.workunit.client.0.smithi170.stdout:6/337: mknod d2/d7/d23/c77 0 2024-01-25T15:03:35.706 INFO:tasks.workunit.client.0.smithi170.stdout:3/324: getdents d3/d1c 0 2024-01-25T15:03:35.708 INFO:tasks.workunit.client.0.smithi170.stdout:3/325: mknod d3/d10/c69 0 2024-01-25T15:03:35.708 INFO:tasks.workunit.client.0.smithi170.stdout:3/326: stat d3/d1c/d2b/d5c 0 2024-01-25T15:03:35.709 INFO:tasks.workunit.client.0.smithi170.stdout:9/302: dwrite d5/df/d16/f2b [4194304,4194304] 0 2024-01-25T15:03:35.709 INFO:tasks.workunit.client.0.smithi170.stdout:3/327: link d3/d1c/d2d/l51 d3/d10/d1e/l6a 0 2024-01-25T15:03:35.711 INFO:tasks.workunit.client.0.smithi170.stdout:0/296: dwrite d8/d9/f56 [0,4194304] 0 2024-01-25T15:03:35.711 INFO:tasks.workunit.client.0.smithi170.stdout:0/297: chown d8/d9/f29 98152937 1 2024-01-25T15:03:35.711 INFO:tasks.workunit.client.0.smithi170.stdout:0/298: chown d8/f42 0 1 2024-01-25T15:03:35.711 INFO:tasks.workunit.client.0.smithi170.stdout:2/334: dwrite d10/d16/f3b [4194304,4194304] 0 2024-01-25T15:03:35.712 INFO:tasks.workunit.client.0.smithi170.stdout:3/328: symlink d3/d2a/d53/l6b 0 2024-01-25T15:03:35.712 INFO:tasks.workunit.client.0.smithi170.stdout:3/329: chown d3/d10/d13/d1b/d29/c33 0 1 2024-01-25T15:03:35.713 INFO:tasks.workunit.client.0.smithi170.stdout:3/330: write d3/d10/d13/f34 [42694,125786] 0 2024-01-25T15:03:35.715 INFO:tasks.workunit.client.0.smithi170.stdout:9/303: dread d5/d1e/d21/d34/f3d [0,4194304] 0 2024-01-25T15:03:35.715 INFO:tasks.workunit.client.0.smithi170.stdout:9/304: truncate d5/d1e/d21/d34/f47 403060 0 2024-01-25T15:03:35.715 INFO:tasks.workunit.client.0.smithi170.stdout:9/305: write d5/df/d16/f19 [2287144,108722] 0 2024-01-25T15:03:35.715 INFO:tasks.workunit.client.0.smithi170.stdout:9/306: stat d5/d1e/d21/c4c 0 2024-01-25T15:03:35.717 INFO:tasks.workunit.client.0.smithi170.stdout:2/335: rename d10/d1b/f25 to d10/d1b/d5f/f78 0 2024-01-25T15:03:35.719 INFO:tasks.workunit.client.0.smithi170.stdout:9/307: link d5/d1e/d21/d46/d18/l3f d5/df/d16/d35/d3c/d56/l69 0 2024-01-25T15:03:35.720 INFO:tasks.workunit.client.0.smithi170.stdout:1/293: dread d0/f12 [0,4194304] 0 2024-01-25T15:03:35.722 INFO:tasks.workunit.client.0.smithi170.stdout:2/336: dread d10/f37 [0,4194304] 0 2024-01-25T15:03:35.723 INFO:tasks.workunit.client.0.smithi170.stdout:9/308: unlink d5/df/d16/d35/f58 0 2024-01-25T15:03:35.724 INFO:tasks.workunit.client.0.smithi170.stdout:1/294: symlink d0/d20/d28/l62 0 2024-01-25T15:03:35.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:35 smithi191 ceph-mon[36347]: pgmap v396: 97 pgs: 97 active+clean; 394 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 MiB/s rd, 50 MiB/s wr, 1.29k op/s 2024-01-25T15:03:35.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:35 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:35.737 INFO:tasks.workunit.client.0.smithi170.stdout:2/337: getdents d10/d1b/d5f 0 2024-01-25T15:03:35.737 INFO:tasks.workunit.client.0.smithi170.stdout:2/338: chown d10/d1e/d32/d3e/f6b 7345 1 2024-01-25T15:03:35.739 INFO:tasks.workunit.client.0.smithi170.stdout:2/339: creat d10/d1e/d32/d62/f79 x:0 0 0 2024-01-25T15:03:35.741 INFO:tasks.workunit.client.0.smithi170.stdout:2/340: getdents d10/d1e/d32/d3e/d5c 0 2024-01-25T15:03:35.743 INFO:tasks.workunit.client.0.smithi170.stdout:2/341: mkdir d10/d1e/d32/d3e/d41/d7a 0 2024-01-25T15:03:35.746 INFO:tasks.workunit.client.0.smithi170.stdout:1/295: dread d0/fd [0,4194304] 0 2024-01-25T15:03:35.746 INFO:tasks.workunit.client.0.smithi170.stdout:0/299: dwrite d8/d10/d2d/d2f/f37 [0,4194304] 0 2024-01-25T15:03:35.746 INFO:tasks.workunit.client.0.smithi170.stdout:3/331: dwrite d3/d1c/d2b/f62 [0,4194304] 0 2024-01-25T15:03:35.746 INFO:tasks.workunit.client.0.smithi170.stdout:1/296: write d0/d20/f2b [3415546,126117] 0 2024-01-25T15:03:35.746 INFO:tasks.workunit.client.0.smithi170.stdout:1/297: chown d0/d20/d28/d2a/d4a/d56/d5b/c61 9049151 1 2024-01-25T15:03:35.748 INFO:tasks.workunit.client.0.smithi170.stdout:0/300: mknod d8/d10/d2d/d53/c64 0 2024-01-25T15:03:35.748 INFO:tasks.workunit.client.0.smithi170.stdout:3/332: write d3/d2a/f5f [353699,13779] 0 2024-01-25T15:03:35.748 INFO:tasks.workunit.client.0.smithi170.stdout:0/301: read d8/d18/f3b [5917,9412] 0 2024-01-25T15:03:35.750 INFO:tasks.workunit.client.0.smithi170.stdout:3/333: rmdir d3/d10/d13/d1b/d29/d38/d58 0 2024-01-25T15:03:35.750 INFO:tasks.workunit.client.0.smithi170.stdout:3/334: read - d3/d10/d52/f64 zero size 2024-01-25T15:03:35.752 INFO:tasks.workunit.client.0.smithi170.stdout:3/335: rename d3/d10/d13/d1b/d29/l57 to d3/d2a/l6c 0 2024-01-25T15:03:35.753 INFO:tasks.workunit.client.0.smithi170.stdout:2/342: write d10/d1b/f1d [2865611,117701] 0 2024-01-25T15:03:35.753 INFO:tasks.workunit.client.0.smithi170.stdout:3/336: mkdir d3/d10/d6d 0 2024-01-25T15:03:35.757 INFO:tasks.workunit.client.0.smithi170.stdout:9/309: dwrite d5/dc/f2c [4194304,4194304] 0 2024-01-25T15:03:35.757 INFO:tasks.workunit.client.0.smithi170.stdout:2/343: rename d10/l51 to d10/d1e/d32/d63/l7b 0 2024-01-25T15:03:35.759 INFO:tasks.workunit.client.0.smithi170.stdout:9/310: mkdir d5/d1e/d21/d46/d18/d6a 0 2024-01-25T15:03:35.760 INFO:tasks.workunit.client.0.smithi170.stdout:0/302: write d8/d9/f16 [4069560,127128] 0 2024-01-25T15:03:35.762 INFO:tasks.workunit.client.0.smithi170.stdout:3/337: rename l2 to d3/d10/d1e/l6e 0 2024-01-25T15:03:35.762 INFO:tasks.workunit.client.0.smithi170.stdout:3/338: fsync d3/fa 0 2024-01-25T15:03:35.763 INFO:tasks.workunit.client.0.smithi170.stdout:1/298: dwrite d0/fe [0,4194304] 0 2024-01-25T15:03:35.764 INFO:tasks.workunit.client.0.smithi170.stdout:0/303: link d8/d10/d2d/d53/c64 d8/d10/d2d/d2f/c65 0 2024-01-25T15:03:35.765 INFO:tasks.workunit.client.0.smithi170.stdout:8/228: sync 2024-01-25T15:03:35.771 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-01-25T15:03:35.771 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-01-25T15:03:35.771 INFO:tasks.workunit.client.0.smithi170.stdout:1/299: mknod d0/c63 0 2024-01-25T15:03:35.772 INFO:tasks.workunit.client.0.smithi170.stdout:8/229: rename d3/d7/d3a/l3b to d3/d7/d3a/l4e 0 2024-01-25T15:03:35.775 INFO:tasks.workunit.client.0.smithi170.stdout:2/344: rename d10/d1e/d32/d63/f69 to d10/d16/f7c 0 2024-01-25T15:03:35.779 INFO:tasks.workunit.client.0.smithi170.stdout:8/230: unlink d3/d7/d22/l2c 0 2024-01-25T15:03:35.781 INFO:tasks.workunit.client.0.smithi170.stdout:9/311: rename d5/d1e/d21/d27 to d5/df/d2e/d6b 0 2024-01-25T15:03:35.782 INFO:tasks.workunit.client.0.smithi170.stdout:8/231: getdents d3/d7/d22/d23 0 2024-01-25T15:03:35.784 INFO:tasks.workunit.client.0.smithi170.stdout:4/287: sync 2024-01-25T15:03:35.784 INFO:tasks.workunit.client.0.smithi170.stdout:5/277: sync 2024-01-25T15:03:35.784 INFO:tasks.workunit.client.0.smithi170.stdout:0/304: dread d8/d9/f56 [0,4194304] 0 2024-01-25T15:03:35.784 INFO:tasks.workunit.client.0.smithi170.stdout:9/312: unlink d5/l9 0 2024-01-25T15:03:35.786 INFO:tasks.workunit.client.0.smithi170.stdout:1/300: rename d0/d1b/f1f to d0/d20/d28/d2a/d4a/d56/f64 0 2024-01-25T15:03:35.786 INFO:tasks.workunit.client.0.smithi170.stdout:1/301: chown d0/d20/d28/d2a/f5e 85 1 2024-01-25T15:03:35.788 INFO:tasks.workunit.client.0.smithi170.stdout:3/339: dwrite d3/d10/d13/f1f [0,4194304] 0 2024-01-25T15:03:35.788 INFO:tasks.workunit.client.0.smithi170.stdout:3/340: write d3/d10/f14 [8836132,7676] 0 2024-01-25T15:03:35.790 INFO:tasks.workunit.client.0.smithi170.stdout:4/288: truncate d6/d7/d34/f30 2748252 0 2024-01-25T15:03:35.791 INFO:tasks.workunit.client.0.smithi170.stdout:0/305: rename d8/c32 to d8/d9/c66 0 2024-01-25T15:03:35.793 INFO:tasks.workunit.client.0.smithi170.stdout:8/232: rmdir d3/d7/d28/d47 39 2024-01-25T15:03:35.795 INFO:tasks.workunit.client.0.smithi170.stdout:9/313: dread d5/df/d16/f19 [0,4194304] 0 2024-01-25T15:03:35.797 INFO:tasks.workunit.client.0.smithi170.stdout:2/345: dwrite d10/d1e/d32/d3e/f6b [0,4194304] 0 2024-01-25T15:03:35.799 INFO:tasks.workunit.client.0.smithi170.stdout:3/341: stat d3/d10/d1e/d21/c60 0 2024-01-25T15:03:35.803 INFO:tasks.workunit.client.0.smithi170.stdout:5/278: rmdir d5 39 2024-01-25T15:03:35.803 INFO:tasks.workunit.client.0.smithi170.stdout:5/279: fdatasync d5/d2a/f53 0 2024-01-25T15:03:35.803 INFO:tasks.workunit.client.0.smithi170.stdout:4/289: getdents d6/d7/d34 0 2024-01-25T15:03:35.805 INFO:tasks.workunit.client.0.smithi170.stdout:0/306: creat d8/d10/d2d/d53/f67 x:0 0 0 2024-01-25T15:03:35.805 INFO:tasks.workunit.client.0.smithi170.stdout:6/338: sync 2024-01-25T15:03:35.805 INFO:tasks.workunit.client.0.smithi170.stdout:7/358: sync 2024-01-25T15:03:35.805 INFO:tasks.workunit.client.0.smithi170.stdout:1/302: rmdir d0/d20/d28 39 2024-01-25T15:03:35.805 INFO:tasks.workunit.client.0.smithi170.stdout:6/339: dread - d2/d7/d23/d19/f6a zero size 2024-01-25T15:03:35.806 INFO:tasks.workunit.client.0.smithi170.stdout:1/303: dread d0/f46 [0,4194304] 0 2024-01-25T15:03:35.806 INFO:tasks.workunit.client.0.smithi170.stdout:1/304: fdatasync d0/d20/f4d 0 2024-01-25T15:03:35.809 INFO:tasks.workunit.client.0.smithi170.stdout:9/314: mkdir d5/d1e/d21/d46/d6c 0 2024-01-25T15:03:35.809 INFO:tasks.workunit.client.0.smithi170.stdout:9/315: write d5/dc/f30 [2741520,68625] 0 2024-01-25T15:03:35.809 INFO:tasks.workunit.client.0.smithi170.stdout:8/233: creat d3/d7/d3a/f4f x:0 0 0 2024-01-25T15:03:35.811 INFO:tasks.workunit.client.0.smithi170.stdout:2/346: creat d10/d1b/d5f/f7d x:0 0 0 2024-01-25T15:03:35.811 INFO:tasks.workunit.client.0.smithi170.stdout:3/342: rmdir d3/d2a/d53 39 2024-01-25T15:03:35.811 INFO:tasks.workunit.client.0.smithi170.stdout:3/343: stat d3/d1c/d2b/f62 0 2024-01-25T15:03:35.811 INFO:tasks.workunit.client.0.smithi170.stdout:3/344: truncate d3/d10/fe 4384767 0 2024-01-25T15:03:35.812 INFO:tasks.workunit.client.0.smithi170.stdout:5/280: creat d5/d10/d2c/d45/d5e/f63 x:0 0 0 2024-01-25T15:03:35.812 INFO:tasks.workunit.client.0.smithi170.stdout:4/290: truncate d6/d7/d1b/f41 3825057 0 2024-01-25T15:03:35.813 INFO:tasks.workunit.client.0.smithi170.stdout:0/307: symlink d8/d10/d2d/d2f/l68 0 2024-01-25T15:03:35.814 INFO:tasks.workunit.client.0.smithi170.stdout:7/359: mkdir d8/d20/d45/d8e 0 2024-01-25T15:03:35.815 INFO:tasks.workunit.client.0.smithi170.stdout:6/340: mkdir d2/d7/d1b/d78 0 2024-01-25T15:03:35.816 INFO:tasks.workunit.client.0.smithi170.stdout:1/305: truncate d0/f5 3232183 0 2024-01-25T15:03:35.818 INFO:tasks.workunit.client.0.smithi170.stdout:9/316: rename d5/l5d to d5/df/d16/d35/l6d 0 2024-01-25T15:03:35.820 INFO:tasks.workunit.client.0.smithi170.stdout:8/234: rename d3/d7/d22/d23/d25/c29 to d3/d7/d22/d23/d25/c50 0 2024-01-25T15:03:35.822 INFO:tasks.workunit.client.0.smithi170.stdout:2/347: creat d10/d1e/d5e/d73/f7e x:0 0 0 2024-01-25T15:03:35.822 INFO:tasks.workunit.client.0.smithi170.stdout:2/348: creat d10/d1e/d5e/d73/f7f x:0 0 0 2024-01-25T15:03:35.824 INFO:tasks.workunit.client.0.smithi170.stdout:3/345: unlink d3/d10/d13/l5e 0 2024-01-25T15:03:35.825 INFO:tasks.workunit.client.0.smithi170.stdout:4/291: dread d6/d7/f9 [4194304,4194304] 0 2024-01-25T15:03:35.828 INFO:tasks.workunit.client.0.smithi170.stdout:7/360: truncate d8/f5d 3978613 0 2024-01-25T15:03:35.828 INFO:tasks.workunit.client.0.smithi170.stdout:1/306: truncate d0/f2f 2177002 0 2024-01-25T15:03:35.831 INFO:tasks.workunit.client.0.smithi170.stdout:9/317: mknod d5/d1e/d21/d46/c6e 0 2024-01-25T15:03:35.831 INFO:tasks.workunit.client.0.smithi170.stdout:9/318: dread - d5/f37 zero size 2024-01-25T15:03:35.831 INFO:tasks.workunit.client.0.smithi170.stdout:9/319: write d5/df/d16/d35/f5a [1424958,8651] 0 2024-01-25T15:03:35.831 INFO:tasks.workunit.client.0.smithi170.stdout:9/320: dread - d5/dc/f36 zero size 2024-01-25T15:03:35.832 INFO:tasks.workunit.client.0.smithi170.stdout:8/235: symlink d3/d7/d22/d23/d25/l51 0 2024-01-25T15:03:35.834 INFO:tasks.workunit.client.0.smithi170.stdout:2/349: truncate d10/d1e/d32/d3e/d5c/f76 3677821 0 2024-01-25T15:03:35.835 INFO:tasks.workunit.client.0.smithi170.stdout:3/346: creat d3/d1c/f6f x:0 0 0 2024-01-25T15:03:35.836 INFO:tasks.workunit.client.0.smithi170.stdout:0/308: getdents d8/d10/d2d/d53 0 2024-01-25T15:03:35.840 INFO:tasks.workunit.client.0.smithi170.stdout:1/307: truncate d0/f46 68278 0 2024-01-25T15:03:35.840 INFO:tasks.workunit.client.0.smithi170.stdout:1/308: creat d0/d20/d3a/f65 x:0 0 0 2024-01-25T15:03:35.842 INFO:tasks.workunit.client.0.smithi170.stdout:2/350: creat d10/d1e/d32/d3e/d41/d7a/f80 x:0 0 0 2024-01-25T15:03:35.842 INFO:tasks.workunit.client.0.smithi170.stdout:5/281: rename d5/d10/f26 to d5/f64 0 2024-01-25T15:03:35.843 INFO:tasks.workunit.client.0.smithi170.stdout:9/321: stat d5/df/d16/d35/c67 0 2024-01-25T15:03:35.845 INFO:tasks.workunit.client.0.smithi170.stdout:0/309: creat d8/d10/f69 x:0 0 0 2024-01-25T15:03:35.846 INFO:tasks.workunit.client.0.smithi170.stdout:6/341: dwrite d2/d7/f4a [0,4194304] 0 2024-01-25T15:03:35.848 INFO:tasks.workunit.client.0.smithi170.stdout:1/309: creat d0/d20/d28/f66 x:0 0 0 2024-01-25T15:03:35.849 INFO:tasks.workunit.client.0.smithi170.stdout:2/351: symlink d10/d16/d42/l81 0 2024-01-25T15:03:35.849 INFO:tasks.workunit.client.0.smithi170.stdout:2/352: getdents d10/d1e/d32/d62/d74 0 2024-01-25T15:03:35.851 INFO:tasks.workunit.client.0.smithi170.stdout:2/353: symlink d10/d1e/d32/d62/d74/l82 0 2024-01-25T15:03:35.851 INFO:tasks.workunit.client.0.smithi170.stdout:2/354: fdatasync d10/d1e/f20 0 2024-01-25T15:03:35.851 INFO:tasks.workunit.client.0.smithi170.stdout:2/355: readlink d10/d16/d42/l6c 0 2024-01-25T15:03:35.852 INFO:tasks.workunit.client.0.smithi170.stdout:7/361: rename d8/d20/d2a/d61/l74 to d8/d20/d45/d68/l8f 0 2024-01-25T15:03:35.853 INFO:tasks.workunit.client.0.smithi170.stdout:9/322: mknod d5/df/d16/d52/c6f 0 2024-01-25T15:03:35.853 INFO:tasks.workunit.client.0.smithi170.stdout:9/323: creat d5/df/d2e/f70 x:0 0 0 2024-01-25T15:03:35.855 INFO:tasks.workunit.client.0.smithi170.stdout:4/292: dwrite d6/d7/d1b/f41 [0,4194304] 0 2024-01-25T15:03:35.855 INFO:tasks.workunit.client.0.smithi170.stdout:4/293: chown d6/d28 2033 1 2024-01-25T15:03:35.856 INFO:tasks.workunit.client.0.smithi170.stdout:4/294: dread d6/d7/d1b/f3b [0,4194304] 0 2024-01-25T15:03:35.857 INFO:tasks.workunit.client.0.smithi170.stdout:6/342: link d2/d7/d23/d19/f6a d2/d7/d23/d19/d2a/f79 0 2024-01-25T15:03:35.858 INFO:tasks.workunit.client.0.smithi170.stdout:1/310: symlink d0/d1b/l67 0 2024-01-25T15:03:35.863 INFO:tasks.workunit.client.0.smithi170.stdout:6/343: truncate d2/d7/d23/f2d 1033857 0 2024-01-25T15:03:35.864 INFO:tasks.workunit.client.0.smithi170.stdout:2/356: getdents d10 0 2024-01-25T15:03:35.867 INFO:tasks.workunit.client.0.smithi170.stdout:6/344: symlink d2/d7/d23/d19/d2a/d43/l7a 0 2024-01-25T15:03:35.868 INFO:tasks.workunit.client.0.smithi170.stdout:8/236: rename d3/d7/d28 to d3/d7/d22/d23/d48/d52 0 2024-01-25T15:03:35.869 INFO:tasks.workunit.client.0.smithi170.stdout:2/357: symlink d10/d1e/d32/d62/l83 0 2024-01-25T15:03:35.869 INFO:tasks.workunit.client.0.smithi170.stdout:2/358: chown d10/d1e/d32 87 1 2024-01-25T15:03:35.870 INFO:tasks.workunit.client.0.smithi170.stdout:5/282: rename d5/f7 to d5/d10/d2c/d45/d5e/f65 0 2024-01-25T15:03:35.871 INFO:tasks.workunit.client.0.smithi170.stdout:8/237: mknod d3/d7/d22/d23/d25/c53 0 2024-01-25T15:03:35.873 INFO:tasks.workunit.client.0.smithi170.stdout:3/347: dwrite d3/d10/d52/f64 [0,4194304] 0 2024-01-25T15:03:35.873 INFO:tasks.workunit.client.0.smithi170.stdout:3/348: readlink d3/d2a/d53/l59 0 2024-01-25T15:03:35.873 INFO:tasks.workunit.client.0.smithi170.stdout:3/349: chown d3/d10/d52/f5d 163459454 1 2024-01-25T15:03:35.873 INFO:tasks.workunit.client.0.smithi170.stdout:3/350: dread - d3/d1c/d2d/f48 zero size 2024-01-25T15:03:35.873 INFO:tasks.workunit.client.0.smithi170.stdout:3/351: chown d3/d1c/f6f 223761 1 2024-01-25T15:03:35.873 INFO:tasks.workunit.client.0.smithi170.stdout:3/352: chown d3/d10/d52 25 1 2024-01-25T15:03:35.873 INFO:tasks.workunit.client.0.smithi170.stdout:3/353: stat d3/d10/d13/f1f 0 2024-01-25T15:03:35.874 INFO:tasks.workunit.client.0.smithi170.stdout:2/359: mkdir d10/d1e/d32/d84 0 2024-01-25T15:03:35.874 INFO:tasks.workunit.client.0.smithi170.stdout:9/324: rename d5/df/d2e/f62 to d5/d1e/d21/d46/d6c/f71 0 2024-01-25T15:03:35.874 INFO:tasks.workunit.client.0.smithi170.stdout:5/283: rmdir d5/d10/d3f 39 2024-01-25T15:03:35.875 INFO:tasks.workunit.client.0.smithi170.stdout:0/310: dwrite d8/d10/d2d/d53/f60 [0,4194304] 0 2024-01-25T15:03:35.881 INFO:tasks.workunit.client.0.smithi170.stdout:6/345: write d2/d7/d23/d19/d2a/d43/d44/f66 [1062954,46888] 0 2024-01-25T15:03:35.881 INFO:tasks.workunit.client.0.smithi170.stdout:6/346: read d2/d7/d23/d19/f29 [398423,36322] 0 2024-01-25T15:03:35.881 INFO:tasks.workunit.client.0.smithi170.stdout:6/347: truncate d2/d7/d1b/f64 1459784 0 2024-01-25T15:03:35.881 INFO:tasks.workunit.client.0.smithi170.stdout:6/348: creat d2/f7b x:0 0 0 2024-01-25T15:03:35.881 INFO:tasks.workunit.client.0.smithi170.stdout:0/311: dread d8/d10/f2e [0,4194304] 0 2024-01-25T15:03:35.881 INFO:tasks.workunit.client.0.smithi170.stdout:3/354: creat d3/d3b/f70 x:0 0 0 2024-01-25T15:03:35.882 INFO:tasks.workunit.client.0.smithi170.stdout:0/312: truncate d8/d10/d2d/d58/f62 491825 0 2024-01-25T15:03:35.882 INFO:tasks.workunit.client.0.smithi170.stdout:1/311: rename d0/f2f to d0/d20/d28/d2a/d4a/d56/d5b/f68 0 2024-01-25T15:03:35.892 INFO:tasks.workunit.client.0.smithi170.stdout:4/295: dwrite d6/d7/d34/f30 [0,4194304] 0 2024-01-25T15:03:35.892 INFO:tasks.workunit.client.0.smithi170.stdout:0/313: mkdir d8/d10/d2d/d2f/d6a 0 2024-01-25T15:03:35.894 INFO:tasks.workunit.client.0.smithi170.stdout:4/296: rmdir d6/d28/d4f 0 2024-01-25T15:03:35.894 INFO:tasks.workunit.client.0.smithi170.stdout:9/325: link d5/df/d2e/f70 d5/df/d2e/d6b/f72 0 2024-01-25T15:03:35.895 INFO:tasks.workunit.client.0.smithi170.stdout:8/238: dwrite d3/d7/f2f [0,4194304] 0 2024-01-25T15:03:35.895 INFO:tasks.workunit.client.0.smithi170.stdout:8/239: write d3/d7/d1e/f44 [493396,114798] 0 2024-01-25T15:03:35.897 INFO:tasks.workunit.client.0.smithi170.stdout:0/314: symlink d8/d9/l6b 0 2024-01-25T15:03:35.899 INFO:tasks.workunit.client.0.smithi170.stdout:9/326: creat d5/df/d2e/d6b/f73 x:0 0 0 2024-01-25T15:03:35.900 INFO:tasks.workunit.client.0.smithi170.stdout:8/240: creat d3/d7/d22/d23/f54 x:0 0 0 2024-01-25T15:03:35.900 INFO:tasks.workunit.client.0.smithi170.stdout:8/241: write d3/d7/d1e/f45 [554275,99240] 0 2024-01-25T15:03:35.900 INFO:tasks.workunit.client.0.smithi170.stdout:4/297: rmdir d6/d7 39 2024-01-25T15:03:35.902 INFO:tasks.workunit.client.0.smithi170.stdout:7/362: unlink d8/d20/d3b/d4d/c70 0 2024-01-25T15:03:35.902 INFO:tasks.workunit.client.0.smithi170.stdout:0/315: creat d8/d10/d5a/f6c x:0 0 0 2024-01-25T15:03:35.904 INFO:tasks.workunit.client.0.smithi170.stdout:9/327: link d5/df/d16/d35/f5a d5/d1e/d21/d46/d18/d6a/f74 0 2024-01-25T15:03:35.904 INFO:tasks.workunit.client.0.smithi170.stdout:9/328: creat d5/df/d16/d35/f75 x:0 0 0 2024-01-25T15:03:35.905 INFO:tasks.workunit.client.0.smithi170.stdout:9/329: creat d5/d1e/d21/d46/f76 x:0 0 0 2024-01-25T15:03:35.905 INFO:tasks.workunit.client.0.smithi170.stdout:9/330: readlink d5/d1e/d21/d46/d18/l48 0 2024-01-25T15:03:35.907 INFO:tasks.workunit.client.0.smithi170.stdout:8/242: symlink d3/d7/d22/d23/d25/d34/l55 0 2024-01-25T15:03:35.908 INFO:tasks.workunit.client.0.smithi170.stdout:5/284: dwrite d5/d2a/f2b [0,4194304] 0 2024-01-25T15:03:35.908 INFO:tasks.workunit.client.0.smithi170.stdout:4/298: mknod d6/d37/c53 0 2024-01-25T15:03:35.910 INFO:tasks.workunit.client.0.smithi170.stdout:1/312: dwrite d0/d20/f4d [0,4194304] 0 2024-01-25T15:03:35.910 INFO:tasks.workunit.client.0.smithi170.stdout:8/243: creat d3/d7/f56 x:0 0 0 2024-01-25T15:03:35.910 INFO:tasks.workunit.client.0.smithi170.stdout:6/349: dwrite d2/d7/d1b/f64 [0,4194304] 0 2024-01-25T15:03:35.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.916+0000 7fe91802b640 1 -- 172.21.15.170:0/794424296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9100fefb0 msgr2=0x7fe9100ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:35.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.916+0000 7fe91802b640 1 --2- 172.21.15.170:0/794424296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9100fefb0 0x7fe9100ff3d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe908009ca0 tx=0x7fe90802c120 comp rx=0 tx=0).stop 2024-01-25T15:03:35.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.916+0000 7fe91802b640 1 -- 172.21.15.170:0/794424296 shutdown_connections 2024-01-25T15:03:35.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.916+0000 7fe91802b640 1 --2- 172.21.15.170:0/794424296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe910102940 0x7fe9101091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.916+0000 7fe91802b640 1 --2- 172.21.15.170:0/794424296 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe910101f80 0x7fe910102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.916+0000 7fe91802b640 1 --2- 172.21.15.170:0/794424296 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe9100fefb0 0x7fe9100ff3d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.916+0000 7fe91802b640 1 -- 172.21.15.170:0/794424296 >> 172.21.15.170:0/794424296 conn(0x7fe9100fa8e0 msgr2=0x7fe9100fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:35.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.917+0000 7fe91802b640 1 -- 172.21.15.170:0/794424296 shutdown_connections 2024-01-25T15:03:35.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.917+0000 7fe91802b640 1 -- 172.21.15.170:0/794424296 wait complete. 2024-01-25T15:03:35.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.917+0000 7fe91802b640 1 Processor -- start 2024-01-25T15:03:35.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.917+0000 7fe91802b640 1 -- start start 2024-01-25T15:03:35.919 INFO:tasks.workunit.client.0.smithi170.stdout:1/313: unlink d0/d20/d28/f38 0 2024-01-25T15:03:35.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.917+0000 7fe91802b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9100fefb0 0x7fe910196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.919 INFO:tasks.workunit.client.0.smithi170.stdout:1/314: fsync d0/d20/d3a/f53 0 2024-01-25T15:03:35.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.917+0000 7fe91802b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe910101f80 0x7fe910197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.917+0000 7fe91802b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe910102940 0x7fe91019e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.917+0000 7fe91802b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91019e900 con 0x7fe910101f80 2024-01-25T15:03:35.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.917+0000 7fe91802b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91019ea70 con 0x7fe9100fefb0 2024-01-25T15:03:35.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.917+0000 7fe91802b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91019ec30 con 0x7fe910102940 2024-01-25T15:03:35.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.917+0000 7fe9155c6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe910101f80 0x7fe910197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.917+0000 7fe9155c6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe910101f80 0x7fe910197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44796/0 (socket says 172.21.15.170:44796) 2024-01-25T15:03:35.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.917+0000 7fe9155c6640 1 -- 172.21.15.170:0/2921900263 learned_addr learned my addr 172.21.15.170:0/2921900263 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:35.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.917+0000 7fe915dc7640 1 --2- 172.21.15.170:0/2921900263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9100fefb0 0x7fe910196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.918+0000 7fe9165c8640 1 --2- 172.21.15.170:0/2921900263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe910102940 0x7fe91019e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.918+0000 7fe9155c6640 1 -- 172.21.15.170:0/2921900263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe910102940 msgr2=0x7fe91019e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:35.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.918+0000 7fe9155c6640 1 --2- 172.21.15.170:0/2921900263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe910102940 0x7fe91019e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.918+0000 7fe9155c6640 1 -- 172.21.15.170:0/2921900263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9100fefb0 msgr2=0x7fe910196e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:35.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.918+0000 7fe9155c6640 1 --2- 172.21.15.170:0/2921900263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9100fefb0 0x7fe910196e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.918+0000 7fe9155c6640 1 -- 172.21.15.170:0/2921900263 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe908009900 con 0x7fe910101f80 2024-01-25T15:03:35.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.918+0000 7fe9155c6640 1 --2- 172.21.15.170:0/2921900263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe910101f80 0x7fe910197350 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe90400b4a0 tx=0x7fe90400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:35.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.918+0000 7fe90effd640 1 -- 172.21.15.170:0/2921900263 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904010610 con 0x7fe910101f80 2024-01-25T15:03:35.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.918+0000 7fe91802b640 1 -- 172.21.15.170:0/2921900263 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91019ef10 con 0x7fe910101f80 2024-01-25T15:03:35.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.918+0000 7fe90effd640 1 -- 172.21.15.170:0/2921900263 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe904010c30 con 0x7fe910101f80 2024-01-25T15:03:35.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.918+0000 7fe90effd640 1 -- 172.21.15.170:0/2921900263 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904017dd0 con 0x7fe910101f80 2024-01-25T15:03:35.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.918+0000 7fe91802b640 1 -- 172.21.15.170:0/2921900263 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91019f410 con 0x7fe910101f80 2024-01-25T15:03:35.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.920+0000 7fe90effd640 1 -- 172.21.15.170:0/2921900263 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fe9040173f0 con 0x7fe910101f80 2024-01-25T15:03:35.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.920+0000 7fe90effd640 1 --2- 172.21.15.170:0/2921900263 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe8f80a12e0 0x7fe8f80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.921+0000 7fe91abed740 1 Processor -- start 2024-01-25T15:03:35.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.921+0000 7fe915dc7640 1 --2- 172.21.15.170:0/2921900263 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe8f80a12e0 0x7fe8f80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.921+0000 7fe90effd640 1 -- 172.21.15.170:0/2921900263 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fe9040cc1b0 con 0x7fe910101f80 2024-01-25T15:03:35.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.921+0000 7fe91abed740 1 -- start start 2024-01-25T15:03:35.924 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.921+0000 7fe91abed740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8080 0x5575e00b84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.921+0000 7fe91abed740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8a70 0x5575e00bd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.921+0000 7fe91abed740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 0x5575e00c0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.921+0000 7fe91abed740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575e008ec20 con 0x5575e00b8080 2024-01-25T15:03:35.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.921+0000 7fe91abed740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575e0026f80 con 0x5575e00bdbe0 2024-01-25T15:03:35.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.921+0000 7fe91abed740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575e0024670 con 0x5575e00b8a70 2024-01-25T15:03:35.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.921+0000 7fe915dc7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8080 0x5575e00b84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.921+0000 7fe9165c8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 0x5575e00c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.921+0000 7fe915dc7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8080 0x5575e00b84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44808/0 (socket says 172.21.15.170:44808) 2024-01-25T15:03:35.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.921+0000 7fe915dc7640 1 -- 172.21.15.170:0/1749587595 learned_addr learned my addr 172.21.15.170:0/1749587595 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:35.925 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.921+0000 7fe915dc7640 1 --2- 172.21.15.170:0/2921900263 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe8f80a12e0 0x7fe8f80a37a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe90802c730 tx=0x7fe908032690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:35.926 INFO:tasks.workunit.client.0.smithi170.stdout:3/355: dwrite d3/d1c/d2d/f35 [4194304,4194304] 0 2024-01-25T15:03:35.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.922+0000 7fe9165c8640 1 -- 172.21.15.170:0/1749587595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8a70 msgr2=0x5575e00bd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:35.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.922+0000 7fe9165c8640 1 --2- 172.21.15.170:0/1749587595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8a70 0x5575e00bd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.929 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.922+0000 7fe9165c8640 1 -- 172.21.15.170:0/1749587595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8080 msgr2=0x5575e00b84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:35.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.922+0000 7fe9165c8640 1 --2- 172.21.15.170:0/1749587595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8080 0x5575e00b84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.922+0000 7fe9165c8640 1 -- 172.21.15.170:0/1749587595 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575e0017d80 con 0x5575e00bdbe0 2024-01-25T15:03:35.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.922+0000 7fe9165c8640 1 --2- 172.21.15.170:0/1749587595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 0x5575e00c0070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe90000b6d0 tx=0x7fe90000bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55ff74329450988 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:35.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.922+0000 7fe8f7fff640 1 -- 172.21.15.170:0/1749587595 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90000d740 con 0x5575e00bdbe0 2024-01-25T15:03:35.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.922+0000 7fe8f7fff640 1 -- 172.21.15.170:0/1749587595 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe90000dd60 con 0x5575e00bdbe0 2024-01-25T15:03:35.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.922+0000 7fe8f7fff640 1 -- 172.21.15.170:0/1749587595 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900014e60 con 0x5575e00bdbe0 2024-01-25T15:03:35.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.923+0000 7fe91abed740 1 -- 172.21.15.170:0/1749587595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 msgr2=0x5575e00c0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:35.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.923+0000 7fe91abed740 1 --2- 172.21.15.170:0/1749587595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 0x5575e00c0070 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe90000b6d0 tx=0x7fe90000bb90 comp rx=0 tx=0).stop 2024-01-25T15:03:35.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.923+0000 7fe91abed740 1 -- 172.21.15.170:0/1749587595 shutdown_connections 2024-01-25T15:03:35.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.923+0000 7fe91abed740 1 --2- 172.21.15.170:0/1749587595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 0x5575e00c0070 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.923+0000 7fe91abed740 1 --2- 172.21.15.170:0/1749587595 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8a70 0x5575e00bd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.923+0000 7fe91abed740 1 --2- 172.21.15.170:0/1749587595 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8080 0x5575e00b84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.930 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.923+0000 7fe91abed740 1 -- 172.21.15.170:0/1749587595 >> 172.21.15.170:0/1749587595 conn(0x5575e00b35f0 msgr2=0x5575e00b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:35.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.923+0000 7fe91abed740 1 -- 172.21.15.170:0/1749587595 shutdown_connections 2024-01-25T15:03:35.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.923+0000 7fe91abed740 1 -- 172.21.15.170:0/1749587595 wait complete. 2024-01-25T15:03:35.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.923+0000 7fe91abed740 1 -- start start 2024-01-25T15:03:35.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.923+0000 7fe91abed740 1 Processor -- start 2024-01-25T15:03:35.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.923+0000 7fe91abed740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8080 0x5575e00c21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.923+0000 7fe91abed740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8a70 0x5575e00c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.923+0000 7fe91abed740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 0x5575e00c9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe91abed740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575e001ff60 con 0x5575e00b8a70 2024-01-25T15:03:35.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe91abed740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575dffd90f0 con 0x5575e00bdbe0 2024-01-25T15:03:35.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe91abed740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575dffd8d90 con 0x5575e00b8080 2024-01-25T15:03:35.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe91abed740 10 client.0 _ll_register_callbacks cb 0x5575dffbeff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:35.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe9155c6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8a70 0x5575e00c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe9155c6640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8a70 0x5575e00c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44814/0 (socket says 172.21.15.170:44814) 2024-01-25T15:03:35.931 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe9155c6640 1 -- 172.21.15.170:0/4069001280 learned_addr learned my addr 172.21.15.170:0/4069001280 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:35.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe9165c8640 1 --2- 172.21.15.170:0/4069001280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 0x5575e00c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe915dc7640 1 --2- 172.21.15.170:0/4069001280 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8080 0x5575e00c21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe9155c6640 1 -- 172.21.15.170:0/4069001280 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8080 msgr2=0x5575e00c21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:35.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe9155c6640 1 --2- 172.21.15.170:0/4069001280 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8080 0x5575e00c21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe9155c6640 1 -- 172.21.15.170:0/4069001280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 msgr2=0x5575e00c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:35.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe9155c6640 1 --2- 172.21.15.170:0/4069001280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 0x5575e00c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe9155c6640 1 -- 172.21.15.170:0/4069001280 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90000e040 con 0x5575e00b8a70 2024-01-25T15:03:35.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe9155c6640 1 --2- 172.21.15.170:0/4069001280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8a70 0x5575e00c26e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe9040ca050 tx=0x7fe904099ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a36f0c7b11954f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:35.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe8f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:35.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe8f57fa640 1 -- 172.21.15.170:0/4069001280 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9040a16b0 con 0x5575e00b8a70 2024-01-25T15:03:35.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe8f57fa640 1 -- 172.21.15.170:0/4069001280 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fe9040976c0 con 0x5575e00b8a70 2024-01-25T15:03:35.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe91abed740 1 -- 172.21.15.170:0/4069001280 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575e0018f50 con 0x5575e00b8a70 2024-01-25T15:03:35.932 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe8f57fa640 1 -- 172.21.15.170:0/4069001280 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe90409d170 con 0x5575e00b8a70 2024-01-25T15:03:35.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe91abed740 10 client.16029 fetch_fsmap learned FSMap version 30 2024-01-25T15:03:35.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.924+0000 7fe91abed740 1 -- 172.21.15.170:0/4069001280 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5575e001e5e0 con 0x5575e00b8a70 2024-01-25T15:03:35.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.925+0000 7fe8f57fa640 1 -- 172.21.15.170:0/4069001280 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5575e0018f50 con 0x5575e00b8a70 2024-01-25T15:03:35.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.925+0000 7fe8f57fa640 1 -- 172.21.15.170:0/4069001280 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe90407a070 con 0x5575e00b8a70 2024-01-25T15:03:35.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.925+0000 7fe91abed740 10 client.16029 fetch_fsmap finished waiting for FSMap version 30 2024-01-25T15:03:35.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.925+0000 7fe91abed740 10 client.16029 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:35.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.925+0000 7fe91abed740 20 client.16029 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:35.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.925+0000 7fe91abed740 1 --2- 172.21.15.170:0/4069001280 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5575e00ce4c0 0x5575e00d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.925+0000 7fe91abed740 4 client.16029 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:35.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.925+0000 7fe91abed740 1 -- 172.21.15.170:0/4069001280 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575e0018c70 con 0x5575e00ce4c0 2024-01-25T15:03:35.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.925+0000 7fe915dc7640 1 --2- 172.21.15.170:0/4069001280 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5575e00ce4c0 0x5575e00d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.925+0000 7fe8f57fa640 10 client.16029 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:35.933 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.925+0000 7fe915dc7640 1 --2- 172.21.15.170:0/4069001280 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5575e00ce4c0 0x5575e00d08e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd993c7958410b01 server_cookie=3065fd1eae027b42 in_seq=0 out_seq=0 2024-01-25T15:03:35.934 INFO:tasks.workunit.client.0.smithi170.stdout:6/350: unlink d2/d7/d23/d19/l4e 0 2024-01-25T15:03:35.934 INFO:tasks.workunit.client.0.smithi170.stdout:6/351: write d2/f4 [4920648,36239] 0 2024-01-25T15:03:35.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.927+0000 7fe8f57fa640 1 -- 172.21.15.170:0/4069001280 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5575e0018c70 con 0x5575e00ce4c0 2024-01-25T15:03:35.934 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.927+0000 7fe8f57fa640 10 client.16029 handle_command_reply: tid=0 2024-01-25T15:03:35.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.927+0000 7fe91abed740 1 client.16029 shutdown 2024-01-25T15:03:35.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.927+0000 7fe91abed740 1 -- 172.21.15.170:0/4069001280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8a70 msgr2=0x5575e00c26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:35.935 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.927+0000 7fe91abed740 1 --2- 172.21.15.170:0/4069001280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8a70 0x5575e00c26e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe9040ca050 tx=0x7fe904099ae0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.935 INFO:tasks.workunit.client.0.smithi170.stdout:5/285: mknod d5/c66 0 2024-01-25T15:03:35.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.927+0000 7fe91abed740 1 -- 172.21.15.170:0/4069001280 shutdown_connections 2024-01-25T15:03:35.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.927+0000 7fe91abed740 1 --2- 172.21.15.170:0/4069001280 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5575e00ce4c0 0x5575e00d08e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.927+0000 7fe91abed740 1 --2- 172.21.15.170:0/4069001280 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 0x5575e00c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.927+0000 7fe91abed740 1 --2- 172.21.15.170:0/4069001280 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8a70 0x5575e00c26e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.927+0000 7fe91abed740 1 --2- 172.21.15.170:0/4069001280 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8080 0x5575e00c21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.927+0000 7fe8f57fa640 0 client.16029 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:35.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.927+0000 7fe91abed740 1 -- 172.21.15.170:0/4069001280 >> 172.21.15.170:0/4069001280 conn(0x5575e00b35f0 msgr2=0x5575e00b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:35.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.927+0000 7fe91abed740 1 -- 172.21.15.170:0/4069001280 shutdown_connections 2024-01-25T15:03:35.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.927+0000 7fe91abed740 1 -- 172.21.15.170:0/4069001280 wait complete. 2024-01-25T15:03:35.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.927+0000 7fe91abed740 20 client.16029 trim_cache size 0 max 16384 2024-01-25T15:03:35.937 INFO:tasks.workunit.client.0.smithi170.stdout:7/363: dwrite d8/d20/d3b/d4d/f78 [0,4194304] 0 2024-01-25T15:03:35.937 INFO:tasks.workunit.client.0.smithi170.stdout:7/364: stat d8/d20/d2a/f87 0 2024-01-25T15:03:35.937 INFO:tasks.workunit.client.0.smithi170.stdout:3/356: mknod d3/d10/c71 0 2024-01-25T15:03:35.937 INFO:tasks.workunit.client.0.smithi170.stdout:3/357: fsync d3/d1c/f24 0 2024-01-25T15:03:35.937 INFO:tasks.workunit.client.0.smithi170.stdout:3/358: truncate d3/d10/d13/f34 826157 0 2024-01-25T15:03:35.938 INFO:tasks.workunit.client.0.smithi170.stdout:3/359: truncate d3/d10/d1e/f20 1515949 0 2024-01-25T15:03:35.938 INFO:tasks.workunit.client.0.smithi170.stdout:4/299: getdents d6/d28 0 2024-01-25T15:03:35.938 INFO:tasks.workunit.client.0.smithi170.stdout:8/244: symlink d3/d7/l57 0 2024-01-25T15:03:35.938 INFO:tasks.workunit.client.0.smithi170.stdout:7/365: creat d8/f90 x:0 0 0 2024-01-25T15:03:35.939 INFO:tasks.workunit.client.0.smithi170.stdout:6/352: getdents d2/d7/d23/d19/d2a/d43 0 2024-01-25T15:03:35.939 INFO:tasks.workunit.client.0.smithi170.stdout:6/353: write d2/d7/d23/d19/d2f/d37/f3f [764083,85322] 0 2024-01-25T15:03:35.940 INFO:tasks.workunit.client.0.smithi170.stdout:7/366: symlink d8/d20/d45/d8e/l91 0 2024-01-25T15:03:35.945 INFO:tasks.workunit.client.0.smithi170.stdout:6/354: unlink d2/d7/d23/l12 0 2024-01-25T15:03:35.945 INFO:tasks.workunit.client.0.smithi170.stdout:7/367: creat d8/f92 x:0 0 0 2024-01-25T15:03:35.948 INFO:tasks.workunit.client.0.smithi170.stdout:5/286: dwrite d5/f13 [0,4194304] 0 2024-01-25T15:03:35.950 INFO:tasks.workunit.client.0.smithi170.stdout:5/287: mknod d5/d10/d2c/d45/c67 0 2024-01-25T15:03:35.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.950+0000 7fe91abed740 1 Processor -- start 2024-01-25T15:03:35.951 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.950+0000 7fe91abed740 1 -- start start 2024-01-25T15:03:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.950+0000 7fe91abed740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8080 0x5575e00b9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.950+0000 7fe91abed740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00b8a70 0x5575e00c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.950+0000 7fe91abed740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00bdbe0 0x5575e00ba430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.951+0000 7fe91abed740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575dff9de60 con 0x5575e00bdbe0 2024-01-25T15:03:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.951+0000 7fe91abed740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575e00b9160 con 0x5575e00b8a70 2024-01-25T15:03:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.951+0000 7fe91abed740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575e00c0530 con 0x5575e00b8080 2024-01-25T15:03:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.951+0000 7fe9165c8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00bdbe0 0x5575e00ba430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.951+0000 7fe9165c8640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00bdbe0 0x5575e00ba430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44816/0 (socket says 172.21.15.170:44816) 2024-01-25T15:03:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.951+0000 7fe9165c8640 1 -- 172.21.15.170:0/4074131584 learned_addr learned my addr 172.21.15.170:0/4074131584 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.951+0000 7fe9155c6640 1 --2- 172.21.15.170:0/4074131584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00b8a70 0x5575e00c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.951+0000 7fe9165c8640 1 -- 172.21.15.170:0/4074131584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8080 msgr2=0x5575e00b9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.951+0000 7fe9165c8640 1 --2- 172.21.15.170:0/4074131584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8080 0x5575e00b9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.953 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.951+0000 7fe9165c8640 1 -- 172.21.15.170:0/4074131584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00b8a70 msgr2=0x5575e00c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:35.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.951+0000 7fe9165c8640 1 --2- 172.21.15.170:0/4074131584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00b8a70 0x5575e00c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.954 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.951+0000 7fe9165c8640 1 -- 172.21.15.170:0/4074131584 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575dffbad80 con 0x5575e00bdbe0 2024-01-25T15:03:35.954 INFO:tasks.workunit.client.0.smithi170.stdout:5/288: mknod d5/d10/d2c/d45/d56/c68 0 2024-01-25T15:03:35.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.951+0000 7fe9165c8640 1 --2- 172.21.15.170:0/4074131584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00bdbe0 0x5575e00ba430 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe90000b5f0 tx=0x7fe90000b270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d927939c05fcee54 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:35.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.952+0000 7fe8f77fe640 1 -- 172.21.15.170:0/4074131584 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90000da10 con 0x5575e00bdbe0 2024-01-25T15:03:35.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.952+0000 7fe8f77fe640 1 -- 172.21.15.170:0/4074131584 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe90000db70 con 0x5575e00bdbe0 2024-01-25T15:03:35.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.952+0000 7fe8f77fe640 1 -- 172.21.15.170:0/4074131584 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90001d790 con 0x5575e00bdbe0 2024-01-25T15:03:35.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.953+0000 7fe91abed740 1 -- 172.21.15.170:0/4074131584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00bdbe0 msgr2=0x5575e00ba430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:35.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.953+0000 7fe91abed740 1 --2- 172.21.15.170:0/4074131584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00bdbe0 0x5575e00ba430 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe90000b5f0 tx=0x7fe90000b270 comp rx=0 tx=0).stop 2024-01-25T15:03:35.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.953+0000 7fe91abed740 1 -- 172.21.15.170:0/4074131584 shutdown_connections 2024-01-25T15:03:35.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.953+0000 7fe91abed740 1 --2- 172.21.15.170:0/4074131584 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00b8a70 0x5575e00c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.953+0000 7fe91abed740 1 --2- 172.21.15.170:0/4074131584 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00bdbe0 0x5575e00ba430 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.955 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.953+0000 7fe91abed740 1 --2- 172.21.15.170:0/4074131584 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8080 0x5575e00b9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.956 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.953+0000 7fe91abed740 1 -- 172.21.15.170:0/4074131584 >> 172.21.15.170:0/4074131584 conn(0x5575e00b35f0 msgr2=0x5575e00d5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:35.956 INFO:tasks.workunit.client.0.smithi170.stdout:5/289: mkdir d5/d10/d2c/d34/d69 0 2024-01-25T15:03:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.953+0000 7fe91abed740 1 -- 172.21.15.170:0/4074131584 shutdown_connections 2024-01-25T15:03:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.953+0000 7fe91abed740 1 -- 172.21.15.170:0/4074131584 wait complete. 2024-01-25T15:03:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.953+0000 7fe91abed740 1 -- start start 2024-01-25T15:03:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.954+0000 7fe91abed740 1 Processor -- start 2024-01-25T15:03:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.954+0000 7fe91abed740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8080 0x5575e00c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.954+0000 7fe91abed740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8a70 0x5575e00c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.954+0000 7fe91abed740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 0x5575e00c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.954+0000 7fe91abed740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575e00c9ac0 con 0x5575e00b8080 2024-01-25T15:03:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.954+0000 7fe91abed740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575e0124970 con 0x5575e00bdbe0 2024-01-25T15:03:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.954+0000 7fe91abed740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575e0124ae0 con 0x5575e00b8a70 2024-01-25T15:03:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.954+0000 7fe915dc7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8080 0x5575e00c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.958 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.954+0000 7fe91abed740 10 client.0 _ll_register_callbacks cb 0x7fe90000b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.954+0000 7fe915dc7640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8080 0x5575e00c7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44826/0 (socket says 172.21.15.170:44826) 2024-01-25T15:03:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.954+0000 7fe915dc7640 1 -- 172.21.15.170:0/960535370 learned_addr learned my addr 172.21.15.170:0/960535370 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.955+0000 7fe915dc7640 1 -- 172.21.15.170:0/960535370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8a70 msgr2=0x5575e00c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.955+0000 7fe9155c6640 1 --2- 172.21.15.170:0/960535370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8a70 0x5575e00c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.955+0000 7fe9165c8640 1 --2- 172.21.15.170:0/960535370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 0x5575e00c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.955+0000 7fe915dc7640 1 --2- 172.21.15.170:0/960535370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8a70 0x5575e00c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.955+0000 7fe915dc7640 1 -- 172.21.15.170:0/960535370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 msgr2=0x5575e00c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.955+0000 7fe915dc7640 1 --2- 172.21.15.170:0/960535370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 0x5575e00c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.955+0000 7fe915dc7640 1 -- 172.21.15.170:0/960535370 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575e0017d80 con 0x5575e00b8080 2024-01-25T15:03:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.955+0000 7fe9165c8640 1 --2- 172.21.15.170:0/960535370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 0x5575e00c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:03:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.955+0000 7fe9155c6640 1 --2- 172.21.15.170:0/960535370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8a70 0x5575e00c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:03:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.955+0000 7fe915dc7640 1 --2- 172.21.15.170:0/960535370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8080 0x5575e00c7e70 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe908005e30 tx=0x7fe90802c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3683a6a3219560 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.955+0000 7fe8f57fa640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:35.959 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.955+0000 7fe8f57fa640 1 -- 172.21.15.170:0/960535370 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908050040 con 0x5575e00b8080 2024-01-25T15:03:35.960 INFO:tasks.workunit.client.0.smithi170.stdout:2/360: rename d10/d16/d42/l5d to d10/d1e/d32/d3e/d41/l85 0 2024-01-25T15:03:35.960 INFO:tasks.workunit.client.0.smithi170.stdout:2/361: dread - d10/d1b/d5f/f7d zero size 2024-01-25T15:03:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.955+0000 7fe8f57fa640 1 -- 172.21.15.170:0/960535370 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fe908034640 con 0x5575e00b8080 2024-01-25T15:03:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.955+0000 7fe91abed740 1 -- 172.21.15.170:0/960535370 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe90000dd60 con 0x5575e00b8080 2024-01-25T15:03:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.956+0000 7fe8f57fa640 1 -- 172.21.15.170:0/960535370 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe908054a90 con 0x5575e00b8080 2024-01-25T15:03:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.956+0000 7fe91abed740 10 client.16035 fetch_fsmap learned FSMap version 30 2024-01-25T15:03:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.956+0000 7fe91abed740 1 -- 172.21.15.170:0/960535370 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5575dffe0990 con 0x5575e00b8080 2024-01-25T15:03:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.956+0000 7fe8f57fa640 1 -- 172.21.15.170:0/960535370 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe908064020 con 0x5575e00b8080 2024-01-25T15:03:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.956+0000 7fe8f57fa640 1 -- 172.21.15.170:0/960535370 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7918+0+0 (secure 0 0 0) 0x7fe908053030 con 0x5575e00b8080 2024-01-25T15:03:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.956+0000 7fe91abed740 10 client.16035 fetch_fsmap finished waiting for FSMap version 30 2024-01-25T15:03:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.956+0000 7fe91abed740 10 client.16035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.956+0000 7fe91abed740 20 client.16035 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.956+0000 7fe91abed740 1 --2- 172.21.15.170:0/960535370 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5575e0126750 0x5575e0128b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.956+0000 7fe91abed740 4 client.16035 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-01-25T15:03:35.962 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.956+0000 7fe91abed740 1 -- 172.21.15.170:0/960535370 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5575dfd1f860 con 0x5575e0126750 2024-01-25T15:03:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.957+0000 7fe9155c6640 1 --2- 172.21.15.170:0/960535370 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5575e0126750 0x5575e0128b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.958+0000 7fe9155c6640 1 --2- 172.21.15.170:0/960535370 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5575e0126750 0x5575e0128b70 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46ea7c2e7d550048 server_cookie=329b2ab507b5ae87 in_seq=0 out_seq=0 2024-01-25T15:03:35.963 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.958+0000 7fe8f57fa640 10 client.16035 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:35.963 INFO:tasks.workunit.client.0.smithi170.stdout:3/360: dwrite d3/d10/ff [4194304,4194304] 0 2024-01-25T15:03:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.959+0000 7fe8f57fa640 1 -- 172.21.15.170:0/960535370 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5575dfd1f860 con 0x5575e0126750 2024-01-25T15:03:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.959+0000 7fe8f57fa640 10 client.16035 handle_command_reply: tid=0 2024-01-25T15:03:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.959+0000 7fe91abed740 1 client.16035 shutdown 2024-01-25T15:03:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.959+0000 7fe91abed740 1 -- 172.21.15.170:0/960535370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8080 msgr2=0x5575e00c7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.959+0000 7fe91abed740 1 --2- 172.21.15.170:0/960535370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8080 0x5575e00c7e70 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe908005e30 tx=0x7fe90802c120 comp rx=0 tx=0).stop 2024-01-25T15:03:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.959+0000 7fe91abed740 1 -- 172.21.15.170:0/960535370 shutdown_connections 2024-01-25T15:03:35.964 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.959+0000 7fe91abed740 1 --2- 172.21.15.170:0/960535370 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x5575e0126750 0x5575e0128b70 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.959+0000 7fe91abed740 1 --2- 172.21.15.170:0/960535370 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5575e00bdbe0 0x5575e00c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.959+0000 7fe91abed740 1 --2- 172.21.15.170:0/960535370 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5575e00b8a70 0x5575e00c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.959+0000 7fe8f57fa640 0 client.16035 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.959+0000 7fe91abed740 1 --2- 172.21.15.170:0/960535370 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5575e00b8080 0x5575e00c7e70 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.959+0000 7fe91abed740 1 -- 172.21.15.170:0/960535370 >> 172.21.15.170:0/960535370 conn(0x5575e00b35f0 msgr2=0x5575e00b9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.959+0000 7fe91abed740 1 -- 172.21.15.170:0/960535370 shutdown_connections 2024-01-25T15:03:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.959+0000 7fe91abed740 1 -- 172.21.15.170:0/960535370 wait complete. 2024-01-25T15:03:35.965 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.959+0000 7fe91abed740 20 client.16035 trim_cache size 0 max 16384 2024-01-25T15:03:35.965 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:03:35.965 INFO:teuthology.orchestra.run.smithi170.stdout: "return_code": 0, 2024-01-25T15:03:35.966 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_tag": "fc060387-7435-4063-bfa0-4016cd451e68", 2024-01-25T15:03:35.966 INFO:teuthology.orchestra.run.smithi170.stdout: "mode": "asynchronous" 2024-01-25T15:03:35.966 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:03:35.966 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.960+0000 7fe91802b640 1 -- 172.21.15.170:0/2921900263 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe8f80a12e0 msgr2=0x7fe8f80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:35.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.960+0000 7fe91802b640 1 --2- 172.21.15.170:0/2921900263 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe8f80a12e0 0x7fe8f80a37a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe90802c730 tx=0x7fe908032690 comp rx=0 tx=0).stop 2024-01-25T15:03:35.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.960+0000 7fe91802b640 1 -- 172.21.15.170:0/2921900263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe910101f80 msgr2=0x7fe910197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:35.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.960+0000 7fe91802b640 1 --2- 172.21.15.170:0/2921900263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe910101f80 0x7fe910197350 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe90400b4a0 tx=0x7fe90400b960 comp rx=0 tx=0).stop 2024-01-25T15:03:35.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.960+0000 7fe91802b640 1 -- 172.21.15.170:0/2921900263 shutdown_connections 2024-01-25T15:03:35.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.960+0000 7fe91802b640 1 --2- 172.21.15.170:0/2921900263 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe8f80a12e0 0x7fe8f80a37a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.960+0000 7fe91802b640 1 --2- 172.21.15.170:0/2921900263 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe910102940 0x7fe91019e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.960+0000 7fe91802b640 1 --2- 172.21.15.170:0/2921900263 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe910101f80 0x7fe910197350 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.960+0000 7fe91802b640 1 --2- 172.21.15.170:0/2921900263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9100fefb0 0x7fe910196e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:35.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.960+0000 7fe91802b640 1 -- 172.21.15.170:0/2921900263 >> 172.21.15.170:0/2921900263 conn(0x7fe9100fa8e0 msgr2=0x7fe9101053c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:35.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.960+0000 7fe91802b640 1 -- 172.21.15.170:0/2921900263 shutdown_connections 2024-01-25T15:03:35.967 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:35.960+0000 7fe91802b640 1 -- 172.21.15.170:0/2921900263 wait complete. 2024-01-25T15:03:35.968 INFO:tasks.workunit.client.0.smithi170.stdout:3/361: getdents d3/d10/d13/d5b 0 2024-01-25T15:03:35.968 INFO:tasks.workunit.client.0.smithi170.stdout:3/362: readlink d3/d1c/d2d/l51 0 2024-01-25T15:03:35.968 INFO:tasks.workunit.client.0.smithi170.stdout:8/245: dwrite d3/d7/d22/d23/d48/d52/d47/f4c [0,4194304] 0 2024-01-25T15:03:35.968 INFO:tasks.workunit.client.0.smithi170.stdout:4/300: dwrite d6/d7/f14 [0,4194304] 0 2024-01-25T15:03:35.969 INFO:tasks.workunit.client.0.smithi170.stdout:8/246: chown d3/d7/l8 25 1 2024-01-25T15:03:35.970 INFO:tasks.workunit.client.0.smithi170.stdout:3/363: truncate d3/d10/ff 4406702 0 2024-01-25T15:03:35.971 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-25T15:03:35.973 INFO:tasks.workunit.client.0.smithi170.stdout:3/364: mkdir d3/d10/d13/d1b/d29/d38/d42/d72 0 2024-01-25T15:03:35.973 INFO:tasks.workunit.client.0.smithi170.stdout:3/365: write d3/d10/d13/f1d [1157060,20813] 0 2024-01-25T15:03:35.975 INFO:tasks.workunit.client.0.smithi170.stdout:8/247: mknod d3/d7/d22/c58 0 2024-01-25T15:03:35.975 INFO:tasks.workunit.client.0.smithi170.stdout:3/366: symlink d3/d10/d1e/l73 0 2024-01-25T15:03:35.980 INFO:tasks.workunit.client.0.smithi170.stdout:8/248: truncate d3/d7/d1e/f45 526520 0 2024-01-25T15:03:35.982 INFO:tasks.workunit.client.0.smithi170.stdout:8/249: chown d3/d7/c1a 73734261 1 2024-01-25T15:03:35.991 INFO:tasks.workunit.client.0.smithi170.stdout:8/250: rmdir d3/d7/d22/d23/d25/d34 39 2024-01-25T15:03:35.995 INFO:tasks.workunit.client.0.smithi170.stdout:8/251: symlink d3/d7/d22/d23/d48/d52/d47/l59 0 2024-01-25T15:03:35.998 INFO:tasks.workunit.client.0.smithi170.stdout:8/252: dread d3/fd [0,4194304] 0 2024-01-25T15:03:35.998 INFO:tasks.workunit.client.0.smithi170.stdout:8/253: chown d3/d7/d1e/l31 5 1 2024-01-25T15:03:35.998 INFO:tasks.workunit.client.0.smithi170.stdout:3/367: dwrite d3/d10/d1e/f20 [0,4194304] 0 2024-01-25T15:03:35.998 INFO:tasks.workunit.client.0.smithi170.stdout:3/368: readlink d3/d1c/l55 0 2024-01-25T15:03:36.004 INFO:tasks.workunit.client.0.smithi170.stdout:2/362: rename d10/f13 to d10/d1e/d32/d3e/d5c/f86 0 2024-01-25T15:03:36.004 INFO:tasks.workunit.client.0.smithi170.stdout:2/363: fdatasync d10/d1e/d5e/f61 0 2024-01-25T15:03:36.011 INFO:tasks.workunit.client.0.smithi170.stdout:4/301: rmdir d6/d37 39 2024-01-25T15:03:36.014 INFO:tasks.workunit.client.0.smithi170.stdout:2/364: mkdir d10/d16/d42/d87 0 2024-01-25T15:03:36.017 INFO:tasks.workunit.client.0.smithi170.stdout:8/254: dwrite d3/d7/f10 [4194304,4194304] 0 2024-01-25T15:03:36.019 INFO:tasks.workunit.client.0.smithi170.stdout:8/255: dread d3/d7/d22/d23/d25/f3c [0,4194304] 0 2024-01-25T15:03:36.038 INFO:tasks.workunit.client.0.smithi170.stdout:8/256: creat d3/d7/d22/f5a x:0 0 0 2024-01-25T15:03:36.039 INFO:tasks.workunit.client.0.smithi170.stdout:9/331: rename d5/d1e to d5/df/d2e/d77 0 2024-01-25T15:03:36.043 INFO:tasks.workunit.client.0.smithi170.stdout:1/315: rename d0/d1b/l22 to d0/d20/d28/d2a/d4a/d56/l69 0 2024-01-25T15:03:36.043 INFO:tasks.workunit.client.0.smithi170.stdout:1/316: read - d0/d20/f26 zero size 2024-01-25T15:03:36.043 INFO:tasks.workunit.client.0.smithi170.stdout:1/317: creat d0/d20/d28/f6a x:0 0 0 2024-01-25T15:03:36.044 INFO:tasks.workunit.client.0.smithi170.stdout:1/318: chown d0/l24 73222654 1 2024-01-25T15:03:36.044 INFO:tasks.workunit.client.0.smithi170.stdout:1/319: chown d0/d20/d28/d2a/d4a/d56/d5b 1986388839 1 2024-01-25T15:03:36.054 INFO:tasks.workunit.client.0.smithi170.stdout:0/316: sync 2024-01-25T15:03:36.055 INFO:tasks.workunit.client.0.smithi170.stdout:2/365: write d10/d1e/f20 [3504742,94169] 0 2024-01-25T15:03:36.055 INFO:tasks.workunit.client.0.smithi170.stdout:1/320: write d0/fb [193780,48375] 0 2024-01-25T15:03:36.057 INFO:tasks.workunit.client.0.smithi170.stdout:1/321: mknod d0/d20/d28/d2a/c6b 0 2024-01-25T15:03:36.063 INFO:tasks.workunit.client.0.smithi170.stdout:8/257: dwrite d3/d7/f2f [0,4194304] 0 2024-01-25T15:03:36.064 INFO:tasks.workunit.client.0.smithi170.stdout:9/332: dwrite d5/df/f3b [0,4194304] 0 2024-01-25T15:03:36.065 INFO:tasks.workunit.client.0.smithi170.stdout:1/322: fdatasync d0/fb 0 2024-01-25T15:03:36.065 INFO:tasks.workunit.client.0.smithi170.stdout:1/323: creat d0/d20/d28/f6c x:0 0 0 2024-01-25T15:03:36.067 INFO:tasks.workunit.client.0.smithi170.stdout:0/317: dread d8/d9/fe [0,4194304] 0 2024-01-25T15:03:36.067 INFO:tasks.workunit.client.0.smithi170.stdout:0/318: truncate d8/d3e/f61 1326632 0 2024-01-25T15:03:36.069 INFO:tasks.workunit.client.0.smithi170.stdout:1/324: creat d0/f6d x:0 0 0 2024-01-25T15:03:36.070 INFO:tasks.workunit.client.0.smithi170.stdout:1/325: dread - d0/d20/f26 zero size 2024-01-25T15:03:36.072 INFO:tasks.workunit.client.0.smithi170.stdout:1/326: mkdir d0/d20/d3a/d6e 0 2024-01-25T15:03:36.075 INFO:tasks.workunit.client.0.smithi170.stdout:1/327: symlink d0/d20/d3a/d60/l6f 0 2024-01-25T15:03:36.075 INFO:tasks.workunit.client.0.smithi170.stdout:1/328: creat d0/d20/d28/f70 x:0 0 0 2024-01-25T15:03:36.077 INFO:tasks.workunit.client.0.smithi170.stdout:8/258: write d3/d7/d22/d23/d48/d52/d47/f4c [3132325,84277] 0 2024-01-25T15:03:36.077 INFO:tasks.workunit.client.0.smithi170.stdout:1/329: mknod d0/d20/d28/d2a/d4a/c71 0 2024-01-25T15:03:36.079 INFO:tasks.workunit.client.0.smithi170.stdout:9/333: truncate d5/df/f3b 3214651 0 2024-01-25T15:03:36.084 INFO:tasks.workunit.client.0.smithi170.stdout:7/368: rename d8/d20/d2a/d35/f32 to d8/d20/d2a/d35/d55/d6e/f93 0 2024-01-25T15:03:36.084 INFO:tasks.workunit.client.0.smithi170.stdout:1/330: mkdir d0/d20/d28/d2a/d4a/d56/d5b/d72 0 2024-01-25T15:03:36.084 INFO:tasks.workunit.client.0.smithi170.stdout:7/369: symlink d8/d20/d45/d68/d71/d8c/l94 0 2024-01-25T15:03:36.084 INFO:tasks.workunit.client.0.smithi170.stdout:7/370: dread - d8/f90 zero size 2024-01-25T15:03:36.088 INFO:tasks.workunit.client.0.smithi170.stdout:5/290: rename d5/d10/d2c/d34/f4e to d5/d10/d2c/d51/d3d/d57/f6a 0 2024-01-25T15:03:36.090 INFO:tasks.workunit.client.0.smithi170.stdout:2/366: dwrite d10/d1e/d5e/f61 [4194304,4194304] 0 2024-01-25T15:03:36.090 INFO:tasks.workunit.client.0.smithi170.stdout:2/367: readlink d10/d16/d42/l6d 0 2024-01-25T15:03:36.091 INFO:tasks.workunit.client.0.smithi170.stdout:1/331: mknod d0/c73 0 2024-01-25T15:03:36.091 INFO:tasks.workunit.client.0.smithi170.stdout:1/332: chown d0/d20/d3a/f44 108 1 2024-01-25T15:03:36.091 INFO:tasks.workunit.client.0.smithi170.stdout:1/333: chown d0/d50 288054129 1 2024-01-25T15:03:36.091 INFO:tasks.workunit.client.0.smithi170.stdout:1/334: read d0/f46 [49787,87554] 0 2024-01-25T15:03:36.093 INFO:tasks.workunit.client.0.smithi170.stdout:7/371: truncate d8/d20/d45/d68/f7c 2540739 0 2024-01-25T15:03:36.106 INFO:tasks.workunit.client.0.smithi170.stdout:3/369: rename d3/d10/d13/d5b to d3/d10/d6d/d74 0 2024-01-25T15:03:36.106 INFO:tasks.workunit.client.0.smithi170.stdout:5/291: mkdir d5/d10/d2c/d51/d6b 0 2024-01-25T15:03:36.108 INFO:tasks.workunit.client.0.smithi170.stdout:1/335: unlink d0/d20/d28/d2a/c48 0 2024-01-25T15:03:36.109 INFO:tasks.workunit.client.0.smithi170.stdout:1/336: symlink d0/d20/d28/d2a/d4a/d56/d5b/d72/l74 0 2024-01-25T15:03:36.112 INFO:tasks.workunit.client.0.smithi170.stdout:0/319: dwrite d8/d10/d5a/f6c [0,4194304] 0 2024-01-25T15:03:36.113 INFO:tasks.workunit.client.0.smithi170.stdout:0/320: dread d8/d10/f2e [0,4194304] 0 2024-01-25T15:03:36.114 INFO:tasks.workunit.client.0.smithi170.stdout:2/368: write d10/d1e/f2e [1871537,104014] 0 2024-01-25T15:03:36.114 INFO:tasks.workunit.client.0.smithi170.stdout:9/334: dwrite d5/df/d2e/d77/d21/d46/d18/f23 [0,4194304] 0 2024-01-25T15:03:36.116 INFO:tasks.workunit.client.0.smithi170.stdout:8/259: dwrite d3/d7/d22/d23/d48/d52/f35 [0,4194304] 0 2024-01-25T15:03:36.116 INFO:tasks.workunit.client.0.smithi170.stdout:8/260: fsync d3/d7/f2a 0 2024-01-25T15:03:36.119 INFO:tasks.workunit.client.0.smithi170.stdout:2/369: creat d10/d16/d42/f88 x:0 0 0 2024-01-25T15:03:36.119 INFO:tasks.workunit.client.0.smithi170.stdout:9/335: symlink d5/df/d16/l78 0 2024-01-25T15:03:36.120 INFO:tasks.workunit.client.0.smithi170.stdout:1/337: write d0/fe [1332962,18674] 0 2024-01-25T15:03:36.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.121+0000 7f15c8256640 1 -- 172.21.15.170:0/2351681648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15c0108be0 msgr2=0x7f15c010b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:36.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.121+0000 7f15c8256640 1 --2- 172.21.15.170:0/2351681648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15c0108be0 0x7f15c010b070 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009ca0 tx=0x7f15b802c100 comp rx=0 tx=0).stop 2024-01-25T15:03:36.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.121+0000 7f15c8256640 1 -- 172.21.15.170:0/2351681648 shutdown_connections 2024-01-25T15:03:36.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.121+0000 7f15c8256640 1 --2- 172.21.15.170:0/2351681648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15c0108be0 0x7f15c010b070 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.121+0000 7f15c8256640 1 --2- 172.21.15.170:0/2351681648 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15c0073750 0x7f15c0073bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.121+0000 7f15c8256640 1 --2- 172.21.15.170:0/2351681648 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15c0074d30 0x7f15c0073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.121+0000 7f15c8256640 1 -- 172.21.15.170:0/2351681648 >> 172.21.15.170:0/2351681648 conn(0x7f15c00fc290 msgr2=0x7f15c00fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:36.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.121+0000 7f15c8256640 1 -- 172.21.15.170:0/2351681648 shutdown_connections 2024-01-25T15:03:36.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.121+0000 7f15c8256640 1 -- 172.21.15.170:0/2351681648 wait complete. 2024-01-25T15:03:36.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.122+0000 7f15c8256640 1 Processor -- start 2024-01-25T15:03:36.123 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.122+0000 7f15c8256640 1 -- start start 2024-01-25T15:03:36.123 INFO:tasks.workunit.client.0.smithi170.stdout:7/372: dwrite d8/d20/d3b/f50 [0,4194304] 0 2024-01-25T15:03:36.123 INFO:tasks.workunit.client.0.smithi170.stdout:7/373: fdatasync d8/d20/d45/d68/d71/f8a 0 2024-01-25T15:03:36.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.122+0000 7f15c8256640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15c0073750 0x7f15c0198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.122+0000 7f15c8256640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15c0074d30 0x7f15c0199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.122+0000 7f15c8256640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15c0108be0 0x7f15c01a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.122+0000 7f15c8256640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c01a08d0 con 0x7f15c0074d30 2024-01-25T15:03:36.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.122+0000 7f15c8256640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c01a0a40 con 0x7f15c0108be0 2024-01-25T15:03:36.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.122+0000 7f15c8256640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c01a0c00 con 0x7f15c0073750 2024-01-25T15:03:36.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.122+0000 7f15c57f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15c0074d30 0x7f15c0199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:36.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.122+0000 7f15c57f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15c0074d30 0x7f15c0199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44840/0 (socket says 172.21.15.170:44840) 2024-01-25T15:03:36.124 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.122+0000 7f15c57f1640 1 -- 172.21.15.170:0/3921253767 learned_addr learned my addr 172.21.15.170:0/3921253767 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:36.125 INFO:tasks.workunit.client.0.smithi170.stdout:8/261: link d3/d7/f2a d3/d7/d22/d23/d25/f5b 0 2024-01-25T15:03:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.123+0000 7f15c57f1640 1 -- 172.21.15.170:0/3921253767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15c0073750 msgr2=0x7f15c0198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.123+0000 7f15c57f1640 1 --2- 172.21.15.170:0/3921253767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15c0073750 0x7f15c0198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.123+0000 7f15c57f1640 1 -- 172.21.15.170:0/3921253767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15c0108be0 msgr2=0x7f15c01a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.123+0000 7f15c57f1640 1 --2- 172.21.15.170:0/3921253767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15c0108be0 0x7f15c01a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.125 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.123+0000 7f15c57f1640 1 -- 172.21.15.170:0/3921253767 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b8009900 con 0x7f15c0074d30 2024-01-25T15:03:36.126 INFO:tasks.workunit.client.0.smithi170.stdout:9/336: write d5/df/d16/d35/d3c/f45 [133701,96162] 0 2024-01-25T15:03:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.123+0000 7f15c57f1640 1 --2- 172.21.15.170:0/3921253767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15c0074d30 0x7f15c0199320 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f15b000d950 tx=0x7f15b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.123+0000 7f15b6ffd640 1 -- 172.21.15.170:0/3921253767 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0009c30 con 0x7f15c0074d30 2024-01-25T15:03:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.124+0000 7f15c8256640 1 -- 172.21.15.170:0/3921253767 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c01a0ee0 con 0x7f15c0074d30 2024-01-25T15:03:36.126 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.124+0000 7f15c8256640 1 -- 172.21.15.170:0/3921253767 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c01a13b0 con 0x7f15c0074d30 2024-01-25T15:03:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.124+0000 7f15b6ffd640 1 -- 172.21.15.170:0/3921253767 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15b0009d90 con 0x7f15c0074d30 2024-01-25T15:03:36.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.124+0000 7f15b6ffd640 1 -- 172.21.15.170:0/3921253767 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b000f6b0 con 0x7f15c0074d30 2024-01-25T15:03:36.127 INFO:tasks.workunit.client.0.smithi170.stdout:3/370: dread d3/d10/d13/f65 [0,4194304] 0 2024-01-25T15:03:36.127 INFO:tasks.workunit.client.0.smithi170.stdout:3/371: read - d3/d10/d52/f5d zero size 2024-01-25T15:03:36.127 INFO:tasks.workunit.client.0.smithi170.stdout:7/374: mknod d8/d20/d73/c95 0 2024-01-25T15:03:36.128 INFO:tasks.workunit.client.0.smithi170.stdout:0/321: write d8/d10/d2d/d53/f60 [3097770,18965] 0 2024-01-25T15:03:36.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.128+0000 7f15cae1e740 1 Processor -- start 2024-01-25T15:03:36.129 INFO:tasks.workunit.client.0.smithi170.stdout:8/262: rename d3/d7/d1e/f44 to d3/d7/d22/d23/d25/f5c 0 2024-01-25T15:03:36.129 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.128+0000 7f15cae1e740 1 -- start start 2024-01-25T15:03:36.130 INFO:tasks.workunit.client.0.smithi170.stdout:9/337: mknod d5/df/d2e/d77/d21/c79 0 2024-01-25T15:03:36.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.129+0000 7f15cae1e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a1341be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.130 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.129+0000 7f15c67f3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a1341be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:36.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.129+0000 7f15c67f3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a1341be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44846/0 (socket says 172.21.15.170:44846) 2024-01-25T15:03:36.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.129+0000 7f15c67f3640 1 -- 172.21.15.170:0/2964410342 learned_addr learned my addr 172.21.15.170:0/2964410342 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:36.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.129+0000 7f15cae1e740 1 --2- 172.21.15.170:0/2964410342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a1341c440 0x561a13420f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.129+0000 7f15cae1e740 1 --2- 172.21.15.170:0/2964410342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a134215b0 0x561a13423a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.129+0000 7f15cae1e740 1 -- 172.21.15.170:0/2964410342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a1338a3b0 con 0x561a1341ba50 2024-01-25T15:03:36.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.129+0000 7f15cae1e740 1 -- 172.21.15.170:0/2964410342 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a13387aa0 con 0x561a134215b0 2024-01-25T15:03:36.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.129+0000 7f15cae1e740 1 -- 172.21.15.170:0/2964410342 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a13383390 con 0x561a1341c440 2024-01-25T15:03:36.131 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.130+0000 7f15b6ffd640 1 -- 172.21.15.170:0/3921253767 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f15b0010a20 con 0x7f15c0074d30 2024-01-25T15:03:36.131 INFO:tasks.workunit.client.0.smithi170.stdout:2/370: dread d10/d1b/f36 [0,4194304] 0 2024-01-25T15:03:36.133 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.130+0000 7f15c5ff2640 1 --2- 172.21.15.170:0/2964410342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a1341c440 0x561a13420f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:36.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.130+0000 7f15c67f3640 1 -- 172.21.15.170:0/2964410342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a1341c440 msgr2=0x561a13420f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:36.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.130+0000 7f15c67f3640 1 --2- 172.21.15.170:0/2964410342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a1341c440 0x561a13420f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.130+0000 7f15c67f3640 1 -- 172.21.15.170:0/2964410342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a134215b0 msgr2=0x561a13423a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-25T15:03:36.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.130+0000 7f15c67f3640 1 --2- 172.21.15.170:0/2964410342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a134215b0 0x561a13423a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.130+0000 7f15c67f3640 1 -- 172.21.15.170:0/2964410342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a13345810 con 0x561a1341ba50 2024-01-25T15:03:36.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.130+0000 7f15c67f3640 1 --2- 172.21.15.170:0/2964410342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a1341be70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f15b8005e30 tx=0x7f15b8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9589a9bcabe04f0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:36.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.131+0000 7f15abfff640 1 -- 172.21.15.170:0/2964410342 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b80323c0 con 0x561a1341ba50 2024-01-25T15:03:36.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.131+0000 7f15abfff640 1 -- 172.21.15.170:0/2964410342 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15b8034bd0 con 0x561a1341ba50 2024-01-25T15:03:36.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.131+0000 7f15abfff640 1 -- 172.21.15.170:0/2964410342 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b8003bd0 con 0x561a1341ba50 2024-01-25T15:03:36.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.131+0000 7f15b6ffd640 1 --2- 172.21.15.170:0/3921253767 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f15ac0a12e0 0x7f15ac0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.131+0000 7f15c5ff2640 1 --2- 172.21.15.170:0/3921253767 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f15ac0a12e0 0x7f15ac0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:36.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.132+0000 7f15b6ffd640 1 -- 172.21.15.170:0/3921253767 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f15b00cc800 con 0x7f15c0074d30 2024-01-25T15:03:36.134 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.132+0000 7f15cae1e740 1 -- 172.21.15.170:0/2964410342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 msgr2=0x561a1341be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:36.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.132+0000 7f15cae1e740 1 --2- 172.21.15.170:0/2964410342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a1341be70 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f15b8005e30 tx=0x7f15b8005ef0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.132+0000 7f15c5ff2640 1 --2- 172.21.15.170:0/3921253767 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f15ac0a12e0 0x7f15ac0a37a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x561a1341c840 tx=0x7f15bc005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:36.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.132+0000 7f15cae1e740 1 -- 172.21.15.170:0/2964410342 shutdown_connections 2024-01-25T15:03:36.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.132+0000 7f15cae1e740 1 --2- 172.21.15.170:0/2964410342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a134215b0 0x561a13423a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.132+0000 7f15cae1e740 1 --2- 172.21.15.170:0/2964410342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a1341c440 0x561a13420f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.132+0000 7f15cae1e740 1 --2- 172.21.15.170:0/2964410342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a1341be70 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.132+0000 7f15cae1e740 1 -- 172.21.15.170:0/2964410342 >> 172.21.15.170:0/2964410342 conn(0x561a13416fc0 msgr2=0x561a134173c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:36.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.132+0000 7f15cae1e740 1 -- 172.21.15.170:0/2964410342 shutdown_connections 2024-01-25T15:03:36.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.132+0000 7f15cae1e740 1 -- 172.21.15.170:0/2964410342 wait complete. 2024-01-25T15:03:36.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.133+0000 7f15cae1e740 1 -- start start 2024-01-25T15:03:36.135 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.133+0000 7f15cae1e740 1 Processor -- start 2024-01-25T15:03:36.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15cae1e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a13425cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15cae1e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a1341c440 0x561a13426230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15cae1e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a134215b0 0x561a1342d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.137 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15cae1e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a1333c780 con 0x561a1341ba50 2024-01-25T15:03:36.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15cae1e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a1333c420 con 0x561a1341c440 2024-01-25T15:03:36.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15cae1e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a13301420 con 0x561a134215b0 2024-01-25T15:03:36.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15cae1e740 10 client.0 _ll_register_callbacks cb 0x561a1333eb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:36.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15c5ff2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a13425cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:36.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15c5ff2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a13425cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44850/0 (socket says 172.21.15.170:44850) 2024-01-25T15:03:36.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15c5ff2640 1 -- 172.21.15.170:0/2258222310 learned_addr learned my addr 172.21.15.170:0/2258222310 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:36.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15c67f3640 1 --2- 172.21.15.170:0/2258222310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a134215b0 0x561a1342d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:36.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15c5ff2640 1 -- 172.21.15.170:0/2258222310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a134215b0 msgr2=0x561a1342d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:36.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15c5ff2640 1 --2- 172.21.15.170:0/2258222310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a134215b0 0x561a1342d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15c5ff2640 1 -- 172.21.15.170:0/2258222310 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a1341c440 msgr2=0x561a13426230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:36.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15c5ff2640 1 --2- 172.21.15.170:0/2258222310 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a1341c440 0x561a13426230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15c5ff2640 1 -- 172.21.15.170:0/2258222310 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c010bc20 con 0x561a1341ba50 2024-01-25T15:03:36.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.134+0000 7f15c67f3640 1 --2- 172.21.15.170:0/2258222310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a134215b0 0x561a1342d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:03:36.138 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.135+0000 7f15c5ff2640 1 --2- 172.21.15.170:0/2258222310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a13425cf0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0109e0 tx=0x7f15bc005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948f1f702e780bf3 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:36.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.135+0000 7f15a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:36.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.135+0000 7f15a97fa640 1 -- 172.21.15.170:0/2258222310 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc00fcd0 con 0x561a1341ba50 2024-01-25T15:03:36.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.135+0000 7f15cae1e740 1 -- 172.21.15.170:0/2258222310 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a13358240 con 0x561a1341ba50 2024-01-25T15:03:36.139 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.136+0000 7f15a97fa640 1 -- 172.21.15.170:0/2258222310 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f15bc00ee80 con 0x561a1341ba50 2024-01-25T15:03:36.139 INFO:tasks.workunit.client.0.smithi170.stdout:2/371: symlink d10/d1e/d32/d3e/d41/l89 0 2024-01-25T15:03:36.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.136+0000 7f15a97fa640 1 -- 172.21.15.170:0/2258222310 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15bc00fe30 con 0x561a1341ba50 2024-01-25T15:03:36.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.136+0000 7f15cae1e740 10 client.16047 fetch_fsmap learned FSMap version 30 2024-01-25T15:03:36.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.136+0000 7f15cae1e740 1 -- 172.21.15.170:0/2258222310 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x561a13381a10 con 0x561a1341ba50 2024-01-25T15:03:36.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.137+0000 7f15a97fa640 1 -- 172.21.15.170:0/2258222310 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561a13358240 con 0x561a1341ba50 2024-01-25T15:03:36.140 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.137+0000 7f15a97fa640 1 -- 172.21.15.170:0/2258222310 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f15bc01d450 con 0x561a1341ba50 2024-01-25T15:03:36.140 INFO:tasks.workunit.client.0.smithi170.stdout:2/372: truncate d10/d1b/d5f/f78 1061322 0 2024-01-25T15:03:36.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.137+0000 7f15cae1e740 10 client.16047 fetch_fsmap finished waiting for FSMap version 30 2024-01-25T15:03:36.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.137+0000 7f15cae1e740 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:36.141 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.138+0000 7f15cae1e740 20 client.16047 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:36.141 INFO:tasks.workunit.client.0.smithi170.stdout:9/338: dread d5/df/d16/f19 [0,4194304] 0 2024-01-25T15:03:36.141 INFO:tasks.workunit.client.0.smithi170.stdout:9/339: readlink d5/df/d16/d35/l38 0 2024-01-25T15:03:36.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.138+0000 7f15cae1e740 1 --2- 172.21.15.170:0/2258222310 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x561a13432120 0x561a13434540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.138+0000 7f15cae1e740 4 client.16047 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:36.142 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.138+0000 7f15cae1e740 1 -- 172.21.15.170:0/2258222310 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a13355b50 con 0x561a13432120 2024-01-25T15:03:36.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.139+0000 7f15c57f1640 1 --2- 172.21.15.170:0/2258222310 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x561a13432120 0x561a13434540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:36.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.140+0000 7f15c57f1640 1 --2- 172.21.15.170:0/2258222310 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x561a13432120 0x561a13434540 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73a079040a51c601 server_cookie=d4907a756070f0fe in_seq=0 out_seq=0 2024-01-25T15:03:36.143 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.140+0000 7f15a97fa640 10 client.16047 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:36.143 INFO:tasks.workunit.client.0.smithi170.stdout:6/355: sync 2024-01-25T15:03:36.143 INFO:tasks.workunit.client.0.smithi170.stdout:6/356: stat d2/d7/d23/f2d 0 2024-01-25T15:03:36.143 INFO:tasks.workunit.client.0.smithi170.stdout:2/373: mknod d10/d1e/d32/d3e/d41/c8a 0 2024-01-25T15:03:36.144 INFO:tasks.workunit.client.0.smithi170.stdout:9/340: rename f2 to d5/df/d2e/d77/d21/d34/f7a 0 2024-01-25T15:03:36.144 INFO:tasks.workunit.client.0.smithi170.stdout:2/374: mkdir d10/d1e/d32/d84/d8b 0 2024-01-25T15:03:36.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.144+0000 7f15a97fa640 1 -- 172.21.15.170:0/2258222310 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561a13355b50 con 0x561a13432120 2024-01-25T15:03:36.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.144+0000 7f15a97fa640 10 client.16047 handle_command_reply: tid=0 2024-01-25T15:03:36.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.144+0000 7f15cae1e740 1 client.16047 shutdown 2024-01-25T15:03:36.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.144+0000 7f15cae1e740 1 -- 172.21.15.170:0/2258222310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 msgr2=0x561a13425cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:36.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.144+0000 7f15cae1e740 1 --2- 172.21.15.170:0/2258222310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a13425cf0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0109e0 tx=0x7f15bc005b10 comp rx=0 tx=0).stop 2024-01-25T15:03:36.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.144+0000 7f15cae1e740 1 -- 172.21.15.170:0/2258222310 shutdown_connections 2024-01-25T15:03:36.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.144+0000 7f15cae1e740 1 --2- 172.21.15.170:0/2258222310 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x561a13432120 0x561a13434540 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.144+0000 7f15cae1e740 1 --2- 172.21.15.170:0/2258222310 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a1341c440 0x561a13426230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.144+0000 7f15cae1e740 1 --2- 172.21.15.170:0/2258222310 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a134215b0 0x561a1342d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.144+0000 7f15cae1e740 1 --2- 172.21.15.170:0/2258222310 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a13425cf0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.144+0000 7f15cae1e740 1 -- 172.21.15.170:0/2258222310 >> 172.21.15.170:0/2258222310 conn(0x561a13416fc0 msgr2=0x561a13416240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:36.146 INFO:tasks.workunit.client.0.smithi170.stdout:6/357: link d2/d7/d23/d19/f29 d2/d7/d23/d19/d2a/d43/d44/f7c 0 2024-01-25T15:03:36.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.144+0000 7f15a97fa640 0 client.16047 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:36.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.144+0000 7f15cae1e740 1 -- 172.21.15.170:0/2258222310 shutdown_connections 2024-01-25T15:03:36.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.144+0000 7f15cae1e740 1 -- 172.21.15.170:0/2258222310 wait complete. 2024-01-25T15:03:36.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.144+0000 7f15cae1e740 20 client.16047 trim_cache size 0 max 16384 2024-01-25T15:03:36.147 INFO:tasks.workunit.client.0.smithi170.stdout:6/358: link d2/d7/l41 d2/d7/d23/d19/d2a/d43/d44/l7d 0 2024-01-25T15:03:36.148 INFO:tasks.workunit.client.0.smithi170.stdout:1/338: dwrite d0/d20/d28/f6a [0,4194304] 0 2024-01-25T15:03:36.148 INFO:tasks.workunit.client.0.smithi170.stdout:1/339: write d0/fe [311086,125293] 0 2024-01-25T15:03:36.149 INFO:tasks.workunit.client.0.smithi170.stdout:6/359: symlink d2/d7/d23/d19/d2f/d5d/l7e 0 2024-01-25T15:03:36.152 INFO:tasks.workunit.client.0.smithi170.stdout:0/322: dread d8/d10/d2d/d2f/f37 [0,4194304] 0 2024-01-25T15:03:36.152 INFO:tasks.workunit.client.0.smithi170.stdout:1/340: mknod d0/d20/d3a/c75 0 2024-01-25T15:03:36.152 INFO:tasks.workunit.client.0.smithi170.stdout:1/341: stat d0/d20/c3f 0 2024-01-25T15:03:36.152 INFO:tasks.workunit.client.0.smithi170.stdout:1/342: truncate d0/d20/d3a/f65 420718 0 2024-01-25T15:03:36.152 INFO:tasks.workunit.client.0.smithi170.stdout:9/341: write d5/dc/f2c [3666954,97891] 0 2024-01-25T15:03:36.153 INFO:tasks.workunit.client.0.smithi170.stdout:3/372: dwrite d3/d10/d1e/f20 [0,4194304] 0 2024-01-25T15:03:36.158 INFO:tasks.workunit.client.0.smithi170.stdout:6/360: truncate d2/d7/d23/d19/d2f/d37/f62 878028 0 2024-01-25T15:03:36.158 INFO:tasks.workunit.client.0.smithi170.stdout:1/343: mknod d0/d20/d3a/c76 0 2024-01-25T15:03:36.158 INFO:tasks.workunit.client.0.smithi170.stdout:6/361: fdatasync d2/d7/d23/d19/f24 0 2024-01-25T15:03:36.159 INFO:tasks.workunit.client.0.smithi170.stdout:6/362: stat d2/d7/d23/l72 0 2024-01-25T15:03:36.159 INFO:tasks.workunit.client.0.smithi170.stdout:8/263: dwrite d3/d7/d1e/f45 [0,4194304] 0 2024-01-25T15:03:36.159 INFO:tasks.workunit.client.0.smithi170.stdout:1/344: dread d0/f46 [0,4194304] 0 2024-01-25T15:03:36.163 INFO:tasks.workunit.client.0.smithi170.stdout:3/373: rmdir d3/d10/d13 39 2024-01-25T15:03:36.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15cae1e740 1 Processor -- start 2024-01-25T15:03:36.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15cae1e740 1 -- start start 2024-01-25T15:03:36.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15cae1e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a1341ba50 0x561a1341ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15cae1e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341c440 0x561a1342d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15cae1e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a134215b0 0x561a1341d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15cae1e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a13412890 con 0x561a1341c440 2024-01-25T15:03:36.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15cae1e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a1340c060 con 0x561a134215b0 2024-01-25T15:03:36.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15cae1e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a1341b610 con 0x561a1341ba50 2024-01-25T15:03:36.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15c57f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341c440 0x561a1342d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:36.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15c57f1640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341c440 0x561a1342d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44862/0 (socket says 172.21.15.170:44862) 2024-01-25T15:03:36.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15c57f1640 1 -- 172.21.15.170:0/242968281 learned_addr learned my addr 172.21.15.170:0/242968281 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:36.165 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15c5ff2640 1 --2- 172.21.15.170:0/242968281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a1341ba50 0x561a1341ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:36.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15c57f1640 1 -- 172.21.15.170:0/242968281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a1341ba50 msgr2=0x561a1341ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:36.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15c57f1640 1 --2- 172.21.15.170:0/242968281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a1341ba50 0x561a1341ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15c57f1640 1 -- 172.21.15.170:0/242968281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a134215b0 msgr2=0x561a1341d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:36.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15c57f1640 1 --2- 172.21.15.170:0/242968281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a134215b0 0x561a1341d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.163+0000 7f15c57f1640 1 -- 172.21.15.170:0/242968281 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a1331e520 con 0x561a1341c440 2024-01-25T15:03:36.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.164+0000 7f15c57f1640 1 --2- 172.21.15.170:0/242968281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341c440 0x561a1342d230 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f15b0099900 tx=0x7f15b00b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e661b23098001e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:36.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.164+0000 7f15ab7fe640 1 -- 172.21.15.170:0/242968281 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0099970 con 0x561a1341c440 2024-01-25T15:03:36.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.164+0000 7f15ab7fe640 1 -- 172.21.15.170:0/242968281 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15b009dac0 con 0x561a1341c440 2024-01-25T15:03:36.166 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.164+0000 7f15ab7fe640 1 -- 172.21.15.170:0/242968281 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0096080 con 0x561a1341c440 2024-01-25T15:03:36.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 -- 172.21.15.170:0/242968281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341c440 msgr2=0x561a1342d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:36.167 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 --2- 172.21.15.170:0/242968281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341c440 0x561a1342d230 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f15b0099900 tx=0x7f15b00b9040 comp rx=0 tx=0).stop 2024-01-25T15:03:36.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 -- 172.21.15.170:0/242968281 shutdown_connections 2024-01-25T15:03:36.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 --2- 172.21.15.170:0/242968281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a134215b0 0x561a1341d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 --2- 172.21.15.170:0/242968281 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341c440 0x561a1342d230 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 --2- 172.21.15.170:0/242968281 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a1341ba50 0x561a1341ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 -- 172.21.15.170:0/242968281 >> 172.21.15.170:0/242968281 conn(0x561a13416fc0 msgr2=0x561a134173a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:36.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 -- 172.21.15.170:0/242968281 shutdown_connections 2024-01-25T15:03:36.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 -- 172.21.15.170:0/242968281 wait complete. 2024-01-25T15:03:36.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 -- start start 2024-01-25T15:03:36.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 Processor -- start 2024-01-25T15:03:36.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a1342aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.168 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a1341c440 0x561a1342b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.169 INFO:tasks.workunit.client.0.smithi170.stdout:8/264: rmdir d3/d7/d22/d23/d48 39 2024-01-25T15:03:36.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a134215b0 0x561a1342c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a1342ca80 con 0x561a1341ba50 2024-01-25T15:03:36.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a1342cbf0 con 0x561a1341c440 2024-01-25T15:03:36.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.165+0000 7f15cae1e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a1342cdb0 con 0x561a134215b0 2024-01-25T15:03:36.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15cae1e740 10 client.0 _ll_register_callbacks cb 0x7f15bc014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:36.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15c5ff2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a1342aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:36.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15c5ff2640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a1342aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:44876/0 (socket says 172.21.15.170:44876) 2024-01-25T15:03:36.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15c67f3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a134215b0 0x561a1342c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:36.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15c5ff2640 1 -- 172.21.15.170:0/3585661739 learned_addr learned my addr 172.21.15.170:0/3585661739 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:36.171 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15c5ff2640 1 -- 172.21.15.170:0/3585661739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a134215b0 msgr2=0x561a1342c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:36.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15c5ff2640 1 --2- 172.21.15.170:0/3585661739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a134215b0 0x561a1342c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15c57f1640 1 --2- 172.21.15.170:0/3585661739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a1341c440 0x561a1342b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:36.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15c5ff2640 1 -- 172.21.15.170:0/3585661739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a1341c440 msgr2=0x561a1342b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:36.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15c5ff2640 1 --2- 172.21.15.170:0/3585661739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a1341c440 0x561a1342b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15c5ff2640 1 -- 172.21.15.170:0/3585661739 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c01a13b0 con 0x561a1341ba50 2024-01-25T15:03:36.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15c57f1640 1 --2- 172.21.15.170:0/3585661739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a1341c440 0x561a1342b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:03:36.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15c5ff2640 1 --2- 172.21.15.170:0/3585661739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a1342aff0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0109e0 tx=0x7f15bc01d6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e041ef079063a6d6 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:36.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:36.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15a97fa640 1 -- 172.21.15.170:0/3585661739 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc034070 con 0x561a1341ba50 2024-01-25T15:03:36.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15cae1e740 1 -- 172.21.15.170:0/3585661739 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a133aac00 con 0x561a1341ba50 2024-01-25T15:03:36.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15a97fa640 1 -- 172.21.15.170:0/3585661739 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f15bc00fe60 con 0x561a1341ba50 2024-01-25T15:03:36.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.166+0000 7f15a97fa640 1 -- 172.21.15.170:0/3585661739 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15bc005030 con 0x561a1341ba50 2024-01-25T15:03:36.172 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.167+0000 7f15cae1e740 10 client.16053 fetch_fsmap learned FSMap version 30 2024-01-25T15:03:36.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.167+0000 7f15cae1e740 1 -- 172.21.15.170:0/3585661739 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x561a13344070 con 0x561a1341ba50 2024-01-25T15:03:36.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.167+0000 7f15a97fa640 1 -- 172.21.15.170:0/3585661739 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561a133aac00 con 0x561a1341ba50 2024-01-25T15:03:36.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.167+0000 7f15a97fa640 1 -- 172.21.15.170:0/3585661739 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 30) v1 ==== 7918+0+0 (secure 0 0 0) 0x7f15bc044480 con 0x561a1341ba50 2024-01-25T15:03:36.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.167+0000 7f15cae1e740 10 client.16053 fetch_fsmap finished waiting for FSMap version 30 2024-01-25T15:03:36.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.167+0000 7f15cae1e740 10 client.16053 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:36.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.167+0000 7f15cae1e740 20 client.16053 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:36.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.167+0000 7f15cae1e740 1 --2- 172.21.15.170:0/3585661739 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x561a134897e0 0x561a1348bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:36.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.167+0000 7f15cae1e740 4 client.16053 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-25T15:03:36.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.167+0000 7f15cae1e740 1 -- 172.21.15.170:0/3585661739 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561a1337c220 con 0x561a134897e0 2024-01-25T15:03:36.173 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.167+0000 7f15c57f1640 1 --2- 172.21.15.170:0/3585661739 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x561a134897e0 0x561a1348bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:36.173 INFO:tasks.workunit.client.0.smithi170.stdout:1/345: symlink d0/d20/d28/d2a/d4a/d56/l77 0 2024-01-25T15:03:36.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.168+0000 7f15a97fa640 10 client.16053 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:36.174 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.168+0000 7f15c57f1640 1 --2- 172.21.15.170:0/3585661739 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x561a134897e0 0x561a1348bc00 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97eedcd6a610428a server_cookie=a59d94cf02b5a7e8 in_seq=0 out_seq=0 2024-01-25T15:03:36.174 INFO:tasks.workunit.client.0.smithi170.stdout:3/374: creat d3/d10/d1e/d21/d41/d4a/f75 x:0 0 0 2024-01-25T15:03:36.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.173+0000 7f15a97fa640 1 -- 172.21.15.170:0/3585661739 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x561a1337c220 con 0x561a134897e0 2024-01-25T15:03:36.175 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.173+0000 7f15a97fa640 10 client.16053 handle_command_reply: tid=0 2024-01-25T15:03:36.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.173+0000 7f15cae1e740 1 client.16053 shutdown 2024-01-25T15:03:36.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.173+0000 7f15cae1e740 1 -- 172.21.15.170:0/3585661739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 msgr2=0x561a1342aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:36.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.173+0000 7f15cae1e740 1 --2- 172.21.15.170:0/3585661739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a1342aff0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f15bc0109e0 tx=0x7f15bc01d6f0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.173+0000 7f15cae1e740 1 -- 172.21.15.170:0/3585661739 shutdown_connections 2024-01-25T15:03:36.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.173+0000 7f15cae1e740 1 --2- 172.21.15.170:0/3585661739 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x561a134897e0 0x561a1348bc00 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.173+0000 7f15cae1e740 1 --2- 172.21.15.170:0/3585661739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x561a1341c440 0x561a1342b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.173+0000 7f15a97fa640 0 client.16053 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:36.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.173+0000 7f15cae1e740 1 --2- 172.21.15.170:0/3585661739 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x561a134215b0 0x561a1342c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.173+0000 7f15cae1e740 1 --2- 172.21.15.170:0/3585661739 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x561a1341ba50 0x561a1342aff0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.173+0000 7f15cae1e740 1 -- 172.21.15.170:0/3585661739 >> 172.21.15.170:0/3585661739 conn(0x561a13416fc0 msgr2=0x561a1341ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:36.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.173+0000 7f15cae1e740 1 -- 172.21.15.170:0/3585661739 shutdown_connections 2024-01-25T15:03:36.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.174+0000 7f15cae1e740 1 -- 172.21.15.170:0/3585661739 wait complete. 2024-01-25T15:03:36.176 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.174+0000 7f15cae1e740 20 client.16053 trim_cache size 0 max 16384 2024-01-25T15:03:36.177 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:03:36.177 INFO:teuthology.orchestra.run.smithi170.stdout: "status": "scrub active (405 inodes in the stack)", 2024-01-25T15:03:36.177 INFO:teuthology.orchestra.run.smithi170.stdout: "scrubs": { 2024-01-25T15:03:36.177 INFO:teuthology.orchestra.run.smithi170.stdout: "fc060387-7435-4063-bfa0-4016cd451e68": { 2024-01-25T15:03:36.177 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/", 2024-01-25T15:03:36.177 INFO:teuthology.orchestra.run.smithi170.stdout: "tag": "fc060387-7435-4063-bfa0-4016cd451e68", 2024-01-25T15:03:36.177 INFO:teuthology.orchestra.run.smithi170.stdout: "options": "recursive,force" 2024-01-25T15:03:36.177 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:03:36.177 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:03:36.177 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:03:36.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.174+0000 7f15c8256640 1 -- 172.21.15.170:0/3921253767 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f15ac0a12e0 msgr2=0x7f15ac0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:36.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.174+0000 7f15c8256640 1 --2- 172.21.15.170:0/3921253767 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f15ac0a12e0 0x7f15ac0a37a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x561a1341c840 tx=0x7f15bc005e50 comp rx=0 tx=0).stop 2024-01-25T15:03:36.178 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.174+0000 7f15c8256640 1 -- 172.21.15.170:0/3921253767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15c0074d30 msgr2=0x7f15c0199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:36.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.174+0000 7f15c8256640 1 --2- 172.21.15.170:0/3921253767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15c0074d30 0x7f15c0199320 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f15b000d950 tx=0x7f15b000de10 comp rx=0 tx=0).stop 2024-01-25T15:03:36.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.174+0000 7f15c8256640 1 -- 172.21.15.170:0/3921253767 shutdown_connections 2024-01-25T15:03:36.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.174+0000 7f15c8256640 1 --2- 172.21.15.170:0/3921253767 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f15ac0a12e0 0x7f15ac0a37a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.174+0000 7f15c8256640 1 --2- 172.21.15.170:0/3921253767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15c0108be0 0x7f15c01a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.174+0000 7f15c8256640 1 --2- 172.21.15.170:0/3921253767 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f15c0074d30 0x7f15c0199320 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.174+0000 7f15c8256640 1 --2- 172.21.15.170:0/3921253767 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f15c0073750 0x7f15c0198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:36.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.174+0000 7f15c8256640 1 -- 172.21.15.170:0/3921253767 >> 172.21.15.170:0/3921253767 conn(0x7f15c00fc290 msgr2=0x7f15c0104ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:36.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.175+0000 7f15c8256640 1 -- 172.21.15.170:0/3921253767 shutdown_connections 2024-01-25T15:03:36.179 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:03:36.175+0000 7f15c8256640 1 -- 172.21.15.170:0/3921253767 wait complete. 2024-01-25T15:03:36.179 INFO:tasks.workunit.client.0.smithi170.stdout:8/265: getdents d3 0 2024-01-25T15:03:36.181 INFO:tasks.workunit.client.0.smithi170.stdout:8/266: unlink d3/d7/d22/d23/d25/l51 0 2024-01-25T15:03:36.181 INFO:tasks.workunit.client.0.smithi170.stdout:8/267: readlink d3/d7/d22/d23/d25/d34/l55 0 2024-01-25T15:03:36.183 INFO:tasks.workunit.client.0.smithi170.stdout:0/323: dwrite d8/d18/f20 [0,4194304] 0 2024-01-25T15:03:36.185 INFO:tasks.workunit.client.0.smithi170.stdout:0/324: symlink d8/d10/d2d/d58/l6d 0 2024-01-25T15:03:36.191 INFO:tasks.workunit.client.0.smithi170.stdout:1/346: dwrite d0/f3d [0,4194304] 0 2024-01-25T15:03:36.192 INFO:tasks.cephfs.filesystem:scrub status for tag:fc060387-7435-4063-bfa0-4016cd451e68 - {'path': '/', 'tag': 'fc060387-7435-4063-bfa0-4016cd451e68', 'options': 'recursive,force'} 2024-01-25T15:03:36.193 INFO:tasks.workunit.client.0.smithi170.stdout:3/375: write d3/d10/d13/f36 [1497466,17757] 0 2024-01-25T15:03:36.193 INFO:tasks.workunit.client.0.smithi170.stdout:3/376: readlink d3/d10/d13/d1b/l32 0 2024-01-25T15:03:36.208 INFO:tasks.workunit.client.0.smithi170.stdout:3/377: dread d3/d1c/d2b/f62 [0,4194304] 0 2024-01-25T15:03:36.208 INFO:tasks.workunit.client.0.smithi170.stdout:1/347: dwrite d0/d20/d28/f4c [0,4194304] 0 2024-01-25T15:03:36.208 INFO:tasks.workunit.client.0.smithi170.stdout:3/378: chown d3/d2a/f5f 28992 1 2024-01-25T15:03:36.209 INFO:tasks.workunit.client.0.smithi170.stdout:3/379: chown d3/d10/f23 7773 1 2024-01-25T15:03:36.211 INFO:tasks.workunit.client.0.smithi170.stdout:1/348: creat d0/d20/d28/d2a/d57/f78 x:0 0 0 2024-01-25T15:03:36.212 INFO:tasks.workunit.client.0.smithi170.stdout:3/380: truncate d3/d10/d13/f34 749255 0 2024-01-25T15:03:36.214 INFO:tasks.workunit.client.0.smithi170.stdout:1/349: symlink d0/d20/d28/d2a/d4a/d56/l79 0 2024-01-25T15:03:36.215 INFO:tasks.workunit.client.0.smithi170.stdout:3/381: truncate d3/f17 1261473 0 2024-01-25T15:03:36.216 INFO:tasks.workunit.client.0.smithi170.stdout:3/382: write d3/d10/f16 [970449,28450] 0 2024-01-25T15:03:36.217 INFO:tasks.workunit.client.0.smithi170.stdout:3/383: creat d3/d10/d13/d1b/d29/d38/f76 x:0 0 0 2024-01-25T15:03:36.217 INFO:tasks.workunit.client.0.smithi170.stdout:3/384: truncate d3/d10/d52/f64 4928225 0 2024-01-25T15:03:36.217 INFO:tasks.workunit.client.0.smithi170.stdout:3/385: getdents d3/d10/d13/d1b/d29/d38/d42/d72 0 2024-01-25T15:03:36.218 INFO:tasks.workunit.client.0.smithi170.stdout:8/268: dwrite d3/d7/d22/d23/d48/d52/f35 [0,4194304] 0 2024-01-25T15:03:36.219 INFO:tasks.workunit.client.0.smithi170.stdout:1/350: link d0/d20/d28/d2a/d4a/d56/l69 d0/d20/d28/l7a 0 2024-01-25T15:03:36.220 INFO:tasks.workunit.client.0.smithi170.stdout:2/375: rename d10/d1e/d5e/f61 to d10/d1e/d32/d62/d74/f8c 0 2024-01-25T15:03:36.225 INFO:tasks.workunit.client.0.smithi170.stdout:1/351: dread d0/f46 [0,4194304] 0 2024-01-25T15:03:36.225 INFO:tasks.workunit.client.0.smithi170.stdout:1/352: truncate d0/d1b/f1c 858402 0 2024-01-25T15:03:36.227 INFO:tasks.workunit.client.0.smithi170.stdout:9/342: rename d5/df/d2e/d6b/l4a to d5/df/d2e/d77/d21/d34/l7b 0 2024-01-25T15:03:36.227 INFO:tasks.workunit.client.0.smithi170.stdout:9/343: write d5/df/d2e/f39 [4708839,105306] 0 2024-01-25T15:03:36.228 INFO:tasks.workunit.client.0.smithi170.stdout:0/325: dwrite d8/d9/f16 [0,4194304] 0 2024-01-25T15:03:36.230 INFO:tasks.workunit.client.0.smithi170.stdout:1/353: dread d0/d2e/f3b [0,4194304] 0 2024-01-25T15:03:36.230 INFO:tasks.workunit.client.0.smithi170.stdout:1/354: dread - d0/d20/d28/d2a/d57/f78 zero size 2024-01-25T15:03:36.230 INFO:tasks.workunit.client.0.smithi170.stdout:2/376: mkdir d10/d1e/d32/d62/d8d 0 2024-01-25T15:03:36.234 INFO:tasks.workunit.client.0.smithi170.stdout:1/355: dread d0/d20/d28/d2a/d4a/d56/d5b/f68 [0,4194304] 0 2024-01-25T15:03:36.237 INFO:tasks.workunit.client.0.smithi170.stdout:9/344: mknod d5/df/d2e/d77/c7c 0 2024-01-25T15:03:36.237 INFO:tasks.workunit.client.0.smithi170.stdout:9/345: creat d5/df/d2e/f7d x:0 0 0 2024-01-25T15:03:36.239 INFO:tasks.workunit.client.0.smithi170.stdout:1/356: mkdir d0/d20/d28/d7b 0 2024-01-25T15:03:36.242 INFO:tasks.workunit.client.0.smithi170.stdout:9/346: symlink d5/df/d2e/d77/d21/d46/d18/d6a/l7e 0 2024-01-25T15:03:36.243 INFO:tasks.workunit.client.0.smithi170.stdout:1/357: symlink d0/d20/d28/d2a/d4a/d56/l7c 0 2024-01-25T15:03:36.244 INFO:tasks.workunit.client.0.smithi170.stdout:0/326: write f2 [5831891,9779] 0 2024-01-25T15:03:36.245 INFO:tasks.workunit.client.0.smithi170.stdout:2/377: write d10/d1e/d32/f38 [2365324,127497] 0 2024-01-25T15:03:36.245 INFO:tasks.workunit.client.0.smithi170.stdout:2/378: dread - d10/d1e/d32/d62/f79 zero size 2024-01-25T15:03:36.245 INFO:tasks.workunit.client.0.smithi170.stdout:9/347: mkdir d5/df/d2e/d77/d21/d34/d3e/d7f 0 2024-01-25T15:03:36.248 INFO:tasks.workunit.client.0.smithi170.stdout:9/348: creat d5/df/d16/d35/d3c/d56/d59/f80 x:0 0 0 2024-01-25T15:03:36.248 INFO:tasks.workunit.client.0.smithi170.stdout:9/349: fdatasync d5/df/d16/d35/f65 0 2024-01-25T15:03:36.250 INFO:tasks.workunit.client.0.smithi170.stdout:9/350: creat d5/df/d2e/d77/d21/d46/f81 x:0 0 0 2024-01-25T15:03:36.253 INFO:tasks.workunit.client.0.smithi170.stdout:9/351: creat d5/df/d2e/d77/f82 x:0 0 0 2024-01-25T15:03:36.253 INFO:tasks.workunit.client.0.smithi170.stdout:9/352: chown d5/df/d2e/d77/d21/c4c 3848 1 2024-01-25T15:03:36.253 INFO:tasks.workunit.client.0.smithi170.stdout:9/353: chown d5/df/d2e/d77/d21/d46 4 1 2024-01-25T15:03:36.253 INFO:tasks.workunit.client.0.smithi170.stdout:9/354: write d5/df/d2e/d77/d21/d34/f5b [549933,70098] 0 2024-01-25T15:03:36.254 INFO:tasks.workunit.client.0.smithi170.stdout:3/386: dwrite d3/d1c/d2d/f35 [4194304,4194304] 0 2024-01-25T15:03:36.255 INFO:tasks.workunit.client.0.smithi170.stdout:8/269: dwrite d3/d7/d22/d23/d48/d52/f35 [0,4194304] 0 2024-01-25T15:03:36.256 INFO:tasks.workunit.client.0.smithi170.stdout:9/355: creat d5/df/d2e/d77/d21/d34/d3e/d7f/f83 x:0 0 0 2024-01-25T15:03:36.260 INFO:tasks.workunit.client.0.smithi170.stdout:1/358: dread d0/d20/d28/f6a [0,4194304] 0 2024-01-25T15:03:36.260 INFO:tasks.workunit.client.0.smithi170.stdout:8/270: rmdir d3/d7/d22/d23/d48 39 2024-01-25T15:03:36.263 INFO:tasks.workunit.client.0.smithi170.stdout:9/356: creat d5/df/d2e/d77/d21/d34/d3e/f84 x:0 0 0 2024-01-25T15:03:36.266 INFO:tasks.workunit.client.0.smithi170.stdout:8/271: mkdir d3/d7/d22/d5d 0 2024-01-25T15:03:36.266 INFO:tasks.workunit.client.0.smithi170.stdout:8/272: write d3/d7/d22/d23/d48/d52/d47/f4c [938332,69219] 0 2024-01-25T15:03:36.267 INFO:tasks.workunit.client.0.smithi170.stdout:8/273: truncate d3/d7/d22/d23/d48/d52/f43 354298 0 2024-01-25T15:03:36.267 INFO:tasks.workunit.client.0.smithi170.stdout:4/302: sync 2024-01-25T15:03:36.267 INFO:tasks.workunit.client.0.smithi170.stdout:9/357: dread d5/df/d2e/d77/d21/d34/f5b [0,4194304] 0 2024-01-25T15:03:36.267 INFO:tasks.workunit.client.0.smithi170.stdout:8/274: creat d3/d7/d1e/f5e x:0 0 0 2024-01-25T15:03:36.267 INFO:tasks.workunit.client.0.smithi170.stdout:9/358: write d5/df/d16/d35/d3c/d56/d59/f80 [14825,57814] 0 2024-01-25T15:03:36.267 INFO:tasks.workunit.client.0.smithi170.stdout:9/359: dread - d5/dc/f36 zero size 2024-01-25T15:03:36.267 INFO:tasks.workunit.client.0.smithi170.stdout:0/327: write d8/d18/f4d [886767,31764] 0 2024-01-25T15:03:36.271 INFO:tasks.workunit.client.0.smithi170.stdout:2/379: dwrite d10/d1e/f20 [0,4194304] 0 2024-01-25T15:03:36.271 INFO:tasks.workunit.client.0.smithi170.stdout:2/380: stat d10/d16/c2a 0 2024-01-25T15:03:36.271 INFO:tasks.workunit.client.0.smithi170.stdout:2/381: fdatasync d10/d1b/d5f/f78 0 2024-01-25T15:03:36.272 INFO:tasks.workunit.client.0.smithi170.stdout:8/275: mknod d3/d7/d22/d23/d48/d52/d47/c5f 0 2024-01-25T15:03:36.273 INFO:tasks.workunit.client.0.smithi170.stdout:9/360: mkdir d5/df/d16/d35/d3c/d56/d85 0 2024-01-25T15:03:36.274 INFO:tasks.workunit.client.0.smithi170.stdout:9/361: write d5/df/d16/d35/d3c/f45 [108246,105843] 0 2024-01-25T15:03:36.274 INFO:tasks.workunit.client.0.smithi170.stdout:9/362: write d5/df/d16/f19 [2787847,92570] 0 2024-01-25T15:03:36.276 INFO:tasks.workunit.client.0.smithi170.stdout:0/328: mknod d8/d10/d2d/d2f/d4f/d5f/c6e 0 2024-01-25T15:03:36.279 INFO:tasks.workunit.client.0.smithi170.stdout:0/329: mknod d8/d3a/c6f 0 2024-01-25T15:03:36.281 INFO:tasks.workunit.client.0.smithi170.stdout:8/276: write d3/d7/d22/d23/f4a [1695328,77623] 0 2024-01-25T15:03:36.281 INFO:tasks.workunit.client.0.smithi170.stdout:0/330: mknod d8/d10/d2d/d2f/d6a/c70 0 2024-01-25T15:03:36.281 INFO:tasks.workunit.client.0.smithi170.stdout:0/331: readlink d8/d9/l21 0 2024-01-25T15:03:36.281 INFO:tasks.workunit.client.0.smithi170.stdout:0/332: fdatasync d8/d9/f29 0 2024-01-25T15:03:36.291 INFO:tasks.workunit.client.0.smithi170.stdout:0/333: dread d8/d18/f4d [0,4194304] 0 2024-01-25T15:03:36.291 INFO:tasks.workunit.client.0.smithi170.stdout:3/387: rename d3/d10/d13/d1b/d29/d38 to d3/d10/d1e/d21/d41/d77 0 2024-01-25T15:03:36.293 INFO:tasks.workunit.client.0.smithi170.stdout:0/334: symlink d8/d18/l71 0 2024-01-25T15:03:36.294 INFO:tasks.workunit.client.0.smithi170.stdout:8/277: write d3/d7/d22/d23/d25/f5b [2948422,1123] 0 2024-01-25T15:03:36.295 INFO:tasks.workunit.client.0.smithi170.stdout:0/335: truncate d8/d10/f4b 539641 0 2024-01-25T15:03:36.296 INFO:tasks.workunit.client.0.smithi170.stdout:0/336: dread d8/d9/f46 [0,4194304] 0 2024-01-25T15:03:36.299 INFO:tasks.workunit.client.0.smithi170.stdout:9/363: dwrite d5/f8 [4194304,4194304] 0 2024-01-25T15:03:36.301 INFO:tasks.workunit.client.0.smithi170.stdout:9/364: getdents d5/df/d16 0 2024-01-25T15:03:36.301 INFO:tasks.workunit.client.0.smithi170.stdout:9/365: write d5/df/d2e/f7d [571058,123992] 0 2024-01-25T15:03:36.301 INFO:tasks.workunit.client.0.smithi170.stdout:9/366: read - d5/dc/f36 zero size 2024-01-25T15:03:36.303 INFO:tasks.workunit.client.0.smithi170.stdout:4/303: rename c5 to d6/d7/d34/c54 0 2024-01-25T15:03:36.314 INFO:tasks.workunit.client.0.smithi170.stdout:8/278: write d3/d7/d22/d23/d48/d52/f35 [2022940,98373] 0 2024-01-25T15:03:36.314 INFO:tasks.workunit.client.0.smithi170.stdout:8/279: write d3/d7/d22/d23/d25/f5b [1308922,49173] 0 2024-01-25T15:03:36.316 INFO:tasks.workunit.client.0.smithi170.stdout:8/280: mknod d3/d7/d22/d23/d25/d41/c60 0 2024-01-25T15:03:36.316 INFO:tasks.workunit.client.0.smithi170.stdout:8/281: read d3/d7/d22/d23/f4a [3100493,71083] 0 2024-01-25T15:03:36.316 INFO:tasks.workunit.client.0.smithi170.stdout:8/282: truncate d3/d7/d22/d23/d48/d52/d47/f4b 547930 0 2024-01-25T15:03:36.316 INFO:tasks.workunit.client.0.smithi170.stdout:8/283: fdatasync f0 0 2024-01-25T15:03:36.318 INFO:tasks.workunit.client.0.smithi170.stdout:8/284: mkdir d3/d7/d22/d23/d25/d41/d61 0 2024-01-25T15:03:36.319 INFO:tasks.workunit.client.0.smithi170.stdout:3/388: dwrite d3/d1c/f6f [0,4194304] 0 2024-01-25T15:03:36.322 INFO:tasks.workunit.client.0.smithi170.stdout:4/304: dwrite d6/d7/d31/f43 [0,4194304] 0 2024-01-25T15:03:36.326 INFO:tasks.workunit.client.0.smithi170.stdout:3/389: link d3/d1c/d2d/l51 d3/d10/d52/l78 0 2024-01-25T15:03:36.329 INFO:tasks.workunit.client.0.smithi170.stdout:4/305: dread d6/d28/f45 [0,4194304] 0 2024-01-25T15:03:36.329 INFO:tasks.workunit.client.0.smithi170.stdout:4/306: chown d6 434273104 1 2024-01-25T15:03:36.332 INFO:tasks.workunit.client.0.smithi170.stdout:3/390: unlink d3/d1c/d2d/f48 0 2024-01-25T15:03:36.335 INFO:tasks.workunit.client.0.smithi170.stdout:3/391: unlink d3/d10/f16 0 2024-01-25T15:03:36.339 INFO:tasks.workunit.client.0.smithi170.stdout:9/367: dwrite d5/df/d2e/f7d [0,4194304] 0 2024-01-25T15:03:36.342 INFO:tasks.workunit.client.0.smithi170.stdout:8/285: dwrite d3/d7/d22/f5a [0,4194304] 0 2024-01-25T15:03:36.342 INFO:tasks.workunit.client.0.smithi170.stdout:8/286: write d3/d7/d22/d23/d48/d52/f35 [1817640,118661] 0 2024-01-25T15:03:36.343 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:36.043+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012dc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/net_cmdlib.sh auth v10 ap=1 s=1194 n(v0 rc2024-01-25T15:03:12.718710+0000 b1194 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56554461a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012dc:[<0x100000012db/net_cmdlib.sh v10>,<0x10000000204/lib v391>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012dc:[<0x100000012db/net_cmdlib.sh v10>,<0x10000000204/lib v391>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.343 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:36.043+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/Makefile auth v8 ap=1 s=1042 n(v0 rc2009-10-09T17:56:03.000000+0000 b1042 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56554461a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d6:[<0x100000012db/Makefile v8>,<0x10000000204/lib v391>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000010d6:[<0x100000012db/Makefile v8>,<0x10000000204/lib v391>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.343 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:36.044+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000010d7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/cmdlib.sh auth v12 ap=1 s=4069 n(v0 rc2009-11-09T06:55:12.000000+0000 b4069 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554461ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000010d7:[<0x100000012db/cmdlib.sh v6>,<0x10000000204/lib v391>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000010d7:[<0x100000012db/cmdlib.sh v12>,<0x10000000204/lib v470>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.343 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-mon[36347]: scrub queued for path: / 2024-01-25T15:03:36.343 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:36.343 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:36.343 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:36.348 INFO:tasks.workunit.client.0.smithi170.stdout:9/368: dread d5/dc/f30 [0,4194304] 0 2024-01-25T15:03:36.350 INFO:tasks.workunit.client.0.smithi170.stdout:3/392: symlink d3/d10/d13/l79 0 2024-01-25T15:03:36.369 INFO:tasks.workunit.client.0.smithi170.stdout:9/369: unlink d5/df/f3b 0 2024-01-25T15:03:36.370 INFO:tasks.workunit.client.0.smithi170.stdout:4/307: creat d6/d28/f55 x:0 0 0 2024-01-25T15:03:36.371 INFO:tasks.workunit.client.0.smithi170.stdout:4/308: creat d6/d28/f56 x:0 0 0 2024-01-25T15:03:36.376 INFO:tasks.workunit.client.0.smithi170.stdout:8/287: rmdir d3/d7 39 2024-01-25T15:03:36.376 INFO:tasks.workunit.client.0.smithi170.stdout:8/288: read - d3/d7/f56 zero size 2024-01-25T15:03:36.376 INFO:tasks.workunit.client.0.smithi170.stdout:8/289: stat d3/d7/d22 0 2024-01-25T15:03:36.378 INFO:tasks.workunit.client.0.smithi170.stdout:2/382: rename d10/d1e/d32/f4b to d10/d1e/d32/d63/f8e 0 2024-01-25T15:03:36.380 INFO:tasks.workunit.client.0.smithi170.stdout:8/290: creat d3/d7/f62 x:0 0 0 2024-01-25T15:03:36.382 INFO:tasks.workunit.client.0.smithi170.stdout:9/370: mkdir d5/df/d2e/d77/d86 0 2024-01-25T15:03:36.382 INFO:tasks.workunit.client.0.smithi170.stdout:9/371: chown d5/df/d2e/d77/d21/d46/f64 1116 1 2024-01-25T15:03:36.382 INFO:tasks.workunit.client.0.smithi170.stdout:7/375: sync 2024-01-25T15:03:36.382 INFO:tasks.workunit.client.0.smithi170.stdout:6/363: sync 2024-01-25T15:03:36.382 INFO:tasks.workunit.client.0.smithi170.stdout:5/292: sync 2024-01-25T15:03:36.382 INFO:tasks.workunit.client.0.smithi170.stdout:1/359: sync 2024-01-25T15:03:36.382 INFO:tasks.workunit.client.0.smithi170.stdout:1/360: write d0/d20/d28/f70 [230897,57241] 0 2024-01-25T15:03:36.383 INFO:tasks.workunit.client.0.smithi170.stdout:0/337: rename d8/d10/d5a/c5b to d8/d10/d2d/d53/c72 0 2024-01-25T15:03:36.384 INFO:tasks.workunit.client.0.smithi170.stdout:9/372: creat d5/df/d16/d35/d3c/d56/d59/d5e/f87 x:0 0 0 2024-01-25T15:03:36.385 INFO:tasks.workunit.client.0.smithi170.stdout:7/376: creat d8/d20/d45/d8e/f96 x:0 0 0 2024-01-25T15:03:36.386 INFO:tasks.workunit.client.0.smithi170.stdout:5/293: fsync d5/d2a/f4a 0 2024-01-25T15:03:36.387 INFO:tasks.workunit.client.0.smithi170.stdout:1/361: link d0/d20/d28/f66 d0/d20/d3a/d60/f7d 0 2024-01-25T15:03:36.387 INFO:tasks.workunit.client.0.smithi170.stdout:1/362: chown d0/d2e 26528157 1 2024-01-25T15:03:36.388 INFO:tasks.workunit.client.0.smithi170.stdout:7/377: dread d8/d20/d45/f59 [0,4194304] 0 2024-01-25T15:03:36.388 INFO:tasks.workunit.client.0.smithi170.stdout:7/378: write d8/d20/d45/d68/f84 [316400,77283] 0 2024-01-25T15:03:36.388 INFO:tasks.workunit.client.0.smithi170.stdout:7/379: chown d8/d20/f29 2599 1 2024-01-25T15:03:36.388 INFO:tasks.workunit.client.0.smithi170.stdout:6/364: dread d2/f3 [0,4194304] 0 2024-01-25T15:03:36.388 INFO:tasks.workunit.client.0.smithi170.stdout:6/365: fsync d2/d7/d23/d19/d2f/d5d/f6f 0 2024-01-25T15:03:36.389 INFO:tasks.workunit.client.0.smithi170.stdout:3/393: rename d3/d10/d13/l47 to d3/d10/d1e/d21/d41/d4b/l7a 0 2024-01-25T15:03:36.389 INFO:tasks.workunit.client.0.smithi170.stdout:7/380: creat d8/d20/d3b/d4d/f97 x:0 0 0 2024-01-25T15:03:36.390 INFO:tasks.workunit.client.0.smithi170.stdout:9/373: mknod d5/dc/c88 0 2024-01-25T15:03:36.391 INFO:tasks.workunit.client.0.smithi170.stdout:3/394: creat d3/d10/d1e/d21/d41/d77/d42/d72/f7b x:0 0 0 2024-01-25T15:03:36.393 INFO:tasks.workunit.client.0.smithi170.stdout:1/363: symlink d0/d20/d3a/d60/l7e 0 2024-01-25T15:03:36.395 INFO:tasks.workunit.client.0.smithi170.stdout:6/366: mknod d2/d7/c7f 0 2024-01-25T15:03:36.395 INFO:tasks.workunit.client.0.smithi170.stdout:6/367: chown d2/d7/f1c 631970025 1 2024-01-25T15:03:36.395 INFO:tasks.workunit.client.0.smithi170.stdout:6/368: chown d2/d7/d23/d19/d2f/d5d/f6f 4898400 1 2024-01-25T15:03:36.396 INFO:tasks.workunit.client.0.smithi170.stdout:7/381: mknod d8/d20/d45/d8e/c98 0 2024-01-25T15:03:36.397 INFO:tasks.workunit.client.0.smithi170.stdout:3/395: symlink d3/d10/d6d/d74/l7c 0 2024-01-25T15:03:36.399 INFO:tasks.workunit.client.0.smithi170.stdout:1/364: symlink d0/d50/l7f 0 2024-01-25T15:03:36.401 INFO:tasks.workunit.client.0.smithi170.stdout:9/374: dread d5/df/d2e/d77/f2a [0,4194304] 0 2024-01-25T15:03:36.401 INFO:tasks.workunit.client.0.smithi170.stdout:6/369: mkdir d2/d7/d23/d19/d2a/d43/d44/d80 0 2024-01-25T15:03:36.401 INFO:tasks.workunit.client.0.smithi170.stdout:8/291: dwrite d3/d7/d1e/f45 [0,4194304] 0 2024-01-25T15:03:36.402 INFO:tasks.workunit.client.0.smithi170.stdout:3/396: truncate d3/d2a/f5f 756127 0 2024-01-25T15:03:36.402 INFO:tasks.workunit.client.0.smithi170.stdout:3/397: truncate d3/d10/ff 4722684 0 2024-01-25T15:03:36.403 INFO:tasks.workunit.client.0.smithi170.stdout:8/292: dread d3/d7/d22/d23/d25/f5c [0,4194304] 0 2024-01-25T15:03:36.403 INFO:tasks.workunit.client.0.smithi170.stdout:8/293: write d3/d7/d22/d23/f54 [1045135,121063] 0 2024-01-25T15:03:36.406 INFO:tasks.workunit.client.0.smithi170.stdout:3/398: getdents d3/d2a/d53 0 2024-01-25T15:03:36.408 INFO:tasks.workunit.client.0.smithi170.stdout:8/294: symlink d3/d7/d22/d5d/l63 0 2024-01-25T15:03:36.408 INFO:tasks.workunit.client.0.smithi170.stdout:8/295: fsync d3/d7/d22/d23/d48/d52/f35 0 2024-01-25T15:03:36.408 INFO:tasks.workunit.client.0.smithi170.stdout:8/296: stat d3/d7/d1e/l21 0 2024-01-25T15:03:36.411 INFO:tasks.workunit.client.0.smithi170.stdout:6/370: read d2/d7/d23/d19/d2a/f55 [2159789,94565] 0 2024-01-25T15:03:36.411 INFO:tasks.workunit.client.0.smithi170.stdout:6/371: chown d2/d7/d23/d19/d2a/c4b 11553 1 2024-01-25T15:03:36.415 INFO:tasks.workunit.client.0.smithi170.stdout:5/294: dwrite d5/d10/f1a [0,4194304] 0 2024-01-25T15:03:36.425 INFO:tasks.workunit.client.0.smithi170.stdout:3/399: dread d3/d10/d13/f1f [0,4194304] 0 2024-01-25T15:03:36.425 INFO:tasks.workunit.client.0.smithi170.stdout:3/400: write d3/d1c/f24 [1340719,5167] 0 2024-01-25T15:03:36.425 INFO:tasks.workunit.client.0.smithi170.stdout:3/401: creat d3/d2a/f7d x:0 0 0 2024-01-25T15:03:36.426 INFO:tasks.workunit.client.0.smithi170.stdout:7/382: dwrite d8/d20/f2e [4194304,4194304] 0 2024-01-25T15:03:36.426 INFO:tasks.workunit.client.0.smithi170.stdout:8/297: dread d3/d7/d22/d23/f54 [0,4194304] 0 2024-01-25T15:03:36.427 INFO:tasks.workunit.client.0.smithi170.stdout:5/295: creat d5/d10/d2c/d45/f6c x:0 0 0 2024-01-25T15:03:36.430 INFO:tasks.workunit.client.0.smithi170.stdout:1/365: getdents d0/d20/d3a/d60 0 2024-01-25T15:03:36.432 INFO:tasks.workunit.client.0.smithi170.stdout:9/375: dwrite d5/df/d2e/f39 [4194304,4194304] 0 2024-01-25T15:03:36.433 INFO:tasks.workunit.client.0.smithi170.stdout:3/402: mkdir d3/d2a/d7e 0 2024-01-25T15:03:36.436 INFO:tasks.workunit.client.0.smithi170.stdout:3/403: read d3/d2a/f5f [672252,26018] 0 2024-01-25T15:03:36.436 INFO:tasks.workunit.client.0.smithi170.stdout:3/404: stat d3/d10/d1e/d21/d41/d4b/d63 0 2024-01-25T15:03:36.437 INFO:tasks.workunit.client.0.smithi170.stdout:5/296: creat d5/d10/d2c/d51/d3d/f6d x:0 0 0 2024-01-25T15:03:36.437 INFO:tasks.workunit.client.0.smithi170.stdout:5/297: write d5/d10/d2c/f5f [706132,53619] 0 2024-01-25T15:03:36.442 INFO:tasks.workunit.client.0.smithi170.stdout:3/405: link d3/d10/d52/f64 d3/d1c/d2b/f7f 0 2024-01-25T15:03:36.442 INFO:tasks.workunit.client.0.smithi170.stdout:3/406: write d3/d2a/f5f [1284396,119954] 0 2024-01-25T15:03:36.442 INFO:tasks.workunit.client.0.smithi170.stdout:3/407: fsync d3/f4c 0 2024-01-25T15:03:36.442 INFO:tasks.workunit.client.0.smithi170.stdout:3/408: write d3/f68 [921132,107088] 0 2024-01-25T15:03:36.443 INFO:tasks.workunit.client.0.smithi170.stdout:5/298: creat d5/d10/d2c/d34/f6e x:0 0 0 2024-01-25T15:03:36.443 INFO:tasks.workunit.client.0.smithi170.stdout:5/299: fsync d5/f1b 0 2024-01-25T15:03:36.444 INFO:tasks.workunit.client.0.smithi170.stdout:1/366: rmdir d0/d50 39 2024-01-25T15:03:36.446 INFO:tasks.workunit.client.0.smithi170.stdout:3/409: symlink d3/d1c/d2b/d5c/l80 0 2024-01-25T15:03:36.450 INFO:tasks.workunit.client.0.smithi170.stdout:5/300: symlink d5/d10/d2c/d45/d56/l6f 0 2024-01-25T15:03:36.451 INFO:tasks.workunit.client.0.smithi170.stdout:1/367: dread d0/d20/d28/d2a/d4a/d56/d5b/f68 [0,4194304] 0 2024-01-25T15:03:36.454 INFO:tasks.workunit.client.0.smithi170.stdout:2/383: rename d10/d16/f19 to d10/d1e/d32/d62/d74/f8f 0 2024-01-25T15:03:36.454 INFO:tasks.workunit.client.0.smithi170.stdout:2/384: write d10/d1e/f53 [1084623,73004] 0 2024-01-25T15:03:36.454 INFO:tasks.workunit.client.0.smithi170.stdout:2/385: stat l2 0 2024-01-25T15:03:36.455 INFO:tasks.workunit.client.0.smithi170.stdout:5/301: symlink d5/d10/d2c/d51/d41/l70 0 2024-01-25T15:03:36.458 INFO:tasks.workunit.client.0.smithi170.stdout:0/338: rename d8/d9/ld to d8/d10/d2d/d2f/d6a/l73 0 2024-01-25T15:03:36.459 INFO:tasks.workunit.client.0.smithi170.stdout:2/386: creat d10/d1e/d32/d63/f90 x:0 0 0 2024-01-25T15:03:36.459 INFO:tasks.workunit.client.0.smithi170.stdout:2/387: write d10/d1e/d32/d3e/f47 [135977,27165] 0 2024-01-25T15:03:36.460 INFO:tasks.workunit.client.0.smithi170.stdout:2/388: creat d10/d1e/f91 x:0 0 0 2024-01-25T15:03:36.460 INFO:tasks.workunit.client.0.smithi170.stdout:2/389: stat d10/d1e/d32/d3e 0 2024-01-25T15:03:36.463 INFO:tasks.workunit.client.0.smithi170.stdout:9/376: rename d5/df/d2e/d77/d21/d46/d18/d6a/l7e to d5/df/d2e/d77/d21/d46/d6c/l89 0 2024-01-25T15:03:36.465 INFO:tasks.workunit.client.0.smithi170.stdout:8/298: dwrite d3/d7/d3a/f3f [0,4194304] 0 2024-01-25T15:03:36.466 INFO:tasks.workunit.client.0.smithi170.stdout:8/299: fdatasync d3/d7/d3a/f3f 0 2024-01-25T15:03:36.466 INFO:tasks.workunit.client.0.smithi170.stdout:5/302: mknod d5/d2a/c71 0 2024-01-25T15:03:36.467 INFO:tasks.workunit.client.0.smithi170.stdout:9/377: mkdir d5/df/d16/d35/d3c/d56/d85/d8a 0 2024-01-25T15:03:36.467 INFO:tasks.workunit.client.0.smithi170.stdout:9/378: read - d5/df/d2e/d77/d21/d46/f64 zero size 2024-01-25T15:03:36.467 INFO:tasks.workunit.client.0.smithi170.stdout:9/379: write d5/dc/f36 [431711,128312] 0 2024-01-25T15:03:36.472 INFO:tasks.workunit.client.0.smithi170.stdout:8/300: mknod d3/c64 0 2024-01-25T15:03:36.474 INFO:tasks.workunit.client.0.smithi170.stdout:5/303: mkdir d5/d10/d2c/d45/d56/d72 0 2024-01-25T15:03:36.474 INFO:tasks.workunit.client.0.smithi170.stdout:5/304: write d5/d10/f5a [396038,47883] 0 2024-01-25T15:03:36.475 INFO:tasks.workunit.client.0.smithi170.stdout:0/339: dread d8/fa [0,4194304] 0 2024-01-25T15:03:36.476 INFO:tasks.workunit.client.0.smithi170.stdout:7/383: rmdir d8/d20/d3b/d4d 39 2024-01-25T15:03:36.476 INFO:tasks.workunit.client.0.smithi170.stdout:3/410: dwrite d3/fa [0,4194304] 0 2024-01-25T15:03:36.478 INFO:tasks.workunit.client.0.smithi170.stdout:9/380: creat d5/df/d2e/d77/d21/d46/d18/d6a/f8b x:0 0 0 2024-01-25T15:03:36.480 INFO:tasks.workunit.client.0.smithi170.stdout:5/305: creat d5/d10/d2c/d45/d56/d72/f73 x:0 0 0 2024-01-25T15:03:36.480 INFO:tasks.workunit.client.0.smithi170.stdout:5/306: fsync d5/d10/f5c 0 2024-01-25T15:03:36.480 INFO:tasks.workunit.client.0.smithi170.stdout:5/307: creat d5/d10/d2c/d51/d3d/f74 x:0 0 0 2024-01-25T15:03:36.484 INFO:tasks.workunit.client.0.smithi170.stdout:7/384: creat d8/d20/d3b/f99 x:0 0 0 2024-01-25T15:03:36.484 INFO:tasks.workunit.client.0.smithi170.stdout:7/385: write d8/d20/d2a/d61/f63 [1094753,77513] 0 2024-01-25T15:03:36.484 INFO:tasks.workunit.client.0.smithi170.stdout:5/308: read d5/d2a/f3e [499151,25046] 0 2024-01-25T15:03:36.484 INFO:tasks.workunit.client.0.smithi170.stdout:7/386: dread d8/d20/d2a/d35/f44 [0,4194304] 0 2024-01-25T15:03:36.484 INFO:tasks.workunit.client.0.smithi170.stdout:2/390: dwrite d10/d1e/d32/d63/f8e [0,4194304] 0 2024-01-25T15:03:36.485 INFO:tasks.workunit.client.0.smithi170.stdout:1/368: dwrite d0/fd [4194304,4194304] 0 2024-01-25T15:03:36.488 INFO:tasks.workunit.client.0.smithi170.stdout:3/411: dread d3/d10/d1e/d21/d41/d77/f4e [0,4194304] 0 2024-01-25T15:03:36.492 INFO:tasks.workunit.client.0.smithi170.stdout:9/381: mknod d5/df/d2e/d77/d21/d34/d3e/c8c 0 2024-01-25T15:03:36.497 INFO:tasks.workunit.client.0.smithi170.stdout:5/309: link d5/d10/d2c/d51/d41/f44 d5/d10/d2c/d45/f75 0 2024-01-25T15:03:36.499 INFO:tasks.workunit.client.0.smithi170.stdout:2/391: unlink d10/d1b/c3c 0 2024-01-25T15:03:36.499 INFO:tasks.workunit.client.0.smithi170.stdout:2/392: truncate d10/d1e/f58 994968 0 2024-01-25T15:03:36.499 INFO:tasks.workunit.client.0.smithi170.stdout:8/301: dwrite d3/f9 [8388608,4194304] 0 2024-01-25T15:03:36.500 INFO:tasks.workunit.client.0.smithi170.stdout:1/369: creat d0/d1b/f80 x:0 0 0 2024-01-25T15:03:36.502 INFO:tasks.workunit.client.0.smithi170.stdout:5/310: unlink d5/d10/l36 0 2024-01-25T15:03:36.503 INFO:tasks.workunit.client.0.smithi170.stdout:3/412: write d3/d1c/d2b/f62 [1914008,53828] 0 2024-01-25T15:03:36.509 INFO:tasks.workunit.client.0.smithi170.stdout:7/387: mknod d8/c9a 0 2024-01-25T15:03:36.509 INFO:tasks.workunit.client.0.smithi170.stdout:2/393: getdents d10/d16 0 2024-01-25T15:03:36.512 INFO:tasks.workunit.client.0.smithi170.stdout:8/302: creat d3/d7/d22/d23/d48/f65 x:0 0 0 2024-01-25T15:03:36.513 INFO:tasks.workunit.client.0.smithi170.stdout:9/382: dwrite d5/df/f20 [0,4194304] 0 2024-01-25T15:03:36.513 INFO:tasks.workunit.client.0.smithi170.stdout:9/383: dread - d5/df/d2e/d77/d21/d46/d6c/f71 zero size 2024-01-25T15:03:36.513 INFO:tasks.workunit.client.0.smithi170.stdout:9/384: stat d5/df/d2e/d77/d21/d34/d3e/d7f 0 2024-01-25T15:03:36.513 INFO:tasks.workunit.client.0.smithi170.stdout:9/385: truncate d5/df/d2e/d77/d21/d46/d6c/f71 603425 0 2024-01-25T15:03:36.513 INFO:tasks.workunit.client.0.smithi170.stdout:1/370: mkdir d0/d20/d28/d2a/d4a/d56/d81 0 2024-01-25T15:03:36.515 INFO:tasks.workunit.client.0.smithi170.stdout:8/303: getdents d3/d7/d22/d23/d48/d52/d47 0 2024-01-25T15:03:36.515 INFO:tasks.workunit.client.0.smithi170.stdout:7/388: mkdir d8/d20/d2a/d35/d55/d9b 0 2024-01-25T15:03:36.516 INFO:tasks.workunit.client.0.smithi170.stdout:7/389: chown d8/d20/d73/c95 314038 1 2024-01-25T15:03:36.516 INFO:tasks.workunit.client.0.smithi170.stdout:7/390: write d8/f1c [2396963,94353] 0 2024-01-25T15:03:36.516 INFO:tasks.workunit.client.0.smithi170.stdout:8/304: dread d3/d7/d22/d23/d48/d52/d47/f4b [0,4194304] 0 2024-01-25T15:03:36.519 INFO:tasks.workunit.client.0.smithi170.stdout:7/391: truncate d8/d20/d45/f46 885690 0 2024-01-25T15:03:36.520 INFO:tasks.workunit.client.0.smithi170.stdout:9/386: rmdir d5/dc 39 2024-01-25T15:03:36.522 INFO:tasks.workunit.client.0.smithi170.stdout:7/392: rename d8/d20/d45/d8e/f96 to d8/d20/d2a/f9c 0 2024-01-25T15:03:36.523 INFO:tasks.workunit.client.0.smithi170.stdout:9/387: mkdir d5/df/d2e/d77/d86/d8d 0 2024-01-25T15:03:36.530 INFO:tasks.workunit.client.0.smithi170.stdout:2/394: truncate d10/d1e/d32/d63/f8e 3184683 0 2024-01-25T15:03:36.530 INFO:tasks.workunit.client.0.smithi170.stdout:2/395: chown d10/d16/c2a 1016378902 1 2024-01-25T15:03:36.530 INFO:tasks.workunit.client.0.smithi170.stdout:2/396: chown d10/d1e/f71 84 1 2024-01-25T15:03:36.534 INFO:tasks.workunit.client.0.smithi170.stdout:2/397: rename d10/d1e/d32/d84 to d10/d1e/d32/d3e/d5c/d92 0 2024-01-25T15:03:36.534 INFO:tasks.workunit.client.0.smithi170.stdout:2/398: creat d10/d1b/d5f/f93 x:0 0 0 2024-01-25T15:03:36.534 INFO:tasks.workunit.client.0.smithi170.stdout:4/309: sync 2024-01-25T15:03:36.535 INFO:tasks.workunit.client.0.smithi170.stdout:5/311: dwrite d5/f1b [4194304,4194304] 0 2024-01-25T15:03:36.535 INFO:tasks.workunit.client.0.smithi170.stdout:3/413: dwrite d3/d10/d13/f1d [0,4194304] 0 2024-01-25T15:03:36.536 INFO:tasks.workunit.client.0.smithi170.stdout:1/371: dwrite d0/d20/d28/f4c [4194304,4194304] 0 2024-01-25T15:03:36.538 INFO:tasks.workunit.client.0.smithi170.stdout:3/414: dread d3/d10/ff [4194304,4194304] 0 2024-01-25T15:03:36.538 INFO:tasks.workunit.client.0.smithi170.stdout:3/415: chown d3/d10/d1e/d21/d41 7 1 2024-01-25T15:03:36.542 INFO:tasks.workunit.client.0.smithi170.stdout:8/305: dwrite d3/d7/f56 [0,4194304] 0 2024-01-25T15:03:36.548 INFO:tasks.workunit.client.0.smithi170.stdout:7/393: write d8/d20/d45/f46 [1764685,51586] 0 2024-01-25T15:03:36.550 INFO:tasks.workunit.client.0.smithi170.stdout:5/312: read d5/d10/f1a [1699241,58950] 0 2024-01-25T15:03:36.557 INFO:tasks.workunit.client.0.smithi170.stdout:8/306: dread d3/d7/d22/f5a [0,4194304] 0 2024-01-25T15:03:36.561 INFO:tasks.workunit.client.0.smithi170.stdout:7/394: rename d8/d20/d45/d68/d71/f8a to d8/d20/d45/d8e/f9d 0 2024-01-25T15:03:36.561 INFO:tasks.workunit.client.0.smithi170.stdout:7/395: write d8/d20/d2a/f3d [37601,32113] 0 2024-01-25T15:03:36.562 INFO:tasks.workunit.client.0.smithi170.stdout:7/396: write f7 [5667418,122407] 0 2024-01-25T15:03:36.563 INFO:tasks.workunit.client.0.smithi170.stdout:8/307: creat d3/d7/d1e/f66 x:0 0 0 2024-01-25T15:03:36.563 INFO:tasks.workunit.client.0.smithi170.stdout:8/308: write d3/d7/d22/d23/d25/f5b [1441816,66542] 0 2024-01-25T15:03:36.563 INFO:tasks.workunit.client.0.smithi170.stdout:9/388: dwrite d5/dc/d42/f44 [0,4194304] 0 2024-01-25T15:03:36.566 INFO:tasks.workunit.client.0.smithi170.stdout:1/372: dwrite d0/d20/d28/d2a/d4a/d56/f64 [0,4194304] 0 2024-01-25T15:03:36.566 INFO:tasks.workunit.client.0.smithi170.stdout:1/373: write d0/f46 [486777,109941] 0 2024-01-25T15:03:36.566 INFO:tasks.workunit.client.0.smithi170.stdout:8/309: dread d3/d7/d22/d23/f54 [0,4194304] 0 2024-01-25T15:03:36.566 INFO:tasks.workunit.client.0.smithi170.stdout:8/310: write d3/d7/d1e/f66 [304287,2092] 0 2024-01-25T15:03:36.568 INFO:tasks.workunit.client.0.smithi170.stdout:7/397: rename d8/d20/d2a/d35/f65 to d8/f9e 0 2024-01-25T15:03:36.570 INFO:tasks.workunit.client.0.smithi170.stdout:1/374: symlink d0/d20/d28/d2a/d4a/d56/d5b/d72/l82 0 2024-01-25T15:03:36.573 INFO:tasks.workunit.client.0.smithi170.stdout:9/389: rename d5/f29 to d5/df/d2e/d77/d21/d46/f8e 0 2024-01-25T15:03:36.575 INFO:tasks.workunit.client.0.smithi170.stdout:7/398: mknod d8/d20/d45/d68/c9f 0 2024-01-25T15:03:36.576 INFO:tasks.workunit.client.0.smithi170.stdout:1/375: mknod d0/d1b/c83 0 2024-01-25T15:03:36.578 INFO:tasks.workunit.client.0.smithi170.stdout:8/311: rename d3/d7/f2a to d3/d7/f67 0 2024-01-25T15:03:36.578 INFO:tasks.workunit.client.0.smithi170.stdout:8/312: stat d3/d7/d22/d23/d25/d41/d61 0 2024-01-25T15:03:36.578 INFO:tasks.workunit.client.0.smithi170.stdout:8/313: fsync d3/f42 0 2024-01-25T15:03:36.578 INFO:tasks.workunit.client.0.smithi170.stdout:7/399: mknod d8/d20/d45/d68/d71/ca0 0 2024-01-25T15:03:36.580 INFO:tasks.workunit.client.0.smithi170.stdout:8/314: symlink d3/d7/d3a/l68 0 2024-01-25T15:03:36.582 INFO:tasks.workunit.client.0.smithi170.stdout:8/315: mknod d3/d7/c69 0 2024-01-25T15:03:36.582 INFO:tasks.workunit.client.0.smithi170.stdout:4/310: dwrite d6/d7/f1a [0,4194304] 0 2024-01-25T15:03:36.583 INFO:tasks.workunit.client.0.smithi170.stdout:8/316: rmdir d3 39 2024-01-25T15:03:36.583 INFO:tasks.workunit.client.0.smithi170.stdout:2/399: dwrite f6 [0,4194304] 0 2024-01-25T15:03:36.588 INFO:tasks.workunit.client.0.smithi170.stdout:6/372: sync 2024-01-25T15:03:36.588 INFO:tasks.workunit.client.0.smithi170.stdout:6/373: fdatasync d2/d7/d23/d19/d2a/d43/f51 0 2024-01-25T15:03:36.588 INFO:tasks.workunit.client.0.smithi170.stdout:6/374: fsync d2/d7/d1b/f1f 0 2024-01-25T15:03:36.588 INFO:tasks.workunit.client.0.smithi170.stdout:2/400: creat d10/d1e/d32/d3e/d5c/f94 x:0 0 0 2024-01-25T15:03:36.588 INFO:tasks.workunit.client.0.smithi170.stdout:3/416: dwrite d3/d10/f1a [0,4194304] 0 2024-01-25T15:03:36.588 INFO:tasks.workunit.client.0.smithi170.stdout:5/313: dwrite d5/d10/f1c [0,4194304] 0 2024-01-25T15:03:36.588 INFO:tasks.workunit.client.0.smithi170.stdout:2/401: creat d10/d1e/d32/d3e/f95 x:0 0 0 2024-01-25T15:03:36.588 INFO:tasks.workunit.client.0.smithi170.stdout:3/417: mkdir d3/d10/d13/d1b/d81 0 2024-01-25T15:03:36.589 INFO:tasks.workunit.client.0.smithi170.stdout:2/402: creat d10/d1e/d32/d62/d8d/f96 x:0 0 0 2024-01-25T15:03:36.595 INFO:tasks.workunit.client.0.smithi170.stdout:3/418: mknod d3/d10/d1e/d21/d41/d4a/c82 0 2024-01-25T15:03:36.595 INFO:tasks.workunit.client.0.smithi170.stdout:3/419: stat d3/d10/d13/f65 0 2024-01-25T15:03:36.596 INFO:tasks.workunit.client.0.smithi170.stdout:8/317: dread d3/d7/d22/d23/d25/f3c [0,4194304] 0 2024-01-25T15:03:36.599 INFO:tasks.workunit.client.0.smithi170.stdout:1/376: dwrite d0/d1b/f1c [0,4194304] 0 2024-01-25T15:03:36.603 INFO:tasks.workunit.client.0.smithi170.stdout:1/377: rename d0/d20/d28/d2a/d4a/d56/l77 to d0/d20/d28/d2a/d57/l84 0 2024-01-25T15:03:36.604 INFO:tasks.workunit.client.0.smithi170.stdout:9/390: write d5/dc/fd [2690616,95257] 0 2024-01-25T15:03:36.604 INFO:tasks.workunit.client.0.smithi170.stdout:9/391: chown d5/df/d2e/d6b/f72 9 1 2024-01-25T15:03:36.604 INFO:tasks.workunit.client.0.smithi170.stdout:9/392: write d5/dc/f30 [5071667,76984] 0 2024-01-25T15:03:36.604 INFO:tasks.workunit.client.0.smithi170.stdout:9/393: dread - d5/df/d2e/d77/d21/d46/f76 zero size 2024-01-25T15:03:36.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-mon[35697]: scrub queued for path: / 2024-01-25T15:03:36.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:36.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:36.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:36.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:36.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:36.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:36.608 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.206+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f92 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/safhpi.c auth v42 ap=1 s=232609 n(v0 rc2009-12-03T15:31:01.000000+0000 b232609 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea30eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f92:[<0x10000001169/safhpi.c v42>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f92:[<0x10000001169/safhpi.c v42>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.608 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.207+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f8c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/plugin.c auth v62 ap=1 s=35175 n(v0 rc2009-12-03T15:31:01.000000+0000 b35175 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea30e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f8c:[<0x10000001169/plugin.c v6>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f8c:[<0x10000001169/plugin.c v62>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.608 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.207+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f8b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/hotswap.c auth v54 ap=1 s=2866 n(v0 rc2007-06-26T11:01:24.000000+0000 b2866 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea30f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f8b:[<0x10000001169/hotswap.c v54>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f8b:[<0x10000001169/hotswap.c v54>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.609 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.207+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116b [...2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ auth{0=1} v83 ap=1 f(v0 m2024-01-25T15:03:12.389717+0000 4=3+1) n(v1 rc2024-01-25T15:03:12.389717+0000 b90792 30=28+2) (inest mix) (ifile excl) (iversion lock) caps={24803=pAsLsXsFsx/pAsLsXsFsxcral@1},l=24803 | dirtyscattered=0 lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561bea30f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000116b:[<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x1000000116b:[<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-25T15:03:12.389717+0000 4=3+1)","ondisk_value.rstat":"n(v0 rc2024-01-25T15:03:12.389717+0000 b90792 30=28+2)","memory_value.dirstat":"f(v0 m2024-01-25T15:03:12.389717+0000 4=3+1)","memory_value.rstat":"n(v1 rc2024-01-25T15:03:12.389717+0000 b90792 30=28+2)","error_str":""},"return_code":0} 2024-01-25T15:03:36.609 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.207+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f90 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/ohpi.c auth v64 ap=1 s=9754 n(v0 rc2024-01-25T15:03:12.380717+0000 b9754 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea30fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f90:[<0x10000001169/ohpi.c v14>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f90:[<0x10000001169/ohpi.c v64>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.609 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.207+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f94 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/Makefile.in auth v48 ap=1 s=22841 n(v0 rc2024-01-25T15:03:12.381717+0000 b22841 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea310100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f94:[<0x10000001169/Makefile.in v48>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f94:[<0x10000001169/Makefile.in v48>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.609 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.207+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f95 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/threaded.c auth v58 ap=1 s=9350 n(v0 rc2008-07-26T03:51:48.000000+0000 b9350 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea310680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f95:[<0x10000001169/threaded.c v58>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f95:[<0x10000001169/threaded.c v58>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.609 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.208+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f93 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/lock.c auth v60 ap=1 s=850 n(v0 rc2008-07-26T03:51:48.000000+0000 b850 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea310c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f93:[<0x10000001169/lock.c v60>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f93:[<0x10000001169/lock.c v60>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.609 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.208+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fb2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/Makefile.am auth{0=1} v72 ap=1 s=2725 n(v0 rc2008-11-20T11:32:27.000000+0000 b2725 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561bea311180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fb2:[<0x10000001169/Makefile.am v40>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fb2:[<0x10000001169/Makefile.am v72>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.609 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.208+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/plugin_static.c.in auth v52 ap=1 s=607 n(v0 rc2024-01-25T15:03:12.379717+0000 b607 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea311700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116a:[<0x10000001169/plugin_static.c.in v52>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000116a:[<0x10000001169/plugin_static.c.in v52>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.609 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.208+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f91 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/init.c auth{0=1} v68 ap=1 s=5117 n(v0 rc2008-11-20T11:32:27.000000+0000 b5117 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561bea32a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f91:[<0x10000001169/init.c v16>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f91:[<0x10000001169/init.c v68>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.609 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.208+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f8e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/event.c auth{0=1} v78 ap=1 s=13120 n(v0 rc2008-11-20T11:32:27.000000+0000 b13120 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561bea32a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f8e:[<0x10000001169/event.c v10>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f8e:[<0x10000001169/event.c v78>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.609 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.208+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f8f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/alarm.c auth v44 ap=1 s=26361 n(v0 rc2009-12-03T15:31:01.000000+0000 b26361 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea32ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f8f:[<0x10000001169/alarm.c v44>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f8f:[<0x10000001169/alarm.c v44>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.609 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.209+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fb1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/domain.c auth{0=1} v70 ap=1 s=21614 n(v0 rc2008-11-20T11:32:27.000000+0000 b21614 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561bea2b0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fb1:[<0x10000001169/domain.c v38>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fb1:[<0x10000001169/domain.c v70>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.609 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.209+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f8d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/session.c auth{0=1} v76 ap=1 s=14691 n(v0 rc2008-07-26T03:51:48.000000+0000 b14691 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x561bea32b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f8d:[<0x10000001169/session.c v8>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f8d:[<0x10000001169/session.c v76>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.610 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.210+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f96 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/config.c auth v56 ap=1 s=29321 n(v0 rc2008-11-20T11:32:27.000000+0000 b29321 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea32b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f96:[<0x10000001169/config.c v56>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f96:[<0x10000001169/config.c v56>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.610 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.210+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116d [...2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ auth v116 ap=1 f(v0 m2024-01-25T15:03:12.389717+0000 25=25+0) n(v0 rc2024-01-25T15:03:12.389717+0000 b71335 26=25+1) (inest lock) (ifile excl) (iversion lock) caps={24803=pAsLsXsFsx/pAsLsXsFsxcral@1},l=24803 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea32bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000116d:[<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x1000000116d:[<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-25T15:03:12.389717+0000 25=25+0)","ondisk_value.rstat":"n(v0 rc2024-01-25T15:03:12.389717+0000 b71335 26=25+1)","memory_value.dirstat":"f(v0 m2024-01-25T15:03:12.389717+0000 25=25+0)","memory_value.rstat":"n(v0 rc2024-01-25T15:03:12.389717+0000 b71335 26=25+1)","error_str":""},"return_code":0} 2024-01-25T15:03:36.610 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.210+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/Makefile.in auth v96 ap=1 s=16396 n(v0 rc2024-01-25T15:03:12.386717+0000 b16396 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea32c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116c:[<0x1000000116b/Makefile.in v2>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000116c:[<0x1000000116b/Makefile.in v96>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.610 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.210+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fb0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/Makefile.am auth v70 ap=1 s=515 n(v0 rc2007-06-26T11:02:43.000000+0000 b515 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea32c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fb0:[<0x1000000116b/Makefile.am v70>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fb0:[<0x1000000116b/Makefile.am v70>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.610 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.210+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f97 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi_tests.txt auth v106 ap=1 s=2546 n(v0 rc2007-06-26T11:02:44.000000+0000 b2546 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea32cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f97:[<0x1000000116b/ohpi_tests.txt v4>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f97:[<0x1000000116b/ohpi_tests.txt v106>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.610 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.210+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f9a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_032.c auth v94 ap=1 s=2142 n(v0 rc2007-06-25T15:51:11.000000+0000 b2142 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea32d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f9a:[<0x1000000116d/ohpi_032.c v8>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f9a:[<0x1000000116d/ohpi_032.c v94>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.610 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.211+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000116e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_035.c auth v68 ap=1 s=1366 n(v0 rc2024-01-25T15:03:12.388717+0000 b1366 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea32d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000116e:[<0x1000000116d/ohpi_035.c v68>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000116e:[<0x1000000116d/ohpi_035.c v68>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.610 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.211+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_010.c auth v62 ap=1 s=2711 n(v0 rc2007-06-25T15:51:10.000000+0000 b2711 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea336000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa1:[<0x1000000116d/ohpi_010.c v62>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fa1:[<0x1000000116d/ohpi_010.c v62>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.610 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.211+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_034.c auth v88 ap=1 s=2352 n(v0 rc2007-06-25T15:51:12.000000+0000 b2352 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea336580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa4:[<0x1000000116d/ohpi_034.c v28>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fa4:[<0x1000000116d/ohpi_034.c v88>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.610 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.211+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_031.c auth v56 ap=1 s=1520 n(v0 rc2007-06-25T15:51:11.000000+0000 b1520 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea336b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa8:[<0x1000000116d/ohpi_031.c v56>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fa8:[<0x1000000116d/ohpi_031.c v56>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.610 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.211+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000faf [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_version.c auth v66 ap=1 s=1203 n(v0 rc2007-06-25T15:51:13.000000+0000 b1203 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea337080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000faf:[<0x1000000116d/ohpi_version.c v66>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000faf:[<0x1000000116d/ohpi_version.c v66>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.610 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.211+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_008.c auth v86 ap=1 s=2739 n(v0 rc2007-06-25T15:51:10.000000+0000 b2739 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea337600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa3:[<0x1000000116d/ohpi_008.c v26>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fa3:[<0x1000000116d/ohpi_008.c v86>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.610 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.212+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000faa [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/Makefile.in auth v82 ap=1 s=28366 n(v0 rc2009-12-03T15:31:01.000000+0000 b28366 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea337b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000faa:[<0x1000000116d/Makefile.in v40>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000faa:[<0x1000000116d/Makefile.in v82>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.611 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.212+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_027.c auth v90 ap=1 s=1466 n(v0 rc2007-06-25T15:51:11.000000+0000 b1466 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea338100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa5:[<0x1000000116d/ohpi_027.c v30>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fa5:[<0x1000000116d/ohpi_027.c v90>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.611 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.212+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f9d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_009.c auth v70 ap=1 s=1762 n(v0 rc2007-06-25T15:51:10.000000+0000 b1762 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea338680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f9d:[<0x1000000116d/ohpi_009.c v70>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f9d:[<0x1000000116d/ohpi_009.c v70>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.611 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.212+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_029.c auth v100 ap=1 s=1546 n(v0 rc2007-06-25T15:51:11.000000+0000 b1546 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea338c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa9:[<0x1000000116d/ohpi_029.c v38>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fa9:[<0x1000000116d/ohpi_029.c v100>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.611 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.212+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_026.c auth v96 ap=1 s=1409 n(v0 rc2007-06-25T15:51:11.000000+0000 b1409 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea339180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa2:[<0x1000000116d/ohpi_026.c v24>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fa2:[<0x1000000116d/ohpi_026.c v96>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.611 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.213+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f9e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/openhpi.conf auth v60 ap=1 s=67 n(v0 rc2007-06-25T15:51:13.000000+0000 b67 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea339700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f9e:[<0x1000000116d/openhpi.conf v60>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f9e:[<0x1000000116d/openhpi.conf v60>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.611 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.213+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fae [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/Makefile.am auth v64 ap=1 s=2822 n(v0 rc2008-07-26T03:51:48.000000+0000 b2822 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea342000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fae:[<0x1000000116d/Makefile.am v64>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fae:[<0x1000000116d/Makefile.am v64>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.611 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.213+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_024.c auth v74 ap=1 s=992 n(v0 rc2007-06-25T15:51:10.000000+0000 b992 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea342580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa6:[<0x1000000116d/ohpi_024.c v74>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fa6:[<0x1000000116d/ohpi_024.c v74>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.611 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.213+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fac [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_037.c auth v84 ap=1 s=1056 n(v0 rc2007-06-25T15:51:12.000000+0000 b1056 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea342b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fac:[<0x1000000116d/ohpi_037.c v44>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fac:[<0x1000000116d/ohpi_037.c v84>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.611 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.213+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f9b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_033.c auth v54 ap=1 s=2164 n(v0 rc2007-06-25T15:51:12.000000+0000 b2164 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea343080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f9b:[<0x1000000116d/ohpi_033.c v54>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f9b:[<0x1000000116d/ohpi_033.c v54>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.611 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.213+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f9c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_025.c auth v76 ap=1 s=1363 n(v0 rc2007-06-25T15:51:11.000000+0000 b1363 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea343600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f9c:[<0x1000000116d/ohpi_025.c v76>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f9c:[<0x1000000116d/ohpi_025.c v76>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.611 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.214+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_036.c auth v72 ap=1 s=1407 n(v0 rc2007-06-25T15:51:12.000000+0000 b1407 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea343b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa0:[<0x1000000116d/ohpi_036.c v72>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fa0:[<0x1000000116d/ohpi_036.c v72>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.611 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.214+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f98 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_030.c auth v98 ap=1 s=1487 n(v0 rc2007-06-25T15:51:11.000000+0000 b1487 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea344100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f98:[<0x1000000116d/ohpi_030.c v4>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f98:[<0x1000000116d/ohpi_030.c v98>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.612 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.214+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fab [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/hpiinjector.c auth v58 ap=1 s=5183 n(v0 rc2007-06-25T15:51:09.000000+0000 b5183 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea344680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fab:[<0x1000000116d/hpiinjector.c v58>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fab:[<0x1000000116d/hpiinjector.c v58>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.612 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.214+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fad [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_038.c auth v52 ap=1 s=1224 n(v0 rc2007-06-25T15:51:12.000000+0000 b1224 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea344c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fad:[<0x1000000116d/ohpi_038.c v52>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fad:[<0x1000000116d/ohpi_038.c v52>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.612 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.214+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f9f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_039.c auth v80 ap=1 s=1034 n(v0 rc2007-06-25T15:51:12.000000+0000 b1034 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea345180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f9f:[<0x1000000116d/ohpi_039.c v18>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f9f:[<0x1000000116d/ohpi_039.c v80>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.612 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.214+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000fa7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_007.c auth v92 ap=1 s=2497 n(v0 rc2007-06-25T15:51:09.000000+0000 b2497 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea345700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000fa7:[<0x1000000116d/ohpi_007.c v34>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000fa7:[<0x1000000116d/ohpi_007.c v92>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.612 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.214+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f99 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_028.c auth v78 ap=1 s=1457 n(v0 rc2007-06-25T15:51:11.000000+0000 b1457 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea34e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f99:[<0x1000000116d/ohpi_028.c v78>,<0x1000000116b/ohpi v88>,<0x10000001169/t v50>,<0x10000000bed/src v828>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f99:[<0x1000000116d/ohpi_028.c v78>,<0x1000000116b/ohpi v116>,<0x10000001169/t v83>,<0x10000000bed/src v1136>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.612 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.220+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000da4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/Makefile.in auth v12 ap=1 s=17019 n(v0 rc2009-12-03T15:31:01.000000+0000 b17019 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2d8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000da4:[<0x10000000f51/Makefile.in v12>,<0x10000000bed/snmp v676>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000da4:[<0x10000000f51/Makefile.in v12>,<0x10000000bed/snmp v676>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.612 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.221+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000da5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/Makefile.am auth v10 ap=1 s=717 n(v0 rc2008-07-26T03:51:48.000000+0000 b717 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2d9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000da5:[<0x10000000f51/Makefile.am v10>,<0x10000000bed/snmp v676>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000da5:[<0x10000000f51/Makefile.am v10>,<0x10000000bed/snmp v676>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.612 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.221+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f52 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/snmp_utils.h auth v14 ap=1 s=3195 n(v0 rc2024-01-25T15:03:12.068725+0000 b3195 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2d8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f52:[<0x10000000f51/snmp_utils.h v2>,<0x10000000bed/snmp v676>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f52:[<0x10000000f51/snmp_utils.h v14>,<0x10000000bed/snmp v676>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.612 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:36.221+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000da3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/snmp_utils.c auth v16 ap=1 s=15983 n(v0 rc2008-07-26T03:51:48.000000+0000 b15983 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2d9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000da3:[<0x10000000f51/snmp_utils.c v4>,<0x10000000bed/snmp v676>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000da3:[<0x10000000f51/snmp_utils.c v16>,<0x10000000bed/snmp v676>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:36.613 INFO:tasks.workunit.client.0.smithi170.stdout:1/378: symlink d0/d20/d3a/d6e/l85 0 2024-01-25T15:03:36.613 INFO:tasks.workunit.client.0.smithi170.stdout:2/403: mknod d10/d1e/d32/d3e/d41/c97 0 2024-01-25T15:03:36.613 INFO:tasks.workunit.client.0.smithi170.stdout:2/404: truncate d10/d1e/d32/d3e/f95 58869 0 2024-01-25T15:03:36.613 INFO:tasks.workunit.client.0.smithi170.stdout:1/379: symlink d0/d1b/l86 0 2024-01-25T15:03:36.613 INFO:tasks.workunit.client.0.smithi170.stdout:7/400: dread d8/d20/f29 [0,4194304] 0 2024-01-25T15:03:36.613 INFO:tasks.workunit.client.0.smithi170.stdout:9/394: truncate d5/dc/f2c 5399484 0 2024-01-25T15:03:36.614 INFO:tasks.workunit.client.0.smithi170.stdout:7/401: dread d8/d20/d2a/d61/f63 [0,4194304] 0 2024-01-25T15:03:36.618 INFO:tasks.workunit.client.0.smithi170.stdout:2/405: write d10/d1e/f20 [2690376,129353] 0 2024-01-25T15:03:36.620 INFO:tasks.workunit.client.0.smithi170.stdout:9/395: write d5/dc/f30 [4757364,97883] 0 2024-01-25T15:03:36.620 INFO:tasks.workunit.client.0.smithi170.stdout:9/396: stat d5/df/d2e/d77/d21/d34/d3e/f84 0 2024-01-25T15:03:36.621 INFO:tasks.workunit.client.0.smithi170.stdout:2/406: mkdir d10/d1e/d32/d98 0 2024-01-25T15:03:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:36 smithi170 ceph-mon[31899]: scrub queued for path: / 2024-01-25T15:03:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:36 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:36 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:36 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:36 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:36 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:36.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:36 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:36.625 INFO:tasks.workunit.client.0.smithi170.stdout:8/318: write d3/d7/d1e/f45 [124663,18250] 0 2024-01-25T15:03:36.625 INFO:tasks.workunit.client.0.smithi170.stdout:6/375: dwrite d2/d7/d23/d19/d2a/f55 [0,4194304] 0 2024-01-25T15:03:36.626 INFO:tasks.workunit.client.0.smithi170.stdout:6/376: mknod d2/d7/d1b/d78/c81 0 2024-01-25T15:03:36.626 INFO:tasks.workunit.client.0.smithi170.stdout:6/377: fsync d2/d7/d23/d19/f24 0 2024-01-25T15:03:36.626 INFO:tasks.workunit.client.0.smithi170.stdout:6/378: fsync d2/f17 0 2024-01-25T15:03:36.627 INFO:tasks.workunit.client.0.smithi170.stdout:2/407: dread d10/d16/d42/f48 [0,4194304] 0 2024-01-25T15:03:36.627 INFO:tasks.workunit.client.0.smithi170.stdout:5/314: dwrite d5/fd [0,4194304] 0 2024-01-25T15:03:36.628 INFO:tasks.workunit.client.0.smithi170.stdout:2/408: stat d10/d1e/d32/d3e/d5c/d92 0 2024-01-25T15:03:36.628 INFO:tasks.workunit.client.0.smithi170.stdout:0/340: sync 2024-01-25T15:03:36.629 INFO:tasks.workunit.client.0.smithi170.stdout:2/409: mkdir d10/d1e/d32/d98/d99 0 2024-01-25T15:03:36.630 INFO:tasks.workunit.client.0.smithi170.stdout:2/410: creat d10/d1e/f9a x:0 0 0 2024-01-25T15:03:36.630 INFO:tasks.workunit.client.0.smithi170.stdout:5/315: creat d5/d10/f76 x:0 0 0 2024-01-25T15:03:36.633 INFO:tasks.workunit.client.0.smithi170.stdout:3/420: dwrite d3/f17 [0,4194304] 0 2024-01-25T15:03:36.639 INFO:tasks.workunit.client.0.smithi170.stdout:5/316: mknod d5/d2a/c77 0 2024-01-25T15:03:36.642 INFO:tasks.workunit.client.0.smithi170.stdout:5/317: mknod d5/d10/d2c/d45/c78 0 2024-01-25T15:03:36.647 INFO:tasks.workunit.client.0.smithi170.stdout:5/318: write d5/d10/d2c/f5f [23520,62440] 0 2024-01-25T15:03:36.655 INFO:tasks.workunit.client.0.smithi170.stdout:5/319: creat d5/d10/d3f/f79 x:0 0 0 2024-01-25T15:03:36.660 INFO:tasks.workunit.client.0.smithi170.stdout:8/319: dwrite d3/d7/d1e/f5e [0,4194304] 0 2024-01-25T15:03:36.660 INFO:tasks.workunit.client.0.smithi170.stdout:8/320: dread - d3/d7/d22/d23/d48/f65 zero size 2024-01-25T15:03:36.664 INFO:tasks.workunit.client.0.smithi170.stdout:7/402: link d8/d20/d2a/d35/d55/c79 d8/d20/d2a/d61/ca1 0 2024-01-25T15:03:36.664 INFO:tasks.workunit.client.0.smithi170.stdout:7/403: write d8/d20/d45/d8e/f9d [3220407,4591] 0 2024-01-25T15:03:36.664 INFO:tasks.workunit.client.0.smithi170.stdout:7/404: creat d8/d20/d2a/fa2 x:0 0 0 2024-01-25T15:03:36.668 INFO:tasks.workunit.client.0.smithi170.stdout:8/321: dread d3/d7/d22/d23/d48/d52/f35 [0,4194304] 0 2024-01-25T15:03:36.668 INFO:tasks.workunit.client.0.smithi170.stdout:8/322: write d3/d7/d22/d23/d25/f2d [4792424,124278] 0 2024-01-25T15:03:36.669 INFO:tasks.workunit.client.0.smithi170.stdout:8/323: truncate d3/d7/d22/d23/d25/f3c 4286585 0 2024-01-25T15:03:36.669 INFO:tasks.workunit.client.0.smithi170.stdout:8/324: stat d3/d7/d22/d23/d25 0 2024-01-25T15:03:36.670 INFO:tasks.workunit.client.0.smithi170.stdout:7/405: symlink d8/d20/d2a/la3 0 2024-01-25T15:03:36.672 INFO:tasks.workunit.client.0.smithi170.stdout:5/320: link d5/d2a/c37 d5/d10/d2c/d51/d3d/d57/c7a 0 2024-01-25T15:03:36.673 INFO:tasks.workunit.client.0.smithi170.stdout:5/321: symlink d5/d2a/l7b 0 2024-01-25T15:03:36.673 INFO:tasks.workunit.client.0.smithi170.stdout:5/322: read - d5/d10/d3f/f79 zero size 2024-01-25T15:03:36.674 INFO:tasks.workunit.client.0.smithi170.stdout:5/323: mkdir d5/d10/d2c/d34/d7c 0 2024-01-25T15:03:36.675 INFO:tasks.workunit.client.0.smithi170.stdout:5/324: dread d5/d10/f5a [0,4194304] 0 2024-01-25T15:03:36.678 INFO:tasks.workunit.client.0.smithi170.stdout:6/379: dwrite d2/d7/d23/d19/d2a/d43/f51 [0,4194304] 0 2024-01-25T15:03:36.682 INFO:tasks.workunit.client.0.smithi170.stdout:0/341: dwrite d8/d10/f69 [0,4194304] 0 2024-01-25T15:03:36.683 INFO:tasks.workunit.client.0.smithi170.stdout:2/411: write d10/d1e/f20 [2695071,49009] 0 2024-01-25T15:03:36.683 INFO:tasks.workunit.client.0.smithi170.stdout:2/412: write d10/d1e/d32/d62/f79 [934670,90427] 0 2024-01-25T15:03:36.684 INFO:tasks.workunit.client.0.smithi170.stdout:2/413: mknod d10/d1e/d32/d62/d8d/c9b 0 2024-01-25T15:03:36.685 INFO:tasks.workunit.client.0.smithi170.stdout:7/406: dread d8/d20/d2a/d35/d55/d6e/f93 [0,4194304] 0 2024-01-25T15:03:36.685 INFO:tasks.workunit.client.0.smithi170.stdout:9/397: dwrite d5/df/d16/d35/f5a [0,4194304] 0 2024-01-25T15:03:36.685 INFO:tasks.workunit.client.0.smithi170.stdout:0/342: getdents d8/d10/d2d 0 2024-01-25T15:03:36.688 INFO:tasks.workunit.client.0.smithi170.stdout:0/343: rename d8/d10/l34 to d8/d10/d5a/l74 0 2024-01-25T15:03:36.689 INFO:tasks.workunit.client.0.smithi170.stdout:0/344: symlink d8/d10/l75 0 2024-01-25T15:03:36.689 INFO:tasks.workunit.client.0.smithi170.stdout:0/345: stat d8/ff 0 2024-01-25T15:03:36.689 INFO:tasks.workunit.client.0.smithi170.stdout:0/346: fdatasync f2 0 2024-01-25T15:03:36.690 INFO:tasks.workunit.client.0.smithi170.stdout:8/325: write d3/d7/d1e/f5e [2948538,101983] 0 2024-01-25T15:03:36.690 INFO:tasks.workunit.client.0.smithi170.stdout:3/421: dwrite d3/d1c/f6f [0,4194304] 0 2024-01-25T15:03:36.691 INFO:tasks.workunit.client.0.smithi170.stdout:0/347: rmdir d8/d10/d2d/d2f/d4f/d59 39 2024-01-25T15:03:36.699 INFO:tasks.workunit.client.0.smithi170.stdout:9/398: write d5/df/d16/d35/f65 [2500488,34925] 0 2024-01-25T15:03:36.699 INFO:tasks.workunit.client.0.smithi170.stdout:5/325: dwrite d5/f13 [0,4194304] 0 2024-01-25T15:03:36.699 INFO:tasks.workunit.client.0.smithi170.stdout:9/399: chown d5/df/d16/f2b 1542513 1 2024-01-25T15:03:36.699 INFO:tasks.workunit.client.0.smithi170.stdout:9/400: write d5/df/d2e/f70 [801079,3309] 0 2024-01-25T15:03:36.700 INFO:tasks.workunit.client.0.smithi170.stdout:9/401: chown d5/df/d2e/d77/d21/d46/d6c 195 1 2024-01-25T15:03:36.700 INFO:tasks.workunit.client.0.smithi170.stdout:5/326: write d5/d2a/f2b [5068165,76744] 0 2024-01-25T15:03:36.701 INFO:tasks.workunit.client.0.smithi170.stdout:3/422: unlink d3/d10/d1e/d21/d41/d77/l3d 0 2024-01-25T15:03:36.708 INFO:tasks.workunit.client.0.smithi170.stdout:0/348: rmdir d8/d9 39 2024-01-25T15:03:36.710 INFO:tasks.workunit.client.0.smithi170.stdout:5/327: mkdir d5/d10/d7d 0 2024-01-25T15:03:36.710 INFO:tasks.workunit.client.0.smithi170.stdout:5/328: stat d5/d10/d2c/c39 0 2024-01-25T15:03:36.710 INFO:tasks.workunit.client.0.smithi170.stdout:4/311: sync 2024-01-25T15:03:36.711 INFO:tasks.workunit.client.0.smithi170.stdout:5/329: link d5/d10/d2c/d45/f6c d5/d10/d2c/d45/d5e/f7e 0 2024-01-25T15:03:36.712 INFO:tasks.workunit.client.0.smithi170.stdout:5/330: chown d5/d10/l28 88 1 2024-01-25T15:03:36.712 INFO:tasks.workunit.client.0.smithi170.stdout:5/331: fdatasync d5/f40 0 2024-01-25T15:03:36.712 INFO:tasks.workunit.client.0.smithi170.stdout:0/349: getdents d8/d3e 0 2024-01-25T15:03:36.714 INFO:tasks.workunit.client.0.smithi170.stdout:2/414: dwrite d10/d1e/f9a [0,4194304] 0 2024-01-25T15:03:36.716 INFO:tasks.workunit.client.0.smithi170.stdout:0/350: creat d8/d10/d2d/d53/f76 x:0 0 0 2024-01-25T15:03:36.716 INFO:tasks.workunit.client.0.smithi170.stdout:5/332: getdents d5/d10/d2c/d45/d56/d72 0 2024-01-25T15:03:36.721 INFO:tasks.workunit.client.0.smithi170.stdout:5/333: rmdir d5/d10/d2c/d51/d6b 0 2024-01-25T15:03:36.723 INFO:tasks.workunit.client.0.smithi170.stdout:0/351: mkdir d8/d10/d77 0 2024-01-25T15:03:36.723 INFO:tasks.workunit.client.0.smithi170.stdout:0/352: stat d8/d10/d2d/d2f/c3f 0 2024-01-25T15:03:36.724 INFO:tasks.workunit.client.0.smithi170.stdout:4/312: read d6/d7/f1a [857016,75141] 0 2024-01-25T15:03:36.724 INFO:tasks.workunit.client.0.smithi170.stdout:6/380: dwrite d2/d7/d1b/f64 [4194304,4194304] 0 2024-01-25T15:03:36.725 INFO:tasks.workunit.client.0.smithi170.stdout:8/326: dwrite d3/d7/d22/d23/d48/d52/d47/f4b [0,4194304] 0 2024-01-25T15:03:36.729 INFO:tasks.workunit.client.0.smithi170.stdout:5/334: symlink d5/l7f 0 2024-01-25T15:03:36.729 INFO:tasks.workunit.client.0.smithi170.stdout:3/423: dwrite d3/d10/f14 [4194304,4194304] 0 2024-01-25T15:03:36.729 INFO:tasks.workunit.client.0.smithi170.stdout:3/424: chown d3/d10/d1e/d21/d41/d4a/c82 0 1 2024-01-25T15:03:36.729 INFO:tasks.workunit.client.0.smithi170.stdout:3/425: stat d3/d10/d13/d1b/d29/c33 0 2024-01-25T15:03:36.729 INFO:tasks.workunit.client.0.smithi170.stdout:7/407: dwrite d8/d20/d45/f46 [0,4194304] 0 2024-01-25T15:03:36.730 INFO:tasks.workunit.client.0.smithi170.stdout:8/327: mknod d3/d7/d22/d23/d48/d52/c6a 0 2024-01-25T15:03:36.730 INFO:tasks.workunit.client.0.smithi170.stdout:8/328: dread - d3/f42 zero size 2024-01-25T15:03:36.730 INFO:tasks.workunit.client.0.smithi170.stdout:8/329: chown d3/d7 169351 1 2024-01-25T15:03:36.731 INFO:tasks.workunit.client.0.smithi170.stdout:3/426: rename d3/d10/d1e/d21/d41/d4b/l7a to d3/d1c/d2b/l83 0 2024-01-25T15:03:36.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:36.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:36.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:36.734 INFO:tasks.workunit.client.0.smithi170.stdout:8/330: write d3/d7/d22/d23/d25/f5c [2989,108263] 0 2024-01-25T15:03:36.734 INFO:tasks.workunit.client.0.smithi170.stdout:8/331: read d3/d7/d22/d23/d48/d52/d47/f4c [14327,99063] 0 2024-01-25T15:03:36.734 INFO:tasks.workunit.client.0.smithi170.stdout:8/332: mknod d3/d7/d22/d23/d48/c6b 0 2024-01-25T15:03:36.735 INFO:tasks.workunit.client.0.smithi170.stdout:4/313: write d6/d37/f40 [2801271,44068] 0 2024-01-25T15:03:36.735 INFO:tasks.workunit.client.0.smithi170.stdout:4/314: fdatasync d6/d7/d1b/f41 0 2024-01-25T15:03:36.737 INFO:tasks.workunit.client.0.smithi170.stdout:8/333: rename d3/d7/d1e/f45 to d3/d7/d1e/f6c 0 2024-01-25T15:03:36.737 INFO:tasks.workunit.client.0.smithi170.stdout:8/334: fsync d3/d7/d22/d23/d25/f2d 0 2024-01-25T15:03:36.739 INFO:tasks.workunit.client.0.smithi170.stdout:4/315: mknod d6/d7/d31/d46/c57 0 2024-01-25T15:03:36.741 INFO:tasks.workunit.client.0.smithi170.stdout:1/380: sync 2024-01-25T15:03:36.741 INFO:tasks.workunit.client.0.smithi170.stdout:4/316: rmdir d6/d7 39 2024-01-25T15:03:36.743 INFO:tasks.workunit.client.0.smithi170.stdout:8/335: write d3/d7/d22/d23/f54 [1012207,92227] 0 2024-01-25T15:03:36.744 INFO:tasks.workunit.client.0.smithi170.stdout:4/317: symlink d6/d7/d34/l58 0 2024-01-25T15:03:36.746 INFO:tasks.workunit.client.0.smithi170.stdout:4/318: truncate d6/d7/d34/f2e 1021956 0 2024-01-25T15:03:36.748 INFO:tasks.workunit.client.0.smithi170.stdout:2/415: dwrite d10/d1e/d32/d3e/f6b [0,4194304] 0 2024-01-25T15:03:36.748 INFO:tasks.workunit.client.0.smithi170.stdout:2/416: stat d10/d16/d42/l81 0 2024-01-25T15:03:36.748 INFO:tasks.workunit.client.0.smithi170.stdout:2/417: write d10/d16/f23 [3107853,88267] 0 2024-01-25T15:03:36.748 INFO:tasks.workunit.client.0.smithi170.stdout:2/418: chown d10/d1e/d32/d63 2456716 1 2024-01-25T15:03:36.748 INFO:tasks.workunit.client.0.smithi170.stdout:2/419: write d10/d1b/d5f/f7d [940981,51137] 0 2024-01-25T15:03:36.751 INFO:tasks.workunit.client.0.smithi170.stdout:0/353: dwrite d8/ff [0,4194304] 0 2024-01-25T15:03:36.751 INFO:tasks.workunit.client.0.smithi170.stdout:4/319: mkdir d6/d28/d59 0 2024-01-25T15:03:36.757 INFO:tasks.workunit.client.0.smithi170.stdout:4/320: creat d6/d37/f5a x:0 0 0 2024-01-25T15:03:36.757 INFO:tasks.workunit.client.0.smithi170.stdout:6/381: dwrite d2/d7/d23/d19/d2f/f32 [0,4194304] 0 2024-01-25T15:03:36.757 INFO:tasks.workunit.client.0.smithi170.stdout:6/382: creat d2/f82 x:0 0 0 2024-01-25T15:03:36.760 INFO:tasks.workunit.client.0.smithi170.stdout:8/336: write d3/d7/d3a/f3f [3507660,98306] 0 2024-01-25T15:03:36.766 INFO:tasks.workunit.client.0.smithi170.stdout:4/321: getdents d6/d7/d31/d46 0 2024-01-25T15:03:36.767 INFO:tasks.workunit.client.0.smithi170.stdout:4/322: creat d6/d37/f5b x:0 0 0 2024-01-25T15:03:36.769 INFO:tasks.workunit.client.0.smithi170.stdout:4/323: rmdir d6/d7 39 2024-01-25T15:03:36.772 INFO:tasks.workunit.client.0.smithi170.stdout:7/408: dwrite d8/f52 [0,4194304] 0 2024-01-25T15:03:36.773 INFO:tasks.workunit.client.0.smithi170.stdout:7/409: getdents d8/d20/d2a/d35/d55/d9b 0 2024-01-25T15:03:36.773 INFO:tasks.workunit.client.0.smithi170.stdout:1/381: dwrite d0/d20/d3a/f53 [0,4194304] 0 2024-01-25T15:03:36.773 INFO:tasks.workunit.client.0.smithi170.stdout:5/335: dwrite d5/f1e [0,4194304] 0 2024-01-25T15:03:36.774 INFO:tasks.workunit.client.0.smithi170.stdout:7/410: creat d8/d20/d2a/d61/fa4 x:0 0 0 2024-01-25T15:03:36.778 INFO:tasks.workunit.client.0.smithi170.stdout:2/420: rename d10/d1e/d32/d62/l70 to d10/d1b/d5f/l9c 0 2024-01-25T15:03:36.781 INFO:tasks.workunit.client.0.smithi170.stdout:1/382: rename d0/d20/d28/d2a/d4a/d56/d5b/d72/l74 to d0/d20/d28/d2a/d4a/d56/l87 0 2024-01-25T15:03:36.782 INFO:tasks.workunit.client.0.smithi170.stdout:2/421: dread d10/f52 [0,4194304] 0 2024-01-25T15:03:36.785 INFO:tasks.workunit.client.0.smithi170.stdout:7/411: creat d8/d20/d2a/d35/d55/d7d/fa5 x:0 0 0 2024-01-25T15:03:36.785 INFO:tasks.workunit.client.0.smithi170.stdout:2/422: creat d10/d1e/d32/f9d x:0 0 0 2024-01-25T15:03:36.785 INFO:tasks.workunit.client.0.smithi170.stdout:2/423: write d10/d1e/d32/d62/d8d/f96 [319408,11820] 0 2024-01-25T15:03:36.786 INFO:tasks.workunit.client.0.smithi170.stdout:0/354: dwrite d8/d10/d2d/d53/f67 [0,4194304] 0 2024-01-25T15:03:36.787 INFO:tasks.workunit.client.0.smithi170.stdout:0/355: stat d8/d9/f46 0 2024-01-25T15:03:36.787 INFO:tasks.workunit.client.0.smithi170.stdout:0/356: creat d8/d18/f78 x:0 0 0 2024-01-25T15:03:36.787 INFO:tasks.workunit.client.0.smithi170.stdout:7/412: dread d8/d20/d45/f59 [0,4194304] 0 2024-01-25T15:03:36.787 INFO:tasks.workunit.client.0.smithi170.stdout:2/424: rmdir d10/d16/d42/d87 0 2024-01-25T15:03:36.794 INFO:tasks.workunit.client.0.smithi170.stdout:0/357: mkdir d8/d10/d2d/d2f/d6a/d79 0 2024-01-25T15:03:36.797 INFO:tasks.workunit.client.0.smithi170.stdout:2/425: mkdir d10/d1e/d5e/d73/d9e 0 2024-01-25T15:03:36.797 INFO:tasks.workunit.client.0.smithi170.stdout:2/426: write d10/d1e/d32/d3e/d5c/f94 [776204,102589] 0 2024-01-25T15:03:36.797 INFO:tasks.workunit.client.0.smithi170.stdout:2/427: dread - d10/d16/f7c zero size 2024-01-25T15:03:36.797 INFO:tasks.workunit.client.0.smithi170.stdout:2/428: fsync f9 0 2024-01-25T15:03:36.799 INFO:tasks.workunit.client.0.smithi170.stdout:7/413: rmdir d8/d20/d2a/d35 39 2024-01-25T15:03:36.800 INFO:tasks.workunit.client.0.smithi170.stdout:7/414: read - d8/d20/d2a/d35/d55/d7d/fa5 zero size 2024-01-25T15:03:36.800 INFO:tasks.workunit.client.0.smithi170.stdout:7/415: fdatasync d8/d20/d3b/f8d 0 2024-01-25T15:03:36.800 INFO:tasks.workunit.client.0.smithi170.stdout:0/358: mkdir d8/d7a 0 2024-01-25T15:03:36.801 INFO:tasks.workunit.client.0.smithi170.stdout:0/359: fdatasync d8/d18/f4d 0 2024-01-25T15:03:36.804 INFO:tasks.workunit.client.0.smithi170.stdout:8/337: dwrite d3/fd [0,4194304] 0 2024-01-25T15:03:36.804 INFO:tasks.workunit.client.0.smithi170.stdout:6/383: dwrite d2/d7/d23/d19/d2a/f55 [0,4194304] 0 2024-01-25T15:03:36.804 INFO:tasks.workunit.client.0.smithi170.stdout:8/338: fsync d3/d7/d1e/f6c 0 2024-01-25T15:03:36.804 INFO:tasks.workunit.client.0.smithi170.stdout:4/324: dwrite d6/d7/d31/f3f [0,4194304] 0 2024-01-25T15:03:36.805 INFO:tasks.workunit.client.0.smithi170.stdout:7/416: mkdir d8/d20/d2a/d35/d55/d7d/da6 0 2024-01-25T15:03:36.807 INFO:tasks.workunit.client.0.smithi170.stdout:5/336: dwrite d5/fe [0,4194304] 0 2024-01-25T15:03:36.815 INFO:tasks.workunit.client.0.smithi170.stdout:8/339: dread d3/d7/f67 [0,4194304] 0 2024-01-25T15:03:36.818 INFO:tasks.workunit.client.0.smithi170.stdout:5/337: dread d5/f1b [0,4194304] 0 2024-01-25T15:03:36.821 INFO:tasks.workunit.client.0.smithi170.stdout:4/325: creat d6/d7/d34/f5c x:0 0 0 2024-01-25T15:03:36.823 INFO:tasks.workunit.client.0.smithi170.stdout:8/340: mkdir d3/d7/d22/d23/d25/d34/d6d 0 2024-01-25T15:03:36.825 INFO:tasks.workunit.client.0.smithi170.stdout:0/360: rmdir d8 39 2024-01-25T15:03:36.825 INFO:tasks.workunit.client.0.smithi170.stdout:0/361: chown d8/d18/l71 0 1 2024-01-25T15:03:36.826 INFO:tasks.workunit.client.0.smithi170.stdout:6/384: rmdir d2/d7/d23/d19/d2f 39 2024-01-25T15:03:36.826 INFO:tasks.workunit.client.0.smithi170.stdout:6/385: chown d2/d7/d23/l30 2011412 1 2024-01-25T15:03:36.827 INFO:tasks.workunit.client.0.smithi170.stdout:5/338: dread d5/d10/d2c/f31 [0,4194304] 0 2024-01-25T15:03:36.827 INFO:tasks.workunit.client.0.smithi170.stdout:8/341: creat d3/d7/d22/d5d/f6e x:0 0 0 2024-01-25T15:03:36.830 INFO:tasks.workunit.client.0.smithi170.stdout:0/362: mknod d8/d10/d2d/c7b 0 2024-01-25T15:03:36.832 INFO:tasks.workunit.client.0.smithi170.stdout:6/386: link d2/d7/d1b/f1f d2/d7/d23/d19/f83 0 2024-01-25T15:03:36.834 INFO:tasks.workunit.client.0.smithi170.stdout:7/417: dwrite d8/f4e [0,4194304] 0 2024-01-25T15:03:36.834 INFO:tasks.workunit.client.0.smithi170.stdout:7/418: write d8/d20/d2a/d35/d55/d6e/f89 [599429,98438] 0 2024-01-25T15:03:36.835 INFO:tasks.workunit.client.0.smithi170.stdout:8/342: getdents d3/d7/d22/d23/d48/d52 0 2024-01-25T15:03:36.835 INFO:tasks.workunit.client.0.smithi170.stdout:8/343: write d3/d7/d22/d23/d48/d52/d47/f4c [5120099,79867] 0 2024-01-25T15:03:36.835 INFO:tasks.workunit.client.0.smithi170.stdout:8/344: write d3/d7/d22/d23/d48/d52/f35 [745684,107857] 0 2024-01-25T15:03:36.835 INFO:tasks.workunit.client.0.smithi170.stdout:8/345: write d3/f9 [3152419,34553] 0 2024-01-25T15:03:36.835 INFO:tasks.workunit.client.0.smithi170.stdout:8/346: creat d3/d7/d1e/f6f x:0 0 0 2024-01-25T15:03:36.835 INFO:tasks.workunit.client.0.smithi170.stdout:0/363: creat d8/d10/d2d/d2f/f7c x:0 0 0 2024-01-25T15:03:36.837 INFO:tasks.workunit.client.0.smithi170.stdout:6/387: symlink d2/d7/d23/d19/d2a/d6b/l84 0 2024-01-25T15:03:36.838 INFO:tasks.workunit.client.0.smithi170.stdout:7/419: mknod d8/d20/d2a/d61/ca7 0 2024-01-25T15:03:36.844 INFO:tasks.workunit.client.0.smithi170.stdout:4/326: dwrite d6/d7/d1b/f1e [4194304,4194304] 0 2024-01-25T15:03:36.845 INFO:tasks.workunit.client.0.smithi170.stdout:8/347: creat d3/d7/d3a/f70 x:0 0 0 2024-01-25T15:03:36.845 INFO:tasks.workunit.client.0.smithi170.stdout:8/348: getdents d3/d7/d22/d23/d25/d34/d6d 0 2024-01-25T15:03:36.845 INFO:tasks.workunit.client.0.smithi170.stdout:8/349: dread - d3/d7/d1e/f6f zero size 2024-01-25T15:03:36.845 INFO:tasks.workunit.client.0.smithi170.stdout:8/350: read - d3/d7/d22/d5d/f6e zero size 2024-01-25T15:03:36.845 INFO:tasks.workunit.client.0.smithi170.stdout:8/351: creat d3/d7/d1e/f71 x:0 0 0 2024-01-25T15:03:36.846 INFO:tasks.workunit.client.0.smithi170.stdout:0/364: unlink d8/d10/d2d/d2f/l43 0 2024-01-25T15:03:36.854 INFO:tasks.workunit.client.0.smithi170.stdout:6/388: mknod d2/d7/d1b/d28/c85 0 2024-01-25T15:03:36.856 INFO:tasks.workunit.client.0.smithi170.stdout:5/339: dwrite d5/d10/d2c/d45/d5e/f7e [0,4194304] 0 2024-01-25T15:03:36.861 INFO:tasks.workunit.client.0.smithi170.stdout:8/352: creat d3/f72 x:0 0 0 2024-01-25T15:03:36.862 INFO:tasks.workunit.client.0.smithi170.stdout:0/365: creat d8/d10/d2d/d53/f7d x:0 0 0 2024-01-25T15:03:36.868 INFO:tasks.workunit.client.0.smithi170.stdout:6/389: mknod d2/d7/d23/d19/d2f/d37/c86 0 2024-01-25T15:03:36.868 INFO:tasks.workunit.client.0.smithi170.stdout:6/390: fsync d2/d7/d23/d19/d2f/d5d/f6f 0 2024-01-25T15:03:36.869 INFO:tasks.workunit.client.0.smithi170.stdout:4/327: getdents d6/d7/d1b 0 2024-01-25T15:03:36.876 INFO:tasks.workunit.client.0.smithi170.stdout:5/340: unlink d5/d2a/c60 0 2024-01-25T15:03:36.876 INFO:tasks.workunit.client.0.smithi170.stdout:5/341: creat d5/d10/d2c/d34/f80 x:0 0 0 2024-01-25T15:03:36.877 INFO:tasks.workunit.client.0.smithi170.stdout:4/328: write d6/d7/f14 [3771353,120552] 0 2024-01-25T15:03:36.878 INFO:tasks.workunit.client.0.smithi170.stdout:6/391: creat d2/d7/d23/d19/d2f/f87 x:0 0 0 2024-01-25T15:03:36.879 INFO:tasks.workunit.client.0.smithi170.stdout:6/392: write f0 [8736732,58909] 0 2024-01-25T15:03:36.879 INFO:tasks.workunit.client.0.smithi170.stdout:6/393: write d2/f10 [5832333,82542] 0 2024-01-25T15:03:36.880 INFO:tasks.workunit.client.0.smithi170.stdout:5/342: unlink d5/d10/d2c/d45/d56/d72/f73 0 2024-01-25T15:03:36.881 INFO:tasks.workunit.client.0.smithi170.stdout:8/353: mkdir d3/d7/d73 0 2024-01-25T15:03:36.882 INFO:tasks.workunit.client.0.smithi170.stdout:0/366: dwrite d8/d10/d2d/d53/f76 [0,4194304] 0 2024-01-25T15:03:36.882 INFO:tasks.workunit.client.0.smithi170.stdout:4/329: truncate d6/d7/f17 4582327 0 2024-01-25T15:03:36.883 INFO:tasks.workunit.client.0.smithi170.stdout:5/343: getdents d5/d54 0 2024-01-25T15:03:36.885 INFO:tasks.workunit.client.0.smithi170.stdout:8/354: mkdir d3/d7/d1e/d74 0 2024-01-25T15:03:36.888 INFO:tasks.workunit.client.0.smithi170.stdout:0/367: mkdir d8/d10/d2d/d2f/d6a/d79/d7e 0 2024-01-25T15:03:36.890 INFO:tasks.workunit.client.0.smithi170.stdout:6/394: write d2/d7/d23/d19/d2a/d43/f51 [3630973,9477] 0 2024-01-25T15:03:36.890 INFO:tasks.workunit.client.0.smithi170.stdout:8/355: creat d3/d7/d22/f75 x:0 0 0 2024-01-25T15:03:36.890 INFO:tasks.workunit.client.0.smithi170.stdout:8/356: read d3/d7/f10 [4103225,86122] 0 2024-01-25T15:03:36.892 INFO:tasks.workunit.client.0.smithi170.stdout:6/395: symlink d2/d7/d1b/l88 0 2024-01-25T15:03:36.895 INFO:tasks.workunit.client.0.smithi170.stdout:6/396: mkdir d2/d7/d1b/d28/d89 0 2024-01-25T15:03:36.899 INFO:tasks.workunit.client.0.smithi170.stdout:0/368: write d8/d10/d2d/d58/f5c [2335847,16538] 0 2024-01-25T15:03:36.903 INFO:tasks.workunit.client.0.smithi170.stdout:2/429: rename d10/d1e/d32/d63/l7b to d10/d1e/d32/l9f 0 2024-01-25T15:03:36.906 INFO:tasks.workunit.client.0.smithi170.stdout:4/330: dwrite d6/f26 [4194304,4194304] 0 2024-01-25T15:03:36.907 INFO:tasks.workunit.client.0.smithi170.stdout:4/331: creat d6/d28/f5d x:0 0 0 2024-01-25T15:03:36.910 INFO:tasks.workunit.client.0.smithi170.stdout:4/332: link d6/d28/l2b d6/d28/d59/l5e 0 2024-01-25T15:03:36.921 INFO:tasks.workunit.client.0.smithi170.stdout:8/357: dwrite d3/d7/d22/d23/d25/f2d [0,4194304] 0 2024-01-25T15:03:36.925 INFO:tasks.workunit.client.0.smithi170.stdout:8/358: creat d3/d7/d22/d23/f76 x:0 0 0 2024-01-25T15:03:36.926 INFO:tasks.workunit.client.0.smithi170.stdout:6/397: dwrite d2/d7/d23/d19/d2a/d43/d44/f66 [4194304,4194304] 0 2024-01-25T15:03:36.926 INFO:tasks.workunit.client.0.smithi170.stdout:6/398: chown d2/d7/d23/d19/d2a/c68 36635 1 2024-01-25T15:03:36.926 INFO:tasks.workunit.client.0.smithi170.stdout:6/399: write d2/d7/d23/d19/d2a/d43/d44/f7c [4596372,96064] 0 2024-01-25T15:03:36.926 INFO:tasks.workunit.client.0.smithi170.stdout:6/400: dread - d2/d7/d23/d19/d2f/d5d/f6f zero size 2024-01-25T15:03:36.926 INFO:tasks.workunit.client.0.smithi170.stdout:6/401: chown d2/d7/d23/d19/d2f/c6d 37384971 1 2024-01-25T15:03:36.926 INFO:tasks.workunit.client.0.smithi170.stdout:8/359: symlink d3/d7/d73/l77 0 2024-01-25T15:03:36.927 INFO:tasks.workunit.client.0.smithi170.stdout:8/360: dread - d3/f72 zero size 2024-01-25T15:03:36.930 INFO:tasks.workunit.client.0.smithi170.stdout:6/402: getdents d2/d7/d23/d19/d2a/d6b 0 2024-01-25T15:03:36.935 INFO:tasks.workunit.client.0.smithi170.stdout:9/402: sync 2024-01-25T15:03:36.935 INFO:tasks.workunit.client.0.smithi170.stdout:3/427: sync 2024-01-25T15:03:36.935 INFO:tasks.workunit.client.0.smithi170.stdout:3/428: write d3/d10/d52/f5d [468583,90443] 0 2024-01-25T15:03:36.936 INFO:tasks.workunit.client.0.smithi170.stdout:3/429: creat d3/d10/d1e/d21/d41/d4b/d63/f84 x:0 0 0 2024-01-25T15:03:36.938 INFO:tasks.workunit.client.0.smithi170.stdout:3/430: dread d3/d10/d13/f34 [0,4194304] 0 2024-01-25T15:03:36.939 INFO:tasks.workunit.client.0.smithi170.stdout:0/369: dwrite d8/d10/f4b [0,4194304] 0 2024-01-25T15:03:36.940 INFO:tasks.workunit.client.0.smithi170.stdout:3/431: mkdir d3/d10/d13/d1b/d85 0 2024-01-25T15:03:36.940 INFO:tasks.workunit.client.0.smithi170.stdout:3/432: fdatasync d3/d10/d13/f34 0 2024-01-25T15:03:36.943 INFO:tasks.workunit.client.0.smithi170.stdout:2/430: dwrite d10/d1e/d32/d3e/d41/d7a/f80 [0,4194304] 0 2024-01-25T15:03:36.943 INFO:tasks.workunit.client.0.smithi170.stdout:4/333: dwrite d6/d28/f52 [0,4194304] 0 2024-01-25T15:03:36.943 INFO:tasks.workunit.client.0.smithi170.stdout:0/370: mkdir d8/d10/d5a/d7f 0 2024-01-25T15:03:36.943 INFO:tasks.workunit.client.0.smithi170.stdout:0/371: fdatasync d8/d10/f2b 0 2024-01-25T15:03:36.944 INFO:tasks.workunit.client.0.smithi170.stdout:2/431: mkdir d10/da0 0 2024-01-25T15:03:36.946 INFO:tasks.workunit.client.0.smithi170.stdout:8/361: truncate d3/d7/d22/d23/d25/f2d 3125037 0 2024-01-25T15:03:36.947 INFO:tasks.workunit.client.0.smithi170.stdout:6/403: dread d2/d7/d23/d19/d2f/f32 [0,4194304] 0 2024-01-25T15:03:36.951 INFO:tasks.workunit.client.0.smithi170.stdout:7/420: rename d8/d20/d2a/d35/d55/c60 to d8/d20/d2a/d35/d55/d6e/ca8 0 2024-01-25T15:03:36.955 INFO:tasks.workunit.client.0.smithi170.stdout:9/403: rename d5/df/d2e/d77/d21/d46/d18/f31 to d5/f8f 0 2024-01-25T15:03:36.956 INFO:tasks.workunit.client.0.smithi170.stdout:3/433: rename d3/d10/d52/l78 to d3/d10/d13/d1b/l86 0 2024-01-25T15:03:36.959 INFO:tasks.workunit.client.0.smithi170.stdout:6/404: dread d2/d7/d23/d19/d2a/d43/d44/f66 [4194304,4194304] 0 2024-01-25T15:03:36.959 INFO:tasks.workunit.client.0.smithi170.stdout:9/404: mkdir d5/df/d2e/d90 0 2024-01-25T15:03:36.959 INFO:tasks.workunit.client.0.smithi170.stdout:6/405: creat d2/d7/d1b/d28/f8a x:0 0 0 2024-01-25T15:03:36.960 INFO:tasks.workunit.client.0.smithi170.stdout:2/432: rename d10/d1e to d10/d1e/d32/d63/da1 22 2024-01-25T15:03:36.960 INFO:tasks.workunit.client.0.smithi170.stdout:0/372: dread d8/ff [0,4194304] 0 2024-01-25T15:03:36.961 INFO:tasks.workunit.client.0.smithi170.stdout:9/405: mkdir d5/df/d16/d35/d3c/d91 0 2024-01-25T15:03:36.964 INFO:tasks.workunit.client.0.smithi170.stdout:0/373: rename d8/d7a to d8/d80 0 2024-01-25T15:03:36.964 INFO:tasks.workunit.client.0.smithi170.stdout:0/374: truncate d8/d10/d2d/d53/f76 4784799 0 2024-01-25T15:03:36.965 INFO:tasks.workunit.client.0.smithi170.stdout:9/406: mknod d5/df/d2e/d77/d21/d46/d6c/c92 0 2024-01-25T15:03:36.966 INFO:tasks.workunit.client.0.smithi170.stdout:8/362: rename d3/d7/d22/f75 to d3/d7/d3a/f78 0 2024-01-25T15:03:36.967 INFO:tasks.workunit.client.0.smithi170.stdout:3/434: dread d3/d10/ff [0,4194304] 0 2024-01-25T15:03:36.967 INFO:tasks.workunit.client.0.smithi170.stdout:0/375: mknod d8/d10/d77/c81 0 2024-01-25T15:03:36.968 INFO:tasks.workunit.client.0.smithi170.stdout:6/406: dread d2/d7/d23/d19/d2f/d37/f62 [0,4194304] 0 2024-01-25T15:03:36.969 INFO:tasks.workunit.client.0.smithi170.stdout:9/407: rmdir d5/df/d2e/d77/d86/d8d 0 2024-01-25T15:03:36.970 INFO:tasks.workunit.client.0.smithi170.stdout:3/435: mknod d3/d3b/c87 0 2024-01-25T15:03:36.972 INFO:tasks.workunit.client.0.smithi170.stdout:4/334: dwrite d6/d7/d34/f2e [0,4194304] 0 2024-01-25T15:03:36.972 INFO:tasks.workunit.client.0.smithi170.stdout:4/335: fdatasync d6/d7/d34/f5c 0 2024-01-25T15:03:36.972 INFO:tasks.workunit.client.0.smithi170.stdout:9/408: link d5/df/d2e/d77/d21/d34/f7a d5/df/d2e/f93 0 2024-01-25T15:03:36.978 INFO:tasks.workunit.client.0.smithi170.stdout:3/436: mkdir d3/d88 0 2024-01-25T15:03:36.978 INFO:tasks.workunit.client.0.smithi170.stdout:4/336: mknod d6/c5f 0 2024-01-25T15:03:36.978 INFO:tasks.workunit.client.0.smithi170.stdout:3/437: chown d3/d10/c71 0 1 2024-01-25T15:03:36.978 INFO:tasks.workunit.client.0.smithi170.stdout:7/421: dwrite d8/d20/d2a/f9c [0,4194304] 0 2024-01-25T15:03:36.980 INFO:tasks.workunit.client.0.smithi170.stdout:4/337: link d6/c22 d6/d7/c60 0 2024-01-25T15:03:36.984 INFO:tasks.workunit.client.0.smithi170.stdout:7/422: mknod d8/d20/d45/ca9 0 2024-01-25T15:03:36.984 INFO:tasks.workunit.client.0.smithi170.stdout:0/376: dread d8/d9/fe [0,4194304] 0 2024-01-25T15:03:36.986 INFO:tasks.workunit.client.0.smithi170.stdout:0/377: mkdir d8/d10/d2d/d82 0 2024-01-25T15:03:36.986 INFO:tasks.workunit.client.0.smithi170.stdout:0/378: dread - d8/d10/d2d/d53/f63 zero size 2024-01-25T15:03:36.990 INFO:tasks.workunit.client.0.smithi170.stdout:0/379: mknod d8/d10/d2d/d2f/d4f/d59/c83 0 2024-01-25T15:03:36.990 INFO:tasks.workunit.client.0.smithi170.stdout:0/380: chown d8/f38 1481694 1 2024-01-25T15:03:36.993 INFO:tasks.workunit.client.0.smithi170.stdout:2/433: dwrite d10/d16/f7c [0,4194304] 0 2024-01-25T15:03:36.995 INFO:tasks.workunit.client.0.smithi170.stdout:2/434: creat d10/d1e/d32/d98/d99/fa2 x:0 0 0 2024-01-25T15:03:36.998 INFO:tasks.workunit.client.0.smithi170.stdout:2/435: mkdir d10/d1e/d5e/d73/d9e/da3 0 2024-01-25T15:03:36.999 INFO:tasks.workunit.client.0.smithi170.stdout:2/436: write d10/d1b/d5f/f78 [2104323,42563] 0 2024-01-25T15:03:37.005 INFO:tasks.workunit.client.0.smithi170.stdout:8/363: dwrite d3/d7/f67 [0,4194304] 0 2024-01-25T15:03:37.030 INFO:tasks.workunit.client.0.smithi170.stdout:9/409: dwrite d5/df/d2e/d77/d21/d46/f76 [0,4194304] 0 2024-01-25T15:03:37.030 INFO:tasks.workunit.client.0.smithi170.stdout:3/438: dwrite d3/d10/d1e/d21/d41/d4b/d63/f84 [0,4194304] 0 2024-01-25T15:03:37.033 INFO:tasks.workunit.client.0.smithi170.stdout:9/410: rename d5/df/d2e/d77/d21/d46/d18/f23 to d5/f94 0 2024-01-25T15:03:37.033 INFO:tasks.workunit.client.0.smithi170.stdout:9/411: creat d5/df/d16/d35/d3c/d56/d59/d5e/f95 x:0 0 0 2024-01-25T15:03:37.035 INFO:tasks.workunit.client.0.smithi170.stdout:3/439: dread d3/d10/ff [0,4194304] 0 2024-01-25T15:03:37.037 INFO:tasks.workunit.client.0.smithi170.stdout:9/412: mkdir d5/df/d2e/d77/d21/d63/d96 0 2024-01-25T15:03:37.037 INFO:tasks.workunit.client.0.smithi170.stdout:9/413: creat d5/df/d16/d35/d3c/d56/d59/d5e/f97 x:0 0 0 2024-01-25T15:03:37.040 INFO:tasks.workunit.client.0.smithi170.stdout:9/414: creat d5/df/d2e/d77/d21/d63/d96/f98 x:0 0 0 2024-01-25T15:03:37.040 INFO:tasks.workunit.client.0.smithi170.stdout:6/407: dwrite d2/f40 [4194304,4194304] 0 2024-01-25T15:03:37.040 INFO:tasks.workunit.client.0.smithi170.stdout:6/408: chown d2/d7/d23/d19/d2a/f79 1024899472 1 2024-01-25T15:03:37.040 INFO:tasks.workunit.client.0.smithi170.stdout:4/338: dwrite d6/d7/f1a [0,4194304] 0 2024-01-25T15:03:37.041 INFO:tasks.workunit.client.0.smithi170.stdout:0/381: dwrite d8/d3e/f61 [0,4194304] 0 2024-01-25T15:03:37.042 INFO:tasks.workunit.client.0.smithi170.stdout:8/364: dwrite d3/d7/d3a/f3f [0,4194304] 0 2024-01-25T15:03:37.043 INFO:tasks.workunit.client.0.smithi170.stdout:3/440: write d3/d2a/f4d [109797,126983] 0 2024-01-25T15:03:37.043 INFO:tasks.workunit.client.0.smithi170.stdout:3/441: write d3/d1c/d2d/f35 [8828696,83287] 0 2024-01-25T15:03:37.043 INFO:tasks.workunit.client.0.smithi170.stdout:3/442: chown c0 1468 1 2024-01-25T15:03:37.045 INFO:tasks.workunit.client.0.smithi170.stdout:6/409: mkdir d2/d7/d23/d19/d2a/d43/d44/d8b 0 2024-01-25T15:03:37.046 INFO:tasks.workunit.client.0.smithi170.stdout:4/339: write d6/d7/f14 [8112052,71518] 0 2024-01-25T15:03:37.050 INFO:tasks.workunit.client.0.smithi170.stdout:0/382: link f6 d8/d18/f84 0 2024-01-25T15:03:37.053 INFO:tasks.workunit.client.0.smithi170.stdout:3/443: creat d3/d10/f89 x:0 0 0 2024-01-25T15:03:37.054 INFO:tasks.workunit.client.0.smithi170.stdout:8/365: write d3/d7/d22/d23/d25/f5b [1040750,16029] 0 2024-01-25T15:03:37.057 INFO:tasks.workunit.client.0.smithi170.stdout:0/383: rename d8/d9/l14 to d8/l85 0 2024-01-25T15:03:37.061 INFO:tasks.workunit.client.0.smithi170.stdout:8/366: creat d3/d7/d1e/d74/f79 x:0 0 0 2024-01-25T15:03:37.063 INFO:tasks.workunit.client.0.smithi170.stdout:3/444: write d3/d10/d1e/d21/d41/d77/f4e [3551791,3192] 0 2024-01-25T15:03:37.064 INFO:tasks.workunit.client.0.smithi170.stdout:8/367: symlink d3/d7/d3a/l7a 0 2024-01-25T15:03:37.064 INFO:tasks.workunit.client.0.smithi170.stdout:8/368: stat d3/d7/d22/d23/c24 0 2024-01-25T15:03:37.064 INFO:tasks.workunit.client.0.smithi170.stdout:8/369: readlink d3/d7/d22/l30 0 2024-01-25T15:03:37.064 INFO:tasks.workunit.client.0.smithi170.stdout:8/370: stat d3/d7/f62 0 2024-01-25T15:03:37.065 INFO:tasks.workunit.client.0.smithi170.stdout:3/445: link d3/d1c/d2d/l51 d3/d10/d13/d1b/l8a 0 2024-01-25T15:03:37.067 INFO:tasks.workunit.client.0.smithi170.stdout:3/446: creat d3/d10/d13/d1b/d29/f8b x:0 0 0 2024-01-25T15:03:37.067 INFO:tasks.workunit.client.0.smithi170.stdout:3/447: chown d3/d10/d1e 664903 1 2024-01-25T15:03:37.069 INFO:tasks.workunit.client.0.smithi170.stdout:0/384: dread d8/f38 [0,4194304] 0 2024-01-25T15:03:37.069 INFO:tasks.workunit.client.0.smithi170.stdout:0/385: fsync d8/fa 0 2024-01-25T15:03:37.071 INFO:tasks.workunit.client.0.smithi170.stdout:0/386: rename d8/d10/l50 to d8/d3e/l86 0 2024-01-25T15:03:37.078 INFO:tasks.workunit.client.0.smithi170.stdout:8/371: rmdir d3/d7/d1e/d74 39 2024-01-25T15:03:37.078 INFO:tasks.workunit.client.0.smithi170.stdout:0/387: dread d8/ff [0,4194304] 0 2024-01-25T15:03:37.079 INFO:tasks.workunit.client.0.smithi170.stdout:8/372: creat d3/d7/d1e/d74/f7b x:0 0 0 2024-01-25T15:03:37.079 INFO:tasks.workunit.client.0.smithi170.stdout:8/373: dread - d3/f42 zero size 2024-01-25T15:03:37.080 INFO:tasks.workunit.client.0.smithi170.stdout:8/374: dread - d3/d7/f62 zero size 2024-01-25T15:03:37.080 INFO:tasks.workunit.client.0.smithi170.stdout:8/375: write d3/d7/d22/d23/d48/d52/f35 [159223,47982] 0 2024-01-25T15:03:37.085 INFO:tasks.workunit.client.0.smithi170.stdout:3/448: link d3/d10/d1e/d21/d41/d77/f76 d3/d2a/d7e/f8c 0 2024-01-25T15:03:37.091 INFO:tasks.workunit.client.0.smithi170.stdout:0/388: write d8/d9/f29 [2840635,62483] 0 2024-01-25T15:03:37.091 INFO:tasks.workunit.client.0.smithi170.stdout:0/389: truncate d8/d10/d2d/d53/f76 5158140 0 2024-01-25T15:03:37.098 INFO:tasks.workunit.client.0.smithi170.stdout:3/449: rmdir d3 39 2024-01-25T15:03:37.102 INFO:tasks.workunit.client.0.smithi170.stdout:3/450: link d3/d10/d52/f5d d3/d10/d13/d1b/d81/f8d 0 2024-01-25T15:03:37.102 INFO:tasks.workunit.client.0.smithi170.stdout:3/451: fdatasync d3/d10/d1e/d21/d41/d77/f4e 0 2024-01-25T15:03:37.117 INFO:tasks.workunit.client.0.smithi170.stdout:0/390: dwrite f2 [4194304,4194304] 0 2024-01-25T15:03:37.118 INFO:tasks.workunit.client.0.smithi170.stdout:0/391: creat d8/d3a/f87 x:0 0 0 2024-01-25T15:03:37.121 INFO:tasks.workunit.client.0.smithi170.stdout:3/452: dwrite d3/d10/d6d/d74/f66 [0,4194304] 0 2024-01-25T15:03:37.133 INFO:tasks.workunit.client.0.smithi170.stdout:3/453: mknod d3/d2a/d53/c8e 0 2024-01-25T15:03:37.135 INFO:tasks.workunit.client.0.smithi170.stdout:3/454: mkdir d3/d10/d13/d1b/d85/d8f 0 2024-01-25T15:03:37.138 INFO:tasks.workunit.client.0.smithi170.stdout:3/455: unlink d3/d1c/d2b/c54 0 2024-01-25T15:03:37.144 INFO:tasks.workunit.client.0.smithi170.stdout:0/392: dwrite d8/d10/f69 [0,4194304] 0 2024-01-25T15:03:37.144 INFO:tasks.workunit.client.0.smithi170.stdout:0/393: chown d8/d3a/l4a 1555 1 2024-01-25T15:03:37.156 INFO:tasks.workunit.client.0.smithi170.stdout:0/394: dread d8/d18/f20 [0,4194304] 0 2024-01-25T15:03:37.157 INFO:tasks.workunit.client.0.smithi170.stdout:3/456: dwrite d3/d2a/f7d [0,4194304] 0 2024-01-25T15:03:37.158 INFO:tasks.workunit.client.0.smithi170.stdout:0/395: creat d8/d10/d2d/d2f/d4f/d5f/f88 x:0 0 0 2024-01-25T15:03:37.158 INFO:tasks.workunit.client.0.smithi170.stdout:0/396: truncate d8/d10/d5a/f6c 4439362 0 2024-01-25T15:03:37.158 INFO:tasks.workunit.client.0.smithi170.stdout:0/397: fsync d8/d18/f20 0 2024-01-25T15:03:37.161 INFO:tasks.workunit.client.0.smithi170.stdout:0/398: mkdir d8/d10/d2d/d89 0 2024-01-25T15:03:37.161 INFO:tasks.workunit.client.0.smithi170.stdout:0/399: rename d8/d10/d2d/d2f/d6a to d8/d10/d2d/d2f/d6a/d8a 22 2024-01-25T15:03:37.165 INFO:tasks.workunit.client.0.smithi170.stdout:3/457: write d3/d10/d13/f65 [1034449,107571] 0 2024-01-25T15:03:37.165 INFO:tasks.workunit.client.0.smithi170.stdout:3/458: write d3/d10/d1e/d21/d41/d4a/f75 [684175,127112] 0 2024-01-25T15:03:37.192 INFO:tasks.workunit.client.0.smithi170.stdout:3/459: dwrite d3/d1c/f24 [0,4194304] 0 2024-01-25T15:03:37.192 INFO:tasks.workunit.client.0.smithi170.stdout:3/460: chown d3/d88 13715 1 2024-01-25T15:03:37.192 INFO:tasks.workunit.client.0.smithi170.stdout:0/400: dwrite d8/d9/f56 [0,4194304] 0 2024-01-25T15:03:37.198 INFO:tasks.workunit.client.0.smithi170.stdout:3/461: creat d3/d10/d1e/d21/d41/d4b/f90 x:0 0 0 2024-01-25T15:03:37.198 INFO:tasks.workunit.client.0.smithi170.stdout:3/462: fdatasync d3/d10/d1e/d21/d41/d4b/d63/f84 0 2024-01-25T15:03:37.201 INFO:tasks.workunit.client.0.smithi170.stdout:0/401: symlink d8/d10/d2d/d2f/d6a/l8b 0 2024-01-25T15:03:37.204 INFO:tasks.workunit.client.0.smithi170.stdout:3/463: symlink d3/d88/l91 0 2024-01-25T15:03:37.206 INFO:tasks.workunit.client.0.smithi170.stdout:0/402: link d8/d10/l41 d8/d10/d2d/d2f/d6a/d79/l8c 0 2024-01-25T15:03:37.208 INFO:tasks.workunit.client.0.smithi170.stdout:3/464: truncate d3/d10/d13/f36 2377004 0 2024-01-25T15:03:37.210 INFO:tasks.workunit.client.0.smithi170.stdout:0/403: truncate d8/d9/f29 836732 0 2024-01-25T15:03:37.214 INFO:tasks.workunit.client.0.smithi170.stdout:3/465: write d3/d10/ff [2539329,27968] 0 2024-01-25T15:03:37.217 INFO:tasks.workunit.client.0.smithi170.stdout:3/466: symlink d3/d10/d6d/d74/l92 0 2024-01-25T15:03:37.217 INFO:tasks.workunit.client.0.smithi170.stdout:3/467: readlink d3/d10/d13/d1b/l86 0 2024-01-25T15:03:37.217 INFO:tasks.workunit.client.0.smithi170.stdout:3/468: dread - d3/d10/d13/d1b/d29/f8b zero size 2024-01-25T15:03:37.229 INFO:tasks.workunit.client.0.smithi170.stdout:3/469: dread d3/d2a/f7d [0,4194304] 0 2024-01-25T15:03:37.229 INFO:tasks.workunit.client.0.smithi170.stdout:3/470: readlink d3/d10/d13/d1b/l32 0 2024-01-25T15:03:37.229 INFO:tasks.workunit.client.0.smithi170.stdout:3/471: dread - d3/d10/d13/d1b/d29/f8b zero size 2024-01-25T15:03:37.233 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.083+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ef [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/open_files.c auth v12 ap=1 s=2611 n(v0 rc2005-10-03T18:03:22.000000+0000 b2611 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544619600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ef:[<0x10000000a98/open_files.c v12>,<0x10000000a8a/nfs01 v118>,<0x10000000414/nfs v317>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000008ef:[<0x10000000a98/open_files.c v12>,<0x10000000a8a/nfs01 v118>,<0x10000000414/nfs v359>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.234 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.083+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a99 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/Makefile auth v8 ap=1 s=1019 n(v0 rc2009-10-09T17:56:05.000000+0000 b1019 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544619080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a99:[<0x10000000a98/Makefile v8>,<0x10000000a8a/nfs01 v118>,<0x10000000414/nfs v317>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000a99:[<0x10000000a98/Makefile v8>,<0x10000000a8a/nfs01 v118>,<0x10000000414/nfs v359>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.234 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.083+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008ee [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/nfs01 auth v10 ap=1 s=6251 n(v0 rc2024-01-25T15:03:11.029749+0000 b6251 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544619b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008ee:[<0x10000000a98/nfs01 v10>,<0x10000000a8a/nfs01 v118>,<0x10000000414/nfs v317>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000008ee:[<0x10000000a98/nfs01 v10>,<0x10000000a8a/nfs01 v118>,<0x10000000414/nfs v359>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.237 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.914+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dbd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ekeyfru.h auth v118 ap=1 s=894 n(v0 rc2007-06-25T15:44:52.000000+0000 b894 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272679080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dbd:[<0x10000000f58/ekeyfru.h v16>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dbd:[<0x10000000f58/ekeyfru.h v118>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.237 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.914+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dbb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_control_event.c auth v116 ap=1 s=20772 n(v0 rc2008-07-26T03:51:45.000000+0000 b20772 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127267a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dbb:[<0x10000000f58/ipmi_control_event.c v12>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dbb:[<0x10000000f58/ipmi_control_event.c v116>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.238 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.915+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000db9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_close.c auth v74 ap=1 s=1428 n(v0 rc2008-07-26T03:51:45.000000+0000 b1428 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272679b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000db9:[<0x10000000f58/ipmi_close.c v74>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000db9:[<0x10000000f58/ipmi_close.c v74>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.238 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.916+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000db8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor_event.c auth v92 ap=1 s=34407 n(v0 rc2008-07-26T03:51:45.000000+0000 b34407 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272679600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000db8:[<0x10000000f58/ipmi_sensor_event.c v92>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000db8:[<0x10000000f58/ipmi_sensor_event.c v92>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.238 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.916+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dba [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/hotswap.c auth v98 ap=1 s=23974 n(v0 rc2008-07-26T03:51:45.000000+0000 b23974 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127267a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dba:[<0x10000000f58/hotswap.c v98>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dba:[<0x10000000f58/hotswap.c v98>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.238 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.917+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.sym auth v124 ap=1 s=44 n(v0 rc2007-06-25T15:44:53.000000+0000 b44 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127267ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc1:[<0x10000000f58/ipmi.sym v24>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dc1:[<0x10000000f58/ipmi.sym v124>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.238 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.917+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/posix_vlog.c auth v126 ap=1 s=1716 n(v0 rc2008-07-26T03:51:45.000000+0000 b1716 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127267b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc5:[<0x10000000f58/posix_vlog.c v32>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dc5:[<0x10000000f58/posix_vlog.c v126>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.238 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.917+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f5a [...2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/ auth v132 ap=1 f(v0 m2024-01-25T15:03:12.097724+0000 3=3+0) n(v0 rc2024-01-25T15:03:12.097724+0000 b31504 4=3+1) (inest lock) (ifile excl) (iversion lock) caps={24803=pAsLsXsFsx/pAsLsXsFsxcral@1},l=24803 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127267b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000f5a:[<0x10000000f58/t v96>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x10000000f5a:[<0x10000000f58/t v132>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-25T15:03:12.097724+0000 3=3+0)","ondisk_value.rstat":"n(v0 rc2024-01-25T15:03:12.097724+0000 b31504 4=3+1)","memory_value.dirstat":"f(v0 m2024-01-25T15:03:12.097724+0000 3=3+0)","memory_value.rstat":"n(v0 rc2024-01-25T15:03:12.097724+0000 b31504 4=3+1)","error_str":""},"return_code":0} 2024-01-25T15:03:37.238 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.917+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dbf [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.h auth v82 ap=1 s=27129 n(v0 rc2008-07-26T03:51:45.000000+0000 b27129 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127268a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dbf:[<0x10000000f58/ipmi.h v82>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dbf:[<0x10000000f58/ipmi.h v82>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.238 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.918+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dbc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_connection.c auth v80 ap=1 s=2814 n(v0 rc2008-07-26T03:51:45.000000+0000 b2814 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127268a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dbc:[<0x10000000f58/ipmi_connection.c v80>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dbc:[<0x10000000f58/ipmi_connection.c v80>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.238 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.918+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dcc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.in auth v72 ap=1 s=25104 n(v0 rc2009-12-03T15:31:00.000000+0000 b25104 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127268ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dcc:[<0x10000000f58/Makefile.in v72>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dcc:[<0x10000000f58/Makefile.in v72>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.238 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.918+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000db7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_vshm_rdrs.c auth v100 ap=1 s=9052 n(v0 rc2008-07-26T03:51:45.000000+0000 b9052 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127268b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000db7:[<0x10000000f58/atca_vshm_rdrs.c v100>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000db7:[<0x10000000f58/atca_vshm_rdrs.c v100>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.238 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.918+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dca [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_mc_event.c auth v90 ap=1 s=4780 n(v0 rc2008-07-26T03:51:45.000000+0000 b4780 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127268b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dca:[<0x10000000f58/ipmi_mc_event.c v90>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dca:[<0x10000000f58/ipmi_mc_event.c v90>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.238 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.918+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dcd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_fru.c auth v104 ap=1 s=35693 n(v0 rc2008-07-26T03:51:45.000000+0000 b35693 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127268bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dcd:[<0x10000000f58/atca_shelf_fru.c v48>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dcd:[<0x10000000f58/atca_shelf_fru.c v104>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.239 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.919+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity.c auth v128 ap=1 s=547 n(v0 rc2007-06-25T15:44:53.000000+0000 b547 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127268c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc8:[<0x10000000f58/ipmi_entity.c v38>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dc8:[<0x10000000f58/ipmi_entity.c v128>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.239 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.919+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.c auth v114 ap=1 s=69212 n(v0 rc2008-07-26T03:51:45.000000+0000 b69212 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127268c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc6:[<0x10000000f58/ipmi.c v34>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dc6:[<0x10000000f58/ipmi.c v114>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.239 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.919+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dce [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_rdrs.c auth v68 ap=1 s=56559 n(v0 rc2008-07-26T03:51:45.000000+0000 b56559 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127268cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dce:[<0x10000000f58/atca_shelf_rdrs.c v68>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dce:[<0x10000000f58/atca_shelf_rdrs.c v68>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.239 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.920+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.am auth v70 ap=1 s=2624 n(v0 rc2008-07-26T03:51:45.000000+0000 b2624 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127268d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd3:[<0x10000000f58/Makefile.am v70>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dd3:[<0x10000000f58/Makefile.am v70>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.239 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.920+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory_event.c auth v108 ap=1 s=8463 n(v0 rc2008-07-26T03:51:45.000000+0000 b8463 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127268d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc4:[<0x10000000f58/ipmi_inventory_event.c v30>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dc4:[<0x10000000f58/ipmi_inventory_event.c v108>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.239 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.920+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f59 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity_event.c auth v78 ap=1 s=26929 n(v0 rc2024-01-25T15:03:12.084724+0000 b26929 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272694000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f59:[<0x10000000f58/ipmi_entity_event.c v78>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f59:[<0x10000000f58/ipmi_entity_event.c v78>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.239 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.920+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/sync.c auth v86 ap=1 s=1285 n(v0 rc2007-06-25T15:44:53.000000+0000 b1285 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272694580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc2:[<0x10000000f58/sync.c v86>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dc2:[<0x10000000f58/sync.c v86>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.239 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.921+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory.c auth v88 ap=1 s=72434 n(v0 rc2008-07-26T03:51:45.000000+0000 b72434 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272694b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc0:[<0x10000000f58/ipmi_inventory.c v88>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dc0:[<0x10000000f58/ipmi_inventory.c v88>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.239 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.921+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dcf [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_util.c auth v84 ap=1 s=10962 n(v0 rc2024-01-25T15:03:12.087724+0000 b10962 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272695600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dcf:[<0x10000000f58/ipmi_util.c v84>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dcf:[<0x10000000f58/ipmi_util.c v84>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.239 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.921+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_slot_rdrs.c auth v106 ap=1 s=28405 n(v0 rc2008-07-26T03:51:45.000000+0000 b28405 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272695080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd0:[<0x10000000f58/atca_slot_rdrs.c v54>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dd0:[<0x10000000f58/atca_slot_rdrs.c v106>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.240 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.921+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_drv.c auth v76 ap=1 s=9092 n(v0 rc2008-07-26T03:51:45.000000+0000 b9092 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272695b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc3:[<0x10000000f58/ipmi_drv.c v76>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dc3:[<0x10000000f58/ipmi_drv.c v76>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.240 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.921+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dcb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_fru_rdrs.c auth v112 ap=1 s=56474 n(v0 rc2008-07-26T03:51:45.000000+0000 b56474 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272696c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dcb:[<0x10000000f58/atca_fru_rdrs.c v44>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dcb:[<0x10000000f58/atca_fru_rdrs.c v112>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.240 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.922+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sel.c auth v130 ap=1 s=12459 n(v0 rc2024-01-25T15:03:12.086724+0000 b12459 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272696680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc9:[<0x10000000f58/ipmi_sel.c v40>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dc9:[<0x10000000f58/ipmi_sel.c v130>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.240 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.922+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dc7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_event.c auth v120 ap=1 s=2455 n(v0 rc2008-07-26T03:51:45.000000+0000 b2455 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272697700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dc7:[<0x10000000f58/ipmi_event.c v36>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dc7:[<0x10000000f58/ipmi_event.c v120>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.240 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.922+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dbe [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_controls.c auth v94 ap=1 s=31969 n(v0 rc2024-01-25T15:03:12.085724+0000 b31969 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272696100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dbe:[<0x10000000f58/ipmi_controls.c v94>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dbe:[<0x10000000f58/ipmi_controls.c v94>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.240 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.922+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor.c auth v102 ap=1 s=36526 n(v0 rc2024-01-25T15:03:12.098724+0000 b36526 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272697180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd4:[<0x10000000f58/ipmi_sensor.c v66>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dd4:[<0x10000000f58/ipmi_sensor.c v102>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.240 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.922+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.in auth v8 ap=1 s=16625 n(v0 rc2009-12-03T15:31:00.000000+0000 b16625 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127269e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd1:[<0x10000000f5a/Makefile.in v8>,<0x10000000f58/t v96>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dd1:[<0x10000000f5a/Makefile.in v8>,<0x10000000f58/t v132>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.240 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.922+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.am auth v10 ap=1 s=1980 n(v0 rc2008-07-26T03:51:45.000000+0000 b1980 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127269e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd2:[<0x10000000f5a/Makefile.am v6>,<0x10000000f58/t v96>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000dd2:[<0x10000000f5a/Makefile.am v10>,<0x10000000f58/t v132>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.240 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:36.923+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f5b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/ipmi_thres_test.c auth v12 ap=1 s=12899 n(v0 rc2024-01-25T15:03:12.097724+0000 b12899 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127269eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f5b:[<0x10000000f5a/ipmi_thres_test.c v2>,<0x10000000f58/t v96>,<0x10000000f57/ipmi v990>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f5b:[<0x10000000f5a/ipmi_thres_test.c v12>,<0x10000000f58/t v132>,<0x10000000f57/ipmi v1299>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.240 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.021+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000969 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-updown auth v38 ap=1 s=6942 n(v0 rc2024-01-25T15:03:10.904752+0000 b6942 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272346100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000969:[<0x10000000968/if4-updown v38>,<0x10000000839/interface v472>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000969:[<0x10000000968/if4-updown v38>,<0x10000000839/interface v472>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.240 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.022+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000828 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-mtu-change auth v56 ap=1 s=7308 n(v0 rc2008-10-06T03:30:34.000000+0000 b7308 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272346680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000828:[<0x10000000968/if4-mtu-change v56>,<0x10000000839/interface v472>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000828:[<0x10000000968/if4-mtu-change v56>,<0x10000000839/interface v472>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.240 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.022+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000825 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-addr-change auth v50 ap=1 s=6886 n(v0 rc2009-11-18T12:05:20.000000+0000 b6886 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272346c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000825:[<0x10000000968/if4-addr-change v50>,<0x10000000839/interface v472>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000825:[<0x10000000968/if4-addr-change v50>,<0x10000000839/interface v472>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.241 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.022+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000823 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-route-addlarge auth v46 ap=1 s=8021 n(v0 rc2008-10-06T03:30:34.000000+0000 b8021 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272347700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000823:[<0x10000000968/if4-route-addlarge v46>,<0x10000000839/interface v472>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000823:[<0x10000000968/if4-route-addlarge v46>,<0x10000000839/interface v472>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.241 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.022+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000827 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-addr-addlarge auth v52 ap=1 s=8295 n(v0 rc2008-10-06T03:30:34.000000+0000 b8295 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272347180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000827:[<0x10000000968/if6-addr-addlarge v52>,<0x10000000839/interface v472>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000827:[<0x10000000968/if6-addr-addlarge v52>,<0x10000000839/interface v472>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.241 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.022+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000821 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/00_Descriptions.txt auth v44 ap=1 s=3302 n(v0 rc2005-10-24T20:18:22.000000+0000 b3302 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272622580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000821:[<0x10000000968/00_Descriptions.txt v44>,<0x10000000839/interface v472>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000821:[<0x10000000968/00_Descriptions.txt v44>,<0x10000000839/interface v472>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.241 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.023+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000822 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-updown auth v32 ap=1 s=6820 n(v0 rc2008-10-06T03:30:34.000000+0000 b6820 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272622000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000822:[<0x10000000968/if6-updown v32>,<0x10000000839/interface v472>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000822:[<0x10000000968/if6-updown v32>,<0x10000000839/interface v472>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.241 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.023+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000820 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/Makefile auth v42 ap=1 s=1043 n(v0 rc2009-10-09T17:56:06.000000+0000 b1043 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272622b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000820:[<0x10000000968/Makefile v42>,<0x10000000839/interface v472>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000820:[<0x10000000968/Makefile v42>,<0x10000000839/interface v472>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.241 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.023+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000085a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-mtu-change auth v54 ap=1 s=7194 n(v0 rc2024-01-25T15:03:10.905752+0000 b7194 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272623080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000085a:[<0x10000000968/if6-mtu-change v54>,<0x10000000839/interface v472>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000085a:[<0x10000000968/if6-mtu-change v54>,<0x10000000839/interface v472>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.241 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.023+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000826 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-alias-addlarge auth v58 ap=1 s=13806 n(v0 rc2009-12-07T11:46:41.000000+0000 b13806 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272623b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000826:[<0x10000000968/if4-alias-addlarge v58>,<0x10000000839/interface v472>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000826:[<0x10000000968/if4-alias-addlarge v58>,<0x10000000839/interface v472>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.241 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.023+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000824 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-alias-adddel auth v40 ap=1 s=9329 n(v0 rc2008-10-06T03:30:34.000000+0000 b9329 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272623600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000824:[<0x10000000968/if4-alias-adddel v40>,<0x10000000839/interface v472>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000824:[<0x10000000968/if4-alias-adddel v40>,<0x10000000839/interface v472>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.241 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.024+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000085c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-route-adddel auth v36 ap=1 s=7906 n(v0 rc2008-10-06T03:30:34.000000+0000 b7906 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272624680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000085c:[<0x10000000968/if6-route-adddel v36>,<0x10000000839/interface v472>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000085c:[<0x10000000968/if6-route-adddel v36>,<0x10000000839/interface v472>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.241 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.024+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000829 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-route-addlarge auth v60 ap=1 s=7882 n(v0 rc2008-10-06T03:30:34.000000+0000 b7882 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272624100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000829:[<0x10000000968/if6-route-addlarge v22>,<0x10000000839/interface v472>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000829:[<0x10000000968/if6-route-addlarge v60>,<0x10000000839/interface v472>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.241 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.024+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000085d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-route-adddel auth v48 ap=1 s=8142 n(v0 rc2008-10-06T03:30:34.000000+0000 b8142 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272624c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000085d:[<0x10000000968/if4-route-adddel v48>,<0x10000000839/interface v472>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000085d:[<0x10000000968/if4-route-adddel v48>,<0x10000000839/interface v472>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.241 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.024+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000085b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-addr-adddel auth v34 ap=1 s=8068 n(v0 rc2008-10-06T03:30:34.000000+0000 b8068 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272625180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000085b:[<0x10000000968/if6-addr-adddel v34>,<0x10000000839/interface v472>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000085b:[<0x10000000968/if6-addr-adddel v34>,<0x10000000839/interface v472>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.241 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.082+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008f4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/Makefile auth v12 ap=1 s=1120 n(v0 rc2009-10-09T17:56:05.000000+0000 b1120 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008f4:[<0x10000000a9c/Makefile v12>,<0x10000000a8a/nfs_fsstress v130>,<0x10000000414/nfs v317>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000008f4:[<0x10000000a9c/Makefile v12>,<0x10000000a8a/nfs_fsstress v130>,<0x10000000414/nfs v359>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.242 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.082+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008f6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/fsstress.c auth v18 ap=1 s=55149 n(v0 rc2007-07-24T10:19:21.000000+0000 b55149 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008f6:[<0x10000000a9c/fsstress.c v18>,<0x10000000a8a/nfs_fsstress v130>,<0x10000000414/nfs v317>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000008f6:[<0x10000000a9c/fsstress.c v18>,<0x10000000a8a/nfs_fsstress v130>,<0x10000000414/nfs v359>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.242 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.082+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a9d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/global.h auth v20 ap=1 s=1885 n(v0 rc2024-01-25T15:03:11.035749+0000 b1885 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272630680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a9d:[<0x10000000a9c/global.h v20>,<0x10000000a8a/nfs_fsstress v130>,<0x10000000414/nfs v317>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000a9d:[<0x10000000a9c/global.h v20>,<0x10000000a8a/nfs_fsstress v130>,<0x10000000414/nfs v359>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.242 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.082+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008f3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/nfs_fsstress.sh auth v14 ap=1 s=3887 n(v0 rc2004-03-15T15:43:42.000000+0000 b3887 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008f3:[<0x10000000a9c/nfs_fsstress.sh v14>,<0x10000000a8a/nfs_fsstress v130>,<0x10000000414/nfs v317>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000008f3:[<0x10000000a9c/nfs_fsstress.sh v14>,<0x10000000a8a/nfs_fsstress v130>,<0x10000000414/nfs v359>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.242 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.086+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000008f5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/xfscompat.h auth v16 ap=1 s=154 n(v0 rc2003-11-21T17:05:49.000000+0000 b154 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272630100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000008f5:[<0x10000000a9c/xfscompat.h v16>,<0x10000000a8a/nfs_fsstress v130>,<0x10000000414/nfs v317>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000008f5:[<0x10000000a9c/xfscompat.h v16>,<0x10000000a8a/nfs_fsstress v130>,<0x10000000414/nfs v359>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.577 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.435+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000155a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/coverage.txt auth v12 ap=1 s=132 n(v0 rc2024-01-25T15:03:13.231698+0000 b132 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544637080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000155a:[<0x10000001559/coverage.txt v12>,<0x100000013f1/pthread_rwlockattr_destroy v2458>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000155a:[<0x10000001559/coverage.txt v12>,<0x100000013f1/pthread_rwlockattr_destroy v2744>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.577 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.325+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002f6a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/f38 auth v179 ap=1 s=4194304 n(v0 rc2024-01-25T15:03:36.231158+0000 b4194304 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-12582912@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=24803 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272807080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002f6a:[<0x10000002f48/f38 v10>,<0x10000002f19/d32 v48>,<0x10000002ed5/d1e v239>,<0x10000002e98/d10 v190>,<0x10000002e93/p2 v496>,<0x10000000006/tmp.rygrP0nesr v55>,<0x10000000005/tmp v26>,<0x100000001fb/client.0 v26>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v40>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v50>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000002f6a:[<0x10000002f48/f38 v179>,<0x10000002f19/d32 v110>,<0x10000002ed5/d1e v345>,<0x10000002e98/d10 v244>,<0x10000002e93/p2 v630>,<0x10000000006/tmp.rygrP0nesr v93>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.577 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.326+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002f92 [...2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/ auth{0=1,1=1} v197 ap=2 f(v0 m2024-01-25T15:03:36.585150+0000 8=6+2) n(v1 rc2024-01-25T15:03:36.714147+0000 b10017271 14=9+5) (iauth sync r=1) (isnap sync r=2) (inest mix w=1 dirty) (ipolicy sync r=2) (ifile excl w=1) (iversion lock) caps={24803=pAsLsXsFsxc/pAsLsXsFsxcral@3},l=24803 | dirtyscattered=1 request=0 lock=5 importingcaps=0 dirfrag=1 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5612727e5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002f92:[<0x10000002f48/d3e v14>,<0x10000002f19/d32 v48>,<0x10000002ed5/d1e v239>,<0x10000002e98/d10 v190>,<0x10000002e93/p2 v496>,<0x10000000006/tmp.rygrP0nesr v55>,<0x10000000005/tmp v26>,<0x100000001fb/client.0 v26>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v40>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v50>,<0x1/volumes v47>]//[]","memoryvalue":"(2)0x10000002f92:[<0x10000002f48/d3e v197>,<0x10000002f19/d32 v110>,<0x10000002ed5/d1e v345>,<0x10000002e98/d10 v244>,<0x10000002e93/p2 v630>,<0x10000000006/tmp.rygrP0nesr v93>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-25T15:03:36.585150+0000 8=6+2)","ondisk_value.rstat":"n(v0 rc2024-01-25T15:03:36.714147+0000 b10017271 14=9+5)","memory_value.dirstat":"f(v0 m2024-01-25T15:03:36.585150+0000 8=6+2)","memory_value.rstat":"n(v1 rc2024-01-25T15:03:36.714147+0000 b10017271 14=9+5)","error_str":""},"return_code":0} 2024-01-25T15:03:37.577 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.435+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/3-1.sh auth v16 ap=1 s=400 n(v0 rc2005-06-03T16:32:26.000000+0000 b400 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544637600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000135f:[<0x10000001559/3-1.sh v10>,<0x100000013f1/pthread_rwlockattr_destroy v2458>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000135f:[<0x10000001559/3-1.sh v16>,<0x100000013f1/pthread_rwlockattr_destroy v2744>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.578 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.435+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/1-1.c auth v14 ap=1 s=1124 n(v0 rc2005-06-03T16:32:26.000000+0000 b1124 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544636b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000135d:[<0x10000001559/1-1.c v6>,<0x100000013f1/pthread_rwlockattr_destroy v2458>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000135d:[<0x10000001559/1-1.c v14>,<0x100000013f1/pthread_rwlockattr_destroy v2744>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.578 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.328+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002cca [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/f47 auth v35 ap=1 s=163142 n(v0 rc2024-01-25T15:03:36.459153+0000 b163142 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272808680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002cca:[<0x10000002f92/f47 v10>,<0x10000002f48/d3e v14>,<0x10000002f19/d32 v48>,<0x10000002ed5/d1e v239>,<0x10000002e98/d10 v190>,<0x10000002e93/p2 v496>,<0x10000000006/tmp.rygrP0nesr v55>,<0x10000000005/tmp v26>,<0x100000001fb/client.0 v26>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v40>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v50>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000002cca:[<0x10000002f92/f47 v35>,<0x10000002f48/d3e v197>,<0x10000002f19/d32 v110>,<0x10000002ed5/d1e v345>,<0x10000002e98/d10 v244>,<0x10000002e93/p2 v630>,<0x10000000006/tmp.rygrP0nesr v93>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.578 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.329+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002fac [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/c44 auth v4 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={24803=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272809180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002fac:[<0x10000002f92/c44 v4>,<0x10000002f48/d3e v14>,<0x10000002f19/d32 v48>,<0x10000002ed5/d1e v239>,<0x10000002e98/d10 v190>,<0x10000002e93/p2 v496>,<0x10000000006/tmp.rygrP0nesr v55>,<0x10000000005/tmp v26>,<0x100000001fb/client.0 v26>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v40>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v50>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000002fac:[<0x10000002f92/c44 v4>,<0x10000002f48/d3e v197>,<0x10000002f19/d32 v110>,<0x10000002ed5/d1e v345>,<0x10000002e98/d10 v244>,<0x10000002e93/p2 v630>,<0x10000000006/tmp.rygrP0nesr v93>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012dc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/net_cmdlib.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:37.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000010d6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/Makefile) see mds.c log and `damage ls` output for details 2024-01-25T15:03:37.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000010d7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/cmdlib.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:37.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.579 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.580 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f92 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/safhpi.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.580 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f8c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/plugin.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.580 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f8b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/hotswap.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.580 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000116b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.580 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f90 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/ohpi.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.580 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f94 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/Makefile.in) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.580 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f95 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/threaded.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.580 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f93 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/lock.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.580 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fb2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/Makefile.am) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.581 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000116a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/plugin_static.c.in) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.581 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f91 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/init.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.581 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f8e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/event.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.581 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f8f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/alarm.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.581 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fb1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/domain.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.581 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f8d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/session.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.581 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f96 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/config.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.581 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000116d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.581 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000116c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/Makefile.in) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.581 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fb0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/Makefile.am) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.581 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f97 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi_tests.txt) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.581 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f9a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_032.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.581 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000116e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_035.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.582 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fa1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_010.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.582 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fa4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_034.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.582 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fa8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_031.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.582 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000faf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_version.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.582 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fa3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_008.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.582 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000faa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/Makefile.in) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.582 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fa5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_027.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.582 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f9d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_009.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.582 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fa9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_029.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.582 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fa2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_026.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.582 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f9e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/openhpi.conf) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.582 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/Makefile.am) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.582 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fa6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_024.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.583 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_037.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.583 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f9b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_033.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.583 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f9c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_025.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.583 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fa0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_036.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.583 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f98 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_030.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.583 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/hpiinjector.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.583 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_038.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.583 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f9f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_039.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.583 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000fa7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_007.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.584 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f99 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_028.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.584 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.584 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.584 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000da4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/Makefile.in) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.584 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000da5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/Makefile.am) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.584 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f52 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/snmp_utils.h) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.584 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000da3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/snmp_utils.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.584 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.584 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: pgmap v397: 97 pgs: 97 active+clean; 483 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 MiB/s rd, 66 MiB/s wr, 1.48k op/s 2024-01-25T15:03:37.584 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.584 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.585 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.586 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.586 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.586 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.436+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/2-1.c auth v20 ap=1 s=1478 n(v0 rc2005-06-03T16:32:26.000000+0000 b1478 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544637b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000135c:[<0x10000001559/2-1.c v4>,<0x100000013f1/pthread_rwlockattr_destroy v2458>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000135c:[<0x10000001559/2-1.c v20>,<0x100000013f1/pthread_rwlockattr_destroy v2744>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.586 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.436+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/assertions.xml auth v18 ap=1 s=675 n(v0 rc2024-01-25T15:03:13.232698+0000 b675 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544638100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000135e:[<0x10000001559/assertions.xml v8>,<0x100000013f1/pthread_rwlockattr_destroy v2458>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000135e:[<0x10000001559/assertions.xml v18>,<0x100000013f1/pthread_rwlockattr_destroy v2744>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.586 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.458+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001470 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-2.sh auth v22 ap=1 s=428 n(v0 rc2005-06-03T16:35:58.000000+0000 b428 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544650100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001470:[<0x1000000168c/5-2.sh v18>,<0x100000013f1/sigismember v1320>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001470:[<0x1000000168c/5-2.sh v22>,<0x100000013f1/sigismember v2812>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.586 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.459+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/coverage.txt auth v20 ap=1 s=317 n(v0 rc2005-06-03T16:35:59.000000+0000 b317 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544650c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000146a:[<0x1000000168c/coverage.txt v6>,<0x100000013f1/sigismember v1320>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000146a:[<0x1000000168c/coverage.txt v20>,<0x100000013f1/sigismember v2812>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.586 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.459+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001469 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-3.sh auth v26 ap=1 s=428 n(v0 rc2005-06-03T16:35:58.000000+0000 b428 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544650680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001469:[<0x1000000168c/5-3.sh v4>,<0x100000013f1/sigismember v1320>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001469:[<0x1000000168c/5-3.sh v26>,<0x100000013f1/sigismember v2812>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.587 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.459+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-core-buildonly.c auth v28 ap=1 s=1667 n(v0 rc2024-01-25T15:03:13.403694+0000 b1667 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544651180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000146c:[<0x1000000168c/5-core-buildonly.c v10>,<0x100000013f1/sigismember v1320>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000146c:[<0x1000000168c/5-core-buildonly.c v28>,<0x100000013f1/sigismember v2812>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.587 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.459+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/4-1.c auth v34 ap=1 s=908 n(v0 rc2005-06-03T16:35:58.000000+0000 b908 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544651700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000146e:[<0x1000000168c/4-1.c v14>,<0x100000013f1/sigismember v1320>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000146e:[<0x1000000168c/4-1.c v34>,<0x100000013f1/sigismember v2812>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.587 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.459+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000168d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/3-1.c auth v36 ap=1 s=861 n(v0 rc2024-01-25T15:03:13.402694+0000 b861 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544664000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000168d:[<0x1000000168c/3-1.c v2>,<0x100000013f1/sigismember v1320>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000168d:[<0x1000000168c/3-1.c v36>,<0x100000013f1/sigismember v2812>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.587 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.459+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-4.sh auth v32 ap=1 s=428 n(v0 rc2005-06-03T16:35:58.000000+0000 b428 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544664580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000146f:[<0x1000000168c/5-4.sh v16>,<0x100000013f1/sigismember v1320>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000146f:[<0x1000000168c/5-4.sh v32>,<0x100000013f1/sigismember v2812>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.587 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.330+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002fc4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/f46 auth v21 ap=1 s=1138856 n(v0 rc2024-01-25T15:03:34.380202+0000 b1138856 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272809700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002fc4:[<0x10000002f92/f46 v8>,<0x10000002f48/d3e v14>,<0x10000002f19/d32 v48>,<0x10000002ed5/d1e v239>,<0x10000002e98/d10 v190>,<0x10000002e93/p2 v496>,<0x10000000006/tmp.rygrP0nesr v55>,<0x10000000005/tmp v26>,<0x100000001fb/client.0 v26>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v40>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v50>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000002fc4:[<0x10000002f92/f46 v21>,<0x10000002f48/d3e v197>,<0x10000002f19/d32 v110>,<0x10000002ed5/d1e v345>,<0x10000002e98/d10 v244>,<0x10000002e93/p2 v630>,<0x10000000006/tmp.rygrP0nesr v93>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.587 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.339+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002fa0 [...2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/d41/ auth{0=1,1=1} v51 ap=2 RANDEPHEMERALPIN f(v1 m2024-01-25T15:03:36.604150+0000 7=6+1) n(v1 rc2024-01-25T15:03:36.903143+0000 b4197979 9=7+2) (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={24803=pAsLsXsFs/pAsLsXsFsxcral@2} | dirtyscattered=0 lock=3 importingcaps=0 dirfrag=1 caps=1 stickydirs=0 dirwaiter=0 replicated=1 dirty=1 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 randepin 0x5612727e9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000002fa0:[<0x10000002f92/d41 v6>,<0x10000002f48/d3e v14>,<0x10000002f19/d32 v48>,<0x10000002ed5/d1e v239>,<0x10000002e98/d10 v190>,<0x10000002e93/p2 v496>,<0x10000000006/tmp.rygrP0nesr v55>,<0x10000000005/tmp v26>,<0x100000001fb/client.0 v26>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v40>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v50>,<0x1/volumes v47>]//[]","memoryvalue":"(2)0x10000002fa0:[<0x10000002f92/d41 v17>,<0x10000002f48/d3e v197>,<0x10000002f19/d32 v110>,<0x10000002ed5/d1e v345>,<0x10000002e98/d10 v244>,<0x10000002e93/p2 v630>,<0x10000000006/tmp.rygrP0nesr v93>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-25T15:03:34.116208+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-25T15:03:34.116208+0000 3=2+1)","memory_value.dirstat":"f(v1 m2024-01-25T15:03:36.604150+0000 7=6+1)","memory_value.rstat":"n(v1 rc2024-01-25T15:03:36.903143+0000 b4197979 9=7+2)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-01-25T15:03:37.587 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.407+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001317 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/22-1.c auth v128 ap=1 s=2459 n(v0 rc2007-07-26T12:02:15.000000+0000 b2459 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272640b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001317:[<0x100000016c4/22-1.c v62>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001317:[<0x100000016c4/22-1.c v128>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.588 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.407+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001310 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/15-2.c auth v110 ap=1 s=2536 n(v0 rc2007-07-26T12:02:15.000000+0000 b2536 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272640000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001310:[<0x100000016c4/15-2.c v48>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001310:[<0x100000016c4/15-2.c v110>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.588 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.407+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fa [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/20-1.c auth v80 ap=1 s=2425 n(v0 rc2005-06-03T16:33:30.000000+0000 b2425 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272641080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012fa:[<0x100000016c4/20-1.c v80>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012fa:[<0x100000016c4/20-1.c v80>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.588 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.407+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001313 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/7-1.c auth v104 ap=1 s=932 n(v0 rc2005-06-03T16:33:32.000000+0000 b932 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272640580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001313:[<0x100000016c4/7-1.c v104>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001313:[<0x100000016c4/7-1.c v104>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.588 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.407+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001316 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/13-1.c auth v90 ap=1 s=706 n(v0 rc2005-06-03T16:33:12.000000+0000 b706 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272641600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001316:[<0x100000016c4/13-1.c v90>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001316:[<0x100000016c4/13-1.c v90>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.588 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.408+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/18-1.sh auth v112 ap=1 s=240 n(v0 rc2005-06-03T16:33:13.000000+0000 b240 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272641b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130d:[<0x100000016c4/18-1.sh v42>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000130d:[<0x100000016c4/18-1.sh v112>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.588 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.589 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dbd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ekeyfru.h) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.589 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dbb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_control_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.589 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000db9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_close.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.589 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000db8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.589 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dba (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/hotswap.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.589 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dc1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.sym) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.589 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dc5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/posix_vlog.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.589 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f5a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.589 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dbf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.h) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.589 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dbc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_connection.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.589 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dcc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.in) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.589 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000db7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_vshm_rdrs.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.589 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_mc_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.590 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dcd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_fru.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.590 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.459+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/assertions.xml auth v24 ap=1 s=975 n(v0 rc2005-06-03T16:35:59.000000+0000 b975 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544664b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000146d:[<0x1000000168c/assertions.xml v12>,<0x100000013f1/sigismember v1320>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000146d:[<0x1000000168c/assertions.xml v24>,<0x100000013f1/sigismember v2812>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.590 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.460+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000146b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-1.sh auth v30 ap=1 s=428 n(v0 rc2005-06-03T16:35:58.000000+0000 b428 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544665080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000146b:[<0x1000000168c/5-1.sh v8>,<0x100000013f1/sigismember v1320>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000146b:[<0x1000000168c/5-1.sh v30>,<0x100000013f1/sigismember v2812>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.590 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.471+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000132e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/7-1.c auth v52 ap=1 s=1857 n(v0 rc2005-06-03T16:30:54.000000+0000 b1857 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544645080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000132e:[<0x10000001547/7-1.c v20>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000132e:[<0x10000001547/7-1.c v52>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.590 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.471+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000132f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/13-1.c auth v38 ap=1 s=2467 n(v0 rc2005-06-03T16:30:54.000000+0000 b2467 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544645600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000132f:[<0x10000001547/13-1.c v38>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000132f:[<0x10000001547/13-1.c v38>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.590 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.471+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000132d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/12-1.c auth v46 ap=1 s=2163 n(v0 rc2005-06-03T16:30:54.000000+0000 b2163 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544645b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000132d:[<0x10000001547/12-1.c v18>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000132d:[<0x10000001547/12-1.c v46>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.590 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.471+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000132a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/1-1.c auth v30 ap=1 s=3004 n(v0 rc2007-07-26T12:02:13.000000+0000 b3004 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544646100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000132a:[<0x10000001547/1-1.c v30>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000132a:[<0x10000001547/1-1.c v30>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.591 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.471+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001327 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/coverage.txt auth v44 ap=1 s=252 n(v0 rc2005-06-03T16:30:54.000000+0000 b252 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544646680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001327:[<0x10000001547/coverage.txt v6>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001327:[<0x10000001547/coverage.txt v44>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.591 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.472+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001331 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/11-2.c auth v42 ap=1 s=1908 n(v0 rc2005-06-03T16:30:54.000000+0000 b1908 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544646c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001331:[<0x10000001547/11-2.c v26>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001331:[<0x10000001547/11-2.c v42>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.591 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.408+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001315 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-6.c auth v84 ap=1 s=3519 n(v0 rc2009-08-22T16:28:39.000000+0000 b3519 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272642100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001315:[<0x100000016c4/17-6.c v84>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001315:[<0x100000016c4/17-6.c v84>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.591 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.408+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/15-1.c auth v122 ap=1 s=2308 n(v0 rc2007-07-26T12:02:15.000000+0000 b2308 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272642680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130e:[<0x100000016c4/15-1.c v44>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000130e:[<0x100000016c4/15-1.c v122>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.591 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.409+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001312 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/12-1.c auth v124 ap=1 s=767 n(v0 rc2005-06-03T16:33:12.000000+0000 b767 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272642c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001312:[<0x100000016c4/12-1.c v52>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001312:[<0x100000016c4/12-1.c v124>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.591 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.409+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001307 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/14-1.c auth v132 ap=1 s=803 n(v0 rc2005-06-03T16:33:12.000000+0000 b803 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272643180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001307:[<0x100000016c4/14-1.c v30>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001307:[<0x100000016c4/14-1.c v132>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.591 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.409+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/1-1.c auth v136 ap=1 s=2583 n(v0 rc2005-06-03T16:33:11.000000+0000 b2583 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272643700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130b:[<0x100000016c4/1-1.c v38>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000130b:[<0x100000016c4/1-1.c v136>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.592 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.409+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ff [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-3.c auth v78 ap=1 s=2434 n(v0 rc2005-06-03T16:33:12.000000+0000 b2434 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127264c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ff:[<0x100000016c4/17-3.c v78>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012ff:[<0x100000016c4/17-3.c v78>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.592 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.410+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001300 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/coverage.txt auth v120 ap=1 s=569 n(v0 rc2005-06-03T16:33:33.000000+0000 b569 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127264c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001300:[<0x100000016c4/coverage.txt v16>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001300:[<0x100000016c4/coverage.txt v120>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.592 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.410+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001311 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/3-1.sh auth v100 ap=1 s=302 n(v0 rc2005-06-03T16:33:32.000000+0000 b302 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127264cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001311:[<0x100000016c4/3-1.sh v100>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001311:[<0x100000016c4/3-1.sh v100>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.592 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.472+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000132b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/8-1.c auth v36 ap=1 s=2860 n(v0 rc2005-06-03T16:30:54.000000+0000 b2860 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544647180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000132b:[<0x10000001547/8-1.c v36>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000132b:[<0x10000001547/8-1.c v36>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.592 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.472+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001328 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/2-1.c auth v40 ap=1 s=2042 n(v0 rc2005-06-03T16:30:54.000000+0000 b2042 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544647700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001328:[<0x10000001547/2-1.c v8>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001328:[<0x10000001547/2-1.c v40>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.593 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.410+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001318 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/4-1.c auth v130 ap=1 s=2456 n(v0 rc2005-06-03T16:33:32.000000+0000 b2456 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127264db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001318:[<0x100000016c4/4-1.c v64>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001318:[<0x100000016c4/4-1.c v130>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.593 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.410+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-4.c auth v96 ap=1 s=2459 n(v0 rc2005-06-03T16:33:28.000000+0000 b2459 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127264d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130c:[<0x100000016c4/19-4.c v96>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000130c:[<0x100000016c4/19-4.c v96>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.593 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.410+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001308 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/2-1.c auth v126 ap=1 s=719 n(v0 rc2005-06-03T16:33:30.000000+0000 b719 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127264e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001308:[<0x100000016c4/2-1.c v32>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001308:[<0x100000016c4/2-1.c v126>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.593 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.410+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/6-1.c auth v92 ap=1 s=838 n(v0 rc2005-06-03T16:33:32.000000+0000 b838 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127264e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130a:[<0x100000016c4/6-1.c v92>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000130a:[<0x100000016c4/6-1.c v92>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.593 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dc8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dc6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dce (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_rdrs.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dd3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.am) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dc4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f59 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dc2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/sync.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dc0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dcf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_util.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dd0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_slot_rdrs.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dc3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_drv.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.594 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dcb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_fru_rdrs.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dc9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sel.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dc7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.595 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dbe (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_controls.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.595 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.472+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001329 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/5-1.c auth v50 ap=1 s=2729 n(v0 rc2005-06-03T16:30:54.000000+0000 b2729 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554464e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001329:[<0x10000001547/5-1.c v10>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001329:[<0x10000001547/5-1.c v50>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.595 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.472+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001326 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/10-1.c auth v56 ap=1 s=1929 n(v0 rc2024-01-25T15:03:13.191698+0000 b1929 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554464e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001326:[<0x10000001547/10-1.c v4>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001326:[<0x10000001547/10-1.c v56>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dd4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dd1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.in) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000dd2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.am) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f5b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/ipmi_thres_test.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000969 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-updown) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000828 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-mtu-change) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000825 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-addr-change) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.596 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000823 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-route-addlarge) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000827 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-addr-addlarge) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000821 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/00_Descriptions.txt) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000822 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-updown) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000820 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/Makefile) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000085a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-mtu-change) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.597 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000826 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-alias-addlarge) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.597 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.472+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001330 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/4-1.sh auth v32 ap=1 s=531 n(v0 rc2005-06-03T16:30:54.000000+0000 b531 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56554464eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001330:[<0x10000001547/4-1.sh v32>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001330:[<0x10000001547/4-1.sh v32>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.597 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.472+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001548 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/9-1.sh auth v34 ap=1 s=526 n(v0 rc2005-06-03T16:30:54.000000+0000 b526 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56554464f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001548:[<0x10000001547/9-1.sh v34>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001548:[<0x10000001547/9-1.sh v34>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.598 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.473+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001332 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/11-1.c auth v48 ap=1 s=1946 n(v0 rc2005-06-03T16:30:53.000000+0000 b1946 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554464f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001332:[<0x10000001547/11-1.c v28>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001332:[<0x10000001547/11-1.c v48>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.598 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.473+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000132c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/assertions.xml auth v54 ap=1 s=3065 n(v0 rc2005-06-03T16:30:54.000000+0000 b3065 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554464fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000132c:[<0x10000001547/assertions.xml v16>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000132c:[<0x10000001547/assertions.xml v54>,<0x100000013f1/mq_receive v2600>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.598 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.411+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001309 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/5-1.c auth v106 ap=1 s=882 n(v0 rc2005-06-03T16:33:32.000000+0000 b882 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127264f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001309:[<0x100000016c4/5-1.c v34>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001309:[<0x100000016c4/5-1.c v106>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.598 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.411+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001301 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-5.c auth v98 ap=1 s=2317 n(v0 rc2007-07-26T12:02:15.000000+0000 b2317 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127264ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001301:[<0x100000016c4/17-5.c v98>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001301:[<0x100000016c4/17-5.c v98>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.599 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.411+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/10-1.c auth v74 ap=1 s=907 n(v0 rc2005-06-03T16:33:12.000000+0000 b907 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127264f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012fb:[<0x100000016c4/10-1.c v74>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012fb:[<0x100000016c4/10-1.c v74>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.599 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.411+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001302 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-2.c auth v116 ap=1 s=2425 n(v0 rc2005-06-03T16:33:12.000000+0000 b2425 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272654000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001302:[<0x100000016c4/17-2.c v20>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001302:[<0x100000016c4/17-2.c v116>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.599 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.411+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001304 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-4.c auth v138 ap=1 s=2421 n(v0 rc2005-06-03T16:33:12.000000+0000 b2421 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127264d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001304:[<0x100000016c4/17-4.c v24>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001304:[<0x100000016c4/17-4.c v138>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.599 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.412+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001449 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/9-1.c auth v142 ap=1 s=890 n(v0 rc2024-01-25T15:03:13.167699+0000 b890 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272654580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001449:[<0x100000016c4/9-1.c v2>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001449:[<0x100000016c4/9-1.c v142>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.599 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.485+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ca [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-24.c auth v831 ap=1 s=1339 n(v0 rc2005-06-03T16:35:45.000000+0000 b1339 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449be000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ca:[<0x100000016ae/6-24.c v16>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014ca:[<0x100000016ae/6-24.c v831>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.599 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.485+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000163d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-63.c auth v843 ap=1 s=904 n(v0 rc2005-06-03T16:35:30.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449bf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000163d:[<0x100000016ae/4-63.c v614>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000163d:[<0x100000016ae/4-63.c v843>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.600 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.412+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fe [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/22-2.c auth v140 ap=1 s=2552 n(v0 rc2007-07-26T12:02:15.000000+0000 b2552 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272654b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012fe:[<0x100000016c4/22-2.c v12>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012fe:[<0x100000016c4/22-2.c v140>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.600 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.412+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001306 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/8-1.sh auth v88 ap=1 s=395 n(v0 rc2005-06-03T16:33:32.000000+0000 b395 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272655080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001306:[<0x100000016c4/8-1.sh v88>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001306:[<0x100000016c4/8-1.sh v88>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.600 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000824 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-alias-adddel) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.600 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000085c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-route-adddel) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000829 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-route-addlarge) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000085d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-route-adddel) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000085b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-addr-adddel) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000008f4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/Makefile) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000008f6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/fsstress.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000a9d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/global.h) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000008f3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/nfs_fsstress.sh) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.601 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000008f5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/xfscompat.h) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:37.602 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.602 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.485+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000162e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-16.c auth v951 ap=1 s=2501 n(v0 rc2005-06-03T16:35:18.000000+0000 b2501 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449be580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000162e:[<0x100000016ae/22-16.c v584>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000162e:[<0x100000016ae/22-16.c v951>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.602 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.486+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015cc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-5.c auth v887 ap=1 s=1333 n(v0 rc2005-06-03T16:35:46.000000+0000 b1333 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449bfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015cc:[<0x100000016ae/6-5.c v388>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015cc:[<0x100000016ae/6-5.c v887>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.602 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.486+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001665 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-17.c auth v947 ap=1 s=4336 n(v0 rc2005-06-03T16:35:19.000000+0000 b4336 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449c0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001665:[<0x100000016ae/23-17.c v694>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001665:[<0x100000016ae/23-17.c v947>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.603 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.486+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001603 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-15.c auth v873 ap=1 s=1476 n(v0 rc2005-06-03T16:34:41.000000+0000 b1476 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449c0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001603:[<0x100000016ae/1-15.c v498>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001603:[<0x100000016ae/1-15.c v873>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.603 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.486+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014cf [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-16.c auth v813 ap=1 s=1722 n(v0 rc2005-06-03T16:34:56.000000+0000 b1722 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449c0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014cf:[<0x100000016ae/13-16.c v26>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014cf:[<0x100000016ae/13-16.c v813>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.603 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.487+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001512 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-24.c auth v865 ap=1 s=1910 n(v0 rc2005-06-03T16:35:29.000000+0000 b1910 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449c1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001512:[<0x100000016ae/4-24.c v164>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001512:[<0x100000016ae/4-24.c v865>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.603 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.487+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015d9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-22.c auth v897 ap=1 s=3873 n(v0 rc2005-06-03T16:34:59.000000+0000 b3873 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449ca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015d9:[<0x100000016ae/18-22.c v414>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015d9:[<0x100000016ae/18-22.c v897>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.603 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.487+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015fb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-23.c auth v961 ap=1 s=2176 n(v0 rc2005-06-03T16:34:58.000000+0000 b2176 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449ca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015fb:[<0x100000016ae/17-23.c v482>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015fb:[<0x100000016ae/17-23.c v961>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.603 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.412+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/11-1.c auth v118 ap=1 s=936 n(v0 rc2005-06-03T16:33:12.000000+0000 b936 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272655b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131b:[<0x100000016c4/11-1.c v70>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000131b:[<0x100000016c4/11-1.c v118>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.603 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.412+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-3.c auth v94 ap=1 s=1809 n(v0 rc2005-06-03T16:33:28.000000+0000 b1809 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272655600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012fc:[<0x100000016c4/19-3.c v94>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012fc:[<0x100000016c4/19-3.c v94>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.604 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.414+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001319 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-5.c auth v144 ap=1 s=2122 n(v0 rc2005-06-03T16:33:30.000000+0000 b2122 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272656680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001319:[<0x100000016c4/19-5.c v66>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001319:[<0x100000016c4/19-5.c v144>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.604 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.414+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/16-1.c auth v114 ap=1 s=1568 n(v0 rc2005-06-03T16:33:12.000000+0000 b1568 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272656c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131a:[<0x100000016c4/16-1.c v68>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000131a:[<0x100000016c4/16-1.c v114>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.604 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.414+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001305 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-7.c auth v134 ap=1 s=3015 n(v0 rc2005-06-03T16:33:12.000000+0000 b3015 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272657180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001305:[<0x100000016c4/17-7.c v26>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001305:[<0x100000016c4/17-7.c v134>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.604 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.414+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-1.c auth v86 ap=1 s=2950 n(v0 rc2005-06-03T16:33:12.000000+0000 b2950 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272656100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131c:[<0x100000016c4/17-1.c v86>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000131c:[<0x100000016c4/17-1.c v86>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.604 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.415+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000130f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/assertions.xml auth v76 ap=1 s=6077 n(v0 rc2024-01-25T15:03:13.169699+0000 b6077 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272657700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000130f:[<0x100000016c4/assertions.xml v76>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000130f:[<0x100000016c4/assertions.xml v76>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.604 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.415+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012fd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-1.c auth v102 ap=1 s=2209 n(v0 rc2005-06-03T16:33:13.000000+0000 b2209 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272662000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012fd:[<0x100000016c4/19-1.c v102>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012fd:[<0x100000016c4/19-1.c v102>,<0x100000013f1/sched_setscheduler v2760>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.605 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.488+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014fc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-47.c auth v895 ap=1 s=1770 n(v0 rc2024-01-25T15:03:13.550690+0000 b1770 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449cb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014fc:[<0x100000016ae/12-47.c v120>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014fc:[<0x100000016ae/12-47.c v895>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.605 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.488+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001510 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-21.c auth v905 ap=1 s=2441 n(v0 rc2005-06-03T16:35:23.000000+0000 b2441 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449cb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001510:[<0x100000016ae/25-21.c v160>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001510:[<0x100000016ae/25-21.c v905>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.605 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.488+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001643 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-40.c auth v917 ap=1 s=1989 n(v0 rc2005-06-03T16:35:29.000000+0000 b1989 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449cbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001643:[<0x100000016ae/4-40.c v626>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001643:[<0x100000016ae/4-40.c v917>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.605 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.489+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001687 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-3.c auth v949 ap=1 s=1719 n(v0 rc2005-06-03T16:34:57.000000+0000 b1719 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001687:[<0x100000016ae/13-3.c v762>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001687:[<0x100000016ae/13-3.c v949>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.605 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.489+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000165d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-15.c auth v965 ap=1 s=1525 n(v0 rc2005-06-03T16:35:25.000000+0000 b1525 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449cc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000165d:[<0x100000016ae/3-15.c v678>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000165d:[<0x100000016ae/3-15.c v965>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.606 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.415+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001314 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/21-1.c auth v82 ap=1 s=1929 n(v0 rc2005-06-03T16:33:31.000000+0000 b1929 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272662b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001314:[<0x100000016c4/21-1.c v82>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001314:[<0x100000016c4/21-1.c v82>,<0x100000013f1/sched_setscheduler v3620>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.606 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.416+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001303 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-2.c auth v108 ap=1 s=1682 n(v0 rc2005-06-03T16:33:28.000000+0000 b1682 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272662580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001303:[<0x100000016c4/19-2.c v22>,<0x100000013f1/sched_setscheduler v2658>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001303:[<0x100000016c4/19-2.c v108>,<0x100000013f1/sched_setscheduler v3620>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.606 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.452+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-3.c auth v28 ap=1 s=10604 n(v0 rc2005-06-03T16:32:14.000000+0000 b10604 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272663600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c0:[<0x1000000156f/4-3.c v28>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000013c0:[<0x1000000156f/4-3.c v28>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.606 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.453+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-2.c auth v30 ap=1 s=11809 n(v0 rc2007-07-26T12:02:14.000000+0000 b11809 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272663080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b8:[<0x1000000156f/4-2.c v30>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000013b8:[<0x1000000156f/4-2.c v30>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.607 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.489+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-39.c auth v901 ap=1 s=1773 n(v0 rc2005-06-03T16:34:55.000000+0000 b1773 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449ccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c9:[<0x100000016ae/12-39.c v14>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014c9:[<0x100000016ae/12-39.c v901>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.607 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.489+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015a3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-26.c auth v847 ap=1 s=1476 n(v0 rc2005-06-03T16:34:51.000000+0000 b1476 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449cd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015a3:[<0x100000016ae/1-26.c v306>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015a3:[<0x100000016ae/1-26.c v847>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.607 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.489+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001676 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-7.c auth v937 ap=1 s=2004 n(v0 rc2005-06-03T16:34:56.000000+0000 b2004 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449cd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001676:[<0x100000016ae/12-7.c v728>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001676:[<0x100000016ae/12-7.c v937>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.607 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.490+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001626 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-84.c auth v809 ap=1 s=902 n(v0 rc2005-06-03T16:35:32.000000+0000 b902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449d4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001626:[<0x100000016ae/4-84.c v568>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001626:[<0x100000016ae/4-84.c v809>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.608 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.490+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001528 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-8.c auth v821 ap=1 s=1472 n(v0 rc2005-06-03T16:34:51.000000+0000 b1472 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449d5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001528:[<0x100000016ae/1-8.c v208>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001528:[<0x100000016ae/1-8.c v821>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.608 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.491+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015fc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-10.c auth v823 ap=1 s=1333 n(v0 rc2005-06-03T16:35:32.000000+0000 b1333 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449d5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015fc:[<0x100000016ae/6-10.c v484>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015fc:[<0x100000016ae/6-10.c v823>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.608 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.491+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000152c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-19.c auth v857 ap=1 s=1476 n(v0 rc2005-06-03T16:34:41.000000+0000 b1476 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449d6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000152c:[<0x100000016ae/1-19.c v216>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000152c:[<0x100000016ae/1-19.c v857>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.608 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.491+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000162c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-8.c auth v909 ap=1 s=6203 n(v0 rc2005-06-03T16:35:25.000000+0000 b6203 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449d7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000162c:[<0x100000016ae/28-8.c v580>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000162c:[<0x100000016ae/28-8.c v909>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.608 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.492+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000167a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-6.c auth v931 ap=1 s=4329 n(v0 rc2005-06-03T16:35:21.000000+0000 b4329 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449d7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000167a:[<0x100000016ae/23-6.c v736>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000167a:[<0x100000016ae/23-6.c v931>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.608 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.492+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000159a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-21.c auth v953 ap=1 s=5509 n(v0 rc2005-06-03T16:34:57.000000+0000 b5509 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449e2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000159a:[<0x100000016ae/16-21.c v288>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000159a:[<0x100000016ae/16-21.c v953>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.609 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.453+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013be [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/1-1.c auth v40 ap=1 s=2649 n(v0 rc2005-06-03T16:32:13.000000+0000 b2649 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272664100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013be:[<0x1000000156f/1-1.c v16>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000013be:[<0x1000000156f/1-1.c v40>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.609 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.453+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013b9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/coverage.txt auth v36 ap=1 s=520 n(v0 rc2005-06-03T16:32:14.000000+0000 b520 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272664680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013b9:[<0x1000000156f/coverage.txt v6>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000013b9:[<0x1000000156f/coverage.txt v36>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.609 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.453+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013ba [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/1-2.c auth v42 ap=1 s=12377 n(v0 rc2007-07-26T12:02:14.000000+0000 b12377 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272663b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013ba:[<0x1000000156f/1-2.c v8>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000013ba:[<0x1000000156f/1-2.c v42>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.609 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.453+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013bc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/testfrmw.h auth v38 ap=1 s=2420 n(v0 rc2005-06-03T16:32:14.000000+0000 b2420 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272664c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013bc:[<0x1000000156f/testfrmw.h v12>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000013bc:[<0x1000000156f/testfrmw.h v38>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.609 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.454+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013c1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-1.c auth v32 ap=1 s=1241 n(v0 rc2005-06-03T16:32:14.000000+0000 b1241 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272665180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013c1:[<0x1000000156f/4-1.c v22>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000013c1:[<0x1000000156f/4-1.c v32>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.609 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.454+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001570 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/3-1.c auth v34 ap=1 s=1403 n(v0 rc2024-01-25T15:03:13.294696+0000 b1403 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272678000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001570:[<0x1000000156f/3-1.c v2>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001570:[<0x1000000156f/3-1.c v34>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.609 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.454+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013bd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/2-1.c auth v44 ap=1 s=11893 n(v0 rc2007-07-26T12:02:14.000000+0000 b11893 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272665700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013bd:[<0x1000000156f/2-1.c v14>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000013bd:[<0x1000000156f/2-1.c v44>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.610 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.454+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013bf [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/assertions.xml auth v24 ap=1 s=1277 n(v0 rc2005-06-03T16:32:14.000000+0000 b1277 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272678b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013bf:[<0x1000000156f/assertions.xml v24>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000013bf:[<0x1000000156f/assertions.xml v24>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.610 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.492+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000164a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-43.c auth v875 ap=1 s=1989 n(v0 rc2005-06-03T16:35:29.000000+0000 b1989 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449e2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000164a:[<0x100000016ae/4-43.c v640>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000164a:[<0x100000016ae/4-43.c v875>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.610 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.493+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000152a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-22.c auth v855 ap=1 s=6206 n(v0 rc2024-01-25T15:03:13.554690+0000 b6206 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449e3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000152a:[<0x100000016ae/28-22.c v212>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000152a:[<0x100000016ae/28-22.c v855>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.610 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.493+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001534 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-20.c auth v943 ap=1 s=3873 n(v0 rc2005-06-03T16:34:59.000000+0000 b3873 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449e3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001534:[<0x100000016ae/18-20.c v232>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001534:[<0x100000016ae/18-20.c v943>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.610 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.493+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001518 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-17.c auth v807 ap=1 s=1525 n(v0 rc2005-06-03T16:35:25.000000+0000 b1525 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449e4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001518:[<0x100000016ae/3-17.c v176>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001518:[<0x100000016ae/3-17.c v807>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.610 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.493+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015fd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-49.c auth v869 ap=1 s=1770 n(v0 rc2005-06-03T16:34:55.000000+0000 b1770 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449e4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015fd:[<0x100000016ae/12-49.c v486>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015fd:[<0x100000016ae/12-49.c v869>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.610 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.494+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015d7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-1.c auth v861 ap=1 s=6206 n(v0 rc2005-06-03T16:35:23.000000+0000 b6206 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449e4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015d7:[<0x100000016ae/28-1.c v410>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015d7:[<0x100000016ae/28-1.c v861>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.611 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.494+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000165c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-82.c auth v955 ap=1 s=904 n(v0 rc2005-06-03T16:35:31.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449e5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000165c:[<0x100000016ae/4-82.c v676>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000165c:[<0x100000016ae/4-82.c v955>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.611 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.494+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015df [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-7.c auth v929 ap=1 s=2176 n(v0 rc2005-06-03T16:34:58.000000+0000 b2176 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449e5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015df:[<0x100000016ae/17-7.c v426>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015df:[<0x100000016ae/17-7.c v929>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.611 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.454+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013bb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/testfrmw.c auth v26 ap=1 s=2106 n(v0 rc2005-06-03T16:32:14.000000+0000 b2106 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272678580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013bb:[<0x1000000156f/testfrmw.c v26>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000013bb:[<0x1000000156f/testfrmw.c v26>,<0x100000013f1/pthread_mutex_trylock v2630>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.611 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.462+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001212 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/1-1.c auth v14 ap=1 s=1614 n(v0 rc2007-07-26T12:02:13.000000+0000 b1614 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272634100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001212:[<0x100000013f8/1-1.c v6>,<0x100000013f1/clock_getcpuclockid v2446>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001212:[<0x100000013f8/1-1.c v14>,<0x100000013f1/clock_getcpuclockid v2446>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.611 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.463+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001213 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/assertions.xml auth v12 ap=1 s=1012 n(v0 rc2005-06-03T16:30:24.000000+0000 b1012 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272635180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001213:[<0x100000013f8/assertions.xml v12>,<0x100000013f1/clock_getcpuclockid v2446>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001213:[<0x100000013f8/assertions.xml v12>,<0x100000013f1/clock_getcpuclockid v2446>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.611 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.463+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001211 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/2-1.c auth v16 ap=1 s=1760 n(v0 rc2007-07-26T12:02:13.000000+0000 b1760 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272634c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001211:[<0x100000013f8/2-1.c v4>,<0x100000013f1/clock_getcpuclockid v2446>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001211:[<0x100000013f8/2-1.c v16>,<0x100000013f1/clock_getcpuclockid v2446>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.611 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.463+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x100000013f9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/coverage.txt auth v10 ap=1 s=12 n(v0 rc2024-01-25T15:03:12.883706+0000 b12 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272634680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000013f9:[<0x100000013f8/coverage.txt v10>,<0x100000013f1/clock_getcpuclockid v2446>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000013f9:[<0x100000013f8/coverage.txt v10>,<0x100000013f1/clock_getcpuclockid v2446>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.612 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.385+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/15-1.c auth v68 ap=1 s=693 n(v0 rc2005-06-03T16:32:49.000000+0000 b693 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2ea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b2:[<0x10000001420/15-1.c v22>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012b2:[<0x10000001420/15-1.c v68>,<0x100000013f1/pthread_sigmask v2756>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.612 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.385+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/7-1.c auth v52 ap=1 s=2682 n(v0 rc2005-06-03T16:32:50.000000+0000 b2682 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2ea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b6:[<0x10000001420/7-1.c v30>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012b6:[<0x10000001420/7-1.c v52>,<0x100000013f1/pthread_sigmask v2756>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.613 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.329+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000002fb3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/d41/c45 auth v2 ap=1 s=0 n(v0 1=1+0) (iversion lock) caps={24803=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad478fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000002fb3:[<0x10000002fa0/c45 v2>,<0x10000002f92/d41 v6>,<0x10000002f48/d3e v14>,<0x10000002f19/d32 v48>,<0x10000002ed5/d1e v239>,<0x10000002e98/d10 v190>,<0x10000002e93/p2 v496>,<0x10000000006/tmp.rygrP0nesr v55>,<0x10000000005/tmp v26>,<0x100000001fb/client.0 v26>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v40>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v50>,<0x1/volumes v47>]//[]","memoryvalue":"(3)0x10000002fb3:[<0x10000002fa0/c45 v2>,<0x10000002f92/d41 v17>,<0x10000002f48/d3e v159>,<0x10000002f19/d32 v110>,<0x10000002ed5/d1e v345>,<0x10000002e98/d10 v244>,<0x10000002e93/p2 v630>,<0x10000000006/tmp.rygrP0nesr v93>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.613 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.386+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001359 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/1-1.c auth v32 ap=1 s=1502 n(v0 rc2005-06-03T16:32:14.000000+0000 b1502 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad491ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001359:[<0x10000001557/1-1.c v14>,<0x100000013f1/pthread_mutex_unlock v2402>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001359:[<0x10000001557/1-1.c v32>,<0x100000013f1/pthread_mutex_unlock v2712>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.613 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.386+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/12-1.c auth v46 ap=1 s=3694 n(v0 rc2024-01-25T15:03:12.986703+0000 b3694 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2eab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b5:[<0x10000001420/12-1.c v46>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012b5:[<0x10000001420/12-1.c v46>,<0x100000013f1/pthread_sigmask v2756>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.614 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.386+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ab [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/coverage.txt auth v72 ap=1 s=902 n(v0 rc2005-06-03T16:32:51.000000+0000 b902 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2eb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ab:[<0x10000001420/coverage.txt v8>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012ab:[<0x10000001420/coverage.txt v72>,<0x100000013f1/pthread_sigmask v2756>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.614 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.614 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.614 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.614 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.615 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012dc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/net_cmdlib.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:37.615 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000010d6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/Makefile) see mds.c log and `damage ls` output for details 2024-01-25T15:03:37.615 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000010d7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/cmdlib.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:37.615 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.615 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.615 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.615 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f92 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/safhpi.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.615 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f8c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/plugin.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.615 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f8b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/hotswap.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.615 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000116b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.615 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f90 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/ohpi.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.615 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f94 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/Makefile.in) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.615 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f95 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/threaded.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.615 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f93 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/lock.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.616 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fb2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/Makefile.am) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.616 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000116a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/plugin_static.c.in) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.616 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.386+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001354 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/coverage.txt auth v30 ap=1 s=538 n(v0 rc2005-06-03T16:32:15.000000+0000 b538 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad491b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001354:[<0x10000001557/coverage.txt v4>,<0x100000013f1/pthread_mutex_unlock v2402>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001354:[<0x10000001557/coverage.txt v30>,<0x100000013f1/pthread_mutex_unlock v2712>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.616 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.386+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/5-2.c auth v24 ap=1 s=4957 n(v0 rc2005-06-03T16:32:15.000000+0000 b4957 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad491a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000135a:[<0x10000001557/5-2.c v16>,<0x100000013f1/pthread_mutex_unlock v2402>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000135a:[<0x10000001557/5-2.c v24>,<0x100000013f1/pthread_mutex_unlock v2712>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.617 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.386+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012af [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/14-1.c auth v62 ap=1 s=2005 n(v0 rc2005-06-03T16:32:49.000000+0000 b2005 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2eb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012af:[<0x10000001420/14-1.c v16>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012af:[<0x10000001420/14-1.c v62>,<0x100000013f1/pthread_sigmask v2756>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.617 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.386+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ae [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/testfrmw.h auth v42 ap=1 s=2420 n(v0 rc2005-06-03T16:32:51.000000+0000 b2420 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2ebb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ae:[<0x10000001420/testfrmw.h v42>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012ae:[<0x10000001420/testfrmw.h v42>,<0x100000013f1/pthread_sigmask v2756>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.617 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.386+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-1.c auth v50 ap=1 s=2616 n(v0 rc2005-06-03T16:32:50.000000+0000 b2616 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2ec100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b3:[<0x10000001420/8-1.c v24>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012b3:[<0x10000001420/8-1.c v50>,<0x100000013f1/pthread_sigmask v2756>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.617 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.387+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/4-1.c auth v70 ap=1 s=3756 n(v0 rc2005-06-03T16:32:49.000000+0000 b3756 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2ec680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b7:[<0x10000001420/4-1.c v32>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012b7:[<0x10000001420/4-1.c v70>,<0x100000013f1/pthread_sigmask v2756>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.618 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.386+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001356 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/testfrmw.h auth v22 ap=1 s=2320 n(v0 rc2005-06-03T16:32:15.000000+0000 b2320 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad491b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001356:[<0x10000001557/testfrmw.h v8>,<0x100000013f1/pthread_mutex_unlock v2402>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001356:[<0x10000001557/testfrmw.h v22>,<0x100000013f1/pthread_mutex_unlock v2712>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.618 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.386+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001357 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/2-1.c auth v20 ap=1 s=2942 n(v0 rc2005-06-03T16:32:14.000000+0000 b2942 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad492a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001357:[<0x10000001557/2-1.c v20>,<0x100000013f1/pthread_mutex_unlock v2402>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001357:[<0x10000001557/2-1.c v20>,<0x100000013f1/pthread_mutex_unlock v2712>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.619 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.387+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001421 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-3.c auth v48 ap=1 s=2621 n(v0 rc2024-01-25T15:03:12.985703+0000 b2621 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2ecc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001421:[<0x10000001420/8-3.c v2>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001421:[<0x10000001420/8-3.c v48>,<0x100000013f1/pthread_sigmask v2756>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.619 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.387+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/6-1.c auth v58 ap=1 s=4490 n(v0 rc2005-06-03T16:32:50.000000+0000 b4490 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2ed180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b1:[<0x10000001420/6-1.c v20>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012b1:[<0x10000001420/6-1.c v58>,<0x100000013f1/pthread_sigmask v2756>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.619 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.386+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001558 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/3-1.c auth v26 ap=1 s=1473 n(v0 rc2024-01-25T15:03:13.226698+0000 b1473 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad492a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001558:[<0x10000001557/3-1.c v2>,<0x100000013f1/pthread_mutex_unlock v2402>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001558:[<0x10000001557/3-1.c v26>,<0x100000013f1/pthread_mutex_unlock v2712>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.620 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.387+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001358 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/5-1.c auth v36 ap=1 s=5249 n(v0 rc2005-06-03T16:32:14.000000+0000 b5249 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad492ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001358:[<0x10000001557/5-1.c v12>,<0x100000013f1/pthread_mutex_unlock v2402>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001358:[<0x10000001557/5-1.c v36>,<0x100000013f1/pthread_mutex_unlock v2712>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.620 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f91 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/init.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.620 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f8e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/event.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.620 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f8f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/alarm.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.620 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fb1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/domain.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.620 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f8d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/session.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.620 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f96 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/config.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.621 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000116d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.621 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000116c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/Makefile.in) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.621 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fb0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/Makefile.am) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.621 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f97 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi_tests.txt) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.621 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f9a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_032.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.621 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000116e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_035.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.621 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fa1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_010.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.621 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fa4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_034.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.621 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fa8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_031.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.622 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.387+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/5-1.c auth v44 ap=1 s=3835 n(v0 rc2005-06-03T16:32:50.000000+0000 b3835 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2ed700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b0:[<0x10000001420/5-1.c v44>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012b0:[<0x10000001420/5-1.c v44>,<0x100000013f1/pthread_sigmask v2756>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.622 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.388+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012aa [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/10-1.c auth v56 ap=1 s=2445 n(v0 rc2005-06-03T16:32:49.000000+0000 b2445 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2f4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012aa:[<0x10000001420/10-1.c v6>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012aa:[<0x10000001420/10-1.c v56>,<0x100000013f1/pthread_sigmask v2756>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.622 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.388+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ac [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/18-1.c auth v60 ap=1 s=8176 n(v0 rc2007-07-26T12:02:14.000000+0000 b8176 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2f4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ac:[<0x10000001420/18-1.c v10>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012ac:[<0x10000001420/18-1.c v60>,<0x100000013f1/pthread_sigmask v2756>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.622 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.388+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/9-1.c auth v40 ap=1 s=3433 n(v0 rc2005-06-03T16:32:51.000000+0000 b3433 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2f4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a9:[<0x10000001420/9-1.c v40>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012a9:[<0x10000001420/9-1.c v40>,<0x100000013f1/pthread_sigmask v2756>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.623 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.387+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001355 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/testfrmw.c auth v34 ap=1 s=1822 n(v0 rc2005-06-03T16:32:15.000000+0000 b1822 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad492b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001355:[<0x10000001557/testfrmw.c v6>,<0x100000013f1/pthread_mutex_unlock v2402>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001355:[<0x10000001557/testfrmw.c v34>,<0x100000013f1/pthread_mutex_unlock v2712>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.623 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.387+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000135b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/assertions.xml auth v28 ap=1 s=1079 n(v0 rc2024-01-25T15:03:13.227698+0000 b1079 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad492b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000135b:[<0x10000001557/assertions.xml v18>,<0x100000013f1/pthread_mutex_unlock v2402>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000135b:[<0x10000001557/assertions.xml v28>,<0x100000013f1/pthread_mutex_unlock v2712>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.624 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.388+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-2.c auth v64 ap=1 s=2623 n(v0 rc2005-06-03T16:32:50.000000+0000 b2623 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2f5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b8:[<0x10000001420/8-2.c v34>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012b8:[<0x10000001420/8-2.c v64>,<0x100000013f1/pthread_sigmask v3638>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.624 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.388+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/16-1.c auth v66 ap=1 s=2453 n(v0 rc2005-06-03T16:32:49.000000+0000 b2453 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2f5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b9:[<0x10000001420/16-1.c v36>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012b9:[<0x10000001420/16-1.c v66>,<0x100000013f1/pthread_sigmask v3638>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.624 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.425+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001320 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/1-1.c auth v38 ap=1 s=1381 n(v0 rc2007-10-17T15:07:13.000000+0000 b1381 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4624c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001320:[<0x10000001545/1-1.c v10>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001320:[<0x10000001545/1-1.c v38>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.624 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.425+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/testfrmw.h auth v36 ap=1 s=2420 n(v0 rc2005-06-03T16:33:49.000000+0000 b2420 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4625700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131d:[<0x10000001545/testfrmw.h v4>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000131d:[<0x10000001545/testfrmw.h v36>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.625 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000faf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_version.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.625 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fa3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_008.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.625 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000faa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/Makefile.in) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.625 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fa5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_027.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.625 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f9d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_009.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.625 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fa9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_029.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.625 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fa2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_026.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.625 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f9e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/openhpi.conf) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.626 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/Makefile.am) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.626 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fa6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_024.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.626 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_037.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.626 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f9b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_033.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.626 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f9c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_025.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.626 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fa0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_036.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.626 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f98 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_030.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.627 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.388+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012ad [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/testfrmw.c auth v38 ap=1 s=2106 n(v0 rc2005-06-03T16:32:51.000000+0000 b2106 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012ad:[<0x10000001420/testfrmw.c v38>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012ad:[<0x10000001420/testfrmw.c v38>,<0x100000013f1/pthread_sigmask v3638>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.627 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.388+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012b4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/assertions.xml auth v54 ap=1 s=4078 n(v0 rc2005-06-03T16:32:51.000000+0000 b4078 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2f6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012b4:[<0x10000001420/assertions.xml v26>,<0x100000013f1/pthread_sigmask v2632>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012b4:[<0x10000001420/assertions.xml v54>,<0x100000013f1/pthread_sigmask v3638>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.628 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.425+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001323 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/2-2.c auth v28 ap=1 s=4529 n(v0 rc2005-06-03T16:33:47.000000+0000 b4529 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4625180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001323:[<0x10000001545/2-2.c v28>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001323:[<0x10000001545/2-2.c v28>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.628 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.425+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001321 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/coverage.c auth v34 ap=1 s=29 n(v0 rc2005-06-03T16:33:47.000000+0000 b29 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4918000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001321:[<0x10000001545/coverage.c v12>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001321:[<0x10000001545/coverage.c v34>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.629 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.417+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001437 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/1-1.c auth v20 ap=1 s=1175 n(v0 rc2005-06-03T16:31:42.000000+0000 b1175 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2f6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001437:[<0x10000001589/1-1.c v8>,<0x100000013f1/pthread_condattr_destroy v2670>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001437:[<0x10000001589/1-1.c v20>,<0x100000013f1/pthread_condattr_destroy v2670>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.629 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.417+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001439 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/4-1.c auth v18 ap=1 s=1143 n(v0 rc2005-06-03T16:31:42.000000+0000 b1143 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2f7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001439:[<0x10000001589/4-1.c v12>,<0x100000013f1/pthread_condattr_destroy v2670>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001439:[<0x10000001589/4-1.c v18>,<0x100000013f1/pthread_condattr_destroy v2670>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.630 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.425+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001324 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/4-1.c auth v24 ap=1 s=1114 n(v0 rc2007-10-17T15:07:13.000000+0000 b1114 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4918580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001324:[<0x10000001545/4-1.c v24>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001324:[<0x10000001545/4-1.c v24>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.630 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.426+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/2-1.c auth v26 ap=1 s=1355 n(v0 rc2007-10-17T15:07:13.000000+0000 b1355 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4918b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131e:[<0x10000001545/2-1.c v26>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000131e:[<0x10000001545/2-1.c v26>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.631 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.417+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000158a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/3-1.c auth v14 ap=1 s=1168 n(v0 rc2005-06-03T16:31:42.000000+0000 b1168 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea300000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000158a:[<0x10000001589/3-1.c v14>,<0x100000013f1/pthread_condattr_destroy v2670>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000158a:[<0x10000001589/3-1.c v14>,<0x100000013f1/pthread_condattr_destroy v2670>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.631 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.417+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001438 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/assertions.xml auth v22 ap=1 s=915 n(v0 rc2005-06-03T16:31:42.000000+0000 b915 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea300580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001438:[<0x10000001589/assertions.xml v10>,<0x100000013f1/pthread_condattr_destroy v2670>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001438:[<0x10000001589/assertions.xml v22>,<0x100000013f1/pthread_condattr_destroy v2670>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012dc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/net_cmdlib.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:37.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000010d6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/Makefile) see mds.c log and `damage ls` output for details 2024-01-25T15:03:37.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000010d7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/cmdlib.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:37.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f92 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/safhpi.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f8c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/plugin.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f8b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/hotswap.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000116b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f90 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/ohpi.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f94 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/Makefile.in) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f95 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/threaded.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f93 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/lock.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fb2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/Makefile.am) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000116a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/plugin_static.c.in) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f91 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/init.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f8e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/event.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f8f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/alarm.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fb1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/domain.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f8d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/session.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f96 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/config.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000116d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000116c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/Makefile.in) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fb0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/Makefile.am) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f97 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi_tests.txt) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f9a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_032.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000116e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_035.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fa1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_010.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fa4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_034.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fa8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_031.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000faf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_version.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fa3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_008.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000faa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/Makefile.in) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fa5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_027.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f9d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_009.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fa9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_029.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fa2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_026.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f9e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/openhpi.conf) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/Makefile.am) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fa6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_024.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_037.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f9b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_033.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f9c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_025.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fa0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_036.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f98 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_030.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/hpiinjector.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_038.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f9f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_039.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000fa7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_007.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f99 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_028.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000da4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/Makefile.in) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000da5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/Makefile.am) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f52 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/snmp_utils.h) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000da3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/snmp_utils.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: pgmap v397: 97 pgs: 97 active+clean; 483 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 MiB/s rd, 66 MiB/s wr, 1.48k op/s 2024-01-25T15:03:37.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dbd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ekeyfru.h) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dbb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_control_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000db9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_close.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000db8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dba (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/hotswap.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dc1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.sym) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dc5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/posix_vlog.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f5a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dbf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.h) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dbc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_connection.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dcc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.in) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000db7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_vshm_rdrs.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_mc_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dcd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_fru.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dc8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dc6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dce (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_rdrs.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dd3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.am) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dc4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f59 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dc2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/sync.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dc0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dcf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_util.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dd0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_slot_rdrs.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dc3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_drv.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dcb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_fru_rdrs.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dc9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sel.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dc7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dbe (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_controls.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dd4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dd1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.in) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000dd2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.am) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f5b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/ipmi_thres_test.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000969 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-updown) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000828 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-mtu-change) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000825 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-addr-change) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000823 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-route-addlarge) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000827 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-addr-addlarge) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000821 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/00_Descriptions.txt) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000822 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-updown) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000820 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/Makefile) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000085a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-mtu-change) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000826 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-alias-addlarge) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000824 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-alias-adddel) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000085c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-route-adddel) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000829 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-route-addlarge) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000085d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-route-adddel) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000085b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-addr-adddel) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000008f4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/Makefile) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000008f6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/fsstress.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000a9d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/global.h) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000008f3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/nfs_fsstress.sh) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000008f5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/xfscompat.h) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:37.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:37 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.642 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.426+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000131f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/5-1.c auth v22 ap=1 s=1474 n(v0 rc2007-10-17T15:07:13.000000+0000 b1474 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4919080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000131f:[<0x10000001545/5-1.c v22>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000131f:[<0x10000001545/5-1.c v22>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.642 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.426+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001325 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/cln.sh auth v32 ap=1 s=174 n(v0 rc2024-01-25T15:03:13.186699+0000 b174 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4919600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001325:[<0x10000001545/cln.sh v20>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001325:[<0x10000001545/cln.sh v32>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.643 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.417+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001435 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/coverage.txt auth v24 ap=1 s=343 n(v0 rc2024-01-25T15:03:13.372694+0000 b343 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2f6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001435:[<0x10000001589/coverage.txt v4>,<0x100000013f1/pthread_condattr_destroy v2670>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001435:[<0x10000001589/coverage.txt v24>,<0x100000013f1/pthread_condattr_destroy v2670>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.643 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.417+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001436 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/2-1.c auth v16 ap=1 s=1595 n(v0 rc2005-06-03T16:31:42.000000+0000 b1595 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2f7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001436:[<0x10000001589/2-1.c v16>,<0x100000013f1/pthread_condattr_destroy v2670>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001436:[<0x10000001589/2-1.c v16>,<0x100000013f1/pthread_condattr_destroy v2670>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.644 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/hpiinjector.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.644 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_038.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.644 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f9f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_039.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.644 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000fa7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_007.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.644 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f99 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_028.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.644 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.644 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.644 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000da4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/Makefile.in) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.644 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000da5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/Makefile.am) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.645 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f52 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/snmp_utils.h) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.645 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000da3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/snmp_utils.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:37.645 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.645 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: pgmap v397: 97 pgs: 97 active+clean; 483 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 52 MiB/s rd, 66 MiB/s wr, 1.48k op/s 2024-01-25T15:03:37.645 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.645 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.645 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.645 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.645 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.645 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.645 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.645 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.645 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.646 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.646 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.646 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.646 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.646 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.646 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.646 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.646 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.646 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.647 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.426+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001546 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/testfrmw.c auth v30 ap=1 s=2106 n(v0 rc2024-01-25T15:03:13.185699+0000 b2106 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4919b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001546:[<0x10000001545/testfrmw.c v2>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001546:[<0x10000001545/testfrmw.c v30>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.647 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.426+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001322 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/assertions.xml auth v40 ap=1 s=962 n(v0 rc2005-06-03T16:33:47.000000+0000 b962 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad491a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001322:[<0x10000001545/assertions.xml v14>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001322:[<0x10000001545/assertions.xml v40>,<0x100000013f1/sem_getvalue v2634>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.648 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.487+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000142b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/1-2.c auth v22 ap=1 s=1692 n(v0 rc2005-06-03T16:36:23.000000+0000 b1692 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea301080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000142b:[<0x10000001583/1-2.c v22>,<0x100000013f1/timer_delete v2624>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000142b:[<0x10000001583/1-2.c v22>,<0x100000013f1/timer_delete v6018>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.648 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.487+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001430 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/2-1.sh auth v38 ap=1 s=485 n(v0 rc2024-01-25T15:03:13.358695+0000 b485 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea300b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001430:[<0x10000001583/2-1.sh v14>,<0x100000013f1/timer_delete v2624>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001430:[<0x10000001583/2-1.sh v38>,<0x100000013f1/timer_delete v6018>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.648 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.488+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001584 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/coverage.txt auth v28 ap=1 s=115 n(v0 rc2024-01-25T15:03:13.357695+0000 b115 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea301b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001584:[<0x10000001583/coverage.txt v28>,<0x100000013f1/timer_delete v2624>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001584:[<0x10000001583/coverage.txt v28>,<0x100000013f1/timer_delete v6018>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.648 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.488+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000142c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/1-1.c auth v36 ap=1 s=2243 n(v0 rc2005-06-03T16:36:23.000000+0000 b2243 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea301600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000142c:[<0x10000001583/1-1.c v6>,<0x100000013f1/timer_delete v2624>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000142c:[<0x10000001583/1-1.c v36>,<0x100000013f1/timer_delete v6018>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.648 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.488+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000142e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/3-1.sh auth v30 ap=1 s=451 n(v0 rc2005-06-03T16:36:24.000000+0000 b451 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea302100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000142e:[<0x10000001583/3-1.sh v10>,<0x100000013f1/timer_delete v2624>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000142e:[<0x10000001583/3-1.sh v30>,<0x100000013f1/timer_delete v6018>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.648 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.488+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001585 [...2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative/ auth v40 ap=1 f(v0 m2024-01-25T15:03:13.364694+0000 2=2+0) n(v0 rc2024-01-25T15:03:13.364694+0000 b3247 3=2+1) (inest lock) (ifile excl) (iversion lock) caps={24803=pAsLsXsFsx/pAsLsXsFsxcral@1},l=24803 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea302680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001585:[<0x10000001583/speculative v24>,<0x100000013f1/timer_delete v2624>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x10000001585:[<0x10000001583/speculative v40>,<0x100000013f1/timer_delete v6018>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-25T15:03:13.364694+0000 2=2+0)","ondisk_value.rstat":"n(v0 rc2024-01-25T15:03:13.364694+0000 b3247 3=2+1)","memory_value.dirstat":"f(v0 m2024-01-25T15:03:13.364694+0000 2=2+0)","memory_value.rstat":"n(v0 rc2024-01-25T15:03:13.364694+0000 b3247 3=2+1)","error_str":""},"return_code":0} 2024-01-25T15:03:37.649 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.649 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dbd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ekeyfru.h) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.649 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dbb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_control_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.649 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000db9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_close.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.649 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000db8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.649 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dba (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/hotswap.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.649 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dc1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.sym) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.649 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dc5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/posix_vlog.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f5a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dbf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.h) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dbc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_connection.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dcc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.in) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000db7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_vshm_rdrs.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_mc_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.650 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dcd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_fru.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.651 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.488+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000142f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/4-1.sh auth v34 ap=1 s=452 n(v0 rc2005-06-03T16:36:24.000000+0000 b452 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea302c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000142f:[<0x10000001583/4-1.sh v12>,<0x100000013f1/timer_delete v2624>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000142f:[<0x10000001583/4-1.sh v34>,<0x100000013f1/timer_delete v6018>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.651 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.488+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000142d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/assertions.xml auth v26 ap=1 s=818 n(v0 rc2005-06-03T16:36:24.000000+0000 b818 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea303180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000142d:[<0x10000001583/assertions.xml v26>,<0x100000013f1/timer_delete v2624>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000142d:[<0x10000001583/assertions.xml v26>,<0x100000013f1/timer_delete v6018>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.651 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.488+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001431 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative/5-2.c auth v8 ap=1 s=2253 n(v0 rc2005-06-03T16:36:24.000000+0000 b2253 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea303700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001431:[<0x10000001585/5-2.c v4>,<0x10000001583/speculative v24>,<0x100000013f1/timer_delete v2624>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001431:[<0x10000001585/5-2.c v8>,<0x10000001583/speculative v40>,<0x100000013f1/timer_delete v6018>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.651 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.488+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001586 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative/5-1.c auth v6 ap=1 s=994 n(v0 rc2024-01-25T15:03:13.364694+0000 b994 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea30e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001586:[<0x10000001585/5-1.c v6>,<0x10000001583/speculative v24>,<0x100000013f1/timer_delete v2624>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001586:[<0x10000001585/5-1.c v6>,<0x10000001583/speculative v40>,<0x100000013f1/timer_delete v6018>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dc8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dc6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dce (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_rdrs.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.652 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dd3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.am) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.653 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dc4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.653 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f59 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.653 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dc2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/sync.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.653 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dc0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.653 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dcf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_util.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.653 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dd0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_slot_rdrs.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.653 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dc3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_drv.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.653 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dcb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_fru_rdrs.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.653 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dc9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sel.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.653 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dc7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_event.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.653 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dbe (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_controls.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.653 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dd4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.653 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dd1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.in) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.654 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000dd2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.am) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.654 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f5b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/ipmi_thres_test.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.654 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.654 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.654 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000969 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-updown) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.654 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000828 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-mtu-change) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.654 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000825 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-addr-change) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.654 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000823 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-route-addlarge) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.654 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000827 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-addr-addlarge) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.654 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000821 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/00_Descriptions.txt) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.654 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000822 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-updown) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.654 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000820 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/Makefile) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.654 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000085a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-mtu-change) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.655 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000826 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-alias-addlarge) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.655 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000824 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-alias-adddel) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.655 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000085c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-route-adddel) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.655 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000829 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-route-addlarge) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.655 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000085d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-route-adddel) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.655 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000085b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-addr-adddel) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.655 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.655 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.655 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.655 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.655 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000008f4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/Makefile) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.655 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000008f6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/fsstress.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.655 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000a9d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/global.h) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.656 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000008f3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/nfs_fsstress.sh) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.656 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000008f5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/xfscompat.h) see mds.l log and `damage ls` output for details 2024-01-25T15:03:37.656 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.656 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.656 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.656 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:37.656 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:37.671 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.494+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000153f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-5.c auth v841 ap=1 s=1525 n(v0 rc2005-06-03T16:35:27.000000+0000 b1525 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449ec000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000153f:[<0x100000016ae/3-5.c v254>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000153f:[<0x100000016ae/3-5.c v841>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.672 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.494+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001611 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-30.c auth v825 ap=1 s=1989 n(v0 rc2005-06-03T16:35:29.000000+0000 b1989 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449ecb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001611:[<0x100000016ae/4-30.c v526>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001611:[<0x100000016ae/4-30.c v825>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.672 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.495+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015de [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.c auth v959 ap=1 s=2106 n(v0 rc2005-06-03T16:35:47.000000+0000 b2106 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449ed600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015de:[<0x100000016ae/testfrmw.c v424>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015de:[<0x100000016ae/testfrmw.c v959>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.672 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.495+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-9.c auth v805 ap=1 s=2492 n(v0 rc2005-06-03T16:35:18.000000+0000 b2492 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449edb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c6:[<0x100000016ae/22-9.c v8>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014c6:[<0x100000016ae/22-9.c v805>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.672 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.495+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-22.c auth v921 ap=1 s=2007 n(v0 rc2024-01-25T15:03:13.549690+0000 b2007 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449ee100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e7:[<0x100000016ae/12-22.c v78>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014e7:[<0x100000016ae/12-22.c v921>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.672 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.496+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001671 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-15.c auth v829 ap=1 s=4222 n(v0 rc2024-01-25T15:03:13.566690+0000 b4222 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449ee680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001671:[<0x100000016ae/19-15.c v718>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001671:[<0x100000016ae/19-15.c v829>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.672 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.496+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015a7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-71.c auth v927 ap=1 s=904 n(v0 rc2005-06-03T16:35:31.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449ef180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015a7:[<0x100000016ae/4-71.c v314>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015a7:[<0x100000016ae/4-71.c v927>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.672 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.497+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000162f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-70.c auth v883 ap=1 s=904 n(v0 rc2005-06-03T16:35:31.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449ef700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000162f:[<0x100000016ae/4-70.c v586>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000162f:[<0x100000016ae/4-70.c v883>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.672 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.497+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000163a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-24.c auth v911 ap=1 s=2191 n(v0 rc2005-06-03T16:34:58.000000+0000 b2191 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449f8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000163a:[<0x100000016ae/17-24.c v608>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000163a:[<0x100000016ae/17-24.c v911>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.672 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.497+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016b0 [...2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/ auth v963 ap=1 f(v0 m2024-01-25T15:03:13.548690+0000 20=20+0) n(v0 rc2024-01-25T15:03:13.548690+0000 b50188 21=20+1) (inest lock) (ifile excl) (iversion lock) caps={24803=pAsLsXsFsx/pAsLsXsFsxcral@1},l=24803 | lock=0 importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449f8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x100000016b0:[<0x100000016ae/templates v770>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(2)0x100000016b0:[<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-25T15:03:13.548690+0000 20=20+0)","ondisk_value.rstat":"n(v0 rc2024-01-25T15:03:13.548690+0000 b50188 21=20+1)","memory_value.dirstat":"f(v0 m2024-01-25T15:03:13.548690+0000 20=20+0)","memory_value.rstat":"n(v0 rc2024-01-25T15:03:13.548690+0000 b50188 21=20+1)","error_str":""},"return_code":0} 2024-01-25T15:03:37.673 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.497+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000165b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/assertions.xml auth v839 ap=1 s=7417 n(v0 rc2005-06-03T16:35:47.000000+0000 b7417 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449f8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000165b:[<0x100000016ae/assertions.xml v674>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000165b:[<0x100000016ae/assertions.xml v839>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.673 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.497+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015a6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-1.c auth v881 ap=1 s=4222 n(v0 rc2024-01-25T15:03:13.556690+0000 b4222 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449f9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015a6:[<0x100000016ae/19-1.c v312>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015a6:[<0x100000016ae/19-1.c v881>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.673 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.498+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015cb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-2.c auth v969 ap=1 s=4222 n(v0 rc2005-06-03T16:35:03.000000+0000 b4222 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449f9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015cb:[<0x100000016ae/19-2.c v386>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015cb:[<0x100000016ae/19-2.c v969>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.673 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.498+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001537 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-24.c auth v925 ap=1 s=2468 n(v0 rc2005-06-03T16:35:23.000000+0000 b2468 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449fa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001537:[<0x100000016ae/25-24.c v238>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001537:[<0x100000016ae/25-24.c v925>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.673 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.498+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001661 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-95.c auth v919 ap=1 s=904 n(v0 rc2005-06-03T16:35:32.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544956b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001661:[<0x100000016ae/4-95.c v686>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001661:[<0x100000016ae/4-95.c v919>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.673 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.498+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001673 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/21-1.c auth v849 ap=1 s=1032 n(v0 rc2005-06-03T16:35:17.000000+0000 b1032 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449fac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001673:[<0x100000016ae/21-1.c v722>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001673:[<0x100000016ae/21-1.c v849>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.673 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.499+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015f1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-91.c auth v955 ap=1 s=904 n(v0 rc2005-06-03T16:35:32.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544956580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015f1:[<0x100000016ae/4-91.c v462>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015f1:[<0x100000016ae/4-91.c v955>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.673 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.499+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014fb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c auth v963 ap=1 s=2588 n(v0 rc2005-06-03T16:35:47.000000+0000 b2588 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544957600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014fb:[<0x100000016ae/9-1.c v118>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014fb:[<0x100000016ae/9-1.c v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.673 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.499+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015ff [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-13.c auth v921 ap=1 s=1902 n(v0 rc2005-06-03T16:35:29.000000+0000 b1902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544957b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015ff:[<0x100000016ae/4-13.c v490>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015ff:[<0x100000016ae/4-13.c v921>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.673 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.499+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014eb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c auth v909 ap=1 s=1773 n(v0 rc2005-06-03T16:34:55.000000+0000 b1773 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544958100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014eb:[<0x100000016ae/12-48.c v86>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014eb:[<0x100000016ae/12-48.c v909>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.673 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.500+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000163e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-9.c auth v943 ap=1 s=1898 n(v0 rc2005-06-03T16:35:32.000000+0000 b1898 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544959700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000163e:[<0x100000016ae/4-9.c v616>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000163e:[<0x100000016ae/4-9.c v943>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.674 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.500+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001540 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c auth v867 ap=1 s=1773 n(v0 rc2005-06-03T16:34:52.000000+0000 b1773 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554496e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001540:[<0x100000016ae/12-27.c v256>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001540:[<0x100000016ae/12-27.c v867>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.674 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.500+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015c7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-3.c auth v903 ap=1 s=4329 n(v0 rc2005-06-03T16:35:20.000000+0000 b4329 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554496e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015c7:[<0x100000016ae/23-3.c v378>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015c7:[<0x100000016ae/23-3.c v903>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.674 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.500+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015a8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c auth v857 ap=1 s=2501 n(v0 rc2005-06-03T16:35:18.000000+0000 b2501 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554496eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015a8:[<0x100000016ae/22-2.c v316>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015a8:[<0x100000016ae/22-2.c v857>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.674 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.500+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001635 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/README auth v899 ap=1 s=751 n(v0 rc2005-06-03T16:35:47.000000+0000 b751 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554496f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001635:[<0x100000016ae/README v598>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001635:[<0x100000016ae/README v899>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.674 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.501+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000164d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-25.c auth v893 ap=1 s=1476 n(v0 rc2005-06-03T16:34:50.000000+0000 b1476 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554496fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000164d:[<0x100000016ae/1-25.c v646>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000164d:[<0x100000016ae/1-25.c v893>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.674 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.501+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014fe [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c auth v849 ap=1 s=904 n(v0 rc2005-06-03T16:35:29.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554496f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014fe:[<0x100000016ae/4-103.c v124>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014fe:[<0x100000016ae/4-103.c v849>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.674 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.501+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001615 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-17.c auth v897 ap=1 s=2501 n(v0 rc2005-06-03T16:35:18.000000+0000 b2501 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544970100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001615:[<0x100000016ae/22-17.c v534>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001615:[<0x100000016ae/22-17.c v897>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.674 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.502+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016af [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c auth v941 ap=1 s=2007 n(v0 rc2024-01-25T15:03:13.524691+0000 b2007 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544970680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016af:[<0x100000016ae/12-16.c v2>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000016af:[<0x100000016ae/12-16.c v941>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.674 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.502+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001644 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-6.c auth v959 ap=1 s=1484 n(v0 rc2005-06-03T16:35:17.000000+0000 b1484 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544971180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001644:[<0x100000016ae/2-6.c v628>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001644:[<0x100000016ae/2-6.c v959>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.674 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.502+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000159b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c auth v917 ap=1 s=1333 n(v0 rc2005-06-03T16:35:44.000000+0000 b1333 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544971700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000159b:[<0x100000016ae/6-16.c v290>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000159b:[<0x100000016ae/6-16.c v917>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.675 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.502+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001532 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c auth v873 ap=1 s=904 n(v0 rc2005-06-03T16:35:30.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544976580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001532:[<0x100000016ae/4-57.c v228>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001532:[<0x100000016ae/4-57.c v873>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.675 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.503+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001670 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-13.c auth v871 ap=1 s=3873 n(v0 rc2005-06-03T16:34:59.000000+0000 b3873 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544976b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001670:[<0x100000016ae/18-13.c v716>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001670:[<0x100000016ae/18-13.c v871>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.675 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.503+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015b7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-8.c auth v843 ap=1 s=1719 n(v0 rc2005-06-03T16:34:57.000000+0000 b1719 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544978100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015b7:[<0x100000016ae/13-8.c v346>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015b7:[<0x100000016ae/13-8.c v843>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.675 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.503+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015e3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-31.c auth v939 ap=1 s=1989 n(v0 rc2005-06-03T16:35:29.000000+0000 b1989 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544978680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015e3:[<0x100000016ae/4-31.c v434>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015e3:[<0x100000016ae/4-31.c v939>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.675 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.504+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001646 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-58.c auth v953 ap=1 s=902 n(v0 rc2005-06-03T16:35:30.000000+0000 b902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544978c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001646:[<0x100000016ae/4-58.c v632>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001646:[<0x100000016ae/4-58.c v953>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.675 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.505+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001541 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c auth v853 ap=1 s=4217 n(v0 rc2005-06-03T16:35:04.000000+0000 b4217 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544979700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001541:[<0x100000016ae/19-3.c v258>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001541:[<0x100000016ae/19-3.c v853>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.675 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.505+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015bd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-14.c auth v937 ap=1 s=2450 n(v0 rc2005-06-03T16:35:22.000000+0000 b2450 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544982b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015bd:[<0x100000016ae/25-14.c v358>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015bd:[<0x100000016ae/25-14.c v937>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.675 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.505+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001617 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-36.c auth v833 ap=1 s=1989 n(v0 rc2005-06-03T16:35:29.000000+0000 b1989 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544982580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001617:[<0x100000016ae/4-36.c v538>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001617:[<0x100000016ae/4-36.c v833>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.675 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.505+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c auth v915 ap=1 s=1330 n(v0 rc2005-06-03T16:35:45.000000+0000 b1330 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544983080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c8:[<0x100000016ae/6-21.c v12>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014c8:[<0x100000016ae/6-21.c v915>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.676 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.506+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001645 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-12.c auth v861 ap=1 s=3873 n(v0 rc2005-06-03T16:34:59.000000+0000 b3873 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544983600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001645:[<0x100000016ae/18-12.c v630>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001645:[<0x100000016ae/18-12.c v861>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.676 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.506+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001516 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c auth v889 ap=1 s=1472 n(v0 rc2005-06-03T16:34:50.000000+0000 b1472 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544983b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001516:[<0x100000016ae/1-23.c v172>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001516:[<0x100000016ae/1-23.c v889>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.676 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.506+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000164b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-20.c auth v901 ap=1 s=1488 n(v0 rc2005-06-03T16:35:16.000000+0000 b1488 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544984100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000164b:[<0x100000016ae/2-20.c v642>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000164b:[<0x100000016ae/2-20.c v901>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.676 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.506+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ee [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c auth v973 ap=1 s=4222 n(v0 rc2005-06-03T16:35:03.000000+0000 b4222 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544984c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ee:[<0x100000016ae/19-20.c v92>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014ee:[<0x100000016ae/19-20.c v973>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.676 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.507+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c auth v911 ap=1 s=2450 n(v0 rc2005-06-03T16:35:23.000000+0000 b2450 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554498c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000150e:[<0x100000016ae/25-22.c v156>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000150e:[<0x100000016ae/25-22.c v911>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.676 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.507+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001511 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c auth v839 ap=1 s=6203 n(v0 rc2005-06-03T16:35:24.000000+0000 b6203 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554498cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001511:[<0x100000016ae/28-7.c v162>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001511:[<0x100000016ae/28-7.c v839>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.676 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.508+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000165f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-14.c auth v877 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554498db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000165f:[<0x100000016ae/17-14.c v682>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000165f:[<0x100000016ae/17-14.c v877>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.676 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.508+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015ed [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-12.c auth v951 ap=1 s=1525 n(v0 rc2005-06-03T16:35:25.000000+0000 b1525 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554498e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015ed:[<0x100000016ae/3-12.c v454>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015ed:[<0x100000016ae/3-12.c v951>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.676 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.509+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c auth v829 ap=1 s=1722 n(v0 rc2005-06-03T16:34:57.000000+0000 b1722 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554498ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c7:[<0x100000016ae/13-25.c v10>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014c7:[<0x100000016ae/13-25.c v829>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.676 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.509+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000152f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c auth v949 ap=1 s=1722 n(v0 rc2005-06-03T16:34:57.000000+0000 b1722 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554498f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000152f:[<0x100000016ae/13-4.c v222>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000152f:[<0x100000016ae/13-4.c v949>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.677 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.510+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000151b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c auth v851 ap=1 s=904 n(v0 rc2005-06-03T16:35:31.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554499a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000151b:[<0x100000016ae/4-67.c v182>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000151b:[<0x100000016ae/4-67.c v851>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.677 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.511+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001628 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-80.c auth v927 ap=1 s=904 n(v0 rc2005-06-03T16:35:31.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554499b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001628:[<0x100000016ae/4-80.c v572>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001628:[<0x100000016ae/4-80.c v927>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.677 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.511+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001618 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-17.c auth v957 ap=1 s=4222 n(v0 rc2005-06-03T16:35:01.000000+0000 b4222 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554499bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001618:[<0x100000016ae/19-17.c v540>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001618:[<0x100000016ae/19-17.c v957>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.677 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.511+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015e4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-25.c auth v969 ap=1 s=1699 n(v0 rc2005-06-03T16:35:47.000000+0000 b1699 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554499c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015e4:[<0x100000016ae/8-25.c v436>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015e4:[<0x100000016ae/8-25.c v969>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.677 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.512+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001619 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-24.c auth v841 ap=1 s=3883 n(v0 rc2005-06-03T16:34:59.000000+0000 b3883 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554499d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001619:[<0x100000016ae/18-24.c v542>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001619:[<0x100000016ae/18-24.c v841>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.677 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.512+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000160b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-8.c auth v887 ap=1 s=5509 n(v0 rc2005-06-03T16:34:58.000000+0000 b5509 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554499d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000160b:[<0x100000016ae/16-8.c v514>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000160b:[<0x100000016ae/16-8.c v887>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.677 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.512+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015bc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-8.c auth v907 ap=1 s=1330 n(v0 rc2005-06-03T16:35:46.000000+0000 b1330 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449a8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015bc:[<0x100000016ae/6-8.c v356>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015bc:[<0x100000016ae/6-8.c v907>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.677 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.512+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015c8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-13.c auth v885 ap=1 s=5512 n(v0 rc2005-06-03T16:34:57.000000+0000 b5512 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449a8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015c8:[<0x100000016ae/16-13.c v380>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015c8:[<0x100000016ae/16-13.c v885>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.677 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.512+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001667 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-22.c auth v869 ap=1 s=1672 n(v0 rc2005-06-03T16:35:47.000000+0000 b1672 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449a8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001667:[<0x100000016ae/8-22.c v698>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001667:[<0x100000016ae/8-22.c v869>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.677 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.513+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015b2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c auth v931 ap=1 s=1722 n(v0 rc2005-06-03T16:34:57.000000+0000 b1722 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449aa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015b2:[<0x100000016ae/13-20.c v336>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015b2:[<0x100000016ae/13-20.c v931>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.677 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.513+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001591 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c auth v875 ap=1 s=4329 n(v0 rc2024-01-25T15:03:13.555690+0000 b4329 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449a9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001591:[<0x100000016ae/23-21.c v270>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001591:[<0x100000016ae/23-21.c v875>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.678 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.513+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c auth v905 ap=1 s=2004 n(v0 rc2005-06-03T16:34:56.000000+0000 b2004 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449aa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e6:[<0x100000016ae/12-6.c v76>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014e6:[<0x100000016ae/12-6.c v905>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.678 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.514+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001527 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c auth v865 ap=1 s=1722 n(v0 rc2005-06-03T16:34:57.000000+0000 b1722 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449aac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001527:[<0x100000016ae/13-22.c v206>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001527:[<0x100000016ae/13-22.c v865>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.678 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.514+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001606 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-23.c auth v831 ap=1 s=4329 n(v0 rc2005-06-03T16:35:20.000000+0000 b4329 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449ab180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001606:[<0x100000016ae/23-23.c v504>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001606:[<0x100000016ae/23-23.c v831>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.678 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.514+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015c4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-4.c auth v891 ap=1 s=5512 n(v0 rc2005-06-03T16:34:58.000000+0000 b5512 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544944100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015c4:[<0x100000016ae/16-4.c v372>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015c4:[<0x100000016ae/16-4.c v891>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.678 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.514+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001607 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-25.c auth v845 ap=1 s=2501 n(v0 rc2005-06-03T16:35:18.000000+0000 b2501 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544944c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001607:[<0x100000016ae/22-25.c v506>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001607:[<0x100000016ae/22-25.c v845>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.678 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.514+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001654 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-9.c auth v919 ap=1 s=1472 n(v0 rc2005-06-03T16:34:51.000000+0000 b1472 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544944680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001654:[<0x100000016ae/1-9.c v660>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001654:[<0x100000016ae/1-9.c v919>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.678 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.515+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015fe [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-1.c auth v869 ap=1 s=1333 n(v0 rc2005-06-03T16:35:32.000000+0000 b1333 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544945180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015fe:[<0x100000016ae/6-1.c v488>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015fe:[<0x100000016ae/6-1.c v869>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.678 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.515+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000151a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-22.c auth v831 ap=1 s=1476 n(v0 rc2005-06-03T16:34:41.000000+0000 b1476 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447be000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000151a:[<0x100000016ae/1-22.c v180>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000151a:[<0x100000016ae/1-22.c v831>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.678 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.515+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015af [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-2.c auth v833 ap=1 s=1333 n(v0 rc2005-06-03T16:35:44.000000+0000 b1333 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447be580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015af:[<0x100000016ae/6-2.c v330>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015af:[<0x100000016ae/6-2.c v833>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.678 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.516+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-1.c auth v901 ap=1 s=1525 n(v0 rc2005-06-03T16:35:25.000000+0000 b1525 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447c0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f5:[<0x100000016ae/3-1.c v106>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014f5:[<0x100000016ae/3-1.c v901>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.679 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.516+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001536 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/gentests.pl auth v827 ap=1 s=1363 n(v0 rc2005-06-03T16:35:47.000000+0000 b1363 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447beb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001536:[<0x100000016ae/gentests.pl v236>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001536:[<0x100000016ae/gentests.pl v827>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.679 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.517+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001525 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-12.c auth v877 ap=1 s=1488 n(v0 rc2005-06-03T16:35:05.000000+0000 b1488 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447c1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001525:[<0x100000016ae/2-12.c v202>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001525:[<0x100000016ae/2-12.c v877>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.679 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.518+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015d5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-14.c auth v859 ap=1 s=4336 n(v0 rc2005-06-03T16:35:18.000000+0000 b4336 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447c0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015d5:[<0x100000016ae/23-14.c v406>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015d5:[<0x100000016ae/23-14.c v859>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.679 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.518+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000159c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-8.c auth v959 ap=1 s=4329 n(v0 rc2005-06-03T16:35:21.000000+0000 b4329 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447bf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000159c:[<0x100000016ae/23-8.c v292>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000159c:[<0x100000016ae/23-8.c v959>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.679 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.518+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001677 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-6.c auth v965 ap=1 s=1520 n(v0 rc2005-06-03T16:35:27.000000+0000 b1520 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544446580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001677:[<0x100000016ae/3-6.c v730>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001677:[<0x100000016ae/3-6.c v965>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.679 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.518+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000161f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-18.c auth v835 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544446b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000161f:[<0x100000016ae/17-18.c v554>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000161f:[<0x100000016ae/17-18.c v835>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.679 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.519+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001505 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-21.c auth v925 ap=1 s=1484 n(v0 rc2005-06-03T16:35:16.000000+0000 b1484 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544447600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001505:[<0x100000016ae/2-21.c v138>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001505:[<0x100000016ae/2-21.c v925>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.679 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.519+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001501 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-26.c auth v839 ap=1 s=1681 n(v0 rc2005-06-03T16:35:47.000000+0000 b1681 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544447b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001501:[<0x100000016ae/8-26.c v130>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001501:[<0x100000016ae/8-26.c v839>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.679 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.519+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014cd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-11.c auth v943 ap=1 s=5512 n(v0 rc2005-06-03T16:34:57.000000+0000 b5512 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544448100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014cd:[<0x100000016ae/16-11.c v22>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014cd:[<0x100000016ae/16-11.c v943>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.679 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.519+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000151f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-18.c auth v967 ap=1 s=2007 n(v0 rc2005-06-03T16:34:52.000000+0000 b2007 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544448c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000151f:[<0x100000016ae/12-18.c v190>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000151f:[<0x100000016ae/12-18.c v967>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.680 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.520+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015b3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-5.c auth v861 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544449180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015b3:[<0x100000016ae/17-5.c v338>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015b3:[<0x100000016ae/17-5.c v861>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.680 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.520+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001542 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-24.c auth v889 ap=1 s=1682 n(v0 rc2005-06-03T16:35:47.000000+0000 b1682 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544898000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001542:[<0x100000016ae/8-24.c v260>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001542:[<0x100000016ae/8-24.c v889>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.680 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.521+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001624 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-24.c auth v873 ap=1 s=1535 n(v0 rc2005-06-03T16:35:27.000000+0000 b1535 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544449700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001624:[<0x100000016ae/3-24.c v564>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001624:[<0x100000016ae/3-24.c v873>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.680 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.521+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015b4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-22.c auth v837 ap=1 s=4336 n(v0 rc2005-06-03T16:35:20.000000+0000 b4336 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544898580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015b4:[<0x100000016ae/23-22.c v340>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015b4:[<0x100000016ae/23-22.c v837>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.680 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.521+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001827 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-25.c auth v937 ap=1 s=6206 n(v0 rc2024-01-25T15:03:14.114677+0000 b6206 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544899600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001827:[<0x100000016ae/28-25.c v768>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001827:[<0x100000016ae/28-25.c v937>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.680 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.522+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015ab [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-15.c auth v829 ap=1 s=6206 n(v0 rc2005-06-03T16:35:24.000000+0000 b6206 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554489a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015ab:[<0x100000016ae/28-15.c v322>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015ab:[<0x100000016ae/28-15.c v829>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.680 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.522+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000153c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-9.c auth v883 ap=1 s=1719 n(v0 rc2005-06-03T16:34:57.000000+0000 b1719 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554489b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000153c:[<0x100000016ae/13-9.c v248>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000153c:[<0x100000016ae/13-9.c v883>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.680 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.523+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000161b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-97.c auth v963 ap=1 s=904 n(v0 rc2005-06-03T16:35:32.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448ce000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000161b:[<0x100000016ae/4-97.c v546>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000161b:[<0x100000016ae/4-97.c v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.680 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.523+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015f5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-7.c auth v879 ap=1 s=1472 n(v0 rc2005-06-03T16:34:51.000000+0000 b1472 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448cf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015f5:[<0x100000016ae/1-7.c v470>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015f5:[<0x100000016ae/1-7.c v879>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.680 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.523+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001641 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-21.c auth v907 ap=1 s=2492 n(v0 rc2005-06-03T16:35:18.000000+0000 b2492 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448cf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001641:[<0x100000016ae/22-21.c v622>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001641:[<0x100000016ae/22-21.c v907>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.680 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.523+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001681 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-17.c auth v867 ap=1 s=2450 n(v0 rc2005-06-03T16:35:22.000000+0000 b2450 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448cfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001681:[<0x100000016ae/25-17.c v750>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001681:[<0x100000016ae/25-17.c v867>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.681 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.524+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000163b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-6.c auth v875 ap=1 s=5509 n(v0 rc2024-01-25T15:03:13.562690+0000 b5509 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448d0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000163b:[<0x100000016ae/16-6.c v610>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000163b:[<0x100000016ae/16-6.c v875>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.681 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.524+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001680 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-5.c auth v949 ap=1 s=1476 n(v0 rc2005-06-03T16:34:51.000000+0000 b1476 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448d0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001680:[<0x100000016ae/1-5.c v748>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001680:[<0x100000016ae/1-5.c v949>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.681 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.524+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001666 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-15.c auth v843 ap=1 s=1722 n(v0 rc2005-06-03T16:34:56.000000+0000 b1722 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448d0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001666:[<0x100000016ae/13-15.c v696>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001666:[<0x100000016ae/13-15.c v843>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.681 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.524+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001653 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-19.c auth v939 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448d1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001653:[<0x100000016ae/17-19.c v658>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001653:[<0x100000016ae/17-19.c v939>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.681 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.525+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001504 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-16.c auth v825 ap=1 s=2450 n(v0 rc2005-06-03T16:35:22.000000+0000 b2450 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448a0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001504:[<0x100000016ae/25-16.c v136>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001504:[<0x100000016ae/25-16.c v825>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.681 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.525+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015f3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-20.c auth v913 ap=1 s=2007 n(v0 rc2005-06-03T16:34:52.000000+0000 b2007 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448a0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015f3:[<0x100000016ae/12-20.c v466>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015f3:[<0x100000016ae/12-20.c v913>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.681 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.525+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014fa [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-44.c auth v957 ap=1 s=1773 n(v0 rc2005-06-03T16:34:55.000000+0000 b1773 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448a1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014fa:[<0x100000016ae/12-44.c v116>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014fa:[<0x100000016ae/12-44.c v957>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.681 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.525+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001521 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-23.c auth v881 ap=1 s=1676 n(v0 rc2005-06-03T16:35:47.000000+0000 b1676 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448a1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001521:[<0x100000016ae/8-23.c v194>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001521:[<0x100000016ae/8-23.c v881>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.681 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.526+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015c5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-2.c auth v947 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448a2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015c5:[<0x100000016ae/17-2.c v374>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015c5:[<0x100000016ae/17-2.c v947>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.681 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.526+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000151e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/10-1.c auth v927 ap=1 s=2269 n(v0 rc2024-01-25T15:03:13.553690+0000 b2269 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448a2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000151e:[<0x100000016ae/10-1.c v188>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000151e:[<0x100000016ae/10-1.c v927>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.681 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.526+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001509 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-12.c auth v887 ap=1 s=1902 n(v0 rc2005-06-03T16:35:29.000000+0000 b1902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448a3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001509:[<0x100000016ae/4-12.c v146>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001509:[<0x100000016ae/4-12.c v887>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.682 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.526+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-3.c auth v935 ap=1 s=3868 n(v0 rc2005-06-03T16:35:00.000000+0000 b3868 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544947080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f6:[<0x100000016ae/18-3.c v108>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014f6:[<0x100000016ae/18-3.c v935>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.682 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.527+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001538 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-7.c auth v905 ap=1 s=1898 n(v0 rc2005-06-03T16:35:31.000000+0000 b1898 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544947600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001538:[<0x100000016ae/4-7.c v240>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001538:[<0x100000016ae/4-7.c v905>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.682 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.527+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014cc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-79.c auth v857 ap=1 s=904 n(v0 rc2005-06-03T16:35:31.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544947b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014cc:[<0x100000016ae/4-79.c v20>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014cc:[<0x100000016ae/4-79.c v857>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.682 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.527+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015b6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-1.c auth v929 ap=1 s=3873 n(v0 rc2005-06-03T16:34:58.000000+0000 b3873 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544948100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015b6:[<0x100000016ae/18-1.c v344>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015b6:[<0x100000016ae/18-1.c v929>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.682 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.528+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001621 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-8.c auth v945 ap=1 s=2441 n(v0 rc2005-06-03T16:35:23.000000+0000 b2441 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544948c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001621:[<0x100000016ae/25-8.c v558>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001621:[<0x100000016ae/25-8.c v945>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.682 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.528+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015f2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-18.c auth v933 ap=1 s=1902 n(v0 rc2005-06-03T16:35:29.000000+0000 b1902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544949700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015f2:[<0x100000016ae/4-18.c v464>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015f2:[<0x100000016ae/4-18.c v933>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.682 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.528+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015dd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-9.c auth v841 ap=1 s=1330 n(v0 rc2005-06-03T16:35:46.000000+0000 b1330 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544956000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015dd:[<0x100000016ae/6-9.c v422>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015dd:[<0x100000016ae/6-9.c v841>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.682 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.528+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015da [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-98.c auth v835 ap=1 s=904 n(v0 rc2005-06-03T16:35:32.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448ca100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015da:[<0x100000016ae/4-98.c v416>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015da:[<0x100000016ae/4-98.c v835>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.682 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.528+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015ad [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c auth v943 ap=1 s=902 n(v0 rc2005-06-03T16:35:32.000000+0000 b902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448cac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015ad:[<0x100000016ae/4-87.c v326>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015ad:[<0x100000016ae/4-87.c v943>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.682 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.529+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001623 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-40.c auth v885 ap=1 s=1773 n(v0 rc2005-06-03T16:34:55.000000+0000 b1773 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448cb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001623:[<0x100000016ae/12-40.c v562>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001623:[<0x100000016ae/12-40.c v885>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.682 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.529+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c auth v855 ap=1 s=902 n(v0 rc2005-06-03T16:35:30.000000+0000 b902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448dc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000150a:[<0x100000016ae/4-60.c v148>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000150a:[<0x100000016ae/4-60.c v855>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.683 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.529+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001543 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c auth v861 ap=1 s=1681 n(v0 rc2005-06-03T16:35:46.000000+0000 b1681 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448cb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001543:[<0x100000016ae/8-13.c v262>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001543:[<0x100000016ae/8-13.c v861>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.683 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.529+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000166c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-23.c auth v959 ap=1 s=5509 n(v0 rc2005-06-03T16:34:57.000000+0000 b5509 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448dcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000166c:[<0x100000016ae/16-23.c v708>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000166c:[<0x100000016ae/16-23.c v959>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.683 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.529+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001601 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-18.c auth v881 ap=1 s=1525 n(v0 rc2005-06-03T16:35:26.000000+0000 b1525 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448dc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001601:[<0x100000016ae/3-18.c v494>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001601:[<0x100000016ae/3-18.c v881>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.683 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.530+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001649 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-26.c auth v893 ap=1 s=2450 n(v0 rc2005-06-03T16:35:23.000000+0000 b2450 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448dd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001649:[<0x100000016ae/25-26.c v638>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001649:[<0x100000016ae/25-26.c v893>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.683 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.530+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000165e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-10.c auth v831 ap=1 s=1476 n(v0 rc2005-06-03T16:34:40.000000+0000 b1476 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448dd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000165e:[<0x100000016ae/1-10.c v680>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000165e:[<0x100000016ae/1-10.c v831>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.683 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.530+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001639 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-11.c auth v869 ap=1 s=6206 n(v0 rc2005-06-03T16:35:23.000000+0000 b6206 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448ddb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001639:[<0x100000016ae/28-11.c v606>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001639:[<0x100000016ae/28-11.c v869>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.683 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.530+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001526 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c auth v883 ap=1 s=2450 n(v0 rc2005-06-03T16:35:22.000000+0000 b2450 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448de100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001526:[<0x100000016ae/25-13.c v204>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001526:[<0x100000016ae/25-13.c v883>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.683 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.530+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000152d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c auth v971 ap=1 s=2501 n(v0 rc2005-06-03T16:35:17.000000+0000 b2501 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448de680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000152d:[<0x100000016ae/22-10.c v218>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000152d:[<0x100000016ae/22-10.c v971>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.683 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.531+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000161a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-4.c auth v915 ap=1 s=4222 n(v0 rc2005-06-03T16:35:04.000000+0000 b4222 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448df180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000161a:[<0x100000016ae/19-4.c v544>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000161a:[<0x100000016ae/19-4.c v915>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.683 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.531+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015f9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-99.c auth v935 ap=1 s=902 n(v0 rc2005-06-03T16:35:32.000000+0000 b902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448df700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015f9:[<0x100000016ae/4-99.c v478>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015f9:[<0x100000016ae/4-99.c v935>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.683 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.531+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001651 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-18.c auth v929 ap=1 s=1476 n(v0 rc2005-06-03T16:34:41.000000+0000 b1476 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448f6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001651:[<0x100000016ae/1-18.c v654>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001651:[<0x100000016ae/1-18.c v929>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.683 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.532+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000161d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-15.c auth v955 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448f7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000161d:[<0x100000016ae/17-15.c v550>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000161d:[<0x100000016ae/17-15.c v955>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.684 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.532+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015b0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c auth v839 ap=1 s=3873 n(v0 rc2005-06-03T16:34:59.000000+0000 b3873 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448f9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015b0:[<0x100000016ae/18-18.c v332>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015b0:[<0x100000016ae/18-18.c v839>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.684 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.532+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000162d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-21.c auth v857 ap=1 s=2176 n(v0 rc2005-06-03T16:34:58.000000+0000 b2176 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448f9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000162d:[<0x100000016ae/17-21.c v582>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000162d:[<0x100000016ae/17-21.c v857>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.684 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.533+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000151d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c auth v879 ap=1 s=4336 n(v0 rc2005-06-03T16:35:18.000000+0000 b4336 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544902b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000151d:[<0x100000016ae/23-11.c v186>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000151d:[<0x100000016ae/23-11.c v879>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.684 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.533+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000163f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-1.c auth v939 ap=1 s=1681 n(v0 rc2005-06-03T16:35:46.000000+0000 b1681 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544902000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000163f:[<0x100000016ae/8-1.c v618>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000163f:[<0x100000016ae/8-1.c v939>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.684 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.533+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c auth v899 ap=1 s=4217 n(v0 rc2005-06-03T16:35:04.000000+0000 b4217 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544903b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f4:[<0x100000016ae/19-7.c v104>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014f4:[<0x100000016ae/19-7.c v899>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.684 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.533+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015fa [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-23.c auth v937 ap=1 s=1330 n(v0 rc2005-06-03T16:35:45.000000+0000 b1330 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544903600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015fa:[<0x100000016ae/6-23.c v480>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015fa:[<0x100000016ae/6-23.c v937>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.684 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.533+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001668 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-22.c auth v961 ap=1 s=1488 n(v0 rc2005-06-03T16:35:16.000000+0000 b1488 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544904100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001668:[<0x100000016ae/2-22.c v700>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001668:[<0x100000016ae/2-22.c v961>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.684 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.534+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001594 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c auth v973 ap=1 s=908 n(v0 rc2005-06-03T16:35:28.000000+0000 b908 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554490c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001594:[<0x100000016ae/4-102.c v276>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001594:[<0x100000016ae/4-102.c v973>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.684 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.534+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ec [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c auth v829 ap=1 s=4336 n(v0 rc2005-06-03T16:35:20.000000+0000 b4336 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544905700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ec:[<0x100000016ae/23-18.c v88>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014ec:[<0x100000016ae/23-18.c v829>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.684 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.534+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000166d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-51.c auth v907 ap=1 s=1989 n(v0 rc2005-06-03T16:35:29.000000+0000 b1989 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554490c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000166d:[<0x100000016ae/4-51.c v710>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000166d:[<0x100000016ae/4-51.c v907>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.684 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.535+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000162a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-42.c auth v947 ap=1 s=1773 n(v0 rc2005-06-03T16:34:55.000000+0000 b1773 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554490d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000162a:[<0x100000016ae/12-42.c v576>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000162a:[<0x100000016ae/12-42.c v947>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.684 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.535+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001530 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c auth v865 ap=1 s=1525 n(v0 rc2005-06-03T16:35:26.000000+0000 b1525 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554490cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001530:[<0x100000016ae/3-20.c v224>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001530:[<0x100000016ae/3-20.c v865>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.685 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.535+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000159d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c auth v953 ap=1 s=1333 n(v0 rc2005-06-03T16:35:32.000000+0000 b1333 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554490db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000159d:[<0x100000016ae/6-11.c v294>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000159d:[<0x100000016ae/6-11.c v953>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.685 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.536+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000162b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-26.c auth v837 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554490e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000162b:[<0x100000016ae/17-26.c v578>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000162b:[<0x100000016ae/17-26.c v837>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.685 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.536+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000167f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-7.c auth v841 ap=1 s=4329 n(v0 rc2005-06-03T16:35:21.000000+0000 b4329 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554490ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000167f:[<0x100000016ae/23-7.c v746>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000167f:[<0x100000016ae/23-7.c v841>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.685 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.536+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000160d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-2.c auth v917 ap=1 s=4336 n(v0 rc2005-06-03T16:35:20.000000+0000 b4336 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554491a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000160d:[<0x100000016ae/23-2.c v518>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000160d:[<0x100000016ae/23-2.c v917>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.685 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.537+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001531 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c auth v921 ap=1 s=1773 n(v0 rc2005-06-03T16:34:55.000000+0000 b1773 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554491bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001531:[<0x100000016ae/12-37.c v226>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001531:[<0x100000016ae/12-37.c v921>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.685 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.537+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001637 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-3.c auth v951 ap=1 s=2492 n(v0 rc2005-06-03T16:35:18.000000+0000 b2492 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554491c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001637:[<0x100000016ae/22-3.c v602>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001637:[<0x100000016ae/22-3.c v951>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.685 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.538+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000165a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-38.c auth v977 ap=1 s=1773 n(v0 rc2005-06-03T16:34:55.000000+0000 b1773 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554491cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000165a:[<0x100000016ae/12-38.c v672>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000165a:[<0x100000016ae/12-38.c v977>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.685 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.538+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015ec [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-10.c auth v945 ap=1 s=5512 n(v0 rc2005-06-03T16:34:57.000000+0000 b5512 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554491d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015ec:[<0x100000016ae/16-10.c v452>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015ec:[<0x100000016ae/16-10.c v945>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.685 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.538+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015a4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c auth v889 ap=1 s=6206 n(v0 rc2005-06-03T16:35:24.000000+0000 b6206 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554491d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015a4:[<0x100000016ae/28-16.c v308>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015a4:[<0x100000016ae/28-16.c v889>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.685 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.539+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001660 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-8.c auth v853 ap=1 s=2492 n(v0 rc2005-06-03T16:35:18.000000+0000 b2492 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544937080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001660:[<0x100000016ae/22-8.c v684>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001660:[<0x100000016ae/22-8.c v853>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.686 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.539+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015ae [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c auth v933 ap=1 s=4336 n(v0 rc2005-06-03T16:35:19.000000+0000 b4336 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544936580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015ae:[<0x100000016ae/23-15.c v328>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015ae:[<0x100000016ae/23-15.c v933>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.686 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.539+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c auth v911 ap=1 s=5512 n(v0 rc2005-06-03T16:34:57.000000+0000 b5512 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544937600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000150c:[<0x100000016ae/16-15.c v152>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000150c:[<0x100000016ae/16-15.c v911>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.686 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.539+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001664 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-17.c auth v871 ap=1 s=2007 n(v0 rc2005-06-03T16:34:52.000000+0000 b2007 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544937b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001664:[<0x100000016ae/12-17.c v692>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001664:[<0x100000016ae/12-17.c v871>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.686 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.540+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001503 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c auth v887 ap=1 s=6206 n(v0 rc2005-06-03T16:35:24.000000+0000 b6206 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544938100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001503:[<0x100000016ae/28-5.c v134>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001503:[<0x100000016ae/28-5.c v887>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.686 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.540+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000151c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c auth v851 ap=1 s=4222 n(v0 rc2005-06-03T16:35:04.000000+0000 b4222 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544938680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000151c:[<0x100000016ae/19-26.c v184>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000151c:[<0x100000016ae/19-26.c v851>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.686 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.540+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001593 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c auth v913 ap=1 s=1719 n(v0 rc2005-06-03T16:34:57.000000+0000 b1719 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544938c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001593:[<0x100000016ae/13-7.c v274>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001593:[<0x100000016ae/13-7.c v913>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.686 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.540+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c auth v931 ap=1 s=1676 n(v0 rc2005-06-03T16:35:47.000000+0000 b1676 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544939180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c4:[<0x100000016ae/8-3.c v4>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014c4:[<0x100000016ae/8-3.c v931>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.686 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.540+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000152e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c auth v863 ap=1 s=1770 n(v0 rc2005-06-03T16:34:52.000000+0000 b1770 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544939700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000152e:[<0x100000016ae/12-29.c v220>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000152e:[<0x100000016ae/12-29.c v863>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.686 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.541+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015dc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-2.c auth v919 ap=1 s=2450 n(v0 rc2005-06-03T16:35:23.000000+0000 b2450 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544942000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015dc:[<0x100000016ae/25-2.c v420>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015dc:[<0x100000016ae/25-2.c v919>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.687 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.541+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015e9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-1.c auth v891 ap=1 s=1488 n(v0 rc2005-06-03T16:35:05.000000+0000 b1488 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544943080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015e9:[<0x100000016ae/2-1.c v446>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015e9:[<0x100000016ae/2-1.c v891>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.687 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.541+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015b9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-19.c auth v949 ap=1 s=2007 n(v0 rc2005-06-03T16:34:52.000000+0000 b2007 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544943b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015b9:[<0x100000016ae/12-19.c v350>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015b9:[<0x100000016ae/12-19.c v949>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.687 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.541+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000160e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-12.c auth v827 ap=1 s=1681 n(v0 rc2005-06-03T16:35:46.000000+0000 b1681 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544943600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000160e:[<0x100000016ae/8-12.c v520>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000160e:[<0x100000016ae/8-12.c v827>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.687 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.542+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c auth v829 ap=1 s=1681 n(v0 rc2005-06-03T16:35:46.000000+0000 b1681 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447a8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e8:[<0x100000016ae/8-14.c v80>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014e8:[<0x100000016ae/8-14.c v829>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.687 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.542+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001609 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-1.c auth v931 ap=1 s=1476 n(v0 rc2005-06-03T16:34:40.000000+0000 b1476 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554486cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001609:[<0x100000016ae/1-1.c v510>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001609:[<0x100000016ae/1-1.c v931>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.687 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.542+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001620 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-12.c auth v959 ap=1 s=6206 n(v0 rc2005-06-03T16:35:24.000000+0000 b6206 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554486d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001620:[<0x100000016ae/28-12.c v556>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001620:[<0x100000016ae/28-12.c v959>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.687 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.543+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001544 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c auth v847 ap=1 s=2501 n(v0 rc2005-06-03T16:35:18.000000+0000 b2501 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554486e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001544:[<0x100000016ae/22-14.c v264>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001544:[<0x100000016ae/22-14.c v847>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.687 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.543+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001519 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c auth v831 ap=1 s=6203 n(v0 rc2005-06-03T16:35:24.000000+0000 b6203 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554486d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001519:[<0x100000016ae/28-6.c v178>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001519:[<0x100000016ae/28-6.c v831>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.687 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.543+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c auth v911 ap=1 s=1333 n(v0 rc2005-06-03T16:35:32.000000+0000 b1333 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554486db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f3:[<0x100000016ae/6-15.c v102>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014f3:[<0x100000016ae/6-15.c v911>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.687 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.544+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000159e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c auth v925 ap=1 s=1330 n(v0 rc2005-06-03T16:35:46.000000+0000 b1330 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544878000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000159e:[<0x100000016ae/6-6.c v296>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000159e:[<0x100000016ae/6-6.c v925>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.687 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.544+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000161e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-25.c auth v949 ap=1 s=4336 n(v0 rc2005-06-03T16:35:20.000000+0000 b4336 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544878580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000161e:[<0x100000016ae/23-25.c v552>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000161e:[<0x100000016ae/23-25.c v949>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.688 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.544+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001595 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c auth v837 ap=1 s=3873 n(v0 rc2005-06-03T16:35:00.000000+0000 b3873 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544878b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001595:[<0x100000016ae/18-26.c v278>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001595:[<0x100000016ae/18-26.c v837>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.688 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.544+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ff [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c auth v827 ap=1 s=2450 n(v0 rc2005-06-03T16:35:22.000000+0000 b2450 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544879600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ff:[<0x100000016ae/25-18.c v126>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014ff:[<0x100000016ae/25-18.c v827>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.688 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.545+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c auth v879 ap=1 s=1989 n(v0 rc2005-06-03T16:35:29.000000+0000 b1989 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544879080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f7:[<0x100000016ae/4-45.c v110>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014f7:[<0x100000016ae/4-45.c v879>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.688 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.545+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000164f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-16.c auth v965 ap=1 s=3873 n(v0 rc2005-06-03T16:34:59.000000+0000 b3873 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544879b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000164f:[<0x100000016ae/18-16.c v650>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000164f:[<0x100000016ae/18-16.c v965>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.688 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.545+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001524 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c auth v905 ap=1 s=2007 n(v0 rc2005-06-03T16:34:51.000000+0000 b2007 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554487a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001524:[<0x100000016ae/12-11.c v200>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001524:[<0x100000016ae/12-11.c v905>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.688 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.545+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014cb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c auth v849 ap=1 s=5509 n(v0 rc2005-06-03T16:34:58.000000+0000 b5509 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554487a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014cb:[<0x100000016ae/16-7.c v18>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014cb:[<0x100000016ae/16-7.c v849>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.688 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.545+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015e1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-23.c auth v839 ap=1 s=1719 n(v0 rc2005-06-03T16:34:57.000000+0000 b1719 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554487ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015e1:[<0x100000016ae/13-23.c v430>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015e1:[<0x100000016ae/13-23.c v839>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.688 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.546+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001629 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-20.c auth v943 ap=1 s=2501 n(v0 rc2005-06-03T16:35:18.000000+0000 b2501 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554487b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001629:[<0x100000016ae/22-20.c v574>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001629:[<0x100000016ae/22-20.c v943>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.688 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.546+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001604 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-23.c auth v845 ap=1 s=3868 n(v0 rc2005-06-03T16:34:59.000000+0000 b3868 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554487b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001604:[<0x100000016ae/18-23.c v500>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001604:[<0x100000016ae/18-23.c v845>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.688 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.546+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015bf [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-2.c auth v933 ap=1 s=1722 n(v0 rc2005-06-03T16:34:57.000000+0000 b1722 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544884000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015bf:[<0x100000016ae/13-2.c v362>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015bf:[<0x100000016ae/13-2.c v933>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.688 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.547+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001522 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c auth v939 ap=1 s=1488 n(v0 rc2005-06-03T16:35:05.000000+0000 b1488 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544884b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001522:[<0x100000016ae/2-10.c v196>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001522:[<0x100000016ae/2-10.c v939>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.689 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.547+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001657 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-7.c auth v871 ap=1 s=1520 n(v0 rc2005-06-03T16:35:27.000000+0000 b1520 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544885080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001657:[<0x100000016ae/3-7.c v666>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001657:[<0x100000016ae/3-7.c v871>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.689 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.547+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c auth v945 ap=1 s=2501 n(v0 rc2005-06-03T16:35:18.000000+0000 b2501 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544885600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f2:[<0x100000016ae/22-4.c v100>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014f2:[<0x100000016ae/22-4.c v945>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.689 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.547+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015aa [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c auth v913 ap=1 s=2176 n(v0 rc2005-06-03T16:34:58.000000+0000 b2176 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544886100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015aa:[<0x100000016ae/17-3.c v320>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015aa:[<0x100000016ae/17-3.c v913>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.689 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.548+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015d4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-33.c auth v885 ap=1 s=1985 n(v0 rc2024-01-25T15:03:13.558690+0000 b1985 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544886c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015d4:[<0x100000016ae/4-33.c v404>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015d4:[<0x100000016ae/4-33.c v885>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.689 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.548+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001682 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-13.c auth v865 ap=1 s=2007 n(v0 rc2005-06-03T16:34:52.000000+0000 b2007 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544887180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001682:[<0x100000016ae/12-13.c v752>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001682:[<0x100000016ae/12-13.c v865>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.689 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.548+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015be [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-26.c auth v897 ap=1 s=1333 n(v0 rc2005-06-03T16:35:45.000000+0000 b1333 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544887700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015be:[<0x100000016ae/6-26.c v360>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015be:[<0x100000016ae/6-26.c v897>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.689 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.548+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015c9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-23.c auth v963 ap=1 s=4217 n(v0 rc2005-06-03T16:35:04.000000+0000 b4217 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554488e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015c9:[<0x100000016ae/19-23.c v382>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015c9:[<0x100000016ae/19-23.c v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.689 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.549+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001658 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-11.c auth v901 ap=1 s=2501 n(v0 rc2005-06-03T16:35:18.000000+0000 b2501 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554488f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001658:[<0x100000016ae/22-11.c v668>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001658:[<0x100000016ae/22-11.c v901>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.689 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.549+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015c1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-10.c auth v833 ap=1 s=2007 n(v0 rc2005-06-03T16:34:51.000000+0000 b2007 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554488fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015c1:[<0x100000016ae/12-10.c v366>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015c1:[<0x100000016ae/12-10.c v833>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.689 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.549+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015b1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt auth v927 ap=1 s=459 n(v0 rc2005-06-03T16:35:47.000000+0000 b459 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544890680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015b1:[<0x100000016ae/coverage.txt v334>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015b1:[<0x100000016ae/coverage.txt v927>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.689 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.550+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c auth v861 ap=1 s=2007 n(v0 rc2005-06-03T16:34:55.000000+0000 b2007 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544890c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000150f:[<0x100000016ae/12-5.c v158>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000150f:[<0x100000016ae/12-5.c v861>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.690 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.550+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001598 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c auth v907 ap=1 s=1898 n(v0 rc2005-06-03T16:35:31.000000+0000 b1898 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544891700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001598:[<0x100000016ae/4-8.c v284>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001598:[<0x100000016ae/4-8.c v907>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.690 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.550+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014fd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c auth v955 ap=1 s=1484 n(v0 rc2005-06-03T16:34:50.000000+0000 b1484 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448aa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014fd:[<0x100000016ae/1-24.c v122>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014fd:[<0x100000016ae/1-24.c v955>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.690 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.550+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000166e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-8.c auth v891 ap=1 s=1667 n(v0 rc2005-06-03T16:35:47.000000+0000 b1667 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448aab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000166e:[<0x100000016ae/8-8.c v712>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000166e:[<0x100000016ae/8-8.c v891>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.690 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.551+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001650 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-7.c auth v857 ap=1 s=1484 n(v0 rc2005-06-03T16:35:17.000000+0000 b1484 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448abb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001650:[<0x100000016ae/2-7.c v652>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001650:[<0x100000016ae/2-7.c v857>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.690 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.551+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c auth v843 ap=1 s=904 n(v0 rc2005-06-03T16:35:32.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448ac680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e9:[<0x100000016ae/4-89.c v82>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014e9:[<0x100000016ae/4-89.c v843>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.690 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.551+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015e6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.h auth v899 ap=1 s=2420 n(v0 rc2005-06-03T16:35:47.000000+0000 b2420 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448acc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015e6:[<0x100000016ae/testfrmw.h v440>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015e6:[<0x100000016ae/testfrmw.h v899>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.690 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.551+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015b8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-4.c auth v853 ap=1 s=1333 n(v0 rc2005-06-03T16:35:46.000000+0000 b1333 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448ad180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015b8:[<0x100000016ae/6-4.c v348>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015b8:[<0x100000016ae/6-4.c v853>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.690 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.552+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001634 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-11.c auth v941 ap=1 s=1525 n(v0 rc2005-06-03T16:35:25.000000+0000 b1525 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448b6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001634:[<0x100000016ae/3-11.c v596>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001634:[<0x100000016ae/3-11.c v941>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.690 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.552+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015f7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-17.c auth v889 ap=1 s=1681 n(v0 rc2005-06-03T16:35:46.000000+0000 b1681 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448b7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015f7:[<0x100000016ae/8-17.c v474>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015f7:[<0x100000016ae/8-17.c v889>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.690 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.553+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000161c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-101.c auth v957 ap=1 s=902 n(v0 rc2005-06-03T16:35:28.000000+0000 b902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448b7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000161c:[<0x100000016ae/4-101.c v548>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000161c:[<0x100000016ae/4-101.c v957>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.690 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.553+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000166b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-7.c auth v961 ap=1 s=1667 n(v0 rc2005-06-03T16:35:47.000000+0000 b1667 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448b7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000166b:[<0x100000016ae/8-7.c v706>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000166b:[<0x100000016ae/8-7.c v961>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.690 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.553+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015d6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-4.c auth v875 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448b9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015d6:[<0x100000016ae/17-4.c v408>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015d6:[<0x100000016ae/17-4.c v875>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.691 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.554+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015ce [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-3.c auth v825 ap=1 s=6203 n(v0 rc2005-06-03T16:35:24.000000+0000 b6203 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448b9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015ce:[<0x100000016ae/28-3.c v392>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015ce:[<0x100000016ae/28-3.c v825>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.691 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.554+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000166f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-16.c auth v867 ap=1 s=1525 n(v0 rc2005-06-03T16:35:25.000000+0000 b1525 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448c8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000166f:[<0x100000016ae/3-16.c v714>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000166f:[<0x100000016ae/3-16.c v867>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.691 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.554+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015f0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-4.c auth v929 ap=1 s=2007 n(v0 rc2005-06-03T16:34:55.000000+0000 b2007 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448c8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015f0:[<0x100000016ae/12-4.c v460>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015f0:[<0x100000016ae/12-4.c v929>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.691 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.554+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015c0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-9.c auth v835 ap=1 s=6203 n(v0 rc2005-06-03T16:35:25.000000+0000 b6203 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448c8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015c0:[<0x100000016ae/28-9.c v364>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015c0:[<0x100000016ae/28-9.c v835>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.691 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.554+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001602 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-9.c auth v937 ap=1 s=2441 n(v0 rc2005-06-03T16:35:23.000000+0000 b2441 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448c9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001602:[<0x100000016ae/25-9.c v496>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001602:[<0x100000016ae/25-9.c v937>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.691 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.554+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015a2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c auth v909 ap=1 s=3873 n(v0 rc2005-06-03T16:34:59.000000+0000 b3873 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448c9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015a2:[<0x100000016ae/18-17.c v304>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015a2:[<0x100000016ae/18-17.c v909>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.691 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.555+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ef [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c auth v903 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655448c9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ef:[<0x100000016ae/17-20.c v94>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014ef:[<0x100000016ae/17-20.c v903>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.691 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.555+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015a9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-77.c auth v865 ap=1 s=904 n(v0 rc2005-06-03T16:35:31.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447f0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015a9:[<0x100000016ae/4-77.c v318>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015a9:[<0x100000016ae/4-77.c v865>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.691 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.555+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001507 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-21.c auth v817 ap=1 s=1719 n(v0 rc2005-06-03T16:34:57.000000+0000 b1719 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447f0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001507:[<0x100000016ae/13-21.c v142>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001507:[<0x100000016ae/13-21.c v817>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.691 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.556+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-81.c auth v829 ap=1 s=902 n(v0 rc2005-06-03T16:35:31.000000+0000 b902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544822580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000150d:[<0x100000016ae/4-81.c v154>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000150d:[<0x100000016ae/4-81.c v829>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.691 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.556+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001632 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-25.c auth v899 ap=1 s=1525 n(v0 rc2005-06-03T16:35:27.000000+0000 b1525 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544822b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001632:[<0x100000016ae/3-25.c v592>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001632:[<0x100000016ae/3-25.c v899>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.692 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.556+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015a1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-18.c auth v831 ap=1 s=6206 n(v0 rc2005-06-03T16:35:24.000000+0000 b6206 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544823080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015a1:[<0x100000016ae/28-18.c v302>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015a1:[<0x100000016ae/28-18.c v831>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.692 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.556+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000158f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-1.c auth v907 ap=1 s=4336 n(v0 rc2005-06-03T16:35:18.000000+0000 b4336 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544823600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000158f:[<0x100000016ae/23-1.c v266>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000158f:[<0x100000016ae/23-1.c v907>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.692 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.556+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015d2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-11.c auth v849 ap=1 s=1902 n(v0 rc2005-06-03T16:35:29.000000+0000 b1902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544824100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015d2:[<0x100000016ae/4-11.c v400>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015d2:[<0x100000016ae/4-11.c v849>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.692 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.556+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000167e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-14.c auth v893 ap=1 s=1488 n(v0 rc2005-06-03T16:35:05.000000+0000 b1488 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544824680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000167e:[<0x100000016ae/2-14.c v744>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000167e:[<0x100000016ae/2-14.c v893>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.692 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.557+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001662 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-15.c auth v883 ap=1 s=1681 n(v0 rc2024-01-25T15:03:13.565690+0000 b1681 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544824c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001662:[<0x100000016ae/8-15.c v688>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001662:[<0x100000016ae/8-15.c v883>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.692 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.557+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015c6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-25.c auth v885 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544825180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015c6:[<0x100000016ae/17-25.c v376>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015c6:[<0x100000016ae/17-25.c v885>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.692 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.557+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000167c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-5.c auth v857 ap=1 s=2501 n(v0 rc2005-06-03T16:35:18.000000+0000 b2501 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554482e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000167c:[<0x100000016ae/22-5.c v740>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000167c:[<0x100000016ae/22-5.c v857>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.692 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.557+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001625 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-9.c auth v827 ap=1 s=5509 n(v0 rc2005-06-03T16:34:58.000000+0000 b5509 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554482f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001625:[<0x100000016ae/16-9.c v566>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001625:[<0x100000016ae/16-9.c v827>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.692 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.558+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000164c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-55.c auth v809 ap=1 s=902 n(v0 rc2005-06-03T16:35:30.000000+0000 b902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554482fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000164c:[<0x100000016ae/4-55.c v644>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000164c:[<0x100000016ae/4-55.c v809>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.692 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.558+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001636 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-25.c auth v811 ap=1 s=1902 n(v0 rc2005-06-03T16:35:29.000000+0000 b1902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544830100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001636:[<0x100000016ae/4-25.c v600>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001636:[<0x100000016ae/4-25.c v811>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.692 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.558+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001616 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-62.c auth v835 ap=1 s=904 n(v0 rc2005-06-03T16:35:30.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544830680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001616:[<0x100000016ae/4-62.c v536>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001616:[<0x100000016ae/4-62.c v835>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.693 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.558+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000160c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-21.c auth v803 ap=1 s=3868 n(v0 rc2005-06-03T16:34:59.000000+0000 b3868 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544831180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000160c:[<0x100000016ae/18-21.c v516>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000160c:[<0x100000016ae/18-21.c v803>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.693 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.559+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015e5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-41.c auth v871 ap=1 s=1989 n(v0 rc2005-06-03T16:35:29.000000+0000 b1989 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544831700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015e5:[<0x100000016ae/4-41.c v438>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015e5:[<0x100000016ae/4-41.c v871>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.693 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.559+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001508 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-48.c auth v821 ap=1 s=1989 n(v0 rc2005-06-03T16:35:29.000000+0000 b1989 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544836580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001508:[<0x100000016ae/4-48.c v144>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001508:[<0x100000016ae/4-48.c v821>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.693 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.559+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001672 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-13.c auth v879 ap=1 s=1525 n(v0 rc2005-06-03T16:35:25.000000+0000 b1525 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544836000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001672:[<0x100000016ae/3-13.c v720>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001672:[<0x100000016ae/3-13.c v879>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.693 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.559+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000166a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-1.c auth v877 ap=1 s=2007 n(v0 rc2005-06-03T16:34:51.000000+0000 b2007 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544836b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000166a:[<0x100000016ae/12-1.c v704>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000166a:[<0x100000016ae/12-1.c v877>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.693 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.559+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015f8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-24.c auth v897 ap=1 s=2519 n(v0 rc2005-06-03T16:35:18.000000+0000 b2519 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544837080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015f8:[<0x100000016ae/22-24.c v476>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015f8:[<0x100000016ae/22-24.c v897>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.693 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.560+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015cf [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-50.c auth v833 ap=1 s=1779 n(v0 rc2005-06-03T16:34:55.000000+0000 b1779 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544837600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015cf:[<0x100000016ae/12-50.c v394>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015cf:[<0x100000016ae/12-50.c v833>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.693 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.560+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001683 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-37.c auth v807 ap=1 s=1989 n(v0 rc2005-06-03T16:35:29.000000+0000 b1989 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544838100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001683:[<0x100000016ae/4-37.c v754>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001683:[<0x100000016ae/4-37.c v807>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.693 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.560+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015e8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-30.c auth v823 ap=1 s=1773 n(v0 rc2005-06-03T16:34:52.000000+0000 b1773 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544837b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015e8:[<0x100000016ae/12-30.c v444>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015e8:[<0x100000016ae/12-30.c v823>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.693 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.560+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-5.c auth v863 ap=1 s=5512 n(v0 rc2005-06-03T16:34:58.000000+0000 b5512 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544838680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f0:[<0x100000016ae/16-5.c v96>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014f0:[<0x100000016ae/16-5.c v863>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.693 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.560+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001678 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-25.c auth v855 ap=1 s=3873 n(v0 rc2005-06-03T16:34:59.000000+0000 b3873 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544839180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001678:[<0x100000016ae/18-25.c v732>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001678:[<0x100000016ae/18-25.c v855>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.694 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.560+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001640 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-11.c auth v813 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544839700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001640:[<0x100000016ae/17-11.c v620>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001640:[<0x100000016ae/17-11.c v813>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.694 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.561+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001647 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-19.c auth v873 ap=1 s=5512 n(v0 rc2005-06-03T16:34:57.000000+0000 b5512 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544844000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001647:[<0x100000016ae/16-19.c v634>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001647:[<0x100000016ae/16-19.c v873>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.694 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.561+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015d0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-22.c auth v825 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544845080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015d0:[<0x100000016ae/17-22.c v396>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015d0:[<0x100000016ae/17-22.c v825>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.694 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.561+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ed [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-46.c auth v861 ap=1 s=1989 n(v0 rc2005-06-03T16:35:29.000000+0000 b1989 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544844580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ed:[<0x100000016ae/4-46.c v90>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014ed:[<0x100000016ae/4-46.c v861>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.694 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.562+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015d1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-4.c auth v805 ap=1 s=2450 n(v0 rc2005-06-03T16:35:23.000000+0000 b2450 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544846680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015d1:[<0x100000016ae/25-4.c v398>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015d1:[<0x100000016ae/25-4.c v805>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.694 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.562+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001592 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-25.c auth v801 ap=1 s=1333 n(v0 rc2005-06-03T16:35:45.000000+0000 b1333 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544846100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001592:[<0x100000016ae/6-25.c v272>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001592:[<0x100000016ae/6-25.c v801>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.694 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.562+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015ee [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-16.c auth v837 ap=1 s=1902 n(v0 rc2005-06-03T16:35:29.000000+0000 b1902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544847180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015ee:[<0x100000016ae/4-16.c v456>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015ee:[<0x100000016ae/4-16.c v837>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.695 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.562+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001663 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-9.c auth v839 ap=1 s=4329 n(v0 rc2005-06-03T16:35:21.000000+0000 b4329 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544846c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001663:[<0x100000016ae/23-9.c v690>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001663:[<0x100000016ae/23-9.c v839>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.695 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.563+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015eb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-22.c auth v853 ap=1 s=1333 n(v0 rc2005-06-03T16:35:45.000000+0000 b1333 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544847700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015eb:[<0x100000016ae/6-22.c v450>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015eb:[<0x100000016ae/6-22.c v853>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.695 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.563+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015c2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-74.c auth v895 ap=1 s=904 n(v0 rc2005-06-03T16:35:31.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447a6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015c2:[<0x100000016ae/4-74.c v368>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015c2:[<0x100000016ae/4-74.c v895>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.695 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.563+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015ba [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-4.c auth v869 ap=1 s=1672 n(v0 rc2005-06-03T16:35:47.000000+0000 b1672 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447a6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015ba:[<0x100000016ae/8-4.c v352>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015ba:[<0x100000016ae/8-4.c v869>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.695 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.563+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-10.c auth v887 ap=1 s=2450 n(v0 rc2005-06-03T16:35:21.000000+0000 b2450 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447a6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f9:[<0x100000016ae/25-10.c v114>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014f9:[<0x100000016ae/25-10.c v887>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.695 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.563+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000167d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-93.c auth v845 ap=1 s=904 n(v0 rc2005-06-03T16:35:32.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447a7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000167d:[<0x100000016ae/4-93.c v742>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000167d:[<0x100000016ae/4-93.c v845>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.696 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.564+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000153e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-14.c auth v867 ap=1 s=3873 n(v0 rc2005-06-03T16:34:59.000000+0000 b3873 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447a7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000153e:[<0x100000016ae/18-14.c v252>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000153e:[<0x100000016ae/18-14.c v867>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.696 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.564+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ce [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-44.c auth v799 ap=1 s=1989 n(v0 rc2005-06-03T16:35:29.000000+0000 b1989 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447a7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ce:[<0x100000016ae/4-44.c v24>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014ce:[<0x100000016ae/4-44.c v799>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.696 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.564+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000160a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-68.c auth v881 ap=1 s=904 n(v0 rc2005-06-03T16:35:31.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447a8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000160a:[<0x100000016ae/4-68.c v512>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000160a:[<0x100000016ae/4-68.c v881>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.696 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.564+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001652 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-12.c auth v841 ap=1 s=5512 n(v0 rc2005-06-03T16:34:57.000000+0000 b5512 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447a8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001652:[<0x100000016ae/16-12.c v656>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001652:[<0x100000016ae/16-12.c v841>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.696 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.564+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015e2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-20.c auth v893 ap=1 s=5512 n(v0 rc2005-06-03T16:34:57.000000+0000 b5512 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554479db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015e2:[<0x100000016ae/16-20.c v432>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015e2:[<0x100000016ae/16-20.c v893>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.696 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.565+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015a0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-94.c auth v801 ap=1 s=904 n(v0 rc2005-06-03T16:35:32.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554479e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015a0:[<0x100000016ae/4-94.c v300>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015a0:[<0x100000016ae/4-94.c v801>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.697 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.565+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015ef [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-17.c auth v889 ap=1 s=5512 n(v0 rc2005-06-03T16:34:57.000000+0000 b5512 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554479ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015ef:[<0x100000016ae/16-17.c v458>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015ef:[<0x100000016ae/16-17.c v889>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.697 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.565+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001659 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-7.c auth v811 ap=1 s=1330 n(v0 rc2005-06-03T16:35:46.000000+0000 b1330 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554479f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001659:[<0x100000016ae/6-7.c v670>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001659:[<0x100000016ae/6-7.c v811>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.697 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.565+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015f4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-14.c auth v909 ap=1 s=1333 n(v0 rc2005-06-03T16:35:32.000000+0000 b1333 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447b8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015f4:[<0x100000016ae/6-14.c v468>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015f4:[<0x100000016ae/6-14.c v909>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.697 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.566+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000153a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-16.c auth v805 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447b8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000153a:[<0x100000016ae/17-16.c v244>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000153a:[<0x100000016ae/17-16.c v805>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.697 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.566+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001613 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-22.c auth v885 ap=1 s=1525 n(v0 rc2005-06-03T16:35:27.000000+0000 b1525 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447b9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001613:[<0x100000016ae/3-22.c v530>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001613:[<0x100000016ae/3-22.c v885>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.697 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.566+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001622 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-61.c auth v879 ap=1 s=902 n(v0 rc2005-06-03T16:35:30.000000+0000 b902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447b9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001622:[<0x100000016ae/4-61.c v560>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001622:[<0x100000016ae/4-61.c v879>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.697 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.566+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-28.c auth v895 ap=1 s=1773 n(v0 rc2005-06-03T16:34:52.000000+0000 b1773 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447ba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e5:[<0x100000016ae/12-28.c v74>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014e5:[<0x100000016ae/12-28.c v895>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.697 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.567+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001608 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-19.c auth v881 ap=1 s=1902 n(v0 rc2005-06-03T16:35:29.000000+0000 b1902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447ba680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001608:[<0x100000016ae/4-19.c v508>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001608:[<0x100000016ae/4-19.c v881>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.697 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.567+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001502 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-24.c auth v803 ap=1 s=1496 n(v0 rc2005-06-03T16:35:17.000000+0000 b1496 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447bac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001502:[<0x100000016ae/2-24.c v132>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001502:[<0x100000016ae/2-24.c v803>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.697 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.567+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001631 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-10.c auth v813 ap=1 s=6206 n(v0 rc2005-06-03T16:35:23.000000+0000 b6206 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447bb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001631:[<0x100000016ae/28-10.c v590>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001631:[<0x100000016ae/28-10.c v813>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.697 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.567+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001513 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-2.c auth v855 ap=1 s=1902 n(v0 rc2024-01-25T15:03:13.552690+0000 b1902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447bb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001513:[<0x100000016ae/4-2.c v166>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001513:[<0x100000016ae/4-2.c v855>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.698 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.567+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001590 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-19.c auth v823 ap=1 s=4336 n(v0 rc2005-06-03T16:35:20.000000+0000 b4336 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447d4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001590:[<0x100000016ae/23-19.c v268>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001590:[<0x100000016ae/23-19.c v823>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.698 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.568+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001656 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-18.c auth v839 ap=1 s=1722 n(v0 rc2005-06-03T16:34:57.000000+0000 b1722 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447d4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001656:[<0x100000016ae/13-18.c v664>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001656:[<0x100000016ae/13-18.c v839>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.698 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.568+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015d8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-16.c auth v869 ap=1 s=1476 n(v0 rc2005-06-03T16:34:41.000000+0000 b1476 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447d4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015d8:[<0x100000016ae/1-16.c v412>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015d8:[<0x100000016ae/1-16.c v869>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.698 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.568+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000167b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-3.c auth v875 ap=1 s=1898 n(v0 rc2005-06-03T16:35:29.000000+0000 b1898 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447d5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000167b:[<0x100000016ae/4-3.c v738>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000167b:[<0x100000016ae/4-3.c v875>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.698 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.568+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015d3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-23.c auth v827 ap=1 s=2004 n(v0 rc2005-06-03T16:34:52.000000+0000 b2004 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447d5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015d3:[<0x100000016ae/12-23.c v402>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015d3:[<0x100000016ae/12-23.c v827>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.698 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.568+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015db [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-2.c auth v865 ap=1 s=1476 n(v0 rc2005-06-03T16:34:41.000000+0000 b1476 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447d6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015db:[<0x100000016ae/1-2.c v418>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015db:[<0x100000016ae/1-2.c v865>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.698 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.569+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001688 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/29-1.c auth v887 ap=1 s=5596 n(v0 rc2005-06-03T16:35:25.000000+0000 b5596 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447d6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001688:[<0x100000016ae/29-1.c v764>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001688:[<0x100000016ae/29-1.c v887>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.698 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.569+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015ac [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-17.c auth v837 ap=1 s=1722 n(v0 rc2005-06-03T16:34:57.000000+0000 b1722 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447d6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015ac:[<0x100000016ae/13-17.c v324>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015ac:[<0x100000016ae/13-17.c v837>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.698 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.569+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001605 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-20.c auth v891 ap=1 s=4336 n(v0 rc2005-06-03T16:35:20.000000+0000 b4336 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447d7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001605:[<0x100000016ae/23-20.c v502>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001605:[<0x100000016ae/23-20.c v891>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.698 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.569+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001539 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-9.c auth v857 ap=1 s=2176 n(v0 rc2005-06-03T16:34:58.000000+0000 b2176 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447d7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001539:[<0x100000016ae/17-9.c v242>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001539:[<0x100000016ae/17-9.c v857>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.698 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.570+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001638 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-92.c auth v859 ap=1 s=904 n(v0 rc2024-01-25T15:03:13.561690+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447e0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001638:[<0x100000016ae/4-92.c v604>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001638:[<0x100000016ae/4-92.c v859>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.698 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.570+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000163c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-18.c auth v845 ap=1 s=1488 n(v0 rc2005-06-03T16:35:05.000000+0000 b1488 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447e1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000163c:[<0x100000016ae/2-18.c v612>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000163c:[<0x100000016ae/2-18.c v845>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.698 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.570+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001642 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-19.c auth v849 ap=1 s=1722 n(v0 rc2005-06-03T16:34:57.000000+0000 b1722 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447e2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001642:[<0x100000016ae/13-19.c v624>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001642:[<0x100000016ae/13-19.c v849>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.699 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.571+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001596 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-26.c auth v807 ap=1 s=6206 n(v0 rc2005-06-03T16:35:24.000000+0000 b6206 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447e2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001596:[<0x100000016ae/28-26.c v280>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001596:[<0x100000016ae/28-26.c v807>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.699 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.571+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001633 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-7.c auth v817 ap=1 s=2441 n(v0 rc2005-06-03T16:35:23.000000+0000 b2441 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447e2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001633:[<0x100000016ae/25-7.c v594>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001633:[<0x100000016ae/25-7.c v817>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.699 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.571+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-19.c auth v833 ap=1 s=6206 n(v0 rc2005-06-03T16:35:24.000000+0000 b6206 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447e3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f1:[<0x100000016ae/28-19.c v98>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014f1:[<0x100000016ae/28-19.c v833>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.699 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.571+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001610 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-69.c auth v899 ap=1 s=904 n(v0 rc2005-06-03T16:35:31.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447e3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001610:[<0x100000016ae/4-69.c v524>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001610:[<0x100000016ae/4-69.c v899>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.699 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.571+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001648 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-5.c auth v861 ap=1 s=1681 n(v0 rc2005-06-03T16:35:47.000000+0000 b1681 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447e6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001648:[<0x100000016ae/8-5.c v636>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001648:[<0x100000016ae/8-5.c v861>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.699 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.572+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015cd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-88.c auth v905 ap=1 s=904 n(v0 rc2005-06-03T16:35:32.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447e7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015cd:[<0x100000016ae/4-88.c v390>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015cd:[<0x100000016ae/4-88.c v905>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.699 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.572+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001523 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-49.c auth v835 ap=1 s=1985 n(v0 rc2005-06-03T16:35:29.000000+0000 b1985 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447e7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001523:[<0x100000016ae/4-49.c v198>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001523:[<0x100000016ae/4-49.c v835>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.699 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.572+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000160f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-53.c auth v897 ap=1 s=904 n(v0 rc2005-06-03T16:35:29.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447e8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000160f:[<0x100000016ae/4-53.c v522>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000160f:[<0x100000016ae/4-53.c v897>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.699 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.573+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001675 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-86.c auth v913 ap=1 s=902 n(v0 rc2005-06-03T16:35:32.000000+0000 b902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447e8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001675:[<0x100000016ae/4-86.c v726>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001675:[<0x100000016ae/4-86.c v913>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.699 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.573+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014c5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-14.c auth v853 ap=1 s=2007 n(v0 rc2005-06-03T16:34:52.000000+0000 b2007 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447e8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014c5:[<0x100000016ae/12-14.c v6>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014c5:[<0x100000016ae/12-14.c v853>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.699 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.573+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014f8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-15.c auth v901 ap=1 s=2501 n(v0 rc2005-06-03T16:35:18.000000+0000 b2501 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447e9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014f8:[<0x100000016ae/22-15.c v112>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014f8:[<0x100000016ae/22-15.c v901>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.699 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.573+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001685 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-20.c auth v867 ap=1 s=1681 n(v0 rc2005-06-03T16:35:47.000000+0000 b1681 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447ee580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001685:[<0x100000016ae/8-20.c v758>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001685:[<0x100000016ae/8-20.c v867>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.700 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.573+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015f6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-17.c auth v903 ap=1 s=1902 n(v0 rc2005-06-03T16:35:29.000000+0000 b1902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447ee000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015f6:[<0x100000016ae/4-17.c v472>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015f6:[<0x100000016ae/4-17.c v903>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.700 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.574+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015bb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-25.c auth v815 ap=1 s=2007 n(v0 rc2005-06-03T16:34:52.000000+0000 b2007 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447eeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015bb:[<0x100000016ae/12-25.c v354>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015bb:[<0x100000016ae/12-25.c v815>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.700 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.574+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001529 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-15.c auth v829 ap=1 s=2450 n(v0 rc2005-06-03T16:35:22.000000+0000 b2450 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447ef080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001529:[<0x100000016ae/25-15.c v210>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001529:[<0x100000016ae/25-15.c v829>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.700 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.574+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015c3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-20.c auth v851 ap=1 s=1333 n(v0 rc2005-06-03T16:35:45.000000+0000 b1333 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447ef600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015c3:[<0x100000016ae/6-20.c v370>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015c3:[<0x100000016ae/6-20.c v851>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.700 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.574+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000159f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-12.c auth v819 ap=1 s=4222 n(v0 rc2005-06-03T16:35:01.000000+0000 b4222 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447efb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000159f:[<0x100000016ae/19-12.c v298>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000159f:[<0x100000016ae/19-12.c v819>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.700 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.574+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001599 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-2.c auth v809 ap=1 s=5512 n(v0 rc2005-06-03T16:34:57.000000+0000 b5512 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655447f0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001599:[<0x100000016ae/16-2.c v286>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001599:[<0x100000016ae/16-2.c v809>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.700 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.575+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015a5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-9.c auth v887 ap=1 s=1667 n(v0 rc2005-06-03T16:35:47.000000+0000 b1667 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544669b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015a5:[<0x100000016ae/8-9.c v310>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015a5:[<0x100000016ae/8-9.c v887>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.700 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.575+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001500 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-8.c auth v853 ap=1 s=3868 n(v0 rc2005-06-03T16:35:01.000000+0000 b3868 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554466a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001500:[<0x100000016ae/18-8.c v128>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001500:[<0x100000016ae/18-8.c v853>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.700 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.575+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001597 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-52.c auth v905 ap=1 s=1773 n(v0 rc2005-06-03T16:34:55.000000+0000 b1773 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554466a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001597:[<0x100000016ae/12-52.c v282>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001597:[<0x100000016ae/12-52.c v905>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.700 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.575+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001520 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-25.c auth v881 ap=1 s=5512 n(v0 rc2005-06-03T16:34:57.000000+0000 b5512 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554466ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001520:[<0x100000016ae/16-25.c v192>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001520:[<0x100000016ae/16-25.c v881>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.700 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.575+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014ea [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-11.c auth v845 ap=1 s=4222 n(v0 rc2005-06-03T16:35:01.000000+0000 b4222 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554476a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014ea:[<0x100000016ae/19-11.c v84>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014ea:[<0x100000016ae/19-11.c v845>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.700 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.576+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000153b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-24.c auth v857 ap=1 s=5518 n(v0 rc2005-06-03T16:34:57.000000+0000 b5518 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554476ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000153b:[<0x100000016ae/16-24.c v246>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000153b:[<0x100000016ae/16-24.c v857>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.701 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.576+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001627 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-17.c auth v869 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554476b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001627:[<0x100000016ae/17-17.c v570>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001627:[<0x100000016ae/17-17.c v869>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.701 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.576+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001614 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-16.c auth v863 ap=1 s=5512 n(v0 rc2005-06-03T16:34:57.000000+0000 b5512 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554476bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001614:[<0x100000016ae/16-16.c v532>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001614:[<0x100000016ae/16-16.c v863>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.701 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.576+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001535 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-14.c auth v815 ap=1 s=1525 n(v0 rc2005-06-03T16:35:25.000000+0000 b1525 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554476c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001535:[<0x100000016ae/3-14.c v234>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001535:[<0x100000016ae/3-14.c v815>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.701 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.577+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015ea [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-26.c auth v877 ap=1 s=1902 n(v0 rc2005-06-03T16:35:29.000000+0000 b1902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554476c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015ea:[<0x100000016ae/4-26.c v448>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015ea:[<0x100000016ae/4-26.c v877>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.701 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.577+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001655 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-25.c auth v911 ap=1 s=2450 n(v0 rc2005-06-03T16:35:23.000000+0000 b2450 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554476cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001655:[<0x100000016ae/25-25.c v662>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001655:[<0x100000016ae/25-25.c v911>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.701 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.577+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000150b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-2.c auth v851 ap=1 s=6206 n(v0 rc2024-01-25T15:03:13.551690+0000 b6206 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554476d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000150b:[<0x100000016ae/28-2.c v150>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000150b:[<0x100000016ae/28-2.c v851>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.701 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.577+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001506 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-5.c auth v899 ap=1 s=1722 n(v0 rc2005-06-03T16:34:57.000000+0000 b1722 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544772580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001506:[<0x100000016ae/13-5.c v140>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001506:[<0x100000016ae/13-5.c v899>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.701 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.578+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-6.c auth v847 ap=1 s=1472 n(v0 rc2005-06-03T16:34:51.000000+0000 b1472 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554476b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d0:[<0x100000016ae/1-6.c v28>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014d0:[<0x100000016ae/1-6.c v847>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.701 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.578+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001514 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-46.c auth v825 ap=1 s=1773 n(v0 rc2005-06-03T16:34:55.000000+0000 b1773 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544772b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001514:[<0x100000016ae/12-46.c v168>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001514:[<0x100000016ae/12-46.c v825>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.701 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.578+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015ca [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-26.c auth v827 ap=1 s=1722 n(v0 rc2005-06-03T16:34:57.000000+0000 b1722 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544773080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015ca:[<0x100000016ae/13-26.c v384>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015ca:[<0x100000016ae/13-26.c v827>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.701 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.579+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015e7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-54.c auth v817 ap=1 s=904 n(v0 rc2005-06-03T16:35:29.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544773600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015e7:[<0x100000016ae/4-54.c v442>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015e7:[<0x100000016ae/4-54.c v817>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.702 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.579+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001674 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-26.c auth v821 ap=1 s=1488 n(v0 rc2005-06-03T16:35:17.000000+0000 b1488 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544775700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001674:[<0x100000016ae/2-26.c v724>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001674:[<0x100000016ae/2-26.c v821>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.702 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.579+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001689 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-12.c auth v901 ap=1 s=2181 n(v0 rc2005-06-03T16:34:58.000000+0000 b2181 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554477a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001689:[<0x100000016ae/17-12.c v766>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001689:[<0x100000016ae/17-12.c v901>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.702 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.580+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001515 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-16.c auth v875 ap=1 s=4222 n(v0 rc2005-06-03T16:35:01.000000+0000 b4222 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544774c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001515:[<0x100000016ae/19-16.c v170>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001515:[<0x100000016ae/19-16.c v875>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.702 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.580+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001612 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-28.c auth v867 ap=1 s=1989 n(v0 rc2005-06-03T16:35:29.000000+0000 b1989 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554477b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001612:[<0x100000016ae/4-28.c v528>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001612:[<0x100000016ae/4-28.c v867>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.702 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.580+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015b5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-11.c auth v861 ap=1 s=3873 n(v0 rc2005-06-03T16:34:59.000000+0000 b3873 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554477a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015b5:[<0x100000016ae/18-11.c v342>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015b5:[<0x100000016ae/18-11.c v861>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.702 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.580+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000153d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-16.c auth v885 ap=1 s=4336 n(v0 rc2005-06-03T16:35:19.000000+0000 b4336 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554477b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000153d:[<0x100000016ae/23-16.c v250>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000153d:[<0x100000016ae/23-16.c v885>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.702 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.581+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001533 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-36.c auth v915 ap=1 s=1773 n(v0 rc2005-06-03T16:34:55.000000+0000 b1773 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554477c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001533:[<0x100000016ae/12-36.c v230>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001533:[<0x100000016ae/12-36.c v915>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.702 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.581+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000152b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-27.c auth v813 ap=1 s=1989 n(v0 rc2005-06-03T16:35:29.000000+0000 b1989 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554477d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000152b:[<0x100000016ae/4-27.c v214>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000152b:[<0x100000016ae/4-27.c v813>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.702 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.581+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001669 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-5.c auth v907 ap=1 s=1902 n(v0 rc2005-06-03T16:35:29.000000+0000 b1902 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554477d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001669:[<0x100000016ae/4-5.c v702>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001669:[<0x100000016ae/4-5.c v907>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.702 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.582+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001686 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-18.c auth v823 ap=1 s=1681 n(v0 rc2005-06-03T16:35:46.000000+0000 b1681 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544786000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001686:[<0x100000016ae/8-18.c v760>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001686:[<0x100000016ae/8-18.c v823>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.702 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.582+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-50.c auth v883 ap=1 s=1997 n(v0 rc2005-06-03T16:35:29.000000+0000 b1997 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544787080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d1:[<0x100000016ae/4-50.c v30>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000014d1:[<0x100000016ae/4-50.c v883>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.702 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.582+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001679 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-78.c auth v819 ap=1 s=904 n(v0 rc2005-06-03T16:35:31.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544787b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001679:[<0x100000016ae/4-78.c v734>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001679:[<0x100000016ae/4-78.c v819>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.702 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.583+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001517 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-19.c auth v855 ap=1 s=3873 n(v0 rc2005-06-03T16:34:59.000000+0000 b3873 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544788100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001517:[<0x100000016ae/18-19.c v174>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001517:[<0x100000016ae/18-19.c v855>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.703 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.583+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001630 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-76.c auth v919 ap=1 s=908 n(v0 rc2005-06-03T16:35:31.000000+0000 b908 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544788c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001630:[<0x100000016ae/4-76.c v588>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001630:[<0x100000016ae/4-76.c v919>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.703 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.583+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001600 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-100.c auth v889 ap=1 s=904 n(v0 rc2005-06-03T16:35:28.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554479c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001600:[<0x100000016ae/4-100.c v492>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001600:[<0x100000016ae/4-100.c v889>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.703 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.583+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000015e0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-18.c auth v879 ap=1 s=2501 n(v0 rc2005-06-03T16:35:18.000000+0000 b2501 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544789700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000015e0:[<0x100000016ae/22-18.c v428>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x100000015e0:[<0x100000016ae/22-18.c v879>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.703 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.583+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001684 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-104.c auth v895 ap=1 s=904 n(v0 rc2005-06-03T16:35:29.000000+0000 b904 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554479c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001684:[<0x100000016ae/4-104.c v756>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x10000001684:[<0x100000016ae/4-104.c v895>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.703 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.584+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000164e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-31.c auth v917 ap=1 s=1773 n(v0 rc2005-06-03T16:34:53.000000+0000 b1773 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554479cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000164e:[<0x100000016ae/12-31.c v648>,<0x100000013f1/sigaction v3676>,<0x100000012df/interfaces v256>,<0x100000012dd/conformance v26>,<0x10000000204/open_posix_testsuite v454>,<0x10000000202/testcases v18>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v17>,<0x10000000005/tmp v11>,<0x100000001fb/client.0 v10>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v26>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v38>,<0x1/volumes v35>]//[]","memoryvalue":"(3)0x1000000164e:[<0x100000016ae/12-31.c v917>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.703 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.584+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/2-1.sh auth v10 ap=1 s=504 n(v0 rc2005-06-03T16:32:42.000000+0000 b504 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56554461b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a8:[<0x1000000141e/2-1.sh v10>,<0x100000013f1/pthread_rwlockattr_setpshared v2506>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012a8:[<0x1000000141e/2-1.sh v10>,<0x100000013f1/pthread_rwlockattr_setpshared v3628>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.703 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.584+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/1-1.c auth v14 ap=1 s=2340 n(v0 rc2005-06-03T16:32:42.000000+0000 b2340 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56554461b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a6:[<0x1000000141e/1-1.c v4>,<0x100000013f1/pthread_rwlockattr_setpshared v2506>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012a6:[<0x1000000141e/1-1.c v14>,<0x100000013f1/pthread_rwlockattr_setpshared v3628>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.703 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.584+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000012a7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/assertions.xml auth v16 ap=1 s=607 n(v0 rc2005-06-03T16:32:42.000000+0000 b607 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544636580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000012a7:[<0x1000000141e/assertions.xml v6>,<0x100000013f1/pthread_rwlockattr_setpshared v2506>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000012a7:[<0x1000000141e/assertions.xml v16>,<0x100000013f1/pthread_rwlockattr_setpshared v3628>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.703 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.584+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014de [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_17-1.in auth v44 ap=1 s=2191 n(v0 rc2005-06-03T16:35:50.000000+0000 b2191 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449fb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014de:[<0x100000016b0/template_17-1.in v28>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014de:[<0x100000016b0/template_17-1.in v44>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.703 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.585+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000141f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/coverage.txt auth v12 ap=1 s=123 n(v0 rc2024-01-25T15:03:12.982703+0000 b123 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544636000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000141f:[<0x1000000141e/coverage.txt v12>,<0x100000013f1/pthread_rwlockattr_setpshared v2506>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000141f:[<0x1000000141e/coverage.txt v12>,<0x100000013f1/pthread_rwlockattr_setpshared v3628>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.703 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.585+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-1.in auth v58 ap=1 s=1910 n(v0 rc2005-06-03T16:35:50.000000+0000 b1910 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a04000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e0:[<0x100000016b0/template_4-1.in v32>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014e0:[<0x100000016b0/template_4-1.in v58>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.703 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.585+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-1.in auth v80 ap=1 s=2013 n(v0 rc2005-06-03T16:35:50.000000+0000 b2013 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x5655449fb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e1:[<0x100000016b0/template_12-1.in v34>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014e1:[<0x100000016b0/template_12-1.in v80>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.704 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.585+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000016b1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_28-1.in auth v70 ap=1 s=6212 n(v0 rc2024-01-25T15:03:13.547690+0000 b6212 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a04580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000016b1:[<0x100000016b0/template_28-1.in v2>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000016b1:[<0x100000016b0/template_28-1.in v70>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.704 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.585+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_13-1.in auth v60 ap=1 s=1728 n(v0 rc2005-06-03T16:35:50.000000+0000 b1728 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a05080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d7:[<0x100000016b0/template_13-1.in v14>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014d7:[<0x100000016b0/template_13-1.in v60>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.704 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.586+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_3-1.in auth v62 ap=1 s=1535 n(v0 rc2005-06-03T16:35:50.000000+0000 b1535 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a05600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d8:[<0x100000016b0/template_3-1.in v16>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014d8:[<0x100000016b0/template_3-1.in v62>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.704 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.586+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_23-1.in auth v74 ap=1 s=4350 n(v0 rc2005-06-03T16:35:50.000000+0000 b4350 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a05b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d4:[<0x100000016b0/template_23-1.in v8>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014d4:[<0x100000016b0/template_23-1.in v74>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.704 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.586+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_18-1.in auth v78 ap=1 s=3883 n(v0 rc2005-06-03T16:35:50.000000+0000 b3883 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a04b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e2:[<0x100000016b0/template_18-1.in v36>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014e2:[<0x100000016b0/template_18-1.in v78>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.704 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.586+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_16-1.in auth v46 ap=1 s=5518 n(v0 rc2005-06-03T16:35:50.000000+0000 b5518 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a06100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d5:[<0x100000016b0/template_16-1.in v10>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014d5:[<0x100000016b0/template_16-1.in v46>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.704 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.586+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014da [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_19-1.in auth v64 ap=1 s=4232 n(v0 rc2005-06-03T16:35:50.000000+0000 b4232 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a06680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014da:[<0x100000016b0/template_19-1.in v20>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014da:[<0x100000016b0/template_19-1.in v64>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.704 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.586+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_2-1.in auth v52 ap=1 s=1496 n(v0 rc2005-06-03T16:35:50.000000+0000 b1496 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a06c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d3:[<0x100000016b0/template_2-1.in v6>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014d3:[<0x100000016b0/template_2-1.in v52>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.704 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.587+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014dd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_8-1.in auth v68 ap=1 s=1718 n(v0 rc2005-06-03T16:35:50.000000+0000 b1718 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a07180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014dd:[<0x100000016b0/template_8-1.in v26>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014dd:[<0x100000016b0/template_8-1.in v68>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.704 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.587+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014df [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_6-1.in auth v76 ap=1 s=1339 n(v0 rc2005-06-03T16:35:50.000000+0000 b1339 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a07700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014df:[<0x100000016b0/template_6-1.in v30>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014df:[<0x100000016b0/template_6-1.in v76>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.704 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.587+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014db [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_1-1.in auth v50 ap=1 s=1484 n(v0 rc2005-06-03T16:35:50.000000+0000 b1484 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a14000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014db:[<0x100000016b0/template_1-1.in v22>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014db:[<0x100000016b0/template_1-1.in v50>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.704 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.587+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014dc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-4.in auth v72 ap=1 s=908 n(v0 rc2005-06-03T16:35:50.000000+0000 b908 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a14580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014dc:[<0x100000016b0/template_4-4.in v24>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014dc:[<0x100000016b0/template_4-4.in v72>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.705 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.587+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-2.in auth v42 ap=1 s=1997 n(v0 rc2005-06-03T16:35:50.000000+0000 b1997 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a14b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e3:[<0x100000016b0/template_4-2.in v38>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014e3:[<0x100000016b0/template_4-2.in v42>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.705 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.588+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014e4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-2.in auth v56 ap=1 s=1779 n(v0 rc2005-06-03T16:35:50.000000+0000 b1779 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a15080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014e4:[<0x100000016b0/template_12-2.in v40>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014e4:[<0x100000016b0/template_12-2.in v56>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.705 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.588+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_25-1.in auth v48 ap=1 s=2468 n(v0 rc2005-06-03T16:35:50.000000+0000 b2468 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a15600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d9:[<0x100000016b0/template_25-1.in v18>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014d9:[<0x100000016b0/template_25-1.in v48>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.705 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.588+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-3.in auth v54 ap=1 s=908 n(v0 rc2005-06-03T16:35:50.000000+0000 b908 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a16100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d6:[<0x100000016b0/template_4-3.in v12>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014d6:[<0x100000016b0/template_4-3.in v54>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.705 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.588+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000014d2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_22-1.in auth v66 ap=1 s=2519 n(v0 rc2005-06-03T16:35:50.000000+0000 b2519 1=1+0) (iversion lock) caps={24803=pAsLsXsFsc/-@1},l=24803(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544a15b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000014d2:[<0x100000016b0/template_22-1.in v4>,<0x100000016ae/templates v770>,<0x100000013f1/sigaction v2346>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000014d2:[<0x100000016b0/template_22-1.in v66>,<0x100000016ae/templates v963>,<0x100000013f1/sigaction v6542>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.705 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.589+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bcc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/cases.sh auth v30 ap=1 s=2672 n(v0 rc2024-01-25T15:03:11.139746+0000 b2672 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544665600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bcc:[<0x10000000bc9/cases.sh v30>,<0x10000000abf/panic_npcc v70>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000bcc:[<0x10000000bc9/cases.sh v30>,<0x10000000abf/panic_npcc v135>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.705 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.592+0000 7f9548939700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bca [...2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/ auth{3=1} v40 ap=3 RANDEPHEMERALPIN f(v0 m2024-01-25T15:03:11.135746+0000 8=8+0) n(v0 rc2024-01-25T15:03:11.135746+0000 b933 9=8+1) (idft sync r=1) (inest sync r=1) (ifile sync->mix g=3 r=1 scatter_wanted) (iversion lock) caps={24803=pAsLsXs/pAsLsXsFsxcral@3} | lock=3 importingcaps=0 dirfrag=1 caps=1 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 randepin 0x565544665b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000bca:[<0x10000000bc9/data v34>,<0x10000000abf/panic_npcc v70>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(2)0x10000000bca:[<0x10000000bc9/data v40>,<0x10000000abf/panic_npcc v135>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-01-25T15:03:11.135746+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2024-01-25T15:03:11.135746+0000 b933 9=8+1)","memory_value.dirstat":"f(v0 m2024-01-25T15:03:11.135746+0000 8=8+0)","memory_value.rstat":"n(v0 rc2024-01-25T15:03:11.135746+0000 b933 9=8+1)","error_str":""},"return_code":0} 2024-01-25T15:03:37.983 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.614+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e28 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/sensor_factors_000.cpp auth v26 ap=1 s=2467 n(v0 rc2007-06-25T15:44:56.000000+0000 b2467 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544638c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e28:[<0x10000000f60/sensor_factors_000.cpp v8>,<0x10000000f5e/t v280>,<0x10000000f57/ipmidirect v1008>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000e28:[<0x10000000f60/sensor_factors_000.cpp v26>,<0x10000000f5e/t v280>,<0x10000000f57/ipmidirect v1297>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.984 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.614+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e27 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/thread_000.cpp auth v18 ap=1 s=1304 n(v0 rc2007-06-25T15:44:56.000000+0000 b1304 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544638680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e27:[<0x10000000f60/thread_000.cpp v18>,<0x10000000f5e/t v280>,<0x10000000f57/ipmidirect v1008>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000e27:[<0x10000000f60/thread_000.cpp v18>,<0x10000000f5e/t v280>,<0x10000000f57/ipmidirect v1297>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.984 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.589+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bcb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_eripv_timeout auth v26 ap=1 s=91 n(v0 rc2009-08-22T17:27:06.000000+0000 b91 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5612726a0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bcb:[<0x10000000bca/uc_no_eripv_timeout v26>,<0x10000000bc9/data v34>,<0x10000000abf/panic_npcc v70>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000bcb:[<0x10000000bca/uc_no_eripv_timeout v26>,<0x10000000bc9/data v40>,<0x10000000abf/panic_npcc v135>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.984 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.589+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000974 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_mcip_timeout auth v22 ap=1 s=76 n(v0 rc2009-08-22T17:27:06.000000+0000 b76 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5612726a1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000974:[<0x10000000bca/uc_no_mcip_timeout v22>,<0x10000000bc9/data v34>,<0x10000000abf/panic_npcc v70>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000974:[<0x10000000bca/uc_no_mcip_timeout v22>,<0x10000000bc9/data v40>,<0x10000000abf/panic_npcc v135>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.984 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.614+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e29 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_001.c auth v20 ap=1 s=8785 n(v0 rc2007-06-25T15:44:56.000000+0000 b8785 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544639700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e29:[<0x10000000f60/con_001.c v20>,<0x10000000f5e/t v280>,<0x10000000f57/ipmidirect v1008>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000e29:[<0x10000000f60/con_001.c v20>,<0x10000000f5e/t v280>,<0x10000000f57/ipmidirect v1297>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.985 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.615+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e2a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.in auth v16 ap=1 s=23602 n(v0 rc2009-12-03T15:31:00.000000+0000 b23602 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544639180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e2a:[<0x10000000f60/Makefile.in v16>,<0x10000000f5e/t v280>,<0x10000000f57/ipmidirect v1008>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000e2a:[<0x10000000f60/Makefile.in v16>,<0x10000000f5e/t v280>,<0x10000000f57/ipmidirect v1297>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.985 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.589+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000977 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_eripv auth v24 ap=1 s=79 n(v0 rc2009-08-22T17:27:06.000000+0000 b79 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5612726a1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000977:[<0x10000000bca/uc_no_eripv v24>,<0x10000000bc9/data v34>,<0x10000000abf/panic_npcc v70>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000977:[<0x10000000bca/uc_no_eripv v24>,<0x10000000bc9/data v40>,<0x10000000abf/panic_npcc v135>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.985 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.590+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000975 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_mcip auth v32 ap=1 s=64 n(v0 rc2009-08-22T17:27:06.000000+0000 b64 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127269fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000975:[<0x10000000bca/uc_no_mcip v10>,<0x10000000bc9/data v34>,<0x10000000abf/panic_npcc v70>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000975:[<0x10000000bca/uc_no_mcip v32>,<0x10000000bc9/data v40>,<0x10000000abf/panic_npcc v135>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.985 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.615+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e2b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.am auth v22 ap=1 s=1825 n(v0 rc2008-07-26T03:51:45.000000+0000 b1825 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544644000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e2b:[<0x10000000f60/Makefile.am v22>,<0x10000000f5e/t v280>,<0x10000000f57/ipmidirect v1008>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000e2b:[<0x10000000f60/Makefile.am v22>,<0x10000000f5e/t v280>,<0x10000000f57/ipmidirect v1297>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.985 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.615+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f61 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/test.h auth v24 ap=1 s=484 n(v0 rc2024-01-25T15:03:12.155723+0000 b484 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544644580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f61:[<0x10000000f60/test.h v2>,<0x10000000f5e/t v280>,<0x10000000f57/ipmidirect v1008>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f61:[<0x10000000f60/test.h v24>,<0x10000000f5e/t v280>,<0x10000000f57/ipmidirect v1297>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.986 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.590+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000973 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/fatal_severity auth v28 ap=1 s=297 n(v0 rc2009-08-22T17:27:06.000000+0000 b297 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5612726a0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000973:[<0x10000000bca/fatal_severity v28>,<0x10000000bc9/data v34>,<0x10000000abf/panic_npcc v70>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000973:[<0x10000000bca/fatal_severity v28>,<0x10000000bc9/data v40>,<0x10000000abf/panic_npcc v135>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.986 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.590+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000976 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/unknown auth v18 ap=1 s=59 n(v0 rc2009-08-22T17:27:06.000000+0000 b59 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127269f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000976:[<0x10000000bca/unknown v18>,<0x10000000bc9/data v34>,<0x10000000abf/panic_npcc v70>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000976:[<0x10000000bca/unknown v18>,<0x10000000bc9/data v40>,<0x10000000abf/panic_npcc v135>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.986 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.615+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000e26 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_000.cpp auth v28 ap=1 s=4983 n(v0 rc2007-06-25T15:44:55.000000+0000 b4983 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544644b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000e26:[<0x10000000f60/con_000.cpp v4>,<0x10000000f5e/t v280>,<0x10000000f57/ipmidirect v1008>,<0x10000000bed/plugins v724>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000e26:[<0x10000000f60/con_000.cpp v28>,<0x10000000f5e/t v280>,<0x10000000f57/ipmidirect v1297>,<0x10000000bed/plugins v1127>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.986 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.672+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000753 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend14 auth v90 ap=1 s=2465 n(v0 rc2008-10-06T03:30:39.000000+0000 b2465 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5655445f0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000753:[<0x10000000956/tcp4-uni-smallsend14 v90>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000753:[<0x10000000956/tcp4-uni-smallsend14 v90>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.986 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.590+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000972 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uncorrected auth v20 ap=1 s=127 n(v0 rc2009-08-22T17:27:06.000000+0000 b127 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127269f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000972:[<0x10000000bca/uncorrected v20>,<0x10000000bc9/data v34>,<0x10000000abf/panic_npcc v70>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000972:[<0x10000000bca/uncorrected v20>,<0x10000000bc9/data v40>,<0x10000000abf/panic_npcc v135>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.987 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.590+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000978 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uncorrected_timeout auth v30 ap=1 s=140 n(v0 rc2009-08-22T17:27:06.000000+0000 b140 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272682000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000978:[<0x10000000bca/uncorrected_timeout v16>,<0x10000000bc9/data v34>,<0x10000000abf/panic_npcc v70>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000978:[<0x10000000bca/uncorrected_timeout v30>,<0x10000000bc9/data v40>,<0x10000000abf/panic_npcc v135>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.987 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.672+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend03 auth v76 ap=1 s=2438 n(v0 rc2008-10-06T03:30:39.000000+0000 b2438 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5655445f0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000075c:[<0x10000000956/tcp4-uni-smallsend03 v76>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000075c:[<0x10000000956/tcp4-uni-smallsend03 v76>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.987 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.673+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000754 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend13 auth v66 ap=1 s=2505 n(v0 rc2008-10-06T03:30:39.000000+0000 b2505 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5655445f0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000754:[<0x10000000956/tcp6-uni-smallsend13 v66>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000754:[<0x10000000956/tcp6-uni-smallsend13 v66>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.987 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.669+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000085f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport02 auth v60 ap=1 s=2498 n(v0 rc2008-10-06T03:30:39.000000+0000 b2498 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272625700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000085f:[<0x10000000a66/udp4-multi-diffport02 v60>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000085f:[<0x10000000a66/udp4-multi-diffport02 v60>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.987 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.669+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport01 auth v50 ap=1 s=2356 n(v0 rc2008-10-06T03:30:40.000000+0000 b2356 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086b:[<0x10000000a66/udp6-multi-diffport01 v50>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000086b:[<0x10000000a66/udp6-multi-diffport01 v50>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.988 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.673+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000756 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend01 auth v70 ap=1 s=2875 n(v0 rc2008-10-06T03:30:39.000000+0000 b2875 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5655445efb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000756:[<0x10000000956/tcp4-uni-smallsend01 v70>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000756:[<0x10000000956/tcp4-uni-smallsend01 v70>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.988 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.673+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend08 auth v106 ap=1 s=2403 n(v0 rc2008-10-06T03:30:39.000000+0000 b2403 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5655445f1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000075b:[<0x10000000956/tcp6-uni-smallsend08 v106>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000075b:[<0x10000000956/tcp6-uni-smallsend08 v106>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.988 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.669+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000860 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport05 auth v40 ap=1 s=2496 n(v0 rc2024-01-25T15:03:10.914752+0000 b2496 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000860:[<0x10000000a66/udp4-multi-diffport05 v40>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000860:[<0x10000000a66/udp4-multi-diffport05 v40>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.988 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.669+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000085e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport05 auth v48 ap=1 s=2496 n(v0 rc2008-10-06T03:30:40.000000+0000 b2496 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000085e:[<0x10000000a66/udp6-multi-diffport05 v48>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000085e:[<0x10000000a66/udp6-multi-diffport05 v48>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.988 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.673+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend05 auth v72 ap=1 s=2440 n(v0 rc2008-10-06T03:30:39.000000+0000 b2440 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5655445f1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000075d:[<0x10000000956/tcp4-uni-smallsend05 v72>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000075d:[<0x10000000956/tcp4-uni-smallsend05 v72>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.989 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.673+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000750 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend02 auth v62 ap=1 s=2444 n(v0 rc2008-10-06T03:30:39.000000+0000 b2444 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544606580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000750:[<0x10000000956/tcp4-uni-smallsend02 v62>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000750:[<0x10000000956/tcp4-uni-smallsend02 v62>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.989 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.670+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport04 auth v62 ap=1 s=2500 n(v0 rc2008-10-06T03:30:40.000000+0000 b2500 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086a:[<0x10000000a66/udp4-multi-diffport04 v62>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000086a:[<0x10000000a66/udp4-multi-diffport04 v62>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.989 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.670+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000866 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport02 auth v38 ap=1 s=2498 n(v0 rc2008-10-06T03:30:40.000000+0000 b2498 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000866:[<0x10000000a66/udp6-multi-diffport02 v38>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000866:[<0x10000000a66/udp6-multi-diffport02 v38>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.989 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.673+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000760 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend13 auth v102 ap=1 s=2471 n(v0 rc2008-10-06T03:30:39.000000+0000 b2471 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544606b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000760:[<0x10000000956/tcp4-uni-smallsend13 v102>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000760:[<0x10000000956/tcp4-uni-smallsend13 v102>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.989 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.674+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend08 auth v104 ap=1 s=2371 n(v0 rc2008-10-06T03:30:39.000000+0000 b2371 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544607080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000075f:[<0x10000000956/tcp4-uni-smallsend08 v104>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000075f:[<0x10000000956/tcp4-uni-smallsend08 v104>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.990 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.670+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000863 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport07 auth v42 ap=1 s=2493 n(v0 rc2008-10-06T03:30:40.000000+0000 b2493 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000863:[<0x10000000a66/udp6-multi-diffport07 v42>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000863:[<0x10000000a66/udp6-multi-diffport07 v42>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.990 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.670+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a67 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport03 auth v46 ap=1 s=2494 n(v0 rc2024-01-25T15:03:10.913752+0000 b2494 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000a67:[<0x10000000a66/udp6-multi-diffport03 v46>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000a67:[<0x10000000a66/udp6-multi-diffport03 v46>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.990 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.674+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000751 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/00_Descriptions.txt auth v100 ap=1 s=1709 n(v0 rc2024-01-25T15:03:10.739756+0000 b1709 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544607b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000751:[<0x10000000956/00_Descriptions.txt v100>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000751:[<0x10000000956/00_Descriptions.txt v100>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.990 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.674+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000758 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend14 auth v78 ap=1 s=2499 n(v0 rc2008-10-06T03:30:39.000000+0000 b2499 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544607600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000758:[<0x10000000956/tcp6-uni-smallsend14 v78>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000758:[<0x10000000956/tcp6-uni-smallsend14 v78>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.990 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.671+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000864 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/00_Descriptions.txt auth v44 ap=1 s=820 n(v0 rc2005-10-24T20:18:24.000000+0000 b820 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000864:[<0x10000000a66/00_Descriptions.txt v44>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000864:[<0x10000000a66/00_Descriptions.txt v44>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.991 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.671+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000861 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/Makefile auth v34 ap=1 s=1058 n(v0 rc2009-10-11T01:40:43.000000+0000 b1058 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000861:[<0x10000000a66/Makefile v34>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000861:[<0x10000000a66/Makefile v34>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.991 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.674+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000074e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/Makefile auth v84 ap=1 s=1057 n(v0 rc2009-10-11T01:40:43.000000+0000 b1057 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544608100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000074e:[<0x10000000956/Makefile v84>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000074e:[<0x10000000956/Makefile v84>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.991 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.674+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000748 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend11 auth v116 ap=1 s=2472 n(v0 rc2008-10-06T03:30:39.000000+0000 b2472 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544608680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000748:[<0x10000000956/tcp4-uni-smallsend11 v116>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000748:[<0x10000000956/tcp4-uni-smallsend11 v116>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.991 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.671+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000867 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport06 auth v52 ap=1 s=2501 n(v0 rc2008-10-06T03:30:40.000000+0000 b2501 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000867:[<0x10000000a66/udp4-multi-diffport06 v52>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000867:[<0x10000000a66/udp4-multi-diffport06 v52>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.991 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.671+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000865 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport06 auth v56 ap=1 s=2501 n(v0 rc2008-10-06T03:30:40.000000+0000 b2501 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000865:[<0x10000000a66/udp6-multi-diffport06 v56>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000865:[<0x10000000a66/udp6-multi-diffport06 v56>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.992 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.674+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend10 auth v98 ap=1 s=2498 n(v0 rc2008-10-06T03:30:39.000000+0000 b2498 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544608c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000075e:[<0x10000000956/tcp6-uni-smallsend10 v98>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000075e:[<0x10000000956/tcp6-uni-smallsend10 v98>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.992 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.675+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000074f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend10 auth v64 ap=1 s=2464 n(v0 rc2008-10-06T03:30:39.000000+0000 b2464 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544609180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000074f:[<0x10000000956/tcp4-uni-smallsend10 v64>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000074f:[<0x10000000956/tcp4-uni-smallsend10 v64>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.992 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.675+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000761 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend09 auth v112 ap=1 s=2504 n(v0 rc2008-10-06T03:30:39.000000+0000 b2504 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544609700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000761:[<0x10000000956/tcp6-uni-smallsend09 v112>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000761:[<0x10000000956/tcp6-uni-smallsend09 v112>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.992 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.675+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000755 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend12 auth v110 ap=1 s=2500 n(v0 rc2008-10-06T03:30:39.000000+0000 b2500 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56554460e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000755:[<0x10000000956/tcp6-uni-smallsend12 v110>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000755:[<0x10000000956/tcp6-uni-smallsend12 v110>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.992 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.671+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000862 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport01 auth v36 ap=1 s=9779 n(v0 rc2008-10-06T18:58:58.000000+0000 b9779 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5612724fa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000862:[<0x10000000a66/udp4-multi-diffport01 v36>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000862:[<0x10000000a66/udp4-multi-diffport01 v36>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.992 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.671+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000869 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport04 auth v58 ap=1 s=2500 n(v0 rc2008-10-06T03:30:40.000000+0000 b2500 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000869:[<0x10000000a66/udp6-multi-diffport04 v58>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000869:[<0x10000000a66/udp6-multi-diffport04 v58>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.993 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.675+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000749 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend06 auth v92 ap=1 s=2445 n(v0 rc2008-10-06T03:30:39.000000+0000 b2445 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56554460e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000749:[<0x10000000956/tcp4-uni-smallsend06 v92>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000749:[<0x10000000956/tcp4-uni-smallsend06 v92>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.993 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.675+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000757 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend05 auth v108 ap=1 s=2474 n(v0 rc2008-10-06T03:30:39.000000+0000 b2474 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56554460eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000757:[<0x10000000956/tcp6-uni-smallsend05 v108>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000757:[<0x10000000956/tcp6-uni-smallsend05 v108>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.993 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.672+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000086c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport07 auth v64 ap=1 s=2493 n(v0 rc2008-10-06T03:30:40.000000+0000 b2493 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x56127262e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000086c:[<0x10000000a66/udp4-multi-diffport07 v32>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000086c:[<0x10000000a66/udp4-multi-diffport07 v64>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.993 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:37.672+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000868 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport03 auth v54 ap=1 s=2494 n(v0 rc2008-10-06T03:30:39.000000+0000 b2494 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56127262eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000868:[<0x10000000a66/udp4-multi-diffport03 v54>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v474>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000868:[<0x10000000a66/udp4-multi-diffport03 v54>,<0x10000000a65/multi-diffport v256>,<0x10000000839/udp v543>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.994 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.675+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000745 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend09 auth v86 ap=1 s=2470 n(v0 rc2008-10-06T03:30:39.000000+0000 b2470 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56554460f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000745:[<0x10000000956/tcp4-uni-smallsend09 v86>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000745:[<0x10000000956/tcp4-uni-smallsend09 v86>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.994 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.676+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000074c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend11 auth v114 ap=1 s=2506 n(v0 rc2008-10-06T03:30:39.000000+0000 b2506 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56554460fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000074c:[<0x10000000956/tcp6-uni-smallsend11 v114>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000074c:[<0x10000000956/tcp6-uni-smallsend11 v114>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.994 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.676+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000747 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend06 auth v88 ap=1 s=2479 n(v0 rc2008-10-06T03:30:39.000000+0000 b2479 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x56554460f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000747:[<0x10000000956/tcp6-uni-smallsend06 v88>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000747:[<0x10000000956/tcp6-uni-smallsend06 v88>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.994 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.676+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000074b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend04 auth v118 ap=1 s=2446 n(v0 rc2008-10-06T03:30:39.000000+0000 b2446 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544610100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000074b:[<0x10000000956/tcp4-uni-smallsend04 v16>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000074b:[<0x10000000956/tcp4-uni-smallsend04 v118>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.994 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.676+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000074d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend01 auth v94 ap=1 s=2377 n(v0 rc2008-10-06T03:30:39.000000+0000 b2377 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544610680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000074d:[<0x10000000956/tcp6-uni-smallsend01 v94>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000074d:[<0x10000000956/tcp6-uni-smallsend01 v94>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.994 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.676+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000759 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend02 auth v96 ap=1 s=2478 n(v0 rc2008-10-06T03:30:39.000000+0000 b2478 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544610c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000759:[<0x10000000956/tcp6-uni-smallsend02 v96>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000759:[<0x10000000956/tcp6-uni-smallsend02 v96>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.995 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.677+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000074a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend07 auth v68 ap=1 s=2439 n(v0 rc2008-10-06T03:30:39.000000+0000 b2439 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544611180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000074a:[<0x10000000956/tcp4-uni-smallsend07 v68>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000074a:[<0x10000000956/tcp4-uni-smallsend07 v68>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.995 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.677+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000957 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend12 auth v80 ap=1 s=2466 n(v0 rc2024-01-25T15:03:10.738756+0000 b2466 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544611700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000957:[<0x10000000956/tcp4-uni-smallsend12 v80>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000957:[<0x10000000956/tcp4-uni-smallsend12 v80>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.995 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.677+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000746 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend03 auth v74 ap=1 s=2472 n(v0 rc2008-10-06T03:30:39.000000+0000 b2472 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544618580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000746:[<0x10000000956/tcp6-uni-smallsend03 v74>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000746:[<0x10000000956/tcp6-uni-smallsend03 v74>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.995 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.677+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000075a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend07 auth v120 ap=1 s=2473 n(v0 rc2008-10-06T03:30:39.000000+0000 b2473 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x565544618000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000075a:[<0x10000000956/tcp6-uni-smallsend07 v46>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000075a:[<0x10000000956/tcp6-uni-smallsend07 v120>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:37.995 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:37.677+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000752 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend04 auth v82 ap=1 s=2480 n(v0 rc2008-10-06T03:30:39.000000+0000 b2480 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x565544618b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000752:[<0x10000000956/tcp6-uni-smallsend04 v82>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000752:[<0x10000000956/tcp6-uni-smallsend04 v82>,<0x10000000851/uni-smallsend v1280>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.104 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.646+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d63 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_005.c auth v36 ap=1 s=1283 n(v0 rc2007-06-25T15:53:27.000000+0000 b1283 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4613080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d63:[<0x10000000f4a/uid_utils_005.c v36>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000d63:[<0x10000000f4a/uid_utils_005.c v36>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.104 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.646+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f4b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_006.c auth v50 ap=1 s=1198 n(v0 rc2024-01-25T15:03:12.026726+0000 b1198 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4613b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f4b:[<0x10000000f4a/uid_utils_006.c v2>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000f4b:[<0x10000000f4a/uid_utils_006.c v50>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.105 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.680+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007bc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip01 auth v78 ap=1 s=2491 n(v0 rc2008-10-06T03:30:35.000000+0000 b2491 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea298680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007bc:[<0x1000000095e/tcp6-multi-diffip01 v78>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007bc:[<0x1000000095e/tcp6-multi-diffip01 v78>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.105 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.680+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip02 auth v62 ap=1 s=2566 n(v0 rc2008-10-06T03:30:35.000000+0000 b2566 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea298c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c4:[<0x1000000095e/tcp6-multi-diffip02 v62>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007c4:[<0x1000000095e/tcp6-multi-diffip02 v62>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.105 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.646+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d5d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_010.c auth v38 ap=1 s=966 n(v0 rc2007-06-25T15:53:27.000000+0000 b966 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4614680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d5d:[<0x10000000f4a/uid_utils_010.c v38>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000d5d:[<0x10000000f4a/uid_utils_010.c v38>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.105 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.646+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d5f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_003.c auth v44 ap=1 s=1244 n(v0 rc2007-06-25T15:53:27.000000+0000 b1244 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4613600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d5f:[<0x10000000f4a/uid_utils_003.c v44>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000d5f:[<0x10000000f4a/uid_utils_003.c v44>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.106 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.681+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007bf [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip03 auth v102 ap=1 s=2560 n(v0 rc2008-10-06T03:30:35.000000+0000 b2560 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea299180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007bf:[<0x1000000095e/tcp6-multi-diffip03 v102>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007bf:[<0x1000000095e/tcp6-multi-diffip03 v102>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.106 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.681+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip05 auth v76 ap=1 s=2562 n(v0 rc2008-10-06T03:30:35.000000+0000 b2562 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea299700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007d5:[<0x1000000095e/tcp4-multi-diffip05 v76>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007d5:[<0x1000000095e/tcp4-multi-diffip05 v76>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.106 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.646+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d59 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_002.c auth v52 ap=1 s=1307 n(v0 rc2007-06-25T15:53:27.000000+0000 b1307 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4614100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d59:[<0x10000000f4a/uid_utils_002.c v4>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000d59:[<0x10000000f4a/uid_utils_002.c v52>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.106 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.647+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d64 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_011.c auth v56 ap=1 s=980 n(v0 rc2007-06-25T15:53:28.000000+0000 b980 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4614c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d64:[<0x10000000f4a/uid_utils_011.c v26>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000d64:[<0x10000000f4a/uid_utils_011.c v56>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.107 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.681+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip14 auth v96 ap=1 s=2556 n(v0 rc2008-10-06T03:30:35.000000+0000 b2556 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2b0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c2:[<0x1000000095e/tcp6-multi-diffip14 v96>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007c2:[<0x1000000095e/tcp6-multi-diffip14 v96>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.107 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.682+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip13 auth v74 ap=1 s=2562 n(v0 rc2008-10-06T03:30:35.000000+0000 b2562 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2b0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c1:[<0x1000000095e/tcp4-multi-diffip13 v74>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007c1:[<0x1000000095e/tcp4-multi-diffip13 v74>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.107 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.647+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d60 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_001.c auth v60 ap=1 s=997 n(v0 rc2007-06-25T15:53:27.000000+0000 b997 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4615180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d60:[<0x10000000f4a/uid_utils_001.c v18>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000d60:[<0x10000000f4a/uid_utils_001.c v60>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.107 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.647+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d65 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_013.c auth v58 ap=1 s=1029 n(v0 rc2007-06-25T15:53:28.000000+0000 b1029 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4615700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d65:[<0x10000000f4a/uid_utils_013.c v28>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000d65:[<0x10000000f4a/uid_utils_013.c v58>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.107 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.682+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007bd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip04 auth v66 ap=1 s=2568 n(v0 rc2008-10-06T03:30:35.000000+0000 b2568 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2b1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007bd:[<0x1000000095e/tcp4-multi-diffip04 v66>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007bd:[<0x1000000095e/tcp4-multi-diffip04 v66>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.108 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.682+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007bb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip02 auth v106 ap=1 s=2566 n(v0 rc2008-10-06T03:30:35.000000+0000 b2566 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2b1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007bb:[<0x1000000095e/tcp4-multi-diffip02 v106>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007bb:[<0x1000000095e/tcp4-multi-diffip02 v106>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.108 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.647+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d61 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_000.c auth v48 ap=1 s=1015 n(v0 rc2007-06-25T15:53:27.000000+0000 b1015 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4622000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d61:[<0x10000000f4a/uid_utils_000.c v20>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000d61:[<0x10000000f4a/uid_utils_000.c v48>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.108 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.647+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d62 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/Makefile.in auth v40 ap=1 s=28407 n(v0 rc2009-12-03T15:31:02.000000+0000 b28407 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4622580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d62:[<0x10000000f4a/Makefile.in v40>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000d62:[<0x10000000f4a/Makefile.in v40>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.108 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.647+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d5a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_009.c auth v46 ap=1 s=978 n(v0 rc2007-06-25T15:53:27.000000+0000 b978 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4622b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d5a:[<0x10000000f4a/uid_utils_009.c v46>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000d5a:[<0x10000000f4a/uid_utils_009.c v46>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.108 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.647+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d66 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_004.c auth v42 ap=1 s=1332 n(v0 rc2007-06-25T15:53:27.000000+0000 b1332 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4623080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d66:[<0x10000000f4a/uid_utils_004.c v42>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000d66:[<0x10000000f4a/uid_utils_004.c v42>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.109 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.682+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007cd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip07 auth v100 ap=1 s=2561 n(v0 rc2008-10-06T03:30:35.000000+0000 b2561 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2b1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007cd:[<0x1000000095e/tcp6-multi-diffip07 v100>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007cd:[<0x1000000095e/tcp6-multi-diffip07 v100>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.109 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.682+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ca [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip12 auth v120 ap=1 s=2557 n(v0 rc2008-10-06T03:30:35.000000+0000 b2557 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2b2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ca:[<0x1000000095e/tcp4-multi-diffip12 v38>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007ca:[<0x1000000095e/tcp4-multi-diffip12 v120>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.109 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.647+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d5c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_008.c auth v62 ap=1 s=861 n(v0 rc2007-06-25T15:53:27.000000+0000 b861 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4623600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d5c:[<0x10000000f4a/uid_utils_008.c v10>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000d5c:[<0x10000000f4a/uid_utils_008.c v62>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.109 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.648+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d5b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_012.c auth v64 ap=1 s=1023 n(v0 rc2007-06-25T15:53:28.000000+0000 b1023 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4623b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d5b:[<0x10000000f4a/uid_utils_012.c v8>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000d5b:[<0x10000000f4a/uid_utils_012.c v64>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.110 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.683+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ba [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip06 auth v64 ap=1 s=2567 n(v0 rc2008-10-06T03:30:35.000000+0000 b2567 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2b2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ba:[<0x1000000095e/tcp6-multi-diffip06 v64>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007ba:[<0x1000000095e/tcp6-multi-diffip06 v64>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.110 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.683+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007be [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip12 auth v80 ap=1 s=2557 n(v0 rc2008-10-06T03:30:35.000000+0000 b2557 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2b2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007be:[<0x1000000095e/tcp6-multi-diffip12 v80>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007be:[<0x1000000095e/tcp6-multi-diffip12 v80>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.110 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.648+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d67 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/Makefile.am auth v34 ap=1 s=2519 n(v0 rc2008-07-26T03:51:50.000000+0000 b2519 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4624100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d67:[<0x10000000f4a/Makefile.am v34>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000d67:[<0x10000000f4a/Makefile.am v34>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.110 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.648+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000d5e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_007.c auth v54 ap=1 s=1298 n(v0 rc2007-06-25T15:53:27.000000+0000 b1298 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4624680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000d5e:[<0x10000000f4a/uid_utils_007.c v14>,<0x10000000bfb/uid v2574>,<0x10000000bf9/t v114>,<0x10000000bed/utils v810>,<0x10000000204/open_hpi_testsuite v415>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000d5e:[<0x10000000f4a/uid_utils_007.c v54>,<0x10000000bfb/uid v2896>,<0x10000000bf9/t v139>,<0x10000000bed/utils v1134>,<0x10000000204/open_hpi_testsuite v1097>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.110 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.664+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld02 auth v50 ap=1 s=6510 n(v0 rc2008-10-06T03:30:34.000000+0000 b6510 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d1a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000067b:[<0x10000000849/mcast4-queryfld02 v50>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v450>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000067b:[<0x10000000849/mcast4-queryfld02 v50>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v549>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.111 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.664+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld06 auth v34 ap=1 s=6796 n(v0 rc2008-10-06T03:30:34.000000+0000 b6796 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d1ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000067e:[<0x10000000849/mcast6-queryfld06 v34>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v450>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000067e:[<0x10000000849/mcast6-queryfld06 v34>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v549>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.111 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.683+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007cc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip14 auth v118 ap=1 s=2556 n(v0 rc2008-10-06T03:30:35.000000+0000 b2556 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2b3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007cc:[<0x1000000095e/tcp4-multi-diffip14 v118>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007cc:[<0x1000000095e/tcp4-multi-diffip14 v118>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.111 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.684+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000095f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip09 auth v94 ap=1 s=2561 n(v0 rc2024-01-25T15:03:10.840753+0000 b2561 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2b3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000095f:[<0x1000000095e/tcp4-multi-diffip09 v94>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000095f:[<0x1000000095e/tcp4-multi-diffip09 v94>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.111 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.664+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000676 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld03 auth v48 ap=1 s=6576 n(v0 rc2008-10-06T03:30:34.000000+0000 b6576 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d1a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000676:[<0x10000000849/mcast6-queryfld03 v48>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v450>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000676:[<0x10000000849/mcast6-queryfld03 v48>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v549>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.111 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.664+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000681 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld06 auth v52 ap=1 s=6932 n(v0 rc2008-10-06T03:30:34.000000+0000 b6932 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d1b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000681:[<0x10000000849/mcast4-queryfld06 v52>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v450>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000681:[<0x10000000849/mcast4-queryfld06 v52>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v549>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.112 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.684+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/00_Descriptions.txt auth v112 ap=1 s=1699 n(v0 rc2005-10-24T20:18:23.000000+0000 b1699 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2b8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c7:[<0x1000000095e/00_Descriptions.txt v112>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007c7:[<0x1000000095e/00_Descriptions.txt v112>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.112 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.684+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip07 auth v68 ap=1 s=2561 n(v0 rc2008-10-06T03:30:35.000000+0000 b2561 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2b8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007d2:[<0x1000000095e/tcp4-multi-diffip07 v68>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007d2:[<0x1000000095e/tcp4-multi-diffip07 v68>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.112 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.664+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000679 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld05 auth v36 ap=1 s=6684 n(v0 rc2008-10-06T03:30:34.000000+0000 b6684 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d1b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000679:[<0x10000000849/mcast6-queryfld05 v36>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v450>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000679:[<0x10000000849/mcast6-queryfld05 v36>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v549>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.112 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.664+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000677 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld05 auth v38 ap=1 s=6793 n(v0 rc2008-10-06T03:30:34.000000+0000 b6793 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4772000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000677:[<0x10000000849/mcast4-queryfld05 v38>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v450>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000677:[<0x10000000849/mcast4-queryfld05 v38>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v549>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.113 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.684+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip03 auth v92 ap=1 s=2560 n(v0 rc2008-10-06T03:30:35.000000+0000 b2560 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2b8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c0:[<0x1000000095e/tcp4-multi-diffip03 v92>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007c0:[<0x1000000095e/tcp4-multi-diffip03 v92>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.113 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.685+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip06 auth v114 ap=1 s=2567 n(v0 rc2008-10-06T03:30:35.000000+0000 b2567 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2b9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c8:[<0x1000000095e/tcp4-multi-diffip06 v114>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007c8:[<0x1000000095e/tcp4-multi-diffip06 v114>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.113 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.665+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/00_Descriptions.txt auth v32 ap=1 s=2225 n(v0 rc2006-09-11T19:31:52.000000+0000 b2225 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4772580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000067d:[<0x10000000849/00_Descriptions.txt v32>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v450>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000067d:[<0x10000000849/00_Descriptions.txt v32>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v549>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.113 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.665+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld01 auth v42 ap=1 s=6242 n(v0 rc2008-10-06T03:30:34.000000+0000 b6242 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4773080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000067a:[<0x10000000849/mcast6-queryfld01 v42>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v450>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000067a:[<0x10000000849/mcast6-queryfld01 v42>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v549>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.114 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.665+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/Makefile auth v30 ap=1 s=1053 n(v0 rc2009-10-09T17:56:06.000000+0000 b1053 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4772b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000067c:[<0x10000000849/Makefile v30>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v450>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000067c:[<0x10000000849/Makefile v30>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v549>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.114 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.665+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000682 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld04 auth v40 ap=1 s=6351 n(v0 rc2008-10-06T03:30:34.000000+0000 b6351 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4773600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000682:[<0x10000000849/mcast6-queryfld04 v40>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v450>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000682:[<0x10000000849/mcast6-queryfld04 v40>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v549>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.114 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.665+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000067f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld03 auth v46 ap=1 s=6661 n(v0 rc2008-10-06T03:30:34.000000+0000 b6661 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4773b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000067f:[<0x10000000849/mcast4-queryfld03 v46>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v450>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000067f:[<0x10000000849/mcast4-queryfld03 v46>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v549>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.114 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.685+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/Makefile auth v104 ap=1 s=1056 n(v0 rc2009-10-11T01:40:42.000000+0000 b1056 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2b9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c3:[<0x1000000095e/Makefile v104>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007c3:[<0x1000000095e/Makefile v104>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.114 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.685+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip04 auth v108 ap=1 s=2568 n(v0 rc2008-10-06T03:30:35.000000+0000 b2568 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2b9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c6:[<0x1000000095e/tcp6-multi-diffip04 v108>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007c6:[<0x1000000095e/tcp6-multi-diffip04 v108>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.114 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.665+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000680 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld04 auth v44 ap=1 s=6450 n(v0 rc2024-01-25T15:03:10.577760+0000 b6450 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4774100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000680:[<0x10000000849/mcast4-queryfld04 v44>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v450>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000680:[<0x10000000849/mcast4-queryfld04 v44>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v549>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.114 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.665+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000084a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld01 auth v56 ap=1 s=6340 n(v0 rc2024-01-25T15:03:10.576760+0000 b6340 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4774680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000084a:[<0x10000000849/mcast4-queryfld01 v56>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v450>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000084a:[<0x10000000849/mcast4-queryfld01 v56>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v549>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.115 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.685+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip11 auth v82 ap=1 s=2563 n(v0 rc2008-10-06T03:30:35.000000+0000 b2563 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2ba100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007d4:[<0x1000000095e/tcp4-multi-diffip11 v82>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007d4:[<0x1000000095e/tcp4-multi-diffip11 v82>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.115 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.686+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip10 auth v72 ap=1 s=2555 n(v0 rc2008-10-06T03:30:35.000000+0000 b2555 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2ba680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007d1:[<0x1000000095e/tcp4-multi-diffip10 v72>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007d1:[<0x1000000095e/tcp4-multi-diffip10 v72>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.115 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.665+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000678 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld02 auth v54 ap=1 s=6408 n(v0 rc2008-10-06T03:30:34.000000+0000 b6408 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4774c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000678:[<0x10000000849/mcast6-queryfld02 v54>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v450>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000678:[<0x10000000849/mcast6-queryfld02 v54>,<0x10000000846/query-flood v126>,<0x10000000839/multicast v549>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.115 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.679+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff04 auth v64 ap=1 s=2469 n(v0 rc2008-10-06T03:30:39.000000+0000 b2469 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d00100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b2:[<0x1000000095c/tcp6-uni-sackoff04 v64>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007b2:[<0x1000000095c/tcp6-uni-sackoff04 v64>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.116 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.686+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007cb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip09 auth v116 ap=1 s=2561 n(v0 rc2008-10-06T03:30:35.000000+0000 b2561 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2bac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007cb:[<0x1000000095e/tcp6-multi-diffip09 v116>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007cb:[<0x1000000095e/tcp6-multi-diffip09 v116>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.116 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.686+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip01 auth v70 ap=1 s=12926 n(v0 rc2008-10-06T18:58:57.000000+0000 b12926 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2bb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007d3:[<0x1000000095e/tcp4-multi-diffip01 v70>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007d3:[<0x1000000095e/tcp4-multi-diffip01 v70>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.116 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.680+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff10 auth v66 ap=1 s=2453 n(v0 rc2008-10-06T03:30:39.000000+0000 b2453 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d01700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a6:[<0x1000000095c/tcp4-uni-sackoff10 v66>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007a6:[<0x1000000095c/tcp4-uni-sackoff10 v66>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.116 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.680+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff11 auth v96 ap=1 s=2461 n(v0 rc2008-10-06T03:30:39.000000+0000 b2461 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d00680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a2:[<0x1000000095c/tcp4-uni-sackoff11 v96>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007a2:[<0x1000000095c/tcp4-uni-sackoff11 v96>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.117 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.680+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff03 auth v102 ap=1 s=2428 n(v0 rc2008-10-06T03:30:39.000000+0000 b2428 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d00c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b1:[<0x1000000095c/tcp4-uni-sackoff03 v102>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007b1:[<0x1000000095c/tcp4-uni-sackoff03 v102>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.117 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.681+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000079d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff06 auth v116 ap=1 s=2435 n(v0 rc2008-10-06T03:30:39.000000+0000 b2435 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4d01180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000079d:[<0x1000000095c/tcp4-uni-sackoff06 v6>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000079d:[<0x1000000095c/tcp4-uni-sackoff06 v116>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.117 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.686+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ce [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip08 auth v90 ap=1 s=2486 n(v0 rc2008-10-06T03:30:35.000000+0000 b2486 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2bb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ce:[<0x1000000095e/tcp4-multi-diffip08 v90>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007ce:[<0x1000000095e/tcp4-multi-diffip08 v90>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.117 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.686+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip11 auth v84 ap=1 s=2563 n(v0 rc2008-10-06T03:30:35.000000+0000 b2563 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2c0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c5:[<0x1000000095e/tcp6-multi-diffip11 v84>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007c5:[<0x1000000095e/tcp6-multi-diffip11 v84>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.117 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.687+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007d0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip05 auth v98 ap=1 s=2562 n(v0 rc2008-10-06T03:30:35.000000+0000 b2562 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2c0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007d0:[<0x1000000095e/tcp6-multi-diffip05 v98>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007d0:[<0x1000000095e/tcp6-multi-diffip05 v98>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.117 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.681+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000095d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff14 auth v88 ap=1 s=2454 n(v0 rc2024-01-25T15:03:10.816754+0000 b2454 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d06000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000095d:[<0x1000000095c/tcp4-uni-sackoff14 v88>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000095d:[<0x1000000095c/tcp4-uni-sackoff14 v88>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.118 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.681+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000079c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff02 auth v106 ap=1 s=2434 n(v0 rc2008-10-06T03:30:39.000000+0000 b2434 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d06b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000079c:[<0x1000000095c/tcp4-uni-sackoff02 v106>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000079c:[<0x1000000095c/tcp4-uni-sackoff02 v106>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.118 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.687+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip08 auth v110 ap=1 s=2486 n(v0 rc2008-10-06T03:30:35.000000+0000 b2486 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2c0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b9:[<0x1000000095e/tcp6-multi-diffip08 v110>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007b9:[<0x1000000095e/tcp6-multi-diffip08 v110>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.118 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.687+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007c9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip10 auth v88 ap=1 s=2555 n(v0 rc2008-10-06T03:30:35.000000+0000 b2555 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2c1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007c9:[<0x1000000095e/tcp6-multi-diffip10 v88>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007c9:[<0x1000000095e/tcp6-multi-diffip10 v88>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.118 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:37.687+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007cf [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip13 auth v86 ap=1 s=2562 n(v0 rc2008-10-06T03:30:35.000000+0000 b2562 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2c1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007cf:[<0x1000000095e/tcp6-multi-diffip13 v86>,<0x10000000851/multi-diffip v1284>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007cf:[<0x1000000095e/tcp6-multi-diffip13 v86>,<0x10000000851/multi-diffip v1350>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.136 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.682+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff11 auth v62 ap=1 s=2495 n(v0 rc2008-10-06T03:30:39.000000+0000 b2495 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d07080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a4:[<0x1000000095c/tcp6-uni-sackoff11 v62>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007a4:[<0x1000000095c/tcp6-uni-sackoff11 v62>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.136 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.682+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007aa [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff05 auth v80 ap=1 s=2430 n(v0 rc2008-10-06T03:30:39.000000+0000 b2430 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d06580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007aa:[<0x1000000095c/tcp4-uni-sackoff05 v80>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007aa:[<0x1000000095c/tcp4-uni-sackoff05 v80>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.136 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.682+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff03 auth v78 ap=1 s=2461 n(v0 rc2008-10-06T03:30:39.000000+0000 b2461 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d07600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b4:[<0x1000000095c/tcp6-uni-sackoff03 v78>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007b4:[<0x1000000095c/tcp6-uni-sackoff03 v78>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.136 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.683+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007af [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff01 auth v74 ap=1 s=3140 n(v0 rc2008-10-06T03:30:39.000000+0000 b3140 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d07b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007af:[<0x1000000095c/tcp4-uni-sackoff01 v74>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007af:[<0x1000000095c/tcp4-uni-sackoff01 v74>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.136 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.683+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff10 auth v112 ap=1 s=2487 n(v0 rc2008-10-06T03:30:39.000000+0000 b2487 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d08100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a3:[<0x1000000095c/tcp6-uni-sackoff10 v112>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007a3:[<0x1000000095c/tcp6-uni-sackoff10 v112>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.136 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.683+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000079e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff02 auth v108 ap=1 s=2467 n(v0 rc2008-10-06T03:30:39.000000+0000 b2467 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d08680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000079e:[<0x1000000095c/tcp6-uni-sackoff02 v108>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000079e:[<0x1000000095c/tcp6-uni-sackoff02 v108>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.136 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.683+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/00_Descriptions.txt auth v84 ap=1 s=1803 n(v0 rc2005-10-24T20:18:23.000000+0000 b1803 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d08c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a8:[<0x1000000095c/00_Descriptions.txt v84>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007a8:[<0x1000000095c/00_Descriptions.txt v84>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.136 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.684+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff09 auth v82 ap=1 s=2493 n(v0 rc2008-10-06T03:30:39.000000+0000 b2493 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d09180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a0:[<0x1000000095c/tcp6-uni-sackoff09 v82>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007a0:[<0x1000000095c/tcp6-uni-sackoff09 v82>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.136 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.684+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ae [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff14 auth v90 ap=1 s=2488 n(v0 rc2008-10-06T03:30:39.000000+0000 b2488 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d09700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ae:[<0x1000000095c/tcp6-uni-sackoff14 v90>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007ae:[<0x1000000095c/tcp6-uni-sackoff14 v90>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.137 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.684+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/Makefile auth v72 ap=1 s=1055 n(v0 rc2009-10-11T01:40:43.000000+0000 b1055 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4606000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a7:[<0x1000000095c/Makefile v72>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007a7:[<0x1000000095c/Makefile v72>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.137 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.685+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff12 auth v100 ap=1 s=2489 n(v0 rc2008-10-06T03:30:39.000000+0000 b2489 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4606580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b7:[<0x1000000095c/tcp6-uni-sackoff12 v100>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007b7:[<0x1000000095c/tcp6-uni-sackoff12 v100>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.137 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.685+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff05 auth v94 ap=1 s=2463 n(v0 rc2008-10-06T03:30:39.000000+0000 b2463 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4606b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b3:[<0x1000000095c/tcp6-uni-sackoff05 v94>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007b3:[<0x1000000095c/tcp6-uni-sackoff05 v94>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.137 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.685+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ac [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff13 auth v114 ap=1 s=2460 n(v0 rc2008-10-06T03:30:39.000000+0000 b2460 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4607080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ac:[<0x1000000095c/tcp4-uni-sackoff13 v114>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007ac:[<0x1000000095c/tcp4-uni-sackoff13 v114>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.137 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.686+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff09 auth v98 ap=1 s=2459 n(v0 rc2024-01-25T15:03:10.817754+0000 b2459 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4607600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a5:[<0x1000000095c/tcp4-uni-sackoff09 v98>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007a5:[<0x1000000095c/tcp4-uni-sackoff09 v98>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.137 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.686+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff04 auth v76 ap=1 s=2436 n(v0 rc2008-10-06T03:30:39.000000+0000 b2436 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4607b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b8:[<0x1000000095c/tcp4-uni-sackoff04 v76>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007b8:[<0x1000000095c/tcp4-uni-sackoff04 v76>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.137 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.686+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ad [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff01 auth v70 ap=1 s=2366 n(v0 rc2008-10-06T03:30:39.000000+0000 b2366 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4608100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ad:[<0x1000000095c/tcp6-uni-sackoff01 v70>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007ad:[<0x1000000095c/tcp6-uni-sackoff01 v70>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.137 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.686+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000079f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff06 auth v118 ap=1 s=2468 n(v0 rc2008-10-06T03:30:39.000000+0000 b2468 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4608680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000079f:[<0x1000000095c/tcp6-uni-sackoff06 v10>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000079f:[<0x1000000095c/tcp6-uni-sackoff06 v118>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.137 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.686+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff08 auth v68 ap=1 s=2392 n(v0 rc2008-10-06T03:30:39.000000+0000 b2392 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4608c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a1:[<0x1000000095c/tcp6-uni-sackoff08 v68>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007a1:[<0x1000000095c/tcp6-uni-sackoff08 v68>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.137 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.687+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff12 auth v92 ap=1 s=2455 n(v0 rc2008-10-06T03:30:39.000000+0000 b2455 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4609180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b0:[<0x1000000095c/tcp4-uni-sackoff12 v92>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007b0:[<0x1000000095c/tcp4-uni-sackoff12 v92>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.137 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.687+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff07 auth v86 ap=1 s=2428 n(v0 rc2008-10-06T03:30:39.000000+0000 b2428 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4609700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b5:[<0x1000000095c/tcp4-uni-sackoff07 v86>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007b5:[<0x1000000095c/tcp4-uni-sackoff07 v86>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.137 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.687+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007b6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff08 auth v110 ap=1 s=2358 n(v0 rc2008-10-06T03:30:39.000000+0000 b2358 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4612000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007b6:[<0x1000000095c/tcp4-uni-sackoff08 v110>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007b6:[<0x1000000095c/tcp4-uni-sackoff08 v110>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.138 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.687+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007ab [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff07 auth v120 ap=1 s=2462 n(v0 rc2008-10-06T03:30:39.000000+0000 b2462 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4612b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007ab:[<0x1000000095c/tcp6-uni-sackoff07 v34>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007ab:[<0x1000000095c/tcp6-uni-sackoff07 v120>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.138 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.687+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000007a9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff13 auth v104 ap=1 s=2494 n(v0 rc2008-10-06T03:30:39.000000+0000 b2494 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4612580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000007a9:[<0x1000000095c/tcp6-uni-sackoff13 v104>,<0x10000000851/uni-sackoff v1304>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000007a9:[<0x1000000095c/tcp6-uni-sackoff13 v104>,<0x10000000851/uni-sackoff v1354>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.138 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.688+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000069d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff10 auth v94 ap=1 s=2459 n(v0 rc2024-01-25T15:03:10.624758+0000 b2459 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4775180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000069d:[<0x10000000852/tcp4-uni-dsackoff10 v94>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000069d:[<0x10000000852/tcp4-uni-dsackoff10 v94>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.138 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.688+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000069b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff03 auth v66 ap=1 s=2433 n(v0 rc2008-10-06T03:30:39.000000+0000 b2433 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4775700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000069b:[<0x10000000852/tcp4-uni-dsackoff03 v66>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000069b:[<0x10000000852/tcp4-uni-dsackoff03 v66>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.138 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.688+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff05 auth v116 ap=1 s=2469 n(v0 rc2008-10-06T03:30:39.000000+0000 b2469 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad48f6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a5:[<0x10000000852/tcp6-uni-dsackoff05 v116>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006a5:[<0x10000000852/tcp6-uni-dsackoff05 v116>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.138 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.688+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000696 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff09 auth v62 ap=1 s=2499 n(v0 rc2008-10-06T03:30:39.000000+0000 b2499 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad48f6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000696:[<0x10000000852/tcp6-uni-dsackoff09 v62>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000696:[<0x10000000852/tcp6-uni-dsackoff09 v62>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.138 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.688+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff12 auth v120 ap=1 s=2495 n(v0 rc2008-10-06T03:30:39.000000+0000 b2495 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad48f6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a9:[<0x10000000852/tcp6-uni-dsackoff12 v44>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006a9:[<0x10000000852/tcp6-uni-dsackoff12 v120>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.138 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.688+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ac [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff14 auth v74 ap=1 s=2494 n(v0 rc2008-10-06T03:30:39.000000+0000 b2494 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad48f7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006ac:[<0x10000000852/tcp6-uni-dsackoff14 v74>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006ac:[<0x10000000852/tcp6-uni-dsackoff14 v74>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.138 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.689+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ae [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff02 auth v84 ap=1 s=2439 n(v0 rc2008-10-06T03:30:39.000000+0000 b2439 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad48f7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006ae:[<0x10000000852/tcp4-uni-dsackoff02 v84>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006ae:[<0x10000000852/tcp4-uni-dsackoff02 v84>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.138 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.689+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff07 auth v70 ap=1 s=2468 n(v0 rc2008-10-06T03:30:39.000000+0000 b2468 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad48f7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a2:[<0x10000000852/tcp6-uni-dsackoff07 v70>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006a2:[<0x10000000852/tcp6-uni-dsackoff07 v70>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.138 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.689+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000698 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff13 auth v64 ap=1 s=2500 n(v0 rc2008-10-06T03:30:39.000000+0000 b2500 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad48f8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000698:[<0x10000000852/tcp6-uni-dsackoff13 v64>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000698:[<0x10000000852/tcp6-uni-dsackoff13 v64>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.138 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.689+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ab [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff08 auth v82 ap=1 s=2398 n(v0 rc2008-10-06T03:30:39.000000+0000 b2398 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad48f8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006ab:[<0x10000000852/tcp6-uni-dsackoff08 v82>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006ab:[<0x10000000852/tcp6-uni-dsackoff08 v82>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.139 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.689+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006af [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff08 auth v76 ap=1 s=2364 n(v0 rc2008-10-06T03:30:39.000000+0000 b2364 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad48f8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006af:[<0x10000000852/tcp4-uni-dsackoff08 v76>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006af:[<0x10000000852/tcp4-uni-dsackoff08 v76>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.139 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.689+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000697 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff02 auth v88 ap=1 s=2473 n(v0 rc2008-10-06T03:30:39.000000+0000 b2473 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad48f9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000697:[<0x10000000852/tcp6-uni-dsackoff02 v88>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000697:[<0x10000000852/tcp6-uni-dsackoff02 v88>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.139 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.690+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/00_Descriptions.txt auth v78 ap=1 s=1790 n(v0 rc2005-10-24T20:18:23.000000+0000 b1790 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad48f9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a1:[<0x10000000852/00_Descriptions.txt v78>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006a1:[<0x10000000852/00_Descriptions.txt v78>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.139 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.690+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/Makefile auth v106 ap=1 s=1056 n(v0 rc2009-10-11T01:40:43.000000+0000 b1056 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4892000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a0:[<0x10000000852/Makefile v106>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006a0:[<0x10000000852/Makefile v106>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.139 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.690+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff11 auth v108 ap=1 s=2501 n(v0 rc2008-10-06T03:30:39.000000+0000 b2501 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4892580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a8:[<0x10000000852/tcp6-uni-dsackoff11 v108>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006a8:[<0x10000000852/tcp6-uni-dsackoff11 v108>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.139 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.690+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000699 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff01 auth v112 ap=1 s=3105 n(v0 rc2008-10-06T03:30:38.000000+0000 b3105 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4892b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000699:[<0x10000000852/tcp4-uni-dsackoff01 v112>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000699:[<0x10000000852/tcp4-uni-dsackoff01 v112>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.139 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.690+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000069a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff09 auth v68 ap=1 s=2465 n(v0 rc2008-10-06T03:30:39.000000+0000 b2465 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4893080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000069a:[<0x10000000852/tcp4-uni-dsackoff09 v68>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000069a:[<0x10000000852/tcp4-uni-dsackoff09 v68>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.139 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.691+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000069e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff05 auth v98 ap=1 s=2435 n(v0 rc2008-10-06T03:30:39.000000+0000 b2435 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4893600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000069e:[<0x10000000852/tcp4-uni-dsackoff05 v98>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000069e:[<0x10000000852/tcp4-uni-dsackoff05 v98>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.139 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.691+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ad [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff03 auth v72 ap=1 s=2467 n(v0 rc2008-10-06T03:30:39.000000+0000 b2467 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4893b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006ad:[<0x10000000852/tcp6-uni-dsackoff03 v72>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006ad:[<0x10000000852/tcp6-uni-dsackoff03 v72>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.139 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.691+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000069f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff04 auth v104 ap=1 s=2475 n(v0 rc2008-10-06T03:30:39.000000+0000 b2475 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4894100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000069f:[<0x10000000852/tcp6-uni-dsackoff04 v104>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000069f:[<0x10000000852/tcp6-uni-dsackoff04 v104>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.139 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.691+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff07 auth v96 ap=1 s=2434 n(v0 rc2008-10-06T03:30:39.000000+0000 b2434 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4894680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a7:[<0x10000000852/tcp4-uni-dsackoff07 v96>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006a7:[<0x10000000852/tcp4-uni-dsackoff07 v96>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.140 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.691+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006b0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff06 auth v92 ap=1 s=2474 n(v0 rc2008-10-06T03:30:39.000000+0000 b2474 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4894c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006b0:[<0x10000000852/tcp6-uni-dsackoff06 v92>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006b0:[<0x10000000852/tcp6-uni-dsackoff06 v92>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.140 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.691+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff11 auth v118 ap=1 s=2467 n(v0 rc2008-10-06T03:30:39.000000+0000 b2467 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4895180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a3:[<0x10000000852/tcp4-uni-dsackoff11 v32>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006a3:[<0x10000000852/tcp4-uni-dsackoff11 v118>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.140 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.691+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000069c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff04 auth v114 ap=1 s=2441 n(v0 rc2008-10-06T03:30:39.000000+0000 b2441 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4895700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000069c:[<0x10000000852/tcp4-uni-dsackoff04 v114>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000069c:[<0x10000000852/tcp4-uni-dsackoff04 v114>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.140 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.692+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff12 auth v80 ap=1 s=2461 n(v0 rc2008-10-06T03:30:39.000000+0000 b2461 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4cfe000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a4:[<0x10000000852/tcp4-uni-dsackoff12 v80>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006a4:[<0x10000000852/tcp4-uni-dsackoff12 v80>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.140 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.692+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006b1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff01 auth v110 ap=1 s=2372 n(v0 rc2008-10-06T03:30:39.000000+0000 b2372 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4cfe580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006b1:[<0x10000000852/tcp6-uni-dsackoff01 v110>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006b1:[<0x10000000852/tcp6-uni-dsackoff01 v110>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.140 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.692+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000853 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff14 auth v86 ap=1 s=2460 n(v0 rc2024-01-25T15:03:10.623758+0000 b2460 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4cfeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000853:[<0x10000000852/tcp4-uni-dsackoff14 v86>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000853:[<0x10000000852/tcp4-uni-dsackoff14 v86>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.140 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.692+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006a6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff10 auth v102 ap=1 s=2493 n(v0 rc2008-10-06T03:30:39.000000+0000 b2493 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4cff080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006a6:[<0x10000000852/tcp6-uni-dsackoff10 v102>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006a6:[<0x10000000852/tcp6-uni-dsackoff10 v102>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.140 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.692+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000695 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff06 auth v90 ap=1 s=2440 n(v0 rc2008-10-06T03:30:39.000000+0000 b2440 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4cff600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000695:[<0x10000000852/tcp4-uni-dsackoff06 v90>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000695:[<0x10000000852/tcp4-uni-dsackoff06 v90>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.140 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.692+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006aa [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff13 auth v100 ap=1 s=2466 n(v0 rc2008-10-06T03:30:39.000000+0000 b2466 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4cffb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006aa:[<0x10000000852/tcp4-uni-dsackoff13 v100>,<0x10000000851/uni-dsackoff v1296>,<0x10000000839/tcp v502>,<0x10000000414/stress v301>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006aa:[<0x10000000852/tcp4-uni-dsackoff13 v100>,<0x10000000851/uni-dsackoff v1352>,<0x10000000839/tcp v551>,<0x10000000414/stress v508>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.141 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.711+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000510 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.stress.sh auth v442 ap=1 s=3692 n(v0 rc2008-03-20T11:54:27.000000+0000 b3692 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d50580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000510:[<0x1000000072c/tirpc_simple_rpc_call.stress.sh v442>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000510:[<0x1000000072c/tirpc_simple_rpc_call.stress.sh v442>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.141 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.711+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000531 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.stress.sh auth v402 ap=1 s=3707 n(v0 rc2008-03-20T11:54:23.000000+0000 b3707 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d50000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000531:[<0x1000000072c/rpc_addrmanagmt_pmap_rmtcall.stress.sh v402>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000531:[<0x1000000072c/rpc_addrmanagmt_pmap_rmtcall.stress.sh v402>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.141 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.711+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_weakauth.sh auth v436 ap=1 s=3674 n(v0 rc2008-03-20T11:54:26.000000+0000 b3674 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d50b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000047d:[<0x1000000072c/tirpc_err_svcerr_weakauth.sh v436>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000047d:[<0x1000000072c/tirpc_err_svcerr_weakauth.sh v436>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.141 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.711+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_bufcreate.limits.sh auth v426 ap=1 s=2816 n(v0 rc2008-03-20T11:54:23.000000+0000 b2816 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d51080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b3:[<0x1000000072c/rpc_createdestroy_clntudp_bufcreate.limits.sh v426>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004b3:[<0x1000000072c/rpc_createdestroy_clntudp_bufcreate.limits.sh v426>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.141 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.712+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.sh auth v414 ap=1 s=3673 n(v0 rc2008-03-20T11:54:25.000000+0000 b3673 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d51600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004fd:[<0x1000000072c/tirpc_bottomlevel_clnt_call.sh v414>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004fd:[<0x1000000072c/tirpc_bottomlevel_clnt_call.sh v414>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.141 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.712+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.stress.sh auth v406 ap=1 s=3752 n(v0 rc2008-03-20T11:54:27.000000+0000 b3752 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d51b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e1:[<0x1000000072c/tirpc_toplevel_clnt_call.stress.sh v406>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004e1:[<0x1000000072c/tirpc_toplevel_clnt_call.stress.sh v406>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.141 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.712+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004be [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_pcreateerror.sh auth v404 ap=1 s=2787 n(v0 rc2008-03-20T11:54:25.000000+0000 b2787 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d52100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004be:[<0x1000000072c/tirpc_err_clnt_pcreateerror.sh v404>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004be:[<0x1000000072c/tirpc_err_clnt_pcreateerror.sh v404>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.141 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.712+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_control.sh auth v420 ap=1 s=3151 n(v0 rc2024-01-25T15:03:10.301766+0000 b3151 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d52680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c6:[<0x1000000072c/rpc_stdcall_clnt_control.sh v420>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004c6:[<0x1000000072c/rpc_stdcall_clnt_control.sh v420>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.141 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.712+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.stress.sh auth v408 ap=1 s=2808 n(v0 rc2008-03-20T11:54:23.000000+0000 b2808 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d52c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005e4:[<0x1000000072c/rpc_createdestroy_clntudp_create.stress.sh v408>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005e4:[<0x1000000072c/rpc_createdestroy_clntudp_create.stress.sh v408>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.141 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.713+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svc_destroy.sh auth v400 ap=1 s=2781 n(v0 rc2008-03-20T11:54:23.000000+0000 b2781 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d53180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000048b:[<0x1000000072c/rpc_createdestroy_svc_destroy.sh v400>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000048b:[<0x1000000072c/rpc_createdestroy_svc_destroy.sh v400>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.141 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.713+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.performance.sh auth v440 ap=1 s=3383 n(v0 rc2008-03-20T11:54:24.000000+0000 b3383 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d53700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000049e:[<0x1000000072c/rpc_createdestroy_svcudp_create.performance.sh v440>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000049e:[<0x1000000072c/rpc_createdestroy_svcudp_create.performance.sh v440>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.141 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.713+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000501 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_progvers.sh auth v434 ap=1 s=3674 n(v0 rc2008-03-20T11:54:26.000000+0000 b3674 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d3a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000501:[<0x1000000072c/tirpc_err_svcerr_progvers.sh v434>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000501:[<0x1000000072c/tirpc_err_svcerr_progvers.sh v434>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.142 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.713+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000505 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.stress.sh auth v412 ap=1 s=2805 n(v0 rc2008-03-20T11:54:24.000000+0000 b2805 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d3a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000505:[<0x1000000072c/rpc_createdestroy_svcudp_create.stress.sh v412>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000505:[<0x1000000072c/rpc_createdestroy_svcudp_create.stress.sh v412>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.142 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.713+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.stress.sh auth v446 ap=1 s=2791 n(v0 rc2008-03-20T11:54:26.000000+0000 b2791 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4d3ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f3:[<0x1000000072c/tirpc_expertlevel_svc_reg.stress.sh v242>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004f3:[<0x1000000072c/tirpc_expertlevel_svc_reg.stress.sh v446>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.142 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.714+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ce [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.sh auth v428 ap=1 s=3688 n(v0 rc2008-03-20T11:54:26.000000+0000 b3688 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d3b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ce:[<0x1000000072c/tirpc_expertlevel_rpcb_rmtcall.sh v428>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004ce:[<0x1000000072c/tirpc_expertlevel_rpcb_rmtcall.sh v428>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.142 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.714+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_tli_create.sh auth v418 ap=1 s=3182 n(v0 rc2008-03-20T11:54:26.000000+0000 b3182 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d3b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a7:[<0x1000000072c/tirpc_expertlevel_clnt_tli_create.sh v418>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004a7:[<0x1000000072c/tirpc_expertlevel_clnt_tli_create.sh v418>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.142 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.714+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000520 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcfd_create.limits.sh auth v396 ap=1 s=2801 n(v0 rc2008-03-20T11:54:23.000000+0000 b2801 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d3bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000520:[<0x1000000072c/rpc_createdestroy_svcfd_create.limits.sh v396>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000520:[<0x1000000072c/rpc_createdestroy_svcfd_create.limits.sh v396>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.142 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.714+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000490 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.complex.sh auth v394 ap=1 s=3012 n(v0 rc2008-03-20T11:54:27.000000+0000 b3012 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d3c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000490:[<0x1000000072c/tirpc_toplevel_clnt_call.complex.sh v394>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000490:[<0x1000000072c/tirpc_toplevel_clnt_call.complex.sh v394>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.142 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.714+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.performance.sh auth v444 ap=1 s=3364 n(v0 rc2008-03-20T11:54:27.000000+0000 b3364 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d3c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004bd:[<0x1000000072c/tirpc_toplevel_clnt_call.performance.sh v444>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004bd:[<0x1000000072c/tirpc_toplevel_clnt_call.performance.sh v444>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.142 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.714+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.complex.sh auth v448 ap=1 s=2810 n(v0 rc2008-03-20T11:54:23.000000+0000 b2810 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4d3cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f5:[<0x1000000072c/rpc_createdestroy_clntraw_create.complex.sh v246>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004f5:[<0x1000000072c/rpc_createdestroy_clntraw_create.complex.sh v448>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.142 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.715+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ad [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.sh auth v422 ap=1 s=2784 n(v0 rc2008-03-20T11:54:23.000000+0000 b2784 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d3d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ad:[<0x1000000072c/rpc_createdestroy_clntraw_create.sh v422>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004ad:[<0x1000000072c/rpc_createdestroy_clntraw_create.sh v422>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.142 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.715+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.complex.sh auth v432 ap=1 s=2631 n(v0 rc2008-03-20T11:54:23.000000+0000 b2631 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d3d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e4:[<0x1000000072c/rpc_broadc_clnt_broadcast.complex.sh v432>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004e4:[<0x1000000072c/rpc_broadc_clnt_broadcast.complex.sh v432>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.142 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.715+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_tli_create.sh auth v430 ap=1 s=3179 n(v0 rc2008-03-20T11:54:26.000000+0000 b3179 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d18000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000047f:[<0x1000000072c/tirpc_expertlevel_svc_tli_create.sh v430>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000047f:[<0x1000000072c/tirpc_expertlevel_svc_tli_create.sh v430>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.142 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.715+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.sh auth v438 ap=1 s=3164 n(v0 rc2008-03-20T11:54:26.000000+0000 b3164 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d18580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d5:[<0x1000000072c/tirpc_expertlevel_svc_unreg.sh v438>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004d5:[<0x1000000072c/tirpc_expertlevel_svc_unreg.sh v438>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.143 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.715+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ee [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.scalability.sh auth v424 ap=1 s=3300 n(v0 rc2008-03-20T11:54:27.000000+0000 b3300 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d18b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ee:[<0x1000000072c/tirpc_simple_rpc_broadcast.scalability.sh v424>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004ee:[<0x1000000072c/tirpc_simple_rpc_broadcast.scalability.sh v424>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.143 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.715+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000487 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authnone_create.sh auth v410 ap=1 s=2774 n(v0 rc2008-03-20T11:54:23.000000+0000 b2774 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d19080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000487:[<0x1000000072c/rpc_auth_authnone_create.sh v410>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000487:[<0x1000000072c/rpc_auth_authnone_create.sh v410>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.143 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.716+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_noprog.sh auth v416 ap=1 s=3668 n(v0 rc2008-03-20T11:54:26.000000+0000 b3668 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d19600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e5:[<0x1000000072c/tirpc_err_svcerr_noprog.sh v416>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004e5:[<0x1000000072c/tirpc_err_svcerr_noprog.sh v416>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.143 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.716+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.dataint.sh auth v398 ap=1 s=3672 n(v0 rc2008-03-20T11:54:27.000000+0000 b3672 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d19b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d6:[<0x1000000072c/tirpc_simple_rpc_call.dataint.sh v398>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004d6:[<0x1000000072c/tirpc_simple_rpc_call.dataint.sh v398>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.143 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.716+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authunix_create.sh auth v410 ap=1 s=2774 n(v0 rc2008-03-20T11:54:23.000000+0000 b2774 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad471e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f7:[<0x1000000072c/rpc_auth_authunix_create.sh v410>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004f7:[<0x1000000072c/rpc_auth_authunix_create.sh v410>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.143 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.716+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000053b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.stress.sh auth v434 ap=1 s=3718 n(v0 rc2008-03-20T11:54:25.000000+0000 b3718 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad471ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000053b:[<0x1000000072c/tirpc_bottomlevel_clnt_call.stress.sh v434>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000053b:[<0x1000000072c/tirpc_bottomlevel_clnt_call.stress.sh v434>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.143 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.716+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000512 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.sh auth v420 ap=1 s=3811 n(v0 rc2008-03-20T11:54:27.000000+0000 b3811 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad471f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000512:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.sh v420>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000512:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.sh v420>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.143 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.716+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.sh auth v396 ap=1 s=3158 n(v0 rc2008-03-20T11:54:26.000000+0000 b3158 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad471f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d1:[<0x1000000072c/tirpc_expertlevel_svc_reg.sh v396>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004d1:[<0x1000000072c/tirpc_expertlevel_svc_reg.sh v396>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.143 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.716+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000486 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_bufcreate.limits.sh auth v424 ap=1 s=2813 n(v0 rc2008-03-20T11:54:24.000000+0000 b2813 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d5a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000486:[<0x1000000072c/rpc_createdestroy_svcudp_bufcreate.limits.sh v424>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000486:[<0x1000000072c/rpc_createdestroy_svcudp_bufcreate.limits.sh v424>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.143 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.716+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_vc_create.limits.sh auth v402 ap=1 s=2794 n(v0 rc2024-01-25T15:03:10.299766+0000 b2794 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d5a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000047c:[<0x1000000072c/tirpc_bottomlevel_clnt_vc_create.limits.sh v402>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000047c:[<0x1000000072c/tirpc_bottomlevel_clnt_vc_create.limits.sh v402>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.143 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.717+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.dataint.sh auth v422 ap=1 s=3665 n(v0 rc2008-03-20T11:54:24.000000+0000 b3665 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d5ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000051e:[<0x1000000072c/rpc_stdcall_callrpc.dataint.sh v422>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000051e:[<0x1000000072c/rpc_stdcall_callrpc.dataint.sh v422>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.144 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.717+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000494 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcfd_create.sh auth v406 ap=1 s=2778 n(v0 rc2008-03-20T11:54:24.000000+0000 b2778 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d5b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000494:[<0x1000000072c/rpc_createdestroy_svcfd_create.sh v406>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000494:[<0x1000000072c/rpc_createdestroy_svcfd_create.sh v406>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.144 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.717+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.performance.sh auth v442 ap=1 s=3386 n(v0 rc2008-03-20T11:54:23.000000+0000 b3386 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d5b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b4:[<0x1000000072c/rpc_createdestroy_clntraw_create.performance.sh v442>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004b4:[<0x1000000072c/rpc_createdestroy_clntraw_create.performance.sh v442>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.144 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.717+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_sendreply.sh auth v416 ap=1 s=3381 n(v0 rc2008-03-20T11:54:25.000000+0000 b3381 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d5bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000050c:[<0x1000000072c/rpc_stdcall_svc_sendreply.sh v416>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000050c:[<0x1000000072c/rpc_stdcall_svc_sendreply.sh v416>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.144 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.717+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004cf [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.sh auth v430 ap=1 s=3290 n(v0 rc2008-03-20T11:54:23.000000+0000 b3290 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d5c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004cf:[<0x1000000072c/rpc_broadc_clnt_broadcast.sh v430>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004cf:[<0x1000000072c/rpc_broadc_clnt_broadcast.sh v430>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.144 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.717+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_svc_destroy.sh auth v398 ap=1 s=2784 n(v0 rc2008-03-20T11:54:27.000000+0000 b2784 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d5c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d7:[<0x1000000072c/tirpc_toplevel_svc_destroy.sh v398>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004d7:[<0x1000000072c/tirpc_toplevel_svc_destroy.sh v398>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.144 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.718+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.basic.sh auth v444 ap=1 s=3745 n(v0 rc2008-03-20T11:54:27.000000+0000 b3745 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d5cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004fb:[<0x1000000072c/tirpc_simple_rpc_call.basic.sh v444>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004fb:[<0x1000000072c/tirpc_simple_rpc_call.basic.sh v444>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.144 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.718+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create.sh auth v428 ap=1 s=3169 n(v0 rc2008-03-20T11:54:27.000000+0000 b3169 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d5d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000051d:[<0x1000000072c/tirpc_toplevel_clnt_create.sh v428>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000051d:[<0x1000000072c/tirpc_toplevel_clnt_create.sh v428>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.144 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.718+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ef [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_svc_tp_create.sh auth v404 ap=1 s=3174 n(v0 rc2008-03-20T11:54:26.000000+0000 b3174 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d5d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ef:[<0x1000000072c/tirpc_interlevel_svc_tp_create.sh v404>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004ef:[<0x1000000072c/tirpc_interlevel_svc_tp_create.sh v404>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.144 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.718+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_vc_create.sh auth v426 ap=1 s=3179 n(v0 rc2008-03-20T11:54:25.000000+0000 b3179 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d2c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a0:[<0x1000000072c/tirpc_bottomlevel_clnt_vc_create.sh v426>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004a0:[<0x1000000072c/tirpc_bottomlevel_clnt_vc_create.sh v426>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.144 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.718+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perror.complex.sh auth v412 ap=1 s=3128 n(v0 rc2008-03-20T11:54:26.000000+0000 b3128 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d2c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000051f:[<0x1000000072c/tirpc_err_clnt_perror.complex.sh v412>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000051f:[<0x1000000072c/tirpc_err_clnt_perror.complex.sh v412>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.144 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.718+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_perror.sh auth v436 ap=1 s=3654 n(v0 rc2008-03-20T11:54:24.000000+0000 b3654 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d2cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b6:[<0x1000000072c/rpc_err_clnt_perror.sh v436>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004b6:[<0x1000000072c/rpc_err_clnt_perror.sh v436>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.145 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.719+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000533 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_control.sh auth v440 ap=1 s=3171 n(v0 rc2008-03-20T11:54:26.000000+0000 b3171 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d2d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000533:[<0x1000000072c/tirpc_interlevel_clnt_control.sh v440>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000533:[<0x1000000072c/tirpc_interlevel_clnt_control.sh v440>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.145 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.719+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000484 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.scalability.sh auth v400 ap=1 s=3295 n(v0 rc2008-03-20T11:54:27.000000+0000 b3295 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d2d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000484:[<0x1000000072c/tirpc_toplevel_clnt_call.scalability.sh v400>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000484:[<0x1000000072c/tirpc_toplevel_clnt_call.scalability.sh v400>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.145 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.719+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.sh auth v394 ap=1 s=2792 n(v0 rc2008-03-20T11:54:24.000000+0000 b2792 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d2db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000051a:[<0x1000000072c/rpc_createdestroy_svctcp_create.sh v394>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000051a:[<0x1000000072c/rpc_createdestroy_svctcp_create.sh v394>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.145 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.719+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.stress.sh auth v408 ap=1 s=3844 n(v0 rc2008-03-20T11:54:27.000000+0000 b3844 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d2e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000049f:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.stress.sh v408>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000049f:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.stress.sh v408>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.145 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.719+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000504 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.performance.sh auth v432 ap=1 s=3347 n(v0 rc2008-03-20T11:54:24.000000+0000 b3347 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d2e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000504:[<0x1000000072c/rpc_stdcall_callrpc.performance.sh v432>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000504:[<0x1000000072c/rpc_stdcall_callrpc.performance.sh v432>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.145 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.719+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.performance.sh auth v414 ap=1 s=3370 n(v0 rc2008-03-20T11:54:26.000000+0000 b3370 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d2ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c1:[<0x1000000072c/tirpc_interlevel_clnt_call.performance.sh v414>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004c1:[<0x1000000072c/tirpc_interlevel_clnt_call.performance.sh v414>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.145 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.719+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.mt.sh auth v438 ap=1 s=3063 n(v0 rc2008-03-20T11:54:26.000000+0000 b3063 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d2f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f0:[<0x1000000072c/tirpc_interlevel_clnt_call.mt.sh v438>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004f0:[<0x1000000072c/tirpc_interlevel_clnt_call.mt.sh v438>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.145 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.720+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000497 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authunix_create_default.sh auth v418 ap=1 s=2798 n(v0 rc2008-03-20T11:54:23.000000+0000 b2798 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d2f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000497:[<0x1000000072c/rpc_auth_authunix_create_default.sh v418>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000497:[<0x1000000072c/rpc_auth_authunix_create_default.sh v418>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.145 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.720+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authnone_create.sh auth v440 ap=1 s=2782 n(v0 rc2008-03-20T11:54:25.000000+0000 b2782 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d20000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004bc:[<0x1000000072c/tirpc_auth_authnone_create.sh v440>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004bc:[<0x1000000072c/tirpc_auth_authnone_create.sh v440>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.145 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.720+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.dataint.sh auth v410 ap=1 s=3691 n(v0 rc2008-03-20T11:54:25.000000+0000 b3691 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d20580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e8:[<0x1000000072c/tirpc_bottomlevel_clnt_call.dataint.sh v410>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004e8:[<0x1000000072c/tirpc_bottomlevel_clnt_call.dataint.sh v410>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.145 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.720+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000496 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_bufcreate.sh auth v418 ap=1 s=2790 n(v0 rc2008-03-20T11:54:24.000000+0000 b2790 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d21080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000496:[<0x1000000072c/rpc_createdestroy_svcudp_bufcreate.sh v418>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000496:[<0x1000000072c/rpc_createdestroy_svcudp_bufcreate.sh v418>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.145 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.720+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fa [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_getmaps.sh auth v398 ap=1 s=3165 n(v0 rc2008-03-20T11:54:23.000000+0000 b3165 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d20b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004fa:[<0x1000000072c/rpc_addrmanagmt_pmap_getmaps.sh v398>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004fa:[<0x1000000072c/rpc_addrmanagmt_pmap_getmaps.sh v398>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.146 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.720+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.performance.sh auth v424 ap=1 s=3386 n(v0 rc2008-03-20T11:54:23.000000+0000 b3386 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d21600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c9:[<0x1000000072c/rpc_createdestroy_clntudp_create.performance.sh v424>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004c9:[<0x1000000072c/rpc_createdestroy_clntudp_create.performance.sh v424>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.146 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.720+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.sh auth v430 ap=1 s=3685 n(v0 rc2008-03-20T11:54:23.000000+0000 b3685 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d21b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f6:[<0x1000000072c/rpc_addrmanagmt_pmap_rmtcall.sh v430>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004f6:[<0x1000000072c/rpc_addrmanagmt_pmap_rmtcall.sh v430>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.146 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.720+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004cc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.mt.sh auth v428 ap=1 s=3090 n(v0 rc2008-03-20T11:54:26.000000+0000 b3090 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d22100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004cc:[<0x1000000072c/tirpc_expertlevel_rpcb_rmtcall.mt.sh v428>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004cc:[<0x1000000072c/tirpc_expertlevel_rpcb_rmtcall.mt.sh v428>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.146 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.721+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000527 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.stress.sh auth v432 ap=1 s=2797 n(v0 rc2008-03-20T11:54:26.000000+0000 b2797 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d22680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000527:[<0x1000000072c/tirpc_expertlevel_svc_unreg.stress.sh v432>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000527:[<0x1000000072c/tirpc_expertlevel_svc_unreg.stress.sh v432>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.146 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.721+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000506 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcraw_create.performance.sh auth v434 ap=1 s=3383 n(v0 rc2008-03-20T11:54:24.000000+0000 b3383 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d22c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000506:[<0x1000000072c/rpc_createdestroy_svcraw_create.performance.sh v434>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000506:[<0x1000000072c/rpc_createdestroy_svcraw_create.performance.sh v434>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.146 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.721+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.performance.sh auth v420 ap=1 s=3373 n(v0 rc2008-03-20T11:54:25.000000+0000 b3373 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d23180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c3:[<0x1000000072c/tirpc_bottomlevel_clnt_call.performance.sh v420>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004c3:[<0x1000000072c/tirpc_bottomlevel_clnt_call.performance.sh v420>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.146 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.721+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000522 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.dataint.sh auth v404 ap=1 s=3671 n(v0 rc2008-03-20T11:54:24.000000+0000 b3671 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d23700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000522:[<0x1000000072c/rpc_stdcall_clnt_call.dataint.sh v404>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000522:[<0x1000000072c/rpc_stdcall_clnt_call.dataint.sh v404>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.146 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.721+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ca [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_auth_destroy.sh auth v426 ap=1 s=2765 n(v0 rc2008-03-20T11:54:23.000000+0000 b2765 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d26000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ca:[<0x1000000072c/rpc_auth_auth_destroy.sh v426>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004ca:[<0x1000000072c/rpc_auth_auth_destroy.sh v426>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.146 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.721+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ae [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.mt.sh auth v448 ap=1 s=3058 n(v0 rc2008-03-20T11:54:27.000000+0000 b3058 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d26580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ae:[<0x1000000072c/tirpc_simple_rpc_reg.mt.sh v448>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004ae:[<0x1000000072c/tirpc_simple_rpc_reg.mt.sh v448>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.146 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.721+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000502 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create.sh auth v446 ap=1 s=3177 n(v0 rc2008-03-20T11:54:26.000000+0000 b3177 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d26b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000502:[<0x1000000072c/tirpc_interlevel_clnt_tp_create.sh v446>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000502:[<0x1000000072c/tirpc_interlevel_clnt_tp_create.sh v446>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.146 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.722+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000485 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_svc_create.sh auth v394 ap=1 s=2781 n(v0 rc2008-03-20T11:54:27.000000+0000 b2781 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d27080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000485:[<0x1000000072c/tirpc_toplevel_svc_create.sh v394>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000485:[<0x1000000072c/tirpc_toplevel_svc_create.sh v394>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.146 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.722+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svc_destroy.stress.sh auth v442 ap=1 s=2799 n(v0 rc2008-03-20T11:54:23.000000+0000 b2799 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d27600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004bb:[<0x1000000072c/rpc_createdestroy_svc_destroy.stress.sh v442>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004bb:[<0x1000000072c/rpc_createdestroy_svc_destroy.stress.sh v442>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.146 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.722+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000500 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.basic.sh auth v402 ap=1 s=2768 n(v0 rc2008-03-20T11:54:27.000000+0000 b2768 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d27b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000500:[<0x1000000072c/tirpc_simple_rpc_reg.basic.sh v402>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000500:[<0x1000000072c/tirpc_simple_rpc_reg.basic.sh v402>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.146 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.722+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.stress.sh auth v436 ap=1 s=3684 n(v0 rc2008-03-20T11:54:24.000000+0000 b3684 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d28100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000050e:[<0x1000000072c/rpc_stdcall_callrpc.stress.sh v436>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000050e:[<0x1000000072c/rpc_stdcall_callrpc.stress.sh v436>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.147 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.722+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000516 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authsys_create.sh auth v406 ap=1 s=2779 n(v0 rc2008-03-20T11:54:25.000000+0000 b2779 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d28680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000516:[<0x1000000072c/tirpc_auth_authsys_create.sh v406>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000516:[<0x1000000072c/tirpc_auth_authsys_create.sh v406>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.147 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.722+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_progvers.sh auth v450 ap=1 s=3666 n(v0 rc2008-03-20T11:54:24.000000+0000 b3666 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d28c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a6:[<0x1000000072c/rpc_err_svcerr_progvers.sh v450>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004a6:[<0x1000000072c/rpc_err_svcerr_progvers.sh v450>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.147 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.722+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000499 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_bufcreate.sh auth v396 ap=1 s=2793 n(v0 rc2008-03-20T11:54:23.000000+0000 b2793 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d29180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000499:[<0x1000000072c/rpc_createdestroy_clntudp_bufcreate.sh v396>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000499:[<0x1000000072c/rpc_createdestroy_clntudp_bufcreate.sh v396>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.147 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.723+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000482 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_dg_create.sh auth v422 ap=1 s=2791 n(v0 rc2008-03-20T11:54:25.000000+0000 b2791 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4d29700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000482:[<0x1000000072c/tirpc_bottomlevel_svc_dg_create.sh v422>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000482:[<0x1000000072c/tirpc_bottomlevel_svc_dg_create.sh v422>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.147 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.723+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000047e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.mt.sh auth v416 ap=1 s=3062 n(v0 rc2008-03-20T11:54:27.000000+0000 b3062 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad488c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000047e:[<0x1000000072c/tirpc_simple_rpc_call.mt.sh v416>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000047e:[<0x1000000072c/tirpc_simple_rpc_call.mt.sh v416>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.147 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.723+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.stress.sh auth v414 ap=1 s=3696 n(v0 rc2008-03-20T11:54:23.000000+0000 b3696 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad488c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b2:[<0x1000000072c/rpc_broadc_clnt_broadcast.stress.sh v414>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004b2:[<0x1000000072c/rpc_broadc_clnt_broadcast.stress.sh v414>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.147 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.723+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ea [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_noprog.sh auth v444 ap=1 s=3660 n(v0 rc2008-03-20T11:54:24.000000+0000 b3660 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad488cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ea:[<0x1000000072c/rpc_err_svcerr_noprog.sh v444>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004ea:[<0x1000000072c/rpc_err_svcerr_noprog.sh v444>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.147 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.723+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.dataint.sh auth v400 ap=1 s=3699 n(v0 rc2008-03-20T11:54:27.000000+0000 b3699 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad488d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005e2:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.dataint.sh v400>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005e2:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.dataint.sh v400>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.147 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.723+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.limits.sh auth v412 ap=1 s=2807 n(v0 rc2008-03-20T11:54:23.000000+0000 b2807 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad488d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a8:[<0x1000000072c/rpc_createdestroy_clnttcp_create.limits.sh v412>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004a8:[<0x1000000072c/rpc_createdestroy_clnttcp_create.limits.sh v412>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.147 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.723+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004bf [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.scalability.sh auth v438 ap=1 s=3650 n(v0 rc2008-03-20T11:54:24.000000+0000 b3650 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad488db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004bf:[<0x1000000072c/rpc_stdcall_callrpc.scalability.sh v438>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004bf:[<0x1000000072c/rpc_stdcall_callrpc.scalability.sh v438>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.147 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.724+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000528 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.sh auth v408 ap=1 s=3673 n(v0 rc2008-03-20T11:54:26.000000+0000 b3673 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad488e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000528:[<0x1000000072c/tirpc_expertlevel_clnt_call.sh v408>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000528:[<0x1000000072c/tirpc_expertlevel_clnt_call.sh v408>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.147 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.724+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_destroy.stress.sh auth v428 ap=1 s=2802 n(v0 rc2008-03-20T11:54:23.000000+0000 b2802 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad46a8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b7:[<0x1000000072c/rpc_createdestroy_clnt_destroy.stress.sh v428>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004b7:[<0x1000000072c/rpc_createdestroy_clnt_destroy.stress.sh v428>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.147 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.724+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000517 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_unset.sh auth v438 ap=1 s=3159 n(v0 rc2008-03-20T11:54:23.000000+0000 b3159 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad46a8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000517:[<0x1000000072c/rpc_addrmanagmt_pmap_unset.sh v438>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000517:[<0x1000000072c/rpc_addrmanagmt_pmap_unset.sh v438>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.148 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.724+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000052b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.mt.sh auth v398 ap=1 s=3082 n(v0 rc2008-03-20T11:54:26.000000+0000 b3082 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad46a8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000052b:[<0x1000000072c/tirpc_expertlevel_svc_unreg.mt.sh v398>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000052b:[<0x1000000072c/tirpc_expertlevel_svc_unreg.mt.sh v398>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.148 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.724+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000523 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.stress.sh auth v420 ap=1 s=3707 n(v0 rc2008-03-20T11:54:27.000000+0000 b3707 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad46a9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000523:[<0x1000000072c/tirpc_simple_rpc_broadcast.stress.sh v420>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000523:[<0x1000000072c/tirpc_simple_rpc_broadcast.stress.sh v420>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.148 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.724+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000534 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_geterr.sh auth v410 ap=1 s=2763 n(v0 rc2008-03-20T11:54:25.000000+0000 b2763 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad46a9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000534:[<0x1000000072c/rpc_stdcall_clnt_geterr.sh v410>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000534:[<0x1000000072c/rpc_stdcall_clnt_geterr.sh v410>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.148 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.725+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.dataint.sh auth v426 ap=1 s=3687 n(v0 rc2008-03-20T11:54:26.000000+0000 b3687 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4534580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a5:[<0x1000000072c/tirpc_simple_rpc_broadcast.dataint.sh v426>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004a5:[<0x1000000072c/tirpc_simple_rpc_broadcast.dataint.sh v426>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.148 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.725+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ba [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.scalability.sh auth v408 ap=1 s=3313 n(v0 rc2008-03-20T11:54:26.000000+0000 b3313 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4534000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ba:[<0x1000000072c/tirpc_expertlevel_rpcb_rmtcall.scalability.sh v408>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004ba:[<0x1000000072c/tirpc_expertlevel_rpcb_rmtcall.scalability.sh v408>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.148 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.725+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_systemerr.sh auth v414 ap=1 s=3669 n(v0 rc2008-03-20T11:54:24.000000+0000 b3669 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4534b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d4:[<0x1000000072c/rpc_err_svcerr_systemerr.sh v414>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004d4:[<0x1000000072c/rpc_err_svcerr_systemerr.sh v414>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.148 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.725+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000053a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getargs.dataint.sh auth v396 ap=1 s=3677 n(v0 rc2008-03-20T11:54:25.000000+0000 b3677 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4535080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000053a:[<0x1000000072c/rpc_stdcall_svc_getargs.dataint.sh v396>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000053a:[<0x1000000072c/rpc_stdcall_svc_getargs.dataint.sh v396>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.148 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.725+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authsys_create_default.sh auth v432 ap=1 s=2803 n(v0 rc2008-03-20T11:54:25.000000+0000 b2803 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4535600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b9:[<0x1000000072c/tirpc_auth_authsys_create_default.sh v432>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004b9:[<0x1000000072c/tirpc_auth_authsys_create_default.sh v432>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.148 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.726+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_dg_create.sh auth v430 ap=1 s=3179 n(v0 rc2008-03-20T11:54:25.000000+0000 b3179 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4535b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d2:[<0x1000000072c/tirpc_bottomlevel_clnt_dg_create.sh v430>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004d2:[<0x1000000072c/tirpc_bottomlevel_clnt_dg_create.sh v430>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.148 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.726+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.scalability.sh auth v434 ap=1 s=3757 n(v0 rc2008-03-20T11:54:24.000000+0000 b3757 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4536100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000050d:[<0x1000000072c/rpc_stdcall_clnt_call.scalability.sh v434>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000050d:[<0x1000000072c/rpc_stdcall_clnt_call.scalability.sh v434>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.148 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.726+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000529 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.stress.sh auth v402 ap=1 s=3700 n(v0 rc2008-03-20T11:54:26.000000+0000 b3700 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4536680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000529:[<0x1000000072c/tirpc_expertlevel_clnt_call.stress.sh v402>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000529:[<0x1000000072c/tirpc_expertlevel_clnt_call.stress.sh v402>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.149 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.726+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000537 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.sh auth v406 ap=1 s=3676 n(v0 rc2008-03-20T11:54:26.000000+0000 b3676 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4536c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000537:[<0x1000000072c/tirpc_interlevel_clnt_call.sh v406>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000537:[<0x1000000072c/tirpc_interlevel_clnt_call.sh v406>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.149 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.726+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004af [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_tli_create.limits.sh auth v416 ap=1 s=2812 n(v0 rc2008-03-20T11:54:26.000000+0000 b2812 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4537180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004af:[<0x1000000072c/tirpc_expertlevel_clnt_tli_create.limits.sh v416>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004af:[<0x1000000072c/tirpc_expertlevel_clnt_tli_create.limits.sh v416>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.149 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.726+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.complex.sh auth v436 ap=1 s=3003 n(v0 rc2008-03-20T11:54:27.000000+0000 b3003 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4537700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000049a:[<0x1000000072c/tirpc_simple_rpc_call.complex.sh v436>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000049a:[<0x1000000072c/tirpc_simple_rpc_call.complex.sh v436>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.149 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.726+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_svc_unregister.sh auth v422 ap=1 s=3165 n(v0 rc2008-03-20T11:54:24.000000+0000 b3165 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad471c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b1:[<0x1000000072c/rpc_regunreg_svc_unregister.sh v422>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004b1:[<0x1000000072c/rpc_regunreg_svc_unregister.sh v422>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.149 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.727+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000525 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_sperrno.sh auth v394 ap=1 s=3657 n(v0 rc2008-03-20T11:54:24.000000+0000 b3657 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad471c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000525:[<0x1000000072c/rpc_err_clnt_sperrno.sh v394>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000525:[<0x1000000072c/rpc_err_clnt_sperrno.sh v394>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.149 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.727+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.performance.sh auth v404 ap=1 s=3373 n(v0 rc2008-03-20T11:54:26.000000+0000 b3373 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad471cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f4:[<0x1000000072c/tirpc_expertlevel_clnt_call.performance.sh v404>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004f4:[<0x1000000072c/tirpc_expertlevel_clnt_call.performance.sh v404>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.149 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.727+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000503 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_xprt_unregister.sh auth v418 ap=1 s=3168 n(v0 rc2008-03-20T11:54:24.000000+0000 b3168 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad471d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000503:[<0x1000000072c/rpc_regunreg_xprt_unregister.sh v418>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000503:[<0x1000000072c/rpc_regunreg_xprt_unregister.sh v418>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.149 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.727+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000483 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_getport.sh auth v424 ap=1 s=3165 n(v0 rc2008-03-20T11:54:23.000000+0000 b3165 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad471d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000483:[<0x1000000072c/rpc_addrmanagmt_pmap_getport.sh v424>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000483:[<0x1000000072c/rpc_addrmanagmt_pmap_getport.sh v424>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.149 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.727+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.dataint.sh auth v400 ap=1 s=3691 n(v0 rc2008-03-20T11:54:26.000000+0000 b3691 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad471db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000049d:[<0x1000000072c/tirpc_expertlevel_clnt_call.dataint.sh v400>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000049d:[<0x1000000072c/tirpc_expertlevel_clnt_call.dataint.sh v400>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.149 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.727+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.performance.sh auth v412 ap=1 s=3369 n(v0 rc2008-03-20T11:54:27.000000+0000 b3369 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad471e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f9:[<0x1000000072c/tirpc_simple_rpc_broadcast.performance.sh v412>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004f9:[<0x1000000072c/tirpc_simple_rpc_broadcast.performance.sh v412>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.149 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.727+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.stress.sh auth v406 ap=1 s=3758 n(v0 rc2008-03-20T11:54:26.000000+0000 b3758 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b26c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a1:[<0x1000000072c/tirpc_interlevel_clnt_call.stress.sh v406>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004a1:[<0x1000000072c/tirpc_interlevel_clnt_call.stress.sh v406>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.149 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.728+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_noproc.sh auth v400 ap=1 s=3668 n(v0 rc2008-03-20T11:54:26.000000+0000 b3668 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b27180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f1:[<0x1000000072c/tirpc_err_svcerr_noproc.sh v400>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004f1:[<0x1000000072c/tirpc_err_svcerr_noproc.sh v400>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.150 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.728+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000509 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.sh auth v434 ap=1 s=3283 n(v0 rc2008-03-20T11:54:24.000000+0000 b3283 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4b27700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000509:[<0x1000000072c/rpc_stdcall_clnt_call.sh v286>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000509:[<0x1000000072c/rpc_stdcall_clnt_call.sh v434>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.150 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.728+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_create.sh auth v410 ap=1 s=3171 n(v0 rc2008-03-20T11:54:23.000000+0000 b3171 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b0a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000048e:[<0x1000000072c/rpc_createdestroy_clnt_create.sh v410>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000048e:[<0x1000000072c/rpc_createdestroy_clnt_create.sh v410>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.150 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.728+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000491 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_dg_create.limits.sh auth v420 ap=1 s=2792 n(v0 rc2008-03-20T11:54:25.000000+0000 b2792 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b0a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000491:[<0x1000000072c/tirpc_bottomlevel_svc_dg_create.limits.sh v420>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000491:[<0x1000000072c/tirpc_bottomlevel_svc_dg_create.limits.sh v420>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.150 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.728+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getaddr.sh auth v398 ap=1 s=2788 n(v0 rc2008-03-20T11:54:25.000000+0000 b2788 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b0ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c7:[<0x1000000072c/tirpc_addrmanagmt_rpcb_getaddr.sh v398>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004c7:[<0x1000000072c/tirpc_addrmanagmt_rpcb_getaddr.sh v398>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.150 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.728+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000495 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_freeargs.sh auth v430 ap=1 s=3375 n(v0 rc2008-03-20T11:54:25.000000+0000 b3375 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b0b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000495:[<0x1000000072c/rpc_stdcall_svc_freeargs.sh v430>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000495:[<0x1000000072c/rpc_stdcall_svc_freeargs.sh v430>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.150 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.729+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.performance.sh auth v426 ap=1 s=3380 n(v0 rc2008-03-20T11:54:23.000000+0000 b3380 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b0b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000050a:[<0x1000000072c/rpc_broadc_clnt_broadcast.performance.sh v426>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000050a:[<0x1000000072c/rpc_broadc_clnt_broadcast.performance.sh v426>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.150 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.729+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.scalability.sh auth v414 ap=1 s=3300 n(v0 rc2008-03-20T11:54:26.000000+0000 b3300 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b0bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000050b:[<0x1000000072c/tirpc_interlevel_clnt_call.scalability.sh v414>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000050b:[<0x1000000072c/tirpc_interlevel_clnt_call.scalability.sh v414>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.150 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.729+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000513 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_unset.sh auth v428 ap=1 s=3167 n(v0 rc2008-03-20T11:54:26.000000+0000 b3167 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b0c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000513:[<0x1000000072c/tirpc_expertlevel_rpcb_unset.sh v428>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000513:[<0x1000000072c/tirpc_expertlevel_rpcb_unset.sh v428>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.150 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.729+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.mt.sh auth v408 ap=1 s=3089 n(v0 rc2008-03-20T11:54:27.000000+0000 b3089 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b0c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000051b:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.mt.sh v408>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000051b:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.mt.sh v408>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.150 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.729+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perrno.sh auth v412 ap=1 s=3662 n(v0 rc2008-03-20T11:54:26.000000+0000 b3662 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b0cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e2:[<0x1000000072c/tirpc_err_clnt_perrno.sh v412>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004e2:[<0x1000000072c/tirpc_err_clnt_perrno.sh v412>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.150 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.729+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000051c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcraw_create.sh auth v416 ap=1 s=2781 n(v0 rc2008-03-20T11:54:24.000000+0000 b2781 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b0d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000051c:[<0x1000000072c/rpc_createdestroy_svcraw_create.sh v416>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000051c:[<0x1000000072c/rpc_createdestroy_svcraw_create.sh v416>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.151 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.729+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ec [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_control.dataint.sh auth v404 ap=1 s=3680 n(v0 rc2008-03-20T11:54:24.000000+0000 b3680 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b0d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ec:[<0x1000000072c/rpc_stdcall_clnt_control.dataint.sh v404>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004ec:[<0x1000000072c/rpc_stdcall_clnt_control.dataint.sh v404>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.151 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.730+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000052e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.dataint.sh auth v396 ap=1 s=3700 n(v0 rc2008-03-20T11:54:26.000000+0000 b3700 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b48000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000052e:[<0x1000000072c/tirpc_expertlevel_rpcb_rmtcall.dataint.sh v396>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000052e:[<0x1000000072c/tirpc_expertlevel_rpcb_rmtcall.dataint.sh v396>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.151 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.730+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004cb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.dataint.sh auth v418 ap=1 s=3682 n(v0 rc2008-03-20T11:54:27.000000+0000 b3682 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b48580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004cb:[<0x1000000072c/tirpc_toplevel_clnt_call.dataint.sh v418>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004cb:[<0x1000000072c/tirpc_toplevel_clnt_call.dataint.sh v418>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.151 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.730+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000507 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.sh auth v432 ap=1 s=2792 n(v0 rc2008-03-20T11:54:24.000000+0000 b2792 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4b48b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000507:[<0x1000000072c/rpc_createdestroy_svcudp_create.sh v282>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000507:[<0x1000000072c/rpc_createdestroy_svcudp_create.sh v432>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.151 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.730+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000518 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create_timed.limits.sh auth v394 ap=1 s=2809 n(v0 rc2008-03-20T11:54:27.000000+0000 b2809 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b49080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000518:[<0x1000000072c/tirpc_toplevel_clnt_create_timed.limits.sh v394>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000518:[<0x1000000072c/tirpc_toplevel_clnt_create_timed.limits.sh v394>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.151 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.730+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_perrno.sh auth v402 ap=1 s=3654 n(v0 rc2008-03-20T11:54:24.000000+0000 b3654 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b49600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a9:[<0x1000000072c/rpc_err_clnt_perrno.sh v402>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004a9:[<0x1000000072c/rpc_err_clnt_perrno.sh v402>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.151 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.731+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getcaller.sh auth v422 ap=1 s=3290 n(v0 rc2008-03-20T11:54:25.000000+0000 b3290 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b49b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c8:[<0x1000000072c/rpc_stdcall_svc_getcaller.sh v422>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004c8:[<0x1000000072c/rpc_stdcall_svc_getcaller.sh v422>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.151 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.731+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.complex.sh auth v438 ap=1 s=3022 n(v0 rc2008-03-20T11:54:26.000000+0000 b3022 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4acb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b5:[<0x1000000072c/tirpc_expertlevel_clnt_call.complex.sh v118>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004b5:[<0x1000000072c/tirpc_expertlevel_clnt_call.complex.sh v438>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.151 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.731+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.mt.sh auth v406 ap=1 s=3076 n(v0 rc2008-03-20T11:54:26.000000+0000 b3076 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4acbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b8:[<0x1000000072c/tirpc_expertlevel_svc_reg.mt.sh v406>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004b8:[<0x1000000072c/tirpc_expertlevel_svc_reg.mt.sh v406>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.151 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.731+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004cd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.sh auth v424 ap=1 s=3679 n(v0 rc2008-03-20T11:54:27.000000+0000 b3679 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b4a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004cd:[<0x1000000072c/tirpc_simple_rpc_broadcast.sh v424>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004cd:[<0x1000000072c/tirpc_simple_rpc_broadcast.sh v424>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.151 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.731+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000493 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.sh auth v432 ap=1 s=3277 n(v0 rc2008-03-20T11:54:24.000000+0000 b3277 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4acc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000493:[<0x1000000072c/rpc_stdcall_callrpc.sh v432>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000493:[<0x1000000072c/rpc_stdcall_callrpc.sh v432>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.151 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.731+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.mt.sh auth v422 ap=1 s=3077 n(v0 rc2008-03-20T11:54:27.000000+0000 b3077 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4acc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f2:[<0x1000000072c/tirpc_simple_rpc_broadcast.mt.sh v422>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004f2:[<0x1000000072c/tirpc_simple_rpc_broadcast.mt.sh v422>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.151 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.732+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.complex.sh auth v414 ap=1 s=3019 n(v0 rc2008-03-20T11:54:26.000000+0000 b3019 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4accc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e0:[<0x1000000072c/tirpc_interlevel_clnt_call.complex.sh v414>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004e0:[<0x1000000072c/tirpc_interlevel_clnt_call.complex.sh v414>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.152 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.732+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004db [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.performance.sh auth v404 ap=1 s=3383 n(v0 rc2008-03-20T11:54:24.000000+0000 b3383 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4acd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004db:[<0x1000000072c/rpc_createdestroy_svctcp_create.performance.sh v404>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004db:[<0x1000000072c/rpc_createdestroy_svctcp_create.performance.sh v404>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.152 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.732+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e6 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_spcreateerror.sh auth v396 ap=1 s=2781 n(v0 rc2008-03-20T11:54:24.000000+0000 b2781 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4acd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e6:[<0x1000000072c/rpc_err_clnt_spcreateerror.sh v396>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004e6:[<0x1000000072c/rpc_err_clnt_spcreateerror.sh v396>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.152 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.732+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000536 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_destroy.sh auth v402 ap=1 s=3172 n(v0 rc2008-03-20T11:54:27.000000+0000 b3172 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4aa4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000536:[<0x1000000072c/tirpc_toplevel_clnt_destroy.sh v402>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000536:[<0x1000000072c/tirpc_toplevel_clnt_destroy.sh v402>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.152 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.732+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004dd [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getmaps.sh auth v424 ap=1 s=2788 n(v0 rc2008-03-20T11:54:25.000000+0000 b2788 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4aa4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004dd:[<0x1000000072c/tirpc_addrmanagmt_rpcb_getmaps.sh v424>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004dd:[<0x1000000072c/tirpc_addrmanagmt_rpcb_getmaps.sh v424>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.152 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.732+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.dataint.sh auth v436 ap=1 s=3684 n(v0 rc2008-03-20T11:54:23.000000+0000 b3684 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4aa4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000048a:[<0x1000000072c/rpc_broadc_clnt_broadcast.dataint.sh v436>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000048a:[<0x1000000072c/rpc_broadc_clnt_broadcast.dataint.sh v436>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.152 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.732+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.performance.sh auth v416 ap=1 s=3374 n(v0 rc2008-03-20T11:54:23.000000+0000 b3374 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4aa5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d0:[<0x1000000072c/rpc_addrmanagmt_pmap_rmtcall.performance.sh v416>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004d0:[<0x1000000072c/rpc_addrmanagmt_pmap_rmtcall.performance.sh v416>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.152 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.733+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000489 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create_timed.limits.sh auth v412 ap=1 s=2823 n(v0 rc2008-03-20T11:54:26.000000+0000 b2823 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4aa5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000489:[<0x1000000072c/tirpc_interlevel_clnt_tp_create_timed.limits.sh v412>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000489:[<0x1000000072c/tirpc_interlevel_clnt_tp_create_timed.limits.sh v412>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.152 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.733+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000526 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.dataint.sh auth v420 ap=1 s=3688 n(v0 rc2008-03-20T11:54:26.000000+0000 b3688 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4aa5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000526:[<0x1000000072c/tirpc_interlevel_clnt_call.dataint.sh v420>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000526:[<0x1000000072c/tirpc_interlevel_clnt_call.dataint.sh v420>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.152 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.733+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_sperror.sh auth v418 ap=1 s=3657 n(v0 rc2008-03-20T11:54:24.000000+0000 b3657 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4aa6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000049b:[<0x1000000072c/rpc_err_clnt_sperror.sh v418>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000049b:[<0x1000000072c/rpc_err_clnt_sperror.sh v418>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.152 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.733+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_control.limits.sh auth v426 ap=1 s=2800 n(v0 rc2008-03-20T11:54:26.000000+0000 b2800 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4aa6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000048f:[<0x1000000072c/tirpc_interlevel_clnt_control.limits.sh v426>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000048f:[<0x1000000072c/tirpc_interlevel_clnt_control.limits.sh v426>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.152 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.733+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ab [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.performance.sh auth v440 ap=1 s=3386 n(v0 rc2008-03-20T11:54:23.000000+0000 b3386 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4aa6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ab:[<0x1000000072c/rpc_createdestroy_clnttcp_create.performance.sh v98>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004ab:[<0x1000000072c/rpc_createdestroy_clnttcp_create.performance.sh v440>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.153 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.734+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000511 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_vc_create.limits.sh auth v430 ap=1 s=2792 n(v0 rc2008-03-20T11:54:25.000000+0000 b2792 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4aa7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000511:[<0x1000000072c/tirpc_bottomlevel_svc_vc_create.limits.sh v430>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000511:[<0x1000000072c/tirpc_bottomlevel_svc_vc_create.limits.sh v430>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.153 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.734+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c5 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.complex.sh auth v434 ap=1 s=3292 n(v0 rc2008-03-20T11:54:24.000000+0000 b3292 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad46a6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c5:[<0x1000000072c/rpc_stdcall_clnt_call.complex.sh v434>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004c5:[<0x1000000072c/rpc_stdcall_clnt_call.complex.sh v434>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.153 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.734+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000530 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.complex.sh auth v398 ap=1 s=3022 n(v0 rc2008-03-20T11:54:25.000000+0000 b3022 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4aa7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000530:[<0x1000000072c/tirpc_bottomlevel_clnt_call.complex.sh v398>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000530:[<0x1000000072c/tirpc_bottomlevel_clnt_call.complex.sh v398>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.153 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.734+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ff [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_svc_register.sh auth v428 ap=1 s=3159 n(v0 rc2008-03-20T11:54:24.000000+0000 b3159 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad46a6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ff:[<0x1000000072c/rpc_regunreg_svc_register.sh v428>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004ff:[<0x1000000072c/rpc_regunreg_svc_register.sh v428>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.153 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.734+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000052d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authdes_create.sh auth v394 ap=1 s=2779 n(v0 rc2008-03-20T11:54:25.000000+0000 b2779 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad46a6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000052d:[<0x1000000072c/tirpc_auth_authdes_create.sh v394>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000052d:[<0x1000000072c/tirpc_auth_authdes_create.sh v394>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.153 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.734+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000492 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.sh auth v400 ap=1 s=3180 n(v0 rc2008-03-20T11:54:23.000000+0000 b3180 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad46a7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000492:[<0x1000000072c/rpc_createdestroy_clnttcp_create.sh v400>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000492:[<0x1000000072c/rpc_createdestroy_clnttcp_create.sh v400>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.153 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.735+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000515 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_systemerr.sh auth v408 ap=1 s=3682 n(v0 rc2008-03-20T11:54:26.000000+0000 b3682 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad46a7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000515:[<0x1000000072c/tirpc_err_svcerr_systemerr.sh v408>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000515:[<0x1000000072c/tirpc_err_svcerr_systemerr.sh v408>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.153 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.735+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.performance.sh auth v410 ap=1 s=3354 n(v0 rc2008-03-20T11:54:27.000000+0000 b3354 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad46a7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a2:[<0x1000000072c/tirpc_simple_rpc_call.performance.sh v410>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004a2:[<0x1000000072c/tirpc_simple_rpc_call.performance.sh v410>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.153 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.735+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.complex.sh auth v416 ap=1 s=3028 n(v0 rc2008-03-20T11:54:27.000000+0000 b3028 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad488e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a4:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.complex.sh v416>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004a4:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.complex.sh v416>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.153 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.735+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000052c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_get_myaddress.sh auth v422 ap=1 s=3168 n(v0 rc2008-03-20T11:54:23.000000+0000 b3168 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad488ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000052c:[<0x1000000072c/rpc_addrmanagmt_get_myaddress.sh v422>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000052c:[<0x1000000072c/rpc_addrmanagmt_get_myaddress.sh v422>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.153 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.735+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.scalability.sh auth v408 ap=1 s=3312 n(v0 rc2008-03-20T11:54:27.000000+0000 b3312 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad488f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c0:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.scalability.sh v408>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004c0:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.scalability.sh v408>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.153 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.735+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000524 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.limits.sh auth v438 ap=1 s=3227 n(v0 rc2008-03-20T11:54:27.000000+0000 b3227 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad488f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000524:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.limits.sh v438>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000524:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.limits.sh v438>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.153 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.735+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000480 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getargs.sh auth v426 ap=1 s=3375 n(v0 rc2008-03-20T11:54:25.000000+0000 b3375 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4a0e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000480:[<0x1000000072c/rpc_stdcall_svc_getargs.sh v426>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000480:[<0x1000000072c/rpc_stdcall_svc_getargs.sh v426>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.154 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.736+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ed [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.sh auth v442 ap=1 s=3672 n(v0 rc2008-03-20T11:54:27.000000+0000 b3672 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4a0e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ed:[<0x1000000072c/tirpc_toplevel_clnt_call.sh v230>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004ed:[<0x1000000072c/tirpc_toplevel_clnt_call.sh v442>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.154 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.736+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000508 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perror.sh auth v402 ap=1 s=3662 n(v0 rc2008-03-20T11:54:26.000000+0000 b3662 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4a0eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000508:[<0x1000000072c/tirpc_err_clnt_perror.sh v402>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000508:[<0x1000000072c/tirpc_err_clnt_perror.sh v402>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.154 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.736+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004df [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_dg_create.limits.sh auth v394 ap=1 s=2794 n(v0 rc2008-03-20T11:54:25.000000+0000 b2794 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4a0f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004df:[<0x1000000072c/tirpc_bottomlevel_clnt_dg_create.limits.sh v394>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004df:[<0x1000000072c/tirpc_bottomlevel_clnt_dg_create.limits.sh v394>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.154 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.736+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004eb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_xprt_register.sh auth v432 ap=1 s=3162 n(v0 rc2008-03-20T11:54:24.000000+0000 b3162 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4a0f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004eb:[<0x1000000072c/rpc_regunreg_xprt_register.sh v432>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004eb:[<0x1000000072c/rpc_regunreg_xprt_register.sh v432>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.154 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.736+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000005e3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.mt.sh auth v414 ap=1 s=3081 n(v0 rc2008-03-20T11:54:25.000000+0000 b3081 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4a0fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000005e3:[<0x1000000072c/tirpc_bottomlevel_clnt_call.mt.sh v414>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000005e3:[<0x1000000072c/tirpc_bottomlevel_clnt_call.mt.sh v414>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.154 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.736+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c2 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.stress.sh auth v398 ap=1 s=2782 n(v0 rc2008-03-20T11:54:27.000000+0000 b2782 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4a10100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c2:[<0x1000000072c/tirpc_simple_rpc_reg.stress.sh v398>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004c2:[<0x1000000072c/tirpc_simple_rpc_reg.stress.sh v398>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.154 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.736+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000539 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_pcreateerror.sh auth v444 ap=1 s=2778 n(v0 rc2008-03-20T11:54:24.000000+0000 b2778 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4a10680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000539:[<0x1000000072c/rpc_err_clnt_pcreateerror.sh v382>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000539:[<0x1000000072c/rpc_err_clnt_pcreateerror.sh v444>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.154 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.737+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000488 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.scalability.sh auth v406 ap=1 s=3285 n(v0 rc2008-03-20T11:54:27.000000+0000 b3285 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4a10c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000488:[<0x1000000072c/tirpc_simple_rpc_call.scalability.sh v406>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000488:[<0x1000000072c/tirpc_simple_rpc_call.scalability.sh v406>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.154 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.737+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000052f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.complex.sh auth v404 ap=1 s=3031 n(v0 rc2008-03-20T11:54:26.000000+0000 b3031 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4a11180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000052f:[<0x1000000072c/tirpc_expertlevel_rpcb_rmtcall.complex.sh v404>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000052f:[<0x1000000072c/tirpc_expertlevel_rpcb_rmtcall.complex.sh v404>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.154 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.737+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004ac [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.stress.sh auth v428 ap=1 s=3690 n(v0 rc2008-03-20T11:54:24.000000+0000 b3690 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4a11700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004ac:[<0x1000000072c/rpc_stdcall_clnt_call.stress.sh v428>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004ac:[<0x1000000072c/rpc_stdcall_clnt_call.stress.sh v428>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.154 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.737+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000514 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_registerrpc.sh auth v424 ap=1 s=3156 n(v0 rc2008-03-20T11:54:24.000000+0000 b3156 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4542000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000514:[<0x1000000072c/rpc_regunreg_registerrpc.sh v424>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000514:[<0x1000000072c/rpc_regunreg_registerrpc.sh v424>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.154 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.737+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create_timed.sh auth v410 ap=1 s=3187 n(v0 rc2008-03-20T11:54:27.000000+0000 b3187 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4542580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004fc:[<0x1000000072c/tirpc_toplevel_clnt_create_timed.sh v410>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004fc:[<0x1000000072c/tirpc_toplevel_clnt_create_timed.sh v410>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.155 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.738+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.stress.sh auth v436 ap=1 s=2808 n(v0 rc2008-03-20T11:54:23.000000+0000 b2808 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4542b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d3:[<0x1000000072c/rpc_createdestroy_clnttcp_create.stress.sh v436>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004d3:[<0x1000000072c/rpc_createdestroy_clnttcp_create.stress.sh v436>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.155 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.738+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000538 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.performance.sh auth v412 ap=1 s=3353 n(v0 rc2008-03-20T11:54:24.000000+0000 b3353 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4543080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000538:[<0x1000000072c/rpc_stdcall_clnt_call.performance.sh v412>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000538:[<0x1000000072c/rpc_stdcall_clnt_call.performance.sh v412>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.155 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.738+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004c4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.mt.sh auth v400 ap=1 s=3072 n(v0 rc2008-03-20T11:54:27.000000+0000 b3072 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4543600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004c4:[<0x1000000072c/tirpc_toplevel_clnt_call.mt.sh v400>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004c4:[<0x1000000072c/tirpc_toplevel_clnt_call.mt.sh v400>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.155 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.738+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authdes_seccreate.sh auth v418 ap=1 s=2788 n(v0 rc2008-03-20T11:54:25.000000+0000 b2788 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4543b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e9:[<0x1000000072c/tirpc_auth_authdes_seccreate.sh v418>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004e9:[<0x1000000072c/tirpc_auth_authdes_seccreate.sh v418>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.155 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.738+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.complex.sh auth v434 ap=1 s=3016 n(v0 rc2008-03-20T11:54:26.000000+0000 b3016 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4544100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000048c:[<0x1000000072c/tirpc_simple_rpc_broadcast.complex.sh v434>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000048c:[<0x1000000072c/tirpc_simple_rpc_broadcast.complex.sh v434>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.155 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.738+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000481 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.scalability.sh auth v440 ap=1 s=3304 n(v0 rc2008-03-20T11:54:26.000000+0000 b3304 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555ad4544680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000481:[<0x1000000072c/tirpc_expertlevel_clnt_call.scalability.sh v14>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000481:[<0x1000000072c/tirpc_expertlevel_clnt_call.scalability.sh v440>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.155 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.738+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000519 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perrno.complex.sh auth v396 ap=1 s=3128 n(v0 rc2008-03-20T11:54:26.000000+0000 b3128 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4544c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000519:[<0x1000000072c/tirpc_err_clnt_perrno.complex.sh v396>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000519:[<0x1000000072c/tirpc_err_clnt_perrno.complex.sh v396>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.155 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.738+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000050f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_auth.sh auth v430 ap=1 s=3654 n(v0 rc2008-03-20T11:54:24.000000+0000 b3654 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4545180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000050f:[<0x1000000072c/rpc_err_svcerr_auth.sh v430>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000050f:[<0x1000000072c/rpc_err_svcerr_auth.sh v430>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.155 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.739+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004de [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.stress.sh auth v420 ap=1 s=2805 n(v0 rc2008-03-20T11:54:24.000000+0000 b2805 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4545700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004de:[<0x1000000072c/rpc_createdestroy_svctcp_create.stress.sh v420>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004de:[<0x1000000072c/rpc_createdestroy_svctcp_create.stress.sh v420>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.155 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.739+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000535 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.sh auth v422 ap=1 s=2795 n(v0 rc2008-03-20T11:54:23.000000+0000 b2795 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b4a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000535:[<0x1000000072c/rpc_createdestroy_clntudp_create.sh v422>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000535:[<0x1000000072c/rpc_createdestroy_clntudp_create.sh v422>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.155 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.739+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000498 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_set.sh auth v400 ap=1 s=3153 n(v0 rc2008-03-20T11:54:23.000000+0000 b3153 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b4ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000498:[<0x1000000072c/rpc_addrmanagmt_pmap_set.sh v400>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000498:[<0x1000000072c/rpc_addrmanagmt_pmap_set.sh v400>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.155 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.739+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e7 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_freeres.sh auth v428 ap=1 s=3292 n(v0 rc2008-03-20T11:54:24.000000+0000 b3292 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b4b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e7:[<0x1000000072c/rpc_stdcall_clnt_freeres.sh v428>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004e7:[<0x1000000072c/rpc_stdcall_clnt_freeres.sh v428>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.156 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.739+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d9 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_noproc.sh auth v424 ap=1 s=3660 n(v0 rc2008-03-20T11:54:24.000000+0000 b3660 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b4b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d9:[<0x1000000072c/rpc_err_svcerr_noproc.sh v424>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004d9:[<0x1000000072c/rpc_err_svcerr_noproc.sh v424>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.156 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.739+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004b0 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create_timed.sh auth v418 ap=1 s=3195 n(v0 rc2008-03-20T11:54:26.000000+0000 b3195 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b1c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004b0:[<0x1000000072c/tirpc_interlevel_clnt_tp_create_timed.sh v418>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004b0:[<0x1000000072c/tirpc_interlevel_clnt_tp_create_timed.sh v418>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.156 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.740+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000072d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.performance.sh auth v414 ap=1 s=3381 n(v0 rc2024-01-25T15:03:10.298766+0000 b3381 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b1c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000072d:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.performance.sh v414>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000072d:[<0x1000000072c/tirpc_simple_rpc_broadcast_exp.performance.sh v414>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.156 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.740+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004e3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_set.sh auth v430 ap=1 s=3161 n(v0 rc2008-03-20T11:54:26.000000+0000 b3161 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b1cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004e3:[<0x1000000072c/tirpc_expertlevel_rpcb_set.sh v430>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004e3:[<0x1000000072c/tirpc_expertlevel_rpcb_set.sh v430>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.156 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.740+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000049c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_destroy.sh auth v420 ap=1 s=2789 n(v0 rc2008-03-20T11:54:23.000000+0000 b2789 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b1d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000049c:[<0x1000000072c/rpc_createdestroy_clnt_destroy.sh v420>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000049c:[<0x1000000072c/rpc_createdestroy_clnt_destroy.sh v420>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.156 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.740+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004aa [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_create.stress.sh auth v416 ap=1 s=2799 n(v0 rc2008-03-20T11:54:23.000000+0000 b2799 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b1d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004aa:[<0x1000000072c/rpc_createdestroy_clnt_create.stress.sh v416>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004aa:[<0x1000000072c/rpc_createdestroy_clnt_create.stress.sh v416>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.156 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.740+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004d8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_weakauth.sh auth v394 ap=1 s=3666 n(v0 rc2008-03-20T11:54:24.000000+0000 b3666 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b1db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004d8:[<0x1000000072c/rpc_err_svcerr_weakauth.sh v394>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004d8:[<0x1000000072c/rpc_err_svcerr_weakauth.sh v394>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.156 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.740+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004f8 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.stress.sh auth v412 ap=1 s=3715 n(v0 rc2008-03-20T11:54:26.000000+0000 b3715 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b1e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004f8:[<0x1000000072c/tirpc_expertlevel_rpcb_rmtcall.stress.sh v412>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004f8:[<0x1000000072c/tirpc_expertlevel_rpcb_rmtcall.stress.sh v412>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.156 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.741+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000048d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_tli_create.limits.sh auth v398 ap=1 s=2809 n(v0 rc2008-03-20T11:54:26.000000+0000 b2809 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b1e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000048d:[<0x1000000072c/tirpc_expertlevel_svc_tli_create.limits.sh v398>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000048d:[<0x1000000072c/tirpc_expertlevel_svc_tli_create.limits.sh v398>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.156 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.741+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004dc [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_vc_create.sh auth v402 ap=1 s=2791 n(v0 rc2008-03-20T11:54:25.000000+0000 b2791 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b1ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004dc:[<0x1000000072c/tirpc_bottomlevel_svc_vc_create.sh v402>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004dc:[<0x1000000072c/tirpc_bottomlevel_svc_vc_create.sh v402>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.156 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.741+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000521 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.performance.sh auth v404 ap=1 s=3382 n(v0 rc2024-01-25T15:03:10.303766+0000 b3382 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b1f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000521:[<0x1000000072c/tirpc_expertlevel_rpcb_rmtcall.performance.sh v404>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000521:[<0x1000000072c/tirpc_expertlevel_rpcb_rmtcall.performance.sh v404>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.156 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.741+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004fe [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.mt.sh auth v396 ap=1 s=3081 n(v0 rc2008-03-20T11:54:26.000000+0000 b3081 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b1f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004fe:[<0x1000000072c/tirpc_expertlevel_clnt_call.mt.sh v396>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004fe:[<0x1000000072c/tirpc_expertlevel_clnt_call.mt.sh v396>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.157 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.741+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a3 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.scalability.sh auth v426 ap=1 s=3304 n(v0 rc2008-03-20T11:54:25.000000+0000 b3304 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4aca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004a3:[<0x1000000072c/tirpc_bottomlevel_clnt_call.scalability.sh v426>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004a3:[<0x1000000072c/tirpc_bottomlevel_clnt_call.scalability.sh v426>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.157 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.741+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000052a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.scalability.sh auth v408 ap=1 s=3667 n(v0 rc2008-03-20T11:54:23.000000+0000 b3667 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4aca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000052a:[<0x1000000072c/rpc_broadc_clnt_broadcast.scalability.sh v408>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000052a:[<0x1000000072c/rpc_broadc_clnt_broadcast.scalability.sh v408>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.157 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.741+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004da [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.limits.sh auth v410 ap=1 s=2804 n(v0 rc2008-03-20T11:54:24.000000+0000 b2804 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4acab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000004da:[<0x1000000072c/rpc_createdestroy_svctcp_create.limits.sh v410>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000004da:[<0x1000000072c/rpc_createdestroy_svctcp_create.limits.sh v410>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.157 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:37.742+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000532 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getaddr.limits.sh auth v406 ap=1 s=2803 n(v0 rc2008-03-20T11:54:25.000000+0000 b2803 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4acb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000532:[<0x1000000072c/tirpc_addrmanagmt_rpcb_getaddr.limits.sh v406>,<0x1000000054d/scripts v1162>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000532:[<0x1000000072c/tirpc_addrmanagmt_rpcb_getaddr.limits.sh v406>,<0x1000000054d/scripts v1196>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.357 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:38.058+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001578 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_join/speculative/6-1.c auth v4 ap=1 s=1719 n(v0 rc2024-01-25T15:03:13.320695+0000 b1719 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561272635700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001578:[<0x10000001577/6-1.c v2>,<0x10000001575/speculative v30>,<0x100000013f1/pthread_join v2546>,<0x100000012df/interfaces v176>,<0x100000012dd/conformance v16>,<0x10000000204/open_posix_testsuite v413>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000001578:[<0x10000001577/6-1.c v4>,<0x10000001575/speculative v30>,<0x100000013f1/pthread_join v6081>,<0x100000012df/interfaces v893>,<0x100000012dd/conformance v258>,<0x10000000204/open_posix_testsuite v1047>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.357 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:38.169+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000980 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal auth v36 ap=1 s=125 n(v0 rc2009-08-22T17:27:06.000000+0000 b125 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272630c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000980:[<0x10000000bd0/fatal v36>,<0x10000000bcd/data v46>,<0x10000000abf/panic v74>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000980:[<0x10000000bd0/fatal v36>,<0x10000000bcd/data v46>,<0x10000000abf/panic v109>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.357 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:38.169+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000097d [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout auth v26 ap=1 s=145 n(v0 rc2009-08-22T17:27:06.000000+0000 b145 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272631180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000097d:[<0x10000000bd0/fatal_timeout v26>,<0x10000000bcd/data v46>,<0x10000000abf/panic v74>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000097d:[<0x10000000bd0/fatal_timeout v26>,<0x10000000bcd/data v46>,<0x10000000abf/panic v109>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.358 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:38.169+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000097e [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout_ripv auth v22 ap=1 s=150 n(v0 rc2009-08-22T17:27:06.000000+0000 b150 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272631700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000097e:[<0x10000000bd0/fatal_timeout_ripv v22>,<0x10000000bcd/data v46>,<0x10000000abf/panic v74>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000097e:[<0x10000000bd0/fatal_timeout_ripv v22>,<0x10000000bcd/data v46>,<0x10000000abf/panic v109>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.358 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:38.170+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bd1 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_userspace auth v34 ap=1 s=129 n(v0 rc2024-01-25T15:03:11.144746+0000 b129 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272632000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bd1:[<0x10000000bd0/fatal_userspace v34>,<0x10000000bcd/data v46>,<0x10000000abf/panic v74>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000bd1:[<0x10000000bd0/fatal_userspace v34>,<0x10000000bcd/data v46>,<0x10000000abf/panic v109>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.358 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:38.170+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000979 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_irq auth v32 ap=1 s=132 n(v0 rc2009-08-22T17:27:06.000000+0000 b132 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272632580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000979:[<0x10000000bd0/fatal_irq v32>,<0x10000000bcd/data v46>,<0x10000000abf/panic v74>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000979:[<0x10000000bd0/fatal_irq v32>,<0x10000000bcd/data v46>,<0x10000000abf/panic v109>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.358 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:38.170+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000097c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_over auth v20 ap=1 s=131 n(v0 rc2009-08-22T17:27:06.000000+0000 b131 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272632b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000097c:[<0x10000000bd0/fatal_over v20>,<0x10000000bcd/data v46>,<0x10000000abf/panic v74>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000097c:[<0x10000000bd0/fatal_over v20>,<0x10000000bcd/data v46>,<0x10000000abf/panic v109>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.358 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:38.170+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000097a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_eipv auth v24 ap=1 s=129 n(v0 rc2009-08-22T17:27:06.000000+0000 b129 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272633080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000097a:[<0x10000000bd0/fatal_eipv v24>,<0x10000000bcd/data v46>,<0x10000000abf/panic v74>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000097a:[<0x10000000bd0/fatal_eipv v24>,<0x10000000bcd/data v46>,<0x10000000abf/panic v109>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.358 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:38.170+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000097b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_no_en auth v30 ap=1 s=135 n(v0 rc2009-08-22T17:27:06.000000+0000 b135 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272633600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000097b:[<0x10000000bd0/fatal_no_en v30>,<0x10000000bcd/data v46>,<0x10000000abf/panic v74>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000097b:[<0x10000000bd0/fatal_no_en v30>,<0x10000000bcd/data v46>,<0x10000000abf/panic v109>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.358 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:03:38.170+0000 7f11008a4700 -1 mds.3.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000097f [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_ripv auth v28 ap=1 s=129 n(v0 rc2009-08-22T17:27:06.000000+0000 b129 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561272633b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000097f:[<0x10000000bd0/fatal_ripv v28>,<0x10000000bcd/data v46>,<0x10000000abf/panic v74>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000097f:[<0x10000000bd0/fatal_ripv v28>,<0x10000000bcd/data v46>,<0x10000000abf/panic v109>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.526 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:38.167+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000953 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srao_mem_scrub_noripv auth v24 ap=1 s=79 n(v0 rc2009-08-22T17:27:06.000000+0000 b79 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2c1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000953:[<0x10000000ac3/srao_mem_scrub_noripv v4>,<0x10000000ac0/data v30>,<0x10000000abf/panic_ucr v80>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000953:[<0x10000000ac3/srao_mem_scrub_noripv v24>,<0x10000000ac0/data v30>,<0x10000000abf/panic_ucr v105>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.526 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:38.168+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096b [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_over auth v20 ap=1 s=94 n(v0 rc2009-08-22T17:27:06.000000+0000 b94 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2c2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000096b:[<0x10000000ac3/srar_over v20>,<0x10000000ac0/data v30>,<0x10000000abf/panic_ucr v80>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000096b:[<0x10000000ac3/srar_over v20>,<0x10000000ac0/data v30>,<0x10000000abf/panic_ucr v105>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.527 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:38.168+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000954 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_no_en auth v14 ap=1 s=85 n(v0 rc2009-08-22T17:27:06.000000+0000 b85 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2c2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000954:[<0x10000000ac3/srar_no_en v14>,<0x10000000ac0/data v30>,<0x10000000abf/panic_ucr v80>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000954:[<0x10000000ac3/srar_no_en v14>,<0x10000000ac0/data v30>,<0x10000000abf/panic_ucr v105>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.527 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:38.168+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096c [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srao_ewb_noripv auth v22 ap=1 s=80 n(v0 rc2009-08-22T17:27:06.000000+0000 b80 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2c2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000096c:[<0x10000000ac3/srao_ewb_noripv v22>,<0x10000000ac0/data v30>,<0x10000000abf/panic_ucr v80>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000096c:[<0x10000000ac3/srao_ewb_noripv v22>,<0x10000000ac0/data v30>,<0x10000000abf/panic_ucr v105>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.527 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:38.168+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_unkown auth v18 ap=1 s=89 n(v0 rc2009-08-22T17:27:06.000000+0000 b89 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2c3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000096a:[<0x10000000ac3/srar_unkown v18>,<0x10000000ac0/data v30>,<0x10000000abf/panic_ucr v80>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000096a:[<0x10000000ac3/srar_unkown v18>,<0x10000000ac0/data v30>,<0x10000000abf/panic_ucr v105>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.527 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:38.168+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ac4 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/s0_ar1 auth v16 ap=1 s=92 n(v0 rc2024-01-25T15:03:11.118747+0000 b92 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2c3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ac4:[<0x10000000ac3/s0_ar1 v16>,<0x10000000ac0/data v30>,<0x10000000abf/panic_ucr v80>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000ac4:[<0x10000000ac3/s0_ar1 v16>,<0x10000000ac0/data v30>,<0x10000000abf/panic_ucr v105>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.527 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.527 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.527 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.527 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000008ef (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/open_files.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000a99 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/Makefile) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000008ee (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/nfs01) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.528 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.529 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.530 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.531 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:38.168+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000989 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_ucna auth v26 ap=1 s=157 n(v0 rc2009-08-22T17:27:07.000000+0000 b157 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2d6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000989:[<0x10000000bda/srao_ucna v26>,<0x10000000bd7/data v44>,<0x10000000abf/recoverable_ucr v78>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000989:[<0x10000000bda/srao_ucna v26>,<0x10000000bd7/data v48>,<0x10000000abf/recoverable_ucr v111>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.531 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:38.169+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000988 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_no_en auth v20 ap=1 s=84 n(v0 rc2009-08-22T17:27:07.000000+0000 b84 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2d6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000988:[<0x10000000bda/srao_no_en v20>,<0x10000000bd7/data v44>,<0x10000000abf/recoverable_ucr v78>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000988:[<0x10000000bda/srao_no_en v20>,<0x10000000bd7/data v48>,<0x10000000abf/recoverable_ucr v111>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.531 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:38.169+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000984 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_unknown auth v28 ap=1 s=89 n(v0 rc2009-08-22T17:27:07.000000+0000 b89 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x561bea2d6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000984:[<0x10000000bda/srao_unknown v4>,<0x10000000bd7/data v44>,<0x10000000abf/recoverable_ucr v78>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000984:[<0x10000000bda/srao_unknown v28>,<0x10000000bd7/data v48>,<0x10000000abf/recoverable_ucr v111>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.531 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:38.169+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000987 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_corrected auth v18 ap=1 s=150 n(v0 rc2009-08-22T17:27:07.000000+0000 b150 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2d7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000987:[<0x10000000bda/srao_corrected v18>,<0x10000000bd7/data v44>,<0x10000000abf/recoverable_ucr v78>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000987:[<0x10000000bda/srao_corrected v18>,<0x10000000bd7/data v48>,<0x10000000abf/recoverable_ucr v111>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.531 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:38.169+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000985 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_ewb auth v24 ap=1 s=105 n(v0 rc2009-08-22T17:27:07.000000+0000 b105 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2d7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000985:[<0x10000000bda/srao_ewb v24>,<0x10000000bd7/data v44>,<0x10000000abf/recoverable_ucr v78>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000985:[<0x10000000bda/srao_ewb v24>,<0x10000000bd7/data v48>,<0x10000000abf/recoverable_ucr v111>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.532 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:38.169+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000986 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_over auth v22 ap=1 s=94 n(v0 rc2009-08-22T17:27:07.000000+0000 b94 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2d7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000986:[<0x10000000bda/srao_over v22>,<0x10000000bd7/data v44>,<0x10000000abf/recoverable_ucr v78>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000986:[<0x10000000bda/srao_over v22>,<0x10000000bd7/data v48>,<0x10000000abf/recoverable_ucr v111>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.532 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:03:38.169+0000 7f4e5879d700 -1 mds.4.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000bdb [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_mem_scrub auth v16 ap=1 s=104 n(v0 rc2024-01-25T15:03:11.159746+0000 b104 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x561bea2d8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000bdb:[<0x10000000bda/srao_mem_scrub v16>,<0x10000000bd7/data v44>,<0x10000000abf/recoverable_ucr v78>,<0x10000000abe/soft-inj v20>,<0x10000000ab6/cases v142>,<0x10000000204/mce-test v397>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000bdb:[<0x10000000bda/srao_mem_scrub v16>,<0x10000000bd7/data v48>,<0x10000000abf/recoverable_ucr v111>,<0x10000000abe/soft-inj v52>,<0x10000000ab6/cases v244>,<0x10000000204/mce-test v1095>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v28>,<0x1/volumes v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.538 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.538 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.538 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.538 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.538 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.538 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.538 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.538 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.538 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.538 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.538 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.539 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.539 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.539 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.539 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.539 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.539 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.539 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.539 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.539 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.539 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.539 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.539 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.539 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.539 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.540 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.540 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.540 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000002f6a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/f38) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.540 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000002f92 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.540 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000002cca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/f47) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.540 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.540 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000002fac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/c44) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.540 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000002fb3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/d41/c45) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.540 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.540 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000002fc4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/f46) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.540 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000002fa0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/d41) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.540 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.540 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.541 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.541 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.541 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.541 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.541 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.541 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012b2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/15-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.541 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012b6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/7-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.541 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012b5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/12-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.541 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001359 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/1-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.541 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012ab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/coverage.txt) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.541 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001354 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/coverage.txt) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.541 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000135a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/5-2.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.541 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/14-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.541 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001356 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/testfrmw.h) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.541 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012ae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/testfrmw.h) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.542 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001357 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/2-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.542 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012b3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.542 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001558 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/3-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.542 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001358 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/5-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.542 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001355 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/testfrmw.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.542 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012b7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/4-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.542 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000135b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/assertions.xml) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.542 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.542 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001421 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-3.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.542 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/6-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.542 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/5-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.542 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012aa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/10-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.543 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012ac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/18-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.543 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012a9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/9-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.543 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012b8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-2.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.543 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012b9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/16-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.543 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012ad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/testfrmw.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.543 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012b4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/assertions.xml) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.543 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.543 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.543 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001317 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/22-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.543 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001310 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/15-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.543 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012fa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/20-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.543 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001313 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/7-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.543 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001316 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/13-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.543 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000130d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/18-1.sh) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.544 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001315 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-6.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.544 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000130e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/15-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.544 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001312 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/12-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.544 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001307 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/14-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.544 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000130b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/1-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.544 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012ff (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-3.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.544 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001300 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/coverage.txt) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.544 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001311 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/3-1.sh) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.544 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001318 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/4-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.544 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000130c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-4.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.544 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001308 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/2-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.544 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000130a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/6-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.544 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001309 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/5-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.545 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001301 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-5.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.545 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012fb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/10-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.545 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001302 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.545 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001304 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-4.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.545 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001449 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/9-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.545 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012fe (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/22-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.545 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001306 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/8-1.sh) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.545 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000131b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/11-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.545 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012fc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-3.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.545 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001319 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-5.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.545 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000131a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/16-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.545 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001305 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-7.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.545 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000131c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.546 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000130f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/assertions.xml) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.546 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012fd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.546 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001314 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/21-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.546 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001303 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.546 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.546 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.546 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001437 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/1-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.546 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001439 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/4-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.546 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000158a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/3-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.546 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001438 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/assertions.xml) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.546 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001435 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/coverage.txt) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.546 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001436 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/2-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.546 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.547 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.547 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.547 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.547 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.547 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.547 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001320 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/1-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.547 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000131d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/testfrmw.h) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.547 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001323 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/2-2.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.547 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001321 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/coverage.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.547 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001324 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/4-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.547 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000131e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/2-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.547 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.547 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000131f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/5-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.547 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.548 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001325 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/cln.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.548 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001546 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/testfrmw.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.548 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001322 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/assertions.xml) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.548 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.548 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.548 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000155a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/coverage.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.548 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000135f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/3-1.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.548 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000135d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/1-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.548 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000135c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/2-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.548 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000135e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.548 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.548 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.548 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.549 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.549 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.549 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.549 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000013c0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-3.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.549 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000013b8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.549 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000013be (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/1-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.549 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000013b9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/coverage.txt) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.549 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000013ba (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/1-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.549 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000013bc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/testfrmw.h) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.549 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000013c1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.549 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001570 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/3-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.549 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000013bd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/2-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.549 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000013bf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/assertions.xml) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.549 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000013bb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/testfrmw.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.550 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.550 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.550 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001470 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-2.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.550 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000146a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/coverage.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.550 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001469 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-3.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.550 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000146c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-core-buildonly.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.550 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000146e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/4-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.550 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000168d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/3-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.550 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000146f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-4.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.550 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000146d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.550 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000146b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-1.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.550 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.550 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.550 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001212 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/1-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.551 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001213 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/assertions.xml) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.551 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001211 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/2-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.551 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000013f9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/coverage.txt) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.551 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.551 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.551 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000132e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/7-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.551 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000132f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/13-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.551 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000132d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/12-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.551 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000132a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/1-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.551 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001327 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/coverage.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.551 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001331 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/11-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.551 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000132b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/8-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.551 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001328 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/2-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.551 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001329 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/5-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.552 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001326 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/10-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.552 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001330 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/4-1.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.552 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001548 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/9-1.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.552 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001332 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/11-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.552 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000132c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.552 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.552 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.552 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.552 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.552 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014ca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.552 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000163d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-63.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.552 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000162e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.552 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015cc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.553 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001665 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.553 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001603 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.553 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.553 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014cf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.553 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001512 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.553 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015d9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.553 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000142b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/1-2.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.553 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001430 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/2-1.sh) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.553 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015fb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.553 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014fc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-47.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.553 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001584 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/coverage.txt) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.553 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001510 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.553 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000142c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/1-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.553 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000142e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/3-1.sh) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001643 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-40.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001585 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000142f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/4-1.sh) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000142d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/assertions.xml) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001431 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative/5-2.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001586 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative/5-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001687 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000165d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014c9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-39.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015a3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001676 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001626 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-84.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.554 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001528 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015fc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000152c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000162c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000167a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000159a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000164a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-43.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000152a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001534 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001518 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015fd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-49.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015d7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000165c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-82.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015df (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.555 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000153f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.556 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001611 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-30.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.556 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015de (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.556 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014c6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.556 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014e7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.556 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001671 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.556 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015a7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-71.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.556 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000162f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-70.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.556 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000163a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.556 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000016b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.556 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000165b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.556 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015a6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.556 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015cb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.556 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001537 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.557 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001661 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-95.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.557 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001673 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/21-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.557 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015f1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-91.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.557 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014fb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.557 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015ff (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.557 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014eb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.557 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000163e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.557 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001540 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.557 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015c7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.557 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015a8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.557 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001635 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/README) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.557 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000164d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.557 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014fe (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.557 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001615 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.558 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000016af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.558 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001644 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.558 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000159b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.558 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001532 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.558 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001670 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.558 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.558 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015b7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.558 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015e3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-31.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.558 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001646 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-58.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.558 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001541 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.558 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015bd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.558 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001617 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-36.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.558 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014c8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.559 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001645 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.559 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001516 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.559 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000164b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.559 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014ee (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.559 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000150e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.559 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001511 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.559 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000165f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.559 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015ed (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.559 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014c7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.559 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000152f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.559 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000151b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.559 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001628 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-80.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.559 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001618 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.559 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015e4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001619 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000160b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015bc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015c8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001667 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015b2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001591 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014e6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001527 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001606 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015c4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001607 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.560 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001654 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.561 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015fe (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.561 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000151a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.561 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.561 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014f5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.561 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001536 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/gentests.pl) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.561 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001525 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.561 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015d5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.561 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000159c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.561 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001677 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.561 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000161f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.561 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001505 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.561 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.561 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001501 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.561 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014cd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000151f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015b3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001542 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001624 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015b4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001827 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015ab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000153c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000161b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-97.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015f5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001641 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001681 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000163b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.562 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001680 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.563 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001666 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.563 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001653 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.563 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001504 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.563 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015f3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.563 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014fa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-44.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.563 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001521 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.563 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015c5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.563 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000151e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/10-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.563 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001509 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.563 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014f6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.563 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001538 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.563 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014cc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-79.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.563 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015b6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.564 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001621 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.564 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015f2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.564 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015dd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.564 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015da (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-98.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.564 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015ad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.564 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001623 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-40.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.564 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000150a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.564 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001543 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.564 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000166c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.564 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001601 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.564 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001649 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.564 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000165e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.564 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001639 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.565 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001526 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.565 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000152d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.565 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000161a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.565 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015f9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-99.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.565 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001651 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.565 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000161d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.565 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.565 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000162d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.565 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000151d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.565 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000163f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.565 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014f4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.565 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015fa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.565 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001668 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.565 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001594 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.566 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014ec (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.566 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000166d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-51.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.566 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000162a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-42.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.566 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001530 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.566 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000159d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.566 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000162b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.566 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000167f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.566 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000160d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.566 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001531 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.566 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001637 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.566 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000165a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-38.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.566 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015ec (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.566 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015a4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.566 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001660 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.567 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015ae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.567 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000150c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.567 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001664 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.567 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001503 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.567 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000151c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.567 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001593 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.567 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014c4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.567 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000152e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.567 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015dc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.567 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015e9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.567 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015b9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.567 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000160e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.567 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014e8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.567 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001609 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.568 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001620 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.568 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001544 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.568 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001519 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.568 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014f3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.568 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000159e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.568 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000161e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.568 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001595 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.568 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014ff (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.568 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014f7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.568 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000164f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.568 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001524 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.568 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014cb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.568 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015e1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.569 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001629 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.569 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001604 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.569 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015bf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.569 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001522 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.569 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001657 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.569 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014f2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.569 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015aa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.569 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015d4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-33.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.569 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001682 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.569 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015be (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.569 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015c9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.569 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001658 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.569 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015c1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.569 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.570 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000150f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.570 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001598 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.570 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014fd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.570 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000166e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.570 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001650 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.570 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014e9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.570 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015e6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.h) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.570 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015b8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.570 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001634 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.570 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015f7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.570 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000161c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-101.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.570 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000166b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.570 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015d6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.570 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015ce (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000166f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015f0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015c0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001602 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015a2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014ef (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015a9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-77.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001507 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000150d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-81.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001632 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015a1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000158f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015d2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.571 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000167e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.572 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001662 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.572 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015c6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.572 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000167c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.572 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001625 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.572 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000164c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-55.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.572 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001636 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.572 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001616 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-62.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.572 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000160c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.572 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015e5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-41.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.572 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001508 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-48.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.572 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001672 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.572 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000166a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.572 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015f8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.572 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015cf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-50.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.573 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001683 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-37.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.573 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015e8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-30.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.573 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014f0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.573 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001678 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.573 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001640 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.573 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001647 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.573 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015d0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.573 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014ed (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-46.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.573 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015d1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.573 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001592 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.573 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015ee (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.573 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001663 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.573 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015eb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.573 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015c2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-74.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.574 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015ba (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.574 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014f9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.574 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000167d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-93.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.574 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000153e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.574 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014ce (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-44.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.574 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000160a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-68.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.574 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001652 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.574 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015e2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.574 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015a0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-94.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.574 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015ef (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.574 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001659 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.574 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015f4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.574 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000153a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.574 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001613 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.575 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001622 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-61.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.575 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014e5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-28.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.575 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001608 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.575 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001502 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.575 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001631 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.575 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001513 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.575 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001590 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.575 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001656 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.575 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015d8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.575 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000167b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.575 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015d3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.575 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015db (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.575 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001688 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/29-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.575 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015ac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.576 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001605 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.576 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001539 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.576 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001638 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-92.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.576 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000163c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.576 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001642 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.576 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001596 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.576 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001633 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.576 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014f1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.576 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001610 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-69.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.576 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001648 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.576 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015cd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-88.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.576 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001523 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-49.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.577 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000160f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-53.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.577 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001675 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-86.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.577 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014c5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.577 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014f8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.577 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001685 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.577 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015f6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.577 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015bb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.577 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001529 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.577 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015c3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.577 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000159f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.577 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001599 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.577 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015a5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.577 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001500 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.577 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001597 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-52.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.578 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001520 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.578 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014ea (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.578 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000153b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.578 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001627 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.578 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001614 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.578 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001535 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.578 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015ea (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.578 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001655 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.578 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000150b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.578 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001506 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.578 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014d0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.578 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001514 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-46.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.578 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015ca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015e7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-54.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001674 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001689 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001515 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001612 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-28.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015b5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000153d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001533 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-36.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000152b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-27.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001669 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001686 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014d1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-50.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001679 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-78.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001517 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001630 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-76.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.579 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001600 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-100.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.580 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000015e0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.580 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001684 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-104.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.580 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000164e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-31.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.580 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012a8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/2-1.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.580 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012a6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/1-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.580 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000012a7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.580 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014de (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_17-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.580 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000141f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/coverage.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.580 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014e0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.580 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014e1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.580 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000016b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_28-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.580 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014d7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_13-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.581 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014d8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_3-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.581 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014d4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_23-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.581 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014e2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_18-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.581 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014d5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_16-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.581 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014da (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_19-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.581 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014d3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_2-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.581 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014dd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_8-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.581 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014df (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_6-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.581 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014db (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_1-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.581 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014dc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-4.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.581 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014e3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-2.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.581 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014e4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-2.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.581 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014d9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_25-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.581 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.581 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014d6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-3.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.582 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000014d2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_22-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.582 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000bcc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/cases.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.582 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000bcb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_eripv_timeout) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.582 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000974 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_mcip_timeout) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.582 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000977 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_eripv) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.582 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000975 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_mcip) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.582 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000973 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/fatal_severity) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.582 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000976 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/unknown) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.582 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000972 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uncorrected) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.582 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000978 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uncorrected_timeout) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.582 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.582 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000bca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.582 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.582 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.583 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000e28 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/sensor_factors_000.cpp) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.583 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000e27 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/thread_000.cpp) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.583 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000e29 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_001.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.583 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000e2a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.583 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000e2b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.am) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.583 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f61 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/test.h) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.583 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000e26 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_000.cpp) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.583 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.583 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.583 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000085f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport02) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.583 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000086b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport01) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.583 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000860 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport05) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.583 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000085e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport05) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.583 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000086a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport04) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000866 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport02) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000863 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport07) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000a67 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport03) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000864 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/00_Descriptions.txt) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000861 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/Makefile) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000867 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport06) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000865 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport06) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000862 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport01) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000869 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport04) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000086c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport07) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000868 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport03) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.584 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.585 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007bc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip01) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.585 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007c4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip02) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.585 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007bf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip03) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.585 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007d5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip05) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.585 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007c2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip14) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.585 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007c1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip13) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.585 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007bd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip04) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.585 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007bb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip02) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.585 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007cd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip07) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.585 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007ca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip12) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.585 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007ba (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip06) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.585 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007be (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip12) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.585 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007cc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip14) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000095f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip09) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007c7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/00_Descriptions.txt) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007d2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip07) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007c0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip03) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007c8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip06) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007c3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/Makefile) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007c6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip04) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007d4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip11) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007d1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip10) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007cb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip09) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007d3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip01) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007ce (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip08) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007c5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip11) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007d0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip05) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.586 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007b9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip08) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007c9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip10) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007cf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip13) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000001578 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_join/speculative/6-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000980 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.587 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000097d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.588 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000097e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout_ripv) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.588 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000bd1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_userspace) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.588 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000979 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_irq) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.588 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000097c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_over) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.588 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000097a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_eipv) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.588 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000097b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_no_en) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.588 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000097f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_ripv) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.588 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.588 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:38.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000008ef (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/open_files.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000a99 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/Makefile) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000008ee (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/nfs01) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000002f6a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/f38) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000002f92 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000002cca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/f47) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000002fac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/c44) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000002fb3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/d41/c45) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000002fc4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/f46) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000002fa0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/d41) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012b2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/15-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012b6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/7-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012b5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/12-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001359 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/1-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012ab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/coverage.txt) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001354 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/coverage.txt) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000135a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/5-2.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/14-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001356 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/testfrmw.h) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012ae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/testfrmw.h) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001357 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/2-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012b3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001558 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/3-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001358 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/5-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001355 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/testfrmw.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012b7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/4-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000135b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/assertions.xml) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001421 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-3.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/6-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/5-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012aa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/10-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012ac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/18-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012a9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/9-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012b8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-2.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012b9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/16-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012ad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/testfrmw.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012b4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/assertions.xml) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001317 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/22-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001310 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/15-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012fa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/20-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001313 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/7-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001316 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/13-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000130d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/18-1.sh) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001315 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-6.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000130e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/15-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001312 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/12-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001307 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/14-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000130b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/1-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012ff (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-3.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001300 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/coverage.txt) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001311 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/3-1.sh) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001318 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/4-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000130c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-4.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001308 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/2-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000130a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/6-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001309 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/5-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001301 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-5.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012fb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/10-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001302 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.640 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001304 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-4.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001449 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/9-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012fe (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/22-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001306 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/8-1.sh) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000131b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/11-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012fc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-3.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001319 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-5.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000131a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/16-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001305 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-7.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000131c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000130f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/assertions.xml) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012fd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001314 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/21-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001303 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.641 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001437 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/1-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001439 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/4-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000158a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/3-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001438 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/assertions.xml) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001435 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/coverage.txt) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001436 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/2-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001320 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/1-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.642 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000131d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/testfrmw.h) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001323 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/2-2.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001321 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/coverage.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001324 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/4-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000131e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/2-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000131f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/5-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001325 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/cln.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001546 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/testfrmw.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001322 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/assertions.xml) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000155a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/coverage.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000135f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/3-1.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000135d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/1-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000135c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/2-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000135e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000013c0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-3.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000013b8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000013be (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/1-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000013b9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/coverage.txt) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000013ba (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/1-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000013bc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/testfrmw.h) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000013c1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001570 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/3-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000013bd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/2-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000013bf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/assertions.xml) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000013bb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/testfrmw.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001470 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-2.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000146a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/coverage.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001469 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-3.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000146c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-core-buildonly.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000146e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/4-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000168d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/3-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000146f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-4.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000146d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000146b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-1.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001212 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/1-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001213 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/assertions.xml) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001211 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/2-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000013f9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/coverage.txt) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000132e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/7-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000132f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/13-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000132d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/12-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000132a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/1-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001327 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/coverage.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001331 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/11-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000132b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/8-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001328 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/2-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001329 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/5-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001326 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/10-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001330 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/4-1.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001548 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/9-1.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001332 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/11-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000132c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014ca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000163d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-63.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000162e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015cc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001665 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001603 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014cf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001512 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015d9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000142b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/1-2.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001430 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/2-1.sh) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015fb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014fc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-47.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001584 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/coverage.txt) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001510 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000142c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/1-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000142e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/3-1.sh) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001643 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-40.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001585 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000142f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/4-1.sh) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000142d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/assertions.xml) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001431 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative/5-2.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001586 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative/5-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001687 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000165d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014c9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-39.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015a3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001676 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001626 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-84.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001528 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015fc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000152c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000162c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000167a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000159a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000164a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-43.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000152a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001534 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001518 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015fd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-49.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015d7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000165c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-82.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015df (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000153f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001611 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-30.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015de (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014c6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014e7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001671 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015a7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-71.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000162f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-70.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000163a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000016b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000165b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015a6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015cb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001537 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001661 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-95.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001673 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/21-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015f1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-91.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014fb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015ff (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014eb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000163e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001540 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015c7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015a8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001635 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/README) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000164d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014fe (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001615 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000016af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001644 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000159b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001532 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001670 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015b7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015e3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-31.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001646 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-58.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001541 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015bd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001617 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-36.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014c8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001645 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001516 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000164b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014ee (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000150e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001511 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000165f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015ed (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014c7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000152f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000151b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001628 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-80.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001618 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015e4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001619 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000160b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015bc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015c8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001667 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015b2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001591 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014e6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001527 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001606 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015c4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001607 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001654 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015fe (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000151a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014f5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001536 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/gentests.pl) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001525 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015d5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000159c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001677 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000161f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001505 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001501 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014cd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000151f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015b3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001542 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001624 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015b4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001827 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015ab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000153c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000161b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-97.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015f5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001641 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001681 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000163b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001680 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001666 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001653 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001504 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015f3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014fa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-44.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001521 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015c5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000151e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/10-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001509 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014f6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001538 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014cc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-79.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015b6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001621 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015f2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015dd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015da (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-98.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015ad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001623 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-40.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000150a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001543 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000166c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001601 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001649 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000165e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001639 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001526 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000152d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000161a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015f9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-99.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001651 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000161d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000162d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000151d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000163f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014f4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015fa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001668 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001594 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014ec (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000166d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-51.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000162a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-42.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001530 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000159d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000162b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000167f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000160d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001531 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001637 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000165a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-38.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015ec (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015a4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001660 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015ae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000150c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001664 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001503 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000151c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001593 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014c4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000152e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015dc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015e9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015b9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000160e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014e8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001609 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001620 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001544 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001519 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014f3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000159e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000161e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001595 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014ff (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014f7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000164f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.663 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001524 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014cb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015e1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001629 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001604 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015bf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001522 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001657 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014f2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015aa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015d4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-33.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001682 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015be (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015c9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.664 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001658 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015c1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000150f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001598 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014fd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000166e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001650 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014e9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015e6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.h) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015b8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001634 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015f7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000161c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-101.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.665 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000166b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015d6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015ce (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000166f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015f0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015c0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001602 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015a2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014ef (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015a9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-77.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001507 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000150d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-81.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001632 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015a1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000158f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.666 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015d2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000167e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001662 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015c6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000167c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001625 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000164c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-55.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001636 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001616 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-62.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000160c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015e5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-41.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001508 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-48.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001672 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.667 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000166a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015f8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015cf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-50.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001683 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-37.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015e8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-30.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014f0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001678 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001640 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001647 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015d0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014ed (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-46.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015d1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001592 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.668 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015ee (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001663 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015eb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015c2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-74.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015ba (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014f9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000167d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-93.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000153e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014ce (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-44.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000160a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-68.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001652 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015e2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015a0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-94.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015ef (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.669 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001659 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015f4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000153a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001613 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001622 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-61.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014e5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-28.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001608 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001502 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001631 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001513 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001590 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001656 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015d8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000167b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015d3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.670 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015db (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001688 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/29-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015ac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001605 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001539 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001638 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-92.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000163c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001642 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001596 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001633 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014f1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001610 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-69.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001648 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.671 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015cd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-88.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001523 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-49.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000160f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-53.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001675 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-86.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014c5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014f8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001685 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015f6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015bb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001529 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015c3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000159f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001599 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015a5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.672 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001500 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001597 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-52.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001520 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014ea (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000153b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001627 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001614 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001535 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015ea (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001655 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000150b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001506 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014d0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001514 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-46.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.673 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015ca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015e7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-54.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001674 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001689 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001515 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001612 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-28.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015b5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000153d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001533 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-36.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000152b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-27.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001669 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001686 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014d1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-50.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001679 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-78.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001517 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.674 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001630 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-76.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001600 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-100.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000015e0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001684 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-104.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000164e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-31.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012a8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/2-1.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012a6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/1-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000012a7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014de (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_17-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000141f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/coverage.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014e0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014e1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000016b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_28-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.675 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014d7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_13-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014d8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_3-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014d4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_23-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014e2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_18-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014d5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_16-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014da (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_19-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014d3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_2-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014dd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_8-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014df (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_6-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014db (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_1-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014dc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-4.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014e3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-2.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014e4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-2.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014d9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_25-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.676 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014d6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-3.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000014d2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_22-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000bcc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/cases.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000bcb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_eripv_timeout) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000974 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_mcip_timeout) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000977 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_eripv) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000975 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_mcip) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000973 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/fatal_severity) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000976 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/unknown) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000972 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uncorrected) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000978 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uncorrected_timeout) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.677 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000bca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000e28 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/sensor_factors_000.cpp) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000e27 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/thread_000.cpp) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000e29 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_001.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000e2a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000e2b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.am) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f61 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/test.h) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000e26 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_000.cpp) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000085f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport02) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.678 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000086b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport01) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000860 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport05) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000085e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport05) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000086a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport04) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000866 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport02) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000863 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport07) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000a67 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport03) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000864 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/00_Descriptions.txt) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000861 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/Makefile) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000867 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport06) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000865 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport06) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000862 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport01) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000869 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport04) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.679 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000086c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport07) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000868 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport03) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007bc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip01) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007c4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip02) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007bf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip03) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007d5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip05) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007c2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip14) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007c1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip13) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007bd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip04) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007bb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip02) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007cd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip07) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.680 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007ca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip12) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007ba (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip06) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007be (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip12) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007cc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip14) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000095f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip09) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007c7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/00_Descriptions.txt) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007d2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip07) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007c0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip03) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007c8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip06) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007c3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/Makefile) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007c6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip04) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007d4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip11) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007d1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip10) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007cb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip09) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.681 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007d3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip01) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007ce (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip08) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007c5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip11) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007d0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip05) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007b9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip08) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007c9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip10) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007cf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip13) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.682 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000001578 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_join/speculative/6-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000980 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000097d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000097e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout_ripv) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000bd1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_userspace) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000979 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_irq) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000097c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_over) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000097a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_eipv) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000097b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_no_en) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.683 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000097f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_ripv) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.684 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:38 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:38.733 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:38.524+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000709 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_err_svcerr_progvers/1-basic.c auth v8 ap=1 s=2593 n(v0 rc2024-01-25T15:03:10.037772+0000 b2593 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5655445ef080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000709:[<0x10000000708/1-basic.c v8>,<0x100000005b9/rpc_err_svcerr_progvers v546>,<0x10000000561/rpc v225>,<0x10000000553/rpc_suite v85>,<0x1000000054d/tests_pack v1130>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000709:[<0x10000000708/1-basic.c v8>,<0x100000005b9/rpc_err_svcerr_progvers v546>,<0x10000000561/rpc v260>,<0x10000000553/rpc_suite v137>,<0x1000000054d/tests_pack v1251>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.734 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:03:38.524+0000 7f954292d700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000462 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_err_svcerr_progvers/assertions.xml auth v6 ap=1 s=134 n(v0 rc2008-03-20T11:54:36.000000+0000 b134 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x5655445ef600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000462:[<0x10000000708/assertions.xml v6>,<0x100000005b9/rpc_err_svcerr_progvers v546>,<0x10000000561/rpc v225>,<0x10000000553/rpc_suite v85>,<0x1000000054d/tests_pack v1130>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000462:[<0x10000000708/assertions.xml v6>,<0x100000005b9/rpc_err_svcerr_progvers v546>,<0x10000000561/rpc v260>,<0x10000000553/rpc_suite v137>,<0x1000000054d/tests_pack v1251>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v181>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v31>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000008ef (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/open_files.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000a99 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/Makefile) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000008ee (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/nfs01) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000002f6a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/f38) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000002f92 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000002cca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/f47) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000002fac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/c44) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000002fb3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/d41/c45) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000002fc4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/f46) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000002fa0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/d41) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012b2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/15-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012b6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/7-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012b5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/12-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001359 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/1-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012ab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/coverage.txt) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001354 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/coverage.txt) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000135a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/5-2.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/14-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001356 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/testfrmw.h) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012ae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/testfrmw.h) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001357 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/2-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012b3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001558 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/3-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001358 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/5-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001355 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/testfrmw.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012b7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/4-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000135b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/assertions.xml) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001421 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-3.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/6-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/5-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012aa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/10-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012ac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/18-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012a9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/9-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012b8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-2.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012b9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/16-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012ad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/testfrmw.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012b4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/assertions.xml) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001317 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/22-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001310 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/15-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012fa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/20-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001313 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/7-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001316 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/13-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000130d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/18-1.sh) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001315 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-6.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000130e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/15-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001312 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/12-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001307 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/14-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000130b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/1-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012ff (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-3.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001300 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/coverage.txt) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001311 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/3-1.sh) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001318 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/4-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000130c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-4.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001308 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/2-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000130a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/6-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001309 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/5-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001301 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-5.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012fb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/10-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001302 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001304 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-4.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001449 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/9-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012fe (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/22-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001306 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/8-1.sh) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000131b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/11-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012fc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-3.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001319 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-5.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000131a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/16-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001305 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-7.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000131c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000130f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/assertions.xml) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012fd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001314 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/21-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001303 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001437 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/1-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001439 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/4-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000158a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/3-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001438 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/assertions.xml) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001435 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/coverage.txt) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001436 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/2-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001320 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/1-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000131d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/testfrmw.h) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001323 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/2-2.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001321 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/coverage.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001324 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/4-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000131e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/2-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000131f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/5-1.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001325 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/cln.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001546 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/testfrmw.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001322 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/assertions.xml) see mds.b log and `damage ls` output for details 2024-01-25T15:03:38.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000155a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/coverage.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000135f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/3-1.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000135d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/1-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000135c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/2-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000135e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000013c0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-3.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000013b8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000013be (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/1-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000013b9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/coverage.txt) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000013ba (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/1-2.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000013bc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/testfrmw.h) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000013c1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001570 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/3-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000013bd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/2-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000013bf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/assertions.xml) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000013bb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/testfrmw.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001470 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-2.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000146a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/coverage.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001469 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-3.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000146c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-core-buildonly.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000146e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/4-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000168d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/3-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000146f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-4.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000146d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000146b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-1.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001212 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/1-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001213 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/assertions.xml) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001211 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/2-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000013f9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/coverage.txt) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000132e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/7-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000132f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/13-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000132d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/12-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000132a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/1-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001327 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/coverage.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001331 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/11-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000132b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/8-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001328 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/2-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001329 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/5-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001326 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/10-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001330 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/4-1.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001548 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/9-1.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001332 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/11-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000132c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014ca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000163d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-63.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000162e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015cc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001665 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001603 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014cf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001512 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015d9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000142b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/1-2.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001430 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/2-1.sh) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015fb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014fc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-47.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001584 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/coverage.txt) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001510 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000142c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/1-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000142e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/3-1.sh) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001643 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-40.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001585 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000142f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/4-1.sh) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000142d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/assertions.xml) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001431 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative/5-2.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001586 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative/5-1.c) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001687 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000165d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014c9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-39.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015a3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001676 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001626 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-84.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001528 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015fc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000152c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000162c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000167a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000159a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000164a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-43.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000152a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001534 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001518 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015fd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-49.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015d7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000165c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-82.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015df (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000153f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001611 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-30.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015de (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014c6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014e7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001671 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015a7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-71.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000162f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-70.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000163a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000016b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000165b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015a6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015cb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001537 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001661 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-95.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001673 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/21-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015f1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-91.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014fb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015ff (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014eb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000163e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001540 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015c7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015a8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001635 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/README) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000164d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014fe (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001615 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000016af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001644 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000159b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001532 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001670 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015b7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015e3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-31.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001646 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-58.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001541 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015bd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001617 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-36.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014c8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001645 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001516 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000164b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014ee (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000150e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001511 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000165f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015ed (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014c7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000152f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000151b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001628 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-80.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001618 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015e4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001619 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000160b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015bc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015c8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001667 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015b2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001591 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014e6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001527 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001606 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015c4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001607 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001654 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015fe (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000151a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014f5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001536 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/gentests.pl) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001525 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015d5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000159c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001677 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000161f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001505 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001501 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014cd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000151f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015b3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001542 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001624 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015b4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001827 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015ab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000153c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000161b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-97.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015f5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001641 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001681 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000163b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001680 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001666 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001653 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001504 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015f3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014fa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-44.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001521 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015c5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000151e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/10-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001509 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014f6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001538 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014cc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-79.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015b6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001621 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015f2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015dd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015da (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-98.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015ad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.768 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001623 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-40.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.769 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000150a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.769 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001543 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.769 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000166c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.769 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001601 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.769 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001649 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.769 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000165e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.769 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001639 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.769 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001526 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.769 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000152d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.769 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000161a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.769 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015f9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-99.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.769 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001651 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.769 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000161d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.769 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000162d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000151d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000163f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014f4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015fa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001668 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001594 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014ec (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000166d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-51.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000162a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-42.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001530 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000159d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000162b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000167f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.770 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000160d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001531 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001637 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000165a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-38.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015ec (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015a4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001660 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015ae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000150c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001664 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001503 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000151c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001593 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014c4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000152e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.771 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015dc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015e9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015b9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000160e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014e8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001609 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001620 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001544 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001519 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014f3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000159e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000161e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001595 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014ff (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.772 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014f7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000164f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001524 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014cb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015e1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001629 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001604 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015bf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001522 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001657 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014f2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015aa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015d4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-33.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001682 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015be (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.773 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015c9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001658 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015c1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000150f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001598 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014fd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000166e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001650 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014e9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015e6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.h) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015b8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001634 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015f7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.774 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000161c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-101.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000166b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015d6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015ce (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000166f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015f0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015c0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001602 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015a2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014ef (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015a9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-77.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001507 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000150d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-81.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001632 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015a1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000158f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015d2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000167e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001662 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015c6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000167c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001625 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000164c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-55.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001636 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.776 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001616 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-62.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000160c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-21.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015e5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-41.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001508 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-48.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001672 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-13.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000166a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015f8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015cf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-50.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001683 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-37.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015e8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-30.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014f0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001678 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001640 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001647 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.777 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015d0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014ed (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-46.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015d1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001592 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015ee (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001663 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015eb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015c2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-74.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015ba (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-4.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014f9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000167d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-93.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000153e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014ce (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-44.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000160a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-68.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001652 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015e2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.778 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015a0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-94.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015ef (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001659 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015f4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000153a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001613 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-22.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001622 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-61.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014e5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-28.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001608 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001502 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001631 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-10.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001513 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001590 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001656 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015d8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.779 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000167b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-3.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015d3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-23.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015db (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001688 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/29-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015ac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001605 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001539 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001638 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-92.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000163c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001642 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001596 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001633 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-7.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.780 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014f1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001610 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-69.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001648 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015cd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-88.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001523 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-49.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000160f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-53.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001675 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-86.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014c5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014f8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001685 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015f6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015bb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001529 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-15.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015c3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-20.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000159f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.781 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001599 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015a5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-9.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001500 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-8.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001597 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-52.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001520 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014ea (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000153b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-24.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001627 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-17.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001614 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001535 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-14.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015ea (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001655 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-25.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000150b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-2.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001506 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014d0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-6.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.782 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001514 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-46.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015ca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015e7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-54.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001674 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-26.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001689 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-12.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001515 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001612 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-28.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015b5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-11.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000153d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-16.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001533 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-36.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000152b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-27.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001669 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-5.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001686 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014d1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-50.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001679 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-78.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.783 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001517 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-19.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001630 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-76.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001600 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-100.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000015e0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-18.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001684 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-104.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000164e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-31.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012a8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/2-1.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012a6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/1-1.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000012a7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014de (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_17-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000141f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/coverage.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014e0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014e1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.784 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000016b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_28-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014d7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_13-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014d8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_3-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014d4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_23-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014e2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_18-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014d5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_16-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014da (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_19-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014d3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_2-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014dd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_8-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014df (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_6-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014db (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_1-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014dc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-4.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014e3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-2.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.785 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014e4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-2.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014d9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_25-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014d6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-3.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000014d2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_22-1.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000bcc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/cases.sh) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000bcb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_eripv_timeout) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000974 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_mcip_timeout) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000977 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_eripv) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000975 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_mcip) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000973 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/fatal_severity) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000976 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/unknown) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000972 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uncorrected) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000978 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uncorrected_timeout) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.786 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000bca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000e28 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/sensor_factors_000.cpp) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000e27 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/thread_000.cpp) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000e29 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_001.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000e2a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.in) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000e2b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.am) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f61 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/test.h) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000e26 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_000.cpp) see mds.c log and `damage ls` output for details 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000085f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport02) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000086b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport01) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000860 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport05) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000085e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport05) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.787 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000086a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport04) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000866 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport02) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000863 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport07) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000a67 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport03) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000864 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/00_Descriptions.txt) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000861 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/Makefile) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000867 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport06) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000865 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport06) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000862 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport01) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000869 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport04) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000086c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport07) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000868 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport03) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007bc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip01) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.788 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007c4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip02) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007bf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip03) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007d5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip05) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007c2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip14) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007c1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip13) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007bd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip04) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007bb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip02) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007cd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip07) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007ca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip12) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007ba (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip06) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007be (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip12) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007cc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip14) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000095f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip09) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007c7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/00_Descriptions.txt) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007d2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip07) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.789 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007c0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip03) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007c8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip06) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007c3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/Makefile) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007c6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip04) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007d4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip11) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007d1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip10) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007cb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip09) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007d3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip01) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007ce (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip08) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007c5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip11) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007d0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip05) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007b9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip08) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007c9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip10) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007cf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip13) see mds.k log and `damage ls` output for details 2024-01-25T15:03:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.790 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000001578 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_join/speculative/6-1.c) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000980 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000097d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000097e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout_ripv) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.791 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000bd1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_userspace) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000979 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_irq) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000097c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_over) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000097a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_eipv) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000097b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_no_en) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000097f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_ripv) see mds.l log and `damage ls` output for details 2024-01-25T15:03:38.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:38.792 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:38 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:38.854 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:38.525+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000713 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_stdcall_svc_getcaller/1-basic.c auth v8 ap=1 s=2289 n(v0 rc2024-01-25T15:03:10.059772+0000 b2289 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b26100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000713:[<0x10000000712/1-basic.c v8>,<0x100000005b9/rpc_stdcall_svc_getcaller v617>,<0x10000000561/rpc v225>,<0x10000000553/rpc_suite v85>,<0x1000000054d/tests_pack v1130>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000713:[<0x10000000712/1-basic.c v8>,<0x100000005b9/rpc_stdcall_svc_getcaller v617>,<0x10000000561/rpc v260>,<0x10000000553/rpc_suite v137>,<0x1000000054d/tests_pack v1251>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.855 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:38.525+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000046a [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_stdcall_svc_getcaller/assertions.xml auth v6 ap=1 s=253 n(v0 rc2008-03-20T11:54:40.000000+0000 b253 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b26680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000046a:[<0x10000000712/assertions.xml v6>,<0x100000005b9/rpc_stdcall_svc_getcaller v617>,<0x10000000561/rpc v225>,<0x10000000553/rpc_suite v85>,<0x1000000054d/tests_pack v1130>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x1000000046a:[<0x10000000712/assertions.xml v6>,<0x100000005b9/rpc_stdcall_svc_getcaller v617>,<0x10000000561/rpc v260>,<0x10000000553/rpc_suite v137>,<0x1000000054d/tests_pack v1251>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.855 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:38.531+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000006ff [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_regunreg_registerrpc/1-basic.c auth v8 ap=1 s=2597 n(v0 rc2024-01-25T15:03:10.023772+0000 b2597 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b25600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000006ff:[<0x100000006fe/1-basic.c v8>,<0x100000005b9/rpc_regunreg_registerrpc v591>,<0x10000000561/rpc v225>,<0x10000000553/rpc_suite v85>,<0x1000000054d/tests_pack v1130>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x100000006ff:[<0x100000006fe/1-basic.c v8>,<0x100000005b9/rpc_regunreg_registerrpc v591>,<0x10000000561/rpc v260>,<0x10000000553/rpc_suite v137>,<0x1000000054d/tests_pack v1251>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:38.855 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:03:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:03:38.531+0000 7f8b3db97700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000459 [2,head] /volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_regunreg_registerrpc/assertions.xml auth v6 ap=1 s=137 n(v0 rc2008-03-20T11:54:36.000000+0000 b137 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24803=0-4194304@1} caps={24803=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24803 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555ad4b25b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000459:[<0x100000006fe/assertions.xml v6>,<0x100000005b9/rpc_regunreg_registerrpc v591>,<0x10000000561/rpc v225>,<0x10000000553/rpc_suite v85>,<0x1000000054d/tests_pack v1130>,<0x1000000054c/rpc-tirpc-full-test-suite v335>,<0x10000000414/rpc v307>,<0x10000000204/network v417>,<0x10000000202/testcases v16>,<0x10000000007/ltp-full-20091231 v16>,<0x10000000006/fsstress v15>,<0x10000000005/tmp v7>,<0x100000001fb/client.0 v8>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v24>,<0x10000000001/sv_1 v47>,<0x10000000000/qa v36>,<0x1/volumes v33>]//[]","memoryvalue":"(3)0x10000000459:[<0x100000006fe/assertions.xml v6>,<0x100000005b9/rpc_regunreg_registerrpc v591>,<0x10000000561/rpc v260>,<0x10000000553/rpc_suite v137>,<0x1000000054d/tests_pack v1251>,<0x1000000054c/rpc-tirpc-full-test-suite v380>,<0x10000000414/rpc v510>,<0x10000000204/network v1137>,<0x10000000202/testcases v1215>,<0x10000000007/ltp-full-20091231 v177>,<0x10000000006/fsstress v97>,<0x10000000005/tmp v28>,<0x100000001fb/client.0 v14>,<0x100000001fa/6466e999-81d6-425e-9907-3f0f6edb37e6 v43>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v34>,<0x1/volumes v20>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-01-25T15:03:39.362 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.362 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000d63 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_005.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.362 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000f4b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_006.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.362 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000d5d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_010.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.362 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000d5f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_003.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.362 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000d59 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_002.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.362 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000d64 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_011.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.362 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000d60 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_001.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.362 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000d65 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_013.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000d63 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_005.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000f4b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_006.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000d5d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_010.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000d5f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_003.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000d59 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_002.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000d64 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_011.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000d60 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_001.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000d65 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_013.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000d61 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_000.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000d62 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/Makefile.in) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000d5a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_009.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000d66 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_004.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000d5c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_008.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000d5b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_012.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000d67 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/Makefile.am) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000d5e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_007.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000067b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000067e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000676 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000681 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000679 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000677 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000067d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/00_Descriptions.txt) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.627 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000067a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000067c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/Makefile) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000682 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000067f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000680 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000084a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000678 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000753 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend14) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000075c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend03) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000754 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend13) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.628 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000756 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend01) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.629 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000075b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend08) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.629 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000075d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend05) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.629 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000750 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend02) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.629 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000760 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend13) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.629 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000075f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend08) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.629 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000751 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/00_Descriptions.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.629 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000758 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend14) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.629 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000074e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/Makefile) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.629 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000748 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend11) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.629 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000075e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend10) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000074f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend10) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000761 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend09) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000755 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend12) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000749 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend06) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000757 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend05) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000745 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend09) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.630 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000074c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend11) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000747 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend06) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000074b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend04) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000074d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend01) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000759 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend02) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000074a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend07) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000957 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend12) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000746 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend03) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000075a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend07) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000752 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend04) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007b2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007a6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff10) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007a2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff11) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.631 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000079d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000095d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff14) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000079c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007a4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff11) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007aa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007b4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007a3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff10) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000079e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007a8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/00_Descriptions.txt) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007a0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff09) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007ae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff14) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.632 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007a7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/Makefile) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007b7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff12) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007b3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007ac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff13) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007a5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff09) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007b8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007ad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000079f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007a1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff08) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff12) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007b5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff07) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007b6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff08) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007ab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff07) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000007a9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff13) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.633 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000069d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff10) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000069b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006a5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000696 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff09) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006a9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff12) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006ac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff14) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006ae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006a2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff07) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000698 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff13) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006ab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff08) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff08) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000697 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006a1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/00_Descriptions.txt) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006a0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/Makefile) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006a8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff11) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.634 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000699 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000069a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff09) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000069e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006ad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000069f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006a7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff07) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006a3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff11) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000069c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006a4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff12) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff14) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006a6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff10) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.635 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000695 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006aa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff13) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000510 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000531 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000047d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_weakauth.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004b3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_bufcreate.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004fd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004e1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004be (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_pcreateerror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004c6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_control.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000005e4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.636 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000048b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svc_destroy.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000049e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000501 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_progvers.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000505 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004f3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004ce (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004a7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_tli_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000520 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcfd_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000490 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004bd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004f5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.637 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004ad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004e4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000047f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_tli_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004d5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004ee (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000487 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authnone_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004e5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_noprog.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004d6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004f7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authunix_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000053b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000512 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004d1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000486 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_bufcreate.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000047c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_vc_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.638 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000051e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000494 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcfd_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004b4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000050c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_sendreply.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004cf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004d7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_svc_destroy.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004fb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.basic.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000051d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004ef (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_svc_tp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004a0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_vc_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.639 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000051f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perror.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004b6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_perror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000533 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_control.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000484 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000051a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000049f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000504 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004c1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004f0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000497 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authunix_create_default.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.643 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004bc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authnone_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004e8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000496 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_bufcreate.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004fa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_getmaps.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004c9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004f6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004cc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000527 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000506 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcraw_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004c3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.644 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000522 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004ca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_auth_destroy.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004ae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000502 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000485 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_svc_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004bb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svc_destroy.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000500 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.basic.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000050e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.645 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000516 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authsys_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004a6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_progvers.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000499 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_bufcreate.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000482 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_dg_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000047e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004b2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004ea (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_noprog.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.646 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000005e2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004a8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004bf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000528 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004b7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_destroy.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000517 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_unset.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.647 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000052b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.648 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000523 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000534 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_geterr.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004a5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.649 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004ba (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004d4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_systemerr.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000053a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getargs.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004b9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authsys_create_default.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004d2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_dg_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000050d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000529 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000537 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_tli_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000049a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_svc_unregister.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000525 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_sperrno.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004f4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.650 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000503 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_xprt_unregister.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000483 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_getport.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000049d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004f9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004a1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004f1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_noproc.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000509 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000048e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000491 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_dg_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004c7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getaddr.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000495 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_freeargs.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000050a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000050b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000513 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_unset.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.651 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000051b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004e2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perrno.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000051c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcraw_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004ec (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_control.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000052e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004cb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000507 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000518 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create_timed.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004a9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_perrno.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004c8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getcaller.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004b5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004b8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004cd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.652 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000493 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004f2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004e0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004db (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004e6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_spcreateerror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000536 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_destroy.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004dd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getmaps.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000048a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004d0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000489 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create_timed.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000526 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000049b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_sperror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000048f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_control.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004ab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000511 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_vc_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.653 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004c5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000530 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004ff (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_svc_register.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000052d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authdes_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000492 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000515 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_systemerr.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004a2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004a4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000052c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_get_myaddress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004c0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000524 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000480 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getargs.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004ed (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.654 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000508 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004df (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_dg_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004eb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_xprt_register.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000005e3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004c2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000539 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_pcreateerror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000488 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000052f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004ac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000514 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_registerrpc.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004fc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create_timed.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004d3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000538 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004c4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004e9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authdes_seccreate.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.655 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000048c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000481 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000519 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perrno.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000050f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_auth.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004de (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000535 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000498 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_set.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004e7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_freeres.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004d9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_noproc.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create_timed.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000072d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004e3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_set.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000049c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_destroy.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.656 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004aa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_create.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004d8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_weakauth.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004f8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000048d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_tli_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004dc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_vc_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000521 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004fe (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004a3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000052a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000004da (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000532 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getaddr.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.657 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000953 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srao_mem_scrub_noripv) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000096b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_over) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000954 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_no_en) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.658 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000096c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srao_ewb_noripv) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000096a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_unkown) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000ac4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/s0_ar1) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000989 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_ucna) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000988 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_no_en) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000984 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_unknown) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000987 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_corrected) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000985 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_ewb) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000986 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_over) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000bdb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_mem_scrub) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: pgmap v398: 97 pgs: 97 active+clean; 626 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 MiB/s rd, 96 MiB/s wr, 1.87k op/s 2024-01-25T15:03:39.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.659 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.660 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.661 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000709 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_err_svcerr_progvers/1-basic.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000462 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_err_svcerr_progvers/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:39.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.662 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:39 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:39.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000d61 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_000.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000d62 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/Makefile.in) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000d5a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_009.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000d66 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_004.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000d5c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_008.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000d5b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_012.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000d67 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/Makefile.am) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000d5e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_007.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000067b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000067e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000676 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000681 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000679 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000677 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000067d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/00_Descriptions.txt) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000067a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000067c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/Makefile) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000682 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000067f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000680 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000084a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000678 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000753 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend14) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000075c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend03) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000754 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend13) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000756 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend01) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000075b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend08) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.737 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000075d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend05) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000750 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend02) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000760 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend13) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000075f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend08) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000751 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/00_Descriptions.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000758 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend14) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000074e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/Makefile) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000748 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend11) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000075e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend10) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000074f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend10) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000761 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend09) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000755 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend12) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000749 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend06) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000757 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend05) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.738 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000745 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend09) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000074c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend11) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000747 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend06) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000074b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend04) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000074d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend01) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000759 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend02) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000074a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend07) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000957 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend12) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000746 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend03) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000075a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend07) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000752 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend04) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007b2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.739 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007a6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff10) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007a2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff11) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000079d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000095d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff14) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000079c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007a4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff11) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007aa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007b4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007a3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff10) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000079e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.740 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007a8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/00_Descriptions.txt) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007a0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff09) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007ae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff14) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007a7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/Makefile) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007b7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff12) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007b3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007ac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff13) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007a5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff09) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007b8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007ad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000079f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007a1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff08) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff12) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007b5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff07) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007b6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff08) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007ab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff07) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.741 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000007a9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff13) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000069d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff10) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000069b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006a5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000696 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff09) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006a9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff12) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006ac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff14) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006ae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006a2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff07) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000698 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff13) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006ab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff08) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff08) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000697 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006a1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/00_Descriptions.txt) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.742 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006a0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/Makefile) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006a8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff11) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000699 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000069a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff09) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000069e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006ad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000069f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006a7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff07) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006a3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff11) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000069c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006a4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff12) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.743 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff14) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006a6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff10) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000695 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006aa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff13) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.744 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000510 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000531 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000047d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_weakauth.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004b3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_bufcreate.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004fd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004e1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004be (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_pcreateerror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.747 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004c6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_control.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000005e4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000048b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svc_destroy.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000049e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000501 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_progvers.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000505 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004f3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004ce (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004a7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_tli_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000520 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcfd_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000490 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004bd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004f5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.748 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004ad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004e4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000047f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_tli_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004d5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004ee (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000487 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authnone_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004e5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_noprog.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004d6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004f7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authunix_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000053b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000512 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004d1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000486 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_bufcreate.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.749 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000047c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_vc_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000051e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000494 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcfd_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004b4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000050c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_sendreply.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004cf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004d7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_svc_destroy.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004fb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.basic.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000051d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004ef (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_svc_tp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004a0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_vc_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000051f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perror.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004b6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_perror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000533 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_control.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000484 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.750 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000051a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000049f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000504 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004c1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004f0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000497 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authunix_create_default.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004bc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authnone_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004e8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000496 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_bufcreate.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004fa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_getmaps.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004c9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004f6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004cc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.751 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000527 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000506 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcraw_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004c3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000522 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004ca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_auth_destroy.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004ae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000502 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000485 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_svc_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004bb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svc_destroy.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000500 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.basic.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000050e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000516 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authsys_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004a6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_progvers.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000499 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_bufcreate.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.752 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000482 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_dg_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000047e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004b2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004ea (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_noprog.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000005e2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004a8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004bf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000528 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004b7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_destroy.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000517 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_unset.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000052b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000523 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000534 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_geterr.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004a5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004ba (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.753 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004d4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_systemerr.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000053a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getargs.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004b9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authsys_create_default.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004d2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_dg_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000050d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000529 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000537 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_tli_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000049a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_svc_unregister.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000525 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_sperrno.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004f4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000503 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_xprt_unregister.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.754 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000483 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_getport.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000049d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004f9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004a1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004f1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_noproc.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000509 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000048e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000491 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_dg_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004c7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getaddr.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000495 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_freeargs.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000050a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000050b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000513 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_unset.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.755 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000051b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004e2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perrno.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000051c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcraw_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004ec (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_control.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000052e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004cb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000507 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000518 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create_timed.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004a9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_perrno.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004c8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getcaller.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004b5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004b8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004cd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000493 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.756 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004f2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004e0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004db (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004e6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_spcreateerror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000536 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_destroy.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004dd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getmaps.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000048a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004d0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000489 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create_timed.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000526 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000049b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_sperror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000048f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_control.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004ab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.757 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000511 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_vc_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004c5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000530 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004ff (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_svc_register.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000052d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authdes_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000492 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000515 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_systemerr.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004a2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004a4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000052c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_get_myaddress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004c0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000524 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000480 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getargs.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004ed (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.758 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000508 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004df (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_dg_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004eb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_xprt_register.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000005e3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004c2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000539 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_pcreateerror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000488 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000052f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004ac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000514 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_registerrpc.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004fc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create_timed.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004d3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000538 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004c4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.759 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004e9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authdes_seccreate.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000048c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000481 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000519 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perrno.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000050f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_auth.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004de (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000535 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000498 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_set.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004e7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_freeres.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004d9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_noproc.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create_timed.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000072d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004e3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_set.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.760 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000049c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_destroy.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004aa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_create.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004d8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_weakauth.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004f8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000048d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_tli_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004dc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_vc_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000521 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004fe (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004a3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000052a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000004da (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.761 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000532 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getaddr.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.762 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000953 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srao_mem_scrub_noripv) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.763 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000096b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_over) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000954 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_no_en) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000096c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srao_ewb_noripv) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000096a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_unkown) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000ac4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/s0_ar1) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000989 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_ucna) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000988 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_no_en) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000984 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_unknown) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000987 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_corrected) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000985 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_ewb) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000986 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_over) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000bdb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_mem_scrub) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.764 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: pgmap v398: 97 pgs: 97 active+clean; 626 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 MiB/s rd, 96 MiB/s wr, 1.87k op/s 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.765 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.766 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000709 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_err_svcerr_progvers/1-basic.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000462 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_err_svcerr_progvers/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:39.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.767 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:39 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:39.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000d63 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_005.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000f4b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_006.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000d5d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_010.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000d5f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_003.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000d59 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_002.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000d64 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_011.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000d60 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_001.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000d65 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_013.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000d61 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_000.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000d62 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/Makefile.in) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000d5a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_009.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.856 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000d66 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_004.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000d5c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_008.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000d5b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_012.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000d67 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/Makefile.am) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000d5e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_007.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000067b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000067e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000676 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000681 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000679 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000677 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.857 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000067d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/00_Descriptions.txt) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.858 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000067a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.858 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000067c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/Makefile) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.858 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000682 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.858 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000067f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.858 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000680 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.858 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000084a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.858 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000678 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.858 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.858 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.858 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000753 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend14) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.858 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000075c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend03) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.858 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000754 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend13) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.858 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000756 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend01) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.858 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000075b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend08) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.859 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000075d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend05) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.859 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000750 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend02) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.859 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000760 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend13) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.859 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000075f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend08) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.859 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000751 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/00_Descriptions.txt) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.859 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000758 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend14) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.859 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000074e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/Makefile) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.859 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000748 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend11) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.859 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000075e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend10) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.859 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000074f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend10) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.859 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000761 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend09) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.859 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000755 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend12) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.859 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000749 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend06) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.859 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000757 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend05) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.859 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000745 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend09) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.860 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000074c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend11) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.860 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000747 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend06) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.860 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000074b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend04) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.860 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000074d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend01) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.860 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000759 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend02) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.860 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000074a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend07) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.860 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000957 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend12) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.860 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000746 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend03) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.860 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000075a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend07) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.860 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000752 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend04) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.860 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.861 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.861 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007b2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.861 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007a6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff10) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.861 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007a2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff11) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.861 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.861 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000079d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.861 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000095d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff14) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.861 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000079c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.861 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007a4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff11) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.861 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007aa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.861 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007b4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.861 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.861 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007a3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff10) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.861 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000079e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007a8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/00_Descriptions.txt) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007a0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff09) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007ae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff14) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007a7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/Makefile) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007b7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff12) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007b3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007ac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff13) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007a5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff09) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007b8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007ad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000079f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007a1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff08) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.862 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff12) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.863 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007b5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff07) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.863 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007b6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff08) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.863 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007ab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff07) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.863 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000007a9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff13) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.863 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000069d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff10) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.863 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000069b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.863 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006a5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.863 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000696 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff09) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.863 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006a9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff12) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.863 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006ac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff14) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.863 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006ae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.863 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006a2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff07) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.866 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000698 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff13) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.866 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006ab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff08) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.866 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff08) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.866 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000697 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff02) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.866 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006a1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/00_Descriptions.txt) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.866 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006a0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/Makefile) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.866 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006a8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff11) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.867 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000699 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.867 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000069a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff09) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.867 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000069e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff05) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.867 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006ad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff03) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.867 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000069f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.867 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006a7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff07) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.867 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.867 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006a3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff11) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.867 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000069c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff04) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.867 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006a4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff12) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.867 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff01) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.867 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000853 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff14) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.867 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006a6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff10) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.867 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000695 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff06) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.868 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006aa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff13) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.868 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.868 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.868 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000510 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.868 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000531 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.868 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000047d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_weakauth.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.868 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004b3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_bufcreate.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.868 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004fd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.868 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004e1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.868 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004be (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_pcreateerror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.868 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004c6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_control.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.868 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000005e4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.869 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000048b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svc_destroy.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.869 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000049e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.869 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000501 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_progvers.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.869 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000505 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.869 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004f3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.869 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004ce (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.869 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004a7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_tli_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.869 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000520 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcfd_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.869 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000490 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.870 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004bd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.870 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004f5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.870 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004ad (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.870 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004e4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.870 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000047f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_tli_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.870 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004d5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.870 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004ee (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.870 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000487 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authnone_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.870 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004e5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_noprog.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.870 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004d6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.870 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004f7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authunix_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.870 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000053b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.870 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000512 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.870 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004d1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.871 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000486 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_bufcreate.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.871 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000047c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_vc_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.871 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000051e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.871 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000494 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcfd_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.871 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004b4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.871 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000050c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_sendreply.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.871 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004cf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.871 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004d7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_svc_destroy.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.871 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004fb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.basic.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.871 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000051d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.871 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004ef (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_svc_tp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.871 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004a0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_vc_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.871 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000051f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perror.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.871 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004b6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_perror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.872 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000533 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_control.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.872 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000484 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.872 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000051a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.872 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000049f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.872 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000504 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.872 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004c1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.872 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004f0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.872 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000497 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authunix_create_default.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.872 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004bc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authnone_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.872 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004e8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.872 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000496 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_bufcreate.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.872 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004fa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_getmaps.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.872 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004c9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.873 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004f6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.873 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004cc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.873 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000527 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.873 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000506 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcraw_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.873 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004c3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.873 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000522 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.873 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004ca (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_auth_destroy.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.873 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004ae (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.873 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000502 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.873 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000485 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_svc_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.873 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004bb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svc_destroy.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.873 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000500 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.basic.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.873 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000050e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.874 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000516 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authsys_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.874 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004a6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_progvers.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.874 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000499 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_bufcreate.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.874 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000482 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_dg_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.874 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000047e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.874 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004b2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.874 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004ea (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_noprog.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.874 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000005e2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.874 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004a8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.874 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004bf (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.874 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000528 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.874 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004b7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_destroy.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.874 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000517 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_unset.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.875 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000052b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.875 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000523 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.875 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000534 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_geterr.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.875 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004a5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.875 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004ba (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.875 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004d4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_systemerr.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.875 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000053a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getargs.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.875 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004b9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authsys_create_default.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.875 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004d2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_dg_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.875 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000050d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.875 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000529 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.875 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000537 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.875 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004af (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_tli_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.875 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000049a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.875 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004b1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_svc_unregister.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.876 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000525 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_sperrno.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.876 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004f4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.876 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000503 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_xprt_unregister.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.876 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000483 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_getport.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.876 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000049d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.876 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004f9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.876 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004a1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.876 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004f1 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_noproc.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.876 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000509 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.876 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000048e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.876 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000491 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_dg_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.876 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004c7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getaddr.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.876 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000495 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_freeargs.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.876 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000050a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.877 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000050b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.877 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000513 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_unset.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.877 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000051b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.877 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004e2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perrno.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.877 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000051c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcraw_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.877 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004ec (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_control.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.877 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000052e (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.877 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004cb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.877 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000507 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.877 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000518 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create_timed.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.877 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004a9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_perrno.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.877 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004c8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getcaller.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.877 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004b5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.877 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004b8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.877 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004cd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.878 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000493 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.878 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004f2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.878 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004e0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.878 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004db (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.878 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004e6 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_spcreateerror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.878 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000536 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_destroy.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.878 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004dd (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getmaps.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.878 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000048a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.878 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004d0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.878 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000489 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create_timed.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.878 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000526 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.dataint.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.878 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000049b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_sperror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.878 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000048f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_control.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.879 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004ab (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.879 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000511 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_vc_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.879 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004c5 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.879 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000530 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.879 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004ff (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_svc_register.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.879 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000052d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authdes_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.879 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000492 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.879 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000515 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_systemerr.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.879 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004a2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.879 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004a4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.879 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000052c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_get_myaddress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.879 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004c0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.880 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000524 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.880 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000480 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getargs.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.880 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004ed (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.880 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000508 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.880 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004df (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_dg_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.880 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004eb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_xprt_register.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.880 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000005e3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.880 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004c2 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.880 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000539 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_pcreateerror.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.880 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000488 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.880 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000052f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.880 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004ac (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.880 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000514 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_registerrpc.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.881 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004fc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create_timed.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.881 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004d3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.881 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000538 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.881 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004c4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.881 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004e9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authdes_seccreate.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.881 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000048c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.881 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000481 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.881 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000519 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perrno.complex.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.881 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000050f (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_auth.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.881 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004de (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.881 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000535 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.881 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000498 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_set.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.881 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004e7 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_freeres.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.881 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004d9 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_noproc.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.881 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004b0 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create_timed.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.882 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000072d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.882 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004e3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_set.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.882 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000049c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_destroy.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.882 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004aa (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_create.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.882 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004d8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_weakauth.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.882 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004f8 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.stress.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.882 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000048d (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_tli_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.882 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004dc (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_vc_create.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.882 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000521 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.performance.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.882 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004fe (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.mt.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.882 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004a3 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.882 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000052a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.scalability.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.882 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000004da (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.882 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000532 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getaddr.limits.sh) see mds.b log and `damage ls` output for details 2024-01-25T15:03:39.882 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000953 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srao_mem_scrub_noripv) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000096b (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_over) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.883 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000954 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_no_en) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.884 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000096c (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srao_ewb_noripv) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.884 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000096a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_unkown) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.884 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000ac4 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/s0_ar1) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.884 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000989 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_ucna) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.884 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000988 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_no_en) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.884 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000984 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_unknown) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.884 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000987 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_corrected) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.884 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000985 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_ewb) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.884 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000986 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_over) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.884 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000bdb (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_mem_scrub) see mds.k log and `damage ls` output for details 2024-01-25T15:03:39.884 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.884 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.884 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: pgmap v398: 97 pgs: 97 active+clean; 626 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 MiB/s rd, 96 MiB/s wr, 1.87k op/s 2024-01-25T15:03:39.884 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.884 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.885 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.886 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.886 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.886 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.886 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.886 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.886 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.886 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.886 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.886 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.886 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.886 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.886 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.886 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.886 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000709 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_err_svcerr_progvers/1-basic.c) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.886 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000462 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_err_svcerr_progvers/assertions.xml) see mds.c log and `damage ls` output for details 2024-01-25T15:03:39.887 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.887 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.887 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.887 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:39.887 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.887 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:39.887 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:39 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:40.169 INFO:tasks.workunit.client.0.smithi170.stdout:6/410: sync 2024-01-25T15:03:40.169 INFO:tasks.workunit.client.0.smithi170.stdout:8/376: sync 2024-01-25T15:03:40.170 INFO:tasks.workunit.client.0.smithi170.stdout:4/340: sync 2024-01-25T15:03:40.170 INFO:tasks.workunit.client.0.smithi170.stdout:0/404: sync 2024-01-25T15:03:40.170 INFO:tasks.workunit.client.0.smithi170.stdout:1/383: sync 2024-01-25T15:03:40.170 INFO:tasks.workunit.client.0.smithi170.stdout:5/344: sync 2024-01-25T15:03:40.170 INFO:tasks.workunit.client.0.smithi170.stdout:7/423: sync 2024-01-25T15:03:40.170 INFO:tasks.workunit.client.0.smithi170.stdout:9/415: sync 2024-01-25T15:03:40.170 INFO:tasks.workunit.client.0.smithi170.stdout:3/472: sync 2024-01-25T15:03:40.170 INFO:tasks.workunit.client.0.smithi170.stdout:8/377: write d3/d7/f10 [724483,98977] 0 2024-01-25T15:03:40.170 INFO:tasks.workunit.client.0.smithi170.stdout:2/437: sync 2024-01-25T15:03:40.170 INFO:tasks.workunit.client.0.smithi170.stdout:2/438: chown d10/d1e/d32/d62/l83 134588 1 2024-01-25T15:03:40.171 INFO:tasks.workunit.client.0.smithi170.stdout:5/345: link c4 d5/d10/d7d/c81 0 2024-01-25T15:03:40.174 INFO:tasks.workunit.client.0.smithi170.stdout:1/384: rename d0/d1b/c47 to d0/d50/c88 0 2024-01-25T15:03:40.177 INFO:tasks.workunit.client.0.smithi170.stdout:0/405: creat d8/d10/d2d/d89/f8d x:0 0 0 2024-01-25T15:03:40.183 INFO:tasks.workunit.client.0.smithi170.stdout:9/416: link d5/df/d16/l78 d5/df/l99 0 2024-01-25T15:03:40.184 INFO:tasks.workunit.client.0.smithi170.stdout:2/439: unlink d10/d1e/l4d 0 2024-01-25T15:03:40.184 INFO:tasks.workunit.client.0.smithi170.stdout:2/440: readlink d10/l17 0 2024-01-25T15:03:40.191 INFO:tasks.workunit.client.0.smithi170.stdout:4/341: dread f2 [0,4194304] 0 2024-01-25T15:03:40.194 INFO:tasks.workunit.client.0.smithi170.stdout:5/346: creat d5/d10/d7d/f82 x:0 0 0 2024-01-25T15:03:40.204 INFO:tasks.workunit.client.0.smithi170.stdout:5/347: creat d5/d10/d2c/d34/d7c/f83 x:0 0 0 2024-01-25T15:03:40.205 INFO:tasks.workunit.client.0.smithi170.stdout:5/348: creat d5/d54/f84 x:0 0 0 2024-01-25T15:03:40.209 INFO:tasks.workunit.client.0.smithi170.stdout:4/342: write d6/d28/f52 [781075,63666] 0 2024-01-25T15:03:40.211 INFO:tasks.workunit.client.0.smithi170.stdout:4/343: mkdir d6/d28/d61 0 2024-01-25T15:03:40.211 INFO:tasks.workunit.client.0.smithi170.stdout:4/344: write d6/d7/d31/f43 [4772855,25071] 0 2024-01-25T15:03:40.211 INFO:tasks.workunit.client.0.smithi170.stdout:4/345: truncate d6/f49 84026 0 2024-01-25T15:03:40.211 INFO:tasks.workunit.client.0.smithi170.stdout:1/385: dread d0/f33 [0,4194304] 0 2024-01-25T15:03:40.213 INFO:tasks.workunit.client.0.smithi170.stdout:1/386: creat d0/d20/d28/d2a/d4a/d56/d81/f89 x:0 0 0 2024-01-25T15:03:40.214 INFO:tasks.workunit.client.0.smithi170.stdout:1/387: rmdir d0/d20/d28/d2a/d4a/d56 39 2024-01-25T15:03:40.214 INFO:tasks.workunit.client.0.smithi170.stdout:1/388: read d0/f41 [114775,53100] 0 2024-01-25T15:03:40.215 INFO:tasks.workunit.client.0.smithi170.stdout:1/389: truncate d0/d20/f4d 3826957 0 2024-01-25T15:03:40.216 INFO:tasks.workunit.client.0.smithi170.stdout:1/390: rmdir d0/d20/d28/d2a/d57 39 2024-01-25T15:03:40.216 INFO:tasks.workunit.client.0.smithi170.stdout:1/391: fsync d0/d20/d28/d2a/d4a/d56/f64 0 2024-01-25T15:03:40.220 INFO:tasks.workunit.client.0.smithi170.stdout:4/346: write d6/d7/d31/f3f [1936884,14497] 0 2024-01-25T15:03:40.226 INFO:tasks.workunit.client.0.smithi170.stdout:6/411: dwrite d2/d7/d23/f2d [0,4194304] 0 2024-01-25T15:03:40.226 INFO:tasks.workunit.client.0.smithi170.stdout:7/424: dwrite d8/d20/d2a/fa2 [0,4194304] 0 2024-01-25T15:03:40.226 INFO:tasks.workunit.client.0.smithi170.stdout:7/425: fdatasync d8/d20/d2a/d61/f77 0 2024-01-25T15:03:40.226 INFO:tasks.workunit.client.0.smithi170.stdout:8/378: dwrite d3/d7/d22/d23/d48/d52/f35 [0,4194304] 0 2024-01-25T15:03:40.226 INFO:tasks.workunit.client.0.smithi170.stdout:0/406: dwrite d8/d10/d2d/d53/f60 [0,4194304] 0 2024-01-25T15:03:40.226 INFO:tasks.workunit.client.0.smithi170.stdout:3/473: dwrite d3/d1c/d2b/f7f [4194304,4194304] 0 2024-01-25T15:03:40.226 INFO:tasks.workunit.client.0.smithi170.stdout:8/379: dread d3/d7/d22/d23/d48/d52/f43 [0,4194304] 0 2024-01-25T15:03:40.228 INFO:tasks.workunit.client.0.smithi170.stdout:6/412: symlink d2/d7/d23/d19/l8c 0 2024-01-25T15:03:40.235 INFO:tasks.workunit.client.0.smithi170.stdout:7/426: rmdir d8/d20/d45 39 2024-01-25T15:03:40.237 INFO:tasks.workunit.client.0.smithi170.stdout:3/474: mknod d3/d3b/c93 0 2024-01-25T15:03:40.237 INFO:tasks.workunit.client.0.smithi170.stdout:1/392: dread d0/d20/d28/f6a [0,4194304] 0 2024-01-25T15:03:40.238 INFO:tasks.workunit.client.0.smithi170.stdout:7/427: write d8/d20/d2a/f34 [2983823,15526] 0 2024-01-25T15:03:40.239 INFO:tasks.workunit.client.0.smithi170.stdout:7/428: fdatasync d8/d20/d2a/fa2 0 2024-01-25T15:03:40.239 INFO:tasks.workunit.client.0.smithi170.stdout:7/429: write d8/d20/d45/d68/f84 [1250893,48502] 0 2024-01-25T15:03:40.239 INFO:tasks.workunit.client.0.smithi170.stdout:8/380: mkdir d3/d7/d1e/d7c 0 2024-01-25T15:03:40.239 INFO:tasks.workunit.client.0.smithi170.stdout:8/381: fsync d3/d7/d22/f5a 0 2024-01-25T15:03:40.239 INFO:tasks.workunit.client.0.smithi170.stdout:8/382: fsync d3/d7/d1e/f5e 0 2024-01-25T15:03:40.240 INFO:tasks.workunit.client.0.smithi170.stdout:0/407: write d8/d10/d2d/d53/f60 [1588602,28621] 0 2024-01-25T15:03:40.240 INFO:tasks.workunit.client.0.smithi170.stdout:0/408: read d8/d18/f3b [2990,82074] 0 2024-01-25T15:03:40.240 INFO:tasks.workunit.client.0.smithi170.stdout:0/409: creat d8/d3a/f8e x:0 0 0 2024-01-25T15:03:40.241 INFO:tasks.workunit.client.0.smithi170.stdout:0/410: chown d8/d9/l6b 8730 1 2024-01-25T15:03:40.241 INFO:tasks.workunit.client.0.smithi170.stdout:0/411: chown d8/d10/d2d/c3c 2860934 1 2024-01-25T15:03:40.241 INFO:tasks.workunit.client.0.smithi170.stdout:6/413: truncate d2/d7/d23/d19/f24 2316410 0 2024-01-25T15:03:40.241 INFO:tasks.workunit.client.0.smithi170.stdout:6/414: dread - d2/d7/d23/d19/d2a/f79 zero size 2024-01-25T15:03:40.241 INFO:tasks.workunit.client.0.smithi170.stdout:6/415: fdatasync d2/f40 0 2024-01-25T15:03:40.246 INFO:tasks.workunit.client.0.smithi170.stdout:4/347: dwrite d6/d7/d34/f5c [0,4194304] 0 2024-01-25T15:03:40.255 INFO:tasks.workunit.client.0.smithi170.stdout:8/383: symlink d3/d7/d3a/l7d 0 2024-01-25T15:03:40.255 INFO:tasks.workunit.client.0.smithi170.stdout:8/384: fdatasync d3/d7/f62 0 2024-01-25T15:03:40.257 INFO:tasks.workunit.client.0.smithi170.stdout:4/348: mknod d6/c62 0 2024-01-25T15:03:40.257 INFO:tasks.workunit.client.0.smithi170.stdout:4/349: write d6/d28/f56 [614791,66701] 0 2024-01-25T15:03:40.257 INFO:tasks.workunit.client.0.smithi170.stdout:4/350: chown d6/d7/d1b/c51 61 1 2024-01-25T15:03:40.257 INFO:tasks.workunit.client.0.smithi170.stdout:8/385: truncate d3/d7/f16 587657 0 2024-01-25T15:03:40.259 INFO:tasks.workunit.client.0.smithi170.stdout:4/351: symlink d6/l63 0 2024-01-25T15:03:40.261 INFO:tasks.workunit.client.0.smithi170.stdout:8/386: mknod d3/d7/d22/d23/d25/d34/d6d/c7e 0 2024-01-25T15:03:40.261 INFO:tasks.workunit.client.0.smithi170.stdout:6/416: read d2/d7/f2e [446611,75587] 0 2024-01-25T15:03:40.261 INFO:tasks.workunit.client.0.smithi170.stdout:7/430: dwrite d8/d20/d2a/d35/d55/d6e/f89 [0,4194304] 0 2024-01-25T15:03:40.262 INFO:tasks.workunit.client.0.smithi170.stdout:8/387: mkdir d3/d7/d1e/d74/d7f 0 2024-01-25T15:03:40.271 INFO:tasks.workunit.client.0.smithi170.stdout:7/431: write d8/d20/f22 [2752885,2073] 0 2024-01-25T15:03:40.273 INFO:tasks.workunit.client.0.smithi170.stdout:7/432: mkdir d8/d20/d45/d68/daa 0 2024-01-25T15:03:40.273 INFO:tasks.workunit.client.0.smithi170.stdout:7/433: chown d8/d20/d45/d68/d71 4767 1 2024-01-25T15:03:40.274 INFO:tasks.workunit.client.0.smithi170.stdout:4/352: dread d6/d7/d34/f30 [0,4194304] 0 2024-01-25T15:03:40.276 INFO:tasks.workunit.client.0.smithi170.stdout:8/388: write d3/d7/d22/d23/d48/d52/f35 [2966850,33266] 0 2024-01-25T15:03:40.276 INFO:tasks.workunit.client.0.smithi170.stdout:9/417: rename c0 to d5/df/d2e/d77/d21/d63/d96/c9a 0 2024-01-25T15:03:40.278 INFO:tasks.workunit.client.0.smithi170.stdout:8/389: mkdir d3/d7/d22/d80 0 2024-01-25T15:03:40.278 INFO:tasks.workunit.client.0.smithi170.stdout:8/390: creat d3/d7/d22/d23/d48/f81 x:0 0 0 2024-01-25T15:03:40.287 INFO:tasks.workunit.client.0.smithi170.stdout:6/417: dwrite d2/d7/d23/d19/f83 [0,4194304] 0 2024-01-25T15:03:40.287 INFO:tasks.workunit.client.0.smithi170.stdout:7/434: dread d8/f9e [0,4194304] 0 2024-01-25T15:03:40.288 INFO:tasks.workunit.client.0.smithi170.stdout:6/418: mknod d2/d7/d23/d19/d2a/c8d 0 2024-01-25T15:03:40.292 INFO:tasks.workunit.client.0.smithi170.stdout:2/441: rename d10/d1e/l3a to d10/d1e/d32/d3e/d5c/la4 0 2024-01-25T15:03:40.294 INFO:tasks.workunit.client.0.smithi170.stdout:2/442: creat d10/d1e/d32/d98/fa5 x:0 0 0 2024-01-25T15:03:40.294 INFO:tasks.workunit.client.0.smithi170.stdout:2/443: chown d10/d1b/c5b 8345576 1 2024-01-25T15:03:40.294 INFO:tasks.workunit.client.0.smithi170.stdout:2/444: write d10/d1e/f26 [1300520,78677] 0 2024-01-25T15:03:40.294 INFO:tasks.workunit.client.0.smithi170.stdout:9/418: write d5/dc/f30 [2920137,128668] 0 2024-01-25T15:03:40.297 INFO:tasks.workunit.client.0.smithi170.stdout:9/419: symlink d5/df/d16/d35/d3c/d56/d59/l9b 0 2024-01-25T15:03:40.301 INFO:tasks.workunit.client.0.smithi170.stdout:9/420: mkdir d5/df/d16/d52/d9c 0 2024-01-25T15:03:40.303 INFO:tasks.workunit.client.0.smithi170.stdout:9/421: symlink d5/df/d16/d35/d3c/l9d 0 2024-01-25T15:03:40.303 INFO:tasks.workunit.client.0.smithi170.stdout:9/422: readlink d5/df/l99 0 2024-01-25T15:03:40.304 INFO:tasks.workunit.client.0.smithi170.stdout:9/423: write d5/df/d2e/d77/f2a [289513,100423] 0 2024-01-25T15:03:40.304 INFO:tasks.workunit.client.0.smithi170.stdout:9/424: truncate f4 1761085 0 2024-01-25T15:03:40.305 INFO:tasks.workunit.client.0.smithi170.stdout:9/425: mknod d5/df/d2e/d77/d21/d63/c9e 0 2024-01-25T15:03:40.307 INFO:tasks.workunit.client.0.smithi170.stdout:9/426: rmdir d5/df/d2e/d90 0 2024-01-25T15:03:40.307 INFO:tasks.workunit.client.0.smithi170.stdout:9/427: readlink d5/df/d16/l43 0 2024-01-25T15:03:40.308 INFO:tasks.workunit.client.0.smithi170.stdout:2/445: dread ff [0,4194304] 0 2024-01-25T15:03:40.308 INFO:tasks.workunit.client.0.smithi170.stdout:9/428: dread d5/df/d16/d35/d3c/d56/d59/f80 [0,4194304] 0 2024-01-25T15:03:40.310 INFO:tasks.workunit.client.0.smithi170.stdout:7/435: dwrite d8/f92 [0,4194304] 0 2024-01-25T15:03:40.310 INFO:tasks.workunit.client.0.smithi170.stdout:9/429: mknod d5/df/d2e/d77/d21/d46/d18/c9f 0 2024-01-25T15:03:40.311 INFO:tasks.workunit.client.0.smithi170.stdout:2/446: rmdir d10/d1e/d32/d3e/d5c 39 2024-01-25T15:03:40.314 INFO:tasks.workunit.client.0.smithi170.stdout:5/349: rename d5/d10 to d5/d54/d85 0 2024-01-25T15:03:40.316 INFO:tasks.workunit.client.0.smithi170.stdout:6/419: dwrite d2/d7/d23/d19/d2f/f32 [4194304,4194304] 0 2024-01-25T15:03:40.317 INFO:tasks.workunit.client.0.smithi170.stdout:1/393: rename d0/d20/d28/d2a/d57/f78 to d0/d20/d28/d7b/f8a 0 2024-01-25T15:03:40.320 INFO:tasks.workunit.client.0.smithi170.stdout:0/412: rename d8/f42 to d8/d10/d2d/d2f/d4f/d5f/f8f 0 2024-01-25T15:03:40.321 INFO:tasks.workunit.client.0.smithi170.stdout:0/413: mknod d8/d10/d5a/d7f/c90 0 2024-01-25T15:03:40.321 INFO:tasks.workunit.client.0.smithi170.stdout:0/414: chown f2 723 1 2024-01-25T15:03:40.329 INFO:tasks.workunit.client.0.smithi170.stdout:2/447: read d10/d1b/f56 [1736111,72700] 0 2024-01-25T15:03:40.329 INFO:tasks.workunit.client.0.smithi170.stdout:2/448: readlink d10/d1b/d5f/l5a 0 2024-01-25T15:03:40.333 INFO:tasks.workunit.client.0.smithi170.stdout:9/430: dwrite d5/df/d16/f2b [4194304,4194304] 0 2024-01-25T15:03:40.338 INFO:tasks.workunit.client.0.smithi170.stdout:5/350: dwrite d5/d54/d85/f21 [0,4194304] 0 2024-01-25T15:03:40.339 INFO:tasks.workunit.client.0.smithi170.stdout:7/436: write d8/f17 [1905347,65094] 0 2024-01-25T15:03:40.339 INFO:tasks.workunit.client.0.smithi170.stdout:7/437: readlink d8/d20/d45/l47 0 2024-01-25T15:03:40.339 INFO:tasks.workunit.client.0.smithi170.stdout:7/438: readlink d8/d20/d45/l47 0 2024-01-25T15:03:40.341 INFO:tasks.workunit.client.0.smithi170.stdout:9/431: creat d5/fa0 x:0 0 0 2024-01-25T15:03:40.343 INFO:tasks.workunit.client.0.smithi170.stdout:5/351: rename d5/d54/d85/d7d to d5/d54/d85/d3f/d86 0 2024-01-25T15:03:40.344 INFO:tasks.workunit.client.0.smithi170.stdout:9/432: mkdir d5/df/d16/da1 0 2024-01-25T15:03:40.345 INFO:tasks.workunit.client.0.smithi170.stdout:6/420: dwrite d2/d7/d23/d19/f20 [0,4194304] 0 2024-01-25T15:03:40.346 INFO:tasks.workunit.client.0.smithi170.stdout:6/421: fdatasync d2/d7/d1b/f1f 0 2024-01-25T15:03:40.347 INFO:tasks.workunit.client.0.smithi170.stdout:0/415: write d8/d10/f2b [7319813,35282] 0 2024-01-25T15:03:40.348 INFO:tasks.workunit.client.0.smithi170.stdout:5/352: creat d5/d54/d85/d2c/d51/d3d/d57/f87 x:0 0 0 2024-01-25T15:03:40.348 INFO:tasks.workunit.client.0.smithi170.stdout:9/433: creat d5/df/d16/d35/d3c/fa2 x:0 0 0 2024-01-25T15:03:40.348 INFO:tasks.workunit.client.0.smithi170.stdout:9/434: dread - d5/df/d16/d35/d3c/f5f zero size 2024-01-25T15:03:40.349 INFO:tasks.workunit.client.0.smithi170.stdout:1/394: dwrite d0/d20/d28/d2a/d4a/d56/f64 [0,4194304] 0 2024-01-25T15:03:40.350 INFO:tasks.workunit.client.0.smithi170.stdout:6/422: link d2/d7/d23/d19/d2a/l38 d2/d7/d23/d19/d2f/d74/l8e 0 2024-01-25T15:03:40.351 INFO:tasks.workunit.client.0.smithi170.stdout:6/423: getdents d2/d7/d1b/d28/d89 0 2024-01-25T15:03:40.351 INFO:tasks.workunit.client.0.smithi170.stdout:6/424: write d2/d7/d23/d19/f29 [3833102,90451] 0 2024-01-25T15:03:40.353 INFO:tasks.workunit.client.0.smithi170.stdout:5/353: link d5/d54/d85/f59 d5/d58/f88 0 2024-01-25T15:03:40.355 INFO:tasks.workunit.client.0.smithi170.stdout:0/416: creat d8/d80/f91 x:0 0 0 2024-01-25T15:03:40.355 INFO:tasks.workunit.client.0.smithi170.stdout:0/417: chown d8/d10/f2e 513013 1 2024-01-25T15:03:40.355 INFO:tasks.workunit.client.0.smithi170.stdout:0/418: read d8/d18/f84 [3319645,46553] 0 2024-01-25T15:03:40.355 INFO:tasks.workunit.client.0.smithi170.stdout:0/419: chown d8/ff 297251325 1 2024-01-25T15:03:40.355 INFO:tasks.workunit.client.0.smithi170.stdout:0/420: dread - d8/d10/d2d/d53/f63 zero size 2024-01-25T15:03:40.356 INFO:tasks.workunit.client.0.smithi170.stdout:0/421: rmdir d8/d18 39 2024-01-25T15:03:40.357 INFO:tasks.workunit.client.0.smithi170.stdout:0/422: symlink d8/d10/d2d/d2f/l92 0 2024-01-25T15:03:40.360 INFO:tasks.workunit.client.0.smithi170.stdout:7/439: dwrite d8/d20/d2a/d35/d55/f69 [0,4194304] 0 2024-01-25T15:03:40.360 INFO:tasks.workunit.client.0.smithi170.stdout:7/440: dread - d8/d20/d2a/f5a zero size 2024-01-25T15:03:40.360 INFO:tasks.workunit.client.0.smithi170.stdout:7/441: stat d8/d20/d45/d68/c9f 0 2024-01-25T15:03:40.361 INFO:tasks.workunit.client.0.smithi170.stdout:7/442: rename d8/d20/c4b to d8/d20/d2a/cab 0 2024-01-25T15:03:40.363 INFO:tasks.workunit.client.0.smithi170.stdout:7/443: mknod d8/d20/d2a/d35/d55/d7d/cac 0 2024-01-25T15:03:40.363 INFO:tasks.workunit.client.0.smithi170.stdout:7/444: readlink d8/d20/l86 0 2024-01-25T15:03:40.366 INFO:tasks.workunit.client.0.smithi170.stdout:7/445: creat d8/d20/d3b/d4d/fad x:0 0 0 2024-01-25T15:03:40.368 INFO:tasks.workunit.client.0.smithi170.stdout:7/446: getdents d8/d20/d2a/d35/d55 0 2024-01-25T15:03:40.369 INFO:tasks.workunit.client.0.smithi170.stdout:7/447: creat d8/d20/d3b/fae x:0 0 0 2024-01-25T15:03:40.370 INFO:tasks.workunit.client.0.smithi170.stdout:6/425: dwrite d2/d7/d23/d19/d2f/f87 [0,4194304] 0 2024-01-25T15:03:40.370 INFO:tasks.workunit.client.0.smithi170.stdout:6/426: truncate d2/f10 9133547 0 2024-01-25T15:03:40.375 INFO:tasks.workunit.client.0.smithi170.stdout:6/427: link d2/c4c d2/d7/d23/d19/d2f/d74/c8f 0 2024-01-25T15:03:40.375 INFO:tasks.workunit.client.0.smithi170.stdout:6/428: symlink d2/d7/d23/d19/d2a/d43/d44/d80/l90 0 2024-01-25T15:03:40.378 INFO:tasks.workunit.client.0.smithi170.stdout:5/354: dwrite d5/d54/d85/f19 [4194304,4194304] 0 2024-01-25T15:03:40.381 INFO:tasks.workunit.client.0.smithi170.stdout:5/355: dread d5/d54/d85/d2c/d51/d41/f44 [0,4194304] 0 2024-01-25T15:03:40.381 INFO:tasks.workunit.client.0.smithi170.stdout:6/429: rmdir d2/d7/d1b/d28/d89 0 2024-01-25T15:03:40.382 INFO:tasks.workunit.client.0.smithi170.stdout:5/356: symlink d5/d54/d85/d2c/d45/d5e/l89 0 2024-01-25T15:03:40.382 INFO:tasks.workunit.client.0.smithi170.stdout:6/430: creat d2/d7/d23/d19/d2f/d5d/f91 x:0 0 0 2024-01-25T15:03:40.383 INFO:tasks.workunit.client.0.smithi170.stdout:6/431: creat d2/d7/d23/d19/d2a/f92 x:0 0 0 2024-01-25T15:03:40.386 INFO:tasks.workunit.client.0.smithi170.stdout:6/432: creat d2/d7/d23/d19/d2a/d43/d44/d80/f93 x:0 0 0 2024-01-25T15:03:40.386 INFO:tasks.workunit.client.0.smithi170.stdout:6/433: readlink d2/d7/d23/d19/d2f/d5d/l7e 0 2024-01-25T15:03:40.386 INFO:tasks.workunit.client.0.smithi170.stdout:6/434: write d2/d7/d23/d19/f24 [2976427,30351] 0 2024-01-25T15:03:40.386 INFO:tasks.workunit.client.0.smithi170.stdout:6/435: chown d2/d7/d23/d19/d2a/c8d 421422 1 2024-01-25T15:03:40.388 INFO:tasks.workunit.client.0.smithi170.stdout:6/436: mkdir d2/d7/d23/d19/d2f/d5d/d94 0 2024-01-25T15:03:40.397 INFO:tasks.workunit.client.0.smithi170.stdout:5/357: write d5/fe [556589,5979] 0 2024-01-25T15:03:40.399 INFO:tasks.workunit.client.0.smithi170.stdout:5/358: rename d5/d54/d85/d2c/l46 to d5/d54/d85/d2c/d34/d7c/l8a 0 2024-01-25T15:03:40.400 INFO:tasks.workunit.client.0.smithi170.stdout:5/359: creat d5/d54/d85/d2c/d34/f8b x:0 0 0 2024-01-25T15:03:40.409 INFO:tasks.workunit.client.0.smithi170.stdout:6/437: dwrite d2/d7/d23/d19/d2f/d37/f3f [0,4194304] 0 2024-01-25T15:03:40.426 INFO:tasks.workunit.client.0.smithi170.stdout:5/360: dwrite d5/d54/d85/d2c/d45/f6c [0,4194304] 0 2024-01-25T15:03:40.427 INFO:tasks.workunit.client.0.smithi170.stdout:5/361: write d5/d54/d85/f5a [342225,93329] 0 2024-01-25T15:03:40.430 INFO:tasks.workunit.client.0.smithi170.stdout:5/362: link d5/cc d5/d54/d85/d2c/d34/d7c/c8c 0 2024-01-25T15:03:40.430 INFO:tasks.workunit.client.0.smithi170.stdout:5/363: rmdir d5/d54/d85/d2c/d51/d3d 39 2024-01-25T15:03:40.431 INFO:tasks.workunit.client.0.smithi170.stdout:5/364: creat d5/d2a/f8d x:0 0 0 2024-01-25T15:03:40.432 INFO:tasks.workunit.client.0.smithi170.stdout:5/365: chown d5/d54/d85/d2c/d45/d56/c5d 32458 1 2024-01-25T15:03:40.433 INFO:tasks.workunit.client.0.smithi170.stdout:6/438: dwrite d2/d7/d23/d19/f29 [0,4194304] 0 2024-01-25T15:03:40.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:40 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a[31895]: 2024-01-25T15:03:40.357+0000 7f06c209e700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-25T15:03:40.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:40 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:40.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:40 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:40.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:40 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:40.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:40 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000713 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_stdcall_svc_getcaller/1-basic.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:40.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:40 smithi170 ceph-mon[31899]: Scrub error on inode 0x1000000046a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_stdcall_svc_getcaller/assertions.xml) see mds.b log and `damage ls` output for details 2024-01-25T15:03:40.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:40 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:40.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:40 smithi170 ceph-mon[31899]: scrub summary: active paths [/] 2024-01-25T15:03:40.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:40 smithi170 ceph-mon[31899]: Scrub error on inode 0x100000006ff (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_regunreg_registerrpc/1-basic.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:40.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:40 smithi170 ceph-mon[31899]: Scrub error on inode 0x10000000459 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_regunreg_registerrpc/assertions.xml) see mds.b log and `damage ls` output for details 2024-01-25T15:03:40.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:40 smithi170 ceph-mon[31899]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:40.627 INFO:tasks.workunit.client.0.smithi170.stdout:3/475: sync 2024-01-25T15:03:40.627 INFO:tasks.workunit.client.0.smithi170.stdout:5/366: sync 2024-01-25T15:03:40.627 INFO:tasks.workunit.client.0.smithi170.stdout:3/476: chown d3/d3b 3904 1 2024-01-25T15:03:40.628 INFO:tasks.workunit.client.0.smithi170.stdout:4/353: sync 2024-01-25T15:03:40.628 INFO:tasks.workunit.client.0.smithi170.stdout:2/449: sync 2024-01-25T15:03:40.628 INFO:tasks.workunit.client.0.smithi170.stdout:1/395: sync 2024-01-25T15:03:40.628 INFO:tasks.workunit.client.0.smithi170.stdout:8/391: sync 2024-01-25T15:03:40.628 INFO:tasks.workunit.client.0.smithi170.stdout:9/435: sync 2024-01-25T15:03:40.628 INFO:tasks.workunit.client.0.smithi170.stdout:0/423: sync 2024-01-25T15:03:40.628 INFO:tasks.workunit.client.0.smithi170.stdout:7/448: sync 2024-01-25T15:03:40.628 INFO:tasks.workunit.client.0.smithi170.stdout:6/439: sync 2024-01-25T15:03:40.628 INFO:tasks.workunit.client.0.smithi170.stdout:7/449: dread - d8/d20/d3b/f99 zero size 2024-01-25T15:03:40.629 INFO:tasks.workunit.client.0.smithi170.stdout:3/477: unlink d3/d10/d1e/l6a 0 2024-01-25T15:03:40.629 INFO:tasks.workunit.client.0.smithi170.stdout:4/354: rmdir d6/d7/d31/d46 39 2024-01-25T15:03:40.629 INFO:tasks.workunit.client.0.smithi170.stdout:4/355: dread - d6/d28/f55 zero size 2024-01-25T15:03:40.629 INFO:tasks.workunit.client.0.smithi170.stdout:4/356: stat d6/d37/f5a 0 2024-01-25T15:03:40.632 INFO:tasks.workunit.client.0.smithi170.stdout:3/478: dread d3/d10/d13/d1b/d81/f8d [0,4194304] 0 2024-01-25T15:03:40.633 INFO:tasks.workunit.client.0.smithi170.stdout:2/450: truncate d10/d16/f7c 393275 0 2024-01-25T15:03:40.633 INFO:tasks.workunit.client.0.smithi170.stdout:8/392: symlink d3/d7/d22/d23/d48/d52/l82 0 2024-01-25T15:03:40.633 INFO:tasks.workunit.client.0.smithi170.stdout:9/436: symlink d5/df/d2e/d6b/la3 0 2024-01-25T15:03:40.633 INFO:tasks.workunit.client.0.smithi170.stdout:8/393: dread - d3/d7/d1e/f6f zero size 2024-01-25T15:03:40.633 INFO:tasks.workunit.client.0.smithi170.stdout:9/437: chown d5/df/d2e/d77/d21/d46/d18/l3f 389232 1 2024-01-25T15:03:40.633 INFO:tasks.workunit.client.0.smithi170.stdout:9/438: fdatasync d5/df/d2e/f39 0 2024-01-25T15:03:40.633 INFO:tasks.workunit.client.0.smithi170.stdout:0/424: symlink d8/d18/l93 0 2024-01-25T15:03:40.634 INFO:tasks.workunit.client.0.smithi170.stdout:6/440: creat d2/d7/d1b/f95 x:0 0 0 2024-01-25T15:03:40.635 INFO:tasks.workunit.client.0.smithi170.stdout:7/450: mkdir d8/d20/d2a/d35/daf 0 2024-01-25T15:03:40.635 INFO:tasks.workunit.client.0.smithi170.stdout:4/357: getdents d6/d7 0 2024-01-25T15:03:40.638 INFO:tasks.workunit.client.0.smithi170.stdout:8/394: mknod d3/d7/d22/d23/d25/d41/d61/c83 0 2024-01-25T15:03:40.640 INFO:tasks.workunit.client.0.smithi170.stdout:6/441: rename f0 to d2/d7/d1b/d28/f96 0 2024-01-25T15:03:40.642 INFO:tasks.workunit.client.0.smithi170.stdout:7/451: mkdir d8/d20/d2a/d35/db0 0 2024-01-25T15:03:40.643 INFO:tasks.workunit.client.0.smithi170.stdout:8/395: creat d3/d7/d22/d23/f84 x:0 0 0 2024-01-25T15:03:40.644 INFO:tasks.workunit.client.0.smithi170.stdout:7/452: mknod d8/d20/d45/cb1 0 2024-01-25T15:03:40.647 INFO:tasks.workunit.client.0.smithi170.stdout:7/453: creat d8/d20/d45/d68/d71/d8c/fb2 x:0 0 0 2024-01-25T15:03:40.654 INFO:tasks.workunit.client.0.smithi170.stdout:6/442: write d2/d7/d23/d19/d2a/f55 [1321559,92976] 0 2024-01-25T15:03:40.654 INFO:tasks.workunit.client.0.smithi170.stdout:6/443: chown d2/d7/d1b/d28/c5f 8637 1 2024-01-25T15:03:40.654 INFO:tasks.workunit.client.0.smithi170.stdout:6/444: fsync d2/f82 0 2024-01-25T15:03:40.654 INFO:tasks.workunit.client.0.smithi170.stdout:8/396: write d3/d7/f16 [941071,42865] 0 2024-01-25T15:03:40.655 INFO:tasks.workunit.client.0.smithi170.stdout:6/445: mkdir d2/d7/d23/d19/d2f/d5d/d94/d97 0 2024-01-25T15:03:40.661 INFO:tasks.workunit.client.0.smithi170.stdout:1/396: dwrite d0/d20/d28/d2a/f5e [0,4194304] 0 2024-01-25T15:03:40.664 INFO:tasks.workunit.client.0.smithi170.stdout:1/397: unlink d0/d2e/c49 0 2024-01-25T15:03:40.664 INFO:tasks.workunit.client.0.smithi170.stdout:1/398: chown d0/d20/d28/l7a 113 1 2024-01-25T15:03:40.664 INFO:tasks.workunit.client.0.smithi170.stdout:1/399: dread - d0/d20/d28/f66 zero size 2024-01-25T15:03:40.669 INFO:tasks.workunit.client.0.smithi170.stdout:1/400: mkdir d0/d20/d28/d2a/d4a/d56/d5b/d72/d8b 0 2024-01-25T15:03:40.669 INFO:tasks.workunit.client.0.smithi170.stdout:1/401: truncate d0/f33 4755482 0 2024-01-25T15:03:40.669 INFO:tasks.workunit.client.0.smithi170.stdout:9/439: dwrite d5/df/d2e/d77/d21/d34/d3e/d7f/f83 [0,4194304] 0 2024-01-25T15:03:40.670 INFO:tasks.workunit.client.0.smithi170.stdout:9/440: creat d5/df/d2e/d77/d21/d46/d18/d6a/fa4 x:0 0 0 2024-01-25T15:03:40.672 INFO:tasks.workunit.client.0.smithi170.stdout:2/451: dwrite d10/d1e/d32/d63/f90 [0,4194304] 0 2024-01-25T15:03:40.673 INFO:tasks.workunit.client.0.smithi170.stdout:1/402: mknod d0/d20/d3a/d6e/c8c 0 2024-01-25T15:03:40.676 INFO:tasks.workunit.client.0.smithi170.stdout:1/403: rmdir d0/d20/d28/d2a/d4a/d56/d5b/d72/d8b 0 2024-01-25T15:03:40.676 INFO:tasks.workunit.client.0.smithi170.stdout:5/367: dwrite d5/d54/d85/d2c/d51/f4c [0,4194304] 0 2024-01-25T15:03:40.677 INFO:tasks.workunit.client.0.smithi170.stdout:5/368: fdatasync d5/f1e 0 2024-01-25T15:03:40.678 INFO:tasks.workunit.client.0.smithi170.stdout:1/404: creat d0/d2e/f8d x:0 0 0 2024-01-25T15:03:40.679 INFO:tasks.workunit.client.0.smithi170.stdout:1/405: mkdir d0/d50/d8e 0 2024-01-25T15:03:40.680 INFO:tasks.workunit.client.0.smithi170.stdout:5/369: dread d5/d54/d85/d2c/d51/d41/f44 [0,4194304] 0 2024-01-25T15:03:40.684 INFO:tasks.workunit.client.0.smithi170.stdout:1/406: read d0/d20/d28/d2a/d4a/d56/d5b/f68 [1458407,111596] 0 2024-01-25T15:03:40.689 INFO:tasks.workunit.client.0.smithi170.stdout:5/370: write d5/f16 [4376136,42616] 0 2024-01-25T15:03:40.693 INFO:tasks.workunit.client.0.smithi170.stdout:4/358: dwrite d6/d7/f9 [0,4194304] 0 2024-01-25T15:03:40.694 INFO:tasks.workunit.client.0.smithi170.stdout:2/452: rmdir d10/d1e/d32/d62 39 2024-01-25T15:03:40.694 INFO:tasks.workunit.client.0.smithi170.stdout:2/453: write d10/d1e/d32/d3e/f47 [839669,43714] 0 2024-01-25T15:03:40.695 INFO:tasks.workunit.client.0.smithi170.stdout:4/359: mknod d6/d7/d34/c64 0 2024-01-25T15:03:40.695 INFO:tasks.workunit.client.0.smithi170.stdout:4/360: chown d6/d7/d34/c1d 414852 1 2024-01-25T15:03:40.697 INFO:tasks.workunit.client.0.smithi170.stdout:6/446: dwrite d2/d7/d23/d19/d2f/d37/f62 [0,4194304] 0 2024-01-25T15:03:40.697 INFO:tasks.workunit.client.0.smithi170.stdout:8/397: dwrite d3/f72 [0,4194304] 0 2024-01-25T15:03:40.697 INFO:tasks.workunit.client.0.smithi170.stdout:4/361: symlink d6/d37/l65 0 2024-01-25T15:03:40.697 INFO:tasks.workunit.client.0.smithi170.stdout:4/362: stat d6/d28/f55 0 2024-01-25T15:03:40.698 INFO:tasks.workunit.client.0.smithi170.stdout:7/454: dwrite d8/d20/d3b/d4d/f97 [0,4194304] 0 2024-01-25T15:03:40.698 INFO:tasks.workunit.client.0.smithi170.stdout:7/455: stat d8/d20/f29 0 2024-01-25T15:03:40.698 INFO:tasks.workunit.client.0.smithi170.stdout:7/456: fsync d8/f31 0 2024-01-25T15:03:40.698 INFO:tasks.workunit.client.0.smithi170.stdout:7/457: dread - d8/d20/d2a/f87 zero size 2024-01-25T15:03:40.698 INFO:tasks.workunit.client.0.smithi170.stdout:7/458: fsync d8/d20/d3b/fae 0 2024-01-25T15:03:40.698 INFO:tasks.workunit.client.0.smithi170.stdout:9/441: dwrite d5/df/d2e/f93 [8388608,4194304] 0 2024-01-25T15:03:40.700 INFO:tasks.workunit.client.0.smithi170.stdout:6/447: rename d2/d7/d23/d19/d2f/d37 to d2/d7/d23/d19/d2a/d43/d98 0 2024-01-25T15:03:40.700 INFO:tasks.workunit.client.0.smithi170.stdout:6/448: chown d2/d7/d23/l3b 593 1 2024-01-25T15:03:40.700 INFO:tasks.workunit.client.0.smithi170.stdout:6/449: creat d2/d7/d23/d19/d2a/f99 x:0 0 0 2024-01-25T15:03:40.701 INFO:tasks.workunit.client.0.smithi170.stdout:1/407: read d0/d20/d3a/f53 [4093259,120916] 0 2024-01-25T15:03:40.701 INFO:tasks.workunit.client.0.smithi170.stdout:1/408: chown d0/d2e/c4f 91860 1 2024-01-25T15:03:40.702 INFO:tasks.workunit.client.0.smithi170.stdout:9/442: mknod d5/df/d16/d35/d3c/d56/d59/ca5 0 2024-01-25T15:03:40.702 INFO:tasks.workunit.client.0.smithi170.stdout:5/371: dread d5/d54/d85/d2c/d45/f75 [0,4194304] 0 2024-01-25T15:03:40.702 INFO:tasks.workunit.client.0.smithi170.stdout:5/372: stat d5/d2a/c71 0 2024-01-25T15:03:40.706 INFO:tasks.workunit.client.0.smithi170.stdout:2/454: mknod d10/d1e/d32/d62/ca6 0 2024-01-25T15:03:40.706 INFO:tasks.workunit.client.0.smithi170.stdout:2/455: creat d10/d1e/d32/d3e/d41/d7a/fa7 x:0 0 0 2024-01-25T15:03:40.707 INFO:tasks.workunit.client.0.smithi170.stdout:5/373: creat d5/f8e x:0 0 0 2024-01-25T15:03:40.711 INFO:tasks.workunit.client.0.smithi170.stdout:8/398: rename d3/d7/d22/d23/d25/d34/d6d to d3/d7/d3a/d85 0 2024-01-25T15:03:40.711 INFO:tasks.workunit.client.0.smithi170.stdout:8/399: readlink d3/d7/d1e/l31 0 2024-01-25T15:03:40.712 INFO:tasks.workunit.client.0.smithi170.stdout:2/456: symlink d10/d16/la8 0 2024-01-25T15:03:40.712 INFO:tasks.workunit.client.0.smithi170.stdout:2/457: write d10/d1e/f2e [542168,50133] 0 2024-01-25T15:03:40.713 INFO:tasks.workunit.client.0.smithi170.stdout:2/458: symlink d10/d1e/d32/d62/d8d/la9 0 2024-01-25T15:03:40.714 INFO:tasks.workunit.client.0.smithi170.stdout:5/374: mkdir d5/d54/d85/d3f/d8f 0 2024-01-25T15:03:40.716 INFO:tasks.workunit.client.0.smithi170.stdout:8/400: mkdir d3/d7/d22/d23/d48/d52/d47/d86 0 2024-01-25T15:03:40.719 INFO:tasks.workunit.client.0.smithi170.stdout:8/401: mknod d3/d7/d22/d23/d25/c87 0 2024-01-25T15:03:40.719 INFO:tasks.workunit.client.0.smithi170.stdout:7/459: dwrite d8/f92 [4194304,4194304] 0 2024-01-25T15:03:40.723 INFO:tasks.workunit.client.0.smithi170.stdout:1/409: read d0/f5 [1068401,127586] 0 2024-01-25T15:03:40.723 INFO:tasks.workunit.client.0.smithi170.stdout:5/375: link d5/fe d5/d54/d85/d2c/d51/d41/f90 0 2024-01-25T15:03:40.724 INFO:tasks.workunit.client.0.smithi170.stdout:2/459: read d10/d1e/f71 [140110,123401] 0 2024-01-25T15:03:40.724 INFO:tasks.workunit.client.0.smithi170.stdout:7/460: symlink d8/d20/d2a/d61/lb3 0 2024-01-25T15:03:40.724 INFO:tasks.workunit.client.0.smithi170.stdout:7/461: chown d8/d20/d2a/fa2 3 1 2024-01-25T15:03:40.725 INFO:tasks.workunit.client.0.smithi170.stdout:7/462: chown d8/d20/d3b/d4d/l83 15272486 1 2024-01-25T15:03:40.725 INFO:tasks.workunit.client.0.smithi170.stdout:7/463: write d8/d20/d45/d8e/f9d [3126796,22670] 0 2024-01-25T15:03:40.725 INFO:tasks.workunit.client.0.smithi170.stdout:8/402: symlink d3/d7/l88 0 2024-01-25T15:03:40.726 INFO:tasks.workunit.client.0.smithi170.stdout:5/376: symlink d5/d58/l91 0 2024-01-25T15:03:40.728 INFO:tasks.workunit.client.0.smithi170.stdout:5/377: symlink d5/d54/d85/d2c/d45/d56/l92 0 2024-01-25T15:03:40.728 INFO:tasks.workunit.client.0.smithi170.stdout:5/378: write d5/d54/d85/d2c/d34/f8b [15266,2227] 0 2024-01-25T15:03:40.728 INFO:tasks.workunit.client.0.smithi170.stdout:2/460: mkdir d10/d16/d42/daa 0 2024-01-25T15:03:40.728 INFO:tasks.workunit.client.0.smithi170.stdout:2/461: stat d10/d1e/l64 0 2024-01-25T15:03:40.729 INFO:tasks.workunit.client.0.smithi170.stdout:6/450: dwrite d2/d7/d23/d19/d2a/d43/f51 [4194304,4194304] 0 2024-01-25T15:03:40.729 INFO:tasks.workunit.client.0.smithi170.stdout:2/462: mkdir d10/d1e/d32/d98/dab 0 2024-01-25T15:03:40.730 INFO:tasks.workunit.client.0.smithi170.stdout:6/451: write d2/d7/d23/d19/f83 [4480997,79243] 0 2024-01-25T15:03:40.730 INFO:tasks.workunit.client.0.smithi170.stdout:6/452: dread - d2/f7b zero size 2024-01-25T15:03:40.730 INFO:tasks.workunit.client.0.smithi170.stdout:8/403: mknod d3/d7/d1e/c89 0 2024-01-25T15:03:40.730 INFO:tasks.workunit.client.0.smithi170.stdout:5/379: truncate d5/d54/d85/d2c/d51/d3d/d57/f6a 2000848 0 2024-01-25T15:03:40.730 INFO:tasks.workunit.client.0.smithi170.stdout:9/443: dwrite d5/df/d16/d35/d3c/fa2 [0,4194304] 0 2024-01-25T15:03:40.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:40 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:40.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:40 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:40.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:40 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:40.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:40 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000713 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_stdcall_svc_getcaller/1-basic.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:40.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:40 smithi191 ceph-mon[36347]: Scrub error on inode 0x1000000046a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_stdcall_svc_getcaller/assertions.xml) see mds.b log and `damage ls` output for details 2024-01-25T15:03:40.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:40 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:40.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:40 smithi191 ceph-mon[36347]: scrub summary: active paths [/] 2024-01-25T15:03:40.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:40 smithi191 ceph-mon[36347]: Scrub error on inode 0x100000006ff (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_regunreg_registerrpc/1-basic.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:40.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:40 smithi191 ceph-mon[36347]: Scrub error on inode 0x10000000459 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_regunreg_registerrpc/assertions.xml) see mds.b log and `damage ls` output for details 2024-01-25T15:03:40.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:40 smithi191 ceph-mon[36347]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:40.735 INFO:tasks.workunit.client.0.smithi170.stdout:6/453: creat d2/d7/d23/d19/d2f/f9a x:0 0 0 2024-01-25T15:03:40.735 INFO:tasks.workunit.client.0.smithi170.stdout:6/454: dread - d2/d7/d23/d19/d2a/f92 zero size 2024-01-25T15:03:40.735 INFO:tasks.workunit.client.0.smithi170.stdout:6/455: chown d2/d7/d23/d19/d2a/d43/l7a 6731 1 2024-01-25T15:03:40.735 INFO:tasks.workunit.client.0.smithi170.stdout:6/456: write d2/d7/d1b/f95 [448078,35717] 0 2024-01-25T15:03:40.736 INFO:tasks.workunit.client.0.smithi170.stdout:8/404: mknod d3/d7/d22/d23/d48/d52/d47/d86/c8a 0 2024-01-25T15:03:40.745 INFO:tasks.workunit.client.0.smithi170.stdout:1/410: dwrite d0/d20/d28/f6c [0,4194304] 0 2024-01-25T15:03:40.752 INFO:tasks.workunit.client.0.smithi170.stdout:9/444: mknod d5/df/d16/d35/d3c/d56/ca6 0 2024-01-25T15:03:40.752 INFO:tasks.workunit.client.0.smithi170.stdout:9/445: write d5/df/d2e/d77/d21/d34/d3e/f84 [1000580,11674] 0 2024-01-25T15:03:40.752 INFO:tasks.workunit.client.0.smithi170.stdout:9/446: write d5/df/d2e/d77/f2a [950218,38407] 0 2024-01-25T15:03:40.752 INFO:tasks.workunit.client.0.smithi170.stdout:9/447: read - d5/df/d2e/d77/d21/d46/d18/d6a/f8b zero size 2024-01-25T15:03:40.753 INFO:tasks.workunit.client.0.smithi170.stdout:6/457: symlink d2/d7/d1b/l9b 0 2024-01-25T15:03:40.754 INFO:tasks.workunit.client.0.smithi170.stdout:8/405: symlink d3/d7/d1e/d74/d7f/l8b 0 2024-01-25T15:03:40.757 INFO:tasks.workunit.client.0.smithi170.stdout:1/411: mkdir d0/d50/d8e/d8f 0 2024-01-25T15:03:40.759 INFO:tasks.workunit.client.0.smithi170.stdout:1/412: dread d0/f46 [0,4194304] 0 2024-01-25T15:03:40.760 INFO:tasks.workunit.client.0.smithi170.stdout:9/448: truncate d5/df/d2e/d77/d21/d34/f7a 1598870 0 2024-01-25T15:03:40.762 INFO:tasks.workunit.client.0.smithi170.stdout:6/458: mknod d2/d7/d23/c9c 0 2024-01-25T15:03:40.762 INFO:tasks.workunit.client.0.smithi170.stdout:6/459: fsync d2/d7/f4a 0 2024-01-25T15:03:40.764 INFO:tasks.workunit.client.0.smithi170.stdout:8/406: truncate d3/d7/d22/d23/d48/d52/d47/f4c 695604 0 2024-01-25T15:03:40.765 INFO:tasks.workunit.client.0.smithi170.stdout:8/407: creat d3/d7/d1e/d74/d7f/f8c x:0 0 0 2024-01-25T15:03:40.769 INFO:tasks.workunit.client.0.smithi170.stdout:8/408: mkdir d3/d7/d3a/d8d 0 2024-01-25T15:03:40.769 INFO:tasks.workunit.client.0.smithi170.stdout:8/409: dread - d3/d7/d3a/f4f zero size 2024-01-25T15:03:40.769 INFO:tasks.workunit.client.0.smithi170.stdout:8/410: read d3/d7/d22/d23/f4a [744615,48260] 0 2024-01-25T15:03:40.769 INFO:tasks.workunit.client.0.smithi170.stdout:8/411: write d3/d7/d22/d23/d25/f5b [1307817,46062] 0 2024-01-25T15:03:40.769 INFO:tasks.workunit.client.0.smithi170.stdout:8/412: chown d3/d7/d22/d23/d48/d52/d47/f4b 290 1 2024-01-25T15:03:40.769 INFO:tasks.workunit.client.0.smithi170.stdout:8/413: truncate d3/d7/f16 1763264 0 2024-01-25T15:03:40.769 INFO:tasks.workunit.client.0.smithi170.stdout:7/464: rename d8/d20/d2a/d35/d55/d6e/c75 to d8/d20/d2a/cb4 0 2024-01-25T15:03:40.770 INFO:tasks.workunit.client.0.smithi170.stdout:1/413: dread d0/ff [0,4194304] 0 2024-01-25T15:03:40.771 INFO:tasks.workunit.client.0.smithi170.stdout:1/414: dread - d0/f6d zero size 2024-01-25T15:03:40.771 INFO:tasks.workunit.client.0.smithi170.stdout:8/414: mkdir d3/d7/d22/d23/d25/d8e 0 2024-01-25T15:03:40.772 INFO:tasks.workunit.client.0.smithi170.stdout:0/425: sync 2024-01-25T15:03:40.772 INFO:tasks.workunit.client.0.smithi170.stdout:3/479: sync 2024-01-25T15:03:40.772 INFO:tasks.workunit.client.0.smithi170.stdout:3/480: dread - d3/d10/d1e/d21/d41/d4b/f90 zero size 2024-01-25T15:03:40.772 INFO:tasks.workunit.client.0.smithi170.stdout:3/481: read - d3/d10/d1e/d21/d41/d77/d42/d72/f7b zero size 2024-01-25T15:03:40.773 INFO:tasks.workunit.client.0.smithi170.stdout:1/415: dread d0/f46 [0,4194304] 0 2024-01-25T15:03:40.773 INFO:tasks.workunit.client.0.smithi170.stdout:1/416: dread - d0/d20/f26 zero size 2024-01-25T15:03:40.773 INFO:tasks.workunit.client.0.smithi170.stdout:2/463: rename d10/d16/d42/c68 to d10/d1b/cac 0 2024-01-25T15:03:40.775 INFO:tasks.workunit.client.0.smithi170.stdout:0/426: mknod d8/d10/d2d/d2f/d4f/c94 0 2024-01-25T15:03:40.776 INFO:tasks.workunit.client.0.smithi170.stdout:8/415: write d3/d7/f15 [744809,41743] 0 2024-01-25T15:03:40.777 INFO:tasks.workunit.client.0.smithi170.stdout:5/380: rename d5/d54/d85/f35 to d5/d54/d85/d2c/d51/f93 0 2024-01-25T15:03:40.779 INFO:tasks.workunit.client.0.smithi170.stdout:0/427: mknod d8/d10/d2d/d2f/d4f/d59/c95 0 2024-01-25T15:03:40.781 INFO:tasks.workunit.client.0.smithi170.stdout:6/460: dread d2/f10 [4194304,4194304] 0 2024-01-25T15:03:40.781 INFO:tasks.workunit.client.0.smithi170.stdout:8/416: rmdir d3/d7/d22/d23/d48/d52/d47/d86 39 2024-01-25T15:03:40.782 INFO:tasks.workunit.client.0.smithi170.stdout:8/417: fsync d3/d7/d3a/f4f 0 2024-01-25T15:03:40.782 INFO:tasks.workunit.client.0.smithi170.stdout:8/418: write d3/f72 [4460400,27849] 0 2024-01-25T15:03:40.783 INFO:tasks.workunit.client.0.smithi170.stdout:3/482: dread d3/f17 [0,4194304] 0 2024-01-25T15:03:40.787 INFO:tasks.workunit.client.0.smithi170.stdout:1/417: rename d0/c10 to d0/d20/d28/c90 0 2024-01-25T15:03:40.787 INFO:tasks.workunit.client.0.smithi170.stdout:3/483: read d3/f68 [631561,104222] 0 2024-01-25T15:03:40.787 INFO:tasks.workunit.client.0.smithi170.stdout:3/484: write d3/d1c/f6f [4486832,92465] 0 2024-01-25T15:03:40.789 INFO:tasks.workunit.client.0.smithi170.stdout:8/419: unlink d3/c64 0 2024-01-25T15:03:40.790 INFO:tasks.workunit.client.0.smithi170.stdout:9/449: dwrite d5/df/d2e/f39 [4194304,4194304] 0 2024-01-25T15:03:40.791 INFO:tasks.workunit.client.0.smithi170.stdout:2/464: rename d10/d1e/f53 to d10/d1e/d5e/d73/d9e/da3/fad 0 2024-01-25T15:03:40.794 INFO:tasks.workunit.client.0.smithi170.stdout:3/485: creat d3/d10/d13/d1b/d29/f94 x:0 0 0 2024-01-25T15:03:40.794 INFO:tasks.workunit.client.0.smithi170.stdout:2/465: symlink d10/d1e/d32/lae 0 2024-01-25T15:03:40.796 INFO:tasks.workunit.client.0.smithi170.stdout:5/381: rmdir d5/d54/d85/d2c/d51/d3d/d57 39 2024-01-25T15:03:40.799 INFO:tasks.workunit.client.0.smithi170.stdout:8/420: write d3/fd [1765601,85217] 0 2024-01-25T15:03:40.799 INFO:tasks.workunit.client.0.smithi170.stdout:8/421: write d3/d7/f12 [2200927,58718] 0 2024-01-25T15:03:40.801 INFO:tasks.workunit.client.0.smithi170.stdout:1/418: getdents d0/d20/d28/d2a/d4a/d56/d81 0 2024-01-25T15:03:40.803 INFO:tasks.workunit.client.0.smithi170.stdout:3/486: creat d3/d10/d1e/d21/d41/f95 x:0 0 0 2024-01-25T15:03:40.804 INFO:tasks.workunit.client.0.smithi170.stdout:2/466: mknod d10/d16/caf 0 2024-01-25T15:03:40.804 INFO:tasks.workunit.client.0.smithi170.stdout:2/467: read d10/d16/d42/f48 [629489,32480] 0 2024-01-25T15:03:40.804 INFO:tasks.workunit.client.0.smithi170.stdout:2/468: write d10/d1e/d5e/d73/f7f [13239,75420] 0 2024-01-25T15:03:40.804 INFO:tasks.workunit.client.0.smithi170.stdout:2/469: write d10/d1e/d32/d62/d8d/f96 [905884,31908] 0 2024-01-25T15:03:40.808 INFO:tasks.workunit.client.0.smithi170.stdout:5/382: unlink d5/d54/d85/d2c/d34/d7c/l8a 0 2024-01-25T15:03:40.808 INFO:tasks.workunit.client.0.smithi170.stdout:7/465: dwrite d8/d20/d3b/f3c [0,4194304] 0 2024-01-25T15:03:40.809 INFO:tasks.workunit.client.0.smithi170.stdout:7/466: write d8/d20/d3b/f99 [722823,79718] 0 2024-01-25T15:03:40.809 INFO:tasks.workunit.client.0.smithi170.stdout:7/467: read d8/f1c [2562128,33538] 0 2024-01-25T15:03:40.809 INFO:tasks.workunit.client.0.smithi170.stdout:6/461: read d2/f40 [5656655,76808] 0 2024-01-25T15:03:40.812 INFO:tasks.workunit.client.0.smithi170.stdout:9/450: symlink d5/df/d2e/d77/la7 0 2024-01-25T15:03:40.812 INFO:tasks.workunit.client.0.smithi170.stdout:9/451: truncate d5/f37 937823 0 2024-01-25T15:03:40.812 INFO:tasks.workunit.client.0.smithi170.stdout:9/452: dread - d5/df/d16/d35/d3c/d56/d59/d5e/f87 zero size 2024-01-25T15:03:40.812 INFO:tasks.workunit.client.0.smithi170.stdout:1/419: mkdir d0/d91 0 2024-01-25T15:03:40.814 INFO:tasks.workunit.client.0.smithi170.stdout:2/470: symlink d10/d1e/lb0 0 2024-01-25T15:03:40.814 INFO:tasks.workunit.client.0.smithi170.stdout:4/363: sync 2024-01-25T15:03:40.814 INFO:tasks.workunit.client.0.smithi170.stdout:0/428: dwrite d8/d3e/f61 [0,4194304] 0 2024-01-25T15:03:40.819 INFO:tasks.workunit.client.0.smithi170.stdout:7/468: write d8/d20/d3b/d4d/f6d [3915433,96710] 0 2024-01-25T15:03:40.819 INFO:tasks.workunit.client.0.smithi170.stdout:7/469: readlink d8/d20/d2a/l36 0 2024-01-25T15:03:40.819 INFO:tasks.workunit.client.0.smithi170.stdout:7/470: dread - d8/f90 zero size 2024-01-25T15:03:40.820 INFO:tasks.workunit.client.0.smithi170.stdout:8/422: getdents d3/d7/d3a 0 2024-01-25T15:03:40.821 INFO:tasks.workunit.client.0.smithi170.stdout:9/453: rmdir d5/df/d2e/d77/d21/d46 39 2024-01-25T15:03:40.821 INFO:tasks.workunit.client.0.smithi170.stdout:6/462: getdents d2 0 2024-01-25T15:03:40.821 INFO:tasks.workunit.client.0.smithi170.stdout:9/454: read - d5/fa0 zero size 2024-01-25T15:03:40.821 INFO:tasks.workunit.client.0.smithi170.stdout:9/455: creat d5/df/d2e/fa8 x:0 0 0 2024-01-25T15:03:40.826 INFO:tasks.workunit.client.0.smithi170.stdout:1/420: write d0/d20/d28/f6c [712471,108920] 0 2024-01-25T15:03:40.827 INFO:tasks.workunit.client.0.smithi170.stdout:6/463: symlink d2/d7/d23/d19/d2a/l9d 0 2024-01-25T15:03:40.827 INFO:tasks.workunit.client.0.smithi170.stdout:2/471: dread f9 [0,4194304] 0 2024-01-25T15:03:40.827 INFO:tasks.workunit.client.0.smithi170.stdout:2/472: creat d10/d1b/d5f/fb1 x:0 0 0 2024-01-25T15:03:40.828 INFO:tasks.workunit.client.0.smithi170.stdout:8/423: dread d3/d7/d22/d23/f54 [0,4194304] 0 2024-01-25T15:03:40.831 INFO:tasks.workunit.client.0.smithi170.stdout:9/456: symlink d5/df/d2e/d77/d21/d46/d18/d6a/la9 0 2024-01-25T15:03:40.832 INFO:tasks.workunit.client.0.smithi170.stdout:0/429: dread d8/d9/f16 [0,4194304] 0 2024-01-25T15:03:40.832 INFO:tasks.workunit.client.0.smithi170.stdout:0/430: chown d8/d10/d2d/d2f/l68 31 1 2024-01-25T15:03:40.833 INFO:tasks.workunit.client.0.smithi170.stdout:7/471: rmdir d8/d20/d45/d8e 39 2024-01-25T15:03:40.833 INFO:tasks.workunit.client.0.smithi170.stdout:7/472: write d8/d20/d2a/d61/f63 [1200244,121784] 0 2024-01-25T15:03:40.833 INFO:tasks.workunit.client.0.smithi170.stdout:7/473: truncate d8/d20/d2a/d35/d55/d7d/fa5 217556 0 2024-01-25T15:03:40.834 INFO:tasks.workunit.client.0.smithi170.stdout:5/383: write d5/d54/d85/d2c/d51/d41/f44 [940714,115515] 0 2024-01-25T15:03:40.835 INFO:tasks.workunit.client.0.smithi170.stdout:1/421: creat d0/d20/d28/d7b/f92 x:0 0 0 2024-01-25T15:03:40.835 INFO:tasks.workunit.client.0.smithi170.stdout:1/422: creat d0/d20/d28/d7b/f93 x:0 0 0 2024-01-25T15:03:40.836 INFO:tasks.workunit.client.0.smithi170.stdout:6/464: symlink d2/d7/d23/d19/d2a/d43/d98/l9e 0 2024-01-25T15:03:40.839 INFO:tasks.workunit.client.0.smithi170.stdout:8/424: symlink d3/d7/d22/d23/d25/d34/l8f 0 2024-01-25T15:03:40.839 INFO:tasks.workunit.client.0.smithi170.stdout:8/425: getdents d3/d7/d3a/d8d 0 2024-01-25T15:03:40.839 INFO:tasks.workunit.client.0.smithi170.stdout:8/426: readlink d3/d7/d22/d23/d25/l27 0 2024-01-25T15:03:40.839 INFO:tasks.workunit.client.0.smithi170.stdout:8/427: readlink d3/d7/d3a/l4e 0 2024-01-25T15:03:40.843 INFO:tasks.workunit.client.0.smithi170.stdout:5/384: rename d5/d54/d85/f59 to d5/d54/d85/d2c/d51/d3d/d57/f94 0 2024-01-25T15:03:40.845 INFO:tasks.workunit.client.0.smithi170.stdout:4/364: dwrite d6/d7/d34/f30 [0,4194304] 0 2024-01-25T15:03:40.846 INFO:tasks.workunit.client.0.smithi170.stdout:1/423: symlink d0/d50/d8e/l94 0 2024-01-25T15:03:40.848 INFO:tasks.workunit.client.0.smithi170.stdout:6/465: mknod d2/d7/d23/d19/d60/c9f 0 2024-01-25T15:03:40.848 INFO:tasks.workunit.client.0.smithi170.stdout:6/466: write d2/f40 [6721526,18831] 0 2024-01-25T15:03:40.848 INFO:tasks.workunit.client.0.smithi170.stdout:6/467: truncate d2/d7/d23/d19/d2a/d43/f58 193633 0 2024-01-25T15:03:40.849 INFO:tasks.workunit.client.0.smithi170.stdout:4/365: symlink d6/d37/l66 0 2024-01-25T15:03:40.849 INFO:tasks.workunit.client.0.smithi170.stdout:4/366: write d6/d28/f5d [479606,93079] 0 2024-01-25T15:03:40.852 INFO:tasks.workunit.client.0.smithi170.stdout:1/424: creat d0/d50/f95 x:0 0 0 2024-01-25T15:03:40.852 INFO:tasks.workunit.client.0.smithi170.stdout:1/425: read d0/f41 [130941,125117] 0 2024-01-25T15:03:40.852 INFO:tasks.workunit.client.0.smithi170.stdout:4/367: mkdir d6/d28/d67 0 2024-01-25T15:03:40.852 INFO:tasks.workunit.client.0.smithi170.stdout:4/368: getdents d6/d28/d67 0 2024-01-25T15:03:40.853 INFO:tasks.workunit.client.0.smithi170.stdout:0/431: write d8/d10/f69 [1529061,18432] 0 2024-01-25T15:03:40.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:40 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:40.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:40 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:40.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:40 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:40.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:40 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000713 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_stdcall_svc_getcaller/1-basic.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:40.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:40 smithi186 ceph-mon[35697]: Scrub error on inode 0x1000000046a (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_stdcall_svc_getcaller/assertions.xml) see mds.b log and `damage ls` output for details 2024-01-25T15:03:40.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:40 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:40.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:40 smithi186 ceph-mon[35697]: scrub summary: active paths [/] 2024-01-25T15:03:40.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:40 smithi186 ceph-mon[35697]: Scrub error on inode 0x100000006ff (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_regunreg_registerrpc/1-basic.c) see mds.b log and `damage ls` output for details 2024-01-25T15:03:40.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:40 smithi186 ceph-mon[35697]: Scrub error on inode 0x10000000459 (/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_regunreg_registerrpc/assertions.xml) see mds.b log and `damage ls` output for details 2024-01-25T15:03:40.855 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:40 smithi186 ceph-mon[35697]: scrub summary: idle+waiting paths [/] 2024-01-25T15:03:40.856 INFO:tasks.workunit.client.0.smithi170.stdout:8/428: write d3/d7/f2f [1929701,65611] 0 2024-01-25T15:03:40.856 INFO:tasks.workunit.client.0.smithi170.stdout:8/429: readlink d3/d7/d22/d23/l26 0 2024-01-25T15:03:40.856 INFO:tasks.workunit.client.0.smithi170.stdout:8/430: dread - d3/d7/d22/d23/f76 zero size 2024-01-25T15:03:40.856 INFO:tasks.workunit.client.0.smithi170.stdout:0/432: mkdir d8/d10/d2d/d2f/d96 0 2024-01-25T15:03:40.856 INFO:tasks.workunit.client.0.smithi170.stdout:4/369: getdents d6/d7/d31 0 2024-01-25T15:03:40.857 INFO:tasks.workunit.client.0.smithi170.stdout:4/370: creat d6/d7/d34/f68 x:0 0 0 2024-01-25T15:03:40.857 INFO:tasks.workunit.client.0.smithi170.stdout:4/371: stat d6/d28/c4e 0 2024-01-25T15:03:40.858 INFO:tasks.workunit.client.0.smithi170.stdout:8/431: mknod d3/d7/d1e/d74/d7f/c90 0 2024-01-25T15:03:40.858 INFO:tasks.workunit.client.0.smithi170.stdout:8/432: fdatasync d3/d7/d1e/f5e 0 2024-01-25T15:03:40.858 INFO:tasks.workunit.client.0.smithi170.stdout:8/433: write d3/d7/f16 [2433777,108454] 0 2024-01-25T15:03:40.858 INFO:tasks.workunit.client.0.smithi170.stdout:8/434: chown d3/d7/d22/d23/d25/c3d 520927254 1 2024-01-25T15:03:40.859 INFO:tasks.workunit.client.0.smithi170.stdout:8/435: write d3/d7/d22/d23/d25/f5b [4809753,128327] 0 2024-01-25T15:03:40.859 INFO:tasks.workunit.client.0.smithi170.stdout:0/433: mknod d8/d10/d2d/d89/c97 0 2024-01-25T15:03:40.859 INFO:tasks.workunit.client.0.smithi170.stdout:0/434: dread - d8/d18/f78 zero size 2024-01-25T15:03:40.859 INFO:tasks.workunit.client.0.smithi170.stdout:7/474: write d8/d20/d3b/d4d/f97 [1626531,130056] 0 2024-01-25T15:03:40.865 INFO:tasks.workunit.client.0.smithi170.stdout:1/426: write d0/ff [2657582,83404] 0 2024-01-25T15:03:40.866 INFO:tasks.workunit.client.0.smithi170.stdout:6/468: write d2/d7/d23/d19/d2f/f32 [172942,47429] 0 2024-01-25T15:03:40.866 INFO:tasks.workunit.client.0.smithi170.stdout:6/469: readlink d2/d7/d1b/l88 0 2024-01-25T15:03:40.866 INFO:tasks.workunit.client.0.smithi170.stdout:7/475: symlink d8/d20/d3b/lb5 0 2024-01-25T15:03:40.868 INFO:tasks.workunit.client.0.smithi170.stdout:5/385: write d5/d54/d85/d2c/d45/f6c [1196920,62161] 0 2024-01-25T15:03:40.871 INFO:tasks.workunit.client.0.smithi170.stdout:6/470: creat d2/fa0 x:0 0 0 2024-01-25T15:03:40.873 INFO:tasks.workunit.client.0.smithi170.stdout:5/386: creat d5/d54/d85/d3f/d8f/f95 x:0 0 0 2024-01-25T15:03:40.873 INFO:tasks.workunit.client.0.smithi170.stdout:5/387: chown d5/f16 381132 1 2024-01-25T15:03:40.873 INFO:tasks.workunit.client.0.smithi170.stdout:5/388: getdents d5/d54/d85/d2c/d45/d56 0 2024-01-25T15:03:40.873 INFO:tasks.workunit.client.0.smithi170.stdout:5/389: write d5/f1b [8857450,31626] 0 2024-01-25T15:03:40.874 INFO:tasks.workunit.client.0.smithi170.stdout:5/390: fdatasync d5/d54/d85/f5c 0 2024-01-25T15:03:40.874 INFO:tasks.workunit.client.0.smithi170.stdout:5/391: fdatasync d5/f8e 0 2024-01-25T15:03:40.874 INFO:tasks.workunit.client.0.smithi170.stdout:8/436: rename d3/d7/d1e/d74 to d3/d7/d3a/d91 0 2024-01-25T15:03:40.875 INFO:tasks.workunit.client.0.smithi170.stdout:8/437: fdatasync d3/d7/d22/d23/d48/d52/f43 0 2024-01-25T15:03:40.876 INFO:tasks.workunit.client.0.smithi170.stdout:6/471: link d2/d7/d1b/d28/f49 d2/d7/d23/d19/d2a/d43/fa1 0 2024-01-25T15:03:40.876 INFO:tasks.workunit.client.0.smithi170.stdout:6/472: write d2/d7/d23/d19/d2f/d5d/f6f [544863,118371] 0 2024-01-25T15:03:40.877 INFO:tasks.workunit.client.0.smithi170.stdout:5/392: unlink d5/d54/d85/d2c/l3c 0 2024-01-25T15:03:40.879 INFO:tasks.workunit.client.0.smithi170.stdout:4/372: dwrite d6/d7/f17 [4194304,4194304] 0 2024-01-25T15:03:40.884 INFO:tasks.workunit.client.0.smithi170.stdout:4/373: dread d6/d28/f45 [0,4194304] 0 2024-01-25T15:03:40.885 INFO:tasks.workunit.client.0.smithi170.stdout:5/393: dread d5/f11 [0,4194304] 0 2024-01-25T15:03:40.885 INFO:tasks.workunit.client.0.smithi170.stdout:5/394: dread - d5/d54/d85/d2c/d51/d3d/d57/f87 zero size 2024-01-25T15:03:40.886 INFO:tasks.workunit.client.0.smithi170.stdout:5/395: mkdir d5/d54/d85/d2c/d51/d96 0 2024-01-25T15:03:40.889 INFO:tasks.workunit.client.0.smithi170.stdout:5/396: link d5/d54/d85/d2c/d45/d56/c68 d5/d54/d85/d2c/d45/d56/d72/c97 0 2024-01-25T15:03:40.890 INFO:tasks.workunit.client.0.smithi170.stdout:5/397: read d5/d54/d85/d2c/d45/f48 [41232,91431] 0 2024-01-25T15:03:40.891 INFO:tasks.workunit.client.0.smithi170.stdout:5/398: unlink d5/d2a/l62 0 2024-01-25T15:03:40.891 INFO:tasks.workunit.client.0.smithi170.stdout:5/399: write d5/d2a/f52 [834476,82151] 0 2024-01-25T15:03:40.897 INFO:tasks.workunit.client.0.smithi170.stdout:1/427: dwrite d0/d1b/f43 [0,4194304] 0 2024-01-25T15:03:40.902 INFO:tasks.workunit.client.0.smithi170.stdout:8/438: dwrite d3/d7/d22/d23/f54 [0,4194304] 0 2024-01-25T15:03:40.902 INFO:tasks.workunit.client.0.smithi170.stdout:8/439: chown d3/d7/f16 21060623 1 2024-01-25T15:03:40.904 INFO:tasks.workunit.client.0.smithi170.stdout:8/440: getdents d3/d7/d22 0 2024-01-25T15:03:40.906 INFO:tasks.workunit.client.0.smithi170.stdout:4/374: dwrite d6/d28/f52 [0,4194304] 0 2024-01-25T15:03:40.906 INFO:tasks.workunit.client.0.smithi170.stdout:8/441: link d3/d7/c1a d3/d7/d22/d23/c92 0 2024-01-25T15:03:40.907 INFO:tasks.workunit.client.0.smithi170.stdout:5/400: read d5/d54/d85/f19 [1665249,121331] 0 2024-01-25T15:03:40.908 INFO:tasks.workunit.client.0.smithi170.stdout:1/428: dread d0/d1b/f43 [0,4194304] 0 2024-01-25T15:03:40.913 INFO:tasks.workunit.client.0.smithi170.stdout:8/442: mknod d3/d7/d22/d23/d48/d52/d47/d86/c93 0 2024-01-25T15:03:40.913 INFO:tasks.workunit.client.0.smithi170.stdout:5/401: symlink d5/d54/d85/d2c/d51/l98 0 2024-01-25T15:03:40.913 INFO:tasks.workunit.client.0.smithi170.stdout:5/402: readlink d5/l7f 0 2024-01-25T15:03:40.913 INFO:tasks.workunit.client.0.smithi170.stdout:5/403: truncate d5/d54/d85/d2c/d34/d7c/f83 86992 0 2024-01-25T15:03:40.915 INFO:tasks.workunit.client.0.smithi170.stdout:1/429: link d0/d20/d28/d2a/d4a/d56/l79 d0/d50/d8e/d8f/l96 0 2024-01-25T15:03:40.915 INFO:tasks.workunit.client.0.smithi170.stdout:1/430: chown d0/d20 54021 1 2024-01-25T15:03:40.915 INFO:tasks.workunit.client.0.smithi170.stdout:1/431: fdatasync d0/fd 0 2024-01-25T15:03:40.916 INFO:tasks.workunit.client.0.smithi170.stdout:8/443: creat d3/d7/d3a/f94 x:0 0 0 2024-01-25T15:03:40.917 INFO:tasks.workunit.client.0.smithi170.stdout:8/444: truncate d3/d7/d22/d23/f33 1111544 0 2024-01-25T15:03:40.919 INFO:tasks.workunit.client.0.smithi170.stdout:8/445: creat d3/d7/d22/d23/d25/f95 x:0 0 0 2024-01-25T15:03:40.920 INFO:tasks.workunit.client.0.smithi170.stdout:8/446: mknod d3/d7/d22/c96 0 2024-01-25T15:03:40.920 INFO:tasks.workunit.client.0.smithi170.stdout:8/447: dread - d3/d7/d22/d23/d48/f65 zero size 2024-01-25T15:03:40.921 INFO:tasks.workunit.client.0.smithi170.stdout:4/375: dread d6/d7/d1b/f41 [0,4194304] 0 2024-01-25T15:03:40.921 INFO:tasks.workunit.client.0.smithi170.stdout:8/448: creat d3/d7/d1e/d7c/f97 x:0 0 0 2024-01-25T15:03:40.922 INFO:tasks.workunit.client.0.smithi170.stdout:8/449: chown d3/d7/d22/d23/d25/l36 1417946 1 2024-01-25T15:03:40.922 INFO:tasks.workunit.client.0.smithi170.stdout:7/476: rename d8/d20/d2a/d35/d55/d7d/fa5 to d8/fb6 0 2024-01-25T15:03:40.925 INFO:tasks.workunit.client.0.smithi170.stdout:4/376: creat d6/d7/d1b/f69 x:0 0 0 2024-01-25T15:03:40.925 INFO:tasks.workunit.client.0.smithi170.stdout:4/377: write d6/d28/f45 [3665000,53243] 0 2024-01-25T15:03:40.926 INFO:tasks.workunit.client.0.smithi170.stdout:4/378: symlink d6/d28/d67/l6a 0 2024-01-25T15:03:40.926 INFO:tasks.workunit.client.0.smithi170.stdout:4/379: readlink l3 0 2024-01-25T15:03:40.926 INFO:tasks.workunit.client.0.smithi170.stdout:8/450: symlink d3/d7/d22/d23/d25/d41/l98 0 2024-01-25T15:03:40.928 INFO:tasks.workunit.client.0.smithi170.stdout:5/404: rename d5/d54/d85/l38 to d5/d54/d85/d2c/d51/d3d/l99 0 2024-01-25T15:03:40.928 INFO:tasks.workunit.client.0.smithi170.stdout:5/405: read d5/d54/d85/d2c/f31 [1292010,130701] 0 2024-01-25T15:03:40.928 INFO:tasks.workunit.client.0.smithi170.stdout:7/477: mknod d8/d20/d2a/d35/db0/cb7 0 2024-01-25T15:03:40.930 INFO:tasks.workunit.client.0.smithi170.stdout:4/380: mkdir d6/d7/d34/d6b 0 2024-01-25T15:03:40.930 INFO:tasks.workunit.client.0.smithi170.stdout:4/381: creat d6/d7/d34/f6c x:0 0 0 2024-01-25T15:03:40.933 INFO:tasks.workunit.client.0.smithi170.stdout:4/382: creat d6/d7/d34/d6b/f6d x:0 0 0 2024-01-25T15:03:40.933 INFO:tasks.workunit.client.0.smithi170.stdout:4/383: fdatasync d6/d7/d34/f68 0 2024-01-25T15:03:40.935 INFO:tasks.workunit.client.0.smithi170.stdout:4/384: rename d6/d7/f17 to d6/d7/d34/f6e 0 2024-01-25T15:03:40.938 INFO:tasks.workunit.client.0.smithi170.stdout:3/487: sync 2024-01-25T15:03:40.942 INFO:tasks.workunit.client.0.smithi170.stdout:1/432: dwrite d0/fd [0,4194304] 0 2024-01-25T15:03:40.942 INFO:tasks.workunit.client.0.smithi170.stdout:1/433: write d0/ff [872838,86328] 0 2024-01-25T15:03:40.942 INFO:tasks.workunit.client.0.smithi170.stdout:1/434: dread - d0/d2e/f8d zero size 2024-01-25T15:03:40.942 INFO:tasks.workunit.client.0.smithi170.stdout:3/488: dread d3/d10/d52/f5d [0,4194304] 0 2024-01-25T15:03:40.942 INFO:tasks.workunit.client.0.smithi170.stdout:3/489: dread - d3/d10/d13/d1b/d29/f94 zero size 2024-01-25T15:03:40.942 INFO:tasks.workunit.client.0.smithi170.stdout:3/490: chown d3/d10/d52/f5d 30898772 1 2024-01-25T15:03:40.943 INFO:tasks.workunit.client.0.smithi170.stdout:1/435: symlink d0/d20/d28/d2a/d4a/d56/d5b/l97 0 2024-01-25T15:03:40.951 INFO:tasks.workunit.client.0.smithi170.stdout:4/385: read d6/d28/f52 [1713997,4371] 0 2024-01-25T15:03:40.952 INFO:tasks.workunit.client.0.smithi170.stdout:4/386: creat d6/d28/d59/f6f x:0 0 0 2024-01-25T15:03:40.953 INFO:tasks.workunit.client.0.smithi170.stdout:4/387: mknod d6/d7/d34/c70 0 2024-01-25T15:03:40.954 INFO:tasks.workunit.client.0.smithi170.stdout:7/478: dwrite d8/d20/f30 [0,4194304] 0 2024-01-25T15:03:40.955 INFO:tasks.workunit.client.0.smithi170.stdout:4/388: truncate d6/d7/d34/f6e 7506028 0 2024-01-25T15:03:40.955 INFO:tasks.workunit.client.0.smithi170.stdout:8/451: dwrite d3/d7/d22/d23/f4a [0,4194304] 0 2024-01-25T15:03:40.960 INFO:tasks.workunit.client.0.smithi170.stdout:5/406: dwrite d5/d54/d85/d2c/d34/f8b [0,4194304] 0 2024-01-25T15:03:40.960 INFO:tasks.workunit.client.0.smithi170.stdout:5/407: chown d5/cc 81808781 1 2024-01-25T15:03:40.961 INFO:tasks.workunit.client.0.smithi170.stdout:5/408: write d5/d54/d85/d3f/f79 [116373,47321] 0 2024-01-25T15:03:40.961 INFO:tasks.workunit.client.0.smithi170.stdout:5/409: dread - d5/d54/d85/d2c/d51/d3d/f74 zero size 2024-01-25T15:03:40.961 INFO:tasks.workunit.client.0.smithi170.stdout:5/410: truncate d5/d54/d85/d2c/d51/d3d/f74 598480 0 2024-01-25T15:03:40.961 INFO:tasks.workunit.client.0.smithi170.stdout:4/389: unlink d6/d7/d34/c15 0 2024-01-25T15:03:40.963 INFO:tasks.workunit.client.0.smithi170.stdout:4/390: write d6/d28/f56 [37248,117493] 0 2024-01-25T15:03:40.965 INFO:tasks.workunit.client.0.smithi170.stdout:5/411: symlink d5/d54/d85/d2c/l9a 0 2024-01-25T15:03:40.968 INFO:tasks.workunit.client.0.smithi170.stdout:5/412: creat d5/d54/d85/d2c/d51/d41/f9b x:0 0 0 2024-01-25T15:03:40.968 INFO:tasks.workunit.client.0.smithi170.stdout:5/413: readlink d5/d54/d85/l18 0 2024-01-25T15:03:40.968 INFO:tasks.workunit.client.0.smithi170.stdout:8/452: write d3/d7/d22/d23/d25/f2d [599583,125995] 0 2024-01-25T15:03:40.968 INFO:tasks.workunit.client.0.smithi170.stdout:8/453: write d3/d7/d22/d23/d25/f5c [1287063,114718] 0 2024-01-25T15:03:40.968 INFO:tasks.workunit.client.0.smithi170.stdout:8/454: write d3/d7/f2f [4309340,111707] 0 2024-01-25T15:03:40.968 INFO:tasks.workunit.client.0.smithi170.stdout:8/455: fdatasync f0 0 2024-01-25T15:03:40.970 INFO:tasks.workunit.client.0.smithi170.stdout:5/414: rename d5/d2a/c71 to d5/d54/d85/d2c/d51/d3d/c9c 0 2024-01-25T15:03:40.970 INFO:tasks.workunit.client.0.smithi170.stdout:5/415: write d5/d54/d85/f14 [684891,44808] 0 2024-01-25T15:03:40.970 INFO:tasks.workunit.client.0.smithi170.stdout:5/416: readlink d5/l22 0 2024-01-25T15:03:40.972 INFO:tasks.workunit.client.0.smithi170.stdout:3/491: dwrite d3/fa [0,4194304] 0 2024-01-25T15:03:40.972 INFO:tasks.workunit.client.0.smithi170.stdout:8/456: mknod d3/d7/c99 0 2024-01-25T15:03:40.974 INFO:tasks.workunit.client.0.smithi170.stdout:3/492: getdents d3/d10/d1e/d21/d41/d4b/d63 0 2024-01-25T15:03:40.975 INFO:tasks.workunit.client.0.smithi170.stdout:1/436: dwrite d0/f6d [0,4194304] 0 2024-01-25T15:03:40.976 INFO:tasks.workunit.client.0.smithi170.stdout:8/457: mkdir d3/d7/d22/d23/d25/d41/d9a 0 2024-01-25T15:03:40.976 INFO:tasks.workunit.client.0.smithi170.stdout:8/458: chown d3/d7/d22/d23/d25/d41/d61/c83 5 1 2024-01-25T15:03:40.976 INFO:tasks.workunit.client.0.smithi170.stdout:8/459: dread - d3/d7/d3a/f70 zero size 2024-01-25T15:03:40.976 INFO:tasks.workunit.client.0.smithi170.stdout:8/460: write d3/d7/d22/d23/d25/f3c [5012375,2131] 0 2024-01-25T15:03:40.977 INFO:tasks.workunit.client.0.smithi170.stdout:5/417: dread d5/d54/d85/d2c/d45/d5e/f65 [0,4194304] 0 2024-01-25T15:03:40.987 INFO:tasks.workunit.client.0.smithi170.stdout:7/479: link d8/d20/d2a/d35/d55/d7d/c6b d8/d20/d45/d68/d71/cb8 0 2024-01-25T15:03:40.989 INFO:tasks.workunit.client.0.smithi170.stdout:1/437: mknod d0/d20/d28/c98 0 2024-01-25T15:03:40.994 INFO:tasks.workunit.client.0.smithi170.stdout:4/391: truncate d6/d7/d34/f6e 4861699 0 2024-01-25T15:03:40.998 INFO:tasks.workunit.client.0.smithi170.stdout:1/438: write d0/d20/d28/d2a/d4a/d56/f64 [3850653,52568] 0 2024-01-25T15:03:40.999 INFO:tasks.workunit.client.0.smithi170.stdout:1/439: creat d0/f99 x:0 0 0 2024-01-25T15:03:41.001 INFO:tasks.workunit.client.0.smithi170.stdout:1/440: truncate d0/d20/f4d 3757058 0 2024-01-25T15:03:41.003 INFO:tasks.workunit.client.0.smithi170.stdout:1/441: dread d0/d20/d28/f29 [0,4194304] 0 2024-01-25T15:03:41.009 INFO:tasks.workunit.client.0.smithi170.stdout:7/480: dwrite d8/d20/d3b/d4d/f97 [0,4194304] 0 2024-01-25T15:03:41.010 INFO:tasks.workunit.client.0.smithi170.stdout:7/481: mkdir d8/d20/d2a/d35/d55/d9b/db9 0 2024-01-25T15:03:41.010 INFO:tasks.workunit.client.0.smithi170.stdout:4/392: read d6/d7/f9 [3974532,15026] 0 2024-01-25T15:03:41.010 INFO:tasks.workunit.client.0.smithi170.stdout:4/393: chown d6/d28/d67/l6a 78363 1 2024-01-25T15:03:41.011 INFO:tasks.workunit.client.0.smithi170.stdout:7/482: rmdir d8/d20/d45 39 2024-01-25T15:03:41.011 INFO:tasks.workunit.client.0.smithi170.stdout:7/483: write d8/d20/d2a/f5a [714138,104107] 0 2024-01-25T15:03:41.011 INFO:tasks.workunit.client.0.smithi170.stdout:7/484: rmdir d8/d20/d45/d68 39 2024-01-25T15:03:41.011 INFO:tasks.workunit.client.0.smithi170.stdout:7/485: symlink d8/d20/d45/d68/d71/lba 2 2024-01-25T15:03:41.011 INFO:tasks.workunit.client.0.smithi170.stdout:7/486: fsync d8/f1c 0 2024-01-25T15:03:41.014 INFO:tasks.workunit.client.0.smithi170.stdout:7/487: link d8/f9e d8/d20/d2a/d35/fbb 0 2024-01-25T15:03:41.015 INFO:tasks.workunit.client.0.smithi170.stdout:5/418: dwrite d5/d54/d85/d2c/f2e [0,4194304] 0 2024-01-25T15:03:41.016 INFO:tasks.workunit.client.0.smithi170.stdout:3/493: rename d3/d10/d1e/d21/d41/d77/d42/d72 to d3/d10/d1e/d96 0 2024-01-25T15:03:41.018 INFO:tasks.workunit.client.0.smithi170.stdout:9/457: sync 2024-01-25T15:03:41.018 INFO:tasks.workunit.client.0.smithi170.stdout:2/473: sync 2024-01-25T15:03:41.018 INFO:tasks.workunit.client.0.smithi170.stdout:0/435: sync 2024-01-25T15:03:41.018 INFO:tasks.workunit.client.0.smithi170.stdout:6/473: sync 2024-01-25T15:03:41.019 INFO:tasks.workunit.client.0.smithi170.stdout:2/474: getdents d10/d1e/d32/d62/d8d 0 2024-01-25T15:03:41.020 INFO:tasks.workunit.client.0.smithi170.stdout:5/419: symlink d5/d54/l9d 0 2024-01-25T15:03:41.020 INFO:tasks.workunit.client.0.smithi170.stdout:5/420: dread - d5/d54/d85/d2c/d51/d3d/f6d zero size 2024-01-25T15:03:41.022 INFO:tasks.workunit.client.0.smithi170.stdout:2/475: creat d10/d1e/d32/d3e/d5c/d92/d8b/fb2 x:0 0 0 2024-01-25T15:03:41.022 INFO:tasks.workunit.client.0.smithi170.stdout:2/476: chown d10/d1b/d5f/l9c 25 1 2024-01-25T15:03:41.022 INFO:tasks.workunit.client.0.smithi170.stdout:2/477: fdatasync d10/d1e/d32/d3e/d41/d7a/fa7 0 2024-01-25T15:03:41.022 INFO:tasks.workunit.client.0.smithi170.stdout:8/461: rename d3/d7/d22/d23/d25/l36 to d3/d7/d22/d5d/l9b 0 2024-01-25T15:03:41.023 INFO:tasks.workunit.client.0.smithi170.stdout:8/462: readlink d3/d7/d22/d23/l2b 0 2024-01-25T15:03:41.023 INFO:tasks.workunit.client.0.smithi170.stdout:8/463: fsync d3/d7/d22/d23/d25/f5b 0 2024-01-25T15:03:41.023 INFO:tasks.workunit.client.0.smithi170.stdout:8/464: fsync d3/d7/d22/d23/d48/f81 0 2024-01-25T15:03:41.023 INFO:tasks.workunit.client.0.smithi170.stdout:8/465: truncate d3/d7/d22/d23/d48/d52/d47/f4b 5143659 0 2024-01-25T15:03:41.027 INFO:tasks.workunit.client.0.smithi170.stdout:3/494: truncate d3/d1c/d2b/f62 878373 0 2024-01-25T15:03:41.027 INFO:tasks.workunit.client.0.smithi170.stdout:1/442: dwrite d0/d50/f95 [0,4194304] 0 2024-01-25T15:03:41.030 INFO:tasks.workunit.client.0.smithi170.stdout:8/466: symlink d3/d7/d22/d23/d48/d52/d47/l9c 0 2024-01-25T15:03:41.032 INFO:tasks.workunit.client.0.smithi170.stdout:3/495: rename d3/d10/d13/d1b/d85/d8f to d3/d1c/d2b/d5c/d97 0 2024-01-25T15:03:41.034 INFO:tasks.workunit.client.0.smithi170.stdout:9/458: write d5/f8 [8215669,9721] 0 2024-01-25T15:03:41.034 INFO:tasks.workunit.client.0.smithi170.stdout:9/459: stat d5/df/d2e/d77/d21/d46/d18/c9f 0 2024-01-25T15:03:41.039 INFO:tasks.workunit.client.0.smithi170.stdout:5/421: dread d5/fd [0,4194304] 0 2024-01-25T15:03:41.039 INFO:tasks.workunit.client.0.smithi170.stdout:5/422: fdatasync d5/d54/d85/d2c/d45/f75 0 2024-01-25T15:03:41.039 INFO:tasks.workunit.client.0.smithi170.stdout:5/423: fdatasync d5/d54/d85/d3f/d8f/f95 0 2024-01-25T15:03:41.052 INFO:tasks.workunit.client.0.smithi170.stdout:4/394: dwrite d6/d28/f5d [0,4194304] 0 2024-01-25T15:03:41.052 INFO:tasks.workunit.client.0.smithi170.stdout:7/488: dwrite d8/d20/d2a/d35/d55/f85 [0,4194304] 0 2024-01-25T15:03:41.052 INFO:tasks.workunit.client.0.smithi170.stdout:6/474: dread d2/d7/f1c [4194304,4194304] 0 2024-01-25T15:03:41.056 INFO:tasks.workunit.client.0.smithi170.stdout:0/436: dwrite f6 [0,4194304] 0 2024-01-25T15:03:41.057 INFO:tasks.workunit.client.0.smithi170.stdout:2/478: write d10/d1e/f20 [1342878,59455] 0 2024-01-25T15:03:41.057 INFO:tasks.workunit.client.0.smithi170.stdout:9/460: dread d5/df/d16/d35/d3c/f4e [0,4194304] 0 2024-01-25T15:03:41.057 INFO:tasks.workunit.client.0.smithi170.stdout:4/395: mkdir d6/d7/d1b/d71 0 2024-01-25T15:03:41.059 INFO:tasks.workunit.client.0.smithi170.stdout:6/475: creat d2/d7/d23/d19/d2f/d5d/d94/fa2 x:0 0 0 2024-01-25T15:03:41.059 INFO:tasks.workunit.client.0.smithi170.stdout:6/476: chown d2/d7/d1b/l56 6 1 2024-01-25T15:03:41.059 INFO:tasks.workunit.client.0.smithi170.stdout:6/477: dread - d2/d7/d23/d19/d2a/d43/d44/d80/f93 zero size 2024-01-25T15:03:41.060 INFO:tasks.workunit.client.0.smithi170.stdout:6/478: readlink d2/d7/l41 0 2024-01-25T15:03:41.060 INFO:tasks.workunit.client.0.smithi170.stdout:6/479: fdatasync d2/d7/d23/d19/d2a/d43/f59 0 2024-01-25T15:03:41.060 INFO:tasks.workunit.client.0.smithi170.stdout:6/480: truncate d2/f4f 266681 0 2024-01-25T15:03:41.061 INFO:tasks.workunit.client.0.smithi170.stdout:0/437: mknod d8/d10/d2d/d2f/d6a/c98 0 2024-01-25T15:03:41.062 INFO:tasks.workunit.client.0.smithi170.stdout:9/461: getdents d5/df/d16/d35/d3c/d56/d85 0 2024-01-25T15:03:41.066 INFO:tasks.workunit.client.0.smithi170.stdout:3/496: dwrite d3/d10/d1e/d96/f7b [0,4194304] 0 2024-01-25T15:03:41.066 INFO:tasks.workunit.client.0.smithi170.stdout:2/479: creat d10/d1e/d5e/d73/d9e/da3/fb3 x:0 0 0 2024-01-25T15:03:41.069 INFO:tasks.workunit.client.0.smithi170.stdout:4/396: rmdir d6/d7/d1b/d71 0 2024-01-25T15:03:41.070 INFO:tasks.workunit.client.0.smithi170.stdout:0/438: creat d8/d9/f99 x:0 0 0 2024-01-25T15:03:41.072 INFO:tasks.workunit.client.0.smithi170.stdout:3/497: mkdir d3/d10/d6d/d98 0 2024-01-25T15:03:41.072 INFO:tasks.workunit.client.0.smithi170.stdout:2/480: dread d10/d1b/f1d [0,4194304] 0 2024-01-25T15:03:41.072 INFO:tasks.workunit.client.0.smithi170.stdout:2/481: chown d10/d1e/f4e 138700854 1 2024-01-25T15:03:41.072 INFO:tasks.workunit.client.0.smithi170.stdout:2/482: readlink d10/d1e/d32/d3e/d5c/la4 0 2024-01-25T15:03:41.072 INFO:tasks.workunit.client.0.smithi170.stdout:5/424: dwrite d5/d2a/f4a [4194304,4194304] 0 2024-01-25T15:03:41.073 INFO:tasks.workunit.client.0.smithi170.stdout:8/467: dwrite d3/d7/d3a/d91/d7f/f8c [0,4194304] 0 2024-01-25T15:03:41.073 INFO:tasks.workunit.client.0.smithi170.stdout:8/468: truncate d3/d7/f62 946155 0 2024-01-25T15:03:41.073 INFO:tasks.workunit.client.0.smithi170.stdout:8/469: fsync d3/d7/d22/d23/d48/d52/f43 0 2024-01-25T15:03:41.074 INFO:tasks.workunit.client.0.smithi170.stdout:4/397: rename d6/d7/d34/l19 to d6/d7/d34/l72 0 2024-01-25T15:03:41.075 INFO:tasks.workunit.client.0.smithi170.stdout:2/483: dread d10/d1e/f71 [0,4194304] 0 2024-01-25T15:03:41.077 INFO:tasks.workunit.client.0.smithi170.stdout:9/462: rmdir d5/df/d2e/d6b 39 2024-01-25T15:03:41.077 INFO:tasks.workunit.client.0.smithi170.stdout:9/463: truncate d5/df/d16/d35/d3c/f5f 400110 0 2024-01-25T15:03:41.078 INFO:tasks.workunit.client.0.smithi170.stdout:2/484: dread d10/d1b/f36 [0,4194304] 0 2024-01-25T15:03:41.079 INFO:tasks.workunit.client.0.smithi170.stdout:3/498: symlink d3/d1c/d2b/l99 0 2024-01-25T15:03:41.079 INFO:tasks.workunit.client.0.smithi170.stdout:3/499: truncate d3/d10/d1e/d21/d41/d4b/f90 68877 0 2024-01-25T15:03:41.081 INFO:tasks.workunit.client.0.smithi170.stdout:2/485: creat d10/d1e/d32/d62/d74/fb4 x:0 0 0 2024-01-25T15:03:41.081 INFO:tasks.workunit.client.0.smithi170.stdout:2/486: write d10/d16/d42/f48 [1621042,79623] 0 2024-01-25T15:03:41.081 INFO:tasks.workunit.client.0.smithi170.stdout:2/487: write d10/d1b/f36 [901416,129321] 0 2024-01-25T15:03:41.083 INFO:tasks.workunit.client.0.smithi170.stdout:4/398: write d6/d7/d1b/f41 [2423652,62881] 0 2024-01-25T15:03:41.083 INFO:tasks.workunit.client.0.smithi170.stdout:8/470: truncate d3/d7/d1e/f6c 2157703 0 2024-01-25T15:03:41.084 INFO:tasks.workunit.client.0.smithi170.stdout:4/399: symlink d6/d28/d67/l73 0 2024-01-25T15:03:41.084 INFO:tasks.workunit.client.0.smithi170.stdout:4/400: write d6/d37/f5a [68915,80889] 0 2024-01-25T15:03:41.085 INFO:tasks.workunit.client.0.smithi170.stdout:3/500: write d3/f17 [1307658,93748] 0 2024-01-25T15:03:41.085 INFO:tasks.workunit.client.0.smithi170.stdout:6/481: dwrite d2/d7/d1b/d28/f8a [0,4194304] 0 2024-01-25T15:03:41.086 INFO:tasks.workunit.client.0.smithi170.stdout:5/425: getdents d5/d54 0 2024-01-25T15:03:41.086 INFO:tasks.workunit.client.0.smithi170.stdout:5/426: write d5/d2a/f53 [199166,61711] 0 2024-01-25T15:03:41.087 INFO:tasks.workunit.client.0.smithi170.stdout:5/427: read d5/d54/d85/f14 [458385,657] 0 2024-01-25T15:03:41.088 INFO:tasks.workunit.client.0.smithi170.stdout:8/471: truncate d3/d7/f2f 3261971 0 2024-01-25T15:03:41.088 INFO:tasks.workunit.client.0.smithi170.stdout:2/488: symlink d10/d1e/d32/d3e/d5c/lb5 0 2024-01-25T15:03:41.088 INFO:tasks.workunit.client.0.smithi170.stdout:4/401: read d6/f49 [77399,31233] 0 2024-01-25T15:03:41.089 INFO:tasks.workunit.client.0.smithi170.stdout:4/402: creat d6/d37/f74 x:0 0 0 2024-01-25T15:03:41.091 INFO:tasks.workunit.client.0.smithi170.stdout:0/439: rename d8/d3a to d8/d9/d9a 0 2024-01-25T15:03:41.093 INFO:tasks.workunit.client.0.smithi170.stdout:3/501: creat d3/d10/d1e/d21/f9a x:0 0 0 2024-01-25T15:03:41.094 INFO:tasks.workunit.client.0.smithi170.stdout:6/482: dread d2/d7/d23/d19/d2a/d43/f59 [0,4194304] 0 2024-01-25T15:03:41.094 INFO:tasks.workunit.client.0.smithi170.stdout:5/428: link d5/d54/d85/d2c/d34/f80 d5/d54/d85/d2c/f9e 0 2024-01-25T15:03:41.095 INFO:tasks.workunit.client.0.smithi170.stdout:7/489: link d8/d20/d45/d68/d71/ca0 d8/d20/d3b/d4d/cbc 0 2024-01-25T15:03:41.096 INFO:tasks.workunit.client.0.smithi170.stdout:7/490: chown d8/d20/d2a/d61/f77 6045 1 2024-01-25T15:03:41.096 INFO:tasks.workunit.client.0.smithi170.stdout:7/491: write d8/fb6 [738676,92934] 0 2024-01-25T15:03:41.096 INFO:tasks.workunit.client.0.smithi170.stdout:8/472: truncate d3/d7/d22/d23/d25/f2d 1990976 0 2024-01-25T15:03:41.096 INFO:tasks.workunit.client.0.smithi170.stdout:8/473: stat d3/d7/d22/d23/f76 0 2024-01-25T15:03:41.096 INFO:tasks.workunit.client.0.smithi170.stdout:2/489: mkdir d10/d1b/db6 0 2024-01-25T15:03:41.098 INFO:tasks.workunit.client.0.smithi170.stdout:4/403: rmdir d6/d7/d31/d46 39 2024-01-25T15:03:41.102 INFO:tasks.workunit.client.0.smithi170.stdout:0/440: rename d8/l85 to d8/d10/d2d/d2f/d6a/d79/d7e/l9b 0 2024-01-25T15:03:41.102 INFO:tasks.workunit.client.0.smithi170.stdout:0/441: write d8/d18/f3b [204677,38933] 0 2024-01-25T15:03:41.106 INFO:tasks.workunit.client.0.smithi170.stdout:3/502: unlink d3/d1c/d2b/f7f 0 2024-01-25T15:03:41.106 INFO:tasks.workunit.client.0.smithi170.stdout:3/503: fdatasync d3/d3b/f70 0 2024-01-25T15:03:41.107 INFO:tasks.workunit.client.0.smithi170.stdout:6/483: symlink d2/d7/d23/d19/d2a/d43/d44/d80/la3 0 2024-01-25T15:03:41.107 INFO:tasks.workunit.client.0.smithi170.stdout:8/474: dread d3/d7/f56 [0,4194304] 0 2024-01-25T15:03:41.115 INFO:tasks.workunit.client.0.smithi170.stdout:7/492: dread d8/d20/d45/f46 [0,4194304] 0 2024-01-25T15:03:41.115 INFO:tasks.workunit.client.0.smithi170.stdout:0/442: symlink d8/d10/d2d/d82/l9c 0 2024-01-25T15:03:41.115 INFO:tasks.workunit.client.0.smithi170.stdout:0/443: write d8/d10/d2d/d2f/f7c [965613,123904] 0 2024-01-25T15:03:41.115 INFO:tasks.workunit.client.0.smithi170.stdout:0/444: rename d8 to d8/d10/d9d 22 2024-01-25T15:03:41.115 INFO:tasks.workunit.client.0.smithi170.stdout:0/445: write d8/d10/d2d/d58/f5c [3530178,10648] 0 2024-01-25T15:03:41.115 INFO:tasks.workunit.client.0.smithi170.stdout:3/504: symlink d3/d10/l9b 0 2024-01-25T15:03:41.121 INFO:tasks.workunit.client.0.smithi170.stdout:5/429: dwrite d5/d54/d85/f5c [0,4194304] 0 2024-01-25T15:03:41.123 INFO:tasks.workunit.client.0.smithi170.stdout:7/493: dread d8/f31 [0,4194304] 0 2024-01-25T15:03:41.124 INFO:tasks.workunit.client.0.smithi170.stdout:0/446: rename d8/d10/d2d/d2f/c55 to d8/d10/d2d/d2f/d4f/d59/c9e 0 2024-01-25T15:03:41.124 INFO:tasks.workunit.client.0.smithi170.stdout:3/505: creat d3/d88/f9c x:0 0 0 2024-01-25T15:03:41.125 INFO:tasks.workunit.client.0.smithi170.stdout:6/484: rmdir d2/d7/d1b/d28 39 2024-01-25T15:03:41.132 INFO:tasks.workunit.client.0.smithi170.stdout:0/447: creat d8/d10/d2d/d58/f9f x:0 0 0 2024-01-25T15:03:41.133 INFO:tasks.workunit.client.0.smithi170.stdout:6/485: mkdir d2/d7/d23/d19/d2a/d43/d44/da4 0 2024-01-25T15:03:41.133 INFO:tasks.workunit.client.0.smithi170.stdout:6/486: fdatasync d2/d7/d23/f2d 0 2024-01-25T15:03:41.133 INFO:tasks.workunit.client.0.smithi170.stdout:6/487: dread - d2/f82 zero size 2024-01-25T15:03:41.135 INFO:tasks.workunit.client.0.smithi170.stdout:0/448: mknod d8/ca0 0 2024-01-25T15:03:41.136 INFO:tasks.workunit.client.0.smithi170.stdout:6/488: creat d2/d7/d23/fa5 x:0 0 0 2024-01-25T15:03:41.138 INFO:tasks.workunit.client.0.smithi170.stdout:6/489: symlink d2/d7/d1b/la6 0 2024-01-25T15:03:41.139 INFO:tasks.workunit.client.0.smithi170.stdout:5/430: write d5/d54/d85/d2c/d45/f75 [1542492,52674] 0 2024-01-25T15:03:41.139 INFO:tasks.workunit.client.0.smithi170.stdout:5/431: dread - d5/d54/d85/d2c/f9e zero size 2024-01-25T15:03:41.140 INFO:tasks.workunit.client.0.smithi170.stdout:0/449: rename d8/d9/c52 to d8/d80/ca1 0 2024-01-25T15:03:41.141 INFO:tasks.workunit.client.0.smithi170.stdout:5/432: truncate d5/d54/d85/f42 8154543 0 2024-01-25T15:03:41.141 INFO:tasks.workunit.client.0.smithi170.stdout:5/433: fsync d5/fd 0 2024-01-25T15:03:41.141 INFO:tasks.workunit.client.0.smithi170.stdout:5/434: truncate d5/d54/d85/f5a 794501 0 2024-01-25T15:03:41.141 INFO:tasks.workunit.client.0.smithi170.stdout:5/435: chown d5/d54/d85/d2c/d45/d5e/f7e 3625535 1 2024-01-25T15:03:41.144 INFO:tasks.workunit.client.0.smithi170.stdout:5/436: symlink d5/d54/d85/d2c/d51/d3d/l9f 0 2024-01-25T15:03:41.144 INFO:tasks.workunit.client.0.smithi170.stdout:5/437: chown d5/d54/d85/d2c/d51/d3d 88508589 1 2024-01-25T15:03:41.146 INFO:tasks.workunit.client.0.smithi170.stdout:4/404: dwrite d6/d7/d34/f68 [0,4194304] 0 2024-01-25T15:03:41.146 INFO:tasks.workunit.client.0.smithi170.stdout:3/506: dwrite d3/d3b/f70 [0,4194304] 0 2024-01-25T15:03:41.146 INFO:tasks.workunit.client.0.smithi170.stdout:8/475: dwrite d3/d7/d22/d23/d25/f2d [0,4194304] 0 2024-01-25T15:03:41.146 INFO:tasks.workunit.client.0.smithi170.stdout:3/507: write d3/d10/d13/d1b/d29/f8b [987693,27638] 0 2024-01-25T15:03:41.147 INFO:tasks.workunit.client.0.smithi170.stdout:3/508: chown d3/d10/d1e/d21/f9a 245734 1 2024-01-25T15:03:41.151 INFO:tasks.workunit.client.0.smithi170.stdout:4/405: write d6/d28/f45 [1473842,48344] 0 2024-01-25T15:03:41.151 INFO:tasks.workunit.client.0.smithi170.stdout:4/406: creat d6/f75 x:0 0 0 2024-01-25T15:03:41.151 INFO:tasks.workunit.client.0.smithi170.stdout:4/407: creat d6/f76 x:0 0 0 2024-01-25T15:03:41.156 INFO:tasks.workunit.client.0.smithi170.stdout:8/476: mkdir d3/d7/d22/d80/d9d 0 2024-01-25T15:03:41.156 INFO:tasks.workunit.client.0.smithi170.stdout:8/477: readlink d3/d7/d22/d5d/l63 0 2024-01-25T15:03:41.157 INFO:tasks.workunit.client.0.smithi170.stdout:6/490: rename d2/d7/d23/d19/d2a/d43/d44/d80 to d2/d7/d1b/d28/da7 0 2024-01-25T15:03:41.161 INFO:tasks.workunit.client.0.smithi170.stdout:4/408: symlink d6/d7/d34/l77 0 2024-01-25T15:03:41.164 INFO:tasks.workunit.client.0.smithi170.stdout:6/491: rmdir d2/d7/d23/d19/d2f/d73 0 2024-01-25T15:03:41.164 INFO:tasks.workunit.client.0.smithi170.stdout:6/492: fdatasync d2/d7/d23/d19/d2a/d43/f59 0 2024-01-25T15:03:41.164 INFO:tasks.workunit.client.0.smithi170.stdout:6/493: chown d2/d7/d23/d19/d2a 516276000 1 2024-01-25T15:03:41.164 INFO:tasks.workunit.client.0.smithi170.stdout:0/450: dwrite d8/d10/f69 [0,4194304] 0 2024-01-25T15:03:41.166 INFO:tasks.workunit.client.0.smithi170.stdout:6/494: creat d2/d7/d23/d19/d2a/d6b/fa8 x:0 0 0 2024-01-25T15:03:41.167 INFO:tasks.workunit.client.0.smithi170.stdout:0/451: mkdir d8/d10/d2d/d2f/d4f/da2 0 2024-01-25T15:03:41.169 INFO:tasks.workunit.client.0.smithi170.stdout:5/438: dread d5/d54/d85/d2c/d51/d41/f44 [0,4194304] 0 2024-01-25T15:03:41.170 INFO:tasks.workunit.client.0.smithi170.stdout:5/439: mkdir d5/d54/d85/d2c/d45/d56/d72/da0 0 2024-01-25T15:03:41.170 INFO:tasks.workunit.client.0.smithi170.stdout:5/440: write d5/f15 [1857426,25838] 0 2024-01-25T15:03:41.170 INFO:tasks.workunit.client.0.smithi170.stdout:5/441: truncate d5/d2a/f2b 5873084 0 2024-01-25T15:03:41.171 INFO:tasks.workunit.client.0.smithi170.stdout:1/443: sync 2024-01-25T15:03:41.171 INFO:tasks.workunit.client.0.smithi170.stdout:1/444: truncate d0/d20/d28/d2a/d4a/d56/f64 5350937 0 2024-01-25T15:03:41.172 INFO:tasks.workunit.client.0.smithi170.stdout:1/445: write d0/f46 [1050616,94632] 0 2024-01-25T15:03:41.174 INFO:tasks.workunit.client.0.smithi170.stdout:1/446: link d0/d1b/l86 d0/d20/d28/l9a 0 2024-01-25T15:03:41.182 INFO:tasks.workunit.client.0.smithi170.stdout:0/452: dread d8/f38 [0,4194304] 0 2024-01-25T15:03:41.182 INFO:tasks.workunit.client.0.smithi170.stdout:0/453: chown d8/d18/f4d 101233 1 2024-01-25T15:03:41.183 INFO:tasks.workunit.client.0.smithi170.stdout:6/495: write d2/f40 [973171,123762] 0 2024-01-25T15:03:41.184 INFO:tasks.workunit.client.0.smithi170.stdout:0/454: creat d8/d10/d2d/d2f/d96/fa3 x:0 0 0 2024-01-25T15:03:41.184 INFO:tasks.workunit.client.0.smithi170.stdout:0/455: truncate d8/d18/f3b 697668 0 2024-01-25T15:03:41.186 INFO:tasks.workunit.client.0.smithi170.stdout:6/496: rename d2/d7/d23/d19/d2a/d43/d98/c47 to d2/d7/d23/d19/d2f/ca9 0 2024-01-25T15:03:41.187 INFO:tasks.workunit.client.0.smithi170.stdout:0/456: link d8/d18/f3b d8/d18/fa4 0 2024-01-25T15:03:41.190 INFO:tasks.workunit.client.0.smithi170.stdout:1/447: write d0/fd [6986882,6062] 0 2024-01-25T15:03:41.190 INFO:tasks.workunit.client.0.smithi170.stdout:1/448: creat d0/d20/d3a/f9b x:0 0 0 2024-01-25T15:03:41.191 INFO:tasks.workunit.client.0.smithi170.stdout:1/449: mkdir d0/d50/d8e/d8f/d9c 0 2024-01-25T15:03:41.191 INFO:tasks.workunit.client.0.smithi170.stdout:1/450: write d0/d20/d28/d7b/f92 [858174,28705] 0 2024-01-25T15:03:41.192 INFO:tasks.workunit.client.0.smithi170.stdout:4/409: dwrite d6/d7/d31/f4d [0,4194304] 0 2024-01-25T15:03:41.196 INFO:tasks.workunit.client.0.smithi170.stdout:0/457: dread d8/d9/f16 [0,4194304] 0 2024-01-25T15:03:41.196 INFO:tasks.workunit.client.0.smithi170.stdout:5/442: dwrite d5/d2a/f8d [0,4194304] 0 2024-01-25T15:03:41.200 INFO:tasks.workunit.client.0.smithi170.stdout:5/443: symlink d5/d54/d85/d2c/d51/d41/la1 0 2024-01-25T15:03:41.200 INFO:tasks.workunit.client.0.smithi170.stdout:5/444: dread - d5/d54/d85/d2c/d45/d5e/f63 zero size 2024-01-25T15:03:41.200 INFO:tasks.workunit.client.0.smithi170.stdout:5/445: chown d5/d54/d85/l18 7257 1 2024-01-25T15:03:41.201 INFO:tasks.workunit.client.0.smithi170.stdout:6/497: dread d2/d7/d1b/f64 [0,4194304] 0 2024-01-25T15:03:41.202 INFO:tasks.workunit.client.0.smithi170.stdout:0/458: getdents d8/d9 0 2024-01-25T15:03:41.202 INFO:tasks.workunit.client.0.smithi170.stdout:0/459: chown d8/d10/f2b 15443512 1 2024-01-25T15:03:41.203 INFO:tasks.workunit.client.0.smithi170.stdout:0/460: write d8/d18/fa4 [1107135,27914] 0 2024-01-25T15:03:41.203 INFO:tasks.workunit.client.0.smithi170.stdout:0/461: write d8/d10/d2d/d89/f8d [382946,102686] 0 2024-01-25T15:03:41.203 INFO:tasks.workunit.client.0.smithi170.stdout:0/462: chown d8/d10/d2d/d82/l9c 189824260 1 2024-01-25T15:03:41.203 INFO:tasks.workunit.client.0.smithi170.stdout:0/463: creat d8/d10/d2d/d58/fa5 x:0 0 0 2024-01-25T15:03:41.204 INFO:tasks.workunit.client.0.smithi170.stdout:5/446: creat d5/d54/d85/d2c/fa2 x:0 0 0 2024-01-25T15:03:41.205 INFO:tasks.workunit.client.0.smithi170.stdout:5/447: chown d5/d58/l91 24 1 2024-01-25T15:03:41.205 INFO:tasks.workunit.client.0.smithi170.stdout:6/498: getdents d2/d7/d23/d19/d2a/d43 0 2024-01-25T15:03:41.209 INFO:tasks.workunit.client.0.smithi170.stdout:5/448: creat d5/d54/fa3 x:0 0 0 2024-01-25T15:03:41.216 INFO:tasks.workunit.client.0.smithi170.stdout:5/449: rmdir d5/d54/d85/d2c/d51/d41 39 2024-01-25T15:03:41.218 INFO:tasks.workunit.client.0.smithi170.stdout:5/450: rmdir d5/d54/d85/d2c/d45/d56/d72 39 2024-01-25T15:03:41.218 INFO:tasks.workunit.client.0.smithi170.stdout:5/451: readlink d5/d54/d85/d2c/d45/d5e/l89 0 2024-01-25T15:03:41.221 INFO:tasks.workunit.client.0.smithi170.stdout:5/452: rename d5/d54/d85/d2c/d51/d3d/l9f to d5/la4 0 2024-01-25T15:03:41.238 INFO:tasks.workunit.client.0.smithi170.stdout:5/453: write d5/f15 [6257707,79995] 0 2024-01-25T15:03:41.238 INFO:tasks.workunit.client.0.smithi170.stdout:5/454: chown d5/d54/d85/f5a 0 1 2024-01-25T15:03:41.239 INFO:tasks.workunit.client.0.smithi170.stdout:5/455: mkdir d5/d54/d85/d3f/d86/da5 0 2024-01-25T15:03:41.239 INFO:tasks.workunit.client.0.smithi170.stdout:5/456: dread - d5/d54/d85/f76 zero size 2024-01-25T15:03:41.240 INFO:tasks.workunit.client.0.smithi170.stdout:5/457: mkdir d5/d54/d85/d2c/d34/d69/da6 0 2024-01-25T15:03:41.240 INFO:tasks.workunit.client.0.smithi170.stdout:5/458: write d5/f40 [912864,99233] 0 2024-01-25T15:03:41.240 INFO:tasks.workunit.client.0.smithi170.stdout:5/459: rmdir d5/d54/d85/d2c/d45/d56/d72 39 2024-01-25T15:03:41.241 INFO:tasks.workunit.client.0.smithi170.stdout:5/460: chown d5/d54/d85/d3f 6830812 1 2024-01-25T15:03:41.246 INFO:tasks.workunit.client.0.smithi170.stdout:4/410: dwrite d6/d7/d34/f6e [0,4194304] 0 2024-01-25T15:03:41.246 INFO:tasks.workunit.client.0.smithi170.stdout:0/464: dwrite d8/d9/f56 [0,4194304] 0 2024-01-25T15:03:41.247 INFO:tasks.workunit.client.0.smithi170.stdout:1/451: dwrite d0/d20/d28/f4c [8388608,4194304] 0 2024-01-25T15:03:41.247 INFO:tasks.workunit.client.0.smithi170.stdout:4/411: mkdir d6/d7/d31/d46/d78 0 2024-01-25T15:03:41.247 INFO:tasks.workunit.client.0.smithi170.stdout:4/412: dread - d6/d7/d34/d6b/f6d zero size 2024-01-25T15:03:41.247 INFO:tasks.workunit.client.0.smithi170.stdout:4/413: chown d6/d7/d34/f68 1 1 2024-01-25T15:03:41.248 INFO:tasks.workunit.client.0.smithi170.stdout:1/452: mknod d0/d20/d28/d2a/d4a/d56/d5b/c9d 0 2024-01-25T15:03:41.249 INFO:tasks.workunit.client.0.smithi170.stdout:4/414: mknod d6/d28/c79 0 2024-01-25T15:03:41.249 INFO:tasks.workunit.client.0.smithi170.stdout:4/415: chown d6/d7/d34/d6b 70 1 2024-01-25T15:03:41.249 INFO:tasks.workunit.client.0.smithi170.stdout:4/416: chown d6/d28/d67/l73 22521668 1 2024-01-25T15:03:41.250 INFO:tasks.workunit.client.0.smithi170.stdout:0/465: rename d8/d3e/f61 to d8/d9/d9a/fa6 0 2024-01-25T15:03:41.250 INFO:tasks.workunit.client.0.smithi170.stdout:0/466: dread - d8/d18/f78 zero size 2024-01-25T15:03:41.250 INFO:tasks.workunit.client.0.smithi170.stdout:4/417: creat d6/d28/f7a x:0 0 0 2024-01-25T15:03:41.251 INFO:tasks.workunit.client.0.smithi170.stdout:5/461: dread d5/d54/d85/f21 [0,4194304] 0 2024-01-25T15:03:41.253 INFO:tasks.workunit.client.0.smithi170.stdout:0/467: symlink d8/d10/d2d/d2f/d4f/da2/la7 0 2024-01-25T15:03:41.253 INFO:tasks.workunit.client.0.smithi170.stdout:0/468: getdents d8/d9 0 2024-01-25T15:03:41.254 INFO:tasks.workunit.client.0.smithi170.stdout:4/418: truncate d6/f49 984581 0 2024-01-25T15:03:41.254 INFO:tasks.workunit.client.0.smithi170.stdout:4/419: fsync d6/d7/d34/f30 0 2024-01-25T15:03:41.257 INFO:tasks.workunit.client.0.smithi170.stdout:0/469: creat d8/d9/fa8 x:0 0 0 2024-01-25T15:03:41.259 INFO:tasks.workunit.client.0.smithi170.stdout:4/420: rename d6/f26 to d6/d7/d31/f7b 0 2024-01-25T15:03:41.261 INFO:tasks.workunit.client.0.smithi170.stdout:0/470: creat d8/d10/d5a/fa9 x:0 0 0 2024-01-25T15:03:41.262 INFO:tasks.workunit.client.0.smithi170.stdout:1/453: write d0/fd [3052472,78805] 0 2024-01-25T15:03:41.263 INFO:tasks.workunit.client.0.smithi170.stdout:1/454: chown d0/c73 3 1 2024-01-25T15:03:41.266 INFO:tasks.workunit.client.0.smithi170.stdout:1/455: mkdir d0/d50/d8e/d9e 0 2024-01-25T15:03:41.268 INFO:tasks.workunit.client.0.smithi170.stdout:1/456: symlink d0/d50/d8e/l9f 0 2024-01-25T15:03:41.268 INFO:tasks.workunit.client.0.smithi170.stdout:1/457: chown d0/l24 190 1 2024-01-25T15:03:41.273 INFO:tasks.workunit.client.0.smithi170.stdout:9/464: sync 2024-01-25T15:03:41.275 INFO:tasks.workunit.client.0.smithi170.stdout:9/465: rmdir d5/df/d16/d35/d3c/d56/d85/d8a 0 2024-01-25T15:03:41.275 INFO:tasks.workunit.client.0.smithi170.stdout:9/466: fsync d5/f8f 0 2024-01-25T15:03:41.276 INFO:tasks.workunit.client.0.smithi170.stdout:9/467: unlink d5/df/d16/d35/d3c/d56/d59/d5e/f95 0 2024-01-25T15:03:41.277 INFO:tasks.workunit.client.0.smithi170.stdout:9/468: mkdir d5/df/d2e/d77/d21/daa 0 2024-01-25T15:03:41.279 INFO:tasks.workunit.client.0.smithi170.stdout:9/469: getdents d5/df/d2e/d77/d21/daa 0 2024-01-25T15:03:41.279 INFO:tasks.workunit.client.0.smithi170.stdout:9/470: dread - d5/df/d16/d35/f75 zero size 2024-01-25T15:03:41.279 INFO:tasks.workunit.client.0.smithi170.stdout:9/471: creat d5/df/d2e/d77/d21/d34/d3e/fab x:0 0 0 2024-01-25T15:03:41.279 INFO:tasks.workunit.client.0.smithi170.stdout:9/472: dread d5/dc/f36 [0,4194304] 0 2024-01-25T15:03:41.280 INFO:tasks.workunit.client.0.smithi170.stdout:9/473: mkdir d5/df/d2e/d77/d21/d46/d6c/dac 0 2024-01-25T15:03:41.280 INFO:tasks.workunit.client.0.smithi170.stdout:9/474: write d5/df/d2e/d77/d21/d46/d6c/f71 [955338,115512] 0 2024-01-25T15:03:41.280 INFO:tasks.workunit.client.0.smithi170.stdout:9/475: write d5/df/d2e/d77/d21/d46/f81 [413451,21629] 0 2024-01-25T15:03:41.281 INFO:tasks.workunit.client.0.smithi170.stdout:9/476: fsync d5/df/d2e/d77/d21/d63/d96/f98 0 2024-01-25T15:03:41.281 INFO:tasks.workunit.client.0.smithi170.stdout:9/477: readlink d5/df/d16/d35/d3c/d56/l69 0 2024-01-25T15:03:41.281 INFO:tasks.workunit.client.0.smithi170.stdout:9/478: getdents d5/df/d2e/d77/d21/d63 0 2024-01-25T15:03:41.292 INFO:tasks.workunit.client.0.smithi170.stdout:0/471: dwrite d8/d18/f78 [0,4194304] 0 2024-01-25T15:03:41.292 INFO:tasks.workunit.client.0.smithi170.stdout:5/462: dwrite d5/d54/d85/d2c/d45/f75 [0,4194304] 0 2024-01-25T15:03:41.292 INFO:tasks.workunit.client.0.smithi170.stdout:2/490: sync 2024-01-25T15:03:41.293 INFO:tasks.workunit.client.0.smithi170.stdout:7/494: sync 2024-01-25T15:03:41.293 INFO:tasks.workunit.client.0.smithi170.stdout:4/421: rename d6/d7/d34/c54 to d6/d28/d67/c7c 0 2024-01-25T15:03:41.296 INFO:tasks.workunit.client.0.smithi170.stdout:5/463: rmdir d5/d54/d85/d2c/d34/d69/da6 0 2024-01-25T15:03:41.300 INFO:tasks.workunit.client.0.smithi170.stdout:1/458: rename d0/d50/d8e/d8f to d0/d50/da0 0 2024-01-25T15:03:41.302 INFO:tasks.workunit.client.0.smithi170.stdout:7/495: creat d8/d20/d45/d68/d71/fbd x:0 0 0 2024-01-25T15:03:41.304 INFO:tasks.workunit.client.0.smithi170.stdout:0/472: rename d8/ff to d8/d10/d2d/d89/faa 0 2024-01-25T15:03:41.305 INFO:tasks.workunit.client.0.smithi170.stdout:1/459: rename d0/d1b/f1c to d0/d1b/fa1 0 2024-01-25T15:03:41.307 INFO:tasks.workunit.client.0.smithi170.stdout:7/496: unlink d8/d20/d45/d8e/l91 0 2024-01-25T15:03:41.307 INFO:tasks.workunit.client.0.smithi170.stdout:7/497: readlink d8/d20/d2a/l2b 0 2024-01-25T15:03:41.308 INFO:tasks.workunit.client.0.smithi170.stdout:5/464: mknod d5/d54/d85/ca7 0 2024-01-25T15:03:41.308 INFO:tasks.workunit.client.0.smithi170.stdout:5/465: fdatasync d5/d54/d85/f5a 0 2024-01-25T15:03:41.309 INFO:tasks.workunit.client.0.smithi170.stdout:7/498: creat d8/d20/d2a/d35/d55/d9b/db9/fbe x:0 0 0 2024-01-25T15:03:41.311 INFO:tasks.workunit.client.0.smithi170.stdout:2/491: rename d10/da0 to d10/d1e/d5e/d73/d9e/db7 0 2024-01-25T15:03:41.311 INFO:tasks.workunit.client.0.smithi170.stdout:2/492: truncate d10/d1e/f91 914571 0 2024-01-25T15:03:41.312 INFO:tasks.workunit.client.0.smithi170.stdout:0/473: symlink d8/d10/d2d/lab 0 2024-01-25T15:03:41.314 INFO:tasks.workunit.client.0.smithi170.stdout:1/460: stat d0/d20/d28/d2a/d57/l84 0 2024-01-25T15:03:41.315 INFO:tasks.workunit.client.0.smithi170.stdout:5/466: mknod d5/d54/d85/d2c/d34/ca8 0 2024-01-25T15:03:41.316 INFO:tasks.workunit.client.0.smithi170.stdout:7/499: rename d8/d20/d45/d68/f7b to d8/d20/d45/d68/d71/d8c/fbf 0 2024-01-25T15:03:41.319 INFO:tasks.workunit.client.0.smithi170.stdout:2/493: truncate d10/f52 202489 0 2024-01-25T15:03:41.319 INFO:tasks.workunit.client.0.smithi170.stdout:2/494: write d10/d1e/d32/d98/fa5 [1016419,52151] 0 2024-01-25T15:03:41.319 INFO:tasks.workunit.client.0.smithi170.stdout:4/422: dwrite d6/d7/d31/f4d [0,4194304] 0 2024-01-25T15:03:41.320 INFO:tasks.workunit.client.0.smithi170.stdout:4/423: chown d6/f76 1485864 1 2024-01-25T15:03:41.320 INFO:tasks.workunit.client.0.smithi170.stdout:0/474: unlink d8/d10/d2d/d53/f60 0 2024-01-25T15:03:41.320 INFO:tasks.workunit.client.0.smithi170.stdout:1/461: mkdir d0/d50/da2 0 2024-01-25T15:03:41.324 INFO:tasks.workunit.client.0.smithi170.stdout:7/500: creat d8/d20/d2a/d35/db0/fc0 x:0 0 0 2024-01-25T15:03:41.324 INFO:tasks.workunit.client.0.smithi170.stdout:7/501: write d8/d20/d2a/f5a [860732,3881] 0 2024-01-25T15:03:41.324 INFO:tasks.workunit.client.0.smithi170.stdout:7/502: stat d8/d20/d45/d8e 0 2024-01-25T15:03:41.337 INFO:tasks.workunit.client.0.smithi170.stdout:2/495: dread d10/d16/f3b [4194304,4194304] 0 2024-01-25T15:03:41.341 INFO:tasks.workunit.client.0.smithi170.stdout:5/467: dwrite d5/d54/d85/d3f/f4f [0,4194304] 0 2024-01-25T15:03:41.346 INFO:tasks.workunit.client.0.smithi170.stdout:5/468: mkdir d5/d58/da9 0 2024-01-25T15:03:41.348 INFO:tasks.workunit.client.0.smithi170.stdout:0/475: dwrite d8/d80/f91 [0,4194304] 0 2024-01-25T15:03:41.349 INFO:tasks.workunit.client.0.smithi170.stdout:1/462: dwrite d0/d2e/f31 [0,4194304] 0 2024-01-25T15:03:41.350 INFO:tasks.workunit.client.0.smithi170.stdout:0/476: symlink d8/d9/lac 0 2024-01-25T15:03:41.351 INFO:tasks.workunit.client.0.smithi170.stdout:2/496: write d10/d1e/d32/d3e/f6b [59913,3228] 0 2024-01-25T15:03:41.351 INFO:tasks.workunit.client.0.smithi170.stdout:2/497: stat d10/c30 0 2024-01-25T15:03:41.351 INFO:tasks.workunit.client.0.smithi170.stdout:2/498: creat d10/d1e/d5e/d73/d9e/da3/fb8 x:0 0 0 2024-01-25T15:03:41.351 INFO:tasks.workunit.client.0.smithi170.stdout:2/499: chown d10/d16/d42/c57 1 1 2024-01-25T15:03:41.351 INFO:tasks.workunit.client.0.smithi170.stdout:3/509: sync 2024-01-25T15:03:41.351 INFO:tasks.workunit.client.0.smithi170.stdout:8/478: sync 2024-01-25T15:03:41.351 INFO:tasks.workunit.client.0.smithi170.stdout:6/499: sync 2024-01-25T15:03:41.351 INFO:tasks.workunit.client.0.smithi170.stdout:4/424: rename d6/d7/d34 to d6/d28/d59/d7d 0 2024-01-25T15:03:41.352 INFO:tasks.workunit.client.0.smithi170.stdout:1/463: creat d0/d20/d28/d2a/fa3 x:0 0 0 2024-01-25T15:03:41.353 INFO:tasks.workunit.client.0.smithi170.stdout:4/425: dread d6/f49 [0,4194304] 0 2024-01-25T15:03:41.356 INFO:tasks.workunit.client.0.smithi170.stdout:0/477: symlink d8/d10/d5a/d7f/lad 0 2024-01-25T15:03:41.356 INFO:tasks.workunit.client.0.smithi170.stdout:6/500: symlink d2/d7/d23/d19/d2a/d43/d44/da4/laa 0 2024-01-25T15:03:41.357 INFO:tasks.workunit.client.0.smithi170.stdout:1/464: truncate d0/d20/d28/f4c 10358296 0 2024-01-25T15:03:41.357 INFO:tasks.workunit.client.0.smithi170.stdout:1/465: fsync d0/f12 0 2024-01-25T15:03:41.361 INFO:tasks.workunit.client.0.smithi170.stdout:4/426: getdents d6/d28/d59 0 2024-01-25T15:03:41.361 INFO:tasks.workunit.client.0.smithi170.stdout:6/501: creat d2/d7/d23/d19/d2a/d43/d44/da4/fab x:0 0 0 2024-01-25T15:03:41.362 INFO:tasks.workunit.client.0.smithi170.stdout:1/466: creat d0/d20/fa4 x:0 0 0 2024-01-25T15:03:41.375 INFO:tasks.workunit.client.0.smithi170.stdout:1/467: dread d0/f5 [0,4194304] 0 2024-01-25T15:03:41.376 INFO:tasks.workunit.client.0.smithi170.stdout:0/478: dread d8/d10/f2b [0,4194304] 0 2024-01-25T15:03:41.382 INFO:tasks.workunit.client.0.smithi170.stdout:8/479: dwrite d3/d7/d22/d23/f33 [0,4194304] 0 2024-01-25T15:03:41.382 INFO:tasks.workunit.client.0.smithi170.stdout:8/480: chown d3/d7/d3a/l7d 9047041 1 2024-01-25T15:03:41.383 INFO:tasks.workunit.client.0.smithi170.stdout:2/500: dwrite d10/d1e/d5e/d73/d9e/da3/fb3 [0,4194304] 0 2024-01-25T15:03:41.384 INFO:tasks.workunit.client.0.smithi170.stdout:8/481: mknod d3/d7/d3a/d91/d7f/c9e 0 2024-01-25T15:03:41.387 INFO:tasks.workunit.client.0.smithi170.stdout:7/503: rename d8/d20/d45/d68/f7c to d8/d20/d2a/d35/d55/d9b/fc1 0 2024-01-25T15:03:41.388 INFO:tasks.workunit.client.0.smithi170.stdout:3/510: dwrite d3/d10/d13/f1d [0,4194304] 0 2024-01-25T15:03:41.388 INFO:tasks.workunit.client.0.smithi170.stdout:1/468: dread d0/d20/f2b [0,4194304] 0 2024-01-25T15:03:41.388 INFO:tasks.workunit.client.0.smithi170.stdout:8/482: mkdir d3/d7/d1e/d7c/d9f 0 2024-01-25T15:03:41.388 INFO:tasks.workunit.client.0.smithi170.stdout:3/511: chown d3/d10/d1e/d21/d41/d4b/f90 16 1 2024-01-25T15:03:41.388 INFO:tasks.workunit.client.0.smithi170.stdout:1/469: dread - d0/d20/d3a/d60/f7d zero size 2024-01-25T15:03:41.390 INFO:tasks.workunit.client.0.smithi170.stdout:5/469: rename d5/d54/d85/d2c/f9e to d5/d54/d85/d3f/faa 0 2024-01-25T15:03:41.392 INFO:tasks.workunit.client.0.smithi170.stdout:1/470: dread d0/d2e/f3b [0,4194304] 0 2024-01-25T15:03:41.393 INFO:tasks.workunit.client.0.smithi170.stdout:1/471: read - d0/d20/d28/d2a/d4a/d56/d81/f89 zero size 2024-01-25T15:03:41.393 INFO:tasks.workunit.client.0.smithi170.stdout:8/483: mkdir d3/d7/da0 0 2024-01-25T15:03:41.395 INFO:tasks.workunit.client.0.smithi170.stdout:8/484: rmdir d3/d7/da0 0 2024-01-25T15:03:41.399 INFO:tasks.workunit.client.0.smithi170.stdout:8/485: creat d3/d7/d73/fa1 x:0 0 0 2024-01-25T15:03:41.399 INFO:tasks.workunit.client.0.smithi170.stdout:8/486: mknod d3/d7/d1e/ca2 0 2024-01-25T15:03:41.399 INFO:tasks.workunit.client.0.smithi170.stdout:8/487: creat d3/d7/d22/d5d/fa3 x:0 0 0 2024-01-25T15:03:41.402 INFO:tasks.workunit.client.0.smithi170.stdout:0/479: dwrite d8/d10/f2e [0,4194304] 0 2024-01-25T15:03:41.402 INFO:tasks.workunit.client.0.smithi170.stdout:8/488: mkdir d3/d7/d22/d23/d25/d41/da4 0 2024-01-25T15:03:41.406 INFO:tasks.workunit.client.0.smithi170.stdout:0/480: unlink d8/d10/d2d/d2f/c3f 0 2024-01-25T15:03:41.407 INFO:tasks.workunit.client.0.smithi170.stdout:8/489: dread d3/d7/d22/d23/d25/f5c [0,4194304] 0 2024-01-25T15:03:41.408 INFO:tasks.workunit.client.0.smithi170.stdout:7/504: dread d8/d20/d2a/d35/f41 [0,4194304] 0 2024-01-25T15:03:41.410 INFO:tasks.workunit.client.0.smithi170.stdout:3/512: write d3/d10/f23 [2049356,119256] 0 2024-01-25T15:03:41.410 INFO:tasks.workunit.client.0.smithi170.stdout:1/472: write d0/d50/f95 [2053764,63731] 0 2024-01-25T15:03:41.411 INFO:tasks.workunit.client.0.smithi170.stdout:7/505: dread d8/d20/d2a/f3d [0,4194304] 0 2024-01-25T15:03:41.412 INFO:tasks.workunit.client.0.smithi170.stdout:7/506: chown d8/f52 1329888 1 2024-01-25T15:03:41.412 INFO:tasks.workunit.client.0.smithi170.stdout:7/507: dread - d8/d20/d45/d68/d71/fbd zero size 2024-01-25T15:03:41.412 INFO:tasks.workunit.client.0.smithi170.stdout:3/513: mknod d3/d10/d1e/d21/d41/d4a/c9d 0 2024-01-25T15:03:41.415 INFO:tasks.workunit.client.0.smithi170.stdout:1/473: getdents d0/d50/da0 0 2024-01-25T15:03:41.415 INFO:tasks.workunit.client.0.smithi170.stdout:1/474: write d0/fe [1583045,36578] 0 2024-01-25T15:03:41.418 INFO:tasks.workunit.client.0.smithi170.stdout:0/481: write d8/d80/f91 [3300057,26615] 0 2024-01-25T15:03:41.419 INFO:tasks.workunit.client.0.smithi170.stdout:1/475: rmdir d0/d20/d3a 39 2024-01-25T15:03:41.421 INFO:tasks.workunit.client.0.smithi170.stdout:7/508: read d8/f5d [2086437,16824] 0 2024-01-25T15:03:41.421 INFO:tasks.workunit.client.0.smithi170.stdout:7/509: chown d8/d20/d3b/f6a 168889 1 2024-01-25T15:03:41.421 INFO:tasks.workunit.client.0.smithi170.stdout:0/482: mknod d8/d10/d2d/d2f/d4f/d5f/cae 0 2024-01-25T15:03:41.421 INFO:tasks.workunit.client.0.smithi170.stdout:3/514: creat d3/d10/d1e/d96/f9e x:0 0 0 2024-01-25T15:03:41.421 INFO:tasks.workunit.client.0.smithi170.stdout:3/515: getdents d3/d1c/d2b/d5c/d97 0 2024-01-25T15:03:41.421 INFO:tasks.workunit.client.0.smithi170.stdout:3/516: write d3/d10/d13/d1b/d29/f94 [587746,44794] 0 2024-01-25T15:03:41.421 INFO:tasks.workunit.client.0.smithi170.stdout:3/517: fsync d3/f68 0 2024-01-25T15:03:41.421 INFO:tasks.workunit.client.0.smithi170.stdout:5/470: dwrite d5/d54/d85/f19 [4194304,4194304] 0 2024-01-25T15:03:41.422 INFO:tasks.workunit.client.0.smithi170.stdout:1/476: truncate d0/d20/d28/f4c 31501 0 2024-01-25T15:03:41.422 INFO:tasks.workunit.client.0.smithi170.stdout:8/490: write d3/d7/d22/d23/f54 [3024362,94400] 0 2024-01-25T15:03:41.423 INFO:tasks.workunit.client.0.smithi170.stdout:7/510: mkdir d8/d20/dc2 0 2024-01-25T15:03:41.423 INFO:tasks.workunit.client.0.smithi170.stdout:7/511: stat d8/d20/d2a/d35/fbb 0 2024-01-25T15:03:41.426 INFO:tasks.workunit.client.0.smithi170.stdout:8/491: rmdir d3/d7/d1e/d7c 39 2024-01-25T15:03:41.429 INFO:tasks.workunit.client.0.smithi170.stdout:4/427: rename d6/d37 to d6/d7/d31/d7e 0 2024-01-25T15:03:41.435 INFO:tasks.workunit.client.0.smithi170.stdout:5/471: dread d5/fe [0,4194304] 0 2024-01-25T15:03:41.439 INFO:tasks.workunit.client.0.smithi170.stdout:5/472: creat d5/d54/d85/d2c/d34/d69/fab x:0 0 0 2024-01-25T15:03:41.442 INFO:tasks.workunit.client.0.smithi170.stdout:4/428: dread d6/d28/d59/d7d/f30 [0,4194304] 0 2024-01-25T15:03:41.445 INFO:tasks.workunit.client.0.smithi170.stdout:5/473: symlink d5/lac 0 2024-01-25T15:03:41.445 INFO:tasks.workunit.client.0.smithi170.stdout:5/474: chown d5/d54/d85/d2c/d34/f6e 4 1 2024-01-25T15:03:41.445 INFO:tasks.workunit.client.0.smithi170.stdout:4/429: mknod d6/d7/d31/c7f 0 2024-01-25T15:03:41.446 INFO:tasks.workunit.client.0.smithi170.stdout:4/430: dread - d6/d7/d31/d7e/f5b zero size 2024-01-25T15:03:41.446 INFO:tasks.workunit.client.0.smithi170.stdout:4/431: fsync d6/d7/d31/f4d 0 2024-01-25T15:03:41.446 INFO:tasks.workunit.client.0.smithi170.stdout:4/432: fsync d6/d7/d31/f7b 0 2024-01-25T15:03:41.446 INFO:tasks.workunit.client.0.smithi170.stdout:8/492: dread d3/d7/d22/d23/f4a [0,4194304] 0 2024-01-25T15:03:41.450 INFO:tasks.workunit.client.0.smithi170.stdout:3/518: dwrite d3/d2a/f7d [4194304,4194304] 0 2024-01-25T15:03:41.452 INFO:tasks.workunit.client.0.smithi170.stdout:3/519: mknod d3/d10/d1e/d21/d41/d4a/c9f 0 2024-01-25T15:03:41.453 INFO:tasks.workunit.client.0.smithi170.stdout:3/520: read d3/d10/d1e/d21/d41/d4b/f90 [60173,85525] 0 2024-01-25T15:03:41.454 INFO:tasks.workunit.client.0.smithi170.stdout:3/521: unlink d3/d10/d1e/d21/d41/f95 0 2024-01-25T15:03:41.455 INFO:tasks.workunit.client.0.smithi170.stdout:3/522: mkdir d3/d3b/d4f/da0 0 2024-01-25T15:03:41.456 INFO:tasks.workunit.client.0.smithi170.stdout:0/483: dwrite d8/d10/d2d/d2f/f37 [4194304,4194304] 0 2024-01-25T15:03:41.457 INFO:tasks.workunit.client.0.smithi170.stdout:3/523: creat d3/d2a/fa1 x:0 0 0 2024-01-25T15:03:41.459 INFO:tasks.workunit.client.0.smithi170.stdout:4/433: getdents d6/d28 0 2024-01-25T15:03:41.460 INFO:tasks.workunit.client.0.smithi170.stdout:2/501: rename d10/d1e/d32/d62/d8d/c9b to d10/d1e/d32/d3e/d5c/cb9 0 2024-01-25T15:03:41.463 INFO:tasks.workunit.client.0.smithi170.stdout:3/524: rename d3/d88/l91 to d3/d10/d52/la2 0 2024-01-25T15:03:41.464 INFO:tasks.workunit.client.0.smithi170.stdout:7/512: dwrite d8/d20/d2a/fa2 [4194304,4194304] 0 2024-01-25T15:03:41.464 INFO:tasks.workunit.client.0.smithi170.stdout:7/513: dread - d8/d20/d2a/d35/f49 zero size 2024-01-25T15:03:41.464 INFO:tasks.workunit.client.0.smithi170.stdout:7/514: truncate d8/d20/d45/f4a 881281 0 2024-01-25T15:03:41.464 INFO:tasks.workunit.client.0.smithi170.stdout:7/515: write d8/d20/d2a/d35/d55/d9b/db9/fbe [528756,13733] 0 2024-01-25T15:03:41.465 INFO:tasks.workunit.client.0.smithi170.stdout:3/525: rmdir d3/d10 39 2024-01-25T15:03:41.465 INFO:tasks.workunit.client.0.smithi170.stdout:7/516: creat d8/d20/d2a/d35/d55/d7d/da6/fc3 x:0 0 0 2024-01-25T15:03:41.465 INFO:tasks.workunit.client.0.smithi170.stdout:7/517: chown d8/d20/d2a/d35/d55/d7d/da6/fc3 4 1 2024-01-25T15:03:41.465 INFO:tasks.workunit.client.0.smithi170.stdout:5/475: dread d5/d54/d85/d2c/d45/f75 [0,4194304] 0 2024-01-25T15:03:41.466 INFO:tasks.workunit.client.0.smithi170.stdout:5/476: write d5/d54/d85/f1a [4517237,5486] 0 2024-01-25T15:03:41.466 INFO:tasks.workunit.client.0.smithi170.stdout:5/477: chown d5/d58/da9 5299171 1 2024-01-25T15:03:41.469 INFO:tasks.workunit.client.0.smithi170.stdout:3/526: dread d3/d10/d1e/d21/d41/d4a/f75 [0,4194304] 0 2024-01-25T15:03:41.469 INFO:tasks.workunit.client.0.smithi170.stdout:3/527: fdatasync d3/d10/d13/d1b/d81/f8d 0 2024-01-25T15:03:41.470 INFO:tasks.workunit.client.0.smithi170.stdout:3/528: read - d3/d2a/d7e/f8c zero size 2024-01-25T15:03:41.470 INFO:tasks.workunit.client.0.smithi170.stdout:3/529: creat d3/d10/d13/d1b/d29/fa3 x:0 0 0 2024-01-25T15:03:41.470 INFO:tasks.workunit.client.0.smithi170.stdout:5/478: truncate d5/d54/d85/d2c/d45/f75 1667211 0 2024-01-25T15:03:41.472 INFO:tasks.workunit.client.0.smithi170.stdout:3/530: symlink d3/d2a/d7e/la4 0 2024-01-25T15:03:41.473 INFO:tasks.workunit.client.0.smithi170.stdout:5/479: creat d5/d54/d85/d2c/d51/d3d/fad x:0 0 0 2024-01-25T15:03:41.473 INFO:tasks.workunit.client.0.smithi170.stdout:5/480: write d5/d54/d85/d2c/f5f [259944,19541] 0 2024-01-25T15:03:41.474 INFO:tasks.workunit.client.0.smithi170.stdout:3/531: mknod d3/d10/d1e/d21/d41/d4a/ca5 0 2024-01-25T15:03:41.474 INFO:tasks.workunit.client.0.smithi170.stdout:3/532: creat d3/d10/d1e/d21/fa6 x:0 0 0 2024-01-25T15:03:41.474 INFO:tasks.workunit.client.0.smithi170.stdout:5/481: mkdir d5/d54/d85/d2c/d45/d5e/dae 0 2024-01-25T15:03:41.476 INFO:tasks.workunit.client.0.smithi170.stdout:3/533: dread d3/d10/d52/f5d [0,4194304] 0 2024-01-25T15:03:41.485 INFO:tasks.workunit.client.0.smithi170.stdout:5/482: write d5/d54/d85/d2c/d45/d5e/f65 [5205159,111545] 0 2024-01-25T15:03:41.488 INFO:tasks.workunit.client.0.smithi170.stdout:3/534: dread d3/d10/f1a [0,4194304] 0 2024-01-25T15:03:41.490 INFO:tasks.workunit.client.0.smithi170.stdout:0/484: dwrite d8/d10/d2d/d53/f63 [0,4194304] 0 2024-01-25T15:03:41.490 INFO:tasks.workunit.client.0.smithi170.stdout:0/485: chown d8/d10/d2d/d2f/d4f/da2/la7 32752 1 2024-01-25T15:03:41.493 INFO:tasks.workunit.client.0.smithi170.stdout:3/535: creat d3/d10/d1e/d21/d41/d77/fa7 x:0 0 0 2024-01-25T15:03:41.493 INFO:tasks.workunit.client.0.smithi170.stdout:0/486: dread d8/d18/f3b [0,4194304] 0 2024-01-25T15:03:41.494 INFO:tasks.workunit.client.0.smithi170.stdout:3/536: rmdir d3/d1c/d2b/d5c 39 2024-01-25T15:03:41.495 INFO:tasks.workunit.client.0.smithi170.stdout:0/487: mknod d8/d18/caf 0 2024-01-25T15:03:41.496 INFO:tasks.workunit.client.0.smithi170.stdout:4/434: dwrite d6/d7/d31/f43 [0,4194304] 0 2024-01-25T15:03:41.496 INFO:tasks.workunit.client.0.smithi170.stdout:3/537: rmdir d3/d1c 39 2024-01-25T15:03:41.498 INFO:tasks.workunit.client.0.smithi170.stdout:4/435: mkdir d6/d7/d31/d7e/d80 0 2024-01-25T15:03:41.503 INFO:tasks.workunit.client.0.smithi170.stdout:0/488: mknod d8/cb0 0 2024-01-25T15:03:41.505 INFO:tasks.workunit.client.0.smithi170.stdout:3/538: link d3/d3b/f70 d3/d10/d13/fa8 0 2024-01-25T15:03:41.505 INFO:tasks.workunit.client.0.smithi170.stdout:3/539: write d3/d10/d1e/d21/d41/d4a/f75 [1429269,88343] 0 2024-01-25T15:03:41.506 INFO:tasks.workunit.client.0.smithi170.stdout:5/483: dwrite d5/d54/d85/f76 [0,4194304] 0 2024-01-25T15:03:41.506 INFO:tasks.workunit.client.0.smithi170.stdout:5/484: write d5/d54/d85/d2c/d34/f6e [180336,85879] 0 2024-01-25T15:03:41.507 INFO:tasks.workunit.client.0.smithi170.stdout:3/540: creat d3/d2a/d7e/fa9 x:0 0 0 2024-01-25T15:03:41.510 INFO:tasks.workunit.client.0.smithi170.stdout:4/436: rmdir d6/d28 39 2024-01-25T15:03:41.512 INFO:tasks.workunit.client.0.smithi170.stdout:4/437: link d6/d7/d1b/f41 d6/d7/f81 0 2024-01-25T15:03:41.512 INFO:tasks.workunit.client.0.smithi170.stdout:4/438: chown d6/l1f 2017468165 1 2024-01-25T15:03:41.512 INFO:tasks.workunit.client.0.smithi170.stdout:4/439: write d6/d7/d31/d7e/f5a [602676,39542] 0 2024-01-25T15:03:41.520 INFO:tasks.workunit.client.0.smithi170.stdout:6/502: sync 2024-01-25T15:03:41.520 INFO:tasks.workunit.client.0.smithi170.stdout:9/479: sync 2024-01-25T15:03:41.520 INFO:tasks.workunit.client.0.smithi170.stdout:2/502: rename d10/f12 to d10/d1e/d32/d62/d74/fba 0 2024-01-25T15:03:41.522 INFO:tasks.workunit.client.0.smithi170.stdout:9/480: getdents d5/dc 0 2024-01-25T15:03:41.524 INFO:tasks.workunit.client.0.smithi170.stdout:4/440: dread d6/d7/d1b/f41 [0,4194304] 0 2024-01-25T15:03:41.524 INFO:tasks.workunit.client.0.smithi170.stdout:4/441: readlink d6/d7/l4c 0 2024-01-25T15:03:41.525 INFO:tasks.workunit.client.0.smithi170.stdout:7/518: rename d8/d20/d45/c6c to d8/d20/d73/cc4 0 2024-01-25T15:03:41.527 INFO:tasks.workunit.client.0.smithi170.stdout:6/503: dread d2/d7/d23/d19/d2a/d43/f51 [0,4194304] 0 2024-01-25T15:03:41.527 INFO:tasks.workunit.client.0.smithi170.stdout:7/519: creat d8/d20/d2a/d35/d55/d7d/fc5 x:0 0 0 2024-01-25T15:03:41.527 INFO:tasks.workunit.client.0.smithi170.stdout:9/481: symlink d5/df/d16/d35/d3c/d56/d59/d5e/lad 0 2024-01-25T15:03:41.531 INFO:tasks.workunit.client.0.smithi170.stdout:2/503: read d10/d1e/f9a [3139583,111755] 0 2024-01-25T15:03:41.531 INFO:tasks.workunit.client.0.smithi170.stdout:2/504: dread - d10/d1e/d32/d62/d74/fb4 zero size 2024-01-25T15:03:41.533 INFO:tasks.workunit.client.0.smithi170.stdout:3/541: dwrite d3/d10/ff [0,4194304] 0 2024-01-25T15:03:41.533 INFO:tasks.workunit.client.0.smithi170.stdout:3/542: dread - d3/d10/d1e/d21/fa6 zero size 2024-01-25T15:03:41.534 INFO:tasks.workunit.client.0.smithi170.stdout:3/543: truncate d3/d1c/f6f 684888 0 2024-01-25T15:03:41.535 INFO:tasks.workunit.client.0.smithi170.stdout:3/544: stat d3/d1c/f24 0 2024-01-25T15:03:41.536 INFO:tasks.workunit.client.0.smithi170.stdout:9/482: dread d5/df/d2e/d77/d21/d46/f8e [0,4194304] 0 2024-01-25T15:03:41.539 INFO:tasks.workunit.client.0.smithi170.stdout:3/545: link d3/f68 d3/d10/d6d/faa 0 2024-01-25T15:03:41.541 INFO:tasks.workunit.client.0.smithi170.stdout:7/520: dread d8/f1c [0,4194304] 0 2024-01-25T15:03:41.542 INFO:tasks.workunit.client.0.smithi170.stdout:9/483: mknod d5/df/d2e/d77/d86/cae 0 2024-01-25T15:03:41.542 INFO:tasks.workunit.client.0.smithi170.stdout:9/484: fdatasync d5/df/d16/d35/f75 0 2024-01-25T15:03:41.543 INFO:tasks.workunit.client.0.smithi170.stdout:3/546: mkdir d3/d1c/d2b/d5c/d97/dab 0 2024-01-25T15:03:41.544 INFO:tasks.workunit.client.0.smithi170.stdout:7/521: symlink d8/d20/d45/d8e/lc6 0 2024-01-25T15:03:41.546 INFO:tasks.workunit.client.0.smithi170.stdout:3/547: creat d3/d10/fac x:0 0 0 2024-01-25T15:03:41.546 INFO:tasks.workunit.client.0.smithi170.stdout:3/548: write d3/d2a/f5f [2433513,58333] 0 2024-01-25T15:03:41.546 INFO:tasks.workunit.client.0.smithi170.stdout:3/549: readlink d3/d10/d13/d1b/l32 0 2024-01-25T15:03:41.546 INFO:tasks.workunit.client.0.smithi170.stdout:3/550: fdatasync d3/d10/d13/f65 0 2024-01-25T15:03:41.548 INFO:tasks.workunit.client.0.smithi170.stdout:3/551: write d3/d10/d13/d1b/d29/f94 [439759,30686] 0 2024-01-25T15:03:41.550 INFO:tasks.workunit.client.0.smithi170.stdout:9/485: dread d5/df/d16/d35/d3c/f4e [0,4194304] 0 2024-01-25T15:03:41.550 INFO:tasks.workunit.client.0.smithi170.stdout:9/486: readlink d5/lb 0 2024-01-25T15:03:41.550 INFO:tasks.workunit.client.0.smithi170.stdout:9/487: fsync d5/f8 0 2024-01-25T15:03:41.552 INFO:tasks.workunit.client.0.smithi170.stdout:4/442: dwrite d6/d7/f14 [4194304,4194304] 0 2024-01-25T15:03:41.552 INFO:tasks.workunit.client.0.smithi170.stdout:4/443: dread - d6/d7/d31/d7e/f5b zero size 2024-01-25T15:03:41.552 INFO:tasks.workunit.client.0.smithi170.stdout:9/488: rmdir d5/df/d16/d35/d3c/d56/d59/d5e 39 2024-01-25T15:03:41.554 INFO:tasks.workunit.client.0.smithi170.stdout:9/489: unlink d5/df/d2e/d77/d21/d34/d3e/f84 0 2024-01-25T15:03:41.558 INFO:tasks.workunit.client.0.smithi170.stdout:9/490: creat d5/df/d2e/d77/faf x:0 0 0 2024-01-25T15:03:41.564 INFO:tasks.workunit.client.0.smithi170.stdout:9/491: mkdir d5/df/d2e/db0 0 2024-01-25T15:03:41.564 INFO:tasks.workunit.client.0.smithi170.stdout:2/505: link d10/d1e/d32/d3e/f6b d10/d1e/d5e/d73/fbb 0 2024-01-25T15:03:41.564 INFO:tasks.workunit.client.0.smithi170.stdout:5/485: rename d5/d54/d85/d2c/d34/f80 to d5/d54/d85/d2c/d45/d56/d72/faf 0 2024-01-25T15:03:41.570 INFO:tasks.workunit.client.0.smithi170.stdout:6/504: rename d2/d7/f1c to d2/d7/d23/d19/d2a/d43/d98/fac 0 2024-01-25T15:03:41.570 INFO:tasks.workunit.client.0.smithi170.stdout:7/522: rename d8/d20/d45 to d8/d20/d45/d68/dc7 22 2024-01-25T15:03:41.571 INFO:tasks.workunit.client.0.smithi170.stdout:7/523: mkdir d8/d20/d45/d68/d71/dc8 0 2024-01-25T15:03:41.573 INFO:tasks.workunit.client.0.smithi170.stdout:6/505: mkdir d2/d7/d23/d19/d2a/d6b/dad 0 2024-01-25T15:03:41.573 INFO:tasks.workunit.client.0.smithi170.stdout:5/486: dread d5/d54/d85/d2c/d34/d7c/f83 [0,4194304] 0 2024-01-25T15:03:41.573 INFO:tasks.workunit.client.0.smithi170.stdout:7/524: creat d8/fc9 x:0 0 0 2024-01-25T15:03:41.574 INFO:tasks.workunit.client.0.smithi170.stdout:5/487: truncate d5/d54/d85/d2c/d51/d41/f90 1529606 0 2024-01-25T15:03:41.575 INFO:tasks.workunit.client.0.smithi170.stdout:3/552: dwrite d3/d10/d13/d1b/d29/f94 [0,4194304] 0 2024-01-25T15:03:41.575 INFO:tasks.workunit.client.0.smithi170.stdout:3/553: fsync d3/d1c/f24 0 2024-01-25T15:03:41.575 INFO:tasks.workunit.client.0.smithi170.stdout:2/506: truncate d10/d1e/f20 2081160 0 2024-01-25T15:03:41.576 INFO:tasks.workunit.client.0.smithi170.stdout:2/507: truncate d10/d1e/d32/d3e/d41/d7a/fa7 495846 0 2024-01-25T15:03:41.576 INFO:tasks.workunit.client.0.smithi170.stdout:2/508: stat d10/d1e/d32/d3e/d41/c59 0 2024-01-25T15:03:41.581 INFO:tasks.workunit.client.0.smithi170.stdout:7/525: rmdir d8/d20/d2a/d35/d55 39 2024-01-25T15:03:41.581 INFO:tasks.workunit.client.0.smithi170.stdout:7/526: chown d8/d20/d2a/d35/db0 37873 1 2024-01-25T15:03:41.582 INFO:tasks.workunit.client.0.smithi170.stdout:5/488: write d5/d54/d85/d2c/d51/d41/f90 [980277,44607] 0 2024-01-25T15:03:41.582 INFO:tasks.workunit.client.0.smithi170.stdout:7/527: creat d8/d20/d2a/d35/d55/d6e/d81/fca x:0 0 0 2024-01-25T15:03:41.583 INFO:tasks.workunit.client.0.smithi170.stdout:5/489: creat d5/d2a/fb0 x:0 0 0 2024-01-25T15:03:41.583 INFO:tasks.workunit.client.0.smithi170.stdout:5/490: chown d5/d54/d85/d2c/d51/d3d/c47 9058083 1 2024-01-25T15:03:41.585 INFO:tasks.workunit.client.0.smithi170.stdout:7/528: truncate d8/f17 754623 0 2024-01-25T15:03:41.585 INFO:tasks.workunit.client.0.smithi170.stdout:7/529: write d8/d20/d45/d68/d71/d8c/fbf [924203,88049] 0 2024-01-25T15:03:41.585 INFO:tasks.workunit.client.0.smithi170.stdout:7/530: dread - d8/d20/d2a/d35/db0/fc0 zero size 2024-01-25T15:03:41.585 INFO:tasks.workunit.client.0.smithi170.stdout:7/531: truncate d8/d20/d2a/f3d 943340 0 2024-01-25T15:03:41.585 INFO:tasks.workunit.client.0.smithi170.stdout:7/532: dread - d8/d20/d45/d68/d71/fbd zero size 2024-01-25T15:03:41.585 INFO:tasks.workunit.client.0.smithi170.stdout:7/533: chown d8/d20/d45/d8e/c98 148070 1 2024-01-25T15:03:41.586 INFO:tasks.workunit.client.0.smithi170.stdout:5/491: rmdir d5/d54/d85/d2c/d45/d56 39 2024-01-25T15:03:41.586 INFO:tasks.workunit.client.0.smithi170.stdout:6/506: dread d2/d7/d23/d19/d2a/d43/f51 [0,4194304] 0 2024-01-25T15:03:41.587 INFO:tasks.workunit.client.0.smithi170.stdout:7/534: creat d8/d20/d45/d68/daa/fcb x:0 0 0 2024-01-25T15:03:41.587 INFO:tasks.workunit.client.0.smithi170.stdout:7/535: truncate d8/d20/d3b/f6a 1031543 0 2024-01-25T15:03:41.587 INFO:tasks.workunit.client.0.smithi170.stdout:7/536: write d8/f9e [265544,59234] 0 2024-01-25T15:03:41.590 INFO:tasks.workunit.client.0.smithi170.stdout:7/537: creat d8/d20/d2a/d35/d55/d7d/fcc x:0 0 0 2024-01-25T15:03:41.590 INFO:tasks.workunit.client.0.smithi170.stdout:7/538: dread - d8/d20/d3b/fae zero size 2024-01-25T15:03:41.593 INFO:tasks.workunit.client.0.smithi170.stdout:9/492: dwrite d5/df/d2e/f7d [4194304,4194304] 0 2024-01-25T15:03:41.597 INFO:tasks.workunit.client.0.smithi170.stdout:9/493: rename d5/df/d2e/d77/d86/cae to d5/df/d49/cb1 0 2024-01-25T15:03:41.597 INFO:tasks.workunit.client.0.smithi170.stdout:9/494: chown d5/dc/f30 1 1 2024-01-25T15:03:41.602 INFO:tasks.workunit.client.0.smithi170.stdout:1/477: sync 2024-01-25T15:03:41.602 INFO:tasks.workunit.client.0.smithi170.stdout:1/478: read d0/d20/d3a/f53 [2619797,25292] 0 2024-01-25T15:03:41.602 INFO:tasks.workunit.client.0.smithi170.stdout:1/479: read d0/d50/f95 [2187500,95206] 0 2024-01-25T15:03:41.602 INFO:tasks.workunit.client.0.smithi170.stdout:1/480: truncate d0/fe 3284471 0 2024-01-25T15:03:41.603 INFO:tasks.workunit.client.0.smithi170.stdout:1/481: write d0/d20/d28/f70 [95375,72525] 0 2024-01-25T15:03:41.604 INFO:tasks.workunit.client.0.smithi170.stdout:1/482: readlink d0/d50/d8e/l9f 0 2024-01-25T15:03:41.606 INFO:tasks.workunit.client.0.smithi170.stdout:3/554: dwrite d3/d10/f1a [4194304,4194304] 0 2024-01-25T15:03:41.606 INFO:tasks.workunit.client.0.smithi170.stdout:1/483: mknod d0/d20/d28/d2a/ca5 0 2024-01-25T15:03:41.606 INFO:tasks.workunit.client.0.smithi170.stdout:1/484: chown d0/d20/d3a/f65 1687 1 2024-01-25T15:03:41.606 INFO:tasks.workunit.client.0.smithi170.stdout:1/485: write d0/d20/d28/d2a/d4a/d56/f64 [3071759,124363] 0 2024-01-25T15:03:41.607 INFO:tasks.workunit.client.0.smithi170.stdout:6/507: write d2/d7/d1b/f1f [1845354,97786] 0 2024-01-25T15:03:41.607 INFO:tasks.workunit.client.0.smithi170.stdout:2/509: dwrite d10/d1e/d32/d3e/d5c/f86 [0,4194304] 0 2024-01-25T15:03:41.608 INFO:tasks.workunit.client.0.smithi170.stdout:3/555: truncate d3/d10/d1e/d21/d41/d4b/d63/f84 2321226 0 2024-01-25T15:03:41.609 INFO:tasks.workunit.client.0.smithi170.stdout:3/556: dread d3/d10/d1e/d21/d41/d4b/f90 [0,4194304] 0 2024-01-25T15:03:41.610 INFO:tasks.workunit.client.0.smithi170.stdout:3/557: rmdir d3/d10/d6d/d74 39 2024-01-25T15:03:41.610 INFO:tasks.workunit.client.0.smithi170.stdout:2/510: write d10/d1e/d32/d3e/d5c/f94 [505910,105989] 0 2024-01-25T15:03:41.614 INFO:tasks.workunit.client.0.smithi170.stdout:2/511: symlink d10/d1e/d5e/d73/d9e/da3/lbc 0 2024-01-25T15:03:41.616 INFO:tasks.workunit.client.0.smithi170.stdout:2/512: creat d10/d1e/d32/d3e/d5c/fbd x:0 0 0 2024-01-25T15:03:41.625 INFO:tasks.workunit.client.0.smithi170.stdout:3/558: rmdir d3/d10/d1e/d96 39 2024-01-25T15:03:41.629 INFO:tasks.workunit.client.0.smithi170.stdout:6/508: write d2/d7/d23/d19/d2a/d43/f51 [6236601,67371] 0 2024-01-25T15:03:41.693 INFO:tasks.workunit.client.0.smithi170.stdout:6/509: chown d2/f10 26271 1 2024-01-25T15:03:41.694 INFO:tasks.workunit.client.0.smithi170.stdout:6/510: creat d2/d7/d23/d19/d2a/d43/d44/da4/fae x:0 0 0 2024-01-25T15:03:41.694 INFO:tasks.workunit.client.0.smithi170.stdout:6/511: chown d2/d7/d23/d19/d2a/d43/d98/fac 407977 1 2024-01-25T15:03:41.700 INFO:tasks.workunit.client.0.smithi170.stdout:5/492: dwrite d5/d2a/f4a [4194304,4194304] 0 2024-01-25T15:03:41.700 INFO:tasks.workunit.client.0.smithi170.stdout:5/493: write d5/d54/d85/d2c/d34/d7c/f83 [352769,30533] 0 2024-01-25T15:03:41.700 INFO:tasks.workunit.client.0.smithi170.stdout:5/494: chown d5/d54/d85/d2c/f31 177698 1 2024-01-25T15:03:41.700 INFO:tasks.workunit.client.0.smithi170.stdout:2/513: dwrite d10/d1e/d5e/d73/d9e/da3/fb3 [0,4194304] 0 2024-01-25T15:03:41.700 INFO:tasks.workunit.client.0.smithi170.stdout:9/495: dwrite d5/df/d16/d35/d3c/d56/d59/d5e/f87 [0,4194304] 0 2024-01-25T15:03:41.700 INFO:tasks.workunit.client.0.smithi170.stdout:1/486: dwrite d0/d50/f52 [0,4194304] 0 2024-01-25T15:03:41.700 INFO:tasks.workunit.client.0.smithi170.stdout:1/487: creat d0/d50/fa6 x:0 0 0 2024-01-25T15:03:41.700 INFO:tasks.workunit.client.0.smithi170.stdout:6/512: dread d2/d7/f4a [0,4194304] 0 2024-01-25T15:03:41.700 INFO:tasks.workunit.client.0.smithi170.stdout:7/539: dwrite d8/d20/d2a/d61/f63 [0,4194304] 0 2024-01-25T15:03:41.700 INFO:tasks.workunit.client.0.smithi170.stdout:7/540: write d8/d20/d2a/d35/d55/d9b/db9/fbe [668246,47833] 0 2024-01-25T15:03:41.700 INFO:tasks.workunit.client.0.smithi170.stdout:7/541: read d8/f1c [3617064,47908] 0 2024-01-25T15:03:41.701 INFO:tasks.workunit.client.0.smithi170.stdout:7/542: read d8/f1f [1049922,112877] 0 2024-01-25T15:03:41.701 INFO:tasks.workunit.client.0.smithi170.stdout:7/543: dread - d8/d20/d45/d68/d71/fbd zero size 2024-01-25T15:03:41.701 INFO:tasks.workunit.client.0.smithi170.stdout:3/559: rename d3/d10/d1e/d21/d41/d77/d42 to d3/d1c/d2b/d5c/dad 0 2024-01-25T15:03:41.701 INFO:tasks.workunit.client.0.smithi170.stdout:1/488: stat d0/d20/d28/l9a 0 2024-01-25T15:03:41.701 INFO:tasks.workunit.client.0.smithi170.stdout:1/489: fsync d0/d20/d3a/f54 0 2024-01-25T15:03:41.701 INFO:tasks.workunit.client.0.smithi170.stdout:9/496: rename d5/df/d2e/d77/d21/d34/d3e/d7f/f83 to d5/df/d2e/d77/d21/d46/fb2 0 2024-01-25T15:03:41.701 INFO:tasks.workunit.client.0.smithi170.stdout:9/497: write d5/df/d2e/d6b/f72 [1135792,68236] 0 2024-01-25T15:03:41.701 INFO:tasks.workunit.client.0.smithi170.stdout:3/560: mkdir d3/d1c/d2b/d5c/dad/dae 0 2024-01-25T15:03:41.701 INFO:tasks.workunit.client.0.smithi170.stdout:3/561: chown d3/d10/d1e/d21/d41/d77 1 1 2024-01-25T15:03:41.701 INFO:tasks.workunit.client.0.smithi170.stdout:1/490: read d0/d20/d28/f36 [936396,57407] 0 2024-01-25T15:03:41.701 INFO:tasks.workunit.client.0.smithi170.stdout:3/562: write d3/d2a/f5f [2029599,119446] 0 2024-01-25T15:03:41.701 INFO:tasks.workunit.client.0.smithi170.stdout:3/563: dread d3/d10/d1e/d21/d41/d4b/f90 [0,4194304] 0 2024-01-25T15:03:41.701 INFO:tasks.workunit.client.0.smithi170.stdout:3/564: mkdir d3/d10/d13/daf 0 2024-01-25T15:03:41.701 INFO:tasks.workunit.client.0.smithi170.stdout:3/565: getdents d3/d10/d52 0 2024-01-25T15:03:41.701 INFO:tasks.workunit.client.0.smithi170.stdout:9/498: dread d5/df/f20 [0,4194304] 0 2024-01-25T15:03:41.702 INFO:tasks.workunit.client.0.smithi170.stdout:1/491: fsync d0/d50/fa6 0 2024-01-25T15:03:41.702 INFO:tasks.workunit.client.0.smithi170.stdout:1/492: rename d0/d1b/c83 to d0/ca7 0 2024-01-25T15:03:41.702 INFO:tasks.workunit.client.0.smithi170.stdout:5/495: dwrite d5/d2a/f53 [0,4194304] 0 2024-01-25T15:03:41.702 INFO:tasks.workunit.client.0.smithi170.stdout:9/499: dread d5/df/f20 [0,4194304] 0 2024-01-25T15:03:41.702 INFO:tasks.workunit.client.0.smithi170.stdout:7/544: dwrite d8/d20/d2a/d35/f41 [4194304,4194304] 0 2024-01-25T15:03:41.702 INFO:tasks.workunit.client.0.smithi170.stdout:7/545: read d8/f1e [586878,32157] 0 2024-01-25T15:03:41.702 INFO:tasks.workunit.client.0.smithi170.stdout:6/513: dwrite d2/d7/d23/d19/d2a/f79 [0,4194304] 0 2024-01-25T15:03:41.702 INFO:tasks.workunit.client.0.smithi170.stdout:9/500: readlink d5/df/d2e/d77/l33 0 2024-01-25T15:03:41.702 INFO:tasks.workunit.client.0.smithi170.stdout:2/514: link d10/d1e/f2e d10/d1e/d32/d62/d8d/fbe 0 2024-01-25T15:03:41.702 INFO:tasks.workunit.client.0.smithi170.stdout:2/515: fdatasync d10/d1e/d32/d62/d8d/fbe 0 2024-01-25T15:03:41.702 INFO:tasks.workunit.client.0.smithi170.stdout:5/496: dread d5/f64 [0,4194304] 0 2024-01-25T15:03:41.702 INFO:tasks.workunit.client.0.smithi170.stdout:7/546: symlink d8/d20/dc2/lcd 0 2024-01-25T15:03:41.702 INFO:tasks.workunit.client.0.smithi170.stdout:5/497: write d5/d54/d85/d2c/d45/f48 [1093405,112564] 0 2024-01-25T15:03:41.703 INFO:tasks.workunit.client.0.smithi170.stdout:5/498: write d5/d54/d85/d2c/d51/d3d/fad [799646,4088] 0 2024-01-25T15:03:41.703 INFO:tasks.workunit.client.0.smithi170.stdout:7/547: write d8/fb6 [185761,119219] 0 2024-01-25T15:03:41.703 INFO:tasks.workunit.client.0.smithi170.stdout:7/548: truncate d8/f3a 497692 0 2024-01-25T15:03:41.703 INFO:tasks.workunit.client.0.smithi170.stdout:1/493: dread d0/d20/d28/f6a [0,4194304] 0 2024-01-25T15:03:41.703 INFO:tasks.workunit.client.0.smithi170.stdout:1/494: fdatasync d0/f5 0 2024-01-25T15:03:41.703 INFO:tasks.workunit.client.0.smithi170.stdout:7/549: symlink d8/d20/d3b/d4d/lce 0 2024-01-25T15:03:41.703 INFO:tasks.workunit.client.0.smithi170.stdout:6/514: mkdir d2/d7/d23/d19/daf 0 2024-01-25T15:03:41.703 INFO:tasks.workunit.client.0.smithi170.stdout:1/495: dread d0/d20/d28/f4c [0,4194304] 0 2024-01-25T15:03:41.703 INFO:tasks.workunit.client.0.smithi170.stdout:6/515: mkdir d2/d7/d23/d19/daf/db0 0 2024-01-25T15:03:41.703 INFO:tasks.workunit.client.0.smithi170.stdout:7/550: mkdir d8/d20/d2a/d35/d55/dcf 0 2024-01-25T15:03:41.703 INFO:tasks.workunit.client.0.smithi170.stdout:7/551: symlink d8/d20/d2a/d35/db0/ld0 0 2024-01-25T15:03:41.703 INFO:tasks.workunit.client.0.smithi170.stdout:1/496: dread d0/f3d [0,4194304] 0 2024-01-25T15:03:41.703 INFO:tasks.workunit.client.0.smithi170.stdout:6/516: symlink d2/d7/d1b/d78/lb1 0 2024-01-25T15:03:41.703 INFO:tasks.workunit.client.0.smithi170.stdout:6/517: write d2/d7/d23/d19/f83 [3504886,111411] 0 2024-01-25T15:03:41.703 INFO:tasks.workunit.client.0.smithi170.stdout:1/497: mkdir d0/d20/d28/d7b/da8 0 2024-01-25T15:03:41.704 INFO:tasks.workunit.client.0.smithi170.stdout:1/498: chown d0/d2e/l37 1856598896 1 2024-01-25T15:03:41.704 INFO:tasks.workunit.client.0.smithi170.stdout:8/493: sync 2024-01-25T15:03:41.704 INFO:tasks.workunit.client.0.smithi170.stdout:0/489: sync 2024-01-25T15:03:41.704 INFO:tasks.workunit.client.0.smithi170.stdout:0/490: fdatasync d8/d10/f2e 0 2024-01-25T15:03:41.704 INFO:tasks.workunit.client.0.smithi170.stdout:6/518: rmdir d2/d7/d1b/d28 39 2024-01-25T15:03:41.704 INFO:tasks.workunit.client.0.smithi170.stdout:7/552: dread d8/f1f [0,4194304] 0 2024-01-25T15:03:41.704 INFO:tasks.workunit.client.0.smithi170.stdout:8/494: creat d3/d7/fa5 x:0 0 0 2024-01-25T15:03:41.704 INFO:tasks.workunit.client.0.smithi170.stdout:4/444: sync 2024-01-25T15:03:41.705 INFO:tasks.workunit.client.0.smithi170.stdout:0/491: creat d8/d10/d2d/d2f/d4f/da2/fb1 x:0 0 0 2024-01-25T15:03:41.705 INFO:tasks.workunit.client.0.smithi170.stdout:6/519: rmdir d2/d7/d23/d19 39 2024-01-25T15:03:41.706 INFO:tasks.workunit.client.0.smithi170.stdout:6/520: creat d2/d7/d23/d19/d2a/fb2 x:0 0 0 2024-01-25T15:03:41.706 INFO:tasks.workunit.client.0.smithi170.stdout:6/521: write d2/d7/d23/d19/d2a/d43/d44/f66 [4035822,20321] 0 2024-01-25T15:03:41.706 INFO:tasks.workunit.client.0.smithi170.stdout:5/499: dwrite d5/d54/d85/d2c/d51/d3d/fad [0,4194304] 0 2024-01-25T15:03:41.706 INFO:tasks.workunit.client.0.smithi170.stdout:8/495: rmdir d3/d7/d22/d23/d25/d41 39 2024-01-25T15:03:41.706 INFO:tasks.workunit.client.0.smithi170.stdout:8/496: write d3/d7/d22/d23/d48/d52/f35 [2096760,75883] 0 2024-01-25T15:03:41.706 INFO:tasks.workunit.client.0.smithi170.stdout:0/492: unlink d8/d9/d9a/f8e 0 2024-01-25T15:03:41.706 INFO:tasks.workunit.client.0.smithi170.stdout:0/493: creat d8/d10/d2d/d2f/d4f/d5f/fb2 x:0 0 0 2024-01-25T15:03:41.706 INFO:tasks.workunit.client.0.smithi170.stdout:0/494: stat d8/d9/f29 0 2024-01-25T15:03:41.709 INFO:tasks.workunit.client.0.smithi170.stdout:5/500: creat d5/d54/d85/fb1 x:0 0 0 2024-01-25T15:03:41.712 INFO:tasks.workunit.client.0.smithi170.stdout:5/501: creat d5/d54/d85/d3f/d86/da5/fb2 x:0 0 0 2024-01-25T15:03:41.713 INFO:tasks.workunit.client.0.smithi170.stdout:5/502: symlink d5/d54/d85/d2c/lb3 0 2024-01-25T15:03:41.713 INFO:tasks.workunit.client.0.smithi170.stdout:7/553: dread d8/fb6 [0,4194304] 0 2024-01-25T15:03:41.713 INFO:tasks.workunit.client.0.smithi170.stdout:7/554: getdents d8/d20/d2a/d35/daf 0 2024-01-25T15:03:41.713 INFO:tasks.workunit.client.0.smithi170.stdout:7/555: chown d8/d20/d2a/d35/db0/cb7 2087336124 1 2024-01-25T15:03:41.714 INFO:tasks.workunit.client.0.smithi170.stdout:5/503: creat d5/d54/d85/d2c/d45/d5e/fb4 x:0 0 0 2024-01-25T15:03:41.714 INFO:tasks.workunit.client.0.smithi170.stdout:5/504: dread - d5/d54/d85/fb1 zero size 2024-01-25T15:03:41.715 INFO:tasks.workunit.client.0.smithi170.stdout:5/505: creat d5/d54/d85/d2c/d51/fb5 x:0 0 0 2024-01-25T15:03:41.724 INFO:tasks.workunit.client.0.smithi170.stdout:1/499: dwrite d0/d2e/f3b [0,4194304] 0 2024-01-25T15:03:41.724 INFO:tasks.workunit.client.0.smithi170.stdout:1/500: chown d0/d20/c2d 44315684 1 2024-01-25T15:03:41.724 INFO:tasks.workunit.client.0.smithi170.stdout:6/522: dwrite d2/d7/d23/d19/d2a/fb2 [0,4194304] 0 2024-01-25T15:03:41.727 INFO:tasks.workunit.client.0.smithi170.stdout:1/501: mknod d0/d20/d28/d2a/d57/ca9 0 2024-01-25T15:03:41.728 INFO:tasks.workunit.client.0.smithi170.stdout:1/502: mkdir d0/d20/d28/d7b/da8/daa 0 2024-01-25T15:03:41.728 INFO:tasks.workunit.client.0.smithi170.stdout:1/503: write d0/d50/f52 [4365360,67255] 0 2024-01-25T15:03:41.729 INFO:tasks.workunit.client.0.smithi170.stdout:1/504: mkdir d0/d50/da0/dab 0 2024-01-25T15:03:41.730 INFO:tasks.workunit.client.0.smithi170.stdout:1/505: symlink d0/d2e/lac 0 2024-01-25T15:03:41.730 INFO:tasks.workunit.client.0.smithi170.stdout:1/506: write d0/d20/d28/f36 [986937,72704] 0 2024-01-25T15:03:41.733 INFO:tasks.workunit.client.0.smithi170.stdout:2/516: rename d10/d1e/d32/d3e/d5c/fbd to d10/d1e/d5e/d73/d9e/db7/fbf 0 2024-01-25T15:03:41.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:41 smithi191 ceph-mon[36347]: pgmap v399: 97 pgs: 97 active+clean; 946 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 113 MiB/s rd, 144 MiB/s wr, 2.35k op/s 2024-01-25T15:03:41.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:41 smithi191 ceph-mon[36347]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-25T15:03:41.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:41 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] up:active 2024-01-25T15:03:41.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:41 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:41.735 INFO:tasks.workunit.client.0.smithi170.stdout:7/556: dwrite d8/d20/d3b/d4d/f78 [0,4194304] 0 2024-01-25T15:03:41.736 INFO:tasks.workunit.client.0.smithi170.stdout:7/557: mkdir d8/d20/d2a/d35/d55/d7d/da6/dd1 0 2024-01-25T15:03:41.737 INFO:tasks.workunit.client.0.smithi170.stdout:8/497: rename d3/d7/d22/d23/d25/c50 to d3/d7/d22/d23/d25/d8e/ca6 0 2024-01-25T15:03:41.742 INFO:tasks.workunit.client.0.smithi170.stdout:5/506: link d5/d2a/c37 d5/d54/d85/d2c/d45/d56/d72/cb6 0 2024-01-25T15:03:41.742 INFO:tasks.workunit.client.0.smithi170.stdout:5/507: creat d5/d54/fb7 x:0 0 0 2024-01-25T15:03:41.742 INFO:tasks.workunit.client.0.smithi170.stdout:5/508: fdatasync d5/d58/f88 0 2024-01-25T15:03:41.742 INFO:tasks.workunit.client.0.smithi170.stdout:5/509: write d5/d54/d85/d3f/faa [161030,76073] 0 2024-01-25T15:03:41.744 INFO:tasks.workunit.client.0.smithi170.stdout:0/495: rename d8/d9/lac to d8/d10/d2d/d2f/lb3 0 2024-01-25T15:03:41.744 INFO:tasks.workunit.client.0.smithi170.stdout:0/496: truncate d8/d10/f36 792834 0 2024-01-25T15:03:41.745 INFO:tasks.workunit.client.0.smithi170.stdout:8/498: unlink d3/d7/d22/d23/f84 0 2024-01-25T15:03:41.746 INFO:tasks.workunit.client.0.smithi170.stdout:6/523: dread d2/d7/d23/f2d [0,4194304] 0 2024-01-25T15:03:41.746 INFO:tasks.workunit.client.0.smithi170.stdout:6/524: creat d2/fb3 x:0 0 0 2024-01-25T15:03:41.746 INFO:tasks.workunit.client.0.smithi170.stdout:6/525: write d2/d7/d23/d19/d2a/d43/d44/f48 [4950577,50055] 0 2024-01-25T15:03:41.746 INFO:tasks.workunit.client.0.smithi170.stdout:7/558: rmdir d8/d20 39 2024-01-25T15:03:41.750 INFO:tasks.workunit.client.0.smithi170.stdout:0/497: mkdir d8/d9/db4 0 2024-01-25T15:03:41.750 INFO:tasks.workunit.client.0.smithi170.stdout:1/507: read d0/f12 [3641268,91692] 0 2024-01-25T15:03:41.750 INFO:tasks.workunit.client.0.smithi170.stdout:1/508: chown d0/ff 2 1 2024-01-25T15:03:41.751 INFO:tasks.workunit.client.0.smithi170.stdout:8/499: rmdir d3/d7/d3a/d91 39 2024-01-25T15:03:41.755 INFO:tasks.workunit.client.0.smithi170.stdout:7/559: creat d8/d20/d73/fd2 x:0 0 0 2024-01-25T15:03:41.755 INFO:tasks.workunit.client.0.smithi170.stdout:7/560: dread - d8/d20/d45/d68/d71/fbd zero size 2024-01-25T15:03:41.757 INFO:tasks.workunit.client.0.smithi170.stdout:1/509: mkdir d0/d20/d3a/dad 0 2024-01-25T15:03:41.757 INFO:tasks.workunit.client.0.smithi170.stdout:1/510: write d0/d20/d28/d7b/f93 [466919,5130] 0 2024-01-25T15:03:41.757 INFO:tasks.workunit.client.0.smithi170.stdout:8/500: mkdir d3/d7/d22/d23/da7 0 2024-01-25T15:03:41.769 INFO:tasks.workunit.client.0.smithi170.stdout:1/511: dread d0/d20/d28/d2a/d4a/d56/d5b/f68 [0,4194304] 0 2024-01-25T15:03:41.769 INFO:tasks.workunit.client.0.smithi170.stdout:1/512: creat d0/d2e/fae x:0 0 0 2024-01-25T15:03:41.771 INFO:tasks.workunit.client.0.smithi170.stdout:8/501: write d3/f72 [3243738,83626] 0 2024-01-25T15:03:41.771 INFO:tasks.workunit.client.0.smithi170.stdout:8/502: readlink d3/l11 0 2024-01-25T15:03:41.772 INFO:tasks.workunit.client.0.smithi170.stdout:1/513: creat d0/d50/da0/dab/faf x:0 0 0 2024-01-25T15:03:41.772 INFO:tasks.workunit.client.0.smithi170.stdout:1/514: write d0/d20/fa4 [207453,73035] 0 2024-01-25T15:03:41.774 INFO:tasks.workunit.client.0.smithi170.stdout:8/503: creat d3/d7/d22/fa8 x:0 0 0 2024-01-25T15:03:41.774 INFO:tasks.workunit.client.0.smithi170.stdout:6/526: dwrite d2/d7/d23/d19/d2f/d5d/d94/fa2 [0,4194304] 0 2024-01-25T15:03:41.774 INFO:tasks.workunit.client.0.smithi170.stdout:5/510: dwrite d5/d54/d85/d2c/d34/f8b [0,4194304] 0 2024-01-25T15:03:41.777 INFO:tasks.workunit.client.0.smithi170.stdout:6/527: mkdir d2/d7/d23/d19/d2f/d5d/d94/d97/db4 0 2024-01-25T15:03:41.777 INFO:tasks.workunit.client.0.smithi170.stdout:2/517: rename d10/d1e/d5e/d73/fbb to d10/d1e/d32/d3e/d5c/d92/fc0 0 2024-01-25T15:03:41.777 INFO:tasks.workunit.client.0.smithi170.stdout:2/518: chown d10/d1e/d32/d3e/d5c 26 1 2024-01-25T15:03:41.777 INFO:tasks.workunit.client.0.smithi170.stdout:2/519: write f8 [4241444,56066] 0 2024-01-25T15:03:41.778 INFO:tasks.workunit.client.0.smithi170.stdout:5/511: mkdir d5/d54/d85/d3f/d8f/db8 0 2024-01-25T15:03:41.778 INFO:tasks.workunit.client.0.smithi170.stdout:5/512: dread - d5/d54/d85/d3f/d8f/f95 zero size 2024-01-25T15:03:41.779 INFO:tasks.workunit.client.0.smithi170.stdout:1/515: rmdir d0/d50/da0/dab 39 2024-01-25T15:03:41.779 INFO:tasks.workunit.client.0.smithi170.stdout:1/516: fsync d0/d20/d28/f66 0 2024-01-25T15:03:41.781 INFO:tasks.workunit.client.0.smithi170.stdout:6/528: truncate d2/d7/d1b/d28/f96 1146137 0 2024-01-25T15:03:41.781 INFO:tasks.workunit.client.0.smithi170.stdout:6/529: chown d2/f17 473629 1 2024-01-25T15:03:41.783 INFO:tasks.workunit.client.0.smithi170.stdout:0/498: rename f2 to d8/d10/d2d/d53/fb5 0 2024-01-25T15:03:41.783 INFO:tasks.workunit.client.0.smithi170.stdout:0/499: chown d8/d10/d2d/d2f/d96 135951 1 2024-01-25T15:03:41.783 INFO:tasks.workunit.client.0.smithi170.stdout:0/500: stat d8/d10/d2d/lab 0 2024-01-25T15:03:41.791 INFO:tasks.workunit.client.0.smithi170.stdout:1/517: rmdir d0/d50/d8e 39 2024-01-25T15:03:41.791 INFO:tasks.workunit.client.0.smithi170.stdout:1/518: truncate d0/f46 1567743 0 2024-01-25T15:03:41.792 INFO:tasks.workunit.client.0.smithi170.stdout:6/530: mkdir d2/d7/d23/d19/daf/db5 0 2024-01-25T15:03:41.792 INFO:tasks.workunit.client.0.smithi170.stdout:6/531: truncate d2/d7/d23/fa5 384162 0 2024-01-25T15:03:41.794 INFO:tasks.workunit.client.0.smithi170.stdout:8/504: rename d3/d7/d22/d80/d9d to d3/d7/d22/d23/d25/d41/da9 0 2024-01-25T15:03:41.796 INFO:tasks.workunit.client.0.smithi170.stdout:0/501: getdents d8/d10/d2d/d2f/d6a/d79 0 2024-01-25T15:03:41.797 INFO:tasks.workunit.client.0.smithi170.stdout:5/513: mkdir d5/db9 0 2024-01-25T15:03:41.797 INFO:tasks.workunit.client.0.smithi170.stdout:5/514: stat d5/f64 0 2024-01-25T15:03:41.799 INFO:tasks.workunit.client.0.smithi170.stdout:5/515: mkdir d5/d54/d85/d2c/d45/dba 0 2024-01-25T15:03:41.799 INFO:tasks.workunit.client.0.smithi170.stdout:2/520: dwrite d10/d1e/d32/d62/d74/f8f [0,4194304] 0 2024-01-25T15:03:41.799 INFO:tasks.workunit.client.0.smithi170.stdout:2/521: write d10/d1e/d5e/d73/d9e/db7/fbf [722986,31366] 0 2024-01-25T15:03:41.799 INFO:tasks.workunit.client.0.smithi170.stdout:2/522: write d10/d1b/f56 [1928696,47719] 0 2024-01-25T15:03:41.801 INFO:tasks.workunit.client.0.smithi170.stdout:2/523: symlink d10/d1e/d32/d3e/d5c/d92/d8b/lc1 0 2024-01-25T15:03:41.801 INFO:tasks.workunit.client.0.smithi170.stdout:8/505: rename d3/d7/d22/d23/c49 to d3/d7/d3a/d85/caa 0 2024-01-25T15:03:41.803 INFO:tasks.workunit.client.0.smithi170.stdout:0/502: mkdir d8/d10/d2d/d2f/d6a/d79/db6 0 2024-01-25T15:03:41.803 INFO:tasks.workunit.client.0.smithi170.stdout:0/503: dread - d8/d10/d2d/d2f/d4f/d5f/fb2 zero size 2024-01-25T15:03:41.803 INFO:tasks.workunit.client.0.smithi170.stdout:0/504: write d8/d10/d2d/d2f/d4f/d5f/fb2 [762248,105971] 0 2024-01-25T15:03:41.804 INFO:tasks.workunit.client.0.smithi170.stdout:5/516: creat d5/d54/d85/d2c/d34/d69/fbb x:0 0 0 2024-01-25T15:03:41.807 INFO:tasks.workunit.client.0.smithi170.stdout:2/524: symlink d10/d1e/d5e/d73/d9e/da3/lc2 0 2024-01-25T15:03:41.807 INFO:tasks.workunit.client.0.smithi170.stdout:2/525: stat d10/d16/d42 0 2024-01-25T15:03:41.811 INFO:tasks.workunit.client.0.smithi170.stdout:0/505: dread d8/d10/d2d/d89/faa [0,4194304] 0 2024-01-25T15:03:41.811 INFO:tasks.workunit.client.0.smithi170.stdout:0/506: truncate d8/d10/f4b 898545 0 2024-01-25T15:03:41.814 INFO:tasks.workunit.client.0.smithi170.stdout:0/507: mkdir d8/d10/d2d/d2f/d96/db7 0 2024-01-25T15:03:41.814 INFO:tasks.workunit.client.0.smithi170.stdout:1/519: dwrite d0/f33 [0,4194304] 0 2024-01-25T15:03:41.814 INFO:tasks.workunit.client.0.smithi170.stdout:1/520: getdents d0/d20/d3a/d60 0 2024-01-25T15:03:41.814 INFO:tasks.workunit.client.0.smithi170.stdout:0/508: creat d8/d10/d2d/d2f/d6a/d79/db6/fb8 x:0 0 0 2024-01-25T15:03:41.814 INFO:tasks.workunit.client.0.smithi170.stdout:0/509: chown d8/d3e/l86 54069545 1 2024-01-25T15:03:41.814 INFO:tasks.workunit.client.0.smithi170.stdout:0/510: fsync d8/d9/f29 0 2024-01-25T15:03:41.817 INFO:tasks.workunit.client.0.smithi170.stdout:5/517: getdents d5 0 2024-01-25T15:03:41.817 INFO:tasks.workunit.client.0.smithi170.stdout:5/518: creat d5/d54/fbc x:0 0 0 2024-01-25T15:03:41.817 INFO:tasks.workunit.client.0.smithi170.stdout:5/519: fsync d5/d54/d85/d3f/f79 0 2024-01-25T15:03:41.825 INFO:tasks.workunit.client.0.smithi170.stdout:2/526: dread d10/d1e/d32/d3e/d41/d7a/f80 [0,4194304] 0 2024-01-25T15:03:41.825 INFO:tasks.workunit.client.0.smithi170.stdout:2/527: stat d10/d1e/d32/d3e/d5c/la4 0 2024-01-25T15:03:41.825 INFO:tasks.workunit.client.0.smithi170.stdout:2/528: chown d10/d1e/d32/d3e/d5c/f86 0 1 2024-01-25T15:03:41.825 INFO:tasks.workunit.client.0.smithi170.stdout:8/506: dwrite d3/d7/f16 [0,4194304] 0 2024-01-25T15:03:41.826 INFO:tasks.workunit.client.0.smithi170.stdout:6/532: link d2/d7/d23/f2d d2/d7/d1b/d78/fb6 0 2024-01-25T15:03:41.827 INFO:tasks.workunit.client.0.smithi170.stdout:2/529: truncate d10/d1e/d32/d62/d74/fba 4052191 0 2024-01-25T15:03:41.829 INFO:tasks.workunit.client.0.smithi170.stdout:8/507: creat d3/d7/d22/d80/fab x:0 0 0 2024-01-25T15:03:41.832 INFO:tasks.workunit.client.0.smithi170.stdout:2/530: rename cc to d10/d1b/cc3 0 2024-01-25T15:03:41.832 INFO:tasks.workunit.client.0.smithi170.stdout:2/531: readlink d10/d1e/d32/d3e/d5c/d92/d8b/lc1 0 2024-01-25T15:03:41.834 INFO:tasks.workunit.client.0.smithi170.stdout:8/508: creat d3/d7/d22/d23/d48/d52/d47/fac x:0 0 0 2024-01-25T15:03:41.834 INFO:tasks.workunit.client.0.smithi170.stdout:8/509: write d3/d7/d22/d23/f76 [1018933,62956] 0 2024-01-25T15:03:41.835 INFO:tasks.workunit.client.0.smithi170.stdout:1/521: read d0/d20/f2b [2314391,60992] 0 2024-01-25T15:03:41.836 INFO:tasks.workunit.client.0.smithi170.stdout:8/510: creat d3/d7/d22/d23/d25/d41/fad x:0 0 0 2024-01-25T15:03:41.836 INFO:tasks.workunit.client.0.smithi170.stdout:2/532: unlink d10/d1e/d32/d3e/d41/c97 0 2024-01-25T15:03:41.837 INFO:tasks.workunit.client.0.smithi170.stdout:2/533: readlink d10/d1e/d5e/d73/d9e/da3/lbc 0 2024-01-25T15:03:41.838 INFO:tasks.workunit.client.0.smithi170.stdout:1/522: rmdir d0/d2e 39 2024-01-25T15:03:41.838 INFO:tasks.workunit.client.0.smithi170.stdout:1/523: readlink d0/d50/d8e/l9f 0 2024-01-25T15:03:41.839 INFO:tasks.workunit.client.0.smithi170.stdout:1/524: mknod d0/d20/cb0 0 2024-01-25T15:03:41.844 INFO:tasks.workunit.client.0.smithi170.stdout:5/520: dwrite d5/d54/d85/d3f/faa [0,4194304] 0 2024-01-25T15:03:41.847 INFO:tasks.workunit.client.0.smithi170.stdout:8/511: write d3/d7/d22/d23/d48/d52/d47/f4b [4017893,42939] 0 2024-01-25T15:03:41.852 INFO:tasks.workunit.client.0.smithi170.stdout:6/533: dwrite d2/d7/d23/d19/f24 [0,4194304] 0 2024-01-25T15:03:41.852 INFO:tasks.workunit.client.0.smithi170.stdout:6/534: read - d2/d7/d23/d19/d2f/f9a zero size 2024-01-25T15:03:41.854 INFO:tasks.workunit.client.0.smithi170.stdout:6/535: getdents d2/d7/d23/d19 0 2024-01-25T15:03:41.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:41 smithi186 ceph-mon[35697]: pgmap v399: 97 pgs: 97 active+clean; 946 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 113 MiB/s rd, 144 MiB/s wr, 2.35k op/s 2024-01-25T15:03:41.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:41 smithi186 ceph-mon[35697]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-25T15:03:41.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:41 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] up:active 2024-01-25T15:03:41.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:41 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:41.855 INFO:tasks.workunit.client.0.smithi170.stdout:6/536: symlink d2/d7/d23/d19/d2a/lb7 0 2024-01-25T15:03:41.862 INFO:tasks.workunit.client.0.smithi170.stdout:1/525: dwrite d0/f33 [0,4194304] 0 2024-01-25T15:03:41.863 INFO:tasks.workunit.client.0.smithi170.stdout:9/501: sync 2024-01-25T15:03:41.863 INFO:tasks.workunit.client.0.smithi170.stdout:3/566: sync 2024-01-25T15:03:41.863 INFO:tasks.workunit.client.0.smithi170.stdout:2/534: rename d10/d1e/d5e/d73/d9e/db7 to d10/d1e/d32/d3e/d41/dc4 0 2024-01-25T15:03:41.863 INFO:tasks.workunit.client.0.smithi170.stdout:3/567: chown d3/d2a/d53/l6b 29 1 2024-01-25T15:03:41.864 INFO:tasks.workunit.client.0.smithi170.stdout:2/535: dread - d10/d1b/f75 zero size 2024-01-25T15:03:41.864 INFO:tasks.workunit.client.0.smithi170.stdout:2/536: read d10/d1b/f36 [327896,10531] 0 2024-01-25T15:03:41.864 INFO:tasks.workunit.client.0.smithi170.stdout:9/502: creat d5/df/d2e/d77/d21/d34/d3e/d7f/fb3 x:0 0 0 2024-01-25T15:03:41.864 INFO:tasks.workunit.client.0.smithi170.stdout:3/568: creat d3/d10/d1e/d21/d41/fb0 x:0 0 0 2024-01-25T15:03:41.864 INFO:tasks.workunit.client.0.smithi170.stdout:9/503: write d5/df/d2e/d77/faf [70206,65770] 0 2024-01-25T15:03:41.865 INFO:tasks.workunit.client.0.smithi170.stdout:6/537: write d2/f4f [255961,25029] 0 2024-01-25T15:03:41.865 INFO:tasks.workunit.client.0.smithi170.stdout:2/537: creat d10/d1e/d32/d3e/d5c/d92/fc5 x:0 0 0 2024-01-25T15:03:41.865 INFO:tasks.workunit.client.0.smithi170.stdout:2/538: chown d10/d1e/d32/d62/f79 218594 1 2024-01-25T15:03:41.865 INFO:tasks.workunit.client.0.smithi170.stdout:2/539: write d10/d1e/f26 [1426399,54319] 0 2024-01-25T15:03:41.866 INFO:tasks.workunit.client.0.smithi170.stdout:6/538: mkdir d2/d7/d1b/d28/db8 0 2024-01-25T15:03:41.866 INFO:tasks.workunit.client.0.smithi170.stdout:6/539: readlink d2/d7/d23/d19/d2f/d5d/l7e 0 2024-01-25T15:03:41.866 INFO:tasks.workunit.client.0.smithi170.stdout:6/540: read - d2/f7b zero size 2024-01-25T15:03:41.866 INFO:tasks.workunit.client.0.smithi170.stdout:8/512: dwrite d3/d7/d22/d5d/f6e [0,4194304] 0 2024-01-25T15:03:41.866 INFO:tasks.workunit.client.0.smithi170.stdout:6/541: chown d2 95 1 2024-01-25T15:03:41.866 INFO:tasks.workunit.client.0.smithi170.stdout:6/542: fsync d2/f82 0 2024-01-25T15:03:41.867 INFO:tasks.workunit.client.0.smithi170.stdout:2/540: write d10/d1e/d5e/d73/d9e/da3/fad [758305,17176] 0 2024-01-25T15:03:41.868 INFO:tasks.workunit.client.0.smithi170.stdout:8/513: symlink d3/d7/d3a/lae 0 2024-01-25T15:03:41.869 INFO:tasks.workunit.client.0.smithi170.stdout:6/543: rmdir d2/d7/d23/d19/d2f/d74 39 2024-01-25T15:03:41.871 INFO:tasks.workunit.client.0.smithi170.stdout:8/514: creat d3/d7/d22/d23/d25/d41/da9/faf x:0 0 0 2024-01-25T15:03:41.872 INFO:tasks.workunit.client.0.smithi170.stdout:6/544: mkdir d2/d7/db9 0 2024-01-25T15:03:41.872 INFO:tasks.workunit.client.0.smithi170.stdout:6/545: read d2/f10 [1140162,105200] 0 2024-01-25T15:03:41.872 INFO:tasks.workunit.client.0.smithi170.stdout:6/546: truncate d2/fa0 192953 0 2024-01-25T15:03:41.873 INFO:tasks.workunit.client.0.smithi170.stdout:8/515: dread d3/d7/f15 [0,4194304] 0 2024-01-25T15:03:41.873 INFO:tasks.workunit.client.0.smithi170.stdout:8/516: stat d3/f72 0 2024-01-25T15:03:41.873 INFO:tasks.workunit.client.0.smithi170.stdout:8/517: dread - d3/d7/d73/fa1 zero size 2024-01-25T15:03:41.873 INFO:tasks.workunit.client.0.smithi170.stdout:6/547: creat d2/d7/d1b/d28/db8/fba x:0 0 0 2024-01-25T15:03:41.873 INFO:tasks.workunit.client.0.smithi170.stdout:6/548: truncate d2/d7/d23/d19/d2f/d5d/f91 9399 0 2024-01-25T15:03:41.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:41 smithi170 ceph-mon[31899]: pgmap v399: 97 pgs: 97 active+clean; 946 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 113 MiB/s rd, 144 MiB/s wr, 2.35k op/s 2024-01-25T15:03:41.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:41 smithi170 ceph-mon[31899]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-25T15:03:41.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:41 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] up:active 2024-01-25T15:03:41.874 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:41 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:41.874 INFO:tasks.workunit.client.0.smithi170.stdout:6/549: symlink d2/lbb 0 2024-01-25T15:03:41.875 INFO:tasks.workunit.client.0.smithi170.stdout:6/550: link d2/d7/d23/d19/d2f/d5d/f6f d2/d7/d23/d19/d2f/d5d/fbc 0 2024-01-25T15:03:41.876 INFO:tasks.workunit.client.0.smithi170.stdout:6/551: mkdir d2/d7/d23/d19/d2f/d74/dbd 0 2024-01-25T15:03:41.877 INFO:tasks.workunit.client.0.smithi170.stdout:6/552: mknod d2/d7/d23/d19/d2a/d43/d98/cbe 0 2024-01-25T15:03:41.878 INFO:tasks.workunit.client.0.smithi170.stdout:6/553: write d2/f7b [65234,8797] 0 2024-01-25T15:03:41.878 INFO:tasks.workunit.client.0.smithi170.stdout:6/554: rmdir d2/d7/d1b/d28 39 2024-01-25T15:03:41.878 INFO:tasks.workunit.client.0.smithi170.stdout:6/555: read d2/d7/d23/d19/d2a/f55 [3393321,33951] 0 2024-01-25T15:03:41.879 INFO:tasks.workunit.client.0.smithi170.stdout:6/556: creat d2/d7/fbf x:0 0 0 2024-01-25T15:03:41.879 INFO:tasks.workunit.client.0.smithi170.stdout:6/557: fdatasync d2/d7/d1b/d28/f49 0 2024-01-25T15:03:41.879 INFO:tasks.workunit.client.0.smithi170.stdout:6/558: stat d2/d7/d23/d19/d2a/d43/l7a 0 2024-01-25T15:03:41.880 INFO:tasks.workunit.client.0.smithi170.stdout:2/541: rename d10/d16 to d10/d1e/d32/d3e/d41/dc4/dc6 0 2024-01-25T15:03:41.882 INFO:tasks.workunit.client.0.smithi170.stdout:8/518: rename d3/d7/d22/d23/d25/d41/c60 to d3/d7/d22/d80/cb0 0 2024-01-25T15:03:41.882 INFO:tasks.workunit.client.0.smithi170.stdout:8/519: write d3/d7/d3a/f4f [625671,91826] 0 2024-01-25T15:03:41.882 INFO:tasks.workunit.client.0.smithi170.stdout:8/520: write d3/d7/d22/d23/d48/f81 [118740,70044] 0 2024-01-25T15:03:41.882 INFO:tasks.workunit.client.0.smithi170.stdout:8/521: write d3/d7/d22/d23/d25/d41/da9/faf [426473,62018] 0 2024-01-25T15:03:41.882 INFO:tasks.workunit.client.0.smithi170.stdout:3/569: dwrite d3/d10/d6d/faa [0,4194304] 0 2024-01-25T15:03:41.882 INFO:tasks.workunit.client.0.smithi170.stdout:8/522: write d3/d7/d3a/d91/f79 [613378,114233] 0 2024-01-25T15:03:41.882 INFO:tasks.workunit.client.0.smithi170.stdout:8/523: creat d3/d7/d73/fb1 x:0 0 0 2024-01-25T15:03:41.883 INFO:tasks.workunit.client.0.smithi170.stdout:6/559: dread d2/f4f [0,4194304] 0 2024-01-25T15:03:41.883 INFO:tasks.workunit.client.0.smithi170.stdout:6/560: write d2/d7/d23/d19/d2a/d43/d44/da4/fae [875977,81576] 0 2024-01-25T15:03:41.883 INFO:tasks.workunit.client.0.smithi170.stdout:6/561: stat d2/d7/d23/d19/d2a/d6b 0 2024-01-25T15:03:41.886 INFO:tasks.workunit.client.0.smithi170.stdout:6/562: symlink d2/d7/d23/d19/daf/lc0 0 2024-01-25T15:03:41.887 INFO:tasks.workunit.client.0.smithi170.stdout:6/563: mkdir d2/d7/d23/d19/d2f/d74/dc1 0 2024-01-25T15:03:41.889 INFO:tasks.workunit.client.0.smithi170.stdout:6/564: link d2/d7/d23/d19/d2f/f32 d2/d7/d1b/d28/da7/fc2 0 2024-01-25T15:03:41.889 INFO:tasks.workunit.client.0.smithi170.stdout:6/565: chown d2/d7/d23/fa5 4 1 2024-01-25T15:03:41.889 INFO:tasks.workunit.client.0.smithi170.stdout:6/566: stat d2/d7/d23/d19/d2a/f55 0 2024-01-25T15:03:41.889 INFO:tasks.workunit.client.0.smithi170.stdout:6/567: write d2/f10 [881603,83553] 0 2024-01-25T15:03:41.894 INFO:tasks.workunit.client.0.smithi170.stdout:8/524: dread d3/d7/f10 [0,4194304] 0 2024-01-25T15:03:41.895 INFO:tasks.workunit.client.0.smithi170.stdout:8/525: getdents d3/d7/d22/d5d 0 2024-01-25T15:03:41.897 INFO:tasks.workunit.client.0.smithi170.stdout:8/526: rmdir d3/d7/d3a/d91/d7f 39 2024-01-25T15:03:41.900 INFO:tasks.workunit.client.0.smithi170.stdout:8/527: creat d3/d7/fb2 x:0 0 0 2024-01-25T15:03:41.900 INFO:tasks.workunit.client.0.smithi170.stdout:8/528: dread - d3/d7/d73/fa1 zero size 2024-01-25T15:03:41.900 INFO:tasks.workunit.client.0.smithi170.stdout:8/529: truncate d3/d7/d22/d23/d25/f95 293116 0 2024-01-25T15:03:41.900 INFO:tasks.workunit.client.0.smithi170.stdout:6/568: dread d2/d7/d23/d19/d2f/f32 [0,4194304] 0 2024-01-25T15:03:41.901 INFO:tasks.workunit.client.0.smithi170.stdout:3/570: read d3/d10/d6d/faa [2704253,55236] 0 2024-01-25T15:03:41.908 INFO:tasks.workunit.client.0.smithi170.stdout:2/542: dwrite d10/d1e/d32/d62/d8d/fbe [0,4194304] 0 2024-01-25T15:03:41.909 INFO:tasks.workunit.client.0.smithi170.stdout:6/569: symlink d2/d7/db9/lc3 0 2024-01-25T15:03:41.911 INFO:tasks.workunit.client.0.smithi170.stdout:3/571: creat d3/d10/d13/d1b/fb1 x:0 0 0 2024-01-25T15:03:41.912 INFO:tasks.workunit.client.0.smithi170.stdout:2/543: symlink d10/d1b/db6/lc7 0 2024-01-25T15:03:41.914 INFO:tasks.workunit.client.0.smithi170.stdout:6/570: mknod d2/d7/d23/d19/d2a/d43/d44/da4/cc4 0 2024-01-25T15:03:41.914 INFO:tasks.workunit.client.0.smithi170.stdout:6/571: truncate d2/d7/d1b/d28/f96 2193626 0 2024-01-25T15:03:41.914 INFO:tasks.workunit.client.0.smithi170.stdout:6/572: getdents d2/d7/d23/d19/d2a/d43/d44/d8b 0 2024-01-25T15:03:41.914 INFO:tasks.workunit.client.0.smithi170.stdout:2/544: rename d10/d1e/d32/d3e/d41/d7a/f80 to d10/d1e/d32/d3e/d41/d7a/fc8 0 2024-01-25T15:03:41.915 INFO:tasks.workunit.client.0.smithi170.stdout:2/545: write d10/d1e/d32/d3e/f95 [258032,9944] 0 2024-01-25T15:03:41.915 INFO:tasks.workunit.client.0.smithi170.stdout:8/530: write d3/d7/d22/d23/f33 [3807876,59534] 0 2024-01-25T15:03:41.916 INFO:tasks.workunit.client.0.smithi170.stdout:3/572: rename d3/l9 to d3/d10/d1e/lb2 0 2024-01-25T15:03:41.917 INFO:tasks.workunit.client.0.smithi170.stdout:6/573: creat d2/d7/d23/d19/d2a/d6b/dad/fc5 x:0 0 0 2024-01-25T15:03:41.919 INFO:tasks.workunit.client.0.smithi170.stdout:8/531: mkdir d3/d7/d3a/d8d/db3 0 2024-01-25T15:03:41.919 INFO:tasks.workunit.client.0.smithi170.stdout:8/532: readlink d3/d7/d22/d23/d48/d52/d47/l59 0 2024-01-25T15:03:41.919 INFO:tasks.workunit.client.0.smithi170.stdout:8/533: write d3/d7/d22/d23/f54 [3964646,87034] 0 2024-01-25T15:03:41.921 INFO:tasks.workunit.client.0.smithi170.stdout:3/573: mkdir d3/d10/d13/d1b/db3 0 2024-01-25T15:03:41.921 INFO:tasks.workunit.client.0.smithi170.stdout:3/574: fdatasync d3/f17 0 2024-01-25T15:03:41.923 INFO:tasks.workunit.client.0.smithi170.stdout:6/574: rename d2/d7/d1b/l9b to d2/d7/d23/d19/daf/db0/lc6 0 2024-01-25T15:03:41.925 INFO:tasks.workunit.client.0.smithi170.stdout:6/575: rmdir d2/d7/d23/d19/d2a/d43/d98 39 2024-01-25T15:03:41.925 INFO:tasks.workunit.client.0.smithi170.stdout:2/546: dread d10/d1e/d32/d3e/d5c/f86 [0,4194304] 0 2024-01-25T15:03:41.930 INFO:tasks.workunit.client.0.smithi170.stdout:4/445: sync 2024-01-25T15:03:41.930 INFO:tasks.workunit.client.0.smithi170.stdout:4/446: read d6/d7/f14 [993819,64801] 0 2024-01-25T15:03:41.931 INFO:tasks.workunit.client.0.smithi170.stdout:2/547: unlink d10/d1e/d32/d3e/f6b 0 2024-01-25T15:03:41.932 INFO:tasks.workunit.client.0.smithi170.stdout:4/447: symlink d6/d7/d31/l82 0 2024-01-25T15:03:41.932 INFO:tasks.workunit.client.0.smithi170.stdout:4/448: fsync d6/d7/d31/d7e/f40 0 2024-01-25T15:03:41.933 INFO:tasks.workunit.client.0.smithi170.stdout:2/548: symlink d10/d1e/d32/d62/d8d/lc9 0 2024-01-25T15:03:41.934 INFO:tasks.workunit.client.0.smithi170.stdout:4/449: creat d6/d28/d59/d7d/f83 x:0 0 0 2024-01-25T15:03:41.934 INFO:tasks.workunit.client.0.smithi170.stdout:4/450: chown d6/d28/d59/d7d/l72 846908 1 2024-01-25T15:03:41.934 INFO:tasks.workunit.client.0.smithi170.stdout:4/451: chown d6/d28/c2f 999261230 1 2024-01-25T15:03:41.934 INFO:tasks.workunit.client.0.smithi170.stdout:4/452: dread - d6/d28/d59/d7d/f83 zero size 2024-01-25T15:03:41.934 INFO:tasks.workunit.client.0.smithi170.stdout:4/453: truncate d6/d7/d31/d7e/f74 19952 0 2024-01-25T15:03:41.935 INFO:tasks.workunit.client.0.smithi170.stdout:4/454: symlink d6/d28/l84 0 2024-01-25T15:03:41.937 INFO:tasks.workunit.client.0.smithi170.stdout:4/455: mknod d6/d28/d67/c85 0 2024-01-25T15:03:41.937 INFO:tasks.workunit.client.0.smithi170.stdout:4/456: dread - d6/d28/d59/d7d/f6c zero size 2024-01-25T15:03:41.939 INFO:tasks.workunit.client.0.smithi170.stdout:8/534: dwrite d3/d7/d3a/f78 [0,4194304] 0 2024-01-25T15:03:41.939 INFO:tasks.workunit.client.0.smithi170.stdout:8/535: fsync d3/d7/d22/d5d/fa3 0 2024-01-25T15:03:41.940 INFO:tasks.workunit.client.0.smithi170.stdout:2/549: dread d10/d1e/d32/d3e/d5c/f86 [0,4194304] 0 2024-01-25T15:03:41.942 INFO:tasks.workunit.client.0.smithi170.stdout:2/550: mknod d10/d1e/d32/d98/dab/cca 0 2024-01-25T15:03:41.942 INFO:tasks.workunit.client.0.smithi170.stdout:8/536: rmdir d3/d7/d22/d5d 39 2024-01-25T15:03:41.942 INFO:tasks.workunit.client.0.smithi170.stdout:8/537: write d3/d7/d73/fa1 [838843,40965] 0 2024-01-25T15:03:41.945 INFO:tasks.workunit.client.0.smithi170.stdout:6/576: dwrite d2/d7/d1b/f95 [0,4194304] 0 2024-01-25T15:03:41.945 INFO:tasks.workunit.client.0.smithi170.stdout:2/551: mknod d10/d1e/d32/d3e/d41/ccb 0 2024-01-25T15:03:41.945 INFO:tasks.workunit.client.0.smithi170.stdout:2/552: readlink d10/d1e/d32/d3e/d5c/d92/d8b/lc1 0 2024-01-25T15:03:41.945 INFO:tasks.workunit.client.0.smithi170.stdout:2/553: creat d10/d1e/d32/d3e/fcc x:0 0 0 2024-01-25T15:03:41.945 INFO:tasks.workunit.client.0.smithi170.stdout:2/554: stat d10/c2f 0 2024-01-25T15:03:41.945 INFO:tasks.workunit.client.0.smithi170.stdout:6/577: read d2/d7/d23/d19/d2a/d43/d98/fac [2072383,31456] 0 2024-01-25T15:03:41.948 INFO:tasks.workunit.client.0.smithi170.stdout:6/578: mkdir d2/d7/d23/d19/d2f/d5d/d94/d97/db4/dc7 0 2024-01-25T15:03:41.950 INFO:tasks.workunit.client.0.smithi170.stdout:6/579: mkdir d2/d7/d23/d19/d2f/d74/dc1/dc8 0 2024-01-25T15:03:41.952 INFO:tasks.workunit.client.0.smithi170.stdout:6/580: rmdir d2/d7/d23/d19/daf/db5 0 2024-01-25T15:03:41.954 INFO:tasks.workunit.client.0.smithi170.stdout:6/581: mknod d2/d7/d1b/d78/cc9 0 2024-01-25T15:03:41.961 INFO:tasks.workunit.client.0.smithi170.stdout:5/521: sync 2024-01-25T15:03:41.961 INFO:tasks.workunit.client.0.smithi170.stdout:0/511: sync 2024-01-25T15:03:41.961 INFO:tasks.workunit.client.0.smithi170.stdout:7/561: sync 2024-01-25T15:03:41.961 INFO:tasks.workunit.client.0.smithi170.stdout:4/457: rename d6/d7/d1b/c3a to d6/d28/d61/c86 0 2024-01-25T15:03:41.961 INFO:tasks.workunit.client.0.smithi170.stdout:0/512: creat d8/d10/d5a/fb9 x:0 0 0 2024-01-25T15:03:41.961 INFO:tasks.workunit.client.0.smithi170.stdout:0/513: fsync d8/d9/f46 0 2024-01-25T15:03:41.962 INFO:tasks.workunit.client.0.smithi170.stdout:5/522: getdents d5/d54/d85/d2c/d51/d3d/d57 0 2024-01-25T15:03:41.967 INFO:tasks.workunit.client.0.smithi170.stdout:2/555: dwrite d10/d1e/d32/d3e/d41/dc4/dc6/d42/f48 [0,4194304] 0 2024-01-25T15:03:41.968 INFO:tasks.workunit.client.0.smithi170.stdout:4/458: creat d6/d28/d59/d7d/d6b/f87 x:0 0 0 2024-01-25T15:03:41.968 INFO:tasks.workunit.client.0.smithi170.stdout:7/562: symlink d8/d20/d2a/d35/daf/ld3 0 2024-01-25T15:03:41.968 INFO:tasks.workunit.client.0.smithi170.stdout:4/459: creat d6/d28/d59/d7d/d6b/f88 x:0 0 0 2024-01-25T15:03:41.969 INFO:tasks.workunit.client.0.smithi170.stdout:2/556: creat d10/d1e/d32/d62/fcd x:0 0 0 2024-01-25T15:03:41.969 INFO:tasks.workunit.client.0.smithi170.stdout:2/557: truncate d10/d1b/d5f/f78 2186034 0 2024-01-25T15:03:41.969 INFO:tasks.workunit.client.0.smithi170.stdout:7/563: symlink d8/d20/d2a/d35/d55/d6e/ld4 0 2024-01-25T15:03:41.969 INFO:tasks.workunit.client.0.smithi170.stdout:7/564: chown d8/f1c 3 1 2024-01-25T15:03:41.970 INFO:tasks.workunit.client.0.smithi170.stdout:5/523: truncate d5/f15 1800720 0 2024-01-25T15:03:41.970 INFO:tasks.workunit.client.0.smithi170.stdout:5/524: write d5/d54/d85/f5a [1825528,44270] 0 2024-01-25T15:03:41.970 INFO:tasks.workunit.client.0.smithi170.stdout:7/565: truncate d8/d20/d2a/d35/d55/f67 1546240 0 2024-01-25T15:03:41.971 INFO:tasks.workunit.client.0.smithi170.stdout:6/582: write d2/d7/d23/d19/d2a/d43/d44/f48 [3018181,86846] 0 2024-01-25T15:03:41.972 INFO:tasks.workunit.client.0.smithi170.stdout:5/525: mkdir d5/d54/d85/d2c/d45/dba/dbd 0 2024-01-25T15:03:41.972 INFO:tasks.workunit.client.0.smithi170.stdout:4/460: truncate d6/d7/d1b/f1e 2913044 0 2024-01-25T15:03:41.972 INFO:tasks.workunit.client.0.smithi170.stdout:4/461: write d6/d28/f55 [104503,116500] 0 2024-01-25T15:03:41.975 INFO:tasks.workunit.client.0.smithi170.stdout:6/583: mknod d2/d7/d23/d19/d2a/d43/d44/da4/cca 0 2024-01-25T15:03:41.975 INFO:tasks.workunit.client.0.smithi170.stdout:6/584: write d2/d7/d23/fa5 [1178485,87532] 0 2024-01-25T15:03:41.975 INFO:tasks.workunit.client.0.smithi170.stdout:6/585: truncate d2/d7/d1b/d28/f8a 4550599 0 2024-01-25T15:03:41.975 INFO:tasks.workunit.client.0.smithi170.stdout:6/586: fdatasync d2/fa0 0 2024-01-25T15:03:41.978 INFO:tasks.workunit.client.0.smithi170.stdout:4/462: mknod d6/d28/d59/d7d/c89 0 2024-01-25T15:03:41.979 INFO:tasks.workunit.client.0.smithi170.stdout:6/587: dread d2/d7/d1b/d28/da7/fc2 [0,4194304] 0 2024-01-25T15:03:41.979 INFO:tasks.workunit.client.0.smithi170.stdout:6/588: write d2/fa0 [898125,116551] 0 2024-01-25T15:03:41.979 INFO:tasks.workunit.client.0.smithi170.stdout:6/589: chown d2/d7/d1b/d28/da7 39 1 2024-01-25T15:03:41.980 INFO:tasks.workunit.client.0.smithi170.stdout:6/590: mkdir d2/d7/d23/d19/d2a/d6b/dad/dcb 0 2024-01-25T15:03:41.981 INFO:tasks.workunit.client.0.smithi170.stdout:6/591: creat d2/fcc x:0 0 0 2024-01-25T15:03:41.981 INFO:tasks.workunit.client.0.smithi170.stdout:6/592: creat d2/fcd x:0 0 0 2024-01-25T15:03:41.984 INFO:tasks.workunit.client.0.smithi170.stdout:2/558: dread d10/d1e/f2e [0,4194304] 0 2024-01-25T15:03:41.986 INFO:tasks.workunit.client.0.smithi170.stdout:5/526: dread d5/d54/d85/d2c/d51/f4c [0,4194304] 0 2024-01-25T15:03:41.986 INFO:tasks.workunit.client.0.smithi170.stdout:5/527: dread - d5/d54/fbc zero size 2024-01-25T15:03:41.986 INFO:tasks.workunit.client.0.smithi170.stdout:2/559: write d10/d1e/f58 [881645,8605] 0 2024-01-25T15:03:41.986 INFO:tasks.workunit.client.0.smithi170.stdout:2/560: truncate d10/d1e/d5e/d73/d9e/da3/fb3 4914650 0 2024-01-25T15:03:41.986 INFO:tasks.workunit.client.0.smithi170.stdout:2/561: chown d10/d1e/d32/d62/d74/fb4 21051 1 2024-01-25T15:03:41.991 INFO:tasks.workunit.client.0.smithi170.stdout:0/514: dwrite d8/d10/d2d/d89/faa [0,4194304] 0 2024-01-25T15:03:41.991 INFO:tasks.workunit.client.0.smithi170.stdout:0/515: readlink d8/d18/l93 0 2024-01-25T15:03:41.991 INFO:tasks.workunit.client.0.smithi170.stdout:0/516: readlink d8/d9/d9a/l4a 0 2024-01-25T15:03:41.994 INFO:tasks.workunit.client.0.smithi170.stdout:4/463: rmdir d6 39 2024-01-25T15:03:41.994 INFO:tasks.workunit.client.0.smithi170.stdout:7/566: dwrite d8/d20/d45/d8e/f9d [0,4194304] 0 2024-01-25T15:03:41.994 INFO:tasks.workunit.client.0.smithi170.stdout:7/567: stat d8/d20/d73 0 2024-01-25T15:03:41.997 INFO:tasks.workunit.client.0.smithi170.stdout:4/464: symlink d6/l8a 0 2024-01-25T15:03:41.997 INFO:tasks.workunit.client.0.smithi170.stdout:4/465: truncate d6/d28/d59/d7d/f24 145215 0 2024-01-25T15:03:41.998 INFO:tasks.workunit.client.0.smithi170.stdout:7/568: symlink d8/d20/d2a/d35/d55/d7d/ld5 0 2024-01-25T15:03:42.002 INFO:tasks.workunit.client.0.smithi170.stdout:7/569: getdents d8/d20/d45/d68/d71/d8c 0 2024-01-25T15:03:42.002 INFO:tasks.workunit.client.0.smithi170.stdout:7/570: write d8/d20/d45/d8e/f9d [4298518,21074] 0 2024-01-25T15:03:42.004 INFO:tasks.workunit.client.0.smithi170.stdout:0/517: write d8/d10/f69 [1553710,117198] 0 2024-01-25T15:03:42.004 INFO:tasks.workunit.client.0.smithi170.stdout:6/593: dwrite d2/d7/d23/d19/d2a/f92 [0,4194304] 0 2024-01-25T15:03:42.006 INFO:tasks.workunit.client.0.smithi170.stdout:0/518: write d8/d10/d2d/d2f/d4f/d5f/fb2 [77570,89152] 0 2024-01-25T15:03:42.012 INFO:tasks.workunit.client.0.smithi170.stdout:5/528: dwrite d5/d54/d85/d2c/f2d [0,4194304] 0 2024-01-25T15:03:42.013 INFO:tasks.workunit.client.0.smithi170.stdout:5/529: dread - d5/d54/d85/d2c/d51/d3d/f6d zero size 2024-01-25T15:03:42.013 INFO:tasks.workunit.client.0.smithi170.stdout:5/530: write d5/d2a/f52 [1256420,87935] 0 2024-01-25T15:03:42.013 INFO:tasks.workunit.client.0.smithi170.stdout:6/594: mkdir d2/d7/d23/d19/d2f/d74/dce 0 2024-01-25T15:03:42.013 INFO:tasks.workunit.client.0.smithi170.stdout:2/562: rename d10/c2f to d10/d1e/d32/d62/d8d/cce 0 2024-01-25T15:03:42.014 INFO:tasks.workunit.client.0.smithi170.stdout:2/563: chown d10/d1b/cc3 6576989 1 2024-01-25T15:03:42.014 INFO:tasks.workunit.client.0.smithi170.stdout:0/519: creat d8/d3e/fba x:0 0 0 2024-01-25T15:03:42.018 INFO:tasks.workunit.client.0.smithi170.stdout:5/531: link d5/d54/d85/d3f/d86/da5/fb2 d5/d54/d85/d2c/fbe 0 2024-01-25T15:03:42.018 INFO:tasks.workunit.client.0.smithi170.stdout:5/532: fdatasync d5/d54/d85/d2c/f5f 0 2024-01-25T15:03:42.019 INFO:tasks.workunit.client.0.smithi170.stdout:6/595: mkdir d2/d7/d23/d19/d2f/d74/dc1/dcf 0 2024-01-25T15:03:42.021 INFO:tasks.workunit.client.0.smithi170.stdout:2/564: stat d10/d1b/cc3 0 2024-01-25T15:03:42.021 INFO:tasks.workunit.client.0.smithi170.stdout:2/565: chown d10/l6e 364 1 2024-01-25T15:03:42.022 INFO:tasks.workunit.client.0.smithi170.stdout:0/520: mknod d8/d10/d5a/cbb 0 2024-01-25T15:03:42.022 INFO:tasks.workunit.client.0.smithi170.stdout:0/521: chown d8/d10/f4b 3279 1 2024-01-25T15:03:42.022 INFO:tasks.workunit.client.0.smithi170.stdout:2/566: write d10/d1e/d32/d3e/d5c/d92/d8b/fb2 [720452,30232] 0 2024-01-25T15:03:42.022 INFO:tasks.workunit.client.0.smithi170.stdout:2/567: creat d10/d1e/d32/d62/d74/fcf x:0 0 0 2024-01-25T15:03:42.024 INFO:tasks.workunit.client.0.smithi170.stdout:6/596: link d2/d7/d23/l5c d2/d7/d23/d19/d2a/d6b/ld0 0 2024-01-25T15:03:42.024 INFO:tasks.workunit.client.0.smithi170.stdout:6/597: write d2/d7/d1b/f1f [1374762,37990] 0 2024-01-25T15:03:42.026 INFO:tasks.workunit.client.0.smithi170.stdout:1/526: sync 2024-01-25T15:03:42.026 INFO:tasks.workunit.client.0.smithi170.stdout:1/527: creat d0/d20/fb1 x:0 0 0 2024-01-25T15:03:42.027 INFO:tasks.workunit.client.0.smithi170.stdout:6/598: symlink d2/d7/d23/ld1 0 2024-01-25T15:03:42.027 INFO:tasks.workunit.client.0.smithi170.stdout:2/568: write d10/d1e/d32/d3e/d41/dc4/fbf [493511,75827] 0 2024-01-25T15:03:42.027 INFO:tasks.workunit.client.0.smithi170.stdout:5/533: write d5/d54/d85/d2c/d34/f8b [296923,3178] 0 2024-01-25T15:03:42.027 INFO:tasks.workunit.client.0.smithi170.stdout:6/599: chown d2/d7/d1b/d78/c81 50 1 2024-01-25T15:03:42.027 INFO:tasks.workunit.client.0.smithi170.stdout:6/600: write d2/f40 [1069378,73845] 0 2024-01-25T15:03:42.028 INFO:tasks.workunit.client.0.smithi170.stdout:5/534: creat d5/d54/d85/d2c/d45/d56/d72/fbf x:0 0 0 2024-01-25T15:03:42.029 INFO:tasks.workunit.client.0.smithi170.stdout:9/504: sync 2024-01-25T15:03:42.029 INFO:tasks.workunit.client.0.smithi170.stdout:9/505: dread - d5/df/d2e/d77/d21/d63/d96/f98 zero size 2024-01-25T15:03:42.029 INFO:tasks.workunit.client.0.smithi170.stdout:9/506: stat d5/df/d2e/d77/d21/d34/d3e/c41 0 2024-01-25T15:03:42.033 INFO:tasks.workunit.client.0.smithi170.stdout:6/601: mkdir d2/d7/d1b/d28/da7/dd2 0 2024-01-25T15:03:42.034 INFO:tasks.workunit.client.0.smithi170.stdout:9/507: mknod d5/df/d16/d52/d9c/cb4 0 2024-01-25T15:03:42.035 INFO:tasks.workunit.client.0.smithi170.stdout:1/528: rmdir d0/d20/d28/d7b 39 2024-01-25T15:03:42.035 INFO:tasks.workunit.client.0.smithi170.stdout:1/529: truncate d0/d20/d3a/f53 4753769 0 2024-01-25T15:03:42.036 INFO:tasks.workunit.client.0.smithi170.stdout:9/508: creat d5/df/d2e/d77/d21/d63/d96/fb5 x:0 0 0 2024-01-25T15:03:42.036 INFO:tasks.workunit.client.0.smithi170.stdout:9/509: chown d5/df/d2e/l61 596 1 2024-01-25T15:03:42.037 INFO:tasks.workunit.client.0.smithi170.stdout:6/602: mkdir d2/d7/d23/d19/d2f/d5d/d94/d97/db4/dd3 0 2024-01-25T15:03:42.039 INFO:tasks.workunit.client.0.smithi170.stdout:1/530: mknod d0/d50/d8e/d9e/cb2 0 2024-01-25T15:03:42.041 INFO:tasks.workunit.client.0.smithi170.stdout:6/603: mkdir d2/d7/d23/d19/d2f/dd4 0 2024-01-25T15:03:42.041 INFO:tasks.workunit.client.0.smithi170.stdout:6/604: chown d2/d7/d23/d19/d2a/d6b/dad/dcb 218 1 2024-01-25T15:03:42.041 INFO:tasks.workunit.client.0.smithi170.stdout:6/605: write d2/d7/d23/d19/d2a/d43/d44/da4/fab [680659,77391] 0 2024-01-25T15:03:42.042 INFO:tasks.workunit.client.0.smithi170.stdout:1/531: truncate d0/ff 894958 0 2024-01-25T15:03:42.042 INFO:tasks.workunit.client.0.smithi170.stdout:1/532: dread - d0/d20/d28/d2a/fa3 zero size 2024-01-25T15:03:42.042 INFO:tasks.workunit.client.0.smithi170.stdout:0/522: dwrite d8/d10/d2d/d2f/d4f/da2/fb1 [0,4194304] 0 2024-01-25T15:03:42.044 INFO:tasks.workunit.client.0.smithi170.stdout:9/510: rmdir d5/df/d16/d35/d3c/d56/d85 0 2024-01-25T15:03:42.045 INFO:tasks.workunit.client.0.smithi170.stdout:5/535: write d5/d54/d85/d3f/faa [3898515,123924] 0 2024-01-25T15:03:42.045 INFO:tasks.workunit.client.0.smithi170.stdout:5/536: creat d5/d54/d85/d2c/d45/d56/d72/fc0 x:0 0 0 2024-01-25T15:03:42.049 INFO:tasks.workunit.client.0.smithi170.stdout:6/606: dread d2/d7/d23/d19/d2a/d43/d44/f48 [0,4194304] 0 2024-01-25T15:03:42.049 INFO:tasks.workunit.client.0.smithi170.stdout:2/569: dwrite d10/d1e/d32/d98/fa5 [0,4194304] 0 2024-01-25T15:03:42.053 INFO:tasks.workunit.client.0.smithi170.stdout:4/466: rename d6/d28/f55 to d6/d7/d31/d46/d78/f8b 0 2024-01-25T15:03:42.058 INFO:tasks.workunit.client.0.smithi170.stdout:0/523: unlink d8/d10/d77/c81 0 2024-01-25T15:03:42.058 INFO:tasks.workunit.client.0.smithi170.stdout:0/524: fdatasync d8/d10/f4b 0 2024-01-25T15:03:42.060 INFO:tasks.workunit.client.0.smithi170.stdout:6/607: truncate d2/d7/d1b/f64 2529287 0 2024-01-25T15:03:42.061 INFO:tasks.workunit.client.0.smithi170.stdout:7/571: rename d8/d20/d2a/d35/db0/fc0 to d8/d20/dc2/fd6 0 2024-01-25T15:03:42.061 INFO:tasks.workunit.client.0.smithi170.stdout:3/575: sync 2024-01-25T15:03:42.062 INFO:tasks.workunit.client.0.smithi170.stdout:4/467: mkdir d6/d8c 0 2024-01-25T15:03:42.062 INFO:tasks.workunit.client.0.smithi170.stdout:4/468: truncate d6/d7/d31/d7e/f5b 471154 0 2024-01-25T15:03:42.062 INFO:tasks.workunit.client.0.smithi170.stdout:4/469: dread - d6/d28/d59/d7d/d6b/f87 zero size 2024-01-25T15:03:42.062 INFO:tasks.workunit.client.0.smithi170.stdout:4/470: fsync d6/d7/d31/d46/d78/f8b 0 2024-01-25T15:03:42.064 INFO:tasks.workunit.client.0.smithi170.stdout:6/608: creat d2/d7/d23/d19/d2f/d74/fd5 x:0 0 0 2024-01-25T15:03:42.068 INFO:tasks.workunit.client.0.smithi170.stdout:1/533: rename d0/d20/d28/l62 to d0/d20/d28/d2a/d57/lb3 0 2024-01-25T15:03:42.069 INFO:tasks.workunit.client.0.smithi170.stdout:7/572: creat d8/d20/d45/d68/d71/d8c/fd7 x:0 0 0 2024-01-25T15:03:42.071 INFO:tasks.workunit.client.0.smithi170.stdout:3/576: creat d3/d1c/fb4 x:0 0 0 2024-01-25T15:03:42.071 INFO:tasks.workunit.client.0.smithi170.stdout:5/537: dwrite d5/d54/d85/fb1 [0,4194304] 0 2024-01-25T15:03:42.071 INFO:tasks.workunit.client.0.smithi170.stdout:5/538: dread - d5/d58/f88 zero size 2024-01-25T15:03:42.071 INFO:tasks.workunit.client.0.smithi170.stdout:5/539: write d5/d54/fa3 [482114,15341] 0 2024-01-25T15:03:42.072 INFO:tasks.workunit.client.0.smithi170.stdout:6/609: mknod d2/d7/d1b/d28/da7/dd2/cd6 0 2024-01-25T15:03:42.074 INFO:tasks.workunit.client.0.smithi170.stdout:9/511: rename d5/df/d16/d35/d3c/d56/d59/l9b to d5/df/d2e/d77/d21/d63/lb6 0 2024-01-25T15:03:42.075 INFO:tasks.workunit.client.0.smithi170.stdout:3/577: write d3/d2a/f5f [801163,13528] 0 2024-01-25T15:03:42.076 INFO:tasks.workunit.client.0.smithi170.stdout:1/534: mknod d0/d50/da0/dab/cb4 0 2024-01-25T15:03:42.078 INFO:tasks.workunit.client.0.smithi170.stdout:2/570: dwrite d10/d1e/d32/d63/f90 [0,4194304] 0 2024-01-25T15:03:42.079 INFO:tasks.workunit.client.0.smithi170.stdout:2/571: chown d10/d1b/db6/lc7 7 1 2024-01-25T15:03:42.079 INFO:tasks.workunit.client.0.smithi170.stdout:5/540: unlink d5/d54/d85/d2c/f2e 0 2024-01-25T15:03:42.080 INFO:tasks.workunit.client.0.smithi170.stdout:5/541: chown d5/c29 20 1 2024-01-25T15:03:42.080 INFO:tasks.workunit.client.0.smithi170.stdout:9/512: getdents d5/dc/d42 0 2024-01-25T15:03:42.080 INFO:tasks.workunit.client.0.smithi170.stdout:9/513: creat d5/df/d16/d35/d3c/d56/d59/fb7 x:0 0 0 2024-01-25T15:03:42.080 INFO:tasks.workunit.client.0.smithi170.stdout:9/514: chown d5/dc/d42/f5c 527416430 1 2024-01-25T15:03:42.081 INFO:tasks.workunit.client.0.smithi170.stdout:5/542: mkdir d5/d54/d85/d2c/d45/dba/dc1 0 2024-01-25T15:03:42.082 INFO:tasks.workunit.client.0.smithi170.stdout:1/535: creat d0/d2e/fb5 x:0 0 0 2024-01-25T15:03:42.085 INFO:tasks.workunit.client.0.smithi170.stdout:9/515: unlink d5/df/d16/d35/d3c/fa2 0 2024-01-25T15:03:42.087 INFO:tasks.workunit.client.0.smithi170.stdout:1/536: creat d0/d20/d28/fb6 x:0 0 0 2024-01-25T15:03:42.088 INFO:tasks.workunit.client.0.smithi170.stdout:1/537: truncate d0/d2e/fae 306402 0 2024-01-25T15:03:42.088 INFO:tasks.workunit.client.0.smithi170.stdout:1/538: readlink d0/d20/d28/d2a/d4a/d56/d5b/l97 0 2024-01-25T15:03:42.088 INFO:tasks.workunit.client.0.smithi170.stdout:1/539: fdatasync d0/f6d 0 2024-01-25T15:03:42.089 INFO:tasks.workunit.client.0.smithi170.stdout:9/516: rmdir d5/df/d16/da1 0 2024-01-25T15:03:42.091 INFO:tasks.workunit.client.0.smithi170.stdout:5/543: rmdir d5/d54/d85/d3f/d8f 39 2024-01-25T15:03:42.092 INFO:tasks.workunit.client.0.smithi170.stdout:5/544: mkdir d5/d54/d85/d2c/d45/dba/dbd/dc2 0 2024-01-25T15:03:42.092 INFO:tasks.workunit.client.0.smithi170.stdout:5/545: stat d5/d54/d85/d2c/d45/d56 0 2024-01-25T15:03:42.093 INFO:tasks.workunit.client.0.smithi170.stdout:5/546: chown d5/f8e 1 1 2024-01-25T15:03:42.094 INFO:tasks.workunit.client.0.smithi170.stdout:1/540: link d0/d2e/f3b d0/d50/d8e/d9e/fb7 0 2024-01-25T15:03:42.096 INFO:tasks.workunit.client.0.smithi170.stdout:2/572: write d10/d1e/d32/d3e/d41/dc4/dc6/d42/f48 [2685207,2185] 0 2024-01-25T15:03:42.096 INFO:tasks.workunit.client.0.smithi170.stdout:5/547: rmdir d5/d54/d85/d2c/d45/d56 39 2024-01-25T15:03:42.097 INFO:tasks.workunit.client.0.smithi170.stdout:5/548: write d5/d54/d85/f19 [1879061,18857] 0 2024-01-25T15:03:42.097 INFO:tasks.workunit.client.0.smithi170.stdout:5/549: creat d5/d54/d85/d2c/d45/fc3 x:0 0 0 2024-01-25T15:03:42.097 INFO:tasks.workunit.client.0.smithi170.stdout:5/550: chown d5/d54/d85/d2c/d45/d5e/f63 2 1 2024-01-25T15:03:42.098 INFO:tasks.workunit.client.0.smithi170.stdout:1/541: link d0/c21 d0/d50/cb8 0 2024-01-25T15:03:42.098 INFO:tasks.workunit.client.0.smithi170.stdout:9/517: rmdir d5/df/d2e/d77/d21/d46/d18/d6a 39 2024-01-25T15:03:42.101 INFO:tasks.workunit.client.0.smithi170.stdout:0/525: dwrite d8/d9/d9a/fa6 [0,4194304] 0 2024-01-25T15:03:42.101 INFO:tasks.workunit.client.0.smithi170.stdout:3/578: write d3/d10/d1e/d21/d41/d77/f4e [2232232,25581] 0 2024-01-25T15:03:42.101 INFO:tasks.workunit.client.0.smithi170.stdout:3/579: write d3/d2a/f5f [563569,20936] 0 2024-01-25T15:03:42.101 INFO:tasks.workunit.client.0.smithi170.stdout:3/580: fdatasync d3/d10/f1a 0 2024-01-25T15:03:42.101 INFO:tasks.workunit.client.0.smithi170.stdout:7/573: dwrite d8/d20/d2a/f5a [0,4194304] 0 2024-01-25T15:03:42.101 INFO:tasks.workunit.client.0.smithi170.stdout:5/551: rename d5/d54/d85/d2c/d51/f93 to d5/d54/d85/d2c/fc4 0 2024-01-25T15:03:42.102 INFO:tasks.workunit.client.0.smithi170.stdout:6/610: dwrite d2/d7/d23/d19/d2a/f55 [0,4194304] 0 2024-01-25T15:03:42.102 INFO:tasks.workunit.client.0.smithi170.stdout:1/542: symlink d0/d20/d28/d2a/d57/lb9 0 2024-01-25T15:03:42.107 INFO:tasks.workunit.client.0.smithi170.stdout:5/552: rename d5/d54/d85/d2c/d45/d5e to d5/d54/d85/d2c/d45/d56/d72/da0/dc5 0 2024-01-25T15:03:42.107 INFO:tasks.workunit.client.0.smithi170.stdout:5/553: write d5/d54/d85/d2c/f5f [160155,107533] 0 2024-01-25T15:03:42.109 INFO:tasks.workunit.client.0.smithi170.stdout:0/526: dread d8/d10/d2d/d2f/d4f/d5f/f8f [0,4194304] 0 2024-01-25T15:03:42.109 INFO:tasks.workunit.client.0.smithi170.stdout:0/527: creat d8/d10/d2d/d2f/fbc x:0 0 0 2024-01-25T15:03:42.113 INFO:tasks.workunit.client.0.smithi170.stdout:9/518: read d5/df/d2e/f7d [761763,76887] 0 2024-01-25T15:03:42.114 INFO:tasks.workunit.client.0.smithi170.stdout:3/581: truncate d3/d3b/f70 4002667 0 2024-01-25T15:03:42.115 INFO:tasks.workunit.client.0.smithi170.stdout:7/574: truncate d8/d20/d45/f46 3467053 0 2024-01-25T15:03:42.116 INFO:tasks.workunit.client.0.smithi170.stdout:2/573: mknod d10/d1e/d32/d63/cd0 0 2024-01-25T15:03:42.116 INFO:tasks.workunit.client.0.smithi170.stdout:2/574: fsync d10/d1e/d32/d3e/d41/dc4/dc6/f3b 0 2024-01-25T15:03:42.117 INFO:tasks.workunit.client.0.smithi170.stdout:6/611: mkdir d2/d7/d23/d19/d2a/d6b/dad/dd7 0 2024-01-25T15:03:42.121 INFO:tasks.workunit.client.0.smithi170.stdout:5/554: mkdir d5/d54/dc6 0 2024-01-25T15:03:42.122 INFO:tasks.workunit.client.0.smithi170.stdout:5/555: symlink d5/d54/d85/d2c/d45/d56/lc7 0 2024-01-25T15:03:42.124 INFO:tasks.workunit.client.0.smithi170.stdout:9/519: truncate d5/df/f15 759612 0 2024-01-25T15:03:42.127 INFO:tasks.workunit.client.0.smithi170.stdout:6/612: creat d2/d7/d23/d19/d2f/dd4/fd8 x:0 0 0 2024-01-25T15:03:42.128 INFO:tasks.workunit.client.0.smithi170.stdout:5/556: creat d5/d54/d85/fc8 x:0 0 0 2024-01-25T15:03:42.130 INFO:tasks.workunit.client.0.smithi170.stdout:2/575: mknod d10/d1e/d32/d63/cd1 0 2024-01-25T15:03:42.132 INFO:tasks.workunit.client.0.smithi170.stdout:1/543: getdents d0/d20/d3a/d6e 0 2024-01-25T15:03:42.133 INFO:tasks.workunit.client.0.smithi170.stdout:1/544: creat d0/d20/d28/d2a/d4a/d56/d5b/d72/fba x:0 0 0 2024-01-25T15:03:42.136 INFO:tasks.workunit.client.0.smithi170.stdout:1/545: getdents d0/d20/d28/d7b/da8 0 2024-01-25T15:03:42.141 INFO:tasks.workunit.client.0.smithi170.stdout:5/557: dread d5/d54/d85/f5c [0,4194304] 0 2024-01-25T15:03:42.141 INFO:tasks.workunit.client.0.smithi170.stdout:1/546: creat d0/d20/d3a/d6e/fbb x:0 0 0 2024-01-25T15:03:42.141 INFO:tasks.workunit.client.0.smithi170.stdout:1/547: fdatasync d0/d1b/fa1 0 2024-01-25T15:03:42.141 INFO:tasks.workunit.client.0.smithi170.stdout:7/575: dwrite d8/d20/d45/d68/d71/d8c/fd7 [0,4194304] 0 2024-01-25T15:03:42.142 INFO:tasks.workunit.client.0.smithi170.stdout:3/582: dwrite d3/fa [0,4194304] 0 2024-01-25T15:03:42.142 INFO:tasks.workunit.client.0.smithi170.stdout:5/558: mkdir d5/d54/d85/d2c/d45/d56/d72/da0/dc9 0 2024-01-25T15:03:42.145 INFO:tasks.workunit.client.0.smithi170.stdout:7/576: read d8/f1f [173164,93530] 0 2024-01-25T15:03:42.149 INFO:tasks.workunit.client.0.smithi170.stdout:6/613: dread d2/d7/d23/d19/d2a/fb2 [0,4194304] 0 2024-01-25T15:03:42.149 INFO:tasks.workunit.client.0.smithi170.stdout:9/520: link d5/df/d2e/f39 d5/df/d2e/d77/d21/d63/d96/fb8 0 2024-01-25T15:03:42.149 INFO:tasks.workunit.client.0.smithi170.stdout:9/521: creat d5/df/d2e/d77/d21/d34/d3e/d7f/fb9 x:0 0 0 2024-01-25T15:03:42.149 INFO:tasks.workunit.client.0.smithi170.stdout:9/522: truncate d5/df/f20 4217489 0 2024-01-25T15:03:42.151 INFO:tasks.workunit.client.0.smithi170.stdout:6/614: truncate d2/d7/d23/d19/d2a/d43/d44/f48 2125312 0 2024-01-25T15:03:42.155 INFO:tasks.workunit.client.0.smithi170.stdout:9/523: creat d5/df/d16/d52/fba x:0 0 0 2024-01-25T15:03:42.155 INFO:tasks.workunit.client.0.smithi170.stdout:2/576: dwrite d10/d1e/d5e/d73/d9e/da3/fb8 [0,4194304] 0 2024-01-25T15:03:42.155 INFO:tasks.workunit.client.0.smithi170.stdout:2/577: creat d10/d1e/d32/d3e/fd2 x:0 0 0 2024-01-25T15:03:42.156 INFO:tasks.workunit.client.0.smithi170.stdout:8/538: sync 2024-01-25T15:03:42.156 INFO:tasks.workunit.client.0.smithi170.stdout:8/539: read - d3/f42 zero size 2024-01-25T15:03:42.156 INFO:tasks.workunit.client.0.smithi170.stdout:8/540: dread - d3/d7/d22/d23/d48/f65 zero size 2024-01-25T15:03:42.157 INFO:tasks.workunit.client.0.smithi170.stdout:1/548: dread d0/d20/d28/f6c [0,4194304] 0 2024-01-25T15:03:42.157 INFO:tasks.workunit.client.0.smithi170.stdout:1/549: write d0/d20/f2b [807114,12782] 0 2024-01-25T15:03:42.157 INFO:tasks.workunit.client.0.smithi170.stdout:3/583: rename d3/d1c/d2d/l51 to d3/d1c/d2d/lb5 0 2024-01-25T15:03:42.157 INFO:tasks.workunit.client.0.smithi170.stdout:9/524: dread d5/dc/f30 [0,4194304] 0 2024-01-25T15:03:42.158 INFO:tasks.workunit.client.0.smithi170.stdout:6/615: mkdir d2/d7/dd9 0 2024-01-25T15:03:42.159 INFO:tasks.workunit.client.0.smithi170.stdout:1/550: symlink d0/d20/d28/d2a/d4a/d56/d5b/d72/lbc 0 2024-01-25T15:03:42.159 INFO:tasks.workunit.client.0.smithi170.stdout:1/551: creat d0/d2e/fbd x:0 0 0 2024-01-25T15:03:42.160 INFO:tasks.workunit.client.0.smithi170.stdout:2/578: getdents d10/d1e/d32/d3e/d41/dc4/dc6/d42 0 2024-01-25T15:03:42.161 INFO:tasks.workunit.client.0.smithi170.stdout:7/577: write d8/d20/d3b/d4d/f78 [2306524,58355] 0 2024-01-25T15:03:42.161 INFO:tasks.workunit.client.0.smithi170.stdout:8/541: creat d3/d7/fb4 x:0 0 0 2024-01-25T15:03:42.162 INFO:tasks.workunit.client.0.smithi170.stdout:3/584: symlink d3/d10/d13/d1b/d81/lb6 0 2024-01-25T15:03:42.162 INFO:tasks.workunit.client.0.smithi170.stdout:3/585: fdatasync d3/d10/d13/d1b/d81/f8d 0 2024-01-25T15:03:42.164 INFO:tasks.workunit.client.0.smithi170.stdout:9/525: symlink d5/df/d16/d35/lbb 0 2024-01-25T15:03:42.165 INFO:tasks.workunit.client.0.smithi170.stdout:6/616: mkdir d2/d7/d23/d19/d2f/d74/dc1/dcf/dda 0 2024-01-25T15:03:42.167 INFO:tasks.workunit.client.0.smithi170.stdout:1/552: mkdir d0/d20/d28/d2a/d4a/dbe 0 2024-01-25T15:03:42.167 INFO:tasks.workunit.client.0.smithi170.stdout:5/559: dwrite d5/d54/d85/f19 [4194304,4194304] 0 2024-01-25T15:03:42.167 INFO:tasks.workunit.client.0.smithi170.stdout:8/542: symlink d3/d7/d22/d23/d25/d34/lb5 0 2024-01-25T15:03:42.168 INFO:tasks.workunit.client.0.smithi170.stdout:3/586: mkdir d3/d10/d13/d1b/d29/db7 0 2024-01-25T15:03:42.171 INFO:tasks.workunit.client.0.smithi170.stdout:9/526: unlink d5/dc/f2c 0 2024-01-25T15:03:42.171 INFO:tasks.workunit.client.0.smithi170.stdout:2/579: dread d10/d1e/d32/f38 [0,4194304] 0 2024-01-25T15:03:42.171 INFO:tasks.workunit.client.0.smithi170.stdout:2/580: truncate d10/d1b/d5f/f7d 1736062 0 2024-01-25T15:03:42.171 INFO:tasks.workunit.client.0.smithi170.stdout:9/527: write d5/df/d2e/d77/f82 [161559,12947] 0 2024-01-25T15:03:42.171 INFO:tasks.workunit.client.0.smithi170.stdout:6/617: mkdir d2/ddb 0 2024-01-25T15:03:42.171 INFO:tasks.workunit.client.0.smithi170.stdout:6/618: read - d2/d7/d23/d19/d2f/f9a zero size 2024-01-25T15:03:42.175 INFO:tasks.workunit.client.0.smithi170.stdout:2/581: mknod d10/d1b/d5f/cd3 0 2024-01-25T15:03:42.179 INFO:tasks.workunit.client.0.smithi170.stdout:8/543: write d3/d7/d22/f5a [794288,52387] 0 2024-01-25T15:03:42.180 INFO:tasks.workunit.client.0.smithi170.stdout:1/553: getdents d0/d2e 0 2024-01-25T15:03:42.180 INFO:tasks.workunit.client.0.smithi170.stdout:1/554: chown d0/d20/d28/l9a 593108999 1 2024-01-25T15:03:42.180 INFO:tasks.workunit.client.0.smithi170.stdout:1/555: readlink d0/d2e/lac 0 2024-01-25T15:03:42.181 INFO:tasks.workunit.client.0.smithi170.stdout:6/619: write d2/d7/d23/d19/d2a/d43/d44/f66 [5559308,26482] 0 2024-01-25T15:03:42.181 INFO:tasks.workunit.client.0.smithi170.stdout:6/620: chown d2/d7/d23/d19/d2f 95 1 2024-01-25T15:03:42.181 INFO:tasks.workunit.client.0.smithi170.stdout:3/587: rmdir d3/d10/d13/d1b/d29 39 2024-01-25T15:03:42.182 INFO:tasks.workunit.client.0.smithi170.stdout:2/582: unlink d10/d1e/l43 0 2024-01-25T15:03:42.182 INFO:tasks.workunit.client.0.smithi170.stdout:2/583: dread - d10/d1e/d32/d62/d74/fb4 zero size 2024-01-25T15:03:42.184 INFO:tasks.workunit.client.0.smithi170.stdout:5/560: dread d5/d2a/f4a [0,4194304] 0 2024-01-25T15:03:42.186 INFO:tasks.workunit.client.0.smithi170.stdout:8/544: getdents d3/d7/d22/d23/d48/d52 0 2024-01-25T15:03:42.187 INFO:tasks.workunit.client.0.smithi170.stdout:1/556: mknod d0/d20/d28/d2a/cbf 0 2024-01-25T15:03:42.188 INFO:tasks.workunit.client.0.smithi170.stdout:1/557: dread d0/d20/d28/d2a/d4a/d56/f64 [4194304,4194304] 0 2024-01-25T15:03:42.189 INFO:tasks.workunit.client.0.smithi170.stdout:6/621: unlink d2/d7/d1b/f95 0 2024-01-25T15:03:42.191 INFO:tasks.workunit.client.0.smithi170.stdout:3/588: creat d3/d10/d13/d1b/d85/fb8 x:0 0 0 2024-01-25T15:03:42.192 INFO:tasks.workunit.client.0.smithi170.stdout:2/584: truncate d10/d1e/d5e/d73/d9e/da3/fb3 2909440 0 2024-01-25T15:03:42.194 INFO:tasks.workunit.client.0.smithi170.stdout:8/545: getdents d3/d7/d3a/d85 0 2024-01-25T15:03:42.202 INFO:tasks.workunit.client.0.smithi170.stdout:5/561: dread d5/d2a/f8d [0,4194304] 0 2024-01-25T15:03:42.202 INFO:tasks.workunit.client.0.smithi170.stdout:1/558: mkdir d0/d50/dc0 0 2024-01-25T15:03:42.202 INFO:tasks.workunit.client.0.smithi170.stdout:6/622: symlink d2/d7/d1b/ldc 0 2024-01-25T15:03:42.202 INFO:tasks.workunit.client.0.smithi170.stdout:1/559: truncate d0/d20/fb1 186048 0 2024-01-25T15:03:42.202 INFO:tasks.workunit.client.0.smithi170.stdout:8/546: mknod d3/d7/d22/d23/d48/cb6 0 2024-01-25T15:03:42.202 INFO:tasks.workunit.client.0.smithi170.stdout:8/547: truncate d3/d7/d1e/d7c/f97 760414 0 2024-01-25T15:03:42.202 INFO:tasks.workunit.client.0.smithi170.stdout:3/589: truncate d3/d10/fe 3448272 0 2024-01-25T15:03:42.204 INFO:tasks.workunit.client.0.smithi170.stdout:5/562: link d5/d54/d85/f50 d5/d58/da9/fca 0 2024-01-25T15:03:42.206 INFO:tasks.workunit.client.0.smithi170.stdout:5/563: truncate d5/d54/d85/d3f/faa 2049886 0 2024-01-25T15:03:42.206 INFO:tasks.workunit.client.0.smithi170.stdout:1/560: rename d0/d20/d28/d2a/d4a/d56/d81 to d0/d20/d28/d2a/d4a/d56/dc1 0 2024-01-25T15:03:42.206 INFO:tasks.workunit.client.0.smithi170.stdout:1/561: fsync d0/f5 0 2024-01-25T15:03:42.206 INFO:tasks.workunit.client.0.smithi170.stdout:1/562: getdents d0/d20/d3a/dad 0 2024-01-25T15:03:42.209 INFO:tasks.workunit.client.0.smithi170.stdout:8/548: creat d3/d7/d22/d23/d25/d41/d61/fb7 x:0 0 0 2024-01-25T15:03:42.211 INFO:tasks.workunit.client.0.smithi170.stdout:5/564: symlink d5/db9/lcb 0 2024-01-25T15:03:42.212 INFO:tasks.workunit.client.0.smithi170.stdout:5/565: chown d5/d54/d85/d2c/d45/d56/d72/da0/dc5/f63 173384548 1 2024-01-25T15:03:42.212 INFO:tasks.workunit.client.0.smithi170.stdout:5/566: stat d5/l7f 0 2024-01-25T15:03:42.212 INFO:tasks.workunit.client.0.smithi170.stdout:5/567: readlink d5/db9/lcb 0 2024-01-25T15:03:42.215 INFO:tasks.workunit.client.0.smithi170.stdout:8/549: mkdir d3/d7/d22/d23/d25/d41/d9a/db8 0 2024-01-25T15:03:42.215 INFO:tasks.workunit.client.0.smithi170.stdout:1/563: dread d0/d20/d3a/f53 [0,4194304] 0 2024-01-25T15:03:42.215 INFO:tasks.workunit.client.0.smithi170.stdout:1/564: dread - d0/d20/d3a/f5a zero size 2024-01-25T15:03:42.216 INFO:tasks.workunit.client.0.smithi170.stdout:2/585: dwrite f6 [0,4194304] 0 2024-01-25T15:03:42.226 INFO:tasks.workunit.client.0.smithi170.stdout:8/550: dread d3/d7/d1e/f5e [0,4194304] 0 2024-01-25T15:03:42.227 INFO:tasks.workunit.client.0.smithi170.stdout:8/551: chown d3/d7/c14 247793 1 2024-01-25T15:03:42.227 INFO:tasks.workunit.client.0.smithi170.stdout:8/552: write d3/d7/d22/d23/d25/d41/d61/fb7 [201309,24220] 0 2024-01-25T15:03:42.227 INFO:tasks.workunit.client.0.smithi170.stdout:3/590: dwrite d3/d10/d1e/d96/f9e [0,4194304] 0 2024-01-25T15:03:42.227 INFO:tasks.workunit.client.0.smithi170.stdout:3/591: stat d3/d2a/d53 0 2024-01-25T15:03:42.229 INFO:tasks.workunit.client.0.smithi170.stdout:7/578: rename d8/d20/d2a/d61/f77 to d8/d20/d2a/d35/d55/d6e/fd8 0 2024-01-25T15:03:42.232 INFO:tasks.workunit.client.0.smithi170.stdout:6/623: rename d2/d7/d23/d19/f29 to d2/d7/d23/d19/d60/fdd 0 2024-01-25T15:03:42.235 INFO:tasks.workunit.client.0.smithi170.stdout:4/471: sync 2024-01-25T15:03:42.235 INFO:tasks.workunit.client.0.smithi170.stdout:3/592: rename d3/d10/d1e/d21/d41/fb0 to d3/d10/d1e/d21/d41/d4a/fb9 0 2024-01-25T15:03:42.235 INFO:tasks.workunit.client.0.smithi170.stdout:3/593: fsync d3/d10/f14 0 2024-01-25T15:03:42.238 INFO:tasks.workunit.client.0.smithi170.stdout:8/553: read d3/d7/d22/d5d/f6e [3117495,1624] 0 2024-01-25T15:03:42.239 INFO:tasks.workunit.client.0.smithi170.stdout:4/472: symlink d6/d7/d31/l8d 0 2024-01-25T15:03:42.240 INFO:tasks.workunit.client.0.smithi170.stdout:3/594: mknod d3/d1c/cba 0 2024-01-25T15:03:42.240 INFO:tasks.workunit.client.0.smithi170.stdout:3/595: write d3/d10/d1e/d21/d41/d77/f76 [757593,3718] 0 2024-01-25T15:03:42.240 INFO:tasks.workunit.client.0.smithi170.stdout:3/596: write d3/d10/d1e/d21/d41/d77/f76 [1664086,21357] 0 2024-01-25T15:03:42.240 INFO:tasks.workunit.client.0.smithi170.stdout:3/597: fsync d3/d2a/f5f 0 2024-01-25T15:03:42.241 INFO:tasks.workunit.client.0.smithi170.stdout:8/554: creat d3/d7/d22/d23/d48/d52/d47/d86/fb9 x:0 0 0 2024-01-25T15:03:42.241 INFO:tasks.workunit.client.0.smithi170.stdout:4/473: getdents d6/d7/d31/d46 0 2024-01-25T15:03:42.241 INFO:tasks.workunit.client.0.smithi170.stdout:4/474: chown d6/d28/f52 10875 1 2024-01-25T15:03:42.242 INFO:tasks.workunit.client.0.smithi170.stdout:3/598: mknod d3/d3b/cbb 0 2024-01-25T15:03:42.244 INFO:tasks.workunit.client.0.smithi170.stdout:8/555: rmdir d3/d7/d22/d23/d25/d41/da4 0 2024-01-25T15:03:42.244 INFO:tasks.workunit.client.0.smithi170.stdout:8/556: write d3/d7/d3a/d91/f7b [138109,114817] 0 2024-01-25T15:03:42.244 INFO:tasks.workunit.client.0.smithi170.stdout:2/586: dwrite d10/d1e/d32/d3e/d5c/d92/d8b/fb2 [0,4194304] 0 2024-01-25T15:03:42.245 INFO:tasks.workunit.client.0.smithi170.stdout:1/565: dwrite d0/d20/d28/d7b/f8a [0,4194304] 0 2024-01-25T15:03:42.245 INFO:tasks.workunit.client.0.smithi170.stdout:3/599: mknod d3/d1c/d2b/d5c/cbc 0 2024-01-25T15:03:42.245 INFO:tasks.workunit.client.0.smithi170.stdout:3/600: chown d3/d10/d1e/lb2 2 1 2024-01-25T15:03:42.247 INFO:tasks.workunit.client.0.smithi170.stdout:2/587: mkdir d10/d1e/d32/d98/d99/dd4 0 2024-01-25T15:03:42.247 INFO:tasks.workunit.client.0.smithi170.stdout:2/588: chown d10/l3d 657 1 2024-01-25T15:03:42.247 INFO:tasks.workunit.client.0.smithi170.stdout:8/557: dread d3/d7/d22/d23/d25/f5c [0,4194304] 0 2024-01-25T15:03:42.247 INFO:tasks.workunit.client.0.smithi170.stdout:8/558: write d3/d7/d22/f5a [2616159,78490] 0 2024-01-25T15:03:42.249 INFO:tasks.workunit.client.0.smithi170.stdout:3/601: mknod d3/d3b/d4f/da0/cbd 0 2024-01-25T15:03:42.249 INFO:tasks.workunit.client.0.smithi170.stdout:3/602: dread - d3/d1c/fb4 zero size 2024-01-25T15:03:42.251 INFO:tasks.workunit.client.0.smithi170.stdout:8/559: rename d3/d7/d22/d23/d25/d41/d9a/db8 to d3/d7/d73/dba 0 2024-01-25T15:03:42.255 INFO:tasks.workunit.client.0.smithi170.stdout:8/560: unlink d3/d7/d22/d23/l2e 0 2024-01-25T15:03:42.256 INFO:tasks.workunit.client.0.smithi170.stdout:8/561: symlink d3/d7/d73/dba/lbb 0 2024-01-25T15:03:42.256 INFO:tasks.workunit.client.0.smithi170.stdout:8/562: creat d3/d7/d22/d23/d48/d52/d47/fbc x:0 0 0 2024-01-25T15:03:42.257 INFO:tasks.workunit.client.0.smithi170.stdout:2/589: dread d10/d1e/d32/d3e/d41/dc4/dc6/f7c [0,4194304] 0 2024-01-25T15:03:42.258 INFO:tasks.workunit.client.0.smithi170.stdout:8/563: unlink d3/d7/d22/d23/f54 0 2024-01-25T15:03:42.258 INFO:tasks.workunit.client.0.smithi170.stdout:2/590: mkdir d10/d1b/db6/dd5 0 2024-01-25T15:03:42.261 INFO:tasks.workunit.client.0.smithi170.stdout:2/591: getdents d10/d1e/d32/d98/d99 0 2024-01-25T15:03:42.263 INFO:tasks.workunit.client.0.smithi170.stdout:2/592: unlink d10/d1b/f75 0 2024-01-25T15:03:42.263 INFO:tasks.workunit.client.0.smithi170.stdout:2/593: write d10/d1e/d32/d3e/d41/dc4/dc6/f23 [13540,115353] 0 2024-01-25T15:03:42.269 INFO:tasks.workunit.client.0.smithi170.stdout:3/603: dread d3/d10/d1e/d21/d41/d77/f4e [0,4194304] 0 2024-01-25T15:03:42.270 INFO:tasks.workunit.client.0.smithi170.stdout:1/566: dwrite d0/f12 [0,4194304] 0 2024-01-25T15:03:42.271 INFO:tasks.workunit.client.0.smithi170.stdout:1/567: creat d0/d20/d28/d2a/d4a/d56/dc1/fc2 x:0 0 0 2024-01-25T15:03:42.279 INFO:tasks.workunit.client.0.smithi170.stdout:8/564: dwrite d3/f42 [0,4194304] 0 2024-01-25T15:03:42.281 INFO:tasks.workunit.client.0.smithi170.stdout:8/565: mkdir d3/d7/d22/dbd 0 2024-01-25T15:03:42.283 INFO:tasks.workunit.client.0.smithi170.stdout:8/566: unlink d3/d7/d1e/d7c/f97 0 2024-01-25T15:03:42.283 INFO:tasks.workunit.client.0.smithi170.stdout:8/567: creat d3/d7/d1e/fbe x:0 0 0 2024-01-25T15:03:42.291 INFO:tasks.workunit.client.0.smithi170.stdout:8/568: dread d3/d7/f10 [0,4194304] 0 2024-01-25T15:03:42.292 INFO:tasks.workunit.client.0.smithi170.stdout:8/569: creat d3/d7/d3a/d91/d7f/fbf x:0 0 0 2024-01-25T15:03:42.292 INFO:tasks.workunit.client.0.smithi170.stdout:8/570: fsync d3/d7/d22/d23/d25/f5c 0 2024-01-25T15:03:42.292 INFO:tasks.workunit.client.0.smithi170.stdout:3/604: dwrite d3/d1c/f24 [0,4194304] 0 2024-01-25T15:03:42.293 INFO:tasks.workunit.client.0.smithi170.stdout:8/571: unlink d3/d7/d3a/d85/c7e 0 2024-01-25T15:03:42.294 INFO:tasks.workunit.client.0.smithi170.stdout:3/605: mknod d3/d10/d1e/d21/d41/d4b/d63/cbe 0 2024-01-25T15:03:42.295 INFO:tasks.workunit.client.0.smithi170.stdout:8/572: creat d3/d7/d3a/d8d/db3/fc0 x:0 0 0 2024-01-25T15:03:42.296 INFO:tasks.workunit.client.0.smithi170.stdout:3/606: creat d3/d10/d1e/fbf x:0 0 0 2024-01-25T15:03:42.299 INFO:tasks.workunit.client.0.smithi170.stdout:3/607: rename d3/d10/d13/d1b/d29/fa3 to d3/d1c/d2b/d5c/d97/dab/fc0 0 2024-01-25T15:03:42.301 INFO:tasks.workunit.client.0.smithi170.stdout:8/573: rmdir d3/d7/d3a 39 2024-01-25T15:03:42.302 INFO:tasks.workunit.client.0.smithi170.stdout:8/574: write d3/d7/f15 [891979,32042] 0 2024-01-25T15:03:42.303 INFO:tasks.workunit.client.0.smithi170.stdout:3/608: creat d3/d1c/d2b/fc1 x:0 0 0 2024-01-25T15:03:42.311 INFO:tasks.workunit.client.0.smithi170.stdout:0/528: sync 2024-01-25T15:03:42.312 INFO:tasks.workunit.client.0.smithi170.stdout:3/609: read d3/d10/d1e/d96/f7b [3372938,40962] 0 2024-01-25T15:03:42.312 INFO:tasks.workunit.client.0.smithi170.stdout:3/610: truncate d3/d2a/fa1 1032623 0 2024-01-25T15:03:42.312 INFO:tasks.workunit.client.0.smithi170.stdout:3/611: dread - d3/d1c/fb4 zero size 2024-01-25T15:03:42.313 INFO:tasks.workunit.client.0.smithi170.stdout:3/612: chown d3/d10/d1e/d21/d41/d4a/f75 0 1 2024-01-25T15:03:42.314 INFO:tasks.workunit.client.0.smithi170.stdout:8/575: rmdir d3/d7 39 2024-01-25T15:03:42.315 INFO:tasks.workunit.client.0.smithi170.stdout:0/529: getdents d8/d10/d2d/d82 0 2024-01-25T15:03:42.316 INFO:tasks.workunit.client.0.smithi170.stdout:3/613: symlink d3/d10/d6d/d98/lc2 0 2024-01-25T15:03:42.318 INFO:tasks.workunit.client.0.smithi170.stdout:8/576: mknod d3/d7/d22/d23/d25/d41/d9a/cc1 0 2024-01-25T15:03:42.319 INFO:tasks.workunit.client.0.smithi170.stdout:0/530: truncate d8/d80/f91 2335538 0 2024-01-25T15:03:42.319 INFO:tasks.workunit.client.0.smithi170.stdout:0/531: dread - d8/d10/d2d/d58/fa5 zero size 2024-01-25T15:03:42.320 INFO:tasks.workunit.client.0.smithi170.stdout:8/577: creat d3/d7/d1e/d7c/d9f/fc2 x:0 0 0 2024-01-25T15:03:42.320 INFO:tasks.workunit.client.0.smithi170.stdout:8/578: chown d3/d7/d22/c58 3 1 2024-01-25T15:03:42.321 INFO:tasks.workunit.client.0.smithi170.stdout:8/579: getdents d3/d7/d3a/d85 0 2024-01-25T15:03:42.323 INFO:tasks.workunit.client.0.smithi170.stdout:8/580: truncate d3/f72 2175591 0 2024-01-25T15:03:42.323 INFO:tasks.workunit.client.0.smithi170.stdout:8/581: fsync d3/d7/d22/d23/f4a 0 2024-01-25T15:03:42.323 INFO:tasks.workunit.client.0.smithi170.stdout:8/582: dread - d3/d7/d22/fa8 zero size 2024-01-25T15:03:42.323 INFO:tasks.workunit.client.0.smithi170.stdout:8/583: dread - d3/d7/d22/d5d/fa3 zero size 2024-01-25T15:03:42.323 INFO:tasks.workunit.client.0.smithi170.stdout:8/584: write d3/d7/d22/d23/d48/d52/f43 [1375789,18500] 0 2024-01-25T15:03:42.324 INFO:tasks.workunit.client.0.smithi170.stdout:3/614: dread d3/d10/d6d/faa [0,4194304] 0 2024-01-25T15:03:42.325 INFO:tasks.workunit.client.0.smithi170.stdout:8/585: link d3/d7/d3a/f78 d3/d7/d1e/fc3 0 2024-01-25T15:03:42.325 INFO:tasks.workunit.client.0.smithi170.stdout:8/586: chown d3/d7/d3a/d91 727 1 2024-01-25T15:03:42.325 INFO:tasks.workunit.client.0.smithi170.stdout:8/587: truncate d3/d7/d3a/d91/d7f/fbf 606217 0 2024-01-25T15:03:42.326 INFO:tasks.workunit.client.0.smithi170.stdout:3/615: truncate d3/d1c/f24 16599 0 2024-01-25T15:03:42.329 INFO:tasks.workunit.client.0.smithi170.stdout:8/588: creat d3/d7/d22/d23/d25/d41/da9/fc4 x:0 0 0 2024-01-25T15:03:42.329 INFO:tasks.workunit.client.0.smithi170.stdout:8/589: getdents d3/d7/d22/d5d 0 2024-01-25T15:03:42.329 INFO:tasks.workunit.client.0.smithi170.stdout:8/590: write d3/d7/d73/fb1 [987310,52005] 0 2024-01-25T15:03:42.329 INFO:tasks.workunit.client.0.smithi170.stdout:8/591: dread - d3/d7/d22/d23/d48/f65 zero size 2024-01-25T15:03:42.330 INFO:tasks.workunit.client.0.smithi170.stdout:3/616: mkdir d3/d10/d1e/d21/d41/d4a/dc3 0 2024-01-25T15:03:42.331 INFO:tasks.workunit.client.0.smithi170.stdout:8/592: symlink d3/d7/d3a/d91/lc5 0 2024-01-25T15:03:42.331 INFO:tasks.workunit.client.0.smithi170.stdout:8/593: write d3/d7/d1e/f71 [558297,68839] 0 2024-01-25T15:03:42.333 INFO:tasks.workunit.client.0.smithi170.stdout:3/617: rename d3/d3b/cbb to d3/d10/cc4 0 2024-01-25T15:03:42.336 INFO:tasks.workunit.client.0.smithi170.stdout:3/618: getdents d3/d1c/d2b 0 2024-01-25T15:03:42.341 INFO:tasks.workunit.client.0.smithi170.stdout:0/532: dwrite d8/d10/d2d/d2f/d4f/da2/fb1 [4194304,4194304] 0 2024-01-25T15:03:42.344 INFO:tasks.workunit.client.0.smithi170.stdout:0/533: mkdir d8/d9/d9a/dbd 0 2024-01-25T15:03:42.344 INFO:tasks.workunit.client.0.smithi170.stdout:0/534: write d8/d18/f3b [227774,57082] 0 2024-01-25T15:03:42.345 INFO:tasks.workunit.client.0.smithi170.stdout:3/619: write d3/d10/d1e/d21/d41/d4b/d63/f84 [66210,45265] 0 2024-01-25T15:03:42.346 INFO:tasks.workunit.client.0.smithi170.stdout:0/535: link d8/d18/l93 d8/d10/d2d/d2f/d4f/d5f/lbe 0 2024-01-25T15:03:42.347 INFO:tasks.workunit.client.0.smithi170.stdout:3/620: mknod d3/d10/d1e/cc5 0 2024-01-25T15:03:42.348 INFO:tasks.workunit.client.0.smithi170.stdout:3/621: truncate d3/d10/fac 361537 0 2024-01-25T15:03:42.356 INFO:tasks.workunit.client.0.smithi170.stdout:8/594: dwrite d3/d7/d22/d23/f4a [4194304,4194304] 0 2024-01-25T15:03:42.356 INFO:tasks.workunit.client.0.smithi170.stdout:8/595: truncate d3/d7/d22/d23/d25/d41/fad 792415 0 2024-01-25T15:03:42.360 INFO:tasks.workunit.client.0.smithi170.stdout:8/596: symlink d3/d7/d1e/d7c/lc6 0 2024-01-25T15:03:42.361 INFO:tasks.workunit.client.0.smithi170.stdout:8/597: mknod d3/d7/d22/d23/d48/cc7 0 2024-01-25T15:03:42.361 INFO:tasks.workunit.client.0.smithi170.stdout:8/598: fsync d3/d7/d3a/d91/d7f/f8c 0 2024-01-25T15:03:42.365 INFO:tasks.workunit.client.0.smithi170.stdout:5/568: sync 2024-01-25T15:03:42.365 INFO:tasks.workunit.client.0.smithi170.stdout:9/528: sync 2024-01-25T15:03:42.365 INFO:tasks.workunit.client.0.smithi170.stdout:5/569: stat d5/d54/d85/d2c/d51/d96 0 2024-01-25T15:03:42.365 INFO:tasks.workunit.client.0.smithi170.stdout:5/570: chown d5/d54/d85/d2c/d51/d3d/c9c 251372070 1 2024-01-25T15:03:42.370 INFO:tasks.workunit.client.0.smithi170.stdout:0/536: dwrite d8/d3e/fba [0,4194304] 0 2024-01-25T15:03:42.370 INFO:tasks.workunit.client.0.smithi170.stdout:0/537: readlink d8/d10/d2d/d82/l9c 0 2024-01-25T15:03:42.370 INFO:tasks.workunit.client.0.smithi170.stdout:0/538: write d8/d18/f3b [1748626,31364] 0 2024-01-25T15:03:42.370 INFO:tasks.workunit.client.0.smithi170.stdout:0/539: dread - d8/d10/d2d/d58/f9f zero size 2024-01-25T15:03:42.373 INFO:tasks.workunit.client.0.smithi170.stdout:0/540: symlink d8/d10/d77/lbf 0 2024-01-25T15:03:42.373 INFO:tasks.workunit.client.0.smithi170.stdout:0/541: truncate d8/d10/d2d/d2f/d4f/d5f/fb2 1357125 0 2024-01-25T15:03:42.374 INFO:tasks.workunit.client.0.smithi170.stdout:0/542: rmdir d8/d10 39 2024-01-25T15:03:42.374 INFO:tasks.workunit.client.0.smithi170.stdout:0/543: chown d8/d10/d2d/d89/f8d 7667 1 2024-01-25T15:03:42.374 INFO:tasks.workunit.client.0.smithi170.stdout:0/544: fdatasync d8/d80/f91 0 2024-01-25T15:03:42.377 INFO:tasks.workunit.client.0.smithi170.stdout:0/545: write d8/d18/fa4 [866538,37365] 0 2024-01-25T15:03:42.377 INFO:tasks.workunit.client.0.smithi170.stdout:9/529: read d5/df/d2e/f39 [4694363,88818] 0 2024-01-25T15:03:42.378 INFO:tasks.workunit.client.0.smithi170.stdout:9/530: chown d5/df/d2e/d77/f57 9 1 2024-01-25T15:03:42.378 INFO:tasks.workunit.client.0.smithi170.stdout:0/546: creat d8/d10/d77/fc0 x:0 0 0 2024-01-25T15:03:42.381 INFO:tasks.workunit.client.0.smithi170.stdout:9/531: mknod d5/df/d2e/d77/cbc 0 2024-01-25T15:03:42.381 INFO:tasks.workunit.client.0.smithi170.stdout:9/532: write d5/df/d16/d35/d3c/d56/d59/fb7 [705019,37155] 0 2024-01-25T15:03:42.381 INFO:tasks.workunit.client.0.smithi170.stdout:8/599: dwrite d3/d7/fa5 [0,4194304] 0 2024-01-25T15:03:42.382 INFO:tasks.workunit.client.0.smithi170.stdout:0/547: dread d8/d80/f91 [0,4194304] 0 2024-01-25T15:03:42.382 INFO:tasks.workunit.client.0.smithi170.stdout:9/533: mknod d5/df/d2e/d6b/cbd 0 2024-01-25T15:03:42.382 INFO:tasks.workunit.client.0.smithi170.stdout:0/548: write d8/d10/f15 [782104,99305] 0 2024-01-25T15:03:42.385 INFO:tasks.workunit.client.0.smithi170.stdout:5/571: dwrite d5/d54/d85/d2c/d45/d56/d72/fbf [0,4194304] 0 2024-01-25T15:03:42.386 INFO:tasks.workunit.client.0.smithi170.stdout:8/600: rename d3/d7/d22/d23/d25/d8e/ca6 to d3/cc8 0 2024-01-25T15:03:42.389 INFO:tasks.workunit.client.0.smithi170.stdout:0/549: unlink d8/d9/d9a/c6f 0 2024-01-25T15:03:42.390 INFO:tasks.workunit.client.0.smithi170.stdout:8/601: mknod d3/d7/d3a/d91/d7f/cc9 0 2024-01-25T15:03:42.392 INFO:tasks.workunit.client.0.smithi170.stdout:9/534: mknod d5/df/d2e/d77/cbe 0 2024-01-25T15:03:42.392 INFO:tasks.workunit.client.0.smithi170.stdout:9/535: creat d5/df/d16/d35/d3c/fbf x:0 0 0 2024-01-25T15:03:42.392 INFO:tasks.workunit.client.0.smithi170.stdout:5/572: rmdir d5/d54/d85/d2c/d45/d56/d72/da0/dc5/dae 0 2024-01-25T15:03:42.392 INFO:tasks.workunit.client.0.smithi170.stdout:5/573: read d5/d2a/f3e [295054,123122] 0 2024-01-25T15:03:42.394 INFO:tasks.workunit.client.0.smithi170.stdout:9/536: unlink d5/df/d16/d35/l6d 0 2024-01-25T15:03:42.396 INFO:tasks.workunit.client.0.smithi170.stdout:0/550: rename d8/d9/f29 to d8/d80/fc1 0 2024-01-25T15:03:42.396 INFO:tasks.workunit.client.0.smithi170.stdout:0/551: chown d8/d18/f4d 146732793 1 2024-01-25T15:03:42.396 INFO:tasks.workunit.client.0.smithi170.stdout:9/537: mkdir d5/df/d2e/d77/d21/d46/d18/dc0 0 2024-01-25T15:03:42.397 INFO:tasks.workunit.client.0.smithi170.stdout:8/602: rename d3/d7/d22/d5d/l63 to d3/d7/d22/d23/lca 0 2024-01-25T15:03:42.398 INFO:tasks.workunit.client.0.smithi170.stdout:9/538: mkdir d5/df/d16/dc1 0 2024-01-25T15:03:42.402 INFO:tasks.workunit.client.0.smithi170.stdout:8/603: dread d3/f72 [0,4194304] 0 2024-01-25T15:03:42.403 INFO:tasks.workunit.client.0.smithi170.stdout:8/604: symlink d3/d7/d22/d80/lcb 0 2024-01-25T15:03:42.404 INFO:tasks.workunit.client.0.smithi170.stdout:8/605: creat d3/d7/d73/dba/fcc x:0 0 0 2024-01-25T15:03:42.404 INFO:tasks.workunit.client.0.smithi170.stdout:8/606: getdents d3/d7/d3a/d91 0 2024-01-25T15:03:42.405 INFO:tasks.workunit.client.0.smithi170.stdout:8/607: fsync d3/d7/d73/fb1 0 2024-01-25T15:03:42.410 INFO:tasks.workunit.client.0.smithi170.stdout:0/552: dread d8/d9/f56 [0,4194304] 0 2024-01-25T15:03:42.413 INFO:tasks.workunit.client.0.smithi170.stdout:5/574: dwrite d5/d54/d85/d2c/d51/d3d/fad [0,4194304] 0 2024-01-25T15:03:42.413 INFO:tasks.workunit.client.0.smithi170.stdout:5/575: dread - d5/d54/fb7 zero size 2024-01-25T15:03:42.415 INFO:tasks.workunit.client.0.smithi170.stdout:5/576: symlink d5/d54/d85/d3f/lcc 0 2024-01-25T15:03:42.420 INFO:tasks.workunit.client.0.smithi170.stdout:5/577: creat d5/d58/fcd x:0 0 0 2024-01-25T15:03:42.420 INFO:tasks.workunit.client.0.smithi170.stdout:5/578: getdents d5/d54/d85/d2c/d51/d96 0 2024-01-25T15:03:42.421 INFO:tasks.workunit.client.0.smithi170.stdout:9/539: dwrite d5/df/d16/d35/d3c/d56/d59/d5e/f97 [0,4194304] 0 2024-01-25T15:03:42.423 INFO:tasks.workunit.client.0.smithi170.stdout:8/608: dread d3/d7/d3a/f3f [0,4194304] 0 2024-01-25T15:03:42.429 INFO:tasks.workunit.client.0.smithi170.stdout:0/553: write d8/d10/f36 [1627474,130423] 0 2024-01-25T15:03:42.430 INFO:tasks.workunit.client.0.smithi170.stdout:9/540: mknod d5/df/d16/d35/d3c/d91/cc2 0 2024-01-25T15:03:42.432 INFO:tasks.workunit.client.0.smithi170.stdout:9/541: mknod d5/df/d2e/db0/cc3 0 2024-01-25T15:03:42.433 INFO:tasks.workunit.client.0.smithi170.stdout:5/579: write d5/d54/d85/f1c [2554312,21809] 0 2024-01-25T15:03:42.435 INFO:tasks.workunit.client.0.smithi170.stdout:8/609: write d3/d7/f56 [3428416,112911] 0 2024-01-25T15:03:42.435 INFO:tasks.workunit.client.0.smithi170.stdout:8/610: readlink d3/d7/d73/dba/lbb 0 2024-01-25T15:03:42.435 INFO:tasks.workunit.client.0.smithi170.stdout:9/542: dread d5/df/d16/d35/d3c/f5f [0,4194304] 0 2024-01-25T15:03:42.437 INFO:tasks.workunit.client.0.smithi170.stdout:2/594: sync 2024-01-25T15:03:42.437 INFO:tasks.workunit.client.0.smithi170.stdout:4/475: sync 2024-01-25T15:03:42.438 INFO:tasks.workunit.client.0.smithi170.stdout:7/579: sync 2024-01-25T15:03:42.438 INFO:tasks.workunit.client.0.smithi170.stdout:6/624: sync 2024-01-25T15:03:42.438 INFO:tasks.workunit.client.0.smithi170.stdout:6/625: truncate d2/d7/d1b/d28/db8/fba 534422 0 2024-01-25T15:03:42.438 INFO:tasks.workunit.client.0.smithi170.stdout:6/626: write d2/d7/d1b/d28/f49 [496367,76012] 0 2024-01-25T15:03:42.438 INFO:tasks.workunit.client.0.smithi170.stdout:8/611: rename d3/d7/d22/d23/f4a to d3/d7/d22/d23/d48/d52/d47/d86/fcd 0 2024-01-25T15:03:42.440 INFO:tasks.workunit.client.0.smithi170.stdout:9/543: creat d5/df/d2e/d77/d21/d34/fc4 x:0 0 0 2024-01-25T15:03:42.446 INFO:tasks.workunit.client.0.smithi170.stdout:8/612: mkdir d3/d7/d3a/dce 0 2024-01-25T15:03:42.446 INFO:tasks.workunit.client.0.smithi170.stdout:1/568: sync 2024-01-25T15:03:42.446 INFO:tasks.workunit.client.0.smithi170.stdout:3/622: sync 2024-01-25T15:03:42.446 INFO:tasks.workunit.client.0.smithi170.stdout:3/623: truncate d3/d1c/d2b/fc1 499820 0 2024-01-25T15:03:42.446 INFO:tasks.workunit.client.0.smithi170.stdout:8/613: write d3/d7/d22/d23/d25/f5b [4064112,13060] 0 2024-01-25T15:03:42.449 INFO:tasks.workunit.client.0.smithi170.stdout:7/580: rmdir d8/d20/d2a 39 2024-01-25T15:03:42.450 INFO:tasks.workunit.client.0.smithi170.stdout:7/581: readlink d8/d20/d2a/d35/db0/ld0 0 2024-01-25T15:03:42.452 INFO:tasks.workunit.client.0.smithi170.stdout:9/544: dread d5/df/d16/d35/d3c/f45 [0,4194304] 0 2024-01-25T15:03:42.453 INFO:tasks.workunit.client.0.smithi170.stdout:9/545: dread - d5/df/d2e/d77/d21/d63/d96/f98 zero size 2024-01-25T15:03:42.453 INFO:tasks.workunit.client.0.smithi170.stdout:9/546: fdatasync d5/df/d2e/d77/d21/d34/f3d 0 2024-01-25T15:03:42.456 INFO:tasks.workunit.client.0.smithi170.stdout:1/569: rmdir d0/d20 39 2024-01-25T15:03:42.460 INFO:tasks.workunit.client.0.smithi170.stdout:5/580: write d5/d2a/f53 [805807,84812] 0 2024-01-25T15:03:42.465 INFO:tasks.workunit.client.0.smithi170.stdout:2/595: dwrite d10/d1e/d32/d98/d99/fa2 [0,4194304] 0 2024-01-25T15:03:42.467 INFO:tasks.workunit.client.0.smithi170.stdout:4/476: rename d6/c22 to d6/d28/d61/c8e 0 2024-01-25T15:03:42.469 INFO:tasks.workunit.client.0.smithi170.stdout:4/477: symlink d6/d28/d61/l8f 0 2024-01-25T15:03:42.471 INFO:tasks.workunit.client.0.smithi170.stdout:0/554: dwrite d8/d10/f2e [0,4194304] 0 2024-01-25T15:03:42.471 INFO:tasks.workunit.client.0.smithi170.stdout:4/478: rmdir d6/d8c 0 2024-01-25T15:03:42.473 INFO:tasks.workunit.client.0.smithi170.stdout:3/624: rename d3/d2a to d3/d3b/dc6 0 2024-01-25T15:03:42.475 INFO:tasks.workunit.client.0.smithi170.stdout:8/614: dwrite d3/d7/d22/d5d/f6e [0,4194304] 0 2024-01-25T15:03:42.475 INFO:tasks.workunit.client.0.smithi170.stdout:0/555: unlink d8/d9/fa8 0 2024-01-25T15:03:42.478 INFO:tasks.workunit.client.0.smithi170.stdout:4/479: mknod d6/d7/d31/c90 0 2024-01-25T15:03:42.480 INFO:tasks.workunit.client.0.smithi170.stdout:3/625: mkdir d3/d10/d1e/d21/d41/d4b/d63/dc7 0 2024-01-25T15:03:42.480 INFO:tasks.workunit.client.0.smithi170.stdout:8/615: symlink d3/d7/d22/lcf 0 2024-01-25T15:03:42.481 INFO:tasks.workunit.client.0.smithi170.stdout:3/626: creat d3/d10/d13/fc8 x:0 0 0 2024-01-25T15:03:42.482 INFO:tasks.workunit.client.0.smithi170.stdout:3/627: readlink d3/d10/d13/l79 0 2024-01-25T15:03:42.482 INFO:tasks.workunit.client.0.smithi170.stdout:3/628: fsync d3/d10/d13/d1b/d29/f94 0 2024-01-25T15:03:42.482 INFO:tasks.workunit.client.0.smithi170.stdout:1/570: dwrite d0/d1b/fa1 [0,4194304] 0 2024-01-25T15:03:42.483 INFO:tasks.workunit.client.0.smithi170.stdout:9/547: dwrite d5/f37 [0,4194304] 0 2024-01-25T15:03:42.483 INFO:tasks.workunit.client.0.smithi170.stdout:9/548: fsync d5/df/d16/d35/d3c/fbf 0 2024-01-25T15:03:42.488 INFO:tasks.workunit.client.0.smithi170.stdout:0/556: dread d8/d9/fe [0,4194304] 0 2024-01-25T15:03:42.489 INFO:tasks.workunit.client.0.smithi170.stdout:1/571: creat d0/d50/da0/d9c/fc3 x:0 0 0 2024-01-25T15:03:42.489 INFO:tasks.workunit.client.0.smithi170.stdout:9/549: getdents d5/df/d2e/d77/d21 0 2024-01-25T15:03:42.489 INFO:tasks.workunit.client.0.smithi170.stdout:0/557: symlink d8/d18/lc2 0 2024-01-25T15:03:42.490 INFO:tasks.workunit.client.0.smithi170.stdout:1/572: symlink d0/d20/d28/d7b/da8/lc4 0 2024-01-25T15:03:42.490 INFO:tasks.workunit.client.0.smithi170.stdout:1/573: stat d0/d20/d3a/d60/l7e 0 2024-01-25T15:03:42.491 INFO:tasks.workunit.client.0.smithi170.stdout:8/616: dread d3/d7/d22/d23/f33 [0,4194304] 0 2024-01-25T15:03:42.493 INFO:tasks.workunit.client.0.smithi170.stdout:0/558: truncate d8/d10/f1b 2226463 0 2024-01-25T15:03:42.493 INFO:tasks.workunit.client.0.smithi170.stdout:0/559: chown d8/d9/f46 16011925 1 2024-01-25T15:03:42.493 INFO:tasks.workunit.client.0.smithi170.stdout:0/560: truncate f6 4791898 0 2024-01-25T15:03:42.493 INFO:tasks.workunit.client.0.smithi170.stdout:0/561: readlink d8/d9/l1a 0 2024-01-25T15:03:42.494 INFO:tasks.workunit.client.0.smithi170.stdout:1/574: creat d0/d20/d28/fc5 x:0 0 0 2024-01-25T15:03:42.494 INFO:tasks.workunit.client.0.smithi170.stdout:1/575: write d0/d2e/fbd [233790,23435] 0 2024-01-25T15:03:42.495 INFO:tasks.workunit.client.0.smithi170.stdout:8/617: mkdir d3/d7/d22/d5d/dd0 0 2024-01-25T15:03:42.496 INFO:tasks.workunit.client.0.smithi170.stdout:9/550: getdents d5/df/d2e/d77/d21/d34 0 2024-01-25T15:03:42.496 INFO:tasks.workunit.client.0.smithi170.stdout:9/551: fsync d5/df/f15 0 2024-01-25T15:03:42.497 INFO:tasks.workunit.client.0.smithi170.stdout:8/618: read d3/d7/d3a/f4f [597205,126976] 0 2024-01-25T15:03:42.502 INFO:tasks.workunit.client.0.smithi170.stdout:9/552: creat d5/df/d16/d35/fc5 x:0 0 0 2024-01-25T15:03:42.502 INFO:tasks.workunit.client.0.smithi170.stdout:1/576: symlink d0/d50/da0/lc6 0 2024-01-25T15:03:42.503 INFO:tasks.workunit.client.0.smithi170.stdout:3/629: dwrite d3/d10/d1e/d21/d41/d4a/f75 [0,4194304] 0 2024-01-25T15:03:42.504 INFO:tasks.workunit.client.0.smithi170.stdout:1/577: mkdir d0/d20/d28/d2a/dc7 0 2024-01-25T15:03:42.504 INFO:tasks.workunit.client.0.smithi170.stdout:1/578: read d0/d20/d28/f70 [194774,49261] 0 2024-01-25T15:03:42.507 INFO:tasks.workunit.client.0.smithi170.stdout:0/562: dread d8/d18/f20 [0,4194304] 0 2024-01-25T15:03:42.509 INFO:tasks.workunit.client.0.smithi170.stdout:3/630: unlink d3/d88/f9c 0 2024-01-25T15:03:42.509 INFO:tasks.workunit.client.0.smithi170.stdout:3/631: creat d3/d10/d1e/d21/d41/d4b/fc9 x:0 0 0 2024-01-25T15:03:42.510 INFO:tasks.workunit.client.0.smithi170.stdout:1/579: getdents d0/d20/d28/d2a/d4a 0 2024-01-25T15:03:42.510 INFO:tasks.workunit.client.0.smithi170.stdout:1/580: chown d0/d50/da0 3 1 2024-01-25T15:03:42.510 INFO:tasks.workunit.client.0.smithi170.stdout:1/581: chown d0/l24 96485 1 2024-01-25T15:03:42.515 INFO:tasks.workunit.client.0.smithi170.stdout:3/632: link d3/f68 d3/d3b/d4f/fca 0 2024-01-25T15:03:42.518 INFO:tasks.workunit.client.0.smithi170.stdout:1/582: creat d0/d91/fc8 x:0 0 0 2024-01-25T15:03:42.519 INFO:tasks.workunit.client.0.smithi170.stdout:7/582: rename d8/d20/d2a/d35/d55/d6e/d81/l88 to d8/ld9 0 2024-01-25T15:03:42.520 INFO:tasks.workunit.client.0.smithi170.stdout:3/633: mkdir d3/d3b/d4f/da0/dcb 0 2024-01-25T15:03:42.522 INFO:tasks.workunit.client.0.smithi170.stdout:3/634: dread d3/d10/d13/d1b/d81/f8d [0,4194304] 0 2024-01-25T15:03:42.524 INFO:tasks.workunit.client.0.smithi170.stdout:3/635: creat d3/d10/d1e/d21/d41/d4b/d63/dc7/fcc x:0 0 0 2024-01-25T15:03:42.526 INFO:tasks.workunit.client.0.smithi170.stdout:3/636: link d3/d10/ff d3/d10/d13/d1b/d85/fcd 0 2024-01-25T15:03:42.526 INFO:tasks.workunit.client.0.smithi170.stdout:3/637: read - d3/d10/d1e/d21/d41/d4b/fc9 zero size 2024-01-25T15:03:42.526 INFO:tasks.workunit.client.0.smithi170.stdout:3/638: chown d3/d10/d52/f5d 3448975 1 2024-01-25T15:03:42.526 INFO:tasks.workunit.client.0.smithi170.stdout:3/639: chown d3/d10/d13/d1b/d29/db7 3295 1 2024-01-25T15:03:42.527 INFO:tasks.workunit.client.0.smithi170.stdout:3/640: creat d3/d88/fce x:0 0 0 2024-01-25T15:03:42.528 INFO:tasks.workunit.client.0.smithi170.stdout:0/563: write d8/d10/f2b [3352282,53396] 0 2024-01-25T15:03:42.530 INFO:tasks.workunit.client.0.smithi170.stdout:8/619: dwrite d3/d7/f12 [0,4194304] 0 2024-01-25T15:03:42.532 INFO:tasks.workunit.client.0.smithi170.stdout:8/620: creat d3/d7/d22/d23/d25/d41/d61/fd1 x:0 0 0 2024-01-25T15:03:42.532 INFO:tasks.workunit.client.0.smithi170.stdout:8/621: read d3/d7/f67 [2786389,68817] 0 2024-01-25T15:03:42.534 INFO:tasks.workunit.client.0.smithi170.stdout:9/553: dwrite d5/df/d16/d52/fba [0,4194304] 0 2024-01-25T15:03:42.534 INFO:tasks.workunit.client.0.smithi170.stdout:1/583: dread d0/d2e/f3b [0,4194304] 0 2024-01-25T15:03:42.534 INFO:tasks.workunit.client.0.smithi170.stdout:1/584: fsync d0/d20/d28/f70 0 2024-01-25T15:03:42.534 INFO:tasks.workunit.client.0.smithi170.stdout:1/585: truncate d0/f41 502955 0 2024-01-25T15:03:42.534 INFO:tasks.workunit.client.0.smithi170.stdout:1/586: truncate d0/d2e/f8d 942853 0 2024-01-25T15:03:42.534 INFO:tasks.workunit.client.0.smithi170.stdout:1/587: chown d0/d20/d28/d2a/d57/l84 173629 1 2024-01-25T15:03:42.534 INFO:tasks.workunit.client.0.smithi170.stdout:9/554: creat d5/df/d16/d35/d3c/d56/d59/fc6 x:0 0 0 2024-01-25T15:03:42.534 INFO:tasks.workunit.client.0.smithi170.stdout:8/622: read d3/d7/d73/fb1 [215117,111181] 0 2024-01-25T15:03:42.535 INFO:tasks.workunit.client.0.smithi170.stdout:1/588: dread d0/d2e/f8d [0,4194304] 0 2024-01-25T15:03:42.539 INFO:tasks.workunit.client.0.smithi170.stdout:8/623: symlink d3/d7/d3a/d91/d7f/ld2 0 2024-01-25T15:03:42.540 INFO:tasks.workunit.client.0.smithi170.stdout:9/555: write d5/df/d2e/d77/d21/d46/f8e [1459831,59543] 0 2024-01-25T15:03:42.540 INFO:tasks.workunit.client.0.smithi170.stdout:9/556: fdatasync f4 0 2024-01-25T15:03:42.540 INFO:tasks.workunit.client.0.smithi170.stdout:9/557: truncate d5/df/d2e/d77/d21/d63/d96/f98 860755 0 2024-01-25T15:03:42.540 INFO:tasks.workunit.client.0.smithi170.stdout:9/558: fdatasync d5/df/d2e/d77/d21/d34/f3d 0 2024-01-25T15:03:42.540 INFO:tasks.workunit.client.0.smithi170.stdout:8/624: mknod d3/d7/d3a/d8d/cd3 0 2024-01-25T15:03:42.542 INFO:tasks.workunit.client.0.smithi170.stdout:9/559: getdents d5/df 0 2024-01-25T15:03:42.543 INFO:tasks.workunit.client.0.smithi170.stdout:8/625: creat d3/d7/d3a/d8d/fd4 x:0 0 0 2024-01-25T15:03:42.543 INFO:tasks.workunit.client.0.smithi170.stdout:7/583: link d8/f17 d8/d20/d2a/d35/d55/d7d/fda 0 2024-01-25T15:03:42.545 INFO:tasks.workunit.client.0.smithi170.stdout:8/626: mkdir d3/d7/d3a/d8d/dd5 0 2024-01-25T15:03:42.545 INFO:tasks.workunit.client.0.smithi170.stdout:8/627: chown d3/c1b 51825 1 2024-01-25T15:03:42.546 INFO:tasks.workunit.client.0.smithi170.stdout:8/628: mknod d3/d7/d3a/d8d/cd6 0 2024-01-25T15:03:42.546 INFO:tasks.workunit.client.0.smithi170.stdout:8/629: dread - d3/d7/d22/d23/d25/d41/d61/fd1 zero size 2024-01-25T15:03:42.547 INFO:tasks.workunit.client.0.smithi170.stdout:7/584: mkdir d8/ddb 0 2024-01-25T15:03:42.548 INFO:tasks.workunit.client.0.smithi170.stdout:7/585: truncate d8/d20/f22 3969041 0 2024-01-25T15:03:42.548 INFO:tasks.workunit.client.0.smithi170.stdout:7/586: chown d8/fb6 7319815 1 2024-01-25T15:03:42.550 INFO:tasks.workunit.client.0.smithi170.stdout:4/480: rename d6/d7/d31/f43 to d6/d7/d31/d7e/d80/f91 0 2024-01-25T15:03:42.551 INFO:tasks.workunit.client.0.smithi170.stdout:3/641: dwrite d3/d1c/f24 [0,4194304] 0 2024-01-25T15:03:42.551 INFO:tasks.workunit.client.0.smithi170.stdout:3/642: read - d3/d10/d13/fc8 zero size 2024-01-25T15:03:42.551 INFO:tasks.workunit.client.0.smithi170.stdout:3/643: creat d3/d10/d1e/d21/d41/d4b/d63/dc7/fcf x:0 0 0 2024-01-25T15:03:42.553 INFO:tasks.workunit.client.0.smithi170.stdout:0/564: rename d8/d9/l28 to d8/d3e/lc3 0 2024-01-25T15:03:42.553 INFO:tasks.workunit.client.0.smithi170.stdout:0/565: write d8/d10/d2d/d58/f5c [1196612,6264] 0 2024-01-25T15:03:42.553 INFO:tasks.workunit.client.0.smithi170.stdout:0/566: dread d8/d18/f84 [4194304,4194304] 0 2024-01-25T15:03:42.555 INFO:tasks.workunit.client.0.smithi170.stdout:7/587: dread d8/d20/d2a/d35/d55/d7d/fda [0,4194304] 0 2024-01-25T15:03:42.556 INFO:tasks.workunit.client.0.smithi170.stdout:3/644: truncate d3/d10/d1e/f20 3947919 0 2024-01-25T15:03:42.558 INFO:tasks.workunit.client.0.smithi170.stdout:9/560: rename d5/df/d2e/d77/d21/d46/f76 to d5/df/d2e/d77/d21/d34/fc7 0 2024-01-25T15:03:42.562 INFO:tasks.workunit.client.0.smithi170.stdout:1/589: dwrite d0/d20/d3a/f53 [0,4194304] 0 2024-01-25T15:03:42.562 INFO:tasks.workunit.client.0.smithi170.stdout:1/590: truncate d0/d2e/fbd 990587 0 2024-01-25T15:03:42.562 INFO:tasks.workunit.client.0.smithi170.stdout:8/630: rename d3/d7/d3a/f3f to d3/d7/d22/d23/d25/d8e/fd7 0 2024-01-25T15:03:42.566 INFO:tasks.workunit.client.0.smithi170.stdout:4/481: dread d6/d7/f9 [0,4194304] 0 2024-01-25T15:03:42.568 INFO:tasks.workunit.client.0.smithi170.stdout:8/631: dread d3/d7/d22/d23/d48/d52/f43 [0,4194304] 0 2024-01-25T15:03:42.568 INFO:tasks.workunit.client.0.smithi170.stdout:8/632: write d3/d7/d22/d23/d48/d52/d47/d86/fb9 [842043,21413] 0 2024-01-25T15:03:42.568 INFO:tasks.workunit.client.0.smithi170.stdout:8/633: chown d3/d7/d22/d23/d25/d41/d61/fb7 7 1 2024-01-25T15:03:42.568 INFO:tasks.workunit.client.0.smithi170.stdout:8/634: write d3/d7/d22/d23/d25/d41/fad [915109,35941] 0 2024-01-25T15:03:42.574 INFO:tasks.workunit.client.0.smithi170.stdout:4/482: truncate d6/d28/d59/d7d/f30 469521 0 2024-01-25T15:03:42.578 INFO:tasks.workunit.client.0.smithi170.stdout:4/483: truncate d6/d7/f9 384669 0 2024-01-25T15:03:42.578 INFO:tasks.workunit.client.0.smithi170.stdout:0/567: dwrite d8/d10/d2d/d2f/f7c [0,4194304] 0 2024-01-25T15:03:42.578 INFO:tasks.workunit.client.0.smithi170.stdout:7/588: write d8/d20/d2a/d35/d55/d6e/f93 [4731458,53608] 0 2024-01-25T15:03:42.579 INFO:tasks.workunit.client.0.smithi170.stdout:0/568: dread d8/d10/d2d/d58/f62 [0,4194304] 0 2024-01-25T15:03:42.585 INFO:tasks.workunit.client.0.smithi170.stdout:0/569: symlink d8/d10/d2d/d82/lc4 0 2024-01-25T15:03:42.585 INFO:tasks.workunit.client.0.smithi170.stdout:0/570: stat d8/d10/d5a/fb9 0 2024-01-25T15:03:42.586 INFO:tasks.workunit.client.0.smithi170.stdout:6/627: sync 2024-01-25T15:03:42.586 INFO:tasks.workunit.client.0.smithi170.stdout:5/581: sync 2024-01-25T15:03:42.586 INFO:tasks.workunit.client.0.smithi170.stdout:2/596: sync 2024-01-25T15:03:42.586 INFO:tasks.workunit.client.0.smithi170.stdout:6/628: readlink d2/d7/d23/l72 0 2024-01-25T15:03:42.586 INFO:tasks.workunit.client.0.smithi170.stdout:2/597: chown d10/d1b/db6/dd5 724 1 2024-01-25T15:03:42.586 INFO:tasks.workunit.client.0.smithi170.stdout:2/598: chown d10/d1e/d32/d3e/d41/dc4/dc6/f3b 43455 1 2024-01-25T15:03:42.587 INFO:tasks.workunit.client.0.smithi170.stdout:2/599: mknod d10/d1b/db6/cd6 0 2024-01-25T15:03:42.590 INFO:tasks.workunit.client.0.smithi170.stdout:2/600: unlink d10/d1e/l64 0 2024-01-25T15:03:42.591 INFO:tasks.workunit.client.0.smithi170.stdout:8/635: dwrite d3/d7/d3a/f94 [0,4194304] 0 2024-01-25T15:03:42.591 INFO:tasks.workunit.client.0.smithi170.stdout:8/636: write d3/d7/d22/d23/f33 [4804382,69044] 0 2024-01-25T15:03:42.594 INFO:tasks.workunit.client.0.smithi170.stdout:2/601: mkdir d10/d1b/db6/dd7 0 2024-01-25T15:03:42.595 INFO:tasks.workunit.client.0.smithi170.stdout:7/589: dread d8/f92 [4194304,4194304] 0 2024-01-25T15:03:42.595 INFO:tasks.workunit.client.0.smithi170.stdout:7/590: chown d8/d20/d45/l47 538287235 1 2024-01-25T15:03:42.595 INFO:tasks.workunit.client.0.smithi170.stdout:7/591: dread - d8/f90 zero size 2024-01-25T15:03:42.600 INFO:tasks.workunit.client.0.smithi170.stdout:8/637: mknod d3/d7/d22/dbd/cd8 0 2024-01-25T15:03:42.600 INFO:tasks.workunit.client.0.smithi170.stdout:6/629: dread d2/d7/d23/d19/d2a/fb2 [0,4194304] 0 2024-01-25T15:03:42.600 INFO:tasks.workunit.client.0.smithi170.stdout:4/484: dwrite d6/d28/d59/d7d/f5c [4194304,4194304] 0 2024-01-25T15:03:42.600 INFO:tasks.workunit.client.0.smithi170.stdout:6/630: write d2/f40 [9369253,112685] 0 2024-01-25T15:03:42.600 INFO:tasks.workunit.client.0.smithi170.stdout:1/591: rmdir d0/d20/d28/d2a/d4a/d56/d5b 39 2024-01-25T15:03:42.603 INFO:tasks.workunit.client.0.smithi170.stdout:2/602: creat d10/fd8 x:0 0 0 2024-01-25T15:03:42.607 INFO:tasks.workunit.client.0.smithi170.stdout:0/571: dwrite d8/d10/d2d/d53/f7d [0,4194304] 0 2024-01-25T15:03:42.607 INFO:tasks.workunit.client.0.smithi170.stdout:0/572: chown d8/d10/d2d/d2f/d6a/c98 121473 1 2024-01-25T15:03:42.608 INFO:tasks.workunit.client.0.smithi170.stdout:4/485: creat d6/d7/d31/d46/f92 x:0 0 0 2024-01-25T15:03:42.611 INFO:tasks.workunit.client.0.smithi170.stdout:6/631: creat d2/d7/d1b/d28/da7/fde x:0 0 0 2024-01-25T15:03:42.613 INFO:tasks.workunit.client.0.smithi170.stdout:0/573: dread d8/d18/f3b [0,4194304] 0 2024-01-25T15:03:42.613 INFO:tasks.workunit.client.0.smithi170.stdout:5/582: dwrite d5/d54/d85/d2c/d45/d56/d72/faf [0,4194304] 0 2024-01-25T15:03:42.614 INFO:tasks.workunit.client.0.smithi170.stdout:1/592: unlink d0/d1b/f80 0 2024-01-25T15:03:42.614 INFO:tasks.workunit.client.0.smithi170.stdout:8/638: dread d3/d7/d22/d23/d25/f3c [0,4194304] 0 2024-01-25T15:03:42.614 INFO:tasks.workunit.client.0.smithi170.stdout:8/639: read d3/d7/d3a/f4f [379897,98230] 0 2024-01-25T15:03:42.615 INFO:tasks.workunit.client.0.smithi170.stdout:2/603: rename d10/d1b/d5f/f78 to d10/d1e/fd9 0 2024-01-25T15:03:42.615 INFO:tasks.workunit.client.0.smithi170.stdout:5/583: creat d5/d54/d85/d2c/d45/fce x:0 0 0 2024-01-25T15:03:42.615 INFO:tasks.workunit.client.0.smithi170.stdout:7/592: symlink d8/ldc 0 2024-01-25T15:03:42.619 INFO:tasks.workunit.client.0.smithi170.stdout:4/486: mkdir d6/d28/d93 0 2024-01-25T15:03:42.619 INFO:tasks.workunit.client.0.smithi170.stdout:4/487: chown d6/d7/d31/l44 1431 1 2024-01-25T15:03:42.620 INFO:tasks.workunit.client.0.smithi170.stdout:8/640: symlink d3/d7/d22/d5d/ld9 0 2024-01-25T15:03:42.621 INFO:tasks.workunit.client.0.smithi170.stdout:2/604: symlink d10/d1e/d32/d3e/d41/dc4/dc6/d42/lda 0 2024-01-25T15:03:42.627 INFO:tasks.workunit.client.0.smithi170.stdout:7/593: unlink d8/d20/d73/cc4 0 2024-01-25T15:03:42.627 INFO:tasks.workunit.client.0.smithi170.stdout:7/594: chown d8/d20/d73 12742 1 2024-01-25T15:03:42.628 INFO:tasks.workunit.client.0.smithi170.stdout:0/574: getdents d8/d80 0 2024-01-25T15:03:42.628 INFO:tasks.workunit.client.0.smithi170.stdout:0/575: fdatasync d8/d80/fc1 0 2024-01-25T15:03:42.628 INFO:tasks.workunit.client.0.smithi170.stdout:7/595: creat d8/d20/d2a/d35/d55/d7d/fdd x:0 0 0 2024-01-25T15:03:42.628 INFO:tasks.workunit.client.0.smithi170.stdout:8/641: rename d3/d7/d3a/d8d/fd4 to d3/d7/d22/d23/d25/d41/d61/fda 0 2024-01-25T15:03:42.629 INFO:tasks.workunit.client.0.smithi170.stdout:2/605: mknod d10/d1b/db6/dd5/cdb 0 2024-01-25T15:03:42.630 INFO:tasks.workunit.client.0.smithi170.stdout:7/596: dread d8/d20/d45/d68/d71/d8c/fbf [0,4194304] 0 2024-01-25T15:03:42.630 INFO:tasks.workunit.client.0.smithi170.stdout:7/597: stat d8/ldc 0 2024-01-25T15:03:42.630 INFO:tasks.workunit.client.0.smithi170.stdout:7/598: write d8/d20/d45/d68/d71/d8c/fb2 [55203,35658] 0 2024-01-25T15:03:42.632 INFO:tasks.workunit.client.0.smithi170.stdout:0/576: rename d8/d10/l41 to d8/d10/d2d/d53/lc5 0 2024-01-25T15:03:42.634 INFO:tasks.workunit.client.0.smithi170.stdout:7/599: creat d8/d20/dc2/fde x:0 0 0 2024-01-25T15:03:42.635 INFO:tasks.workunit.client.0.smithi170.stdout:0/577: truncate d8/d10/d2d/d53/f67 1464454 0 2024-01-25T15:03:42.636 INFO:tasks.workunit.client.0.smithi170.stdout:8/642: getdents d3 0 2024-01-25T15:03:42.636 INFO:tasks.workunit.client.0.smithi170.stdout:8/643: write d3/fd [2969910,84298] 0 2024-01-25T15:03:42.637 INFO:tasks.workunit.client.0.smithi170.stdout:8/644: write d3/d7/d22/d23/d25/f95 [1113612,27493] 0 2024-01-25T15:03:42.639 INFO:tasks.workunit.client.0.smithi170.stdout:1/593: dwrite d0/d50/fa6 [0,4194304] 0 2024-01-25T15:03:42.639 INFO:tasks.workunit.client.0.smithi170.stdout:1/594: fsync d0/d20/d3a/d6e/fbb 0 2024-01-25T15:03:42.639 INFO:tasks.workunit.client.0.smithi170.stdout:1/595: write d0/fe [2395027,30218] 0 2024-01-25T15:03:42.639 INFO:tasks.workunit.client.0.smithi170.stdout:1/596: creat d0/d1b/fc9 x:0 0 0 2024-01-25T15:03:42.640 INFO:tasks.workunit.client.0.smithi170.stdout:1/597: chown d0/d20/d28/d2a/d4a/c71 34538540 1 2024-01-25T15:03:42.640 INFO:tasks.workunit.client.0.smithi170.stdout:1/598: chown d0/fb 41936 1 2024-01-25T15:03:42.640 INFO:tasks.workunit.client.0.smithi170.stdout:0/578: mkdir d8/d10/d2d/d89/dc6 0 2024-01-25T15:03:42.644 INFO:tasks.workunit.client.0.smithi170.stdout:8/645: creat d3/d7/d22/d23/fdb x:0 0 0 2024-01-25T15:03:42.644 INFO:tasks.workunit.client.0.smithi170.stdout:8/646: dread - d3/d7/d1e/f6f zero size 2024-01-25T15:03:42.650 INFO:tasks.workunit.client.0.smithi170.stdout:1/599: mknod d0/d20/d28/d2a/d4a/dbe/cca 0 2024-01-25T15:03:42.651 INFO:tasks.workunit.client.0.smithi170.stdout:8/647: mknod d3/d7/d22/d23/d25/d41/d61/cdc 0 2024-01-25T15:03:42.651 INFO:tasks.workunit.client.0.smithi170.stdout:5/584: dwrite d5/f15 [0,4194304] 0 2024-01-25T15:03:42.653 INFO:tasks.workunit.client.0.smithi170.stdout:2/606: dwrite d10/d1e/d32/d3e/d41/dc4/dc6/f7c [0,4194304] 0 2024-01-25T15:03:42.654 INFO:tasks.workunit.client.0.smithi170.stdout:0/579: write d8/d9/f16 [224862,34290] 0 2024-01-25T15:03:42.656 INFO:tasks.workunit.client.0.smithi170.stdout:5/585: unlink d5/d54/d85/d3f/d86/f82 0 2024-01-25T15:03:42.661 INFO:tasks.workunit.client.0.smithi170.stdout:0/580: rename f6 to d8/d3e/fc7 0 2024-01-25T15:03:42.661 INFO:tasks.workunit.client.0.smithi170.stdout:0/581: write d8/d10/d2d/d2f/d4f/d5f/f88 [459744,63345] 0 2024-01-25T15:03:42.661 INFO:tasks.workunit.client.0.smithi170.stdout:2/607: dread d10/d1e/d32/d3e/f46 [0,4194304] 0 2024-01-25T15:03:42.662 INFO:tasks.workunit.client.0.smithi170.stdout:8/648: getdents d3/d7/d3a/d8d 0 2024-01-25T15:03:42.663 INFO:tasks.workunit.client.0.smithi170.stdout:2/608: getdents d10/d1e/d32/d62/d8d 0 2024-01-25T15:03:42.667 INFO:tasks.workunit.client.0.smithi170.stdout:0/582: creat d8/d9/db4/fc8 x:0 0 0 2024-01-25T15:03:42.669 INFO:tasks.workunit.client.0.smithi170.stdout:8/649: creat d3/d7/d22/d23/d48/d52/d47/fdd x:0 0 0 2024-01-25T15:03:42.674 INFO:tasks.workunit.client.0.smithi170.stdout:1/600: dwrite d0/f99 [0,4194304] 0 2024-01-25T15:03:42.674 INFO:tasks.workunit.client.0.smithi170.stdout:1/601: chown d0/d50/da0/l96 1285 1 2024-01-25T15:03:42.675 INFO:tasks.workunit.client.0.smithi170.stdout:5/586: mkdir d5/d54/d85/d2c/d51/d41/dcf 0 2024-01-25T15:03:42.675 INFO:tasks.workunit.client.0.smithi170.stdout:5/587: chown d5/d54/d85/d2c/d34/f8b 1 1 2024-01-25T15:03:42.676 INFO:tasks.workunit.client.0.smithi170.stdout:0/583: mkdir d8/d10/d2d/d89/dc6/dc9 0 2024-01-25T15:03:42.676 INFO:tasks.workunit.client.0.smithi170.stdout:7/600: link d8/f42 d8/d20/d2a/d35/d55/d7d/da6/dd1/fdf 0 2024-01-25T15:03:42.676 INFO:tasks.workunit.client.0.smithi170.stdout:7/601: fsync d8/d20/d2a/d35/d55/d6e/f89 0 2024-01-25T15:03:42.678 INFO:tasks.workunit.client.0.smithi170.stdout:2/609: rename d10/d1e/d32/d3e/d41/dc4/dc6/l40 to d10/d1e/d5e/ldc 0 2024-01-25T15:03:42.678 INFO:tasks.workunit.client.0.smithi170.stdout:2/610: write d10/fd8 [600827,67082] 0 2024-01-25T15:03:42.679 INFO:tasks.workunit.client.0.smithi170.stdout:2/611: chown d10/d1e/d32/d3e/d41/d7a/fa7 2 1 2024-01-25T15:03:42.679 INFO:tasks.workunit.client.0.smithi170.stdout:2/612: fdatasync d10/d1e/d32/d62/f79 0 2024-01-25T15:03:42.679 INFO:tasks.workunit.client.0.smithi170.stdout:1/602: link d0/d2e/fae d0/d50/da0/dab/fcb 0 2024-01-25T15:03:42.679 INFO:tasks.workunit.client.0.smithi170.stdout:2/613: creat d10/d1e/d32/d62/d8d/fdd x:0 0 0 2024-01-25T15:03:42.682 INFO:tasks.workunit.client.0.smithi170.stdout:2/614: symlink d10/d1e/d32/d3e/d5c/d92/lde 0 2024-01-25T15:03:42.682 INFO:tasks.workunit.client.0.smithi170.stdout:5/588: unlink d5/d54/d85/f76 0 2024-01-25T15:03:42.682 INFO:tasks.workunit.client.0.smithi170.stdout:5/589: stat d5/d54/d85/d2c/c61 0 2024-01-25T15:03:42.682 INFO:tasks.workunit.client.0.smithi170.stdout:0/584: mkdir d8/d10/d2d/d89/dc6/dc9/dca 0 2024-01-25T15:03:42.684 INFO:tasks.workunit.client.0.smithi170.stdout:7/602: link d8/d20/d3b/lb5 d8/d20/d2a/d35/le0 0 2024-01-25T15:03:42.685 INFO:tasks.workunit.client.0.smithi170.stdout:1/603: unlink d0/d50/da0/dab/fcb 0 2024-01-25T15:03:42.686 INFO:tasks.workunit.client.0.smithi170.stdout:2/615: symlink d10/d1e/d5e/d73/d9e/da3/ldf 0 2024-01-25T15:03:42.687 INFO:tasks.workunit.client.0.smithi170.stdout:5/590: truncate d5/d54/d85/d2c/d51/d3d/fad 3924851 0 2024-01-25T15:03:42.689 INFO:tasks.workunit.client.0.smithi170.stdout:1/604: link d0/d1b/fa1 d0/fcc 0 2024-01-25T15:03:42.690 INFO:tasks.workunit.client.0.smithi170.stdout:5/591: creat d5/d54/d85/d3f/d8f/fd0 x:0 0 0 2024-01-25T15:03:42.693 INFO:tasks.workunit.client.0.smithi170.stdout:5/592: mkdir d5/d54/d85/d2c/d51/d41/dd1 0 2024-01-25T15:03:42.693 INFO:tasks.workunit.client.0.smithi170.stdout:5/593: stat d5/d58/da9/fca 0 2024-01-25T15:03:42.693 INFO:tasks.workunit.client.0.smithi170.stdout:5/594: readlink d5/d54/d85/d2c/d45/d56/lc7 0 2024-01-25T15:03:42.693 INFO:tasks.workunit.client.0.smithi170.stdout:8/650: dwrite d3/d7/d1e/f6c [0,4194304] 0 2024-01-25T15:03:42.695 INFO:tasks.workunit.client.0.smithi170.stdout:8/651: mknod d3/d7/d73/cde 0 2024-01-25T15:03:42.697 INFO:tasks.workunit.client.0.smithi170.stdout:8/652: mknod d3/d7/d3a/cdf 0 2024-01-25T15:03:42.700 INFO:tasks.workunit.client.0.smithi170.stdout:8/653: write d3/d7/d22/d23/d25/d41/fad [157839,68648] 0 2024-01-25T15:03:42.700 INFO:tasks.workunit.client.0.smithi170.stdout:8/654: dread - d3/d7/d22/d5d/fa3 zero size 2024-01-25T15:03:42.700 INFO:tasks.workunit.client.0.smithi170.stdout:8/655: chown d3/d7/d1e/l21 535231271 1 2024-01-25T15:03:42.702 INFO:tasks.workunit.client.0.smithi170.stdout:8/656: link d3/d7/d22/d23/d48/f81 d3/d7/d22/d23/d25/fe0 0 2024-01-25T15:03:42.702 INFO:tasks.workunit.client.0.smithi170.stdout:8/657: fdatasync d3/d7/d22/d23/d48/d52/d47/fdd 0 2024-01-25T15:03:42.704 INFO:tasks.workunit.client.0.smithi170.stdout:5/595: dread d5/d54/d85/f19 [4194304,4194304] 0 2024-01-25T15:03:42.704 INFO:tasks.workunit.client.0.smithi170.stdout:5/596: write d5/d54/fbc [852453,36807] 0 2024-01-25T15:03:42.704 INFO:tasks.workunit.client.0.smithi170.stdout:5/597: read d5/d54/d85/f1c [40593,115398] 0 2024-01-25T15:03:42.705 INFO:tasks.workunit.client.0.smithi170.stdout:5/598: creat d5/d54/d85/d2c/d45/fd2 x:0 0 0 2024-01-25T15:03:42.705 INFO:tasks.workunit.client.0.smithi170.stdout:8/658: unlink d3/d7/d22/d23/c24 0 2024-01-25T15:03:42.705 INFO:tasks.workunit.client.0.smithi170.stdout:5/599: chown d5/d54/d85/d3f/f4f 1779455715 1 2024-01-25T15:03:42.705 INFO:tasks.workunit.client.0.smithi170.stdout:8/659: chown d3/d7/d22/d23/c92 649 1 2024-01-25T15:03:42.705 INFO:tasks.workunit.client.0.smithi170.stdout:5/600: fsync d5/d54/d85/d2c/d34/d69/fab 0 2024-01-25T15:03:42.705 INFO:tasks.workunit.client.0.smithi170.stdout:8/660: stat d3/d7/d22/d23/d25/d41/da9 0 2024-01-25T15:03:42.712 INFO:tasks.workunit.client.0.smithi170.stdout:0/585: dwrite d8/d10/d2d/d53/f76 [0,4194304] 0 2024-01-25T15:03:42.712 INFO:tasks.workunit.client.0.smithi170.stdout:0/586: readlink d8/d10/d2d/d2f/d6a/l8b 0 2024-01-25T15:03:42.716 INFO:tasks.workunit.client.0.smithi170.stdout:1/605: write d0/d20/f4d [1012021,110293] 0 2024-01-25T15:03:42.716 INFO:tasks.workunit.client.0.smithi170.stdout:1/606: write d0/d20/d28/d2a/d4a/d56/dc1/fc2 [995178,113416] 0 2024-01-25T15:03:42.718 INFO:tasks.workunit.client.0.smithi170.stdout:2/616: dwrite d10/d1b/f1d [0,4194304] 0 2024-01-25T15:03:42.722 INFO:tasks.workunit.client.0.smithi170.stdout:2/617: symlink d10/d1e/d32/d62/le0 0 2024-01-25T15:03:42.727 INFO:tasks.workunit.client.0.smithi170.stdout:5/601: dread d5/d54/d85/d3f/f4f [0,4194304] 0 2024-01-25T15:03:42.728 INFO:tasks.workunit.client.0.smithi170.stdout:3/645: sync 2024-01-25T15:03:42.728 INFO:tasks.workunit.client.0.smithi170.stdout:7/603: rename d8/d20/d2a/d35/d55/d7d/da6/dd1/fdf to d8/d20/d2a/d35/d55/d6e/d81/fe1 0 2024-01-25T15:03:42.728 INFO:tasks.workunit.client.0.smithi170.stdout:9/561: sync 2024-01-25T15:03:42.729 INFO:tasks.workunit.client.0.smithi170.stdout:0/587: rename d8/d9/f99 to d8/d80/fcb 0 2024-01-25T15:03:42.733 INFO:tasks.workunit.client.0.smithi170.stdout:5/602: write d5/d54/d85/d2c/d45/d56/d72/da0/dc5/f65 [6326110,140] 0 2024-01-25T15:03:42.733 INFO:tasks.workunit.client.0.smithi170.stdout:3/646: unlink d3/d10/d13/f1d 0 2024-01-25T15:03:42.733 INFO:tasks.workunit.client.0.smithi170.stdout:9/562: link d5/df/d16/f2b d5/df/d2e/d77/d21/d34/d3e/d7f/fc8 0 2024-01-25T15:03:42.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:42 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] up:active 2024-01-25T15:03:42.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:42 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:42.734 INFO:tasks.workunit.client.0.smithi170.stdout:5/603: getdents d5/d58/da9 0 2024-01-25T15:03:42.735 INFO:tasks.workunit.client.0.smithi170.stdout:5/604: rmdir d5/d54/d85/d2c/d45/d56/d72/da0/dc5 39 2024-01-25T15:03:42.738 INFO:tasks.workunit.client.0.smithi170.stdout:5/605: rmdir d5/d54/d85/d2c/d51/d41/dd1 0 2024-01-25T15:03:42.741 INFO:tasks.workunit.client.0.smithi170.stdout:5/606: symlink d5/d54/d85/d2c/d51/d41/ld3 0 2024-01-25T15:03:42.742 INFO:tasks.workunit.client.0.smithi170.stdout:5/607: creat d5/d58/da9/fd4 x:0 0 0 2024-01-25T15:03:42.742 INFO:tasks.workunit.client.0.smithi170.stdout:0/588: dread d8/d9/d9a/fa6 [0,4194304] 0 2024-01-25T15:03:42.742 INFO:tasks.workunit.client.0.smithi170.stdout:0/589: chown d8/d10/d2d/d2f/d4f/l4e 449 1 2024-01-25T15:03:42.743 INFO:tasks.workunit.client.0.smithi170.stdout:1/607: dwrite d0/d20/d28/d2a/d4a/d56/d5b/f68 [0,4194304] 0 2024-01-25T15:03:42.748 INFO:tasks.workunit.client.0.smithi170.stdout:5/608: mkdir d5/d54/d85/d3f/d8f/db8/dd5 0 2024-01-25T15:03:42.750 INFO:tasks.workunit.client.0.smithi170.stdout:9/563: dread d5/df/d2e/f7d [4194304,4194304] 0 2024-01-25T15:03:42.751 INFO:tasks.workunit.client.0.smithi170.stdout:9/564: mknod d5/df/d2e/d77/d86/cc9 0 2024-01-25T15:03:42.753 INFO:tasks.workunit.client.0.smithi170.stdout:9/565: mkdir d5/dca 0 2024-01-25T15:03:42.755 INFO:tasks.workunit.client.0.smithi170.stdout:7/604: rename d8/d20/d2a/d35/d55/d6e/f89 to d8/d20/d45/d68/d71/dc8/fe2 0 2024-01-25T15:03:42.755 INFO:tasks.workunit.client.0.smithi170.stdout:7/605: stat d8/fc9 0 2024-01-25T15:03:42.756 INFO:tasks.workunit.client.0.smithi170.stdout:7/606: mknod d8/d20/dc2/ce3 0 2024-01-25T15:03:42.756 INFO:tasks.workunit.client.0.smithi170.stdout:1/608: dread d0/f12 [0,4194304] 0 2024-01-25T15:03:42.757 INFO:tasks.workunit.client.0.smithi170.stdout:7/607: creat d8/fe4 x:0 0 0 2024-01-25T15:03:42.759 INFO:tasks.workunit.client.0.smithi170.stdout:7/608: mkdir d8/de5 0 2024-01-25T15:03:42.766 INFO:tasks.workunit.client.0.smithi170.stdout:0/590: dwrite d8/d10/d2d/d53/f7d [0,4194304] 0 2024-01-25T15:03:42.767 INFO:tasks.workunit.client.0.smithi170.stdout:1/609: read d0/f3d [2544164,53415] 0 2024-01-25T15:03:42.767 INFO:tasks.workunit.client.0.smithi170.stdout:1/610: dread - d0/d20/d28/d2a/d4a/d56/d5b/d72/fba zero size 2024-01-25T15:03:42.768 INFO:tasks.workunit.client.0.smithi170.stdout:1/611: creat d0/d20/d28/d2a/d4a/d56/d5b/fcd x:0 0 0 2024-01-25T15:03:42.779 INFO:tasks.workunit.client.0.smithi170.stdout:7/609: dread d8/d20/d2a/d35/f41 [0,4194304] 0 2024-01-25T15:03:42.789 INFO:tasks.workunit.client.0.smithi170.stdout:7/610: write d8/d20/d45/f46 [2158622,40665] 0 2024-01-25T15:03:42.790 INFO:tasks.workunit.client.0.smithi170.stdout:7/611: symlink d8/d20/d2a/d35/d55/d7d/da6/le6 0 2024-01-25T15:03:42.790 INFO:tasks.workunit.client.0.smithi170.stdout:9/566: dwrite d5/df/d2e/f93 [0,4194304] 0 2024-01-25T15:03:42.792 INFO:tasks.workunit.client.0.smithi170.stdout:7/612: symlink d8/d20/d45/le7 0 2024-01-25T15:03:42.792 INFO:tasks.workunit.client.0.smithi170.stdout:7/613: write d8/d20/f22 [4251752,90208] 0 2024-01-25T15:03:42.792 INFO:tasks.workunit.client.0.smithi170.stdout:5/609: dwrite d5/d54/d85/d2c/d45/f6c [0,4194304] 0 2024-01-25T15:03:42.792 INFO:tasks.workunit.client.0.smithi170.stdout:0/591: dwrite d8/d10/d2d/d2f/d96/fa3 [0,4194304] 0 2024-01-25T15:03:42.792 INFO:tasks.workunit.client.0.smithi170.stdout:0/592: write d8/d9/f16 [4628047,46198] 0 2024-01-25T15:03:42.792 INFO:tasks.workunit.client.0.smithi170.stdout:7/614: creat d8/d20/d2a/d35/d55/fe8 x:0 0 0 2024-01-25T15:03:42.795 INFO:tasks.workunit.client.0.smithi170.stdout:5/610: unlink d5/d54/d85/c27 0 2024-01-25T15:03:42.795 INFO:tasks.workunit.client.0.smithi170.stdout:5/611: write d5/d54/d85/d2c/d34/d69/fab [479994,80455] 0 2024-01-25T15:03:42.795 INFO:tasks.workunit.client.0.smithi170.stdout:5/612: chown d5/d54/d85/d2c/d51/d3d/c47 0 1 2024-01-25T15:03:42.800 INFO:tasks.workunit.client.0.smithi170.stdout:0/593: mknod d8/d10/d2d/ccc 0 2024-01-25T15:03:42.803 INFO:tasks.workunit.client.0.smithi170.stdout:6/632: sync 2024-01-25T15:03:42.804 INFO:tasks.workunit.client.0.smithi170.stdout:9/567: write d5/f8f [96345,11587] 0 2024-01-25T15:03:42.804 INFO:tasks.workunit.client.0.smithi170.stdout:6/633: mkdir d2/d7/d23/d19/d2f/d74/dce/ddf 0 2024-01-25T15:03:42.804 INFO:tasks.workunit.client.0.smithi170.stdout:6/634: dread - d2/d7/d23/d19/d2a/d6b/dad/fc5 zero size 2024-01-25T15:03:42.808 INFO:tasks.workunit.client.0.smithi170.stdout:0/594: dread d8/d9/d9a/fa6 [0,4194304] 0 2024-01-25T15:03:42.811 INFO:tasks.workunit.client.0.smithi170.stdout:6/635: rename d2/d7/d23/d19/d2f/f32 to d2/d7/d23/d19/d2f/d5d/d94/d97/db4/dd3/fe0 0 2024-01-25T15:03:42.811 INFO:tasks.workunit.client.0.smithi170.stdout:6/636: write d2/d7/d23/d19/d2f/d5d/d94/d97/db4/dd3/fe0 [12139,89205] 0 2024-01-25T15:03:42.812 INFO:tasks.workunit.client.0.smithi170.stdout:0/595: mknod d8/d10/d2d/d89/dc6/dc9/dca/ccd 0 2024-01-25T15:03:42.814 INFO:tasks.workunit.client.0.smithi170.stdout:0/596: symlink d8/d10/d2d/d58/lce 0 2024-01-25T15:03:42.815 INFO:tasks.workunit.client.0.smithi170.stdout:6/637: truncate d2/d7/d23/f2d 3404665 0 2024-01-25T15:03:42.816 INFO:tasks.workunit.client.0.smithi170.stdout:0/597: mknod d8/d10/d2d/d2f/ccf 0 2024-01-25T15:03:42.817 INFO:tasks.workunit.client.0.smithi170.stdout:6/638: unlink d2/d7/d23/d19/d2f/d5d/fbc 0 2024-01-25T15:03:42.819 INFO:tasks.workunit.client.0.smithi170.stdout:0/598: link d8/cb0 d8/d10/cd0 0 2024-01-25T15:03:42.820 INFO:tasks.workunit.client.0.smithi170.stdout:0/599: fdatasync d8/d10/d2d/d53/f63 0 2024-01-25T15:03:42.821 INFO:tasks.workunit.client.0.smithi170.stdout:6/639: fsync d2/f10 0 2024-01-25T15:03:42.822 INFO:tasks.workunit.client.0.smithi170.stdout:6/640: write d2/f4f [232101,126248] 0 2024-01-25T15:03:42.822 INFO:tasks.workunit.client.0.smithi170.stdout:6/641: chown d2/f40 91 1 2024-01-25T15:03:42.822 INFO:tasks.workunit.client.0.smithi170.stdout:6/642: read d2/d7/d23/d19/f83 [2847881,114395] 0 2024-01-25T15:03:42.824 INFO:tasks.workunit.client.0.smithi170.stdout:0/600: unlink d8/d9/db4/fc8 0 2024-01-25T15:03:42.824 INFO:tasks.workunit.client.0.smithi170.stdout:0/601: chown d8/d3e/l49 13833 1 2024-01-25T15:03:42.824 INFO:tasks.workunit.client.0.smithi170.stdout:9/568: dwrite d5/df/d2e/d77/d21/d46/d18/d6a/fa4 [0,4194304] 0 2024-01-25T15:03:42.826 INFO:tasks.workunit.client.0.smithi170.stdout:6/643: stat d2/d7/d23/d19/d2f/ca9 0 2024-01-25T15:03:42.826 INFO:tasks.workunit.client.0.smithi170.stdout:6/644: creat d2/d7/d23/d19/d2a/fe1 x:0 0 0 2024-01-25T15:03:42.826 INFO:tasks.workunit.client.0.smithi170.stdout:6/645: write d2/d7/f2e [1054134,63242] 0 2024-01-25T15:03:42.829 INFO:tasks.workunit.client.0.smithi170.stdout:9/569: unlink d5/df/d2e/d77/d21/d46/d18/d6a/fa4 0 2024-01-25T15:03:42.831 INFO:tasks.workunit.client.0.smithi170.stdout:6/646: mkdir d2/d7/d23/d19/d2f/d74/dce/ddf/de2 0 2024-01-25T15:03:42.833 INFO:tasks.workunit.client.0.smithi170.stdout:6/647: dread d2/f7b [0,4194304] 0 2024-01-25T15:03:42.833 INFO:tasks.workunit.client.0.smithi170.stdout:9/570: mknod d5/df/d2e/d77/d21/d34/d3e/d7f/ccb 0 2024-01-25T15:03:42.834 INFO:tasks.workunit.client.0.smithi170.stdout:6/648: creat d2/d7/d23/d19/daf/db0/fe3 x:0 0 0 2024-01-25T15:03:42.835 INFO:tasks.workunit.client.0.smithi170.stdout:9/571: creat d5/df/d2e/d77/d21/daa/fcc x:0 0 0 2024-01-25T15:03:42.835 INFO:tasks.workunit.client.0.smithi170.stdout:9/572: write d5/fa0 [181360,68291] 0 2024-01-25T15:03:42.847 INFO:tasks.workunit.client.0.smithi170.stdout:9/573: dread d5/df/d2e/d77/d21/d34/d3e/d7f/fc8 [0,4194304] 0 2024-01-25T15:03:42.847 INFO:tasks.workunit.client.0.smithi170.stdout:6/649: write d2/d7/d23/d19/f20 [188033,121148] 0 2024-01-25T15:03:42.847 INFO:tasks.workunit.client.0.smithi170.stdout:6/650: readlink d2/d7/d23/d19/l34 0 2024-01-25T15:03:42.847 INFO:tasks.workunit.client.0.smithi170.stdout:6/651: write d2/d7/d23/d19/d2a/d6b/dad/fc5 [651289,47732] 0 2024-01-25T15:03:42.848 INFO:tasks.workunit.client.0.smithi170.stdout:9/574: creat d5/df/d2e/d77/d21/d34/fcd x:0 0 0 2024-01-25T15:03:42.848 INFO:tasks.workunit.client.0.smithi170.stdout:9/575: readlink l3 0 2024-01-25T15:03:42.848 INFO:tasks.workunit.client.0.smithi170.stdout:0/602: dwrite d8/d10/d2d/d53/f63 [0,4194304] 0 2024-01-25T15:03:42.849 INFO:tasks.workunit.client.0.smithi170.stdout:6/652: symlink d2/d7/d23/d19/d2f/d74/dce/le4 0 2024-01-25T15:03:42.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:42 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] up:active 2024-01-25T15:03:42.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:42 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:42.858 INFO:tasks.workunit.client.0.smithi170.stdout:9/576: dread d5/df/f1a [0,4194304] 0 2024-01-25T15:03:42.860 INFO:tasks.workunit.client.0.smithi170.stdout:6/653: write d2/d7/d23/d19/d2a/d43/d44/f7c [484531,105828] 0 2024-01-25T15:03:42.860 INFO:tasks.workunit.client.0.smithi170.stdout:4/488: sync 2024-01-25T15:03:42.860 INFO:tasks.workunit.client.0.smithi170.stdout:6/654: chown d2/d7/f18 2584707 1 2024-01-25T15:03:42.860 INFO:tasks.workunit.client.0.smithi170.stdout:4/489: write d6/d28/d59/d7d/d6b/f6d [651779,102024] 0 2024-01-25T15:03:42.861 INFO:tasks.workunit.client.0.smithi170.stdout:9/577: mkdir d5/dc/dce 0 2024-01-25T15:03:42.863 INFO:tasks.workunit.client.0.smithi170.stdout:9/578: getdents d5/df/d16/d35/d3c 0 2024-01-25T15:03:42.865 INFO:tasks.workunit.client.0.smithi170.stdout:9/579: symlink d5/df/d2e/d77/d21/d46/d6c/dac/lcf 0 2024-01-25T15:03:42.865 INFO:tasks.workunit.client.0.smithi170.stdout:9/580: fsync d5/df/d16/d35/fc5 0 2024-01-25T15:03:42.865 INFO:tasks.workunit.client.0.smithi170.stdout:9/581: fdatasync d5/f8f 0 2024-01-25T15:03:42.866 INFO:tasks.workunit.client.0.smithi170.stdout:9/582: link d5/df/d2e/d77/d21/d46/f81 d5/df/d2e/d6b/fd0 0 2024-01-25T15:03:42.867 INFO:tasks.workunit.client.0.smithi170.stdout:9/583: symlink d5/df/d2e/d77/d21/d46/d6c/ld1 0 2024-01-25T15:03:42.867 INFO:tasks.workunit.client.0.smithi170.stdout:9/584: write d5/dc/fd [3230665,65981] 0 2024-01-25T15:03:42.868 INFO:tasks.workunit.client.0.smithi170.stdout:9/585: mkdir d5/df/d2e/d6b/dd2 0 2024-01-25T15:03:42.868 INFO:tasks.workunit.client.0.smithi170.stdout:0/603: dwrite d8/d10/d5a/f6c [4194304,4194304] 0 2024-01-25T15:03:42.869 INFO:tasks.workunit.client.0.smithi170.stdout:0/604: creat d8/d10/d2d/d2f/d96/db7/fd1 x:0 0 0 2024-01-25T15:03:42.869 INFO:tasks.workunit.client.0.smithi170.stdout:6/655: dread d2/d7/d23/d19/f6a [0,4194304] 0 2024-01-25T15:03:42.870 INFO:tasks.workunit.client.0.smithi170.stdout:6/656: dread d2/f7b [0,4194304] 0 2024-01-25T15:03:42.871 INFO:tasks.workunit.client.0.smithi170.stdout:9/586: dread d5/dc/f36 [0,4194304] 0 2024-01-25T15:03:42.871 INFO:tasks.workunit.client.0.smithi170.stdout:9/587: readlink d5/df/l99 0 2024-01-25T15:03:42.871 INFO:tasks.workunit.client.0.smithi170.stdout:9/588: chown d5/df/d2e/f93 245 1 2024-01-25T15:03:42.873 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:42 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] up:active 2024-01-25T15:03:42.873 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:42 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:42.875 INFO:tasks.workunit.client.0.smithi170.stdout:0/605: dread d8/d10/d2d/d2f/d4f/d5f/f8f [0,4194304] 0 2024-01-25T15:03:42.880 INFO:tasks.workunit.client.0.smithi170.stdout:4/490: rename d6/d28/d67/l6a to d6/d7/d31/d46/l94 0 2024-01-25T15:03:42.882 INFO:tasks.workunit.client.0.smithi170.stdout:6/657: rename d2/d7/d23/d19/d2a/f92 to d2/d7/d23/d19/d2f/d74/dbd/fe5 0 2024-01-25T15:03:42.882 INFO:tasks.workunit.client.0.smithi170.stdout:6/658: fdatasync d2/d7/d23/d19/d2a/d6b/fa8 0 2024-01-25T15:03:42.883 INFO:tasks.workunit.client.0.smithi170.stdout:0/606: dread d8/d9/fe [0,4194304] 0 2024-01-25T15:03:42.884 INFO:tasks.workunit.client.0.smithi170.stdout:6/659: rename d2/d7/d23/d19/d2a/d43/d44/d8b to d2/d7/d1b/de6 0 2024-01-25T15:03:42.885 INFO:tasks.workunit.client.0.smithi170.stdout:0/607: rename d8/d10/d2d/d2f/d4f/d59/c5e to d8/d10/d5a/cd2 0 2024-01-25T15:03:42.886 INFO:tasks.workunit.client.0.smithi170.stdout:0/608: mknod d8/d10/d2d/d2f/cd3 0 2024-01-25T15:03:42.886 INFO:tasks.workunit.client.0.smithi170.stdout:0/609: chown d8/d10/l2a 799441 1 2024-01-25T15:03:42.888 INFO:tasks.workunit.client.0.smithi170.stdout:4/491: dread d6/d28/f45 [0,4194304] 0 2024-01-25T15:03:42.888 INFO:tasks.workunit.client.0.smithi170.stdout:9/589: dwrite d5/df/d2e/d77/f57 [0,4194304] 0 2024-01-25T15:03:42.892 INFO:tasks.workunit.client.0.smithi170.stdout:4/492: creat d6/d7/d31/d46/d78/f95 x:0 0 0 2024-01-25T15:03:42.893 INFO:tasks.workunit.client.0.smithi170.stdout:9/590: dread d5/df/d2e/d6b/f72 [0,4194304] 0 2024-01-25T15:03:42.893 INFO:tasks.workunit.client.0.smithi170.stdout:4/493: truncate d6/d28/f52 90076 0 2024-01-25T15:03:42.895 INFO:tasks.workunit.client.0.smithi170.stdout:6/660: dread d2/d7/d1b/f1f [0,4194304] 0 2024-01-25T15:03:42.899 INFO:tasks.workunit.client.0.smithi170.stdout:2/618: sync 2024-01-25T15:03:42.899 INFO:tasks.workunit.client.0.smithi170.stdout:8/661: sync 2024-01-25T15:03:42.899 INFO:tasks.workunit.client.0.smithi170.stdout:8/662: dread - d3/d7/fb4 zero size 2024-01-25T15:03:42.900 INFO:tasks.workunit.client.0.smithi170.stdout:2/619: fsync d10/d1e/d32/d3e/d41/dc4/dc6/d42/f48 0 2024-01-25T15:03:42.900 INFO:tasks.workunit.client.0.smithi170.stdout:8/663: stat d3/d7/d22/d23/d48/cc7 0 2024-01-25T15:03:42.900 INFO:tasks.workunit.client.0.smithi170.stdout:2/620: write d10/d1e/d32/f66 [607327,7399] 0 2024-01-25T15:03:42.900 INFO:tasks.workunit.client.0.smithi170.stdout:2/621: read d10/d1e/d32/d63/f8e [1410381,107251] 0 2024-01-25T15:03:42.902 INFO:tasks.workunit.client.0.smithi170.stdout:8/664: creat d3/d7/d22/d80/fe1 x:0 0 0 2024-01-25T15:03:42.902 INFO:tasks.workunit.client.0.smithi170.stdout:8/665: chown d3/d7/d3a/cdf 41352 1 2024-01-25T15:03:42.902 INFO:tasks.workunit.client.0.smithi170.stdout:8/666: fdatasync d3/d7/d22/d23/d48/d52/f43 0 2024-01-25T15:03:42.902 INFO:tasks.workunit.client.0.smithi170.stdout:8/667: write d3/d7/d22/d23/d25/d41/d61/fda [172877,109710] 0 2024-01-25T15:03:42.902 INFO:tasks.workunit.client.0.smithi170.stdout:8/668: stat d3/d7/d22/f5a 0 2024-01-25T15:03:42.902 INFO:tasks.workunit.client.0.smithi170.stdout:8/669: write d3/d7/d22/d5d/f6e [4711901,51743] 0 2024-01-25T15:03:42.902 INFO:tasks.workunit.client.0.smithi170.stdout:8/670: fdatasync d3/d7/d22/d23/d48/d52/d47/fbc 0 2024-01-25T15:03:42.902 INFO:tasks.workunit.client.0.smithi170.stdout:9/591: truncate d5/df/d2e/d77/f57 523803 0 2024-01-25T15:03:42.902 INFO:tasks.workunit.client.0.smithi170.stdout:9/592: fdatasync d5/df/d2e/d77/d21/d34/d3e/d7f/fc8 0 2024-01-25T15:03:42.902 INFO:tasks.workunit.client.0.smithi170.stdout:9/593: readlink l3 0 2024-01-25T15:03:42.903 INFO:tasks.workunit.client.0.smithi170.stdout:8/671: mkdir d3/d7/d22/d23/d48/d52/d47/de2 0 2024-01-25T15:03:42.904 INFO:tasks.workunit.client.0.smithi170.stdout:8/672: getdents d3/d7/d3a/d91/d7f 0 2024-01-25T15:03:42.908 INFO:tasks.workunit.client.0.smithi170.stdout:9/594: stat d5/df/d2e/d77/d21/d63/d96/fb8 0 2024-01-25T15:03:42.909 INFO:tasks.workunit.client.0.smithi170.stdout:9/595: rmdir d5/dc 39 2024-01-25T15:03:42.913 INFO:tasks.workunit.client.0.smithi170.stdout:0/610: dwrite d8/d9/d9a/f87 [0,4194304] 0 2024-01-25T15:03:42.913 INFO:tasks.workunit.client.0.smithi170.stdout:5/613: sync 2024-01-25T15:03:42.914 INFO:tasks.workunit.client.0.smithi170.stdout:3/647: sync 2024-01-25T15:03:42.914 INFO:tasks.workunit.client.0.smithi170.stdout:1/612: sync 2024-01-25T15:03:42.914 INFO:tasks.workunit.client.0.smithi170.stdout:5/614: creat d5/d58/da9/fd6 x:0 0 0 2024-01-25T15:03:42.914 INFO:tasks.workunit.client.0.smithi170.stdout:5/615: truncate d5/d54/d85/d2c/d34/d69/fbb 778502 0 2024-01-25T15:03:42.916 INFO:tasks.workunit.client.0.smithi170.stdout:3/648: mknod d3/d10/d1e/d21/d41/d4b/cd0 0 2024-01-25T15:03:42.923 INFO:tasks.workunit.client.0.smithi170.stdout:3/649: mknod d3/d3b/d4f/da0/dcb/cd1 0 2024-01-25T15:03:42.923 INFO:tasks.workunit.client.0.smithi170.stdout:3/650: chown d3/d1c/d2b/fc1 12794 1 2024-01-25T15:03:42.923 INFO:tasks.workunit.client.0.smithi170.stdout:5/616: mkdir d5/d54/d85/d3f/d86/dd7 0 2024-01-25T15:03:42.923 INFO:tasks.workunit.client.0.smithi170.stdout:0/611: getdents d8/d9/db4 0 2024-01-25T15:03:42.925 INFO:tasks.workunit.client.0.smithi170.stdout:3/651: creat d3/d3b/d4f/da0/dcb/fd2 x:0 0 0 2024-01-25T15:03:42.926 INFO:tasks.workunit.client.0.smithi170.stdout:4/494: dwrite d6/d7/d1b/f41 [0,4194304] 0 2024-01-25T15:03:42.927 INFO:tasks.workunit.client.0.smithi170.stdout:4/495: truncate d6/d28/d59/d7d/f5c 174430 0 2024-01-25T15:03:42.927 INFO:tasks.workunit.client.0.smithi170.stdout:4/496: truncate d6/d28/d59/d7d/f83 305608 0 2024-01-25T15:03:42.932 INFO:tasks.workunit.client.0.smithi170.stdout:7/615: sync 2024-01-25T15:03:42.934 INFO:tasks.workunit.client.0.smithi170.stdout:7/616: creat d8/d20/d2a/d35/d55/d7d/da6/dd1/fe9 x:0 0 0 2024-01-25T15:03:42.935 INFO:tasks.workunit.client.0.smithi170.stdout:7/617: dread - d8/d20/d3b/fae zero size 2024-01-25T15:03:42.936 INFO:tasks.workunit.client.0.smithi170.stdout:7/618: symlink d8/d20/d2a/d35/d55/d7d/da6/lea 0 2024-01-25T15:03:42.937 INFO:tasks.workunit.client.0.smithi170.stdout:2/622: dwrite d10/d1e/d5e/d73/f7f [0,4194304] 0 2024-01-25T15:03:42.938 INFO:tasks.workunit.client.0.smithi170.stdout:7/619: dread d8/d20/d3b/f6a [0,4194304] 0 2024-01-25T15:03:42.941 INFO:tasks.workunit.client.0.smithi170.stdout:9/596: dwrite d5/df/f1a [4194304,4194304] 0 2024-01-25T15:03:42.942 INFO:tasks.workunit.client.0.smithi170.stdout:1/613: dwrite d0/d91/fc8 [0,4194304] 0 2024-01-25T15:03:42.943 INFO:tasks.workunit.client.0.smithi170.stdout:2/623: link d10/d1e/d5e/d73/d9e/da3/lc2 d10/d1b/le1 0 2024-01-25T15:03:42.945 INFO:tasks.workunit.client.0.smithi170.stdout:9/597: mknod d5/df/d16/d35/d3c/d56/cd3 0 2024-01-25T15:03:42.946 INFO:tasks.workunit.client.0.smithi170.stdout:7/620: rmdir d8/d20/d45/d68/daa 39 2024-01-25T15:03:42.948 INFO:tasks.workunit.client.0.smithi170.stdout:2/624: rmdir d10/d1e/d32/d98/dab 39 2024-01-25T15:03:42.949 INFO:tasks.workunit.client.0.smithi170.stdout:8/673: dwrite d3/d7/d22/d23/d48/d52/d47/fbc [0,4194304] 0 2024-01-25T15:03:42.949 INFO:tasks.workunit.client.0.smithi170.stdout:7/621: mkdir d8/d20/d2a/d35/d55/d7d/da6/dd1/deb 0 2024-01-25T15:03:42.950 INFO:tasks.workunit.client.0.smithi170.stdout:7/622: stat d8/d20/d3b/f8d 0 2024-01-25T15:03:42.950 INFO:tasks.workunit.client.0.smithi170.stdout:7/623: chown d8/f1e 1591605212 1 2024-01-25T15:03:42.950 INFO:tasks.workunit.client.0.smithi170.stdout:9/598: dread d5/df/d16/d35/d3c/d56/d59/f80 [0,4194304] 0 2024-01-25T15:03:42.950 INFO:tasks.workunit.client.0.smithi170.stdout:9/599: fsync d5/df/d2e/d77/d21/d34/d3e/d7f/fb3 0 2024-01-25T15:03:42.951 INFO:tasks.workunit.client.0.smithi170.stdout:8/674: dread d3/d7/d1e/f66 [0,4194304] 0 2024-01-25T15:03:42.952 INFO:tasks.workunit.client.0.smithi170.stdout:7/624: creat d8/d20/d45/fec x:0 0 0 2024-01-25T15:03:42.958 INFO:tasks.workunit.client.0.smithi170.stdout:7/625: getdents d8/d20/d2a/d35/d55/d7d/da6 0 2024-01-25T15:03:42.959 INFO:tasks.workunit.client.0.smithi170.stdout:3/652: dwrite d3/d10/f23 [4194304,4194304] 0 2024-01-25T15:03:42.959 INFO:tasks.workunit.client.0.smithi170.stdout:4/497: dwrite d6/d7/d31/d7e/f5b [0,4194304] 0 2024-01-25T15:03:42.960 INFO:tasks.workunit.client.0.smithi170.stdout:4/498: creat d6/d28/d67/f96 x:0 0 0 2024-01-25T15:03:42.961 INFO:tasks.workunit.client.0.smithi170.stdout:4/499: write d6/d28/d59/d7d/f6c [814811,11552] 0 2024-01-25T15:03:42.963 INFO:tasks.workunit.client.0.smithi170.stdout:4/500: link d6/d28/d59/d7d/f24 d6/d28/d59/d7d/f97 0 2024-01-25T15:03:42.966 INFO:tasks.workunit.client.0.smithi170.stdout:8/675: read d3/d7/d22/d5d/f6e [2462028,123762] 0 2024-01-25T15:03:42.966 INFO:tasks.workunit.client.0.smithi170.stdout:1/614: dwrite d0/d1b/fa1 [0,4194304] 0 2024-01-25T15:03:42.967 INFO:tasks.workunit.client.0.smithi170.stdout:9/600: dread d5/df/d2e/d77/d21/d63/d96/fb8 [0,4194304] 0 2024-01-25T15:03:42.967 INFO:tasks.workunit.client.0.smithi170.stdout:9/601: fsync d5/dc/f30 0 2024-01-25T15:03:42.968 INFO:tasks.workunit.client.0.smithi170.stdout:8/676: rename d3/d7/d22/d23/d25/fe0 to d3/d7/fe3 0 2024-01-25T15:03:42.969 INFO:tasks.workunit.client.0.smithi170.stdout:9/602: dread d5/df/d2e/d77/d21/d34/f5b [0,4194304] 0 2024-01-25T15:03:42.969 INFO:tasks.workunit.client.0.smithi170.stdout:8/677: creat d3/d7/d22/d23/d25/d41/da9/fe4 x:0 0 0 2024-01-25T15:03:42.969 INFO:tasks.workunit.client.0.smithi170.stdout:8/678: readlink d3/d7/d3a/d91/lc5 0 2024-01-25T15:03:42.971 INFO:tasks.workunit.client.0.smithi170.stdout:8/679: rmdir d3/d7/d73/dba 39 2024-01-25T15:03:42.971 INFO:tasks.workunit.client.0.smithi170.stdout:8/680: creat d3/d7/d1e/d7c/d9f/fe5 x:0 0 0 2024-01-25T15:03:42.972 INFO:tasks.workunit.client.0.smithi170.stdout:7/626: dread d8/d20/d2a/f5a [0,4194304] 0 2024-01-25T15:03:42.973 INFO:tasks.workunit.client.0.smithi170.stdout:7/627: truncate f7 3165829 0 2024-01-25T15:03:42.973 INFO:tasks.workunit.client.0.smithi170.stdout:7/628: chown d8/d20/d2a/d61/f63 7 1 2024-01-25T15:03:42.973 INFO:tasks.workunit.client.0.smithi170.stdout:7/629: fdatasync d8/d20/d2a/d35/d55/d7d/fda 0 2024-01-25T15:03:42.974 INFO:tasks.workunit.client.0.smithi170.stdout:7/630: fsync d8/d20/d3b/f8d 0 2024-01-25T15:03:42.974 INFO:tasks.workunit.client.0.smithi170.stdout:7/631: write d8/d20/d45/f46 [950747,104482] 0 2024-01-25T15:03:42.974 INFO:tasks.workunit.client.0.smithi170.stdout:3/653: link d3/d10/d1e/d21/d41/d77/f76 d3/d3b/dc6/fd3 0 2024-01-25T15:03:42.976 INFO:tasks.workunit.client.0.smithi170.stdout:7/632: creat d8/d20/d2a/d61/fed x:0 0 0 2024-01-25T15:03:42.976 INFO:tasks.workunit.client.0.smithi170.stdout:7/633: chown d8/d20/f30 114 1 2024-01-25T15:03:42.977 INFO:tasks.workunit.client.0.smithi170.stdout:3/654: creat d3/d1c/d2b/fd4 x:0 0 0 2024-01-25T15:03:42.977 INFO:tasks.workunit.client.0.smithi170.stdout:3/655: chown d3/d10/d13/d1b 1748157 1 2024-01-25T15:03:42.979 INFO:tasks.workunit.client.0.smithi170.stdout:7/634: fdatasync d8/d20/d45/f46 0 2024-01-25T15:03:42.981 INFO:tasks.workunit.client.0.smithi170.stdout:3/656: mknod d3/d10/d6d/d98/cd5 0 2024-01-25T15:03:42.981 INFO:tasks.workunit.client.0.smithi170.stdout:3/657: chown d3/d10/d13/d1b/c67 583 1 2024-01-25T15:03:42.981 INFO:tasks.workunit.client.0.smithi170.stdout:3/658: chown d3/d3b/dc6/d53/l6b 0 1 2024-01-25T15:03:42.982 INFO:tasks.workunit.client.0.smithi170.stdout:3/659: truncate d3/d10/d13/d1b/d81/f8d 893221 0 2024-01-25T15:03:42.995 INFO:tasks.workunit.client.0.smithi170.stdout:1/615: dwrite d0/d20/f4d [0,4194304] 0 2024-01-25T15:03:42.995 INFO:tasks.workunit.client.0.smithi170.stdout:4/501: dwrite d6/d7/d31/d7e/f5b [0,4194304] 0 2024-01-25T15:03:42.999 INFO:tasks.workunit.client.0.smithi170.stdout:4/502: rmdir d6/d28/d59 39 2024-01-25T15:03:43.000 INFO:tasks.workunit.client.0.smithi170.stdout:4/503: symlink d6/d7/d31/d7e/d80/l98 0 2024-01-25T15:03:43.002 INFO:tasks.workunit.client.0.smithi170.stdout:9/603: dwrite d5/df/d16/d35/d3c/f4e [0,4194304] 0 2024-01-25T15:03:43.002 INFO:tasks.workunit.client.0.smithi170.stdout:9/604: fdatasync d5/f37 0 2024-01-25T15:03:43.002 INFO:tasks.workunit.client.0.smithi170.stdout:9/605: readlink d5/df/d16/d35/d3c/d56/l69 0 2024-01-25T15:03:43.002 INFO:tasks.workunit.client.0.smithi170.stdout:9/606: dread - d5/df/d2e/d77/d21/d34/fcd zero size 2024-01-25T15:03:43.003 INFO:tasks.workunit.client.0.smithi170.stdout:4/504: creat d6/f99 x:0 0 0 2024-01-25T15:03:43.004 INFO:tasks.workunit.client.0.smithi170.stdout:4/505: creat d6/d28/d93/f9a x:0 0 0 2024-01-25T15:03:43.004 INFO:tasks.workunit.client.0.smithi170.stdout:7/635: dwrite f2 [0,4194304] 0 2024-01-25T15:03:43.004 INFO:tasks.workunit.client.0.smithi170.stdout:7/636: fsync d8/d20/d3b/fae 0 2024-01-25T15:03:43.004 INFO:tasks.workunit.client.0.smithi170.stdout:7/637: readlink d8/d20/d2a/l2b 0 2024-01-25T15:03:43.005 INFO:tasks.workunit.client.0.smithi170.stdout:9/607: rename f4 to d5/df/d16/d35/d3c/d56/d59/d5e/fd4 0 2024-01-25T15:03:43.006 INFO:tasks.workunit.client.0.smithi170.stdout:4/506: truncate d6/d7/f81 1040299 0 2024-01-25T15:03:43.006 INFO:tasks.workunit.client.0.smithi170.stdout:4/507: fsync d6/d7/d31/d7e/f5a 0 2024-01-25T15:03:43.007 INFO:tasks.workunit.client.0.smithi170.stdout:7/638: creat d8/d20/d45/d8e/fee x:0 0 0 2024-01-25T15:03:43.007 INFO:tasks.workunit.client.0.smithi170.stdout:7/639: write d8/d20/d3b/f8d [479941,65321] 0 2024-01-25T15:03:43.007 INFO:tasks.workunit.client.0.smithi170.stdout:4/508: mknod d6/d28/d67/c9b 0 2024-01-25T15:03:43.008 INFO:tasks.workunit.client.0.smithi170.stdout:4/509: mkdir d6/d7/d31/d7e/d9c 0 2024-01-25T15:03:43.010 INFO:tasks.workunit.client.0.smithi170.stdout:4/510: chown d6/d28/d59/d7d/c64 2345 1 2024-01-25T15:03:43.015 INFO:tasks.workunit.client.0.smithi170.stdout:9/608: read d5/df/f20 [3814052,126318] 0 2024-01-25T15:03:43.016 INFO:tasks.workunit.client.0.smithi170.stdout:9/609: mknod d5/dc/dce/cd5 0 2024-01-25T15:03:43.023 INFO:tasks.workunit.client.0.smithi170.stdout:3/660: dwrite d3/d10/d13/d1b/d29/f8b [0,4194304] 0 2024-01-25T15:03:43.026 INFO:tasks.workunit.client.0.smithi170.stdout:1/616: dwrite d0/d20/d3a/f53 [4194304,4194304] 0 2024-01-25T15:03:43.026 INFO:tasks.workunit.client.0.smithi170.stdout:1/617: stat d0/d1b 0 2024-01-25T15:03:43.026 INFO:tasks.workunit.client.0.smithi170.stdout:1/618: creat d0/d91/fce x:0 0 0 2024-01-25T15:03:43.027 INFO:tasks.workunit.client.0.smithi170.stdout:3/661: creat d3/d10/d13/d1b/d29/fd6 x:0 0 0 2024-01-25T15:03:43.030 INFO:tasks.workunit.client.0.smithi170.stdout:3/662: creat d3/d10/d13/d1b/db3/fd7 x:0 0 0 2024-01-25T15:03:43.035 INFO:tasks.workunit.client.0.smithi170.stdout:3/663: unlink d3/d10/d1e/d21/d41/d4b/fc9 0 2024-01-25T15:03:43.035 INFO:tasks.workunit.client.0.smithi170.stdout:3/664: creat d3/d10/d1e/d21/d41/d4a/dc3/fd8 x:0 0 0 2024-01-25T15:03:43.036 INFO:tasks.workunit.client.0.smithi170.stdout:3/665: mknod d3/d1c/cd9 0 2024-01-25T15:03:43.036 INFO:tasks.workunit.client.0.smithi170.stdout:3/666: readlink d3/d10/d6d/d98/lc2 0 2024-01-25T15:03:43.036 INFO:tasks.workunit.client.0.smithi170.stdout:3/667: chown d3/d1c/d2b/d5c/d97 6250121 1 2024-01-25T15:03:43.036 INFO:tasks.workunit.client.0.smithi170.stdout:7/640: dwrite d8/d20/d2a/d35/d55/fe8 [0,4194304] 0 2024-01-25T15:03:43.036 INFO:tasks.workunit.client.0.smithi170.stdout:7/641: fsync d8/d20/d2a/d35/d55/d7d/fc5 0 2024-01-25T15:03:43.036 INFO:tasks.workunit.client.0.smithi170.stdout:3/668: creat d3/d3b/fda x:0 0 0 2024-01-25T15:03:43.038 INFO:tasks.workunit.client.0.smithi170.stdout:7/642: creat d8/d20/fef x:0 0 0 2024-01-25T15:03:43.038 INFO:tasks.workunit.client.0.smithi170.stdout:7/643: readlink d8/d20/d2a/d35/d55/d7d/da6/le6 0 2024-01-25T15:03:43.042 INFO:tasks.workunit.client.0.smithi170.stdout:4/511: dwrite d6/d28/d59/d7d/d6b/f88 [0,4194304] 0 2024-01-25T15:03:43.042 INFO:tasks.workunit.client.0.smithi170.stdout:4/512: creat d6/d28/d67/f9d x:0 0 0 2024-01-25T15:03:43.042 INFO:tasks.workunit.client.0.smithi170.stdout:4/513: write d6/d7/d31/d46/f92 [292348,11776] 0 2024-01-25T15:03:43.042 INFO:tasks.workunit.client.0.smithi170.stdout:4/514: truncate d6/d7/d31/d46/d78/f95 917478 0 2024-01-25T15:03:43.042 INFO:tasks.workunit.client.0.smithi170.stdout:4/515: write d6/d7/d1b/f3b [691434,96270] 0 2024-01-25T15:03:43.044 INFO:tasks.workunit.client.0.smithi170.stdout:1/619: dread d0/fd [4194304,4194304] 0 2024-01-25T15:03:43.045 INFO:tasks.workunit.client.0.smithi170.stdout:1/620: write d0/d20/d28/d2a/d4a/d56/d5b/d72/fba [829367,27625] 0 2024-01-25T15:03:43.045 INFO:tasks.workunit.client.0.smithi170.stdout:1/621: fdatasync d0/d20/d28/fc5 0 2024-01-25T15:03:43.046 INFO:tasks.workunit.client.0.smithi170.stdout:3/669: write d3/d1c/d2d/f35 [4704366,103716] 0 2024-01-25T15:03:43.046 INFO:tasks.workunit.client.0.smithi170.stdout:4/516: symlink d6/d7/d31/l9e 0 2024-01-25T15:03:43.048 INFO:tasks.workunit.client.0.smithi170.stdout:6/661: sync 2024-01-25T15:03:43.049 INFO:tasks.workunit.client.0.smithi170.stdout:6/662: write d2/d7/d23/d19/d2a/d43/d44/f7c [605113,43877] 0 2024-01-25T15:03:43.049 INFO:tasks.workunit.client.0.smithi170.stdout:1/622: truncate d0/d20/d28/d2a/f5e 542856 0 2024-01-25T15:03:43.049 INFO:tasks.workunit.client.0.smithi170.stdout:3/670: mknod d3/d3b/dc6/cdb 0 2024-01-25T15:03:43.050 INFO:tasks.workunit.client.0.smithi170.stdout:3/671: chown d3/d10/d13/d1b/d85 1759671 1 2024-01-25T15:03:43.051 INFO:tasks.workunit.client.0.smithi170.stdout:6/663: truncate d2/d7/f2e 209970 0 2024-01-25T15:03:43.051 INFO:tasks.workunit.client.0.smithi170.stdout:9/610: dwrite d5/df/d2e/d77/d21/d46/d18/d6a/f8b [0,4194304] 0 2024-01-25T15:03:43.052 INFO:tasks.workunit.client.0.smithi170.stdout:1/623: unlink d0/f41 0 2024-01-25T15:03:43.054 INFO:tasks.workunit.client.0.smithi170.stdout:6/664: creat d2/d7/d23/d19/d2f/d5d/d94/d97/db4/fe7 x:0 0 0 2024-01-25T15:03:43.057 INFO:tasks.workunit.client.0.smithi170.stdout:6/665: creat d2/d7/d1b/d28/da7/dd2/fe8 x:0 0 0 2024-01-25T15:03:43.060 INFO:tasks.workunit.client.0.smithi170.stdout:6/666: rename d2/d7/l67 to d2/d7/d23/d19/d2f/d5d/d94/d97/db4/dd3/le9 0 2024-01-25T15:03:43.061 INFO:tasks.workunit.client.0.smithi170.stdout:7/644: dwrite d8/f52 [0,4194304] 0 2024-01-25T15:03:43.084 INFO:tasks.workunit.client.0.smithi170.stdout:3/672: dwrite d3/d10/d6d/d74/f66 [4194304,4194304] 0 2024-01-25T15:03:43.084 INFO:tasks.workunit.client.0.smithi170.stdout:1/624: dwrite d0/d91/fce [0,4194304] 0 2024-01-25T15:03:43.087 INFO:tasks.workunit.client.0.smithi170.stdout:1/625: link d0/d20/d28/d2a/d4a/d56/l7c d0/d20/d3a/dad/lcf 0 2024-01-25T15:03:43.088 INFO:tasks.workunit.client.0.smithi170.stdout:1/626: rename d0/d20/d28/f36 to d0/d20/d28/d2a/d4a/d56/dc1/fd0 0 2024-01-25T15:03:43.088 INFO:tasks.workunit.client.0.smithi170.stdout:1/627: stat d0/d50/da0/d9c/fc3 0 2024-01-25T15:03:43.096 INFO:tasks.workunit.client.0.smithi170.stdout:4/517: dwrite d6/d7/d31/f4d [4194304,4194304] 0 2024-01-25T15:03:43.097 INFO:tasks.workunit.client.0.smithi170.stdout:6/667: dwrite d2/d7/d1b/d28/f96 [0,4194304] 0 2024-01-25T15:03:43.097 INFO:tasks.workunit.client.0.smithi170.stdout:9/611: dwrite d5/df/d2e/d77/faf [0,4194304] 0 2024-01-25T15:03:43.099 INFO:tasks.workunit.client.0.smithi170.stdout:3/673: write d3/d10/f23 [5579529,33305] 0 2024-01-25T15:03:43.105 INFO:tasks.workunit.client.0.smithi170.stdout:1/628: dread d0/f6d [0,4194304] 0 2024-01-25T15:03:43.106 INFO:tasks.workunit.client.0.smithi170.stdout:3/674: link d3/l3f d3/d10/d1e/d21/d41/d4b/d63/dc7/ldc 0 2024-01-25T15:03:43.107 INFO:tasks.workunit.client.0.smithi170.stdout:1/629: dread d0/d2e/fbd [0,4194304] 0 2024-01-25T15:03:43.115 INFO:tasks.workunit.client.0.smithi170.stdout:9/612: write d5/df/d2e/d77/d21/d63/d96/fb8 [463294,37559] 0 2024-01-25T15:03:43.117 INFO:tasks.workunit.client.0.smithi170.stdout:9/613: truncate d5/df/f1a 4820216 0 2024-01-25T15:03:43.117 INFO:tasks.workunit.client.0.smithi170.stdout:9/614: chown d5/df/d2e/d77/d21/d46/d6c 43 1 2024-01-25T15:03:43.117 INFO:tasks.workunit.client.0.smithi170.stdout:9/615: chown d5/dc/d42/l4f 24 1 2024-01-25T15:03:43.119 INFO:tasks.workunit.client.0.smithi170.stdout:3/675: dread d3/d10/d13/d1b/d29/f8b [0,4194304] 0 2024-01-25T15:03:43.121 INFO:tasks.workunit.client.0.smithi170.stdout:3/676: mknod d3/d10/d13/d1b/d85/cdd 0 2024-01-25T15:03:43.121 INFO:tasks.workunit.client.0.smithi170.stdout:3/677: chown d3/d10/d13/fc8 3114 1 2024-01-25T15:03:43.121 INFO:tasks.workunit.client.0.smithi170.stdout:3/678: fdatasync d3/d3b/dc6/f5f 0 2024-01-25T15:03:43.121 INFO:tasks.workunit.client.0.smithi170.stdout:3/679: mknod d3/d3b/dc6/d53/cde 0 2024-01-25T15:03:43.121 INFO:tasks.workunit.client.0.smithi170.stdout:3/680: stat d3/d10/f23 0 2024-01-25T15:03:43.122 INFO:tasks.workunit.client.0.smithi170.stdout:3/681: write d3/d88/fce [949838,61329] 0 2024-01-25T15:03:43.122 INFO:tasks.workunit.client.0.smithi170.stdout:3/682: mkdir d3/d3b/d4f/da0/ddf 0 2024-01-25T15:03:43.123 INFO:tasks.workunit.client.0.smithi170.stdout:4/518: dwrite d6/d7/d1b/f41 [0,4194304] 0 2024-01-25T15:03:43.130 INFO:tasks.workunit.client.0.smithi170.stdout:4/519: dread d6/d28/d59/d7d/f6c [0,4194304] 0 2024-01-25T15:03:43.130 INFO:tasks.workunit.client.0.smithi170.stdout:9/616: write d5/df/d16/d35/d3c/d56/d59/d5e/f97 [4041813,104014] 0 2024-01-25T15:03:43.130 INFO:tasks.workunit.client.0.smithi170.stdout:6/668: dwrite d2/d7/d1b/f64 [0,4194304] 0 2024-01-25T15:03:43.130 INFO:tasks.workunit.client.0.smithi170.stdout:9/617: chown d5/df/d2e/d77/d21/d63/d96 41 1 2024-01-25T15:03:43.133 INFO:tasks.workunit.client.0.smithi170.stdout:4/520: dread d6/d28/d59/d7d/f24 [0,4194304] 0 2024-01-25T15:03:43.134 INFO:tasks.workunit.client.0.smithi170.stdout:4/521: chown d6/d7/d31/d7e/f40 2 1 2024-01-25T15:03:43.134 INFO:tasks.workunit.client.0.smithi170.stdout:4/522: fdatasync d6/d7/d31/f4d 0 2024-01-25T15:03:43.134 INFO:tasks.workunit.client.0.smithi170.stdout:6/669: unlink d2/d7/d1b/d28/f49 0 2024-01-25T15:03:43.135 INFO:tasks.workunit.client.0.smithi170.stdout:6/670: mkdir d2/d7/d23/d19/d2f/d74/dce/ddf/de2/dea 0 2024-01-25T15:03:43.137 INFO:tasks.workunit.client.0.smithi170.stdout:6/671: creat d2/d7/d23/d19/d2a/d43/feb x:0 0 0 2024-01-25T15:03:43.137 INFO:tasks.workunit.client.0.smithi170.stdout:6/672: write d2/d7/d23/d19/d2f/d5d/f6f [1289848,100067] 0 2024-01-25T15:03:43.144 INFO:tasks.workunit.client.0.smithi170.stdout:3/683: dwrite d3/d10/d1e/d21/fa6 [0,4194304] 0 2024-01-25T15:03:43.151 INFO:tasks.workunit.client.0.smithi170.stdout:5/617: sync 2024-01-25T15:03:43.151 INFO:tasks.workunit.client.0.smithi170.stdout:0/612: sync 2024-01-25T15:03:43.151 INFO:tasks.workunit.client.0.smithi170.stdout:0/613: truncate d8/d80/f91 2569154 0 2024-01-25T15:03:43.154 INFO:tasks.workunit.client.0.smithi170.stdout:5/618: symlink d5/d54/d85/d3f/d8f/ld8 0 2024-01-25T15:03:43.155 INFO:tasks.workunit.client.0.smithi170.stdout:0/614: mknod d8/d10/cd4 0 2024-01-25T15:03:43.168 INFO:tasks.workunit.client.0.smithi170.stdout:9/618: dwrite d5/df/f1a [4194304,4194304] 0 2024-01-25T15:03:43.168 INFO:tasks.workunit.client.0.smithi170.stdout:4/523: dwrite d6/d28/f52 [0,4194304] 0 2024-01-25T15:03:43.169 INFO:tasks.workunit.client.0.smithi170.stdout:0/615: read d8/d10/d2d/d53/f63 [2440980,21725] 0 2024-01-25T15:03:43.170 INFO:tasks.workunit.client.0.smithi170.stdout:6/673: dwrite d2/d7/d23/d19/d2f/d74/dbd/fe5 [0,4194304] 0 2024-01-25T15:03:43.170 INFO:tasks.workunit.client.0.smithi170.stdout:9/619: unlink d5/df/d16/d35/d3c/d91/cc2 0 2024-01-25T15:03:43.170 INFO:tasks.workunit.client.0.smithi170.stdout:9/620: chown d5/f8 94082730 1 2024-01-25T15:03:43.170 INFO:tasks.workunit.client.0.smithi170.stdout:9/621: fsync d5/f14 0 2024-01-25T15:03:43.171 INFO:tasks.workunit.client.0.smithi170.stdout:4/524: mkdir d6/d7/d9f 0 2024-01-25T15:03:43.175 INFO:tasks.workunit.client.0.smithi170.stdout:6/674: symlink d2/d7/d23/d19/d2a/d6b/dad/lec 0 2024-01-25T15:03:43.176 INFO:tasks.workunit.client.0.smithi170.stdout:4/525: truncate d6/d7/f1a 2189285 0 2024-01-25T15:03:43.178 INFO:tasks.workunit.client.0.smithi170.stdout:4/526: read d6/d7/d31/d46/d78/f95 [573924,112955] 0 2024-01-25T15:03:43.178 INFO:tasks.workunit.client.0.smithi170.stdout:4/527: creat d6/fa0 x:0 0 0 2024-01-25T15:03:43.178 INFO:tasks.workunit.client.0.smithi170.stdout:4/528: stat d6/d7/d1b/c32 0 2024-01-25T15:03:43.178 INFO:tasks.workunit.client.0.smithi170.stdout:4/529: write d6/f99 [904689,5755] 0 2024-01-25T15:03:43.178 INFO:tasks.workunit.client.0.smithi170.stdout:6/675: mkdir d2/d7/d23/d19/d2f/dd4/ded 0 2024-01-25T15:03:43.178 INFO:tasks.workunit.client.0.smithi170.stdout:6/676: write d2/f82 [337489,56692] 0 2024-01-25T15:03:43.179 INFO:tasks.workunit.client.0.smithi170.stdout:4/530: creat d6/d28/d61/fa1 x:0 0 0 2024-01-25T15:03:43.179 INFO:tasks.workunit.client.0.smithi170.stdout:4/531: write d6/f75 [536891,114967] 0 2024-01-25T15:03:43.180 INFO:tasks.workunit.client.0.smithi170.stdout:0/616: dread d8/d10/d2d/d2f/f37 [0,4194304] 0 2024-01-25T15:03:43.181 INFO:tasks.workunit.client.0.smithi170.stdout:6/677: mknod d2/d7/cee 0 2024-01-25T15:03:43.181 INFO:tasks.workunit.client.0.smithi170.stdout:8/681: sync 2024-01-25T15:03:43.181 INFO:tasks.workunit.client.0.smithi170.stdout:2/625: sync 2024-01-25T15:03:43.181 INFO:tasks.workunit.client.0.smithi170.stdout:8/682: readlink d3/d7/d3a/d91/d7f/ld2 0 2024-01-25T15:03:43.182 INFO:tasks.workunit.client.0.smithi170.stdout:4/532: creat d6/d7/fa2 x:0 0 0 2024-01-25T15:03:43.183 INFO:tasks.workunit.client.0.smithi170.stdout:0/617: creat d8/d10/d2d/d2f/d4f/d59/fd5 x:0 0 0 2024-01-25T15:03:43.183 INFO:tasks.workunit.client.0.smithi170.stdout:0/618: readlink d8/d10/d2d/d2f/l92 0 2024-01-25T15:03:43.184 INFO:tasks.workunit.client.0.smithi170.stdout:6/678: mknod d2/d7/d23/d19/d2f/d74/dc1/cef 0 2024-01-25T15:03:43.184 INFO:tasks.workunit.client.0.smithi170.stdout:4/533: dread d6/d7/d1b/f3b [0,4194304] 0 2024-01-25T15:03:43.185 INFO:tasks.workunit.client.0.smithi170.stdout:8/683: creat d3/d7/d3a/d8d/dd5/fe6 x:0 0 0 2024-01-25T15:03:43.185 INFO:tasks.workunit.client.0.smithi170.stdout:8/684: fdatasync d3/d7/d22/d23/d48/d52/f43 0 2024-01-25T15:03:43.185 INFO:tasks.workunit.client.0.smithi170.stdout:9/622: dread d5/df/d2e/f93 [0,4194304] 0 2024-01-25T15:03:43.185 INFO:tasks.workunit.client.0.smithi170.stdout:9/623: read - d5/df/d2e/d77/d21/d34/d3e/d7f/fb3 zero size 2024-01-25T15:03:43.186 INFO:tasks.workunit.client.0.smithi170.stdout:8/685: mknod d3/d7/d3a/d91/ce7 0 2024-01-25T15:03:43.192 INFO:tasks.workunit.client.0.smithi170.stdout:9/624: dread d5/df/d16/d35/d3c/d56/d59/d5e/f97 [0,4194304] 0 2024-01-25T15:03:43.192 INFO:tasks.workunit.client.0.smithi170.stdout:9/625: read - d5/df/d2e/d77/d21/d46/f64 zero size 2024-01-25T15:03:43.192 INFO:tasks.workunit.client.0.smithi170.stdout:9/626: write d5/df/d2e/d77/f57 [1546502,108513] 0 2024-01-25T15:03:43.192 INFO:tasks.workunit.client.0.smithi170.stdout:9/627: fsync d5/df/d2e/d6b/f72 0 2024-01-25T15:03:43.192 INFO:tasks.workunit.client.0.smithi170.stdout:9/628: fsync d5/df/d16/d35/d3c/d56/d59/d5e/f87 0 2024-01-25T15:03:43.195 INFO:tasks.workunit.client.0.smithi170.stdout:9/629: mkdir d5/df/d16/d35/d3c/d91/dd6 0 2024-01-25T15:03:43.195 INFO:tasks.workunit.client.0.smithi170.stdout:9/630: stat d5/df/d2e/d6b/fd0 0 2024-01-25T15:03:43.204 INFO:tasks.workunit.client.0.smithi170.stdout:4/534: unlink d6/d7/c60 0 2024-01-25T15:03:43.205 INFO:tasks.workunit.client.0.smithi170.stdout:0/619: write d8/d18/f20 [2266316,46831] 0 2024-01-25T15:03:43.205 INFO:tasks.workunit.client.0.smithi170.stdout:9/631: write d5/df/d2e/d77/d21/d63/d96/fb8 [7375558,48226] 0 2024-01-25T15:03:43.207 INFO:tasks.workunit.client.0.smithi170.stdout:9/632: truncate d5/df/d2e/d77/d21/d46/d18/d6a/f74 45325 0 2024-01-25T15:03:43.207 INFO:tasks.workunit.client.0.smithi170.stdout:9/633: readlink d5/df/d16/d35/d3c/l9d 0 2024-01-25T15:03:43.207 INFO:tasks.workunit.client.0.smithi170.stdout:2/626: link d10/d1b/c31 d10/d1e/d32/d3e/d41/dc4/dc6/d42/daa/ce2 0 2024-01-25T15:03:43.209 INFO:tasks.workunit.client.0.smithi170.stdout:9/634: mkdir d5/dca/dd7 0 2024-01-25T15:03:43.209 INFO:tasks.workunit.client.0.smithi170.stdout:2/627: creat d10/d1e/d32/d3e/d5c/d92/fe3 x:0 0 0 2024-01-25T15:03:43.211 INFO:tasks.workunit.client.0.smithi170.stdout:6/679: dwrite d2/d7/d1b/d28/f76 [0,4194304] 0 2024-01-25T15:03:43.221 INFO:tasks.workunit.client.0.smithi170.stdout:4/535: dread d6/d7/f81 [0,4194304] 0 2024-01-25T15:03:43.221 INFO:tasks.workunit.client.0.smithi170.stdout:4/536: fsync d6/d7/d31/d7e/f74 0 2024-01-25T15:03:43.221 INFO:tasks.workunit.client.0.smithi170.stdout:4/537: write d6/d7/d31/d7e/f40 [745011,53490] 0 2024-01-25T15:03:43.221 INFO:tasks.workunit.client.0.smithi170.stdout:4/538: creat d6/d28/d93/fa3 x:0 0 0 2024-01-25T15:03:43.221 INFO:tasks.workunit.client.0.smithi170.stdout:2/628: getdents d10/d1e/d32/d62 0 2024-01-25T15:03:43.225 INFO:tasks.workunit.client.0.smithi170.stdout:4/539: dread d6/d28/d59/d7d/f5c [0,4194304] 0 2024-01-25T15:03:43.228 INFO:tasks.workunit.client.0.smithi170.stdout:9/635: rename d5/df/d2e/d77/d21/d63 to d5/df/d2e/d77/d21/d46/d6c/dd8 0 2024-01-25T15:03:43.232 INFO:tasks.workunit.client.0.smithi170.stdout:9/636: dread d5/df/d2e/f70 [0,4194304] 0 2024-01-25T15:03:43.233 INFO:tasks.workunit.client.0.smithi170.stdout:9/637: mkdir d5/df/d16/d35/d3c/d91/dd6/dd9 0 2024-01-25T15:03:43.234 INFO:tasks.workunit.client.0.smithi170.stdout:9/638: chown d5/df/d16/d35/d3c/d56/d59/d5e/f97 87511 1 2024-01-25T15:03:43.234 INFO:tasks.workunit.client.0.smithi170.stdout:2/629: dread d10/d1e/d32/d3e/d5c/f86 [0,4194304] 0 2024-01-25T15:03:43.235 INFO:tasks.workunit.client.0.smithi170.stdout:9/639: rename d5/l6 to d5/df/d2e/d77/d21/d46/d6c/lda 0 2024-01-25T15:03:43.235 INFO:tasks.workunit.client.0.smithi170.stdout:0/620: dwrite d8/d10/f2b [0,4194304] 0 2024-01-25T15:03:43.237 INFO:tasks.workunit.client.0.smithi170.stdout:9/640: unlink d5/df/d16/d35/d3c/d56/d59/fc6 0 2024-01-25T15:03:43.237 INFO:tasks.workunit.client.0.smithi170.stdout:9/641: dread - d5/df/d16/d35/d3c/fbf zero size 2024-01-25T15:03:43.241 INFO:tasks.workunit.client.0.smithi170.stdout:6/680: dwrite d2/d7/d23/d19/d2f/dd4/fd8 [0,4194304] 0 2024-01-25T15:03:43.241 INFO:tasks.workunit.client.0.smithi170.stdout:6/681: write d2/f40 [819047,78722] 0 2024-01-25T15:03:43.241 INFO:tasks.workunit.client.0.smithi170.stdout:9/642: rename d5/df/d16/d35/f5a to d5/df/d2e/d77/d21/d34/d3e/fdb 0 2024-01-25T15:03:43.247 INFO:tasks.workunit.client.0.smithi170.stdout:9/643: rmdir d5/df/d2e/d77/d21/daa 39 2024-01-25T15:03:43.247 INFO:tasks.workunit.client.0.smithi170.stdout:9/644: readlink d5/df/d16/l78 0 2024-01-25T15:03:43.247 INFO:tasks.workunit.client.0.smithi170.stdout:0/621: dread d8/d10/d2d/d53/f63 [0,4194304] 0 2024-01-25T15:03:43.248 INFO:tasks.workunit.client.0.smithi170.stdout:0/622: write d8/d18/f20 [513031,123747] 0 2024-01-25T15:03:43.248 INFO:tasks.workunit.client.0.smithi170.stdout:0/623: chown d8/d10/d2d/d58/f9f 1 1 2024-01-25T15:03:43.255 INFO:tasks.workunit.client.0.smithi170.stdout:6/682: rmdir d2/d7/d1b 39 2024-01-25T15:03:43.257 INFO:tasks.workunit.client.0.smithi170.stdout:9/645: rename d5/df/d2e/d77/d21/d46/f8e to d5/df/d2e/d77/d21/d46/fdc 0 2024-01-25T15:03:43.257 INFO:tasks.workunit.client.0.smithi170.stdout:9/646: chown d5/df/d16/d35/d3c/d56/d59/f80 45237 1 2024-01-25T15:03:43.257 INFO:tasks.workunit.client.0.smithi170.stdout:4/540: dwrite d6/d28/d67/f9d [0,4194304] 0 2024-01-25T15:03:43.257 INFO:tasks.workunit.client.0.smithi170.stdout:0/624: mkdir d8/d9/dd6 0 2024-01-25T15:03:43.258 INFO:tasks.workunit.client.0.smithi170.stdout:6/683: dread - d2/d7/d23/d19/d2a/d43/feb zero size 2024-01-25T15:03:43.258 INFO:tasks.workunit.client.0.smithi170.stdout:6/684: truncate d2/d7/d1b/f1f 5240339 0 2024-01-25T15:03:43.260 INFO:tasks.workunit.client.0.smithi170.stdout:0/625: truncate d8/d10/f69 1531886 0 2024-01-25T15:03:43.262 INFO:tasks.workunit.client.0.smithi170.stdout:0/626: mknod d8/d10/d2d/d2f/d4f/d59/cd7 0 2024-01-25T15:03:43.262 INFO:tasks.workunit.client.0.smithi170.stdout:0/627: fdatasync d8/d10/d77/fc0 0 2024-01-25T15:03:43.263 INFO:tasks.workunit.client.0.smithi170.stdout:0/628: truncate d8/d10/d2d/d53/f76 1157927 0 2024-01-25T15:03:43.263 INFO:tasks.workunit.client.0.smithi170.stdout:2/630: dwrite d10/fd8 [0,4194304] 0 2024-01-25T15:03:43.264 INFO:tasks.workunit.client.0.smithi170.stdout:4/541: unlink d6/d28/d61/c86 0 2024-01-25T15:03:43.265 INFO:tasks.workunit.client.0.smithi170.stdout:0/629: unlink d8/d9/d9a/f87 0 2024-01-25T15:03:43.265 INFO:tasks.workunit.client.0.smithi170.stdout:6/685: write d2/d7/d1b/d78/fb6 [2913506,7823] 0 2024-01-25T15:03:43.273 INFO:tasks.workunit.client.0.smithi170.stdout:2/631: creat d10/d1b/db6/dd7/fe4 x:0 0 0 2024-01-25T15:03:43.275 INFO:tasks.workunit.client.0.smithi170.stdout:4/542: symlink d6/d7/d31/d46/la4 0 2024-01-25T15:03:43.276 INFO:tasks.workunit.client.0.smithi170.stdout:7/645: sync 2024-01-25T15:03:43.277 INFO:tasks.workunit.client.0.smithi170.stdout:1/630: sync 2024-01-25T15:03:43.277 INFO:tasks.workunit.client.0.smithi170.stdout:5/619: sync 2024-01-25T15:03:43.278 INFO:tasks.workunit.client.0.smithi170.stdout:0/630: mknod d8/d9/d9a/cd8 0 2024-01-25T15:03:43.278 INFO:tasks.workunit.client.0.smithi170.stdout:0/631: stat d8/d18 0 2024-01-25T15:03:43.278 INFO:tasks.workunit.client.0.smithi170.stdout:3/684: sync 2024-01-25T15:03:43.278 INFO:tasks.workunit.client.0.smithi170.stdout:5/620: creat d5/d54/d85/d2c/d45/d56/d72/da0/dc5/fd9 x:0 0 0 2024-01-25T15:03:43.280 INFO:tasks.workunit.client.0.smithi170.stdout:6/686: mkdir d2/d7/d23/d19/d2f/df0 0 2024-01-25T15:03:43.282 INFO:tasks.workunit.client.0.smithi170.stdout:0/632: mkdir d8/d10/d5a/d7f/dd9 0 2024-01-25T15:03:43.283 INFO:tasks.workunit.client.0.smithi170.stdout:6/687: creat d2/d7/d23/d19/d2f/d74/dc1/dcf/ff1 x:0 0 0 2024-01-25T15:03:43.284 INFO:tasks.workunit.client.0.smithi170.stdout:6/688: stat d2/d7/d1b/d28/da7/fde 0 2024-01-25T15:03:43.285 INFO:tasks.workunit.client.0.smithi170.stdout:0/633: mknod d8/d10/d2d/d2f/d96/db7/cda 0 2024-01-25T15:03:43.285 INFO:tasks.workunit.client.0.smithi170.stdout:2/632: rename d10/d1e/d32/d98/dab to d10/d1e/d32/d3e/d5c/de5 0 2024-01-25T15:03:43.286 INFO:tasks.workunit.client.0.smithi170.stdout:6/689: symlink d2/d7/d23/d19/d2f/dd4/lf2 0 2024-01-25T15:03:43.289 INFO:tasks.workunit.client.0.smithi170.stdout:9/647: dwrite d5/df/d2e/d77/d21/d46/d6c/dd8/d96/fb8 [4194304,4194304] 0 2024-01-25T15:03:43.289 INFO:tasks.workunit.client.0.smithi170.stdout:9/648: chown d5/df/d16/l51 55410956 1 2024-01-25T15:03:43.289 INFO:tasks.workunit.client.0.smithi170.stdout:9/649: creat d5/df/d2e/fdd x:0 0 0 2024-01-25T15:03:43.289 INFO:tasks.workunit.client.0.smithi170.stdout:5/621: write d5/fd [1922503,108023] 0 2024-01-25T15:03:43.289 INFO:tasks.workunit.client.0.smithi170.stdout:5/622: write d5/d54/d85/d2c/d51/d3d/d57/f87 [897493,106040] 0 2024-01-25T15:03:43.289 INFO:tasks.workunit.client.0.smithi170.stdout:5/623: read - d5/d54/d85/d2c/d45/d56/d72/da0/dc5/fb4 zero size 2024-01-25T15:03:43.289 INFO:tasks.workunit.client.0.smithi170.stdout:5/624: chown d5/d2a/f2b 12473223 1 2024-01-25T15:03:43.289 INFO:tasks.workunit.client.0.smithi170.stdout:2/633: symlink d10/d1e/d32/d3e/d41/dc4/dc6/le6 0 2024-01-25T15:03:43.295 INFO:tasks.workunit.client.0.smithi170.stdout:9/650: creat d5/df/d16/d35/d3c/d91/dd6/dd9/fde x:0 0 0 2024-01-25T15:03:43.295 INFO:tasks.workunit.client.0.smithi170.stdout:1/631: truncate d0/fb 1780704 0 2024-01-25T15:03:43.295 INFO:tasks.workunit.client.0.smithi170.stdout:9/651: chown d5/dc/c13 18335 1 2024-01-25T15:03:43.296 INFO:tasks.workunit.client.0.smithi170.stdout:9/652: write d5/df/d2e/d77/d21/d34/f5b [524225,26298] 0 2024-01-25T15:03:43.296 INFO:tasks.workunit.client.0.smithi170.stdout:9/653: write d5/df/f15 [576989,26320] 0 2024-01-25T15:03:43.296 INFO:tasks.workunit.client.0.smithi170.stdout:1/632: mkdir d0/d20/d28/d2a/d4a/d56/dc1/dd1 0 2024-01-25T15:03:43.298 INFO:tasks.workunit.client.0.smithi170.stdout:6/690: dread d2/d7/d23/d19/f6a [0,4194304] 0 2024-01-25T15:03:43.298 INFO:tasks.workunit.client.0.smithi170.stdout:1/633: creat d0/d20/d28/d2a/d4a/d56/d5b/fd2 x:0 0 0 2024-01-25T15:03:43.299 INFO:tasks.workunit.client.0.smithi170.stdout:9/654: read d5/dc/f36 [402796,65092] 0 2024-01-25T15:03:43.299 INFO:tasks.workunit.client.0.smithi170.stdout:6/691: mknod d2/d7/d1b/cf3 0 2024-01-25T15:03:43.303 INFO:tasks.workunit.client.0.smithi170.stdout:1/634: creat d0/d20/d28/d7b/da8/daa/fd3 x:0 0 0 2024-01-25T15:03:43.306 INFO:tasks.workunit.client.0.smithi170.stdout:7/646: dwrite d8/f1f [0,4194304] 0 2024-01-25T15:03:43.308 INFO:tasks.workunit.client.0.smithi170.stdout:6/692: dread d2/d7/d23/d19/d60/fdd [0,4194304] 0 2024-01-25T15:03:43.309 INFO:tasks.workunit.client.0.smithi170.stdout:7/647: symlink d8/d20/d45/d68/lf0 0 2024-01-25T15:03:43.313 INFO:tasks.workunit.client.0.smithi170.stdout:2/634: dwrite d10/d1e/d32/d3e/d41/d7a/fc8 [0,4194304] 0 2024-01-25T15:03:43.313 INFO:tasks.workunit.client.0.smithi170.stdout:2/635: creat d10/d1e/d32/d62/d74/fe7 x:0 0 0 2024-01-25T15:03:43.317 INFO:tasks.workunit.client.0.smithi170.stdout:5/625: dwrite d5/f8e [0,4194304] 0 2024-01-25T15:03:43.317 INFO:tasks.workunit.client.0.smithi170.stdout:5/626: fsync d5/d54/d85/d2c/fa2 0 2024-01-25T15:03:43.317 INFO:tasks.workunit.client.0.smithi170.stdout:5/627: chown d5/d54/d85/d2c/c39 1 1 2024-01-25T15:03:43.318 INFO:tasks.workunit.client.0.smithi170.stdout:2/636: rmdir d10/d1e/d32/d3e 39 2024-01-25T15:03:43.321 INFO:tasks.workunit.client.0.smithi170.stdout:8/686: sync 2024-01-25T15:03:43.321 INFO:tasks.workunit.client.0.smithi170.stdout:4/543: rename d6/d28/f56 to d6/d7/d31/d46/d78/fa5 0 2024-01-25T15:03:43.322 INFO:tasks.workunit.client.0.smithi170.stdout:2/637: dread d10/d1e/d32/d3e/f95 [0,4194304] 0 2024-01-25T15:03:43.324 INFO:tasks.workunit.client.0.smithi170.stdout:0/634: rename d8/d10/d77/lbf to d8/d9/d9a/ldb 0 2024-01-25T15:03:43.324 INFO:tasks.workunit.client.0.smithi170.stdout:0/635: fsync d8/d10/d77/fc0 0 2024-01-25T15:03:43.324 INFO:tasks.workunit.client.0.smithi170.stdout:0/636: getdents d8/d10/d5a/d7f/dd9 0 2024-01-25T15:03:43.324 INFO:tasks.workunit.client.0.smithi170.stdout:0/637: chown d8/d10/d2d/d58/l6d 146 1 2024-01-25T15:03:43.324 INFO:tasks.workunit.client.0.smithi170.stdout:4/544: truncate d6/d28/d59/f6f 347053 0 2024-01-25T15:03:43.326 INFO:tasks.workunit.client.0.smithi170.stdout:8/687: symlink d3/d7/d22/d23/d48/le8 0 2024-01-25T15:03:43.326 INFO:tasks.workunit.client.0.smithi170.stdout:8/688: chown d3/d7/d22/d23/d48/cc7 721990425 1 2024-01-25T15:03:43.326 INFO:tasks.workunit.client.0.smithi170.stdout:8/689: dread - d3/d7/d22/d5d/fa3 zero size 2024-01-25T15:03:43.326 INFO:tasks.workunit.client.0.smithi170.stdout:5/628: getdents d5/d54/d85/d2c/d45/d56/d72/da0/dc5 0 2024-01-25T15:03:43.326 INFO:tasks.workunit.client.0.smithi170.stdout:5/629: write d5/d2a/fb0 [687227,55154] 0 2024-01-25T15:03:43.327 INFO:tasks.workunit.client.0.smithi170.stdout:2/638: mkdir d10/d1e/d32/d3e/d41/dc4/dc6/d42/de8 0 2024-01-25T15:03:43.328 INFO:tasks.workunit.client.0.smithi170.stdout:2/639: truncate d10/d1e/d32/d3e/d5c/d92/fc5 950063 0 2024-01-25T15:03:43.328 INFO:tasks.workunit.client.0.smithi170.stdout:2/640: readlink d10/d1e/d5e/d73/d9e/da3/lc2 0 2024-01-25T15:03:43.328 INFO:tasks.workunit.client.0.smithi170.stdout:2/641: chown d10/l3f 241326366 1 2024-01-25T15:03:43.329 INFO:tasks.workunit.client.0.smithi170.stdout:8/690: rmdir d3/d7/d22 39 2024-01-25T15:03:43.329 INFO:tasks.workunit.client.0.smithi170.stdout:4/545: rmdir d6/d28/d67 39 2024-01-25T15:03:43.330 INFO:tasks.workunit.client.0.smithi170.stdout:8/691: creat d3/d7/d73/fe9 x:0 0 0 2024-01-25T15:03:43.330 INFO:tasks.workunit.client.0.smithi170.stdout:2/642: mkdir d10/d1e/d32/d3e/d5c/d92/de9 0 2024-01-25T15:03:43.332 INFO:tasks.workunit.client.0.smithi170.stdout:2/643: creat d10/d1e/d32/d98/d99/dd4/fea x:0 0 0 2024-01-25T15:03:43.333 INFO:tasks.workunit.client.0.smithi170.stdout:8/692: mkdir d3/d7/d22/d80/dea 0 2024-01-25T15:03:43.333 INFO:tasks.workunit.client.0.smithi170.stdout:8/693: truncate d3/d7/d22/d23/d48/f81 359344 0 2024-01-25T15:03:43.333 INFO:tasks.workunit.client.0.smithi170.stdout:8/694: read - d3/d7/d22/d80/fe1 zero size 2024-01-25T15:03:43.333 INFO:tasks.workunit.client.0.smithi170.stdout:8/695: write d3/d7/d3a/f4f [880096,116228] 0 2024-01-25T15:03:43.334 INFO:tasks.workunit.client.0.smithi170.stdout:8/696: link d3/f72 d3/d7/d3a/d8d/db3/feb 0 2024-01-25T15:03:43.334 INFO:tasks.workunit.client.0.smithi170.stdout:8/697: dread - d3/d7/d1e/f6f zero size 2024-01-25T15:03:43.337 INFO:tasks.workunit.client.0.smithi170.stdout:1/635: dwrite d0/d20/d28/d2a/d4a/d56/d5b/fd2 [0,4194304] 0 2024-01-25T15:03:43.337 INFO:tasks.workunit.client.0.smithi170.stdout:9/655: write d5/df/d2e/f39 [5032323,100137] 0 2024-01-25T15:03:43.339 INFO:tasks.workunit.client.0.smithi170.stdout:1/636: link d0/d20/d28/f66 d0/d50/d8e/d9e/fd4 0 2024-01-25T15:03:43.341 INFO:tasks.workunit.client.0.smithi170.stdout:6/693: dwrite d2/d7/fbf [0,4194304] 0 2024-01-25T15:03:43.341 INFO:tasks.workunit.client.0.smithi170.stdout:8/698: dread d3/d7/d22/f5a [0,4194304] 0 2024-01-25T15:03:43.342 INFO:tasks.workunit.client.0.smithi170.stdout:6/694: chown d2/d7/d23/d19/daf/db0/lc6 5 1 2024-01-25T15:03:43.344 INFO:tasks.workunit.client.0.smithi170.stdout:9/656: dread d5/df/d2e/d77/d21/d46/d18/d6a/f74 [0,4194304] 0 2024-01-25T15:03:43.349 INFO:tasks.workunit.client.0.smithi170.stdout:8/699: unlink d3/d7/d22/d23/d25/d41/fad 0 2024-01-25T15:03:43.350 INFO:tasks.workunit.client.0.smithi170.stdout:8/700: creat d3/d7/d22/d23/fec x:0 0 0 2024-01-25T15:03:43.356 INFO:tasks.workunit.client.0.smithi170.stdout:6/695: link d2/d7/d23/d19/d2a/d43/d44/f7c d2/d7/d23/ff4 0 2024-01-25T15:03:43.356 INFO:tasks.workunit.client.0.smithi170.stdout:5/630: dwrite d5/d54/d85/d2c/d45/d56/d72/fbf [0,4194304] 0 2024-01-25T15:03:43.356 INFO:tasks.workunit.client.0.smithi170.stdout:4/546: link d6/d7/d31/l44 d6/d28/d61/la6 0 2024-01-25T15:03:43.356 INFO:tasks.workunit.client.0.smithi170.stdout:4/547: chown d6/l1f 385 1 2024-01-25T15:03:43.357 INFO:tasks.workunit.client.0.smithi170.stdout:2/644: dwrite d10/d1e/d32/d62/fcd [0,4194304] 0 2024-01-25T15:03:43.358 INFO:tasks.workunit.client.0.smithi170.stdout:5/631: mkdir d5/d54/d85/d2c/d51/d96/dda 0 2024-01-25T15:03:43.358 INFO:tasks.workunit.client.0.smithi170.stdout:5/632: getdents d5/d54/d85/d2c/d45/dba/dc1 0 2024-01-25T15:03:43.358 INFO:tasks.workunit.client.0.smithi170.stdout:5/633: write d5/d54/d85/d3f/f79 [488581,116581] 0 2024-01-25T15:03:43.358 INFO:tasks.workunit.client.0.smithi170.stdout:2/645: creat d10/d1e/d32/feb x:0 0 0 2024-01-25T15:03:43.362 INFO:tasks.workunit.client.0.smithi170.stdout:7/648: rename d8/d20/d2a/d35/d55/d6e/ld4 to d8/d20/d45/d68/lf1 0 2024-01-25T15:03:43.362 INFO:tasks.workunit.client.0.smithi170.stdout:7/649: fdatasync d8/d20/d2a/d35/d55/d7d/fcc 0 2024-01-25T15:03:43.363 INFO:tasks.workunit.client.0.smithi170.stdout:7/650: truncate d8/d20/d3b/d4d/f97 1072452 0 2024-01-25T15:03:43.365 INFO:tasks.workunit.client.0.smithi170.stdout:0/638: rename d8/d9/l21 to d8/d10/d5a/ldc 0 2024-01-25T15:03:43.368 INFO:tasks.workunit.client.0.smithi170.stdout:5/634: dread d5/d2a/f2b [0,4194304] 0 2024-01-25T15:03:43.369 INFO:tasks.workunit.client.0.smithi170.stdout:9/657: dwrite d5/df/d16/d35/f75 [0,4194304] 0 2024-01-25T15:03:43.369 INFO:tasks.workunit.client.0.smithi170.stdout:0/639: mknod d8/d10/d2d/d2f/d4f/cdd 0 2024-01-25T15:03:43.371 INFO:tasks.workunit.client.0.smithi170.stdout:7/651: write d8/d20/d2a/d35/d55/d6e/f93 [2892885,127501] 0 2024-01-25T15:03:43.371 INFO:tasks.workunit.client.0.smithi170.stdout:9/658: dread d5/df/d16/d35/d3c/d56/d59/f80 [0,4194304] 0 2024-01-25T15:03:43.372 INFO:tasks.workunit.client.0.smithi170.stdout:9/659: write d5/df/d2e/d6b/f72 [1411554,41198] 0 2024-01-25T15:03:43.376 INFO:tasks.workunit.client.0.smithi170.stdout:5/635: rmdir d5/d58/da9 39 2024-01-25T15:03:43.377 INFO:tasks.workunit.client.0.smithi170.stdout:4/548: rename d6/d7/d31/l44 to d6/d7/d31/d46/d78/la7 0 2024-01-25T15:03:43.381 INFO:tasks.workunit.client.0.smithi170.stdout:0/640: write d8/d10/d2d/d53/f7d [979871,55034] 0 2024-01-25T15:03:43.381 INFO:tasks.workunit.client.0.smithi170.stdout:4/549: mkdir d6/d28/d59/da8 0 2024-01-25T15:03:43.381 INFO:tasks.workunit.client.0.smithi170.stdout:4/550: chown d6/d28/d61 125 1 2024-01-25T15:03:43.382 INFO:tasks.workunit.client.0.smithi170.stdout:4/551: fsync d6/d28/d59/d7d/f6c 0 2024-01-25T15:03:43.384 INFO:tasks.workunit.client.0.smithi170.stdout:0/641: symlink d8/d10/lde 0 2024-01-25T15:03:43.386 INFO:tasks.workunit.client.0.smithi170.stdout:0/642: mknod d8/d10/d2d/d2f/d4f/da2/cdf 0 2024-01-25T15:03:43.386 INFO:tasks.workunit.client.0.smithi170.stdout:0/643: chown d8/d10/d2d/c44 55402 1 2024-01-25T15:03:43.386 INFO:tasks.workunit.client.0.smithi170.stdout:0/644: readlink d8/d18/l93 0 2024-01-25T15:03:43.388 INFO:tasks.workunit.client.0.smithi170.stdout:0/645: link d8/d10/d2d/ccc d8/d10/d2d/d89/dc6/dc9/dca/ce0 0 2024-01-25T15:03:43.390 INFO:tasks.workunit.client.0.smithi170.stdout:7/652: dread d8/f1c [0,4194304] 0 2024-01-25T15:03:43.390 INFO:tasks.workunit.client.0.smithi170.stdout:8/701: dwrite d3/d7/d73/fb1 [0,4194304] 0 2024-01-25T15:03:43.390 INFO:tasks.workunit.client.0.smithi170.stdout:7/653: fdatasync d8/d20/d2a/d35/d55/d9b/db9/fbe 0 2024-01-25T15:03:43.390 INFO:tasks.workunit.client.0.smithi170.stdout:6/696: dwrite d2/d7/d23/d19/d2f/d5d/d94/d97/db4/fe7 [0,4194304] 0 2024-01-25T15:03:43.391 INFO:tasks.workunit.client.0.smithi170.stdout:8/702: fdatasync d3/d7/d22/d23/d48/d52/d47/f4c 0 2024-01-25T15:03:43.397 INFO:tasks.workunit.client.0.smithi170.stdout:7/654: unlink d8/d20/d2a/c7a 0 2024-01-25T15:03:43.397 INFO:tasks.workunit.client.0.smithi170.stdout:8/703: symlink d3/d7/d3a/d91/d7f/led 0 2024-01-25T15:03:43.398 INFO:tasks.workunit.client.0.smithi170.stdout:9/660: dwrite d5/df/d16/f19 [0,4194304] 0 2024-01-25T15:03:43.398 INFO:tasks.workunit.client.0.smithi170.stdout:6/697: symlink d2/d7/d23/d19/d2f/d74/dce/ddf/de2/dea/lf5 0 2024-01-25T15:03:43.399 INFO:tasks.workunit.client.0.smithi170.stdout:7/655: truncate d8/d20/d3b/f3c 531128 0 2024-01-25T15:03:43.400 INFO:tasks.workunit.client.0.smithi170.stdout:7/656: dread d8/f31 [4194304,4194304] 0 2024-01-25T15:03:43.400 INFO:tasks.workunit.client.0.smithi170.stdout:7/657: read d8/d20/d3b/d4d/f78 [1282170,25165] 0 2024-01-25T15:03:43.400 INFO:tasks.workunit.client.0.smithi170.stdout:7/658: creat d8/d20/dc2/ff2 x:0 0 0 2024-01-25T15:03:43.403 INFO:tasks.workunit.client.0.smithi170.stdout:6/698: dread d2/d7/d23/d19/d2a/d43/d44/f48 [0,4194304] 0 2024-01-25T15:03:43.405 INFO:tasks.workunit.client.0.smithi170.stdout:2/646: dwrite d10/d1e/d32/d3e/d41/dc4/dc6/f3b [0,4194304] 0 2024-01-25T15:03:43.405 INFO:tasks.workunit.client.0.smithi170.stdout:2/647: fsync d10/d1e/d32/d3e/d5c/f86 0 2024-01-25T15:03:43.406 INFO:tasks.workunit.client.0.smithi170.stdout:6/699: mkdir d2/d7/d1b/d28/da7/dd2/df6 0 2024-01-25T15:03:43.406 INFO:tasks.workunit.client.0.smithi170.stdout:0/646: write d8/d9/d9a/fa6 [3123758,110293] 0 2024-01-25T15:03:43.410 INFO:tasks.workunit.client.0.smithi170.stdout:2/648: creat d10/d1e/d32/d3e/d41/dc4/dc6/d42/daa/fec x:0 0 0 2024-01-25T15:03:43.413 INFO:tasks.workunit.client.0.smithi170.stdout:6/700: dread d2/d7/d23/ff4 [0,4194304] 0 2024-01-25T15:03:43.416 INFO:tasks.workunit.client.0.smithi170.stdout:2/649: mknod d10/d1e/d32/d3e/d41/dc4/dc6/d42/daa/ced 0 2024-01-25T15:03:43.418 INFO:tasks.workunit.client.0.smithi170.stdout:2/650: creat d10/d1e/d32/d3e/d5c/d92/de9/fee x:0 0 0 2024-01-25T15:03:43.419 INFO:tasks.workunit.client.0.smithi170.stdout:7/659: dread d8/d20/d2a/d35/f41 [4194304,4194304] 0 2024-01-25T15:03:43.420 INFO:tasks.workunit.client.0.smithi170.stdout:0/647: rmdir d8/d10/d2d/d2f/d4f/d59 39 2024-01-25T15:03:43.422 INFO:tasks.workunit.client.0.smithi170.stdout:8/704: dwrite d3/d7/d1e/f6f [0,4194304] 0 2024-01-25T15:03:43.423 INFO:tasks.workunit.client.0.smithi170.stdout:7/660: mknod d8/d20/d2a/cf3 0 2024-01-25T15:03:43.423 INFO:tasks.workunit.client.0.smithi170.stdout:7/661: truncate d8/d20/d45/d68/d71/d8c/fbf 1682687 0 2024-01-25T15:03:43.426 INFO:tasks.workunit.client.0.smithi170.stdout:2/651: getdents d10 0 2024-01-25T15:03:43.428 INFO:tasks.workunit.client.0.smithi170.stdout:4/552: rename d6/d28/f45 to d6/d7/d31/d46/fa9 0 2024-01-25T15:03:43.428 INFO:tasks.workunit.client.0.smithi170.stdout:4/553: fdatasync d6/d7/d31/f3f 0 2024-01-25T15:03:43.433 INFO:tasks.workunit.client.0.smithi170.stdout:8/705: creat d3/d7/d22/fee x:0 0 0 2024-01-25T15:03:43.436 INFO:tasks.workunit.client.0.smithi170.stdout:0/648: creat d8/d10/d2d/d2f/d6a/d79/d7e/fe1 x:0 0 0 2024-01-25T15:03:43.437 INFO:tasks.workunit.client.0.smithi170.stdout:0/649: dread - d8/d10/d5a/fa9 zero size 2024-01-25T15:03:43.437 INFO:tasks.workunit.client.0.smithi170.stdout:0/650: truncate d8/d10/d5a/fb9 391860 0 2024-01-25T15:03:43.438 INFO:tasks.workunit.client.0.smithi170.stdout:9/661: rename d5/df/d2e/d77/d21/d46/d6c/dac/lcf to d5/df/d2e/d77/d21/d34/ldf 0 2024-01-25T15:03:43.438 INFO:tasks.workunit.client.0.smithi170.stdout:9/662: dread - d5/df/d2e/d77/d21/daa/fcc zero size 2024-01-25T15:03:43.439 INFO:tasks.workunit.client.0.smithi170.stdout:8/706: creat d3/d7/d3a/d8d/db3/fef x:0 0 0 2024-01-25T15:03:43.439 INFO:tasks.workunit.client.0.smithi170.stdout:7/662: mknod d8/cf4 0 2024-01-25T15:03:43.440 INFO:tasks.workunit.client.0.smithi170.stdout:0/651: symlink d8/d10/d2d/d2f/d4f/le2 0 2024-01-25T15:03:43.443 INFO:tasks.workunit.client.0.smithi170.stdout:6/701: rename d2/d7/d23/d19/d60/c9f to d2/d7/d23/d19/d2f/d74/dc1/cf7 0 2024-01-25T15:03:43.444 INFO:tasks.workunit.client.0.smithi170.stdout:9/663: mknod d5/df/d16/ce0 0 2024-01-25T15:03:43.444 INFO:tasks.workunit.client.0.smithi170.stdout:9/664: write d5/df/d2e/d77/d21/d46/d6c/dd8/d96/fb5 [712665,81116] 0 2024-01-25T15:03:43.444 INFO:tasks.workunit.client.0.smithi170.stdout:9/665: fdatasync d5/dc/fd 0 2024-01-25T15:03:43.444 INFO:tasks.workunit.client.0.smithi170.stdout:8/707: creat d3/d7/d22/d23/d48/d52/d47/de2/ff0 x:0 0 0 2024-01-25T15:03:43.444 INFO:tasks.workunit.client.0.smithi170.stdout:8/708: stat d3/d7/fa5 0 2024-01-25T15:03:43.444 INFO:tasks.workunit.client.0.smithi170.stdout:0/652: creat d8/d10/d5a/d7f/fe3 x:0 0 0 2024-01-25T15:03:43.446 INFO:tasks.workunit.client.0.smithi170.stdout:9/666: link d5/df/d2e/d77/d21/d46/d18/d6a/la9 d5/df/d2e/d77/d21/d46/d6c/dac/le1 0 2024-01-25T15:03:43.447 INFO:tasks.workunit.client.0.smithi170.stdout:8/709: symlink d3/d7/d22/d23/d25/d8e/lf1 0 2024-01-25T15:03:43.447 INFO:tasks.workunit.client.0.smithi170.stdout:8/710: read d3/d7/d3a/d91/d7f/fbf [35758,95226] 0 2024-01-25T15:03:43.447 INFO:tasks.workunit.client.0.smithi170.stdout:8/711: dread - d3/d7/d22/d23/d25/d41/d61/fd1 zero size 2024-01-25T15:03:43.448 INFO:tasks.workunit.client.0.smithi170.stdout:8/712: dread - d3/d7/d1e/d7c/d9f/fe5 zero size 2024-01-25T15:03:43.448 INFO:tasks.workunit.client.0.smithi170.stdout:0/653: link d8/d10/d2d/d2f/d4f/d5f/f88 d8/d3e/fe4 0 2024-01-25T15:03:43.448 INFO:tasks.workunit.client.0.smithi170.stdout:9/667: truncate d5/f8f 4514875 0 2024-01-25T15:03:43.450 INFO:tasks.workunit.client.0.smithi170.stdout:8/713: rename d3/d7/d73/dba/lbb to d3/d7/d3a/lf2 0 2024-01-25T15:03:43.450 INFO:tasks.workunit.client.0.smithi170.stdout:8/714: fdatasync d3/d7/d3a/f4f 0 2024-01-25T15:03:43.450 INFO:tasks.workunit.client.0.smithi170.stdout:6/702: dread d2/d7/d23/d19/d2a/d43/f59 [0,4194304] 0 2024-01-25T15:03:43.450 INFO:tasks.workunit.client.0.smithi170.stdout:6/703: chown d2/d7/d23/d19/d2a/c8d 1682846 1 2024-01-25T15:03:43.451 INFO:tasks.workunit.client.0.smithi170.stdout:9/668: truncate d5/df/d16/f19 3329102 0 2024-01-25T15:03:43.453 INFO:tasks.workunit.client.0.smithi170.stdout:8/715: mknod d3/d7/d22/d23/d25/d8e/cf3 0 2024-01-25T15:03:43.453 INFO:tasks.workunit.client.0.smithi170.stdout:8/716: write d3/d7/fb4 [111506,52616] 0 2024-01-25T15:03:43.454 INFO:tasks.workunit.client.0.smithi170.stdout:9/669: unlink d5/df/d16/c66 0 2024-01-25T15:03:43.454 INFO:tasks.workunit.client.0.smithi170.stdout:9/670: creat d5/df/d2e/d77/d21/d34/d3e/d7f/fe2 x:0 0 0 2024-01-25T15:03:43.455 INFO:tasks.workunit.client.0.smithi170.stdout:8/717: creat d3/d7/d3a/d8d/ff4 x:0 0 0 2024-01-25T15:03:43.456 INFO:tasks.workunit.client.0.smithi170.stdout:2/652: dwrite d10/d1e/d32/d62/d74/fb4 [0,4194304] 0 2024-01-25T15:03:43.456 INFO:tasks.workunit.client.0.smithi170.stdout:2/653: getdents d10/d1e/d32/d3e/d41/dc4/dc6/d42/de8 0 2024-01-25T15:03:43.456 INFO:tasks.workunit.client.0.smithi170.stdout:2/654: chown d10/d1b/d5f/f7d 228 1 2024-01-25T15:03:43.456 INFO:tasks.workunit.client.0.smithi170.stdout:2/655: dread - d10/d1e/d32/d3e/d5c/d92/de9/fee zero size 2024-01-25T15:03:43.456 INFO:tasks.workunit.client.0.smithi170.stdout:2/656: creat d10/d1e/d5e/d73/d9e/da3/fef x:0 0 0 2024-01-25T15:03:43.456 INFO:tasks.workunit.client.0.smithi170.stdout:8/718: mkdir d3/d7/d22/d80/dea/df5 0 2024-01-25T15:03:43.456 INFO:tasks.workunit.client.0.smithi170.stdout:8/719: dread - d3/d7/d22/d80/fab zero size 2024-01-25T15:03:43.460 INFO:tasks.workunit.client.0.smithi170.stdout:4/554: dwrite d6/d7/d31/d46/f92 [0,4194304] 0 2024-01-25T15:03:43.464 INFO:tasks.workunit.client.0.smithi170.stdout:0/654: dread d8/d9/d9a/fa6 [0,4194304] 0 2024-01-25T15:03:43.464 INFO:tasks.workunit.client.0.smithi170.stdout:0/655: creat d8/d10/d2d/d53/fe5 x:0 0 0 2024-01-25T15:03:43.464 INFO:tasks.workunit.client.0.smithi170.stdout:0/656: fdatasync d8/d3e/fc7 0 2024-01-25T15:03:43.464 INFO:tasks.workunit.client.0.smithi170.stdout:0/657: chown d8/d10/d2d/d2f/d4f/d5f 615 1 2024-01-25T15:03:43.467 INFO:tasks.workunit.client.0.smithi170.stdout:4/555: rmdir d6/d28/d61 39 2024-01-25T15:03:43.470 INFO:tasks.workunit.client.0.smithi170.stdout:8/720: write d3/d7/fa5 [3409375,48662] 0 2024-01-25T15:03:43.476 INFO:tasks.workunit.client.0.smithi170.stdout:0/658: mknod d8/d10/d77/ce6 0 2024-01-25T15:03:43.476 INFO:tasks.workunit.client.0.smithi170.stdout:8/721: symlink d3/d7/d3a/d91/lf6 0 2024-01-25T15:03:43.477 INFO:tasks.workunit.client.0.smithi170.stdout:4/556: write d6/d28/d67/f9d [1756128,61045] 0 2024-01-25T15:03:43.479 INFO:tasks.workunit.client.0.smithi170.stdout:4/557: symlink d6/d7/d31/d46/d78/laa 0 2024-01-25T15:03:43.479 INFO:tasks.workunit.client.0.smithi170.stdout:4/558: creat d6/d7/d31/d46/d78/fab x:0 0 0 2024-01-25T15:03:43.480 INFO:tasks.workunit.client.0.smithi170.stdout:2/657: truncate d10/d1e/d32/d3e/d5c/f76 2572195 0 2024-01-25T15:03:43.480 INFO:tasks.workunit.client.0.smithi170.stdout:2/658: chown d10/d1e/f71 118188873 1 2024-01-25T15:03:43.480 INFO:tasks.workunit.client.0.smithi170.stdout:8/722: dread d3/d7/d22/d23/d25/d41/da9/faf [0,4194304] 0 2024-01-25T15:03:43.481 INFO:tasks.workunit.client.0.smithi170.stdout:8/723: truncate d3/d7/f16 4524963 0 2024-01-25T15:03:43.481 INFO:tasks.workunit.client.0.smithi170.stdout:6/704: dwrite d2/f82 [0,4194304] 0 2024-01-25T15:03:43.482 INFO:tasks.workunit.client.0.smithi170.stdout:9/671: dwrite d5/df/d2e/f70 [0,4194304] 0 2024-01-25T15:03:43.482 INFO:tasks.workunit.client.0.smithi170.stdout:9/672: creat d5/df/d2e/d77/d21/d34/fe3 x:0 0 0 2024-01-25T15:03:43.482 INFO:tasks.workunit.client.0.smithi170.stdout:9/673: creat d5/df/d16/d35/fe4 x:0 0 0 2024-01-25T15:03:43.482 INFO:tasks.workunit.client.0.smithi170.stdout:9/674: write d5/df/d2e/d77/d21/d34/fc4 [117917,14177] 0 2024-01-25T15:03:43.483 INFO:tasks.workunit.client.0.smithi170.stdout:0/659: rename d8/d10/d2d/d2f/d4f to d8/d3e/de7 0 2024-01-25T15:03:43.485 INFO:tasks.workunit.client.0.smithi170.stdout:4/559: symlink d6/d7/d31/lac 0 2024-01-25T15:03:43.486 INFO:tasks.workunit.client.0.smithi170.stdout:4/560: mkdir d6/d28/d61/dad 0 2024-01-25T15:03:43.486 INFO:tasks.workunit.client.0.smithi170.stdout:4/561: truncate d6/d28/d59/d7d/f5c 616459 0 2024-01-25T15:03:43.487 INFO:tasks.workunit.client.0.smithi170.stdout:4/562: creat d6/d7/fae x:0 0 0 2024-01-25T15:03:43.487 INFO:tasks.workunit.client.0.smithi170.stdout:8/724: creat d3/d7/d22/d23/d48/d52/d47/d86/ff7 x:0 0 0 2024-01-25T15:03:43.493 INFO:tasks.workunit.client.0.smithi170.stdout:2/659: dread d10/fd8 [0,4194304] 0 2024-01-25T15:03:43.496 INFO:tasks.workunit.client.0.smithi170.stdout:9/675: mkdir d5/df/d2e/d77/d21/d34/d3e/de5 0 2024-01-25T15:03:43.496 INFO:tasks.workunit.client.0.smithi170.stdout:9/676: truncate d5/df/d2e/d77/d21/d34/d3e/d7f/fe2 575775 0 2024-01-25T15:03:43.496 INFO:tasks.workunit.client.0.smithi170.stdout:4/563: dread d6/d7/d31/d7e/f40 [0,4194304] 0 2024-01-25T15:03:43.497 INFO:tasks.workunit.client.0.smithi170.stdout:0/660: creat d8/d10/d2d/d2f/d6a/fe8 x:0 0 0 2024-01-25T15:03:43.498 INFO:tasks.workunit.client.0.smithi170.stdout:9/677: write d5/df/d2e/d77/d21/d46/d6c/f71 [748644,74539] 0 2024-01-25T15:03:43.499 INFO:tasks.workunit.client.0.smithi170.stdout:8/725: creat d3/d7/d22/dbd/ff8 x:0 0 0 2024-01-25T15:03:43.500 INFO:tasks.workunit.client.0.smithi170.stdout:2/660: mkdir d10/d1e/d5e/d73/df0 0 2024-01-25T15:03:43.501 INFO:tasks.workunit.client.0.smithi170.stdout:4/564: creat d6/d28/d59/da8/faf x:0 0 0 2024-01-25T15:03:43.502 INFO:tasks.workunit.client.0.smithi170.stdout:0/661: symlink d8/d10/d5a/d7f/dd9/le9 0 2024-01-25T15:03:43.504 INFO:tasks.workunit.client.0.smithi170.stdout:9/678: rename d5/df/d16/d35/f65 to d5/df/d2e/db0/fe6 0 2024-01-25T15:03:43.505 INFO:tasks.workunit.client.0.smithi170.stdout:8/726: mkdir d3/d7/d1e/df9 0 2024-01-25T15:03:43.505 INFO:tasks.workunit.client.0.smithi170.stdout:8/727: creat d3/d7/d22/d23/ffa x:0 0 0 2024-01-25T15:03:43.505 INFO:tasks.workunit.client.0.smithi170.stdout:8/728: truncate d3/d7/d73/fa1 1454421 0 2024-01-25T15:03:43.508 INFO:tasks.workunit.client.0.smithi170.stdout:6/705: dwrite d2/fa0 [0,4194304] 0 2024-01-25T15:03:43.508 INFO:tasks.workunit.client.0.smithi170.stdout:0/662: mkdir d8/d10/d2d/d2f/d6a/d79/dea 0 2024-01-25T15:03:43.508 INFO:tasks.workunit.client.0.smithi170.stdout:0/663: truncate d8/d9/fe 4268302 0 2024-01-25T15:03:43.517 INFO:tasks.workunit.client.0.smithi170.stdout:0/664: mkdir d8/d9/dd6/deb 0 2024-01-25T15:03:43.519 INFO:tasks.workunit.client.0.smithi170.stdout:0/665: mknod d8/d10/d2d/d82/cec 0 2024-01-25T15:03:43.519 INFO:tasks.workunit.client.0.smithi170.stdout:0/666: fdatasync d8/d10/d2d/d2f/d6a/d79/db6/fb8 0 2024-01-25T15:03:43.520 INFO:tasks.workunit.client.0.smithi170.stdout:0/667: write d8/d10/d2d/d2f/d6a/d79/d7e/fe1 [750084,92645] 0 2024-01-25T15:03:43.529 INFO:tasks.workunit.client.0.smithi170.stdout:4/565: write d6/d7/d1b/f1e [2822390,39164] 0 2024-01-25T15:03:43.530 INFO:tasks.workunit.client.0.smithi170.stdout:8/729: dwrite d3/d7/d3a/f94 [0,4194304] 0 2024-01-25T15:03:43.530 INFO:tasks.workunit.client.0.smithi170.stdout:8/730: write f0 [5595985,59286] 0 2024-01-25T15:03:43.531 INFO:tasks.workunit.client.0.smithi170.stdout:4/566: creat d6/d28/d67/fb0 x:0 0 0 2024-01-25T15:03:43.532 INFO:tasks.workunit.client.0.smithi170.stdout:8/731: symlink d3/d7/d22/d23/d48/d52/d47/lfb 0 2024-01-25T15:03:43.533 INFO:tasks.workunit.client.0.smithi170.stdout:8/732: rename d3/d7/d22/d80/fab to d3/d7/d3a/d8d/ffc 0 2024-01-25T15:03:43.533 INFO:tasks.workunit.client.0.smithi170.stdout:8/733: write d3/d7/d3a/f4f [167246,54003] 0 2024-01-25T15:03:43.534 INFO:tasks.workunit.client.0.smithi170.stdout:6/706: dwrite d2/f7b [0,4194304] 0 2024-01-25T15:03:43.535 INFO:tasks.workunit.client.0.smithi170.stdout:8/734: link d3/d7/d22/d23/d48/d52/d47/de2/ff0 d3/d7/d1e/df9/ffd 0 2024-01-25T15:03:43.535 INFO:tasks.workunit.client.0.smithi170.stdout:8/735: creat d3/d7/d22/d23/ffe x:0 0 0 2024-01-25T15:03:43.535 INFO:tasks.workunit.client.0.smithi170.stdout:8/736: truncate d3/d7/d22/d23/d25/d41/da9/fc4 976487 0 2024-01-25T15:03:43.536 INFO:tasks.workunit.client.0.smithi170.stdout:6/707: symlink d2/d7/d23/d19/d2f/d5d/d94/d97/lf8 0 2024-01-25T15:03:43.537 INFO:tasks.workunit.client.0.smithi170.stdout:6/708: readlink d2/d7/d23/ld1 0 2024-01-25T15:03:43.537 INFO:tasks.workunit.client.0.smithi170.stdout:6/709: read d2/d7/d1b/d28/db8/fba [487346,21851] 0 2024-01-25T15:03:43.547 INFO:tasks.workunit.client.0.smithi170.stdout:8/737: dread d3/d7/d22/f5a [0,4194304] 0 2024-01-25T15:03:43.547 INFO:tasks.workunit.client.0.smithi170.stdout:0/668: dwrite d8/d3e/fc7 [0,4194304] 0 2024-01-25T15:03:43.549 INFO:tasks.workunit.client.0.smithi170.stdout:8/738: rename d3/d7/d22/d23/d25/d41/da9/fc4 to d3/d7/d22/d23/d25/d41/da9/fff 0 2024-01-25T15:03:43.549 INFO:tasks.workunit.client.0.smithi170.stdout:0/669: symlink d8/d10/d2d/d2f/d96/db7/led 0 2024-01-25T15:03:43.551 INFO:tasks.workunit.client.0.smithi170.stdout:4/567: dwrite d6/d7/d31/f3f [0,4194304] 0 2024-01-25T15:03:43.551 INFO:tasks.workunit.client.0.smithi170.stdout:4/568: readlink d6/d7/l4c 0 2024-01-25T15:03:43.554 INFO:tasks.workunit.client.0.smithi170.stdout:4/569: creat d6/d7/d31/d7e/d9c/fb1 x:0 0 0 2024-01-25T15:03:43.554 INFO:tasks.workunit.client.0.smithi170.stdout:4/570: fdatasync d6/d28/d61/fa1 0 2024-01-25T15:03:43.555 INFO:tasks.workunit.client.0.smithi170.stdout:4/571: creat d6/d28/d61/fb2 x:0 0 0 2024-01-25T15:03:43.557 INFO:tasks.workunit.client.0.smithi170.stdout:4/572: creat d6/d7/d31/fb3 x:0 0 0 2024-01-25T15:03:43.558 INFO:tasks.workunit.client.0.smithi170.stdout:8/739: dread d3/d7/d22/d23/d25/d8e/fd7 [0,4194304] 0 2024-01-25T15:03:43.558 INFO:tasks.workunit.client.0.smithi170.stdout:8/740: write d3/d7/d22/d23/d25/d41/d61/fd1 [663372,91598] 0 2024-01-25T15:03:43.559 INFO:tasks.workunit.client.0.smithi170.stdout:8/741: getdents d3/d7/d22/d23/d25/d41 0 2024-01-25T15:03:43.559 INFO:tasks.workunit.client.0.smithi170.stdout:8/742: chown d3/d7/d3a/d91 3615884 1 2024-01-25T15:03:43.562 INFO:tasks.workunit.client.0.smithi170.stdout:4/573: rmdir d6/d28/d67 39 2024-01-25T15:03:43.566 INFO:tasks.workunit.client.0.smithi170.stdout:6/710: dwrite d2/f3 [0,4194304] 0 2024-01-25T15:03:43.571 INFO:tasks.workunit.client.0.smithi170.stdout:8/743: dread d3/d7/d22/d23/d25/d41/d61/fd1 [0,4194304] 0 2024-01-25T15:03:43.571 INFO:tasks.workunit.client.0.smithi170.stdout:8/744: readlink d3/d7/d22/d5d/l9b 0 2024-01-25T15:03:43.571 INFO:tasks.workunit.client.0.smithi170.stdout:8/745: fdatasync d3/d7/f56 0 2024-01-25T15:03:43.572 INFO:tasks.workunit.client.0.smithi170.stdout:8/746: fdatasync d3/d7/d22/d23/d25/f5c 0 2024-01-25T15:03:43.572 INFO:tasks.workunit.client.0.smithi170.stdout:8/747: stat d3/d7/d3a/f94 0 2024-01-25T15:03:43.577 INFO:tasks.workunit.client.0.smithi170.stdout:6/711: write d2/d7/d23/d19/d2a/f55 [1608393,120647] 0 2024-01-25T15:03:43.579 INFO:tasks.workunit.client.0.smithi170.stdout:0/670: dwrite d8/fa [4194304,4194304] 0 2024-01-25T15:03:43.580 INFO:tasks.workunit.client.0.smithi170.stdout:4/574: dwrite d6/d7/fa2 [0,4194304] 0 2024-01-25T15:03:43.581 INFO:tasks.workunit.client.0.smithi170.stdout:0/671: link d8/d10/d2d/d53/f67 d8/d10/fee 0 2024-01-25T15:03:43.581 INFO:tasks.workunit.client.0.smithi170.stdout:0/672: chown d8/d10/d2d/d53/f63 64156193 1 2024-01-25T15:03:43.584 INFO:tasks.workunit.client.0.smithi170.stdout:0/673: unlink d8/d3e/de7/c94 0 2024-01-25T15:03:43.585 INFO:tasks.workunit.client.0.smithi170.stdout:0/674: mknod d8/d10/d2d/d89/dc6/dc9/dca/cef 0 2024-01-25T15:03:43.586 INFO:tasks.workunit.client.0.smithi170.stdout:4/575: unlink d6/d28/f52 0 2024-01-25T15:03:43.586 INFO:tasks.workunit.client.0.smithi170.stdout:4/576: write d6/d7/d31/d46/d78/f95 [813910,25942] 0 2024-01-25T15:03:43.586 INFO:tasks.workunit.client.0.smithi170.stdout:4/577: write d6/d28/f7a [907644,87652] 0 2024-01-25T15:03:43.587 INFO:tasks.workunit.client.0.smithi170.stdout:6/712: write d2/d7/f18 [372041,33174] 0 2024-01-25T15:03:43.590 INFO:tasks.workunit.client.0.smithi170.stdout:6/713: write d2/d7/d23/fa5 [462646,16226] 0 2024-01-25T15:03:43.590 INFO:tasks.workunit.client.0.smithi170.stdout:6/714: chown d2/d7/d23/d19/d2a/d43/l7a 7 1 2024-01-25T15:03:43.593 INFO:tasks.workunit.client.0.smithi170.stdout:0/675: dread d8/d10/d2d/d53/f7d [0,4194304] 0 2024-01-25T15:03:43.593 INFO:tasks.workunit.client.0.smithi170.stdout:0/676: chown d8/d9/d9a/dbd 13236 1 2024-01-25T15:03:43.595 INFO:tasks.workunit.client.0.smithi170.stdout:8/748: dwrite d3/d7/d22/d23/d48/d52/d47/fdd [0,4194304] 0 2024-01-25T15:03:43.595 INFO:tasks.workunit.client.0.smithi170.stdout:8/749: chown d3/d7/d22/lcf 155 1 2024-01-25T15:03:43.595 INFO:tasks.workunit.client.0.smithi170.stdout:8/750: write d3/d7/d22/fee [155225,78415] 0 2024-01-25T15:03:43.596 INFO:tasks.workunit.client.0.smithi170.stdout:4/578: write d6/d7/f81 [1970630,34414] 0 2024-01-25T15:03:43.597 INFO:tasks.workunit.client.0.smithi170.stdout:0/677: mknod d8/cf0 0 2024-01-25T15:03:43.604 INFO:tasks.workunit.client.0.smithi170.stdout:0/678: dread d8/d10/d2d/d53/f63 [0,4194304] 0 2024-01-25T15:03:43.604 INFO:tasks.workunit.client.0.smithi170.stdout:0/679: chown d8/d9/f46 187 1 2024-01-25T15:03:43.606 INFO:tasks.workunit.client.0.smithi170.stdout:8/751: symlink d3/d7/d22/d23/d48/d52/d47/d86/l100 0 2024-01-25T15:03:43.606 INFO:tasks.workunit.client.0.smithi170.stdout:8/752: creat d3/d7/d1e/d7c/d9f/f101 x:0 0 0 2024-01-25T15:03:43.608 INFO:tasks.workunit.client.0.smithi170.stdout:0/680: mknod d8/d10/d5a/d7f/cf1 0 2024-01-25T15:03:43.612 INFO:tasks.workunit.client.0.smithi170.stdout:8/753: mknod d3/d7/d1e/d7c/d9f/c102 0 2024-01-25T15:03:43.613 INFO:tasks.workunit.client.0.smithi170.stdout:0/681: mkdir d8/d10/d2d/d82/df2 0 2024-01-25T15:03:43.618 INFO:tasks.workunit.client.0.smithi170.stdout:8/754: dread d3/d7/f56 [0,4194304] 0 2024-01-25T15:03:43.618 INFO:tasks.workunit.client.0.smithi170.stdout:8/755: stat d3/d7/d22/d23/d48/d52/d47 0 2024-01-25T15:03:43.618 INFO:tasks.workunit.client.0.smithi170.stdout:8/756: truncate d3/d7/d3a/d8d/dd5/fe6 506998 0 2024-01-25T15:03:43.619 INFO:tasks.workunit.client.0.smithi170.stdout:8/757: mknod d3/d7/d3a/d8d/dd5/c103 0 2024-01-25T15:03:43.620 INFO:tasks.workunit.client.0.smithi170.stdout:6/715: dwrite d2/d7/d23/d19/d2a/d43/d44/da4/fab [0,4194304] 0 2024-01-25T15:03:43.620 INFO:tasks.workunit.client.0.smithi170.stdout:6/716: write d2/d7/d1b/f1f [2782089,79449] 0 2024-01-25T15:03:43.631 INFO:tasks.workunit.client.0.smithi170.stdout:0/682: dread d8/d10/d5a/f6c [4194304,4194304] 0 2024-01-25T15:03:43.632 INFO:tasks.workunit.client.0.smithi170.stdout:0/683: dread - d8/d10/d2d/d2f/fbc zero size 2024-01-25T15:03:43.632 INFO:tasks.workunit.client.0.smithi170.stdout:0/684: readlink d8/d10/l75 0 2024-01-25T15:03:43.633 INFO:tasks.workunit.client.0.smithi170.stdout:6/717: write d2/d7/d23/d19/d2f/d5d/d94/d97/db4/dd3/fe0 [3377552,83611] 0 2024-01-25T15:03:43.633 INFO:tasks.workunit.client.0.smithi170.stdout:4/579: rename d6/f76 to d6/d28/d61/dad/fb4 0 2024-01-25T15:03:43.635 INFO:tasks.workunit.client.0.smithi170.stdout:4/580: symlink d6/d28/d59/da8/lb5 0 2024-01-25T15:03:43.635 INFO:tasks.workunit.client.0.smithi170.stdout:4/581: readlink d6/d7/d31/l48 0 2024-01-25T15:03:43.641 INFO:tasks.workunit.client.0.smithi170.stdout:8/758: dwrite d3/d7/d22/d23/ffa [0,4194304] 0 2024-01-25T15:03:43.643 INFO:tasks.workunit.client.0.smithi170.stdout:4/582: symlink d6/d7/d31/d7e/lb6 0 2024-01-25T15:03:43.645 INFO:tasks.workunit.client.0.smithi170.stdout:4/583: mkdir d6/d7/db7 0 2024-01-25T15:03:43.663 INFO:tasks.workunit.client.0.smithi170.stdout:8/759: dwrite d3/d7/d73/dba/fcc [0,4194304] 0 2024-01-25T15:03:43.663 INFO:tasks.workunit.client.0.smithi170.stdout:6/718: dwrite d2/d7/d1b/f1f [0,4194304] 0 2024-01-25T15:03:43.669 INFO:tasks.workunit.client.0.smithi170.stdout:6/719: mkdir d2/df9 0 2024-01-25T15:03:43.685 INFO:tasks.workunit.client.0.smithi170.stdout:8/760: dwrite d3/d7/d3a/f70 [0,4194304] 0 2024-01-25T15:03:43.688 INFO:tasks.workunit.client.0.smithi170.stdout:8/761: rmdir d3/d7/d3a/d8d/db3 39 2024-01-25T15:03:43.699 INFO:tasks.workunit.client.0.smithi170.stdout:8/762: dread d3/d7/d1e/f6f [0,4194304] 0 2024-01-25T15:03:43.701 INFO:tasks.workunit.client.0.smithi170.stdout:8/763: rename d3/d7/d22/d23/d25/d41/da9 to d3/d7/d22/d23/d48/d52/d47/de2/d104 0 2024-01-25T15:03:43.710 INFO:tasks.workunit.client.0.smithi170.stdout:8/764: dread d3/d7/d3a/f94 [0,4194304] 0 2024-01-25T15:03:43.711 INFO:tasks.workunit.client.0.smithi170.stdout:8/765: creat d3/d7/d22/d23/d25/d8e/f105 x:0 0 0 2024-01-25T15:03:43.712 INFO:tasks.workunit.client.0.smithi170.stdout:8/766: mknod d3/d7/d1e/df9/c106 0 2024-01-25T15:03:43.712 INFO:tasks.workunit.client.0.smithi170.stdout:8/767: creat d3/d7/d1e/d7c/d9f/f107 x:0 0 0 2024-01-25T15:03:43.720 INFO:tasks.workunit.client.0.smithi170.stdout:8/768: dread d3/d7/d3a/f70 [0,4194304] 0 2024-01-25T15:03:43.722 INFO:tasks.workunit.client.0.smithi170.stdout:8/769: mkdir d3/d7/d3a/d108 0 2024-01-25T15:03:43.730 INFO:tasks.workunit.client.0.smithi170.stdout:8/770: dread d3/d7/d22/d23/d48/d52/d47/fbc [0,4194304] 0 2024-01-25T15:03:43.732 INFO:tasks.workunit.client.0.smithi170.stdout:8/771: rename d3/d7/d1e/d7c/d9f/c102 to d3/d7/d22/c109 0 2024-01-25T15:03:43.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:43 smithi191 ceph-mon[36347]: pgmap v400: 97 pgs: 97 active+clean; 996 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 120 MiB/s rd, 148 MiB/s wr, 2.24k op/s 2024-01-25T15:03:43.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:43 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] up:active 2024-01-25T15:03:43.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:43 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:43.735 INFO:tasks.workunit.client.0.smithi170.stdout:8/772: dread d3/d7/d22/d23/d25/f95 [0,4194304] 0 2024-01-25T15:03:43.735 INFO:tasks.workunit.client.0.smithi170.stdout:8/773: chown d3/d7/d22/d23/f76 16 1 2024-01-25T15:03:43.735 INFO:tasks.workunit.client.0.smithi170.stdout:8/774: write d3/d7/d22/d5d/f6e [5801028,5279] 0 2024-01-25T15:03:43.735 INFO:tasks.workunit.client.0.smithi170.stdout:8/775: dread - d3/d7/d1e/fbe zero size 2024-01-25T15:03:43.735 INFO:tasks.workunit.client.0.smithi170.stdout:8/776: creat d3/d7/d22/d23/d48/d52/d47/de2/f10a x:0 0 0 2024-01-25T15:03:43.735 INFO:tasks.workunit.client.0.smithi170.stdout:8/777: chown d3/d7/d22/fa8 3523408 1 2024-01-25T15:03:43.735 INFO:tasks.workunit.client.0.smithi170.stdout:8/778: write d3/d7/fb2 [611083,78232] 0 2024-01-25T15:03:43.743 INFO:tasks.workunit.client.0.smithi170.stdout:8/779: dread d3/d7/d1e/f6c [0,4194304] 0 2024-01-25T15:03:43.743 INFO:tasks.workunit.client.0.smithi170.stdout:8/780: creat d3/d7/d22/d23/d48/d52/d47/de2/f10b x:0 0 0 2024-01-25T15:03:43.754 INFO:tasks.workunit.client.0.smithi170.stdout:8/781: dread d3/d7/d22/d23/d25/f2d [0,4194304] 0 2024-01-25T15:03:43.754 INFO:tasks.workunit.client.0.smithi170.stdout:8/782: truncate d3/d7/d22/d23/d48/d52/d47/de2/d104/fff 1666880 0 2024-01-25T15:03:43.762 INFO:tasks.workunit.client.0.smithi170.stdout:8/783: dread d3/d7/d22/d23/d25/d8e/fd7 [0,4194304] 0 2024-01-25T15:03:43.763 INFO:tasks.workunit.client.0.smithi170.stdout:8/784: creat d3/d7/d22/d23/d25/d41/f10c x:0 0 0 2024-01-25T15:03:43.765 INFO:tasks.workunit.client.0.smithi170.stdout:8/785: creat d3/d7/d1e/df9/f10d x:0 0 0 2024-01-25T15:03:43.765 INFO:tasks.workunit.client.0.smithi170.stdout:8/786: fdatasync d3/d7/d22/f5a 0 2024-01-25T15:03:43.767 INFO:tasks.workunit.client.0.smithi170.stdout:8/787: rename d3/d7/d1e/d7c/lc6 to d3/d7/d22/l10e 0 2024-01-25T15:03:43.776 INFO:tasks.workunit.client.0.smithi170.stdout:8/788: dread d3/d7/d3a/d91/d7f/f8c [0,4194304] 0 2024-01-25T15:03:43.777 INFO:tasks.workunit.client.0.smithi170.stdout:8/789: rename d3/d7/d22/c109 to d3/d7/d3a/d8d/dd5/c10f 0 2024-01-25T15:03:43.778 INFO:tasks.workunit.client.0.smithi170.stdout:8/790: mknod d3/d7/d22/d5d/dd0/c110 0 2024-01-25T15:03:43.778 INFO:tasks.workunit.client.0.smithi170.stdout:8/791: creat d3/d7/d22/d23/f111 x:0 0 0 2024-01-25T15:03:43.778 INFO:tasks.workunit.client.0.smithi170.stdout:8/792: chown d3/d7/d3a/d8d/dd5/c10f 31437 1 2024-01-25T15:03:43.780 INFO:tasks.workunit.client.0.smithi170.stdout:8/793: rename d3/d7/d22/d23/d25/l3e to d3/d7/d22/d23/d25/d8e/l112 0 2024-01-25T15:03:43.781 INFO:tasks.workunit.client.0.smithi170.stdout:8/794: mknod d3/d7/d3a/d8d/c113 0 2024-01-25T15:03:43.790 INFO:tasks.workunit.client.0.smithi170.stdout:8/795: dread d3/f9 [4194304,4194304] 0 2024-01-25T15:03:43.790 INFO:tasks.workunit.client.0.smithi170.stdout:8/796: read d3/d7/d22/f5a [2540475,90902] 0 2024-01-25T15:03:43.791 INFO:tasks.workunit.client.0.smithi170.stdout:8/797: creat d3/d7/d3a/d91/f114 x:0 0 0 2024-01-25T15:03:43.792 INFO:tasks.workunit.client.0.smithi170.stdout:8/798: creat d3/d7/d3a/dce/f115 x:0 0 0 2024-01-25T15:03:43.799 INFO:tasks.workunit.client.0.smithi170.stdout:8/799: getdents d3/d7/d3a/d91 0 2024-01-25T15:03:43.799 INFO:tasks.workunit.client.0.smithi170.stdout:8/800: creat d3/d7/d73/f116 x:0 0 0 2024-01-25T15:03:43.800 INFO:tasks.workunit.client.0.smithi170.stdout:8/801: creat d3/d7/d22/d80/dea/df5/f117 x:0 0 0 2024-01-25T15:03:43.802 INFO:tasks.workunit.client.0.smithi170.stdout:8/802: link d3/d7/d22/d23/d48/d52/d47/de2/d104/fff d3/d7/d1e/df9/f118 0 2024-01-25T15:03:43.811 INFO:tasks.workunit.client.0.smithi170.stdout:8/803: write d3/d7/d22/d23/d25/f2d [1689856,5707] 0 2024-01-25T15:03:43.813 INFO:tasks.workunit.client.0.smithi170.stdout:8/804: unlink d3/d7/d22/d23/d25/d41/l98 0 2024-01-25T15:03:43.814 INFO:tasks.workunit.client.0.smithi170.stdout:8/805: mkdir d3/d7/d3a/d85/d119 0 2024-01-25T15:03:43.814 INFO:tasks.workunit.client.0.smithi170.stdout:8/806: write d3/d7/d3a/d8d/db3/fef [358430,124429] 0 2024-01-25T15:03:43.814 INFO:tasks.workunit.client.0.smithi170.stdout:8/807: mknod d3/d7/d22/d23/d25/d41/d61/c11a 0 2024-01-25T15:03:43.816 INFO:tasks.workunit.client.0.smithi170.stdout:8/808: rename d3/d7/d22/d23/d48/d52/d47/d86/c93 to d3/d7/d22/d23/d48/c11b 0 2024-01-25T15:03:43.816 INFO:tasks.workunit.client.0.smithi170.stdout:8/809: dread - d3/d7/d22/d23/d48/d52/d47/de2/ff0 zero size 2024-01-25T15:03:43.816 INFO:tasks.workunit.client.0.smithi170.stdout:8/810: stat d3/d7/d1e/df9 0 2024-01-25T15:03:43.816 INFO:tasks.workunit.client.0.smithi170.stdout:8/811: write d3/d7/d22/d23/d48/d52/d47/f4b [3239981,115212] 0 2024-01-25T15:03:43.817 INFO:tasks.workunit.client.0.smithi170.stdout:8/812: write d3/d7/d3a/f78 [4833327,61355] 0 2024-01-25T15:03:43.818 INFO:tasks.workunit.client.0.smithi170.stdout:8/813: mknod d3/d7/d22/d5d/dd0/c11c 0 2024-01-25T15:03:43.838 INFO:tasks.workunit.client.0.smithi170.stdout:8/814: dwrite d3/d7/d22/d23/d48/d52/d47/de2/d104/fe4 [0,4194304] 0 2024-01-25T15:03:43.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:43 smithi186 ceph-mon[35697]: pgmap v400: 97 pgs: 97 active+clean; 996 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 120 MiB/s rd, 148 MiB/s wr, 2.24k op/s 2024-01-25T15:03:43.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:43 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] up:active 2024-01-25T15:03:43.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:43 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:43.856 INFO:tasks.workunit.client.0.smithi170.stdout:8/815: dwrite d3/d7/d3a/d8d/db3/feb [0,4194304] 0 2024-01-25T15:03:43.856 INFO:tasks.workunit.client.0.smithi170.stdout:8/816: write d3/d7/d22/fa8 [533055,87943] 0 2024-01-25T15:03:43.857 INFO:tasks.workunit.client.0.smithi170.stdout:8/817: mknod d3/d7/d3a/dce/c11d 0 2024-01-25T15:03:43.862 INFO:tasks.workunit.client.0.smithi170.stdout:8/818: dread d3/d7/d3a/f78 [4194304,4194304] 0 2024-01-25T15:03:43.871 INFO:tasks.workunit.client.0.smithi170.stdout:8/819: dread d3/d7/d22/d5d/f6e [0,4194304] 0 2024-01-25T15:03:43.871 INFO:tasks.workunit.client.0.smithi170.stdout:8/820: chown d3/d7/d22/d23/d25/d41/f10c 1 1 2024-01-25T15:03:43.872 INFO:tasks.workunit.client.0.smithi170.stdout:8/821: creat d3/d7/d22/d23/d48/f11e x:0 0 0 2024-01-25T15:03:43.873 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:43 smithi170 ceph-mon[31899]: pgmap v400: 97 pgs: 97 active+clean; 996 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 120 MiB/s rd, 148 MiB/s wr, 2.24k op/s 2024-01-25T15:03:43.873 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:43 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] up:active 2024-01-25T15:03:43.873 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:43 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:43.874 INFO:tasks.workunit.client.0.smithi170.stdout:8/822: dread d3/d7/d3a/d91/f7b [0,4194304] 0 2024-01-25T15:03:43.875 INFO:tasks.workunit.client.0.smithi170.stdout:8/823: mknod d3/d7/d22/d23/d25/d41/d9a/c11f 0 2024-01-25T15:03:43.875 INFO:tasks.workunit.client.0.smithi170.stdout:8/824: fdatasync d3/d7/d1e/d7c/d9f/fc2 0 2024-01-25T15:03:43.877 INFO:tasks.workunit.client.0.smithi170.stdout:8/825: dread d3/d7/d22/d23/f76 [0,4194304] 0 2024-01-25T15:03:43.879 INFO:tasks.workunit.client.0.smithi170.stdout:8/826: link d3/d7/d22/d23/d48/d52/d47/de2/d104/fff d3/d7/d22/d23/d25/d8e/f120 0 2024-01-25T15:03:43.880 INFO:tasks.workunit.client.0.smithi170.stdout:8/827: unlink d3/d7/d22/d23/d48/d52/c6a 0 2024-01-25T15:03:43.881 INFO:tasks.workunit.client.0.smithi170.stdout:8/828: symlink d3/d7/d3a/dce/l121 0 2024-01-25T15:03:43.882 INFO:tasks.workunit.client.0.smithi170.stdout:8/829: chown d3/d7/d3a/d91/lc5 4031895 1 2024-01-25T15:03:43.882 INFO:tasks.workunit.client.0.smithi170.stdout:8/830: stat d3/d7/d3a/d8d/db3/fef 0 2024-01-25T15:03:43.883 INFO:tasks.workunit.client.0.smithi170.stdout:8/831: rename d3/d7/d22/d23/d25/d41/d61/cdc to d3/d7/d3a/d91/d7f/c122 0 2024-01-25T15:03:43.883 INFO:tasks.workunit.client.0.smithi170.stdout:8/832: readlink d3/d7/d22/d23/l2b 0 2024-01-25T15:03:43.900 INFO:tasks.workunit.client.0.smithi170.stdout:8/833: dwrite d3/d7/d1e/fbe [0,4194304] 0 2024-01-25T15:03:43.900 INFO:tasks.workunit.client.0.smithi170.stdout:8/834: fdatasync d3/d7/d22/d5d/f6e 0 2024-01-25T15:03:43.902 INFO:tasks.workunit.client.0.smithi170.stdout:8/835: mkdir d3/d7/d22/d23/d25/d41/d9a/d123 0 2024-01-25T15:03:44.623 INFO:tasks.workunit.client.0.smithi170.stdout:3/685: sync 2024-01-25T15:03:44.624 INFO:tasks.workunit.client.0.smithi170.stdout:8/836: sync 2024-01-25T15:03:44.624 INFO:tasks.workunit.client.0.smithi170.stdout:1/637: sync 2024-01-25T15:03:44.624 INFO:tasks.workunit.client.0.smithi170.stdout:7/663: sync 2024-01-25T15:03:44.624 INFO:tasks.workunit.client.0.smithi170.stdout:9/679: sync 2024-01-25T15:03:44.624 INFO:tasks.workunit.client.0.smithi170.stdout:6/720: sync 2024-01-25T15:03:44.624 INFO:tasks.workunit.client.0.smithi170.stdout:1/638: fsync d0/d2e/fae 0 2024-01-25T15:03:44.624 INFO:tasks.workunit.client.0.smithi170.stdout:4/584: sync 2024-01-25T15:03:44.624 INFO:tasks.workunit.client.0.smithi170.stdout:0/685: sync 2024-01-25T15:03:44.624 INFO:tasks.workunit.client.0.smithi170.stdout:5/636: sync 2024-01-25T15:03:44.624 INFO:tasks.workunit.client.0.smithi170.stdout:2/661: sync 2024-01-25T15:03:44.624 INFO:tasks.workunit.client.0.smithi170.stdout:4/585: write d6/d7/d31/d46/d78/f8b [1050299,75032] 0 2024-01-25T15:03:44.624 INFO:tasks.workunit.client.0.smithi170.stdout:0/686: chown d8/d10/d77 24316225 1 2024-01-25T15:03:44.625 INFO:tasks.workunit.client.0.smithi170.stdout:2/662: truncate d10/d1e/d32/d3e/d5c/d92/fc5 1862044 0 2024-01-25T15:03:44.625 INFO:tasks.workunit.client.0.smithi170.stdout:5/637: write d5/d54/d85/d2c/f5f [105258,507] 0 2024-01-25T15:03:44.625 INFO:tasks.workunit.client.0.smithi170.stdout:2/663: write d10/d1e/f4e [1101356,41893] 0 2024-01-25T15:03:44.625 INFO:tasks.workunit.client.0.smithi170.stdout:4/586: symlink d6/d28/lb8 0 2024-01-25T15:03:44.631 INFO:tasks.workunit.client.0.smithi170.stdout:7/664: mkdir d8/d20/d45/d8e/df5 0 2024-01-25T15:03:44.631 INFO:tasks.workunit.client.0.smithi170.stdout:0/687: mknod d8/d10/d5a/d7f/dd9/cf3 0 2024-01-25T15:03:44.631 INFO:tasks.workunit.client.0.smithi170.stdout:5/638: rename d5/d54/d85/f50 to d5/d54/d85/d2c/d51/d3d/d57/fdb 0 2024-01-25T15:03:44.631 INFO:tasks.workunit.client.0.smithi170.stdout:3/686: mkdir d3/d88/de0 0 2024-01-25T15:03:44.632 INFO:tasks.workunit.client.0.smithi170.stdout:5/639: stat d5/d54/d85/d2c/d45/c67 0 2024-01-25T15:03:44.633 INFO:tasks.workunit.client.0.smithi170.stdout:3/687: symlink d3/d10/d1e/d21/d41/d4a/dc3/le1 0 2024-01-25T15:03:44.636 INFO:tasks.workunit.client.0.smithi170.stdout:7/665: dread d8/d20/d2a/d35/d55/d6e/fd8 [0,4194304] 0 2024-01-25T15:03:44.636 INFO:tasks.workunit.client.0.smithi170.stdout:7/666: chown d8/d20/d45/d68/d71/cb8 63297885 1 2024-01-25T15:03:44.639 INFO:tasks.workunit.client.0.smithi170.stdout:3/688: mkdir d3/d10/de2 0 2024-01-25T15:03:44.641 INFO:tasks.workunit.client.0.smithi170.stdout:7/667: dread d8/fb6 [0,4194304] 0 2024-01-25T15:03:44.641 INFO:tasks.workunit.client.0.smithi170.stdout:3/689: truncate d3/d10/d1e/d21/fa6 130905 0 2024-01-25T15:03:44.641 INFO:tasks.workunit.client.0.smithi170.stdout:9/680: write d5/df/d2e/d77/faf [3424238,118256] 0 2024-01-25T15:03:44.641 INFO:tasks.workunit.client.0.smithi170.stdout:7/668: symlink d8/d20/d2a/d35/d55/d9b/db9/lf6 0 2024-01-25T15:03:44.643 INFO:tasks.workunit.client.0.smithi170.stdout:3/690: rename d3/d10/d13/l15 to d3/d10/d13/d1b/d29/db7/le3 0 2024-01-25T15:03:44.643 INFO:tasks.workunit.client.0.smithi170.stdout:3/691: stat d3/d10/d1e/d21/d41/d4a/ca5 0 2024-01-25T15:03:44.644 INFO:tasks.workunit.client.0.smithi170.stdout:3/692: write d3/d10/d13/f34 [114807,90780] 0 2024-01-25T15:03:44.645 INFO:tasks.workunit.client.0.smithi170.stdout:3/693: stat d3/d10/d13/d1b/d29/f94 0 2024-01-25T15:03:44.645 INFO:tasks.workunit.client.0.smithi170.stdout:3/694: fdatasync d3/fa 0 2024-01-25T15:03:44.645 INFO:tasks.workunit.client.0.smithi170.stdout:3/695: creat d3/d3b/d4f/da0/dcb/fe4 x:0 0 0 2024-01-25T15:03:44.646 INFO:tasks.workunit.client.0.smithi170.stdout:9/681: link d5/df/d2e/d77/d21/d46/fdc d5/df/d2e/db0/fe7 0 2024-01-25T15:03:44.652 INFO:tasks.workunit.client.0.smithi170.stdout:3/696: unlink d3/d10/d6d/d98/lc2 0 2024-01-25T15:03:44.655 INFO:tasks.workunit.client.0.smithi170.stdout:9/682: mknod d5/df/d16/d35/d3c/d56/d59/d5e/ce8 0 2024-01-25T15:03:44.655 INFO:tasks.workunit.client.0.smithi170.stdout:3/697: mkdir d3/d10/d1e/de5 0 2024-01-25T15:03:44.658 INFO:tasks.workunit.client.0.smithi170.stdout:3/698: creat d3/d3b/d4f/da0/ddf/fe6 x:0 0 0 2024-01-25T15:03:44.665 INFO:tasks.workunit.client.0.smithi170.stdout:5/640: dwrite d5/d54/d85/d2c/f31 [0,4194304] 0 2024-01-25T15:03:44.665 INFO:tasks.workunit.client.0.smithi170.stdout:5/641: fdatasync d5/d54/d85/d3f/d8f/f95 0 2024-01-25T15:03:44.671 INFO:tasks.workunit.client.0.smithi170.stdout:1/639: dwrite d0/f99 [0,4194304] 0 2024-01-25T15:03:44.671 INFO:tasks.workunit.client.0.smithi170.stdout:1/640: write d0/d50/f95 [2026291,84210] 0 2024-01-25T15:03:44.671 INFO:tasks.workunit.client.0.smithi170.stdout:5/642: mknod d5/d54/d85/cdc 0 2024-01-25T15:03:44.671 INFO:tasks.workunit.client.0.smithi170.stdout:5/643: fdatasync d5/d54/d85/d2c/d34/d69/fab 0 2024-01-25T15:03:44.672 INFO:tasks.workunit.client.0.smithi170.stdout:0/688: dread d8/d18/f4d [0,4194304] 0 2024-01-25T15:03:44.673 INFO:tasks.workunit.client.0.smithi170.stdout:5/644: getdents d5/d54/d85/d2c/d45/d56/d72 0 2024-01-25T15:03:44.673 INFO:tasks.workunit.client.0.smithi170.stdout:5/645: creat d5/d54/d85/d2c/d51/fdd x:0 0 0 2024-01-25T15:03:44.673 INFO:tasks.workunit.client.0.smithi170.stdout:5/646: chown d5/d2a/f3e 0 1 2024-01-25T15:03:44.673 INFO:tasks.workunit.client.0.smithi170.stdout:5/647: truncate d5/d54/d85/d3f/d8f/fd0 823286 0 2024-01-25T15:03:44.676 INFO:tasks.workunit.client.0.smithi170.stdout:6/721: dwrite d2/d7/d23/d19/f6a [0,4194304] 0 2024-01-25T15:03:44.676 INFO:tasks.workunit.client.0.smithi170.stdout:6/722: write d2/d7/d23/d19/d2a/d43/d44/f66 [6242268,108392] 0 2024-01-25T15:03:44.682 INFO:tasks.workunit.client.0.smithi170.stdout:9/683: write d5/dc/d42/f44 [628121,81786] 0 2024-01-25T15:03:44.682 INFO:tasks.workunit.client.0.smithi170.stdout:8/837: dwrite d3/d7/d22/fee [0,4194304] 0 2024-01-25T15:03:44.682 INFO:tasks.workunit.client.0.smithi170.stdout:2/664: dwrite d10/d1e/f9a [0,4194304] 0 2024-01-25T15:03:44.682 INFO:tasks.workunit.client.0.smithi170.stdout:4/587: dwrite d6/d7/d31/fb3 [0,4194304] 0 2024-01-25T15:03:44.689 INFO:tasks.workunit.client.0.smithi170.stdout:6/723: dread d2/d7/d23/d19/d2a/f79 [0,4194304] 0 2024-01-25T15:03:44.689 INFO:tasks.workunit.client.0.smithi170.stdout:6/724: chown d2/d7/d23/d19/d2f/dd4/ded 0 1 2024-01-25T15:03:44.689 INFO:tasks.workunit.client.0.smithi170.stdout:6/725: dread - d2/d7/d1b/d28/da7/dd2/fe8 zero size 2024-01-25T15:03:44.689 INFO:tasks.workunit.client.0.smithi170.stdout:6/726: creat d2/d7/d23/d19/d2a/d6b/ffa x:0 0 0 2024-01-25T15:03:44.690 INFO:tasks.workunit.client.0.smithi170.stdout:8/838: getdents d3/d7/d22/d5d 0 2024-01-25T15:03:44.690 INFO:tasks.workunit.client.0.smithi170.stdout:8/839: readlink d3/d7/d1e/l31 0 2024-01-25T15:03:44.690 INFO:tasks.workunit.client.0.smithi170.stdout:0/689: dread d8/d18/f20 [0,4194304] 0 2024-01-25T15:03:44.690 INFO:tasks.workunit.client.0.smithi170.stdout:0/690: stat d8/d18/c31 0 2024-01-25T15:03:44.690 INFO:tasks.workunit.client.0.smithi170.stdout:0/691: write d8/d10/d2d/d58/fa5 [691175,4836] 0 2024-01-25T15:03:44.690 INFO:tasks.workunit.client.0.smithi170.stdout:0/692: chown d8/cb0 23 1 2024-01-25T15:03:44.694 INFO:tasks.workunit.client.0.smithi170.stdout:9/684: getdents d5/df/d2e/d77/d21/d46/d6c 0 2024-01-25T15:03:44.697 INFO:tasks.workunit.client.0.smithi170.stdout:9/685: truncate d5/df/d2e/d6b/f72 2267176 0 2024-01-25T15:03:44.703 INFO:tasks.workunit.client.0.smithi170.stdout:6/727: write d2/d7/d1b/f64 [1716819,22013] 0 2024-01-25T15:03:44.704 INFO:tasks.workunit.client.0.smithi170.stdout:6/728: chown d2/c4c 12486928 1 2024-01-25T15:03:44.704 INFO:tasks.workunit.client.0.smithi170.stdout:9/686: unlink d5/dc/c88 0 2024-01-25T15:03:44.704 INFO:tasks.workunit.client.0.smithi170.stdout:6/729: read d2/d7/d23/fa5 [126967,106037] 0 2024-01-25T15:03:44.704 INFO:tasks.workunit.client.0.smithi170.stdout:6/730: truncate d2/d7/d23/d19/d2a/d6b/dad/fc5 1026597 0 2024-01-25T15:03:44.704 INFO:tasks.workunit.client.0.smithi170.stdout:7/669: dwrite d8/d20/d45/d68/daa/fcb [0,4194304] 0 2024-01-25T15:03:44.704 INFO:tasks.workunit.client.0.smithi170.stdout:3/699: dwrite d3/d3b/dc6/d7e/fa9 [0,4194304] 0 2024-01-25T15:03:44.704 INFO:tasks.workunit.client.0.smithi170.stdout:4/588: write d6/d7/d31/d7e/d80/f91 [771589,35608] 0 2024-01-25T15:03:44.704 INFO:tasks.workunit.client.0.smithi170.stdout:4/589: chown d6/d7/d9f 0 1 2024-01-25T15:03:44.704 INFO:tasks.workunit.client.0.smithi170.stdout:4/590: fsync d6/d7/d31/d46/f92 0 2024-01-25T15:03:44.705 INFO:tasks.workunit.client.0.smithi170.stdout:9/687: link d5/df/d2e/d77/f82 d5/dc/fe9 0 2024-01-25T15:03:44.705 INFO:tasks.workunit.client.0.smithi170.stdout:9/688: truncate d5/df/d2e/d77/d21/daa/fcc 105824 0 2024-01-25T15:03:44.707 INFO:tasks.workunit.client.0.smithi170.stdout:6/731: truncate d2/d7/d23/d19/d2f/d74/dbd/fe5 3090754 0 2024-01-25T15:03:44.709 INFO:tasks.workunit.client.0.smithi170.stdout:9/689: dread d5/df/d2e/d77/d21/d46/d6c/f71 [0,4194304] 0 2024-01-25T15:03:44.709 INFO:tasks.workunit.client.0.smithi170.stdout:9/690: fdatasync d5/df/f15 0 2024-01-25T15:03:44.711 INFO:tasks.workunit.client.0.smithi170.stdout:2/665: dread d10/d1e/d32/d62/d74/fba [0,4194304] 0 2024-01-25T15:03:44.711 INFO:tasks.workunit.client.0.smithi170.stdout:2/666: creat d10/d1b/db6/dd7/ff1 x:0 0 0 2024-01-25T15:03:44.713 INFO:tasks.workunit.client.0.smithi170.stdout:0/693: dread d8/d9/d9a/fa6 [0,4194304] 0 2024-01-25T15:03:44.713 INFO:tasks.workunit.client.0.smithi170.stdout:3/700: mknod d3/d10/d1e/de5/ce7 0 2024-01-25T15:03:44.716 INFO:tasks.workunit.client.0.smithi170.stdout:9/691: creat d5/df/d2e/d77/d21/d46/d18/dc0/fea x:0 0 0 2024-01-25T15:03:44.718 INFO:tasks.workunit.client.0.smithi170.stdout:1/641: dwrite d0/d50/d8e/d9e/fd4 [0,4194304] 0 2024-01-25T15:03:44.718 INFO:tasks.workunit.client.0.smithi170.stdout:7/670: dread d8/f4e [0,4194304] 0 2024-01-25T15:03:44.718 INFO:tasks.workunit.client.0.smithi170.stdout:7/671: chown d8/d20/d2a/d35/d55/d7d/da6/dd1/fe9 18 1 2024-01-25T15:03:44.718 INFO:tasks.workunit.client.0.smithi170.stdout:7/672: stat d8/d20/d2a/d61/c7e 0 2024-01-25T15:03:44.719 INFO:tasks.workunit.client.0.smithi170.stdout:8/840: dwrite d3/f42 [0,4194304] 0 2024-01-25T15:03:44.719 INFO:tasks.workunit.client.0.smithi170.stdout:8/841: readlink d3/d7/d3a/l4e 0 2024-01-25T15:03:44.719 INFO:tasks.workunit.client.0.smithi170.stdout:4/591: getdents d6/d7/d31 0 2024-01-25T15:03:44.719 INFO:tasks.workunit.client.0.smithi170.stdout:4/592: readlink l1 0 2024-01-25T15:03:44.720 INFO:tasks.workunit.client.0.smithi170.stdout:3/701: rename d3/d10/d13/daf to d3/d10/de2/de8 0 2024-01-25T15:03:44.721 INFO:tasks.workunit.client.0.smithi170.stdout:3/702: fsync d3/fa 0 2024-01-25T15:03:44.726 INFO:tasks.workunit.client.0.smithi170.stdout:6/732: creat d2/d7/d23/d19/d2a/d43/d98/ffb x:0 0 0 2024-01-25T15:03:44.727 INFO:tasks.workunit.client.0.smithi170.stdout:9/692: creat d5/df/d2e/d77/d21/feb x:0 0 0 2024-01-25T15:03:44.730 INFO:tasks.workunit.client.0.smithi170.stdout:1/642: creat d0/d20/fd5 x:0 0 0 2024-01-25T15:03:44.732 INFO:tasks.workunit.client.0.smithi170.stdout:7/673: unlink d8/d20/d45/d68/d71/d8c/fd7 0 2024-01-25T15:03:44.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:44 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] up:active 2024-01-25T15:03:44.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:44 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:44.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:44 smithi191 ceph-mon[36347]: pgmap v401: 97 pgs: 97 active+clean; 1.3 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 164 MiB/s rd, 191 MiB/s wr, 2.38k op/s 2024-01-25T15:03:44.734 INFO:tasks.workunit.client.0.smithi170.stdout:8/842: mknod d3/d7/d22/d5d/dd0/c124 0 2024-01-25T15:03:44.734 INFO:tasks.workunit.client.0.smithi170.stdout:8/843: fsync d3/d7/d22/d23/d48/d52/d47/de2/d104/fff 0 2024-01-25T15:03:44.734 INFO:tasks.workunit.client.0.smithi170.stdout:8/844: fsync d3/d7/d22/fa8 0 2024-01-25T15:03:44.737 INFO:tasks.workunit.client.0.smithi170.stdout:5/648: dwrite d5/d2a/f2b [4194304,4194304] 0 2024-01-25T15:03:44.739 INFO:tasks.workunit.client.0.smithi170.stdout:3/703: creat d3/fe9 x:0 0 0 2024-01-25T15:03:44.739 INFO:tasks.workunit.client.0.smithi170.stdout:2/667: dwrite d10/d1b/db6/dd7/ff1 [0,4194304] 0 2024-01-25T15:03:44.739 INFO:tasks.workunit.client.0.smithi170.stdout:2/668: chown d10/d1e/d32/d3e/d41 12581307 1 2024-01-25T15:03:44.740 INFO:tasks.workunit.client.0.smithi170.stdout:2/669: creat d10/d1e/d32/d3e/d41/dc4/dc6/d42/daa/ff2 x:0 0 0 2024-01-25T15:03:44.740 INFO:tasks.workunit.client.0.smithi170.stdout:6/733: mkdir d2/d7/dd9/dfc 0 2024-01-25T15:03:44.743 INFO:tasks.workunit.client.0.smithi170.stdout:9/693: dread d5/df/d2e/d77/d21/d46/d18/d6a/f8b [0,4194304] 0 2024-01-25T15:03:44.743 INFO:tasks.workunit.client.0.smithi170.stdout:8/845: mkdir d3/d7/d73/dba/d125 0 2024-01-25T15:03:44.743 INFO:tasks.workunit.client.0.smithi170.stdout:9/694: truncate d5/df/d2e/db0/fe6 4764122 0 2024-01-25T15:03:44.743 INFO:tasks.workunit.client.0.smithi170.stdout:9/695: write d5/df/d2e/d77/d21/d34/d3e/d7f/fe2 [1021520,77361] 0 2024-01-25T15:03:44.744 INFO:tasks.workunit.client.0.smithi170.stdout:1/643: write d0/f99 [2993195,16322] 0 2024-01-25T15:03:44.747 INFO:tasks.workunit.client.0.smithi170.stdout:0/694: rename d8/d10/d2d/d89 to d8/d10/d2d/d53/df4 0 2024-01-25T15:03:44.748 INFO:tasks.workunit.client.0.smithi170.stdout:0/695: write d8/d10/d2d/d58/f62 [1039786,14550] 0 2024-01-25T15:03:44.748 INFO:tasks.workunit.client.0.smithi170.stdout:7/674: dread d8/f31 [0,4194304] 0 2024-01-25T15:03:44.748 INFO:tasks.workunit.client.0.smithi170.stdout:7/675: fdatasync d8/f92 0 2024-01-25T15:03:44.748 INFO:tasks.workunit.client.0.smithi170.stdout:7/676: dread - d8/d20/d45/d8e/fee zero size 2024-01-25T15:03:44.749 INFO:tasks.workunit.client.0.smithi170.stdout:9/696: symlink d5/df/d2e/d77/d21/d46/d6c/lec 0 2024-01-25T15:03:44.750 INFO:tasks.workunit.client.0.smithi170.stdout:1/644: symlink d0/d50/da0/ld6 0 2024-01-25T15:03:44.750 INFO:tasks.workunit.client.0.smithi170.stdout:1/645: readlink d0/d20/l27 0 2024-01-25T15:03:44.750 INFO:tasks.workunit.client.0.smithi170.stdout:4/593: rmdir d6/d7/d31/d7e 39 2024-01-25T15:03:44.751 INFO:tasks.workunit.client.0.smithi170.stdout:4/594: chown d6/d28/f5d 912 1 2024-01-25T15:03:44.751 INFO:tasks.workunit.client.0.smithi170.stdout:6/734: dread d2/d7/d1b/d28/da7/fc2 [0,4194304] 0 2024-01-25T15:03:44.751 INFO:tasks.workunit.client.0.smithi170.stdout:3/704: dread d3/d3b/dc6/d7e/fa9 [0,4194304] 0 2024-01-25T15:03:44.751 INFO:tasks.workunit.client.0.smithi170.stdout:3/705: fdatasync d3/d10/d13/d1b/d29/f94 0 2024-01-25T15:03:44.752 INFO:tasks.workunit.client.0.smithi170.stdout:3/706: write d3/fe9 [170256,21849] 0 2024-01-25T15:03:44.752 INFO:tasks.workunit.client.0.smithi170.stdout:3/707: chown d3/d1c/c45 8621 1 2024-01-25T15:03:44.753 INFO:tasks.workunit.client.0.smithi170.stdout:5/649: rename d5/d54/d85/d2c/d51/d3d/d57 to d5/d54/d85/d2c/d51/d96/dda/dde 0 2024-01-25T15:03:44.754 INFO:tasks.workunit.client.0.smithi170.stdout:0/696: symlink d8/d9/d9a/dbd/lf5 0 2024-01-25T15:03:44.755 INFO:tasks.workunit.client.0.smithi170.stdout:7/677: symlink d8/d20/dc2/lf7 0 2024-01-25T15:03:44.757 INFO:tasks.workunit.client.0.smithi170.stdout:1/646: creat d0/d20/d28/d2a/d4a/dbe/fd7 x:0 0 0 2024-01-25T15:03:44.758 INFO:tasks.workunit.client.0.smithi170.stdout:1/647: creat d0/d20/d28/d2a/d4a/d56/d5b/d72/fd8 x:0 0 0 2024-01-25T15:03:44.758 INFO:tasks.workunit.client.0.smithi170.stdout:6/735: symlink d2/d7/d1b/d28/da7/lfd 0 2024-01-25T15:03:44.758 INFO:tasks.workunit.client.0.smithi170.stdout:1/648: chown d0/d20/d28/d7b/da8/lc4 110 1 2024-01-25T15:03:44.758 INFO:tasks.workunit.client.0.smithi170.stdout:1/649: creat d0/d20/d28/d7b/da8/daa/fd9 x:0 0 0 2024-01-25T15:03:44.760 INFO:tasks.workunit.client.0.smithi170.stdout:3/708: unlink d3/d3b/dc6/d53/l59 0 2024-01-25T15:03:44.761 INFO:tasks.workunit.client.0.smithi170.stdout:8/846: rename d3/d7/d22/d23/d48/d52/d47/d86/fcd to d3/d7/d3a/d8d/f126 0 2024-01-25T15:03:44.761 INFO:tasks.workunit.client.0.smithi170.stdout:5/650: rmdir d5/d54/d85/d2c/d34/d7c 39 2024-01-25T15:03:44.761 INFO:tasks.workunit.client.0.smithi170.stdout:5/651: creat d5/d54/d85/d3f/d8f/fdf x:0 0 0 2024-01-25T15:03:44.762 INFO:tasks.workunit.client.0.smithi170.stdout:2/670: dwrite d10/d1b/db6/dd7/fe4 [0,4194304] 0 2024-01-25T15:03:44.763 INFO:tasks.workunit.client.0.smithi170.stdout:6/736: mknod d2/d7/d23/d19/d2f/d5d/cfe 0 2024-01-25T15:03:44.768 INFO:tasks.workunit.client.0.smithi170.stdout:4/595: dread d6/d28/d59/d7d/f2e [0,4194304] 0 2024-01-25T15:03:44.768 INFO:tasks.workunit.client.0.smithi170.stdout:3/709: symlink d3/lea 0 2024-01-25T15:03:44.768 INFO:tasks.workunit.client.0.smithi170.stdout:8/847: creat d3/d7/d3a/d85/d119/f127 x:0 0 0 2024-01-25T15:03:44.768 INFO:tasks.workunit.client.0.smithi170.stdout:8/848: write d3/d7/d22/f5a [3434841,5199] 0 2024-01-25T15:03:44.768 INFO:tasks.workunit.client.0.smithi170.stdout:8/849: creat d3/d7/d22/d23/d48/d52/d47/de2/f128 x:0 0 0 2024-01-25T15:03:44.769 INFO:tasks.workunit.client.0.smithi170.stdout:1/650: rename d0/c17 to d0/d20/cda 0 2024-01-25T15:03:44.771 INFO:tasks.workunit.client.0.smithi170.stdout:0/697: dread d8/d10/d2d/d53/fb5 [0,4194304] 0 2024-01-25T15:03:44.772 INFO:tasks.workunit.client.0.smithi170.stdout:3/710: mknod d3/d10/d13/ceb 0 2024-01-25T15:03:44.775 INFO:tasks.workunit.client.0.smithi170.stdout:1/651: unlink d0/d2e/c4f 0 2024-01-25T15:03:44.777 INFO:tasks.workunit.client.0.smithi170.stdout:3/711: mknod d3/d10/d1e/d21/d41/d4b/d63/dc7/cec 0 2024-01-25T15:03:44.780 INFO:tasks.workunit.client.0.smithi170.stdout:9/697: dwrite d5/dc/f36 [0,4194304] 0 2024-01-25T15:03:44.780 INFO:tasks.workunit.client.0.smithi170.stdout:9/698: dread - d5/df/d2e/d77/d21/d34/d3e/d7f/fb9 zero size 2024-01-25T15:03:44.781 INFO:tasks.workunit.client.0.smithi170.stdout:1/652: unlink d0/ca7 0 2024-01-25T15:03:44.782 INFO:tasks.workunit.client.0.smithi170.stdout:1/653: fsync d0/d20/fd5 0 2024-01-25T15:03:44.783 INFO:tasks.workunit.client.0.smithi170.stdout:7/678: dwrite d8/d20/d2a/d35/d55/d9b/fc1 [0,4194304] 0 2024-01-25T15:03:44.783 INFO:tasks.workunit.client.0.smithi170.stdout:6/737: dread d2/d7/d23/d19/d2a/d43/d98/f3f [0,4194304] 0 2024-01-25T15:03:44.783 INFO:tasks.workunit.client.0.smithi170.stdout:3/712: symlink d3/led 0 2024-01-25T15:03:44.785 INFO:tasks.workunit.client.0.smithi170.stdout:4/596: write d6/d28/d59/d7d/d6b/f88 [3580985,91996] 0 2024-01-25T15:03:44.785 INFO:tasks.workunit.client.0.smithi170.stdout:4/597: creat d6/d28/d59/da8/fb9 x:0 0 0 2024-01-25T15:03:44.788 INFO:tasks.workunit.client.0.smithi170.stdout:8/850: dread d3/d7/d3a/d8d/db3/feb [0,4194304] 0 2024-01-25T15:03:44.790 INFO:tasks.workunit.client.0.smithi170.stdout:2/671: dwrite d10/d1e/d32/d3e/d41/dc4/dc6/f23 [0,4194304] 0 2024-01-25T15:03:44.790 INFO:tasks.workunit.client.0.smithi170.stdout:0/698: dread d8/d10/d2d/d58/f5c [0,4194304] 0 2024-01-25T15:03:44.791 INFO:tasks.workunit.client.0.smithi170.stdout:0/699: write d8/d10/d2d/d58/fa5 [479565,91790] 0 2024-01-25T15:03:44.792 INFO:tasks.workunit.client.0.smithi170.stdout:2/672: dread d10/d1e/f91 [0,4194304] 0 2024-01-25T15:03:44.792 INFO:tasks.workunit.client.0.smithi170.stdout:2/673: chown d10/d1e/d32/d3e/d41/dc4/dc6/d42/f48 1141246689 1 2024-01-25T15:03:44.792 INFO:tasks.workunit.client.0.smithi170.stdout:2/674: dread - d10/d1e/d32/d3e/fd2 zero size 2024-01-25T15:03:44.795 INFO:tasks.workunit.client.0.smithi170.stdout:9/699: rename d5/df/d2e/d77/d21/d34/d3e/de5 to d5/df/d16/d35/d3c/d91/dd6/dd9/ded 0 2024-01-25T15:03:44.796 INFO:tasks.workunit.client.0.smithi170.stdout:1/654: symlink d0/d50/dc0/ldb 0 2024-01-25T15:03:44.798 INFO:tasks.workunit.client.0.smithi170.stdout:7/679: rmdir d8/de5 0 2024-01-25T15:03:44.800 INFO:tasks.workunit.client.0.smithi170.stdout:4/598: symlink d6/d7/d9f/lba 0 2024-01-25T15:03:44.802 INFO:tasks.workunit.client.0.smithi170.stdout:8/851: link d3/d7/d22/d23/d48/d52/d47/d86/fb9 d3/d7/d22/d23/d25/d8e/f129 0 2024-01-25T15:03:44.803 INFO:tasks.workunit.client.0.smithi170.stdout:3/713: symlink d3/d10/d1e/d96/lee 0 2024-01-25T15:03:44.806 INFO:tasks.workunit.client.0.smithi170.stdout:2/675: dread d10/d1e/d32/d3e/d5c/f86 [0,4194304] 0 2024-01-25T15:03:44.816 INFO:tasks.workunit.client.0.smithi170.stdout:6/738: rename d2/d7/c7f to d2/d7/d23/d19/d2f/d74/dce/ddf/cff 0 2024-01-25T15:03:44.817 INFO:tasks.workunit.client.0.smithi170.stdout:1/655: symlink d0/d50/da2/ldc 0 2024-01-25T15:03:44.817 INFO:tasks.workunit.client.0.smithi170.stdout:1/656: readlink d0/d20/l27 0 2024-01-25T15:03:44.820 INFO:tasks.workunit.client.0.smithi170.stdout:8/852: mkdir d3/d7/d22/d23/d25/d12a 0 2024-01-25T15:03:44.820 INFO:tasks.workunit.client.0.smithi170.stdout:8/853: read d3/d7/d22/d23/d48/d52/d47/de2/d104/faf [479258,92159] 0 2024-01-25T15:03:44.822 INFO:tasks.workunit.client.0.smithi170.stdout:3/714: rename d3/d3b/dc6/d7e/fa9 to d3/d1c/fef 0 2024-01-25T15:03:44.822 INFO:tasks.workunit.client.0.smithi170.stdout:3/715: fdatasync d3/d10/d1e/d21/d41/d4b/d63/dc7/fcc 0 2024-01-25T15:03:44.823 INFO:tasks.workunit.client.0.smithi170.stdout:8/854: creat d3/d7/d3a/f12b x:0 0 0 2024-01-25T15:03:44.825 INFO:tasks.workunit.client.0.smithi170.stdout:8/855: mknod d3/d7/d3a/d85/c12c 0 2024-01-25T15:03:44.829 INFO:tasks.workunit.client.0.smithi170.stdout:1/657: dread d0/fd [4194304,4194304] 0 2024-01-25T15:03:44.829 INFO:tasks.workunit.client.0.smithi170.stdout:0/700: dwrite d8/d10/d2d/d58/f5c [4194304,4194304] 0 2024-01-25T15:03:44.832 INFO:tasks.workunit.client.0.smithi170.stdout:0/701: getdents d8/d10/d2d/d53/df4/dc6 0 2024-01-25T15:03:44.832 INFO:tasks.workunit.client.0.smithi170.stdout:0/702: truncate d8/d10/d2d/d2f/d6a/fe8 553217 0 2024-01-25T15:03:44.832 INFO:tasks.workunit.client.0.smithi170.stdout:7/680: dwrite d8/d20/d2a/d35/d55/d6e/d81/fca [0,4194304] 0 2024-01-25T15:03:44.832 INFO:tasks.workunit.client.0.smithi170.stdout:7/681: chown d8/d20/d2a/d35/db0 1252961232 1 2024-01-25T15:03:44.838 INFO:tasks.workunit.client.0.smithi170.stdout:0/703: getdents d8/d10/d2d/d53 0 2024-01-25T15:03:44.838 INFO:tasks.workunit.client.0.smithi170.stdout:0/704: fsync d8/d18/f84 0 2024-01-25T15:03:44.840 INFO:tasks.workunit.client.0.smithi170.stdout:7/682: getdents d8/d20/d3b 0 2024-01-25T15:03:44.843 INFO:tasks.workunit.client.0.smithi170.stdout:0/705: rename d8/d10/d2d/d2f/c33 to d8/d9/cf6 0 2024-01-25T15:03:44.849 INFO:tasks.workunit.client.0.smithi170.stdout:2/676: dread d10/d1e/d32/d3e/d41/dc4/dc6/f3b [4194304,4194304] 0 2024-01-25T15:03:44.850 INFO:tasks.workunit.client.0.smithi170.stdout:0/706: dread d8/d10/d2d/d58/f5c [0,4194304] 0 2024-01-25T15:03:44.850 INFO:tasks.workunit.client.0.smithi170.stdout:6/739: dwrite d2/d7/d23/d19/d2a/d43/d44/da4/fab [4194304,4194304] 0 2024-01-25T15:03:44.850 INFO:tasks.workunit.client.0.smithi170.stdout:0/707: creat d8/d10/d77/ff7 x:0 0 0 2024-01-25T15:03:44.851 INFO:tasks.workunit.client.0.smithi170.stdout:6/740: write d2/d7/d1b/d28/da7/fc2 [779890,85198] 0 2024-01-25T15:03:44.851 INFO:tasks.workunit.client.0.smithi170.stdout:6/741: write d2/d7/d23/d19/d2f/d74/dc1/dcf/ff1 [230671,5427] 0 2024-01-25T15:03:44.851 INFO:tasks.workunit.client.0.smithi170.stdout:6/742: fsync d2/d7/d23/d19/d2a/d43/d98/f3f 0 2024-01-25T15:03:44.851 INFO:tasks.workunit.client.0.smithi170.stdout:2/677: mknod d10/d1b/cf3 0 2024-01-25T15:03:44.853 INFO:tasks.workunit.client.0.smithi170.stdout:1/658: dread d0/d20/d3a/d60/f7d [0,4194304] 0 2024-01-25T15:03:44.853 INFO:tasks.workunit.client.0.smithi170.stdout:3/716: dwrite d3/d10/d1e/d21/d41/d4b/d63/dc7/fcc [0,4194304] 0 2024-01-25T15:03:44.853 INFO:tasks.workunit.client.0.smithi170.stdout:1/659: truncate d0/d2e/f3b 4654617 0 2024-01-25T15:03:44.853 INFO:tasks.workunit.client.0.smithi170.stdout:1/660: readlink d0/l24 0 2024-01-25T15:03:44.853 INFO:tasks.workunit.client.0.smithi170.stdout:1/661: read d0/d20/d28/d2a/d4a/d56/dc1/fd0 [1976894,65194] 0 2024-01-25T15:03:44.853 INFO:tasks.workunit.client.0.smithi170.stdout:0/708: rename d8/d10/d5a/ldc to d8/d18/lf8 0 2024-01-25T15:03:44.854 INFO:tasks.workunit.client.0.smithi170.stdout:4/599: link d6/d7/d31/l8d d6/d7/d31/d7e/d9c/lbb 0 2024-01-25T15:03:44.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:44 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] up:active 2024-01-25T15:03:44.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:44 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:44.854 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:44 smithi186 ceph-mon[35697]: pgmap v401: 97 pgs: 97 active+clean; 1.3 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 164 MiB/s rd, 191 MiB/s wr, 2.38k op/s 2024-01-25T15:03:44.855 INFO:tasks.workunit.client.0.smithi170.stdout:6/743: mkdir d2/d7/d23/d19/d2f/d74/dc1/dcf/d100 0 2024-01-25T15:03:44.856 INFO:tasks.workunit.client.0.smithi170.stdout:6/744: write d2/d7/f18 [3327867,119474] 0 2024-01-25T15:03:44.856 INFO:tasks.workunit.client.0.smithi170.stdout:4/600: getdents d6/d7/d31/d7e/d9c 0 2024-01-25T15:03:44.856 INFO:tasks.workunit.client.0.smithi170.stdout:4/601: write d6/fa0 [675520,78041] 0 2024-01-25T15:03:44.856 INFO:tasks.workunit.client.0.smithi170.stdout:6/745: dread d2/d7/d1b/d28/f8a [4194304,4194304] 0 2024-01-25T15:03:44.858 INFO:tasks.workunit.client.0.smithi170.stdout:2/678: mkdir d10/d1e/d5e/d73/d9e/da3/df4 0 2024-01-25T15:03:44.859 INFO:tasks.workunit.client.0.smithi170.stdout:3/717: mknod d3/d10/d13/d1b/cf0 0 2024-01-25T15:03:44.859 INFO:tasks.workunit.client.0.smithi170.stdout:3/718: truncate d3/d3b/fda 1011765 0 2024-01-25T15:03:44.860 INFO:tasks.workunit.client.0.smithi170.stdout:1/662: truncate d0/d20/d3a/f54 2870777 0 2024-01-25T15:03:44.861 INFO:tasks.workunit.client.0.smithi170.stdout:0/709: mkdir d8/d10/d2d/d53/df4/dc6/dc9/df9 0 2024-01-25T15:03:44.862 INFO:tasks.workunit.client.0.smithi170.stdout:1/663: mkdir d0/d20/ddd 0 2024-01-25T15:03:44.862 INFO:tasks.workunit.client.0.smithi170.stdout:1/664: readlink d0/d1b/l86 0 2024-01-25T15:03:44.863 INFO:tasks.workunit.client.0.smithi170.stdout:4/602: dread d6/d7/d1b/f1e [0,4194304] 0 2024-01-25T15:03:44.863 INFO:tasks.workunit.client.0.smithi170.stdout:0/710: creat d8/d10/d2d/d53/df4/dc6/dc9/dca/ffa x:0 0 0 2024-01-25T15:03:44.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:44 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] up:active 2024-01-25T15:03:44.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:44 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:44.875 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:44 smithi170 ceph-mon[31899]: pgmap v401: 97 pgs: 97 active+clean; 1.3 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 164 MiB/s rd, 191 MiB/s wr, 2.38k op/s 2024-01-25T15:03:44.877 INFO:tasks.workunit.client.0.smithi170.stdout:7/683: dwrite d8/d20/d45/f46 [0,4194304] 0 2024-01-25T15:03:44.878 INFO:tasks.workunit.client.0.smithi170.stdout:1/665: write d0/d20/f4d [1556552,35177] 0 2024-01-25T15:03:44.882 INFO:tasks.workunit.client.0.smithi170.stdout:7/684: dread d8/d20/d2a/d35/f37 [0,4194304] 0 2024-01-25T15:03:44.882 INFO:tasks.workunit.client.0.smithi170.stdout:7/685: creat d8/d20/d45/d68/d71/d8c/ff8 x:0 0 0 2024-01-25T15:03:44.882 INFO:tasks.workunit.client.0.smithi170.stdout:4/603: getdents d6/d28 0 2024-01-25T15:03:44.882 INFO:tasks.workunit.client.0.smithi170.stdout:4/604: write d6/d7/d31/d7e/f74 [759439,60802] 0 2024-01-25T15:03:44.889 INFO:tasks.workunit.client.0.smithi170.stdout:2/679: rename d10/c67 to d10/d1e/d32/d98/d99/dd4/cf5 0 2024-01-25T15:03:44.889 INFO:tasks.workunit.client.0.smithi170.stdout:1/666: write d0/d1b/fa1 [2766745,107804] 0 2024-01-25T15:03:44.897 INFO:tasks.workunit.client.0.smithi170.stdout:3/719: dwrite d3/d3b/fda [0,4194304] 0 2024-01-25T15:03:44.898 INFO:tasks.workunit.client.0.smithi170.stdout:3/720: rmdir d3/d3b/dc6/d7e 39 2024-01-25T15:03:44.899 INFO:tasks.workunit.client.0.smithi170.stdout:6/746: dwrite d2/d7/f4a [0,4194304] 0 2024-01-25T15:03:44.899 INFO:tasks.workunit.client.0.smithi170.stdout:0/711: dwrite d8/f38 [0,4194304] 0 2024-01-25T15:03:44.900 INFO:tasks.workunit.client.0.smithi170.stdout:0/712: chown d8/d3e/fe4 15532 1 2024-01-25T15:03:44.903 INFO:tasks.workunit.client.0.smithi170.stdout:6/747: dread d2/d7/d1b/d28/db8/fba [0,4194304] 0 2024-01-25T15:03:44.908 INFO:tasks.workunit.client.0.smithi170.stdout:7/686: dwrite d8/f1e [0,4194304] 0 2024-01-25T15:03:44.908 INFO:tasks.workunit.client.0.smithi170.stdout:7/687: chown d8/d20/d45/d68/daa/fcb 317 1 2024-01-25T15:03:44.909 INFO:tasks.workunit.client.0.smithi170.stdout:0/713: mknod d8/cfb 0 2024-01-25T15:03:44.909 INFO:tasks.workunit.client.0.smithi170.stdout:0/714: write d8/d10/d2d/d2f/d6a/d79/db6/fb8 [514473,80849] 0 2024-01-25T15:03:44.909 INFO:tasks.workunit.client.0.smithi170.stdout:0/715: chown d8/d3e/fe4 3730610 1 2024-01-25T15:03:44.909 INFO:tasks.workunit.client.0.smithi170.stdout:0/716: write d8/d10/d2d/d58/f5c [3162062,77889] 0 2024-01-25T15:03:44.909 INFO:tasks.workunit.client.0.smithi170.stdout:0/717: chown d8/c30 13 1 2024-01-25T15:03:44.909 INFO:tasks.workunit.client.0.smithi170.stdout:0/718: chown d8/d10/d2d/d53/df4/dc6/dc9 135130 1 2024-01-25T15:03:44.909 INFO:tasks.workunit.client.0.smithi170.stdout:6/748: getdents d2/d7/d23/d19/d2f/d74/dc1 0 2024-01-25T15:03:44.915 INFO:tasks.workunit.client.0.smithi170.stdout:3/721: dread d3/d10/d1e/d21/d41/d77/f76 [0,4194304] 0 2024-01-25T15:03:44.917 INFO:tasks.workunit.client.0.smithi170.stdout:4/605: link d6/c3e d6/d28/d93/cbc 0 2024-01-25T15:03:44.917 INFO:tasks.workunit.client.0.smithi170.stdout:6/749: dread d2/d7/d23/d19/f6a [0,4194304] 0 2024-01-25T15:03:44.917 INFO:tasks.workunit.client.0.smithi170.stdout:6/750: write d2/d7/d23/d19/d60/fdd [1715403,29719] 0 2024-01-25T15:03:44.918 INFO:tasks.workunit.client.0.smithi170.stdout:3/722: symlink d3/d1c/d2d/lf1 0 2024-01-25T15:03:44.918 INFO:tasks.workunit.client.0.smithi170.stdout:4/606: fdatasync d6/d7/d31/f4d 0 2024-01-25T15:03:44.918 INFO:tasks.workunit.client.0.smithi170.stdout:4/607: write d6/d28/d59/d7d/f5c [850978,35672] 0 2024-01-25T15:03:44.918 INFO:tasks.workunit.client.0.smithi170.stdout:4/608: stat d6/d28/f5d 0 2024-01-25T15:03:44.921 INFO:tasks.workunit.client.0.smithi170.stdout:4/609: symlink d6/d28/lbd 0 2024-01-25T15:03:44.921 INFO:tasks.workunit.client.0.smithi170.stdout:5/652: sync 2024-01-25T15:03:44.922 INFO:tasks.workunit.client.0.smithi170.stdout:4/610: fdatasync d6/d7/d31/d46/d78/fab 0 2024-01-25T15:03:44.927 INFO:tasks.workunit.client.0.smithi170.stdout:2/680: dwrite d10/d1e/d32/d63/f90 [0,4194304] 0 2024-01-25T15:03:44.929 INFO:tasks.workunit.client.0.smithi170.stdout:4/611: dread d6/d28/d67/f9d [0,4194304] 0 2024-01-25T15:03:44.929 INFO:tasks.workunit.client.0.smithi170.stdout:1/667: dwrite d0/d20/d28/d2a/d4a/d56/d5b/d72/fba [0,4194304] 0 2024-01-25T15:03:44.929 INFO:tasks.workunit.client.0.smithi170.stdout:2/681: rmdir d10/d1e/d32/d3e/d5c/d92 39 2024-01-25T15:03:44.930 INFO:tasks.workunit.client.0.smithi170.stdout:3/723: getdents d3/d10/d1e/d96 0 2024-01-25T15:03:44.936 INFO:tasks.workunit.client.0.smithi170.stdout:1/668: mkdir d0/d20/ddd/dde 0 2024-01-25T15:03:44.936 INFO:tasks.workunit.client.0.smithi170.stdout:1/669: write d0/d50/f95 [1375410,28659] 0 2024-01-25T15:03:44.936 INFO:tasks.workunit.client.0.smithi170.stdout:3/724: getdents d3/d10/d6d/d74 0 2024-01-25T15:03:44.937 INFO:tasks.workunit.client.0.smithi170.stdout:7/688: link d8/l58 d8/d20/d2a/d35/d55/d7d/da6/dd1/lf9 0 2024-01-25T15:03:44.937 INFO:tasks.workunit.client.0.smithi170.stdout:7/689: write d8/fe4 [359698,27512] 0 2024-01-25T15:03:44.937 INFO:tasks.workunit.client.0.smithi170.stdout:1/670: readlink d0/d20/d28/d2a/d4a/d56/d5b/d72/l82 0 2024-01-25T15:03:44.937 INFO:tasks.workunit.client.0.smithi170.stdout:7/690: fsync d8/d20/d2a/d35/f41 0 2024-01-25T15:03:44.938 INFO:tasks.workunit.client.0.smithi170.stdout:3/725: symlink d3/d1c/d2b/d5c/d97/dab/lf2 0 2024-01-25T15:03:44.939 INFO:tasks.workunit.client.0.smithi170.stdout:7/691: creat d8/d20/d2a/d35/d55/d7d/da6/ffa x:0 0 0 2024-01-25T15:03:44.940 INFO:tasks.workunit.client.0.smithi170.stdout:3/726: rename d3/d10/d1e/d21/d41/d4a/c82 to d3/d10/d1e/d21/d41/d4b/cf3 0 2024-01-25T15:03:44.940 INFO:tasks.workunit.client.0.smithi170.stdout:6/751: write d2/d7/d23/d19/d2f/d5d/d94/fa2 [2345681,77720] 0 2024-01-25T15:03:44.941 INFO:tasks.workunit.client.0.smithi170.stdout:6/752: chown d2/d7/ca 449 1 2024-01-25T15:03:44.942 INFO:tasks.workunit.client.0.smithi170.stdout:6/753: mknod d2/d7/d1b/d28/da7/c101 0 2024-01-25T15:03:44.945 INFO:tasks.workunit.client.0.smithi170.stdout:0/719: dwrite d8/d18/f84 [0,4194304] 0 2024-01-25T15:03:44.946 INFO:tasks.workunit.client.0.smithi170.stdout:3/727: dread d3/d10/f1a [0,4194304] 0 2024-01-25T15:03:44.948 INFO:tasks.workunit.client.0.smithi170.stdout:6/754: rmdir d2/d7/d23/d19/d2f 39 2024-01-25T15:03:44.949 INFO:tasks.workunit.client.0.smithi170.stdout:4/612: dread d6/d7/d31/d46/f92 [0,4194304] 0 2024-01-25T15:03:44.951 INFO:tasks.workunit.client.0.smithi170.stdout:1/671: write d0/d20/d3a/f53 [6390140,119846] 0 2024-01-25T15:03:44.951 INFO:tasks.workunit.client.0.smithi170.stdout:1/672: creat d0/fdf x:0 0 0 2024-01-25T15:03:44.952 INFO:tasks.workunit.client.0.smithi170.stdout:3/728: mknod d3/d88/de0/cf4 0 2024-01-25T15:03:44.952 INFO:tasks.workunit.client.0.smithi170.stdout:3/729: stat d3/d3b/d4f/da0/dcb 0 2024-01-25T15:03:44.952 INFO:tasks.workunit.client.0.smithi170.stdout:6/755: mknod d2/d7/dd9/c102 0 2024-01-25T15:03:44.953 INFO:tasks.workunit.client.0.smithi170.stdout:7/692: write d8/d20/d3b/d4d/f97 [115367,100249] 0 2024-01-25T15:03:44.953 INFO:tasks.workunit.client.0.smithi170.stdout:7/693: creat d8/d20/d73/ffb x:0 0 0 2024-01-25T15:03:44.953 INFO:tasks.workunit.client.0.smithi170.stdout:4/613: creat d6/d28/d59/fbe x:0 0 0 2024-01-25T15:03:44.953 INFO:tasks.workunit.client.0.smithi170.stdout:4/614: write d6/d28/f7a [1936936,2296] 0 2024-01-25T15:03:44.953 INFO:tasks.workunit.client.0.smithi170.stdout:6/756: read d2/d7/d23/d19/d2f/d74/dc1/dcf/ff1 [12755,111804] 0 2024-01-25T15:03:44.955 INFO:tasks.workunit.client.0.smithi170.stdout:3/730: getdents d3/d3b/dc6 0 2024-01-25T15:03:44.955 INFO:tasks.workunit.client.0.smithi170.stdout:5/653: dwrite d5/d54/d85/d2c/d45/d56/d72/da0/dc5/f65 [8388608,4194304] 0 2024-01-25T15:03:44.956 INFO:tasks.workunit.client.0.smithi170.stdout:5/654: write d5/f16 [6655159,128696] 0 2024-01-25T15:03:44.956 INFO:tasks.workunit.client.0.smithi170.stdout:5/655: write d5/d54/d85/d2c/d34/f8b [568415,20440] 0 2024-01-25T15:03:44.956 INFO:tasks.workunit.client.0.smithi170.stdout:2/682: dwrite d10/d1e/d32/d98/d99/dd4/fea [0,4194304] 0 2024-01-25T15:03:44.962 INFO:tasks.workunit.client.0.smithi170.stdout:7/694: truncate d8/d20/d2a/d35/d55/f85 2680830 0 2024-01-25T15:03:44.966 INFO:tasks.workunit.client.0.smithi170.stdout:0/720: write d8/d10/f2b [118778,64061] 0 2024-01-25T15:03:44.966 INFO:tasks.workunit.client.0.smithi170.stdout:3/731: creat d3/d10/d1e/d21/d41/d4b/d63/ff5 x:0 0 0 2024-01-25T15:03:44.966 INFO:tasks.workunit.client.0.smithi170.stdout:9/700: sync 2024-01-25T15:03:44.966 INFO:tasks.workunit.client.0.smithi170.stdout:2/683: link d10/d1e/d5e/d73/d9e/da3/fb8 d10/d1e/d32/d3e/d41/dc4/dc6/d42/de8/ff6 0 2024-01-25T15:03:44.966 INFO:tasks.workunit.client.0.smithi170.stdout:3/732: read - d3/d10/d1e/d21/f9a zero size 2024-01-25T15:03:44.967 INFO:tasks.workunit.client.0.smithi170.stdout:8/856: sync 2024-01-25T15:03:44.967 INFO:tasks.workunit.client.0.smithi170.stdout:8/857: chown d3/d7/d3a/d91/ce7 18 1 2024-01-25T15:03:44.967 INFO:tasks.workunit.client.0.smithi170.stdout:9/701: creat d5/df/d2e/d77/d21/d46/d18/dc0/fee x:0 0 0 2024-01-25T15:03:44.967 INFO:tasks.workunit.client.0.smithi170.stdout:2/684: creat d10/d1e/d32/d3e/d41/dc4/dc6/d42/daa/ff7 x:0 0 0 2024-01-25T15:03:44.976 INFO:tasks.workunit.client.0.smithi170.stdout:5/656: dread d5/d54/d85/d2c/f31 [0,4194304] 0 2024-01-25T15:03:44.977 INFO:tasks.workunit.client.0.smithi170.stdout:7/695: unlink d8/d20/d45/d68/lf0 0 2024-01-25T15:03:44.980 INFO:tasks.workunit.client.0.smithi170.stdout:1/673: dwrite d0/d20/d28/d7b/f8a [0,4194304] 0 2024-01-25T15:03:44.980 INFO:tasks.workunit.client.0.smithi170.stdout:1/674: chown d0/d50/da0/d9c/fc3 1 1 2024-01-25T15:03:44.980 INFO:tasks.workunit.client.0.smithi170.stdout:1/675: truncate d0/d20/d28/d2a/fa3 361444 0 2024-01-25T15:03:44.981 INFO:tasks.workunit.client.0.smithi170.stdout:1/676: dread d0/d20/d3a/f65 [0,4194304] 0 2024-01-25T15:03:44.983 INFO:tasks.workunit.client.0.smithi170.stdout:9/702: creat d5/df/d2e/db0/fef x:0 0 0 2024-01-25T15:03:44.983 INFO:tasks.workunit.client.0.smithi170.stdout:9/703: dread - d5/df/d2e/db0/fef zero size 2024-01-25T15:03:44.986 INFO:tasks.workunit.client.0.smithi170.stdout:4/615: dwrite d6/d7/d31/f4d [4194304,4194304] 0 2024-01-25T15:03:44.987 INFO:tasks.workunit.client.0.smithi170.stdout:3/733: write d3/d10/fe [3790221,73345] 0 2024-01-25T15:03:44.990 INFO:tasks.workunit.client.0.smithi170.stdout:7/696: dread d8/d20/d2a/d35/fbb [0,4194304] 0 2024-01-25T15:03:44.991 INFO:tasks.workunit.client.0.smithi170.stdout:8/858: rmdir d3/d7/d22/d23/d25/d41 39 2024-01-25T15:03:44.991 INFO:tasks.workunit.client.0.smithi170.stdout:8/859: fdatasync d3/d7/d3a/d8d/ffc 0 2024-01-25T15:03:44.995 INFO:tasks.workunit.client.0.smithi170.stdout:9/704: truncate d5/f14 1341446 0 2024-01-25T15:03:44.997 INFO:tasks.workunit.client.0.smithi170.stdout:7/697: link d8/d20/fef d8/d20/d3b/ffc 0 2024-01-25T15:03:45.000 INFO:tasks.workunit.client.0.smithi170.stdout:8/860: link d3/d7/d3a/d91/d7f/f8c d3/d7/d3a/f12d 0 2024-01-25T15:03:45.000 INFO:tasks.workunit.client.0.smithi170.stdout:9/705: mknod d5/df/d2e/d77/d21/d46/d6c/dac/cf0 0 2024-01-25T15:03:45.001 INFO:tasks.workunit.client.0.smithi170.stdout:8/861: mknod d3/d7/d22/c12e 0 2024-01-25T15:03:45.002 INFO:tasks.workunit.client.0.smithi170.stdout:8/862: stat d3/d7/d3a/d8d/dd5/c10f 0 2024-01-25T15:03:45.004 INFO:tasks.workunit.client.0.smithi170.stdout:8/863: dread d3/d7/d3a/d8d/dd5/fe6 [0,4194304] 0 2024-01-25T15:03:45.004 INFO:tasks.workunit.client.0.smithi170.stdout:2/685: dwrite d10/f37 [0,4194304] 0 2024-01-25T15:03:45.004 INFO:tasks.workunit.client.0.smithi170.stdout:9/706: getdents d5/df/d16/d35 0 2024-01-25T15:03:45.004 INFO:tasks.workunit.client.0.smithi170.stdout:9/707: write d5/df/d2e/d77/d21/d34/f5b [1588007,50863] 0 2024-01-25T15:03:45.005 INFO:tasks.workunit.client.0.smithi170.stdout:9/708: fsync d5/df/d2e/d77/d21/d46/d6c/dd8/d96/fb8 0 2024-01-25T15:03:45.010 INFO:tasks.workunit.client.0.smithi170.stdout:7/698: dread d8/d20/d2a/d35/fbb [0,4194304] 0 2024-01-25T15:03:45.012 INFO:tasks.workunit.client.0.smithi170.stdout:7/699: unlink d8/d20/d3b/d4d/c6f 0 2024-01-25T15:03:45.012 INFO:tasks.workunit.client.0.smithi170.stdout:0/721: dwrite d8/d3e/de7/da2/fb1 [0,4194304] 0 2024-01-25T15:03:45.012 INFO:tasks.workunit.client.0.smithi170.stdout:0/722: write d8/d10/d2d/d53/f7d [487087,652] 0 2024-01-25T15:03:45.012 INFO:tasks.workunit.client.0.smithi170.stdout:0/723: write d8/d3e/fe4 [820699,112604] 0 2024-01-25T15:03:45.013 INFO:tasks.workunit.client.0.smithi170.stdout:3/734: dwrite d3/d10/d1e/d21/d41/d4a/f75 [4194304,4194304] 0 2024-01-25T15:03:45.013 INFO:tasks.workunit.client.0.smithi170.stdout:3/735: chown d3/d10/d1e/d21/f9a 155 1 2024-01-25T15:03:45.013 INFO:tasks.workunit.client.0.smithi170.stdout:3/736: stat d3/d10/f89 0 2024-01-25T15:03:45.013 INFO:tasks.workunit.client.0.smithi170.stdout:3/737: fdatasync d3/d1c/d2b/fc1 0 2024-01-25T15:03:45.015 INFO:tasks.workunit.client.0.smithi170.stdout:5/657: dwrite d5/d54/d85/fc8 [0,4194304] 0 2024-01-25T15:03:45.015 INFO:tasks.workunit.client.0.smithi170.stdout:0/724: rmdir d8/d9/dd6 39 2024-01-25T15:03:45.021 INFO:tasks.workunit.client.0.smithi170.stdout:3/738: mkdir d3/d3b/d4f/df6 0 2024-01-25T15:03:45.023 INFO:tasks.workunit.client.0.smithi170.stdout:9/709: write d5/f37 [3949135,97637] 0 2024-01-25T15:03:45.025 INFO:tasks.workunit.client.0.smithi170.stdout:5/658: symlink d5/d54/d85/d3f/d86/le0 0 2024-01-25T15:03:45.028 INFO:tasks.workunit.client.0.smithi170.stdout:9/710: mkdir d5/df/d49/df1 0 2024-01-25T15:03:45.029 INFO:tasks.workunit.client.0.smithi170.stdout:9/711: dread d5/df/d16/d35/d3c/f5f [0,4194304] 0 2024-01-25T15:03:45.029 INFO:tasks.workunit.client.0.smithi170.stdout:9/712: creat d5/df/d2e/d77/d21/d34/d3e/d7f/ff2 x:0 0 0 2024-01-25T15:03:45.030 INFO:tasks.workunit.client.0.smithi170.stdout:5/659: symlink d5/d54/d85/d2c/d51/d96/dda/dde/le1 0 2024-01-25T15:03:45.032 INFO:tasks.workunit.client.0.smithi170.stdout:7/700: write d8/d20/d45/f4a [1428864,67230] 0 2024-01-25T15:03:45.032 INFO:tasks.workunit.client.0.smithi170.stdout:7/701: fsync d8/d20/d3b/f8d 0 2024-01-25T15:03:45.032 INFO:tasks.workunit.client.0.smithi170.stdout:7/702: chown d8/d20/d2a/d35/d55/d7d/fda 56075343 1 2024-01-25T15:03:45.032 INFO:tasks.workunit.client.0.smithi170.stdout:5/660: creat d5/d54/d85/d2c/d45/dba/fe2 x:0 0 0 2024-01-25T15:03:45.032 INFO:tasks.workunit.client.0.smithi170.stdout:5/661: creat d5/d54/d85/d2c/d34/d69/fe3 x:0 0 0 2024-01-25T15:03:45.033 INFO:tasks.workunit.client.0.smithi170.stdout:4/616: rename d6/l8a to d6/d28/d61/lbf 0 2024-01-25T15:03:45.037 INFO:tasks.workunit.client.0.smithi170.stdout:9/713: symlink d5/df/d16/d35/d3c/d56/d59/d5e/lf3 0 2024-01-25T15:03:45.038 INFO:tasks.workunit.client.0.smithi170.stdout:3/739: rmdir d3/d3b 39 2024-01-25T15:03:45.039 INFO:tasks.workunit.client.0.smithi170.stdout:3/740: write d3/d1c/d2b/fd4 [66335,24838] 0 2024-01-25T15:03:45.043 INFO:tasks.workunit.client.0.smithi170.stdout:4/617: link d6/d7/d31/d46/fa9 d6/d7/d31/d46/d78/fc0 0 2024-01-25T15:03:45.043 INFO:tasks.workunit.client.0.smithi170.stdout:4/618: creat d6/d28/d93/fc1 x:0 0 0 2024-01-25T15:03:45.044 INFO:tasks.workunit.client.0.smithi170.stdout:4/619: write d6/d28/f7a [999062,89692] 0 2024-01-25T15:03:45.051 INFO:tasks.workunit.client.0.smithi170.stdout:7/703: dread d8/d20/d2a/d35/d55/d6e/d81/fca [0,4194304] 0 2024-01-25T15:03:45.053 INFO:tasks.workunit.client.0.smithi170.stdout:7/704: creat d8/d20/d2a/d35/d55/d7d/da6/dd1/deb/ffd x:0 0 0 2024-01-25T15:03:45.053 INFO:tasks.workunit.client.0.smithi170.stdout:8/864: dwrite d3/d7/d3a/f94 [0,4194304] 0 2024-01-25T15:03:45.054 INFO:tasks.workunit.client.0.smithi170.stdout:2/686: dwrite d10/d1e/d32/d62/d74/fcf [0,4194304] 0 2024-01-25T15:03:45.057 INFO:tasks.workunit.client.0.smithi170.stdout:0/725: dwrite d8/d10/d77/ff7 [0,4194304] 0 2024-01-25T15:03:45.057 INFO:tasks.workunit.client.0.smithi170.stdout:0/726: readlink d8/d10/l2a 0 2024-01-25T15:03:45.057 INFO:tasks.workunit.client.0.smithi170.stdout:0/727: write d8/d18/f4d [250933,6408] 0 2024-01-25T15:03:45.057 INFO:tasks.workunit.client.0.smithi170.stdout:0/728: fsync d8/d10/d2d/d2f/d96/db7/fd1 0 2024-01-25T15:03:45.058 INFO:tasks.workunit.client.0.smithi170.stdout:9/714: dread d5/df/d2e/d77/d21/d46/fdc [0,4194304] 0 2024-01-25T15:03:45.058 INFO:tasks.workunit.client.0.smithi170.stdout:5/662: dwrite d5/f1b [8388608,4194304] 0 2024-01-25T15:03:45.061 INFO:tasks.workunit.client.0.smithi170.stdout:4/620: unlink d6/c62 0 2024-01-25T15:03:45.061 INFO:tasks.workunit.client.0.smithi170.stdout:4/621: fdatasync d6/d28/f5d 0 2024-01-25T15:03:45.064 INFO:tasks.workunit.client.0.smithi170.stdout:3/741: dwrite d3/d10/d1e/fbf [0,4194304] 0 2024-01-25T15:03:45.064 INFO:tasks.workunit.client.0.smithi170.stdout:3/742: write d3/d1c/fb4 [304956,112491] 0 2024-01-25T15:03:45.069 INFO:tasks.workunit.client.0.smithi170.stdout:3/743: dread d3/d1c/f6f [0,4194304] 0 2024-01-25T15:03:45.073 INFO:tasks.workunit.client.0.smithi170.stdout:7/705: dwrite d8/d20/d73/ffb [0,4194304] 0 2024-01-25T15:03:45.073 INFO:tasks.workunit.client.0.smithi170.stdout:7/706: truncate d8/d20/d2a/d35/d55/d7d/fdd 228189 0 2024-01-25T15:03:45.073 INFO:tasks.workunit.client.0.smithi170.stdout:7/707: write d8/d20/d45/d68/d71/d8c/ff8 [503999,101789] 0 2024-01-25T15:03:45.073 INFO:tasks.workunit.client.0.smithi170.stdout:7/708: write d8/d20/d3b/f8d [1156416,65403] 0 2024-01-25T15:03:45.073 INFO:tasks.workunit.client.0.smithi170.stdout:7/709: fsync d8/f92 0 2024-01-25T15:03:45.073 INFO:tasks.workunit.client.0.smithi170.stdout:7/710: creat d8/d20/d2a/d35/d55/d7d/da6/dd1/deb/ffe x:0 0 0 2024-01-25T15:03:45.073 INFO:tasks.workunit.client.0.smithi170.stdout:7/711: truncate d8/d20/d45/f59 1333901 0 2024-01-25T15:03:45.079 INFO:tasks.workunit.client.0.smithi170.stdout:5/663: dwrite d5/fd [0,4194304] 0 2024-01-25T15:03:45.095 INFO:tasks.workunit.client.0.smithi170.stdout:5/664: write d5/d2a/f8d [2217451,120706] 0 2024-01-25T15:03:45.098 INFO:tasks.workunit.client.0.smithi170.stdout:8/865: truncate d3/d7/f2f 356537 0 2024-01-25T15:03:45.098 INFO:tasks.workunit.client.0.smithi170.stdout:8/866: chown d3/d7/d22/d23/d48/f11e 15594350 1 2024-01-25T15:03:45.098 INFO:tasks.workunit.client.0.smithi170.stdout:2/687: truncate d10/d1e/f9a 3832635 0 2024-01-25T15:03:45.115 INFO:tasks.workunit.client.0.smithi170.stdout:8/867: dwrite d3/d7/f12 [0,4194304] 0 2024-01-25T15:03:45.115 INFO:tasks.workunit.client.0.smithi170.stdout:8/868: readlink d3/d7/d73/l77 0 2024-01-25T15:03:45.120 INFO:tasks.workunit.client.0.smithi170.stdout:0/729: rmdir d8/d10 39 2024-01-25T15:03:45.122 INFO:tasks.workunit.client.0.smithi170.stdout:9/715: mknod d5/df/d2e/d6b/dd2/cf4 0 2024-01-25T15:03:45.122 INFO:tasks.workunit.client.0.smithi170.stdout:9/716: chown d5/df/d16/d35/fc5 3088198 1 2024-01-25T15:03:45.124 INFO:tasks.workunit.client.0.smithi170.stdout:0/730: dread d8/d3e/de7/d5f/f8f [4194304,4194304] 0 2024-01-25T15:03:45.124 INFO:tasks.workunit.client.0.smithi170.stdout:0/731: stat d8/d9/f56 0 2024-01-25T15:03:45.126 INFO:tasks.workunit.client.0.smithi170.stdout:6/757: sync 2024-01-25T15:03:45.127 INFO:tasks.workunit.client.0.smithi170.stdout:3/744: rmdir d3/d10/de2 39 2024-01-25T15:03:45.128 INFO:tasks.workunit.client.0.smithi170.stdout:3/745: creat d3/d10/d1e/ff7 x:0 0 0 2024-01-25T15:03:45.128 INFO:tasks.workunit.client.0.smithi170.stdout:3/746: chown d3/d1c/d2b/fd4 13173807 1 2024-01-25T15:03:45.128 INFO:tasks.workunit.client.0.smithi170.stdout:3/747: readlink d3/d10/d13/l79 0 2024-01-25T15:03:45.131 INFO:tasks.workunit.client.0.smithi170.stdout:1/677: sync 2024-01-25T15:03:45.131 INFO:tasks.workunit.client.0.smithi170.stdout:1/678: readlink d0/d1b/l67 0 2024-01-25T15:03:45.132 INFO:tasks.workunit.client.0.smithi170.stdout:1/679: write d0/d20/fa4 [182389,103338] 0 2024-01-25T15:03:45.132 INFO:tasks.workunit.client.0.smithi170.stdout:4/622: mkdir d6/d28/dc2 0 2024-01-25T15:03:45.134 INFO:tasks.workunit.client.0.smithi170.stdout:2/688: link l7 d10/lf8 0 2024-01-25T15:03:45.135 INFO:tasks.workunit.client.0.smithi170.stdout:7/712: unlink d8/d20/d45/d68/d71/ca0 0 2024-01-25T15:03:45.135 INFO:tasks.workunit.client.0.smithi170.stdout:7/713: stat d8/d20/d2a/f9c 0 2024-01-25T15:03:45.138 INFO:tasks.workunit.client.0.smithi170.stdout:8/869: mknod d3/c12f 0 2024-01-25T15:03:45.138 INFO:tasks.workunit.client.0.smithi170.stdout:8/870: stat d3/d7/d22/d23/d48/d52/d47/fac 0 2024-01-25T15:03:45.139 INFO:tasks.workunit.client.0.smithi170.stdout:6/758: unlink d2/d7/l15 0 2024-01-25T15:03:45.142 INFO:tasks.workunit.client.0.smithi170.stdout:3/748: creat d3/d88/de0/ff8 x:0 0 0 2024-01-25T15:03:45.142 INFO:tasks.workunit.client.0.smithi170.stdout:3/749: chown d3/d10/d13/ceb 80 1 2024-01-25T15:03:45.149 INFO:tasks.workunit.client.0.smithi170.stdout:1/680: creat d0/d20/d28/d2a/dc7/fe0 x:0 0 0 2024-01-25T15:03:45.149 INFO:tasks.workunit.client.0.smithi170.stdout:0/732: dwrite d8/d10/d2d/d2f/f7c [0,4194304] 0 2024-01-25T15:03:45.151 INFO:tasks.workunit.client.0.smithi170.stdout:4/623: dwrite d6/d28/d59/da8/faf [0,4194304] 0 2024-01-25T15:03:45.152 INFO:tasks.workunit.client.0.smithi170.stdout:4/624: chown d6/d7/d1b/f41 1275 1 2024-01-25T15:03:45.156 INFO:tasks.workunit.client.0.smithi170.stdout:6/759: truncate d2/d7/f18 1667204 0 2024-01-25T15:03:45.161 INFO:tasks.workunit.client.0.smithi170.stdout:1/681: unlink d0/d1b/c1e 0 2024-01-25T15:03:45.165 INFO:tasks.workunit.client.0.smithi170.stdout:4/625: symlink d6/d28/d59/d7d/lc3 0 2024-01-25T15:03:45.165 INFO:tasks.workunit.client.0.smithi170.stdout:4/626: fsync d6/d28/d59/d7d/d6b/f6d 0 2024-01-25T15:03:45.166 INFO:tasks.workunit.client.0.smithi170.stdout:8/871: creat d3/d7/d22/d23/d25/d41/d9a/f130 x:0 0 0 2024-01-25T15:03:45.166 INFO:tasks.workunit.client.0.smithi170.stdout:8/872: write d3/d7/d1e/d7c/d9f/f101 [102455,119202] 0 2024-01-25T15:03:45.167 INFO:tasks.workunit.client.0.smithi170.stdout:3/750: dwrite d3/d10/ff [0,4194304] 0 2024-01-25T15:03:45.173 INFO:tasks.workunit.client.0.smithi170.stdout:7/714: write d8/d20/d2a/d35/d55/d7d/fda [1759888,80513] 0 2024-01-25T15:03:45.176 INFO:tasks.workunit.client.0.smithi170.stdout:1/682: truncate d0/d50/d8e/d9e/fb7 1307398 0 2024-01-25T15:03:45.178 INFO:tasks.workunit.client.0.smithi170.stdout:6/760: write d2/d7/f18 [615000,98222] 0 2024-01-25T15:03:45.182 INFO:tasks.workunit.client.0.smithi170.stdout:8/873: symlink d3/d7/d22/d23/d25/d41/d61/l131 0 2024-01-25T15:03:45.183 INFO:tasks.workunit.client.0.smithi170.stdout:8/874: creat d3/d7/d22/d23/d48/d52/d47/de2/f132 x:0 0 0 2024-01-25T15:03:45.185 INFO:tasks.workunit.client.0.smithi170.stdout:7/715: mkdir d8/d20/d2a/d35/dff 0 2024-01-25T15:03:45.185 INFO:tasks.workunit.client.0.smithi170.stdout:3/751: dwrite d3/d3b/dc6/f5f [0,4194304] 0 2024-01-25T15:03:45.185 INFO:tasks.workunit.client.0.smithi170.stdout:3/752: creat d3/d10/d13/d1b/d85/ff9 x:0 0 0 2024-01-25T15:03:45.190 INFO:tasks.workunit.client.0.smithi170.stdout:1/683: mkdir d0/d50/de1 0 2024-01-25T15:03:45.190 INFO:tasks.workunit.client.0.smithi170.stdout:1/684: chown d0/d20/d28/d2a/d4a/d56/d5b/c9d 31 1 2024-01-25T15:03:45.197 INFO:tasks.workunit.client.0.smithi170.stdout:4/627: mkdir d6/d28/d59/dc4 0 2024-01-25T15:03:45.198 INFO:tasks.workunit.client.0.smithi170.stdout:7/716: write d8/d20/f2e [607294,130267] 0 2024-01-25T15:03:45.198 INFO:tasks.workunit.client.0.smithi170.stdout:7/717: chown d8/d20/d2a/d35/d55/d7d/da6/dd1 15519 1 2024-01-25T15:03:45.198 INFO:tasks.workunit.client.0.smithi170.stdout:7/718: dread - d8/d20/d45/fec zero size 2024-01-25T15:03:45.200 INFO:tasks.workunit.client.0.smithi170.stdout:7/719: creat d8/d20/d2a/d35/d55/d6e/d81/f100 x:0 0 0 2024-01-25T15:03:45.200 INFO:tasks.workunit.client.0.smithi170.stdout:7/720: truncate d8/d20/d2a/f87 458987 0 2024-01-25T15:03:45.200 INFO:tasks.workunit.client.0.smithi170.stdout:7/721: chown d8/d20/d2a/d35/d55/d7d/fda 2 1 2024-01-25T15:03:45.201 INFO:tasks.workunit.client.0.smithi170.stdout:5/665: fdatasync d5/d58/fcd 0 2024-01-25T15:03:45.201 INFO:tasks.workunit.client.0.smithi170.stdout:5/666: truncate d5/d54/d85/d2c/fa2 1024362 0 2024-01-25T15:03:45.203 INFO:tasks.workunit.client.0.smithi170.stdout:5/667: rename d5/d54/d85/d2c/d45/d56/d72/da0/dc5/f7e to d5/d54/d85/d2c/d45/d56/d72/da0/dc5/fe4 0 2024-01-25T15:03:45.203 INFO:tasks.workunit.client.0.smithi170.stdout:5/668: fsync d5/d54/d85/d2c/d51/d96/dda/dde/f94 0 2024-01-25T15:03:45.203 INFO:tasks.workunit.client.0.smithi170.stdout:5/669: fdatasync d5/d54/d85/d2c/d45/f48 0 2024-01-25T15:03:45.204 INFO:tasks.workunit.client.0.smithi170.stdout:5/670: fsync d5/d54/d85/d2c/d34/d69/fe3 0 2024-01-25T15:03:45.204 INFO:tasks.workunit.client.0.smithi170.stdout:0/733: dread - d8/d10/d2d/d53/df4/dc6/dc9/dca/ffa zero size 2024-01-25T15:03:45.210 INFO:tasks.workunit.client.0.smithi170.stdout:8/875: dwrite d3/d7/d22/d23/f111 [0,4194304] 0 2024-01-25T15:03:45.211 INFO:tasks.workunit.client.0.smithi170.stdout:2/689: getdents d10/d1e/d32/d3e/d41/dc4/dc6/d42 0 2024-01-25T15:03:45.215 INFO:tasks.workunit.client.0.smithi170.stdout:6/761: creat d2/d7/d23/d19/d2f/f103 x:0 0 0 2024-01-25T15:03:45.215 INFO:tasks.workunit.client.0.smithi170.stdout:6/762: truncate d2/fcd 324870 0 2024-01-25T15:03:45.215 INFO:tasks.workunit.client.0.smithi170.stdout:6/763: chown d2/d7/d23/d19/d2a/d43/d98/fac 12452198 1 2024-01-25T15:03:45.216 INFO:tasks.workunit.client.0.smithi170.stdout:4/628: creat d6/d28/d59/dc4/fc5 x:0 0 0 2024-01-25T15:03:45.217 INFO:tasks.workunit.client.0.smithi170.stdout:8/876: dread d3/fd [0,4194304] 0 2024-01-25T15:03:45.217 INFO:tasks.workunit.client.0.smithi170.stdout:8/877: write d3/d7/d22/d5d/f6e [2744389,31498] 0 2024-01-25T15:03:45.217 INFO:tasks.workunit.client.0.smithi170.stdout:1/685: getdents d0/d20/d28/d2a/dc7 0 2024-01-25T15:03:45.219 INFO:tasks.workunit.client.0.smithi170.stdout:6/764: truncate d2/d7/d23/d19/d2a/d43/d98/f3f 2300935 0 2024-01-25T15:03:45.220 INFO:tasks.workunit.client.0.smithi170.stdout:4/629: mkdir d6/d7/d31/d46/dc6 0 2024-01-25T15:03:45.220 INFO:tasks.workunit.client.0.smithi170.stdout:5/671: symlink d5/d54/d85/le5 0 2024-01-25T15:03:45.222 INFO:tasks.workunit.client.0.smithi170.stdout:0/734: rename d8/d10/d2d/d2f/d6a/d79/l8c to d8/d9/dd6/deb/lfc 0 2024-01-25T15:03:45.222 INFO:tasks.workunit.client.0.smithi170.stdout:0/735: read d8/d3e/de7/d5f/fb2 [1303405,92888] 0 2024-01-25T15:03:45.223 INFO:tasks.workunit.client.0.smithi170.stdout:8/878: dread d3/f9 [4194304,4194304] 0 2024-01-25T15:03:45.223 INFO:tasks.workunit.client.0.smithi170.stdout:8/879: write d3/d7/d22/d23/d48/d52/d47/de2/f10a [890535,101447] 0 2024-01-25T15:03:45.223 INFO:tasks.workunit.client.0.smithi170.stdout:6/765: creat d2/ddb/f104 x:0 0 0 2024-01-25T15:03:45.225 INFO:tasks.workunit.client.0.smithi170.stdout:4/630: truncate d6/d7/d31/d46/d78/fa5 535502 0 2024-01-25T15:03:45.226 INFO:tasks.workunit.client.0.smithi170.stdout:5/672: creat d5/d54/d85/d2c/d51/d96/dda/fe6 x:0 0 0 2024-01-25T15:03:45.226 INFO:tasks.workunit.client.0.smithi170.stdout:5/673: read - d5/d54/d85/d3f/d8f/fdf zero size 2024-01-25T15:03:45.226 INFO:tasks.workunit.client.0.smithi170.stdout:5/674: fsync d5/d54/f84 0 2024-01-25T15:03:45.227 INFO:tasks.workunit.client.0.smithi170.stdout:7/722: dwrite d8/d20/d2a/d35/d55/d6e/d81/fca [0,4194304] 0 2024-01-25T15:03:45.230 INFO:tasks.workunit.client.0.smithi170.stdout:8/880: symlink d3/d7/d3a/d91/l133 0 2024-01-25T15:03:45.230 INFO:tasks.workunit.client.0.smithi170.stdout:8/881: dread - d3/d7/d22/d23/fdb zero size 2024-01-25T15:03:45.230 INFO:tasks.workunit.client.0.smithi170.stdout:8/882: write d3/d7/d22/d23/d48/f81 [925856,77843] 0 2024-01-25T15:03:45.230 INFO:tasks.workunit.client.0.smithi170.stdout:6/766: chown d2/d7/d23/c9c 261384 1 2024-01-25T15:03:45.232 INFO:tasks.workunit.client.0.smithi170.stdout:6/767: rmdir d2/d7/d23/d19/d2f/d74/dce/ddf 39 2024-01-25T15:03:45.232 INFO:tasks.workunit.client.0.smithi170.stdout:6/768: read - d2/ddb/f104 zero size 2024-01-25T15:03:45.233 INFO:tasks.workunit.client.0.smithi170.stdout:6/769: mkdir d2/d7/d23/d19/daf/d105 0 2024-01-25T15:03:45.233 INFO:tasks.workunit.client.0.smithi170.stdout:6/770: chown d2/d7/d1b/de6 842713 1 2024-01-25T15:03:45.233 INFO:tasks.workunit.client.0.smithi170.stdout:6/771: write d2/d7/d23/d19/d2a/fe1 [219667,14260] 0 2024-01-25T15:03:45.235 INFO:tasks.workunit.client.0.smithi170.stdout:6/772: creat d2/d7/d23/d19/d2f/df0/f106 x:0 0 0 2024-01-25T15:03:45.235 INFO:tasks.workunit.client.0.smithi170.stdout:6/773: fsync d2/d7/d23/d19/daf/db0/fe3 0 2024-01-25T15:03:45.235 INFO:tasks.workunit.client.0.smithi170.stdout:6/774: fsync d2/d7/fbf 0 2024-01-25T15:03:45.244 INFO:tasks.workunit.client.0.smithi170.stdout:5/675: dread d5/d54/d85/d2c/f31 [0,4194304] 0 2024-01-25T15:03:45.244 INFO:tasks.workunit.client.0.smithi170.stdout:5/676: write d5/d54/d85/f1a [4562843,20376] 0 2024-01-25T15:03:45.248 INFO:tasks.workunit.client.0.smithi170.stdout:7/723: dread d8/f92 [0,4194304] 0 2024-01-25T15:03:45.248 INFO:tasks.workunit.client.0.smithi170.stdout:7/724: readlink d8/d20/d45/d68/l8f 0 2024-01-25T15:03:45.249 INFO:tasks.workunit.client.0.smithi170.stdout:5/677: mknod d5/d54/d85/d3f/d86/ce7 0 2024-01-25T15:03:45.251 INFO:tasks.workunit.client.0.smithi170.stdout:5/678: symlink d5/d54/d85/d2c/d45/d56/d72/da0/le8 0 2024-01-25T15:03:45.252 INFO:tasks.workunit.client.0.smithi170.stdout:7/725: rmdir d8/d20/d2a/d35/d55/d9b 39 2024-01-25T15:03:45.255 INFO:tasks.workunit.client.0.smithi170.stdout:5/679: mknod d5/d54/d85/d2c/d45/ce9 0 2024-01-25T15:03:45.257 INFO:tasks.workunit.client.0.smithi170.stdout:4/631: dwrite d6/d28/d59/d7d/f6c [0,4194304] 0 2024-01-25T15:03:45.257 INFO:tasks.workunit.client.0.smithi170.stdout:4/632: stat d6/d7/f81 0 2024-01-25T15:03:45.257 INFO:tasks.workunit.client.0.smithi170.stdout:1/686: dwrite d0/d20/d28/f4c [0,4194304] 0 2024-01-25T15:03:45.260 INFO:tasks.workunit.client.0.smithi170.stdout:4/633: creat d6/d28/d59/d7d/d6b/fc7 x:0 0 0 2024-01-25T15:03:45.260 INFO:tasks.workunit.client.0.smithi170.stdout:4/634: write d6/d28/d59/d7d/f30 [575404,47797] 0 2024-01-25T15:03:45.260 INFO:tasks.workunit.client.0.smithi170.stdout:4/635: readlink l1 0 2024-01-25T15:03:45.260 INFO:tasks.workunit.client.0.smithi170.stdout:4/636: fdatasync d6/d28/d59/d7d/f97 0 2024-01-25T15:03:45.261 INFO:tasks.workunit.client.0.smithi170.stdout:1/687: creat d0/d20/d28/d2a/d4a/d56/d5b/d72/fe2 x:0 0 0 2024-01-25T15:03:45.262 INFO:tasks.workunit.client.0.smithi170.stdout:1/688: read - d0/d20/d3a/f40 zero size 2024-01-25T15:03:45.264 INFO:tasks.workunit.client.0.smithi170.stdout:1/689: unlink d0/d50/da2/ldc 0 2024-01-25T15:03:45.264 INFO:tasks.workunit.client.0.smithi170.stdout:1/690: chown d0/d20/d28/d2a/d4a/d56/d5b/fcd 1 1 2024-01-25T15:03:45.264 INFO:tasks.workunit.client.0.smithi170.stdout:8/883: dwrite d3/f42 [4194304,4194304] 0 2024-01-25T15:03:45.265 INFO:tasks.workunit.client.0.smithi170.stdout:0/736: dwrite d8/d3e/fc7 [0,4194304] 0 2024-01-25T15:03:45.265 INFO:tasks.workunit.client.0.smithi170.stdout:1/691: mkdir d0/d20/d28/d2a/d4a/d56/dc1/de3 0 2024-01-25T15:03:45.266 INFO:tasks.workunit.client.0.smithi170.stdout:2/690: rename la to d10/d1e/d32/d98/d99/lf9 0 2024-01-25T15:03:45.266 INFO:tasks.workunit.client.0.smithi170.stdout:0/737: creat d8/d10/d2d/d53/df4/dc6/ffd x:0 0 0 2024-01-25T15:03:45.267 INFO:tasks.workunit.client.0.smithi170.stdout:2/691: fdatasync d10/d1e/d32/d3e/d5c/d92/d8b/fb2 0 2024-01-25T15:03:45.267 INFO:tasks.workunit.client.0.smithi170.stdout:8/884: dread d3/d7/d73/fa1 [0,4194304] 0 2024-01-25T15:03:45.268 INFO:tasks.workunit.client.0.smithi170.stdout:8/885: chown d3/d7/d73/dba 7892737 1 2024-01-25T15:03:45.268 INFO:tasks.workunit.client.0.smithi170.stdout:8/886: dread - d3/d7/d22/d23/d48/f65 zero size 2024-01-25T15:03:45.269 INFO:tasks.workunit.client.0.smithi170.stdout:2/692: creat d10/d1e/d32/d3e/d41/ffa x:0 0 0 2024-01-25T15:03:45.269 INFO:tasks.workunit.client.0.smithi170.stdout:2/693: write f9 [4015967,42460] 0 2024-01-25T15:03:45.270 INFO:tasks.workunit.client.0.smithi170.stdout:6/775: rename d2/d7/d23/d19/d2a/d43/feb to d2/d7/d23/d19/d2f/d5d/d94/d97/db4/f107 0 2024-01-25T15:03:45.272 INFO:tasks.workunit.client.0.smithi170.stdout:6/776: truncate d2/f82 3935934 0 2024-01-25T15:03:45.272 INFO:tasks.workunit.client.0.smithi170.stdout:6/777: dread - d2/fb3 zero size 2024-01-25T15:03:45.274 INFO:tasks.workunit.client.0.smithi170.stdout:6/778: mknod d2/d7/d23/d19/d2a/d43/c108 0 2024-01-25T15:03:45.276 INFO:tasks.workunit.client.0.smithi170.stdout:6/779: mkdir d2/d7/d1b/d28/da7/dd2/d109 0 2024-01-25T15:03:45.278 INFO:tasks.workunit.client.0.smithi170.stdout:5/680: dwrite d5/d54/d85/d2c/fc4 [0,4194304] 0 2024-01-25T15:03:45.278 INFO:tasks.workunit.client.0.smithi170.stdout:4/637: dread d6/d28/d59/d7d/f6e [0,4194304] 0 2024-01-25T15:03:45.279 INFO:tasks.workunit.client.0.smithi170.stdout:5/681: chown c1 36 1 2024-01-25T15:03:45.279 INFO:tasks.workunit.client.0.smithi170.stdout:5/682: fsync d5/d54/d85/d2c/d51/d3d/fad 0 2024-01-25T15:03:45.279 INFO:tasks.workunit.client.0.smithi170.stdout:5/683: chown d5/d54/d85/l28 7588887 1 2024-01-25T15:03:45.279 INFO:tasks.workunit.client.0.smithi170.stdout:4/638: mknod d6/d28/dc2/cc8 0 2024-01-25T15:03:45.280 INFO:tasks.workunit.client.0.smithi170.stdout:4/639: readlink d6/d28/l2b 0 2024-01-25T15:03:45.285 INFO:tasks.workunit.client.0.smithi170.stdout:4/640: unlink d6/d7/d31/d46/d78/la7 0 2024-01-25T15:03:45.287 INFO:tasks.workunit.client.0.smithi170.stdout:2/694: dread d10/d1b/f1d [0,4194304] 0 2024-01-25T15:03:45.287 INFO:tasks.workunit.client.0.smithi170.stdout:4/641: symlink d6/d28/d61/lc9 0 2024-01-25T15:03:45.291 INFO:tasks.workunit.client.0.smithi170.stdout:2/695: dread d10/d1e/d32/d3e/d5c/f94 [0,4194304] 0 2024-01-25T15:03:45.293 INFO:tasks.workunit.client.0.smithi170.stdout:8/887: dwrite d3/d7/f16 [4194304,4194304] 0 2024-01-25T15:03:45.297 INFO:tasks.workunit.client.0.smithi170.stdout:2/696: link d10/d1e/d32/d98/d99/lf9 d10/d1e/d5e/d73/d9e/da3/df4/lfb 0 2024-01-25T15:03:45.301 INFO:tasks.workunit.client.0.smithi170.stdout:7/726: rename d8/d20/d2a/d35/d55/d7d/da6/dd1/deb/ffe to d8/d20/d45/d68/d71/dc8/f101 0 2024-01-25T15:03:45.304 INFO:tasks.workunit.client.0.smithi170.stdout:1/692: rename d0/d20/d28/d2a/ca5 to d0/d20/d28/d2a/d4a/d56/dc1/de3/ce4 0 2024-01-25T15:03:45.304 INFO:tasks.workunit.client.0.smithi170.stdout:1/693: read d0/d2e/fbd [389987,121967] 0 2024-01-25T15:03:45.305 INFO:tasks.workunit.client.0.smithi170.stdout:4/642: dwrite d6/d28/d67/f96 [0,4194304] 0 2024-01-25T15:03:45.306 INFO:tasks.workunit.client.0.smithi170.stdout:2/697: write ff [1100623,60229] 0 2024-01-25T15:03:45.306 INFO:tasks.workunit.client.0.smithi170.stdout:6/780: dwrite d2/d7/d23/d19/d2f/d74/dbd/fe5 [0,4194304] 0 2024-01-25T15:03:45.306 INFO:tasks.workunit.client.0.smithi170.stdout:2/698: write d10/d1e/d32/d62/d8d/f96 [1392526,16235] 0 2024-01-25T15:03:45.307 INFO:tasks.workunit.client.0.smithi170.stdout:2/699: read d10/d1e/d32/d3e/d41/dc4/fbf [654436,45021] 0 2024-01-25T15:03:45.307 INFO:tasks.workunit.client.0.smithi170.stdout:0/738: rename d8/d10/d77/fc0 to d8/d10/ffe 0 2024-01-25T15:03:45.307 INFO:tasks.workunit.client.0.smithi170.stdout:1/694: creat d0/d20/d3a/d60/fe5 x:0 0 0 2024-01-25T15:03:45.308 INFO:tasks.workunit.client.0.smithi170.stdout:4/643: creat d6/d7/d9f/fca x:0 0 0 2024-01-25T15:03:45.309 INFO:tasks.workunit.client.0.smithi170.stdout:4/644: read d6/d28/d59/d7d/d6b/f88 [3596561,20804] 0 2024-01-25T15:03:45.309 INFO:tasks.workunit.client.0.smithi170.stdout:7/727: getdents d8/d20/d45/d68 0 2024-01-25T15:03:45.311 INFO:tasks.workunit.client.0.smithi170.stdout:6/781: creat d2/d7/d23/f10a x:0 0 0 2024-01-25T15:03:45.311 INFO:tasks.workunit.client.0.smithi170.stdout:4/645: dread d6/d28/d59/d7d/f5c [0,4194304] 0 2024-01-25T15:03:45.315 INFO:tasks.workunit.client.0.smithi170.stdout:1/695: symlink d0/d50/le6 0 2024-01-25T15:03:45.315 INFO:tasks.workunit.client.0.smithi170.stdout:7/728: creat d8/d20/d2a/d35/db0/f102 x:0 0 0 2024-01-25T15:03:45.316 INFO:tasks.workunit.client.0.smithi170.stdout:7/729: chown d8/d20/d45/d68/daa/fcb 0 1 2024-01-25T15:03:45.316 INFO:tasks.workunit.client.0.smithi170.stdout:4/646: mknod d6/d7/d9f/ccb 0 2024-01-25T15:03:45.316 INFO:tasks.workunit.client.0.smithi170.stdout:0/739: mknod d8/d10/d2d/d2f/d6a/d79/dea/cff 0 2024-01-25T15:03:45.317 INFO:tasks.workunit.client.0.smithi170.stdout:4/647: getdents d6/d28/dc2 0 2024-01-25T15:03:45.317 INFO:tasks.workunit.client.0.smithi170.stdout:4/648: fdatasync d6/d28/d59/da8/faf 0 2024-01-25T15:03:45.317 INFO:tasks.workunit.client.0.smithi170.stdout:1/696: symlink d0/d20/d28/d2a/d4a/d56/dc1/le7 0 2024-01-25T15:03:45.317 INFO:tasks.workunit.client.0.smithi170.stdout:1/697: readlink d0/d20/d28/l7a 0 2024-01-25T15:03:45.317 INFO:tasks.workunit.client.0.smithi170.stdout:1/698: fdatasync d0/fe 0 2024-01-25T15:03:45.317 INFO:tasks.workunit.client.0.smithi170.stdout:7/730: unlink d8/d20/d45/d68/c9f 0 2024-01-25T15:03:45.318 INFO:tasks.workunit.client.0.smithi170.stdout:7/731: stat d8/d20/d45/le7 0 2024-01-25T15:03:45.318 INFO:tasks.workunit.client.0.smithi170.stdout:2/700: dread d10/d1e/d5e/d73/d9e/da3/fb8 [0,4194304] 0 2024-01-25T15:03:45.318 INFO:tasks.workunit.client.0.smithi170.stdout:0/740: mkdir d8/d3e/de7/d59/d100 0 2024-01-25T15:03:45.322 INFO:tasks.workunit.client.0.smithi170.stdout:1/699: mkdir d0/de8 0 2024-01-25T15:03:45.323 INFO:tasks.workunit.client.0.smithi170.stdout:6/782: dread d2/d7/fbf [0,4194304] 0 2024-01-25T15:03:45.323 INFO:tasks.workunit.client.0.smithi170.stdout:1/700: truncate d0/d20/d28/d2a/d4a/d56/d5b/d72/fba 3516561 0 2024-01-25T15:03:45.324 INFO:tasks.workunit.client.0.smithi170.stdout:6/783: mknod d2/d7/d1b/d28/da7/dd2/df6/c10b 0 2024-01-25T15:03:45.325 INFO:tasks.workunit.client.0.smithi170.stdout:1/701: rmdir d0/d20/d28/d2a/dc7 39 2024-01-25T15:03:45.325 INFO:tasks.workunit.client.0.smithi170.stdout:1/702: creat d0/d20/d28/d7b/da8/daa/fe9 x:0 0 0 2024-01-25T15:03:45.325 INFO:tasks.workunit.client.0.smithi170.stdout:6/784: getdents d2/d7/d23/d19/d2f/d74/dce/ddf 0 2024-01-25T15:03:45.333 INFO:tasks.workunit.client.0.smithi170.stdout:9/717: sync 2024-01-25T15:03:45.333 INFO:tasks.workunit.client.0.smithi170.stdout:3/753: sync 2024-01-25T15:03:45.333 INFO:tasks.workunit.client.0.smithi170.stdout:3/754: write d3/d10/f14 [2886301,69691] 0 2024-01-25T15:03:45.333 INFO:tasks.workunit.client.0.smithi170.stdout:3/755: chown d3/d3b/d4f/da0/ddf 0 1 2024-01-25T15:03:45.334 INFO:tasks.workunit.client.0.smithi170.stdout:3/756: truncate d3/d10/d1e/d96/f9e 702604 0 2024-01-25T15:03:45.355 INFO:tasks.workunit.client.0.smithi170.stdout:2/701: dwrite d10/d1e/f26 [0,4194304] 0 2024-01-25T15:03:45.356 INFO:tasks.workunit.client.0.smithi170.stdout:2/702: readlink d10/d1e/d32/d62/l83 0 2024-01-25T15:03:45.360 INFO:tasks.workunit.client.0.smithi170.stdout:0/741: dwrite d8/d3e/fba [0,4194304] 0 2024-01-25T15:03:45.361 INFO:tasks.workunit.client.0.smithi170.stdout:0/742: truncate d8/d3e/de7/da2/fb1 7653148 0 2024-01-25T15:03:45.362 INFO:tasks.workunit.client.0.smithi170.stdout:0/743: unlink d8/d10/lde 0 2024-01-25T15:03:45.367 INFO:tasks.workunit.client.0.smithi170.stdout:4/649: dwrite d6/d28/d93/fc1 [0,4194304] 0 2024-01-25T15:03:45.367 INFO:tasks.workunit.client.0.smithi170.stdout:6/785: dwrite d2/f4f [0,4194304] 0 2024-01-25T15:03:45.368 INFO:tasks.workunit.client.0.smithi170.stdout:7/732: dwrite d8/f17 [0,4194304] 0 2024-01-25T15:03:45.368 INFO:tasks.workunit.client.0.smithi170.stdout:7/733: write d8/d20/d3b/f8d [2134792,655] 0 2024-01-25T15:03:45.368 INFO:tasks.workunit.client.0.smithi170.stdout:7/734: getdents d8/d20/d2a/d35/dff 0 2024-01-25T15:03:45.369 INFO:tasks.workunit.client.0.smithi170.stdout:9/718: dwrite d5/df/f1a [0,4194304] 0 2024-01-25T15:03:45.370 INFO:tasks.workunit.client.0.smithi170.stdout:2/703: write d10/d1e/d32/d62/d8d/fbe [2407799,62072] 0 2024-01-25T15:03:45.370 INFO:tasks.workunit.client.0.smithi170.stdout:9/719: write d5/df/d2e/fdd [445254,80547] 0 2024-01-25T15:03:45.370 INFO:tasks.workunit.client.0.smithi170.stdout:3/757: dwrite d3/d1c/fef [0,4194304] 0 2024-01-25T15:03:45.372 INFO:tasks.workunit.client.0.smithi170.stdout:2/704: creat d10/d1b/db6/dd7/ffc x:0 0 0 2024-01-25T15:03:45.377 INFO:tasks.workunit.client.0.smithi170.stdout:7/735: mkdir d8/d20/d2a/d35/d55/d7d/d103 0 2024-01-25T15:03:45.377 INFO:tasks.workunit.client.0.smithi170.stdout:7/736: truncate d8/f90 878852 0 2024-01-25T15:03:45.377 INFO:tasks.workunit.client.0.smithi170.stdout:9/720: mknod d5/df/d2e/d77/d21/daa/cf5 0 2024-01-25T15:03:45.384 INFO:tasks.workunit.client.0.smithi170.stdout:9/721: dread d5/dc/d42/f44 [0,4194304] 0 2024-01-25T15:03:45.386 INFO:tasks.workunit.client.0.smithi170.stdout:3/758: dread d3/d10/d13/d1b/d29/f8b [0,4194304] 0 2024-01-25T15:03:45.387 INFO:tasks.workunit.client.0.smithi170.stdout:3/759: mknod d3/d3b/d4f/df6/cfa 0 2024-01-25T15:03:45.388 INFO:tasks.workunit.client.0.smithi170.stdout:3/760: readlink d3/d1c/d2b/d5c/d97/dab/lf2 0 2024-01-25T15:03:45.389 INFO:tasks.workunit.client.0.smithi170.stdout:3/761: symlink d3/d3b/d4f/da0/dcb/lfb 0 2024-01-25T15:03:45.400 INFO:tasks.workunit.client.0.smithi170.stdout:0/744: dwrite d8/d9/f56 [0,4194304] 0 2024-01-25T15:03:45.402 INFO:tasks.workunit.client.0.smithi170.stdout:6/786: dwrite d2/f4 [0,4194304] 0 2024-01-25T15:03:45.402 INFO:tasks.workunit.client.0.smithi170.stdout:6/787: chown d2/d7/d23/d19/d2f/dd4/ded 28 1 2024-01-25T15:03:45.402 INFO:tasks.workunit.client.0.smithi170.stdout:6/788: chown d2/d7/d23/d19/d2f/d5d/f91 9981122 1 2024-01-25T15:03:45.402 INFO:tasks.workunit.client.0.smithi170.stdout:6/789: creat d2/d7/d23/d19/d2a/d43/d98/f10c x:0 0 0 2024-01-25T15:03:45.403 INFO:tasks.workunit.client.0.smithi170.stdout:0/745: symlink d8/d10/d2d/d2f/d96/db7/l101 0 2024-01-25T15:03:45.405 INFO:tasks.workunit.client.0.smithi170.stdout:6/790: unlink d2/d7/d1b/f64 0 2024-01-25T15:03:45.406 INFO:tasks.workunit.client.0.smithi170.stdout:4/650: rename d6/d28/d67/c7c to d6/ccc 0 2024-01-25T15:03:45.406 INFO:tasks.workunit.client.0.smithi170.stdout:4/651: chown d6/d28/d67 0 1 2024-01-25T15:03:45.406 INFO:tasks.workunit.client.0.smithi170.stdout:4/652: fdatasync d6/d28/d61/fa1 0 2024-01-25T15:03:45.408 INFO:tasks.workunit.client.0.smithi170.stdout:5/684: sync 2024-01-25T15:03:45.409 INFO:tasks.workunit.client.0.smithi170.stdout:0/746: link d8/d3e/de7/d59/c83 d8/d18/c102 0 2024-01-25T15:03:45.409 INFO:tasks.workunit.client.0.smithi170.stdout:0/747: readlink d8/d10/d5a/l5d 0 2024-01-25T15:03:45.409 INFO:tasks.workunit.client.0.smithi170.stdout:5/685: write d5/d54/d85/d2c/f5f [912560,14513] 0 2024-01-25T15:03:45.409 INFO:tasks.workunit.client.0.smithi170.stdout:5/686: dread - d5/d54/d85/d2c/d45/d56/f5b zero size 2024-01-25T15:03:45.409 INFO:tasks.workunit.client.0.smithi170.stdout:5/687: write d5/d54/d85/d2c/d34/d7c/f83 [669949,39253] 0 2024-01-25T15:03:45.409 INFO:tasks.workunit.client.0.smithi170.stdout:5/688: write d5/d54/d85/d3f/d8f/fdf [822176,44727] 0 2024-01-25T15:03:45.409 INFO:tasks.workunit.client.0.smithi170.stdout:5/689: creat d5/d54/d85/d3f/d8f/fea x:0 0 0 2024-01-25T15:03:45.410 INFO:tasks.workunit.client.0.smithi170.stdout:4/653: truncate d6/d7/d1b/f3b 774182 0 2024-01-25T15:03:45.410 INFO:tasks.workunit.client.0.smithi170.stdout:0/748: getdents d8/d3e/de7/da2 0 2024-01-25T15:03:45.413 INFO:tasks.workunit.client.0.smithi170.stdout:7/737: dread d8/f17 [0,4194304] 0 2024-01-25T15:03:45.413 INFO:tasks.workunit.client.0.smithi170.stdout:2/705: dwrite d10/d1e/d32/d62/d74/fba [0,4194304] 0 2024-01-25T15:03:45.413 INFO:tasks.workunit.client.0.smithi170.stdout:2/706: fdatasync d10/d1e/d32/d3e/d41/ffa 0 2024-01-25T15:03:45.413 INFO:tasks.workunit.client.0.smithi170.stdout:7/738: write d8/f9e [1735106,68567] 0 2024-01-25T15:03:45.413 INFO:tasks.workunit.client.0.smithi170.stdout:7/739: chown d8/d20/d2a/d35/f41 6 1 2024-01-25T15:03:45.413 INFO:tasks.workunit.client.0.smithi170.stdout:7/740: chown d8/d20/d45/l48 1694221 1 2024-01-25T15:03:45.413 INFO:tasks.workunit.client.0.smithi170.stdout:7/741: write d8/d20/d2a/d61/fa4 [890562,103863] 0 2024-01-25T15:03:45.413 INFO:tasks.workunit.client.0.smithi170.stdout:7/742: write d8/d20/d3b/ffc [1028344,49480] 0 2024-01-25T15:03:45.414 INFO:tasks.workunit.client.0.smithi170.stdout:6/791: symlink d2/d7/d23/d19/d2a/d43/l10d 0 2024-01-25T15:03:45.414 INFO:tasks.workunit.client.0.smithi170.stdout:6/792: dread - d2/d7/d1b/d28/da7/dd2/fe8 zero size 2024-01-25T15:03:45.414 INFO:tasks.workunit.client.0.smithi170.stdout:2/707: creat d10/d1e/d32/d98/ffd x:0 0 0 2024-01-25T15:03:45.416 INFO:tasks.workunit.client.0.smithi170.stdout:4/654: creat d6/d7/d31/d46/dc6/fcd x:0 0 0 2024-01-25T15:03:45.417 INFO:tasks.workunit.client.0.smithi170.stdout:0/749: mknod d8/d10/d2d/d2f/d6a/d79/d7e/c103 0 2024-01-25T15:03:45.417 INFO:tasks.workunit.client.0.smithi170.stdout:0/750: getdents d8/d9/db4 0 2024-01-25T15:03:45.419 INFO:tasks.workunit.client.0.smithi170.stdout:3/762: dwrite d3/d10/d1e/d21/d41/d4a/fb9 [0,4194304] 0 2024-01-25T15:03:45.419 INFO:tasks.workunit.client.0.smithi170.stdout:3/763: fdatasync d3/d1c/d2d/f35 0 2024-01-25T15:03:45.425 INFO:tasks.workunit.client.0.smithi170.stdout:0/751: unlink d8/d10/d2d/d53/lc5 0 2024-01-25T15:03:45.426 INFO:tasks.workunit.client.0.smithi170.stdout:0/752: write d8/d10/d2d/d53/df4/f8d [1105762,66805] 0 2024-01-25T15:03:45.447 INFO:tasks.workunit.client.0.smithi170.stdout:8/888: sync 2024-01-25T15:03:45.447 INFO:tasks.workunit.client.0.smithi170.stdout:1/703: sync 2024-01-25T15:03:45.447 INFO:tasks.workunit.client.0.smithi170.stdout:9/722: rename d5/df/d2e/d77/d21/d46/d6c/dd8/d96/c9a to d5/cf6 0 2024-01-25T15:03:45.447 INFO:tasks.workunit.client.0.smithi170.stdout:1/704: readlink d0/l13 0 2024-01-25T15:03:45.449 INFO:tasks.workunit.client.0.smithi170.stdout:8/889: unlink d3/d7/d22/d80/cb0 0 2024-01-25T15:03:45.449 INFO:tasks.workunit.client.0.smithi170.stdout:8/890: stat d3/d7/c69 0 2024-01-25T15:03:45.450 INFO:tasks.workunit.client.0.smithi170.stdout:9/723: symlink d5/df/d16/d52/d9c/lf7 0 2024-01-25T15:03:45.450 INFO:tasks.workunit.client.0.smithi170.stdout:9/724: chown d5/df/d16/ce0 91939858 1 2024-01-25T15:03:45.450 INFO:tasks.workunit.client.0.smithi170.stdout:9/725: getdents d5/df/d2e/d77/d21/d46/d6c/dac 0 2024-01-25T15:03:45.452 INFO:tasks.workunit.client.0.smithi170.stdout:0/753: link d8/d10/d5a/cd2 d8/d10/d2d/d53/df4/dc6/dc9/dca/c104 0 2024-01-25T15:03:45.452 INFO:tasks.workunit.client.0.smithi170.stdout:0/754: chown d8/d10/d2d/ccc 2599024 1 2024-01-25T15:03:45.453 INFO:tasks.workunit.client.0.smithi170.stdout:0/755: symlink d8/d10/d2d/d2f/d96/db7/l105 0 2024-01-25T15:03:45.454 INFO:tasks.workunit.client.0.smithi170.stdout:0/756: mkdir d8/d10/d2d/d2f/d6a/d106 0 2024-01-25T15:03:45.454 INFO:tasks.workunit.client.0.smithi170.stdout:0/757: dread - d8/d10/d2d/d2f/fbc zero size 2024-01-25T15:03:45.454 INFO:tasks.workunit.client.0.smithi170.stdout:0/758: getdents d8/d10/d2d/d2f/d6a/d106 0 2024-01-25T15:03:45.455 INFO:tasks.workunit.client.0.smithi170.stdout:8/891: read d3/d7/d22/d23/d48/d52/d47/fbc [3973213,45859] 0 2024-01-25T15:03:45.455 INFO:tasks.workunit.client.0.smithi170.stdout:8/892: write d3/d7/d3a/d8d/ff4 [402500,9598] 0 2024-01-25T15:03:45.461 INFO:tasks.workunit.client.0.smithi170.stdout:6/793: dwrite d2/d7/d23/d19/d60/fdd [0,4194304] 0 2024-01-25T15:03:45.462 INFO:tasks.workunit.client.0.smithi170.stdout:4/655: dwrite d6/d28/d59/d7d/f68 [0,4194304] 0 2024-01-25T15:03:45.462 INFO:tasks.workunit.client.0.smithi170.stdout:6/794: fsync d2/d7/d23/d19/d2a/d43/d98/ffb 0 2024-01-25T15:03:45.462 INFO:tasks.workunit.client.0.smithi170.stdout:9/726: dread d5/df/d2e/f70 [0,4194304] 0 2024-01-25T15:03:45.462 INFO:tasks.workunit.client.0.smithi170.stdout:9/727: write d5/df/d2e/fdd [1433687,24886] 0 2024-01-25T15:03:45.464 INFO:tasks.workunit.client.0.smithi170.stdout:4/656: write d6/d28/f7a [1331921,50971] 0 2024-01-25T15:03:45.464 INFO:tasks.workunit.client.0.smithi170.stdout:2/708: dwrite d10/d1e/d32/d3e/d5c/d92/fc0 [4194304,4194304] 0 2024-01-25T15:03:45.466 INFO:tasks.workunit.client.0.smithi170.stdout:9/728: rmdir d5/df/d16 39 2024-01-25T15:03:45.466 INFO:tasks.workunit.client.0.smithi170.stdout:9/729: fdatasync d5/f14 0 2024-01-25T15:03:45.468 INFO:tasks.workunit.client.0.smithi170.stdout:2/709: getdents d10/d1e/d32/d3e/d5c/d92/de9 0 2024-01-25T15:03:45.468 INFO:tasks.workunit.client.0.smithi170.stdout:9/730: write d5/df/d2e/d6b/fd0 [164650,1546] 0 2024-01-25T15:03:45.468 INFO:tasks.workunit.client.0.smithi170.stdout:9/731: write d5/df/d2e/d77/d21/d34/d3e/fab [406068,60729] 0 2024-01-25T15:03:45.469 INFO:tasks.workunit.client.0.smithi170.stdout:9/732: rmdir d5/df/d2e/d77/d86 39 2024-01-25T15:03:45.472 INFO:tasks.workunit.client.0.smithi170.stdout:4/657: unlink d6/d28/c3c 0 2024-01-25T15:03:45.472 INFO:tasks.workunit.client.0.smithi170.stdout:9/733: write d5/df/d2e/d77/d21/d34/f5b [975575,98691] 0 2024-01-25T15:03:45.472 INFO:tasks.workunit.client.0.smithi170.stdout:9/734: creat d5/df/d2e/db0/ff8 x:0 0 0 2024-01-25T15:03:45.472 INFO:tasks.workunit.client.0.smithi170.stdout:4/658: write d6/d28/d59/d7d/d6b/f88 [2605046,130955] 0 2024-01-25T15:03:45.472 INFO:tasks.workunit.client.0.smithi170.stdout:1/705: dwrite d0/d2e/f31 [4194304,4194304] 0 2024-01-25T15:03:45.474 INFO:tasks.workunit.client.0.smithi170.stdout:4/659: link d6/d28/f5d d6/d28/d61/fce 0 2024-01-25T15:03:45.474 INFO:tasks.workunit.client.0.smithi170.stdout:9/735: getdents d5/dca 0 2024-01-25T15:03:45.474 INFO:tasks.workunit.client.0.smithi170.stdout:9/736: chown d5/dc/dce 2 1 2024-01-25T15:03:45.476 INFO:tasks.workunit.client.0.smithi170.stdout:5/690: rename d5/c1f to d5/d58/da9/ceb 0 2024-01-25T15:03:45.477 INFO:tasks.workunit.client.0.smithi170.stdout:1/706: creat d0/d50/da0/d9c/fea x:0 0 0 2024-01-25T15:03:45.477 INFO:tasks.workunit.client.0.smithi170.stdout:5/691: mknod d5/d54/d85/d2c/d45/dba/dbd/cec 0 2024-01-25T15:03:45.479 INFO:tasks.workunit.client.0.smithi170.stdout:3/764: rename d3/d3b/d4f to d3/d10/d1e/d21/d41/d4a/dc3/dfc 0 2024-01-25T15:03:45.479 INFO:tasks.workunit.client.0.smithi170.stdout:3/765: dread - d3/d10/d13/d1b/fb1 zero size 2024-01-25T15:03:45.481 INFO:tasks.workunit.client.0.smithi170.stdout:5/692: mknod d5/d54/dc6/ced 0 2024-01-25T15:03:45.481 INFO:tasks.workunit.client.0.smithi170.stdout:5/693: stat d5/d54/d85/d2c/d45/d56/l6f 0 2024-01-25T15:03:45.484 INFO:tasks.workunit.client.0.smithi170.stdout:2/710: rename d10/d1e/d5e/d73/d9e/da3/fad to d10/d1e/d32/d3e/d5c/de5/ffe 0 2024-01-25T15:03:45.484 INFO:tasks.workunit.client.0.smithi170.stdout:0/759: dwrite d8/d10/d2d/d53/fb5 [8388608,4194304] 0 2024-01-25T15:03:45.484 INFO:tasks.workunit.client.0.smithi170.stdout:8/893: dwrite d3/d7/d1e/f6c [0,4194304] 0 2024-01-25T15:03:45.486 INFO:tasks.workunit.client.0.smithi170.stdout:0/760: creat d8/f107 x:0 0 0 2024-01-25T15:03:45.486 INFO:tasks.workunit.client.0.smithi170.stdout:0/761: fdatasync d8/d3e/fe4 0 2024-01-25T15:03:45.487 INFO:tasks.workunit.client.0.smithi170.stdout:8/894: mkdir d3/d7/d22/d23/d25/d12a/d134 0 2024-01-25T15:03:45.487 INFO:tasks.workunit.client.0.smithi170.stdout:8/895: write d3/d7/d3a/d8d/dd5/fe6 [846962,10700] 0 2024-01-25T15:03:45.487 INFO:tasks.workunit.client.0.smithi170.stdout:4/660: dread f2 [0,4194304] 0 2024-01-25T15:03:45.488 INFO:tasks.workunit.client.0.smithi170.stdout:0/762: mkdir d8/d3e/de7/d5f/d108 0 2024-01-25T15:03:45.488 INFO:tasks.workunit.client.0.smithi170.stdout:0/763: read d8/d18/f20 [3517120,65173] 0 2024-01-25T15:03:45.489 INFO:tasks.workunit.client.0.smithi170.stdout:3/766: dread d3/d1c/d2b/fc1 [0,4194304] 0 2024-01-25T15:03:45.489 INFO:tasks.workunit.client.0.smithi170.stdout:5/694: write d5/f40 [686138,75794] 0 2024-01-25T15:03:45.489 INFO:tasks.workunit.client.0.smithi170.stdout:5/695: chown d5/d58/da9/ceb 193 1 2024-01-25T15:03:45.489 INFO:tasks.workunit.client.0.smithi170.stdout:5/696: chown d5/d54/d85/d2c/d51/d41/la1 16185 1 2024-01-25T15:03:45.489 INFO:tasks.workunit.client.0.smithi170.stdout:3/767: write d3/d3b/f70 [4173455,114926] 0 2024-01-25T15:03:45.489 INFO:tasks.workunit.client.0.smithi170.stdout:5/697: write d5/fe [1170236,62735] 0 2024-01-25T15:03:45.489 INFO:tasks.workunit.client.0.smithi170.stdout:8/896: mknod d3/d7/d22/c135 0 2024-01-25T15:03:45.492 INFO:tasks.workunit.client.0.smithi170.stdout:0/764: dread d8/d10/d2d/d2f/d6a/d79/db6/fb8 [0,4194304] 0 2024-01-25T15:03:45.492 INFO:tasks.workunit.client.0.smithi170.stdout:0/765: stat d8/d3e/de7/d5f/f88 0 2024-01-25T15:03:45.492 INFO:tasks.workunit.client.0.smithi170.stdout:6/795: dwrite d2/d7/d23/d19/f5e [0,4194304] 0 2024-01-25T15:03:45.494 INFO:tasks.workunit.client.0.smithi170.stdout:0/766: dread - d8/d80/fcb zero size 2024-01-25T15:03:45.494 INFO:tasks.workunit.client.0.smithi170.stdout:0/767: chown d8/d10/f15 68565585 1 2024-01-25T15:03:45.494 INFO:tasks.workunit.client.0.smithi170.stdout:0/768: fsync d8/d10/d2d/d2f/f7c 0 2024-01-25T15:03:45.494 INFO:tasks.workunit.client.0.smithi170.stdout:0/769: chown d8/d10/d2d/d2f/d96/db7/l105 833 1 2024-01-25T15:03:45.496 INFO:tasks.workunit.client.0.smithi170.stdout:6/796: creat d2/d7/d23/d19/d2a/d43/f10e x:0 0 0 2024-01-25T15:03:45.498 INFO:tasks.workunit.client.0.smithi170.stdout:6/797: chown d2/d7/d23/d19/d2f/d74/dc1/dcf/ff1 42403405 1 2024-01-25T15:03:45.498 INFO:tasks.workunit.client.0.smithi170.stdout:6/798: write d2/d7/d1b/d28/db8/fba [121855,4235] 0 2024-01-25T15:03:45.500 INFO:tasks.workunit.client.0.smithi170.stdout:0/770: symlink d8/d3e/de7/d5f/d108/l109 0 2024-01-25T15:03:45.500 INFO:tasks.workunit.client.0.smithi170.stdout:0/771: dread - d8/d10/d2d/d58/f9f zero size 2024-01-25T15:03:45.502 INFO:tasks.workunit.client.0.smithi170.stdout:3/768: truncate d3/d3b/dc6/d7e/f8c 840916 0 2024-01-25T15:03:45.502 INFO:tasks.workunit.client.0.smithi170.stdout:3/769: dread - d3/d10/d1e/d21/d41/d77/fa7 zero size 2024-01-25T15:03:45.502 INFO:tasks.workunit.client.0.smithi170.stdout:3/770: readlink d3/d1c/d2b/l99 0 2024-01-25T15:03:45.502 INFO:tasks.workunit.client.0.smithi170.stdout:3/771: truncate d3/d10/d13/d1b/d85/fb8 856180 0 2024-01-25T15:03:45.503 INFO:tasks.workunit.client.0.smithi170.stdout:0/772: truncate d8/d9/d9a/fa6 2388825 0 2024-01-25T15:03:45.505 INFO:tasks.workunit.client.0.smithi170.stdout:3/772: rename d3/d10/d13/d1b/l32 to d3/d10/d6d/d98/lfd 0 2024-01-25T15:03:45.505 INFO:tasks.workunit.client.0.smithi170.stdout:3/773: chown d3/d10/d13/l79 390433 1 2024-01-25T15:03:45.505 INFO:tasks.workunit.client.0.smithi170.stdout:3/774: creat d3/d10/d13/d1b/db3/ffe x:0 0 0 2024-01-25T15:03:45.505 INFO:tasks.workunit.client.0.smithi170.stdout:3/775: chown d3/d10/d13/d1b/d85/fcd 115999782 1 2024-01-25T15:03:45.505 INFO:tasks.workunit.client.0.smithi170.stdout:3/776: chown d3/d3b/dc6/d7e 0 1 2024-01-25T15:03:45.506 INFO:tasks.workunit.client.0.smithi170.stdout:3/777: write d3/d10/fac [862475,81847] 0 2024-01-25T15:03:45.506 INFO:tasks.workunit.client.0.smithi170.stdout:8/897: dread d3/d7/d22/d23/f76 [0,4194304] 0 2024-01-25T15:03:45.506 INFO:tasks.workunit.client.0.smithi170.stdout:8/898: write d3/d7/fb4 [893957,41229] 0 2024-01-25T15:03:45.507 INFO:tasks.workunit.client.0.smithi170.stdout:3/778: mknod d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/cff 0 2024-01-25T15:03:45.507 INFO:tasks.workunit.client.0.smithi170.stdout:3/779: write d3/d10/d1e/d21/d41/d4a/dc3/fd8 [483639,111337] 0 2024-01-25T15:03:45.507 INFO:tasks.workunit.client.0.smithi170.stdout:0/773: symlink d8/d10/d2d/d2f/d6a/d79/l10a 0 2024-01-25T15:03:45.508 INFO:tasks.workunit.client.0.smithi170.stdout:0/774: chown d8/d10/d2d/d53/df4/dc6/dc9/dca 121259 1 2024-01-25T15:03:45.509 INFO:tasks.workunit.client.0.smithi170.stdout:3/780: creat d3/d10/d6d/f100 x:0 0 0 2024-01-25T15:03:45.509 INFO:tasks.workunit.client.0.smithi170.stdout:3/781: dread - d3/d10/d6d/f100 zero size 2024-01-25T15:03:45.509 INFO:tasks.workunit.client.0.smithi170.stdout:4/661: read d6/d7/d31/d7e/f5b [1514884,107039] 0 2024-01-25T15:03:45.511 INFO:tasks.workunit.client.0.smithi170.stdout:3/782: symlink d3/d10/d1e/d21/d41/d4a/dc3/l101 0 2024-01-25T15:03:45.513 INFO:tasks.workunit.client.0.smithi170.stdout:4/662: truncate d6/d7/d31/d46/d78/fc0 411614 0 2024-01-25T15:03:45.516 INFO:tasks.workunit.client.0.smithi170.stdout:1/707: dwrite d0/d20/d28/d2a/d4a/d56/dc1/fc2 [0,4194304] 0 2024-01-25T15:03:45.517 INFO:tasks.workunit.client.0.smithi170.stdout:0/775: rename d8/d10/c45 to d8/d10/d2d/d2f/d6a/d79/c10b 0 2024-01-25T15:03:45.517 INFO:tasks.workunit.client.0.smithi170.stdout:0/776: truncate d8/f107 784552 0 2024-01-25T15:03:45.518 INFO:tasks.workunit.client.0.smithi170.stdout:3/783: creat d3/d10/d1e/d21/d41/d4a/dc3/dfc/f102 x:0 0 0 2024-01-25T15:03:45.519 INFO:tasks.workunit.client.0.smithi170.stdout:9/737: dwrite d5/f37 [0,4194304] 0 2024-01-25T15:03:45.519 INFO:tasks.workunit.client.0.smithi170.stdout:9/738: truncate d5/df/d2e/d77/d21/d34/fe3 313546 0 2024-01-25T15:03:45.520 INFO:tasks.workunit.client.0.smithi170.stdout:2/711: dwrite d10/d1e/d32/f9d [0,4194304] 0 2024-01-25T15:03:45.521 INFO:tasks.workunit.client.0.smithi170.stdout:0/777: rmdir d8/d10/d2d/d53/df4/dc6/dc9 39 2024-01-25T15:03:45.524 INFO:tasks.workunit.client.0.smithi170.stdout:9/739: creat d5/df/d2e/d77/d21/d46/d6c/dac/ff9 x:0 0 0 2024-01-25T15:03:45.525 INFO:tasks.workunit.client.0.smithi170.stdout:9/740: truncate d5/df/d2e/d77/d21/d46/d6c/dac/ff9 177271 0 2024-01-25T15:03:45.531 INFO:tasks.workunit.client.0.smithi170.stdout:3/784: write d3/d10/f14 [6185453,92901] 0 2024-01-25T15:03:45.533 INFO:tasks.workunit.client.0.smithi170.stdout:0/778: dread d8/d3e/de7/da2/fb1 [4194304,4194304] 0 2024-01-25T15:03:45.538 INFO:tasks.workunit.client.0.smithi170.stdout:3/785: mknod d3/d10/d13/d1b/d81/c103 0 2024-01-25T15:03:45.538 INFO:tasks.workunit.client.0.smithi170.stdout:3/786: write d3/d1c/d2d/f35 [9790769,48791] 0 2024-01-25T15:03:45.538 INFO:tasks.workunit.client.0.smithi170.stdout:0/779: dread d8/d80/f91 [0,4194304] 0 2024-01-25T15:03:45.538 INFO:tasks.workunit.client.0.smithi170.stdout:0/780: chown d8/d10/d2d 0 1 2024-01-25T15:03:45.539 INFO:tasks.workunit.client.0.smithi170.stdout:8/899: dwrite d3/d7/d1e/f71 [0,4194304] 0 2024-01-25T15:03:45.540 INFO:tasks.workunit.client.0.smithi170.stdout:4/663: dwrite d6/d28/d67/f96 [0,4194304] 0 2024-01-25T15:03:45.541 INFO:tasks.workunit.client.0.smithi170.stdout:9/741: write d5/f94 [3189134,95592] 0 2024-01-25T15:03:45.541 INFO:tasks.workunit.client.0.smithi170.stdout:3/787: mkdir d3/d1c/d104 0 2024-01-25T15:03:45.541 INFO:tasks.workunit.client.0.smithi170.stdout:3/788: rename d3/d10/d1e/d21/d41/d4a to d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/d105 22 2024-01-25T15:03:45.542 INFO:tasks.workunit.client.0.smithi170.stdout:4/664: mknod d6/d28/d67/ccf 0 2024-01-25T15:03:45.544 INFO:tasks.workunit.client.0.smithi170.stdout:4/665: creat d6/d28/dc2/fd0 x:0 0 0 2024-01-25T15:03:45.545 INFO:tasks.workunit.client.0.smithi170.stdout:8/900: link d3/d7/d22/d5d/f6e d3/d7/d22/f136 0 2024-01-25T15:03:45.545 INFO:tasks.workunit.client.0.smithi170.stdout:8/901: chown d3/d7/d22/lcf 1 1 2024-01-25T15:03:45.547 INFO:tasks.workunit.client.0.smithi170.stdout:1/708: dwrite d0/d50/da0/d9c/fea [0,4194304] 0 2024-01-25T15:03:45.547 INFO:tasks.workunit.client.0.smithi170.stdout:9/742: creat d5/df/d2e/d77/d21/d46/ffa x:0 0 0 2024-01-25T15:03:45.549 INFO:tasks.workunit.client.0.smithi170.stdout:8/902: mkdir d3/d7/d3a/d8d/d137 0 2024-01-25T15:03:45.550 INFO:tasks.workunit.client.0.smithi170.stdout:8/903: dread d3/d7/d1e/f66 [0,4194304] 0 2024-01-25T15:03:45.550 INFO:tasks.workunit.client.0.smithi170.stdout:8/904: fsync d3/d7/d22/d23/d48/d52/d47/d86/fb9 0 2024-01-25T15:03:45.551 INFO:tasks.workunit.client.0.smithi170.stdout:1/709: creat d0/de8/feb x:0 0 0 2024-01-25T15:03:45.551 INFO:tasks.workunit.client.0.smithi170.stdout:8/905: write d3/d7/fb4 [517407,111413] 0 2024-01-25T15:03:45.552 INFO:tasks.workunit.client.0.smithi170.stdout:8/906: write d3/d7/d22/d23/d48/f65 [192429,33648] 0 2024-01-25T15:03:45.552 INFO:tasks.workunit.client.0.smithi170.stdout:9/743: creat d5/df/ffb x:0 0 0 2024-01-25T15:03:45.556 INFO:tasks.workunit.client.0.smithi170.stdout:1/710: creat d0/d20/d28/d2a/d4a/d56/dc1/de3/fec x:0 0 0 2024-01-25T15:03:45.557 INFO:tasks.workunit.client.0.smithi170.stdout:9/744: link d5/df/d16/d52/d9c/cb4 d5/df/d16/d35/d3c/d91/dd6/cfc 0 2024-01-25T15:03:45.557 INFO:tasks.workunit.client.0.smithi170.stdout:9/745: dread - d5/df/d2e/d77/d21/d34/d3e/d7f/fb3 zero size 2024-01-25T15:03:45.558 INFO:tasks.workunit.client.0.smithi170.stdout:0/781: dread d8/d18/f4d [0,4194304] 0 2024-01-25T15:03:45.559 INFO:tasks.workunit.client.0.smithi170.stdout:9/746: readlink d5/df/d2e/d77/l3a 0 2024-01-25T15:03:45.559 INFO:tasks.workunit.client.0.smithi170.stdout:9/747: readlink d5/df/d2e/d77/d21/d34/ldf 0 2024-01-25T15:03:45.559 INFO:tasks.workunit.client.0.smithi170.stdout:0/782: truncate d8/d10/d2d/d58/f9f 290804 0 2024-01-25T15:03:45.560 INFO:tasks.workunit.client.0.smithi170.stdout:7/743: sync 2024-01-25T15:03:45.560 INFO:tasks.workunit.client.0.smithi170.stdout:7/744: chown d8/d20/d45/f46 22542348 1 2024-01-25T15:03:45.560 INFO:tasks.workunit.client.0.smithi170.stdout:7/745: chown d8/l58 124 1 2024-01-25T15:03:45.560 INFO:tasks.workunit.client.0.smithi170.stdout:7/746: write d8/d20/d3b/d4d/f78 [4462669,51971] 0 2024-01-25T15:03:45.560 INFO:tasks.workunit.client.0.smithi170.stdout:7/747: chown d8/l33 0 1 2024-01-25T15:03:45.560 INFO:tasks.workunit.client.0.smithi170.stdout:9/748: mkdir d5/dc/dce/dfd 0 2024-01-25T15:03:45.561 INFO:tasks.workunit.client.0.smithi170.stdout:3/789: dwrite d3/d10/d1e/fbf [4194304,4194304] 0 2024-01-25T15:03:45.561 INFO:tasks.workunit.client.0.smithi170.stdout:0/783: creat d8/d9/d9a/f10c x:0 0 0 2024-01-25T15:03:45.564 INFO:tasks.workunit.client.0.smithi170.stdout:9/749: symlink d5/df/d16/d35/d3c/lfe 0 2024-01-25T15:03:45.568 INFO:tasks.workunit.client.0.smithi170.stdout:7/748: getdents d8/d20/d2a 0 2024-01-25T15:03:45.568 INFO:tasks.workunit.client.0.smithi170.stdout:7/749: write d8/f5d [518745,19230] 0 2024-01-25T15:03:45.568 INFO:tasks.workunit.client.0.smithi170.stdout:7/750: chown d8/d20/dc2 803427399 1 2024-01-25T15:03:45.570 INFO:tasks.workunit.client.0.smithi170.stdout:9/750: link d5/df/d16/f19 d5/df/d2e/d77/d21/d46/d18/fff 0 2024-01-25T15:03:45.574 INFO:tasks.workunit.client.0.smithi170.stdout:2/712: link d10/d1e/d5e/d73/d9e/da3/lbc d10/d1e/d5e/d73/d9e/lff 0 2024-01-25T15:03:45.574 INFO:tasks.workunit.client.0.smithi170.stdout:9/751: symlink d5/df/d2e/d77/d21/daa/l100 0 2024-01-25T15:03:45.577 INFO:tasks.workunit.client.0.smithi170.stdout:2/713: dread d10/d1e/d32/d3e/d41/dc4/fbf [0,4194304] 0 2024-01-25T15:03:45.578 INFO:tasks.workunit.client.0.smithi170.stdout:9/752: mkdir d5/df/d16/d35/d3c/d91/d101 0 2024-01-25T15:03:45.578 INFO:tasks.workunit.client.0.smithi170.stdout:4/666: dwrite d6/d7/d31/d46/dc6/fcd [0,4194304] 0 2024-01-25T15:03:45.579 INFO:tasks.workunit.client.0.smithi170.stdout:4/667: write d6/d28/d59/d7d/d6b/fc7 [302641,12109] 0 2024-01-25T15:03:45.579 INFO:tasks.workunit.client.0.smithi170.stdout:4/668: fsync d6/d7/d1b/f1e 0 2024-01-25T15:03:45.579 INFO:tasks.workunit.client.0.smithi170.stdout:4/669: readlink d6/d28/d59/d7d/l58 0 2024-01-25T15:03:45.579 INFO:tasks.workunit.client.0.smithi170.stdout:9/753: dread d5/df/d2e/d77/d21/d34/f47 [0,4194304] 0 2024-01-25T15:03:45.584 INFO:tasks.workunit.client.0.smithi170.stdout:0/784: dwrite d8/d10/d2d/d2f/d96/db7/fd1 [0,4194304] 0 2024-01-25T15:03:45.585 INFO:tasks.workunit.client.0.smithi170.stdout:9/754: unlink d5/df/d2e/d77/d21/d46/d6c/dac/le1 0 2024-01-25T15:03:45.585 INFO:tasks.workunit.client.0.smithi170.stdout:4/670: rmdir d6/d28/d59/d7d/d6b 39 2024-01-25T15:03:45.586 INFO:tasks.workunit.client.0.smithi170.stdout:4/671: stat d6/d28/dc2/cc8 0 2024-01-25T15:03:45.586 INFO:tasks.workunit.client.0.smithi170.stdout:4/672: write d6/d28/d93/f9a [226845,97965] 0 2024-01-25T15:03:45.586 INFO:tasks.workunit.client.0.smithi170.stdout:4/673: write d6/d28/d59/dc4/fc5 [144506,74640] 0 2024-01-25T15:03:45.587 INFO:tasks.workunit.client.0.smithi170.stdout:9/755: getdents d5/df/d2e/d77/d21/d46/d6c/dd8 0 2024-01-25T15:03:45.588 INFO:tasks.workunit.client.0.smithi170.stdout:4/674: chown d6/d7/d31/l48 2453 1 2024-01-25T15:03:45.591 INFO:tasks.workunit.client.0.smithi170.stdout:7/751: dwrite d8/d20/d2a/d35/d55/d9b/fc1 [0,4194304] 0 2024-01-25T15:03:45.595 INFO:tasks.workunit.client.0.smithi170.stdout:9/756: dread d5/f8 [4194304,4194304] 0 2024-01-25T15:03:45.595 INFO:tasks.workunit.client.0.smithi170.stdout:3/790: rename d3/d3b/dc6/fd3 to d3/d10/d6d/f106 0 2024-01-25T15:03:45.595 INFO:tasks.workunit.client.0.smithi170.stdout:9/757: truncate d5/df/d16/d35/d3c/d91/dd6/dd9/fde 612969 0 2024-01-25T15:03:45.595 INFO:tasks.workunit.client.0.smithi170.stdout:3/791: write d3/d10/d6d/faa [1968237,17281] 0 2024-01-25T15:03:45.596 INFO:tasks.workunit.client.0.smithi170.stdout:3/792: read d3/d1c/d2b/f62 [306679,51364] 0 2024-01-25T15:03:45.596 INFO:tasks.workunit.client.0.smithi170.stdout:7/752: rename d8/d20/d2a/d35/db0/cb7 to d8/d20/d45/c104 0 2024-01-25T15:03:45.598 INFO:tasks.workunit.client.0.smithi170.stdout:2/714: link d10/d1e/d32/d3e/d41/dc4/dc6/caf d10/d1e/d5e/d73/df0/c100 0 2024-01-25T15:03:45.598 INFO:tasks.workunit.client.0.smithi170.stdout:2/715: chown d10/f18 166 1 2024-01-25T15:03:45.598 INFO:tasks.workunit.client.0.smithi170.stdout:3/793: getdents d3/d3b/dc6/d7e 0 2024-01-25T15:03:45.600 INFO:tasks.workunit.client.0.smithi170.stdout:3/794: symlink d3/d10/d1e/d21/d41/d4a/dc3/l107 0 2024-01-25T15:03:45.601 INFO:tasks.workunit.client.0.smithi170.stdout:4/675: dread d6/d7/f81 [0,4194304] 0 2024-01-25T15:03:45.601 INFO:tasks.workunit.client.0.smithi170.stdout:7/753: unlink d8/d20/d2a/d35/d55/d6e/d81/f100 0 2024-01-25T15:03:45.601 INFO:tasks.workunit.client.0.smithi170.stdout:7/754: chown d8/d20/d2a/d35/d55/d6e/ca8 270 1 2024-01-25T15:03:45.601 INFO:tasks.workunit.client.0.smithi170.stdout:7/755: chown d8/d20/d3b/d4d 1 1 2024-01-25T15:03:45.602 INFO:tasks.workunit.client.0.smithi170.stdout:3/795: truncate d3/d10/d1e/d96/f9e 499568 0 2024-01-25T15:03:45.602 INFO:tasks.workunit.client.0.smithi170.stdout:7/756: symlink d8/d20/d2a/d35/d55/d9b/l105 0 2024-01-25T15:03:45.603 INFO:tasks.workunit.client.0.smithi170.stdout:7/757: rmdir d8/d20/d2a/d35/d55/d9b/db9 39 2024-01-25T15:03:45.605 INFO:tasks.workunit.client.0.smithi170.stdout:9/758: dread d5/df/d2e/d77/d21/d34/f3d [0,4194304] 0 2024-01-25T15:03:45.605 INFO:tasks.workunit.client.0.smithi170.stdout:9/759: chown d5/df/d2e/l61 3773357 1 2024-01-25T15:03:45.605 INFO:tasks.workunit.client.0.smithi170.stdout:9/760: chown d5/df/d2e/d6b/dd2/cf4 7 1 2024-01-25T15:03:45.605 INFO:tasks.workunit.client.0.smithi170.stdout:9/761: fdatasync d5/df/ffb 0 2024-01-25T15:03:45.608 INFO:tasks.workunit.client.0.smithi170.stdout:3/796: creat d3/d10/d13/d1b/d81/f108 x:0 0 0 2024-01-25T15:03:45.608 INFO:tasks.workunit.client.0.smithi170.stdout:0/785: dwrite d8/d10/d2d/d2f/d6a/d79/db6/fb8 [0,4194304] 0 2024-01-25T15:03:45.608 INFO:tasks.workunit.client.0.smithi170.stdout:3/797: creat d3/d10/d1e/d21/d41/d4a/dc3/dfc/f109 x:0 0 0 2024-01-25T15:03:45.614 INFO:tasks.workunit.client.0.smithi170.stdout:2/716: dread f9 [0,4194304] 0 2024-01-25T15:03:45.618 INFO:tasks.workunit.client.0.smithi170.stdout:0/786: rename d8/d3e to d8/d10/d2d/d2f/d6a/d79/d7e/d10d 0 2024-01-25T15:03:45.619 INFO:tasks.workunit.client.0.smithi170.stdout:9/762: dread d5/df/d2e/d77/d21/d34/fc7 [0,4194304] 0 2024-01-25T15:03:45.620 INFO:tasks.workunit.client.0.smithi170.stdout:0/787: link d8/d10/cd4 d8/d10/d2d/d2f/d6a/d79/d7e/d10d/de7/d5f/d108/c10e 0 2024-01-25T15:03:45.622 INFO:tasks.workunit.client.0.smithi170.stdout:0/788: mkdir d8/d10/d10f 0 2024-01-25T15:03:45.624 INFO:tasks.workunit.client.0.smithi170.stdout:0/789: dread d8/d10/d2d/d58/fa5 [0,4194304] 0 2024-01-25T15:03:45.626 INFO:tasks.workunit.client.0.smithi170.stdout:2/717: read d10/d1e/d5e/d73/d9e/da3/fb3 [520132,12216] 0 2024-01-25T15:03:45.630 INFO:tasks.workunit.client.0.smithi170.stdout:2/718: creat d10/d1e/d32/d3e/d41/dc4/f101 x:0 0 0 2024-01-25T15:03:45.637 INFO:tasks.workunit.client.0.smithi170.stdout:2/719: rename d10/d1e/d32/d98/d99 to d10/d1e/d32/d3e/d5c/d102 0 2024-01-25T15:03:45.637 INFO:tasks.workunit.client.0.smithi170.stdout:4/676: dwrite d6/d7/d1b/f3b [0,4194304] 0 2024-01-25T15:03:45.637 INFO:tasks.workunit.client.0.smithi170.stdout:3/798: dwrite d3/d10/d13/d1b/d29/fd6 [0,4194304] 0 2024-01-25T15:03:45.638 INFO:tasks.workunit.client.0.smithi170.stdout:3/799: readlink d3/d3b/dc6/d53/l6b 0 2024-01-25T15:03:45.639 INFO:tasks.workunit.client.0.smithi170.stdout:3/800: write d3/d1c/fb4 [19594,122544] 0 2024-01-25T15:03:45.647 INFO:tasks.workunit.client.0.smithi170.stdout:7/758: dwrite d8/d20/d2a/d35/d55/d7d/fda [0,4194304] 0 2024-01-25T15:03:45.649 INFO:tasks.workunit.client.0.smithi170.stdout:2/720: read d10/d1e/d32/d3e/d41/dc4/dc6/f23 [606610,61618] 0 2024-01-25T15:03:45.649 INFO:tasks.workunit.client.0.smithi170.stdout:2/721: chown d10/d1e/d5e/d73 16610219 1 2024-01-25T15:03:45.649 INFO:tasks.workunit.client.0.smithi170.stdout:2/722: chown d10/d1e/d32/d3e/d41/dc4/fbf 15 1 2024-01-25T15:03:45.649 INFO:tasks.workunit.client.0.smithi170.stdout:2/723: readlink d10/l3d 0 2024-01-25T15:03:45.649 INFO:tasks.workunit.client.0.smithi170.stdout:7/759: link l1 d8/d20/d45/l106 0 2024-01-25T15:03:45.651 INFO:tasks.workunit.client.0.smithi170.stdout:2/724: symlink d10/d1e/d32/d3e/d41/dc4/dc6/l103 0 2024-01-25T15:03:45.653 INFO:tasks.workunit.client.0.smithi170.stdout:5/698: sync 2024-01-25T15:03:45.655 INFO:tasks.workunit.client.0.smithi170.stdout:5/699: rmdir d5/d54/d85/d2c/d51/d96 39 2024-01-25T15:03:45.657 INFO:tasks.workunit.client.0.smithi170.stdout:0/790: dwrite d8/d10/d2d/d2f/d6a/d79/d7e/d10d/fba [0,4194304] 0 2024-01-25T15:03:45.659 INFO:tasks.workunit.client.0.smithi170.stdout:0/791: unlink d8/d10/cd4 0 2024-01-25T15:03:45.660 INFO:tasks.workunit.client.0.smithi170.stdout:0/792: creat d8/d10/f110 x:0 0 0 2024-01-25T15:03:45.661 INFO:tasks.workunit.client.0.smithi170.stdout:0/793: stat d8/d10/d2d/d2f/d6a/d79/d7e/d10d/de7/d5f/d108/c10e 0 2024-01-25T15:03:45.662 INFO:tasks.workunit.client.0.smithi170.stdout:0/794: truncate d8/d18/f4d 3073883 0 2024-01-25T15:03:45.664 INFO:tasks.workunit.client.0.smithi170.stdout:5/700: write d5/f1b [6966184,64067] 0 2024-01-25T15:03:45.664 INFO:tasks.workunit.client.0.smithi170.stdout:3/801: dwrite d3/d1c/fef [0,4194304] 0 2024-01-25T15:03:45.666 INFO:tasks.workunit.client.0.smithi170.stdout:5/701: unlink d5/cc 0 2024-01-25T15:03:45.668 INFO:tasks.workunit.client.0.smithi170.stdout:3/802: mknod d3/c10a 0 2024-01-25T15:03:45.672 INFO:tasks.workunit.client.0.smithi170.stdout:4/677: dwrite d6/d7/d1b/f41 [0,4194304] 0 2024-01-25T15:03:45.678 INFO:tasks.workunit.client.0.smithi170.stdout:4/678: symlink d6/d7/d9f/ld1 0 2024-01-25T15:03:45.687 INFO:tasks.workunit.client.0.smithi170.stdout:0/795: dwrite d8/d80/fc1 [0,4194304] 0 2024-01-25T15:03:45.687 INFO:tasks.workunit.client.0.smithi170.stdout:0/796: fsync d8/d10/fee 0 2024-01-25T15:03:45.688 INFO:tasks.workunit.client.0.smithi170.stdout:0/797: write d8/d10/ffe [669019,15372] 0 2024-01-25T15:03:45.688 INFO:tasks.workunit.client.0.smithi170.stdout:0/798: stat d8/d10/f2e 0 2024-01-25T15:03:45.688 INFO:tasks.workunit.client.0.smithi170.stdout:0/799: mkdir d8/d10/d2d/d53/df4/dc6/dc9/dca/d111 0 2024-01-25T15:03:45.692 INFO:tasks.workunit.client.0.smithi170.stdout:4/679: dread d6/d7/d31/f3f [0,4194304] 0 2024-01-25T15:03:45.695 INFO:tasks.workunit.client.0.smithi170.stdout:6/799: sync 2024-01-25T15:03:45.695 INFO:tasks.workunit.client.0.smithi170.stdout:8/907: sync 2024-01-25T15:03:45.695 INFO:tasks.workunit.client.0.smithi170.stdout:8/908: dread - d3/d7/d3a/dce/f115 zero size 2024-01-25T15:03:45.695 INFO:tasks.workunit.client.0.smithi170.stdout:8/909: creat d3/d7/d22/d23/f138 x:0 0 0 2024-01-25T15:03:45.695 INFO:tasks.workunit.client.0.smithi170.stdout:4/680: rmdir d6/d7/d31/d7e 39 2024-01-25T15:03:45.696 INFO:tasks.workunit.client.0.smithi170.stdout:5/702: dwrite d5/d54/d85/d2c/d51/d41/f9b [0,4194304] 0 2024-01-25T15:03:45.699 INFO:tasks.workunit.client.0.smithi170.stdout:3/803: dwrite d3/d10/d1e/d21/d41/d4b/d63/dc7/fcc [0,4194304] 0 2024-01-25T15:03:45.699 INFO:tasks.workunit.client.0.smithi170.stdout:4/681: mkdir d6/d7/d31/dd2 0 2024-01-25T15:03:45.701 INFO:tasks.workunit.client.0.smithi170.stdout:4/682: dread d6/d28/d59/d7d/f83 [0,4194304] 0 2024-01-25T15:03:45.701 INFO:tasks.workunit.client.0.smithi170.stdout:4/683: creat d6/d28/d59/dc4/fd3 x:0 0 0 2024-01-25T15:03:45.708 INFO:tasks.workunit.client.0.smithi170.stdout:5/703: getdents d5/d54/d85/d2c/d45 0 2024-01-25T15:03:45.708 INFO:tasks.workunit.client.0.smithi170.stdout:5/704: readlink d5/d54/d85/d2c/d45/d56/l6f 0 2024-01-25T15:03:45.708 INFO:tasks.workunit.client.0.smithi170.stdout:5/705: readlink d5/d54/l9d 0 2024-01-25T15:03:45.708 INFO:tasks.workunit.client.0.smithi170.stdout:5/706: chown d5/f8e 2152131 1 2024-01-25T15:03:45.712 INFO:tasks.workunit.client.0.smithi170.stdout:0/800: dwrite d8/d10/d2d/d2f/d6a/d79/d7e/d10d/fe4 [0,4194304] 0 2024-01-25T15:03:45.715 INFO:tasks.workunit.client.0.smithi170.stdout:0/801: symlink d8/d18/l112 0 2024-01-25T15:03:45.715 INFO:tasks.workunit.client.0.smithi170.stdout:0/802: stat d8/d10/fee 0 2024-01-25T15:03:45.717 INFO:tasks.workunit.client.0.smithi170.stdout:0/803: creat d8/d10/d10f/f113 x:0 0 0 2024-01-25T15:03:45.717 INFO:tasks.workunit.client.0.smithi170.stdout:0/804: creat d8/d9/d9a/f114 x:0 0 0 2024-01-25T15:03:45.717 INFO:tasks.workunit.client.0.smithi170.stdout:0/805: write d8/d9/d9a/fa6 [221095,42666] 0 2024-01-25T15:03:45.720 INFO:tasks.workunit.client.0.smithi170.stdout:0/806: symlink d8/d10/d2d/d2f/d6a/d79/l115 0 2024-01-25T15:03:45.723 INFO:tasks.workunit.client.0.smithi170.stdout:8/910: dwrite d3/d7/d3a/f94 [0,4194304] 0 2024-01-25T15:03:45.723 INFO:tasks.workunit.client.0.smithi170.stdout:8/911: chown d3/d7/d1e/d7c/d9f/f101 3531297 1 2024-01-25T15:03:45.723 INFO:tasks.workunit.client.0.smithi170.stdout:6/800: dwrite d2/d7/d23/d19/d2a/d6b/dad/fc5 [0,4194304] 0 2024-01-25T15:03:45.729 INFO:tasks.workunit.client.0.smithi170.stdout:3/804: dwrite d3/f17 [0,4194304] 0 2024-01-25T15:03:45.730 INFO:tasks.workunit.client.0.smithi170.stdout:6/801: truncate d2/d7/d23/d19/d2a/d6b/dad/fc5 56481 0 2024-01-25T15:03:45.731 INFO:tasks.workunit.client.0.smithi170.stdout:4/684: rename d6/d28/d59/l5e to d6/d28/d61/ld4 0 2024-01-25T15:03:45.732 INFO:tasks.workunit.client.0.smithi170.stdout:4/685: truncate d6/d28/d59/dc4/fc5 891510 0 2024-01-25T15:03:45.732 INFO:tasks.workunit.client.0.smithi170.stdout:5/707: rename d5 to d5/d54/d85/d2c/d51/d96/dee 22 2024-01-25T15:03:45.732 INFO:tasks.workunit.client.0.smithi170.stdout:4/686: dread - d6/d7/fae zero size 2024-01-25T15:03:45.732 INFO:tasks.workunit.client.0.smithi170.stdout:4/687: fsync d6/d7/d31/d46/d78/f95 0 2024-01-25T15:03:45.733 INFO:tasks.workunit.client.0.smithi170.stdout:1/711: sync 2024-01-25T15:03:45.733 INFO:tasks.workunit.client.0.smithi170.stdout:9/763: sync 2024-01-25T15:03:45.736 INFO:tasks.workunit.client.0.smithi170.stdout:0/807: rename d8/d10/d2d/d2f/d6a/d79/d7e/d10d/de7/d5f/d108/c10e to d8/d10/d2d/d2f/d6a/d79/dea/c116 0 2024-01-25T15:03:45.737 INFO:tasks.workunit.client.0.smithi170.stdout:0/808: chown d8/d10/d2d/d53/df4/dc6/dc9/df9 54919337 1 2024-01-25T15:03:45.739 INFO:tasks.workunit.client.0.smithi170.stdout:0/809: rmdir d8/d10/d2d/d2f/d96/db7 39 2024-01-25T15:03:45.742 INFO:tasks.workunit.client.0.smithi170.stdout:9/764: dread d5/df/f20 [0,4194304] 0 2024-01-25T15:03:45.745 INFO:tasks.workunit.client.0.smithi170.stdout:9/765: dread d5/dc/f30 [0,4194304] 0 2024-01-25T15:03:45.746 INFO:tasks.workunit.client.0.smithi170.stdout:9/766: rmdir d5/df/d16/d35/d3c/d91/d101 0 2024-01-25T15:03:45.747 INFO:tasks.workunit.client.0.smithi170.stdout:5/708: write d5/d2a/f4a [5016072,63334] 0 2024-01-25T15:03:45.749 INFO:tasks.workunit.client.0.smithi170.stdout:9/767: dread d5/df/d2e/d77/d21/d46/d18/d6a/f74 [0,4194304] 0 2024-01-25T15:03:45.751 INFO:tasks.workunit.client.0.smithi170.stdout:9/768: creat d5/df/d2e/d77/d21/d34/d3e/f102 x:0 0 0 2024-01-25T15:03:45.752 INFO:tasks.workunit.client.0.smithi170.stdout:9/769: fsync d5/df/d16/d35/d3c/f45 0 2024-01-25T15:03:45.752 INFO:tasks.workunit.client.0.smithi170.stdout:3/805: dwrite d3/d10/ff [4194304,4194304] 0 2024-01-25T15:03:45.766 INFO:tasks.workunit.client.0.smithi170.stdout:6/802: rename d2/d7/d23/d19/d2a/d43/f51 to d2/d7/d23/d19/d2f/d74/dc1/f10f 0 2024-01-25T15:03:45.767 INFO:tasks.workunit.client.0.smithi170.stdout:0/810: dwrite d8/d10/d2d/d2f/d6a/d79/d7e/d10d/de7/d5f/fb2 [0,4194304] 0 2024-01-25T15:03:45.767 INFO:tasks.workunit.client.0.smithi170.stdout:0/811: write d8/d10/d2d/d53/f67 [2187948,75176] 0 2024-01-25T15:03:45.767 INFO:tasks.workunit.client.0.smithi170.stdout:0/812: creat d8/d10/d2d/d2f/d6a/d79/d7e/f117 x:0 0 0 2024-01-25T15:03:45.768 INFO:tasks.workunit.client.0.smithi170.stdout:1/712: rename d0/d50/d8e/d9e/fb7 to d0/fed 0 2024-01-25T15:03:45.768 INFO:tasks.workunit.client.0.smithi170.stdout:1/713: read d0/fd [1010752,25842] 0 2024-01-25T15:03:45.770 INFO:tasks.workunit.client.0.smithi170.stdout:6/803: mknod d2/d7/d1b/d28/da7/dd2/d109/c110 0 2024-01-25T15:03:45.770 INFO:tasks.workunit.client.0.smithi170.stdout:6/804: fsync d2/d7/f18 0 2024-01-25T15:03:45.770 INFO:tasks.workunit.client.0.smithi170.stdout:5/709: dwrite d5/d54/d85/d2c/d51/fb5 [0,4194304] 0 2024-01-25T15:03:45.772 INFO:tasks.workunit.client.0.smithi170.stdout:5/710: symlink d5/d58/da9/lef 0 2024-01-25T15:03:45.772 INFO:tasks.workunit.client.0.smithi170.stdout:5/711: truncate d5/d2a/fb0 1284489 0 2024-01-25T15:03:45.773 INFO:tasks.workunit.client.0.smithi170.stdout:0/813: symlink d8/d10/d2d/l118 0 2024-01-25T15:03:45.773 INFO:tasks.workunit.client.0.smithi170.stdout:0/814: dread - d8/d10/d2d/d2f/fbc zero size 2024-01-25T15:03:45.775 INFO:tasks.workunit.client.0.smithi170.stdout:0/815: fdatasync d8/d10/fee 0 2024-01-25T15:03:45.775 INFO:tasks.workunit.client.0.smithi170.stdout:6/805: mkdir d2/d7/d23/d19/d2f/d5d/d94/d97/db4/dc7/d111 0 2024-01-25T15:03:45.783 INFO:tasks.workunit.client.0.smithi170.stdout:5/712: truncate d5/d54/d85/f21 30976 0 2024-01-25T15:03:45.783 INFO:tasks.workunit.client.0.smithi170.stdout:5/713: fsync d5/d54/fb7 0 2024-01-25T15:03:45.784 INFO:tasks.workunit.client.0.smithi170.stdout:5/714: chown d5/d54/d85/d2c/d45/d56/f5b 6662 1 2024-01-25T15:03:45.784 INFO:tasks.workunit.client.0.smithi170.stdout:1/714: dread d0/d91/fce [0,4194304] 0 2024-01-25T15:03:45.802 INFO:tasks.workunit.client.0.smithi170.stdout:7/760: sync 2024-01-25T15:03:45.802 INFO:tasks.workunit.client.0.smithi170.stdout:2/725: sync 2024-01-25T15:03:45.802 INFO:tasks.workunit.client.0.smithi170.stdout:9/770: rename d5/df/d2e/d77/d21/d34/fc4 to d5/df/d2e/d77/d21/d46/d6c/dd8/d96/f103 0 2024-01-25T15:03:45.803 INFO:tasks.workunit.client.0.smithi170.stdout:9/771: read d5/df/d2e/d77/f2a [644825,3826] 0 2024-01-25T15:03:45.805 INFO:tasks.workunit.client.0.smithi170.stdout:3/806: rename d3/d10/de2 to d3/d10/d52/d10b 0 2024-01-25T15:03:45.806 INFO:tasks.workunit.client.0.smithi170.stdout:1/715: dwrite d0/d20/d28/d2a/d4a/d56/dc1/fd0 [0,4194304] 0 2024-01-25T15:03:45.808 INFO:tasks.workunit.client.0.smithi170.stdout:3/807: unlink d3/d1c/d2d/lf1 0 2024-01-25T15:03:45.810 INFO:tasks.workunit.client.0.smithi170.stdout:1/716: mkdir d0/d20/d28/dee 0 2024-01-25T15:03:45.810 INFO:tasks.workunit.client.0.smithi170.stdout:1/717: truncate d0/d20/d28/d2a/d4a/d56/dc1/de3/fec 797704 0 2024-01-25T15:03:45.810 INFO:tasks.workunit.client.0.smithi170.stdout:1/718: write d0/d20/fd5 [762647,13865] 0 2024-01-25T15:03:45.810 INFO:tasks.workunit.client.0.smithi170.stdout:1/719: read d0/f99 [3355540,102994] 0 2024-01-25T15:03:45.810 INFO:tasks.workunit.client.0.smithi170.stdout:1/720: write d0/d50/d8e/d9e/fd4 [4198625,77297] 0 2024-01-25T15:03:45.811 INFO:tasks.workunit.client.0.smithi170.stdout:1/721: mkdir d0/d20/d28/d2a/d4a/def 0 2024-01-25T15:03:45.819 INFO:tasks.workunit.client.0.smithi170.stdout:3/808: dread d3/fe9 [0,4194304] 0 2024-01-25T15:03:45.819 INFO:tasks.workunit.client.0.smithi170.stdout:3/809: fsync d3/d3b/f70 0 2024-01-25T15:03:45.819 INFO:tasks.workunit.client.0.smithi170.stdout:6/806: dwrite d2/d7/d23/f2d [0,4194304] 0 2024-01-25T15:03:45.821 INFO:tasks.workunit.client.0.smithi170.stdout:3/810: unlink d3/d10/d1e/d21/d41/d4a/fb9 0 2024-01-25T15:03:45.824 INFO:tasks.workunit.client.0.smithi170.stdout:6/807: truncate d2/f17 934797 0 2024-01-25T15:03:45.825 INFO:tasks.workunit.client.0.smithi170.stdout:6/808: creat d2/d7/d23/d19/d2f/d74/dce/ddf/de2/f112 x:0 0 0 2024-01-25T15:03:45.832 INFO:tasks.workunit.client.0.smithi170.stdout:3/811: dread d3/f68 [0,4194304] 0 2024-01-25T15:03:45.838 INFO:tasks.workunit.client.0.smithi170.stdout:1/722: dwrite d0/d20/f4d [0,4194304] 0 2024-01-25T15:03:45.838 INFO:tasks.workunit.client.0.smithi170.stdout:1/723: write d0/d20/d3a/f9b [148992,93804] 0 2024-01-25T15:03:45.838 INFO:tasks.workunit.client.0.smithi170.stdout:9/772: dwrite d5/df/d16/d35/d3c/d56/d59/fb7 [0,4194304] 0 2024-01-25T15:03:45.838 INFO:tasks.workunit.client.0.smithi170.stdout:7/761: dwrite d8/d20/d2a/fa2 [0,4194304] 0 2024-01-25T15:03:45.838 INFO:tasks.workunit.client.0.smithi170.stdout:9/773: write d5/dc/fd [2424684,64580] 0 2024-01-25T15:03:45.838 INFO:tasks.workunit.client.0.smithi170.stdout:9/774: truncate d5/dc/fd 5387992 0 2024-01-25T15:03:45.838 INFO:tasks.workunit.client.0.smithi170.stdout:7/762: write d8/d20/d3b/f99 [1664133,32225] 0 2024-01-25T15:03:45.838 INFO:tasks.workunit.client.0.smithi170.stdout:0/816: rename d8/d10/d2d/d58/lce to d8/d10/d2d/d53/df4/dc6/dc9/dca/d111/l119 0 2024-01-25T15:03:45.838 INFO:tasks.workunit.client.0.smithi170.stdout:0/817: chown d8/d10/d2d/d53/df4/dc6/dc9 455 1 2024-01-25T15:03:45.839 INFO:tasks.workunit.client.0.smithi170.stdout:0/818: mkdir d8/d10/d2d/d53/df4/dc6/dc9/dca/d11a 0 2024-01-25T15:03:45.841 INFO:tasks.workunit.client.0.smithi170.stdout:9/775: unlink d5/df/d2e/d77/l33 0 2024-01-25T15:03:45.841 INFO:tasks.workunit.client.0.smithi170.stdout:9/776: chown d5/df/f1a 3470829 1 2024-01-25T15:03:45.841 INFO:tasks.workunit.client.0.smithi170.stdout:9/777: write d5/df/d2e/d77/f82 [857471,43950] 0 2024-01-25T15:03:45.842 INFO:tasks.workunit.client.0.smithi170.stdout:7/763: unlink d8/d20/d2a/d35/f41 0 2024-01-25T15:03:45.847 INFO:tasks.workunit.client.0.smithi170.stdout:0/819: symlink d8/d9/d9a/dbd/l11b 0 2024-01-25T15:03:45.848 INFO:tasks.workunit.client.0.smithi170.stdout:9/778: unlink d5/df/d2e/d77/d21/d46/d6c/dac/ff9 0 2024-01-25T15:03:45.855 INFO:tasks.workunit.client.0.smithi170.stdout:1/724: dwrite d0/d2e/f3b [0,4194304] 0 2024-01-25T15:03:45.855 INFO:tasks.workunit.client.0.smithi170.stdout:1/725: chown d0/d20/d3a/d60/fe5 41 1 2024-01-25T15:03:45.855 INFO:tasks.workunit.client.0.smithi170.stdout:0/820: truncate d8/d10/f1b 425950 0 2024-01-25T15:03:45.856 INFO:tasks.workunit.client.0.smithi170.stdout:0/821: truncate d8/d10/ffe 409285 0 2024-01-25T15:03:45.856 INFO:tasks.workunit.client.0.smithi170.stdout:0/822: dread - d8/d9/d9a/f114 zero size 2024-01-25T15:03:45.865 INFO:tasks.workunit.client.0.smithi170.stdout:6/809: rename d2/d7/d23/d19/d2f to d2/d7/d23/d19/d2a/d43/d98/d113 0 2024-01-25T15:03:45.865 INFO:tasks.workunit.client.0.smithi170.stdout:6/810: write d2/ddb/f104 [595888,105107] 0 2024-01-25T15:03:45.865 INFO:tasks.workunit.client.0.smithi170.stdout:6/811: write d2/d7/d1b/d28/da7/fde [895538,56472] 0 2024-01-25T15:03:45.868 INFO:tasks.workunit.client.0.smithi170.stdout:8/912: sync 2024-01-25T15:03:45.874 INFO:tasks.workunit.client.0.smithi170.stdout:1/726: dwrite d0/d50/da0/dab/faf [0,4194304] 0 2024-01-25T15:03:45.875 INFO:tasks.workunit.client.0.smithi170.stdout:1/727: chown d0/f5 2052451 1 2024-01-25T15:03:45.876 INFO:tasks.workunit.client.0.smithi170.stdout:8/913: dread d3/d7/d1e/f6c [0,4194304] 0 2024-01-25T15:03:45.876 INFO:tasks.workunit.client.0.smithi170.stdout:1/728: symlink d0/d50/lf0 0 2024-01-25T15:03:45.878 INFO:tasks.workunit.client.0.smithi170.stdout:1/729: creat d0/d20/d28/d2a/d4a/d56/d5b/ff1 x:0 0 0 2024-01-25T15:03:45.880 INFO:tasks.workunit.client.0.smithi170.stdout:1/730: truncate d0/d20/d28/d2a/d4a/d56/f64 2146928 0 2024-01-25T15:03:45.882 INFO:tasks.workunit.client.0.smithi170.stdout:7/764: rename d8/d20/d2a/d35/d55/d6e/d81 to d8/d20/d45/d107 0 2024-01-25T15:03:45.882 INFO:tasks.workunit.client.0.smithi170.stdout:9/779: rename d5/df/d49 to d5/df/d49/df1/d104 22 2024-01-25T15:03:45.882 INFO:tasks.workunit.client.0.smithi170.stdout:7/765: read - d8/d20/d2a/d35/d55/d7d/da6/dd1/fe9 zero size 2024-01-25T15:03:45.884 INFO:tasks.workunit.client.0.smithi170.stdout:9/780: creat d5/df/d2e/d77/d21/d46/d6c/dd8/d96/f105 x:0 0 0 2024-01-25T15:03:45.885 INFO:tasks.workunit.client.0.smithi170.stdout:9/781: dread d5/df/d2e/d77/d21/daa/fcc [0,4194304] 0 2024-01-25T15:03:45.885 INFO:tasks.workunit.client.0.smithi170.stdout:9/782: chown d5/df/d2e/d77/d21/d34/d3e/d7f/fb3 0 1 2024-01-25T15:03:45.886 INFO:tasks.workunit.client.0.smithi170.stdout:7/766: symlink d8/d20/d45/d68/d71/dc8/l108 0 2024-01-25T15:03:45.888 INFO:tasks.workunit.client.0.smithi170.stdout:0/823: rename d8/d10/d2d/d2f/d6a to d8/d11c 0 2024-01-25T15:03:45.888 INFO:tasks.workunit.client.0.smithi170.stdout:0/824: chown d8/d10/d2d/d58 973281 1 2024-01-25T15:03:45.888 INFO:tasks.workunit.client.0.smithi170.stdout:0/825: dread - d8/d10/d2d/d2f/fbc zero size 2024-01-25T15:03:45.888 INFO:tasks.workunit.client.0.smithi170.stdout:0/826: chown d8/d10/d2d/d58 0 1 2024-01-25T15:03:45.889 INFO:tasks.workunit.client.0.smithi170.stdout:7/767: dread - d8/f42 zero size 2024-01-25T15:03:45.890 INFO:tasks.workunit.client.0.smithi170.stdout:0/827: rename d8/c30 to d8/d11c/d79/d7e/d10d/de7/d59/c11d 0 2024-01-25T15:03:45.892 INFO:tasks.workunit.client.0.smithi170.stdout:7/768: rename d8/d20/d2a/d35/c38 to d8/d20/d45/c109 0 2024-01-25T15:03:45.894 INFO:tasks.workunit.client.0.smithi170.stdout:7/769: link d8/d20/d2a/d35/d55/d7d/da6/fc3 d8/d20/d2a/d35/d55/d9b/f10a 0 2024-01-25T15:03:45.894 INFO:tasks.workunit.client.0.smithi170.stdout:7/770: write d8/d20/d2a/f87 [638834,6309] 0 2024-01-25T15:03:45.894 INFO:tasks.workunit.client.0.smithi170.stdout:7/771: write d8/d20/d2a/d35/d55/d7d/fc5 [388052,14609] 0 2024-01-25T15:03:45.896 INFO:tasks.workunit.client.0.smithi170.stdout:7/772: creat d8/d20/d45/d8e/df5/f10b x:0 0 0 2024-01-25T15:03:45.896 INFO:tasks.workunit.client.0.smithi170.stdout:8/914: dwrite d3/d7/f12 [0,4194304] 0 2024-01-25T15:03:45.896 INFO:tasks.workunit.client.0.smithi170.stdout:8/915: readlink d3/d7/d22/d23/d48/d52/d47/d86/l100 0 2024-01-25T15:03:45.897 INFO:tasks.workunit.client.0.smithi170.stdout:7/773: mkdir d8/d20/d45/d10c 0 2024-01-25T15:03:45.897 INFO:tasks.workunit.client.0.smithi170.stdout:7/774: stat f2 0 2024-01-25T15:03:45.897 INFO:tasks.workunit.client.0.smithi170.stdout:7/775: creat d8/d20/d2a/d35/d55/d7d/da6/dd1/f10d x:0 0 0 2024-01-25T15:03:45.899 INFO:tasks.workunit.client.0.smithi170.stdout:8/916: mkdir d3/d7/d22/d23/d25/d41/d61/d139 0 2024-01-25T15:03:45.899 INFO:tasks.workunit.client.0.smithi170.stdout:8/917: write d3/d7/d1e/d7c/d9f/fc2 [72957,57199] 0 2024-01-25T15:03:45.899 INFO:tasks.workunit.client.0.smithi170.stdout:8/918: write d3/d7/d22/d23/d48/d52/d47/f4c [822661,113442] 0 2024-01-25T15:03:45.899 INFO:tasks.workunit.client.0.smithi170.stdout:8/919: write d3/d7/f67 [3881444,120960] 0 2024-01-25T15:03:45.900 INFO:tasks.workunit.client.0.smithi170.stdout:7/776: symlink d8/d20/d45/d8e/df5/l10e 0 2024-01-25T15:03:45.902 INFO:tasks.workunit.client.0.smithi170.stdout:0/828: write d8/d10/f1b [704085,119463] 0 2024-01-25T15:03:45.902 INFO:tasks.workunit.client.0.smithi170.stdout:0/829: stat d8/d10/d2d/d2f 0 2024-01-25T15:03:45.904 INFO:tasks.workunit.client.0.smithi170.stdout:8/920: rename d3/d7/d22/d80/fe1 to d3/d7/d3a/d8d/f13a 0 2024-01-25T15:03:45.904 INFO:tasks.workunit.client.0.smithi170.stdout:8/921: creat d3/d7/d3a/dce/f13b x:0 0 0 2024-01-25T15:03:45.905 INFO:tasks.workunit.client.0.smithi170.stdout:0/830: dread d8/d10/d2d/d53/df4/f8d [0,4194304] 0 2024-01-25T15:03:45.905 INFO:tasks.workunit.client.0.smithi170.stdout:0/831: chown d8/d11c/d79/d7e/f117 7648 1 2024-01-25T15:03:45.906 INFO:tasks.workunit.client.0.smithi170.stdout:0/832: mknod d8/d9/d9a/c11e 0 2024-01-25T15:03:45.907 INFO:tasks.workunit.client.0.smithi170.stdout:0/833: getdents d8/d10/d2d/d2f 0 2024-01-25T15:03:45.908 INFO:tasks.workunit.client.0.smithi170.stdout:9/783: link d5/df/d2e/d77/d21/daa/fcc d5/df/f106 0 2024-01-25T15:03:45.908 INFO:tasks.workunit.client.0.smithi170.stdout:9/784: readlink d5/dc/d42/l4f 0 2024-01-25T15:03:45.908 INFO:tasks.workunit.client.0.smithi170.stdout:0/834: creat d8/d10/d2d/d53/df4/f11f x:0 0 0 2024-01-25T15:03:45.914 INFO:tasks.workunit.client.0.smithi170.stdout:8/922: dread d3/d7/d22/d5d/f6e [0,4194304] 0 2024-01-25T15:03:45.914 INFO:tasks.workunit.client.0.smithi170.stdout:8/923: creat d3/d7/d22/d23/d48/d52/d47/de2/f13c x:0 0 0 2024-01-25T15:03:45.915 INFO:tasks.workunit.client.0.smithi170.stdout:9/785: creat d5/df/d16/d35/d3c/d91/dd6/f107 x:0 0 0 2024-01-25T15:03:45.915 INFO:tasks.workunit.client.0.smithi170.stdout:9/786: creat d5/df/d2e/d77/d21/d46/d18/dc0/f108 x:0 0 0 2024-01-25T15:03:45.923 INFO:tasks.workunit.client.0.smithi170.stdout:9/787: read d5/df/d16/d35/f75 [3257285,101129] 0 2024-01-25T15:03:45.930 INFO:tasks.workunit.client.0.smithi170.stdout:7/777: link d8/d20/d2a/d35/d55/d9b/f10a d8/d20/d2a/d35/f10f 0 2024-01-25T15:03:45.930 INFO:tasks.workunit.client.0.smithi170.stdout:9/788: read d5/df/d2e/f70 [502828,105645] 0 2024-01-25T15:03:45.932 INFO:tasks.workunit.client.0.smithi170.stdout:7/778: mkdir d8/d110 0 2024-01-25T15:03:45.932 INFO:tasks.workunit.client.0.smithi170.stdout:7/779: write d8/d20/d45/d68/d71/fbd [196432,41] 0 2024-01-25T15:03:45.932 INFO:tasks.workunit.client.0.smithi170.stdout:7/780: write d8/d20/d3b/d4d/f97 [416928,145] 0 2024-01-25T15:03:45.932 INFO:tasks.workunit.client.0.smithi170.stdout:8/924: write d3/d7/d1e/f71 [3668562,87329] 0 2024-01-25T15:03:45.932 INFO:tasks.workunit.client.0.smithi170.stdout:7/781: creat d8/d110/f111 x:0 0 0 2024-01-25T15:03:45.934 INFO:tasks.workunit.client.0.smithi170.stdout:8/925: link d3/d7/d3a/d91/lf6 d3/d7/d22/d23/d25/d41/l13d 0 2024-01-25T15:03:45.936 INFO:tasks.workunit.client.0.smithi170.stdout:8/926: write d3/d7/d1e/fc3 [4330868,62571] 0 2024-01-25T15:03:45.936 INFO:tasks.workunit.client.0.smithi170.stdout:8/927: creat d3/d7/d22/d80/f13e x:0 0 0 2024-01-25T15:03:45.938 INFO:tasks.workunit.client.0.smithi170.stdout:0/835: dwrite d8/fa [4194304,4194304] 0 2024-01-25T15:03:45.938 INFO:tasks.workunit.client.0.smithi170.stdout:0/836: write d8/d10/d2d/d53/f63 [3333466,62580] 0 2024-01-25T15:03:45.939 INFO:tasks.workunit.client.0.smithi170.stdout:0/837: chown d8/d11c/d79/d7e/d10d/de7/cdd 32444 1 2024-01-25T15:03:45.939 INFO:tasks.workunit.client.0.smithi170.stdout:0/838: truncate d8/d10/f1b 1380776 0 2024-01-25T15:03:45.939 INFO:tasks.workunit.client.0.smithi170.stdout:7/782: write d8/d20/d2a/d35/d55/d9b/f10a [355005,5146] 0 2024-01-25T15:03:45.939 INFO:tasks.workunit.client.0.smithi170.stdout:8/928: link d3/d7/d22/d23/d25/d8e/cf3 d3/d7/c13f 0 2024-01-25T15:03:45.941 INFO:tasks.workunit.client.0.smithi170.stdout:0/839: mknod d8/d80/c120 0 2024-01-25T15:03:45.942 INFO:tasks.workunit.client.0.smithi170.stdout:4/688: sync 2024-01-25T15:03:45.942 INFO:tasks.workunit.client.0.smithi170.stdout:8/929: mknod d3/d7/d22/d23/d25/d41/d9a/c140 0 2024-01-25T15:03:45.942 INFO:tasks.workunit.client.0.smithi170.stdout:8/930: write d3/d7/d3a/d8d/db3/fef [1371887,85668] 0 2024-01-25T15:03:45.947 INFO:tasks.workunit.client.0.smithi170.stdout:0/840: rename d8/d10/d2d/ccc to d8/d11c/d79/d7e/d10d/de7/d59/c121 0 2024-01-25T15:03:45.947 INFO:tasks.workunit.client.0.smithi170.stdout:8/931: mknod d3/d7/d22/d23/d48/c141 0 2024-01-25T15:03:45.947 INFO:tasks.workunit.client.0.smithi170.stdout:8/932: stat d3/d7/d3a/d91/l133 0 2024-01-25T15:03:45.948 INFO:tasks.workunit.client.0.smithi170.stdout:8/933: symlink d3/d7/d1e/d7c/l142 0 2024-01-25T15:03:45.952 INFO:tasks.workunit.client.0.smithi170.stdout:9/789: dwrite d5/df/d16/d35/d3c/fbf [0,4194304] 0 2024-01-25T15:03:45.955 INFO:tasks.workunit.client.0.smithi170.stdout:9/790: stat d5/df/d2e/d77/d21/d46/d18/l3f 0 2024-01-25T15:03:45.955 INFO:tasks.workunit.client.0.smithi170.stdout:9/791: chown d5/df/d2e/d77/d21/d46/d6c/c92 82760 1 2024-01-25T15:03:45.969 INFO:tasks.workunit.client.0.smithi170.stdout:4/689: dwrite d6/fa0 [0,4194304] 0 2024-01-25T15:03:45.971 INFO:tasks.workunit.client.0.smithi170.stdout:7/783: link d8/d20/d45/d68/daa/fcb d8/d20/d2a/d35/d55/d7d/f112 0 2024-01-25T15:03:45.971 INFO:tasks.workunit.client.0.smithi170.stdout:7/784: readlink d8/d20/l86 0 2024-01-25T15:03:45.973 INFO:tasks.workunit.client.0.smithi170.stdout:0/841: dwrite d8/d80/fc1 [4194304,4194304] 0 2024-01-25T15:03:45.974 INFO:tasks.workunit.client.0.smithi170.stdout:7/785: getdents d8/d20/d45/d68/d71/d8c 0 2024-01-25T15:03:45.977 INFO:tasks.workunit.client.0.smithi170.stdout:9/792: dwrite d5/df/d2e/d77/d21/d34/d3e/d7f/fb9 [0,4194304] 0 2024-01-25T15:03:45.979 INFO:tasks.workunit.client.0.smithi170.stdout:4/690: rmdir d6/d7/d31/d7e/d9c 39 2024-01-25T15:03:45.982 INFO:tasks.workunit.client.0.smithi170.stdout:9/793: creat d5/df/d16/f109 x:0 0 0 2024-01-25T15:03:45.982 INFO:tasks.workunit.client.0.smithi170.stdout:4/691: mknod d6/d7/cd5 0 2024-01-25T15:03:45.983 INFO:tasks.workunit.client.0.smithi170.stdout:7/786: creat d8/ddb/f113 x:0 0 0 2024-01-25T15:03:45.984 INFO:tasks.workunit.client.0.smithi170.stdout:9/794: mknod d5/df/d2e/d77/d21/d46/d6c/c10a 0 2024-01-25T15:03:45.985 INFO:tasks.workunit.client.0.smithi170.stdout:7/787: mknod d8/d20/d2a/d35/d55/dcf/c114 0 2024-01-25T15:03:45.985 INFO:tasks.workunit.client.0.smithi170.stdout:7/788: creat d8/d20/d45/d8e/df5/f115 x:0 0 0 2024-01-25T15:03:45.985 INFO:tasks.workunit.client.0.smithi170.stdout:7/789: creat d8/d20/d45/d68/d71/f116 x:0 0 0 2024-01-25T15:03:45.985 INFO:tasks.workunit.client.0.smithi170.stdout:7/790: chown d8/d20/d45/ca9 239672 1 2024-01-25T15:03:45.985 INFO:tasks.workunit.client.0.smithi170.stdout:7/791: creat d8/d20/d73/f117 x:0 0 0 2024-01-25T15:03:45.986 INFO:tasks.workunit.client.0.smithi170.stdout:9/795: link d5/df/d16/d35/d3c/d56/d59/d5e/lf3 d5/df/d16/d35/d3c/d91/dd6/l10b 0 2024-01-25T15:03:45.986 INFO:tasks.workunit.client.0.smithi170.stdout:9/796: truncate d5/df/d2e/d77/d21/d34/f47 461474 0 2024-01-25T15:03:45.986 INFO:tasks.workunit.client.0.smithi170.stdout:9/797: fsync d5/df/d2e/d77/faf 0 2024-01-25T15:03:45.987 INFO:tasks.workunit.client.0.smithi170.stdout:9/798: creat d5/df/d2e/d77/d21/d46/d6c/dd8/d96/f10c x:0 0 0 2024-01-25T15:03:45.989 INFO:tasks.workunit.client.0.smithi170.stdout:9/799: getdents d5/dc/dce 0 2024-01-25T15:03:45.990 INFO:tasks.workunit.client.0.smithi170.stdout:9/800: mkdir d5/df/d49/df1/d10d 0 2024-01-25T15:03:45.991 INFO:tasks.workunit.client.0.smithi170.stdout:9/801: readlink d5/df/d2e/d77/d21/d46/d6c/lec 0 2024-01-25T15:03:45.991 INFO:tasks.workunit.client.0.smithi170.stdout:9/802: truncate d5/df/d16/d35/d3c/fbf 3692927 0 2024-01-25T15:03:45.992 INFO:tasks.workunit.client.0.smithi170.stdout:0/842: dwrite d8/d10/f1b [0,4194304] 0 2024-01-25T15:03:45.993 INFO:tasks.workunit.client.0.smithi170.stdout:0/843: mknod d8/d10/d2d/d82/c122 0 2024-01-25T15:03:45.994 INFO:tasks.workunit.client.0.smithi170.stdout:0/844: stat d8/d9/f16 0 2024-01-25T15:03:45.995 INFO:tasks.workunit.client.0.smithi170.stdout:0/845: unlink d8/d9/d9a/dbd/lf5 0 2024-01-25T15:03:45.996 INFO:tasks.workunit.client.0.smithi170.stdout:0/846: creat d8/d10/d2d/d53/df4/f123 x:0 0 0 2024-01-25T15:03:45.997 INFO:tasks.workunit.client.0.smithi170.stdout:0/847: mknod d8/d10/d2d/d58/c124 0 2024-01-25T15:03:45.998 INFO:tasks.workunit.client.0.smithi170.stdout:6/812: sync 2024-01-25T15:03:45.998 INFO:tasks.workunit.client.0.smithi170.stdout:3/812: sync 2024-01-25T15:03:45.998 INFO:tasks.workunit.client.0.smithi170.stdout:5/715: sync 2024-01-25T15:03:45.998 INFO:tasks.workunit.client.0.smithi170.stdout:2/726: sync 2024-01-25T15:03:45.998 INFO:tasks.workunit.client.0.smithi170.stdout:2/727: fsync d10/d1b/f36 0 2024-01-25T15:03:45.998 INFO:tasks.workunit.client.0.smithi170.stdout:6/813: truncate d2/d7/d23/d19/d2a/d6b/dad/fc5 787916 0 2024-01-25T15:03:45.998 INFO:tasks.workunit.client.0.smithi170.stdout:2/728: chown d10/d1e/d32/d3e/d5c/d102/lf9 1562335341 1 2024-01-25T15:03:46.001 INFO:tasks.workunit.client.0.smithi170.stdout:6/814: symlink d2/d7/d1b/d28/l114 0 2024-01-25T15:03:46.008 INFO:tasks.workunit.client.0.smithi170.stdout:0/848: dread d8/d10/d2d/d2f/f7c [0,4194304] 0 2024-01-25T15:03:46.008 INFO:tasks.workunit.client.0.smithi170.stdout:0/849: creat d8/d9/d9a/f125 x:0 0 0 2024-01-25T15:03:46.009 INFO:tasks.workunit.client.0.smithi170.stdout:0/850: mknod d8/d9/c126 0 2024-01-25T15:03:46.010 INFO:tasks.workunit.client.0.smithi170.stdout:0/851: truncate d8/d80/fc1 138598 0 2024-01-25T15:03:46.011 INFO:tasks.workunit.client.0.smithi170.stdout:4/692: rename d6/d28/d61/c8e to d6/d28/d59/da8/cd6 0 2024-01-25T15:03:46.013 INFO:tasks.workunit.client.0.smithi170.stdout:6/815: read d2/d7/d23/d19/d2a/d43/d98/d113/d74/dbd/fe5 [4088068,67723] 0 2024-01-25T15:03:46.014 INFO:tasks.workunit.client.0.smithi170.stdout:4/693: dread d6/f75 [0,4194304] 0 2024-01-25T15:03:46.014 INFO:tasks.workunit.client.0.smithi170.stdout:1/731: sync 2024-01-25T15:03:46.014 INFO:tasks.workunit.client.0.smithi170.stdout:1/732: write d0/d20/d3a/f53 [8435875,47245] 0 2024-01-25T15:03:46.014 INFO:tasks.workunit.client.0.smithi170.stdout:1/733: fsync d0/d20/d28/d2a/f5e 0 2024-01-25T15:03:46.015 INFO:tasks.workunit.client.0.smithi170.stdout:4/694: mknod d6/d7/d31/dd2/cd7 0 2024-01-25T15:03:46.020 INFO:tasks.workunit.client.0.smithi170.stdout:4/695: unlink d6/c3e 0 2024-01-25T15:03:46.029 INFO:tasks.workunit.client.0.smithi170.stdout:2/729: dwrite d10/d1e/f20 [0,4194304] 0 2024-01-25T15:03:46.036 INFO:tasks.workunit.client.0.smithi170.stdout:4/696: write d6/d7/d31/f7b [568439,112806] 0 2024-01-25T15:03:46.039 INFO:tasks.workunit.client.0.smithi170.stdout:1/734: dwrite d0/d20/d28/d2a/d4a/d56/d5b/f68 [0,4194304] 0 2024-01-25T15:03:46.042 INFO:tasks.workunit.client.0.smithi170.stdout:7/792: rename d8/d20/d2a/d35/d55/f67 to d8/d20/d45/d68/f118 0 2024-01-25T15:03:46.044 INFO:tasks.workunit.client.0.smithi170.stdout:3/813: rename d3/d10/d1e/d21/d41/d4a/dc3/dfc/fca to d3/d10/d13/d1b/f10c 0 2024-01-25T15:03:46.044 INFO:tasks.workunit.client.0.smithi170.stdout:3/814: write d3/d3b/dc6/fa1 [764663,30091] 0 2024-01-25T15:03:46.044 INFO:tasks.workunit.client.0.smithi170.stdout:7/793: mkdir d8/d20/d45/d10c/d119 0 2024-01-25T15:03:46.050 INFO:tasks.workunit.client.0.smithi170.stdout:2/730: dwrite d10/d1e/d5e/d73/d9e/da3/fb8 [0,4194304] 0 2024-01-25T15:03:46.052 INFO:tasks.workunit.client.0.smithi170.stdout:2/731: readlink d10/d1e/d5e/d73/d9e/da3/lc2 0 2024-01-25T15:03:46.054 INFO:tasks.workunit.client.0.smithi170.stdout:2/732: creat d10/f104 x:0 0 0 2024-01-25T15:03:46.057 INFO:tasks.workunit.client.0.smithi170.stdout:7/794: dread d8/d20/d45/f46 [0,4194304] 0 2024-01-25T15:03:46.062 INFO:tasks.workunit.client.0.smithi170.stdout:0/852: rename d8/d11c/d79/dea/cff to d8/d10/d2d/d53/df4/dc6/dc9/dca/c127 0 2024-01-25T15:03:46.062 INFO:tasks.workunit.client.0.smithi170.stdout:0/853: write d8/d10/f4b [1766107,42327] 0 2024-01-25T15:03:46.063 INFO:tasks.workunit.client.0.smithi170.stdout:3/815: dwrite d3/d10/d52/f64 [8388608,4194304] 0 2024-01-25T15:03:46.064 INFO:tasks.workunit.client.0.smithi170.stdout:3/816: fsync d3/d10/d52/f5d 0 2024-01-25T15:03:46.064 INFO:tasks.workunit.client.0.smithi170.stdout:0/854: mknod d8/d10/d2d/c128 0 2024-01-25T15:03:46.066 INFO:tasks.workunit.client.0.smithi170.stdout:3/817: unlink d3/d10/d1e/l39 0 2024-01-25T15:03:46.067 INFO:tasks.workunit.client.0.smithi170.stdout:0/855: link d8/d10/f15 d8/d10/d2d/d82/df2/f129 0 2024-01-25T15:03:46.067 INFO:tasks.workunit.client.0.smithi170.stdout:0/856: chown d8/d18/l93 1674 1 2024-01-25T15:03:46.068 INFO:tasks.workunit.client.0.smithi170.stdout:3/818: rmdir d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/ddf 39 2024-01-25T15:03:46.069 INFO:tasks.workunit.client.0.smithi170.stdout:7/795: dread d8/d20/d3b/d4d/f78 [0,4194304] 0 2024-01-25T15:03:46.069 INFO:tasks.workunit.client.0.smithi170.stdout:2/733: write d10/d1e/d5e/d73/d9e/da3/fb8 [709871,104514] 0 2024-01-25T15:03:46.069 INFO:tasks.workunit.client.0.smithi170.stdout:2/734: readlink d10/d1e/d32/d3e/d41/dc4/dc6/d42/l6d 0 2024-01-25T15:03:46.070 INFO:tasks.workunit.client.0.smithi170.stdout:3/819: creat d3/d1c/d2b/d5c/f10d x:0 0 0 2024-01-25T15:03:46.071 INFO:tasks.workunit.client.0.smithi170.stdout:3/820: dread - d3/d10/d13/d1b/db3/fd7 zero size 2024-01-25T15:03:46.071 INFO:tasks.workunit.client.0.smithi170.stdout:7/796: creat d8/ddb/f11a x:0 0 0 2024-01-25T15:03:46.072 INFO:tasks.workunit.client.0.smithi170.stdout:2/735: dread d10/d1e/f58 [0,4194304] 0 2024-01-25T15:03:46.073 INFO:tasks.workunit.client.0.smithi170.stdout:3/821: symlink d3/d10/d1e/d21/d41/d4a/dc3/dfc/l10e 0 2024-01-25T15:03:46.074 INFO:tasks.workunit.client.0.smithi170.stdout:7/797: mkdir d8/d20/d45/d10c/d11b 0 2024-01-25T15:03:46.075 INFO:tasks.workunit.client.0.smithi170.stdout:3/822: symlink d3/d10/d13/d1b/l10f 0 2024-01-25T15:03:46.091 INFO:tasks.workunit.client.0.smithi170.stdout:7/798: link d8/d20/d2a/d35/d55/d7d/c62 d8/d20/d2a/d35/dff/c11c 0 2024-01-25T15:03:46.092 INFO:tasks.workunit.client.0.smithi170.stdout:4/697: rename d6/d7/d31/fb3 to d6/d28/d93/fd8 0 2024-01-25T15:03:46.092 INFO:tasks.workunit.client.0.smithi170.stdout:7/799: dread d8/d20/d2a/f3d [0,4194304] 0 2024-01-25T15:03:46.093 INFO:tasks.workunit.client.0.smithi170.stdout:1/735: rename d0/d20/d28/d2a/d4a/def to d0/d2e/df2 0 2024-01-25T15:03:46.094 INFO:tasks.workunit.client.0.smithi170.stdout:3/823: dwrite d3/d10/d1e/d21/fa6 [0,4194304] 0 2024-01-25T15:03:46.101 INFO:tasks.workunit.client.0.smithi170.stdout:7/800: write d8/d20/d2a/d35/d55/d9b/fc1 [225018,98844] 0 2024-01-25T15:03:46.101 INFO:tasks.workunit.client.0.smithi170.stdout:4/698: link d6/d7/d31/l4a d6/d28/d67/ld9 0 2024-01-25T15:03:46.103 INFO:tasks.workunit.client.0.smithi170.stdout:7/801: rmdir d8/d20/d2a 39 2024-01-25T15:03:46.103 INFO:tasks.workunit.client.0.smithi170.stdout:7/802: stat d8/d20/d3b/d4d/cbc 0 2024-01-25T15:03:46.103 INFO:tasks.workunit.client.0.smithi170.stdout:4/699: dread d6/d28/d59/d7d/f30 [0,4194304] 0 2024-01-25T15:03:46.103 INFO:tasks.workunit.client.0.smithi170.stdout:7/803: write d8/d20/d2a/d35/d55/d7d/da6/dd1/fe9 [78230,122570] 0 2024-01-25T15:03:46.106 INFO:tasks.workunit.client.0.smithi170.stdout:1/736: dread d0/d50/f95 [0,4194304] 0 2024-01-25T15:03:46.106 INFO:tasks.workunit.client.0.smithi170.stdout:1/737: write d0/ff [1452974,60925] 0 2024-01-25T15:03:46.106 INFO:tasks.workunit.client.0.smithi170.stdout:1/738: chown d0/d20/d28/d2a/d4a/d56/l69 2135720 1 2024-01-25T15:03:46.106 INFO:tasks.workunit.client.0.smithi170.stdout:1/739: creat d0/d20/d28/ff3 x:0 0 0 2024-01-25T15:03:46.106 INFO:tasks.workunit.client.0.smithi170.stdout:1/740: fdatasync d0/d20/d28/d2a/f5e 0 2024-01-25T15:03:46.106 INFO:tasks.workunit.client.0.smithi170.stdout:1/741: read - d0/d20/d28/d7b/da8/daa/fd3 zero size 2024-01-25T15:03:46.106 INFO:tasks.workunit.client.0.smithi170.stdout:7/804: fsync d8/d20/d2a/d35/d55/d9b/fc1 0 2024-01-25T15:03:46.106 INFO:tasks.workunit.client.0.smithi170.stdout:1/742: dread d0/d20/d28/d2a/fa3 [0,4194304] 0 2024-01-25T15:03:46.107 INFO:tasks.workunit.client.0.smithi170.stdout:7/805: truncate d8/d20/d2a/d35/d55/d9b/db9/fbe 628678 0 2024-01-25T15:03:46.108 INFO:tasks.workunit.client.0.smithi170.stdout:1/743: link d0/d50/fa6 d0/d2e/ff4 0 2024-01-25T15:03:46.109 INFO:tasks.workunit.client.0.smithi170.stdout:7/806: truncate d8/f1f 2550142 0 2024-01-25T15:03:46.109 INFO:tasks.workunit.client.0.smithi170.stdout:7/807: stat d8/d20/d2a/d35/d55/d9b 0 2024-01-25T15:03:46.111 INFO:tasks.workunit.client.0.smithi170.stdout:1/744: creat d0/d2e/ff5 x:0 0 0 2024-01-25T15:03:46.111 INFO:tasks.workunit.client.0.smithi170.stdout:1/745: readlink d0/d2e/l42 0 2024-01-25T15:03:46.112 INFO:tasks.workunit.client.0.smithi170.stdout:7/808: mknod d8/d20/d2a/d35/daf/c11d 0 2024-01-25T15:03:46.112 INFO:tasks.workunit.client.0.smithi170.stdout:7/809: readlink d8/d20/dc2/lf7 0 2024-01-25T15:03:46.114 INFO:tasks.workunit.client.0.smithi170.stdout:7/810: link d8/d20/d45/f46 d8/d20/d45/d8e/f11e 0 2024-01-25T15:03:46.122 INFO:tasks.workunit.client.0.smithi170.stdout:1/746: dread d0/d20/d28/f66 [0,4194304] 0 2024-01-25T15:03:46.124 INFO:tasks.workunit.client.0.smithi170.stdout:4/700: dwrite d6/d7/d31/d7e/f5b [0,4194304] 0 2024-01-25T15:03:46.124 INFO:tasks.workunit.client.0.smithi170.stdout:4/701: chown d6/d7/db7 1366 1 2024-01-25T15:03:46.124 INFO:tasks.workunit.client.0.smithi170.stdout:4/702: creat d6/d7/d31/d46/d78/fda x:0 0 0 2024-01-25T15:03:46.124 INFO:tasks.workunit.client.0.smithi170.stdout:4/703: truncate d6/d28/d59/d7d/d6b/f6d 1164284 0 2024-01-25T15:03:46.124 INFO:tasks.workunit.client.0.smithi170.stdout:4/704: write d6/f49 [1799816,5224] 0 2024-01-25T15:03:46.125 INFO:tasks.workunit.client.0.smithi170.stdout:4/705: stat d6/d28/d59/d7d/d6b/f6d 0 2024-01-25T15:03:46.125 INFO:tasks.workunit.client.0.smithi170.stdout:8/934: sync 2024-01-25T15:03:46.128 INFO:tasks.workunit.client.0.smithi170.stdout:8/935: getdents d3/d7/d22/d80 0 2024-01-25T15:03:46.130 INFO:tasks.workunit.client.0.smithi170.stdout:8/936: mkdir d3/d7/d22/d23/d48/d52/d143 0 2024-01-25T15:03:46.133 INFO:tasks.workunit.client.0.smithi170.stdout:8/937: link d3/d7/d1e/l40 d3/d7/d22/l144 0 2024-01-25T15:03:46.145 INFO:tasks.workunit.client.0.smithi170.stdout:7/811: rename d8/d20/d3b/d4d/cbc to d8/d20/d2a/d35/daf/c11f 0 2024-01-25T15:03:46.145 INFO:tasks.workunit.client.0.smithi170.stdout:7/812: fdatasync d8/d20/d73/ffb 0 2024-01-25T15:03:46.145 INFO:tasks.workunit.client.0.smithi170.stdout:7/813: chown d8/d20/d45/d10c/d119 560 1 2024-01-25T15:03:46.154 INFO:tasks.workunit.client.0.smithi170.stdout:8/938: dwrite d3/d7/d22/d23/d25/d8e/f129 [0,4194304] 0 2024-01-25T15:03:46.157 INFO:tasks.workunit.client.0.smithi170.stdout:8/939: mknod d3/d7/d22/d23/d25/d41/d9a/c145 0 2024-01-25T15:03:46.158 INFO:tasks.workunit.client.0.smithi170.stdout:8/940: chown d3 10022 1 2024-01-25T15:03:46.164 INFO:tasks.workunit.client.0.smithi170.stdout:4/706: rename d6/d7/d31/d7e/f40 to d6/d28/d59/da8/fdb 0 2024-01-25T15:03:46.165 INFO:tasks.workunit.client.0.smithi170.stdout:4/707: mknod d6/d7/d31/cdc 0 2024-01-25T15:03:46.165 INFO:tasks.workunit.client.0.smithi170.stdout:4/708: truncate d6/d28/d59/d7d/d6b/f87 880094 0 2024-01-25T15:03:46.166 INFO:tasks.workunit.client.0.smithi170.stdout:4/709: write d6/d7/d1b/f69 [99271,83924] 0 2024-01-25T15:03:46.176 INFO:tasks.workunit.client.0.smithi170.stdout:8/941: dwrite d3/d7/d22/f5a [0,4194304] 0 2024-01-25T15:03:46.177 INFO:tasks.workunit.client.0.smithi170.stdout:8/942: stat d3/d7/d22/d23/d48/d52/d47/l59 0 2024-01-25T15:03:46.179 INFO:tasks.workunit.client.0.smithi170.stdout:8/943: unlink d3/d7/d1e/d7c/d9f/fe5 0 2024-01-25T15:03:46.179 INFO:tasks.workunit.client.0.smithi170.stdout:8/944: chown d3/d7/fe3 1462585 1 2024-01-25T15:03:46.179 INFO:tasks.workunit.client.0.smithi170.stdout:8/945: mknod d3/d7/d1e/c146 0 2024-01-25T15:03:46.181 INFO:tasks.workunit.client.0.smithi170.stdout:8/946: mknod d3/d7/d22/d23/c147 0 2024-01-25T15:03:46.181 INFO:tasks.workunit.client.0.smithi170.stdout:8/947: dread - d3/d7/d73/f116 zero size 2024-01-25T15:03:46.181 INFO:tasks.workunit.client.0.smithi170.stdout:8/948: creat d3/d7/d3a/d8d/d137/f148 x:0 0 0 2024-01-25T15:03:46.182 INFO:tasks.workunit.client.0.smithi170.stdout:8/949: creat d3/d7/d3a/d8d/db3/f149 x:0 0 0 2024-01-25T15:03:46.183 INFO:tasks.workunit.client.0.smithi170.stdout:8/950: mkdir d3/d7/d22/d23/d48/d52/d47/de2/d14a 0 2024-01-25T15:03:46.184 INFO:tasks.workunit.client.0.smithi170.stdout:8/951: mkdir d3/d7/d14b 0 2024-01-25T15:03:46.185 INFO:tasks.workunit.client.0.smithi170.stdout:8/952: chown d3/d7/d1e/d7c/d9f/fc2 100595550 1 2024-01-25T15:03:46.186 INFO:tasks.workunit.client.0.smithi170.stdout:4/710: dwrite d6/d28/d93/f9a [0,4194304] 0 2024-01-25T15:03:46.186 INFO:tasks.workunit.client.0.smithi170.stdout:8/953: rename d3/d7/d22/l10e to d3/d7/d22/d23/da7/l14c 0 2024-01-25T15:03:46.187 INFO:tasks.workunit.client.0.smithi170.stdout:8/954: mkdir d3/d7/d3a/d85/d14d 0 2024-01-25T15:03:46.188 INFO:tasks.workunit.client.0.smithi170.stdout:8/955: rename d3/d7/d22/d23/d25/d8e/l112 to d3/d7/d22/d23/d25/d34/l14e 0 2024-01-25T15:03:46.188 INFO:tasks.workunit.client.0.smithi170.stdout:8/956: truncate d3/d7/d22/d23/f76 1908828 0 2024-01-25T15:03:46.192 INFO:tasks.workunit.client.0.smithi170.stdout:4/711: dread d6/d7/d1b/f1e [0,4194304] 0 2024-01-25T15:03:46.194 INFO:tasks.workunit.client.0.smithi170.stdout:4/712: unlink d6/d28/c79 0 2024-01-25T15:03:46.196 INFO:tasks.workunit.client.0.smithi170.stdout:4/713: unlink d6/d28/d59/d7d/c50 0 2024-01-25T15:03:46.197 INFO:tasks.workunit.client.0.smithi170.stdout:4/714: creat d6/d7/d31/d7e/fdd x:0 0 0 2024-01-25T15:03:46.200 INFO:tasks.workunit.client.0.smithi170.stdout:9/803: sync 2024-01-25T15:03:46.202 INFO:tasks.workunit.client.0.smithi170.stdout:9/804: creat d5/df/d2e/d77/d21/d46/d6c/dd8/d96/f10e x:0 0 0 2024-01-25T15:03:46.203 INFO:tasks.workunit.client.0.smithi170.stdout:9/805: creat d5/df/d16/d35/d3c/d91/f10f x:0 0 0 2024-01-25T15:03:46.203 INFO:tasks.workunit.client.0.smithi170.stdout:9/806: fdatasync d5/df/d2e/d77/d21/d46/d18/d6a/f74 0 2024-01-25T15:03:46.204 INFO:tasks.workunit.client.0.smithi170.stdout:9/807: mknod d5/df/d49/df1/d10d/c110 0 2024-01-25T15:03:46.207 INFO:tasks.workunit.client.0.smithi170.stdout:9/808: dread d5/df/d2e/d77/d21/d34/f5b [0,4194304] 0 2024-01-25T15:03:46.207 INFO:tasks.workunit.client.0.smithi170.stdout:9/809: write d5/df/d16/d35/d3c/d56/d59/f80 [1018177,1857] 0 2024-01-25T15:03:46.207 INFO:tasks.workunit.client.0.smithi170.stdout:9/810: write d5/df/d2e/d77/d21/d46/d18/fff [3553318,3543] 0 2024-01-25T15:03:46.208 INFO:tasks.workunit.client.0.smithi170.stdout:9/811: mkdir d5/df/d2e/d77/d21/d34/d111 0 2024-01-25T15:03:46.210 INFO:tasks.workunit.client.0.smithi170.stdout:9/812: creat d5/df/d16/d35/d3c/d91/dd6/dd9/ded/f112 x:0 0 0 2024-01-25T15:03:46.217 INFO:tasks.workunit.client.0.smithi170.stdout:4/715: rename d6/d7/cd5 to d6/d28/cde 0 2024-01-25T15:03:46.217 INFO:tasks.workunit.client.0.smithi170.stdout:4/716: chown d6/d28/d61/l8f 150 1 2024-01-25T15:03:46.222 INFO:tasks.workunit.client.0.smithi170.stdout:9/813: write d5/df/d2e/d77/d21/d34/d3e/d7f/fc8 [5562415,2044] 0 2024-01-25T15:03:46.250 INFO:tasks.workunit.client.0.smithi170.stdout:9/814: dwrite d5/df/d2e/d77/d21/d46/d18/dc0/fea [0,4194304] 0 2024-01-25T15:03:46.250 INFO:tasks.workunit.client.0.smithi170.stdout:9/815: creat d5/df/f113 x:0 0 0 2024-01-25T15:03:46.250 INFO:tasks.workunit.client.0.smithi170.stdout:4/717: dwrite d6/d28/d93/fd8 [0,4194304] 0 2024-01-25T15:03:46.250 INFO:tasks.workunit.client.0.smithi170.stdout:4/718: write d6/d7/d31/d46/d78/fa5 [1472267,101033] 0 2024-01-25T15:03:46.250 INFO:tasks.workunit.client.0.smithi170.stdout:4/719: chown d6/d28/d59/d7d/d6b/f6d 37 1 2024-01-25T15:03:46.254 INFO:tasks.workunit.client.0.smithi170.stdout:9/816: unlink d5/df/d2e/db0/cc3 0 2024-01-25T15:03:46.255 INFO:tasks.workunit.client.0.smithi170.stdout:4/720: rename d6/d7/d31/d46/d78/laa to d6/d7/d31/d46/dc6/ldf 0 2024-01-25T15:03:46.256 INFO:tasks.workunit.client.0.smithi170.stdout:4/721: mkdir d6/d28/d93/de0 0 2024-01-25T15:03:46.258 INFO:tasks.workunit.client.0.smithi170.stdout:4/722: dread d6/d28/d59/d7d/d6b/fc7 [0,4194304] 0 2024-01-25T15:03:46.258 INFO:tasks.workunit.client.0.smithi170.stdout:4/723: mkdir d6/d7/d9f/de1 0 2024-01-25T15:03:46.276 INFO:tasks.workunit.client.0.smithi170.stdout:9/817: dwrite d5/df/d16/d35/d3c/d56/d59/d5e/f97 [0,4194304] 0 2024-01-25T15:03:46.278 INFO:tasks.workunit.client.0.smithi170.stdout:9/818: unlink d5/df/d2e/db0/fef 0 2024-01-25T15:03:46.278 INFO:tasks.workunit.client.0.smithi170.stdout:9/819: getdents d5/df/d16/d35/d3c/d56 0 2024-01-25T15:03:46.285 INFO:tasks.workunit.client.0.smithi170.stdout:9/820: dread d5/df/d2e/d77/d21/d46/fdc [0,4194304] 0 2024-01-25T15:03:46.287 INFO:tasks.workunit.client.0.smithi170.stdout:9/821: mknod d5/df/d16/d35/d3c/d91/dd6/dd9/ded/c114 0 2024-01-25T15:03:46.287 INFO:tasks.workunit.client.0.smithi170.stdout:9/822: chown d5/df/d16/d35/d3c/d56/d59/f80 3970712 1 2024-01-25T15:03:46.288 INFO:tasks.workunit.client.0.smithi170.stdout:9/823: mkdir d5/df/d16/d35/d115 0 2024-01-25T15:03:46.288 INFO:tasks.workunit.client.0.smithi170.stdout:9/824: stat d5/dc/fe9 0 2024-01-25T15:03:46.289 INFO:tasks.workunit.client.0.smithi170.stdout:5/716: sync 2024-01-25T15:03:46.289 INFO:tasks.workunit.client.0.smithi170.stdout:6/816: sync 2024-01-25T15:03:46.289 INFO:tasks.workunit.client.0.smithi170.stdout:6/817: fdatasync d2/d7/d23/f10a 0 2024-01-25T15:03:46.289 INFO:tasks.workunit.client.0.smithi170.stdout:9/825: creat d5/dca/dd7/f116 x:0 0 0 2024-01-25T15:03:46.289 INFO:tasks.workunit.client.0.smithi170.stdout:9/826: chown d5/df/d2e/d77/d21/d34/d3e/f102 0 1 2024-01-25T15:03:46.290 INFO:tasks.workunit.client.0.smithi170.stdout:9/827: mknod d5/df/d2e/d77/d21/d46/c117 0 2024-01-25T15:03:46.290 INFO:tasks.workunit.client.0.smithi170.stdout:5/717: mkdir d5/d54/d85/d2c/d45/d56/d72/df0 0 2024-01-25T15:03:46.290 INFO:tasks.workunit.client.0.smithi170.stdout:9/828: mkdir d5/df/d2e/d77/d86/d118 0 2024-01-25T15:03:46.291 INFO:tasks.workunit.client.0.smithi170.stdout:9/829: read d5/df/d2e/d77/d21/d46/d6c/dd8/d96/f98 [381417,30326] 0 2024-01-25T15:03:46.291 INFO:tasks.workunit.client.0.smithi170.stdout:9/830: fsync d5/df/f15 0 2024-01-25T15:03:46.292 INFO:tasks.workunit.client.0.smithi170.stdout:9/831: fsync d5/df/f113 0 2024-01-25T15:03:46.292 INFO:tasks.workunit.client.0.smithi170.stdout:9/832: write d5/dc/f30 [949476,20273] 0 2024-01-25T15:03:46.292 INFO:tasks.workunit.client.0.smithi170.stdout:9/833: write d5/df/d16/d35/d3c/d91/dd6/dd9/fde [1640257,45843] 0 2024-01-25T15:03:46.297 INFO:tasks.workunit.client.0.smithi170.stdout:5/718: truncate d5/d54/d85/d2c/d45/f75 2121729 0 2024-01-25T15:03:46.298 INFO:tasks.workunit.client.0.smithi170.stdout:6/818: write d2/d7/fbf [235735,64493] 0 2024-01-25T15:03:46.298 INFO:tasks.workunit.client.0.smithi170.stdout:6/819: fdatasync d2/d7/d23/d19/d2a/f79 0 2024-01-25T15:03:46.299 INFO:tasks.workunit.client.0.smithi170.stdout:5/719: mknod d5/d54/d85/d3f/d8f/cf1 0 2024-01-25T15:03:46.299 INFO:tasks.workunit.client.0.smithi170.stdout:6/820: mkdir d2/d7/d23/d19/d2a/d43/d98/d113/d115 0 2024-01-25T15:03:46.301 INFO:tasks.workunit.client.0.smithi170.stdout:6/821: symlink d2/d7/d23/d19/d2a/d43/d98/d113/d5d/d94/d97/l116 0 2024-01-25T15:03:46.301 INFO:tasks.workunit.client.0.smithi170.stdout:5/720: mknod d5/db9/cf2 0 2024-01-25T15:03:46.303 INFO:tasks.workunit.client.0.smithi170.stdout:6/822: mknod d2/d7/d23/d19/d2a/d6b/dad/dd7/c117 0 2024-01-25T15:03:46.303 INFO:tasks.workunit.client.0.smithi170.stdout:6/823: chown d2/d7/d23/d19/d2a/d43/d98/d113/d5d/f91 605 1 2024-01-25T15:03:46.303 INFO:tasks.workunit.client.0.smithi170.stdout:6/824: fsync d2/d7/d23/f10a 0 2024-01-25T15:03:46.305 INFO:tasks.workunit.client.0.smithi170.stdout:5/721: rmdir d5/d54/d85/d3f/d86/dd7 0 2024-01-25T15:03:46.305 INFO:tasks.workunit.client.0.smithi170.stdout:5/722: chown d5/d54/d85/d2c/d51/d3d/c9c 148819 1 2024-01-25T15:03:46.305 INFO:tasks.workunit.client.0.smithi170.stdout:6/825: getdents d2/d7/d23/d19/d2a/d43/d44/da4 0 2024-01-25T15:03:46.305 INFO:tasks.workunit.client.0.smithi170.stdout:6/826: fdatasync d2/d7/d1b/d28/da7/dd2/fe8 0 2024-01-25T15:03:46.308 INFO:tasks.workunit.client.0.smithi170.stdout:5/723: link d5/d54/d85/d3f/d86/c81 d5/d54/d85/d3f/d8f/db8/dd5/cf3 0 2024-01-25T15:03:46.308 INFO:tasks.workunit.client.0.smithi170.stdout:5/724: chown d5/d54/d85/d3f/d8f 10086 1 2024-01-25T15:03:46.308 INFO:tasks.workunit.client.0.smithi170.stdout:5/725: chown d5/d54/d85/d2c/d34/f8b 1174 1 2024-01-25T15:03:46.314 INFO:tasks.workunit.client.0.smithi170.stdout:5/726: truncate d5/f16 13011161 0 2024-01-25T15:03:46.315 INFO:tasks.workunit.client.0.smithi170.stdout:5/727: symlink d5/d54/d85/d3f/lf4 0 2024-01-25T15:03:46.318 INFO:tasks.workunit.client.0.smithi170.stdout:5/728: dread d5/d54/d85/d3f/f79 [0,4194304] 0 2024-01-25T15:03:46.327 INFO:tasks.workunit.client.0.smithi170.stdout:9/834: dwrite d5/df/d2e/d77/d21/d34/fcd [0,4194304] 0 2024-01-25T15:03:46.327 INFO:tasks.workunit.client.0.smithi170.stdout:9/835: chown d5/df/d2e/d77/d21/d34/d3e/fdb 50 1 2024-01-25T15:03:46.327 INFO:tasks.workunit.client.0.smithi170.stdout:6/827: dwrite d2/f4f [4194304,4194304] 0 2024-01-25T15:03:46.328 INFO:tasks.workunit.client.0.smithi170.stdout:6/828: symlink d2/d7/d23/d19/d2a/d43/d98/d113/d74/dc1/dc8/l118 0 2024-01-25T15:03:46.335 INFO:tasks.workunit.client.0.smithi170.stdout:6/829: creat d2/d7/d1b/d28/f119 x:0 0 0 2024-01-25T15:03:46.336 INFO:tasks.workunit.client.0.smithi170.stdout:6/830: readlink d2/d7/d23/l30 0 2024-01-25T15:03:46.338 INFO:tasks.workunit.client.0.smithi170.stdout:9/836: symlink d5/df/d2e/d77/d21/d46/d6c/dd8/d96/l119 0 2024-01-25T15:03:46.338 INFO:tasks.workunit.client.0.smithi170.stdout:9/837: creat d5/df/d16/d35/d3c/d91/f11a x:0 0 0 2024-01-25T15:03:46.342 INFO:tasks.workunit.client.0.smithi170.stdout:9/838: unlink d5/df/d16/d35/d3c/d56/d59/f80 0 2024-01-25T15:03:46.343 INFO:tasks.workunit.client.0.smithi170.stdout:9/839: creat d5/df/d16/d35/d3c/d56/d59/f11b x:0 0 0 2024-01-25T15:03:46.344 INFO:tasks.workunit.client.0.smithi170.stdout:9/840: write d5/df/f20 [3123403,47898] 0 2024-01-25T15:03:46.344 INFO:tasks.workunit.client.0.smithi170.stdout:9/841: dread - d5/df/d2e/d77/d21/d46/d6c/dd8/d96/f10c zero size 2024-01-25T15:03:46.348 INFO:tasks.workunit.client.0.smithi170.stdout:6/831: dread d2/d7/d1b/d28/da7/fc2 [0,4194304] 0 2024-01-25T15:03:46.348 INFO:tasks.workunit.client.0.smithi170.stdout:6/832: fdatasync d2/d7/d1b/d78/fb6 0 2024-01-25T15:03:46.350 INFO:tasks.workunit.client.0.smithi170.stdout:6/833: mkdir d2/d7/d1b/d78/d11a 0 2024-01-25T15:03:46.350 INFO:tasks.workunit.client.0.smithi170.stdout:2/736: sync 2024-01-25T15:03:46.350 INFO:tasks.workunit.client.0.smithi170.stdout:8/957: sync 2024-01-25T15:03:46.351 INFO:tasks.workunit.client.0.smithi170.stdout:7/814: sync 2024-01-25T15:03:46.351 INFO:tasks.workunit.client.0.smithi170.stdout:3/824: sync 2024-01-25T15:03:46.351 INFO:tasks.workunit.client.0.smithi170.stdout:1/747: sync 2024-01-25T15:03:46.351 INFO:tasks.workunit.client.0.smithi170.stdout:1/748: creat d0/d2e/ff6 x:0 0 0 2024-01-25T15:03:46.351 INFO:tasks.workunit.client.0.smithi170.stdout:6/834: symlink d2/d7/d1b/d28/da7/l11b 0 2024-01-25T15:03:46.351 INFO:tasks.workunit.client.0.smithi170.stdout:6/835: write d2/d7/d23/d19/d2a/fe1 [385027,101932] 0 2024-01-25T15:03:46.352 INFO:tasks.workunit.client.0.smithi170.stdout:6/836: chown d2/d7/d23/d19/d2a/c8d 166 1 2024-01-25T15:03:46.352 INFO:tasks.workunit.client.0.smithi170.stdout:2/737: creat d10/d1e/d32/d3e/d5c/d92/d8b/f105 x:0 0 0 2024-01-25T15:03:46.352 INFO:tasks.workunit.client.0.smithi170.stdout:0/857: sync 2024-01-25T15:03:46.353 INFO:tasks.workunit.client.0.smithi170.stdout:8/958: rename d3/d7/d22/d23/d25/d34 to d3/d7/d22/d23/d25/d8e/d14f 0 2024-01-25T15:03:46.353 INFO:tasks.workunit.client.0.smithi170.stdout:8/959: readlink d3/d7/d3a/d91/lf6 0 2024-01-25T15:03:46.355 INFO:tasks.workunit.client.0.smithi170.stdout:7/815: unlink d8/fc9 0 2024-01-25T15:03:46.356 INFO:tasks.workunit.client.0.smithi170.stdout:2/738: dread d10/d1e/d32/d62/d8d/f96 [0,4194304] 0 2024-01-25T15:03:46.359 INFO:tasks.workunit.client.0.smithi170.stdout:1/749: read d0/f46 [736989,118478] 0 2024-01-25T15:03:46.364 INFO:tasks.workunit.client.0.smithi170.stdout:5/729: dwrite d5/d54/d85/f42 [4194304,4194304] 0 2024-01-25T15:03:46.364 INFO:tasks.workunit.client.0.smithi170.stdout:5/730: write d5/d58/da9/fd4 [459140,102089] 0 2024-01-25T15:03:46.364 INFO:tasks.workunit.client.0.smithi170.stdout:5/731: creat d5/d54/d85/d2c/d34/d69/ff5 x:0 0 0 2024-01-25T15:03:46.364 INFO:tasks.workunit.client.0.smithi170.stdout:5/732: write d5/d2a/f3e [1368644,220] 0 2024-01-25T15:03:46.366 INFO:tasks.workunit.client.0.smithi170.stdout:6/837: truncate d2/f82 3600857 0 2024-01-25T15:03:46.366 INFO:tasks.workunit.client.0.smithi170.stdout:3/825: rmdir d3/d10/d1e/d21/d41/d4a 39 2024-01-25T15:03:46.367 INFO:tasks.workunit.client.0.smithi170.stdout:6/838: creat d2/d7/d23/d19/d2a/d6b/dad/f11c x:0 0 0 2024-01-25T15:03:46.369 INFO:tasks.workunit.client.0.smithi170.stdout:6/839: creat d2/d7/d23/d19/d2a/d43/d98/d113/d74/dc1/dcf/d100/f11d x:0 0 0 2024-01-25T15:03:46.369 INFO:tasks.workunit.client.0.smithi170.stdout:1/750: symlink d0/de8/lf7 0 2024-01-25T15:03:46.369 INFO:tasks.workunit.client.0.smithi170.stdout:6/840: truncate d2/d7/d23/d19/d2a/d43/d98/d113/d74/dc1/dcf/ff1 1146887 0 2024-01-25T15:03:46.369 INFO:tasks.workunit.client.0.smithi170.stdout:1/751: creat d0/d20/d3a/d60/ff8 x:0 0 0 2024-01-25T15:03:46.373 INFO:tasks.workunit.client.0.smithi170.stdout:3/826: creat d3/d10/d1e/de5/f110 x:0 0 0 2024-01-25T15:03:46.373 INFO:tasks.workunit.client.0.smithi170.stdout:3/827: write d3/d10/d13/d1b/d81/f108 [290047,94537] 0 2024-01-25T15:03:46.373 INFO:tasks.workunit.client.0.smithi170.stdout:3/828: chown d3/d1c/d2b/fc1 85 1 2024-01-25T15:03:46.374 INFO:tasks.workunit.client.0.smithi170.stdout:6/841: truncate d2/d7/d1b/d28/f76 2289062 0 2024-01-25T15:03:46.376 INFO:tasks.workunit.client.0.smithi170.stdout:1/752: link d0/d20/d28/d2a/d4a/d56/l58 d0/d20/d28/d7b/da8/lf9 0 2024-01-25T15:03:46.378 INFO:tasks.workunit.client.0.smithi170.stdout:3/829: mknod d3/d1c/d104/c111 0 2024-01-25T15:03:46.378 INFO:tasks.workunit.client.0.smithi170.stdout:3/830: dread - d3/d10/d1e/ff7 zero size 2024-01-25T15:03:46.378 INFO:tasks.workunit.client.0.smithi170.stdout:3/831: rename d3/d3b to d3/d3b/dc6/d53/d112 22 2024-01-25T15:03:46.379 INFO:tasks.workunit.client.0.smithi170.stdout:1/753: symlink d0/d50/d8e/lfa 0 2024-01-25T15:03:46.380 INFO:tasks.workunit.client.0.smithi170.stdout:3/832: mknod d3/d10/d6d/d98/c113 0 2024-01-25T15:03:46.380 INFO:tasks.workunit.client.0.smithi170.stdout:3/833: chown d3/d1c/d2b/d5c/d97/dab/fc0 318518513 1 2024-01-25T15:03:46.380 INFO:tasks.workunit.client.0.smithi170.stdout:3/834: readlink d3/d1c/d2b/d5c/d97/dab/lf2 0 2024-01-25T15:03:46.381 INFO:tasks.workunit.client.0.smithi170.stdout:8/960: dwrite d3/f72 [0,4194304] 0 2024-01-25T15:03:46.381 INFO:tasks.workunit.client.0.smithi170.stdout:8/961: write d3/d7/d3a/d85/d119/f127 [711692,78591] 0 2024-01-25T15:03:46.382 INFO:tasks.workunit.client.0.smithi170.stdout:1/754: creat d0/d50/da2/ffb x:0 0 0 2024-01-25T15:03:46.383 INFO:tasks.workunit.client.0.smithi170.stdout:9/842: dwrite d5/df/d2e/d77/d21/d34/d3e/d7f/fe2 [0,4194304] 0 2024-01-25T15:03:46.384 INFO:tasks.workunit.client.0.smithi170.stdout:1/755: mkdir d0/d20/d28/d7b/dfc 0 2024-01-25T15:03:46.385 INFO:tasks.workunit.client.0.smithi170.stdout:1/756: write d0/f46 [161491,20446] 0 2024-01-25T15:03:46.396 INFO:tasks.workunit.client.0.smithi170.stdout:2/739: dwrite d10/f104 [0,4194304] 0 2024-01-25T15:03:46.399 INFO:tasks.workunit.client.0.smithi170.stdout:7/816: dwrite d8/d20/d2a/d35/d55/d9b/db9/fbe [0,4194304] 0 2024-01-25T15:03:46.401 INFO:tasks.workunit.client.0.smithi170.stdout:6/842: dread d2/d7/d23/d19/d2a/fb2 [0,4194304] 0 2024-01-25T15:03:46.403 INFO:tasks.workunit.client.0.smithi170.stdout:3/835: dread d3/d10/d1e/d21/d41/d4b/d63/dc7/fcc [0,4194304] 0 2024-01-25T15:03:46.405 INFO:tasks.workunit.client.0.smithi170.stdout:4/724: sync 2024-01-25T15:03:46.406 INFO:tasks.workunit.client.0.smithi170.stdout:4/725: creat d6/d7/d31/d46/dc6/fe2 x:0 0 0 2024-01-25T15:03:46.413 INFO:tasks.workunit.client.0.smithi170.stdout:4/726: symlink d6/d28/d59/da8/le3 0 2024-01-25T15:03:46.413 INFO:tasks.workunit.client.0.smithi170.stdout:4/727: stat d6/d7/d31/d46/la4 0 2024-01-25T15:03:46.413 INFO:tasks.workunit.client.0.smithi170.stdout:4/728: truncate d6/d28/d93/fa3 32226 0 2024-01-25T15:03:46.419 INFO:tasks.workunit.client.0.smithi170.stdout:9/843: dwrite d5/df/d2e/d77/d21/d46/d6c/dd8/d96/fb8 [0,4194304] 0 2024-01-25T15:03:46.420 INFO:tasks.workunit.client.0.smithi170.stdout:9/844: chown d5/df 394735940 1 2024-01-25T15:03:46.420 INFO:tasks.workunit.client.0.smithi170.stdout:9/845: mkdir d5/df/d2e/d77/d21/d46/d18/d11c 0 2024-01-25T15:03:46.420 INFO:tasks.workunit.client.0.smithi170.stdout:7/817: write d8/d20/d2a/d35/d55/d7d/fda [3071926,38316] 0 2024-01-25T15:03:46.423 INFO:tasks.workunit.client.0.smithi170.stdout:9/846: unlink d5/df/d2e/d77/d21/d34/ldf 0 2024-01-25T15:03:46.423 INFO:tasks.workunit.client.0.smithi170.stdout:9/847: chown d5/df/d16/d52/c6f 20770 1 2024-01-25T15:03:46.423 INFO:tasks.workunit.client.0.smithi170.stdout:9/848: write d5/df/d2e/d77/d21/d46/d6c/dd8/d96/f103 [583723,57627] 0 2024-01-25T15:03:46.427 INFO:tasks.workunit.client.0.smithi170.stdout:7/818: dread d8/d20/d2a/d61/fa4 [0,4194304] 0 2024-01-25T15:03:46.427 INFO:tasks.workunit.client.0.smithi170.stdout:6/843: read d2/d7/d23/d19/f83 [2950746,128720] 0 2024-01-25T15:03:46.427 INFO:tasks.workunit.client.0.smithi170.stdout:7/819: stat d8/d20/d2a/d35/daf/c11f 0 2024-01-25T15:03:46.427 INFO:tasks.workunit.client.0.smithi170.stdout:7/820: fsync d8/d20/d3b/f50 0 2024-01-25T15:03:46.428 INFO:tasks.workunit.client.0.smithi170.stdout:7/821: stat d8/d20/d2a/d35/d55/d7d/fc5 0 2024-01-25T15:03:46.429 INFO:tasks.workunit.client.0.smithi170.stdout:7/822: mkdir d8/d20/d2a/d35/d55/dcf/d120 0 2024-01-25T15:03:46.429 INFO:tasks.workunit.client.0.smithi170.stdout:7/823: fsync d8/d20/d3b/d4d/f97 0 2024-01-25T15:03:46.429 INFO:tasks.workunit.client.0.smithi170.stdout:7/824: chown d8/d20/d2a/c3e 6556391 1 2024-01-25T15:03:46.429 INFO:tasks.workunit.client.0.smithi170.stdout:7/825: chown d8/d20/d45/d68/f84 123822266 1 2024-01-25T15:03:46.429 INFO:tasks.workunit.client.0.smithi170.stdout:6/844: dread d2/d7/f2e [0,4194304] 0 2024-01-25T15:03:46.430 INFO:tasks.workunit.client.0.smithi170.stdout:2/740: dwrite d10/d1e/d32/d62/d74/fe7 [0,4194304] 0 2024-01-25T15:03:46.433 INFO:tasks.workunit.client.0.smithi170.stdout:7/826: write d8/d20/fef [52578,70451] 0 2024-01-25T15:03:46.433 INFO:tasks.workunit.client.0.smithi170.stdout:7/827: chown c6 94 1 2024-01-25T15:03:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.434+0000 7fd83a790640 1 -- 172.21.15.170:0/754041501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd834101ef0 msgr2=0x7fd834104360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.434+0000 7fd83a790640 1 --2- 172.21.15.170:0/754041501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd834101ef0 0x7fd834104360 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd828009900 tx=0x7fd82802bc50 comp rx=0 tx=0).stop 2024-01-25T15:03:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.435+0000 7fd83a790640 1 -- 172.21.15.170:0/754041501 shutdown_connections 2024-01-25T15:03:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.435+0000 7fd83a790640 1 --2- 172.21.15.170:0/754041501 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8341048a0 0x7fd834104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.435+0000 7fd83a790640 1 --2- 172.21.15.170:0/754041501 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd834101ef0 0x7fd834104360 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.435+0000 7fd83a790640 1 --2- 172.21.15.170:0/754041501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8340ff580 0x7fd8341019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.435+0000 7fd83a790640 1 -- 172.21.15.170:0/754041501 >> 172.21.15.170:0/754041501 conn(0x7fd8340fb180 msgr2=0x7fd8340fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:46.436 INFO:tasks.workunit.client.0.smithi170.stdout:7/828: mkdir d8/d20/d2a/d35/d55/d6e/d121 0 2024-01-25T15:03:46.436 INFO:tasks.workunit.client.0.smithi170.stdout:7/829: creat d8/d20/d45/f122 x:0 0 0 2024-01-25T15:03:46.437 INFO:tasks.workunit.client.0.smithi170.stdout:7/830: fsync d8/d20/d2a/d35/d55/d7d/da6/dd1/fe9 0 2024-01-25T15:03:46.437 INFO:tasks.workunit.client.0.smithi170.stdout:7/831: write d8/d20/d45/d8e/fee [414577,40146] 0 2024-01-25T15:03:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.435+0000 7fd83a790640 1 -- 172.21.15.170:0/754041501 shutdown_connections 2024-01-25T15:03:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.435+0000 7fd83a790640 1 -- 172.21.15.170:0/754041501 wait complete. 2024-01-25T15:03:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.436+0000 7fd83a790640 1 Processor -- start 2024-01-25T15:03:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.436+0000 7fd83a790640 1 -- start start 2024-01-25T15:03:46.438 INFO:tasks.workunit.client.0.smithi170.stdout:7/832: symlink d8/d20/d2a/d35/d55/d7d/da6/dd1/deb/l123 0 2024-01-25T15:03:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.436+0000 7fd83a790640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8340ff580 0x7fd83419d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.436+0000 7fd83a790640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8341048a0 0x7fd83419d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.436+0000 7fd83a790640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8341a2a50 0x7fd8341a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.437+0000 7fd83a790640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8341a5380 con 0x7fd8341048a0 2024-01-25T15:03:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.437+0000 7fd83a790640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8341a54f0 con 0x7fd8340ff580 2024-01-25T15:03:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.437+0000 7fd83a790640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8341a56b0 con 0x7fd8341a2a50 2024-01-25T15:03:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.437+0000 7fd838d2d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8341a2a50 0x7fd8341a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.437+0000 7fd833fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8340ff580 0x7fd83419d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.437+0000 7fd838d2d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8341a2a50 0x7fd8341a4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:41620/0 (socket says 172.21.15.170:41620) 2024-01-25T15:03:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.437+0000 7fd838d2d640 1 -- 172.21.15.170:0/1718675890 learned_addr learned my addr 172.21.15.170:0/1718675890 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.437+0000 7fd8337fe640 1 --2- 172.21.15.170:0/1718675890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8341048a0 0x7fd83419d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.440 INFO:tasks.workunit.client.0.smithi170.stdout:7/833: mkdir d8/d20/d2a/d35/d55/d6e/d121/d124 0 2024-01-25T15:03:46.440 INFO:tasks.workunit.client.0.smithi170.stdout:3/836: dwrite d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/dcb/fe4 [0,4194304] 0 2024-01-25T15:03:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.437+0000 7fd838d2d640 1 -- 172.21.15.170:0/1718675890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8340ff580 msgr2=0x7fd83419d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.437+0000 7fd838d2d640 1 --2- 172.21.15.170:0/1718675890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8340ff580 0x7fd83419d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.437+0000 7fd838d2d640 1 -- 172.21.15.170:0/1718675890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8341048a0 msgr2=0x7fd83419d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.437+0000 7fd838d2d640 1 --2- 172.21.15.170:0/1718675890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8341048a0 0x7fd83419d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.437+0000 7fd838d2d640 1 -- 172.21.15.170:0/1718675890 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd828009560 con 0x7fd8341a2a50 2024-01-25T15:03:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.437+0000 7fd838d2d640 1 --2- 172.21.15.170:0/1718675890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8341a2a50 0x7fd8341a4e40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00eb10 tx=0x7fd82c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.438+0000 7fd8317fa640 1 -- 172.21.15.170:0/1718675890 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c004b20 con 0x7fd8341a2a50 2024-01-25T15:03:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.438+0000 7fd8317fa640 1 -- 172.21.15.170:0/1718675890 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd82c004c80 con 0x7fd8341a2a50 2024-01-25T15:03:46.442 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.438+0000 7fd8317fa640 1 -- 172.21.15.170:0/1718675890 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c010690 con 0x7fd8341a2a50 2024-01-25T15:03:46.442 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.438+0000 7fd83a790640 1 -- 172.21.15.170:0/1718675890 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8341a5990 con 0x7fd8341a2a50 2024-01-25T15:03:46.442 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.438+0000 7fd83a790640 1 -- 172.21.15.170:0/1718675890 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8341a5ea0 con 0x7fd8341a2a50 2024-01-25T15:03:46.442 INFO:tasks.workunit.client.0.smithi170.stdout:3/837: creat d3/d1c/d2b/d5c/dad/f114 x:0 0 0 2024-01-25T15:03:46.442 INFO:tasks.workunit.client.0.smithi170.stdout:4/729: dwrite d6/d28/d59/d7d/d6b/f6d [0,4194304] 0 2024-01-25T15:03:46.442 INFO:tasks.workunit.client.0.smithi170.stdout:5/733: dwrite d5/f1e [0,4194304] 0 2024-01-25T15:03:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.442+0000 7fd8317fa640 1 -- 172.21.15.170:0/1718675890 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fd82c005020 con 0x7fd8341a2a50 2024-01-25T15:03:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.442+0000 7fd83d42e740 1 Processor -- start 2024-01-25T15:03:46.444 INFO:tasks.workunit.client.0.smithi170.stdout:1/757: rename d0/d20/d28/d2a/d4a/d56/d5b/d72/fba to d0/d20/d28/ffd 0 2024-01-25T15:03:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.443+0000 7fd83d42e740 1 -- start start 2024-01-25T15:03:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.443+0000 7fd83d42e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0441412a0 0x55d0441416c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.443+0000 7fd83d42e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044141c90 0x55d044146790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.443+0000 7fd83d42e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044146e00 0x55d044149290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.443+0000 7fd83d42e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0440b1070 con 0x55d044146e00 2024-01-25T15:03:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.443+0000 7fd83d42e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0440ae760 con 0x55d044141c90 2024-01-25T15:03:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.443+0000 7fd83d42e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0440aa050 con 0x55d0441412a0 2024-01-25T15:03:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.443+0000 7fd8317fa640 1 --2- 172.21.15.170:0/1718675890 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd81c0a1380 0x7fd81c0a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.443+0000 7fd8337fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044146e00 0x55d044149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.443+0000 7fd8337fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044146e00 0x55d044149290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41658/0 (socket says 172.21.15.170:41658) 2024-01-25T15:03:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.443+0000 7fd8337fe640 1 -- 172.21.15.170:0/905162853 learned_addr learned my addr 172.21.15.170:0/905162853 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.444+0000 7fd833fff640 1 --2- 172.21.15.170:0/905162853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044141c90 0x55d044146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.444+0000 7fd8337fe640 1 -- 172.21.15.170:0/905162853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0441412a0 msgr2=0x55d0441416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.444+0000 7fd8337fe640 1 --2- 172.21.15.170:0/905162853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0441412a0 0x55d0441416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.444+0000 7fd8337fe640 1 -- 172.21.15.170:0/905162853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044141c90 msgr2=0x55d044146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.444+0000 7fd8337fe640 1 --2- 172.21.15.170:0/905162853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044141c90 0x55d044146790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.444+0000 7fd8317fa640 1 -- 172.21.15.170:0/1718675890 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fd82c014070 con 0x7fd8341a2a50 2024-01-25T15:03:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.444+0000 7fd8337fe640 1 -- 172.21.15.170:0/905162853 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0440a1e70 con 0x55d044146e00 2024-01-25T15:03:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.444+0000 7fd8337fe640 1 --2- 172.21.15.170:0/905162853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044146e00 0x55d044149290 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd828005ab0 tx=0x7fd82802c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8f9519b8cfe724 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:46.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.444+0000 7fd838d2d640 1 --2- 172.21.15.170:0/1718675890 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd81c0a1380 0x7fd81c0a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.444+0000 7fd81a7fc640 1 -- 172.21.15.170:0/905162853 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82802cbd0 con 0x55d044146e00 2024-01-25T15:03:46.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.445+0000 7fd81a7fc640 1 -- 172.21.15.170:0/905162853 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd828004040 con 0x55d044146e00 2024-01-25T15:03:46.447 INFO:tasks.workunit.client.0.smithi170.stdout:7/834: creat d8/d20/d45/d10c/d119/f125 x:0 0 0 2024-01-25T15:03:46.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.445+0000 7fd81a7fc640 1 -- 172.21.15.170:0/905162853 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8280039d0 con 0x55d044146e00 2024-01-25T15:03:46.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.446+0000 7fd83d42e740 1 -- 172.21.15.170:0/905162853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044146e00 msgr2=0x55d044149290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:46.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.446+0000 7fd83d42e740 1 --2- 172.21.15.170:0/905162853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044146e00 0x55d044149290 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd828005ab0 tx=0x7fd82802c9e0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.446+0000 7fd838d2d640 1 --2- 172.21.15.170:0/1718675890 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd81c0a1380 0x7fd81c0a3840 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd82c004fd0 tx=0x7fd82c0057a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:46.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.446+0000 7fd83d42e740 1 -- 172.21.15.170:0/905162853 shutdown_connections 2024-01-25T15:03:46.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.446+0000 7fd83d42e740 1 --2- 172.21.15.170:0/905162853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044141c90 0x55d044146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.446+0000 7fd83d42e740 1 --2- 172.21.15.170:0/905162853 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044146e00 0x55d044149290 secure :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fd828005ab0 tx=0x7fd82802c9e0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.446+0000 7fd83d42e740 1 --2- 172.21.15.170:0/905162853 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0441412a0 0x55d0441416c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.446+0000 7fd83d42e740 1 -- 172.21.15.170:0/905162853 >> 172.21.15.170:0/905162853 conn(0x55d04413c810 msgr2=0x55d04413cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:46.449 INFO:tasks.workunit.client.0.smithi170.stdout:3/838: symlink d3/d1c/l115 0 2024-01-25T15:03:46.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.447+0000 7fd83d42e740 1 -- 172.21.15.170:0/905162853 shutdown_connections 2024-01-25T15:03:46.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.447+0000 7fd83d42e740 1 -- 172.21.15.170:0/905162853 wait complete. 2024-01-25T15:03:46.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.447+0000 7fd83d42e740 1 -- start start 2024-01-25T15:03:46.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.448+0000 7fd83d42e740 1 Processor -- start 2024-01-25T15:03:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.448+0000 7fd83d42e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0441412a0 0x55d04415c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.448+0000 7fd83d42e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044141c90 0x55d04415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.448+0000 7fd83d42e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044161890 0x55d044163c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.448+0000 7fd83d42e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0440631e0 con 0x55d044141c90 2024-01-25T15:03:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.448+0000 7fd83d42e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d044062e80 con 0x55d044161890 2024-01-25T15:03:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.448+0000 7fd83d42e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0440280c0 con 0x55d0441412a0 2024-01-25T15:03:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.448+0000 7fd833fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044141c90 0x55d04415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.448+0000 7fd833fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044141c90 0x55d04415c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41662/0 (socket says 172.21.15.170:41662) 2024-01-25T15:03:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.449+0000 7fd833fff640 1 -- 172.21.15.170:0/1149747627 learned_addr learned my addr 172.21.15.170:0/1149747627 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.449+0000 7fd8337fe640 1 --2- 172.21.15.170:0/1149747627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0441412a0 0x55d04415c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.449+0000 7fd83d42e740 10 client.0 _ll_register_callbacks cb 0x55d04404dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.449+0000 7fd8337fe640 1 --2- 172.21.15.170:0/1149747627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044161890 0x55d044163c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.452 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.449+0000 7fd833fff640 1 -- 172.21.15.170:0/1149747627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0441412a0 msgr2=0x55d04415c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:46.452 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.449+0000 7fd833fff640 1 --2- 172.21.15.170:0/1149747627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0441412a0 0x55d04415c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.452 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.449+0000 7fd833fff640 1 -- 172.21.15.170:0/1149747627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044161890 msgr2=0x55d044163c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:46.452 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.449+0000 7fd833fff640 1 --2- 172.21.15.170:0/1149747627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044161890 0x55d044163c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.452 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.449+0000 7fd833fff640 1 -- 172.21.15.170:0/1149747627 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82802de70 con 0x55d044141c90 2024-01-25T15:03:46.452 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.449+0000 7fd833fff640 1 --2- 172.21.15.170:0/1149747627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044141c90 0x55d04415c8d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd824009ee0 tx=0x7fd824011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44a7170b5962f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:46.452 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.449+0000 7fd8137fe640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:46.452 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.450+0000 7fd8137fe640 1 -- 172.21.15.170:0/1149747627 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824015660 con 0x55d044141c90 2024-01-25T15:03:46.452 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.450+0000 7fd83d42e740 1 -- 172.21.15.170:0/1149747627 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d0440a3040 con 0x55d044141c90 2024-01-25T15:03:46.452 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.450+0000 7fd8137fe640 1 -- 172.21.15.170:0/1149747627 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fd8240157c0 con 0x55d044141c90 2024-01-25T15:03:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.450+0000 7fd8137fe640 1 -- 172.21.15.170:0/1149747627 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8240159a0 con 0x55d044141c90 2024-01-25T15:03:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.450+0000 7fd83d42e740 10 client.16065 fetch_fsmap learned FSMap version 36 2024-01-25T15:03:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.450+0000 7fd83d42e740 1 -- 172.21.15.170:0/1149747627 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d0440a86d0 con 0x55d044141c90 2024-01-25T15:03:46.453 INFO:tasks.workunit.client.0.smithi170.stdout:7/835: write d8/d20/d2a/d35/f37 [352669,51289] 0 2024-01-25T15:03:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.451+0000 7fd8137fe640 1 -- 172.21.15.170:0/1149747627 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd8240143e0 con 0x55d044141c90 2024-01-25T15:03:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.451+0000 7fd8137fe640 1 -- 172.21.15.170:0/1149747627 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fd82401d3b0 con 0x55d044141c90 2024-01-25T15:03:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.451+0000 7fd83d42e740 10 client.16065 fetch_fsmap finished waiting for FSMap version 36 2024-01-25T15:03:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.451+0000 7fd83d42e740 10 client.16065 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.451+0000 7fd83d42e740 20 client.16065 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.451+0000 7fd83d42e740 1 --2- 172.21.15.170:0/1149747627 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d044168660 0x55d04416ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.451+0000 7fd83d42e740 4 client.16065 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:03:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.451+0000 7fd83d42e740 1 -- 172.21.15.170:0/1149747627 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d0440a3040 con 0x55d044168660 2024-01-25T15:03:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.452+0000 7fd8337fe640 1 --2- 172.21.15.170:0/1149747627 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d044168660 0x55d04416ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.455 INFO:tasks.workunit.client.0.smithi170.stdout:5/734: mknod d5/d54/dc6/cf6 0 2024-01-25T15:03:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.454+0000 7fd8337fe640 1 --2- 172.21.15.170:0/1149747627 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d044168660 0x55d04416ab00 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c496d78203e5af1 server_cookie=289c16939cae79b in_seq=0 out_seq=0 2024-01-25T15:03:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.454+0000 7fd8137fe640 10 client.16065 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:46.455 INFO:tasks.workunit.client.0.smithi170.stdout:4/730: unlink d6/d28/d59/f6f 0 2024-01-25T15:03:46.456 INFO:tasks.workunit.client.0.smithi170.stdout:6/845: dwrite d2/d7/d23/d19/d2a/fe1 [0,4194304] 0 2024-01-25T15:03:46.458 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.458+0000 7fd8137fe640 1 -- 172.21.15.170:0/1149747627 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d0440a3040 con 0x55d044168660 2024-01-25T15:03:46.458 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.458+0000 7fd8137fe640 10 client.16065 handle_command_reply: tid=0 2024-01-25T15:03:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.458+0000 7fd83d42e740 1 client.16065 shutdown 2024-01-25T15:03:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.459+0000 7fd83d42e740 1 -- 172.21.15.170:0/1149747627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044141c90 msgr2=0x55d04415c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.459+0000 7fd83d42e740 1 --2- 172.21.15.170:0/1149747627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044141c90 0x55d04415c8d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd824009ee0 tx=0x7fd824011630 comp rx=0 tx=0).stop 2024-01-25T15:03:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.459+0000 7fd83d42e740 1 -- 172.21.15.170:0/1149747627 shutdown_connections 2024-01-25T15:03:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.459+0000 7fd83d42e740 1 --2- 172.21.15.170:0/1149747627 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d044168660 0x55d04416ab00 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.459+0000 7fd83d42e740 1 --2- 172.21.15.170:0/1149747627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044161890 0x55d044163c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.459+0000 7fd83d42e740 1 --2- 172.21.15.170:0/1149747627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044141c90 0x55d04415c8d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.459+0000 7fd83d42e740 1 --2- 172.21.15.170:0/1149747627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0441412a0 0x55d04415c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.459+0000 7fd8137fe640 0 client.16065 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.459+0000 7fd83d42e740 1 -- 172.21.15.170:0/1149747627 >> 172.21.15.170:0/1149747627 conn(0x55d04413c810 msgr2=0x55d04413ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:46.461 INFO:tasks.workunit.client.0.smithi170.stdout:1/758: dread d0/d20/d28/f6a [0,4194304] 0 2024-01-25T15:03:46.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.459+0000 7fd83d42e740 1 -- 172.21.15.170:0/1149747627 shutdown_connections 2024-01-25T15:03:46.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.459+0000 7fd83d42e740 1 -- 172.21.15.170:0/1149747627 wait complete. 2024-01-25T15:03:46.461 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.460+0000 7fd83d42e740 20 client.16065 trim_cache size 0 max 16384 2024-01-25T15:03:46.462 INFO:tasks.workunit.client.0.smithi170.stdout:3/839: dread d3/d10/fe [0,4194304] 0 2024-01-25T15:03:46.466 INFO:tasks.workunit.client.0.smithi170.stdout:4/731: mkdir d6/d7/d31/d46/de4 0 2024-01-25T15:03:46.466 INFO:tasks.workunit.client.0.smithi170.stdout:5/735: creat d5/d54/d85/d2c/d51/d41/dcf/ff7 x:0 0 0 2024-01-25T15:03:46.466 INFO:tasks.workunit.client.0.smithi170.stdout:6/846: symlink d2/ddb/l11e 0 2024-01-25T15:03:46.470 INFO:tasks.workunit.client.0.smithi170.stdout:6/847: mknod d2/d7/d23/d19/d2a/d43/d98/d113/d74/dc1/dcf/c11f 0 2024-01-25T15:03:46.471 INFO:tasks.workunit.client.0.smithi170.stdout:2/741: rename d10/d1e/f2e to d10/d1e/d5e/d73/df0/f106 0 2024-01-25T15:03:46.471 INFO:tasks.workunit.client.0.smithi170.stdout:9/849: dwrite d5/df/d2e/f39 [4194304,4194304] 0 2024-01-25T15:03:46.472 INFO:tasks.workunit.client.0.smithi170.stdout:4/732: getdents d6/d7/d31/d46/dc6 0 2024-01-25T15:03:46.482 INFO:tasks.workunit.client.0.smithi170.stdout:6/848: dread d2/d7/d23/d19/d2a/d43/d98/f62 [0,4194304] 0 2024-01-25T15:03:46.482 INFO:tasks.workunit.client.0.smithi170.stdout:6/849: fdatasync d2/d7/d1b/d28/f8a 0 2024-01-25T15:03:46.483 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd83d42e740 1 Processor -- start 2024-01-25T15:03:46.484 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd83d42e740 1 -- start start 2024-01-25T15:03:46.484 INFO:tasks.workunit.client.0.smithi170.stdout:7/836: dwrite d8/d20/d2a/fa2 [4194304,4194304] 0 2024-01-25T15:03:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd83d42e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0441412a0 0x55d044163c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd83d42e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044161890 0x55d0441466c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd83d42e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044142550 0x55d0441789a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd83d42e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d04413c680 con 0x55d044161890 2024-01-25T15:03:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd83d42e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d044164de0 con 0x55d044142550 2024-01-25T15:03:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd83d42e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0441681f0 con 0x55d0441412a0 2024-01-25T15:03:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd833fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044161890 0x55d0441466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd833fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044161890 0x55d0441466c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41678/0 (socket says 172.21.15.170:41678) 2024-01-25T15:03:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd833fff640 1 -- 172.21.15.170:0/279439415 learned_addr learned my addr 172.21.15.170:0/279439415 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd8337fe640 1 --2- 172.21.15.170:0/279439415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044142550 0x55d0441789a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd833fff640 1 -- 172.21.15.170:0/279439415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0441412a0 msgr2=0x55d044163c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd833fff640 1 --2- 172.21.15.170:0/279439415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0441412a0 0x55d044163c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd833fff640 1 -- 172.21.15.170:0/279439415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044142550 msgr2=0x55d0441789a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd833fff640 1 --2- 172.21.15.170:0/279439415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044142550 0x55d0441789a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd833fff640 1 -- 172.21.15.170:0/279439415 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d044045060 con 0x55d044161890 2024-01-25T15:03:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.483+0000 7fd8337fe640 1 --2- 172.21.15.170:0/279439415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044142550 0x55d0441789a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:03:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.484+0000 7fd833fff640 1 --2- 172.21.15.170:0/279439415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044161890 0x55d0441466c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd824000c00 tx=0x7fd824009150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d16336804d3fe3 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.484+0000 7fd819ffb640 1 -- 172.21.15.170:0/279439415 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824009a20 con 0x55d044161890 2024-01-25T15:03:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.484+0000 7fd819ffb640 1 -- 172.21.15.170:0/279439415 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd824005e50 con 0x55d044161890 2024-01-25T15:03:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.484+0000 7fd819ffb640 1 -- 172.21.15.170:0/279439415 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8240062a0 con 0x55d044161890 2024-01-25T15:03:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 -- 172.21.15.170:0/279439415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044161890 msgr2=0x55d0441466c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 --2- 172.21.15.170:0/279439415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044161890 0x55d0441466c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd824000c00 tx=0x7fd824009150 comp rx=0 tx=0).stop 2024-01-25T15:03:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 -- 172.21.15.170:0/279439415 shutdown_connections 2024-01-25T15:03:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 --2- 172.21.15.170:0/279439415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044142550 0x55d0441789a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 --2- 172.21.15.170:0/279439415 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d044161890 0x55d0441466c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 --2- 172.21.15.170:0/279439415 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d0441412a0 0x55d044163c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 -- 172.21.15.170:0/279439415 >> 172.21.15.170:0/279439415 conn(0x55d04413c810 msgr2=0x55d04413cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 -- 172.21.15.170:0/279439415 shutdown_connections 2024-01-25T15:03:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 -- 172.21.15.170:0/279439415 wait complete. 2024-01-25T15:03:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 -- start start 2024-01-25T15:03:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 Processor -- start 2024-01-25T15:03:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0441412a0 0x55d0441b9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d044142550 0x55d0441bbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044161890 0x55d0441be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0441be800 con 0x55d0441412a0 2024-01-25T15:03:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0441be970 con 0x55d044161890 2024-01-25T15:03:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0441beb30 con 0x55d044142550 2024-01-25T15:03:46.492 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd83d42e740 10 client.0 _ll_register_callbacks cb 0x7fd828009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:03:46.492 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd8337fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0441412a0 0x55d0441b9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.492 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.485+0000 7fd8337fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0441412a0 0x55d0441b9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:41694/0 (socket says 172.21.15.170:41694) 2024-01-25T15:03:46.492 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd8337fe640 1 -- 172.21.15.170:0/4162361545 learned_addr learned my addr 172.21.15.170:0/4162361545 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:03:46.492 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd833fff640 1 --2- 172.21.15.170:0/4162361545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d044142550 0x55d0441bbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.492 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd8337fe640 1 --2- 172.21.15.170:0/4162361545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044161890 0x55d0441be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.492 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd8337fe640 1 -- 172.21.15.170:0/4162361545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d044142550 msgr2=0x55d0441bbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:46.492 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd8337fe640 1 --2- 172.21.15.170:0/4162361545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d044142550 0x55d0441bbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.492 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd8337fe640 1 -- 172.21.15.170:0/4162361545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044161890 msgr2=0x55d0441be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:03:46.492 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd8337fe640 1 --2- 172.21.15.170:0/4162361545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044161890 0x55d0441be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:46.492 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd8337fe640 1 -- 172.21.15.170:0/4162361545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd828052040 con 0x55d0441412a0 2024-01-25T15:03:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd833fff640 1 --2- 172.21.15.170:0/4162361545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d044142550 0x55d0441bbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:03:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd8337fe640 1 --2- 172.21.15.170:0/4162361545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0441412a0 0x55d0441b9640 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd82802c260 tx=0x7fd82802c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2229d2b7c6eb75e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:03:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd8137fe640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:03:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd8137fe640 1 -- 172.21.15.170:0/4162361545 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82804f040 con 0x55d0441412a0 2024-01-25T15:03:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd8137fe640 1 -- 172.21.15.170:0/4162361545 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fd828000e40 con 0x55d0441412a0 2024-01-25T15:03:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd83d42e740 1 -- 172.21.15.170:0/4162361545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd828004040 con 0x55d0441412a0 2024-01-25T15:03:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd8137fe640 1 -- 172.21.15.170:0/4162361545 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8280048d0 con 0x55d0441412a0 2024-01-25T15:03:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd83d42e740 10 client.16071 fetch_fsmap learned FSMap version 36 2024-01-25T15:03:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd83d42e740 1 -- 172.21.15.170:0/4162361545 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) v3 -- 0x55d0440a86d0 con 0x55d0441412a0 2024-01-25T15:03:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd8137fe640 1 -- 172.21.15.170:0/4162361545 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd828004040 con 0x55d0441412a0 2024-01-25T15:03:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd8137fe640 1 -- 172.21.15.170:0/4162361545 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 36) v1 ==== 7934+0+0 (secure 0 0 0) 0x7fd828061020 con 0x55d0441412a0 2024-01-25T15:03:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.486+0000 7fd83d42e740 10 client.16071 fetch_fsmap finished waiting for FSMap version 36 2024-01-25T15:03:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.487+0000 7fd83d42e740 10 client.16071 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:03:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.487+0000 7fd83d42e740 20 client.16071 populate_metadata read hostname 'smithi170' 2024-01-25T15:03:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.487+0000 7fd83d42e740 1 --2- 172.21.15.170:0/4162361545 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d0441c01a0 0x55d0441c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:03:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.487+0000 7fd83d42e740 4 client.16071 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-25T15:03:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.487+0000 7fd83d42e740 1 -- 172.21.15.170:0/4162361545 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d0440a2d60 con 0x55d0441c01a0 2024-01-25T15:03:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.487+0000 7fd833fff640 1 --2- 172.21.15.170:0/4162361545 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d0441c01a0 0x55d0441c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:03:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.487+0000 7fd833fff640 1 --2- 172.21.15.170:0/4162361545 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d0441c01a0 0x55d0441c25c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f55923e40925d9b5 server_cookie=890d49d7eaa33890 in_seq=0 out_seq=0 2024-01-25T15:03:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:46.487+0000 7fd8137fe640 10 client.16071 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:46.500 INFO:tasks.workunit.client.0.smithi170.stdout:3/840: dwrite d3/d10/d1e/d21/d41/d4a/f75 [4194304,4194304] 0 2024-01-25T15:03:46.501 INFO:tasks.workunit.client.0.smithi170.stdout:3/841: symlink d3/d10/d6d/d98/l116 0 2024-01-25T15:03:46.503 INFO:tasks.workunit.client.0.smithi170.stdout:1/759: dwrite d0/f3d [4194304,4194304] 0 2024-01-25T15:03:46.504 INFO:tasks.workunit.client.0.smithi170.stdout:1/760: chown d0/d50/d8e/d9e/fd4 98 1 2024-01-25T15:03:46.504 INFO:tasks.workunit.client.0.smithi170.stdout:3/842: mkdir d3/d1c/d2b/d5c/dad/d117 0 2024-01-25T15:03:46.504 INFO:tasks.workunit.client.0.smithi170.stdout:3/843: fsync d3/d10/d13/f1f 0 2024-01-25T15:03:46.504 INFO:tasks.workunit.client.0.smithi170.stdout:5/736: dwrite d5/d54/d85/f1c [0,4194304] 0 2024-01-25T15:03:46.504 INFO:tasks.workunit.client.0.smithi170.stdout:3/844: fdatasync d3/d10/d13/d1b/d29/f8b 0 2024-01-25T15:03:46.504 INFO:tasks.workunit.client.0.smithi170.stdout:3/845: fdatasync d3/d10/d13/d1b/d29/f8b 0 2024-01-25T15:03:46.504 INFO:tasks.workunit.client.0.smithi170.stdout:3/846: write d3/d1c/d2b/d5c/dad/f114 [588010,40264] 0 2024-01-25T15:03:46.507 INFO:tasks.workunit.client.0.smithi170.stdout:5/737: unlink d5/d54/d85/d2c/d51/d41/dcf/ff7 0 2024-01-25T15:03:46.509 INFO:tasks.workunit.client.0.smithi170.stdout:5/738: creat d5/d54/d85/d2c/d45/dba/dbd/ff8 x:0 0 0 2024-01-25T15:03:46.512 INFO:tasks.workunit.client.0.smithi170.stdout:2/742: rename d10/d1b/d5f to d10/d1e/d32/d62/d74/d107 0 2024-01-25T15:03:46.515 INFO:tasks.workunit.client.0.smithi170.stdout:6/850: rename d2/d7/d23/d19/d2a/d43/d44/f66 to d2/d7/d23/d19/d2a/d43/d98/d113/dd4/ded/f120 0 2024-01-25T15:03:46.515 INFO:tasks.workunit.client.0.smithi170.stdout:0/858: sync 2024-01-25T15:03:46.515 INFO:tasks.workunit.client.0.smithi170.stdout:0/859: truncate d8/d10/d2d/d53/f63 4332946 0 2024-01-25T15:03:46.515 INFO:tasks.workunit.client.0.smithi170.stdout:0/860: dread - d8/d10/d2d/d53/df4/dc6/dc9/dca/ffa zero size 2024-01-25T15:03:46.515 INFO:tasks.workunit.client.0.smithi170.stdout:0/861: write d8/d10/f110 [720988,116113] 0 2024-01-25T15:03:46.532 INFO:tasks.workunit.client.0.smithi170.stdout:3/847: dwrite d3/d10/d1e/d21/d41/d77/f76 [0,4194304] 0 2024-01-25T15:03:46.533 INFO:tasks.workunit.client.0.smithi170.stdout:2/743: dread d10/d1e/d32/d3e/d41/dc4/dc6/f3b [0,4194304] 0 2024-01-25T15:03:46.539 INFO:tasks.workunit.client.0.smithi170.stdout:5/739: dwrite d5/d58/da9/fd4 [0,4194304] 0 2024-01-25T15:03:46.540 INFO:tasks.workunit.client.0.smithi170.stdout:5/740: chown d5/d54/d85/d2c/d45/d56/d72 0 1 2024-01-25T15:03:46.541 INFO:tasks.workunit.client.0.smithi170.stdout:2/744: dread d10/fd8 [0,4194304] 0 2024-01-25T15:03:46.548 INFO:tasks.workunit.client.0.smithi170.stdout:2/745: link d10/d1e/d32/f66 d10/d1e/d32/d3e/d41/dc4/dc6/d42/f108 0 2024-01-25T15:03:46.550 INFO:tasks.workunit.client.0.smithi170.stdout:2/746: write d10/d1e/d32/f66 [1433155,120131] 0 2024-01-25T15:03:46.571 INFO:tasks.workunit.client.0.smithi170.stdout:2/747: dwrite d10/d1e/f91 [0,4194304] 0 2024-01-25T15:03:46.571 INFO:tasks.workunit.client.0.smithi170.stdout:2/748: readlink l2 0 2024-01-25T15:03:46.909 INFO:tasks.workunit.client.0.smithi170.stdout:1/761: link d0/d20/d3a/d6e/l85 d0/d20/d28/d2a/d4a/dbe/lfe 0 2024-01-25T15:03:46.911 INFO:tasks.workunit.client.0.smithi170.stdout:3/848: mkdir d3/d1c/d2b/d5c/d97/d118 0 2024-01-25T15:03:46.919 INFO:tasks.workunit.client.0.smithi170.stdout:1/762: write d0/d20/f4d [420159,39355] 0 2024-01-25T15:03:46.919 INFO:tasks.workunit.client.0.smithi170.stdout:3/849: dread d3/d3b/dc6/f4d [0,4194304] 0 2024-01-25T15:03:46.922 INFO:tasks.workunit.client.0.smithi170.stdout:1/763: symlink d0/d2e/lff 0 2024-01-25T15:03:46.924 INFO:tasks.workunit.client.0.smithi170.stdout:1/764: rmdir d0/d20/d28/d2a/d4a/d56 39 2024-01-25T15:03:46.933 INFO:tasks.workunit.client.0.smithi170.stdout:1/765: write d0/d20/d28/ffd [9236,40398] 0 2024-01-25T15:03:46.941 INFO:tasks.workunit.client.0.smithi170.stdout:3/850: dwrite d3/d10/d1e/d21/d41/d77/fa7 [0,4194304] 0 2024-01-25T15:03:47.038 INFO:tasks.workunit.client.0.smithi170.stdout:6/851: link d2/d7/d23/d19/d2a/d43/d98/f3f d2/d7/d23/d19/d2a/d43/d98/d113/d74/dc1/f121 0 2024-01-25T15:03:47.041 INFO:tasks.workunit.client.0.smithi170.stdout:6/852: dread d2/d7/d1b/d28/da7/fde [0,4194304] 0 2024-01-25T15:03:47.041 INFO:tasks.workunit.client.0.smithi170.stdout:6/853: chown d2/d7/d1b/d28/c5f 7 1 2024-01-25T15:03:47.041 INFO:tasks.workunit.client.0.smithi170.stdout:7/837: rename d8/f52 to d8/d20/d3b/f126 0 2024-01-25T15:03:47.042 INFO:tasks.workunit.client.0.smithi170.stdout:6/854: symlink d2/d7/d1b/d78/d11a/l122 0 2024-01-25T15:03:47.043 INFO:tasks.workunit.client.0.smithi170.stdout:7/838: creat d8/d20/d45/d68/d71/d8c/f127 x:0 0 0 2024-01-25T15:03:47.043 INFO:tasks.workunit.client.0.smithi170.stdout:7/839: write d8/d20/d2a/f34 [2634232,7614] 0 2024-01-25T15:03:47.043 INFO:tasks.workunit.client.0.smithi170.stdout:7/840: chown d8/d20/d2a/d35/d55/c79 28975 1 2024-01-25T15:03:47.045 INFO:tasks.workunit.client.0.smithi170.stdout:6/855: truncate d2/d7/d23/d19/d2a/d43/d98/d113/d5d/d94/fa2 110417 0 2024-01-25T15:03:47.046 INFO:tasks.workunit.client.0.smithi170.stdout:6/856: rmdir d2/d7/d23/d19/d2a/d43/d98/d113/d74/dc1/dcf/d100 39 2024-01-25T15:03:47.046 INFO:tasks.workunit.client.0.smithi170.stdout:7/841: creat d8/d20/d3b/f128 x:0 0 0 2024-01-25T15:03:47.046 INFO:tasks.workunit.client.0.smithi170.stdout:7/842: chown d8/d20/d45/d68/d71/d8c/fbf 30284413 1 2024-01-25T15:03:47.052 INFO:tasks.workunit.client.0.smithi170.stdout:5/741: rename d5/d54/d85/d2c/d45/dba to d5/d58/da9/df9 0 2024-01-25T15:03:47.052 INFO:tasks.workunit.client.0.smithi170.stdout:0/862: link d8/d10/d2d/c44 d8/d10/d2d/d53/df4/dc6/dc9/df9/c12a 0 2024-01-25T15:03:47.055 INFO:tasks.workunit.client.0.smithi170.stdout:7/843: dread d8/d20/f2e [0,4194304] 0 2024-01-25T15:03:47.055 INFO:tasks.workunit.client.0.smithi170.stdout:7/844: write d8/d110/f111 [151868,112682] 0 2024-01-25T15:03:47.055 INFO:tasks.workunit.client.0.smithi170.stdout:1/766: rename d0/d20/d3a/c75 to d0/d2e/df2/c100 0 2024-01-25T15:03:47.055 INFO:tasks.workunit.client.0.smithi170.stdout:1/767: stat d0/d20/d28/d2a/l30 0 2024-01-25T15:03:47.056 INFO:tasks.workunit.client.0.smithi170.stdout:5/742: truncate d5/d54/d85/f5a 1546538 0 2024-01-25T15:03:47.058 INFO:tasks.workunit.client.0.smithi170.stdout:5/743: creat d5/db9/ffa x:0 0 0 2024-01-25T15:03:47.058 INFO:tasks.workunit.client.0.smithi170.stdout:5/744: fdatasync d5/d54/d85/d3f/d86/da5/fb2 0 2024-01-25T15:03:47.058 INFO:tasks.workunit.client.0.smithi170.stdout:5/745: chown d5/d58/da9/lef 732 1 2024-01-25T15:03:47.060 INFO:tasks.workunit.client.0.smithi170.stdout:6/857: write d2/fa0 [1547591,130782] 0 2024-01-25T15:03:47.061 INFO:tasks.workunit.client.0.smithi170.stdout:3/851: rename d3/f17 to d3/d10/d1e/f119 0 2024-01-25T15:03:47.063 INFO:tasks.workunit.client.0.smithi170.stdout:7/845: write d8/d20/d45/d8e/f11e [735627,44813] 0 2024-01-25T15:03:47.064 INFO:tasks.workunit.client.0.smithi170.stdout:5/746: creat d5/d54/d85/d2c/d51/d3d/ffb x:0 0 0 2024-01-25T15:03:47.065 INFO:tasks.workunit.client.0.smithi170.stdout:6/858: write d2/d7/d23/fa5 [1092939,92377] 0 2024-01-25T15:03:47.067 INFO:tasks.workunit.client.0.smithi170.stdout:0/863: mkdir d8/d11c/d79/d7e/d10d/de7/d12b 0 2024-01-25T15:03:47.068 INFO:tasks.workunit.client.0.smithi170.stdout:3/852: symlink d3/d10/d13/d1b/d85/l11a 0 2024-01-25T15:03:47.071 INFO:tasks.workunit.client.0.smithi170.stdout:5/747: rename d5/d54/d85/ca7 to d5/d54/d85/d3f/d86/da5/cfc 0 2024-01-25T15:03:47.072 INFO:tasks.workunit.client.0.smithi170.stdout:6/859: creat d2/d7/d23/d19/d2a/d6b/dad/dd7/f123 x:0 0 0 2024-01-25T15:03:47.072 INFO:tasks.workunit.client.0.smithi170.stdout:1/768: dwrite d0/d2e/ff5 [0,4194304] 0 2024-01-25T15:03:47.075 INFO:tasks.workunit.client.0.smithi170.stdout:5/748: symlink d5/d54/d85/d2c/d51/d3d/lfd 0 2024-01-25T15:03:47.079 INFO:tasks.workunit.client.0.smithi170.stdout:5/749: mknod d5/d54/d85/d2c/d45/d56/cfe 0 2024-01-25T15:03:47.079 INFO:tasks.workunit.client.0.smithi170.stdout:5/750: chown d5/fd 26734264 1 2024-01-25T15:03:47.081 INFO:tasks.workunit.client.0.smithi170.stdout:6/860: rename d2/d7/d23/d19/d2a/f99 to d2/d7/d23/d19/d2a/d6b/dad/dcb/f124 0 2024-01-25T15:03:47.081 INFO:tasks.workunit.client.0.smithi170.stdout:6/861: dread - d2/d7/d23/d19/d2a/d6b/dad/f11c zero size 2024-01-25T15:03:47.081 INFO:tasks.workunit.client.0.smithi170.stdout:6/862: dread - d2/d7/d23/d19/d2a/d43/d98/d113/d5d/d94/d97/db4/f107 zero size 2024-01-25T15:03:47.081 INFO:tasks.workunit.client.0.smithi170.stdout:6/863: stat d2/cc 0 2024-01-25T15:03:47.081 INFO:tasks.workunit.client.0.smithi170.stdout:6/864: fdatasync d2/d7/d23/d19/f5e 0 2024-01-25T15:03:47.083 INFO:tasks.workunit.client.0.smithi170.stdout:6/865: symlink d2/d7/d23/d19/d2a/d43/d98/d113/d74/l125 0 2024-01-25T15:03:47.083 INFO:tasks.workunit.client.0.smithi170.stdout:1/769: dread d0/d20/d28/f6a [0,4194304] 0 2024-01-25T15:03:47.084 INFO:tasks.workunit.client.0.smithi170.stdout:1/770: stat d0/d20/d28/d2a/d4a/d56/d5b/c5f 0 2024-01-25T15:03:47.085 INFO:tasks.workunit.client.0.smithi170.stdout:1/771: read d0/d20/d28/d7b/f93 [397664,78177] 0 2024-01-25T15:03:47.087 INFO:tasks.workunit.client.0.smithi170.stdout:5/751: rename d5/d54/d85/d3f/d86/c81 to d5/d54/d85/d3f/d8f/db8/cff 0 2024-01-25T15:03:47.088 INFO:tasks.workunit.client.0.smithi170.stdout:5/752: truncate d5/d54/d85/d2c/d51/d41/f90 1624779 0 2024-01-25T15:03:47.088 INFO:tasks.workunit.client.0.smithi170.stdout:5/753: read - d5/d54/d85/d3f/d86/da5/fb2 zero size 2024-01-25T15:03:47.088 INFO:tasks.workunit.client.0.smithi170.stdout:8/962: sync 2024-01-25T15:03:47.089 INFO:tasks.workunit.client.0.smithi170.stdout:2/749: sync 2024-01-25T15:03:47.089 INFO:tasks.workunit.client.0.smithi170.stdout:4/733: sync 2024-01-25T15:03:47.089 INFO:tasks.workunit.client.0.smithi170.stdout:9/850: sync 2024-01-25T15:03:47.089 INFO:tasks.workunit.client.0.smithi170.stdout:4/734: creat d6/d7/d9f/fe5 x:0 0 0 2024-01-25T15:03:47.089 INFO:tasks.workunit.client.0.smithi170.stdout:4/735: fdatasync d6/d7/d1b/f41 0 2024-01-25T15:03:47.089 INFO:tasks.workunit.client.0.smithi170.stdout:5/754: dread d5/d54/d85/d2c/d34/d69/fbb [0,4194304] 0 2024-01-25T15:03:47.090 INFO:tasks.workunit.client.0.smithi170.stdout:2/750: write d10/d1e/d32/d62/d8d/f96 [543785,49126] 0 2024-01-25T15:03:47.090 INFO:tasks.workunit.client.0.smithi170.stdout:2/751: fdatasync d10/fd8 0 2024-01-25T15:03:47.090 INFO:tasks.workunit.client.0.smithi170.stdout:6/866: read d2/d7/d23/d19/f5e [3575714,32030] 0 2024-01-25T15:03:47.090 INFO:tasks.workunit.client.0.smithi170.stdout:8/963: mkdir d3/d7/d3a/d8d/d137/d150 0 2024-01-25T15:03:47.090 INFO:tasks.workunit.client.0.smithi170.stdout:8/964: chown d3/d7/d22/d23/d48/d52/d47/de2/d104/fe4 355292 1 2024-01-25T15:03:47.090 INFO:tasks.workunit.client.0.smithi170.stdout:2/752: readlink d10/d1e/d5e/d73/d9e/da3/ldf 0 2024-01-25T15:03:47.091 INFO:tasks.workunit.client.0.smithi170.stdout:2/753: mkdir d10/d1e/d32/d3e/d41/dc4/dc6/d42/d109 0 2024-01-25T15:03:47.094 INFO:tasks.workunit.client.0.smithi170.stdout:9/851: rename d5/df/d2e/d77/d21/d46/d18/c9f to d5/df/d16/d52/d9c/c11d 0 2024-01-25T15:03:47.096 INFO:tasks.workunit.client.0.smithi170.stdout:3/853: dwrite d3/d10/d13/d1b/d85/fcd [0,4194304] 0 2024-01-25T15:03:47.097 INFO:tasks.workunit.client.0.smithi170.stdout:0/864: dwrite d8/d11c/d79/d7e/d10d/de7/da2/fb1 [0,4194304] 0 2024-01-25T15:03:47.098 INFO:tasks.workunit.client.0.smithi170.stdout:6/867: mknod d2/d7/d23/d19/d2a/d43/d98/d113/d5d/d94/d97/db4/dc7/d111/c126 0 2024-01-25T15:03:47.099 INFO:tasks.workunit.client.0.smithi170.stdout:8/965: link d3/d7/d3a/d8d/dd5/c10f d3/d7/d22/d23/d25/d41/d61/d139/c151 0 2024-01-25T15:03:47.101 INFO:tasks.workunit.client.0.smithi170.stdout:9/852: getdents d5/df/d2e/d77/d21/d34/d3e 0 2024-01-25T15:03:47.101 INFO:tasks.workunit.client.0.smithi170.stdout:8/966: dread d3/d7/d1e/d7c/d9f/fc2 [0,4194304] 0 2024-01-25T15:03:47.106 INFO:tasks.workunit.client.0.smithi170.stdout:4/736: dread d6/d7/fa2 [0,4194304] 0 2024-01-25T15:03:47.108 INFO:tasks.workunit.client.0.smithi170.stdout:4/737: mknod d6/d28/dc2/ce6 0 2024-01-25T15:03:47.109 INFO:tasks.workunit.client.0.smithi170.stdout:3/854: symlink d3/d10/d13/d1b/d29/db7/l11b 0 2024-01-25T15:03:47.109 INFO:tasks.workunit.client.0.smithi170.stdout:4/738: creat d6/d28/d61/dad/fe7 x:0 0 0 2024-01-25T15:03:47.112 INFO:tasks.workunit.client.0.smithi170.stdout:1/772: dwrite d0/d20/d28/d2a/d4a/dbe/fd7 [0,4194304] 0 2024-01-25T15:03:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.112+0000 7fd8137fe640 1 -- 172.21.15.170:0/4162361545 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d0440a2d60 con 0x55d0441c01a0 2024-01-25T15:03:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.112+0000 7fd8137fe640 10 client.16071 handle_command_reply: tid=0 2024-01-25T15:03:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.112+0000 7fd83d42e740 1 client.16071 shutdown 2024-01-25T15:03:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.113+0000 7fd83d42e740 1 -- 172.21.15.170:0/4162361545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0441412a0 msgr2=0x55d0441b9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.113+0000 7fd83d42e740 1 --2- 172.21.15.170:0/4162361545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0441412a0 0x55d0441b9640 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd82802c260 tx=0x7fd82802c9e0 comp rx=0 tx=0).stop 2024-01-25T15:03:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.113+0000 7fd83d42e740 1 -- 172.21.15.170:0/4162361545 shutdown_connections 2024-01-25T15:03:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.113+0000 7fd83d42e740 1 --2- 172.21.15.170:0/4162361545 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55d0441c01a0 0x55d0441c25c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.113+0000 7fd83d42e740 1 --2- 172.21.15.170:0/4162361545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55d044161890 0x55d0441be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.113+0000 7fd8137fe640 0 client.16071 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:03:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.113+0000 7fd83d42e740 1 --2- 172.21.15.170:0/4162361545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55d044142550 0x55d0441bbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:47.114 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.113+0000 7fd83d42e740 1 --2- 172.21.15.170:0/4162361545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55d0441412a0 0x55d0441b9640 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.113+0000 7fd83d42e740 1 -- 172.21.15.170:0/4162361545 >> 172.21.15.170:0/4162361545 conn(0x55d04413c810 msgr2=0x55d044143070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.113+0000 7fd83d42e740 1 -- 172.21.15.170:0/4162361545 shutdown_connections 2024-01-25T15:03:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.113+0000 7fd83d42e740 1 -- 172.21.15.170:0/4162361545 wait complete. 2024-01-25T15:03:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.113+0000 7fd83d42e740 20 client.16071 trim_cache size 0 max 16384 2024-01-25T15:03:47.115 INFO:tasks.workunit.client.0.smithi170.stdout:6/868: symlink d2/d7/d23/d19/d2a/d6b/l127 0 2024-01-25T15:03:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:{ 2024-01-25T15:03:47.115 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "message": "", 2024-01-25T15:03:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "return_code": 0 2024-01-25T15:03:47.116 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:} 2024-01-25T15:03:47.116 INFO:tasks.workunit.client.0.smithi170.stdout:1/773: mkdir d0/d20/d28/d2a/d4a/d56/d5b/d72/d101 0 2024-01-25T15:03:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.114+0000 7fd83a790640 1 -- 172.21.15.170:0/1718675890 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd81c0a1380 msgr2=0x7fd81c0a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.114+0000 7fd83a790640 1 --2- 172.21.15.170:0/1718675890 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd81c0a1380 0x7fd81c0a3840 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd82c004fd0 tx=0x7fd82c0057a0 comp rx=0 tx=0).stop 2024-01-25T15:03:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.114+0000 7fd83a790640 1 -- 172.21.15.170:0/1718675890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8341a2a50 msgr2=0x7fd8341a4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:03:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.114+0000 7fd83a790640 1 --2- 172.21.15.170:0/1718675890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8341a2a50 0x7fd8341a4e40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd82c00eb10 tx=0x7fd82c00c2d0 comp rx=0 tx=0).stop 2024-01-25T15:03:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.114+0000 7fd83a790640 1 -- 172.21.15.170:0/1718675890 shutdown_connections 2024-01-25T15:03:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.114+0000 7fd83a790640 1 --2- 172.21.15.170:0/1718675890 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fd81c0a1380 0x7fd81c0a3840 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.114+0000 7fd83a790640 1 --2- 172.21.15.170:0/1718675890 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fd8341a2a50 0x7fd8341a4e40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:47.117 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.114+0000 7fd83a790640 1 --2- 172.21.15.170:0/1718675890 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fd8341048a0 0x7fd83419d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:47.118 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.114+0000 7fd83a790640 1 --2- 172.21.15.170:0/1718675890 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8340ff580 0x7fd83419d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:03:47.118 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.114+0000 7fd83a790640 1 -- 172.21.15.170:0/1718675890 >> 172.21.15.170:0/1718675890 conn(0x7fd8340fb180 msgr2=0x7fd834100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:03:47.118 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.114+0000 7fd83a790640 1 -- 172.21.15.170:0/1718675890 shutdown_connections 2024-01-25T15:03:47.118 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:03:47.114+0000 7fd83a790640 1 -- 172.21.15.170:0/1718675890 wait complete. 2024-01-25T15:03:47.118 INFO:tasks.workunit.client.0.smithi170.stdout:9/853: mkdir d5/df/d2e/d77/d21/d46/d18/dc0/d11e 0 2024-01-25T15:03:47.119 INFO:tasks.workunit.client.0.smithi170.stdout:3/855: creat d3/d10/d6d/d74/f11c x:0 0 0 2024-01-25T15:03:47.119 INFO:tasks.workunit.client.0.smithi170.stdout:0/865: dwrite d8/d10/d2d/d53/f7d [0,4194304] 0 2024-01-25T15:03:47.119 INFO:tasks.workunit.client.0.smithi170.stdout:0/866: stat d8/d9/f16 0 2024-01-25T15:03:47.123 INFO:tasks.workunit.client.0.smithi170.stdout:3/856: dread d3/d10/d13/f34 [0,4194304] 0 2024-01-25T15:03:47.123 INFO:tasks.workunit.client.0.smithi170.stdout:6/869: mkdir d2/d128 0 2024-01-25T15:03:47.124 INFO:tasks.workunit.client.0.smithi170.stdout:6/870: read - d2/d7/d23/d19/d2a/d43/d98/d113/d74/fd5 zero size 2024-01-25T15:03:47.125 INFO:tasks.workunit.client.0.smithi170.stdout:6/871: fdatasync d2/d7/d23/d19/d2a/d43/d98/d113/dd4/fd8 0 2024-01-25T15:03:47.125 INFO:tasks.workunit.client.0.smithi170.stdout:1/774: creat d0/d20/d28/d7b/dfc/f102 x:0 0 0 2024-01-25T15:03:47.125 INFO:tasks.workunit.client.0.smithi170.stdout:1/775: chown d0/d20/d28/c55 60786 1 2024-01-25T15:03:47.126 INFO:tasks.workunit.client.0.smithi170.stdout:7/846: unlink d8/d20/d2a/d35/f10f 0 2024-01-25T15:03:47.131 INFO:tasks.workunit.client.0.smithi170.stdout:8/967: getdents d3/d7/d3a/d8d/dd5 0 2024-01-25T15:03:47.131 INFO:tasks.workunit.client.0.smithi170.stdout:0/867: truncate d8/d9/f46 3006992 0 2024-01-25T15:03:47.135 INFO:tasks.workunit.client.0.smithi170.stdout:9/854: rmdir d5/df/d2e/d77/d21/d34 39 2024-01-25T15:03:47.136 INFO:tasks.workunit.client.0.smithi170.stdout:4/739: dwrite d6/d28/d59/fbe [0,4194304] 0 2024-01-25T15:03:47.140 INFO:tasks.workunit.client.0.smithi170.stdout:8/968: creat d3/d7/d3a/d8d/f152 x:0 0 0 2024-01-25T15:03:47.140 INFO:tasks.workunit.client.0.smithi170.stdout:8/969: read - d3/d7/d22/d23/d48/d52/d47/de2/f128 zero size 2024-01-25T15:03:47.143 INFO:tasks.workunit.client.0.smithi170.stdout:4/740: rmdir d6/d7/d1b 39 2024-01-25T15:03:47.143 INFO:tasks.workunit.client.0.smithi170.stdout:4/741: write d6/d7/d31/f7b [2997733,71152] 0 2024-01-25T15:03:47.143 INFO:tasks.workunit.client.0.smithi170.stdout:4/742: write d6/f99 [1229099,50730] 0 2024-01-25T15:03:47.145 INFO:tasks.workunit.client.0.smithi170.stdout:0/868: write d8/d10/d2d/d2f/d96/fa3 [3849226,43510] 0 2024-01-25T15:03:47.145 INFO:tasks.workunit.client.0.smithi170.stdout:0/869: getdents d8/d10/d2d/d53/df4/dc6/dc9/dca/d11a 0 2024-01-25T15:03:47.145 INFO:tasks.workunit.client.0.smithi170.stdout:0/870: write d8/d80/f91 [3417957,21546] 0 2024-01-25T15:03:47.145 INFO:tasks.workunit.client.0.smithi170.stdout:8/970: getdents d3/d7/d1e/d7c 0 2024-01-25T15:03:47.145 INFO:tasks.workunit.client.0.smithi170.stdout:3/857: rmdir d3/d10/d1e/d96 39 2024-01-25T15:03:47.147 INFO:tasks.workunit.client.0.smithi170.stdout:8/971: mkdir d3/d7/d22/d23/d48/d52/d153 0 2024-01-25T15:03:47.149 INFO:tasks.workunit.client.0.smithi170.stdout:8/972: unlink d3/d7/d22/d5d/l9b 0 2024-01-25T15:03:47.150 INFO:tasks.workunit.client.0.smithi170.stdout:3/858: getdents d3/d10/d1e/de5 0 2024-01-25T15:03:47.151 INFO:tasks.workunit.client.0.smithi170.stdout:8/973: mknod d3/d7/d73/dba/c154 0 2024-01-25T15:03:47.151 INFO:tasks.workunit.client.0.smithi170.stdout:5/755: dwrite d5/d54/d85/d2c/d51/d41/f44 [0,4194304] 0 2024-01-25T15:03:47.153 INFO:tasks.workunit.client.0.smithi170.stdout:5/756: rmdir d5/d54/d85/d2c/d45/d56 39 2024-01-25T15:03:47.153 INFO:tasks.workunit.client.0.smithi170.stdout:5/757: truncate d5/f40 1058497 0 2024-01-25T15:03:47.155 INFO:tasks.workunit.client.0.smithi170.stdout:5/758: symlink d5/d54/d85/d2c/d51/d41/l100 0 2024-01-25T15:03:47.162 INFO:tasks.workunit.client.0.smithi170.stdout:8/974: read d3/d7/d22/d23/d48/d52/d47/d86/fb9 [177375,61686] 0 2024-01-25T15:03:47.162 INFO:tasks.workunit.client.0.smithi170.stdout:8/975: readlink d3/d7/d73/l77 0 2024-01-25T15:03:47.162 INFO:tasks.workunit.client.0.smithi170.stdout:9/855: dwrite d5/df/f1a [4194304,4194304] 0 2024-01-25T15:03:47.162 INFO:tasks.workunit.client.0.smithi170.stdout:9/856: chown d5/df/d16/d52/d9c/cb4 39 1 2024-01-25T15:03:47.163 INFO:tasks.workunit.client.0.smithi170.stdout:8/976: truncate d3/d7/d3a/d8d/db3/feb 1998519 0 2024-01-25T15:03:47.165 INFO:tasks.workunit.client.0.smithi170.stdout:9/857: unlink d5/df/d16/l43 0 2024-01-25T15:03:47.175 INFO:tasks.workunit.client.0.smithi170.stdout:5/759: dwrite d5/d54/d85/d2c/d45/d56/d72/faf [4194304,4194304] 0 2024-01-25T15:03:47.176 INFO:tasks.workunit.client.0.smithi170.stdout:5/760: truncate d5/d54/d85/d2c/d45/d56/d72/da0/dc5/fe4 3138279 0 2024-01-25T15:03:47.192 INFO:tasks.workunit.client.0.smithi170.stdout:5/761: write d5/d58/da9/fd4 [18772,93425] 0 2024-01-25T15:03:47.193 INFO:tasks.workunit.client.0.smithi170.stdout:5/762: dread - d5/d54/d85/d2c/d34/d69/ff5 zero size 2024-01-25T15:03:47.193 INFO:tasks.workunit.client.0.smithi170.stdout:5/763: read d5/f40 [183843,82483] 0 2024-01-25T15:03:47.193 INFO:tasks.workunit.client.0.smithi170.stdout:5/764: write d5/d54/d85/d2c/d34/f6e [751838,21331] 0 2024-01-25T15:03:47.193 INFO:tasks.workunit.client.0.smithi170.stdout:5/765: fdatasync d5/d54/d85/d3f/f79 0 2024-01-25T15:03:47.193 INFO:tasks.workunit.client.0.smithi170.stdout:9/858: dwrite d5/df/d2e/d77/d21/d46/d18/d6a/f74 [0,4194304] 0 2024-01-25T15:03:47.193 INFO:tasks.workunit.client.0.smithi170.stdout:9/859: fdatasync d5/df/d2e/db0/ff8 0 2024-01-25T15:03:47.193 INFO:tasks.workunit.client.0.smithi170.stdout:9/860: chown d5/df/d2e/f70 15 1 2024-01-25T15:03:47.207 INFO:tasks.workunit.client.0.smithi170.stdout:8/977: write d3/d7/d22/d23/d25/f3c [4987943,91587] 0 2024-01-25T15:03:47.207 INFO:tasks.workunit.client.0.smithi170.stdout:8/978: chown d3/d7/d3a/d91/lf6 6 1 2024-01-25T15:03:47.209 INFO:tasks.workunit.client.0.smithi170.stdout:8/979: getdents d3 0 2024-01-25T15:03:47.209 INFO:tasks.workunit.client.0.smithi170.stdout:8/980: creat d3/d7/d3a/d85/d119/f155 x:0 0 0 2024-01-25T15:03:47.212 INFO:tasks.workunit.client.0.smithi170.stdout:5/766: dwrite d5/d54/d85/d2c/d45/d56/d72/fc0 [0,4194304] 0 2024-01-25T15:03:47.212 INFO:tasks.workunit.client.0.smithi170.stdout:7/847: dwrite d8/d20/d45/d107/fca [0,4194304] 0 2024-01-25T15:03:47.213 INFO:tasks.workunit.client.0.smithi170.stdout:7/848: chown d8/d20/d2a/d35/d55/d7d/l5f 116 1 2024-01-25T15:03:47.215 INFO:tasks.workunit.client.0.smithi170.stdout:7/849: unlink d8/d20/d2a/f3d 0 2024-01-25T15:03:47.215 INFO:tasks.workunit.client.0.smithi170.stdout:7/850: read - d8/d20/d2a/d35/d55/d7d/fcc zero size 2024-01-25T15:03:47.216 INFO:tasks.workunit.client.0.smithi170.stdout:7/851: fsync d8/d20/d2a/d35/d55/d7d/fdd 0 2024-01-25T15:03:47.216 INFO:tasks.workunit.client.0.smithi170.stdout:7/852: getdents d8/d20/d2a/d35/d55/d7d/d103 0 2024-01-25T15:03:47.216 INFO:tasks.workunit.client.0.smithi170.stdout:4/743: unlink d6/d28/d67/ld9 0 2024-01-25T15:03:47.218 INFO:tasks.workunit.client.0.smithi170.stdout:4/744: mknod d6/d28/ce8 0 2024-01-25T15:03:47.218 INFO:tasks.workunit.client.0.smithi170.stdout:4/745: write d6/d28/d59/dc4/fd3 [472871,58963] 0 2024-01-25T15:03:47.221 INFO:tasks.workunit.client.0.smithi170.stdout:7/853: unlink d8/d20/d2a/d35/d55/d7d/c62 0 2024-01-25T15:03:47.221 INFO:tasks.workunit.client.0.smithi170.stdout:7/854: chown d8/d20/d45/l47 186 1 2024-01-25T15:03:47.222 INFO:tasks.workunit.client.0.smithi170.stdout:0/871: dwrite d8/f107 [0,4194304] 0 2024-01-25T15:03:47.222 INFO:tasks.workunit.client.0.smithi170.stdout:8/981: write d3/d7/d22/d23/d48/d52/d47/fdd [2425094,114968] 0 2024-01-25T15:03:47.223 INFO:tasks.workunit.client.0.smithi170.stdout:7/855: mknod d8/d20/d45/d68/d71/dc8/c129 0 2024-01-25T15:03:47.226 INFO:tasks.workunit.client.0.smithi170.stdout:0/872: unlink d8/d10/d2d/d53/fe5 0 2024-01-25T15:03:47.227 INFO:tasks.workunit.client.0.smithi170.stdout:8/982: creat d3/d7/d22/d23/d25/d41/f156 x:0 0 0 2024-01-25T15:03:47.228 INFO:tasks.workunit.client.0.smithi170.stdout:8/983: chown d3/d7/d22/d23/d25/d8e/d14f 40568 1 2024-01-25T15:03:47.228 INFO:tasks.workunit.client.0.smithi170.stdout:8/984: truncate d3/f72 2038205 0 2024-01-25T15:03:47.232 INFO:tasks.workunit.client.0.smithi170.stdout:4/746: rmdir d6/d28/d59 39 2024-01-25T15:03:47.232 INFO:tasks.workunit.client.0.smithi170.stdout:5/767: getdents d5/d58 0 2024-01-25T15:03:47.233 INFO:tasks.workunit.client.0.smithi170.stdout:5/768: mkdir d5/d54/d85/d2c/d45/d56/d72/da0/d101 0 2024-01-25T15:03:47.234 INFO:tasks.workunit.client.0.smithi170.stdout:5/769: unlink d5/d54/d85/d2c/d45/fd2 0 2024-01-25T15:03:47.234 INFO:tasks.workunit.client.0.smithi170.stdout:5/770: getdents d5/d58/da9/df9/dc1 0 2024-01-25T15:03:47.235 INFO:tasks.workunit.client.0.smithi170.stdout:0/873: creat d8/d11c/d79/d7e/d10d/de7/d59/d100/f12c x:0 0 0 2024-01-25T15:03:47.235 INFO:tasks.workunit.client.0.smithi170.stdout:8/985: link d3/d7/d3a/f78 d3/d7/d22/dbd/f157 0 2024-01-25T15:03:47.235 INFO:tasks.workunit.client.0.smithi170.stdout:0/874: chown d8/d11c/d79/l115 3 1 2024-01-25T15:03:47.235 INFO:tasks.workunit.client.0.smithi170.stdout:0/875: stat d8/d11c/d79/d7e/f117 0 2024-01-25T15:03:47.235 INFO:tasks.workunit.client.0.smithi170.stdout:4/747: dread d6/f75 [0,4194304] 0 2024-01-25T15:03:47.235 INFO:tasks.workunit.client.0.smithi170.stdout:4/748: creat d6/d7/d9f/fe9 x:0 0 0 2024-01-25T15:03:47.235 INFO:tasks.workunit.client.0.smithi170.stdout:0/876: truncate d8/d9/f46 514547 0 2024-01-25T15:03:47.236 INFO:tasks.workunit.client.0.smithi170.stdout:8/986: dread d3/d7/d3a/d8d/ff4 [0,4194304] 0 2024-01-25T15:03:47.236 INFO:tasks.workunit.client.0.smithi170.stdout:8/987: chown d3/d7/d22/dbd/f157 58297692 1 2024-01-25T15:03:47.237 INFO:tasks.workunit.client.0.smithi170.stdout:0/877: unlink d8/d18/lc2 0 2024-01-25T15:03:47.238 INFO:tasks.workunit.client.0.smithi170.stdout:8/988: symlink d3/d7/d73/dba/d125/l158 0 2024-01-25T15:03:47.238 INFO:tasks.workunit.client.0.smithi170.stdout:8/989: creat d3/d7/d1e/df9/f159 x:0 0 0 2024-01-25T15:03:47.238 INFO:tasks.workunit.client.0.smithi170.stdout:4/749: unlink d6/d28/lbd 0 2024-01-25T15:03:47.240 INFO:tasks.workunit.client.0.smithi170.stdout:8/990: mknod d3/d7/d3a/d8d/dd5/c15a 0 2024-01-25T15:03:47.242 INFO:tasks.workunit.client.0.smithi170.stdout:8/991: mknod d3/d7/d22/c15b 0 2024-01-25T15:03:47.244 INFO:tasks.workunit.client.0.smithi170.stdout:4/750: creat d6/d28/d59/dc4/fea x:0 0 0 2024-01-25T15:03:47.245 INFO:tasks.workunit.client.0.smithi170.stdout:8/992: mknod d3/d7/d3a/d91/d7f/c15c 0 2024-01-25T15:03:47.245 INFO:tasks.workunit.client.0.smithi170.stdout:4/751: mknod d6/d28/d67/ceb 0 2024-01-25T15:03:47.246 INFO:tasks.workunit.client.0.smithi170.stdout:8/993: getdents d3/d7/d22/d23/d25/d8e/d14f 0 2024-01-25T15:03:47.246 INFO:tasks.workunit.client.0.smithi170.stdout:4/752: creat d6/d28/d67/fec x:0 0 0 2024-01-25T15:03:47.248 INFO:tasks.workunit.client.0.smithi170.stdout:4/753: mkdir d6/d7/d9f/de1/ded 0 2024-01-25T15:03:47.255 INFO:tasks.workunit.client.0.smithi170.stdout:7/856: dwrite d8/d20/d45/d68/daa/fcb [0,4194304] 0 2024-01-25T15:03:47.256 INFO:tasks.workunit.client.0.smithi170.stdout:8/994: dread d3/d7/d3a/d8d/db3/feb [0,4194304] 0 2024-01-25T15:03:47.256 INFO:tasks.workunit.client.0.smithi170.stdout:8/995: fdatasync d3/d7/d22/d23/f76 0 2024-01-25T15:03:47.257 INFO:tasks.workunit.client.0.smithi170.stdout:8/996: link d3/d7/d3a/d8d/f13a d3/d7/d3a/f15d 0 2024-01-25T15:03:47.257 INFO:tasks.workunit.client.0.smithi170.stdout:8/997: write d3/d7/d1e/f6f [4276758,125591] 0 2024-01-25T15:03:47.269 INFO:tasks.workunit.client.0.smithi170.stdout:4/754: dwrite d6/d28/dc2/fd0 [0,4194304] 0 2024-01-25T15:03:47.269 INFO:tasks.workunit.client.0.smithi170.stdout:7/857: dread d8/d20/f22 [0,4194304] 0 2024-01-25T15:03:47.271 INFO:tasks.workunit.client.0.smithi170.stdout:7/858: link c6 d8/ddb/c12a 0 2024-01-25T15:03:47.273 INFO:tasks.workunit.client.0.smithi170.stdout:7/859: creat d8/d20/d2a/d35/d55/d9b/db9/f12b x:0 0 0 2024-01-25T15:03:47.277 INFO:tasks.workunit.client.0.smithi170.stdout:8/998: dwrite d3/d7/d73/fa1 [0,4194304] 0 2024-01-25T15:03:47.279 INFO:tasks.workunit.client.0.smithi170.stdout:8/999: creat d3/d7/d73/dba/f15e x:0 0 0 2024-01-25T15:03:47.283 INFO:tasks.workunit.client.0.smithi170.stdout:4/755: link d6/d28/d93/fc1 d6/d7/d31/dd2/fee 0 2024-01-25T15:03:47.284 INFO:tasks.workunit.client.0.smithi170.stdout:4/756: write d6/d7/d31/d7e/d9c/fb1 [256624,100389] 0 2024-01-25T15:03:47.284 INFO:tasks.workunit.client.0.smithi170.stdout:4/757: dread - d6/d7/d9f/fe5 zero size 2024-01-25T15:03:47.291 INFO:tasks.workunit.client.0.smithi170.stdout:7/860: dwrite d8/d20/d73/ffb [0,4194304] 0 2024-01-25T15:03:47.294 INFO:tasks.workunit.client.0.smithi170.stdout:7/861: getdents d8/d20/d3b 0 2024-01-25T15:03:47.296 INFO:tasks.workunit.client.0.smithi170.stdout:7/862: creat d8/d20/d2a/f12c x:0 0 0 2024-01-25T15:03:47.301 INFO:tasks.workunit.client.0.smithi170.stdout:7/863: dread d8/d20/d45/d68/f118 [0,4194304] 0 2024-01-25T15:03:47.304 INFO:tasks.workunit.client.0.smithi170.stdout:7/864: truncate d8/d20/d2a/d35/d55/d7d/da6/fc3 174864 0 2024-01-25T15:03:47.304 INFO:tasks.workunit.client.0.smithi170.stdout:7/865: write d8/d20/d2a/d35/d55/d7d/fdd [474243,93586] 0 2024-01-25T15:03:47.305 INFO:tasks.workunit.client.0.smithi170.stdout:7/866: mknod d8/d20/d45/d8e/c12d 0 2024-01-25T15:03:47.305 INFO:tasks.workunit.client.0.smithi170.stdout:7/867: chown d8/d20/d2a/cab 1603120391 1 2024-01-25T15:03:47.308 INFO:tasks.workunit.client.0.smithi170.stdout:7/868: unlink d8/l40 0 2024-01-25T15:03:47.311 INFO:tasks.workunit.client.0.smithi170.stdout:7/869: symlink d8/d20/d73/l12e 0 2024-01-25T15:03:47.311 INFO:tasks.workunit.client.0.smithi170.stdout:7/870: fsync d8/d20/d2a/fa2 0 2024-01-25T15:03:47.311 INFO:tasks.workunit.client.0.smithi170.stdout:7/871: fsync d8/f3a 0 2024-01-25T15:03:47.311 INFO:tasks.workunit.client.0.smithi170.stdout:4/758: dwrite d6/d28/d61/fb2 [0,4194304] 0 2024-01-25T15:03:47.311 INFO:tasks.workunit.client.0.smithi170.stdout:7/872: symlink d8/d20/d2a/d35/d55/d7d/da6/l12f 0 2024-01-25T15:03:47.312 INFO:tasks.workunit.client.0.smithi170.stdout:7/873: readlink d8/d20/d2a/d35/db0/ld0 0 2024-01-25T15:03:47.321 INFO:tasks.workunit.client.0.smithi170.stdout:4/759: truncate d6/d28/d59/da8/fdb 3343301 0 2024-01-25T15:03:47.323 INFO:tasks.workunit.client.0.smithi170.stdout:4/760: creat d6/d7/d31/d7e/d9c/fef x:0 0 0 2024-01-25T15:03:47.324 INFO:tasks.workunit.client.0.smithi170.stdout:4/761: dread d6/d28/d59/d7d/f97 [0,4194304] 0 2024-01-25T15:03:47.325 INFO:tasks.workunit.client.0.smithi170.stdout:4/762: mknod d6/d28/dc2/cf0 0 2024-01-25T15:03:47.326 INFO:tasks.workunit.client.0.smithi170.stdout:4/763: creat d6/d7/d31/d7e/d80/ff1 x:0 0 0 2024-01-25T15:03:47.347 INFO:tasks.workunit.client.0.smithi170.stdout:4/764: dwrite d6/d7/d1b/f1e [0,4194304] 0 2024-01-25T15:03:47.348 INFO:tasks.workunit.client.0.smithi170.stdout:4/765: chown d6/d7/d31/d7e/d9c 7135 1 2024-01-25T15:03:47.350 INFO:tasks.workunit.client.0.smithi170.stdout:4/766: dread d6/d7/d31/d46/d78/f8b [0,4194304] 0 2024-01-25T15:03:47.352 INFO:tasks.workunit.client.0.smithi170.stdout:4/767: mkdir d6/d7/d31/d7e/d9c/df2 0 2024-01-25T15:03:47.353 INFO:tasks.workunit.client.0.smithi170.stdout:4/768: getdents d6/d7/d9f/de1 0 2024-01-25T15:03:47.362 INFO:tasks.workunit.client.0.smithi170.stdout:4/769: dread d6/d7/d31/dd2/fee [0,4194304] 0 2024-01-25T15:03:47.363 INFO:tasks.workunit.client.0.smithi170.stdout:4/770: symlink d6/d7/d31/d46/lf3 0 2024-01-25T15:03:47.371 INFO:tasks.workunit.client.0.smithi170.stdout:4/771: write d6/d28/d67/f96 [1134110,8074] 0 2024-01-25T15:03:47.373 INFO:tasks.workunit.client.0.smithi170.stdout:4/772: symlink d6/lf4 0 2024-01-25T15:03:47.374 INFO:tasks.workunit.client.0.smithi170.stdout:4/773: symlink d6/d7/d31/d46/dc6/lf5 0 2024-01-25T15:03:47.375 INFO:tasks.workunit.client.0.smithi170.stdout:4/774: symlink d6/d28/d67/lf6 0 2024-01-25T15:03:47.375 INFO:tasks.workunit.client.0.smithi170.stdout:4/775: chown d6/d7/d31/f7b 1705 1 2024-01-25T15:03:47.375 INFO:tasks.workunit.client.0.smithi170.stdout:4/776: dread - d6/d7/d9f/fe5 zero size 2024-01-25T15:03:47.433 INFO:tasks.workunit.client.0.smithi170.stdout:6/872: rename d2/d7/d23/d19/d2a/d43/d98/d113/d74/l125 to d2/d7/d23/d19/d2a/d43/d98/d113/d5d/d94/d97/db4/l129 0 2024-01-25T15:03:47.435 INFO:tasks.workunit.client.0.smithi170.stdout:1/776: rename d0/d20/d3a/f40 to d0/d20/ddd/dde/f103 0 2024-01-25T15:03:47.435 INFO:tasks.workunit.client.0.smithi170.stdout:1/777: write d0/f99 [1426501,15661] 0 2024-01-25T15:03:47.435 INFO:tasks.workunit.client.0.smithi170.stdout:1/778: chown d0/d20/d28/dee 466 1 2024-01-25T15:03:47.437 INFO:tasks.workunit.client.0.smithi170.stdout:3/859: rename d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/dcb/lfb to d3/d10/d13/d1b/d85/l11d 0 2024-01-25T15:03:47.438 INFO:tasks.workunit.client.0.smithi170.stdout:3/860: read d3/d1c/fb4 [78053,30066] 0 2024-01-25T15:03:47.438 INFO:tasks.workunit.client.0.smithi170.stdout:2/754: sync 2024-01-25T15:03:47.438 INFO:tasks.workunit.client.0.smithi170.stdout:3/861: write d3/d10/d13/d1b/d85/fb8 [249958,12998] 0 2024-01-25T15:03:47.439 INFO:tasks.workunit.client.0.smithi170.stdout:1/779: unlink d0/ff 0 2024-01-25T15:03:47.439 INFO:tasks.workunit.client.0.smithi170.stdout:1/780: fdatasync d0/d50/f95 0 2024-01-25T15:03:47.439 INFO:tasks.workunit.client.0.smithi170.stdout:1/781: dread - d0/d20/d28/d2a/d4a/d56/d5b/d72/fd8 zero size 2024-01-25T15:03:47.440 INFO:tasks.workunit.client.0.smithi170.stdout:9/861: rename d5/df/f15 to d5/df/d16/d35/d3c/d56/d59/d5e/f11f 0 2024-01-25T15:03:47.440 INFO:tasks.workunit.client.0.smithi170.stdout:9/862: creat d5/f120 x:0 0 0 2024-01-25T15:03:47.441 INFO:tasks.workunit.client.0.smithi170.stdout:3/862: mknod d3/d1c/d2b/d5c/d97/d118/c11e 0 2024-01-25T15:03:47.442 INFO:tasks.workunit.client.0.smithi170.stdout:3/863: creat d3/d10/d13/f11f x:0 0 0 2024-01-25T15:03:47.442 INFO:tasks.workunit.client.0.smithi170.stdout:3/864: readlink d3/lea 0 2024-01-25T15:03:47.442 INFO:tasks.workunit.client.0.smithi170.stdout:3/865: dread - d3/d10/d13/f11f zero size 2024-01-25T15:03:47.443 INFO:tasks.workunit.client.0.smithi170.stdout:1/782: symlink d0/d50/d8e/l104 0 2024-01-25T15:03:47.443 INFO:tasks.workunit.client.0.smithi170.stdout:6/873: write d2/d7/d23/d19/f6a [3330084,54106] 0 2024-01-25T15:03:47.443 INFO:tasks.workunit.client.0.smithi170.stdout:5/771: rename d5/d58/da9/df9/dc1 to d5/d54/d85/d2c/d45/d56/d102 0 2024-01-25T15:03:47.444 INFO:tasks.workunit.client.0.smithi170.stdout:2/755: link d10/d1e/d32/d3e/d41/dc4/dc6/caf d10/d1e/d32/d3e/d41/dc4/dc6/d42/daa/c10a 0 2024-01-25T15:03:47.445 INFO:tasks.workunit.client.0.smithi170.stdout:1/783: creat d0/d50/dc0/f105 x:0 0 0 2024-01-25T15:03:47.445 INFO:tasks.workunit.client.0.smithi170.stdout:1/784: stat d0/d2e/ff4 0 2024-01-25T15:03:47.445 INFO:tasks.workunit.client.0.smithi170.stdout:9/863: rmdir d5/df/d2e/d77/d21/d46/d6c/dd8 39 2024-01-25T15:03:47.446 INFO:tasks.workunit.client.0.smithi170.stdout:1/785: dread d0/d20/d3a/f65 [0,4194304] 0 2024-01-25T15:03:47.446 INFO:tasks.workunit.client.0.smithi170.stdout:6/874: creat d2/d7/dd9/dfc/f12a x:0 0 0 2024-01-25T15:03:47.447 INFO:tasks.workunit.client.0.smithi170.stdout:5/772: truncate d5/d54/d85/d2c/f2d 1101409 0 2024-01-25T15:03:47.447 INFO:tasks.workunit.client.0.smithi170.stdout:5/773: write d5/d54/d85/d2c/d34/d69/fab [1539766,19161] 0 2024-01-25T15:03:47.448 INFO:tasks.workunit.client.0.smithi170.stdout:9/864: creat d5/df/d2e/d77/d21/d34/d3e/d7f/f121 x:0 0 0 2024-01-25T15:03:47.449 INFO:tasks.workunit.client.0.smithi170.stdout:6/875: link d2/d7/d23/f10a d2/d7/d23/d19/f12b 0 2024-01-25T15:03:47.452 INFO:tasks.workunit.client.0.smithi170.stdout:5/774: dread d5/fe [0,4194304] 0 2024-01-25T15:03:47.461 INFO:tasks.workunit.client.0.smithi170.stdout:2/756: dread d10/d1e/f91 [0,4194304] 0 2024-01-25T15:03:47.464 INFO:tasks.workunit.client.0.smithi170.stdout:5/775: truncate d5/f16 11510457 0 2024-01-25T15:03:47.465 INFO:tasks.workunit.client.0.smithi170.stdout:5/776: getdents d5/d54/d85/d2c/d34 0 2024-01-25T15:03:47.467 INFO:tasks.workunit.client.0.smithi170.stdout:2/757: dread d10/d1e/d32/d3e/f46 [0,4194304] 0 2024-01-25T15:03:47.474 INFO:tasks.workunit.client.0.smithi170.stdout:6/876: dwrite d2/d7/d23/d19/d2a/d43/d98/d113/d74/dc1/dcf/d100/f11d [0,4194304] 0 2024-01-25T15:03:47.475 INFO:tasks.workunit.client.0.smithi170.stdout:9/865: dwrite d5/df/d2e/d77/d21/d46/d18/fff [4194304,4194304] 0 2024-01-25T15:03:47.475 INFO:tasks.workunit.client.0.smithi170.stdout:9/866: fdatasync d5/df/d16/d35/d3c/d91/f10f 0 2024-01-25T15:03:47.476 INFO:tasks.workunit.client.0.smithi170.stdout:6/877: creat d2/d7/d23/d19/d2a/d43/d98/d113/f12c x:0 0 0 2024-01-25T15:03:47.477 INFO:tasks.workunit.client.0.smithi170.stdout:0/878: rename d8/d9/l1a to d8/d10/d2d/d53/df4/l12d 0 2024-01-25T15:03:47.479 INFO:tasks.workunit.client.0.smithi170.stdout:6/878: creat d2/d7/d1b/d78/d11a/f12d x:0 0 0 2024-01-25T15:03:47.481 INFO:tasks.workunit.client.0.smithi170.stdout:6/879: rmdir d2/d7/d23/d19/d2a/d43/d98/d113/d74/dc1/dc8 39 2024-01-25T15:03:47.482 INFO:tasks.workunit.client.0.smithi170.stdout:0/879: truncate d8/d10/d2d/d53/fb5 9209074 0 2024-01-25T15:03:47.482 INFO:tasks.workunit.client.0.smithi170.stdout:0/880: chown d8/d9/d9a/c11e 3 1 2024-01-25T15:03:47.482 INFO:tasks.workunit.client.0.smithi170.stdout:0/881: write d8/d9/f16 [2432240,6607] 0 2024-01-25T15:03:47.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:47 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:47.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:47 smithi191 ceph-mon[36347]: pgmap v402: 97 pgs: 97 active+clean; 1.4 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 158 MiB/s rd, 183 MiB/s wr, 1.74k op/s 2024-01-25T15:03:47.484 INFO:tasks.workunit.client.0.smithi170.stdout:0/882: rmdir d8/d11c/d79/d7e/d10d/de7/d59 39 2024-01-25T15:03:47.484 INFO:tasks.workunit.client.0.smithi170.stdout:0/883: write d8/d10/d5a/fb9 [1420474,64060] 0 2024-01-25T15:03:47.484 INFO:tasks.workunit.client.0.smithi170.stdout:0/884: chown d8/d11c/d79/d7e/c103 55278 1 2024-01-25T15:03:47.485 INFO:tasks.workunit.client.0.smithi170.stdout:2/758: dread d10/d1b/db6/dd7/fe4 [0,4194304] 0 2024-01-25T15:03:47.487 INFO:tasks.workunit.client.0.smithi170.stdout:5/777: dwrite d5/f13 [8388608,4194304] 0 2024-01-25T15:03:47.487 INFO:tasks.workunit.client.0.smithi170.stdout:5/778: write d5/d58/da9/df9/dbd/ff8 [362932,29132] 0 2024-01-25T15:03:47.488 INFO:tasks.workunit.client.0.smithi170.stdout:7/874: rename d8/d20/d2a/d35/daf/c11f to d8/d20/d45/d68/d71/c130 0 2024-01-25T15:03:47.490 INFO:tasks.workunit.client.0.smithi170.stdout:4/777: rename d6/d28/d61/fce to d6/d28/d67/ff7 0 2024-01-25T15:03:47.491 INFO:tasks.workunit.client.0.smithi170.stdout:7/875: creat d8/d20/d2a/d35/d55/d7d/da6/dd1/deb/f131 x:0 0 0 2024-01-25T15:03:47.491 INFO:tasks.workunit.client.0.smithi170.stdout:7/876: readlink d8/d20/d2a/d35/l7f 0 2024-01-25T15:03:47.491 INFO:tasks.workunit.client.0.smithi170.stdout:7/877: write d8/d20/d45/d68/d71/d8c/fb2 [800176,11895] 0 2024-01-25T15:03:47.491 INFO:tasks.workunit.client.0.smithi170.stdout:7/878: fdatasync d8/d20/d45/fec 0 2024-01-25T15:03:47.491 INFO:tasks.workunit.client.0.smithi170.stdout:7/879: fsync d8/d20/d2a/d35/d55/d7d/fcc 0 2024-01-25T15:03:47.491 INFO:tasks.workunit.client.0.smithi170.stdout:7/880: write d8/d20/d45/d68/d71/d8c/fbf [1644342,94466] 0 2024-01-25T15:03:47.494 INFO:tasks.workunit.client.0.smithi170.stdout:3/866: rename d3/d1c/d2b/d5c/d97/d118 to d3/d1c/d2b/d5c/d120 0 2024-01-25T15:03:47.494 INFO:tasks.workunit.client.0.smithi170.stdout:3/867: fdatasync d3/d1c/d2b/fc1 0 2024-01-25T15:03:47.495 INFO:tasks.workunit.client.0.smithi170.stdout:4/778: truncate d6/d28/d59/da8/fdb 15214 0 2024-01-25T15:03:47.497 INFO:tasks.workunit.client.0.smithi170.stdout:7/881: mkdir d8/d20/d45/d10c/d132 0 2024-01-25T15:03:47.500 INFO:tasks.workunit.client.0.smithi170.stdout:3/868: mknod d3/d10/c121 0 2024-01-25T15:03:47.501 INFO:tasks.workunit.client.0.smithi170.stdout:4/779: rmdir d6/d7/d9f/de1 39 2024-01-25T15:03:47.502 INFO:tasks.workunit.client.0.smithi170.stdout:2/759: write d10/d1e/f71 [1602100,63147] 0 2024-01-25T15:03:47.502 INFO:tasks.workunit.client.0.smithi170.stdout:4/780: write d6/d7/d31/d7e/d9c/fb1 [227390,48947] 0 2024-01-25T15:03:47.502 INFO:tasks.workunit.client.0.smithi170.stdout:4/781: truncate d6/d7/d31/d7e/d9c/fb1 971856 0 2024-01-25T15:03:47.502 INFO:tasks.workunit.client.0.smithi170.stdout:4/782: readlink d6/d7/d31/d7e/d9c/lbb 0 2024-01-25T15:03:47.502 INFO:tasks.workunit.client.0.smithi170.stdout:9/867: dwrite d5/df/d2e/d77/f82 [0,4194304] 0 2024-01-25T15:03:47.503 INFO:tasks.workunit.client.0.smithi170.stdout:2/760: mkdir d10/d1e/d32/d62/d74/d10b 0 2024-01-25T15:03:47.503 INFO:tasks.workunit.client.0.smithi170.stdout:4/783: mknod d6/d28/d61/cf8 0 2024-01-25T15:03:47.504 INFO:tasks.workunit.client.0.smithi170.stdout:4/784: stat d6/d28/d59/da8/fdb 0 2024-01-25T15:03:47.504 INFO:tasks.workunit.client.0.smithi170.stdout:4/785: truncate d6/d28/d59/dc4/fc5 1707532 0 2024-01-25T15:03:47.504 INFO:tasks.workunit.client.0.smithi170.stdout:1/786: rename d0/d20/d28/d7b/da8 to d0/d20/d28/d2a/d4a/d56/d106 0 2024-01-25T15:03:47.504 INFO:tasks.workunit.client.0.smithi170.stdout:2/761: dread - d10/d1e/d5e/d73/d9e/da3/fef zero size 2024-01-25T15:03:47.505 INFO:tasks.workunit.client.0.smithi170.stdout:3/869: symlink d3/d10/d52/l122 0 2024-01-25T15:03:47.505 INFO:tasks.workunit.client.0.smithi170.stdout:3/870: fsync d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/ddf/fe6 0 2024-01-25T15:03:47.509 INFO:tasks.workunit.client.0.smithi170.stdout:4/786: link d6/c21 d6/d7/db7/cf9 0 2024-01-25T15:03:47.509 INFO:tasks.workunit.client.0.smithi170.stdout:7/882: dread d8/d20/d2a/f87 [0,4194304] 0 2024-01-25T15:03:47.513 INFO:tasks.workunit.client.0.smithi170.stdout:6/880: rename d2/d7/ca to d2/d7/d23/d19/d2a/d6b/dad/c12e 0 2024-01-25T15:03:47.515 INFO:tasks.workunit.client.0.smithi170.stdout:0/885: dwrite d8/d9/d9a/f10c [0,4194304] 0 2024-01-25T15:03:47.515 INFO:tasks.workunit.client.0.smithi170.stdout:0/886: chown d8/d18/l57 1 1 2024-01-25T15:03:47.516 INFO:tasks.workunit.client.0.smithi170.stdout:1/787: unlink d0/d20/d28/d7b/f92 0 2024-01-25T15:03:47.516 INFO:tasks.workunit.client.0.smithi170.stdout:1/788: fdatasync d0/fd 0 2024-01-25T15:03:47.516 INFO:tasks.workunit.client.0.smithi170.stdout:5/779: dwrite d5/d54/d85/d2c/f31 [0,4194304] 0 2024-01-25T15:03:47.516 INFO:tasks.workunit.client.0.smithi170.stdout:5/780: dread - d5/d58/fcd zero size 2024-01-25T15:03:47.518 INFO:tasks.workunit.client.0.smithi170.stdout:5/781: symlink d5/d54/d85/d2c/d45/l103 0 2024-01-25T15:03:47.519 INFO:tasks.workunit.client.0.smithi170.stdout:2/762: truncate d10/d1e/fd9 957382 0 2024-01-25T15:03:47.519 INFO:tasks.workunit.client.0.smithi170.stdout:2/763: chown d10/d1e/d32/d3e/fcc 901 1 2024-01-25T15:03:47.519 INFO:tasks.workunit.client.0.smithi170.stdout:2/764: readlink d10/l6e 0 2024-01-25T15:03:47.520 INFO:tasks.workunit.client.0.smithi170.stdout:4/787: creat d6/ffa x:0 0 0 2024-01-25T15:03:47.522 INFO:tasks.workunit.client.0.smithi170.stdout:7/883: mknod d8/d20/d2a/d35/c133 0 2024-01-25T15:03:47.527 INFO:tasks.workunit.client.0.smithi170.stdout:9/868: dwrite d5/df/d2e/d77/d21/d46/d6c/f71 [0,4194304] 0 2024-01-25T15:03:47.532 INFO:tasks.workunit.client.0.smithi170.stdout:4/788: symlink d6/d28/d59/da8/lfb 0 2024-01-25T15:03:47.532 INFO:tasks.workunit.client.0.smithi170.stdout:4/789: creat d6/d28/d59/dc4/ffc x:0 0 0 2024-01-25T15:03:47.532 INFO:tasks.workunit.client.0.smithi170.stdout:4/790: creat d6/d28/d61/dad/ffd x:0 0 0 2024-01-25T15:03:47.532 INFO:tasks.workunit.client.0.smithi170.stdout:4/791: write d6/d28/d61/dad/fe7 [749892,7803] 0 2024-01-25T15:03:47.534 INFO:tasks.workunit.client.0.smithi170.stdout:7/884: mknod d8/d20/d45/d68/d71/d8c/c134 0 2024-01-25T15:03:47.535 INFO:tasks.workunit.client.0.smithi170.stdout:7/885: creat d8/d110/f135 x:0 0 0 2024-01-25T15:03:47.535 INFO:tasks.workunit.client.0.smithi170.stdout:7/886: creat d8/d20/d2a/d35/d55/d7d/da6/dd1/deb/f136 x:0 0 0 2024-01-25T15:03:47.535 INFO:tasks.workunit.client.0.smithi170.stdout:4/792: mkdir d6/d28/d61/dfe 0 2024-01-25T15:03:47.537 INFO:tasks.workunit.client.0.smithi170.stdout:9/869: write d5/df/d2e/d77/d21/d46/fdc [3256639,122985] 0 2024-01-25T15:03:47.545 INFO:tasks.workunit.client.0.smithi170.stdout:7/887: dread d8/d20/d45/d8e/f9d [0,4194304] 0 2024-01-25T15:03:47.545 INFO:tasks.workunit.client.0.smithi170.stdout:7/888: write d8/d20/d45/d68/d71/d8c/fb2 [1394812,97765] 0 2024-01-25T15:03:47.545 INFO:tasks.workunit.client.0.smithi170.stdout:7/889: dread - d8/ddb/f113 zero size 2024-01-25T15:03:47.547 INFO:tasks.workunit.client.0.smithi170.stdout:7/890: unlink d8/d20/d2a/d35/db0/ld0 0 2024-01-25T15:03:47.549 INFO:tasks.workunit.client.0.smithi170.stdout:0/887: dwrite d8/d10/d2d/d53/f76 [0,4194304] 0 2024-01-25T15:03:47.550 INFO:tasks.workunit.client.0.smithi170.stdout:1/789: dwrite d0/f12 [0,4194304] 0 2024-01-25T15:03:47.551 INFO:tasks.workunit.client.0.smithi170.stdout:0/888: creat d8/d9/dd6/f12e x:0 0 0 2024-01-25T15:03:47.555 INFO:tasks.workunit.client.0.smithi170.stdout:1/790: symlink d0/de8/l107 0 2024-01-25T15:03:47.555 INFO:tasks.workunit.client.0.smithi170.stdout:1/791: creat d0/d20/d28/d7b/dfc/f108 x:0 0 0 2024-01-25T15:03:47.555 INFO:tasks.workunit.client.0.smithi170.stdout:1/792: stat d0/d20/d28/f29 0 2024-01-25T15:03:47.556 INFO:tasks.workunit.client.0.smithi170.stdout:0/889: symlink d8/d11c/d106/l12f 0 2024-01-25T15:03:47.556 INFO:tasks.workunit.client.0.smithi170.stdout:0/890: truncate d8/d11c/d79/d7e/d10d/de7/d59/fd5 593940 0 2024-01-25T15:03:47.556 INFO:tasks.workunit.client.0.smithi170.stdout:0/891: fdatasync d8/d9/d9a/f10c 0 2024-01-25T15:03:47.556 INFO:tasks.workunit.client.0.smithi170.stdout:6/881: dwrite d2/d7/d23/ff4 [0,4194304] 0 2024-01-25T15:03:47.556 INFO:tasks.workunit.client.0.smithi170.stdout:7/891: write d8/d20/d2a/d35/d55/fe8 [4080110,24047] 0 2024-01-25T15:03:47.560 INFO:tasks.workunit.client.0.smithi170.stdout:6/882: link d2/d7/d23/d19/d2a/d43/d98/d113/d74/dce/ddf/cff d2/d7/d23/d19/d2a/d43/d98/d113/d74/dc1/dcf/d100/c12f 0 2024-01-25T15:03:47.560 INFO:tasks.workunit.client.0.smithi170.stdout:9/870: dwrite d5/df/d2e/f7d [8388608,4194304] 0 2024-01-25T15:03:47.561 INFO:tasks.workunit.client.0.smithi170.stdout:6/883: mkdir d2/d7/d1b/d28/db8/d130 0 2024-01-25T15:03:47.562 INFO:tasks.workunit.client.0.smithi170.stdout:9/871: symlink d5/df/d49/df1/l122 0 2024-01-25T15:03:47.562 INFO:tasks.workunit.client.0.smithi170.stdout:9/872: truncate d5/df/d2e/db0/ff8 472984 0 2024-01-25T15:03:47.563 INFO:tasks.workunit.client.0.smithi170.stdout:6/884: getdents d2/d7/d23/d19/d2a/d43/d98/d113/d5d/d94/d97/db4/dc7 0 2024-01-25T15:03:47.563 INFO:tasks.workunit.client.0.smithi170.stdout:6/885: stat d2/d7/d1b/d28/da7/lfd 0 2024-01-25T15:03:47.564 INFO:tasks.workunit.client.0.smithi170.stdout:9/873: getdents d5/df/d16/d35/d3c/d56/d59/d5e 0 2024-01-25T15:03:47.564 INFO:tasks.workunit.client.0.smithi170.stdout:6/886: symlink d2/d7/d23/d19/d2a/d43/d98/d113/d74/dc1/l131 0 2024-01-25T15:03:47.574 INFO:tasks.workunit.client.0.smithi170.stdout:3/871: rename d3/d3b/c87 to d3/d10/d13/d1b/d29/db7/c123 0 2024-01-25T15:03:47.574 INFO:tasks.workunit.client.0.smithi170.stdout:0/892: dread d8/d10/d2d/d53/df4/faa [0,4194304] 0 2024-01-25T15:03:47.575 INFO:tasks.workunit.client.0.smithi170.stdout:3/872: stat d3/d10/d13/d1b/d85/l11d 0 2024-01-25T15:03:47.575 INFO:tasks.workunit.client.0.smithi170.stdout:3/873: fsync d3/d10/d1e/f20 0 2024-01-25T15:03:47.576 INFO:tasks.workunit.client.0.smithi170.stdout:0/893: creat d8/d10/d2d/d2f/d96/f130 x:0 0 0 2024-01-25T15:03:47.577 INFO:tasks.workunit.client.0.smithi170.stdout:1/793: dwrite d0/d20/d3a/d60/ff8 [0,4194304] 0 2024-01-25T15:03:47.577 INFO:tasks.workunit.client.0.smithi170.stdout:1/794: read d0/d50/f95 [675644,46785] 0 2024-01-25T15:03:47.577 INFO:tasks.workunit.client.0.smithi170.stdout:1/795: creat d0/d1b/f109 x:0 0 0 2024-01-25T15:03:47.578 INFO:tasks.workunit.client.0.smithi170.stdout:3/874: getdents d3/d10/d1e/d21/d41/d4a/dc3/dfc/df6 0 2024-01-25T15:03:47.578 INFO:tasks.workunit.client.0.smithi170.stdout:3/875: dread - d3/f4c zero size 2024-01-25T15:03:47.578 INFO:tasks.workunit.client.0.smithi170.stdout:9/874: dread d5/df/d2e/d77/d21/d46/fb2 [0,4194304] 0 2024-01-25T15:03:47.578 INFO:tasks.workunit.client.0.smithi170.stdout:9/875: chown d5/df/d49/df1/d10d 73666 1 2024-01-25T15:03:47.588 INFO:tasks.workunit.client.0.smithi170.stdout:1/796: dread d0/f5 [0,4194304] 0 2024-01-25T15:03:47.589 INFO:tasks.workunit.client.0.smithi170.stdout:1/797: creat d0/d20/d28/d2a/d4a/d56/dc1/dd1/f10a x:0 0 0 2024-01-25T15:03:47.600 INFO:tasks.workunit.client.0.smithi170.stdout:3/876: dwrite d3/d10/d13/d1b/d81/f108 [0,4194304] 0 2024-01-25T15:03:47.600 INFO:tasks.workunit.client.0.smithi170.stdout:1/798: link d0/fe d0/d50/da0/d9c/f10b 0 2024-01-25T15:03:47.600 INFO:tasks.workunit.client.0.smithi170.stdout:1/799: chown d0/d20/d28/d2a/d4a/d56/f64 1916 1 2024-01-25T15:03:47.600 INFO:tasks.workunit.client.0.smithi170.stdout:1/800: write d0/d20/d28/ffd [430666,44267] 0 2024-01-25T15:03:47.600 INFO:tasks.workunit.client.0.smithi170.stdout:1/801: dread - d0/d20/ddd/dde/f103 zero size 2024-01-25T15:03:47.600 INFO:tasks.workunit.client.0.smithi170.stdout:5/782: rename d5/d54/d85/d2c/d51/d41/c49 to d5/d54/d85/d2c/d45/d56/d72/da0/dc5/c104 0 2024-01-25T15:03:47.601 INFO:tasks.workunit.client.0.smithi170.stdout:3/877: creat d3/d1c/d2b/d5c/dad/d117/f124 x:0 0 0 2024-01-25T15:03:47.602 INFO:tasks.workunit.client.0.smithi170.stdout:3/878: fsync d3/d10/d13/d1b/d85/ff9 0 2024-01-25T15:03:47.602 INFO:tasks.workunit.client.0.smithi170.stdout:1/802: creat d0/d20/d28/d2a/d4a/d56/dc1/f10c x:0 0 0 2024-01-25T15:03:47.602 INFO:tasks.workunit.client.0.smithi170.stdout:1/803: chown d0/d20/d28/d2a/l30 16158732 1 2024-01-25T15:03:47.602 INFO:tasks.workunit.client.0.smithi170.stdout:1/804: creat d0/d20/d3a/d60/f10d x:0 0 0 2024-01-25T15:03:47.603 INFO:tasks.workunit.client.0.smithi170.stdout:1/805: chown d0/c21 0 1 2024-01-25T15:03:47.603 INFO:tasks.workunit.client.0.smithi170.stdout:1/806: creat d0/d20/d3a/d6e/f10e x:0 0 0 2024-01-25T15:03:47.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:47 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:47.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:47 smithi186 ceph-mon[35697]: pgmap v402: 97 pgs: 97 active+clean; 1.4 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 158 MiB/s rd, 183 MiB/s wr, 1.74k op/s 2024-01-25T15:03:47.605 INFO:tasks.workunit.client.0.smithi170.stdout:5/783: creat d5/d54/d85/d3f/d8f/db8/f105 x:0 0 0 2024-01-25T15:03:47.605 INFO:tasks.workunit.client.0.smithi170.stdout:5/784: creat d5/d54/f106 x:0 0 0 2024-01-25T15:03:47.605 INFO:tasks.workunit.client.0.smithi170.stdout:5/785: mkdir d5/d58/da9/d107 0 2024-01-25T15:03:47.606 INFO:tasks.workunit.client.0.smithi170.stdout:3/879: mkdir d3/d10/d1e/de5/d125 0 2024-01-25T15:03:47.606 INFO:tasks.workunit.client.0.smithi170.stdout:3/880: write d3/d10/d1e/d96/f9e [1399969,93298] 0 2024-01-25T15:03:47.608 INFO:tasks.workunit.client.0.smithi170.stdout:1/807: mknod d0/de8/c10f 0 2024-01-25T15:03:47.608 INFO:tasks.workunit.client.0.smithi170.stdout:1/808: truncate d0/d20/d28/d2a/dc7/fe0 28231 0 2024-01-25T15:03:47.610 INFO:tasks.workunit.client.0.smithi170.stdout:3/881: mkdir d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/ddf/d126 0 2024-01-25T15:03:47.610 INFO:tasks.workunit.client.0.smithi170.stdout:3/882: creat d3/d88/de0/f127 x:0 0 0 2024-01-25T15:03:47.612 INFO:tasks.workunit.client.0.smithi170.stdout:3/883: mknod d3/d10/d13/d1b/d29/db7/c128 0 2024-01-25T15:03:47.612 INFO:tasks.workunit.client.0.smithi170.stdout:3/884: fdatasync d3/d10/d13/f1f 0 2024-01-25T15:03:47.622 INFO:tasks.workunit.client.0.smithi170.stdout:3/885: dread d3/d10/d1e/d21/fa6 [0,4194304] 0 2024-01-25T15:03:47.623 INFO:tasks.workunit.client.0.smithi170.stdout:3/886: mkdir d3/d10/d13/d1b/db3/d129 0 2024-01-25T15:03:47.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:47 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:47.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:47 smithi170 ceph-mon[31899]: pgmap v402: 97 pgs: 97 active+clean; 1.4 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 158 MiB/s rd, 183 MiB/s wr, 1.74k op/s 2024-01-25T15:03:47.625 INFO:tasks.workunit.client.0.smithi170.stdout:5/786: dwrite d5/d54/d85/f1c [4194304,4194304] 0 2024-01-25T15:03:47.626 INFO:tasks.workunit.client.0.smithi170.stdout:4/793: rename d6/d7/d31/d46/d78/f8b to d6/d28/d93/fff 0 2024-01-25T15:03:47.626 INFO:tasks.workunit.client.0.smithi170.stdout:5/787: creat d5/d54/d85/d2c/d45/d56/d102/f108 x:0 0 0 2024-01-25T15:03:47.628 INFO:tasks.workunit.client.0.smithi170.stdout:5/788: symlink d5/d54/d85/d2c/d45/d56/d72/da0/dc9/l109 0 2024-01-25T15:03:47.628 INFO:tasks.workunit.client.0.smithi170.stdout:5/789: chown d5/d54/d85/d2c/d34/d7c 40 1 2024-01-25T15:03:47.629 INFO:tasks.workunit.client.0.smithi170.stdout:4/794: rename d6/d7/d31/d46/d78/fda to d6/d7/d31/d46/d78/f100 0 2024-01-25T15:03:47.641 INFO:tasks.workunit.client.0.smithi170.stdout:3/887: dwrite d3/d10/d13/fc8 [0,4194304] 0 2024-01-25T15:03:47.648 INFO:tasks.workunit.client.0.smithi170.stdout:3/888: getdents d3/d1c/d2b/d5c/dad 0 2024-01-25T15:03:47.651 INFO:tasks.workunit.client.0.smithi170.stdout:2/765: sync 2024-01-25T15:03:47.652 INFO:tasks.workunit.client.0.smithi170.stdout:0/894: rename d8/d11c/d79/d7e/d10d/de7/d5f/lbe to d8/d10/d2d/d53/df4/dc6/dc9/l131 0 2024-01-25T15:03:47.653 INFO:tasks.workunit.client.0.smithi170.stdout:2/766: truncate d10/d1e/d32/d62/fcd 224138 0 2024-01-25T15:03:47.653 INFO:tasks.workunit.client.0.smithi170.stdout:2/767: readlink d10/l29 0 2024-01-25T15:03:47.653 INFO:tasks.workunit.client.0.smithi170.stdout:2/768: chown d10/d1e/d32/d3e/d5c/f94 6 1 2024-01-25T15:03:47.653 INFO:tasks.workunit.client.0.smithi170.stdout:4/795: dwrite d6/d28/d59/dc4/fea [0,4194304] 0 2024-01-25T15:03:47.653 INFO:tasks.workunit.client.0.smithi170.stdout:4/796: readlink d6/d28/d67/lf6 0 2024-01-25T15:03:47.654 INFO:tasks.workunit.client.0.smithi170.stdout:2/769: link d10/d1e/f9a d10/d1b/f10c 0 2024-01-25T15:03:47.657 INFO:tasks.workunit.client.0.smithi170.stdout:0/895: mknod d8/d80/c132 0 2024-01-25T15:03:47.657 INFO:tasks.workunit.client.0.smithi170.stdout:0/896: readlink d8/d10/l75 0 2024-01-25T15:03:47.657 INFO:tasks.workunit.client.0.smithi170.stdout:2/770: truncate d10/fd8 3323158 0 2024-01-25T15:03:47.659 INFO:tasks.workunit.client.0.smithi170.stdout:2/771: getdents d10/d1b/db6/dd7 0 2024-01-25T15:03:47.660 INFO:tasks.workunit.client.0.smithi170.stdout:0/897: mkdir d8/d10/d5a/d133 0 2024-01-25T15:03:47.674 INFO:tasks.workunit.client.0.smithi170.stdout:4/797: dwrite d6/d28/d67/f96 [0,4194304] 0 2024-01-25T15:03:47.676 INFO:tasks.workunit.client.0.smithi170.stdout:4/798: mknod d6/d7/d31/d7e/d80/c101 0 2024-01-25T15:03:47.677 INFO:tasks.workunit.client.0.smithi170.stdout:4/799: dread d6/d28/d59/da8/fdb [0,4194304] 0 2024-01-25T15:03:47.677 INFO:tasks.workunit.client.0.smithi170.stdout:5/790: rename d5/d54/d85/d3f/d8f to d5/d58/d10a 0 2024-01-25T15:03:47.677 INFO:tasks.workunit.client.0.smithi170.stdout:5/791: truncate d5/d54/d85/d2c/d45/f6c 4106501 0 2024-01-25T15:03:47.686 INFO:tasks.workunit.client.0.smithi170.stdout:2/772: dwrite d10/d1e/f26 [0,4194304] 0 2024-01-25T15:03:47.695 INFO:tasks.workunit.client.0.smithi170.stdout:4/800: read f2 [3371544,56377] 0 2024-01-25T15:03:47.696 INFO:tasks.workunit.client.0.smithi170.stdout:4/801: truncate d6/d7/d31/d7e/f5b 1758428 0 2024-01-25T15:03:47.703 INFO:tasks.workunit.client.0.smithi170.stdout:5/792: dwrite d5/f64 [0,4194304] 0 2024-01-25T15:03:47.707 INFO:tasks.workunit.client.0.smithi170.stdout:5/793: mkdir d5/d54/d85/d2c/d45/d10b 0 2024-01-25T15:03:47.707 INFO:tasks.workunit.client.0.smithi170.stdout:5/794: chown d5/d54/d85/d2c/d45/ce9 768 1 2024-01-25T15:03:47.710 INFO:tasks.workunit.client.0.smithi170.stdout:1/809: sync 2024-01-25T15:03:47.710 INFO:tasks.workunit.client.0.smithi170.stdout:9/876: sync 2024-01-25T15:03:47.710 INFO:tasks.workunit.client.0.smithi170.stdout:6/887: sync 2024-01-25T15:03:47.710 INFO:tasks.workunit.client.0.smithi170.stdout:7/892: sync 2024-01-25T15:03:47.710 INFO:tasks.workunit.client.0.smithi170.stdout:3/889: rename d3/d10/d1e/d96/f7b to d3/d10/d52/d10b/f12a 0 2024-01-25T15:03:47.711 INFO:tasks.workunit.client.0.smithi170.stdout:9/877: dread d5/df/d2e/d77/d21/d46/d6c/dd8/d96/f98 [0,4194304] 0 2024-01-25T15:03:47.711 INFO:tasks.workunit.client.0.smithi170.stdout:6/888: stat d2/d7/d23/d19/d2a/d43/d98/f3f 0 2024-01-25T15:03:47.711 INFO:tasks.workunit.client.0.smithi170.stdout:6/889: write d2/d7/dd9/dfc/f12a [763671,11596] 0 2024-01-25T15:03:47.712 INFO:tasks.workunit.client.0.smithi170.stdout:3/890: mknod d3/d1c/d2b/d5c/d97/dab/c12b 0 2024-01-25T15:03:47.712 INFO:tasks.workunit.client.0.smithi170.stdout:7/893: rmdir d8/d20/d2a/d35/d55/d6e 39 2024-01-25T15:03:47.713 INFO:tasks.workunit.client.0.smithi170.stdout:2/773: dwrite d10/d1e/d32/d62/d74/d107/f93 [0,4194304] 0 2024-01-25T15:03:47.713 INFO:tasks.workunit.client.0.smithi170.stdout:1/810: symlink d0/d50/de1/l110 0 2024-01-25T15:03:47.713 INFO:tasks.workunit.client.0.smithi170.stdout:1/811: creat d0/d20/d3a/d60/f111 x:0 0 0 2024-01-25T15:03:47.714 INFO:tasks.workunit.client.0.smithi170.stdout:1/812: chown d0/d2e/lac 0 1 2024-01-25T15:03:47.714 INFO:tasks.workunit.client.0.smithi170.stdout:9/878: symlink d5/df/d16/d52/d9c/l123 0 2024-01-25T15:03:47.715 INFO:tasks.workunit.client.0.smithi170.stdout:6/890: truncate d2/d7/d23/d19/d2a/d43/d44/da4/fae 837278 0 2024-01-25T15:03:47.716 INFO:tasks.workunit.client.0.smithi170.stdout:9/879: truncate d5/df/d2e/d77/d21/daa/fcc 24776 0 2024-01-25T15:03:47.717 INFO:tasks.workunit.client.0.smithi170.stdout:6/891: unlink d2/d7/d23/d19/d2a/d43/d98/d113/d74/dc1/l131 0 2024-01-25T15:03:47.719 INFO:tasks.workunit.client.0.smithi170.stdout:1/813: mkdir d0/d20/d28/dee/d112 0 2024-01-25T15:03:47.721 INFO:tasks.workunit.client.0.smithi170.stdout:2/774: dread d10/d1e/d5e/d73/d9e/da3/fb8 [0,4194304] 0 2024-01-25T15:03:47.721 INFO:tasks.workunit.client.0.smithi170.stdout:2/775: chown d10/d1e/d32/d62/d74/d10b 1539237 1 2024-01-25T15:03:47.721 INFO:tasks.workunit.client.0.smithi170.stdout:6/892: write d2/ddb/f104 [478304,83154] 0 2024-01-25T15:03:47.721 INFO:tasks.workunit.client.0.smithi170.stdout:6/893: dread - d2/d7/d23/d19/d2a/d43/d98/d113/f12c zero size 2024-01-25T15:03:47.721 INFO:tasks.workunit.client.0.smithi170.stdout:6/894: chown d2/d7 1475 1 2024-01-25T15:03:47.721 INFO:tasks.workunit.client.0.smithi170.stdout:2/776: creat d10/d1e/d32/d62/d8d/f10d x:0 0 0 2024-01-25T15:03:47.722 INFO:tasks.workunit.client.0.smithi170.stdout:0/898: rename d8/d10/d2d/d82/df2 to d8/d9/dd6/deb/d134 0 2024-01-25T15:03:47.722 INFO:tasks.workunit.client.0.smithi170.stdout:0/899: dread - d8/d9/d9a/f114 zero size 2024-01-25T15:03:47.725 INFO:tasks.workunit.client.0.smithi170.stdout:7/894: getdents d8/d110 0 2024-01-25T15:03:47.725 INFO:tasks.workunit.client.0.smithi170.stdout:7/895: fsync d8/d110/f111 0 2024-01-25T15:03:47.726 INFO:tasks.workunit.client.0.smithi170.stdout:7/896: truncate d8/d20/d2a/d35/d55/d6e/fd8 2137634 0 2024-01-25T15:03:47.727 INFO:tasks.workunit.client.0.smithi170.stdout:7/897: write d8/d20/d2a/d35/f37 [681492,58865] 0 2024-01-25T15:03:47.727 INFO:tasks.workunit.client.0.smithi170.stdout:9/880: mkdir d5/df/d2e/d6b/d124 0 2024-01-25T15:03:47.729 INFO:tasks.workunit.client.0.smithi170.stdout:3/891: write d3/d10/d13/d1b/d81/f108 [1925321,85497] 0 2024-01-25T15:03:47.729 INFO:tasks.workunit.client.0.smithi170.stdout:3/892: write d3/d1c/f24 [5221716,94367] 0 2024-01-25T15:03:47.729 INFO:tasks.workunit.client.0.smithi170.stdout:3/893: creat d3/d10/d6d/d74/f12c x:0 0 0 2024-01-25T15:03:47.730 INFO:tasks.workunit.client.0.smithi170.stdout:1/814: dread d0/fd [4194304,4194304] 0 2024-01-25T15:03:47.731 INFO:tasks.workunit.client.0.smithi170.stdout:7/898: mkdir d8/d20/d2a/d61/d137 0 2024-01-25T15:03:47.732 INFO:tasks.workunit.client.0.smithi170.stdout:9/881: truncate d5/df/d16/f2b 6968079 0 2024-01-25T15:03:47.734 INFO:tasks.workunit.client.0.smithi170.stdout:5/795: dwrite d5/d54/d85/d2c/d51/d96/dda/dde/f6a [0,4194304] 0 2024-01-25T15:03:47.734 INFO:tasks.workunit.client.0.smithi170.stdout:5/796: fsync d5/d54/d85/d3f/d86/da5/fb2 0 2024-01-25T15:03:47.735 INFO:tasks.workunit.client.0.smithi170.stdout:6/895: dread d2/d7/d23/d19/d2a/d43/d44/da4/fab [0,4194304] 0 2024-01-25T15:03:47.735 INFO:tasks.workunit.client.0.smithi170.stdout:6/896: readlink d2/d7/d23/d19/d2a/d43/d44/l5b 0 2024-01-25T15:03:47.735 INFO:tasks.workunit.client.0.smithi170.stdout:5/797: chown d5/d54/d85/d2c/d45/c78 1095729244 1 2024-01-25T15:03:47.735 INFO:tasks.workunit.client.0.smithi170.stdout:5/798: getdents d5/d58/da9/d107 0 2024-01-25T15:03:47.736 INFO:tasks.workunit.client.0.smithi170.stdout:1/815: mknod d0/d2e/df2/c113 0 2024-01-25T15:03:47.736 INFO:tasks.workunit.client.0.smithi170.stdout:1/816: write d0/f5 [1773029,101735] 0 2024-01-25T15:03:47.739 INFO:tasks.workunit.client.0.smithi170.stdout:5/799: mkdir d5/d54/d85/d2c/d45/d56/d72/d10c 0 2024-01-25T15:03:47.739 INFO:tasks.workunit.client.0.smithi170.stdout:5/800: chown d5/d58/da9/df9/fe2 34 1 2024-01-25T15:03:47.739 INFO:tasks.workunit.client.0.smithi170.stdout:7/899: creat d8/ddb/f138 x:0 0 0 2024-01-25T15:03:47.740 INFO:tasks.workunit.client.0.smithi170.stdout:9/882: mkdir d5/df/d16/d35/d3c/d91/d125 0 2024-01-25T15:03:47.740 INFO:tasks.workunit.client.0.smithi170.stdout:9/883: dread - d5/df/d2e/d77/d21/d46/f64 zero size 2024-01-25T15:03:47.740 INFO:tasks.workunit.client.0.smithi170.stdout:9/884: dread - d5/df/d2e/d77/d21/feb zero size 2024-01-25T15:03:47.740 INFO:tasks.workunit.client.0.smithi170.stdout:9/885: chown d5/df/d2e/d77/d21/d46/c6e 143 1 2024-01-25T15:03:47.741 INFO:tasks.workunit.client.0.smithi170.stdout:6/897: creat d2/d7/d23/d19/d2a/d43/d98/d113/d5d/d94/d97/db4/dc7/f132 x:0 0 0 2024-01-25T15:03:47.742 INFO:tasks.workunit.client.0.smithi170.stdout:1/817: rmdir d0/d50/da0/dab 39 2024-01-25T15:03:47.743 INFO:tasks.workunit.client.0.smithi170.stdout:1/818: chown d0/d20/d28/c32 16839 1 2024-01-25T15:03:47.743 INFO:tasks.workunit.client.0.smithi170.stdout:3/894: dread d3/d10/d13/d1b/d29/f94 [0,4194304] 0 2024-01-25T15:03:47.744 INFO:tasks.workunit.client.0.smithi170.stdout:9/886: mknod d5/df/d2e/d77/d86/c126 0 2024-01-25T15:03:47.745 INFO:tasks.workunit.client.0.smithi170.stdout:6/898: mknod d2/d7/d23/d19/d2a/d6b/dad/dcb/c133 0 2024-01-25T15:03:47.748 INFO:tasks.workunit.client.0.smithi170.stdout:9/887: symlink d5/df/d2e/d77/d21/d46/d18/l127 0 2024-01-25T15:03:47.751 INFO:tasks.workunit.client.0.smithi170.stdout:1/819: rmdir d0/d50/dc0 39 2024-01-25T15:03:47.751 INFO:tasks.workunit.client.0.smithi170.stdout:1/820: fsync d0/d20/d28/d2a/d4a/d56/d5b/fcd 0 2024-01-25T15:03:47.752 INFO:tasks.workunit.client.0.smithi170.stdout:1/821: mknod d0/d20/d28/d2a/d4a/d56/c114 0 2024-01-25T15:03:47.753 INFO:tasks.workunit.client.0.smithi170.stdout:7/900: write d8/d20/d3b/f6a [1597051,22941] 0 2024-01-25T15:03:47.753 INFO:tasks.workunit.client.0.smithi170.stdout:7/901: truncate d8/ddb/f113 219450 0 2024-01-25T15:03:47.754 INFO:tasks.workunit.client.0.smithi170.stdout:2/777: rename d10/d1b/c31 to d10/d1e/c10e 0 2024-01-25T15:03:47.755 INFO:tasks.workunit.client.0.smithi170.stdout:0/900: dwrite d8/d80/fcb [0,4194304] 0 2024-01-25T15:03:47.755 INFO:tasks.workunit.client.0.smithi170.stdout:7/902: rename d8/d20/d2a/d35/d55/d9b/l105 to d8/d20/d2a/d35/d55/d9b/l139 0 2024-01-25T15:03:47.755 INFO:tasks.workunit.client.0.smithi170.stdout:7/903: fdatasync d8/d20/d73/fd2 0 2024-01-25T15:03:47.757 INFO:tasks.workunit.client.0.smithi170.stdout:9/888: rename d5/df/d2e/d6b/d124 to d5/df/d16/d52/d128 0 2024-01-25T15:03:47.757 INFO:tasks.workunit.client.0.smithi170.stdout:9/889: creat d5/df/d2e/d77/d21/d46/f129 x:0 0 0 2024-01-25T15:03:47.761 INFO:tasks.workunit.client.0.smithi170.stdout:1/822: rename d0/d20/d3a/d60/ff8 to d0/d20/d28/d2a/d4a/d56/f115 0 2024-01-25T15:03:47.762 INFO:tasks.workunit.client.0.smithi170.stdout:5/801: dread d5/d54/d85/d2c/d45/d56/d72/da0/dc5/f65 [0,4194304] 0 2024-01-25T15:03:47.762 INFO:tasks.workunit.client.0.smithi170.stdout:9/890: creat d5/df/d16/d35/d3c/d56/d59/d5e/f12a x:0 0 0 2024-01-25T15:03:47.764 INFO:tasks.workunit.client.0.smithi170.stdout:1/823: mkdir d0/d20/d28/dee/d116 0 2024-01-25T15:03:47.765 INFO:tasks.workunit.client.0.smithi170.stdout:1/824: creat d0/d20/d3a/d6e/f117 x:0 0 0 2024-01-25T15:03:47.766 INFO:tasks.workunit.client.0.smithi170.stdout:9/891: rmdir d5/df/d2e/d6b/dd2 39 2024-01-25T15:03:47.767 INFO:tasks.workunit.client.0.smithi170.stdout:9/892: chown d5/df/d2e/f39 2 1 2024-01-25T15:03:47.767 INFO:tasks.workunit.client.0.smithi170.stdout:3/895: dwrite d3/d10/d1e/d21/fa6 [0,4194304] 0 2024-01-25T15:03:47.768 INFO:tasks.workunit.client.0.smithi170.stdout:1/825: mkdir d0/d20/d28/d2a/d4a/d56/d118 0 2024-01-25T15:03:47.770 INFO:tasks.workunit.client.0.smithi170.stdout:5/802: mkdir d5/d54/d85/d10d 0 2024-01-25T15:03:47.770 INFO:tasks.workunit.client.0.smithi170.stdout:6/899: dwrite d2/d7/d23/d19/d2a/d6b/dad/fc5 [0,4194304] 0 2024-01-25T15:03:47.772 INFO:tasks.workunit.client.0.smithi170.stdout:5/803: mkdir d5/d54/d85/d2c/d45/d56/d102/d10e 0 2024-01-25T15:03:47.772 INFO:tasks.workunit.client.0.smithi170.stdout:3/896: mknod d3/d1c/d2b/d5c/d97/c12d 0 2024-01-25T15:03:47.774 INFO:tasks.workunit.client.0.smithi170.stdout:1/826: rename d0/d2e/ff6 to d0/d20/d28/d2a/d4a/f119 0 2024-01-25T15:03:47.775 INFO:tasks.workunit.client.0.smithi170.stdout:6/900: creat d2/d7/d23/d19/d2a/d43/d98/d113/d5d/d94/d97/db4/dc7/d111/f134 x:0 0 0 2024-01-25T15:03:47.776 INFO:tasks.workunit.client.0.smithi170.stdout:5/804: mknod d5/d54/d85/d2c/d34/c10f 0 2024-01-25T15:03:47.777 INFO:tasks.workunit.client.0.smithi170.stdout:3/897: symlink d3/d10/d1e/d21/d41/d4a/l12e 0 2024-01-25T15:03:47.785 INFO:tasks.workunit.client.0.smithi170.stdout:0/901: dwrite d8/d10/d5a/f6c [4194304,4194304] 0 2024-01-25T15:03:47.787 INFO:tasks.workunit.client.0.smithi170.stdout:1/827: dread d0/d50/f52 [0,4194304] 0 2024-01-25T15:03:47.787 INFO:tasks.workunit.client.0.smithi170.stdout:1/828: chown d0/d20/d28/d2a/d4a/d56/dc1/fc2 122876 1 2024-01-25T15:03:47.787 INFO:tasks.workunit.client.0.smithi170.stdout:1/829: read d0/d1b/fa1 [1769487,118129] 0 2024-01-25T15:03:47.787 INFO:tasks.workunit.client.0.smithi170.stdout:1/830: dread - d0/d1b/f109 zero size 2024-01-25T15:03:47.787 INFO:tasks.workunit.client.0.smithi170.stdout:1/831: chown d0/d20/d28/d2a/c34 58 1 2024-01-25T15:03:47.787 INFO:tasks.workunit.client.0.smithi170.stdout:1/832: creat d0/d20/d28/d2a/d4a/d56/dc1/de3/f11a x:0 0 0 2024-01-25T15:03:47.789 INFO:tasks.workunit.client.0.smithi170.stdout:6/901: dread d2/d7/d23/d19/d2a/d43/d98/d113/d5d/d94/d97/db4/dd3/fe0 [0,4194304] 0 2024-01-25T15:03:47.789 INFO:tasks.workunit.client.0.smithi170.stdout:6/902: rmdir d2/d7/d23/d19/d2a/d43/d44 39 2024-01-25T15:03:47.791 INFO:tasks.workunit.client.0.smithi170.stdout:6/903: rename d2/f17 to d2/d7/d23/d19/daf/d105/f135 0 2024-01-25T15:03:47.792 INFO:tasks.workunit.client.0.smithi170.stdout:6/904: creat d2/d7/d23/d19/d2a/d6b/f136 x:0 0 0 2024-01-25T15:03:47.797 INFO:tasks.workunit.client.0.smithi170.stdout:1/833: write d0/d2e/f31 [6090337,65713] 0 2024-01-25T15:03:47.797 INFO:tasks.workunit.client.0.smithi170.stdout:1/834: fdatasync d0/d20/d3a/d60/fe5 0 2024-01-25T15:03:47.798 INFO:tasks.workunit.client.0.smithi170.stdout:1/835: symlink d0/d50/da2/l11b 0 2024-01-25T15:03:47.798 INFO:tasks.workunit.client.0.smithi170.stdout:1/836: readlink d0/d2e/l37 0 2024-01-25T15:03:47.799 INFO:tasks.workunit.client.0.smithi170.stdout:1/837: symlink d0/d20/d28/l11c 0 2024-01-25T15:03:47.801 INFO:tasks.workunit.client.0.smithi170.stdout:9/893: dwrite d5/df/d16/d35/d3c/f5f [0,4194304] 0 2024-01-25T15:03:47.802 INFO:tasks.workunit.client.0.smithi170.stdout:2/778: dwrite d10/d1e/d32/d3e/d41/dc4/f101 [0,4194304] 0 2024-01-25T15:03:47.802 INFO:tasks.workunit.client.0.smithi170.stdout:5/805: dwrite d5/d54/d85/d3f/d86/da5/fb2 [0,4194304] 0 2024-01-25T15:03:47.805 INFO:tasks.workunit.client.0.smithi170.stdout:7/904: dwrite d8/d20/d2a/d35/f44 [0,4194304] 0 2024-01-25T15:03:47.805 INFO:tasks.workunit.client.0.smithi170.stdout:9/894: mkdir d5/df/d16/d52/d128/d12b 0 2024-01-25T15:03:47.805 INFO:tasks.workunit.client.0.smithi170.stdout:7/905: truncate d8/d20/d45/fec 136782 0 2024-01-25T15:03:47.805 INFO:tasks.workunit.client.0.smithi170.stdout:2/779: symlink d10/d1e/d32/d62/d74/l10f 0 2024-01-25T15:03:47.811 INFO:tasks.workunit.client.0.smithi170.stdout:3/898: rmdir d3/d1c/d2b 39 2024-01-25T15:03:47.811 INFO:tasks.workunit.client.0.smithi170.stdout:3/899: chown d3/d10/d1e/d21/d41/d77/fa7 1730333 1 2024-01-25T15:03:47.814 INFO:tasks.workunit.client.0.smithi170.stdout:0/902: dwrite d8/d11c/d79/d7e/d10d/fba [0,4194304] 0 2024-01-25T15:03:47.814 INFO:tasks.workunit.client.0.smithi170.stdout:0/903: dread - d8/d9/d9a/f125 zero size 2024-01-25T15:03:47.814 INFO:tasks.workunit.client.0.smithi170.stdout:5/806: rmdir d5/d54/d85/d2c/d51/d96/dda/dde 39 2024-01-25T15:03:47.826 INFO:tasks.workunit.client.0.smithi170.stdout:6/905: dwrite d2/d7/d23/d19/d2a/d6b/f136 [0,4194304] 0 2024-01-25T15:03:47.826 INFO:tasks.workunit.client.0.smithi170.stdout:7/906: creat d8/d20/d45/d68/f13a x:0 0 0 2024-01-25T15:03:47.827 INFO:tasks.workunit.client.0.smithi170.stdout:7/907: fsync d8/d20/d45/d107/fca 0 2024-01-25T15:03:47.828 INFO:tasks.workunit.client.0.smithi170.stdout:2/780: link d10/d1e/f58 d10/d1e/f110 0 2024-01-25T15:03:47.828 INFO:tasks.workunit.client.0.smithi170.stdout:2/781: write d10/f37 [1674470,119051] 0 2024-01-25T15:03:47.829 INFO:tasks.workunit.client.0.smithi170.stdout:0/904: creat d8/d9/f135 x:0 0 0 2024-01-25T15:03:47.830 INFO:tasks.workunit.client.0.smithi170.stdout:1/838: dwrite d0/d91/fc8 [0,4194304] 0 2024-01-25T15:03:47.833 INFO:tasks.workunit.client.0.smithi170.stdout:6/906: creat d2/d7/d23/d19/daf/d105/f137 x:0 0 0 2024-01-25T15:03:47.833 INFO:tasks.workunit.client.0.smithi170.stdout:6/907: read d2/d7/f18 [1374024,69314] 0 2024-01-25T15:03:47.833 INFO:tasks.workunit.client.0.smithi170.stdout:6/908: fdatasync d2/f10 0 2024-01-25T15:03:47.834 INFO:tasks.workunit.client.0.smithi170.stdout:7/908: creat d8/d20/d2a/d61/d137/f13b x:0 0 0 2024-01-25T15:03:47.834 INFO:tasks.workunit.client.0.smithi170.stdout:7/909: write d8/d20/d45/d10c/d119/f125 [166353,54392] 0 2024-01-25T15:03:47.835 INFO:tasks.workunit.client.0.smithi170.stdout:0/905: getdents d8/d10/d2d 0 2024-01-25T15:03:47.838 INFO:tasks.workunit.client.0.smithi170.stdout:0/906: dread d8/d9/f46 [0,4194304] 0 2024-01-25T15:03:47.838 INFO:tasks.workunit.client.0.smithi170.stdout:0/907: chown d8/d9/d9a/l4a 372823243 1 2024-01-25T15:03:47.840 INFO:tasks.workunit.client.0.smithi170.stdout:1/839: unlink d0/d50/da0/dab/cb4 0 2024-01-25T15:03:47.840 INFO:tasks.workunit.client.0.smithi170.stdout:4/802: sync 2024-01-25T15:03:47.841 INFO:tasks.workunit.client.0.smithi170.stdout:3/900: dwrite d3/d3b/f70 [0,4194304] 0 2024-01-25T15:03:47.841 INFO:tasks.workunit.client.0.smithi170.stdout:2/782: write d10/d1e/d32/d98/fa5 [2110060,18749] 0 2024-01-25T15:03:47.842 INFO:tasks.workunit.client.0.smithi170.stdout:1/840: symlink d0/d20/d28/d2a/d4a/d56/d106/l11d 0 2024-01-25T15:03:47.850 INFO:tasks.workunit.client.0.smithi170.stdout:4/803: write d6/d28/d93/f9a [3229973,31076] 0 2024-01-25T15:03:47.850 INFO:tasks.workunit.client.0.smithi170.stdout:3/901: creat d3/d10/d52/d10b/de8/f12f x:0 0 0 2024-01-25T15:03:47.852 INFO:tasks.workunit.client.0.smithi170.stdout:4/804: creat d6/d7/d31/d7e/f102 x:0 0 0 2024-01-25T15:03:47.863 INFO:tasks.workunit.client.0.smithi170.stdout:2/783: write f6 [2517036,96885] 0 2024-01-25T15:03:47.868 INFO:tasks.workunit.client.0.smithi170.stdout:4/805: getdents d6/d28 0 2024-01-25T15:03:47.873 INFO:tasks.workunit.client.0.smithi170.stdout:7/910: dwrite d8/d20/d3b/d4d/f78 [0,4194304] 0 2024-01-25T15:03:47.873 INFO:tasks.workunit.client.0.smithi170.stdout:3/902: dwrite d3/d88/de0/f127 [0,4194304] 0 2024-01-25T15:03:47.873 INFO:tasks.workunit.client.0.smithi170.stdout:7/911: dread - d8/d20/d2a/d35/db0/f102 zero size 2024-01-25T15:03:47.873 INFO:tasks.workunit.client.0.smithi170.stdout:7/912: creat d8/d20/d73/f13c x:0 0 0 2024-01-25T15:03:47.874 INFO:tasks.workunit.client.0.smithi170.stdout:6/909: dwrite d2/f40 [4194304,4194304] 0 2024-01-25T15:03:47.878 INFO:tasks.workunit.client.0.smithi170.stdout:7/913: mkdir d8/d20/d2a/d35/d13d 0 2024-01-25T15:03:47.880 INFO:tasks.workunit.client.0.smithi170.stdout:7/914: getdents d8/d20/d45/d10c/d119 0 2024-01-25T15:03:47.881 INFO:tasks.workunit.client.0.smithi170.stdout:2/784: dwrite d10/d1e/d32/d3e/d41/dc4/fbf [0,4194304] 0 2024-01-25T15:03:47.881 INFO:tasks.workunit.client.0.smithi170.stdout:3/903: write d3/d10/d1e/d21/d41/d4b/d63/dc7/fcc [1628214,116087] 0 2024-01-25T15:03:47.882 INFO:tasks.workunit.client.0.smithi170.stdout:5/807: rename d5/d54/d85/d2c/d51/d41/ld3 to d5/d54/d85/d2c/d45/d56/d72/df0/l110 0 2024-01-25T15:03:47.882 INFO:tasks.workunit.client.0.smithi170.stdout:5/808: chown d5/d54/d85/d2c/f2d 104 1 2024-01-25T15:03:47.883 INFO:tasks.workunit.client.0.smithi170.stdout:2/785: truncate d10/d1e/d32/d62/d74/fe7 2898073 0 2024-01-25T15:03:47.884 INFO:tasks.workunit.client.0.smithi170.stdout:3/904: unlink d3/d10/d6d/d98/lfd 0 2024-01-25T15:03:47.885 INFO:tasks.workunit.client.0.smithi170.stdout:5/809: symlink d5/d54/d85/d3f/d86/l111 0 2024-01-25T15:03:47.886 INFO:tasks.workunit.client.0.smithi170.stdout:5/810: symlink d5/d54/d85/d3f/l112 0 2024-01-25T15:03:47.886 INFO:tasks.workunit.client.0.smithi170.stdout:5/811: symlink d5/l113 0 2024-01-25T15:03:47.889 INFO:tasks.workunit.client.0.smithi170.stdout:4/806: dwrite d6/d7/d31/d7e/f74 [0,4194304] 0 2024-01-25T15:03:47.893 INFO:tasks.workunit.client.0.smithi170.stdout:4/807: mknod d6/d7/d31/d46/c103 0 2024-01-25T15:03:47.893 INFO:tasks.workunit.client.0.smithi170.stdout:4/808: fsync d6/d7/d9f/fca 0 2024-01-25T15:03:47.894 INFO:tasks.workunit.client.0.smithi170.stdout:2/786: dread d10/d1e/d32/d3e/d5c/d102/fa2 [0,4194304] 0 2024-01-25T15:03:47.894 INFO:tasks.workunit.client.0.smithi170.stdout:2/787: chown f8 1009822191 1 2024-01-25T15:03:47.894 INFO:tasks.workunit.client.0.smithi170.stdout:7/915: write d8/d20/d3b/f50 [1047154,57589] 0 2024-01-25T15:03:47.895 INFO:tasks.workunit.client.0.smithi170.stdout:4/809: dread d6/d28/d59/d7d/f24 [0,4194304] 0 2024-01-25T15:03:47.899 INFO:tasks.workunit.client.0.smithi170.stdout:3/905: read d3/d10/d1e/fbf [1982671,114109] 0 2024-01-25T15:03:47.899 INFO:tasks.workunit.client.0.smithi170.stdout:3/906: read d3/d1c/fb4 [353473,108734] 0 2024-01-25T15:03:47.901 INFO:tasks.workunit.client.0.smithi170.stdout:4/810: dread d6/d7/d31/d7e/f5b [0,4194304] 0 2024-01-25T15:03:47.901 INFO:tasks.workunit.client.0.smithi170.stdout:4/811: dread - d6/d28/d61/dad/ffd zero size 2024-01-25T15:03:47.901 INFO:tasks.workunit.client.0.smithi170.stdout:4/812: truncate d6/d28/d59/da8/fdb 498221 0 2024-01-25T15:03:47.907 INFO:tasks.workunit.client.0.smithi170.stdout:2/788: dread d10/d1e/d5e/d73/f7f [0,4194304] 0 2024-01-25T15:03:47.907 INFO:tasks.workunit.client.0.smithi170.stdout:2/789: chown d10/d1e/d5e/d73/d9e/da3/fb8 37708 1 2024-01-25T15:03:47.910 INFO:tasks.workunit.client.0.smithi170.stdout:4/813: dread d6/d28/f7a [0,4194304] 0 2024-01-25T15:03:47.912 INFO:tasks.workunit.client.0.smithi170.stdout:4/814: write d6/d28/d59/d7d/d6b/f87 [369200,3996] 0 2024-01-25T15:03:47.912 INFO:tasks.workunit.client.0.smithi170.stdout:4/815: chown d6/d28/d67/f9d 127242184 1 2024-01-25T15:03:47.916 INFO:tasks.workunit.client.0.smithi170.stdout:4/816: mknod d6/d7/d31/c104 0 2024-01-25T15:03:47.916 INFO:tasks.workunit.client.0.smithi170.stdout:4/817: chown d6/d7/d1b/c42 13 1 2024-01-25T15:03:47.917 INFO:tasks.workunit.client.0.smithi170.stdout:3/907: dread d3/d10/d1e/d21/d41/d77/f76 [0,4194304] 0 2024-01-25T15:03:47.919 INFO:tasks.workunit.client.0.smithi170.stdout:5/812: dwrite d5/d54/d85/d2c/d45/d56/d72/fbf [0,4194304] 0 2024-01-25T15:03:47.919 INFO:tasks.workunit.client.0.smithi170.stdout:5/813: creat d5/d54/d85/d2c/d51/d41/dcf/f114 x:0 0 0 2024-01-25T15:03:47.919 INFO:tasks.workunit.client.0.smithi170.stdout:5/814: dread - d5/d58/da9/fca zero size 2024-01-25T15:03:47.920 INFO:tasks.workunit.client.0.smithi170.stdout:2/790: dread d10/f37 [0,4194304] 0 2024-01-25T15:03:47.921 INFO:tasks.workunit.client.0.smithi170.stdout:5/815: rename d5/d54/d85/d2c/c39 to d5/d54/d85/d3f/d86/da5/c115 0 2024-01-25T15:03:47.921 INFO:tasks.workunit.client.0.smithi170.stdout:5/816: fsync d5/fd 0 2024-01-25T15:03:47.921 INFO:tasks.workunit.client.0.smithi170.stdout:5/817: write d5/d58/d10a/fea [545975,32103] 0 2024-01-25T15:03:47.921 INFO:tasks.workunit.client.0.smithi170.stdout:5/818: chown c1 12174 1 2024-01-25T15:03:47.921 INFO:tasks.workunit.client.0.smithi170.stdout:5/819: write d5/d54/d85/d2c/d45/fce [710259,43540] 0 2024-01-25T15:03:47.921 INFO:tasks.workunit.client.0.smithi170.stdout:5/820: chown d5/d54/d85/d2c/d51/d41/dcf 232487624 1 2024-01-25T15:03:47.923 INFO:tasks.workunit.client.0.smithi170.stdout:2/791: creat d10/d1e/d5e/d73/df0/f111 x:0 0 0 2024-01-25T15:03:47.923 INFO:tasks.workunit.client.0.smithi170.stdout:5/821: rmdir d5/d54/d85/d2c/d45/d56/d72/da0/d101 0 2024-01-25T15:03:47.925 INFO:tasks.workunit.client.0.smithi170.stdout:5/822: mknod d5/c116 0 2024-01-25T15:03:47.925 INFO:tasks.workunit.client.0.smithi170.stdout:7/916: dwrite d8/d20/d3b/d4d/fad [0,4194304] 0 2024-01-25T15:03:47.929 INFO:tasks.workunit.client.0.smithi170.stdout:3/908: dread d3/d10/d1e/d21/d41/d77/f76 [0,4194304] 0 2024-01-25T15:03:47.931 INFO:tasks.workunit.client.0.smithi170.stdout:4/818: dread d6/d28/d59/d7d/d6b/f88 [0,4194304] 0 2024-01-25T15:03:47.931 INFO:tasks.workunit.client.0.smithi170.stdout:7/917: symlink d8/d20/d45/d68/daa/l13e 0 2024-01-25T15:03:47.931 INFO:tasks.workunit.client.0.smithi170.stdout:7/918: getdents d8/d20/d3b 0 2024-01-25T15:03:47.932 INFO:tasks.workunit.client.0.smithi170.stdout:4/819: mkdir d6/d28/dc2/d105 0 2024-01-25T15:03:47.932 INFO:tasks.workunit.client.0.smithi170.stdout:4/820: chown d6/d7/d31/d7e/d9c/fb1 14688 1 2024-01-25T15:03:47.932 INFO:tasks.workunit.client.0.smithi170.stdout:4/821: truncate d6/d28/d59/d7d/f68 4682451 0 2024-01-25T15:03:47.932 INFO:tasks.workunit.client.0.smithi170.stdout:4/822: write d6/f49 [1882422,108981] 0 2024-01-25T15:03:47.933 INFO:tasks.workunit.client.0.smithi170.stdout:2/792: dread d10/d1e/f9a [0,4194304] 0 2024-01-25T15:03:47.933 INFO:tasks.workunit.client.0.smithi170.stdout:3/909: mkdir d3/d10/d6d/d74/d130 0 2024-01-25T15:03:47.934 INFO:tasks.workunit.client.0.smithi170.stdout:2/793: write d10/d1e/d32/d98/fa5 [336549,82538] 0 2024-01-25T15:03:47.934 INFO:tasks.workunit.client.0.smithi170.stdout:2/794: write d10/d1e/d32/d3e/d41/dc4/dc6/d42/f88 [1025747,128426] 0 2024-01-25T15:03:47.934 INFO:tasks.workunit.client.0.smithi170.stdout:7/919: mkdir d8/d20/d45/d8e/d13f 0 2024-01-25T15:03:47.934 INFO:tasks.workunit.client.0.smithi170.stdout:7/920: write d8/d110/f111 [632122,59785] 0 2024-01-25T15:03:47.934 INFO:tasks.workunit.client.0.smithi170.stdout:3/910: mknod d3/d3b/dc6/d53/c131 0 2024-01-25T15:03:47.935 INFO:tasks.workunit.client.0.smithi170.stdout:3/911: write d3/d10/d1e/d21/f9a [358055,31132] 0 2024-01-25T15:03:47.936 INFO:tasks.workunit.client.0.smithi170.stdout:7/921: link d8/d20/d45/d68/d71/l72 d8/d20/d3b/l140 0 2024-01-25T15:03:47.937 INFO:tasks.workunit.client.0.smithi170.stdout:5/823: dread d5/d54/d85/d2c/fbe [0,4194304] 0 2024-01-25T15:03:47.943 INFO:tasks.workunit.client.0.smithi170.stdout:5/824: mknod d5/d58/da9/d107/c117 0 2024-01-25T15:03:47.945 INFO:tasks.workunit.client.0.smithi170.stdout:5/825: creat d5/d58/d10a/f118 x:0 0 0 2024-01-25T15:03:47.946 INFO:tasks.workunit.client.0.smithi170.stdout:9/895: sync 2024-01-25T15:03:47.946 INFO:tasks.workunit.client.0.smithi170.stdout:9/896: dread - d5/df/d16/d35/d3c/d91/f10f zero size 2024-01-25T15:03:47.946 INFO:tasks.workunit.client.0.smithi170.stdout:5/826: mknod d5/d54/d85/d2c/d34/c119 0 2024-01-25T15:03:47.946 INFO:tasks.workunit.client.0.smithi170.stdout:5/827: write d5/d54/d85/d2c/f5f [1594587,14535] 0 2024-01-25T15:03:47.948 INFO:tasks.workunit.client.0.smithi170.stdout:4/823: dread d6/d7/d1b/f3b [0,4194304] 0 2024-01-25T15:03:47.948 INFO:tasks.workunit.client.0.smithi170.stdout:4/824: chown d6/f75 0 1 2024-01-25T15:03:47.948 INFO:tasks.workunit.client.0.smithi170.stdout:9/897: symlink d5/df/d2e/d77/d21/d46/d18/l12c 0 2024-01-25T15:03:47.948 INFO:tasks.workunit.client.0.smithi170.stdout:9/898: creat d5/dca/dd7/f12d x:0 0 0 2024-01-25T15:03:47.950 INFO:tasks.workunit.client.0.smithi170.stdout:4/825: creat d6/d7/d31/d46/dc6/f106 x:0 0 0 2024-01-25T15:03:47.952 INFO:tasks.workunit.client.0.smithi170.stdout:9/899: mknod d5/df/d49/df1/c12e 0 2024-01-25T15:03:47.960 INFO:tasks.workunit.client.0.smithi170.stdout:3/912: dwrite d3/d10/d6d/d74/f12c [0,4194304] 0 2024-01-25T15:03:47.960 INFO:tasks.workunit.client.0.smithi170.stdout:3/913: write d3/f68 [3004738,9096] 0 2024-01-25T15:03:47.962 INFO:tasks.workunit.client.0.smithi170.stdout:2/795: dwrite d10/d1e/d32/d3e/d41/dc4/dc6/d42/f88 [0,4194304] 0 2024-01-25T15:03:47.972 INFO:tasks.workunit.client.0.smithi170.stdout:4/826: dwrite d6/d7/d31/d7e/f102 [0,4194304] 0 2024-01-25T15:03:47.973 INFO:tasks.workunit.client.0.smithi170.stdout:4/827: fdatasync d6/d28/d59/d7d/d6b/fc7 0 2024-01-25T15:03:47.975 INFO:tasks.workunit.client.0.smithi170.stdout:7/922: dwrite d8/d20/d45/f46 [0,4194304] 0 2024-01-25T15:03:47.977 INFO:tasks.workunit.client.0.smithi170.stdout:3/914: link d3/d10/f23 d3/d10/d13/d1b/d81/f132 0 2024-01-25T15:03:47.978 INFO:tasks.workunit.client.0.smithi170.stdout:3/915: write d3/d10/d13/d1b/d81/f8d [1871746,20920] 0 2024-01-25T15:03:47.978 INFO:tasks.workunit.client.0.smithi170.stdout:3/916: stat d3/d10/d1e/d21/d41/d4a/dc3/dfc/df6/cfa 0 2024-01-25T15:03:47.980 INFO:tasks.workunit.client.0.smithi170.stdout:4/828: symlink d6/d7/d31/d46/l107 0 2024-01-25T15:03:47.981 INFO:tasks.workunit.client.0.smithi170.stdout:3/917: link d3/d10/d13/d1b/db3/fd7 d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/dcb/f133 0 2024-01-25T15:03:47.983 INFO:tasks.workunit.client.0.smithi170.stdout:2/796: symlink d10/d1e/d5e/l112 0 2024-01-25T15:03:47.985 INFO:tasks.workunit.client.0.smithi170.stdout:3/918: link d3/d10/d13/d1b/c67 d3/d10/d1e/de5/c134 0 2024-01-25T15:03:47.985 INFO:tasks.workunit.client.0.smithi170.stdout:3/919: fsync d3/d10/d52/f64 0 2024-01-25T15:03:47.985 INFO:tasks.workunit.client.0.smithi170.stdout:3/920: chown d3/d3b/c93 11491453 1 2024-01-25T15:03:47.985 INFO:tasks.workunit.client.0.smithi170.stdout:9/900: dwrite d5/df/d2e/fa8 [0,4194304] 0 2024-01-25T15:03:47.986 INFO:tasks.workunit.client.0.smithi170.stdout:5/828: link d5/d2a/f53 d5/d54/d85/d2c/d45/d56/d102/d10e/f11a 0 2024-01-25T15:03:47.987 INFO:tasks.workunit.client.0.smithi170.stdout:0/908: sync 2024-01-25T15:03:47.991 INFO:tasks.workunit.client.0.smithi170.stdout:4/829: mkdir d6/d7/d31/d108 0 2024-01-25T15:03:47.991 INFO:tasks.workunit.client.0.smithi170.stdout:4/830: chown d6/d7/d31/d7e/lb6 414038 1 2024-01-25T15:03:47.991 INFO:tasks.workunit.client.0.smithi170.stdout:4/831: truncate d6/d28/f5d 3867539 0 2024-01-25T15:03:47.992 INFO:tasks.workunit.client.0.smithi170.stdout:4/832: readlink d6/d28/l2b 0 2024-01-25T15:03:47.993 INFO:tasks.workunit.client.0.smithi170.stdout:3/921: symlink d3/d1c/d2b/d5c/d97/dab/l135 0 2024-01-25T15:03:47.994 INFO:tasks.workunit.client.0.smithi170.stdout:2/797: mkdir d10/d1e/d32/d62/d74/d107/d113 0 2024-01-25T15:03:47.994 INFO:tasks.workunit.client.0.smithi170.stdout:2/798: stat d10/d1e/d32/d3e/d41/dc4/dc6/l103 0 2024-01-25T15:03:47.994 INFO:tasks.workunit.client.0.smithi170.stdout:2/799: fdatasync d10/d1e/d32/d3e/d41/dc4/f101 0 2024-01-25T15:03:47.998 INFO:tasks.workunit.client.0.smithi170.stdout:5/829: dread d5/d54/d85/f1a [0,4194304] 0 2024-01-25T15:03:47.998 INFO:tasks.workunit.client.0.smithi170.stdout:9/901: creat d5/dc/dce/f12f x:0 0 0 2024-01-25T15:03:48.002 INFO:tasks.workunit.client.0.smithi170.stdout:4/833: unlink d6/d7/f9 0 2024-01-25T15:03:48.003 INFO:tasks.workunit.client.0.smithi170.stdout:3/922: mknod d3/d10/d13/d1b/d81/c136 0 2024-01-25T15:03:48.005 INFO:tasks.workunit.client.0.smithi170.stdout:5/830: creat d5/d54/d85/d2c/d34/f11b x:0 0 0 2024-01-25T15:03:48.005 INFO:tasks.workunit.client.0.smithi170.stdout:5/831: readlink d5/d54/d85/d2c/d51/d41/l100 0 2024-01-25T15:03:48.008 INFO:tasks.workunit.client.0.smithi170.stdout:0/909: unlink d8/d11c/d79/dea/c116 0 2024-01-25T15:03:48.009 INFO:tasks.workunit.client.0.smithi170.stdout:0/910: stat d8/d10/d2d/d2f/cd3 0 2024-01-25T15:03:48.011 INFO:tasks.workunit.client.0.smithi170.stdout:9/902: dread d5/df/d16/d52/fba [0,4194304] 0 2024-01-25T15:03:48.011 INFO:tasks.workunit.client.0.smithi170.stdout:9/903: creat d5/df/d2e/d77/d21/d46/f130 x:0 0 0 2024-01-25T15:03:48.011 INFO:tasks.workunit.client.0.smithi170.stdout:2/800: getdents d10/d1e 0 2024-01-25T15:03:48.011 INFO:tasks.workunit.client.0.smithi170.stdout:2/801: readlink d10/d1e/d32/d3e/d5c/d92/d8b/lc1 0 2024-01-25T15:03:48.011 INFO:tasks.workunit.client.0.smithi170.stdout:2/802: creat d10/d1e/d32/d62/d8d/f114 x:0 0 0 2024-01-25T15:03:48.012 INFO:tasks.workunit.client.0.smithi170.stdout:2/803: creat d10/d1e/d32/f115 x:0 0 0 2024-01-25T15:03:48.012 INFO:tasks.workunit.client.0.smithi170.stdout:3/923: getdents d3/d10/d1e/d21/d41/d4b/d63/dc7 0 2024-01-25T15:03:48.014 INFO:tasks.workunit.client.0.smithi170.stdout:2/804: creat d10/d1e/d32/d3e/d5c/d102/dd4/f116 x:0 0 0 2024-01-25T15:03:48.015 INFO:tasks.workunit.client.0.smithi170.stdout:3/924: symlink d3/d10/d1e/d96/l137 0 2024-01-25T15:03:48.017 INFO:tasks.workunit.client.0.smithi170.stdout:9/904: link d5/df/d16/d35/d3c/d56/d59/d5e/f97 d5/df/d2e/d77/d21/d46/d6c/f131 0 2024-01-25T15:03:48.017 INFO:tasks.workunit.client.0.smithi170.stdout:9/905: chown d5/df/d2e/d77/d21/d34/d3e 77422337 1 2024-01-25T15:03:48.019 INFO:tasks.workunit.client.0.smithi170.stdout:9/906: read d5/df/d2e/d77/d21/d46/d6c/dd8/d96/fb8 [1084040,35993] 0 2024-01-25T15:03:48.019 INFO:tasks.workunit.client.0.smithi170.stdout:9/907: fsync d5/df/d2e/d77/d21/d34/d3e/d7f/f121 0 2024-01-25T15:03:48.020 INFO:tasks.workunit.client.0.smithi170.stdout:9/908: unlink d5/df/d2e/d77/d21/d34/d3e/c60 0 2024-01-25T15:03:48.021 INFO:tasks.workunit.client.0.smithi170.stdout:0/911: write d8/d10/d2d/d2f/f37 [4094803,121788] 0 2024-01-25T15:03:48.021 INFO:tasks.workunit.client.0.smithi170.stdout:0/912: chown d8/d80/c120 165 1 2024-01-25T15:03:48.022 INFO:tasks.workunit.client.0.smithi170.stdout:9/909: creat d5/df/d16/d35/f132 x:0 0 0 2024-01-25T15:03:48.022 INFO:tasks.workunit.client.0.smithi170.stdout:9/910: dread - d5/df/d2e/d77/d21/d46/d6c/dd8/d96/f10e zero size 2024-01-25T15:03:48.023 INFO:tasks.workunit.client.0.smithi170.stdout:0/913: unlink d8/d10/d2d/d2f/lb3 0 2024-01-25T15:03:48.024 INFO:tasks.workunit.client.0.smithi170.stdout:9/911: symlink d5/df/d2e/d77/d21/l133 0 2024-01-25T15:03:48.025 INFO:tasks.workunit.client.0.smithi170.stdout:3/925: write d3/d3b/fda [3560640,22084] 0 2024-01-25T15:03:48.025 INFO:tasks.workunit.client.0.smithi170.stdout:3/926: dread - d3/d10/d13/d1b/d85/ff9 zero size 2024-01-25T15:03:48.025 INFO:tasks.workunit.client.0.smithi170.stdout:0/914: truncate d8/f107 732367 0 2024-01-25T15:03:48.026 INFO:tasks.workunit.client.0.smithi170.stdout:0/915: chown d8/d11c/d79/d7e/d10d/de7/d59/c11d 0 1 2024-01-25T15:03:48.026 INFO:tasks.workunit.client.0.smithi170.stdout:3/927: mknod d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/dcb/c138 0 2024-01-25T15:03:48.029 INFO:tasks.workunit.client.0.smithi170.stdout:3/928: link d3/d1c/l115 d3/d10/d13/d1b/d85/l139 0 2024-01-25T15:03:48.029 INFO:tasks.workunit.client.0.smithi170.stdout:1/841: sync 2024-01-25T15:03:48.029 INFO:tasks.workunit.client.0.smithi170.stdout:6/910: sync 2024-01-25T15:03:48.029 INFO:tasks.workunit.client.0.smithi170.stdout:7/923: rename d8/d20/d2a/d35/l7f to d8/d20/d45/d107/l141 0 2024-01-25T15:03:48.029 INFO:tasks.workunit.client.0.smithi170.stdout:6/911: chown d2/d7/d23/d19/f5e 66124345 1 2024-01-25T15:03:48.030 INFO:tasks.workunit.client.0.smithi170.stdout:1/842: dread - d0/d20/d28/d2a/d4a/d56/dc1/dd1/f10a zero size 2024-01-25T15:03:48.030 INFO:tasks.workunit.client.0.smithi170.stdout:7/924: write d8/d20/d2a/d35/db0/f102 [512376,127304] 0 2024-01-25T15:03:48.030 INFO:tasks.workunit.client.0.smithi170.stdout:6/912: creat d2/d7/d1b/d78/d11a/f138 x:0 0 0 2024-01-25T15:03:48.030 INFO:tasks.workunit.client.0.smithi170.stdout:7/925: chown d8/f1e 2 1 2024-01-25T15:03:48.030 INFO:tasks.workunit.client.0.smithi170.stdout:6/913: write d2/fcc [118426,45721] 0 2024-01-25T15:03:48.034 INFO:tasks.workunit.client.0.smithi170.stdout:6/914: dread d2/fcc [0,4194304] 0 2024-01-25T15:03:48.035 INFO:tasks.workunit.client.0.smithi170.stdout:6/915: write d2/d7/d23/d19/d2a/d43/d98/d113/f12c [244815,47076] 0 2024-01-25T15:03:48.042 INFO:tasks.workunit.client.0.smithi170.stdout:3/929: write d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/dcb/fe4 [2709161,17399] 0 2024-01-25T15:03:48.042 INFO:tasks.workunit.client.0.smithi170.stdout:3/930: write d3/d1c/d2b/f62 [247835,26677] 0 2024-01-25T15:03:48.042 INFO:tasks.workunit.client.0.smithi170.stdout:3/931: chown d3/d10/d13/d1b/d81/c136 1481956535 1 2024-01-25T15:03:48.055 INFO:tasks.workunit.client.0.smithi170.stdout:9/912: dwrite d5/f120 [0,4194304] 0 2024-01-25T15:03:48.055 INFO:tasks.workunit.client.0.smithi170.stdout:9/913: read - d5/df/d16/f109 zero size 2024-01-25T15:03:48.056 INFO:tasks.workunit.client.0.smithi170.stdout:9/914: chown d5/df/d2e/d77/d21/d46/d6c/dd8 117791 1 2024-01-25T15:03:48.056 INFO:tasks.workunit.client.0.smithi170.stdout:0/916: dwrite d8/d9/f46 [0,4194304] 0 2024-01-25T15:03:48.056 INFO:tasks.workunit.client.0.smithi170.stdout:0/917: chown d8/d10/d77/ff7 466 1 2024-01-25T15:03:48.058 INFO:tasks.workunit.client.0.smithi170.stdout:7/926: dwrite d8/d20/d3b/d4d/f6d [4194304,4194304] 0 2024-01-25T15:03:48.058 INFO:tasks.workunit.client.0.smithi170.stdout:7/927: chown d8/d20/d45/d68/d71/f116 365117 1 2024-01-25T15:03:48.058 INFO:tasks.workunit.client.0.smithi170.stdout:7/928: chown d8/d20/d2a/f87 3 1 2024-01-25T15:03:48.058 INFO:tasks.workunit.client.0.smithi170.stdout:4/834: rename d6/d7/d9f/fe9 to d6/d28/f109 0 2024-01-25T15:03:48.058 INFO:tasks.workunit.client.0.smithi170.stdout:4/835: write d6/d28/d59/dc4/ffc [943720,96542] 0 2024-01-25T15:03:48.059 INFO:tasks.workunit.client.0.smithi170.stdout:0/918: creat d8/d11c/d79/d7e/d10d/de7/d5f/d108/f136 x:0 0 0 2024-01-25T15:03:48.061 INFO:tasks.workunit.client.0.smithi170.stdout:7/929: creat d8/d20/d2a/d35/d13d/f142 x:0 0 0 2024-01-25T15:03:48.061 INFO:tasks.workunit.client.0.smithi170.stdout:7/930: readlink d8/d20/dc2/lcd 0 2024-01-25T15:03:48.065 INFO:tasks.workunit.client.0.smithi170.stdout:7/931: unlink d8/d20/dc2/fd6 0 2024-01-25T15:03:48.072 INFO:tasks.workunit.client.0.smithi170.stdout:7/932: stat d8/d20/d2a/d35/d55 0 2024-01-25T15:03:48.072 INFO:tasks.workunit.client.0.smithi170.stdout:7/933: chown d8/d20/d45/d68/d71/l72 13 1 2024-01-25T15:03:48.075 INFO:tasks.workunit.client.0.smithi170.stdout:7/934: getdents d8 0 2024-01-25T15:03:48.077 INFO:tasks.workunit.client.0.smithi170.stdout:0/919: dwrite d8/d11c/d79/d7e/d10d/de7/d5f/f88 [0,4194304] 0 2024-01-25T15:03:48.077 INFO:tasks.workunit.client.0.smithi170.stdout:7/935: truncate d8/d20/d45/d68/f118 1722075 0 2024-01-25T15:03:48.080 INFO:tasks.workunit.client.0.smithi170.stdout:0/920: symlink d8/d11c/d79/d7e/d10d/de7/d12b/l137 0 2024-01-25T15:03:48.080 INFO:tasks.workunit.client.0.smithi170.stdout:0/921: write d8/d10/ffe [1124493,19609] 0 2024-01-25T15:03:48.080 INFO:tasks.workunit.client.0.smithi170.stdout:0/922: write d8/d10/d77/ff7 [4611440,78004] 0 2024-01-25T15:03:48.080 INFO:tasks.workunit.client.0.smithi170.stdout:0/923: chown d8/d10/d2d/d2f/c65 3482394 1 2024-01-25T15:03:48.081 INFO:tasks.workunit.client.0.smithi170.stdout:2/805: rename d10/d1b/cc3 to d10/d1e/d5e/d73/d9e/da3/c117 0 2024-01-25T15:03:48.083 INFO:tasks.workunit.client.0.smithi170.stdout:2/806: dread d10/d1b/f1d [0,4194304] 0 2024-01-25T15:03:48.084 INFO:tasks.workunit.client.0.smithi170.stdout:2/807: creat d10/d1e/d5e/f118 x:0 0 0 2024-01-25T15:03:48.092 INFO:tasks.workunit.client.0.smithi170.stdout:0/924: dread d8/d11c/d79/d7e/d10d/fba [0,4194304] 0 2024-01-25T15:03:48.093 INFO:tasks.workunit.client.0.smithi170.stdout:0/925: unlink d8/d9/d9a/l40 0 2024-01-25T15:03:48.098 INFO:tasks.workunit.client.0.smithi170.stdout:7/936: dwrite d8/d20/d45/d68/d71/d8c/fbf [0,4194304] 0 2024-01-25T15:03:48.099 INFO:tasks.workunit.client.0.smithi170.stdout:7/937: chown d8/f90 46 1 2024-01-25T15:03:48.099 INFO:tasks.workunit.client.0.smithi170.stdout:7/938: chown d8/ld9 6556968 1 2024-01-25T15:03:48.099 INFO:tasks.workunit.client.0.smithi170.stdout:7/939: readlink d8/d20/d45/d68/d71/dc8/l108 0 2024-01-25T15:03:48.099 INFO:tasks.workunit.client.0.smithi170.stdout:7/940: write d8/d20/d2a/d35/f49 [209898,121350] 0 2024-01-25T15:03:48.099 INFO:tasks.workunit.client.0.smithi170.stdout:7/941: creat d8/d20/d2a/f143 x:0 0 0 2024-01-25T15:03:48.103 INFO:tasks.workunit.client.0.smithi170.stdout:7/942: mknod d8/d20/d2a/d35/d55/c144 0 2024-01-25T15:03:48.108 INFO:tasks.workunit.client.0.smithi170.stdout:2/808: dwrite d10/d1e/d32/d62/f79 [0,4194304] 0 2024-01-25T15:03:48.114 INFO:tasks.workunit.client.0.smithi170.stdout:1/843: rename d0/d50/da0 to d0/d20/d3a/d6e/d11e 0 2024-01-25T15:03:48.118 INFO:tasks.workunit.client.0.smithi170.stdout:6/916: rename d2/ddb/f104 to d2/d7/d1b/d28/db8/f139 0 2024-01-25T15:03:48.118 INFO:tasks.workunit.client.0.smithi170.stdout:6/917: chown d2/d7/d23/d19/d2a/d43/d98/d113/dd4/fd8 5077 1 2024-01-25T15:03:48.118 INFO:tasks.workunit.client.0.smithi170.stdout:6/918: truncate d2/fcc 1178693 0 2024-01-25T15:03:48.118 INFO:tasks.workunit.client.0.smithi170.stdout:6/919: creat d2/f13a x:0 0 0 2024-01-25T15:03:48.118 INFO:tasks.workunit.client.0.smithi170.stdout:1/844: symlink d0/d50/de1/l11f 0 2024-01-25T15:03:48.118 INFO:tasks.workunit.client.0.smithi170.stdout:7/943: write d8/d20/f2e [5103990,6247] 0 2024-01-25T15:03:48.119 INFO:tasks.workunit.client.0.smithi170.stdout:7/944: write d8/d20/d45/d68/d71/fbd [681130,84636] 0 2024-01-25T15:03:48.120 INFO:tasks.workunit.client.0.smithi170.stdout:0/926: rename d8/d9/d9a/dbd/l11b to d8/d11c/d79/d7e/d10d/de7/d12b/l138 0 2024-01-25T15:03:48.120 INFO:tasks.workunit.client.0.smithi170.stdout:2/809: dread d10/d1e/d32/d3e/d41/dc4/dc6/f3b [0,4194304] 0 2024-01-25T15:03:48.120 INFO:tasks.workunit.client.0.smithi170.stdout:2/810: read - d10/d1e/d32/d3e/d5c/d92/fe3 zero size 2024-01-25T15:03:48.122 INFO:tasks.workunit.client.0.smithi170.stdout:6/920: rmdir d2/d7/d23/d19/d2a/d6b/dad/dcb 39 2024-01-25T15:03:48.122 INFO:tasks.workunit.client.0.smithi170.stdout:6/921: write d2/d7/d23/d19/f5e [4902523,79522] 0 2024-01-25T15:03:48.122 INFO:tasks.workunit.client.0.smithi170.stdout:6/922: chown d2/d7/d23/l30 35125653 1 2024-01-25T15:03:48.123 INFO:tasks.workunit.client.0.smithi170.stdout:6/923: truncate d2/d7/d23/d19/d2a/d6b/dad/dcb/f124 830085 0 2024-01-25T15:03:48.123 INFO:tasks.workunit.client.0.smithi170.stdout:0/927: getdents d8/d10/d2d/d58 0 2024-01-25T15:03:48.125 INFO:tasks.workunit.client.0.smithi170.stdout:6/924: mknod d2/d7/d23/d19/d2a/d43/d98/d113/d5d/d94/d97/db4/dd3/c13b 0 2024-01-25T15:03:48.125 INFO:tasks.workunit.client.0.smithi170.stdout:0/928: mkdir d8/d9/dd6/d139 0 2024-01-25T15:03:48.127 INFO:tasks.workunit.client.0.smithi170.stdout:0/929: creat d8/d10/d2d/d53/df4/dc6/f13a x:0 0 0 2024-01-25T15:03:48.128 INFO:tasks.workunit.client.0.smithi170.stdout:6/925: creat d2/d7/d1b/d28/da7/dd2/d109/f13c x:0 0 0 2024-01-25T15:03:48.128 INFO:tasks.workunit.client.0.smithi170.stdout:6/926: chown d2/d7/d23/d19/d2a/d43/d98/f62 26 1 2024-01-25T15:03:48.128 INFO:tasks.workunit.client.0.smithi170.stdout:6/927: stat d2/d7/d23/l72 0 2024-01-25T15:03:48.128 INFO:tasks.workunit.client.0.smithi170.stdout:6/928: readlink d2/d7/db9/lc3 0 2024-01-25T15:03:48.129 INFO:tasks.workunit.client.0.smithi170.stdout:2/811: truncate d10/d1e/f20 1079760 0 2024-01-25T15:03:48.129 INFO:tasks.workunit.client.0.smithi170.stdout:6/929: creat d2/d7/d1b/d78/f13d x:0 0 0 2024-01-25T15:03:48.137 INFO:tasks.workunit.client.0.smithi170.stdout:0/930: write d8/d10/d2d/d53/f7d [3441676,69436] 0 2024-01-25T15:03:48.139 INFO:tasks.workunit.client.0.smithi170.stdout:5/832: sync 2024-01-25T15:03:48.139 INFO:tasks.workunit.client.0.smithi170.stdout:5/833: stat d5/c30 0 2024-01-25T15:03:48.142 INFO:tasks.workunit.client.0.smithi170.stdout:6/930: write d2/d7/d23/d19/d2a/d43/d98/d113/d74/dc1/dcf/d100/f11d [1164871,49246] 0 2024-01-25T15:03:48.142 INFO:tasks.workunit.client.0.smithi170.stdout:0/931: symlink d8/d11c/d79/dea/l13b 0 2024-01-25T15:03:48.142 INFO:tasks.workunit.client.0.smithi170.stdout:6/931: dread - d2/d7/d1b/d28/da7/f93 zero size 2024-01-25T15:03:48.142 INFO:tasks.workunit.client.0.smithi170.stdout:1/845: dwrite d0/d50/fa6 [0,4194304] 0 2024-01-25T15:03:48.142 INFO:tasks.workunit.client.0.smithi170.stdout:1/846: fsync d0/f5 0 2024-01-25T15:03:48.142 INFO:tasks.workunit.client.0.smithi170.stdout:0/932: chown d8/d11c/d79/d7e/d10d/de7/d5f/d108/l109 3488207 1 2024-01-25T15:03:48.146 INFO:tasks.workunit.client.0.smithi170.stdout:1/847: link d0/d20/cda d0/d50/d8e/d9e/c120 0 2024-01-25T15:03:48.147 INFO:tasks.workunit.client.0.smithi170.stdout:1/848: chown d0/d20/d28/d2a/d4a/d56/d5b/c9d 151215 1 2024-01-25T15:03:48.148 INFO:tasks.workunit.client.0.smithi170.stdout:0/933: unlink d8/d10/d2d/d2f/d96/db7/l101 0 2024-01-25T15:03:48.151 INFO:tasks.workunit.client.0.smithi170.stdout:1/849: creat d0/d50/da2/f121 x:0 0 0 2024-01-25T15:03:48.152 INFO:tasks.workunit.client.0.smithi170.stdout:0/934: mkdir d8/d10/d5a/d13c 0 2024-01-25T15:03:48.152 INFO:tasks.workunit.client.0.smithi170.stdout:0/935: chown d8/d10/d2d/d2f/d96/db7 3741191 1 2024-01-25T15:03:48.153 INFO:tasks.workunit.client.0.smithi170.stdout:5/834: dread d5/d54/d85/d2c/d51/fb5 [0,4194304] 0 2024-01-25T15:03:48.156 INFO:tasks.workunit.client.0.smithi170.stdout:5/835: truncate d5/d54/d85/d2c/d51/f4c 232898 0 2024-01-25T15:03:48.159 INFO:tasks.workunit.client.0.smithi170.stdout:5/836: mknod d5/d58/da9/d107/c11c 0 2024-01-25T15:03:48.159 INFO:tasks.workunit.client.0.smithi170.stdout:5/837: fsync d5/f8e 0 2024-01-25T15:03:48.162 INFO:tasks.workunit.client.0.smithi170.stdout:1/850: dread d0/d20/d3a/f44 [0,4194304] 0 2024-01-25T15:03:48.162 INFO:tasks.workunit.client.0.smithi170.stdout:1/851: write d0/d20/d28/d2a/d4a/d56/dc1/dd1/f10a [5890,45043] 0 2024-01-25T15:03:48.165 INFO:tasks.workunit.client.0.smithi170.stdout:5/838: truncate d5/d2a/f4a 4997127 0 2024-01-25T15:03:48.168 INFO:tasks.workunit.client.0.smithi170.stdout:2/812: rename d10/d1e/d32/d3e/d5c/d102/dd4/fea to d10/d1e/d32/d62/d74/d107/f119 0 2024-01-25T15:03:48.169 INFO:tasks.workunit.client.0.smithi170.stdout:2/813: mkdir d10/d1e/d32/d62/d74/d10b/d11a 0 2024-01-25T15:03:48.170 INFO:tasks.workunit.client.0.smithi170.stdout:2/814: creat d10/d1e/d32/d62/d8d/f11b x:0 0 0 2024-01-25T15:03:48.171 INFO:tasks.workunit.client.0.smithi170.stdout:2/815: mknod d10/d1e/d32/d3e/d41/dc4/dc6/d42/daa/c11c 0 2024-01-25T15:03:48.171 INFO:tasks.workunit.client.0.smithi170.stdout:6/932: rename d2/fcc to d2/d7/d23/d19/f13e 0 2024-01-25T15:03:48.171 INFO:tasks.workunit.client.0.smithi170.stdout:6/933: readlink d2/d7/d23/d19/d2a/d43/d98/d113/l57 0 2024-01-25T15:03:48.172 INFO:tasks.workunit.client.0.smithi170.stdout:2/816: mkdir d10/d1e/d32/d3e/d5c/d92/d8b/d11d 0 2024-01-25T15:03:48.174 INFO:tasks.workunit.client.0.smithi170.stdout:1/852: dread d0/d20/d28/f4c [0,4194304] 0 2024-01-25T15:03:48.174 INFO:tasks.workunit.client.0.smithi170.stdout:1/853: chown d0/d20/d28/d7b/dfc/f102 198145 1 2024-01-25T15:03:48.175 INFO:tasks.workunit.client.0.smithi170.stdout:0/936: dwrite d8/d11c/d79/d7e/d10d/de7/d59/d100/f12c [0,4194304] 0 2024-01-25T15:03:48.179 INFO:tasks.workunit.client.0.smithi170.stdout:1/854: mkdir d0/d20/d28/d2a/dc7/d122 0 2024-01-25T15:03:48.180 INFO:tasks.workunit.client.0.smithi170.stdout:1/855: fdatasync d0/d20/d3a/d6e/d11e/d9c/fc3 0 2024-01-25T15:03:48.180 INFO:tasks.workunit.client.0.smithi170.stdout:1/856: stat d0/d20/d28/d2a/d4a/d56/dc1/de3/fec 0 2024-01-25T15:03:48.180 INFO:tasks.workunit.client.0.smithi170.stdout:1/857: stat d0/de8/feb 0 2024-01-25T15:03:48.181 INFO:tasks.workunit.client.0.smithi170.stdout:1/858: dread - d0/d20/d3a/d60/fe5 zero size 2024-01-25T15:03:48.181 INFO:tasks.workunit.client.0.smithi170.stdout:1/859: chown d0/d20/d28/dee/d112 371182511 1 2024-01-25T15:03:48.183 INFO:tasks.workunit.client.0.smithi170.stdout:0/937: creat d8/d10/d5a/d7f/dd9/f13d x:0 0 0 2024-01-25T15:03:48.186 INFO:tasks.workunit.client.0.smithi170.stdout:0/938: rename d8/d10/d2d/c128 to d8/d11c/d79/d7e/d10d/de7/d5f/c13e 0 2024-01-25T15:03:48.187 INFO:tasks.workunit.client.0.smithi170.stdout:0/939: read d8/d18/f20 [1259378,11818] 0 2024-01-25T15:03:48.189 INFO:tasks.workunit.client.0.smithi170.stdout:0/940: unlink d8/d10/d77/ce6 0 2024-01-25T15:03:48.191 INFO:tasks.workunit.client.0.smithi170.stdout:0/941: creat d8/d10/d2d/d53/df4/dc6/dc9/f13f x:0 0 0 2024-01-25T15:03:48.193 INFO:tasks.workunit.client.0.smithi170.stdout:0/942: mknod d8/d11c/c140 0 2024-01-25T15:03:48.193 INFO:tasks.workunit.client.0.smithi170.stdout:0/943: fsync d8/d11c/d79/d7e/d10d/fba 0 2024-01-25T15:03:48.195 INFO:tasks.workunit.client.0.smithi170.stdout:0/944: mknod d8/d10/d2d/d53/df4/dc6/dc9/dca/d111/c141 0 2024-01-25T15:03:48.197 INFO:tasks.workunit.client.0.smithi170.stdout:5/839: dwrite d5/d58/da9/df9/dbd/ff8 [0,4194304] 0 2024-01-25T15:03:48.197 INFO:tasks.workunit.client.0.smithi170.stdout:5/840: write d5/d54/d85/d2c/d34/f6e [1265267,22449] 0 2024-01-25T15:03:48.201 INFO:tasks.workunit.client.0.smithi170.stdout:5/841: dread d5/d54/fa3 [0,4194304] 0 2024-01-25T15:03:48.201 INFO:tasks.workunit.client.0.smithi170.stdout:5/842: chown d5/d54/d85/d3f/l112 180594 1 2024-01-25T15:03:48.201 INFO:tasks.workunit.client.0.smithi170.stdout:5/843: fsync d5/d54/d85/d2c/d51/d96/dda/dde/fdb 0 2024-01-25T15:03:48.201 INFO:tasks.workunit.client.0.smithi170.stdout:5/844: readlink d5/lac 0 2024-01-25T15:03:48.202 INFO:tasks.workunit.client.0.smithi170.stdout:0/945: unlink d8/d10/d2d/d53/df4/f11f 0 2024-01-25T15:03:48.202 INFO:tasks.workunit.client.0.smithi170.stdout:0/946: truncate d8/d10/d2d/d53/df4/dc6/dc9/dca/ffa 790472 0 2024-01-25T15:03:48.202 INFO:tasks.workunit.client.0.smithi170.stdout:5/845: creat d5/d54/d85/d3f/f11d x:0 0 0 2024-01-25T15:03:48.202 INFO:tasks.workunit.client.0.smithi170.stdout:5/846: readlink d5/d54/d85/d2c/l32 0 2024-01-25T15:03:48.209 INFO:tasks.workunit.client.0.smithi170.stdout:0/947: rename d8/d10/d2d/d58 to d8/d9/dd6/d139/d142 0 2024-01-25T15:03:48.209 INFO:tasks.workunit.client.0.smithi170.stdout:0/948: write d8/d10/d5a/fa9 [345925,20071] 0 2024-01-25T15:03:48.217 INFO:tasks.workunit.client.0.smithi170.stdout:2/817: dwrite d10/d1e/d32/d3e/d5c/f76 [0,4194304] 0 2024-01-25T15:03:48.217 INFO:tasks.workunit.client.0.smithi170.stdout:2/818: chown d10/d1e/d32/d3e/d41/c8a 10102 1 2024-01-25T15:03:48.218 INFO:tasks.workunit.client.0.smithi170.stdout:2/819: fdatasync d10/f104 0 2024-01-25T15:03:48.219 INFO:tasks.workunit.client.0.smithi170.stdout:2/820: mkdir d10/d1e/d5e/d73/d9e/da3/d11e 0 2024-01-25T15:03:48.221 INFO:tasks.workunit.client.0.smithi170.stdout:6/934: dwrite d2/d7/d23/d19/d2a/d43/fa1 [0,4194304] 0 2024-01-25T15:03:48.221 INFO:tasks.workunit.client.0.smithi170.stdout:2/821: dread d10/d1e/fd9 [0,4194304] 0 2024-01-25T15:03:48.222 INFO:tasks.workunit.client.0.smithi170.stdout:1/860: dwrite d0/fed [0,4194304] 0 2024-01-25T15:03:48.222 INFO:tasks.workunit.client.0.smithi170.stdout:1/861: chown d0/d20/d28/d7b 2 1 2024-01-25T15:03:48.228 INFO:tasks.workunit.client.0.smithi170.stdout:2/822: creat d10/d1e/d32/d3e/d41/dc4/dc6/f11f x:0 0 0 2024-01-25T15:03:48.228 INFO:tasks.workunit.client.0.smithi170.stdout:6/935: rmdir d2/d7/d23/d19/d2a/d43/d44/da4 39 2024-01-25T15:03:48.228 INFO:tasks.workunit.client.0.smithi170.stdout:6/936: creat d2/d7/d23/d19/d2a/d6b/f13f x:0 0 0 2024-01-25T15:03:48.229 INFO:tasks.workunit.client.0.smithi170.stdout:1/862: rename d0/d20/d28/d2a/d4a/d56/dc1/fd0 to d0/d20/d28/d2a/d4a/d56/dc1/de3/f123 0 2024-01-25T15:03:48.230 INFO:tasks.workunit.client.0.smithi170.stdout:2/823: dread d10/d1e/d32/d62/fcd [0,4194304] 0 2024-01-25T15:03:48.230 INFO:tasks.workunit.client.0.smithi170.stdout:2/824: truncate d10/d1e/d32/d3e/d41/dc4/dc6/d42/daa/fec 950410 0 2024-01-25T15:03:48.232 INFO:tasks.workunit.client.0.smithi170.stdout:0/949: dread d8/d9/dd6/d139/d142/f5c [4194304,4194304] 0 2024-01-25T15:03:48.234 INFO:tasks.workunit.client.0.smithi170.stdout:6/937: unlink d2/d7/d23/l5c 0 2024-01-25T15:03:48.235 INFO:tasks.workunit.client.0.smithi170.stdout:6/938: rename d2/d7/d23/d19/d2a/d43/d98/d113/d74/dc1/cef to d2/d7/d23/d19/d2a/d43/d98/d113/d74/dc1/dcf/dda/c140 0 2024-01-25T15:03:48.235 INFO:tasks.workunit.client.0.smithi170.stdout:6/939: readlink d2/d7/d23/d19/d2a/d43/d98/l4d 0 2024-01-25T15:03:48.236 INFO:tasks.workunit.client.0.smithi170.stdout:6/940: symlink d2/d7/d23/d19/d2a/d43/d98/d113/d74/dce/l141 0 2024-01-25T15:03:48.236 INFO:tasks.workunit.client.0.smithi170.stdout:6/941: fsync d2/f4 0 2024-01-25T15:03:48.237 INFO:tasks.workunit.client.0.smithi170.stdout:2/825: truncate d10/d1e/d32/d62/f79 2285522 0 2024-01-25T15:03:48.237 INFO:tasks.workunit.client.0.smithi170.stdout:6/942: symlink d2/d7/l142 0 2024-01-25T15:03:48.241 INFO:tasks.workunit.client.0.smithi170.stdout:2/826: dread d10/d1e/d32/d62/d8d/f96 [0,4194304] 0 2024-01-25T15:03:48.249 INFO:tasks.workunit.client.0.smithi170.stdout:5/847: dwrite d5/d54/d85/d2c/d45/d56/d102/d10e/f11a [0,4194304] 0 2024-01-25T15:03:48.257 INFO:tasks.workunit.client.0.smithi170.stdout:1/863: dwrite d0/d2e/fae [0,4194304] 0 2024-01-25T15:03:48.257 INFO:tasks.workunit.client.0.smithi170.stdout:1/864: chown d0/d20/d28/d2a/d57/ca9 3672 1 2024-01-25T15:03:48.258 INFO:tasks.workunit.client.0.smithi170.stdout:3/932: sync 2024-01-25T15:03:48.258 INFO:tasks.workunit.client.0.smithi170.stdout:9/915: sync 2024-01-25T15:03:48.258 INFO:tasks.workunit.client.0.smithi170.stdout:7/945: sync 2024-01-25T15:03:48.258 INFO:tasks.workunit.client.0.smithi170.stdout:2/827: rename d10/d1e/d32/d3e/d41/c8a to d10/d1e/d5e/d73/d9e/da3/df4/c120 0 2024-01-25T15:03:48.258 INFO:tasks.workunit.client.0.smithi170.stdout:2/828: chown d10/d1e/d5e/d73/d9e/da3/fb8 738895 1 2024-01-25T15:03:48.258 INFO:tasks.workunit.client.0.smithi170.stdout:9/916: truncate d5/df/d2e/d77/d21/d46/ffa 303483 0 2024-01-25T15:03:48.258 INFO:tasks.workunit.client.0.smithi170.stdout:4/836: sync 2024-01-25T15:03:48.258 INFO:tasks.workunit.client.0.smithi170.stdout:3/933: creat d3/d10/f13a x:0 0 0 2024-01-25T15:03:48.258 INFO:tasks.workunit.client.0.smithi170.stdout:3/934: write d3/d88/de0/ff8 [66015,42143] 0 2024-01-25T15:03:48.259 INFO:tasks.workunit.client.0.smithi170.stdout:4/837: creat d6/d7/d31/d7e/f10a x:0 0 0 2024-01-25T15:03:48.264 INFO:tasks.workunit.client.0.smithi170.stdout:6/943: chown d2/d7/d23/d19/d2a/d43/d98/d113/d74/l8e 185078 1 2024-01-25T15:03:48.264 INFO:tasks.workunit.client.0.smithi170.stdout:6/944: readlink d2/d7/l41 0 2024-01-25T15:03:48.265 INFO:tasks.workunit.client.0.smithi170.stdout:1/865: symlink d0/d20/d3a/d6e/d11e/dab/l124 0 2024-01-25T15:03:48.266 INFO:tasks.workunit.client.0.smithi170.stdout:9/917: rename d5/df/d2e/d6b/f73 to d5/df/d2e/d77/d21/d46/f134 0 2024-01-25T15:03:48.266 INFO:tasks.workunit.client.0.smithi170.stdout:3/935: mknod d3/d10/d13/d1b/db3/d129/c13b 0 2024-01-25T15:03:48.266 INFO:tasks.workunit.client.0.smithi170.stdout:6/945: chown d2/d7/d23/c65 353858724 1 2024-01-25T15:03:48.269 INFO:tasks.workunit.client.0.smithi170.stdout:5/848: dwrite d5/d2a/f4a [0,4194304] 0 2024-01-25T15:03:48.269 INFO:tasks.workunit.client.0.smithi170.stdout:1/866: rename d0/d20/d3a/d60/f10d to d0/de8/f125 0 2024-01-25T15:03:48.270 INFO:tasks.workunit.client.0.smithi170.stdout:3/936: creat d3/d10/d1e/d21/d41/d4b/f13c x:0 0 0 2024-01-25T15:03:48.270 INFO:tasks.workunit.client.0.smithi170.stdout:3/937: chown d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/dcb/c138 14105838 1 2024-01-25T15:03:48.270 INFO:tasks.workunit.client.0.smithi170.stdout:6/946: write d2/d7/d23/d19/d2a/d6b/f136 [4812661,46055] 0 2024-01-25T15:03:48.272 INFO:tasks.workunit.client.0.smithi170.stdout:5/849: creat d5/d54/d85/d2c/d51/d96/dda/dde/f11e x:0 0 0 2024-01-25T15:03:48.275 INFO:tasks.workunit.client.0.smithi170.stdout:6/947: mkdir d2/d143 0 2024-01-25T15:03:48.278 INFO:tasks.workunit.client.0.smithi170.stdout:5/850: rename d5/d54/d85/d2c/l9a to d5/d2a/l11f 0 2024-01-25T15:03:48.278 INFO:tasks.workunit.client.0.smithi170.stdout:5/851: truncate d5/d54/fa3 1468396 0 2024-01-25T15:03:48.279 INFO:tasks.workunit.client.0.smithi170.stdout:6/948: mkdir d2/d7/d1b/d28/db8/d130/d144 0 2024-01-25T15:03:48.279 INFO:tasks.workunit.client.0.smithi170.stdout:6/949: write d2/d7/fbf [3214534,112067] 0 2024-01-25T15:03:48.280 INFO:tasks.workunit.client.0.smithi170.stdout:6/950: write d2/d7/d23/d19/d2a/d43/d98/d113/d74/fd5 [1008286,8588] 0 2024-01-25T15:03:48.281 INFO:tasks.workunit.client.0.smithi170.stdout:6/951: symlink d2/d7/d23/d19/d2a/d43/d98/d113/dd4/l145 0 2024-01-25T15:03:48.282 INFO:tasks.workunit.client.0.smithi170.stdout:4/838: dread d6/d7/d31/f7b [4194304,4194304] 0 2024-01-25T15:03:48.282 INFO:tasks.workunit.client.0.smithi170.stdout:2/829: dwrite d10/fd8 [0,4194304] 0 2024-01-25T15:03:48.282 INFO:tasks.workunit.client.0.smithi170.stdout:1/867: rmdir d0/de8 39 2024-01-25T15:03:48.284 INFO:tasks.workunit.client.0.smithi170.stdout:4/839: mkdir d6/d28/d59/d7d/d10b 0 2024-01-25T15:03:48.286 INFO:tasks.workunit.client.0.smithi170.stdout:1/868: symlink d0/d20/d28/d2a/d4a/d56/d106/l126 0 2024-01-25T15:03:48.286 INFO:tasks.workunit.client.0.smithi170.stdout:1/869: chown d0/fdf 344 1 2024-01-25T15:03:48.286 INFO:tasks.workunit.client.0.smithi170.stdout:1/870: readlink d0/d20/d28/d2a/d57/lb3 0 2024-01-25T15:03:48.290 INFO:tasks.workunit.client.0.smithi170.stdout:3/938: dread d3/d10/d1e/d21/d41/d77/f76 [0,4194304] 0 2024-01-25T15:03:48.290 INFO:tasks.workunit.client.0.smithi170.stdout:3/939: fdatasync d3/d1c/d2d/f35 0 2024-01-25T15:03:48.295 INFO:tasks.workunit.client.0.smithi170.stdout:3/940: dread d3/d10/f1a [0,4194304] 0 2024-01-25T15:03:48.296 INFO:tasks.workunit.client.0.smithi170.stdout:2/830: write f8 [2125165,61398] 0 2024-01-25T15:03:48.299 INFO:tasks.workunit.client.0.smithi170.stdout:6/952: dread d2/d7/d1b/d78/fb6 [0,4194304] 0 2024-01-25T15:03:48.299 INFO:tasks.workunit.client.0.smithi170.stdout:3/941: rename d3/cc to d3/d10/d6d/d74/c13d 0 2024-01-25T15:03:48.300 INFO:tasks.workunit.client.0.smithi170.stdout:6/953: fsync d2/d7/d23/d19/d2a/f79 0 2024-01-25T15:03:48.300 INFO:tasks.workunit.client.0.smithi170.stdout:1/871: read d0/d2e/fae [3793292,104887] 0 2024-01-25T15:03:48.300 INFO:tasks.workunit.client.0.smithi170.stdout:1/872: creat d0/d20/d28/d2a/d4a/d56/dc1/f127 x:0 0 0 2024-01-25T15:03:48.301 INFO:tasks.workunit.client.0.smithi170.stdout:3/942: mknod d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/c13e 0 2024-01-25T15:03:48.301 INFO:tasks.workunit.client.0.smithi170.stdout:3/943: fdatasync d3/d10/d1e/d21/d41/d4a/dc3/fd8 0 2024-01-25T15:03:48.302 INFO:tasks.workunit.client.0.smithi170.stdout:5/852: dwrite d5/d54/d85/d2c/d34/f8b [0,4194304] 0 2024-01-25T15:03:48.302 INFO:tasks.workunit.client.0.smithi170.stdout:1/873: mknod d0/d20/d3a/c128 0 2024-01-25T15:03:48.303 INFO:tasks.workunit.client.0.smithi170.stdout:3/944: mknod d3/d10/d52/c13f 0 2024-01-25T15:03:48.304 INFO:tasks.workunit.client.0.smithi170.stdout:6/954: mkdir d2/d7/d23/d146 0 2024-01-25T15:03:48.304 INFO:tasks.workunit.client.0.smithi170.stdout:6/955: dread - d2/d7/d23/d19/d2a/d43/f10e zero size 2024-01-25T15:03:48.304 INFO:tasks.workunit.client.0.smithi170.stdout:6/956: creat d2/d7/d23/d19/d2a/d6b/f147 x:0 0 0 2024-01-25T15:03:48.305 INFO:tasks.workunit.client.0.smithi170.stdout:6/957: chown d2/d7/d23/d19/d2a/d43/d98/d113/dd4/fd8 2472435 1 2024-01-25T15:03:48.305 INFO:tasks.workunit.client.0.smithi170.stdout:1/874: rename d0/d50/de1/l11f to d0/d20/d28/d2a/d4a/d56/d106/l129 0 2024-01-25T15:03:48.307 INFO:tasks.workunit.client.0.smithi170.stdout:6/958: creat d2/d7/d23/d19/d2a/d43/d98/d113/d5d/d94/f148 x:0 0 0 2024-01-25T15:03:48.307 INFO:tasks.workunit.client.0.smithi170.stdout:6/959: fsync d2/d7/d23/d19/d2a/d43/d44/da4/fae 0 2024-01-25T15:03:48.307 INFO:tasks.workunit.client.0.smithi170.stdout:6/960: write d2/d7/d23/d19/d2a/d6b/f147 [512879,59118] 0 2024-01-25T15:03:48.308 INFO:tasks.workunit.client.0.smithi170.stdout:2/831: dread d10/d1e/d5e/d73/f7f [0,4194304] 0 2024-01-25T15:03:48.308 INFO:tasks.workunit.client.0.smithi170.stdout:2/832: chown d10/d1e/d32/d62/d8d/f114 25641183 1 2024-01-25T15:03:48.309 INFO:tasks.workunit.client.0.smithi170.stdout:1/875: mkdir d0/d20/d12a 0 2024-01-25T15:03:48.309 INFO:tasks.workunit.client.0.smithi170.stdout:2/833: mknod d10/d1e/d5e/d73/d9e/da3/df4/c121 0 2024-01-25T15:03:48.309 INFO:tasks.workunit.client.0.smithi170.stdout:2/834: write d10/d1e/d32/d62/d8d/f10d [618848,103006] 0 2024-01-25T15:03:48.311 INFO:tasks.workunit.client.0.smithi170.stdout:6/961: getdents d2/d7/d23/d19/d2a/d43/d44 0 2024-01-25T15:03:48.311 INFO:tasks.workunit.client.0.smithi170.stdout:6/962: truncate d2/d7/d23/d19/d2a/d6b/dad/dd7/f123 491502 0 2024-01-25T15:03:48.312 INFO:tasks.workunit.client.0.smithi170.stdout:1/876: creat d0/d20/d3a/f12b x:0 0 0 2024-01-25T15:03:48.316 INFO:tasks.workunit.client.0.smithi170.stdout:6/963: creat d2/d7/db9/f149 x:0 0 0 2024-01-25T15:03:48.329 INFO:tasks.workunit.client.0.smithi170.stdout:6/964: creat d2/d7/d1b/d28/da7/dd2/f14a x:0 0 0 2024-01-25T15:03:48.329 INFO:tasks.workunit.client.0.smithi170.stdout:6/965: read - d2/d7/d1b/d28/da7/f93 zero size 2024-01-25T15:03:48.329 INFO:tasks.workunit.client.0.smithi170.stdout:6/966: truncate d2/d7/d1b/d28/da7/dd2/f14a 439912 0 2024-01-25T15:03:48.329 INFO:tasks.workunit.client.0.smithi170.stdout:6/967: write d2/d7/d23/d19/d2a/d6b/fa8 [969465,3708] 0 2024-01-25T15:03:48.330 INFO:tasks.workunit.client.0.smithi170.stdout:6/968: mkdir d2/d7/d1b/d28/da7/d14b 0 2024-01-25T15:03:48.330 INFO:tasks.workunit.client.0.smithi170.stdout:6/969: read - d2/d7/d23/d19/f12b zero size 2024-01-25T15:03:48.333 INFO:tasks.workunit.client.0.smithi170.stdout:3/945: rename d3/d1c/d2b/d5c/dad to d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/dcb/d140 0 2024-01-25T15:03:48.335 INFO:tasks.workunit.client.0.smithi170.stdout:1/877: rename d0/d20/d28/d2a/fa3 to d0/d20/d3a/f12c 0 2024-01-25T15:03:48.335 INFO:tasks.workunit.client.0.smithi170.stdout:1/878: creat d0/d91/f12d x:0 0 0 2024-01-25T15:03:48.336 INFO:tasks.workunit.client.0.smithi170.stdout:1/879: write d0/d20/d3a/d60/f7d [4827512,46156] 0 2024-01-25T15:03:48.336 INFO:tasks.workunit.client.0.smithi170.stdout:1/880: creat d0/d20/d3a/dad/f12e x:0 0 0 2024-01-25T15:03:48.337 INFO:tasks.workunit.client.0.smithi170.stdout:1/881: mknod d0/d20/d28/d2a/d57/c12f 0 2024-01-25T15:03:48.343 INFO:tasks.workunit.client.0.smithi170.stdout:2/835: dread d10/d1e/f20 [0,4194304] 0 2024-01-25T15:03:48.343 INFO:tasks.workunit.client.0.smithi170.stdout:2/836: fdatasync d10/d1e/d32/d3e/d41/dc4/dc6/f23 0 2024-01-25T15:03:48.345 INFO:tasks.workunit.client.0.smithi170.stdout:2/837: mknod d10/d1e/d32/d3e/d41/dc4/c122 0 2024-01-25T15:03:48.352 INFO:tasks.workunit.client.0.smithi170.stdout:2/838: write d10/d1e/d5e/d73/f7f [3605306,15519] 0 2024-01-25T15:03:48.352 INFO:tasks.workunit.client.0.smithi170.stdout:2/839: getdents d10/d1e/d32/d62/d74/d107/d113 0 2024-01-25T15:03:48.354 INFO:tasks.workunit.client.0.smithi170.stdout:3/946: dwrite d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/dcb/d140/d117/f124 [0,4194304] 0 2024-01-25T15:03:48.355 INFO:tasks.workunit.client.0.smithi170.stdout:3/947: getdents d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0 0 2024-01-25T15:03:48.355 INFO:tasks.workunit.client.0.smithi170.stdout:3/948: write d3/d3b/fda [2310428,16956] 0 2024-01-25T15:03:48.356 INFO:tasks.workunit.client.0.smithi170.stdout:2/840: mknod d10/d1e/d32/d63/c123 0 2024-01-25T15:03:48.357 INFO:tasks.workunit.client.0.smithi170.stdout:2/841: creat d10/d1e/d5e/f124 x:0 0 0 2024-01-25T15:03:48.357 INFO:tasks.workunit.client.0.smithi170.stdout:2/842: write d10/d1e/d32/d3e/d41/dc4/dc6/d42/daa/fec [1782613,17213] 0 2024-01-25T15:03:48.357 INFO:tasks.workunit.client.0.smithi170.stdout:2/843: chown d10/d1e/d32/d62/d74/d107/f119 81296 1 2024-01-25T15:03:48.358 INFO:tasks.workunit.client.0.smithi170.stdout:2/844: write d10/f52 [200876,4772] 0 2024-01-25T15:03:48.359 INFO:tasks.workunit.client.0.smithi170.stdout:1/882: dwrite d0/d20/d28/fb6 [0,4194304] 0 2024-01-25T15:03:48.359 INFO:tasks.workunit.client.0.smithi170.stdout:1/883: truncate d0/d20/d3a/f65 535698 0 2024-01-25T15:03:48.359 INFO:tasks.workunit.client.0.smithi170.stdout:1/884: fsync d0/d20/d28/d2a/d4a/d56/dc1/de3/f123 0 2024-01-25T15:03:48.363 INFO:tasks.workunit.client.0.smithi170.stdout:2/845: unlink d10/d1e/d32/d62/fcd 0 2024-01-25T15:03:48.364 INFO:tasks.workunit.client.0.smithi170.stdout:1/885: rename d0/l24 to d0/d20/d28/d2a/d4a/dbe/l130 0 2024-01-25T15:03:48.364 INFO:tasks.workunit.client.0.smithi170.stdout:1/886: write d0/d20/d3a/d60/fe5 [977402,61798] 0 2024-01-25T15:03:48.366 INFO:tasks.workunit.client.0.smithi170.stdout:3/949: dread d3/d10/d13/d1b/f10c [0,4194304] 0 2024-01-25T15:03:48.367 INFO:tasks.workunit.client.0.smithi170.stdout:2/846: write d10/d1e/d32/d3e/d41/dc4/dc6/f3b [2019403,124570] 0 2024-01-25T15:03:48.367 INFO:tasks.workunit.client.0.smithi170.stdout:1/887: getdents d0/d20/d28/d2a/d57 0 2024-01-25T15:03:48.367 INFO:tasks.workunit.client.0.smithi170.stdout:1/888: read d0/d20/fa4 [180321,128419] 0 2024-01-25T15:03:48.367 INFO:tasks.workunit.client.0.smithi170.stdout:1/889: truncate d0/d20/d28/d2a/d4a/d56/d106/daa/fd3 689803 0 2024-01-25T15:03:48.369 INFO:tasks.workunit.client.0.smithi170.stdout:1/890: dread d0/d20/d28/d7b/f93 [0,4194304] 0 2024-01-25T15:03:48.372 INFO:tasks.workunit.client.0.smithi170.stdout:2/847: rename d10/d1e/d5e/d73/d9e/da3/lc2 to d10/d1e/d32/d3e/d5c/d102/dd4/l125 0 2024-01-25T15:03:48.373 INFO:tasks.workunit.client.0.smithi170.stdout:2/848: symlink d10/d1b/l126 0 2024-01-25T15:03:48.373 INFO:tasks.workunit.client.0.smithi170.stdout:2/849: chown d10/d1e/d32/d3e/d41/dc4/dc6 59 1 2024-01-25T15:03:48.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:48 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a[31895]: 2024-01-25T15:03:48.090+0000 7f06c209e700 -1 log_channel(cluster) log [ERR] : Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-25T15:03:48.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:48 smithi170 ceph-mon[31899]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-25T15:03:48.374 INFO:tasks.workunit.client.0.smithi170.stdout:2/850: mkdir d10/d1e/d32/d3e/d41/dc4/dc6/d42/de8/d127 0 2024-01-25T15:03:48.374 INFO:tasks.workunit.client.0.smithi170.stdout:2/851: chown f6 26 1 2024-01-25T15:03:48.377 INFO:tasks.workunit.client.0.smithi170.stdout:3/950: write d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/dcb/d140/d117/f124 [2046238,22567] 0 2024-01-25T15:03:48.379 INFO:tasks.workunit.client.0.smithi170.stdout:3/951: mknod d3/d1c/d2b/d5c/d97/dab/c141 0 2024-01-25T15:03:48.379 INFO:tasks.workunit.client.0.smithi170.stdout:3/952: fsync d3/d10/d1e/d21/d41/d4b/d63/ff5 0 2024-01-25T15:03:48.381 INFO:tasks.workunit.client.0.smithi170.stdout:0/950: sync 2024-01-25T15:03:48.381 INFO:tasks.workunit.client.0.smithi170.stdout:2/852: write d10/d1e/d32/d3e/d41/dc4/dc6/f3b [1293486,58264] 0 2024-01-25T15:03:48.382 INFO:tasks.workunit.client.0.smithi170.stdout:2/853: chown d10/d1e/d32/d3e/d41/ffa 825816634 1 2024-01-25T15:03:48.383 INFO:tasks.workunit.client.0.smithi170.stdout:0/951: dread d8/d11c/d79/d7e/d10d/de7/d59/fd5 [0,4194304] 0 2024-01-25T15:03:48.383 INFO:tasks.workunit.client.0.smithi170.stdout:0/952: chown d8/d11c/d79/d7e/fe1 789658 1 2024-01-25T15:03:48.383 INFO:tasks.workunit.client.0.smithi170.stdout:0/953: chown d8/d10/d2d/d2f/f37 4962211 1 2024-01-25T15:03:48.383 INFO:tasks.workunit.client.0.smithi170.stdout:0/954: write d8/d11c/d79/db6/fb8 [4613600,60117] 0 2024-01-25T15:03:48.394 INFO:tasks.workunit.client.0.smithi170.stdout:0/955: dread d8/d10/d2d/d53/fb5 [4194304,4194304] 0 2024-01-25T15:03:48.410 INFO:tasks.workunit.client.0.smithi170.stdout:3/953: dwrite d3/d10/d6d/f106 [0,4194304] 0 2024-01-25T15:03:48.411 INFO:tasks.workunit.client.0.smithi170.stdout:2/854: dwrite d10/d1e/d32/d3e/d5c/d92/d8b/fb2 [4194304,4194304] 0 2024-01-25T15:03:48.411 INFO:tasks.workunit.client.0.smithi170.stdout:3/954: stat d3/d10/d13/d1b/d85/l139 0 2024-01-25T15:03:48.412 INFO:tasks.workunit.client.0.smithi170.stdout:2/855: chown d10/d1e/d32/d62/d74/d107/cd3 1089535188 1 2024-01-25T15:03:48.412 INFO:tasks.workunit.client.0.smithi170.stdout:2/856: fdatasync d10/d1e/d32/d3e/d41/dc4/dc6/d42/f108 0 2024-01-25T15:03:48.413 INFO:tasks.workunit.client.0.smithi170.stdout:3/955: getdents d3/d10/d52/d10b/de8 0 2024-01-25T15:03:48.413 INFO:tasks.workunit.client.0.smithi170.stdout:2/857: creat d10/d1e/d32/d3e/d41/dc4/dc6/d42/d109/f128 x:0 0 0 2024-01-25T15:03:48.413 INFO:tasks.workunit.client.0.smithi170.stdout:2/858: rmdir d10/d1e/d32/d3e/d5c/de5 39 2024-01-25T15:03:48.421 INFO:tasks.workunit.client.0.smithi170.stdout:3/956: dread d3/d3b/fda [0,4194304] 0 2024-01-25T15:03:48.421 INFO:tasks.workunit.client.0.smithi170.stdout:3/957: truncate d3/d1c/d2b/d5c/d97/dab/fc0 231548 0 2024-01-25T15:03:48.421 INFO:tasks.workunit.client.0.smithi170.stdout:3/958: fdatasync d3/d10/d13/f1f 0 2024-01-25T15:03:48.424 INFO:tasks.workunit.client.0.smithi170.stdout:0/956: dwrite d8/d11c/d79/d7e/d10d/de7/d5f/f8f [0,4194304] 0 2024-01-25T15:03:48.429 INFO:tasks.workunit.client.0.smithi170.stdout:3/959: write d3/d10/d1e/d21/d41/d77/f4e [1090678,75067] 0 2024-01-25T15:03:48.429 INFO:tasks.workunit.client.0.smithi170.stdout:3/960: write d3/d10/d1e/d21/d41/d4a/dc3/dfc/f102 [417343,119105] 0 2024-01-25T15:03:48.455 INFO:tasks.workunit.client.0.smithi170.stdout:0/957: dwrite d8/d10/d5a/fa9 [0,4194304] 0 2024-01-25T15:03:48.455 INFO:tasks.workunit.client.0.smithi170.stdout:0/958: readlink d8/d9/l12 0 2024-01-25T15:03:48.455 INFO:tasks.workunit.client.0.smithi170.stdout:3/961: dwrite d3/d10/fac [0,4194304] 0 2024-01-25T15:03:48.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:48 smithi191 ceph-mon[36347]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-25T15:03:48.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:48 smithi186 ceph-mon[35697]: Health check update: 4 MDSs report damaged metadata (MDS_DAMAGE) 2024-01-25T15:03:49.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:49 smithi191 ceph-mon[36347]: pgmap v403: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 163 MiB/s rd, 191 MiB/s wr, 1.61k op/s 2024-01-25T15:03:49.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:49 smithi186 ceph-mon[35697]: pgmap v403: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 163 MiB/s rd, 191 MiB/s wr, 1.61k op/s 2024-01-25T15:03:49.618 INFO:tasks.workunit.client.0.smithi170.stdout:1/891: rename d0/d20/d3a/d6e/fbb to d0/d50/d8e/f131 0 2024-01-25T15:03:49.618 INFO:tasks.workunit.client.0.smithi170.stdout:1/892: read - d0/d20/ddd/dde/f103 zero size 2024-01-25T15:03:49.618 INFO:tasks.workunit.client.0.smithi170.stdout:1/893: write d0/d20/d3a/f12c [1181462,34586] 0 2024-01-25T15:03:49.618 INFO:tasks.workunit.client.0.smithi170.stdout:1/894: fdatasync d0/d20/d28/d2a/dc7/fe0 0 2024-01-25T15:03:49.618 INFO:tasks.workunit.client.0.smithi170.stdout:1/895: write d0/d20/d28/d2a/d4a/d56/d106/daa/fe9 [991226,16467] 0 2024-01-25T15:03:49.619 INFO:tasks.workunit.client.0.smithi170.stdout:1/896: symlink d0/d20/d3a/l132 0 2024-01-25T15:03:49.620 INFO:tasks.workunit.client.0.smithi170.stdout:1/897: fsync d0/d2e/f8d 0 2024-01-25T15:03:49.621 INFO:tasks.workunit.client.0.smithi170.stdout:7/946: sync 2024-01-25T15:03:49.621 INFO:tasks.workunit.client.0.smithi170.stdout:6/970: sync 2024-01-25T15:03:49.621 INFO:tasks.workunit.client.0.smithi170.stdout:5/853: sync 2024-01-25T15:03:49.621 INFO:tasks.workunit.client.0.smithi170.stdout:4/840: sync 2024-01-25T15:03:49.621 INFO:tasks.workunit.client.0.smithi170.stdout:0/959: sync 2024-01-25T15:03:49.621 INFO:tasks.workunit.client.0.smithi170.stdout:9/918: sync 2024-01-25T15:03:49.621 INFO:tasks.workunit.client.0.smithi170.stdout:4/841: truncate d6/d28/d67/fb0 291161 0 2024-01-25T15:03:49.621 INFO:tasks.workunit.client.0.smithi170.stdout:6/971: write d2/d7/d23/d19/daf/db0/fe3 [909592,93009] 0 2024-01-25T15:03:49.622 INFO:tasks.workunit.client.0.smithi170.stdout:4/842: mknod d6/d28/d93/de0/c10c 0 2024-01-25T15:03:49.622 INFO:tasks.workunit.client.0.smithi170.stdout:5/854: mkdir d5/d58/da9/d107/d120 0 2024-01-25T15:03:49.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:49 smithi170 ceph-mon[31899]: pgmap v403: 97 pgs: 97 active+clean; 1.5 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 163 MiB/s rd, 191 MiB/s wr, 1.61k op/s 2024-01-25T15:03:49.624 INFO:tasks.workunit.client.0.smithi170.stdout:9/919: mknod d5/df/d2e/d77/d21/d46/d6c/dac/c135 0 2024-01-25T15:03:49.624 INFO:tasks.workunit.client.0.smithi170.stdout:9/920: dread - d5/df/d2e/d77/d21/d46/f130 zero size 2024-01-25T15:03:49.626 INFO:tasks.workunit.client.0.smithi170.stdout:6/972: symlink d2/d7/d23/d19/d2a/d43/d98/d113/l14c 0 2024-01-25T15:03:49.629 INFO:tasks.workunit.client.0.smithi170.stdout:4/843: mknod d6/d7/d31/d46/de4/c10d 0 2024-01-25T15:03:49.630 INFO:tasks.workunit.client.0.smithi170.stdout:6/973: dread d2/d7/d1b/d28/db8/f139 [0,4194304] 0 2024-01-25T15:03:49.632 INFO:tasks.workunit.client.0.smithi170.stdout:2/859: rename d10/d1e/d32/d3e/d5c/d102/lf9 to d10/d1e/d32/d3e/d5c/d92/d8b/l129 0 2024-01-25T15:03:49.632 INFO:tasks.workunit.client.0.smithi170.stdout:2/860: fdatasync f8 0 2024-01-25T15:03:49.632 INFO:tasks.workunit.client.0.smithi170.stdout:6/974: mknod d2/d7/d1b/d28/db8/c14d 0 2024-01-25T15:03:49.633 INFO:tasks.workunit.client.0.smithi170.stdout:7/947: write d8/f1e [725884,76291] 0 2024-01-25T15:03:49.635 INFO:tasks.workunit.client.0.smithi170.stdout:3/962: rename d3/fe9 to d3/d10/d52/f142 0 2024-01-25T15:03:49.635 INFO:tasks.workunit.client.0.smithi170.stdout:3/963: creat d3/d10/d13/d1b/d85/f143 x:0 0 0 2024-01-25T15:03:49.635 INFO:tasks.workunit.client.0.smithi170.stdout:3/964: chown d3/d3b/dc6/cdb 26608093 1 2024-01-25T15:03:49.635 INFO:tasks.workunit.client.0.smithi170.stdout:3/965: creat d3/d10/d1e/d21/f144 x:0 0 0 2024-01-25T15:03:49.635 INFO:tasks.workunit.client.0.smithi170.stdout:3/966: write d3/d10/d1e/d21/d41/d4b/f90 [1117369,126731] 0 2024-01-25T15:03:49.635 INFO:tasks.workunit.client.0.smithi170.stdout:3/967: write d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/dcb/d140/d117/f124 [2609380,81849] 0 2024-01-25T15:03:49.635 INFO:tasks.workunit.client.0.smithi170.stdout:6/975: creat d2/d7/d23/d19/d2a/d43/d98/d113/dd4/f14e x:0 0 0 2024-01-25T15:03:49.637 INFO:tasks.workunit.client.0.smithi170.stdout:1/898: rename d0/d20/d28/ff3 to d0/d20/d28/d2a/d4a/d56/d118/f133 0 2024-01-25T15:03:49.637 INFO:tasks.workunit.client.0.smithi170.stdout:1/899: truncate d0/d20/f26 630558 0 2024-01-25T15:03:49.641 INFO:tasks.workunit.client.0.smithi170.stdout:6/976: unlink d2/d7/d23/d19/f20 0 2024-01-25T15:03:49.645 INFO:tasks.workunit.client.0.smithi170.stdout:0/960: rename d8/d9/d9a/f10c to d8/f143 0 2024-01-25T15:03:49.646 INFO:tasks.workunit.client.0.smithi170.stdout:7/948: creat d8/d20/d3b/d4d/f145 x:0 0 0 2024-01-25T15:03:49.648 INFO:tasks.workunit.client.0.smithi170.stdout:1/900: dread d0/d1b/f43 [0,4194304] 0 2024-01-25T15:03:49.649 INFO:tasks.workunit.client.0.smithi170.stdout:9/921: rename d5/df/d2e/f70 to d5/df/d16/d35/d115/f136 0 2024-01-25T15:03:49.650 INFO:tasks.workunit.client.0.smithi170.stdout:0/961: getdents d8/d11c/d79/db6 0 2024-01-25T15:03:49.651 INFO:tasks.workunit.client.0.smithi170.stdout:0/962: dread d8/d11c/fe8 [0,4194304] 0 2024-01-25T15:03:49.651 INFO:tasks.workunit.client.0.smithi170.stdout:1/901: truncate d0/d2e/f3b 602225 0 2024-01-25T15:03:49.655 INFO:tasks.workunit.client.0.smithi170.stdout:9/922: creat d5/df/d16/d35/d3c/d91/dd6/dd9/f137 x:0 0 0 2024-01-25T15:03:49.657 INFO:tasks.workunit.client.0.smithi170.stdout:0/963: truncate d8/d11c/d79/d7e/d10d/fe4 3833426 0 2024-01-25T15:03:49.660 INFO:tasks.workunit.client.0.smithi170.stdout:1/902: rmdir d0/d20/d28/dee 39 2024-01-25T15:03:49.661 INFO:tasks.workunit.client.0.smithi170.stdout:1/903: write d0/de8/feb [693446,34315] 0 2024-01-25T15:03:49.661 INFO:tasks.workunit.client.0.smithi170.stdout:5/855: dwrite d5/d54/d85/d2c/d45/d56/d102/d10e/f11a [0,4194304] 0 2024-01-25T15:03:49.662 INFO:tasks.workunit.client.0.smithi170.stdout:5/856: symlink d5/d54/d85/d2c/d45/d10b/l121 0 2024-01-25T15:03:49.662 INFO:tasks.workunit.client.0.smithi170.stdout:5/857: chown d5/l22 11686055 1 2024-01-25T15:03:49.672 INFO:tasks.workunit.client.0.smithi170.stdout:0/964: write d8/d11c/d79/d7e/d10d/fc7 [1568829,103463] 0 2024-01-25T15:03:49.672 INFO:tasks.workunit.client.0.smithi170.stdout:0/965: fsync d8/d9/f56 0 2024-01-25T15:03:49.672 INFO:tasks.workunit.client.0.smithi170.stdout:0/966: chown d8/d11c/d79/d7e/d10d/de7/d5f/c13e 973495040 1 2024-01-25T15:03:49.673 INFO:tasks.workunit.client.0.smithi170.stdout:7/949: dwrite d8/d20/d2a/d35/d55/d9b/db9/fbe [0,4194304] 0 2024-01-25T15:03:49.673 INFO:tasks.workunit.client.0.smithi170.stdout:7/950: creat d8/d20/d45/d68/d71/f146 x:0 0 0 2024-01-25T15:03:49.677 INFO:tasks.workunit.client.0.smithi170.stdout:5/858: dread d5/d54/d85/d2c/d51/d3d/fad [0,4194304] 0 2024-01-25T15:03:49.679 INFO:tasks.workunit.client.0.smithi170.stdout:5/859: creat d5/d54/d85/d2c/d45/d10b/f122 x:0 0 0 2024-01-25T15:03:49.680 INFO:tasks.workunit.client.0.smithi170.stdout:0/967: getdents d8/d11c/d79/dea 0 2024-01-25T15:03:49.681 INFO:tasks.workunit.client.0.smithi170.stdout:5/860: creat d5/d54/d85/d2c/d45/d56/d102/d10e/f123 x:0 0 0 2024-01-25T15:03:49.685 INFO:tasks.workunit.client.0.smithi170.stdout:9/923: dwrite d5/df/d2e/fdd [0,4194304] 0 2024-01-25T15:03:49.685 INFO:tasks.workunit.client.0.smithi170.stdout:9/924: write d5/df/f20 [3969365,45949] 0 2024-01-25T15:03:49.687 INFO:tasks.workunit.client.0.smithi170.stdout:1/904: dwrite d0/d20/d28/d2a/d4a/d56/dc1/f127 [0,4194304] 0 2024-01-25T15:03:49.688 INFO:tasks.workunit.client.0.smithi170.stdout:1/905: dread d0/d20/d3a/f65 [0,4194304] 0 2024-01-25T15:03:49.694 INFO:tasks.workunit.client.0.smithi170.stdout:1/906: creat d0/d20/d28/d2a/d4a/d56/d118/f134 x:0 0 0 2024-01-25T15:03:49.694 INFO:tasks.workunit.client.0.smithi170.stdout:1/907: read - d0/d1b/f109 zero size 2024-01-25T15:03:49.713 INFO:tasks.workunit.client.0.smithi170.stdout:5/861: dwrite d5/d58/da9/df9/fe2 [0,4194304] 0 2024-01-25T15:03:49.713 INFO:tasks.workunit.client.0.smithi170.stdout:9/925: dwrite d5/df/d2e/d77/d21/d46/d6c/dd8/d96/f103 [0,4194304] 0 2024-01-25T15:03:49.714 INFO:tasks.workunit.client.0.smithi170.stdout:9/926: write d5/dca/dd7/f12d [135248,65254] 0 2024-01-25T15:03:49.714 INFO:tasks.workunit.client.0.smithi170.stdout:9/927: fsync d5/df/d2e/d77/d21/d46/f130 0 2024-01-25T15:03:49.715 INFO:tasks.workunit.client.0.smithi170.stdout:5/862: symlink d5/d54/d85/d2c/d45/d56/d72/l124 0 2024-01-25T15:03:49.716 INFO:tasks.workunit.client.0.smithi170.stdout:5/863: dread - d5/d54/d85/d2c/d34/f11b zero size 2024-01-25T15:03:49.716 INFO:tasks.workunit.client.0.smithi170.stdout:5/864: chown d5/d54/d85/d2c/d34/ca8 5 1 2024-01-25T15:03:49.716 INFO:tasks.workunit.client.0.smithi170.stdout:9/928: getdents d5/df/d16 0 2024-01-25T15:03:49.716 INFO:tasks.workunit.client.0.smithi170.stdout:9/929: stat d5/dc/dce/f12f 0 2024-01-25T15:03:49.716 INFO:tasks.workunit.client.0.smithi170.stdout:1/908: dwrite d0/d2e/fbd [0,4194304] 0 2024-01-25T15:03:49.717 INFO:tasks.workunit.client.0.smithi170.stdout:9/930: mknod d5/df/d2e/d77/d21/daa/c138 0 2024-01-25T15:03:49.717 INFO:tasks.workunit.client.0.smithi170.stdout:4/844: rename d6/d7/d31/d7e/l66 to d6/d7/d31/d46/de4/l10e 0 2024-01-25T15:03:49.717 INFO:tasks.workunit.client.0.smithi170.stdout:4/845: write d6/d28/d67/fec [708614,39154] 0 2024-01-25T15:03:49.717 INFO:tasks.workunit.client.0.smithi170.stdout:5/865: mkdir d5/d58/da9/df9/d125 0 2024-01-25T15:03:49.719 INFO:tasks.workunit.client.0.smithi170.stdout:5/866: mkdir d5/d58/da9/df9/d125/d126 0 2024-01-25T15:03:49.720 INFO:tasks.workunit.client.0.smithi170.stdout:1/909: creat d0/d20/d28/d2a/d4a/d56/f135 x:0 0 0 2024-01-25T15:03:49.722 INFO:tasks.workunit.client.0.smithi170.stdout:5/867: chown d5/d58/d10a/db8/dd5 15 1 2024-01-25T15:03:49.722 INFO:tasks.workunit.client.0.smithi170.stdout:1/910: mkdir d0/d20/d3a/d6e/d11e/dab/d136 0 2024-01-25T15:03:49.723 INFO:tasks.workunit.client.0.smithi170.stdout:1/911: creat d0/d20/ddd/dde/f137 x:0 0 0 2024-01-25T15:03:49.725 INFO:tasks.workunit.client.0.smithi170.stdout:5/868: dread d5/d54/d85/f14 [0,4194304] 0 2024-01-25T15:03:49.736 INFO:tasks.workunit.client.0.smithi170.stdout:9/931: dwrite d5/df/d2e/d77/f57 [0,4194304] 0 2024-01-25T15:03:49.746 INFO:tasks.workunit.client.0.smithi170.stdout:5/869: dwrite d5/d54/d85/f1a [0,4194304] 0 2024-01-25T15:03:49.752 INFO:tasks.workunit.client.0.smithi170.stdout:2/861: rename d10/d1e/d5e/d73/f7e to d10/d1e/d32/d3e/d5c/d102/dd4/f12a 0 2024-01-25T15:03:49.754 INFO:tasks.workunit.client.0.smithi170.stdout:2/862: getdents d10/d1e/d32/d62/d74 0 2024-01-25T15:03:49.758 INFO:tasks.workunit.client.0.smithi170.stdout:3/968: rename d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/c13e to d3/d1c/d2b/d5c/d97/dab/c145 0 2024-01-25T15:03:49.763 INFO:tasks.workunit.client.0.smithi170.stdout:6/977: rename d2/d7/d1b/l88 to d2/d7/d23/d19/d2a/l14f 0 2024-01-25T15:03:49.764 INFO:tasks.workunit.client.0.smithi170.stdout:6/978: write d2/d7/d23/d19/d2a/d6b/f147 [495295,93285] 0 2024-01-25T15:03:49.777 INFO:tasks.workunit.client.0.smithi170.stdout:5/870: dwrite d5/d58/da9/fd6 [0,4194304] 0 2024-01-25T15:03:49.779 INFO:tasks.workunit.client.0.smithi170.stdout:5/871: creat d5/d58/da9/df9/d125/d126/f127 x:0 0 0 2024-01-25T15:03:49.783 INFO:tasks.workunit.client.0.smithi170.stdout:2/863: dwrite d10/fd8 [0,4194304] 0 2024-01-25T15:03:49.783 INFO:tasks.workunit.client.0.smithi170.stdout:2/864: symlink d10/d1b/l12b 0 2024-01-25T15:03:49.783 INFO:tasks.workunit.client.0.smithi170.stdout:2/865: mkdir d10/d1e/d5e/d73/d9e/d12c 0 2024-01-25T15:03:49.786 INFO:tasks.workunit.client.0.smithi170.stdout:2/866: dread d10/d1e/d32/d3e/f46 [0,4194304] 0 2024-01-25T15:03:49.786 INFO:tasks.workunit.client.0.smithi170.stdout:0/968: rename d8/ca0 to d8/d10/d2d/d53/df4/dc6/dc9/c144 0 2024-01-25T15:03:49.786 INFO:tasks.workunit.client.0.smithi170.stdout:0/969: chown d8/cf0 16311017 1 2024-01-25T15:03:49.787 INFO:tasks.workunit.client.0.smithi170.stdout:0/970: chown d8/d11c 359 1 2024-01-25T15:03:49.788 INFO:tasks.workunit.client.0.smithi170.stdout:0/971: creat d8/d10/d2d/d53/df4/dc6/dc9/dca/d111/f145 x:0 0 0 2024-01-25T15:03:49.789 INFO:tasks.workunit.client.0.smithi170.stdout:0/972: fdatasync d8/d10/ffe 0 2024-01-25T15:03:49.789 INFO:tasks.workunit.client.0.smithi170.stdout:0/973: fdatasync d8/d11c/d79/d7e/d10d/fc7 0 2024-01-25T15:03:49.789 INFO:tasks.workunit.client.0.smithi170.stdout:2/867: mknod d10/d1b/db6/dd5/c12d 0 2024-01-25T15:03:49.789 INFO:tasks.workunit.client.0.smithi170.stdout:2/868: fsync d10/d1e/d32/d3e/d41/dc4/dc6/f23 0 2024-01-25T15:03:49.790 INFO:tasks.workunit.client.0.smithi170.stdout:0/974: link d8/d9/dd6/d139/d142/fa5 d8/d11c/f146 0 2024-01-25T15:03:49.790 INFO:tasks.workunit.client.0.smithi170.stdout:0/975: truncate d8/d10/d2d/d53/df4/dc6/f13a 782993 0 2024-01-25T15:03:49.791 INFO:tasks.workunit.client.0.smithi170.stdout:2/869: link d10/d1b/l12b d10/d1e/d5e/d73/d9e/d12c/l12e 0 2024-01-25T15:03:49.791 INFO:tasks.workunit.client.0.smithi170.stdout:3/969: dwrite d3/d1c/d2b/d5c/d97/dab/fc0 [0,4194304] 0 2024-01-25T15:03:49.793 INFO:tasks.workunit.client.0.smithi170.stdout:2/870: creat d10/d1e/d32/d3e/d5c/d92/f12f x:0 0 0 2024-01-25T15:03:49.796 INFO:tasks.workunit.client.0.smithi170.stdout:3/970: creat d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/dcb/d140/f146 x:0 0 0 2024-01-25T15:03:49.797 INFO:tasks.workunit.client.0.smithi170.stdout:3/971: rmdir d3/d1c/d2b/d5c/d97 39 2024-01-25T15:03:49.798 INFO:tasks.workunit.client.0.smithi170.stdout:3/972: creat d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/dcb/d140/d117/f147 x:0 0 0 2024-01-25T15:03:49.801 INFO:tasks.workunit.client.0.smithi170.stdout:3/973: symlink d3/d10/d1e/d96/l148 0 2024-01-25T15:03:49.801 INFO:tasks.workunit.client.0.smithi170.stdout:3/974: creat d3/d10/d13/d1b/db3/f149 x:0 0 0 2024-01-25T15:03:49.801 INFO:tasks.workunit.client.0.smithi170.stdout:3/975: chown d3/d10/d52 130538 1 2024-01-25T15:03:49.807 INFO:tasks.workunit.client.0.smithi170.stdout:2/871: link d10/d1e/d32/d3e/d41/dc4/dc6/d42/l81 d10/d1e/d32/d3e/d5c/d102/dd4/l130 0 2024-01-25T15:03:49.813 INFO:tasks.workunit.client.0.smithi170.stdout:0/976: dwrite d8/d18/fa4 [0,4194304] 0 2024-01-25T15:03:49.813 INFO:tasks.workunit.client.0.smithi170.stdout:0/977: readlink d8/d10/d2d/d53/df4/dc6/dc9/l131 0 2024-01-25T15:03:49.815 INFO:tasks.workunit.client.0.smithi170.stdout:4/846: rename d6/d7/d31/d7e/f74 to d6/d7/d31/dd2/f10f 0 2024-01-25T15:03:49.819 INFO:tasks.workunit.client.0.smithi170.stdout:6/979: rename d2/d7/d23/d19/d2a/d43/d98/d113/dd4/lf2 to d2/d7/d23/d19/d2a/d43/d98/d113/d5d/d94/d97/db4/dc7/d111/l150 0 2024-01-25T15:03:49.820 INFO:tasks.workunit.client.0.smithi170.stdout:4/847: mkdir d6/d28/d59/da8/d110 0 2024-01-25T15:03:49.820 INFO:tasks.workunit.client.0.smithi170.stdout:6/980: dread d2/d7/d1b/d28/f8a [4194304,4194304] 0 2024-01-25T15:03:49.822 INFO:tasks.workunit.client.0.smithi170.stdout:7/951: sync 2024-01-25T15:03:49.822 INFO:tasks.workunit.client.0.smithi170.stdout:6/981: truncate d2/d7/d23/d19/d2a/d6b/dad/dd7/f123 309770 0 2024-01-25T15:03:49.823 INFO:tasks.workunit.client.0.smithi170.stdout:7/952: mknod d8/d20/d2a/d35/d55/c147 0 2024-01-25T15:03:49.824 INFO:tasks.workunit.client.0.smithi170.stdout:3/976: dwrite d3/d10/d52/f142 [0,4194304] 0 2024-01-25T15:03:49.825 INFO:tasks.workunit.client.0.smithi170.stdout:7/953: creat d8/d20/d2a/d35/d55/d6e/f148 x:0 0 0 2024-01-25T15:03:49.829 INFO:tasks.workunit.client.0.smithi170.stdout:7/954: creat d8/d20/d45/d10c/d132/f149 x:0 0 0 2024-01-25T15:03:49.829 INFO:tasks.workunit.client.0.smithi170.stdout:7/955: stat d8/d20/dc2/ff2 0 2024-01-25T15:03:49.829 INFO:tasks.workunit.client.0.smithi170.stdout:7/956: chown d8/d20/d2a/d35/f49 347413213 1 2024-01-25T15:03:49.830 INFO:tasks.workunit.client.0.smithi170.stdout:6/982: write d2/d7/d23/d19/d2a/d43/f58 [967992,59341] 0 2024-01-25T15:03:49.830 INFO:tasks.workunit.client.0.smithi170.stdout:6/983: fsync d2/d7/d23/d19/d2a/d43/d98/d113/dd4/fd8 0 2024-01-25T15:03:49.831 INFO:tasks.workunit.client.0.smithi170.stdout:6/984: mknod d2/d7/d23/d146/c151 0 2024-01-25T15:03:49.834 INFO:tasks.workunit.client.0.smithi170.stdout:7/957: dread d8/f1e [0,4194304] 0 2024-01-25T15:03:49.834 INFO:tasks.workunit.client.0.smithi170.stdout:7/958: fdatasync d8/d20/f30 0 2024-01-25T15:03:49.835 INFO:tasks.workunit.client.0.smithi170.stdout:2/872: dwrite d10/d1e/d32/f66 [0,4194304] 0 2024-01-25T15:03:49.841 INFO:tasks.workunit.client.0.smithi170.stdout:5/872: rename d5/d54/d85/d2c/d34/d69/fe3 to d5/db9/f128 0 2024-01-25T15:03:49.842 INFO:tasks.workunit.client.0.smithi170.stdout:6/985: write d2/f4f [3887557,45463] 0 2024-01-25T15:03:49.843 INFO:tasks.workunit.client.0.smithi170.stdout:5/873: link d5/d54/d85/d2c/d45/d56/lc7 d5/d58/da9/df9/d125/l129 0 2024-01-25T15:03:49.843 INFO:tasks.workunit.client.0.smithi170.stdout:5/874: write d5/d54/d85/d2c/d34/f11b [822899,51430] 0 2024-01-25T15:03:49.843 INFO:tasks.workunit.client.0.smithi170.stdout:5/875: fsync d5/f13 0 2024-01-25T15:03:49.845 INFO:tasks.workunit.client.0.smithi170.stdout:2/873: link d10/d1e/d32/d62/d8d/fbe d10/d1e/d32/d3e/d41/d7a/f131 0 2024-01-25T15:03:49.847 INFO:tasks.workunit.client.0.smithi170.stdout:2/874: symlink d10/d1e/d32/d62/l132 0 2024-01-25T15:03:49.850 INFO:tasks.workunit.client.0.smithi170.stdout:2/875: mkdir d10/d1e/d32/d133 0 2024-01-25T15:03:49.852 INFO:tasks.workunit.client.0.smithi170.stdout:2/876: creat d10/d1e/d32/d3e/d41/dc4/f134 x:0 0 0 2024-01-25T15:03:49.853 INFO:tasks.workunit.client.0.smithi170.stdout:2/877: creat d10/d1b/db6/dd7/f135 x:0 0 0 2024-01-25T15:03:49.860 INFO:tasks.workunit.client.0.smithi170.stdout:4/848: rename d6/d28/d59/d7d/d6b to d6/d28/dc2/d111 0 2024-01-25T15:03:49.860 INFO:tasks.workunit.client.0.smithi170.stdout:4/849: readlink d6/d7/d31/d46/dc6/lf5 0 2024-01-25T15:03:49.860 INFO:tasks.workunit.client.0.smithi170.stdout:4/850: creat d6/d7/d31/d46/f112 x:0 0 0 2024-01-25T15:03:49.861 INFO:tasks.workunit.client.0.smithi170.stdout:7/959: rename d8/ddb/f11a to d8/d20/dc2/f14a 0 2024-01-25T15:03:49.861 INFO:tasks.workunit.client.0.smithi170.stdout:7/960: chown d8/d20/d2a/d35/d55/dcf/d120 4370649 1 2024-01-25T15:03:49.863 INFO:tasks.workunit.client.0.smithi170.stdout:7/961: rmdir d8/d20/d2a/d35/db0 39 2024-01-25T15:03:49.863 INFO:tasks.workunit.client.0.smithi170.stdout:7/962: fsync d8/d20/d3b/f3c 0 2024-01-25T15:03:49.863 INFO:tasks.workunit.client.0.smithi170.stdout:7/963: fdatasync d8/d20/d2a/d61/fed 0 2024-01-25T15:03:49.863 INFO:tasks.workunit.client.0.smithi170.stdout:7/964: write d8/d20/d2a/d35/d55/d7d/fcc [711680,85914] 0 2024-01-25T15:03:49.864 INFO:tasks.workunit.client.0.smithi170.stdout:5/876: dwrite d5/d54/d85/f21 [0,4194304] 0 2024-01-25T15:03:49.866 INFO:tasks.workunit.client.0.smithi170.stdout:4/851: rename d6/d7/d9f/ld1 to d6/d28/d59/l113 0 2024-01-25T15:03:49.866 INFO:tasks.workunit.client.0.smithi170.stdout:5/877: link d5/d54/d85/d2c/d45/d56/d72/da0/dc5/l89 d5/d54/d85/d2c/d45/d56/d102/d10e/l12a 0 2024-01-25T15:03:49.872 INFO:tasks.workunit.client.0.smithi170.stdout:7/965: dread f7 [0,4194304] 0 2024-01-25T15:03:49.873 INFO:tasks.workunit.client.0.smithi170.stdout:7/966: mknod d8/d20/d2a/c14b 0 2024-01-25T15:03:49.873 INFO:tasks.workunit.client.0.smithi170.stdout:4/852: dread d6/f49 [0,4194304] 0 2024-01-25T15:03:49.873 INFO:tasks.workunit.client.0.smithi170.stdout:2/878: dwrite d10/d1e/d32/d3e/d41/dc4/dc6/d42/daa/ff7 [0,4194304] 0 2024-01-25T15:03:49.875 INFO:tasks.workunit.client.0.smithi170.stdout:7/967: dread d8/d20/d2a/d35/d55/d7d/da6/dd1/fe9 [0,4194304] 0 2024-01-25T15:03:49.878 INFO:tasks.workunit.client.0.smithi170.stdout:2/879: mknod d10/d1e/d32/d3e/d41/dc4/c136 0 2024-01-25T15:03:49.879 INFO:tasks.workunit.client.0.smithi170.stdout:2/880: readlink d10/d1e/d32/l60 0 2024-01-25T15:03:49.879 INFO:tasks.workunit.client.0.smithi170.stdout:2/881: fsync d10/d1e/d32/d3e/d41/dc4/dc6/d42/f108 0 2024-01-25T15:03:49.880 INFO:tasks.workunit.client.0.smithi170.stdout:2/882: creat d10/d1e/d32/d3e/f137 x:0 0 0 2024-01-25T15:03:49.890 INFO:tasks.workunit.client.0.smithi170.stdout:5/878: dwrite d5/f16 [0,4194304] 0 2024-01-25T15:03:49.890 INFO:tasks.workunit.client.0.smithi170.stdout:5/879: chown c1 165938721 1 2024-01-25T15:03:49.892 INFO:tasks.workunit.client.0.smithi170.stdout:7/968: dwrite d8/d20/d45/f122 [0,4194304] 0 2024-01-25T15:03:49.892 INFO:tasks.workunit.client.0.smithi170.stdout:7/969: truncate d8/d20/fef 1922261 0 2024-01-25T15:03:49.892 INFO:tasks.workunit.client.0.smithi170.stdout:2/883: dread d10/f18 [0,4194304] 0 2024-01-25T15:03:49.892 INFO:tasks.workunit.client.0.smithi170.stdout:5/880: rename d5/c30 to d5/d54/d85/d2c/d34/d7c/c12b 0 2024-01-25T15:03:49.893 INFO:tasks.workunit.client.0.smithi170.stdout:5/881: creat d5/d58/da9/df9/f12c x:0 0 0 2024-01-25T15:03:49.893 INFO:tasks.workunit.client.0.smithi170.stdout:5/882: creat d5/d54/d85/d2c/d51/d3d/f12d x:0 0 0 2024-01-25T15:03:49.895 INFO:tasks.workunit.client.0.smithi170.stdout:5/883: symlink d5/d54/d85/d2c/d45/d56/d72/da0/l12e 0 2024-01-25T15:03:49.895 INFO:tasks.workunit.client.0.smithi170.stdout:2/884: symlink d10/l138 0 2024-01-25T15:03:49.898 INFO:tasks.workunit.client.0.smithi170.stdout:5/884: rename d5/d54/d85/d2c/fa2 to d5/d54/f12f 0 2024-01-25T15:03:49.900 INFO:tasks.workunit.client.0.smithi170.stdout:2/885: getdents d10/d1b 0 2024-01-25T15:03:49.902 INFO:tasks.workunit.client.0.smithi170.stdout:2/886: symlink d10/d1e/d32/d3e/d41/dc4/dc6/d42/de8/d127/l139 0 2024-01-25T15:03:49.904 INFO:tasks.workunit.client.0.smithi170.stdout:5/885: mkdir d5/d54/d85/d2c/d51/d96/dda/d130 0 2024-01-25T15:03:49.906 INFO:tasks.workunit.client.0.smithi170.stdout:1/912: sync 2024-01-25T15:03:49.906 INFO:tasks.workunit.client.0.smithi170.stdout:1/913: stat d0/d20/d28/d2a/d4a/d56/dc1/f127 0 2024-01-25T15:03:49.906 INFO:tasks.workunit.client.0.smithi170.stdout:1/914: fsync d0/d91/fc8 0 2024-01-25T15:03:49.908 INFO:tasks.workunit.client.0.smithi170.stdout:5/886: getdents d5/d2a 0 2024-01-25T15:03:49.909 INFO:tasks.workunit.client.0.smithi170.stdout:5/887: chown d5/d54/d85/d2c/d51/d96/dda/dde/f87 816 1 2024-01-25T15:03:49.920 INFO:tasks.workunit.client.0.smithi170.stdout:1/915: rmdir d0 39 2024-01-25T15:03:49.920 INFO:tasks.workunit.client.0.smithi170.stdout:1/916: fsync d0/d20/f2b 0 2024-01-25T15:03:49.920 INFO:tasks.workunit.client.0.smithi170.stdout:5/888: write d5/d54/d85/d2c/d51/d41/f9b [909188,106588] 0 2024-01-25T15:03:49.926 INFO:tasks.workunit.client.0.smithi170.stdout:2/887: rename d10/d1e/d32/d62/le0 to d10/d1e/d5e/d73/l13a 0 2024-01-25T15:03:49.939 INFO:tasks.workunit.client.0.smithi170.stdout:1/917: dwrite d0/fdf [0,4194304] 0 2024-01-25T15:03:49.939 INFO:tasks.workunit.client.0.smithi170.stdout:1/918: read - d0/d2e/fb5 zero size 2024-01-25T15:03:49.940 INFO:tasks.workunit.client.0.smithi170.stdout:5/889: rename d5/d54/d85/d2c/d34/f11b to d5/d58/f131 0 2024-01-25T15:03:49.942 INFO:tasks.workunit.client.0.smithi170.stdout:1/919: dread d0/d2e/f3b [0,4194304] 0 2024-01-25T15:03:49.942 INFO:tasks.workunit.client.0.smithi170.stdout:1/920: chown d0/c73 327 1 2024-01-25T15:03:49.951 INFO:tasks.workunit.client.0.smithi170.stdout:5/890: rename d5/d54/d85/d2c/d51/d41/la1 to d5/d58/da9/df9/dbd/l132 0 2024-01-25T15:03:49.974 INFO:tasks.workunit.client.0.smithi170.stdout:5/891: dwrite d5/d54/d85/f14 [0,4194304] 0 2024-01-25T15:03:49.976 INFO:tasks.workunit.client.0.smithi170.stdout:5/892: creat d5/d54/d85/f133 x:0 0 0 2024-01-25T15:03:49.976 INFO:tasks.workunit.client.0.smithi170.stdout:5/893: chown d5/d58/d10a/fdf 44 1 2024-01-25T15:03:49.977 INFO:tasks.workunit.client.0.smithi170.stdout:5/894: creat d5/d58/f134 x:0 0 0 2024-01-25T15:03:49.977 INFO:tasks.workunit.client.0.smithi170.stdout:5/895: chown d5/d58/da9/df9 82 1 2024-01-25T15:03:49.977 INFO:tasks.workunit.client.0.smithi170.stdout:5/896: fdatasync d5/d54/d85/d2c/d51/d96/dda/dde/f87 0 2024-01-25T15:03:49.978 INFO:tasks.workunit.client.0.smithi170.stdout:5/897: getdents d5/d54/d85/d2c/d34/d7c 0 2024-01-25T15:03:49.979 INFO:tasks.workunit.client.0.smithi170.stdout:5/898: mkdir d5/d54/d85/d2c/d45/d56/d72/d135 0 2024-01-25T15:03:49.979 INFO:tasks.workunit.client.0.smithi170.stdout:5/899: write d5/d54/d85/d2c/d51/d96/dda/dde/fdb [1003423,3161] 0 2024-01-25T15:03:49.980 INFO:tasks.workunit.client.0.smithi170.stdout:5/900: mknod d5/d54/d85/d2c/d45/d56/c136 0 2024-01-25T15:03:49.980 INFO:tasks.workunit.client.0.smithi170.stdout:5/901: chown d5/d58/da9/df9/d125/d126 1413789577 1 2024-01-25T15:03:49.983 INFO:tasks.workunit.client.0.smithi170.stdout:5/902: rmdir d5/d54/d85/d2c/d51 39 2024-01-25T15:03:49.993 INFO:tasks.workunit.client.0.smithi170.stdout:5/903: read d5/d54/d85/d2c/d45/d56/d72/fbf [2349781,104324] 0 2024-01-25T15:03:49.994 INFO:tasks.workunit.client.0.smithi170.stdout:5/904: mknod d5/d54/d85/d2c/d45/d56/d72/da0/dc9/c137 0 2024-01-25T15:03:50.005 INFO:tasks.workunit.client.0.smithi170.stdout:5/905: write d5/d54/d85/f21 [1944825,15299] 0 2024-01-25T15:03:50.006 INFO:tasks.workunit.client.0.smithi170.stdout:5/906: mkdir d5/d54/d85/d2c/d51/d96/dda/d138 0 2024-01-25T15:03:50.007 INFO:tasks.workunit.client.0.smithi170.stdout:5/907: mkdir d5/d54/d85/d2c/d45/d139 0 2024-01-25T15:03:50.016 INFO:tasks.workunit.client.0.smithi170.stdout:5/908: dread d5/d54/d85/d2c/d45/d56/d72/fc0 [0,4194304] 0 2024-01-25T15:03:50.016 INFO:tasks.workunit.client.0.smithi170.stdout:5/909: symlink d5/d54/d85/d2c/d51/d3d/l13a 0 2024-01-25T15:03:50.018 INFO:tasks.workunit.client.0.smithi170.stdout:5/910: chown d5/d58/f88 191 1 2024-01-25T15:03:50.035 INFO:tasks.workunit.client.0.smithi170.stdout:9/932: sync 2024-01-25T15:03:50.036 INFO:tasks.workunit.client.0.smithi170.stdout:9/933: unlink d5/df/d16/d35/d3c/d91/f10f 0 2024-01-25T15:03:50.037 INFO:tasks.workunit.client.0.smithi170.stdout:5/911: dwrite d5/d58/da9/df9/d125/d126/f127 [0,4194304] 0 2024-01-25T15:03:50.042 INFO:tasks.workunit.client.0.smithi170.stdout:5/912: rename d5/d54/d85/d2c/d51/d96 to d5/d54/d85/d10d/d13b 0 2024-01-25T15:03:50.054 INFO:tasks.workunit.client.0.smithi170.stdout:5/913: write d5/f1b [8449028,109064] 0 2024-01-25T15:03:50.055 INFO:tasks.workunit.client.0.smithi170.stdout:9/934: dwrite d5/df/f20 [0,4194304] 0 2024-01-25T15:03:50.055 INFO:tasks.workunit.client.0.smithi170.stdout:9/935: write d5/df/d2e/d6b/f72 [2078092,122346] 0 2024-01-25T15:03:50.055 INFO:tasks.workunit.client.0.smithi170.stdout:9/936: creat d5/df/d2e/f139 x:0 0 0 2024-01-25T15:03:50.069 INFO:tasks.workunit.client.0.smithi170.stdout:5/914: symlink d5/d54/d85/d3f/d86/da5/l13c 0 2024-01-25T15:03:50.070 INFO:tasks.workunit.client.0.smithi170.stdout:5/915: fsync d5/f64 0 2024-01-25T15:03:50.077 INFO:tasks.workunit.client.0.smithi170.stdout:9/937: dwrite d5/df/d2e/d77/d21/d46/fb2 [0,4194304] 0 2024-01-25T15:03:50.086 INFO:tasks.workunit.client.0.smithi170.stdout:9/938: truncate d5/dc/fd 254504 0 2024-01-25T15:03:50.089 INFO:tasks.workunit.client.0.smithi170.stdout:9/939: creat d5/df/d49/df1/f13a x:0 0 0 2024-01-25T15:03:50.090 INFO:tasks.workunit.client.0.smithi170.stdout:9/940: symlink d5/df/d2e/l13b 0 2024-01-25T15:03:50.090 INFO:tasks.workunit.client.0.smithi170.stdout:9/941: dread - d5/df/d2e/d77/d21/d34/d3e/d7f/f121 zero size 2024-01-25T15:03:50.094 INFO:tasks.workunit.client.0.smithi170.stdout:5/916: dwrite d5/f8e [0,4194304] 0 2024-01-25T15:03:50.100 INFO:tasks.workunit.client.0.smithi170.stdout:5/917: rmdir d5/d58/da9/d107/d120 0 2024-01-25T15:03:50.100 INFO:tasks.workunit.client.0.smithi170.stdout:5/918: creat d5/d58/da9/df9/d125/d126/f13d x:0 0 0 2024-01-25T15:03:50.111 INFO:tasks.workunit.client.0.smithi170.stdout:9/942: write d5/dc/f30 [3813632,96505] 0 2024-01-25T15:03:50.115 INFO:tasks.workunit.client.0.smithi170.stdout:9/943: rename d5/df/d2e/d77/d21/d34/f47 to d5/df/d49/df1/d10d/f13c 0 2024-01-25T15:03:50.124 INFO:tasks.workunit.client.0.smithi170.stdout:5/919: dwrite d5/f1b [0,4194304] 0 2024-01-25T15:03:50.124 INFO:tasks.workunit.client.0.smithi170.stdout:5/920: dread - d5/db9/f128 zero size 2024-01-25T15:03:50.124 INFO:tasks.workunit.client.0.smithi170.stdout:5/921: fsync d5/d54/d85/d2c/d51/fdd 0 2024-01-25T15:03:50.125 INFO:tasks.workunit.client.0.smithi170.stdout:5/922: stat d5/d54/d85/d2c/d45/d56/d102/d10e/l12a 0 2024-01-25T15:03:50.125 INFO:tasks.workunit.client.0.smithi170.stdout:5/923: readlink d5/d54/d85/d2c/d51/d3d/l99 0 2024-01-25T15:03:50.136 INFO:tasks.workunit.client.0.smithi170.stdout:9/944: dwrite d5/df/d16/f2b [4194304,4194304] 0 2024-01-25T15:03:50.136 INFO:tasks.workunit.client.0.smithi170.stdout:9/945: fsync d5/f8f 0 2024-01-25T15:03:50.138 INFO:tasks.workunit.client.0.smithi170.stdout:9/946: creat d5/df/d16/d35/d3c/d56/d59/f13d x:0 0 0 2024-01-25T15:03:50.146 INFO:tasks.workunit.client.0.smithi170.stdout:5/924: dwrite d5/f16 [0,4194304] 0 2024-01-25T15:03:50.149 INFO:tasks.workunit.client.0.smithi170.stdout:5/925: unlink d5/d54/d85/d2c/d45/d56/d72/fc0 0 2024-01-25T15:03:50.149 INFO:tasks.workunit.client.0.smithi170.stdout:5/926: symlink d5/d54/d85/d10d/d13b/dda/dde/l13e 0 2024-01-25T15:03:50.150 INFO:tasks.workunit.client.0.smithi170.stdout:5/927: creat d5/d58/da9/d107/f13f x:0 0 0 2024-01-25T15:03:50.151 INFO:tasks.workunit.client.0.smithi170.stdout:5/928: read - d5/d58/d10a/db8/f105 zero size 2024-01-25T15:03:50.152 INFO:tasks.workunit.client.0.smithi170.stdout:5/929: unlink d5/f13 0 2024-01-25T15:03:50.153 INFO:tasks.workunit.client.0.smithi170.stdout:5/930: creat d5/d54/d85/d2c/d45/d56/d72/da0/dc5/f140 x:0 0 0 2024-01-25T15:03:50.176 INFO:tasks.workunit.client.0.smithi170.stdout:5/931: dwrite d5/d2a/f8d [0,4194304] 0 2024-01-25T15:03:50.184 INFO:tasks.workunit.client.0.smithi170.stdout:5/932: dread d5/f64 [0,4194304] 0 2024-01-25T15:03:50.186 INFO:tasks.workunit.client.0.smithi170.stdout:5/933: mkdir d5/d54/d85/d2c/d45/d56/d102/d10e/d141 0 2024-01-25T15:03:50.190 INFO:tasks.workunit.client.0.smithi170.stdout:5/934: rmdir d5/d54/d85/d2c/d45/d56/d72/da0/dc5 39 2024-01-25T15:03:50.202 INFO:tasks.workunit.client.0.smithi170.stdout:5/935: dread d5/d54/d85/f5c [0,4194304] 0 2024-01-25T15:03:50.206 INFO:tasks.workunit.client.0.smithi170.stdout:5/936: dread d5/d54/d85/d2c/d51/d41/f90 [0,4194304] 0 2024-01-25T15:03:50.208 INFO:tasks.workunit.client.0.smithi170.stdout:5/937: symlink d5/d54/d85/d3f/d86/da5/l142 0 2024-01-25T15:03:50.217 INFO:tasks.workunit.client.0.smithi170.stdout:0/978: sync 2024-01-25T15:03:50.217 INFO:tasks.workunit.client.0.smithi170.stdout:3/977: sync 2024-01-25T15:03:50.219 INFO:tasks.workunit.client.0.smithi170.stdout:3/978: mkdir d3/d10/d52/d10b/d14a 0 2024-01-25T15:03:50.221 INFO:tasks.workunit.client.0.smithi170.stdout:3/979: mknod d3/d10/d1e/c14b 0 2024-01-25T15:03:50.223 INFO:tasks.workunit.client.0.smithi170.stdout:3/980: mknod d3/c14c 0 2024-01-25T15:03:50.223 INFO:tasks.workunit.client.0.smithi170.stdout:0/979: dread d8/d10/d2d/d53/f7d [0,4194304] 0 2024-01-25T15:03:50.223 INFO:tasks.workunit.client.0.smithi170.stdout:0/980: write d8/d10/d2d/d53/df4/faa [4698824,81431] 0 2024-01-25T15:03:50.223 INFO:tasks.workunit.client.0.smithi170.stdout:0/981: getdents d8/d10/d2d/d53/df4/dc6/dc9/df9 0 2024-01-25T15:03:50.224 INFO:tasks.workunit.client.0.smithi170.stdout:0/982: fdatasync d8/f107 0 2024-01-25T15:03:50.225 INFO:tasks.workunit.client.0.smithi170.stdout:0/983: mkdir d8/d11c/d79/d7e/d10d/de7/d5f/d147 0 2024-01-25T15:03:50.227 INFO:tasks.workunit.client.0.smithi170.stdout:0/984: mknod d8/d10/d2d/d82/c148 0 2024-01-25T15:03:50.228 INFO:tasks.workunit.client.0.smithi170.stdout:0/985: getdents d8/d11c/d79 0 2024-01-25T15:03:50.229 INFO:tasks.workunit.client.0.smithi170.stdout:0/986: mkdir d8/d10/d2d/d53/df4/d149 0 2024-01-25T15:03:50.231 INFO:tasks.workunit.client.0.smithi170.stdout:0/987: mkdir d8/d10/d2d/d53/df4/dc6/dc9/dca/d14a 0 2024-01-25T15:03:50.233 INFO:tasks.workunit.client.0.smithi170.stdout:5/938: dwrite d5/d58/da9/fca [0,4194304] 0 2024-01-25T15:03:50.236 INFO:tasks.workunit.client.0.smithi170.stdout:5/939: mkdir d5/d54/d85/d10d/d13b/dda/dde/d143 0 2024-01-25T15:03:50.236 INFO:tasks.workunit.client.0.smithi170.stdout:5/940: truncate d5/d58/da9/df9/d125/d126/f13d 15874 0 2024-01-25T15:03:50.237 INFO:tasks.workunit.client.0.smithi170.stdout:5/941: mknod d5/d54/d85/d2c/d51/c144 0 2024-01-25T15:03:50.237 INFO:tasks.workunit.client.0.smithi170.stdout:5/942: dread - d5/d54/d85/d2c/d45/fc3 zero size 2024-01-25T15:03:50.239 INFO:tasks.workunit.client.0.smithi170.stdout:5/943: unlink d5/d54/d85/d2c/d34/d69/fab 0 2024-01-25T15:03:50.240 INFO:tasks.workunit.client.0.smithi170.stdout:3/981: dwrite d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/dcb/fd2 [0,4194304] 0 2024-01-25T15:03:50.240 INFO:tasks.workunit.client.0.smithi170.stdout:3/982: chown d3/d10/d6d/d74/f11c 30789 1 2024-01-25T15:03:50.240 INFO:tasks.workunit.client.0.smithi170.stdout:3/983: stat d3/d10/d13/d1b/d29 0 2024-01-25T15:03:50.241 INFO:tasks.workunit.client.0.smithi170.stdout:5/944: creat d5/d58/d10a/db8/f145 x:0 0 0 2024-01-25T15:03:50.243 INFO:tasks.workunit.client.0.smithi170.stdout:3/984: mkdir d3/d10/d13/d14d 0 2024-01-25T15:03:50.252 INFO:tasks.workunit.client.0.smithi170.stdout:3/985: dread d3/d10/d1e/d21/d41/d4a/dc3/dfc/da0/dcb/d140/d117/f124 [0,4194304] 0 2024-01-25T15:03:50.258 INFO:tasks.workunit.client.0.smithi170.stdout:0/988: dwrite d8/d9/d9a/fa6 [0,4194304] 0 2024-01-25T15:03:50.258 INFO:tasks.workunit.client.0.smithi170.stdout:0/989: dread - d8/d11c/d79/d7e/d10d/de7/d5f/d108/f136 zero size 2024-01-25T15:03:50.258 INFO:tasks.workunit.client.0.smithi170.stdout:5/945: rename d5/d58/da9/lef to d5/d54/d85/d3f/d86/l146 0 2024-01-25T15:03:50.260 INFO:tasks.workunit.client.0.smithi170.stdout:0/990: mknod d8/d10/d2d/d53/df4/dc6/dc9/dca/d14a/c14b 0 2024-01-25T15:03:50.260 INFO:tasks.workunit.client.0.smithi170.stdout:0/991: symlink d8/d10/d2d/d53/df4/dc6/dc9/df9/l14c 0 2024-01-25T15:03:50.264 INFO:tasks.workunit.client.0.smithi170.stdout:6/986: sync 2024-01-25T15:03:50.264 INFO:tasks.workunit.client.0.smithi170.stdout:4/853: sync 2024-01-25T15:03:50.264 INFO:tasks.workunit.client.0.smithi170.stdout:7/970: sync 2024-01-25T15:03:50.266 INFO:tasks.workunit.client.0.smithi170.stdout:4/854: creat d6/d28/d59/da8/f114 x:0 0 0 2024-01-25T15:03:50.266 INFO:tasks.workunit.client.0.smithi170.stdout:7/971: symlink d8/d20/l14c 0 2024-01-25T15:03:50.267 INFO:tasks.workunit.client.0.smithi170.stdout:0/992: rename d8/d11c to d8/d9/d9a/d14d 0 2024-01-25T15:03:50.267 INFO:tasks.workunit.client.0.smithi170.stdout:0/993: fsync d8/d10/d2d/d53/f67 0 2024-01-25T15:03:50.267 INFO:tasks.workunit.client.0.smithi170.stdout:0/994: chown d8/l54 62429 1 2024-01-25T15:03:50.268 INFO:tasks.workunit.client.0.smithi170.stdout:5/946: dread d5/d54/d85/d10d/d13b/dda/dde/fdb [0,4194304] 0 2024-01-25T15:03:50.268 INFO:tasks.workunit.client.0.smithi170.stdout:0/995: symlink d8/d9/dd6/d139/d142/l14e 0 2024-01-25T15:03:50.269 INFO:tasks.workunit.client.0.smithi170.stdout:0/996: write d8/d10/d2d/d53/f7d [1941590,9672] 0 2024-01-25T15:03:50.270 INFO:tasks.workunit.client.0.smithi170.stdout:5/947: mknod d5/d54/d85/d2c/d45/d56/d72/da0/c147 0 2024-01-25T15:03:50.270 INFO:tasks.workunit.client.0.smithi170.stdout:5/948: stat d5/d58/da9/df9/d125/d126/f13d 0 2024-01-25T15:03:50.270 INFO:tasks.workunit.client.0.smithi170.stdout:0/997: mkdir d8/d14f 0 2024-01-25T15:03:50.271 INFO:tasks.workunit.client.0.smithi170.stdout:3/986: dwrite d3/d10/d13/d1b/d81/f8d [0,4194304] 0 2024-01-25T15:03:50.275 INFO:tasks.workunit.client.0.smithi170.stdout:0/998: dread d8/d9/d9a/d14d/d79/d7e/fe1 [0,4194304] 0 2024-01-25T15:03:50.275 INFO:tasks.workunit.client.0.smithi170.stdout:4/855: dread d6/d28/dc2/d111/f88 [0,4194304] 0 2024-01-25T15:03:50.275 INFO:tasks.workunit.client.0.smithi170.stdout:3/987: link d3/d10/d13/f65 d3/d10/d1e/d21/f14e 0 2024-01-25T15:03:50.275 INFO:tasks.workunit.client.0.smithi170.stdout:3/988: write d3/d10/d1e/fbf [2581215,4626] 0 2024-01-25T15:03:50.283 INFO:tasks.workunit.client.0.smithi170.stdout:0/999: unlink d8/d10/d2d/d82/l9c 0 2024-01-25T15:03:50.285 INFO:tasks.workunit.client.0.smithi170.stdout:4/856: mkdir d6/d28/d59/d7d/d115 0 2024-01-25T15:03:50.285 INFO:tasks.workunit.client.0.smithi170.stdout:6/987: link d2/d7/d1b/d28/db8/c14d d2/d7/d23/d19/d2a/d43/d98/d113/d74/dbd/c152 0 2024-01-25T15:03:50.286 INFO:tasks.workunit.client.0.smithi170.stdout:3/989: truncate d3/d1c/d2b/f62 713318 0 2024-01-25T15:03:50.286 INFO:tasks.workunit.client.0.smithi170.stdout:3/990: fdatasync d3/d10/d13/fa8 0 2024-01-25T15:03:50.286 INFO:tasks.workunit.client.0.smithi170.stdout:3/991: dread - d3/d10/d13/d1b/d85/ff9 zero size 2024-01-25T15:03:50.286 INFO:tasks.workunit.client.0.smithi170.stdout:3/992: dread - d3/d10/f13a zero size 2024-01-25T15:03:50.286 INFO:tasks.workunit.client.0.smithi170.stdout:3/993: fsync d3/d10/d13/fc8 0 2024-01-25T15:03:50.286 INFO:tasks.workunit.client.0.smithi170.stdout:7/972: dwrite d8/f9e [4194304,4194304] 0 2024-01-25T15:03:50.288 INFO:tasks.workunit.client.0.smithi170.stdout:3/994: mknod d3/d10/d1e/d21/d41/d4b/d63/dc7/c14f 0 2024-01-25T15:03:50.293 INFO:tasks.workunit.client.0.smithi170.stdout:6/988: creat d2/d7/d23/d19/d2a/d43/d98/d113/d5d/d94/d97/db4/dc7/d111/f153 x:0 0 0 2024-01-25T15:03:50.293 INFO:tasks.workunit.client.0.smithi170.stdout:6/989: write d2/fcd [573900,112322] 0 2024-01-25T15:03:50.293 INFO:tasks.workunit.client.0.smithi170.stdout:6/990: fsync d2/d7/d23/d19/d2a/d6b/f13f 0 2024-01-25T15:03:50.293 INFO:tasks.workunit.client.0.smithi170.stdout:6/991: chown d2/d7/d23/d19/d2a/d43/d98/d113/d74 55322352 1 2024-01-25T15:03:50.293 INFO:tasks.workunit.client.0.smithi170.stdout:6/992: truncate d2/d7/f18 1700795 0 2024-01-25T15:03:50.300 INFO:tasks.workunit.client.0.smithi170.stdout:3/995: rmdir d3/d10/d1e/d21 39 2024-01-25T15:03:50.301 INFO:tasks.workunit.client.0.smithi170.stdout:3/996: creat d3/d10/d13/d14d/f150 x:0 0 0 2024-01-25T15:03:50.309 INFO:tasks.workunit.client.0.smithi170.stdout:7/973: dwrite d8/d20/d45/d8e/f11e [0,4194304] 0 2024-01-25T15:03:50.309 INFO:tasks.workunit.client.0.smithi170.stdout:7/974: write d8/d20/d2a/d35/d55/d7d/da6/dd1/deb/ffd [866938,95966] 0 2024-01-25T15:03:50.310 INFO:tasks.workunit.client.0.smithi170.stdout:7/975: truncate d8/d20/d45/f122 3018915 0 2024-01-25T15:03:50.314 INFO:tasks.workunit.client.0.smithi170.stdout:2/888: sync 2024-01-25T15:03:50.314 INFO:tasks.workunit.client.0.smithi170.stdout:9/947: sync 2024-01-25T15:03:50.314 INFO:tasks.workunit.client.0.smithi170.stdout:1/921: sync 2024-01-25T15:03:50.314 INFO:tasks.workunit.client.0.smithi170.stdout:5/949: rename d5/d54/d85/d2c/d51/d3d to d5/d54/d85/d2c/d45/d139/d148 0 2024-01-25T15:03:50.314 INFO:tasks.workunit.client.0.smithi170.stdout:5/950: creat d5/d54/d85/d2c/f149 x:0 0 0 2024-01-25T15:03:50.314 INFO:tasks.workunit.client.0.smithi170.stdout:5/951: fdatasync d5/d58/da9/df9/fe2 0 2024-01-25T15:03:50.314 INFO:tasks.workunit.client.0.smithi170.stdout:9/948: write d5/df/d16/d35/d3c/d91/dd6/dd9/f137 [862882,77488] 0 2024-01-25T15:03:50.315 INFO:tasks.workunit.client.0.smithi170.stdout:6/993: dwrite d2/d7/d1b/d28/da7/dd2/fe8 [0,4194304] 0 2024-01-25T15:03:50.315 INFO:tasks.workunit.client.0.smithi170.stdout:2/889: mknod d10/d1e/d32/d3e/c13b 0 2024-01-25T15:03:50.315 INFO:tasks.workunit.client.0.smithi170.stdout:2/890: read d10/f52 [91502,88618] 0 2024-01-25T15:03:50.315 INFO:tasks.workunit.client.0.smithi170.stdout:1/922: mknod d0/d20/d28/c138 0 2024-01-25T15:03:50.316 INFO:tasks.workunit.client.0.smithi170.stdout:3/997: link d3/d10/d1e/d21/d41/d4b/d63/dc7/c14f d3/d10/d1e/d96/c151 0 2024-01-25T15:03:50.316 INFO:tasks.workunit.client.0.smithi170.stdout:9/949: chown d5/df/d16/d35/d115/f136 21570 1 2024-01-25T15:03:50.317 INFO:tasks.workunit.client.0.smithi170.stdout:5/952: getdents d5/d54/d85/d2c/d34 0 2024-01-25T15:03:50.319 INFO:tasks.workunit.client.0.smithi170.stdout:7/976: dread d8/f5d [0,4194304] 0 2024-01-25T15:03:50.320 INFO:tasks.workunit.client.0.smithi170.stdout:1/923: creat d0/d20/d28/f139 x:0 0 0 2024-01-25T15:03:50.321 INFO:tasks.workunit.client.0.smithi170.stdout:9/950: creat d5/df/d16/d35/d3c/d91/dd6/dd9/ded/f13e x:0 0 0 2024-01-25T15:03:50.322 INFO:tasks.workunit.client.0.smithi170.stdout:9/951: truncate d5/dca/dd7/f12d 615223 0 2024-01-25T15:03:50.322 INFO:tasks.workunit.client.0.smithi170.stdout:9/952: chown d5/df/d16/d35/d3c/d56/cd3 17559813 1 2024-01-25T15:03:50.324 INFO:tasks.workunit.client.0.smithi170.stdout:5/953: getdents d5/d54/d85/d3f/d86 0 2024-01-25T15:03:50.327 INFO:tasks.workunit.client.0.smithi170.stdout:7/977: rmdir d8/d20/d45/d68/d71/dc8 39 2024-01-25T15:03:50.327 INFO:tasks.workunit.client.0.smithi170.stdout:7/978: write d8/d20/d45/d68/d71/d8c/f127 [74174,9052] 0 2024-01-25T15:03:50.327 INFO:tasks.workunit.client.0.smithi170.stdout:6/994: dread d2/d7/d1b/d28/f8a [0,4194304] 0 2024-01-25T15:03:50.327 INFO:tasks.workunit.client.0.smithi170.stdout:1/924: mkdir d0/d50/dc0/d13a 0 2024-01-25T15:03:50.328 INFO:tasks.workunit.client.0.smithi170.stdout:5/954: creat d5/d54/d85/d10d/f14a x:0 0 0 2024-01-25T15:03:50.329 INFO:tasks.workunit.client.0.smithi170.stdout:1/925: symlink d0/d20/d28/d2a/d57/l13b 0 2024-01-25T15:03:50.329 INFO:tasks.workunit.client.0.smithi170.stdout:2/891: write d10/d1e/d32/d62/d74/f8f [810334,81421] 0 2024-01-25T15:03:50.329 INFO:tasks.workunit.client.0.smithi170.stdout:2/892: truncate d10/d1e/d32/d3e/f137 416982 0 2024-01-25T15:03:50.329 INFO:tasks.workunit.client.0.smithi170.stdout:2/893: write d10/d1b/db6/dd7/fe4 [4415880,46387] 0 2024-01-25T15:03:50.330 INFO:tasks.workunit.client.0.smithi170.stdout:5/955: mkdir d5/d54/d85/d10d/d13b/dda/d130/d14b 0 2024-01-25T15:03:50.331 INFO:tasks.workunit.client.0.smithi170.stdout:9/953: dread d5/df/d2e/d77/d21/d46/fdc [0,4194304] 0 2024-01-25T15:03:50.331 INFO:tasks.workunit.client.0.smithi170.stdout:5/956: truncate d5/f11 3885730 0 2024-01-25T15:03:50.332 INFO:tasks.workunit.client.0.smithi170.stdout:9/954: symlink d5/df/d2e/d77/d21/d34/d111/l13f 0 2024-01-25T15:03:50.332 INFO:tasks.workunit.client.0.smithi170.stdout:9/955: readlink d5/df/d16/l1d 0 2024-01-25T15:03:50.333 INFO:tasks.workunit.client.0.smithi170.stdout:1/926: creat d0/d20/d3a/d6e/d11e/d9c/f13c x:0 0 0 2024-01-25T15:03:50.333 INFO:tasks.workunit.client.0.smithi170.stdout:9/956: symlink d5/df/d16/d35/d3c/d91/dd6/dd9/l140 0 2024-01-25T15:03:50.333 INFO:tasks.workunit.client.0.smithi170.stdout:9/957: creat d5/df/d2e/d77/d21/d34/d3e/d7f/f141 x:0 0 0 2024-01-25T15:03:50.333 INFO:tasks.workunit.client.0.smithi170.stdout:9/958: creat d5/df/d2e/d77/d21/d46/f142 x:0 0 0 2024-01-25T15:03:50.337 INFO:tasks.workunit.client.0.smithi170.stdout:9/959: unlink d5/df/d2e/d77/d21/d46/c6e 0 2024-01-25T15:03:50.341 INFO:tasks.workunit.client.0.smithi170.stdout:1/927: dread d0/d20/d28/f6c [0,4194304] 0 2024-01-25T15:03:50.343 INFO:tasks.workunit.client.0.smithi170.stdout:1/928: mknod d0/d2e/df2/c13d 0 2024-01-25T15:03:50.343 INFO:tasks.workunit.client.0.smithi170.stdout:1/929: stat d0/d20/d28/ffd 0 2024-01-25T15:03:50.343 INFO:tasks.workunit.client.0.smithi170.stdout:1/930: fsync d0/de8/feb 0 2024-01-25T15:03:50.343 INFO:tasks.workunit.client.0.smithi170.stdout:1/931: chown d0/d50/dc0/ldb 1 1 2024-01-25T15:03:50.348 INFO:tasks.workunit.client.0.smithi170.stdout:2/894: dread ff [0,4194304] 0 2024-01-25T15:03:50.348 INFO:tasks.workunit.client.0.smithi170.stdout:2/895: write d10/d1b/db6/dd7/ffc [174415,28864] 0 2024-01-25T15:03:50.350 INFO:tasks.workunit.client.0.smithi170.stdout:6/995: dwrite d2/d7/d23/d19/d2a/d43/d44/f48 [0,4194304] 0 2024-01-25T15:03:50.350 INFO:tasks.workunit.client.0.smithi170.stdout:6/996: truncate d2/d7/d23/d19/d2a/d43/d98/d113/d5d/d94/fa2 604701 0 2024-01-25T15:03:50.350 INFO:tasks.workunit.client.0.smithi170.stdout:2/896: symlink d10/d1b/db6/dd5/l13c 0 2024-01-25T15:03:50.352 INFO:tasks.workunit.client.0.smithi170.stdout:2/897: creat d10/d1e/d32/d3e/d5c/d102/dd4/f13d x:0 0 0 2024-01-25T15:03:50.352 INFO:tasks.workunit.client.0.smithi170.stdout:6/997: rename d2/d7/dd9/dfc/f12a to d2/d7/d1b/d28/f154 0 2024-01-25T15:03:50.353 INFO:tasks.workunit.client.0.smithi170.stdout:6/998: symlink d2/d7/d23/d19/d2a/d43/d98/d113/d74/dc1/dcf/d100/l155 0 2024-01-25T15:03:50.354 INFO:tasks.workunit.client.0.smithi170.stdout:5/957: dread d5/f40 [0,4194304] 0 2024-01-25T15:03:50.355 INFO:tasks.workunit.client.0.smithi170.stdout:7/979: link d8/d20/d3b/d4d/l57 d8/d20/d45/d68/d71/dc8/l14d 0 2024-01-25T15:03:50.356 INFO:tasks.workunit.client.0.smithi170.stdout:5/958: symlink d5/d58/d10a/db8/l14c 0 2024-01-25T15:03:50.356 INFO:tasks.workunit.client.0.smithi170.stdout:5/959: chown d5/d54/d85/d2c/d51/d41/dcf 214898978 1 2024-01-25T15:03:50.356 INFO:tasks.workunit.client.0.smithi170.stdout:5/960: stat d5/d58/da9/d107/f13f 0 2024-01-25T15:03:50.358 INFO:tasks.workunit.client.0.smithi170.stdout:5/961: unlink d5/d54/d85/d2c/d51/d41/l70 0 2024-01-25T15:03:50.358 INFO:tasks.workunit.client.0.smithi170.stdout:5/962: creat d5/d58/da9/df9/f14d x:0 0 0 2024-01-25T15:03:50.363 INFO:tasks.workunit.client.0.smithi170.stdout:2/898: link d10/d1e/d32/d3e/d41/dc4/dc6/d42/f88 d10/d1e/d5e/d73/d9e/da3/df4/f13e 0 2024-01-25T15:03:50.363 INFO:tasks.workunit.client.0.smithi170.stdout:2/899: write d10/d1e/d32/d98/ffd [1046252,35215] 0 2024-01-25T15:03:50.369 INFO:tasks.workunit.client.0.smithi170.stdout:1/932: dwrite d0/d20/d3a/d6e/d11e/dab/faf [0,4194304] 0 2024-01-25T15:03:50.370 INFO:tasks.workunit.client.0.smithi170.stdout:1/933: mkdir d0/d20/d3a/d6e/d11e/dab/d13e 0 2024-01-25T15:03:50.371 INFO:tasks.workunit.client.0.smithi170.stdout:2/900: write d10/d1e/d32/d62/d74/d107/f7d [1383189,127055] 0 2024-01-25T15:03:50.371 INFO:tasks.workunit.client.0.smithi170.stdout:2/901: stat d10/d1e/d32/d3e/d5c/f94 0 2024-01-25T15:03:50.371 INFO:tasks.workunit.client.0.smithi170.stdout:2/902: chown d10/d1e/d32/d98 0 1 2024-01-25T15:03:50.372 INFO:tasks.workunit.client.0.smithi170.stdout:5/963: dread d5/d54/d85/d2c/d51/d41/f44 [0,4194304] 0 2024-01-25T15:03:50.373 INFO:tasks.workunit.client.0.smithi170.stdout:5/964: symlink d5/d58/da9/df9/d125/l14e 0 2024-01-25T15:03:50.381 INFO:tasks.workunit.client.0.smithi170.stdout:7/980: dwrite d8/d110/f111 [0,4194304] 0 2024-01-25T15:03:50.382 INFO:tasks.workunit.client.0.smithi170.stdout:7/981: creat d8/d20/d2a/d35/d55/d7d/da6/f14e x:0 0 0 2024-01-25T15:03:50.384 INFO:tasks.workunit.client.0.smithi170.stdout:7/982: creat d8/d20/d2a/d35/d55/d9b/f14f x:0 0 0 2024-01-25T15:03:50.384 INFO:tasks.workunit.client.0.smithi170.stdout:7/983: creat d8/d20/d45/f150 x:0 0 0 2024-01-25T15:03:50.389 INFO:tasks.workunit.client.0.smithi170.stdout:2/903: write d10/d1e/d32/f9d [3684428,4973] 0 2024-01-25T15:03:50.390 INFO:tasks.workunit.client.0.smithi170.stdout:7/984: truncate d8/d20/d3b/f6a 811666 0 2024-01-25T15:03:50.390 INFO:tasks.workunit.client.0.smithi170.stdout:2/904: fdatasync d10/d1e/d32/d3e/d41/dc4/dc6/d42/daa/ff7 0 2024-01-25T15:03:50.390 INFO:tasks.workunit.client.0.smithi170.stdout:5/965: link d5/d54/d85/d2c/d45/d56/d72/da0/dc5/l89 d5/d54/d85/d2c/d34/d69/l14f 0 2024-01-25T15:03:50.392 INFO:tasks.workunit.client.0.smithi170.stdout:2/905: dread d10/d1e/d32/d3e/d5c/de5/ffe [0,4194304] 0 2024-01-25T15:03:50.393 INFO:tasks.workunit.client.0.smithi170.stdout:7/985: mkdir d8/d20/d151 0 2024-01-25T15:03:50.393 INFO:tasks.workunit.client.0.smithi170.stdout:7/986: write d8/ddb/f138 [173769,43498] 0 2024-01-25T15:03:50.395 INFO:tasks.workunit.client.0.smithi170.stdout:2/906: creat d10/d1e/d5e/d73/f13f x:0 0 0 2024-01-25T15:03:50.395 INFO:tasks.workunit.client.0.smithi170.stdout:2/907: dread - d10/d1e/d5e/f118 zero size 2024-01-25T15:03:50.395 INFO:tasks.workunit.client.0.smithi170.stdout:2/908: truncate d10/d1e/d32/d3e/d41/dc4/f134 809768 0 2024-01-25T15:03:50.396 INFO:tasks.workunit.client.0.smithi170.stdout:1/934: dwrite d0/d20/d3a/d60/f111 [0,4194304] 0 2024-01-25T15:03:50.403 INFO:tasks.workunit.client.0.smithi170.stdout:5/966: write d5/d58/da9/df9/fe2 [957157,40501] 0 2024-01-25T15:03:50.403 INFO:tasks.workunit.client.0.smithi170.stdout:5/967: write d5/f40 [4245766,33582] 0 2024-01-25T15:03:50.413 INFO:tasks.workunit.client.0.smithi170.stdout:5/968: write d5/d2a/f2b [1831982,410] 0 2024-01-25T15:03:50.414 INFO:tasks.workunit.client.0.smithi170.stdout:5/969: truncate d5/d54/d85/d10d/d13b/dda/dde/fdb 3525451 0 2024-01-25T15:03:50.415 INFO:tasks.workunit.client.0.smithi170.stdout:5/970: creat d5/d58/f150 x:0 0 0 2024-01-25T15:03:50.415 INFO:tasks.workunit.client.0.smithi170.stdout:5/971: chown d5/d54/d85/l28 0 1 2024-01-25T15:03:50.416 INFO:tasks.workunit.client.0.smithi170.stdout:5/972: mkdir d5/d54/d151 0 2024-01-25T15:03:50.416 INFO:tasks.workunit.client.0.smithi170.stdout:5/973: creat d5/d54/d85/d3f/f152 x:0 0 0 2024-01-25T15:03:50.417 INFO:tasks.workunit.client.0.smithi170.stdout:5/974: chown d5/d54/d85/f5c 6078 1 2024-01-25T15:03:50.424 INFO:tasks.workunit.client.0.smithi170.stdout:7/987: dwrite d8/d20/d45/d10c/d119/f125 [0,4194304] 0 2024-01-25T15:03:50.424 INFO:tasks.workunit.client.0.smithi170.stdout:1/935: dwrite d0/d20/d3a/d6e/f10e [0,4194304] 0 2024-01-25T15:03:50.428 INFO:tasks.workunit.client.0.smithi170.stdout:1/936: mknod d0/d20/d3a/dad/c13f 0 2024-01-25T15:03:50.430 INFO:tasks.workunit.client.0.smithi170.stdout:5/975: rename d5/d58/l91 to d5/d54/d85/d2c/l153 0 2024-01-25T15:03:50.433 INFO:tasks.workunit.client.0.smithi170.stdout:5/976: rename d5/d58/da9/d107/c11c to d5/d58/c154 0 2024-01-25T15:03:50.450 INFO:tasks.workunit.client.0.smithi170.stdout:7/988: dwrite d8/d110/f111 [0,4194304] 0 2024-01-25T15:03:50.450 INFO:tasks.workunit.client.0.smithi170.stdout:7/989: stat d8/d20/d45/d8e/df5/f10b 0 2024-01-25T15:03:50.450 INFO:tasks.workunit.client.0.smithi170.stdout:7/990: fsync d8/d20/d45/d8e/fee 0 2024-01-25T15:03:50.450 INFO:tasks.workunit.client.0.smithi170.stdout:7/991: readlink d8/d20/d45/l48 0 2024-01-25T15:03:50.450 INFO:tasks.workunit.client.0.smithi170.stdout:7/992: stat d8/d20/d45/d8e/df5/l10e 0 2024-01-25T15:03:50.452 INFO:tasks.workunit.client.0.smithi170.stdout:7/993: symlink d8/d20/d2a/d35/d55/d6e/d121/l152 0 2024-01-25T15:03:50.452 INFO:tasks.workunit.client.0.smithi170.stdout:7/994: fsync d8/f3a 0 2024-01-25T15:03:50.453 INFO:tasks.workunit.client.0.smithi170.stdout:7/995: mknod d8/d20/d45/d8e/c153 0 2024-01-25T15:03:50.454 INFO:tasks.workunit.client.0.smithi170.stdout:7/996: mkdir d8/d20/d45/d10c/d11b/d154 0 2024-01-25T15:03:50.465 INFO:tasks.workunit.client.0.smithi170.stdout:1/937: dwrite d0/d20/d3a/d6e/d11e/d9c/fc3 [0,4194304] 0 2024-01-25T15:03:50.465 INFO:tasks.workunit.client.0.smithi170.stdout:5/977: dwrite d5/d54/d85/f5a [0,4194304] 0 2024-01-25T15:03:50.465 INFO:tasks.workunit.client.0.smithi170.stdout:5/978: creat d5/d58/d10a/db8/f155 x:0 0 0 2024-01-25T15:03:50.465 INFO:tasks.workunit.client.0.smithi170.stdout:5/979: write d5/d2a/f2b [2421741,46453] 0 2024-01-25T15:03:50.466 INFO:tasks.workunit.client.0.smithi170.stdout:1/938: creat d0/f140 x:0 0 0 2024-01-25T15:03:50.468 INFO:tasks.workunit.client.0.smithi170.stdout:5/980: symlink d5/d54/d85/d10d/d13b/dda/d130/d14b/l156 0 2024-01-25T15:03:50.470 INFO:tasks.workunit.client.0.smithi170.stdout:7/997: dread d8/d20/d45/f46 [0,4194304] 0 2024-01-25T15:03:50.470 INFO:tasks.workunit.client.0.smithi170.stdout:7/998: stat d8/d20/d3b/fae 0 2024-01-25T15:03:50.470 INFO:tasks.workunit.client.0.smithi170.stdout:5/981: mknod d5/d58/da9/df9/c157 0 2024-01-25T15:03:50.471 INFO:tasks.workunit.client.0.smithi170.stdout:5/982: creat d5/d54/d85/d2c/d51/f158 x:0 0 0 2024-01-25T15:03:50.481 INFO:tasks.workunit.client.0.smithi170.stdout:1/939: dread d0/d20/d28/d2a/d4a/d56/f115 [0,4194304] 0 2024-01-25T15:03:50.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:50 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:50.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:50 smithi191 ceph-mon[36347]: scrub summary: idle 2024-01-25T15:03:50.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:50 smithi191 ceph-mon[36347]: scrub summary: idle 2024-01-25T15:03:50.484 INFO:tasks.workunit.client.0.smithi170.stdout:1/940: rename d0/d20/d28/d2a/d4a/d56/dc1/fc2 to d0/d20/d28/d2a/dc7/d122/f141 0 2024-01-25T15:03:50.484 INFO:tasks.workunit.client.0.smithi170.stdout:1/941: truncate d0/d50/da2/f121 206459 0 2024-01-25T15:03:50.485 INFO:tasks.workunit.client.0.smithi170.stdout:1/942: link d0/d20/d28/d2a/d4a/d56/d106/daa/fd9 d0/d20/f142 0 2024-01-25T15:03:50.485 INFO:tasks.workunit.client.0.smithi170.stdout:1/943: read d0/d2e/f8d [578422,63636] 0 2024-01-25T15:03:50.487 INFO:tasks.workunit.client.0.smithi170.stdout:1/944: mkdir d0/d20/d28/d2a/d4a/d56/d106/daa/d143 0 2024-01-25T15:03:50.487 INFO:tasks.workunit.client.0.smithi170.stdout:1/945: write d0/d20/d28/d7b/dfc/f102 [977979,92927] 0 2024-01-25T15:03:50.498 INFO:tasks.workunit.client.0.smithi170.stdout:4/857: sync 2024-01-25T15:03:50.498 INFO:tasks.workunit.client.0.smithi170.stdout:4/858: fsync d6/d7/d1b/f41 0 2024-01-25T15:03:50.498 INFO:tasks.workunit.client.0.smithi170.stdout:4/859: readlink d6/d7/l4c 0 2024-01-25T15:03:50.499 INFO:tasks.workunit.client.0.smithi170.stdout:4/860: chown d6/d7/d31/d46/l94 9495753 1 2024-01-25T15:03:50.499 INFO:tasks.workunit.client.0.smithi170.stdout:4/861: truncate d6/d28/d67/fec 1329263 0 2024-01-25T15:03:50.499 INFO:tasks.workunit.client.0.smithi170.stdout:1/946: rename d0/d20/d28/l11c to d0/d20/d28/d2a/d4a/d56/d5b/l144 0 2024-01-25T15:03:50.500 INFO:tasks.workunit.client.0.smithi170.stdout:1/947: dread d0/d20/fb1 [0,4194304] 0 2024-01-25T15:03:50.500 INFO:tasks.workunit.client.0.smithi170.stdout:1/948: chown d0/d20/d28/d2a/d4a/d56/f135 181 1 2024-01-25T15:03:50.503 INFO:tasks.workunit.client.0.smithi170.stdout:1/949: creat d0/d20/d28/d7b/dfc/f145 x:0 0 0 2024-01-25T15:03:50.503 INFO:tasks.workunit.client.0.smithi170.stdout:1/950: write d0/d20/d28/d2a/d4a/d56/dc1/f10c [836377,32444] 0 2024-01-25T15:03:50.503 INFO:tasks.workunit.client.0.smithi170.stdout:1/951: chown d0/d20/d28/d2a/d4a/d56/d5b/f68 62004 1 2024-01-25T15:03:50.503 INFO:tasks.workunit.client.0.smithi170.stdout:1/952: truncate d0/d20/d28/d2a/d4a/f119 371036 0 2024-01-25T15:03:50.503 INFO:tasks.workunit.client.0.smithi170.stdout:1/953: write d0/d50/da2/f121 [1173050,60809] 0 2024-01-25T15:03:50.503 INFO:tasks.workunit.client.0.smithi170.stdout:1/954: read d0/d20/d28/f70 [89132,69758] 0 2024-01-25T15:03:50.503 INFO:tasks.workunit.client.0.smithi170.stdout:1/955: creat d0/f146 x:0 0 0 2024-01-25T15:03:50.504 INFO:tasks.workunit.client.0.smithi170.stdout:1/956: symlink d0/d20/d28/dee/d112/l147 0 2024-01-25T15:03:50.504 INFO:tasks.workunit.client.0.smithi170.stdout:1/957: chown d0/d2e 2 1 2024-01-25T15:03:50.519 INFO:tasks.workunit.client.0.smithi170.stdout:1/958: write d0/d2e/ff5 [4131833,30396] 0 2024-01-25T15:03:50.520 INFO:tasks.workunit.client.0.smithi170.stdout:4/862: dwrite d6/d7/d31/d7e/d80/f91 [4194304,4194304] 0 2024-01-25T15:03:50.521 INFO:tasks.workunit.client.0.smithi170.stdout:4/863: mknod d6/c116 0 2024-01-25T15:03:50.525 INFO:tasks.workunit.client.0.smithi170.stdout:4/864: mkdir d6/d7/d31/d7e/d80/d117 0 2024-01-25T15:03:50.525 INFO:tasks.workunit.client.0.smithi170.stdout:4/865: chown d6/d7/f14 1 1 2024-01-25T15:03:50.527 INFO:tasks.workunit.client.0.smithi170.stdout:9/960: sync 2024-01-25T15:03:50.527 INFO:tasks.workunit.client.0.smithi170.stdout:3/998: sync 2024-01-25T15:03:50.527 INFO:tasks.workunit.client.0.smithi170.stdout:6/999: sync 2024-01-25T15:03:50.527 INFO:tasks.workunit.client.0.smithi170.stdout:3/999: stat d3/l3f 0 2024-01-25T15:03:50.535 INFO:tasks.workunit.client.0.smithi170.stdout:9/961: dread d5/df/d2e/d77/d21/d46/d6c/f71 [0,4194304] 0 2024-01-25T15:03:50.537 INFO:tasks.workunit.client.0.smithi170.stdout:9/962: mkdir d5/df/d2e/d77/d143 0 2024-01-25T15:03:50.539 INFO:tasks.workunit.client.0.smithi170.stdout:9/963: mkdir d5/df/d2e/d77/d144 0 2024-01-25T15:03:50.540 INFO:tasks.workunit.client.0.smithi170.stdout:9/964: creat d5/df/d2e/d77/d86/d118/f145 x:0 0 0 2024-01-25T15:03:50.540 INFO:tasks.workunit.client.0.smithi170.stdout:1/959: dwrite d0/d20/ddd/dde/f137 [0,4194304] 0 2024-01-25T15:03:50.542 INFO:tasks.workunit.client.0.smithi170.stdout:4/866: rename d6/d28/dc2 to d6/d28/d59/d118 0 2024-01-25T15:03:50.548 INFO:tasks.workunit.client.0.smithi170.stdout:1/960: mknod d0/d20/d28/d2a/d4a/d56/d5b/d72/c148 0 2024-01-25T15:03:50.548 INFO:tasks.workunit.client.0.smithi170.stdout:1/961: write d0/d20/d3a/f9b [668913,52631] 0 2024-01-25T15:03:50.551 INFO:tasks.workunit.client.0.smithi170.stdout:4/867: write d6/d28/d67/f96 [4140192,130651] 0 2024-01-25T15:03:50.553 INFO:tasks.workunit.client.0.smithi170.stdout:4/868: creat d6/d7/d31/f119 x:0 0 0 2024-01-25T15:03:50.555 INFO:tasks.workunit.client.0.smithi170.stdout:4/869: symlink d6/d28/d59/dc4/l11a 0 2024-01-25T15:03:50.555 INFO:tasks.workunit.client.0.smithi170.stdout:4/870: write d6/d28/d59/fbe [4583688,103445] 0 2024-01-25T15:03:50.555 INFO:tasks.workunit.client.0.smithi170.stdout:4/871: chown d6/d28/d59/d7d/f6c 1401 1 2024-01-25T15:03:50.555 INFO:tasks.workunit.client.0.smithi170.stdout:4/872: write d6/d28/f7a [1207065,66454] 0 2024-01-25T15:03:50.563 INFO:tasks.workunit.client.0.smithi170.stdout:9/965: dwrite d5/df/d2e/d77/d21/d46/f129 [0,4194304] 0 2024-01-25T15:03:50.563 INFO:tasks.workunit.client.0.smithi170.stdout:9/966: read d5/df/d2e/d77/d21/d46/d6c/dd8/d96/f98 [516257,73304] 0 2024-01-25T15:03:50.566 INFO:tasks.workunit.client.0.smithi170.stdout:9/967: link d5/df/f1a d5/df/d2e/f146 0 2024-01-25T15:03:50.566 INFO:tasks.workunit.client.0.smithi170.stdout:9/968: chown d5/df/d2e/d77/d21/d46/d6c/dd8/d96/f10e 13646182 1 2024-01-25T15:03:50.566 INFO:tasks.workunit.client.0.smithi170.stdout:9/969: chown d5/df/d49/df1/l122 22070 1 2024-01-25T15:03:50.567 INFO:tasks.workunit.client.0.smithi170.stdout:9/970: getdents d5/df/d16/d35/d3c/d56/d59/d5e 0 2024-01-25T15:03:50.575 INFO:tasks.workunit.client.0.smithi170.stdout:1/962: dwrite d0/d20/d28/d2a/f5e [0,4194304] 0 2024-01-25T15:03:50.576 INFO:tasks.workunit.client.0.smithi170.stdout:1/963: stat d0/d20/d3a/d6e/d11e/ld6 0 2024-01-25T15:03:50.578 INFO:tasks.workunit.client.0.smithi170.stdout:1/964: creat d0/d20/d28/d2a/d4a/d56/d5b/f149 x:0 0 0 2024-01-25T15:03:50.579 INFO:tasks.workunit.client.0.smithi170.stdout:1/965: rename d0/d20/cda to d0/d20/d28/d7b/dfc/c14a 0 2024-01-25T15:03:50.583 INFO:tasks.workunit.client.0.smithi170.stdout:4/873: dwrite d6/d7/d31/d7e/d9c/fef [0,4194304] 0 2024-01-25T15:03:50.585 INFO:tasks.workunit.client.0.smithi170.stdout:4/874: truncate f2 3257475 0 2024-01-25T15:03:50.585 INFO:tasks.workunit.client.0.smithi170.stdout:4/875: creat d6/d7/d31/d46/dc6/f11b x:0 0 0 2024-01-25T15:03:50.586 INFO:tasks.workunit.client.0.smithi170.stdout:2/909: sync 2024-01-25T15:03:50.586 INFO:tasks.workunit.client.0.smithi170.stdout:7/999: sync 2024-01-25T15:03:50.587 INFO:tasks.workunit.client.0.smithi170.stdout:2/910: creat d10/d1e/d32/d62/d74/d107/d113/f140 x:0 0 0 2024-01-25T15:03:50.588 INFO:tasks.workunit.client.0.smithi170.stdout:5/983: sync 2024-01-25T15:03:50.589 INFO:tasks.workunit.client.0.smithi170.stdout:5/984: creat d5/d54/d85/d2c/d45/d10b/f159 x:0 0 0 2024-01-25T15:03:50.589 INFO:tasks.workunit.client.0.smithi170.stdout:5/985: fsync d5/d54/d85/d2c/d34/d69/ff5 0 2024-01-25T15:03:50.589 INFO:tasks.workunit.client.0.smithi170.stdout:2/911: mknod d10/d1e/d5e/d73/df0/c141 0 2024-01-25T15:03:50.593 INFO:tasks.workunit.client.0.smithi170.stdout:5/986: rename d5/l7f to d5/d54/d85/d10d/d13b/dda/d138/l15a 0 2024-01-25T15:03:50.593 INFO:tasks.workunit.client.0.smithi170.stdout:5/987: chown d5/d54/d85/d2c/d34/c10f 11403 1 2024-01-25T15:03:50.594 INFO:tasks.workunit.client.0.smithi170.stdout:2/912: mknod d10/d1e/d5e/d73/d9e/d12c/c142 0 2024-01-25T15:03:50.597 INFO:tasks.workunit.client.0.smithi170.stdout:9/971: dwrite d5/dc/fe9 [4194304,4194304] 0 2024-01-25T15:03:50.597 INFO:tasks.workunit.client.0.smithi170.stdout:9/972: creat d5/df/d2e/d77/d21/d34/d3e/d7f/f147 x:0 0 0 2024-01-25T15:03:50.597 INFO:tasks.workunit.client.0.smithi170.stdout:9/973: chown d5/df/d2e/d77/d21/daa/l100 0 1 2024-01-25T15:03:50.597 INFO:tasks.workunit.client.0.smithi170.stdout:9/974: stat d5/dc/f30 0 2024-01-25T15:03:50.597 INFO:tasks.workunit.client.0.smithi170.stdout:9/975: write d5/dc/d42/f44 [946074,103593] 0 2024-01-25T15:03:50.597 INFO:tasks.workunit.client.0.smithi170.stdout:9/976: fdatasync d5/df/d16/d35/d3c/d56/d59/d5e/fd4 0 2024-01-25T15:03:50.603 INFO:tasks.workunit.client.0.smithi170.stdout:9/977: rename d5/df/d49 to d5/df/d2e/d77/d21/d46/d18/dc0/d11e/d148 0 2024-01-25T15:03:50.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:50 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:50.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:50 smithi186 ceph-mon[35697]: scrub summary: idle 2024-01-25T15:03:50.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:50 smithi186 ceph-mon[35697]: scrub summary: idle 2024-01-25T15:03:50.605 INFO:tasks.workunit.client.0.smithi170.stdout:4/876: dread d6/d28/f5d [0,4194304] 0 2024-01-25T15:03:50.607 INFO:tasks.workunit.client.0.smithi170.stdout:1/966: dwrite d0/f12 [0,4194304] 0 2024-01-25T15:03:50.607 INFO:tasks.workunit.client.0.smithi170.stdout:1/967: write d0/d1b/fa1 [2623675,105935] 0 2024-01-25T15:03:50.607 INFO:tasks.workunit.client.0.smithi170.stdout:9/978: rename d5/df/d16/d35/d3c/f4e to d5/dc/dce/dfd/f149 0 2024-01-25T15:03:50.607 INFO:tasks.workunit.client.0.smithi170.stdout:9/979: fsync d5/df/d2e/d6b/f72 0 2024-01-25T15:03:50.613 INFO:tasks.workunit.client.0.smithi170.stdout:5/988: dwrite d5/db9/f128 [0,4194304] 0 2024-01-25T15:03:50.616 INFO:tasks.workunit.client.0.smithi170.stdout:9/980: read d5/df/d16/d52/fba [30526,120223] 0 2024-01-25T15:03:50.616 INFO:tasks.workunit.client.0.smithi170.stdout:9/981: stat d5/df/d2e/d77/d21/d34/d3e/fdb 0 2024-01-25T15:03:50.616 INFO:tasks.workunit.client.0.smithi170.stdout:1/968: getdents d0/d20/d28/d2a/d4a/d56/d5b/d72 0 2024-01-25T15:03:50.616 INFO:tasks.workunit.client.0.smithi170.stdout:2/913: dwrite d10/d1e/d5e/f118 [0,4194304] 0 2024-01-25T15:03:50.619 INFO:tasks.workunit.client.0.smithi170.stdout:1/969: dread d0/d20/d3a/d60/fe5 [0,4194304] 0 2024-01-25T15:03:50.620 INFO:tasks.workunit.client.0.smithi170.stdout:1/970: chown d0/d20/d3a/d6e/d11e/lc6 212103606 1 2024-01-25T15:03:50.623 INFO:tasks.workunit.client.0.smithi170.stdout:1/971: creat d0/d20/d28/d2a/dc7/f14b x:0 0 0 2024-01-25T15:03:50.623 INFO:tasks.workunit.client.0.smithi170.stdout:1/972: dread - d0/d20/d28/fc5 zero size 2024-01-25T15:03:50.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:50 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:50.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:50 smithi170 ceph-mon[31899]: scrub summary: idle 2024-01-25T15:03:50.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:50 smithi170 ceph-mon[31899]: scrub summary: idle 2024-01-25T15:03:50.624 INFO:tasks.workunit.client.0.smithi170.stdout:4/877: link d6/d7/d31/d46/d78/f100 d6/d28/d59/d118/d111/f11c 0 2024-01-25T15:03:50.625 INFO:tasks.workunit.client.0.smithi170.stdout:4/878: creat d6/d28/f11d x:0 0 0 2024-01-25T15:03:50.626 INFO:tasks.workunit.client.0.smithi170.stdout:1/973: unlink d0/d20/d28/d2a/cbf 0 2024-01-25T15:03:50.626 INFO:tasks.workunit.client.0.smithi170.stdout:1/974: read d0/d20/d28/d2a/dc7/fe0 [3749,11490] 0 2024-01-25T15:03:50.634 INFO:tasks.workunit.client.0.smithi170.stdout:4/879: read d6/fa0 [1311267,19357] 0 2024-01-25T15:03:50.637 INFO:tasks.workunit.client.0.smithi170.stdout:9/982: dwrite d5/df/d2e/d6b/f72 [0,4194304] 0 2024-01-25T15:03:50.638 INFO:tasks.workunit.client.0.smithi170.stdout:2/914: read d10/d1e/d32/d3e/d5c/d92/d8b/fb2 [4711965,108154] 0 2024-01-25T15:03:50.638 INFO:tasks.workunit.client.0.smithi170.stdout:4/880: link d6/c5f d6/d7/d31/d46/c11e 0 2024-01-25T15:03:50.640 INFO:tasks.workunit.client.0.smithi170.stdout:9/983: symlink d5/df/d2e/d77/d21/d46/d6c/dac/l14a 0 2024-01-25T15:03:50.646 INFO:tasks.workunit.client.0.smithi170.stdout:1/975: dwrite d0/d20/d3a/d6e/d11e/d9c/f13c [0,4194304] 0 2024-01-25T15:03:50.647 INFO:tasks.workunit.client.0.smithi170.stdout:1/976: stat d0/d20/d28/c90 0 2024-01-25T15:03:50.651 INFO:tasks.workunit.client.0.smithi170.stdout:2/915: rename d10/f104 to d10/d1e/d32/d3e/d41/d7a/f143 0 2024-01-25T15:03:50.653 INFO:tasks.workunit.client.0.smithi170.stdout:2/916: symlink d10/d1e/d32/d3e/d41/dc4/dc6/d42/daa/l144 0 2024-01-25T15:03:50.664 INFO:tasks.workunit.client.0.smithi170.stdout:2/917: dread d10/d1b/db6/dd7/ff1 [0,4194304] 0 2024-01-25T15:03:50.667 INFO:tasks.workunit.client.0.smithi170.stdout:4/881: rename d6/d7/d31/d7e/d9c/lbb to d6/d7/d31/d7e/d80/l11f 0 2024-01-25T15:03:50.668 INFO:tasks.workunit.client.0.smithi170.stdout:4/882: mknod d6/d7/d31/d7e/d9c/df2/c120 0 2024-01-25T15:03:50.669 INFO:tasks.workunit.client.0.smithi170.stdout:1/977: rename d0/d2e/l37 to d0/d20/d28/d2a/d4a/d56/dc1/l14c 0 2024-01-25T15:03:50.671 INFO:tasks.workunit.client.0.smithi170.stdout:1/978: mkdir d0/d50/d14d 0 2024-01-25T15:03:50.671 INFO:tasks.workunit.client.0.smithi170.stdout:1/979: fsync d0/d20/f142 0 2024-01-25T15:03:50.681 INFO:tasks.workunit.client.0.smithi170.stdout:2/918: rename d10/l17 to d10/d1e/d5e/d73/d9e/da3/l145 0 2024-01-25T15:03:50.683 INFO:tasks.workunit.client.0.smithi170.stdout:4/883: rename d6/d7/d31/lac to d6/d7/db7/l121 0 2024-01-25T15:03:50.684 INFO:tasks.workunit.client.0.smithi170.stdout:2/919: unlink d10/d1e/d5e/d73/d9e/da3/fef 0 2024-01-25T15:03:50.684 INFO:tasks.workunit.client.0.smithi170.stdout:2/920: write d10/d1e/d5e/d73/f13f [427994,21203] 0 2024-01-25T15:03:50.685 INFO:tasks.workunit.client.0.smithi170.stdout:2/921: creat d10/d1e/d32/d3e/d41/d7a/f146 x:0 0 0 2024-01-25T15:03:50.685 INFO:tasks.workunit.client.0.smithi170.stdout:2/922: fdatasync d10/d1e/d32/d3e/d41/dc4/f101 0 2024-01-25T15:03:50.687 INFO:tasks.workunit.client.0.smithi170.stdout:1/980: dwrite d0/de8/f125 [0,4194304] 0 2024-01-25T15:03:50.712 INFO:tasks.workunit.client.0.smithi170.stdout:4/884: dwrite d6/d28/f5d [0,4194304] 0 2024-01-25T15:03:50.712 INFO:tasks.workunit.client.0.smithi170.stdout:1/981: dwrite d0/d20/d28/f66 [0,4194304] 0 2024-01-25T15:03:50.713 INFO:tasks.workunit.client.0.smithi170.stdout:2/923: rename d10/d1e/d32/d62/d8d/lc9 to d10/d1e/d32/d3e/l147 0 2024-01-25T15:03:50.714 INFO:tasks.workunit.client.0.smithi170.stdout:2/924: chown d10/d1e/lb0 470 1 2024-01-25T15:03:50.714 INFO:tasks.workunit.client.0.smithi170.stdout:1/982: mknod d0/d20/d28/d2a/d4a/d56/dc1/de3/c14e 0 2024-01-25T15:03:50.714 INFO:tasks.workunit.client.0.smithi170.stdout:1/983: chown d0/d20/d28/d2a/c34 1622351 1 2024-01-25T15:03:50.715 INFO:tasks.workunit.client.0.smithi170.stdout:1/984: write d0/d20/ddd/dde/f103 [466665,2060] 0 2024-01-25T15:03:50.715 INFO:tasks.workunit.client.0.smithi170.stdout:1/985: dread - d0/d20/d28/d2a/d4a/d56/dc1/f89 zero size 2024-01-25T15:03:50.718 INFO:tasks.workunit.client.0.smithi170.stdout:1/986: rmdir d0/d20/d28/d2a/d4a/d56/d5b/d72/d101 0 2024-01-25T15:03:50.722 INFO:tasks.workunit.client.0.smithi170.stdout:4/885: link d6/d28/c4e d6/c122 0 2024-01-25T15:03:50.724 INFO:tasks.workunit.client.0.smithi170.stdout:9/984: sync 2024-01-25T15:03:50.724 INFO:tasks.workunit.client.0.smithi170.stdout:5/989: sync 2024-01-25T15:03:50.726 INFO:tasks.workunit.client.0.smithi170.stdout:5/990: mkdir d5/d58/da9/df9/dbd/dc2/d15b 0 2024-01-25T15:03:50.726 INFO:tasks.workunit.client.0.smithi170.stdout:9/985: symlink d5/df/d16/d52/d9c/l14b 0 2024-01-25T15:03:50.727 INFO:tasks.workunit.client.0.smithi170.stdout:5/991: rmdir d5/d54/d85/d2c/d34/d7c 39 2024-01-25T15:03:50.728 INFO:tasks.workunit.client.0.smithi170.stdout:9/986: symlink d5/df/d2e/d77/d21/d46/d6c/l14c 0 2024-01-25T15:03:50.728 INFO:tasks.workunit.client.0.smithi170.stdout:9/987: creat d5/df/d2e/d77/d21/d46/d6c/dac/f14d x:0 0 0 2024-01-25T15:03:50.728 INFO:tasks.workunit.client.0.smithi170.stdout:5/992: symlink d5/d54/d85/d2c/d45/d56/d72/d10c/l15c 0 2024-01-25T15:03:50.729 INFO:tasks.workunit.client.0.smithi170.stdout:2/925: dread d10/d1e/d32/d62/d74/d107/f93 [0,4194304] 0 2024-01-25T15:03:50.729 INFO:tasks.workunit.client.0.smithi170.stdout:2/926: fdatasync d10/d1e/d32/d3e/d41/d7a/fa7 0 2024-01-25T15:03:50.729 INFO:tasks.workunit.client.0.smithi170.stdout:4/886: dread d6/d7/d31/d7e/f5a [0,4194304] 0 2024-01-25T15:03:50.729 INFO:tasks.workunit.client.0.smithi170.stdout:5/993: chown d5/d58/c154 1669495 1 2024-01-25T15:03:50.729 INFO:tasks.workunit.client.0.smithi170.stdout:9/988: mknod d5/df/d2e/d77/d21/d34/c14e 0 2024-01-25T15:03:50.730 INFO:tasks.workunit.client.0.smithi170.stdout:2/927: creat d10/d1b/db6/f148 x:0 0 0 2024-01-25T15:03:50.730 INFO:tasks.workunit.client.0.smithi170.stdout:5/994: truncate d5/d54/d85/d2c/d45/f48 1234086 0 2024-01-25T15:03:50.731 INFO:tasks.workunit.client.0.smithi170.stdout:5/995: stat d5/c66 0 2024-01-25T15:03:50.731 INFO:tasks.workunit.client.0.smithi170.stdout:9/989: rmdir d5/df/d16/d35/d3c/d91/dd6/dd9/ded 39 2024-01-25T15:03:50.732 INFO:tasks.workunit.client.0.smithi170.stdout:1/987: dread d0/fd [4194304,4194304] 0 2024-01-25T15:03:50.732 INFO:tasks.workunit.client.0.smithi170.stdout:1/988: truncate d0/d20/fb1 951650 0 2024-01-25T15:03:50.732 INFO:tasks.workunit.client.0.smithi170.stdout:1/989: chown d0/d20/d28/d2a/d57/l13b 42736137 1 2024-01-25T15:03:50.733 INFO:tasks.workunit.client.0.smithi170.stdout:9/990: rename d5/df/d2e/d77/d21/d46/d18/dc0/f108 to d5/df/d2e/d77/d143/f14f 0 2024-01-25T15:03:50.734 INFO:tasks.workunit.client.0.smithi170.stdout:9/991: dread d5/dca/dd7/f12d [0,4194304] 0 2024-01-25T15:03:50.735 INFO:tasks.workunit.client.0.smithi170.stdout:5/996: write d5/d54/d85/d2c/f2d [1267376,122932] 0 2024-01-25T15:03:50.736 INFO:tasks.workunit.client.0.smithi170.stdout:9/992: mknod d5/df/d16/d52/d128/d12b/c150 0 2024-01-25T15:03:50.751 INFO:tasks.workunit.client.0.smithi170.stdout:5/997: dread d5/d54/d85/f5c [0,4194304] 0 2024-01-25T15:03:50.753 INFO:tasks.workunit.client.0.smithi170.stdout:5/998: creat d5/d54/d85/d2c/d45/d56/d72/f15d x:0 0 0 2024-01-25T15:03:50.753 INFO:tasks.workunit.client.0.smithi170.stdout:5/999: write d5/d54/d85/d2c/d45/d139/d148/ffb [611035,52582] 0 2024-01-25T15:03:50.756 INFO:tasks.workunit.client.0.smithi170.stdout:1/990: dread d0/d20/ddd/dde/f137 [0,4194304] 0 2024-01-25T15:03:50.756 INFO:tasks.workunit.client.0.smithi170.stdout:1/991: fdatasync d0/d20/d3a/d6e/d11e/d9c/fea 0 2024-01-25T15:03:50.760 INFO:tasks.workunit.client.0.smithi170.stdout:9/993: dwrite d5/df/d16/d35/d3c/d91/dd6/dd9/fde [0,4194304] 0 2024-01-25T15:03:50.760 INFO:tasks.workunit.client.0.smithi170.stdout:2/928: dwrite d10/d1e/d32/d3e/f47 [0,4194304] 0 2024-01-25T15:03:50.762 INFO:tasks.workunit.client.0.smithi170.stdout:9/994: symlink d5/df/d2e/d77/d86/d118/l151 0 2024-01-25T15:03:50.764 INFO:tasks.workunit.client.0.smithi170.stdout:9/995: mkdir d5/df/d2e/d77/d21/d46/d152 0 2024-01-25T15:03:50.766 INFO:tasks.workunit.client.0.smithi170.stdout:4/887: dwrite d6/d28/d67/f96 [0,4194304] 0 2024-01-25T15:03:50.766 INFO:tasks.workunit.client.0.smithi170.stdout:1/992: dread d0/de8/f125 [0,4194304] 0 2024-01-25T15:03:50.766 INFO:tasks.workunit.client.0.smithi170.stdout:4/888: readlink d6/d28/lb8 0 2024-01-25T15:03:50.766 INFO:tasks.workunit.client.0.smithi170.stdout:1/993: write d0/d20/f142 [517410,45052] 0 2024-01-25T15:03:50.772 INFO:tasks.workunit.client.0.smithi170.stdout:4/889: creat d6/d28/d93/f123 x:0 0 0 2024-01-25T15:03:50.772 INFO:tasks.workunit.client.0.smithi170.stdout:4/890: write d6/d7/d31/d46/dc6/fe2 [456155,49073] 0 2024-01-25T15:03:50.775 INFO:tasks.workunit.client.0.smithi170.stdout:2/929: rmdir d10/d1e/d32 39 2024-01-25T15:03:50.776 INFO:tasks.workunit.client.0.smithi170.stdout:9/996: dread d5/df/d2e/d77/d21/d34/d3e/d7f/fe2 [0,4194304] 0 2024-01-25T15:03:50.789 INFO:tasks.workunit.client.0.smithi170.stdout:2/930: dread d10/d1e/d32/d3e/d41/d7a/f143 [0,4194304] 0 2024-01-25T15:03:50.791 INFO:tasks.workunit.client.0.smithi170.stdout:1/994: dwrite d0/d1b/fc9 [0,4194304] 0 2024-01-25T15:03:50.793 INFO:tasks.workunit.client.0.smithi170.stdout:1/995: mknod d0/d50/d8e/c14f 0 2024-01-25T15:03:50.794 INFO:tasks.workunit.client.0.smithi170.stdout:1/996: creat d0/d20/d28/d2a/d4a/d56/d106/f150 x:0 0 0 2024-01-25T15:03:50.795 INFO:tasks.workunit.client.0.smithi170.stdout:4/891: dwrite d6/d28/f5d [4194304,4194304] 0 2024-01-25T15:03:50.798 INFO:tasks.workunit.client.0.smithi170.stdout:9/997: dwrite d5/df/ffb [0,4194304] 0 2024-01-25T15:03:50.800 INFO:tasks.workunit.client.0.smithi170.stdout:4/892: creat d6/d28/d67/f124 x:0 0 0 2024-01-25T15:03:50.800 INFO:tasks.workunit.client.0.smithi170.stdout:9/998: creat d5/df/d2e/d6b/f153 x:0 0 0 2024-01-25T15:03:50.810 INFO:tasks.workunit.client.0.smithi170.stdout:4/893: dread d6/d7/d31/d7e/f102 [0,4194304] 0 2024-01-25T15:03:50.810 INFO:tasks.workunit.client.0.smithi170.stdout:4/894: fdatasync d6/d28/d59/d7d/f83 0 2024-01-25T15:03:50.813 INFO:tasks.workunit.client.0.smithi170.stdout:4/895: mknod d6/d28/d59/d118/d111/c125 0 2024-01-25T15:03:50.815 INFO:tasks.workunit.client.0.smithi170.stdout:9/999: dread d5/df/d2e/f7d [8388608,4194304] 0 2024-01-25T15:03:50.819 INFO:tasks.workunit.client.0.smithi170.stdout:2/931: dwrite d10/d1e/d5e/d73/d9e/da3/fb8 [0,4194304] 0 2024-01-25T15:03:50.819 INFO:tasks.workunit.client.0.smithi170.stdout:2/932: write d10/d1e/d5e/d73/d9e/da3/fb3 [3142282,74663] 0 2024-01-25T15:03:50.819 INFO:tasks.workunit.client.0.smithi170.stdout:1/997: dwrite d0/d2e/f8d [0,4194304] 0 2024-01-25T15:03:50.820 INFO:tasks.workunit.client.0.smithi170.stdout:4/896: rmdir d6/d28/d67 39 2024-01-25T15:03:50.822 INFO:tasks.workunit.client.0.smithi170.stdout:1/998: rename d0/d2e/df2/c113 to d0/d20/d3a/d60/c151 0 2024-01-25T15:03:50.823 INFO:tasks.workunit.client.0.smithi170.stdout:1/999: fdatasync d0/d20/d28/d2a/d4a/f119 0 2024-01-25T15:03:50.824 INFO:tasks.workunit.client.0.smithi170.stdout:2/933: link d10/d1e/d32/d3e/d5c/d102/dd4/l130 d10/d1e/d32/d62/d74/d10b/l149 0 2024-01-25T15:03:50.825 INFO:tasks.workunit.client.0.smithi170.stdout:2/934: truncate d10/d1e/d32/d3e/d41/dc4/dc6/d42/daa/fec 704921 0 2024-01-25T15:03:50.825 INFO:tasks.workunit.client.0.smithi170.stdout:2/935: write d10/d1e/d32/d62/d8d/fdd [794829,98246] 0 2024-01-25T15:03:50.825 INFO:tasks.workunit.client.0.smithi170.stdout:2/936: fdatasync d10/d1e/d32/d3e/d41/dc4/dc6/f23 0 2024-01-25T15:03:50.825 INFO:tasks.workunit.client.0.smithi170.stdout:4/897: read d6/d7/d1b/f3b [89702,48220] 0 2024-01-25T15:03:50.826 INFO:tasks.workunit.client.0.smithi170.stdout:2/937: mknod d10/d1b/db6/dd7/c14a 0 2024-01-25T15:03:50.826 INFO:tasks.workunit.client.0.smithi170.stdout:4/898: mknod d6/c126 0 2024-01-25T15:03:50.827 INFO:tasks.workunit.client.0.smithi170.stdout:4/899: stat d6/d28/d67 0 2024-01-25T15:03:50.827 INFO:tasks.workunit.client.0.smithi170.stdout:4/900: chown d6/d7/d9f/de1 425 1 2024-01-25T15:03:50.827 INFO:tasks.workunit.client.0.smithi170.stdout:4/901: write d6/d28/d59/d118/fd0 [5198028,92145] 0 2024-01-25T15:03:50.828 INFO:tasks.workunit.client.0.smithi170.stdout:4/902: truncate d6/d7/d31/f4d 6843003 0 2024-01-25T15:03:50.828 INFO:tasks.workunit.client.0.smithi170.stdout:4/903: write d6/d28/d59/da8/fdb [822404,66177] 0 2024-01-25T15:03:50.828 INFO:tasks.workunit.client.0.smithi170.stdout:4/904: chown d6/d28/d59/da8/le3 10 1 2024-01-25T15:03:50.830 INFO:tasks.workunit.client.0.smithi170.stdout:4/905: creat d6/d7/d31/d7e/d80/d117/f127 x:0 0 0 2024-01-25T15:03:50.831 INFO:tasks.workunit.client.0.smithi170.stdout:2/938: unlink d10/d1e/d32/d62/f79 0 2024-01-25T15:03:50.831 INFO:tasks.workunit.client.0.smithi170.stdout:4/906: symlink d6/d7/d31/dd2/l128 0 2024-01-25T15:03:50.853 INFO:tasks.workunit.client.0.smithi170.stdout:4/907: dwrite d6/d7/d31/d46/d78/fc0 [0,4194304] 0 2024-01-25T15:03:50.853 INFO:tasks.workunit.client.0.smithi170.stdout:4/908: chown d6/d28/d59/dc4/l11a 1930849022 1 2024-01-25T15:03:50.853 INFO:tasks.workunit.client.0.smithi170.stdout:4/909: chown d6/d7/d31/d7e/d9c/fef 21242635 1 2024-01-25T15:03:50.853 INFO:tasks.workunit.client.0.smithi170.stdout:4/910: readlink d6/d7/d31/d46/de4/l10e 0 2024-01-25T15:03:50.853 INFO:tasks.workunit.client.0.smithi170.stdout:4/911: write d6/d28/d59/dc4/fd3 [571327,52886] 0 2024-01-25T15:03:50.853 INFO:tasks.workunit.client.0.smithi170.stdout:2/939: dwrite d10/d1b/db6/dd7/f135 [0,4194304] 0 2024-01-25T15:03:50.856 INFO:tasks.workunit.client.0.smithi170.stdout:4/912: rmdir d6/d7/d31/d108 0 2024-01-25T15:03:50.876 INFO:tasks.workunit.client.0.smithi170.stdout:4/913: dwrite d6/d28/d59/da8/fdb [0,4194304] 0 2024-01-25T15:03:50.876 INFO:tasks.workunit.client.0.smithi170.stdout:4/914: stat d6/d28/d61/la6 0 2024-01-25T15:03:50.884 INFO:tasks.workunit.client.0.smithi170.stdout:4/915: link d6/d28/d59/d118/d111/f88 d6/d7/d31/d7e/d9c/df2/f129 0 2024-01-25T15:03:50.885 INFO:tasks.workunit.client.0.smithi170.stdout:4/916: truncate d6/d28/d59/d7d/f6c 598465 0 2024-01-25T15:03:50.886 INFO:tasks.workunit.client.0.smithi170.stdout:4/917: creat d6/d28/d59/da8/d110/f12a x:0 0 0 2024-01-25T15:03:50.886 INFO:tasks.workunit.client.0.smithi170.stdout:4/918: chown d6/d7/d31 1989 1 2024-01-25T15:03:50.887 INFO:tasks.workunit.client.0.smithi170.stdout:4/919: symlink d6/d7/d9f/de1/ded/l12b 0 2024-01-25T15:03:50.887 INFO:tasks.workunit.client.0.smithi170.stdout:4/920: write d6/d7/d31/d7e/d80/ff1 [741030,93515] 0 2024-01-25T15:03:50.896 INFO:tasks.workunit.client.0.smithi170.stdout:4/921: dread d6/d7/d1b/f1e [0,4194304] 0 2024-01-25T15:03:50.897 INFO:tasks.workunit.client.0.smithi170.stdout:4/922: mknod d6/d7/d9f/de1/c12c 0 2024-01-25T15:03:50.898 INFO:tasks.workunit.client.0.smithi170.stdout:4/923: symlink d6/d7/l12d 0 2024-01-25T15:03:50.898 INFO:tasks.workunit.client.0.smithi170.stdout:4/924: dread - d6/d7/d31/d7e/d80/d117/f127 zero size 2024-01-25T15:03:50.898 INFO:tasks.workunit.client.0.smithi170.stdout:4/925: dread - d6/ffa zero size 2024-01-25T15:03:50.899 INFO:tasks.workunit.client.0.smithi170.stdout:4/926: mknod d6/d7/d31/dd2/c12e 0 2024-01-25T15:03:50.901 INFO:tasks.workunit.client.0.smithi170.stdout:4/927: mkdir d6/d28/d61/d12f 0 2024-01-25T15:03:50.901 INFO:tasks.workunit.client.0.smithi170.stdout:4/928: chown d6/d28/d59/dc4 246 1 2024-01-25T15:03:50.901 INFO:tasks.workunit.client.0.smithi170.stdout:4/929: chown d6/d28/d59/d7d/d10b 8190542 1 2024-01-25T15:03:50.901 INFO:tasks.workunit.client.0.smithi170.stdout:4/930: write d6/d7/d31/d7e/d9c/fb1 [945115,128408] 0 2024-01-25T15:03:50.901 INFO:tasks.workunit.client.0.smithi170.stdout:4/931: chown d6/d7/d9f/de1/ded 172 1 2024-01-25T15:03:50.902 INFO:tasks.workunit.client.0.smithi170.stdout:4/932: mkdir d6/d7/d1b/d130 0 2024-01-25T15:03:50.902 INFO:tasks.workunit.client.0.smithi170.stdout:4/933: chown d6/d28/d59/d7d/c4b 11 1 2024-01-25T15:03:50.902 INFO:tasks.workunit.client.0.smithi170.stdout:4/934: dread - d6/d28/d67/f124 zero size 2024-01-25T15:03:50.905 INFO:tasks.workunit.client.0.smithi170.stdout:4/935: dread d6/d7/d31/d46/d78/f95 [0,4194304] 0 2024-01-25T15:03:50.928 INFO:tasks.workunit.client.0.smithi170.stdout:4/936: dwrite d6/d28/d59/d7d/f6c [0,4194304] 0 2024-01-25T15:03:50.930 INFO:tasks.workunit.client.0.smithi170.stdout:4/937: mkdir d6/d7/d1b/d131 0 2024-01-25T15:03:50.930 INFO:tasks.workunit.client.0.smithi170.stdout:4/938: fsync d6/d28/d59/d7d/f24 0 2024-01-25T15:03:50.931 INFO:tasks.workunit.client.0.smithi170.stdout:4/939: stat d6/d28/d59/d118/d111/f11c 0 2024-01-25T15:03:50.931 INFO:tasks.workunit.client.0.smithi170.stdout:4/940: creat d6/d7/d31/d46/f132 x:0 0 0 2024-01-25T15:03:50.932 INFO:tasks.workunit.client.0.smithi170.stdout:4/941: creat d6/d28/d61/d12f/f133 x:0 0 0 2024-01-25T15:03:50.942 INFO:tasks.workunit.client.0.smithi170.stdout:4/942: link d6/d28/c2f d6/d7/d31/d7e/d9c/c134 0 2024-01-25T15:03:50.943 INFO:tasks.workunit.client.0.smithi170.stdout:4/943: rmdir d6/d28/d93/de0 39 2024-01-25T15:03:50.943 INFO:tasks.workunit.client.0.smithi170.stdout:4/944: fsync d6/d7/d31/d7e/d9c/fef 0 2024-01-25T15:03:50.953 INFO:tasks.workunit.client.0.smithi170.stdout:4/945: read d6/d28/d59/d118/d111/f6d [4119197,61102] 0 2024-01-25T15:03:50.954 INFO:tasks.workunit.client.0.smithi170.stdout:4/946: unlink d6/d28/d59/d7d/c70 0 2024-01-25T15:03:50.955 INFO:tasks.workunit.client.0.smithi170.stdout:4/947: creat d6/d7/d31/f135 x:0 0 0 2024-01-25T15:03:50.956 INFO:tasks.workunit.client.0.smithi170.stdout:4/948: creat d6/d7/d1b/d130/f136 x:0 0 0 2024-01-25T15:03:50.976 INFO:tasks.workunit.client.0.smithi170.stdout:4/949: dwrite d6/d7/d31/d46/d78/f100 [0,4194304] 0 2024-01-25T15:03:50.978 INFO:tasks.workunit.client.0.smithi170.stdout:4/950: creat d6/d28/d59/d118/d105/f137 x:0 0 0 2024-01-25T15:03:50.978 INFO:tasks.workunit.client.0.smithi170.stdout:4/951: dread - d6/d28/f11d zero size 2024-01-25T15:03:50.978 INFO:tasks.workunit.client.0.smithi170.stdout:4/952: stat d6/d7/d1b 0 2024-01-25T15:03:50.979 INFO:tasks.workunit.client.0.smithi170.stdout:4/953: creat d6/d7/d31/d7e/d9c/df2/f138 x:0 0 0 2024-01-25T15:03:50.979 INFO:tasks.workunit.client.0.smithi170.stdout:4/954: chown d6/c5f 14224963 1 2024-01-25T15:03:50.979 INFO:tasks.workunit.client.0.smithi170.stdout:4/955: write d6/d28/d59/d7d/f97 [1116781,117320] 0 2024-01-25T15:03:51.000 INFO:tasks.workunit.client.0.smithi170.stdout:4/956: dwrite d6/d28/d59/d7d/f83 [0,4194304] 0 2024-01-25T15:03:51.011 INFO:tasks.workunit.client.0.smithi170.stdout:4/957: link d6/d28/d61/lbf d6/d7/d31/d7e/d80/l139 0 2024-01-25T15:03:51.011 INFO:tasks.workunit.client.0.smithi170.stdout:4/958: creat d6/d7/d31/d46/dc6/f13a x:0 0 0 2024-01-25T15:03:51.019 INFO:tasks.workunit.client.0.smithi170.stdout:4/959: link d6/d7/d31/d7e/d9c/df2/f129 d6/d7/f13b 0 2024-01-25T15:03:51.019 INFO:tasks.workunit.client.0.smithi170.stdout:4/960: write d6/d28/d59/d118/d111/f87 [1559437,21967] 0 2024-01-25T15:03:51.076 INFO:tasks.workunit.client.0.smithi170.stdout:2/940: sync 2024-01-25T15:03:51.085 INFO:tasks.workunit.client.0.smithi170.stdout:2/941: write d10/d1e/d32/d3e/f47 [1433523,78731] 0 2024-01-25T15:03:51.086 INFO:tasks.workunit.client.0.smithi170.stdout:2/942: dread d10/d1e/d32/d3e/d5c/d92/fc5 [0,4194304] 0 2024-01-25T15:03:51.086 INFO:tasks.workunit.client.0.smithi170.stdout:2/943: readlink d10/d1e/d5e/d73/d9e/da3/l145 0 2024-01-25T15:03:51.088 INFO:tasks.workunit.client.0.smithi170.stdout:2/944: truncate ff 4194256 0 2024-01-25T15:03:51.088 INFO:tasks.workunit.client.0.smithi170.stdout:2/945: truncate d10/d1b/db6/f148 471827 0 2024-01-25T15:03:51.089 INFO:tasks.workunit.client.0.smithi170.stdout:2/946: mknod d10/d1e/d32/d133/c14b 0 2024-01-25T15:03:51.090 INFO:tasks.workunit.client.0.smithi170.stdout:2/947: symlink d10/d1e/d32/d98/l14c 0 2024-01-25T15:03:51.090 INFO:tasks.workunit.client.0.smithi170.stdout:2/948: chown d10/d1e/d32/d3e/d41/d7a 18 1 2024-01-25T15:03:51.103 INFO:tasks.workunit.client.0.smithi170.stdout:2/949: rename d10/d1e/d32/d3e/d41/dc4/f101 to d10/d1b/db6/dd5/f14d 0 2024-01-25T15:03:51.104 INFO:tasks.workunit.client.0.smithi170.stdout:2/950: creat d10/d1e/d5e/d73/d9e/da3/df4/f14e x:0 0 0 2024-01-25T15:03:51.104 INFO:tasks.workunit.client.0.smithi170.stdout:2/951: stat d10/d1e/d5e/d73/f7f 0 2024-01-25T15:03:51.116 INFO:tasks.workunit.client.0.smithi170.stdout:2/952: rename d10/d1e/d32/d3e/d41/dc4/dc6/d42/daa/fec to d10/d1e/d32/d98/f14f 0 2024-01-25T15:03:51.116 INFO:tasks.workunit.client.0.smithi170.stdout:2/953: read d10/d1e/d5e/d73/d9e/da3/fb3 [885864,69346] 0 2024-01-25T15:03:51.118 INFO:tasks.workunit.client.0.smithi170.stdout:4/961: sync 2024-01-25T15:03:51.119 INFO:tasks.workunit.client.0.smithi170.stdout:4/962: creat d6/d28/d59/d118/f13c x:0 0 0 2024-01-25T15:03:51.120 INFO:tasks.workunit.client.0.smithi170.stdout:4/963: fsync d6/f49 0 2024-01-25T15:03:51.120 INFO:tasks.workunit.client.0.smithi170.stdout:4/964: creat d6/d28/d93/de0/f13d x:0 0 0 2024-01-25T15:03:51.124 INFO:tasks.workunit.client.0.smithi170.stdout:2/954: link d10/d1e/d32/d98/fa5 d10/d1b/db6/f150 0 2024-01-25T15:03:51.125 INFO:tasks.workunit.client.0.smithi170.stdout:2/955: chown d10/d1e/d32/d3e/f137 59409266 1 2024-01-25T15:03:51.125 INFO:tasks.workunit.client.0.smithi170.stdout:2/956: write d10/d1e/d32/d62/d8d/f10d [1581920,81974] 0 2024-01-25T15:03:51.125 INFO:tasks.workunit.client.0.smithi170.stdout:2/957: stat d10/c11 0 2024-01-25T15:03:51.125 INFO:tasks.workunit.client.0.smithi170.stdout:2/958: chown d10/d1b/c5b 448566 1 2024-01-25T15:03:51.125 INFO:tasks.workunit.client.0.smithi170.stdout:2/959: chown d10/d1e/d32/d3e/d5c/d92/d8b/lc1 28 1 2024-01-25T15:03:51.130 INFO:tasks.workunit.client.0.smithi170.stdout:4/965: rmdir d6/d28 39 2024-01-25T15:03:51.139 INFO:tasks.workunit.client.0.smithi170.stdout:2/960: rename d10/d1e/d32/d62 to d10/d1e/d32/d3e/d5c/d92/de9/d151 0 2024-01-25T15:03:51.139 INFO:tasks.workunit.client.0.smithi170.stdout:4/966: dread d6/d7/d31/d46/d78/f100 [0,4194304] 0 2024-01-25T15:03:51.140 INFO:tasks.workunit.client.0.smithi170.stdout:2/961: creat d10/d1e/d32/d3e/d41/dc4/dc6/d42/de8/f152 x:0 0 0 2024-01-25T15:03:51.146 INFO:tasks.workunit.client.0.smithi170.stdout:2/962: stat d10/d1e/d32/d3e/d5c/d102/dd4 0 2024-01-25T15:03:51.150 INFO:tasks.workunit.client.0.smithi170.stdout:2/963: symlink d10/d1e/d32/d3e/d5c/d102/dd4/l153 0 2024-01-25T15:03:51.154 INFO:tasks.workunit.client.0.smithi170.stdout:2/964: write d10/d1e/d32/d3e/d5c/d92/de9/d151/d74/f8c [5597117,54074] 0 2024-01-25T15:03:51.154 INFO:tasks.workunit.client.0.smithi170.stdout:2/965: fdatasync d10/d1e/d32/d3e/d41/d7a/f146 0 2024-01-25T15:03:51.158 INFO:tasks.workunit.client.0.smithi170.stdout:2/966: rmdir d10/d1e/d5e 39 2024-01-25T15:03:51.158 INFO:tasks.workunit.client.0.smithi170.stdout:2/967: write f8 [8936662,29311] 0 2024-01-25T15:03:51.158 INFO:tasks.workunit.client.0.smithi170.stdout:2/968: fdatasync d10/d1e/d32/d3e/d41/dc4/dc6/d42/de8/f152 0 2024-01-25T15:03:51.159 INFO:tasks.workunit.client.0.smithi170.stdout:2/969: unlink d10/d1e/d32/d3e/d41/dc4/dc6/d42/l6d 0 2024-01-25T15:03:51.160 INFO:tasks.workunit.client.0.smithi170.stdout:2/970: mknod d10/d1e/d32/d3e/d41/dc4/dc6/d42/de8/d127/c154 0 2024-01-25T15:03:51.161 INFO:tasks.workunit.client.0.smithi170.stdout:2/971: write d10/d1e/d32/f115 [342134,9565] 0 2024-01-25T15:03:51.162 INFO:tasks.workunit.client.0.smithi170.stdout:2/972: symlink d10/d1e/d32/d3e/d5c/d102/dd4/l155 0 2024-01-25T15:03:51.163 INFO:tasks.workunit.client.0.smithi170.stdout:2/973: mkdir d10/d1e/d32/d133/d156 0 2024-01-25T15:03:51.163 INFO:tasks.workunit.client.0.smithi170.stdout:2/974: read d10/f37 [3264216,6084] 0 2024-01-25T15:03:51.163 INFO:tasks.workunit.client.0.smithi170.stdout:2/975: chown d10/d1e/d5e/d73/d9e/da3/c117 2 1 2024-01-25T15:03:51.164 INFO:tasks.workunit.client.0.smithi170.stdout:4/967: dwrite d6/d7/d31/d46/fa9 [0,4194304] 0 2024-01-25T15:03:51.164 INFO:tasks.workunit.client.0.smithi170.stdout:4/968: chown d6/d7/db7/l121 27048 1 2024-01-25T15:03:51.165 INFO:tasks.workunit.client.0.smithi170.stdout:4/969: getdents d6/d28/d59/d118/d105 0 2024-01-25T15:03:51.165 INFO:tasks.workunit.client.0.smithi170.stdout:4/970: fdatasync d6/d7/d31/d7e/f10a 0 2024-01-25T15:03:51.177 INFO:tasks.workunit.client.0.smithi170.stdout:4/971: write d6/d7/d31/d7e/d80/f91 [6538434,64268] 0 2024-01-25T15:03:51.177 INFO:tasks.workunit.client.0.smithi170.stdout:2/976: rename d10/d1e/d5e/ldc to d10/d1e/d32/d3e/d5c/d102/dd4/l157 0 2024-01-25T15:03:51.178 INFO:tasks.workunit.client.0.smithi170.stdout:2/977: creat d10/d1b/db6/dd5/f158 x:0 0 0 2024-01-25T15:03:51.179 INFO:tasks.workunit.client.0.smithi170.stdout:4/972: truncate d6/d7/d31/d7e/d9c/df2/f129 3831977 0 2024-01-25T15:03:51.179 INFO:tasks.workunit.client.0.smithi170.stdout:4/973: stat d6/d7/d31/d46/fa9 0 2024-01-25T15:03:51.180 INFO:tasks.workunit.client.0.smithi170.stdout:4/974: write d6/d7/d31/d46/d78/f95 [334501,101065] 0 2024-01-25T15:03:51.180 INFO:tasks.workunit.client.0.smithi170.stdout:2/978: mknod d10/d1e/d32/d98/c159 0 2024-01-25T15:03:51.181 INFO:tasks.workunit.client.0.smithi170.stdout:4/975: getdents d6/d7/d31/d7e/d9c/df2 0 2024-01-25T15:03:51.194 INFO:tasks.workunit.client.0.smithi170.stdout:4/976: link d6/d7/d31/d7e/f102 d6/d7/d31/d46/dc6/f13e 0 2024-01-25T15:03:51.194 INFO:tasks.workunit.client.0.smithi170.stdout:4/977: dread - d6/ffa zero size 2024-01-25T15:03:51.194 INFO:tasks.workunit.client.0.smithi170.stdout:4/978: dread - d6/d7/d31/f135 zero size 2024-01-25T15:03:51.195 INFO:tasks.workunit.client.0.smithi170.stdout:4/979: mkdir d6/d7/d9f/de1/d13f 0 2024-01-25T15:03:51.195 INFO:tasks.workunit.client.0.smithi170.stdout:4/980: chown d6/d28/d59/d7d/l72 2024 1 2024-01-25T15:03:51.200 INFO:tasks.workunit.client.0.smithi170.stdout:2/979: dwrite d10/f37 [0,4194304] 0 2024-01-25T15:03:51.219 INFO:tasks.workunit.client.0.smithi170.stdout:4/981: dwrite d6/d28/d59/d118/d111/f87 [0,4194304] 0 2024-01-25T15:03:51.219 INFO:tasks.workunit.client.0.smithi170.stdout:4/982: fdatasync d6/d7/d31/d7e/f10a 0 2024-01-25T15:03:51.220 INFO:tasks.workunit.client.0.smithi170.stdout:4/983: dread - d6/d28/d59/da8/d110/f12a zero size 2024-01-25T15:03:51.221 INFO:tasks.workunit.client.0.smithi170.stdout:4/984: creat d6/d28/d59/d7d/d115/f140 x:0 0 0 2024-01-25T15:03:51.222 INFO:tasks.workunit.client.0.smithi170.stdout:2/980: dwrite d10/d1e/d32/d3e/d41/dc4/dc6/d42/de8/f152 [0,4194304] 0 2024-01-25T15:03:51.223 INFO:tasks.workunit.client.0.smithi170.stdout:2/981: mknod d10/c15a 0 2024-01-25T15:03:51.234 INFO:tasks.workunit.client.0.smithi170.stdout:4/985: read d6/d28/d59/d7d/f6c [69320,27924] 0 2024-01-25T15:03:51.234 INFO:tasks.workunit.client.0.smithi170.stdout:4/986: write d6/d7/d31/f135 [793015,17231] 0 2024-01-25T15:03:51.234 INFO:tasks.workunit.client.0.smithi170.stdout:4/987: dread d6/d28/d93/fa3 [0,4194304] 0 2024-01-25T15:03:51.234 INFO:tasks.workunit.client.0.smithi170.stdout:4/988: fsync d6/d28/d59/d118/d111/f11c 0 2024-01-25T15:03:51.235 INFO:tasks.workunit.client.0.smithi170.stdout:4/989: creat d6/d7/d1b/d131/f141 x:0 0 0 2024-01-25T15:03:51.236 INFO:tasks.workunit.client.0.smithi170.stdout:4/990: rename d6/d28/d59/d7d/c47 to d6/d28/d59/d118/d105/c142 0 2024-01-25T15:03:51.237 INFO:tasks.workunit.client.0.smithi170.stdout:4/991: mkdir d6/d7/d1b/d130/d143 0 2024-01-25T15:03:51.238 INFO:tasks.workunit.client.0.smithi170.stdout:4/992: write d6/d7/d31/d7e/d80/d117/f127 [453817,93149] 0 2024-01-25T15:03:51.240 INFO:tasks.workunit.client.0.smithi170.stdout:4/993: creat d6/d28/d59/d118/d111/f144 x:0 0 0 2024-01-25T15:03:51.241 INFO:tasks.workunit.client.0.smithi170.stdout:4/994: truncate d6/d7/d1b/d130/f136 177033 0 2024-01-25T15:03:51.241 INFO:tasks.workunit.client.0.smithi170.stdout:2/982: dwrite d10/d1b/db6/dd7/ff1 [4194304,4194304] 0 2024-01-25T15:03:51.242 INFO:tasks.workunit.client.0.smithi170.stdout:2/983: getdents d10/d1e/d32/d3e/d41/d7a 0 2024-01-25T15:03:51.242 INFO:tasks.workunit.client.0.smithi170.stdout:4/995: creat d6/d28/d61/d12f/f145 x:0 0 0 2024-01-25T15:03:51.242 INFO:tasks.workunit.client.0.smithi170.stdout:2/984: write d10/d1e/d32/d3e/d41/d7a/fa7 [890089,98248] 0 2024-01-25T15:03:51.244 INFO:tasks.workunit.client.0.smithi170.stdout:4/996: dread d6/d28/d59/d7d/f5c [0,4194304] 0 2024-01-25T15:03:51.244 INFO:tasks.workunit.client.0.smithi170.stdout:2/985: rename d10/d1e/d32/d3e/d5c/d92/de9/d151/d74/d107/fb1 to d10/d1e/d32/d3e/d41/dc4/dc6/d42/d109/f15b 0 2024-01-25T15:03:51.245 INFO:tasks.workunit.client.0.smithi170.stdout:2/986: symlink d10/d1e/d32/d3e/d41/dc4/dc6/d42/l15c 0 2024-01-25T15:03:51.264 INFO:tasks.workunit.client.0.smithi170.stdout:4/997: dwrite d6/d7/d31/d46/dc6/f13e [0,4194304] 0 2024-01-25T15:03:51.266 INFO:tasks.workunit.client.0.smithi170.stdout:4/998: mkdir d6/d7/d31/d146 0 2024-01-25T15:03:51.267 INFO:tasks.workunit.client.0.smithi170.stdout:4/999: mkdir d6/d7/d31/d7e/d9c/df2/d147 0 2024-01-25T15:03:51.270 INFO:tasks.workunit.client.0.smithi170.stdout:2/987: dwrite d10/d1e/d32/d3e/d5c/d92/de9/d151/d8d/fbe [4194304,4194304] 0 2024-01-25T15:03:51.272 INFO:tasks.workunit.client.0.smithi170.stdout:2/988: creat d10/d1e/d32/d3e/d5c/d92/de9/d151/d74/d10b/f15d x:0 0 0 2024-01-25T15:03:51.272 INFO:tasks.workunit.client.0.smithi170.stdout:2/989: truncate d10/d1b/db6/dd7/ffc 670539 0 2024-01-25T15:03:51.275 INFO:tasks.workunit.client.0.smithi170.stdout:2/990: write d10/d1e/d32/d3e/d5c/f76 [4012448,76450] 0 2024-01-25T15:03:51.275 INFO:tasks.workunit.client.0.smithi170.stdout:2/991: read d10/d1e/d32/d3e/d5c/d92/de9/d151/d74/f8f [832916,49995] 0 2024-01-25T15:03:51.276 INFO:tasks.workunit.client.0.smithi170.stdout:2/992: truncate d10/d1e/d32/d3e/d41/dc4/fbf 3360429 0 2024-01-25T15:03:51.276 INFO:tasks.workunit.client.0.smithi170.stdout:2/993: readlink d10/d1e/d32/d3e/d5c/d92/de9/d151/l83 0 2024-01-25T15:03:51.286 INFO:tasks.workunit.client.0.smithi170.stdout:2/994: link d10/d1e/d32/d3e/d5c/d92/de9/d151/d74/f8c d10/d1e/d5e/d73/f15e 0 2024-01-25T15:03:51.299 INFO:tasks.workunit.client.0.smithi170.stdout:2/995: rename d10/d1b/db6/dd7/fe4 to d10/d1e/d32/d3e/d5c/d92/d8b/d11d/f15f 0 2024-01-25T15:03:51.299 INFO:tasks.workunit.client.0.smithi170.stdout:2/996: chown d10/d1e/d5e/d73/d9e/da3/c117 249119664 1 2024-01-25T15:03:51.324 INFO:tasks.workunit.client.0.smithi170.stdout:2/997: dwrite d10/d1e/d32/f115 [0,4194304] 0 2024-01-25T15:03:51.327 INFO:tasks.workunit.client.0.smithi170.stdout:2/998: dread d10/d1e/d32/d3e/d5c/f94 [0,4194304] 0 2024-01-25T15:03:51.327 INFO:tasks.workunit.client.0.smithi170.stdout:2/999: write d10/d1e/d32/d3e/d5c/d92/d8b/f105 [74600,111459] 0 2024-01-25T15:03:51.330 INFO:tasks.workunit.client.0.smithi170.stderr:+ rm -rf -- ./tmp.rygrP0nesr 2024-01-25T15:03:51.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:51 smithi191 ceph-mon[36347]: scrub summary: idle 2024-01-25T15:03:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:51 smithi191 ceph-mon[36347]: scrub summary: idle 2024-01-25T15:03:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:51 smithi191 ceph-mon[36347]: scrub summary: idle 2024-01-25T15:03:51.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:51 smithi191 ceph-mon[36347]: pgmap v404: 97 pgs: 97 active+clean; 1.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 181 MiB/s rd, 206 MiB/s wr, 1.52k op/s 2024-01-25T15:03:51.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:51 smithi186 ceph-mon[35697]: scrub summary: idle 2024-01-25T15:03:51.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:51 smithi186 ceph-mon[35697]: scrub summary: idle 2024-01-25T15:03:51.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:51 smithi186 ceph-mon[35697]: scrub summary: idle 2024-01-25T15:03:51.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:51 smithi186 ceph-mon[35697]: pgmap v404: 97 pgs: 97 active+clean; 1.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 181 MiB/s rd, 206 MiB/s wr, 1.52k op/s 2024-01-25T15:03:51.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:51 smithi170 ceph-mon[31899]: scrub summary: idle 2024-01-25T15:03:51.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:51 smithi170 ceph-mon[31899]: scrub summary: idle 2024-01-25T15:03:51.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:51 smithi170 ceph-mon[31899]: scrub summary: idle 2024-01-25T15:03:51.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:51 smithi170 ceph-mon[31899]: pgmap v404: 97 pgs: 97 active+clean; 1.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 181 MiB/s rd, 206 MiB/s wr, 1.52k op/s 2024-01-25T15:03:53.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:53 smithi186 ceph-mon[35697]: pgmap v405: 97 pgs: 97 active+clean; 1.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 153 MiB/s rd, 171 MiB/s wr, 996 op/s 2024-01-25T15:03:53.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:53 smithi170 ceph-mon[31899]: pgmap v405: 97 pgs: 97 active+clean; 1.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 153 MiB/s rd, 171 MiB/s wr, 996 op/s 2024-01-25T15:03:53.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:53 smithi191 ceph-mon[36347]: pgmap v405: 97 pgs: 97 active+clean; 1.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 153 MiB/s rd, 171 MiB/s wr, 996 op/s 2024-01-25T15:03:55.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:55 smithi186 ceph-mon[35697]: pgmap v406: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 159 MiB/s rd, 184 MiB/s wr, 840 op/s 2024-01-25T15:03:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:55 smithi170 ceph-mon[31899]: pgmap v406: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 159 MiB/s rd, 184 MiB/s wr, 840 op/s 2024-01-25T15:03:55.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:55 smithi191 ceph-mon[36347]: pgmap v406: 97 pgs: 97 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 159 MiB/s rd, 184 MiB/s wr, 840 op/s 2024-01-25T15:03:57.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:57 smithi186 ceph-mon[35697]: pgmap v407: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 112 MiB/s rd, 138 MiB/s wr, 693 op/s 2024-01-25T15:03:57.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:57 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:57.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:57 smithi170 ceph-mon[31899]: pgmap v407: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 112 MiB/s rd, 138 MiB/s wr, 693 op/s 2024-01-25T15:03:57.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:57 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:57.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:57 smithi191 ceph-mon[36347]: pgmap v407: 97 pgs: 97 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 112 MiB/s rd, 138 MiB/s wr, 693 op/s 2024-01-25T15:03:57.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:57 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:03:59.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:03:59 smithi170 ceph-mon[31899]: pgmap v408: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s rd, 112 MiB/s wr, 697 op/s 2024-01-25T15:03:59.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:03:59 smithi191 ceph-mon[36347]: pgmap v408: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s rd, 112 MiB/s wr, 697 op/s 2024-01-25T15:03:59.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:03:59 smithi186 ceph-mon[35697]: pgmap v408: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 88 MiB/s rd, 112 MiB/s wr, 697 op/s 2024-01-25T15:04:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.219+0000 7f683505c640 1 -- 172.21.15.170:0/793804368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6830101790 msgr2=0x7f6830103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.219+0000 7f683505c640 1 --2- 172.21.15.170:0/793804368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6830101790 0x7f6830103b80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f6820009900 tx=0x7f682002bc30 comp rx=0 tx=0).stop 2024-01-25T15:04:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.219+0000 7f683505c640 1 -- 172.21.15.170:0/793804368 shutdown_connections 2024-01-25T15:04:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.219+0000 7f683505c640 1 --2- 172.21.15.170:0/793804368 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68301069f0 0x7f6830108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.219+0000 7f683505c640 1 --2- 172.21.15.170:0/793804368 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f68301040c0 0x7f68301064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.219+0000 7f683505c640 1 --2- 172.21.15.170:0/793804368 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6830101790 0x7f6830103b80 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.219+0000 7f683505c640 1 -- 172.21.15.170:0/793804368 >> 172.21.15.170:0/793804368 conn(0x7f68300fb180 msgr2=0x7f68300fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.219+0000 7f683505c640 1 -- 172.21.15.170:0/793804368 shutdown_connections 2024-01-25T15:04:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.219+0000 7f683505c640 1 -- 172.21.15.170:0/793804368 wait complete. 2024-01-25T15:04:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.219+0000 7f683505c640 1 Processor -- start 2024-01-25T15:04:00.222 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f683505c640 1 -- start start 2024-01-25T15:04:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f683505c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6830101790 0x7f6830101100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f683505c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68301040c0 0x7f68300ff740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f683505c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68301069f0 0x7f68300ffc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f683505c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68301003e0 con 0x7f68301069f0 2024-01-25T15:04:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f683505c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6830100550 con 0x7f68301040c0 2024-01-25T15:04:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f683505c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68301a0cb0 con 0x7f6830101790 2024-01-25T15:04:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f682f59e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68301069f0 0x7f68300ffc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f682ed9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6830101790 0x7f6830101100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f682f59e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68301069f0 0x7f68300ffc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52162/0 (socket says 172.21.15.170:52162) 2024-01-25T15:04:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f682f59e640 1 -- 172.21.15.170:0/3573391774 learned_addr learned my addr 172.21.15.170:0/3573391774 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f6827fff640 1 --2- 172.21.15.170:0/3573391774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68301040c0 0x7f68300ff740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f682ed9d640 1 -- 172.21.15.170:0/3573391774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68301040c0 msgr2=0x7f68300ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:00.223 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f682ed9d640 1 --2- 172.21.15.170:0/3573391774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68301040c0 0x7f68300ff740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.224 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f682ed9d640 1 -- 172.21.15.170:0/3573391774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68301069f0 msgr2=0x7f68300ffc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:00.224 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f682ed9d640 1 --2- 172.21.15.170:0/3573391774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68301069f0 0x7f68300ffc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.224 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f682ed9d640 1 -- 172.21.15.170:0/3573391774 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6820009560 con 0x7f6830101790 2024-01-25T15:04:00.224 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f682f59e640 1 --2- 172.21.15.170:0/3573391774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68301069f0 0x7f68300ffc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:00.224 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.220+0000 7f682ed9d640 1 --2- 172.21.15.170:0/3573391774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6830101790 0x7f6830101100 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6820009230 tx=0x7f6820004e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:00.224 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.221+0000 7f682cd99640 1 -- 172.21.15.170:0/3573391774 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820004350 con 0x7f6830101790 2024-01-25T15:04:00.224 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.221+0000 7f682cd99640 1 -- 172.21.15.170:0/3573391774 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68200044b0 con 0x7f6830101790 2024-01-25T15:04:00.224 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.221+0000 7f683505c640 1 -- 172.21.15.170:0/3573391774 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68301a0f00 con 0x7f6830101790 2024-01-25T15:04:00.224 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.221+0000 7f682cd99640 1 -- 172.21.15.170:0/3573391774 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820003e10 con 0x7f6830101790 2024-01-25T15:04:00.224 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.221+0000 7f683505c640 1 -- 172.21.15.170:0/3573391774 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68301a1320 con 0x7f6830101790 2024-01-25T15:04:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.223+0000 7f682cd99640 1 -- 172.21.15.170:0/3573391774 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f6820005000 con 0x7f6830101790 2024-01-25T15:04:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.223+0000 7f6837c23740 1 Processor -- start 2024-01-25T15:04:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.223+0000 7f6837c23740 1 -- start start 2024-01-25T15:04:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.223+0000 7f682cd99640 1 --2- 172.21.15.170:0/3573391774 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f681c0a1380 0x7f681c0a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.233 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f682f59e640 1 --2- 172.21.15.170:0/3573391774 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f681c0a1380 0x7f681c0a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f682cd99640 1 -- 172.21.15.170:0/3573391774 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f68200ef2c0 con 0x7f6830101790 2024-01-25T15:04:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f6837c23740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b22a0 0x56163d1b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f6837c23740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b2c90 0x56163d1b7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f6837c23740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 0x56163d1ba290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f6837c23740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d122070 con 0x56163d1b22a0 2024-01-25T15:04:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f6837c23740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d11f760 con 0x56163d1b2c90 2024-01-25T15:04:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f6837c23740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d11b050 con 0x56163d1b7e00 2024-01-25T15:04:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f682ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b22a0 0x56163d1b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f682ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b22a0 0x56163d1b26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52172/0 (socket says 172.21.15.170:52172) 2024-01-25T15:04:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f6827fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b2c90 0x56163d1b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f682ed9d640 1 -- 172.21.15.170:0/1052916500 learned_addr learned my addr 172.21.15.170:0/1052916500 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f682f59e640 1 --2- 172.21.15.170:0/1052916500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 0x56163d1ba290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f6827fff640 1 -- 172.21.15.170:0/1052916500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 msgr2=0x56163d1ba290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:00.234 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f6827fff640 1 --2- 172.21.15.170:0/1052916500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 0x56163d1ba290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f6827fff640 1 -- 172.21.15.170:0/1052916500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b22a0 msgr2=0x56163d1b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f6827fff640 1 --2- 172.21.15.170:0/1052916500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b22a0 0x56163d1b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f6827fff640 1 -- 172.21.15.170:0/1052916500 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56163d112e70 con 0x56163d1b2c90 2024-01-25T15:04:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f682f59e640 1 --2- 172.21.15.170:0/1052916500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 0x56163d1ba290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f682ed9d640 1 --2- 172.21.15.170:0/1052916500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b22a0 0x56163d1b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f682f59e640 1 --2- 172.21.15.170:0/3573391774 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f681c0a1380 0x7f681c0a3840 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6828009fd0 tx=0x7f682800fc00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f6827fff640 1 --2- 172.21.15.170:0/1052916500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b2c90 0x56163d1b7790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6830068ed0 tx=0x7f6818011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98fe5c6f62d62f35 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f68257fa640 1 -- 172.21.15.170:0/1052916500 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6818004230 con 0x56163d1b2c90 2024-01-25T15:04:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f68257fa640 1 -- 172.21.15.170:0/1052916500 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6818009e10 con 0x56163d1b2c90 2024-01-25T15:04:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.224+0000 7f68257fa640 1 -- 172.21.15.170:0/1052916500 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6818004b70 con 0x56163d1b2c90 2024-01-25T15:04:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.225+0000 7f6837c23740 1 -- 172.21.15.170:0/1052916500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b2c90 msgr2=0x56163d1b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.225+0000 7f6837c23740 1 --2- 172.21.15.170:0/1052916500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b2c90 0x56163d1b7790 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6830068ed0 tx=0x7f6818011810 comp rx=0 tx=0).stop 2024-01-25T15:04:00.235 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.225+0000 7f6837c23740 1 -- 172.21.15.170:0/1052916500 shutdown_connections 2024-01-25T15:04:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.225+0000 7f6837c23740 1 --2- 172.21.15.170:0/1052916500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b2c90 0x56163d1b7790 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.225+0000 7f6837c23740 1 --2- 172.21.15.170:0/1052916500 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 0x56163d1ba290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.225+0000 7f6837c23740 1 --2- 172.21.15.170:0/1052916500 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b22a0 0x56163d1b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.225+0000 7f6837c23740 1 -- 172.21.15.170:0/1052916500 >> 172.21.15.170:0/1052916500 conn(0x56163d1ad810 msgr2=0x56163d1adc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.225+0000 7f6837c23740 1 -- 172.21.15.170:0/1052916500 shutdown_connections 2024-01-25T15:04:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.225+0000 7f6837c23740 1 -- 172.21.15.170:0/1052916500 wait complete. 2024-01-25T15:04:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.226+0000 7f6837c23740 1 -- start start 2024-01-25T15:04:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.226+0000 7f6837c23740 1 Processor -- start 2024-01-25T15:04:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.226+0000 7f6837c23740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 0x56163d1bc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.226+0000 7f6837c23740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b2c90 0x56163d1bc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.226+0000 7f6837c23740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b7e00 0x56163d1c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.226+0000 7f6837c23740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d0d41e0 con 0x56163d1b7e00 2024-01-25T15:04:00.236 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.226+0000 7f6837c23740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d0d3e80 con 0x56163d1b22a0 2024-01-25T15:04:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.226+0000 7f6837c23740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d0990c0 con 0x56163d1b2c90 2024-01-25T15:04:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.226+0000 7f6837c23740 10 client.0 _ll_register_callbacks cb 0x56163d0beac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.226+0000 7f682ed9d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 0x56163d1bc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.226+0000 7f682ed9d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 0x56163d1bc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:44774/0 (socket says 172.21.15.170:44774) 2024-01-25T15:04:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.226+0000 7f682ed9d640 1 -- 172.21.15.170:0/1392626381 learned_addr learned my addr 172.21.15.170:0/1392626381 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.226+0000 7f6827fff640 1 --2- 172.21.15.170:0/1392626381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b2c90 0x56163d1bc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.226+0000 7f682f59e640 1 --2- 172.21.15.170:0/1392626381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b7e00 0x56163d1c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.227+0000 7f682ed9d640 1 -- 172.21.15.170:0/1392626381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b2c90 msgr2=0x56163d1bc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.227+0000 7f682ed9d640 1 --2- 172.21.15.170:0/1392626381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b2c90 0x56163d1bc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.227+0000 7f682ed9d640 1 -- 172.21.15.170:0/1392626381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b7e00 msgr2=0x56163d1c36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.227+0000 7f682ed9d640 1 --2- 172.21.15.170:0/1392626381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b7e00 0x56163d1c36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.227+0000 7f682ed9d640 1 -- 172.21.15.170:0/1392626381 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6818009830 con 0x56163d1b22a0 2024-01-25T15:04:00.237 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.227+0000 7f682ed9d640 1 --2- 172.21.15.170:0/1392626381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 0x56163d1bc150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6820005c40 tx=0x7f682002bc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36a42b36cd925e3f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.227+0000 7f68167fc640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-01-25T15:04:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.227+0000 7f68167fc640 1 -- 172.21.15.170:0/1392626381 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68200bc430 con 0x56163d1b22a0 2024-01-25T15:04:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.227+0000 7f68167fc640 1 -- 172.21.15.170:0/1392626381 <== mon.2 v2:172.21.15.186:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f68200c0580 con 0x56163d1b22a0 2024-01-25T15:04:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.227+0000 7f6837c23740 1 -- 172.21.15.170:0/1392626381 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56163d114040 con 0x56163d1b22a0 2024-01-25T15:04:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.227+0000 7f68167fc640 1 -- 172.21.15.170:0/1392626381 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68200c47c0 con 0x56163d1b22a0 2024-01-25T15:04:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.227+0000 7f6837c23740 10 client.25367 fetch_fsmap learned FSMap version 39 2024-01-25T15:04:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.227+0000 7f6837c23740 1 -- 172.21.15.170:0/1392626381 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x56163d1196d0 con 0x56163d1b22a0 2024-01-25T15:04:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.227+0000 7f68167fc640 1 -- 172.21.15.170:0/1392626381 <== mon.2 v2:172.21.15.186:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56163d114040 con 0x56163d1b22a0 2024-01-25T15:04:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.228+0000 7f68167fc640 1 -- 172.21.15.170:0/1392626381 <== mon.2 v2:172.21.15.186:3300/0 5 ==== fsmap(e 39) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f68200ee070 con 0x56163d1b22a0 2024-01-25T15:04:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.228+0000 7f6837c23740 10 client.25367 fetch_fsmap finished waiting for FSMap version 39 2024-01-25T15:04:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.228+0000 7f6837c23740 10 client.25367 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:04:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.228+0000 7f6837c23740 20 client.25367 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.228+0000 7f6837c23740 1 --2- 172.21.15.170:0/1392626381 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56163d1c7ea0 0x56163d1ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.228+0000 7f6837c23740 4 client.25367 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:04:00.238 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.228+0000 7f6837c23740 1 -- 172.21.15.170:0/1392626381 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56163d113d60 con 0x56163d1c7ea0 2024-01-25T15:04:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.228+0000 7f6827fff640 1 --2- 172.21.15.170:0/1392626381 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56163d1c7ea0 0x56163d1ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.228+0000 7f68167fc640 10 client.25367 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.228+0000 7f6827fff640 1 --2- 172.21.15.170:0/1392626381 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56163d1c7ea0 0x56163d1ca2c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ba01f93ac729d3e server_cookie=5d5a3683a5fab483 in_seq=0 out_seq=0 2024-01-25T15:04:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.229+0000 7f68167fc640 1 -- 172.21.15.170:0/1392626381 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56163d113d60 con 0x56163d1c7ea0 2024-01-25T15:04:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.229+0000 7f68167fc640 10 client.25367 handle_command_reply: tid=0 2024-01-25T15:04:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.229+0000 7f6837c23740 1 client.25367 shutdown 2024-01-25T15:04:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.229+0000 7f6837c23740 1 -- 172.21.15.170:0/1392626381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 msgr2=0x56163d1bc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.229+0000 7f6837c23740 1 --2- 172.21.15.170:0/1392626381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 0x56163d1bc150 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6820005c40 tx=0x7f682002bc30 comp rx=0 tx=0).stop 2024-01-25T15:04:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.229+0000 7f6837c23740 1 -- 172.21.15.170:0/1392626381 shutdown_connections 2024-01-25T15:04:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.229+0000 7f6837c23740 1 --2- 172.21.15.170:0/1392626381 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56163d1c7ea0 0x56163d1ca2c0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.229+0000 7f6837c23740 1 --2- 172.21.15.170:0/1392626381 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b7e00 0x56163d1c36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.229+0000 7f6837c23740 1 --2- 172.21.15.170:0/1392626381 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b2c90 0x56163d1bc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.239 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.229+0000 7f68167fc640 0 client.25367 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.229+0000 7f6837c23740 1 --2- 172.21.15.170:0/1392626381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 0x56163d1bc150 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.229+0000 7f6837c23740 1 -- 172.21.15.170:0/1392626381 >> 172.21.15.170:0/1392626381 conn(0x56163d1ad810 msgr2=0x56163d1aca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.229+0000 7f6837c23740 1 -- 172.21.15.170:0/1392626381 shutdown_connections 2024-01-25T15:04:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.229+0000 7f6837c23740 1 -- 172.21.15.170:0/1392626381 wait complete. 2024-01-25T15:04:00.240 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.229+0000 7f6837c23740 20 client.25367 trim_cache size 0 max 16384 2024-01-25T15:04:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6837c23740 1 Processor -- start 2024-01-25T15:04:00.245 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6837c23740 1 -- start start 2024-01-25T15:04:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6837c23740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 0x56163d1ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6837c23740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b2c90 0x56163d1c3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6837c23740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 0x56163d1ac700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6837c23740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d114040 con 0x56163d1b2c90 2024-01-25T15:04:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6837c23740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d1bce80 con 0x56163d1b22a0 2024-01-25T15:04:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6837c23740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d1bb230 con 0x56163d1b7e00 2024-01-25T15:04:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6827fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b2c90 0x56163d1c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6827fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b2c90 0x56163d1c3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52190/0 (socket says 172.21.15.170:52190) 2024-01-25T15:04:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6827fff640 1 -- 172.21.15.170:0/331518477 learned_addr learned my addr 172.21.15.170:0/331518477 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f682ed9d640 1 --2- 172.21.15.170:0/331518477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 0x56163d1ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f682f59e640 1 --2- 172.21.15.170:0/331518477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 0x56163d1ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6827fff640 1 -- 172.21.15.170:0/331518477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 msgr2=0x56163d1ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:00.246 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6827fff640 1 --2- 172.21.15.170:0/331518477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 0x56163d1ac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6827fff640 1 -- 172.21.15.170:0/331518477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 msgr2=0x56163d1ac1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6827fff640 1 --2- 172.21.15.170:0/331518477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 0x56163d1ac1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.243+0000 7f6827fff640 1 -- 172.21.15.170:0/331518477 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56163d0b6060 con 0x56163d1b2c90 2024-01-25T15:04:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.244+0000 7f6827fff640 1 --2- 172.21.15.170:0/331518477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b2c90 0x56163d1c3660 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6818004690 tx=0x7f6818011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d7185001a1b505 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.244+0000 7f6824ff9640 1 -- 172.21.15.170:0/331518477 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6818019b00 con 0x56163d1b2c90 2024-01-25T15:04:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.244+0000 7f6824ff9640 1 -- 172.21.15.170:0/331518477 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6818019570 con 0x56163d1b2c90 2024-01-25T15:04:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.244+0000 7f6824ff9640 1 -- 172.21.15.170:0/331518477 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6818004990 con 0x56163d1b2c90 2024-01-25T15:04:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.244+0000 7f6837c23740 1 -- 172.21.15.170:0/331518477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b2c90 msgr2=0x56163d1c3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.244+0000 7f6837c23740 1 --2- 172.21.15.170:0/331518477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b2c90 0x56163d1c3660 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6818004690 tx=0x7f6818011dc0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 1 -- 172.21.15.170:0/331518477 shutdown_connections 2024-01-25T15:04:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 1 --2- 172.21.15.170:0/331518477 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 0x56163d1ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 1 --2- 172.21.15.170:0/331518477 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b2c90 0x56163d1c3660 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 1 --2- 172.21.15.170:0/331518477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 0x56163d1ac1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 1 -- 172.21.15.170:0/331518477 >> 172.21.15.170:0/331518477 conn(0x56163d1ad810 msgr2=0x56163d1b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:00.247 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 1 -- 172.21.15.170:0/331518477 shutdown_connections 2024-01-25T15:04:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 1 -- 172.21.15.170:0/331518477 wait complete. 2024-01-25T15:04:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 1 -- start start 2024-01-25T15:04:00.248 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 1 Processor -- start 2024-01-25T15:04:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 0x56163d1c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b2c90 0x56163d1c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 0x56163d1c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.250 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d1c39c0 con 0x56163d1b2c90 2024-01-25T15:04:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d21e3d0 con 0x56163d1b22a0 2024-01-25T15:04:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163d21e510 con 0x56163d1b7e00 2024-01-25T15:04:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6837c23740 10 client.0 _ll_register_callbacks cb 0x7f6818009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6827fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b2c90 0x56163d1c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f682ed9d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 0x56163d1c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f682f59e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 0x56163d1c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6827fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b2c90 0x56163d1c22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:52202/0 (socket says 172.21.15.170:52202) 2024-01-25T15:04:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.245+0000 7f6827fff640 1 -- 172.21.15.170:0/2612211302 learned_addr learned my addr 172.21.15.170:0/2612211302 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f682ed9d640 1 -- 172.21.15.170:0/2612211302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 msgr2=0x56163d1c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f682ed9d640 1 --2- 172.21.15.170:0/2612211302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 0x56163d1c27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f682ed9d640 1 -- 172.21.15.170:0/2612211302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b2c90 msgr2=0x56163d1c22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:00.251 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f682ed9d640 1 --2- 172.21.15.170:0/2612211302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b2c90 0x56163d1c22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f682ed9d640 1 -- 172.21.15.170:0/2612211302 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56163d112e70 con 0x56163d1b22a0 2024-01-25T15:04:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f682f59e640 1 --2- 172.21.15.170:0/2612211302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 0x56163d1c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f6827fff640 1 --2- 172.21.15.170:0/2612211302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b2c90 0x56163d1c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f682ed9d640 1 --2- 172.21.15.170:0/2612211302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 0x56163d1c1d70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f68200b8ea0 tx=0x7f6820003800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac2cb483a54e364f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f68167fc640 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2024-01-25T15:04:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f68167fc640 1 -- 172.21.15.170:0/2612211302 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68200bbd90 con 0x56163d1b22a0 2024-01-25T15:04:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f6837c23740 1 -- 172.21.15.170:0/2612211302 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6818009e10 con 0x56163d1b22a0 2024-01-25T15:04:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f68167fc640 1 -- 172.21.15.170:0/2612211302 <== mon.2 v2:172.21.15.186:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f68200c0580 con 0x56163d1b22a0 2024-01-25T15:04:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f68167fc640 1 -- 172.21.15.170:0/2612211302 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68200bc430 con 0x56163d1b22a0 2024-01-25T15:04:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f6837c23740 10 client.25373 fetch_fsmap learned FSMap version 39 2024-01-25T15:04:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f6837c23740 1 -- 172.21.15.170:0/2612211302 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x56163d0dba80 con 0x56163d1b22a0 2024-01-25T15:04:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f68167fc640 1 -- 172.21.15.170:0/2612211302 <== mon.2 v2:172.21.15.186:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6818009e10 con 0x56163d1b22a0 2024-01-25T15:04:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f68167fc640 1 -- 172.21.15.170:0/2612211302 <== mon.2 v2:172.21.15.186:3300/0 5 ==== fsmap(e 39) v1 ==== 7950+0+0 (secure 0 0 0) 0x7f68200ee040 con 0x56163d1b22a0 2024-01-25T15:04:00.252 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f6837c23740 10 client.25373 fetch_fsmap finished waiting for FSMap version 39 2024-01-25T15:04:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f6837c23740 10 client.25373 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:04:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f6837c23740 20 client.25373 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.246+0000 7f6837c23740 1 --2- 172.21.15.170:0/2612211302 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56163d21f9a0 0x56163d221dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.247+0000 7f6837c23740 4 client.25373 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-25T15:04:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.247+0000 7f6837c23740 1 -- 172.21.15.170:0/2612211302 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56163ce1a600 con 0x56163d21f9a0 2024-01-25T15:04:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.247+0000 7f6827fff640 1 --2- 172.21.15.170:0/2612211302 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56163d21f9a0 0x56163d221dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.247+0000 7f68167fc640 10 client.25373 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:00.253 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.247+0000 7f6827fff640 1 --2- 172.21.15.170:0/2612211302 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56163d21f9a0 0x56163d221dc0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59182e0aa08e522b server_cookie=7e6ddd80c41cd438 in_seq=0 out_seq=0 2024-01-25T15:04:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.337+0000 7f68167fc640 1 -- 172.21.15.170:0/2612211302 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56163ce1a600 con 0x56163d21f9a0 2024-01-25T15:04:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.337+0000 7f68167fc640 10 client.25373 handle_command_reply: tid=0 2024-01-25T15:04:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.337+0000 7f6837c23740 1 client.25373 shutdown 2024-01-25T15:04:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.337+0000 7f6837c23740 1 -- 172.21.15.170:0/2612211302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 msgr2=0x56163d1c1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.337+0000 7f6837c23740 1 --2- 172.21.15.170:0/2612211302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 0x56163d1c1d70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f68200b8ea0 tx=0x7f6820003800 comp rx=0 tx=0).stop 2024-01-25T15:04:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.337+0000 7f6837c23740 1 -- 172.21.15.170:0/2612211302 shutdown_connections 2024-01-25T15:04:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.337+0000 7f6837c23740 1 --2- 172.21.15.170:0/2612211302 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56163d21f9a0 0x56163d221dc0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.337+0000 7f6837c23740 1 --2- 172.21.15.170:0/2612211302 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56163d1b7e00 0x56163d1c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.337+0000 7f68167fc640 0 client.25373 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.337+0000 7f6837c23740 1 --2- 172.21.15.170:0/2612211302 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56163d1b2c90 0x56163d1c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.337+0000 7f6837c23740 1 --2- 172.21.15.170:0/2612211302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56163d1b22a0 0x56163d1c1d70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.339 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.337+0000 7f6837c23740 1 -- 172.21.15.170:0/2612211302 >> 172.21.15.170:0/2612211302 conn(0x56163d1ad810 msgr2=0x56163d1b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.338+0000 7f6837c23740 1 -- 172.21.15.170:0/2612211302 shutdown_connections 2024-01-25T15:04:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.338+0000 7f6837c23740 1 -- 172.21.15.170:0/2612211302 wait complete. 2024-01-25T15:04:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.338+0000 7f6837c23740 20 client.25373 trim_cache size 0 max 16384 2024-01-25T15:04:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:{ 2024-01-25T15:04:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "message": "", 2024-01-25T15:04:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "return_code": 0 2024-01-25T15:04:00.340 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:} 2024-01-25T15:04:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.338+0000 7f683505c640 1 -- 172.21.15.170:0/3573391774 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f681c0a1380 msgr2=0x7f681c0a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.338+0000 7f683505c640 1 --2- 172.21.15.170:0/3573391774 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f681c0a1380 0x7f681c0a3840 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6828009fd0 tx=0x7f682800fc00 comp rx=0 tx=0).stop 2024-01-25T15:04:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.338+0000 7f683505c640 1 -- 172.21.15.170:0/3573391774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6830101790 msgr2=0x7f6830101100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.338+0000 7f683505c640 1 --2- 172.21.15.170:0/3573391774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6830101790 0x7f6830101100 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6820009230 tx=0x7f6820004e50 comp rx=0 tx=0).stop 2024-01-25T15:04:00.341 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.338+0000 7f683505c640 1 -- 172.21.15.170:0/3573391774 shutdown_connections 2024-01-25T15:04:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.338+0000 7f683505c640 1 --2- 172.21.15.170:0/3573391774 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f681c0a1380 0x7f681c0a3840 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.338+0000 7f683505c640 1 --2- 172.21.15.170:0/3573391774 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f68301040c0 0x7f68300ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.338+0000 7f683505c640 1 --2- 172.21.15.170:0/3573391774 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f68301069f0 0x7f68300ffc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.338+0000 7f683505c640 1 --2- 172.21.15.170:0/3573391774 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6830101790 0x7f6830101100 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.338+0000 7f683505c640 1 -- 172.21.15.170:0/3573391774 >> 172.21.15.170:0/3573391774 conn(0x7f68300fb180 msgr2=0x7f6830102030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.339+0000 7f683505c640 1 -- 172.21.15.170:0/3573391774 shutdown_connections 2024-01-25T15:04:00.342 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:00.339+0000 7f683505c640 1 -- 172.21.15.170:0/3573391774 wait complete. 2024-01-25T15:04:00.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:00 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:04:00.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:00 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:04:00.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:00 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:04:01.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:01 smithi170 ceph-mon[31899]: pgmap v409: 97 pgs: 97 active+clean; 993 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s rd, 89 MiB/s wr, 641 op/s 2024-01-25T15:04:01.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:01 smithi191 ceph-mon[36347]: pgmap v409: 97 pgs: 97 active+clean; 993 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s rd, 89 MiB/s wr, 641 op/s 2024-01-25T15:04:01.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:01 smithi186 ceph-mon[35697]: pgmap v409: 97 pgs: 97 active+clean; 993 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s rd, 89 MiB/s wr, 641 op/s 2024-01-25T15:04:02.096 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-01-25T15:04:02.096 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-01-25T15:04:02.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:02 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:04:02.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:02 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:04:02.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:02 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:04:03.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:03 smithi170 ceph-mon[31899]: pgmap v410: 97 pgs: 97 active+clean; 743 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 MiB/s rd, 43 MiB/s wr, 391 op/s 2024-01-25T15:04:03.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:03 smithi191 ceph-mon[36347]: pgmap v410: 97 pgs: 97 active+clean; 743 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 MiB/s rd, 43 MiB/s wr, 391 op/s 2024-01-25T15:04:03.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:03 smithi186 ceph-mon[35697]: pgmap v410: 97 pgs: 97 active+clean; 743 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 MiB/s rd, 43 MiB/s wr, 391 op/s 2024-01-25T15:04:05.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:05 smithi186 ceph-mon[35697]: pgmap v411: 97 pgs: 97 active+clean; 251 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 28 MiB/s wr, 455 op/s 2024-01-25T15:04:05.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:05 smithi170 ceph-mon[31899]: pgmap v411: 97 pgs: 97 active+clean; 251 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 28 MiB/s wr, 455 op/s 2024-01-25T15:04:05.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:05 smithi191 ceph-mon[36347]: pgmap v411: 97 pgs: 97 active+clean; 251 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 MiB/s rd, 28 MiB/s wr, 455 op/s 2024-01-25T15:04:06.193 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-01-25T15:04:06.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.299+0000 7fba490ee640 1 -- 172.21.15.170:0/3890219047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba441069d0 msgr2=0x7fba44108e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.299+0000 7fba490ee640 1 --2- 172.21.15.170:0/3890219047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba441069d0 0x7fba44108e20 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009ca0 tx=0x7fba3c02c0f0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.299+0000 7fba490ee640 1 -- 172.21.15.170:0/3890219047 shutdown_connections 2024-01-25T15:04:06.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.299+0000 7fba490ee640 1 --2- 172.21.15.170:0/3890219047 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba441040a0 0x7fba44106490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.299+0000 7fba490ee640 1 --2- 172.21.15.170:0/3890219047 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba441069d0 0x7fba44108e20 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.299+0000 7fba490ee640 1 --2- 172.21.15.170:0/3890219047 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba44101770 0x7fba44103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.299+0000 7fba490ee640 1 -- 172.21.15.170:0/3890219047 >> 172.21.15.170:0/3890219047 conn(0x7fba440fb180 msgr2=0x7fba440fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.299+0000 7fba490ee640 1 -- 172.21.15.170:0/3890219047 shutdown_connections 2024-01-25T15:04:06.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.299+0000 7fba490ee640 1 -- 172.21.15.170:0/3890219047 wait complete. 2024-01-25T15:04:06.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba490ee640 1 Processor -- start 2024-01-25T15:04:06.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba490ee640 1 -- start start 2024-01-25T15:04:06.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba490ee640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba44101770 0x7fba44196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba490ee640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba441040a0 0x7fba44197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba490ee640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba441069d0 0x7fba4419e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.303 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba490ee640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4419e7e0 con 0x7fba44101770 2024-01-25T15:04:06.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba490ee640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4419e950 con 0x7fba441040a0 2024-01-25T15:04:06.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba490ee640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4419eb10 con 0x7fba441069d0 2024-01-25T15:04:06.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba42d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba44101770 0x7fba44196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba42d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba44101770 0x7fba44196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56054/0 (socket says 172.21.15.170:56054) 2024-01-25T15:04:06.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba42d9d640 1 -- 172.21.15.170:0/848833335 learned_addr learned my addr 172.21.15.170:0/848833335 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:06.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba3bfff640 1 --2- 172.21.15.170:0/848833335 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba441040a0 0x7fba44197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba4359e640 1 --2- 172.21.15.170:0/848833335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba441069d0 0x7fba4419e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba42d9d640 1 -- 172.21.15.170:0/848833335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba441069d0 msgr2=0x7fba4419e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba42d9d640 1 --2- 172.21.15.170:0/848833335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba441069d0 0x7fba4419e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba42d9d640 1 -- 172.21.15.170:0/848833335 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba441040a0 msgr2=0x7fba44197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba42d9d640 1 --2- 172.21.15.170:0/848833335 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba441040a0 0x7fba44197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.300+0000 7fba42d9d640 1 -- 172.21.15.170:0/848833335 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2c009490 con 0x7fba44101770 2024-01-25T15:04:06.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.301+0000 7fba42d9d640 1 --2- 172.21.15.170:0/848833335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba44101770 0x7fba44196d00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fba3400e9f0 tx=0x7fba3400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.304 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.301+0000 7fba40d99640 1 -- 172.21.15.170:0/848833335 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba34009720 con 0x7fba44101770 2024-01-25T15:04:06.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.301+0000 7fba490ee640 1 -- 172.21.15.170:0/848833335 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3c009900 con 0x7fba44101770 2024-01-25T15:04:06.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.301+0000 7fba40d99640 1 -- 172.21.15.170:0/848833335 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba3400cd80 con 0x7fba44101770 2024-01-25T15:04:06.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.301+0000 7fba40d99640 1 -- 172.21.15.170:0/848833335 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba34010430 con 0x7fba44101770 2024-01-25T15:04:06.305 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.301+0000 7fba490ee640 1 -- 172.21.15.170:0/848833335 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4419f120 con 0x7fba44101770 2024-01-25T15:04:06.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.303+0000 7fba40d99640 1 -- 172.21.15.170:0/848833335 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fba34005020 con 0x7fba44101770 2024-01-25T15:04:06.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.303+0000 7fba40d99640 1 --2- 172.21.15.170:0/848833335 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fba300a12e0 0x7fba300a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.303+0000 7fba3bfff640 1 --2- 172.21.15.170:0/848833335 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fba300a12e0 0x7fba300a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.303+0000 7fba40d99640 1 -- 172.21.15.170:0/848833335 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fba34014070 con 0x7fba44101770 2024-01-25T15:04:06.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba4bd94740 1 Processor -- start 2024-01-25T15:04:06.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba4bd94740 1 -- start start 2024-01-25T15:04:06.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba3bfff640 1 --2- 172.21.15.170:0/848833335 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fba300a12e0 0x7fba300a37a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fba440689b0 tx=0x7fba2c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba4bd94740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b007da50 0x55b2b007de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.312 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba4bd94740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007e440 0x55b2b0082f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba4bd94740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b00835b0 0x55b2b0085a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba4bd94740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2affec3b0 con 0x55b2b007e440 2024-01-25T15:04:06.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba4bd94740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2affe9aa0 con 0x55b2b00835b0 2024-01-25T15:04:06.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba4bd94740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2affe5390 con 0x55b2b007da50 2024-01-25T15:04:06.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba3bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007e440 0x55b2b0082f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba42d9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b007da50 0x55b2b007de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba3bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007e440 0x55b2b0082f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56062/0 (socket says 172.21.15.170:56062) 2024-01-25T15:04:06.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba42d9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b007da50 0x55b2b007de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:54970/0 (socket says 172.21.15.170:54970) 2024-01-25T15:04:06.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba3bfff640 1 -- 172.21.15.170:0/882025846 learned_addr learned my addr 172.21.15.170:0/882025846 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:06.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba4359e640 1 --2- 172.21.15.170:0/882025846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b00835b0 0x55b2b0085a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba3bfff640 1 -- 172.21.15.170:0/882025846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b007da50 msgr2=0x55b2b007de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba3bfff640 1 --2- 172.21.15.170:0/882025846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b007da50 0x55b2b007de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba3bfff640 1 -- 172.21.15.170:0/882025846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b00835b0 msgr2=0x55b2b0085a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.313 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba3bfff640 1 --2- 172.21.15.170:0/882025846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b00835b0 0x55b2b0085a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.304+0000 7fba3bfff640 1 -- 172.21.15.170:0/882025846 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2affa7810 con 0x55b2b007e440 2024-01-25T15:04:06.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.305+0000 7fba3bfff640 1 --2- 172.21.15.170:0/882025846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007e440 0x55b2b0082f40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fba2c01c460 tx=0x7fba2c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430005f6610fe66e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.305+0000 7fba397fa640 1 -- 172.21.15.170:0/882025846 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c00e670 con 0x55b2b007e440 2024-01-25T15:04:06.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.305+0000 7fba397fa640 1 -- 172.21.15.170:0/882025846 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba2c00ec90 con 0x55b2b007e440 2024-01-25T15:04:06.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.305+0000 7fba397fa640 1 -- 172.21.15.170:0/882025846 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c026b70 con 0x55b2b007e440 2024-01-25T15:04:06.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.305+0000 7fba4bd94740 1 -- 172.21.15.170:0/882025846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007e440 msgr2=0x55b2b0082f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.305+0000 7fba4bd94740 1 --2- 172.21.15.170:0/882025846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007e440 0x55b2b0082f40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fba2c01c460 tx=0x7fba2c014000 comp rx=0 tx=0).stop 2024-01-25T15:04:06.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 1 -- 172.21.15.170:0/882025846 shutdown_connections 2024-01-25T15:04:06.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 1 --2- 172.21.15.170:0/882025846 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b00835b0 0x55b2b0085a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 1 --2- 172.21.15.170:0/882025846 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007e440 0x55b2b0082f40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 1 --2- 172.21.15.170:0/882025846 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b007da50 0x55b2b007de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 1 -- 172.21.15.170:0/882025846 >> 172.21.15.170:0/882025846 conn(0x55b2b0078fc0 msgr2=0x55b2b00793c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 1 -- 172.21.15.170:0/882025846 shutdown_connections 2024-01-25T15:04:06.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 1 -- 172.21.15.170:0/882025846 wait complete. 2024-01-25T15:04:06.314 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 1 -- start start 2024-01-25T15:04:06.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 1 Processor -- start 2024-01-25T15:04:06.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007da50 0x55b2b0087c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b007e440 0x55b2b0088150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b00835b0 0x55b2b008f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2aff9e780 con 0x55b2b007da50 2024-01-25T15:04:06.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2aff9e420 con 0x55b2b007e440 2024-01-25T15:04:06.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2aff63420 con 0x55b2b00835b0 2024-01-25T15:04:06.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4bd94740 10 client.0 _ll_register_callbacks cb 0x55b2affa0b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:06.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba42d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007da50 0x55b2b0087c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba3bfff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b007e440 0x55b2b0088150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba42d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007da50 0x55b2b0087c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56066/0 (socket says 172.21.15.170:56066) 2024-01-25T15:04:06.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba42d9d640 1 -- 172.21.15.170:0/3855960300 learned_addr learned my addr 172.21.15.170:0/3855960300 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:06.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.306+0000 7fba4359e640 1 --2- 172.21.15.170:0/3855960300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b00835b0 0x55b2b008f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.315 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.307+0000 7fba42d9d640 1 -- 172.21.15.170:0/3855960300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b00835b0 msgr2=0x55b2b008f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.307+0000 7fba42d9d640 1 --2- 172.21.15.170:0/3855960300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b00835b0 0x55b2b008f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.307+0000 7fba42d9d640 1 -- 172.21.15.170:0/3855960300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b007e440 msgr2=0x55b2b0088150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.307+0000 7fba42d9d640 1 --2- 172.21.15.170:0/3855960300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b007e440 0x55b2b0088150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.307+0000 7fba42d9d640 1 -- 172.21.15.170:0/3855960300 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2c017050 con 0x55b2b007da50 2024-01-25T15:04:06.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.307+0000 7fba42d9d640 1 --2- 172.21.15.170:0/3855960300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007da50 0x55b2b0087c10 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fba34096a60 tx=0x7fba34098320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3ed5ca71922350 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.307+0000 7fba2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:06.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.308+0000 7fba2a7fc640 1 -- 172.21.15.170:0/3855960300 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3409e1d0 con 0x55b2b007da50 2024-01-25T15:04:06.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.308+0000 7fba2a7fc640 1 -- 172.21.15.170:0/3855960300 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fba340a2410 con 0x55b2b007da50 2024-01-25T15:04:06.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.308+0000 7fba4bd94740 1 -- 172.21.15.170:0/3855960300 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2affba240 con 0x55b2b007da50 2024-01-25T15:04:06.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.308+0000 7fba2a7fc640 1 -- 172.21.15.170:0/3855960300 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba340052d0 con 0x55b2b007da50 2024-01-25T15:04:06.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.308+0000 7fba4bd94740 10 client.16101 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:06.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.308+0000 7fba4bd94740 1 -- 172.21.15.170:0/3855960300 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55b2affe3a10 con 0x55b2b007da50 2024-01-25T15:04:06.316 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.309+0000 7fba2a7fc640 1 -- 172.21.15.170:0/3855960300 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b2affba240 con 0x55b2b007da50 2024-01-25T15:04:06.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.309+0000 7fba2a7fc640 1 -- 172.21.15.170:0/3855960300 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fba3401f060 con 0x55b2b007da50 2024-01-25T15:04:06.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.309+0000 7fba4bd94740 10 client.16101 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:06.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.309+0000 7fba4bd94740 10 client.16101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:04:06.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.309+0000 7fba4bd94740 20 client.16101 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:06.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.309+0000 7fba4bd94740 1 --2- 172.21.15.170:0/3855960300 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2b0093ec0 0x55b2b00962e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.309+0000 7fba4bd94740 4 client.16101 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:04:06.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.309+0000 7fba4bd94740 1 -- 172.21.15.170:0/3855960300 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2affb7b50 con 0x55b2b0093ec0 2024-01-25T15:04:06.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.309+0000 7fba3bfff640 1 --2- 172.21.15.170:0/3855960300 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2b0093ec0 0x55b2b00962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.309+0000 7fba2a7fc640 10 client.16101 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:06.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.309+0000 7fba3bfff640 1 --2- 172.21.15.170:0/3855960300 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2b0093ec0 0x55b2b00962e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef95718c3a513e5b server_cookie=847d7062fcc77910 in_seq=0 out_seq=0 2024-01-25T15:04:06.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.310+0000 7fba2a7fc640 1 -- 172.21.15.170:0/3855960300 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b2affb7b50 con 0x55b2b0093ec0 2024-01-25T15:04:06.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.310+0000 7fba2a7fc640 10 client.16101 handle_command_reply: tid=0 2024-01-25T15:04:06.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.310+0000 7fba4bd94740 1 client.16101 shutdown 2024-01-25T15:04:06.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.311+0000 7fba4bd94740 1 -- 172.21.15.170:0/3855960300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007da50 msgr2=0x55b2b0087c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.317 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.311+0000 7fba4bd94740 1 --2- 172.21.15.170:0/3855960300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007da50 0x55b2b0087c10 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fba34096a60 tx=0x7fba34098320 comp rx=0 tx=0).stop 2024-01-25T15:04:06.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.311+0000 7fba4bd94740 1 -- 172.21.15.170:0/3855960300 shutdown_connections 2024-01-25T15:04:06.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.311+0000 7fba4bd94740 1 --2- 172.21.15.170:0/3855960300 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2b0093ec0 0x55b2b00962e0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.311+0000 7fba4bd94740 1 --2- 172.21.15.170:0/3855960300 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b007e440 0x55b2b0088150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.311+0000 7fba4bd94740 1 --2- 172.21.15.170:0/3855960300 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b00835b0 0x55b2b008f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.311+0000 7fba2a7fc640 0 client.16101 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:06.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.311+0000 7fba4bd94740 1 --2- 172.21.15.170:0/3855960300 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007da50 0x55b2b0087c10 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.311+0000 7fba4bd94740 1 -- 172.21.15.170:0/3855960300 >> 172.21.15.170:0/3855960300 conn(0x55b2b0078fc0 msgr2=0x55b2b0078240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.311+0000 7fba4bd94740 1 -- 172.21.15.170:0/3855960300 shutdown_connections 2024-01-25T15:04:06.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.311+0000 7fba4bd94740 1 -- 172.21.15.170:0/3855960300 wait complete. 2024-01-25T15:04:06.318 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.311+0000 7fba4bd94740 20 client.16101 trim_cache size 0 max 16384 2024-01-25T15:04:06.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.326+0000 7fba4bd94740 1 Processor -- start 2024-01-25T15:04:06.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.326+0000 7fba4bd94740 1 -- start start 2024-01-25T15:04:06.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.326+0000 7fba4bd94740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b007da50 0x55b2b0087820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.326+0000 7fba4bd94740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007e440 0x55b2b008f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.326+0000 7fba4bd94740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b00835b0 0x55b2b0087d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.326+0000 7fba4bd94740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2affba240 con 0x55b2b007e440 2024-01-25T15:04:06.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.326+0000 7fba4bd94740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b0074a20 con 0x55b2b00835b0 2024-01-25T15:04:06.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.326+0000 7fba4bd94740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b007d610 con 0x55b2b007da50 2024-01-25T15:04:06.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.326+0000 7fba3bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007e440 0x55b2b008f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.326+0000 7fba3bfff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007e440 0x55b2b008f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56072/0 (socket says 172.21.15.170:56072) 2024-01-25T15:04:06.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.326+0000 7fba3bfff640 1 -- 172.21.15.170:0/1152049342 learned_addr learned my addr 172.21.15.170:0/1152049342 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:06.328 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.326+0000 7fba42d9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b007da50 0x55b2b0087820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.327+0000 7fba4359e640 1 --2- 172.21.15.170:0/1152049342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b00835b0 0x55b2b0087d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.327+0000 7fba3bfff640 1 -- 172.21.15.170:0/1152049342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b007da50 msgr2=0x55b2b0087820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.327+0000 7fba3bfff640 1 --2- 172.21.15.170:0/1152049342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b007da50 0x55b2b0087820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.327+0000 7fba3bfff640 1 -- 172.21.15.170:0/1152049342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b00835b0 msgr2=0x55b2b0087d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.327+0000 7fba3bfff640 1 --2- 172.21.15.170:0/1152049342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b00835b0 0x55b2b0087d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.327+0000 7fba3bfff640 1 -- 172.21.15.170:0/1152049342 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2aff80520 con 0x55b2b007e440 2024-01-25T15:04:06.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.327+0000 7fba3bfff640 1 --2- 172.21.15.170:0/1152049342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007e440 0x55b2b008f120 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fba2c01e010 tx=0x7fba2c009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b755260111124888 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.327+0000 7fba38ff9640 1 -- 172.21.15.170:0/1152049342 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c026700 con 0x55b2b007e440 2024-01-25T15:04:06.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.327+0000 7fba38ff9640 1 -- 172.21.15.170:0/1152049342 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba2c026e90 con 0x55b2b007e440 2024-01-25T15:04:06.329 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.327+0000 7fba38ff9640 1 -- 172.21.15.170:0/1152049342 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c036100 con 0x55b2b007e440 2024-01-25T15:04:06.333 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 -- 172.21.15.170:0/1152049342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007e440 msgr2=0x55b2b008f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 --2- 172.21.15.170:0/1152049342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007e440 0x55b2b008f120 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fba2c01e010 tx=0x7fba2c009370 comp rx=0 tx=0).stop 2024-01-25T15:04:06.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 -- 172.21.15.170:0/1152049342 shutdown_connections 2024-01-25T15:04:06.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 --2- 172.21.15.170:0/1152049342 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b00835b0 0x55b2b0087d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 --2- 172.21.15.170:0/1152049342 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007e440 0x55b2b008f120 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 --2- 172.21.15.170:0/1152049342 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b007da50 0x55b2b0087820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 -- 172.21.15.170:0/1152049342 >> 172.21.15.170:0/1152049342 conn(0x55b2b0078fc0 msgr2=0x55b2b007f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 -- 172.21.15.170:0/1152049342 shutdown_connections 2024-01-25T15:04:06.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 -- 172.21.15.170:0/1152049342 wait complete. 2024-01-25T15:04:06.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 -- start start 2024-01-25T15:04:06.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 Processor -- start 2024-01-25T15:04:06.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007da50 0x55b2b008dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b007e440 0x55b2b008e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b00835b0 0x55b2b00ea3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.334 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b008ea00 con 0x55b2b007da50 2024-01-25T15:04:06.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b008eb70 con 0x55b2b007e440 2024-01-25T15:04:06.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2b00ea980 con 0x55b2b00835b0 2024-01-25T15:04:06.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4bd94740 10 client.0 _ll_register_callbacks cb 0x7fba34099f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:06.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba42d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007da50 0x55b2b008dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba42d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007da50 0x55b2b008dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56084/0 (socket says 172.21.15.170:56084) 2024-01-25T15:04:06.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba42d9d640 1 -- 172.21.15.170:0/2055676090 learned_addr learned my addr 172.21.15.170:0/2055676090 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:06.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba3bfff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b007e440 0x55b2b008e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.328+0000 7fba4359e640 1 --2- 172.21.15.170:0/2055676090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b00835b0 0x55b2b00ea3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba42d9d640 1 -- 172.21.15.170:0/2055676090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b00835b0 msgr2=0x55b2b00ea3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba42d9d640 1 --2- 172.21.15.170:0/2055676090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b00835b0 0x55b2b00ea3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba42d9d640 1 -- 172.21.15.170:0/2055676090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b007e440 msgr2=0x55b2b008e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba42d9d640 1 --2- 172.21.15.170:0/2055676090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b007e440 0x55b2b008e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba42d9d640 1 -- 172.21.15.170:0/2055676090 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b2affa7810 con 0x55b2b007da50 2024-01-25T15:04:06.335 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba3bfff640 1 --2- 172.21.15.170:0/2055676090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b007e440 0x55b2b008e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:06.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba42d9d640 1 --2- 172.21.15.170:0/2055676090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007da50 0x55b2b008dcd0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fba34096a10 tx=0x7fba34096460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da61d361af75b0d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:06.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba2a7fc640 1 -- 172.21.15.170:0/2055676090 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba34096190 con 0x55b2b007da50 2024-01-25T15:04:06.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba2a7fc640 1 -- 172.21.15.170:0/2055676090 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fba340a21e0 con 0x55b2b007da50 2024-01-25T15:04:06.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba4bd94740 1 -- 172.21.15.170:0/2055676090 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2b000cc00 con 0x55b2b007da50 2024-01-25T15:04:06.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba2a7fc640 1 -- 172.21.15.170:0/2055676090 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba340a2020 con 0x55b2b007da50 2024-01-25T15:04:06.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba4bd94740 10 client.16107 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:06.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba4bd94740 1 -- 172.21.15.170:0/2055676090 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55b2affa6070 con 0x55b2b007da50 2024-01-25T15:04:06.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba2a7fc640 1 -- 172.21.15.170:0/2055676090 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b2b000cc00 con 0x55b2b007da50 2024-01-25T15:04:06.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba2a7fc640 1 -- 172.21.15.170:0/2055676090 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fba3401f070 con 0x55b2b007da50 2024-01-25T15:04:06.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba4bd94740 10 client.16107 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:06.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba4bd94740 10 client.16107 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:04:06.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba4bd94740 20 client.16107 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:06.336 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba4bd94740 1 --2- 172.21.15.170:0/2055676090 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2b00ec040 0x55b2b00ee460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba4bd94740 4 client.16107 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-01-25T15:04:06.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.329+0000 7fba4bd94740 1 -- 172.21.15.170:0/2055676090 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b2affde220 con 0x55b2b00ec040 2024-01-25T15:04:06.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.330+0000 7fba3bfff640 1 --2- 172.21.15.170:0/2055676090 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2b00ec040 0x55b2b00ee460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.330+0000 7fba2a7fc640 10 client.16107 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:06.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.330+0000 7fba3bfff640 1 --2- 172.21.15.170:0/2055676090 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2b00ec040 0x55b2b00ee460 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51c02825761825cb server_cookie=433ad76d8b4099b6 in_seq=0 out_seq=0 2024-01-25T15:04:06.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.331+0000 7fba2a7fc640 1 -- 172.21.15.170:0/2055676090 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b2affde220 con 0x55b2b00ec040 2024-01-25T15:04:06.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.331+0000 7fba2a7fc640 10 client.16107 handle_command_reply: tid=0 2024-01-25T15:04:06.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.331+0000 7fba4bd94740 1 client.16107 shutdown 2024-01-25T15:04:06.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.331+0000 7fba4bd94740 1 -- 172.21.15.170:0/2055676090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007da50 msgr2=0x55b2b008dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.331+0000 7fba4bd94740 1 --2- 172.21.15.170:0/2055676090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007da50 0x55b2b008dcd0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fba34096a10 tx=0x7fba34096460 comp rx=0 tx=0).stop 2024-01-25T15:04:06.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.331+0000 7fba4bd94740 1 -- 172.21.15.170:0/2055676090 shutdown_connections 2024-01-25T15:04:06.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.331+0000 7fba4bd94740 1 --2- 172.21.15.170:0/2055676090 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2b00ec040 0x55b2b00ee460 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.331+0000 7fba4bd94740 1 --2- 172.21.15.170:0/2055676090 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2b007e440 0x55b2b008e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.331+0000 7fba2a7fc640 0 client.16107 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:06.337 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.331+0000 7fba4bd94740 1 --2- 172.21.15.170:0/2055676090 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2b00835b0 0x55b2b00ea3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.331+0000 7fba4bd94740 1 --2- 172.21.15.170:0/2055676090 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2b007da50 0x55b2b008dcd0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.331+0000 7fba4bd94740 1 -- 172.21.15.170:0/2055676090 >> 172.21.15.170:0/2055676090 conn(0x55b2b0078fc0 msgr2=0x55b2b0087820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.331+0000 7fba4bd94740 1 -- 172.21.15.170:0/2055676090 shutdown_connections 2024-01-25T15:04:06.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.331+0000 7fba4bd94740 1 -- 172.21.15.170:0/2055676090 wait complete. 2024-01-25T15:04:06.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.332+0000 7fba4bd94740 20 client.16107 trim_cache size 0 max 16384 2024-01-25T15:04:06.338 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:04:06.338 INFO:teuthology.orchestra.run.smithi170.stdout: "status": "no active scrubs running", 2024-01-25T15:04:06.338 INFO:teuthology.orchestra.run.smithi170.stdout: "scrubs": {} 2024-01-25T15:04:06.338 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:04:06.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.332+0000 7fba490ee640 1 -- 172.21.15.170:0/848833335 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fba300a12e0 msgr2=0x7fba300a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.332+0000 7fba490ee640 1 --2- 172.21.15.170:0/848833335 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fba300a12e0 0x7fba300a37a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fba440689b0 tx=0x7fba2c005f90 comp rx=0 tx=0).stop 2024-01-25T15:04:06.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.332+0000 7fba490ee640 1 -- 172.21.15.170:0/848833335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba44101770 msgr2=0x7fba44196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.332+0000 7fba490ee640 1 --2- 172.21.15.170:0/848833335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba44101770 0x7fba44196d00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fba3400e9f0 tx=0x7fba3400edf0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.332+0000 7fba490ee640 1 -- 172.21.15.170:0/848833335 shutdown_connections 2024-01-25T15:04:06.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.332+0000 7fba490ee640 1 --2- 172.21.15.170:0/848833335 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fba300a12e0 0x7fba300a37a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.332+0000 7fba490ee640 1 --2- 172.21.15.170:0/848833335 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba441040a0 0x7fba44197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.332+0000 7fba490ee640 1 --2- 172.21.15.170:0/848833335 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fba441069d0 0x7fba4419e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.332+0000 7fba490ee640 1 --2- 172.21.15.170:0/848833335 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fba44101770 0x7fba44196d00 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.332+0000 7fba490ee640 1 -- 172.21.15.170:0/848833335 >> 172.21.15.170:0/848833335 conn(0x7fba440fb180 msgr2=0x7fba441020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.332+0000 7fba490ee640 1 -- 172.21.15.170:0/848833335 shutdown_connections 2024-01-25T15:04:06.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.332+0000 7fba490ee640 1 -- 172.21.15.170:0/848833335 wait complete. 2024-01-25T15:04:06.344 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-01-25T15:04:06.345 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:04:06.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.449+0000 7ffb624d5640 1 -- 172.21.15.170:0/3035143135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c100e00 msgr2=0x7ffb5c101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.449+0000 7ffb624d5640 1 --2- 172.21.15.170:0/3035143135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c100e00 0x7ffb5c101280 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c009900 tx=0x7ffb4c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:04:06.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.449+0000 7ffb624d5640 1 -- 172.21.15.170:0/3035143135 shutdown_connections 2024-01-25T15:04:06.452 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.449+0000 7ffb624d5640 1 --2- 172.21.15.170:0/3035143135 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb5c1017c0 0x7ffb5c108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.449+0000 7ffb624d5640 1 --2- 172.21.15.170:0/3035143135 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c100e00 0x7ffb5c101280 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.449+0000 7ffb624d5640 1 --2- 172.21.15.170:0/3035143135 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c0ffc10 0x7ffb5c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.449+0000 7ffb624d5640 1 -- 172.21.15.170:0/3035143135 >> 172.21.15.170:0/3035143135 conn(0x7ffb5c0fb180 msgr2=0x7ffb5c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.450+0000 7ffb624d5640 1 -- 172.21.15.170:0/3035143135 shutdown_connections 2024-01-25T15:04:06.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.450+0000 7ffb624d5640 1 -- 172.21.15.170:0/3035143135 wait complete. 2024-01-25T15:04:06.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.450+0000 7ffb624d5640 1 Processor -- start 2024-01-25T15:04:06.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.450+0000 7ffb624d5640 1 -- start start 2024-01-25T15:04:06.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.450+0000 7ffb624d5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c0ffc10 0x7ffb5c196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.450+0000 7ffb624d5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb5c100e00 0x7ffb5c197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.450+0000 7ffb624d5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c1017c0 0x7ffb5c19e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.450+0000 7ffb624d5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c19e7f0 con 0x7ffb5c1017c0 2024-01-25T15:04:06.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.450+0000 7ffb624d5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c19e960 con 0x7ffb5c100e00 2024-01-25T15:04:06.453 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.450+0000 7ffb624d5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c19eb20 con 0x7ffb5c0ffc10 2024-01-25T15:04:06.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.450+0000 7ffb60a72640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c1017c0 0x7ffb5c19e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb60a72640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c1017c0 0x7ffb5c19e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56092/0 (socket says 172.21.15.170:56092) 2024-01-25T15:04:06.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb5bfff640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c0ffc10 0x7ffb5c196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb60a72640 1 -- 172.21.15.170:0/3975515627 learned_addr learned my addr 172.21.15.170:0/3975515627 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:06.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb5b7fe640 1 --2- 172.21.15.170:0/3975515627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb5c100e00 0x7ffb5c197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb60a72640 1 -- 172.21.15.170:0/3975515627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c0ffc10 msgr2=0x7ffb5c196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb60a72640 1 --2- 172.21.15.170:0/3975515627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c0ffc10 0x7ffb5c196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb60a72640 1 -- 172.21.15.170:0/3975515627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb5c100e00 msgr2=0x7ffb5c197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb60a72640 1 --2- 172.21.15.170:0/3975515627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb5c100e00 0x7ffb5c197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb60a72640 1 -- 172.21.15.170:0/3975515627 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb54009840 con 0x7ffb5c1017c0 2024-01-25T15:04:06.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb5bfff640 1 --2- 172.21.15.170:0/3975515627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c0ffc10 0x7ffb5c196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:06.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb5b7fe640 1 --2- 172.21.15.170:0/3975515627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb5c100e00 0x7ffb5c197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:06.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb60a72640 1 --2- 172.21.15.170:0/3975515627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c1017c0 0x7ffb5c19e280 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400efd0 tx=0x7ffb5400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.454 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb597fa640 1 -- 172.21.15.170:0/3975515627 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb54009b40 con 0x7ffb5c1017c0 2024-01-25T15:04:06.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb597fa640 1 -- 172.21.15.170:0/3975515627 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb54003b70 con 0x7ffb5c1017c0 2024-01-25T15:04:06.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb597fa640 1 -- 172.21.15.170:0/3975515627 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb54010850 con 0x7ffb5c1017c0 2024-01-25T15:04:06.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb624d5640 1 -- 172.21.15.170:0/3975515627 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4c009560 con 0x7ffb5c1017c0 2024-01-25T15:04:06.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.451+0000 7ffb624d5640 1 -- 172.21.15.170:0/3975515627 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5c19f130 con 0x7ffb5c1017c0 2024-01-25T15:04:06.455 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.452+0000 7ffb624d5640 1 -- 172.21.15.170:0/3975515627 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5c106fa0 con 0x7ffb5c1017c0 2024-01-25T15:04:06.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.453+0000 7ffb597fa640 1 -- 172.21.15.170:0/3975515627 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7ffb540109d0 con 0x7ffb5c1017c0 2024-01-25T15:04:06.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.454+0000 7ffb597fa640 1 --2- 172.21.15.170:0/3975515627 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ffb440a12e0 0x7ffb440a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.454+0000 7ffb597fa640 1 -- 172.21.15.170:0/3975515627 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7ffb54014070 con 0x7ffb5c1017c0 2024-01-25T15:04:06.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.454+0000 7ffb5bfff640 1 --2- 172.21.15.170:0/3975515627 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ffb440a12e0 0x7ffb440a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.456 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.454+0000 7ffb5bfff640 1 --2- 172.21.15.170:0/3975515627 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ffb440a12e0 0x7ffb440a37a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c1981e0 tx=0x7ffb50005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.459 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.458+0000 7ffb597fa640 1 -- 172.21.15.170:0/3975515627 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ffb540d3080 con 0x7ffb5c1017c0 2024-01-25T15:04:06.715 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.715+0000 7ffb624d5640 1 -- 172.21.15.170:0/3975515627 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb5c10c600 con 0x7ffb5c1017c0 2024-01-25T15:04:06.716 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.715+0000 7ffb597fa640 1 -- 172.21.15.170:0/3975515627 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+11444 (secure 0 0 0) 0x7ffb5c10c600 con 0x7ffb5c1017c0 2024-01-25T15:04:06.716 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:04:06.716 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-25T14:59:53.534085+0000","modified":"2024-01-25T15:04:01.073594+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24484,"mds_1":24479,"mds_2":24466,"mds_3":24418,"mds_4":24398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":4,"incarnation":23,"state":"up:active","state_seq":67,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":21,"state":"up:active","state_seq":67,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":19,"state":"up:active","state_seq":63,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24479":{"gid":24479,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":59,"addr":"172.21.15.186:6839/2132502182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":2132502182},{"type":"v1","addr":"172.21.15.186:6839","nonce":2132502182}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:04:06.717 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 40 2024-01-25T15:04:06.718 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.718+0000 7ffb624d5640 1 -- 172.21.15.170:0/3975515627 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ffb440a12e0 msgr2=0x7ffb440a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.718+0000 7ffb624d5640 1 --2- 172.21.15.170:0/3975515627 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ffb440a12e0 0x7ffb440a37a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c1981e0 tx=0x7ffb50005f90 comp rx=0 tx=0).stop 2024-01-25T15:04:06.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.718+0000 7ffb624d5640 1 -- 172.21.15.170:0/3975515627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c1017c0 msgr2=0x7ffb5c19e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.718+0000 7ffb624d5640 1 --2- 172.21.15.170:0/3975515627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c1017c0 0x7ffb5c19e280 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ffb5400efd0 tx=0x7ffb5400c6a0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.718+0000 7ffb624d5640 1 -- 172.21.15.170:0/3975515627 shutdown_connections 2024-01-25T15:04:06.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.718+0000 7ffb624d5640 1 --2- 172.21.15.170:0/3975515627 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ffb440a12e0 0x7ffb440a37a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.718+0000 7ffb624d5640 1 --2- 172.21.15.170:0/3975515627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb5c100e00 0x7ffb5c197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.718+0000 7ffb624d5640 1 --2- 172.21.15.170:0/3975515627 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ffb5c1017c0 0x7ffb5c19e280 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.718+0000 7ffb624d5640 1 --2- 172.21.15.170:0/3975515627 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ffb5c0ffc10 0x7ffb5c196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.718+0000 7ffb624d5640 1 -- 172.21.15.170:0/3975515627 >> 172.21.15.170:0/3975515627 conn(0x7ffb5c0fb180 msgr2=0x7ffb5c104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.718+0000 7ffb624d5640 1 -- 172.21.15.170:0/3975515627 shutdown_connections 2024-01-25T15:04:06.719 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.718+0000 7ffb624d5640 1 -- 172.21.15.170:0/3975515627 wait complete. 2024-01-25T15:04:06.730 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2024-01-25T15:04:06.835 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.834+0000 7f3bbd105640 1 -- 172.21.15.170:0/567129382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bb81069f0 msgr2=0x7f3bb8108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.834+0000 7f3bbd105640 1 --2- 172.21.15.170:0/567129382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bb81069f0 0x7f3bb8108e40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009ca0 tx=0x7f3bb002c0f0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.834+0000 7f3bbd105640 1 -- 172.21.15.170:0/567129382 shutdown_connections 2024-01-25T15:04:06.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.834+0000 7f3bbd105640 1 --2- 172.21.15.170:0/567129382 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bb81069f0 0x7f3bb8108e40 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.834+0000 7f3bbd105640 1 --2- 172.21.15.170:0/567129382 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb81040c0 0x7f3bb81064b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.834+0000 7f3bbd105640 1 --2- 172.21.15.170:0/567129382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bb8101790 0x7f3bb8103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.834+0000 7f3bbd105640 1 -- 172.21.15.170:0/567129382 >> 172.21.15.170:0/567129382 conn(0x7f3bb80fb180 msgr2=0x7f3bb80fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.834+0000 7f3bbd105640 1 -- 172.21.15.170:0/567129382 shutdown_connections 2024-01-25T15:04:06.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.834+0000 7f3bbd105640 1 -- 172.21.15.170:0/567129382 wait complete. 2024-01-25T15:04:06.836 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.835+0000 7f3bbd105640 1 Processor -- start 2024-01-25T15:04:06.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.835+0000 7f3bbd105640 1 -- start start 2024-01-25T15:04:06.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.835+0000 7f3bbd105640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb8101790 0x7f3bb8196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.835+0000 7f3bbd105640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bb81040c0 0x7f3bb8197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.835+0000 7f3bbd105640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bb81069f0 0x7f3bb819e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.835+0000 7f3bbd105640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb819e7f0 con 0x7f3bb81069f0 2024-01-25T15:04:06.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.835+0000 7f3bbd105640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb819e960 con 0x7f3bb81040c0 2024-01-25T15:04:06.838 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.835+0000 7f3bbd105640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb819eb20 con 0x7f3bb8101790 2024-01-25T15:04:06.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3bb759e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bb81069f0 0x7f3bb819e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3bb759e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bb81069f0 0x7f3bb819e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56114/0 (socket says 172.21.15.170:56114) 2024-01-25T15:04:06.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3bb759e640 1 -- 172.21.15.170:0/4034580929 learned_addr learned my addr 172.21.15.170:0/4034580929 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:06.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3bb6d9d640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb8101790 0x7f3bb8196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3bb659c640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bb81040c0 0x7f3bb8197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3bb759e640 1 -- 172.21.15.170:0/4034580929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb8101790 msgr2=0x7f3bb8196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3bb759e640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb8101790 0x7f3bb8196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3bb759e640 1 -- 172.21.15.170:0/4034580929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bb81040c0 msgr2=0x7f3bb8197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3bb759e640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bb81040c0 0x7f3bb8197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3bb759e640 1 -- 172.21.15.170:0/4034580929 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb0009900 con 0x7f3bb81069f0 2024-01-25T15:04:06.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3bb6d9d640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb8101790 0x7f3bb8196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:06.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3bb659c640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bb81040c0 0x7f3bb8197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:06.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3bb759e640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bb81069f0 0x7f3bb819e280 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0005cc0 tx=0x7f3bb00329c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3b9ffff640 1 -- 172.21.15.170:0/4034580929 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0034e80 con 0x7f3bb81069f0 2024-01-25T15:04:06.839 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3bbd105640 1 -- 172.21.15.170:0/4034580929 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb819eda0 con 0x7f3bb81069f0 2024-01-25T15:04:06.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3b9ffff640 1 -- 172.21.15.170:0/4034580929 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bb0032e90 con 0x7f3bb81069f0 2024-01-25T15:04:06.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3b9ffff640 1 -- 172.21.15.170:0/4034580929 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb00047a0 con 0x7f3bb81069f0 2024-01-25T15:04:06.840 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.836+0000 7f3bbd105640 1 -- 172.21.15.170:0/4034580929 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb819f1c0 con 0x7f3bb81069f0 2024-01-25T15:04:06.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.838+0000 7f3b9ffff640 1 -- 172.21.15.170:0/4034580929 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f3bb003b040 con 0x7f3bb81069f0 2024-01-25T15:04:06.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.838+0000 7f3bbfda6740 1 Processor -- start 2024-01-25T15:04:06.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bbfda6740 1 -- start start 2024-01-25T15:04:06.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bbfda6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c3f40 0x5564bc5c4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bbfda6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c4930 0x5564bc5c9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bbfda6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bbfda6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564bc532270 con 0x5564bc5c9aa0 2024-01-25T15:04:06.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bbfda6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564bc52f960 con 0x5564bc5c3f40 2024-01-25T15:04:06.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bbfda6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564bc52b250 con 0x5564bc5c4930 2024-01-25T15:04:06.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bb6d9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c4930 0x5564bc5c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bb659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bb6d9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c4930 0x5564bc5c9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:55058/0 (socket says 172.21.15.170:55058) 2024-01-25T15:04:06.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3b9ffff640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3ba00a12e0 0x7f3ba00a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bb6d9d640 1 -- 172.21.15.170:0/1563550081 learned_addr learned my addr 172.21.15.170:0/1563550081 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:06.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bb659c640 1 --2- 172.21.15.170:0/1563550081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c3f40 0x5564bc5c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bb759e640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3ba00a12e0 0x7f3ba00a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bb6d9d640 1 -- 172.21.15.170:0/1563550081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c3f40 msgr2=0x5564bc5c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bb6d9d640 1 --2- 172.21.15.170:0/1563550081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c3f40 0x5564bc5c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bb6d9d640 1 -- 172.21.15.170:0/1563550081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 msgr2=0x5564bc5cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bb6d9d640 1 --2- 172.21.15.170:0/1563550081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bb6d9d640 1 -- 172.21.15.170:0/1563550081 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564bc4ed7f0 con 0x5564bc5c4930 2024-01-25T15:04:06.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3b9ffff640 1 -- 172.21.15.170:0/4034580929 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f3bb00ef270 con 0x7f3bb81069f0 2024-01-25T15:04:06.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.839+0000 7f3bb6d9d640 1 --2- 172.21.15.170:0/1563550081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c4930 0x5564bc5c9430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80104d0 tx=0x7f3ba8010990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2fa7cb2ca3b1e0e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.840+0000 7f3b9d7fa640 1 -- 172.21.15.170:0/1563550081 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8004220 con 0x5564bc5c4930 2024-01-25T15:04:06.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.840+0000 7f3bb759e640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3ba00a12e0 0x7f3ba00a37a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00bc370 tx=0x7f3bb008b9f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.840+0000 7f3b9d7fa640 1 -- 172.21.15.170:0/1563550081 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ba8015070 con 0x5564bc5c4930 2024-01-25T15:04:06.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.840+0000 7f3b9d7fa640 1 -- 172.21.15.170:0/1563550081 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8011960 con 0x5564bc5c4930 2024-01-25T15:04:06.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.840+0000 7f3bbfda6740 1 -- 172.21.15.170:0/1563550081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c4930 msgr2=0x5564bc5c9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.840+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/1563550081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c4930 0x5564bc5c9430 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3ba80104d0 tx=0x7f3ba8010990 comp rx=0 tx=0).stop 2024-01-25T15:04:06.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.840+0000 7f3bbfda6740 1 -- 172.21.15.170:0/1563550081 shutdown_connections 2024-01-25T15:04:06.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.840+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/1563550081 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.840+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/1563550081 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c4930 0x5564bc5c9430 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.840+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/1563550081 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c3f40 0x5564bc5c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.840+0000 7f3bbfda6740 1 -- 172.21.15.170:0/1563550081 >> 172.21.15.170:0/1563550081 conn(0x5564bc5bf4b0 msgr2=0x5564bc5bf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.840+0000 7f3bbfda6740 1 -- 172.21.15.170:0/1563550081 shutdown_connections 2024-01-25T15:04:06.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.840+0000 7f3bbfda6740 1 -- 172.21.15.170:0/1563550081 wait complete. 2024-01-25T15:04:06.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bbfda6740 1 -- start start 2024-01-25T15:04:06.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bbfda6740 1 Processor -- start 2024-01-25T15:04:06.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bbfda6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c3f40 0x5564bc5ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bbfda6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c4930 0x5564bc5ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bbfda6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bbfda6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564bc4e4610 con 0x5564bc5c9aa0 2024-01-25T15:04:06.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bbfda6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564bc4e42b0 con 0x5564bc5c4930 2024-01-25T15:04:06.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bbfda6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564bc4a9400 con 0x5564bc5c3f40 2024-01-25T15:04:06.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bbfda6740 10 client.0 _ll_register_callbacks cb 0x5564bc521ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:06.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bb659c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c3f40 0x5564bc5ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bb659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bb659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56132/0 (socket says 172.21.15.170:56132) 2024-01-25T15:04:06.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bb659c640 1 -- 172.21.15.170:0/2552162699 learned_addr learned my addr 172.21.15.170:0/2552162699 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:06.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bb6d9d640 1 --2- 172.21.15.170:0/2552162699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c4930 0x5564bc5ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bb659c640 1 -- 172.21.15.170:0/2552162699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c3f40 msgr2=0x5564bc5ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bb659c640 1 --2- 172.21.15.170:0/2552162699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c3f40 0x5564bc5ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bb659c640 1 -- 172.21.15.170:0/2552162699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c4930 msgr2=0x5564bc5ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bb659c640 1 --2- 172.21.15.170:0/2552162699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c4930 0x5564bc5ce690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bb659c640 1 -- 172.21.15.170:0/2552162699 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba800bd30 con 0x5564bc5c9aa0 2024-01-25T15:04:06.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3bb659c640 1 --2- 172.21.15.170:0/2552162699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d56d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3bac012b70 tx=0x7f3bac009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=332676f377fdb4a7 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3b9aff5640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:06.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.841+0000 7f3b9aff5640 1 -- 172.21.15.170:0/2552162699 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac022600 con 0x5564bc5c9aa0 2024-01-25T15:04:06.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.842+0000 7f3b9aff5640 1 -- 172.21.15.170:0/2552162699 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f3bac00f430 con 0x5564bc5c9aa0 2024-01-25T15:04:06.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.842+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2552162699 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564bc5240e0 con 0x5564bc5c9aa0 2024-01-25T15:04:06.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.842+0000 7f3b9aff5640 1 -- 172.21.15.170:0/2552162699 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bac022760 con 0x5564bc5c9aa0 2024-01-25T15:04:06.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.842+0000 7f3bbfda6740 10 client.16125 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:06.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.842+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2552162699 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x5564bc5298d0 con 0x5564bc5c9aa0 2024-01-25T15:04:06.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.842+0000 7f3b9aff5640 1 -- 172.21.15.170:0/2552162699 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5564bc5240e0 con 0x5564bc5c9aa0 2024-01-25T15:04:06.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.842+0000 7f3b9aff5640 1 -- 172.21.15.170:0/2552162699 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f3bac02b050 con 0x5564bc5c9aa0 2024-01-25T15:04:06.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.842+0000 7f3bbfda6740 10 client.16125 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:06.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.842+0000 7f3bbfda6740 10 client.16125 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-01-25T15:04:06.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.842+0000 7f3bbfda6740 20 client.16125 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:06.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.842+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2552162699 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x5564bc5da090 0x5564bc5dc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.842+0000 7f3bbfda6740 4 client.16125 mds_command: new command op to 24398 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:04:06.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.842+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2552162699 --> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5564bc523e00 con 0x5564bc5da090 2024-01-25T15:04:06.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.843+0000 7f3bb6d9d640 1 --2- 172.21.15.170:0/2552162699 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x5564bc5da090 0x5564bc5dc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.843+0000 7f3b9aff5640 10 client.16125 ms_handle_connect on v2:172.21.15.186:6832/1347511259 2024-01-25T15:04:06.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.843+0000 7f3bb6d9d640 1 --2- 172.21.15.170:0/2552162699 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x5564bc5da090 0x5564bc5dc4d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4528ea206da39c6f server_cookie=18460d6f5d204b48 in_seq=0 out_seq=0 2024-01-25T15:04:06.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.843+0000 7f3b9aff5640 1 -- 172.21.15.170:0/2552162699 <== mds.4 v2:172.21.15.186:6832/1347511259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5564bc523e00 con 0x5564bc5da090 2024-01-25T15:04:06.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.843+0000 7f3b9aff5640 10 client.16125 handle_command_reply: tid=0 2024-01-25T15:04:06.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.843+0000 7f3bbfda6740 1 client.16125 shutdown 2024-01-25T15:04:06.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.844+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2552162699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 msgr2=0x5564bc5d56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.844+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2552162699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d56d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3bac012b70 tx=0x7f3bac009600 comp rx=0 tx=0).stop 2024-01-25T15:04:06.851 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.844+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2552162699 shutdown_connections 2024-01-25T15:04:06.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.844+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2552162699 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c4930 0x5564bc5ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.844+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2552162699 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x5564bc5da090 0x5564bc5dc4d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.844+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2552162699 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d56d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.844+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2552162699 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c3f40 0x5564bc5ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.844+0000 7f3b9aff5640 0 client.16125 ms_handle_reset on v2:172.21.15.186:6832/1347511259 2024-01-25T15:04:06.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.844+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2552162699 >> 172.21.15.170:0/2552162699 conn(0x5564bc5bf4b0 msgr2=0x5564bc5be7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.844+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2552162699 shutdown_connections 2024-01-25T15:04:06.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.844+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2552162699 wait complete. 2024-01-25T15:04:06.852 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.844+0000 7f3bbfda6740 20 client.16125 trim_cache size 0 max 16384 2024-01-25T15:04:06.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.855+0000 7f3bbfda6740 1 Processor -- start 2024-01-25T15:04:06.861 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.855+0000 7f3bbfda6740 1 -- start start 2024-01-25T15:04:06.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.855+0000 7f3bbfda6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c3f40 0x5564bc5ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.855+0000 7f3bbfda6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c4930 0x5564bc5ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.855+0000 7f3bbfda6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.855+0000 7f3bbfda6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564bc5bffa0 con 0x5564bc5c9aa0 2024-01-25T15:04:06.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3bbfda6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564bc5b1650 con 0x5564bc5c4930 2024-01-25T15:04:06.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3bbfda6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564bc5baf10 con 0x5564bc5c3f40 2024-01-25T15:04:06.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3bb659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3bb659c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c3f40 0x5564bc5ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3bb659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56146/0 (socket says 172.21.15.170:56146) 2024-01-25T15:04:06.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3bb659c640 1 -- 172.21.15.170:0/2588200218 learned_addr learned my addr 172.21.15.170:0/2588200218 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:06.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3bb6d9d640 1 --2- 172.21.15.170:0/2588200218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c4930 0x5564bc5ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3bb659c640 1 -- 172.21.15.170:0/2588200218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c3f40 msgr2=0x5564bc5ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3bb659c640 1 --2- 172.21.15.170:0/2588200218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c3f40 0x5564bc5ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.862 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3bb659c640 1 -- 172.21.15.170:0/2588200218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c4930 msgr2=0x5564bc5ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3bb659c640 1 --2- 172.21.15.170:0/2588200218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c4930 0x5564bc5ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3bb659c640 1 -- 172.21.15.170:0/2588200218 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564bc4c6500 con 0x5564bc5c9aa0 2024-01-25T15:04:06.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3bb659c640 1 --2- 172.21.15.170:0/2588200218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d55f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x5564bc5bb340 tx=0x7f3bac009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22bc8b5185cba0fd server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3b9cff9640 1 -- 172.21.15.170:0/2588200218 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00fe80 con 0x5564bc5c9aa0 2024-01-25T15:04:06.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3b9cff9640 1 -- 172.21.15.170:0/2588200218 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3bac00f8f0 con 0x5564bc5c9aa0 2024-01-25T15:04:06.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.856+0000 7f3b9cff9640 1 -- 172.21.15.170:0/2588200218 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac02dd70 con 0x5564bc5c9aa0 2024-01-25T15:04:06.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2588200218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 msgr2=0x5564bc5d55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2588200218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d55f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x5564bc5bb340 tx=0x7f3bac009800 comp rx=0 tx=0).stop 2024-01-25T15:04:06.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2588200218 shutdown_connections 2024-01-25T15:04:06.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2588200218 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c4930 0x5564bc5ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2588200218 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d55f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2588200218 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c3f40 0x5564bc5ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2588200218 >> 172.21.15.170:0/2588200218 conn(0x5564bc5bf4b0 msgr2=0x5564bc5bf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2588200218 shutdown_connections 2024-01-25T15:04:06.863 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2588200218 wait complete. 2024-01-25T15:04:06.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 -- start start 2024-01-25T15:04:06.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 Processor -- start 2024-01-25T15:04:06.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c3f40 0x5564bc5d3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c4930 0x5564bc5d44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564bc6305e0 con 0x5564bc5c3f40 2024-01-25T15:04:06.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564bc630720 con 0x5564bc5c9aa0 2024-01-25T15:04:06.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564bc630860 con 0x5564bc5c4930 2024-01-25T15:04:06.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bbfda6740 10 client.0 _ll_register_callbacks cb 0x7f3ba800bb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:06.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bb659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c3f40 0x5564bc5d3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bb659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c3f40 0x5564bc5d3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56160/0 (socket says 172.21.15.170:56160) 2024-01-25T15:04:06.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bb659c640 1 -- 172.21.15.170:0/2776836814 learned_addr learned my addr 172.21.15.170:0/2776836814 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:06.864 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bb6d9d640 1 --2- 172.21.15.170:0/2776836814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c4930 0x5564bc5d44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.857+0000 7f3bb659c640 1 --2- 172.21.15.170:0/2776836814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3bb659c640 1 -- 172.21.15.170:0/2776836814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c4930 msgr2=0x5564bc5d44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3bb659c640 1 --2- 172.21.15.170:0/2776836814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c4930 0x5564bc5d44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3bb659c640 1 -- 172.21.15.170:0/2776836814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c9aa0 msgr2=0x5564bc5d4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:06.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3bb659c640 1 --2- 172.21.15.170:0/2776836814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3bb659c640 1 -- 172.21.15.170:0/2776836814 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564bc5298d0 con 0x5564bc5c3f40 2024-01-25T15:04:06.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3bb659c640 1 --2- 172.21.15.170:0/2776836814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c3f40 0x5564bc5d3f90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3bac010010 tx=0x7f3bac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437b34218d4b8200 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:06.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3b9aff5640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:06.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3b9aff5640 1 -- 172.21.15.170:0/2776836814 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00f630 con 0x5564bc5c3f40 2024-01-25T15:04:06.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3b9aff5640 1 -- 172.21.15.170:0/2776836814 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f3bac000e40 con 0x5564bc5c3f40 2024-01-25T15:04:06.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2776836814 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564bc22a7e0 con 0x5564bc5c3f40 2024-01-25T15:04:06.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3b9aff5640 1 -- 172.21.15.170:0/2776836814 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bac009c40 con 0x5564bc5c3f40 2024-01-25T15:04:06.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3bbfda6740 10 client.16131 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:06.865 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2776836814 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x5564bc4ec050 con 0x5564bc5c3f40 2024-01-25T15:04:06.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3b9aff5640 1 -- 172.21.15.170:0/2776836814 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5564bc22a7e0 con 0x5564bc5c3f40 2024-01-25T15:04:06.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3b9aff5640 1 -- 172.21.15.170:0/2776836814 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f3bac02b040 con 0x5564bc5c3f40 2024-01-25T15:04:06.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3bbfda6740 10 client.16131 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:06.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3bbfda6740 10 client.16131 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.k 2024-01-25T15:04:06.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3bbfda6740 20 client.16131 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:06.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2776836814 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x5564bc632000 0x5564bc634420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:06.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3bbfda6740 4 client.16131 mds_command: new command op to 24398 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:04:06.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.858+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2776836814 --> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5564bc27de30 con 0x5564bc632000 2024-01-25T15:04:06.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.859+0000 7f3bb6d9d640 1 --2- 172.21.15.170:0/2776836814 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x5564bc632000 0x5564bc634420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:06.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.859+0000 7f3bb6d9d640 1 --2- 172.21.15.170:0/2776836814 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x5564bc632000 0x5564bc634420 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b32c50b978210719 server_cookie=c68c879b4e06dff4 in_seq=0 out_seq=0 2024-01-25T15:04:06.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.859+0000 7f3b9aff5640 10 client.16131 ms_handle_connect on v2:172.21.15.186:6832/1347511259 2024-01-25T15:04:06.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3b9aff5640 1 -- 172.21.15.170:0/2776836814 <== mds.4 v2:172.21.15.186:6832/1347511259 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+35046 (crc 0 0 0) 0x5564bc27de30 con 0x5564bc632000 2024-01-25T15:04:06.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3b9aff5640 10 client.16131 handle_command_reply: tid=0 2024-01-25T15:04:06.866 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbfda6740 1 client.16131 shutdown 2024-01-25T15:04:06.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2776836814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c3f40 msgr2=0x5564bc5d3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2776836814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c3f40 0x5564bc5d3f90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3bac010010 tx=0x7f3bac000bc0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2776836814 shutdown_connections 2024-01-25T15:04:06.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2776836814 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5564bc5c9aa0 0x5564bc5d4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2776836814 >> [v2:172.21.15.186:6832/1347511259,v1:172.21.15.186:6833/1347511259] conn(0x5564bc632000 0x5564bc634420 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2776836814 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5564bc5c4930 0x5564bc5d44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbfda6740 1 --2- 172.21.15.170:0/2776836814 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5564bc5c3f40 0x5564bc5d3f90 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3b9aff5640 0 client.16131 ms_handle_reset on v2:172.21.15.186:6832/1347511259 2024-01-25T15:04:06.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2776836814 >> 172.21.15.170:0/2776836814 conn(0x5564bc5bf4b0 msgr2=0x5564bc5c5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2776836814 shutdown_connections 2024-01-25T15:04:06.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbfda6740 1 -- 172.21.15.170:0/2776836814 wait complete. 2024-01-25T15:04:06.867 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbfda6740 20 client.16131 trim_cache size 0 max 16384 2024-01-25T15:04:06.868 INFO:teuthology.orchestra.run.smithi170.stdout:[ 2024-01-25T15:04:06.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.868 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.868 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 122588077, 2024-01-25T15:04:06.868 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633290, 2024-01-25T15:04:06.868 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/3-1.c" 2024-01-25T15:04:06.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.869 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.869 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 204652443, 2024-01-25T15:04:06.869 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632569, 2024-01-25T15:04:06.869 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/16-1.c" 2024-01-25T15:04:06.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.869 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.869 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 257933295, 2024-01-25T15:04:06.869 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631778, 2024-01-25T15:04:06.869 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_026.c" 2024-01-25T15:04:06.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.869 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.869 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 269164118, 2024-01-25T15:04:06.870 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629781, 2024-01-25T15:04:06.870 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip05" 2024-01-25T15:04:06.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.870 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.870 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 292974284, 2024-01-25T15:04:06.870 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630212, 2024-01-25T15:04:06.870 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_unknown" 2024-01-25T15:04:06.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.870 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.870 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 315555737, 2024-01-25T15:04:06.870 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632949, 2024-01-25T15:04:06.870 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/coverage.txt" 2024-01-25T15:04:06.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.871 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.871 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 320611712, 2024-01-25T15:04:06.871 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631768, 2024-01-25T15:04:06.871 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_030.c" 2024-01-25T15:04:06.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.871 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.871 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 329238298, 2024-01-25T15:04:06.871 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632953, 2024-01-25T15:04:06.871 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/4-1.c" 2024-01-25T15:04:06.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.871 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.872 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 347940513, 2024-01-25T15:04:06.872 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630175, 2024-01-25T15:04:06.872 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip09" 2024-01-25T15:04:06.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.872 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.872 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 377037131, 2024-01-25T15:04:06.872 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632236, 2024-01-25T15:04:06.872 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/Makefile.in" 2024-01-25T15:04:06.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.872 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.872 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 510779187, 2024-01-25T15:04:06.872 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631774, 2024-01-25T15:04:06.873 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/openhpi.conf" 2024-01-25T15:04:06.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.873 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.873 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 551844540, 2024-01-25T15:04:06.873 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630186, 2024-01-25T15:04:06.873 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_unkown" 2024-01-25T15:04:06.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.873 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.873 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 645691179, 2024-01-25T15:04:06.873 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631761, 2024-01-25T15:04:06.873 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/init.c" 2024-01-25T15:04:06.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.874 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.874 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 652998091, 2024-01-25T15:04:06.874 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631762, 2024-01-25T15:04:06.874 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/safhpi.c" 2024-01-25T15:04:06.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.874 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.874 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 756096066, 2024-01-25T15:04:06.874 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629776, 2024-01-25T15:04:06.874 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip05" 2024-01-25T15:04:06.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.874 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.875 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 773205195, 2024-01-25T15:04:06.875 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631772, 2024-01-25T15:04:06.875 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_025.c" 2024-01-25T15:04:06.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.875 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.875 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 778943836, 2024-01-25T15:04:06.875 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630214, 2024-01-25T15:04:06.875 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_over" 2024-01-25T15:04:06.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.875 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.875 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 798328025, 2024-01-25T15:04:06.875 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632565, 2024-01-25T15:04:06.876 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/12-1.c" 2024-01-25T15:04:06.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.876 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.876 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 823906393, 2024-01-25T15:04:06.876 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631794, 2024-01-25T15:04:06.876 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/Makefile.am" 2024-01-25T15:04:06.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.876 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.876 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 835075689, 2024-01-25T15:04:06.876 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629770, 2024-01-25T15:04:06.876 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip12" 2024-01-25T15:04:06.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.877 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.877 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 841866254, 2024-01-25T15:04:06.877 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631793, 2024-01-25T15:04:06.877 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/domain.c" 2024-01-25T15:04:06.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.877 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.877 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 873448209, 2024-01-25T15:04:06.877 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630811, 2024-01-25T15:04:06.877 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_mem_scrub" 2024-01-25T15:04:06.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.878 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.878 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 951521769, 2024-01-25T15:04:06.878 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632559, 2024-01-25T15:04:06.878 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/14-1.c" 2024-01-25T15:04:06.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.878 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.878 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 964659351, 2024-01-25T15:04:06.878 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629775, 2024-01-25T15:04:06.878 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip13" 2024-01-25T15:04:06.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.878 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.878 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 994992282, 2024-01-25T15:04:06.878 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629759, 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip03" 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 999499511, 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630215, 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_corrected" 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1031460494, 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631779, 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_008.c" 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.879 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.880 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1041437835, 2024-01-25T15:04:06.880 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629761, 2024-01-25T15:04:06.880 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip13" 2024-01-25T15:04:06.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.880 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.880 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1066267486, 2024-01-25T15:04:06.880 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631775, 2024-01-25T15:04:06.880 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_039.c" 2024-01-25T15:04:06.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.880 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.880 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1092266624, 2024-01-25T15:04:06.881 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633286, 2024-01-25T15:04:06.881 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative/5-1.c" 2024-01-25T15:04:06.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.881 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.881 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1139156548, 2024-01-25T15:04:06.881 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631784, 2024-01-25T15:04:06.881 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_031.c" 2024-01-25T15:04:06.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.881 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.881 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1140067540, 2024-01-25T15:04:06.881 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630532, 2024-01-25T15:04:06.881 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/s0_ar1" 2024-01-25T15:04:06.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.882 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.882 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1241749664, 2024-01-25T15:04:06.882 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631769, 2024-01-25T15:04:06.882 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_028.c" 2024-01-25T15:04:06.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.882 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.882 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1247283451, 2024-01-25T15:04:06.882 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631787, 2024-01-25T15:04:06.882 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/hpiinjector.c" 2024-01-25T15:04:06.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.882 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.883 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1324903710, 2024-01-25T15:04:06.883 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629767, 2024-01-25T15:04:06.883 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/00_Descriptions.txt" 2024-01-25T15:04:06.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.883 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.883 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1325396817, 2024-01-25T15:04:06.883 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632940, 2024-01-25T15:04:06.883 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/1-1.c" 2024-01-25T15:04:06.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.883 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.884 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1327778563, 2024-01-25T15:04:06.884 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632557, 2024-01-25T15:04:06.884 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/testfrmw.c" 2024-01-25T15:04:06.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.884 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.884 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1370517182, 2024-01-25T15:04:06.884 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631767, 2024-01-25T15:04:06.884 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi_tests.txt" 2024-01-25T15:04:06.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.884 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.885 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1390737797, 2024-01-25T15:04:06.885 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629778, 2024-01-25T15:04:06.885 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip07" 2024-01-25T15:04:06.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.885 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.885 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1399795792, 2024-01-25T15:04:06.885 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629764, 2024-01-25T15:04:06.885 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip02" 2024-01-25T15:04:06.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.885 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.885 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1429833747, 2024-01-25T15:04:06.885 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632562, 2024-01-25T15:04:06.886 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/15-1.c" 2024-01-25T15:04:06.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.886 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.886 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1443312560, 2024-01-25T15:04:06.886 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629755, 2024-01-25T15:04:06.886 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip02" 2024-01-25T15:04:06.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.886 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.886 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1511338977, 2024-01-25T15:04:06.886 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632234, 2024-01-25T15:04:06.886 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/plugin_static.c.in" 2024-01-25T15:04:06.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.887 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.887 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1586331860, 2024-01-25T15:04:06.887 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630188, 2024-01-25T15:04:06.887 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srao_ewb_noripv" 2024-01-25T15:04:06.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.887 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.887 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1616497079, 2024-01-25T15:04:06.887 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632555, 2024-01-25T15:04:06.887 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/coverage.txt" 2024-01-25T15:04:06.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.887 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.888 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1623435487, 2024-01-25T15:04:06.888 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632941, 2024-01-25T15:04:06.888 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/assertions.xml" 2024-01-25T15:04:06.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.888 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.888 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1684563458, 2024-01-25T15:04:06.888 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631763, 2024-01-25T15:04:06.888 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/lock.c" 2024-01-25T15:04:06.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.888 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.888 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1713053921, 2024-01-25T15:04:06.888 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630187, 2024-01-25T15:04:06.889 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_over" 2024-01-25T15:04:06.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.889 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.889 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1737211760, 2024-01-25T15:04:06.889 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631783, 2024-01-25T15:04:06.889 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_007.c" 2024-01-25T15:04:06.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.889 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.889 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1784816719, 2024-01-25T15:04:06.889 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633285, 2024-01-25T15:04:06.889 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative" 2024-01-25T15:04:06.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.890 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.890 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1810375284, 2024-01-25T15:04:06.890 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629779, 2024-01-25T15:04:06.890 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip01" 2024-01-25T15:04:06.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.890 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.890 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1829034726, 2024-01-25T15:04:06.890 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632942, 2024-01-25T15:04:06.890 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/3-1.sh" 2024-01-25T15:04:06.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.890 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.890 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1853066643, 2024-01-25T15:04:06.891 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632939, 2024-01-25T15:04:06.891 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/1-2.c" 2024-01-25T15:04:06.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.891 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.891 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1855475260, 2024-01-25T15:04:06.891 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631770, 2024-01-25T15:04:06.891 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_032.c" 2024-01-25T15:04:06.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.891 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.891 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1881949765, 2024-01-25T15:04:06.891 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629769, 2024-01-25T15:04:06.891 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip10" 2024-01-25T15:04:06.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.892 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.892 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1891523465, 2024-01-25T15:04:06.892 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631757, 2024-01-25T15:04:06.892 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/session.c" 2024-01-25T15:04:06.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.892 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.892 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1908699871, 2024-01-25T15:04:06.892 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631759, 2024-01-25T15:04:06.892 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/alarm.c" 2024-01-25T15:04:06.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.893 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.893 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1930654617, 2024-01-25T15:04:06.893 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631785, 2024-01-25T15:04:06.893 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_029.c" 2024-01-25T15:04:06.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.893 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.893 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1949356767, 2024-01-25T15:04:06.893 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631764, 2024-01-25T15:04:06.893 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/Makefile.in" 2024-01-25T15:04:06.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.893 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.893 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2224469364, 2024-01-25T15:04:06.894 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631766, 2024-01-25T15:04:06.894 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/config.c" 2024-01-25T15:04:06.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.894 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.894 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2267719328, 2024-01-25T15:04:06.894 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630163, 2024-01-25T15:04:06.894 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srao_mem_scrub_noripv" 2024-01-25T15:04:06.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.894 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.894 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2273442248, 2024-01-25T15:04:06.894 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630213, 2024-01-25T15:04:06.894 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_ewb" 2024-01-25T15:04:06.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.895 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.895 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2296423196, 2024-01-25T15:04:06.895 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631786, 2024-01-25T15:04:06.895 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/Makefile.in" 2024-01-25T15:04:06.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.895 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.895 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2310162672, 2024-01-25T15:04:06.895 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629773, 2024-01-25T15:04:06.895 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip07" 2024-01-25T15:04:06.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.895 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.896 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2322057807, 2024-01-25T15:04:06.896 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630216, 2024-01-25T15:04:06.896 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_no_en" 2024-01-25T15:04:06.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.896 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.896 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2374207031, 2024-01-25T15:04:06.896 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631781, 2024-01-25T15:04:06.896 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_027.c" 2024-01-25T15:04:06.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.896 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.896 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2389566714, 2024-01-25T15:04:06.896 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632556, 2024-01-25T15:04:06.897 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/18-1.c" 2024-01-25T15:04:06.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.897 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.897 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2479101817, 2024-01-25T15:04:06.897 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632560, 2024-01-25T15:04:06.897 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/5-1.c" 2024-01-25T15:04:06.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.897 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.897 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2565659632, 2024-01-25T15:04:06.897 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629754, 2024-01-25T15:04:06.897 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip06" 2024-01-25T15:04:06.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.898 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.898 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2568114119, 2024-01-25T15:04:06.898 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632237, 2024-01-25T15:04:06.898 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi" 2024-01-25T15:04:06.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.898 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.898 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2600270775, 2024-01-25T15:04:06.898 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631760, 2024-01-25T15:04:06.898 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/ohpi.c" 2024-01-25T15:04:06.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.899 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.899 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2659328852, 2024-01-25T15:04:06.899 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631777, 2024-01-25T15:04:06.899 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_010.c" 2024-01-25T15:04:06.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.899 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.899 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2711505902, 2024-01-25T15:04:06.899 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631776, 2024-01-25T15:04:06.899 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_036.c" 2024-01-25T15:04:06.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.899 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.899 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2730694613, 2024-01-25T15:04:06.899 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631269, 2024-01-25T15:04:06.900 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/Makefile.am" 2024-01-25T15:04:06.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.900 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.900 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2742180340, 2024-01-25T15:04:06.900 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629753, 2024-01-25T15:04:06.900 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip08" 2024-01-25T15:04:06.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.900 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.900 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2758747046, 2024-01-25T15:04:06.900 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632945, 2024-01-25T15:04:06.900 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative/5-2.c" 2024-01-25T15:04:06.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.901 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.901 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2783572814, 2024-01-25T15:04:06.901 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629765, 2024-01-25T15:04:06.901 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip11" 2024-01-25T15:04:06.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.901 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.901 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2796029466, 2024-01-25T15:04:06.901 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631771, 2024-01-25T15:04:06.901 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_033.c" 2024-01-25T15:04:06.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.901 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.902 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2860102391, 2024-01-25T15:04:06.902 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631792, 2024-01-25T15:04:06.902 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/Makefile.am" 2024-01-25T15:04:06.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.902 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.902 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2874479810, 2024-01-25T15:04:06.902 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632558, 2024-01-25T15:04:06.902 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/testfrmw.h" 2024-01-25T15:04:06.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.902 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.902 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2924051642, 2024-01-25T15:04:06.902 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631268, 2024-01-25T15:04:06.903 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/Makefile.in" 2024-01-25T15:04:06.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.903 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.903 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3033111400, 2024-01-25T15:04:06.903 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631267, 2024-01-25T15:04:06.903 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/snmp_utils.c" 2024-01-25T15:04:06.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.903 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.903 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3045184271, 2024-01-25T15:04:06.903 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631782, 2024-01-25T15:04:06.903 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_024.c" 2024-01-25T15:04:06.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.904 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.904 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3099182889, 2024-01-25T15:04:06.904 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632553, 2024-01-25T15:04:06.904 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/9-1.c" 2024-01-25T15:04:06.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.904 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.904 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3176382279, 2024-01-25T15:04:06.904 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629780, 2024-01-25T15:04:06.904 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip11" 2024-01-25T15:04:06.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.904 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.905 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3289120500, 2024-01-25T15:04:06.905 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632561, 2024-01-25T15:04:06.905 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/6-1.c" 2024-01-25T15:04:06.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.905 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.905 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3292701190, 2024-01-25T15:04:06.905 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632568, 2024-01-25T15:04:06.905 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-2.c" 2024-01-25T15:04:06.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.905 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.905 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3306878161, 2024-01-25T15:04:06.905 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629777, 2024-01-25T15:04:06.905 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip10" 2024-01-25T15:04:06.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.906 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.906 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3315130746, 2024-01-25T15:04:06.906 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632564, 2024-01-25T15:04:06.906 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/assertions.xml" 2024-01-25T15:04:06.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.906 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.906 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3360020058, 2024-01-25T15:04:06.906 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631765, 2024-01-25T15:04:06.906 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/threaded.c" 2024-01-25T15:04:06.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.907 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.907 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3397244105, 2024-01-25T15:04:06.907 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633284, 2024-01-25T15:04:06.907 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/coverage.txt" 2024-01-25T15:04:06.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.907 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.907 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3413942504, 2024-01-25T15:04:06.907 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632943, 2024-01-25T15:04:06.907 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/4-1.sh" 2024-01-25T15:04:06.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.907 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.907 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3446214354, 2024-01-25T15:04:06.907 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629758, 2024-01-25T15:04:06.908 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip12" 2024-01-25T15:04:06.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.908 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.908 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3476953149, 2024-01-25T15:04:06.908 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631790, 2024-01-25T15:04:06.908 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/Makefile.am" 2024-01-25T15:04:06.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.908 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.908 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3488315201, 2024-01-25T15:04:06.908 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632566, 2024-01-25T15:04:06.908 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/7-1.c" 2024-01-25T15:04:06.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3506501359, 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632952, 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/assertions.xml" 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3511516611, 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631788, 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_037.c" 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3523485982, 2024-01-25T15:04:06.909 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631758, 2024-01-25T15:04:06.910 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/event.c" 2024-01-25T15:04:06.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.910 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.910 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3534328749, 2024-01-25T15:04:06.910 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629768, 2024-01-25T15:04:06.910 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip06" 2024-01-25T15:04:06.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.910 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.910 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3601240940, 2024-01-25T15:04:06.910 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630217, 2024-01-25T15:04:06.910 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_ucna" 2024-01-25T15:04:06.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3615047725, 2024-01-25T15:04:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631756, 2024-01-25T15:04:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/plugin.c" 2024-01-25T15:04:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3646328890, 2024-01-25T15:04:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629774, 2024-01-25T15:04:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip08" 2024-01-25T15:04:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3682439035, 2024-01-25T15:04:06.911 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631773, 2024-01-25T15:04:06.912 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_009.c" 2024-01-25T15:04:06.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.912 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.912 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3682795314, 2024-01-25T15:04:06.912 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631780, 2024-01-25T15:04:06.912 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_034.c" 2024-01-25T15:04:06.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.912 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.912 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3687398400, 2024-01-25T15:04:06.912 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632929, 2024-01-25T15:04:06.912 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-3.c" 2024-01-25T15:04:06.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.913 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.913 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3722756177, 2024-01-25T15:04:06.913 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632944, 2024-01-25T15:04:06.913 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/2-1.sh" 2024-01-25T15:04:06.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.913 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.913 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3761435517, 2024-01-25T15:04:06.913 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631698, 2024-01-25T15:04:06.913 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/snmp_utils.h" 2024-01-25T15:04:06.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.913 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.913 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3762481789, 2024-01-25T15:04:06.914 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632567, 2024-01-25T15:04:06.914 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/4-1.c" 2024-01-25T15:04:06.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.914 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.914 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3836058817, 2024-01-25T15:04:06.914 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632238, 2024-01-25T15:04:06.914 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_035.c" 2024-01-25T15:04:06.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.914 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.914 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3874623942, 2024-01-25T15:04:06.914 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631791, 2024-01-25T15:04:06.914 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_version.c" 2024-01-25T15:04:06.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.915 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.915 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3877786868, 2024-01-25T15:04:06.915 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631789, 2024-01-25T15:04:06.915 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_038.c" 2024-01-25T15:04:06.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.915 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.915 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3892108966, 2024-01-25T15:04:06.915 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632950, 2024-01-25T15:04:06.915 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/2-1.c" 2024-01-25T15:04:06.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.915 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.916 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3942817616, 2024-01-25T15:04:06.916 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629760, 2024-01-25T15:04:06.916 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip03" 2024-01-25T15:04:06.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.916 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.916 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3953801913, 2024-01-25T15:04:06.916 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632235, 2024-01-25T15:04:06.916 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t" 2024-01-25T15:04:06.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.916 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.916 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3979201433, 2024-01-25T15:04:06.916 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632554, 2024-01-25T15:04:06.917 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/10-1.c" 2024-01-25T15:04:06.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.917 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.917 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3984583078, 2024-01-25T15:04:06.917 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629772, 2024-01-25T15:04:06.917 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip14" 2024-01-25T15:04:06.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.917 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.917 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3987039884, 2024-01-25T15:04:06.917 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629771, 2024-01-25T15:04:06.917 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip09" 2024-01-25T15:04:06.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.918 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.918 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3995960232, 2024-01-25T15:04:06.918 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629762, 2024-01-25T15:04:06.918 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip14" 2024-01-25T15:04:06.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.918 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.918 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4009726381, 2024-01-25T15:04:06.918 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629766, 2024-01-25T15:04:06.918 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip04" 2024-01-25T15:04:06.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.918 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.918 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4018954533, 2024-01-25T15:04:06.918 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629757, 2024-01-25T15:04:06.919 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip04" 2024-01-25T15:04:06.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.919 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.919 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4074343305, 2024-01-25T15:04:06.919 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630164, 2024-01-25T15:04:06.919 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_no_en" 2024-01-25T15:04:06.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.919 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.919 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4076171959, 2024-01-25T15:04:06.919 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631755, 2024-01-25T15:04:06.919 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/hotswap.c" 2024-01-25T15:04:06.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.920 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.920 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4095229294, 2024-01-25T15:04:06.920 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629763, 2024-01-25T15:04:06.920 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/Makefile" 2024-01-25T15:04:06.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.920 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.920 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4112648525, 2024-01-25T15:04:06.920 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629756, 2024-01-25T15:04:06.920 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip01" 2024-01-25T15:04:06.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.920 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.920 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4262951973, 2024-01-25T15:04:06.920 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632563, 2024-01-25T15:04:06.921 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-1.c" 2024-01-25T15:04:06.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:06.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:06.921 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:06.921 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4289212542, 2024-01-25T15:04:06.921 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632951, 2024-01-25T15:04:06.921 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/1-1.c" 2024-01-25T15:04:06.921 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:06.921 INFO:teuthology.orchestra.run.smithi170.stdout:] 2024-01-25T15:04:06.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbd105640 1 -- 172.21.15.170:0/4034580929 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3ba00a12e0 msgr2=0x7f3ba00a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbd105640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3ba00a12e0 0x7f3ba00a37a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3bb00bc370 tx=0x7f3bb008b9f0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbd105640 1 -- 172.21.15.170:0/4034580929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bb81069f0 msgr2=0x7f3bb819e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:06.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbd105640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bb81069f0 0x7f3bb819e280 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0005cc0 tx=0x7f3bb00329c0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.860+0000 7f3bbd105640 1 -- 172.21.15.170:0/4034580929 shutdown_connections 2024-01-25T15:04:06.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.861+0000 7f3bbd105640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f3ba00a12e0 0x7f3ba00a37a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.861+0000 7f3bbd105640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bb81040c0 0x7f3bb8197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.861+0000 7f3bbd105640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f3bb81069f0 0x7f3bb819e280 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.861+0000 7f3bbd105640 1 --2- 172.21.15.170:0/4034580929 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f3bb8101790 0x7f3bb8196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:06.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.861+0000 7f3bbd105640 1 -- 172.21.15.170:0/4034580929 >> 172.21.15.170:0/4034580929 conn(0x7f3bb80fb180 msgr2=0x7f3bb8102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:06.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.861+0000 7f3bbd105640 1 -- 172.21.15.170:0/4034580929 shutdown_connections 2024-01-25T15:04:06.923 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:06.861+0000 7f3bbd105640 1 -- 172.21.15.170:0/4034580929 wait complete. 2024-01-25T15:04:06.924 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2024-01-25T15:04:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.031+0000 7fa94ea31640 1 -- 172.21.15.170:0/3391099407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9481017a0 msgr2=0x7fa948108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.031+0000 7fa94ea31640 1 --2- 172.21.15.170:0/3391099407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9481017a0 0x7fa948108030 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa940009ca0 tx=0x7fa94002c0f0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.031+0000 7fa94ea31640 1 -- 172.21.15.170:0/3391099407 shutdown_connections 2024-01-25T15:04:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.031+0000 7fa94ea31640 1 --2- 172.21.15.170:0/3391099407 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9481017a0 0x7fa948108030 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.031+0000 7fa94ea31640 1 --2- 172.21.15.170:0/3391099407 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa948100de0 0x7fa948101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.031+0000 7fa94ea31640 1 --2- 172.21.15.170:0/3391099407 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9480ffbf0 0x7fa948100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.032 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.031+0000 7fa94ea31640 1 -- 172.21.15.170:0/3391099407 >> 172.21.15.170:0/3391099407 conn(0x7fa9480fb180 msgr2=0x7fa9480fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.031+0000 7fa94ea31640 1 -- 172.21.15.170:0/3391099407 shutdown_connections 2024-01-25T15:04:07.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.031+0000 7fa94ea31640 1 -- 172.21.15.170:0/3391099407 wait complete. 2024-01-25T15:04:07.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.031+0000 7fa94ea31640 1 Processor -- start 2024-01-25T15:04:07.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.031+0000 7fa94ea31640 1 -- start start 2024-01-25T15:04:07.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa94ea31640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9480ffbf0 0x7fa9480689e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa94ea31640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa948100de0 0x7fa94819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa94ea31640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9481017a0 0x7fa94819e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa94ea31640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94819e790 con 0x7fa9480ffbf0 2024-01-25T15:04:07.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa94ea31640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94819e900 con 0x7fa9481017a0 2024-01-25T15:04:07.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa94ea31640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa94819eac0 con 0x7fa948100de0 2024-01-25T15:04:07.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa947fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9480ffbf0 0x7fa9480689e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa947fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9480ffbf0 0x7fa9480689e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56178/0 (socket says 172.21.15.170:56178) 2024-01-25T15:04:07.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa947fff640 1 -- 172.21.15.170:0/1524633017 learned_addr learned my addr 172.21.15.170:0/1524633017 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa9477fe640 1 --2- 172.21.15.170:0/1524633017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa948100de0 0x7fa94819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa94cfce640 1 --2- 172.21.15.170:0/1524633017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9481017a0 0x7fa94819e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa947fff640 1 -- 172.21.15.170:0/1524633017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa948100de0 msgr2=0x7fa94819b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa947fff640 1 --2- 172.21.15.170:0/1524633017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa948100de0 0x7fa94819b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa947fff640 1 -- 172.21.15.170:0/1524633017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9481017a0 msgr2=0x7fa94819e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa947fff640 1 --2- 172.21.15.170:0/1524633017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9481017a0 0x7fa94819e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa947fff640 1 -- 172.21.15.170:0/1524633017 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa940009900 con 0x7fa9480ffbf0 2024-01-25T15:04:07.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.032+0000 7fa947fff640 1 --2- 172.21.15.170:0/1524633017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9480ffbf0 0x7fa9480689e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa93800e9c0 tx=0x7fa93800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.033+0000 7fa9457fa640 1 -- 172.21.15.170:0/1524633017 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa938009700 con 0x7fa9480ffbf0 2024-01-25T15:04:07.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.033+0000 7fa9457fa640 1 -- 172.21.15.170:0/1524633017 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9380044e0 con 0x7fa9480ffbf0 2024-01-25T15:04:07.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.033+0000 7fa94ea31640 1 -- 172.21.15.170:0/1524633017 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa94819eda0 con 0x7fa9480ffbf0 2024-01-25T15:04:07.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.033+0000 7fa9457fa640 1 -- 172.21.15.170:0/1524633017 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa938010430 con 0x7fa9480ffbf0 2024-01-25T15:04:07.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.033+0000 7fa94ea31640 1 -- 172.21.15.170:0/1524633017 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa94819f250 con 0x7fa9480ffbf0 2024-01-25T15:04:07.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.035+0000 7fa9457fa640 1 -- 172.21.15.170:0/1524633017 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fa938003fa0 con 0x7fa9480ffbf0 2024-01-25T15:04:07.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.035+0000 7fa9515f9740 1 Processor -- start 2024-01-25T15:04:07.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.035+0000 7fa9515f9740 1 -- start start 2024-01-25T15:04:07.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.035+0000 7fa9515f9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c60f40 0x556629c61360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.035+0000 7fa9515f9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 0x556629c66430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa9515f9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 0x556629c68f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa9515f9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629bcf270 con 0x556629c60f40 2024-01-25T15:04:07.042 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa9515f9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629bcc960 con 0x556629c61930 2024-01-25T15:04:07.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa9515f9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629bc8250 con 0x556629c66aa0 2024-01-25T15:04:07.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa9457fa640 1 --2- 172.21.15.170:0/1524633017 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa9300a1430 0x7fa9300a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa94cfce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c60f40 0x556629c61360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa947fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 0x556629c66430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa9477fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 0x556629c68f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa94cfce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c60f40 0x556629c61360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56192/0 (socket says 172.21.15.170:56192) 2024-01-25T15:04:07.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa94cfce640 1 -- 172.21.15.170:0/1872209197 learned_addr learned my addr 172.21.15.170:0/1872209197 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa94cfce640 1 --2- 172.21.15.170:0/1524633017 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa9300a1430 0x7fa9300a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa9457fa640 1 -- 172.21.15.170:0/1524633017 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fa938014070 con 0x7fa9480ffbf0 2024-01-25T15:04:07.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa9477fe640 1 -- 172.21.15.170:0/1872209197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 msgr2=0x556629c66430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa9477fe640 1 --2- 172.21.15.170:0/1872209197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 0x556629c66430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa9477fe640 1 -- 172.21.15.170:0/1872209197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c60f40 msgr2=0x556629c61360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa9477fe640 1 --2- 172.21.15.170:0/1872209197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c60f40 0x556629c61360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa9477fe640 1 -- 172.21.15.170:0/1872209197 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556629b8a7f0 con 0x556629c66aa0 2024-01-25T15:04:07.043 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa94cfce640 1 --2- 172.21.15.170:0/1872209197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c60f40 0x556629c61360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa947fff640 1 --2- 172.21.15.170:0/1872209197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 0x556629c66430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa9477fe640 1 --2- 172.21.15.170:0/1872209197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 0x556629c68f30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009bd0 tx=0x7fa93c011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbffcbef3d50565b server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa94cfce640 1 --2- 172.21.15.170:0/1524633017 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa9300a1430 0x7fa9300a38f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x556629c62190 tx=0x7fa940032690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa92e7fc640 1 -- 172.21.15.170:0/1872209197 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c004230 con 0x556629c66aa0 2024-01-25T15:04:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa92e7fc640 1 -- 172.21.15.170:0/1872209197 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa93c009e40 con 0x556629c66aa0 2024-01-25T15:04:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.036+0000 7fa92e7fc640 1 -- 172.21.15.170:0/1872209197 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c004c40 con 0x556629c66aa0 2024-01-25T15:04:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.037+0000 7fa9515f9740 1 -- 172.21.15.170:0/1872209197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 msgr2=0x556629c68f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.037+0000 7fa9515f9740 1 --2- 172.21.15.170:0/1872209197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 0x556629c68f30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009bd0 tx=0x7fa93c011810 comp rx=0 tx=0).stop 2024-01-25T15:04:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.037+0000 7fa9515f9740 1 -- 172.21.15.170:0/1872209197 shutdown_connections 2024-01-25T15:04:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.037+0000 7fa9515f9740 1 --2- 172.21.15.170:0/1872209197 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 0x556629c66430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.037+0000 7fa9515f9740 1 --2- 172.21.15.170:0/1872209197 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 0x556629c68f30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.037+0000 7fa9515f9740 1 --2- 172.21.15.170:0/1872209197 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c60f40 0x556629c61360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.044 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.037+0000 7fa9515f9740 1 -- 172.21.15.170:0/1872209197 >> 172.21.15.170:0/1872209197 conn(0x556629c5c4b0 msgr2=0x556629c5c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.037+0000 7fa9515f9740 1 -- 172.21.15.170:0/1872209197 shutdown_connections 2024-01-25T15:04:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.037+0000 7fa9515f9740 1 -- 172.21.15.170:0/1872209197 wait complete. 2024-01-25T15:04:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.037+0000 7fa9515f9740 1 -- start start 2024-01-25T15:04:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9515f9740 1 Processor -- start 2024-01-25T15:04:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9515f9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c60f40 0x556629c6b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9515f9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c61930 0x556629c6b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9515f9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 0x556629c72620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9515f9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629b81610 con 0x556629c61930 2024-01-25T15:04:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9515f9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629b812b0 con 0x556629c60f40 2024-01-25T15:04:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9515f9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629b46400 con 0x556629c66aa0 2024-01-25T15:04:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9515f9740 10 client.0 _ll_register_callbacks cb 0x556629bbeee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9477fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c61930 0x556629c6b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9477fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c61930 0x556629c6b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56204/0 (socket says 172.21.15.170:56204) 2024-01-25T15:04:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9477fe640 1 -- 172.21.15.170:0/486302367 learned_addr learned my addr 172.21.15.170:0/486302367 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.045 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa94cfce640 1 --2- 172.21.15.170:0/486302367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 0x556629c72620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa947fff640 1 --2- 172.21.15.170:0/486302367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c60f40 0x556629c6b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9477fe640 1 -- 172.21.15.170:0/486302367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 msgr2=0x556629c72620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9477fe640 1 --2- 172.21.15.170:0/486302367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 0x556629c72620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9477fe640 1 -- 172.21.15.170:0/486302367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c60f40 msgr2=0x556629c6b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9477fe640 1 --2- 172.21.15.170:0/486302367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c60f40 0x556629c6b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9477fe640 1 -- 172.21.15.170:0/486302367 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93c009830 con 0x556629c61930 2024-01-25T15:04:07.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa947fff640 1 --2- 172.21.15.170:0/486302367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c60f40 0x556629c6b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:07.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9477fe640 1 --2- 172.21.15.170:0/486302367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c61930 0x556629c6b5e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa93c011d10 tx=0x7fa93c019b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3133c26db574f1eb server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.038+0000 7fa9277fe640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:07.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.039+0000 7fa9277fe640 1 -- 172.21.15.170:0/486302367 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93c024470 con 0x556629c61930 2024-01-25T15:04:07.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.039+0000 7fa9277fe640 1 -- 172.21.15.170:0/486302367 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fa93c0245d0 con 0x556629c61930 2024-01-25T15:04:07.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.039+0000 7fa9515f9740 1 -- 172.21.15.170:0/486302367 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556629bc10e0 con 0x556629c61930 2024-01-25T15:04:07.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.039+0000 7fa9277fe640 1 -- 172.21.15.170:0/486302367 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa93c024790 con 0x556629c61930 2024-01-25T15:04:07.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.039+0000 7fa9515f9740 10 client.16143 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:07.046 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.039+0000 7fa9515f9740 1 -- 172.21.15.170:0/486302367 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x556629bc68d0 con 0x556629c61930 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.039+0000 7fa9277fe640 1 -- 172.21.15.170:0/486302367 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556629bc10e0 con 0x556629c61930 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.039+0000 7fa9277fe640 1 -- 172.21.15.170:0/486302367 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fa93c023a90 con 0x556629c61930 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.039+0000 7fa9515f9740 10 client.16143 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.039+0000 7fa9515f9740 10 client.16143 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.039+0000 7fa9515f9740 20 client.16143 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.039+0000 7fa9515f9740 1 --2- 172.21.15.170:0/486302367 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x556629c76e80 0x556629c792a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.039+0000 7fa9515f9740 4 client.16143 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.039+0000 7fa9515f9740 1 -- 172.21.15.170:0/486302367 --> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556629bc0e00 con 0x556629c76e80 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.039+0000 7fa947fff640 1 --2- 172.21.15.170:0/486302367 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x556629c76e80 0x556629c792a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.040+0000 7fa9277fe640 10 client.16143 ms_handle_connect on v2:172.21.15.191:6832/274874056 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.040+0000 7fa947fff640 1 --2- 172.21.15.170:0/486302367 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x556629c76e80 0x556629c792a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e0b6c73f7cce8dd8 server_cookie=82b4992db298e144 in_seq=0 out_seq=0 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.041+0000 7fa9277fe640 1 -- 172.21.15.170:0/486302367 <== mds.3 v2:172.21.15.191:6832/274874056 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556629bc0e00 con 0x556629c76e80 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.041+0000 7fa9277fe640 10 client.16143 handle_command_reply: tid=0 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.041+0000 7fa9515f9740 1 client.16143 shutdown 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.041+0000 7fa9515f9740 1 -- 172.21.15.170:0/486302367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c61930 msgr2=0x556629c6b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.047 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.041+0000 7fa9515f9740 1 --2- 172.21.15.170:0/486302367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c61930 0x556629c6b5e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fa93c011d10 tx=0x7fa93c019b30 comp rx=0 tx=0).stop 2024-01-25T15:04:07.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.041+0000 7fa9515f9740 1 -- 172.21.15.170:0/486302367 shutdown_connections 2024-01-25T15:04:07.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.041+0000 7fa9515f9740 1 --2- 172.21.15.170:0/486302367 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x556629c76e80 0x556629c792a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.041+0000 7fa9515f9740 1 --2- 172.21.15.170:0/486302367 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 0x556629c72620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.041+0000 7fa9515f9740 1 --2- 172.21.15.170:0/486302367 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c61930 0x556629c6b5e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.041+0000 7fa9277fe640 0 client.16143 ms_handle_reset on v2:172.21.15.191:6832/274874056 2024-01-25T15:04:07.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.041+0000 7fa9515f9740 1 --2- 172.21.15.170:0/486302367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c60f40 0x556629c6b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.041+0000 7fa9515f9740 1 -- 172.21.15.170:0/486302367 >> 172.21.15.170:0/486302367 conn(0x556629c5c4b0 msgr2=0x556629c5b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.041+0000 7fa9515f9740 1 -- 172.21.15.170:0/486302367 shutdown_connections 2024-01-25T15:04:07.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.041+0000 7fa9515f9740 1 -- 172.21.15.170:0/486302367 wait complete. 2024-01-25T15:04:07.048 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.041+0000 7fa9515f9740 20 client.16143 trim_cache size 0 max 16384 2024-01-25T15:04:07.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa9515f9740 1 Processor -- start 2024-01-25T15:04:07.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa9515f9740 1 -- start start 2024-01-25T15:04:07.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa9515f9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c60f40 0x556629c7dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa9515f9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 0x556629c725e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa9515f9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c66aa0 0x556629c6b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa9515f9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629c73110 con 0x556629c66aa0 2024-01-25T15:04:07.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa9515f9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629c57f80 con 0x556629c61930 2024-01-25T15:04:07.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa9515f9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629c5c320 con 0x556629c60f40 2024-01-25T15:04:07.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa94cfce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c66aa0 0x556629c6b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa94cfce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c66aa0 0x556629c6b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56210/0 (socket says 172.21.15.170:56210) 2024-01-25T15:04:07.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa94cfce640 1 -- 172.21.15.170:0/1476641467 learned_addr learned my addr 172.21.15.170:0/1476641467 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa947fff640 1 --2- 172.21.15.170:0/1476641467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c60f40 0x556629c7dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa9477fe640 1 --2- 172.21.15.170:0/1476641467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 0x556629c725e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa94cfce640 1 -- 172.21.15.170:0/1476641467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c60f40 msgr2=0x556629c7dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa94cfce640 1 --2- 172.21.15.170:0/1476641467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c60f40 0x556629c7dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa94cfce640 1 -- 172.21.15.170:0/1476641467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 msgr2=0x556629c725e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa94cfce640 1 --2- 172.21.15.170:0/1476641467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 0x556629c725e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa94cfce640 1 -- 172.21.15.170:0/1476641467 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556629b63500 con 0x556629c66aa0 2024-01-25T15:04:07.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.053+0000 7fa94cfce640 1 --2- 172.21.15.170:0/1476641467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c66aa0 0x556629c6b0a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa940005e30 tx=0x7fa94002e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf0e70ab9e08a37 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.054+0000 7fa92dffb640 1 -- 172.21.15.170:0/1476641467 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940032990 con 0x556629c66aa0 2024-01-25T15:04:07.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.054+0000 7fa92dffb640 1 -- 172.21.15.170:0/1476641467 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa940032af0 con 0x556629c66aa0 2024-01-25T15:04:07.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.054+0000 7fa92dffb640 1 -- 172.21.15.170:0/1476641467 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940004830 con 0x556629c66aa0 2024-01-25T15:04:07.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.054+0000 7fa9515f9740 1 -- 172.21.15.170:0/1476641467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c66aa0 msgr2=0x556629c6b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.054+0000 7fa9515f9740 1 --2- 172.21.15.170:0/1476641467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c66aa0 0x556629c6b0a0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fa940005e30 tx=0x7fa94002e040 comp rx=0 tx=0).stop 2024-01-25T15:04:07.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.054+0000 7fa9515f9740 1 -- 172.21.15.170:0/1476641467 shutdown_connections 2024-01-25T15:04:07.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.054+0000 7fa9515f9740 1 --2- 172.21.15.170:0/1476641467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 0x556629c725e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.054+0000 7fa9515f9740 1 --2- 172.21.15.170:0/1476641467 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c66aa0 0x556629c6b0a0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.054+0000 7fa9515f9740 1 --2- 172.21.15.170:0/1476641467 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c60f40 0x556629c7dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.054+0000 7fa9515f9740 1 -- 172.21.15.170:0/1476641467 >> 172.21.15.170:0/1476641467 conn(0x556629c5c4b0 msgr2=0x556629c5c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.054+0000 7fa9515f9740 1 -- 172.21.15.170:0/1476641467 shutdown_connections 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.054+0000 7fa9515f9740 1 -- 172.21.15.170:0/1476641467 wait complete. 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.054+0000 7fa9515f9740 1 -- start start 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa9515f9740 1 Processor -- start 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa9515f9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c60f40 0x556629c71f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa9515f9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 0x556629c724a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa9515f9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 0x556629c70570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa9515f9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629c70c20 con 0x556629c60f40 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa9515f9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629c70d90 con 0x556629c61930 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa9515f9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x556629c70f50 con 0x556629c66aa0 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa9515f9740 10 client.0 _ll_register_callbacks cb 0x7fa93c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa947fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c60f40 0x556629c71f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa947fff640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c60f40 0x556629c71f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56212/0 (socket says 172.21.15.170:56212) 2024-01-25T15:04:07.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa947fff640 1 -- 172.21.15.170:0/1848139495 learned_addr learned my addr 172.21.15.170:0/1848139495 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa9477fe640 1 --2- 172.21.15.170:0/1848139495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 0x556629c724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa94cfce640 1 --2- 172.21.15.170:0/1848139495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 0x556629c70570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa947fff640 1 -- 172.21.15.170:0/1848139495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 msgr2=0x556629c70570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa947fff640 1 --2- 172.21.15.170:0/1848139495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 0x556629c70570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa947fff640 1 -- 172.21.15.170:0/1848139495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 msgr2=0x556629c724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa947fff640 1 --2- 172.21.15.170:0/1848139495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 0x556629c724a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa947fff640 1 -- 172.21.15.170:0/1848139495 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa940030070 con 0x556629c60f40 2024-01-25T15:04:07.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa947fff640 1 --2- 172.21.15.170:0/1848139495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c60f40 0x556629c71f60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa9380ca980 tx=0x7fa93806c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567a04296f6a1eb server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.055+0000 7fa9277fe640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:07.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.056+0000 7fa9277fe640 1 -- 172.21.15.170:0/1848139495 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93809e110 con 0x556629c60f40 2024-01-25T15:04:07.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.056+0000 7fa9277fe640 1 -- 172.21.15.170:0/1848139495 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fa9380cae40 con 0x556629c60f40 2024-01-25T15:04:07.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.056+0000 7fa9515f9740 1 -- 172.21.15.170:0/1848139495 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa93c009e40 con 0x556629c60f40 2024-01-25T15:04:07.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.056+0000 7fa9277fe640 1 -- 172.21.15.170:0/1848139495 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9380a2350 con 0x556629c60f40 2024-01-25T15:04:07.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.056+0000 7fa9515f9740 10 client.16149 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.056+0000 7fa9515f9740 1 -- 172.21.15.170:0/1848139495 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x556629b89050 con 0x556629c60f40 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.056+0000 7fa9277fe640 1 -- 172.21.15.170:0/1848139495 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa93c009e40 con 0x556629c60f40 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.056+0000 7fa9277fe640 1 -- 172.21.15.170:0/1848139495 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fa93801f060 con 0x556629c60f40 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.056+0000 7fa9515f9740 10 client.16149 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.056+0000 7fa9515f9740 10 client.16149 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.l 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.056+0000 7fa9515f9740 20 client.16149 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.056+0000 7fa9515f9740 1 --2- 172.21.15.170:0/1848139495 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x556629c76e80 0x556629cd08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.056+0000 7fa9515f9740 4 client.16149 mds_command: new command op to 24418 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.056+0000 7fa9515f9740 1 -- 172.21.15.170:0/1848139495 --> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5566298c77e0 con 0x556629c76e80 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.056+0000 7fa9477fe640 1 --2- 172.21.15.170:0/1848139495 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x556629c76e80 0x556629cd08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.057+0000 7fa9277fe640 10 client.16149 ms_handle_connect on v2:172.21.15.191:6832/274874056 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.057+0000 7fa9477fe640 1 --2- 172.21.15.170:0/1848139495 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x556629c76e80 0x556629cd08f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f35ef45af080ff14 server_cookie=e6ccc81a819b260a in_seq=0 out_seq=0 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa9277fe640 1 -- 172.21.15.170:0/1848139495 <== mds.3 v2:172.21.15.191:6832/274874056 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+40425 (crc 0 0 0) 0x5566298c77e0 con 0x556629c76e80 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa9277fe640 10 client.16149 handle_command_reply: tid=0 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa9515f9740 1 client.16149 shutdown 2024-01-25T15:04:07.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa9515f9740 1 -- 172.21.15.170:0/1848139495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c60f40 msgr2=0x556629c71f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa9515f9740 1 --2- 172.21.15.170:0/1848139495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c60f40 0x556629c71f60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa9380ca980 tx=0x7fa93806c0f0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa9515f9740 1 -- 172.21.15.170:0/1848139495 shutdown_connections 2024-01-25T15:04:07.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa9515f9740 1 --2- 172.21.15.170:0/1848139495 >> [v2:172.21.15.191:6832/274874056,v1:172.21.15.191:6833/274874056] conn(0x556629c76e80 0x556629cd08f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa9515f9740 1 --2- 172.21.15.170:0/1848139495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x556629c61930 0x556629c724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa9277fe640 0 client.16149 ms_handle_reset on v2:172.21.15.191:6832/274874056 2024-01-25T15:04:07.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa9515f9740 1 --2- 172.21.15.170:0/1848139495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x556629c66aa0 0x556629c70570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa9515f9740 1 --2- 172.21.15.170:0/1848139495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x556629c60f40 0x556629c71f60 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa9515f9740 1 -- 172.21.15.170:0/1848139495 >> 172.21.15.170:0/1848139495 conn(0x556629c5c4b0 msgr2=0x556629c7dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa9515f9740 1 -- 172.21.15.170:0/1848139495 shutdown_connections 2024-01-25T15:04:07.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa9515f9740 1 -- 172.21.15.170:0/1848139495 wait complete. 2024-01-25T15:04:07.064 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa9515f9740 20 client.16149 trim_cache size 0 max 16384 2024-01-25T15:04:07.065 INFO:teuthology.orchestra.run.smithi170.stdout:[ 2024-01-25T15:04:07.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.065 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.065 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 40817110, 2024-01-25T15:04:07.065 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633264, 2024-01-25T15:04:07.065 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/3-1.c" 2024-01-25T15:04:07.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.066 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.066 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 54517123, 2024-01-25T15:04:07.066 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630203, 2024-01-25T15:04:07.066 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_no_en" 2024-01-25T15:04:07.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.066 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.066 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 60738302, 2024-01-25T15:04:07.066 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632401, 2024-01-25T15:04:07.066 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/2-1.c" 2024-01-25T15:04:07.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.066 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.066 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 97902692, 2024-01-25T15:04:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632660, 2024-01-25T15:04:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/21-1.c" 2024-01-25T15:04:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 100186235, 2024-01-25T15:04:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629863, 2024-01-25T15:04:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-addr-addlarge" 2024-01-25T15:04:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 129388462, 2024-01-25T15:04:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629862, 2024-01-25T15:04:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-alias-addlarge" 2024-01-25T15:04:07.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.068 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.068 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 147675462, 2024-01-25T15:04:07.068 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631295, 2024-01-25T15:04:07.068 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.h" 2024-01-25T15:04:07.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.068 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.068 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 161987513, 2024-01-25T15:04:07.068 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631313, 2024-01-25T15:04:07.068 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.in" 2024-01-25T15:04:07.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.068 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.069 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 171051099, 2024-01-25T15:04:07.069 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511639954, 2024-01-25T15:04:07.069 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e" 2024-01-25T15:04:07.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.069 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.069 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 214062119, 2024-01-25T15:04:07.069 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631289, 2024-01-25T15:04:07.069 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_close.c" 2024-01-25T15:04:07.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.069 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.069 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 246288549, 2024-01-25T15:04:07.069 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630207, 2024-01-25T15:04:07.069 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_ripv" 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 346360765, 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632833, 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-1.c" 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 362651921, 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630208, 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal" 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.070 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 366945984, 2024-01-25T15:04:07.071 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631287, 2024-01-25T15:04:07.071 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_vshm_rdrs.c" 2024-01-25T15:04:07.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.071 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.071 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.071 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 390007368, 2024-01-25T15:04:07.071 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629932, 2024-01-25T15:04:07.071 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport07" 2024-01-25T15:04:07.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.071 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.071 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.071 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 413792472, 2024-01-25T15:04:07.071 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630204, 2024-01-25T15:04:07.071 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_over" 2024-01-25T15:04:07.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.072 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.072 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 425334181, 2024-01-25T15:04:07.072 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631310, 2024-01-25T15:04:07.072 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_rdrs.c" 2024-01-25T15:04:07.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.072 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.072 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 457395575, 2024-01-25T15:04:07.072 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631309, 2024-01-25T15:04:07.072 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_fru.c" 2024-01-25T15:04:07.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.072 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.072 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 459248751, 2024-01-25T15:04:07.073 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632637, 2024-01-25T15:04:07.073 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-1.c" 2024-01-25T15:04:07.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.073 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.073 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 559956669, 2024-01-25T15:04:07.073 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631314, 2024-01-25T15:04:07.073 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.am" 2024-01-25T15:04:07.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.073 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.073 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 563157570, 2024-01-25T15:04:07.073 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632639, 2024-01-25T15:04:07.073 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-3.c" 2024-01-25T15:04:07.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.074 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.074 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 602712220, 2024-01-25T15:04:07.074 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632647, 2024-01-25T15:04:07.074 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/14-1.c" 2024-01-25T15:04:07.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.074 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.074 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 617093959, 2024-01-25T15:04:07.074 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632638, 2024-01-25T15:04:07.074 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/22-2.c" 2024-01-25T15:04:07.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.074 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.074 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 618678563, 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629931, 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport01" 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 679040851, 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631298, 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/sync.c" 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 740632906, 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632831, 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/assertions.xml" 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.076 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.076 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 769473077, 2024-01-25T15:04:07.076 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629858, 2024-01-25T15:04:07.076 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-updown" 2024-01-25T15:04:07.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.076 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.076 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 793665142, 2024-01-25T15:04:07.076 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632636, 2024-01-25T15:04:07.076 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-3.c" 2024-01-25T15:04:07.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.076 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.076 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 876697081, 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631300, 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory_event.c" 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 880754053, 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632828, 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/testfrmw.h" 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 897663047, 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631312, 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_slot_rdrs.c" 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.078 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.078 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 921335001, 2024-01-25T15:04:07.078 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631306, 2024-01-25T15:04:07.078 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_mc_event.c" 2024-01-25T15:04:07.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.078 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.078 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 938869524, 2024-01-25T15:04:07.078 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632651, 2024-01-25T15:04:07.078 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/1-1.c" 2024-01-25T15:04:07.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.078 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.078 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1025588230, 2024-01-25T15:04:07.078 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629927, 2024-01-25T15:04:07.079 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport06" 2024-01-25T15:04:07.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.079 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.079 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1034546294, 2024-01-25T15:04:07.079 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629915, 2024-01-25T15:04:07.079 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-addr-adddel" 2024-01-25T15:04:07.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.079 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.079 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1043746019, 2024-01-25T15:04:07.079 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631301, 2024-01-25T15:04:07.079 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/posix_vlog.c" 2024-01-25T15:04:07.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1078890945, 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632402, 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/1-1.c" 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1087632359, 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632644, 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-4.c" 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1118116930, 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632657, 2024-01-25T15:04:07.080 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/3-1.sh" 2024-01-25T15:04:07.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.081 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.081 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1121026454, 2024-01-25T15:04:07.081 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632650, 2024-01-25T15:04:07.081 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/6-1.c" 2024-01-25T15:04:07.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.081 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.081 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1122125394, 2024-01-25T15:04:07.081 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629921, 2024-01-25T15:04:07.081 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/Makefile" 2024-01-25T15:04:07.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.082 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.082 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1159626659, 2024-01-25T15:04:07.082 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632666, 2024-01-25T15:04:07.082 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/16-1.c" 2024-01-25T15:04:07.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.082 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.082 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1217441459, 2024-01-25T15:04:07.082 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630185, 2024-01-25T15:04:07.082 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-updown" 2024-01-25T15:04:07.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.082 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.082 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1240844466, 2024-01-25T15:04:07.082 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631290, 2024-01-25T15:04:07.083 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/hotswap.c" 2024-01-25T15:04:07.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.083 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.083 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1260301265, 2024-01-25T15:04:07.083 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631305, 2024-01-25T15:04:07.083 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sel.c" 2024-01-25T15:04:07.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.083 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.083 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1269053039, 2024-01-25T15:04:07.083 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632668, 2024-01-25T15:04:07.083 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-1.c" 2024-01-25T15:04:07.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.084 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.084 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1318002477, 2024-01-25T15:04:07.084 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632825, 2024-01-25T15:04:07.084 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/coverage.txt" 2024-01-25T15:04:07.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.084 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.084 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1329004690, 2024-01-25T15:04:07.084 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631297, 2024-01-25T15:04:07.084 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.sym" 2024-01-25T15:04:07.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.085 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.085 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1340722008, 2024-01-25T15:04:07.085 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629916, 2024-01-25T15:04:07.085 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-route-adddel" 2024-01-25T15:04:07.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.085 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.085 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1452172427, 2024-01-25T15:04:07.085 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629929, 2024-01-25T15:04:07.085 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport04" 2024-01-25T15:04:07.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.085 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.086 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1452825976, 2024-01-25T15:04:07.086 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511639980, 2024-01-25T15:04:07.086 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/c44" 2024-01-25T15:04:07.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.086 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.086 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1468355763, 2024-01-25T15:04:07.086 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630795, 2024-01-25T15:04:07.086 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_eripv_timeout" 2024-01-25T15:04:07.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.086 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.086 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1472632720, 2024-01-25T15:04:07.086 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630205, 2024-01-25T15:04:07.087 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout" 2024-01-25T15:04:07.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.087 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.087 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1482793315, 2024-01-25T15:04:07.087 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632643, 2024-01-25T15:04:07.087 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-2.c" 2024-01-25T15:04:07.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.087 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.087 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1493744806, 2024-01-25T15:04:07.087 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629923, 2024-01-25T15:04:07.087 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport07" 2024-01-25T15:04:07.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.088 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.088 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1537241879, 2024-01-25T15:04:07.088 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629856, 2024-01-25T15:04:07.088 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/Makefile" 2024-01-25T15:04:07.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.088 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.088 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1553343911, 2024-01-25T15:04:07.088 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632826, 2024-01-25T15:04:07.088 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/1-2.c" 2024-01-25T15:04:07.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.089 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.089 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1578404930, 2024-01-25T15:04:07.089 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631311, 2024-01-25T15:04:07.089 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_util.c" 2024-01-25T15:04:07.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.089 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.089 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1581068907, 2024-01-25T15:04:07.089 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629914, 2024-01-25T15:04:07.089 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-mtu-change" 2024-01-25T15:04:07.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.089 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.089 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1696591600, 2024-01-25T15:04:07.090 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631288, 2024-01-25T15:04:07.090 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor_event.c" 2024-01-25T15:04:07.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.090 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.090 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1697622961, 2024-01-25T15:04:07.090 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629924, 2024-01-25T15:04:07.090 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/00_Descriptions.txt" 2024-01-25T15:04:07.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.090 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.090 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1718487072, 2024-01-25T15:04:07.090 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632663, 2024-01-25T15:04:07.090 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/22-1.c" 2024-01-25T15:04:07.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.091 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.091 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1808582807, 2024-01-25T15:04:07.091 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629864, 2024-01-25T15:04:07.091 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-mtu-change" 2024-01-25T15:04:07.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.091 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.091 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1839353533, 2024-01-25T15:04:07.091 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630069, 2024-01-25T15:04:07.091 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/xfscompat.h" 2024-01-25T15:04:07.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.092 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.092 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1866500803, 2024-01-25T15:04:07.092 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630196, 2024-01-25T15:04:07.092 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_mcip_timeout" 2024-01-25T15:04:07.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.092 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.092 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1890108412, 2024-01-25T15:04:07.092 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629920, 2024-01-25T15:04:07.092 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport05" 2024-01-25T15:04:07.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.092 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.092 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1902303838, 2024-01-25T15:04:07.093 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629857, 2024-01-25T15:04:07.093 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/00_Descriptions.txt" 2024-01-25T15:04:07.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.093 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.093 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1931117030, 2024-01-25T15:04:07.093 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632662, 2024-01-25T15:04:07.093 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/13-1.c" 2024-01-25T15:04:07.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.093 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.093 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1963208400, 2024-01-25T15:04:07.093 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631294, 2024-01-25T15:04:07.093 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_controls.c" 2024-01-25T15:04:07.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.094 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.094 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1971306396, 2024-01-25T15:04:07.094 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632655, 2024-01-25T15:04:07.094 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/assertions.xml" 2024-01-25T15:04:07.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.094 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.094 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1987818603, 2024-01-25T15:04:07.094 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631293, 2024-01-25T15:04:07.094 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ekeyfru.h" 2024-01-25T15:04:07.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.094 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.095 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2034379801, 2024-01-25T15:04:07.095 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632969, 2024-01-25T15:04:07.095 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/9-1.c" 2024-01-25T15:04:07.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.095 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.095 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2144496124, 2024-01-25T15:04:07.095 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632832, 2024-01-25T15:04:07.095 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-3.c" 2024-01-25T15:04:07.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.095 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.095 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2175109089, 2024-01-25T15:04:07.095 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511639968, 2024-01-25T15:04:07.096 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/d41" 2024-01-25T15:04:07.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.096 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.096 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2180390188, 2024-01-25T15:04:07.096 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630200, 2024-01-25T15:04:07.096 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uncorrected_timeout" 2024-01-25T15:04:07.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.096 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.096 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2207118636, 2024-01-25T15:04:07.096 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632661, 2024-01-25T15:04:07.096 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-6.c" 2024-01-25T15:04:07.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.097 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.097 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2216609938, 2024-01-25T15:04:07.097 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632889, 2024-01-25T15:04:07.097 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/coverage.txt" 2024-01-25T15:04:07.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.097 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.097 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2228761698, 2024-01-25T15:04:07.097 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631705, 2024-01-25T15:04:07.097 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity_event.c" 2024-01-25T15:04:07.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.097 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.097 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2231039598, 2024-01-25T15:04:07.098 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629917, 2024-01-25T15:04:07.098 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-route-adddel" 2024-01-25T15:04:07.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.098 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.098 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2296848463, 2024-01-25T15:04:07.098 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630198, 2024-01-25T15:04:07.098 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/unknown" 2024-01-25T15:04:07.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.098 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.098 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2352533229, 2024-01-25T15:04:07.098 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630195, 2024-01-25T15:04:07.098 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/fatal_severity" 2024-01-25T15:04:07.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.099 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.099 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2375209234, 2024-01-25T15:04:07.099 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632658, 2024-01-25T15:04:07.099 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/12-1.c" 2024-01-25T15:04:07.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.099 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.099 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2387731079, 2024-01-25T15:04:07.099 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631316, 2024-01-25T15:04:07.099 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor.c" 2024-01-25T15:04:07.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.099 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.100 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2407668433, 2024-01-25T15:04:07.100 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632648, 2024-01-25T15:04:07.100 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/2-1.c" 2024-01-25T15:04:07.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.100 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.100 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2471814256, 2024-01-25T15:04:07.100 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631302, 2024-01-25T15:04:07.100 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.c" 2024-01-25T15:04:07.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.100 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.100 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2497875103, 2024-01-25T15:04:07.100 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632667, 2024-01-25T15:04:07.101 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/11-1.c" 2024-01-25T15:04:07.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.101 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.101 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2530163701, 2024-01-25T15:04:07.101 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633272, 2024-01-25T15:04:07.101 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_join/speculative/6-1.c" 2024-01-25T15:04:07.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.101 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.101 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2539094781, 2024-01-25T15:04:07.101 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629930, 2024-01-25T15:04:07.101 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport04" 2024-01-25T15:04:07.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.102 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.102 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2553555280, 2024-01-25T15:04:07.102 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629926, 2024-01-25T15:04:07.102 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport02" 2024-01-25T15:04:07.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.102 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.102 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2618005928, 2024-01-25T15:04:07.102 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631292, 2024-01-25T15:04:07.102 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_connection.c" 2024-01-25T15:04:07.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.102 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.103 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2618687944, 2024-01-25T15:04:07.103 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632659, 2024-01-25T15:04:07.103 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/7-1.c" 2024-01-25T15:04:07.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.103 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.103 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2650561548, 2024-01-25T15:04:07.103 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629860, 2024-01-25T15:04:07.103 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-alias-adddel" 2024-01-25T15:04:07.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.103 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.103 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2656137780, 2024-01-25T15:04:07.103 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632652, 2024-01-25T15:04:07.103 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-4.c" 2024-01-25T15:04:07.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.104 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.104 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2658749483, 2024-01-25T15:04:07.104 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629861, 2024-01-25T15:04:07.104 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-addr-change" 2024-01-25T15:04:07.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.104 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.104 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2680704102, 2024-01-25T15:04:07.104 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632642, 2024-01-25T15:04:07.104 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-2.c" 2024-01-25T15:04:07.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.105 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.105 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2717464677, 2024-01-25T15:04:07.105 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632640, 2024-01-25T15:04:07.105 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/coverage.txt" 2024-01-25T15:04:07.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.105 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.105 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2732421072, 2024-01-25T15:04:07.105 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631706, 2024-01-25T15:04:07.105 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t" 2024-01-25T15:04:07.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.105 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.106 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2735039626, 2024-01-25T15:04:07.106 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631304, 2024-01-25T15:04:07.106 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity.c" 2024-01-25T15:04:07.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.106 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.106 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2760040219, 2024-01-25T15:04:07.106 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630067, 2024-01-25T15:04:07.106 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/nfs_fsstress.sh" 2024-01-25T15:04:07.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.106 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.106 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2792849645, 2024-01-25T15:04:07.106 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629865, 2024-01-25T15:04:07.106 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-route-addlarge" 2024-01-25T15:04:07.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.107 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.107 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2879076960, 2024-01-25T15:04:07.107 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632649, 2024-01-25T15:04:07.107 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/5-1.c" 2024-01-25T15:04:07.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.107 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.107 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2899707843, 2024-01-25T15:04:07.107 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630201, 2024-01-25T15:04:07.107 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_irq" 2024-01-25T15:04:07.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.108 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.108 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2959002492, 2024-01-25T15:04:07.108 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631308, 2024-01-25T15:04:07.108 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.in" 2024-01-25T15:04:07.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.108 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.108 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2980719304, 2024-01-25T15:04:07.108 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631307, 2024-01-25T15:04:07.108 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_fru_rdrs.c" 2024-01-25T15:04:07.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.108 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.108 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3006469527, 2024-01-25T15:04:07.109 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631291, 2024-01-25T15:04:07.109 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_control_event.c" 2024-01-25T15:04:07.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.109 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.109 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3034015030, 2024-01-25T15:04:07.109 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632827, 2024-01-25T15:04:07.109 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/testfrmw.c" 2024-01-25T15:04:07.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.109 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.109 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3073954346, 2024-01-25T15:04:07.109 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632664, 2024-01-25T15:04:07.109 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/4-1.c" 2024-01-25T15:04:07.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.110 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.110 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3084967073, 2024-01-25T15:04:07.110 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632665, 2024-01-25T15:04:07.110 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-5.c" 2024-01-25T15:04:07.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.110 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.110 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3090365525, 2024-01-25T15:04:07.110 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632641, 2024-01-25T15:04:07.110 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-5.c" 2024-01-25T15:04:07.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.110 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.111 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3116863435, 2024-01-25T15:04:07.111 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629925, 2024-01-25T15:04:07.111 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport06" 2024-01-25T15:04:07.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.111 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.111 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3168990346, 2024-01-25T15:04:07.111 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511639914, 2024-01-25T15:04:07.111 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/f38" 2024-01-25T15:04:07.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.111 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.111 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3179182018, 2024-01-25T15:04:07.111 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630194, 2024-01-25T15:04:07.111 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uncorrected" 2024-01-25T15:04:07.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.112 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.112 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3186183588, 2024-01-25T15:04:07.112 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629859, 2024-01-25T15:04:07.112 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-route-addlarge" 2024-01-25T15:04:07.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.112 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.112 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3198470111, 2024-01-25T15:04:07.112 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632654, 2024-01-25T15:04:07.112 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/15-1.c" 2024-01-25T15:04:07.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.113 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.113 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3219795460, 2024-01-25T15:04:07.113 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632829, 2024-01-25T15:04:07.113 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/2-1.c" 2024-01-25T15:04:07.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.113 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.113 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3296481586, 2024-01-25T15:04:07.113 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632656, 2024-01-25T15:04:07.113 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/15-2.c" 2024-01-25T15:04:07.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.113 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.114 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3366020769, 2024-01-25T15:04:07.114 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629922, 2024-01-25T15:04:07.114 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport01" 2024-01-25T15:04:07.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.114 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.114 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3374801713, 2024-01-25T15:04:07.114 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511640004, 2024-01-25T15:04:07.114 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/f46" 2024-01-25T15:04:07.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.114 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.114 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3382088107, 2024-01-25T15:04:07.114 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632646, 2024-01-25T15:04:07.115 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/8-1.sh" 2024-01-25T15:04:07.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.115 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.115 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3394422422, 2024-01-25T15:04:07.115 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511639242, 2024-01-25T15:04:07.115 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/f47" 2024-01-25T15:04:07.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.115 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.115 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3410381821, 2024-01-25T15:04:07.115 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632403, 2024-01-25T15:04:07.115 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/assertions.xml" 2024-01-25T15:04:07.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.116 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.116 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3523109685, 2024-01-25T15:04:07.116 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632830, 2024-01-25T15:04:07.116 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/1-1.c" 2024-01-25T15:04:07.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.116 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.116 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3526905536, 2024-01-25T15:04:07.116 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630493, 2024-01-25T15:04:07.116 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/global.h" 2024-01-25T15:04:07.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.117 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.117 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3540579560, 2024-01-25T15:04:07.117 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630202, 2024-01-25T15:04:07.117 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_eipv" 2024-01-25T15:04:07.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.117 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.117 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3603038744, 2024-01-25T15:04:07.117 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629928, 2024-01-25T15:04:07.117 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport03" 2024-01-25T15:04:07.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.117 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.117 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3613497037, 2024-01-25T15:04:07.118 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630068, 2024-01-25T15:04:07.118 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/Makefile" 2024-01-25T15:04:07.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.118 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.118 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3620340435, 2024-01-25T15:04:07.118 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631315, 2024-01-25T15:04:07.118 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.am" 2024-01-25T15:04:07.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.118 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.118 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3717146236, 2024-01-25T15:04:07.118 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631296, 2024-01-25T15:04:07.118 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory.c" 2024-01-25T15:04:07.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.119 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.119 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3737034345, 2024-01-25T15:04:07.119 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632634, 2024-01-25T15:04:07.119 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/20-1.c" 2024-01-25T15:04:07.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.119 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.119 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3782659486, 2024-01-25T15:04:07.119 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630801, 2024-01-25T15:04:07.119 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_userspace" 2024-01-25T15:04:07.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.119 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.120 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3793837154, 2024-01-25T15:04:07.120 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630197, 2024-01-25T15:04:07.120 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_mcip" 2024-01-25T15:04:07.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.120 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.120 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3925198208, 2024-01-25T15:04:07.120 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631707, 2024-01-25T15:04:07.120 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/ipmi_thres_test.c" 2024-01-25T15:04:07.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.120 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.120 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3933702280, 2024-01-25T15:04:07.120 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631299, 2024-01-25T15:04:07.121 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_drv.c" 2024-01-25T15:04:07.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.121 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.121 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4010624224, 2024-01-25T15:04:07.121 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630206, 2024-01-25T15:04:07.121 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout_ripv" 2024-01-25T15:04:07.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.121 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.121 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4040829761, 2024-01-25T15:04:07.121 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629919, 2024-01-25T15:04:07.121 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport02" 2024-01-25T15:04:07.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.122 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.122 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4087387650, 2024-01-25T15:04:07.122 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632653, 2024-01-25T15:04:07.122 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/18-1.sh" 2024-01-25T15:04:07.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.122 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.122 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4131054599, 2024-01-25T15:04:07.122 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631303, 2024-01-25T15:04:07.122 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_event.c" 2024-01-25T15:04:07.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.122 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.123 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4140879910, 2024-01-25T15:04:07.123 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632645, 2024-01-25T15:04:07.123 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-7.c" 2024-01-25T15:04:07.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.123 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.123 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4215769699, 2024-01-25T15:04:07.123 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630439, 2024-01-25T15:04:07.123 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport03" 2024-01-25T15:04:07.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.123 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.123 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4217853198, 2024-01-25T15:04:07.124 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632824, 2024-01-25T15:04:07.124 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-2.c" 2024-01-25T15:04:07.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.124 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.124 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4234710027, 2024-01-25T15:04:07.124 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630070, 2024-01-25T15:04:07.124 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/fsstress.c" 2024-01-25T15:04:07.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.124 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.124 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4234991015, 2024-01-25T15:04:07.124 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629918, 2024-01-25T15:04:07.125 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport05" 2024-01-25T15:04:07.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.125 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.125 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4242290153, 2024-01-25T15:04:07.125 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632635, 2024-01-25T15:04:07.125 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/10-1.c" 2024-01-25T15:04:07.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.125 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.125 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4273114844, 2024-01-25T15:04:07.125 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630199, 2024-01-25T15:04:07.125 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_eripv" 2024-01-25T15:04:07.125 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:07.125 INFO:teuthology.orchestra.run.smithi170.stdout:] 2024-01-25T15:04:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa94ea31640 1 -- 172.21.15.170:0/1524633017 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa9300a1430 msgr2=0x7fa9300a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa94ea31640 1 --2- 172.21.15.170:0/1524633017 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa9300a1430 0x7fa9300a38f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x556629c62190 tx=0x7fa940032690 comp rx=0 tx=0).stop 2024-01-25T15:04:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa94ea31640 1 -- 172.21.15.170:0/1524633017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9480ffbf0 msgr2=0x7fa9480689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.058+0000 7fa94ea31640 1 --2- 172.21.15.170:0/1524633017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9480ffbf0 0x7fa9480689e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa93800e9c0 tx=0x7fa93800ee80 comp rx=0 tx=0).stop 2024-01-25T15:04:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.059+0000 7fa94ea31640 1 -- 172.21.15.170:0/1524633017 shutdown_connections 2024-01-25T15:04:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.059+0000 7fa94ea31640 1 --2- 172.21.15.170:0/1524633017 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fa9300a1430 0x7fa9300a38f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.059+0000 7fa94ea31640 1 --2- 172.21.15.170:0/1524633017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa9481017a0 0x7fa94819e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.059+0000 7fa94ea31640 1 --2- 172.21.15.170:0/1524633017 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fa948100de0 0x7fa94819b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.059+0000 7fa94ea31640 1 --2- 172.21.15.170:0/1524633017 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fa9480ffbf0 0x7fa9480689e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.059+0000 7fa94ea31640 1 -- 172.21.15.170:0/1524633017 >> 172.21.15.170:0/1524633017 conn(0x7fa9480fb180 msgr2=0x7fa948104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.127 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.059+0000 7fa94ea31640 1 -- 172.21.15.170:0/1524633017 shutdown_connections 2024-01-25T15:04:07.128 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.059+0000 7fa94ea31640 1 -- 172.21.15.170:0/1524633017 wait complete. 2024-01-25T15:04:07.128 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-01-25T15:04:07.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.240+0000 7f60a3389640 1 -- 172.21.15.170:0/3066072527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f609c0fefb0 msgr2=0x7f609c0ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.240+0000 7f60a3389640 1 --2- 172.21.15.170:0/3066072527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f609c0fefb0 0x7f609c0ff3d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6098009900 tx=0x7f609802bc30 comp rx=0 tx=0).stop 2024-01-25T15:04:07.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.240+0000 7f60a3389640 1 -- 172.21.15.170:0/3066072527 shutdown_connections 2024-01-25T15:04:07.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.240+0000 7f60a3389640 1 --2- 172.21.15.170:0/3066072527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f609c101f80 0x7f609c102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.240+0000 7f60a3389640 1 --2- 172.21.15.170:0/3066072527 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f609c102940 0x7f609c1091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.240+0000 7f60a3389640 1 --2- 172.21.15.170:0/3066072527 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f609c0fefb0 0x7f609c0ff3d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.240+0000 7f60a3389640 1 -- 172.21.15.170:0/3066072527 >> 172.21.15.170:0/3066072527 conn(0x7f609c0fa8e0 msgr2=0x7f609c0fcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.240+0000 7f60a3389640 1 -- 172.21.15.170:0/3066072527 shutdown_connections 2024-01-25T15:04:07.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.240+0000 7f60a3389640 1 -- 172.21.15.170:0/3066072527 wait complete. 2024-01-25T15:04:07.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a3389640 1 Processor -- start 2024-01-25T15:04:07.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a3389640 1 -- start start 2024-01-25T15:04:07.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a3389640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f609c0fefb0 0x7f609c196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a3389640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f609c101f80 0x7f609c197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a3389640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f609c102940 0x7f609c19e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a3389640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c19e810 con 0x7f609c0fefb0 2024-01-25T15:04:07.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a3389640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c19e980 con 0x7f609c101f80 2024-01-25T15:04:07.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a3389640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c19eb40 con 0x7f609c102940 2024-01-25T15:04:07.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a1125640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f609c0fefb0 0x7f609c196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a1125640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f609c0fefb0 0x7f609c196d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56230/0 (socket says 172.21.15.170:56230) 2024-01-25T15:04:07.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a1125640 1 -- 172.21.15.170:0/1272023591 learned_addr learned my addr 172.21.15.170:0/1272023591 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a1926640 1 --2- 172.21.15.170:0/1272023591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f609c102940 0x7f609c19e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a0924640 1 --2- 172.21.15.170:0/1272023591 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f609c101f80 0x7f609c197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a1125640 1 -- 172.21.15.170:0/1272023591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f609c102940 msgr2=0x7f609c19e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a1125640 1 --2- 172.21.15.170:0/1272023591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f609c102940 0x7f609c19e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a1125640 1 -- 172.21.15.170:0/1272023591 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f609c101f80 msgr2=0x7f609c197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a1125640 1 --2- 172.21.15.170:0/1272023591 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f609c101f80 0x7f609c197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.241+0000 7f60a1125640 1 -- 172.21.15.170:0/1272023591 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6098009560 con 0x7f609c0fefb0 2024-01-25T15:04:07.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.242+0000 7f60a1125640 1 --2- 172.21.15.170:0/1272023591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f609c0fefb0 0x7f609c196d30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6098009230 tx=0x7f6098004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.242+0000 7f60927fc640 1 -- 172.21.15.170:0/1272023591 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980043d0 con 0x7f609c0fefb0 2024-01-25T15:04:07.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.242+0000 7f60927fc640 1 -- 172.21.15.170:0/1272023591 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60980054c0 con 0x7f609c0fefb0 2024-01-25T15:04:07.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.242+0000 7f60927fc640 1 -- 172.21.15.170:0/1272023591 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6098003e50 con 0x7f609c0fefb0 2024-01-25T15:04:07.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.242+0000 7f60a3389640 1 -- 172.21.15.170:0/1272023591 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c19edc0 con 0x7f609c0fefb0 2024-01-25T15:04:07.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.242+0000 7f60a3389640 1 -- 172.21.15.170:0/1272023591 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c19f1c0 con 0x7f609c0fefb0 2024-01-25T15:04:07.251 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.244+0000 7f60927fc640 1 -- 172.21.15.170:0/1272023591 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f60980035f0 con 0x7f609c0fefb0 2024-01-25T15:04:07.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a6024740 1 Processor -- start 2024-01-25T15:04:07.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a6024740 1 -- start start 2024-01-25T15:04:07.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60927fc640 1 --2- 172.21.15.170:0/1272023591 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f60880a12e0 0x7f60880a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a6024740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a34f40 0x55e9c1a35360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a6024740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a35930 0x55e9c1a3a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a6024740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a3aaa0 0x55e9c1a3cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a6024740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c19a3270 con 0x55e9c1a35930 2024-01-25T15:04:07.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a6024740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c19a0960 con 0x55e9c1a3aaa0 2024-01-25T15:04:07.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a6024740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c199c250 con 0x55e9c1a34f40 2024-01-25T15:04:07.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a0924640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a35930 0x55e9c1a3a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a1125640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a34f40 0x55e9c1a35360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.252 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60927fc640 1 -- 172.21.15.170:0/1272023591 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f60980ef450 con 0x7f609c0fefb0 2024-01-25T15:04:07.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a1926640 1 --2- 172.21.15.170:0/1272023591 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f60880a12e0 0x7f60880a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a0924640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a35930 0x55e9c1a3a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56244/0 (socket says 172.21.15.170:56244) 2024-01-25T15:04:07.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a1125640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a34f40 0x55e9c1a35360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:55156/0 (socket says 172.21.15.170:55156) 2024-01-25T15:04:07.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a0924640 1 -- 172.21.15.170:0/2230416383 learned_addr learned my addr 172.21.15.170:0/2230416383 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a1926640 1 --2- 172.21.15.170:0/2230416383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a3aaa0 0x55e9c1a3cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a0924640 1 -- 172.21.15.170:0/2230416383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a34f40 msgr2=0x55e9c1a35360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a0924640 1 --2- 172.21.15.170:0/2230416383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a34f40 0x55e9c1a35360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a0924640 1 -- 172.21.15.170:0/2230416383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a3aaa0 msgr2=0x55e9c1a3cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.245+0000 7f60a0924640 1 --2- 172.21.15.170:0/2230416383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a3aaa0 0x55e9c1a3cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.246+0000 7f60a0924640 1 -- 172.21.15.170:0/2230416383 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9c195e7f0 con 0x55e9c1a35930 2024-01-25T15:04:07.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.246+0000 7f60a1125640 1 --2- 172.21.15.170:0/2230416383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a34f40 0x55e9c1a35360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:07.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.246+0000 7f60a1926640 1 --2- 172.21.15.170:0/1272023591 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f60880a12e0 0x7f60880a37a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f60940098b0 tx=0x7f6094009e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.246+0000 7f60a0924640 1 --2- 172.21.15.170:0/2230416383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a35930 0x55e9c1a3a430 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f608c009cf0 tx=0x7f608c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45209aef2ab66397 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.246+0000 7f60877fe640 1 -- 172.21.15.170:0/2230416383 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c009ea0 con 0x55e9c1a35930 2024-01-25T15:04:07.253 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.246+0000 7f60877fe640 1 -- 172.21.15.170:0/2230416383 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f608c004230 con 0x55e9c1a35930 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.246+0000 7f60877fe640 1 -- 172.21.15.170:0/2230416383 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c019790 con 0x55e9c1a35930 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.247+0000 7f60a6024740 1 -- 172.21.15.170:0/2230416383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a35930 msgr2=0x55e9c1a3a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.247+0000 7f60a6024740 1 --2- 172.21.15.170:0/2230416383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a35930 0x55e9c1a3a430 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f608c009cf0 tx=0x7f608c011810 comp rx=0 tx=0).stop 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.247+0000 7f60a6024740 1 -- 172.21.15.170:0/2230416383 shutdown_connections 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.247+0000 7f60a6024740 1 --2- 172.21.15.170:0/2230416383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a3aaa0 0x55e9c1a3cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.247+0000 7f60a6024740 1 --2- 172.21.15.170:0/2230416383 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a35930 0x55e9c1a3a430 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.247+0000 7f60a6024740 1 --2- 172.21.15.170:0/2230416383 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a34f40 0x55e9c1a35360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.247+0000 7f60a6024740 1 -- 172.21.15.170:0/2230416383 >> 172.21.15.170:0/2230416383 conn(0x55e9c1a304b0 msgr2=0x55e9c1a308b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.247+0000 7f60a6024740 1 -- 172.21.15.170:0/2230416383 shutdown_connections 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.247+0000 7f60a6024740 1 -- 172.21.15.170:0/2230416383 wait complete. 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.247+0000 7f60a6024740 1 -- start start 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.247+0000 7f60a6024740 1 Processor -- start 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a6024740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a34f40 0x55e9c1a3f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a6024740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a35930 0x55e9c1a3f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a6024740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a3aaa0 0x55e9c1a466b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.254 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a6024740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c1955610 con 0x55e9c1a35930 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a6024740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c19552b0 con 0x55e9c1a3aaa0 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a6024740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c191a400 con 0x55e9c1a34f40 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a6024740 10 client.0 _ll_register_callbacks cb 0x55e9c1992ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a0924640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a35930 0x55e9c1a3f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a1926640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a3aaa0 0x55e9c1a466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a0924640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a35930 0x55e9c1a3f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56248/0 (socket says 172.21.15.170:56248) 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a0924640 1 -- 172.21.15.170:0/942701658 learned_addr learned my addr 172.21.15.170:0/942701658 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a1125640 1 --2- 172.21.15.170:0/942701658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a34f40 0x55e9c1a3f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a0924640 1 -- 172.21.15.170:0/942701658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a34f40 msgr2=0x55e9c1a3f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a0924640 1 --2- 172.21.15.170:0/942701658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a34f40 0x55e9c1a3f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a0924640 1 -- 172.21.15.170:0/942701658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a3aaa0 msgr2=0x55e9c1a466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a0924640 1 --2- 172.21.15.170:0/942701658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a3aaa0 0x55e9c1a466b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a0924640 1 -- 172.21.15.170:0/942701658 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608c009950 con 0x55e9c1a35930 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a1926640 1 --2- 172.21.15.170:0/942701658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a3aaa0 0x55e9c1a466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a0924640 1 --2- 172.21.15.170:0/942701658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a35930 0x55e9c1a3f670 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f608c0041c0 tx=0x7f608c005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4ecdef2e2adb6f server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.255 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f6084ff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:07.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f6084ff9640 1 -- 172.21.15.170:0/942701658 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c005240 con 0x55e9c1a35930 2024-01-25T15:04:07.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f6084ff9640 1 -- 172.21.15.170:0/942701658 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f608c0053a0 con 0x55e9c1a35930 2024-01-25T15:04:07.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a6024740 1 -- 172.21.15.170:0/942701658 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9c19950e0 con 0x55e9c1a35930 2024-01-25T15:04:07.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f6084ff9640 1 -- 172.21.15.170:0/942701658 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f608c009ea0 con 0x55e9c1a35930 2024-01-25T15:04:07.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.248+0000 7f60a6024740 10 client.16161 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:07.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.249+0000 7f60a6024740 1 -- 172.21.15.170:0/942701658 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55e9c199a8d0 con 0x55e9c1a35930 2024-01-25T15:04:07.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.249+0000 7f6084ff9640 1 -- 172.21.15.170:0/942701658 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e9c19950e0 con 0x55e9c1a35930 2024-01-25T15:04:07.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.249+0000 7f6084ff9640 1 -- 172.21.15.170:0/942701658 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f608c021040 con 0x55e9c1a35930 2024-01-25T15:04:07.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.249+0000 7f60a6024740 10 client.16161 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:07.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.249+0000 7f60a6024740 10 client.16161 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-01-25T15:04:07.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.249+0000 7f60a6024740 20 client.16161 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:07.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.249+0000 7f60a6024740 1 --2- 172.21.15.170:0/942701658 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55e9c1a4af40 0x55e9c1a4d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.249+0000 7f60a6024740 4 client.16161 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:04:07.256 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.249+0000 7f60a6024740 1 -- 172.21.15.170:0/942701658 --> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9c1994e00 con 0x55e9c1a4af40 2024-01-25T15:04:07.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.249+0000 7f60a1125640 1 --2- 172.21.15.170:0/942701658 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55e9c1a4af40 0x55e9c1a4d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.249+0000 7f6084ff9640 10 client.16161 ms_handle_connect on v2:172.21.15.191:6836/719224494 2024-01-25T15:04:07.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.249+0000 7f60a1125640 1 --2- 172.21.15.170:0/942701658 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55e9c1a4af40 0x55e9c1a4d360 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=122aa407924394f4 server_cookie=703a4dbcc6a3eaff in_seq=0 out_seq=0 2024-01-25T15:04:07.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.250+0000 7f6084ff9640 1 -- 172.21.15.170:0/942701658 <== mds.2 v2:172.21.15.191:6836/719224494 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e9c1994e00 con 0x55e9c1a4af40 2024-01-25T15:04:07.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.250+0000 7f6084ff9640 10 client.16161 handle_command_reply: tid=0 2024-01-25T15:04:07.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.250+0000 7f60a6024740 1 client.16161 shutdown 2024-01-25T15:04:07.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.251+0000 7f60a6024740 1 -- 172.21.15.170:0/942701658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a35930 msgr2=0x55e9c1a3f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.251+0000 7f60a6024740 1 --2- 172.21.15.170:0/942701658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a35930 0x55e9c1a3f670 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f608c0041c0 tx=0x7f608c005db0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.251+0000 7f60a6024740 1 -- 172.21.15.170:0/942701658 shutdown_connections 2024-01-25T15:04:07.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.251+0000 7f60a6024740 1 --2- 172.21.15.170:0/942701658 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55e9c1a4af40 0x55e9c1a4d360 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.251+0000 7f6084ff9640 0 client.16161 ms_handle_reset on v2:172.21.15.191:6836/719224494 2024-01-25T15:04:07.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.251+0000 7f60a6024740 1 --2- 172.21.15.170:0/942701658 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a3aaa0 0x55e9c1a466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.251+0000 7f60a6024740 1 --2- 172.21.15.170:0/942701658 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a35930 0x55e9c1a3f670 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.251+0000 7f60a6024740 1 --2- 172.21.15.170:0/942701658 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a34f40 0x55e9c1a3f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.257 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.251+0000 7f60a6024740 1 -- 172.21.15.170:0/942701658 >> 172.21.15.170:0/942701658 conn(0x55e9c1a304b0 msgr2=0x55e9c1a2f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.251+0000 7f60a6024740 1 -- 172.21.15.170:0/942701658 shutdown_connections 2024-01-25T15:04:07.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.251+0000 7f60a6024740 1 -- 172.21.15.170:0/942701658 wait complete. 2024-01-25T15:04:07.258 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.251+0000 7f60a6024740 20 client.16161 trim_cache size 0 max 16384 2024-01-25T15:04:07.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.266+0000 7f60a6024740 1 Processor -- start 2024-01-25T15:04:07.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.266+0000 7f60a6024740 1 -- start start 2024-01-25T15:04:07.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.266+0000 7f60a6024740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a304b0 0x55e9c1a3e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a6024740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a34f40 0x55e9c1a46670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a6024740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a35930 0x55e9c1a3e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.268 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a6024740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c19950e0 con 0x55e9c1a34f40 2024-01-25T15:04:07.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a6024740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c1a3d3f0 con 0x55e9c1a304b0 2024-01-25T15:04:07.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a6024740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c1a47810 con 0x55e9c1a35930 2024-01-25T15:04:07.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a0924640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a34f40 0x55e9c1a46670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a1125640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a304b0 0x55e9c1a3e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a0924640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a34f40 0x55e9c1a46670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56264/0 (socket says 172.21.15.170:56264) 2024-01-25T15:04:07.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a0924640 1 -- 172.21.15.170:0/3731563725 learned_addr learned my addr 172.21.15.170:0/3731563725 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a1926640 1 --2- 172.21.15.170:0/3731563725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a35930 0x55e9c1a3e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a0924640 1 -- 172.21.15.170:0/3731563725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a35930 msgr2=0x55e9c1a3e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a0924640 1 --2- 172.21.15.170:0/3731563725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a35930 0x55e9c1a3e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a0924640 1 -- 172.21.15.170:0/3731563725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a304b0 msgr2=0x55e9c1a3e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a0924640 1 --2- 172.21.15.170:0/3731563725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a304b0 0x55e9c1a3e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a0924640 1 -- 172.21.15.170:0/3731563725 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9c1937500 con 0x55e9c1a34f40 2024-01-25T15:04:07.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a1125640 1 --2- 172.21.15.170:0/3731563725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a304b0 0x55e9c1a3e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:07.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f60a0924640 1 --2- 172.21.15.170:0/3731563725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a34f40 0x55e9c1a46670 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f608c005d80 tx=0x7f608c009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f64c2d782d6f76c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.269 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f6086ffd640 1 -- 172.21.15.170:0/3731563725 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c003d40 con 0x55e9c1a34f40 2024-01-25T15:04:07.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f6086ffd640 1 -- 172.21.15.170:0/3731563725 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f608c009ea0 con 0x55e9c1a34f40 2024-01-25T15:04:07.270 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.267+0000 7f6086ffd640 1 -- 172.21.15.170:0/3731563725 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0055f0 con 0x55e9c1a34f40 2024-01-25T15:04:07.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.268+0000 7f60a6024740 1 -- 172.21.15.170:0/3731563725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a34f40 msgr2=0x55e9c1a46670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.268+0000 7f60a6024740 1 --2- 172.21.15.170:0/3731563725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a34f40 0x55e9c1a46670 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f608c005d80 tx=0x7f608c009850 comp rx=0 tx=0).stop 2024-01-25T15:04:07.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.268+0000 7f60a6024740 1 -- 172.21.15.170:0/3731563725 shutdown_connections 2024-01-25T15:04:07.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.268+0000 7f60a6024740 1 --2- 172.21.15.170:0/3731563725 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a35930 0x55e9c1a3e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.268+0000 7f60a6024740 1 --2- 172.21.15.170:0/3731563725 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a34f40 0x55e9c1a46670 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.268+0000 7f60a6024740 1 --2- 172.21.15.170:0/3731563725 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a304b0 0x55e9c1a3e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.268+0000 7f60a6024740 1 -- 172.21.15.170:0/3731563725 >> 172.21.15.170:0/3731563725 conn(0x55e9c1a36710 msgr2=0x55e9c1a36df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.268+0000 7f60a6024740 1 -- 172.21.15.170:0/3731563725 shutdown_connections 2024-01-25T15:04:07.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.268+0000 7f60a6024740 1 -- 172.21.15.170:0/3731563725 wait complete. 2024-01-25T15:04:07.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.268+0000 7f60a6024740 1 -- start start 2024-01-25T15:04:07.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.268+0000 7f60a6024740 1 Processor -- start 2024-01-25T15:04:07.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a6024740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a304b0 0x55e9c1a46330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.275 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a6024740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a34f40 0x55e9c1a44990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a6024740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a35930 0x55e9c1a44ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a6024740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c1a46b20 con 0x55e9c1a34f40 2024-01-25T15:04:07.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a6024740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c1a45440 con 0x55e9c1a35930 2024-01-25T15:04:07.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a6024740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9c1a45600 con 0x55e9c1a304b0 2024-01-25T15:04:07.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a6024740 10 client.0 _ll_register_callbacks cb 0x7f608c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:07.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a0924640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a34f40 0x55e9c1a44990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a0924640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a34f40 0x55e9c1a44990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56276/0 (socket says 172.21.15.170:56276) 2024-01-25T15:04:07.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a0924640 1 -- 172.21.15.170:0/3120524385 learned_addr learned my addr 172.21.15.170:0/3120524385 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a1125640 1 --2- 172.21.15.170:0/3120524385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a304b0 0x55e9c1a46330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a1926640 1 --2- 172.21.15.170:0/3120524385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a35930 0x55e9c1a44ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a0924640 1 -- 172.21.15.170:0/3120524385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a304b0 msgr2=0x55e9c1a46330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a0924640 1 --2- 172.21.15.170:0/3120524385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a304b0 0x55e9c1a46330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.276 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a0924640 1 -- 172.21.15.170:0/3120524385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a35930 msgr2=0x55e9c1a44ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a0924640 1 --2- 172.21.15.170:0/3120524385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a35930 0x55e9c1a44ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a0924640 1 -- 172.21.15.170:0/3120524385 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c19f1c0 con 0x55e9c1a34f40 2024-01-25T15:04:07.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f60a0924640 1 --2- 172.21.15.170:0/3120524385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a34f40 0x55e9c1a44990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f608c019440 tx=0x7f608c003900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521250a998936847 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f6084ff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:07.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f6084ff9640 1 -- 172.21.15.170:0/3120524385 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c009ea0 con 0x55e9c1a34f40 2024-01-25T15:04:07.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.269+0000 7f6084ff9640 1 -- 172.21.15.170:0/3120524385 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f608c000e40 con 0x55e9c1a34f40 2024-01-25T15:04:07.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.270+0000 7f60a6024740 1 -- 172.21.15.170:0/3120524385 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9c169b7e0 con 0x55e9c1a34f40 2024-01-25T15:04:07.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.270+0000 7f6084ff9640 1 -- 172.21.15.170:0/3120524385 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f608c019640 con 0x55e9c1a34f40 2024-01-25T15:04:07.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.270+0000 7f60a6024740 10 client.16167 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:07.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.270+0000 7f60a6024740 1 -- 172.21.15.170:0/3120524385 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55e9c199a8d0 con 0x55e9c1a34f40 2024-01-25T15:04:07.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.270+0000 7f6084ff9640 1 -- 172.21.15.170:0/3120524385 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e9c169b7e0 con 0x55e9c1a34f40 2024-01-25T15:04:07.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.270+0000 7f6084ff9640 1 -- 172.21.15.170:0/3120524385 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f608c021040 con 0x55e9c1a34f40 2024-01-25T15:04:07.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.270+0000 7f60a6024740 10 client.16167 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:07.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.270+0000 7f60a6024740 10 client.16167 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-01-25T15:04:07.277 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.270+0000 7f60a6024740 20 client.16167 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:07.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.270+0000 7f60a6024740 1 --2- 172.21.15.170:0/3120524385 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55e9c1a3aaa0 0x55e9c1aa4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.270+0000 7f60a6024740 4 client.16167 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:04:07.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.270+0000 7f60a6024740 1 -- 172.21.15.170:0/3120524385 --> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e9c16eee30 con 0x55e9c1a3aaa0 2024-01-25T15:04:07.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.270+0000 7f60a1125640 1 --2- 172.21.15.170:0/3120524385 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55e9c1a3aaa0 0x55e9c1aa4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.271+0000 7f60a1125640 1 --2- 172.21.15.170:0/3120524385 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55e9c1a3aaa0 0x55e9c1aa4940 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=64dac9d09c85b777 server_cookie=8659d6874ec16d60 in_seq=0 out_seq=0 2024-01-25T15:04:07.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.271+0000 7f6084ff9640 10 client.16167 ms_handle_connect on v2:172.21.15.191:6836/719224494 2024-01-25T15:04:07.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.273+0000 7f6084ff9640 1 -- 172.21.15.170:0/3120524385 <== mds.2 v2:172.21.15.191:6836/719224494 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+133523 (crc 0 0 0) 0x55e9c16eee30 con 0x55e9c1a3aaa0 2024-01-25T15:04:07.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.273+0000 7f6084ff9640 10 client.16167 handle_command_reply: tid=0 2024-01-25T15:04:07.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.273+0000 7f60a6024740 1 client.16167 shutdown 2024-01-25T15:04:07.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.273+0000 7f60a6024740 1 -- 172.21.15.170:0/3120524385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a34f40 msgr2=0x55e9c1a44990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.273+0000 7f60a6024740 1 --2- 172.21.15.170:0/3120524385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a34f40 0x55e9c1a44990 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f608c019440 tx=0x7f608c003900 comp rx=0 tx=0).stop 2024-01-25T15:04:07.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.273+0000 7f60a6024740 1 -- 172.21.15.170:0/3120524385 shutdown_connections 2024-01-25T15:04:07.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.273+0000 7f60a6024740 1 --2- 172.21.15.170:0/3120524385 >> [v2:172.21.15.191:6836/719224494,v1:172.21.15.191:6837/719224494] conn(0x55e9c1a3aaa0 0x55e9c1aa4940 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a6024740 1 --2- 172.21.15.170:0/3120524385 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55e9c1a35930 0x55e9c1a44ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.278 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f6084ff9640 0 client.16167 ms_handle_reset on v2:172.21.15.191:6836/719224494 2024-01-25T15:04:07.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a6024740 1 --2- 172.21.15.170:0/3120524385 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55e9c1a34f40 0x55e9c1a44990 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a6024740 1 --2- 172.21.15.170:0/3120524385 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55e9c1a304b0 0x55e9c1a46330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a6024740 1 -- 172.21.15.170:0/3120524385 >> 172.21.15.170:0/3120524385 conn(0x55e9c1a36710 msgr2=0x55e9c1a33fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a6024740 1 -- 172.21.15.170:0/3120524385 shutdown_connections 2024-01-25T15:04:07.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a6024740 1 -- 172.21.15.170:0/3120524385 wait complete. 2024-01-25T15:04:07.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a6024740 20 client.16167 trim_cache size 0 max 16384 2024-01-25T15:04:07.281 INFO:teuthology.orchestra.run.smithi170.stdout:[ 2024-01-25T15:04:07.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.281 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.281 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3493753, 2024-01-25T15:04:07.281 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632086, 2024-01-25T15:04:07.281 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/Makefile" 2024-01-25T15:04:07.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.281 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.281 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3513889, 2024-01-25T15:04:07.281 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633202, 2024-01-25T15:04:07.281 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c" 2024-01-25T15:04:07.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.282 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.282 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4423226, 2024-01-25T15:04:07.282 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633157, 2024-01-25T15:04:07.282 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-21.c" 2024-01-25T15:04:07.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.282 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.282 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 7096140, 2024-01-25T15:04:07.282 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633531, 2024-01-25T15:04:07.282 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-3.c" 2024-01-25T15:04:07.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 8224273, 2024-01-25T15:04:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629657, 2024-01-25T15:04:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend02" 2024-01-25T15:04:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 9477112, 2024-01-25T15:04:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633458, 2024-01-25T15:04:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-25.c" 2024-01-25T15:04:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.283 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 22305393, 2024-01-25T15:04:07.284 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633349, 2024-01-25T15:04:07.284 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-2.c" 2024-01-25T15:04:07.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.284 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.284 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 34007004, 2024-01-25T15:04:07.284 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633191, 2024-01-25T15:04:07.284 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c" 2024-01-25T15:04:07.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.284 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.284 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 34948289, 2024-01-25T15:04:07.284 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633198, 2024-01-25T15:04:07.285 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c" 2024-01-25T15:04:07.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.285 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.285 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 43904579, 2024-01-25T15:04:07.285 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633501, 2024-01-25T15:04:07.285 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-15.c" 2024-01-25T15:04:07.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.285 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.285 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 47397518, 2024-01-25T15:04:07.285 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633177, 2024-01-25T15:04:07.285 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c" 2024-01-25T15:04:07.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.286 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.286 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 71461998, 2024-01-25T15:04:07.286 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633513, 2024-01-25T15:04:07.286 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-5.c" 2024-01-25T15:04:07.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.286 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.286 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 89880926, 2024-01-25T15:04:07.286 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633148, 2024-01-25T15:04:07.286 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-47.c" 2024-01-25T15:04:07.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.286 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.287 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 91972567, 2024-01-25T15:04:07.287 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629659, 2024-01-25T15:04:07.287 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend08" 2024-01-25T15:04:07.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.287 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.287 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 107960561, 2024-01-25T15:04:07.287 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629645, 2024-01-25T15:04:07.287 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend01" 2024-01-25T15:04:07.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.287 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.287 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 110017050, 2024-01-25T15:04:07.288 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633365, 2024-01-25T15:04:07.288 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-14.c" 2024-01-25T15:04:07.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.288 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.288 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 130383642, 2024-01-25T15:04:07.288 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633193, 2024-01-25T15:04:07.288 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-15.c" 2024-01-25T15:04:07.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.288 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.288 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 134918217, 2024-01-25T15:04:07.288 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633472, 2024-01-25T15:04:07.289 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-11.c" 2024-01-25T15:04:07.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.289 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.289 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 136300655, 2024-01-25T15:04:07.289 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629655, 2024-01-25T15:04:07.289 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend05" 2024-01-25T15:04:07.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.289 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.289 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 148108484, 2024-01-25T15:04:07.289 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633382, 2024-01-25T15:04:07.289 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.h" 2024-01-25T15:04:07.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.290 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.290 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 148796610, 2024-01-25T15:04:07.290 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633007, 2024-01-25T15:04:07.290 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-4.sh" 2024-01-25T15:04:07.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.290 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.290 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 149615979, 2024-01-25T15:04:07.290 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633483, 2024-01-25T15:04:07.290 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-20.c" 2024-01-25T15:04:07.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.290 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.290 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 166393426, 2024-01-25T15:04:07.291 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633409, 2024-01-25T15:04:07.291 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-18.c" 2024-01-25T15:04:07.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.291 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.291 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 175170010, 2024-01-25T15:04:07.291 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633155, 2024-01-25T15:04:07.291 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c" 2024-01-25T15:04:07.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.291 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.291 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 207673407, 2024-01-25T15:04:07.291 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633181, 2024-01-25T15:04:07.291 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c" 2024-01-25T15:04:07.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.292 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.292 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 210769291, 2024-01-25T15:04:07.292 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633373, 2024-01-25T15:04:07.292 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-9.c" 2024-01-25T15:04:07.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.292 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.292 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 215938282, 2024-01-25T15:04:07.292 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633320, 2024-01-25T15:04:07.292 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c" 2024-01-25T15:04:07.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.293 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.293 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 218291538, 2024-01-25T15:04:07.293 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633205, 2024-01-25T15:04:07.293 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-14.c" 2024-01-25T15:04:07.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.293 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.293 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 227040412, 2024-01-25T15:04:07.293 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633383, 2024-01-25T15:04:07.293 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-54.c" 2024-01-25T15:04:07.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.293 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.293 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 235730696, 2024-01-25T15:04:07.294 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633507, 2024-01-25T15:04:07.294 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-9.c" 2024-01-25T15:04:07.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.294 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.294 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 254959196, 2024-01-25T15:04:07.294 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633318, 2024-01-25T15:04:07.294 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-1.c" 2024-01-25T15:04:07.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.294 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.294 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 260388998, 2024-01-25T15:04:07.294 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633461, 2024-01-25T15:04:07.294 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/README" 2024-01-25T15:04:07.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.295 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.295 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 264677015, 2024-01-25T15:04:07.295 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633178, 2024-01-25T15:04:07.295 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-22.c" 2024-01-25T15:04:07.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.295 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.295 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 271698814, 2024-01-25T15:04:07.295 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632680, 2024-01-25T15:04:07.295 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/2-1.c" 2024-01-25T15:04:07.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.295 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.295 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 274241040, 2024-01-25T15:04:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633295, 2024-01-25T15:04:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-1.c" 2024-01-25T15:04:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 296133907, 2024-01-25T15:04:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633340, 2024-01-25T15:04:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-8.c" 2024-01-25T15:04:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 309785897, 2024-01-25T15:04:07.296 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633348, 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-4.c" 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 323309250, 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633130, 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-11.c" 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 347885459, 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633406, 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-1.c" 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.297 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.298 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 386006307, 2024-01-25T15:04:07.298 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633401, 2024-01-25T15:04:07.298 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-99.c" 2024-01-25T15:04:07.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.298 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.298 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 400528341, 2024-01-25T15:04:07.298 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633538, 2024-01-25T15:04:07.298 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-13.c" 2024-01-25T15:04:07.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.298 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.298 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 401549911, 2024-01-25T15:04:07.298 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633476, 2024-01-25T15:04:07.298 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-6.c" 2024-01-25T15:04:07.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.299 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.299 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 408082690, 2024-01-25T15:04:07.299 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633528, 2024-01-25T15:04:07.299 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-25.c" 2024-01-25T15:04:07.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.299 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.299 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 409477822, 2024-01-25T15:04:07.299 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633393, 2024-01-25T15:04:07.299 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-91.c" 2024-01-25T15:04:07.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.299 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.300 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 415778845, 2024-01-25T15:04:07.300 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633167, 2024-01-25T15:04:07.300 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c" 2024-01-25T15:04:07.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.300 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.300 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 417063233, 2024-01-25T15:04:07.300 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633310, 2024-01-25T15:04:07.300 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c" 2024-01-25T15:04:07.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.300 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.300 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 429554033, 2024-01-25T15:04:07.300 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631401, 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_001.c" 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 442047100, 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633384, 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-30.c" 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 456036393, 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633217, 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c" 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.301 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.302 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 458525684, 2024-01-25T15:04:07.302 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633158, 2024-01-25T15:04:07.302 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-5.c" 2024-01-25T15:04:07.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.302 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.302 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 464936135, 2024-01-25T15:04:07.302 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633321, 2024-01-25T15:04:07.302 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-77.c" 2024-01-25T15:04:07.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.302 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.302 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 467367426, 2024-01-25T15:04:07.302 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629643, 2024-01-25T15:04:07.303 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend04" 2024-01-25T15:04:07.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.303 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.303 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 470456962, 2024-01-25T15:04:07.303 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633414, 2024-01-25T15:04:07.303 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-23.c" 2024-01-25T15:04:07.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.303 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.303 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 486449821, 2024-01-25T15:04:07.303 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629656, 2024-01-25T15:04:07.303 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend14" 2024-01-25T15:04:07.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.304 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.304 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 490095782, 2024-01-25T15:04:07.304 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633187, 2024-01-25T15:04:07.304 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-49.c" 2024-01-25T15:04:07.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.304 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.304 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 502760094, 2024-01-25T15:04:07.304 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633360, 2024-01-25T15:04:07.304 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-22.c" 2024-01-25T15:04:07.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.304 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.304 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 505620771, 2024-01-25T15:04:07.304 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629664, 2024-01-25T15:04:07.305 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend13" 2024-01-25T15:04:07.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.305 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.305 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 515229585, 2024-01-25T15:04:07.305 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633128, 2024-01-25T15:04:07.305 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c" 2024-01-25T15:04:07.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.305 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.305 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 519198853, 2024-01-25T15:04:07.305 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632685, 2024-01-25T15:04:07.305 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/12-1.c" 2024-01-25T15:04:07.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.306 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.306 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 521093504, 2024-01-25T15:04:07.306 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629641, 2024-01-25T15:04:07.306 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend06" 2024-01-25T15:04:07.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.306 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.306 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 524858185, 2024-01-25T15:04:07.306 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629644, 2024-01-25T15:04:07.306 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend11" 2024-01-25T15:04:07.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.306 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.307 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 525585516, 2024-01-25T15:04:07.307 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633502, 2024-01-25T15:04:07.307 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-10.c" 2024-01-25T15:04:07.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.307 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.307 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 540000276, 2024-01-25T15:04:07.307 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633195, 2024-01-25T15:04:07.307 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-27.c" 2024-01-25T15:04:07.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.307 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.307 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 557558853, 2024-01-25T15:04:07.307 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633209, 2024-01-25T15:04:07.307 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-9.c" 2024-01-25T15:04:07.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.308 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.308 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 561145630, 2024-01-25T15:04:07.308 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633175, 2024-01-25T15:04:07.308 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-19.c" 2024-01-25T15:04:07.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.308 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.308 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 568894542, 2024-01-25T15:04:07.308 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633003, 2024-01-25T15:04:07.308 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-1.sh" 2024-01-25T15:04:07.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.309 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.309 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 581801549, 2024-01-25T15:04:07.309 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633526, 2024-01-25T15:04:07.309 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-7.c" 2024-01-25T15:04:07.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.309 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.309 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 595833620, 2024-01-25T15:04:07.309 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633387, 2024-01-25T15:04:07.309 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-22.c" 2024-01-25T15:04:07.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.309 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 611494159, 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633542, 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-18.c" 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 632477742, 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633301, 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c" 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 655060223, 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633326, 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c" 2024-01-25T15:04:07.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.311 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.311 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 670085663, 2024-01-25T15:04:07.311 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633345, 2024-01-25T15:04:07.311 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-10.c" 2024-01-25T15:04:07.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.311 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.311 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 679025240, 2024-01-25T15:04:07.311 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633438, 2024-01-25T15:04:07.311 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-25.c" 2024-01-25T15:04:07.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.311 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.311 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 684131546, 2024-01-25T15:04:07.312 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633473, 2024-01-25T15:04:07.312 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-21.c" 2024-01-25T15:04:07.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.312 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.312 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 687232469, 2024-01-25T15:04:07.312 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630489, 2024-01-25T15:04:07.312 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/Makefile" 2024-01-25T15:04:07.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.312 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.312 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 691453857, 2024-01-25T15:04:07.312 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633505, 2024-01-25T15:04:07.313 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-95.c" 2024-01-25T15:04:07.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.313 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.313 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 700192925, 2024-01-25T15:04:07.313 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633137, 2024-01-25T15:04:07.313 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-19.c" 2024-01-25T15:04:07.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.313 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.313 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 700528940, 2024-01-25T15:04:07.313 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633359, 2024-01-25T15:04:07.313 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-50.c" 2024-01-25T15:04:07.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.314 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.314 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 703279921, 2024-01-25T15:04:07.314 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633159, 2024-01-25T15:04:07.314 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-21.c" 2024-01-25T15:04:07.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.314 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.314 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 718599954, 2024-01-25T15:04:07.314 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633008, 2024-01-25T15:04:07.314 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-2.sh" 2024-01-25T15:04:07.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.314 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.314 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 719347346, 2024-01-25T15:04:07.315 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629661, 2024-01-25T15:04:07.315 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend05" 2024-01-25T15:04:07.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.315 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.315 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 728311982, 2024-01-25T15:04:07.315 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633207, 2024-01-25T15:04:07.315 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-24.c" 2024-01-25T15:04:07.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.315 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.315 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 742445485, 2024-01-25T15:04:07.315 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633115, 2024-01-25T15:04:07.315 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_1-1.in" 2024-01-25T15:04:07.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.316 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.316 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 749775441, 2024-01-25T15:04:07.316 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633481, 2024-01-25T15:04:07.316 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-26.c" 2024-01-25T15:04:07.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.316 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.316 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 762516883, 2024-01-25T15:04:07.316 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630167, 2024-01-25T15:04:07.316 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend12" 2024-01-25T15:04:07.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.317 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.317 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 769904462, 2024-01-25T15:04:07.317 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633395, 2024-01-25T15:04:07.317 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-20.c" 2024-01-25T15:04:07.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.317 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.317 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 778140313, 2024-01-25T15:04:07.317 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631402, 2024-01-25T15:04:07.317 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.in" 2024-01-25T15:04:07.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.318 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.318 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 781688225, 2024-01-25T15:04:07.318 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633151, 2024-01-25T15:04:07.318 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c" 2024-01-25T15:04:07.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.318 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.318 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 782784999, 2024-01-25T15:04:07.318 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633452, 2024-01-25T15:04:07.318 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-8.c" 2024-01-25T15:04:07.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.318 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.318 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 794018368, 2024-01-25T15:04:07.319 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633368, 2024-01-25T15:04:07.319 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-16.c" 2024-01-25T15:04:07.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.319 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.319 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 804770831, 2024-01-25T15:04:07.319 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633131, 2024-01-25T15:04:07.319 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c" 2024-01-25T15:04:07.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.319 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.319 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 810357181, 2024-01-25T15:04:07.319 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633400, 2024-01-25T15:04:07.320 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-24.c" 2024-01-25T15:04:07.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.320 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.320 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 819849583, 2024-01-25T15:04:07.320 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633305, 2024-01-25T15:04:07.320 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-2.c" 2024-01-25T15:04:07.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.320 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.320 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 826622717, 2024-01-25T15:04:07.320 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633432, 2024-01-25T15:04:07.320 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-17.c" 2024-01-25T15:04:07.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.321 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.321 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 827593982, 2024-01-25T15:04:07.321 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633165, 2024-01-25T15:04:07.321 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-81.c" 2024-01-25T15:04:07.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.321 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.321 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 832225486, 2024-01-25T15:04:07.321 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633113, 2024-01-25T15:04:07.321 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_25-1.in" 2024-01-25T15:04:07.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.321 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.322 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 852709335, 2024-01-25T15:04:07.322 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633199, 2024-01-25T15:04:07.322 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c" 2024-01-25T15:04:07.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.322 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.322 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 864591582, 2024-01-25T15:04:07.322 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633106, 2024-01-25T15:04:07.322 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_22-1.in" 2024-01-25T15:04:07.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.322 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.322 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 871571599, 2024-01-25T15:04:07.322 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633200, 2024-01-25T15:04:07.322 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c" 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 878414512, 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633315, 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-26.c" 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 903640203, 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633533, 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-93.c" 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.323 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 931881817, 2024-01-25T15:04:07.324 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633184, 2024-01-25T15:04:07.324 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-25.c" 2024-01-25T15:04:07.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.324 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.324 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 952823653, 2024-01-25T15:04:07.324 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633334, 2024-01-25T15:04:07.324 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-1.c" 2024-01-25T15:04:07.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.324 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.324 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 953871823, 2024-01-25T15:04:07.324 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633385, 2024-01-25T15:04:07.324 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-1.c" 2024-01-25T15:04:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 966245799, 2024-01-25T15:04:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632734, 2024-01-25T15:04:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/assertions.xml" 2024-01-25T15:04:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 980168810, 2024-01-25T15:04:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633450, 2024-01-25T15:04:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-42.c" 2024-01-25T15:04:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.325 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 985064382, 2024-01-25T15:04:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632688, 2024-01-25T15:04:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/4-1.sh" 2024-01-25T15:04:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1008162973, 2024-01-25T15:04:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633463, 2024-01-25T15:04:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-3.c" 2024-01-25T15:04:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1014472199, 2024-01-25T15:04:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633309, 2024-01-25T15:04:07.326 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c" 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1035093230, 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633313, 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-18.c" 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1051337602, 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633353, 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-23.c" 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.327 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1055150152, 2024-01-25T15:04:07.328 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633537, 2024-01-25T15:04:07.328 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-17.c" 2024-01-25T15:04:07.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.328 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.328 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1061842932, 2024-01-25T15:04:07.328 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633096, 2024-01-25T15:04:07.328 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c" 2024-01-25T15:04:07.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.328 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.328 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1063410775, 2024-01-25T15:04:07.328 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633425, 2024-01-25T15:04:07.328 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-30.c" 2024-01-25T15:04:07.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.329 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.329 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1078919924, 2024-01-25T15:04:07.329 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633138, 2024-01-25T15:04:07.329 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c" 2024-01-25T15:04:07.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.329 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.329 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1111746378, 2024-01-25T15:04:07.329 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633306, 2024-01-25T15:04:07.329 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-21.c" 2024-01-25T15:04:07.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.329 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1112591544, 2024-01-25T15:04:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633322, 2024-01-25T15:04:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c" 2024-01-25T15:04:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1116252532, 2024-01-25T15:04:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631399, 2024-01-25T15:04:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/thread_000.cpp" 2024-01-25T15:04:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1121277050, 2024-01-25T15:04:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633336, 2024-01-25T15:04:07.330 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-4.c" 2024-01-25T15:04:07.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.331 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.331 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1133530668, 2024-01-25T15:04:07.331 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629658, 2024-01-25T15:04:07.331 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend07" 2024-01-25T15:04:07.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.331 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.331 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1134034948, 2024-01-25T15:04:07.331 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633423, 2024-01-25T15:04:07.331 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-53.c" 2024-01-25T15:04:07.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.331 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.332 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1144360225, 2024-01-25T15:04:07.332 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633358, 2024-01-25T15:04:07.332 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-3.c" 2024-01-25T15:04:07.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.332 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.332 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1148885816, 2024-01-25T15:04:07.332 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633503, 2024-01-25T15:04:07.332 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-14.c" 2024-01-25T15:04:07.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.332 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.332 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1159292342, 2024-01-25T15:04:07.332 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633511, 2024-01-25T15:04:07.332 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-22.c" 2024-01-25T15:04:07.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.333 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.333 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1166053145, 2024-01-25T15:04:07.333 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629653, 2024-01-25T15:04:07.333 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend12" 2024-01-25T15:04:07.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.333 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.333 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1173477981, 2024-01-25T15:04:07.333 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633583, 2024-01-25T15:04:07.333 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c" 2024-01-25T15:04:07.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.334 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.334 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1173758545, 2024-01-25T15:04:07.334 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633308, 2024-01-25T15:04:07.334 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-8.c" 2024-01-25T15:04:07.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.334 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.334 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1179056033, 2024-01-25T15:04:07.334 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633482, 2024-01-25T15:04:07.334 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-43.c" 2024-01-25T15:04:07.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.334 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.335 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1180697008, 2024-01-25T15:04:07.335 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632550, 2024-01-25T15:04:07.335 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/1-1.c" 2024-01-25T15:04:07.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.335 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.335 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1183081759, 2024-01-25T15:04:07.335 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633154, 2024-01-25T15:04:07.335 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-24.c" 2024-01-25T15:04:07.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.335 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.335 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1198584460, 2024-01-25T15:04:07.335 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633302, 2024-01-25T15:04:07.335 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-26.c" 2024-01-25T15:04:07.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.336 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.336 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1211122375, 2024-01-25T15:04:07.336 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629638, 2024-01-25T15:04:07.336 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend03" 2024-01-25T15:04:07.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.336 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.336 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1220062767, 2024-01-25T15:04:07.336 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633462, 2024-01-25T15:04:07.336 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-25.c" 2024-01-25T15:04:07.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.337 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.337 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1223263351, 2024-01-25T15:04:07.337 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633518, 2024-01-25T15:04:07.337 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-8.c" 2024-01-25T15:04:07.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.337 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.337 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1226149705, 2024-01-25T15:04:07.337 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633413, 2024-01-25T15:04:07.337 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-20.c" 2024-01-25T15:04:07.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.337 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.337 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1244564459, 2024-01-25T15:04:07.338 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633341, 2024-01-25T15:04:07.338 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-14.c" 2024-01-25T15:04:07.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.338 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.338 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1248320304, 2024-01-25T15:04:07.338 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633324, 2024-01-25T15:04:07.338 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-17.c" 2024-01-25T15:04:07.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.338 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.338 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1257044513, 2024-01-25T15:04:07.338 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633197, 2024-01-25T15:04:07.338 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c" 2024-01-25T15:04:07.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.339 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.339 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1260900636, 2024-01-25T15:04:07.339 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633186, 2024-01-25T15:04:07.339 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c" 2024-01-25T15:04:07.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.339 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.339 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1280106715, 2024-01-25T15:04:07.339 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633212, 2024-01-25T15:04:07.339 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-9.c" 2024-01-25T15:04:07.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.339 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.339 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1287942533, 2024-01-25T15:04:07.340 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633356, 2024-01-25T15:04:07.340 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-5.c" 2024-01-25T15:04:07.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.340 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.340 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1297458465, 2024-01-25T15:04:07.340 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633959, 2024-01-25T15:04:07.340 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-25.c" 2024-01-25T15:04:07.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.340 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.340 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1303271313, 2024-01-25T15:04:07.340 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633394, 2024-01-25T15:04:07.341 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-18.c" 2024-01-25T15:04:07.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.341 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.341 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1304969136, 2024-01-25T15:04:07.341 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633346, 2024-01-25T15:04:07.341 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-74.c" 2024-01-25T15:04:07.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.341 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.341 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1307224177, 2024-01-25T15:04:07.341 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633299, 2024-01-25T15:04:07.341 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c" 2024-01-25T15:04:07.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.342 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.342 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1308953156, 2024-01-25T15:04:07.342 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633330, 2024-01-25T15:04:07.342 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c" 2024-01-25T15:04:07.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.342 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.342 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1319235661, 2024-01-25T15:04:07.342 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632689, 2024-01-25T15:04:07.342 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/11-2.c" 2024-01-25T15:04:07.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.343 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.343 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1337556411, 2024-01-25T15:04:07.343 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633392, 2024-01-25T15:04:07.343 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-4.c" 2024-01-25T15:04:07.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.343 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.343 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1349729826, 2024-01-25T15:04:07.343 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629646, 2024-01-25T15:04:07.343 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/Makefile" 2024-01-25T15:04:07.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.343 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.343 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1359937115, 2024-01-25T15:04:07.343 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633333, 2024-01-25T15:04:07.344 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-11.c" 2024-01-25T15:04:07.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.344 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.344 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1360375194, 2024-01-25T15:04:07.344 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633534, 2024-01-25T15:04:07.344 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-14.c" 2024-01-25T15:04:07.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.344 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.344 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1375417738, 2024-01-25T15:04:07.344 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633002, 2024-01-25T15:04:07.344 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/coverage.txt" 2024-01-25T15:04:07.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1379402805, 2024-01-25T15:04:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633475, 2024-01-25T15:04:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-40.c" 2024-01-25T15:04:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1395320047, 2024-01-25T15:04:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633160, 2024-01-25T15:04:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-48.c" 2024-01-25T15:04:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.345 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1420818597, 2024-01-25T15:04:07.346 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633433, 2024-01-25T15:04:07.346 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-24.c" 2024-01-25T15:04:07.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.346 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.346 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1466031575, 2024-01-25T15:04:07.346 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629662, 2024-01-25T15:04:07.346 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend10" 2024-01-25T15:04:07.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.346 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.346 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1474069698, 2024-01-25T15:04:07.346 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633456, 2024-01-25T15:04:07.346 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-76.c" 2024-01-25T15:04:07.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.347 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.347 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1474409130, 2024-01-25T15:04:07.347 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633411, 2024-01-25T15:04:07.347 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-15.c" 2024-01-25T15:04:07.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.347 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.347 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1477031556, 2024-01-25T15:04:07.347 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633498, 2024-01-25T15:04:07.347 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-38.c" 2024-01-25T15:04:07.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.347 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.348 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1479425538, 2024-01-25T15:04:07.348 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633173, 2024-01-25T15:04:07.348 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-16.c" 2024-01-25T15:04:07.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.348 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.348 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1488684096, 2024-01-25T15:04:07.348 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633092, 2024-01-25T15:04:07.348 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c" 2024-01-25T15:04:07.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.348 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.348 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1497457388, 2024-01-25T15:04:07.348 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633132, 2024-01-25T15:04:07.348 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c" 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1505853283, 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633094, 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-9.c" 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1527718844, 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633214, 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-14.c" 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.349 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1530262176, 2024-01-25T15:04:07.350 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633491, 2024-01-25T15:04:07.350 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-19.c" 2024-01-25T15:04:07.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.350 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.350 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1539249866, 2024-01-25T15:04:07.350 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633303, 2024-01-25T15:04:07.350 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-52.c" 2024-01-25T15:04:07.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.350 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.350 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1541848358, 2024-01-25T15:04:07.350 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633105, 2024-01-25T15:04:07.350 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-50.c" 2024-01-25T15:04:07.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.351 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.351 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1546664142, 2024-01-25T15:04:07.351 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633357, 2024-01-25T15:04:07.351 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-88.c" 2024-01-25T15:04:07.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.351 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.351 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1550560602, 2024-01-25T15:04:07.351 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633351, 2024-01-25T15:04:07.351 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-3.c" 2024-01-25T15:04:07.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.351 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.352 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1574122861, 2024-01-25T15:04:07.352 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630063, 2024-01-25T15:04:07.352 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/open_files.c" 2024-01-25T15:04:07.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.352 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.352 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1581282982, 2024-01-25T15:04:07.352 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629647, 2024-01-25T15:04:07.352 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend10" 2024-01-25T15:04:07.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.352 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.352 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1598744291, 2024-01-25T15:04:07.352 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633471, 2024-01-25T15:04:07.353 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-1.c" 2024-01-25T15:04:07.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.353 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.353 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1599873821, 2024-01-25T15:04:07.353 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633183, 2024-01-25T15:04:07.353 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-18.c" 2024-01-25T15:04:07.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.353 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.353 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1604787174, 2024-01-25T15:04:07.353 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633099, 2024-01-25T15:04:07.353 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c" 2024-01-25T15:04:07.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.354 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.354 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1612379404, 2024-01-25T15:04:07.354 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633544, 2024-01-25T15:04:07.354 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/29-1.c" 2024-01-25T15:04:07.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.354 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.354 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1631138690, 2024-01-25T15:04:07.354 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633304, 2024-01-25T15:04:07.354 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c" 2024-01-25T15:04:07.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.354 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.354 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1635838368, 2024-01-25T15:04:07.355 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633163, 2024-01-25T15:04:07.355 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-2.c" 2024-01-25T15:04:07.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.355 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.355 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1650532000, 2024-01-25T15:04:07.355 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631403, 2024-01-25T15:04:07.355 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.am" 2024-01-25T15:04:07.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.355 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.355 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1657687256, 2024-01-25T15:04:07.355 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633488, 2024-01-25T15:04:07.355 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-7.c" 2024-01-25T15:04:07.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.356 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.356 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1680325110, 2024-01-25T15:04:07.356 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632684, 2024-01-25T15:04:07.356 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/assertions.xml" 2024-01-25T15:04:07.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.356 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.356 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1705365624, 2024-01-25T15:04:07.356 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633521, 2024-01-25T15:04:07.356 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-15.c" 2024-01-25T15:04:07.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.357 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.357 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1707315056, 2024-01-25T15:04:07.357 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633529, 2024-01-25T15:04:07.357 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-78.c" 2024-01-25T15:04:07.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.357 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.357 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1710147209, 2024-01-25T15:04:07.357 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633110, 2024-01-25T15:04:07.357 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-3.in" 2024-01-25T15:04:07.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.357 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.357 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1717685143, 2024-01-25T15:04:07.358 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633484, 2024-01-25T15:04:07.358 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-55.c" 2024-01-25T15:04:07.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.358 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.358 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1720541506, 2024-01-25T15:04:07.358 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633418, 2024-01-25T15:04:07.358 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-68.c" 2024-01-25T15:04:07.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.358 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.358 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1745028852, 2024-01-25T15:04:07.358 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633149, 2024-01-25T15:04:07.358 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c" 2024-01-25T15:04:07.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.359 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.359 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1769055445, 2024-01-25T15:04:07.359 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633201, 2024-01-25T15:04:07.359 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c" 2024-01-25T15:04:07.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.359 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.359 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1771889132, 2024-01-25T15:04:07.359 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633444, 2024-01-25T15:04:07.359 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-24.c" 2024-01-25T15:04:07.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.359 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.360 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1783677474, 2024-01-25T15:04:07.360 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629639, 2024-01-25T15:04:07.360 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend06" 2024-01-25T15:04:07.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.360 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.360 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1784224274, 2024-01-25T15:04:07.360 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633390, 2024-01-25T15:04:07.360 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-16.c" 2024-01-25T15:04:07.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.360 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.360 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1798130113, 2024-01-25T15:04:07.360 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632604, 2024-01-25T15:04:07.360 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/net_cmdlib.sh" 2024-01-25T15:04:07.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.361 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.361 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1806205043, 2024-01-25T15:04:07.361 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633145, 2024-01-25T15:04:07.361 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-10.c" 2024-01-25T15:04:07.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.361 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.361 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1817640198, 2024-01-25T15:04:07.361 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633398, 2024-01-25T15:04:07.361 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-17.c" 2024-01-25T15:04:07.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.362 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.362 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1828586864, 2024-01-25T15:04:07.362 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633381, 2024-01-25T15:04:07.362 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-41.c" 2024-01-25T15:04:07.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.362 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.362 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1834023316, 2024-01-25T15:04:07.362 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633331, 2024-01-25T15:04:07.362 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-5.c" 2024-01-25T15:04:07.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.362 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.362 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1837500136, 2024-01-25T15:04:07.362 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629637, 2024-01-25T15:04:07.363 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend09" 2024-01-25T15:04:07.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.363 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.363 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1837823245, 2024-01-25T15:04:07.363 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633540, 2024-01-25T15:04:07.363 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-104.c" 2024-01-25T15:04:07.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.363 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.363 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1844656278, 2024-01-25T15:04:07.363 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633152, 2024-01-25T15:04:07.363 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-8.c" 2024-01-25T15:04:07.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.364 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.364 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1845309852, 2024-01-25T15:04:07.364 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633495, 2024-01-25T15:04:07.364 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-7.c" 2024-01-25T15:04:07.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.364 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.364 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1858988750, 2024-01-25T15:04:07.364 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633342, 2024-01-25T15:04:07.364 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-26.c" 2024-01-25T15:04:07.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.364 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.364 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1859155087, 2024-01-25T15:04:07.365 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633522, 2024-01-25T15:04:07.365 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-13.c" 2024-01-25T15:04:07.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.365 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.365 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1873674541, 2024-01-25T15:04:07.365 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633467, 2024-01-25T15:04:07.365 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-6.c" 2024-01-25T15:04:07.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.365 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.365 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1881359921, 2024-01-25T15:04:07.365 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633338, 2024-01-25T15:04:07.365 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-4.c" 2024-01-25T15:04:07.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.366 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.366 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1898231780, 2024-01-25T15:04:07.366 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633376, 2024-01-25T15:04:07.366 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-18.c" 2024-01-25T15:04:07.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.366 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.366 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1912029712, 2024-01-25T15:04:07.366 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633496, 2024-01-25T15:04:07.366 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-11.c" 2024-01-25T15:04:07.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.366 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.367 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1924074299, 2024-01-25T15:04:07.367 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633176, 2024-01-25T15:04:07.367 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-17.c" 2024-01-25T15:04:07.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.367 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.367 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1930742324, 2024-01-25T15:04:07.367 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633391, 2024-01-25T15:04:07.367 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-17.c" 2024-01-25T15:04:07.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.367 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.367 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1936240834, 2024-01-25T15:04:07.367 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633316, 2024-01-25T15:04:07.368 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c" 2024-01-25T15:04:07.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.368 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.368 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1939015060, 2024-01-25T15:04:07.368 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633457, 2024-01-25T15:04:07.368 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-10.c" 2024-01-25T15:04:07.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.368 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.368 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1939411761, 2024-01-25T15:04:07.368 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633375, 2024-01-25T15:04:07.368 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-7.c" 2024-01-25T15:04:07.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.369 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.369 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1953840413, 2024-01-25T15:04:07.369 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633103, 2024-01-25T15:04:07.369 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-16.c" 2024-01-25T15:04:07.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.369 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.369 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1956143567, 2024-01-25T15:04:07.369 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632735, 2024-01-25T15:04:07.369 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/3-1.sh" 2024-01-25T15:04:07.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.369 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.369 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1960722944, 2024-01-25T15:04:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633585, 2024-01-25T15:04:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_28-1.in" 2024-01-25T15:04:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1977762577, 2024-01-25T15:04:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633142, 2024-01-25T15:04:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-3.c" 2024-01-25T15:04:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1981523641, 2024-01-25T15:04:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633220, 2024-01-25T15:04:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c" 2024-01-25T15:04:07.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.371 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.371 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1992402197, 2024-01-25T15:04:07.371 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633135, 2024-01-25T15:04:07.371 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c" 2024-01-25T15:04:07.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.371 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.371 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2013587040, 2024-01-25T15:04:07.371 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633441, 2024-01-25T15:04:07.371 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-8.c" 2024-01-25T15:04:07.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.371 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.371 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2026352113, 2024-01-25T15:04:07.372 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633442, 2024-01-25T15:04:07.372 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-61.c" 2024-01-25T15:04:07.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.372 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.372 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2042664070, 2024-01-25T15:04:07.372 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633344, 2024-01-25T15:04:07.372 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-9.c" 2024-01-25T15:04:07.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.372 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.372 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2042728035, 2024-01-25T15:04:07.372 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633362, 2024-01-25T15:04:07.372 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-11.c" 2024-01-25T15:04:07.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.373 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.373 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2050503369, 2024-01-25T15:04:07.373 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633536, 2024-01-25T15:04:07.373 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-5.c" 2024-01-25T15:04:07.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.373 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.373 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2050801459, 2024-01-25T15:04:07.373 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633527, 2024-01-25T15:04:07.373 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-6.c" 2024-01-25T15:04:07.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.374 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.374 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2066257023, 2024-01-25T15:04:07.374 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628898, 2024-01-25T15:04:07.374 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_err_svcerr_progvers/assertions.xml" 2024-01-25T15:04:07.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.374 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.374 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2069379186, 2024-01-25T15:04:07.374 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633489, 2024-01-25T15:04:07.374 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-18.c" 2024-01-25T15:04:07.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.374 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.374 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2071574575, 2024-01-25T15:04:07.375 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633093, 2024-01-25T15:04:07.375 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-14.c" 2024-01-25T15:04:07.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.375 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.375 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2076732309, 2024-01-25T15:04:07.375 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633519, 2024-01-25T15:04:07.375 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-16.c" 2024-01-25T15:04:07.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.375 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.375 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2081043447, 2024-01-25T15:04:07.375 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633434, 2024-01-25T15:04:07.375 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-4.c" 2024-01-25T15:04:07.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.376 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.376 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2081289650, 2024-01-25T15:04:07.376 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633439, 2024-01-25T15:04:07.376 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-18.c" 2024-01-25T15:04:07.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.376 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.376 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2081877437, 2024-01-25T15:04:07.376 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633412, 2024-01-25T15:04:07.376 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-23.c" 2024-01-25T15:04:07.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.377 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.377 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2116826609, 2024-01-25T15:04:07.377 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633492, 2024-01-25T15:04:07.377 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-9.c" 2024-01-25T15:04:07.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.377 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.377 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2119351349, 2024-01-25T15:04:07.377 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633466, 2024-01-25T15:04:07.377 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-24.c" 2024-01-25T15:04:07.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.377 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.378 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2121971888, 2024-01-25T15:04:07.378 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629663, 2024-01-25T15:04:07.378 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend08" 2024-01-25T15:04:07.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.378 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.378 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2131724851, 2024-01-25T15:04:07.378 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633004, 2024-01-25T15:04:07.378 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-core-buildonly.c" 2024-01-25T15:04:07.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.378 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.378 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2138133212, 2024-01-25T15:04:07.378 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633478, 2024-01-25T15:04:07.378 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-58.c" 2024-01-25T15:04:07.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.379 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.379 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2151483382, 2024-01-25T15:04:07.379 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633474, 2024-01-25T15:04:07.379 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-19.c" 2024-01-25T15:04:07.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.379 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.379 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2152905463, 2024-01-25T15:04:07.379 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631713, 2024-01-25T15:04:07.379 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/test.h" 2024-01-25T15:04:07.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.380 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.380 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2168641247, 2024-01-25T15:04:07.380 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633435, 2024-01-25T15:04:07.380 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-97.c" 2024-01-25T15:04:07.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.380 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.380 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2169534480, 2024-01-25T15:04:07.380 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633347, 2024-01-25T15:04:07.380 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-20.c" 2024-01-25T15:04:07.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.380 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.381 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2179675705, 2024-01-25T15:04:07.381 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633300, 2024-01-25T15:04:07.381 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c" 2024-01-25T15:04:07.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.381 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.381 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2201741412, 2024-01-25T15:04:07.381 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633446, 2024-01-25T15:04:07.381 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-84.c" 2024-01-25T15:04:07.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.381 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.381 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2214296255, 2024-01-25T15:04:07.381 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632551, 2024-01-25T15:04:07.382 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/assertions.xml" 2024-01-25T15:04:07.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.382 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.382 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2221439596, 2024-01-25T15:04:07.382 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629640, 2024-01-25T15:04:07.382 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend11" 2024-01-25T15:04:07.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.382 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.382 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2221512717, 2024-01-25T15:04:07.382 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633296, 2024-01-25T15:04:07.382 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-19.c" 2024-01-25T15:04:07.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.383 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.383 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2223875508, 2024-01-25T15:04:07.383 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629654, 2024-01-25T15:04:07.383 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend01" 2024-01-25T15:04:07.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.383 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.383 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2237090324, 2024-01-25T15:04:07.383 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633156, 2024-01-25T15:04:07.383 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-16.c" 2024-01-25T15:04:07.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.383 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.384 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2240231999, 2024-01-25T15:04:07.384 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633114, 2024-01-25T15:04:07.384 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_19-1.in" 2024-01-25T15:04:07.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.384 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.384 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2241897442, 2024-01-25T15:04:07.384 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630062, 2024-01-25T15:04:07.384 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/nfs01" 2024-01-25T15:04:07.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.384 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.384 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2244803520, 2024-01-25T15:04:07.385 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633116, 2024-01-25T15:04:07.385 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-4.in" 2024-01-25T15:04:07.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.385 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.385 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2265154197, 2024-01-25T15:04:07.385 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633297, 2024-01-25T15:04:07.385 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c" 2024-01-25T15:04:07.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.385 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.385 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2276220756, 2024-01-25T15:04:07.385 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633210, 2024-01-25T15:04:07.385 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-16.c" 2024-01-25T15:04:07.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.386 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.386 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2281937414, 2024-01-25T15:04:07.386 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633311, 2024-01-25T15:04:07.386 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-12.c" 2024-01-25T15:04:07.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.386 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.386 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2283004789, 2024-01-25T15:04:07.386 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633141, 2024-01-25T15:04:07.386 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-1.c" 2024-01-25T15:04:07.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.386 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.386 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2300423344, 2024-01-25T15:04:07.387 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633098, 2024-01-25T15:04:07.387 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-24.c" 2024-01-25T15:04:07.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.387 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.387 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2300893861, 2024-01-25T15:04:07.387 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633497, 2024-01-25T15:04:07.387 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-7.c" 2024-01-25T15:04:07.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.387 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.387 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2311819854, 2024-01-25T15:04:07.387 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633100, 2024-01-25T15:04:07.387 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-79.c" 2024-01-25T15:04:07.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.388 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.388 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2323061879, 2024-01-25T15:04:07.388 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633429, 2024-01-25T15:04:07.388 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-17.c" 2024-01-25T15:04:07.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.388 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.388 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2328686070, 2024-01-25T15:04:07.388 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633523, 2024-01-25T15:04:07.388 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/21-1.c" 2024-01-25T15:04:07.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.389 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.389 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2342117801, 2024-01-25T15:04:07.389 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633514, 2024-01-25T15:04:07.389 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-1.c" 2024-01-25T15:04:07.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.389 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.389 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2349505133, 2024-01-25T15:04:07.389 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633545, 2024-01-25T15:04:07.389 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-12.c" 2024-01-25T15:04:07.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.389 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.390 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2349645865, 2024-01-25T15:04:07.390 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633005, 2024-01-25T15:04:07.390 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/assertions.xml" 2024-01-25T15:04:07.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.390 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.390 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2361951593, 2024-01-25T15:04:07.390 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633123, 2024-01-25T15:04:07.390 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-2.in" 2024-01-25T15:04:07.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.390 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.390 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2381569839, 2024-01-25T15:04:07.390 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633329, 2024-01-25T15:04:07.391 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt" 2024-01-25T15:04:07.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.391 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.391 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2389396501, 2024-01-25T15:04:07.391 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633307, 2024-01-25T15:04:07.391 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c" 2024-01-25T15:04:07.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.391 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.391 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2399147752, 2024-01-25T15:04:07.391 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633437, 2024-01-25T15:04:07.391 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-15.c" 2024-01-25T15:04:07.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.392 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.392 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2401816082, 2024-01-25T15:04:07.392 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633224, 2024-01-25T15:04:07.392 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/9-1.sh" 2024-01-25T15:04:07.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.392 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.392 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2403544808, 2024-01-25T15:04:07.392 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633185, 2024-01-25T15:04:07.392 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-23.c" 2024-01-25T15:04:07.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.392 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.393 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2410703995, 2024-01-25T15:04:07.393 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633426, 2024-01-25T15:04:07.393 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-28.c" 2024-01-25T15:04:07.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.393 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.393 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2410942576, 2024-01-25T15:04:07.393 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633469, 2024-01-25T15:04:07.393 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-63.c" 2024-01-25T15:04:07.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.393 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.393 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2416154645, 2024-01-25T15:04:07.393 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633107, 2024-01-25T15:04:07.394 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_2-1.in" 2024-01-25T15:04:07.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.394 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.394 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2423133039, 2024-01-25T15:04:07.394 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633417, 2024-01-25T15:04:07.394 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-1.c" 2024-01-25T15:04:07.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.394 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.394 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2424340606, 2024-01-25T15:04:07.394 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633509, 2024-01-25T15:04:07.394 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-17.c" 2024-01-25T15:04:07.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.395 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.395 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2434003144, 2024-01-25T15:04:07.395 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633402, 2024-01-25T15:04:07.395 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-23.c" 2024-01-25T15:04:07.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.395 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.395 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2450328802, 2024-01-25T15:04:07.395 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633428, 2024-01-25T15:04:07.395 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-16.c" 2024-01-25T15:04:07.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.395 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.395 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2457950022, 2024-01-25T15:04:07.396 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633146, 2024-01-25T15:04:07.396 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-44.c" 2024-01-25T15:04:07.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.396 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.396 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2461294499, 2024-01-25T15:04:07.396 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633125, 2024-01-25T15:04:07.396 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-28.c" 2024-01-25T15:04:07.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.396 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.396 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2481211711, 2024-01-25T15:04:07.396 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633164, 2024-01-25T15:04:07.396 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c" 2024-01-25T15:04:07.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.397 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.397 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2487533669, 2024-01-25T15:04:07.397 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633512, 2024-01-25T15:04:07.397 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-22.c" 2024-01-25T15:04:07.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.397 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.397 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2489010017, 2024-01-25T15:04:07.397 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633361, 2024-01-25T15:04:07.397 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-4.c" 2024-01-25T15:04:07.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.397 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.398 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2491032378, 2024-01-25T15:04:07.398 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633510, 2024-01-25T15:04:07.398 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-15.c" 2024-01-25T15:04:07.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.398 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.398 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2491344686, 2024-01-25T15:04:07.398 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633493, 2024-01-25T15:04:07.398 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-25.c" 2024-01-25T15:04:07.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.398 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.398 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2493088327, 2024-01-25T15:04:07.398 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633001, 2024-01-25T15:04:07.399 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-3.sh" 2024-01-25T15:04:07.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.399 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.399 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2497072524, 2024-01-25T15:04:07.399 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633500, 2024-01-25T15:04:07.399 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-82.c" 2024-01-25T15:04:07.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.399 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.399 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2504436913, 2024-01-25T15:04:07.399 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632681, 2024-01-25T15:04:07.399 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/5-1.c" 2024-01-25T15:04:07.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.400 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.400 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2511468015, 2024-01-25T15:04:07.400 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633397, 2024-01-25T15:04:07.400 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-7.c" 2024-01-25T15:04:07.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.400 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.400 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2518115251, 2024-01-25T15:04:07.400 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633455, 2024-01-25T15:04:07.400 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-70.c" 2024-01-25T15:04:07.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.400 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.400 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2543119303, 2024-01-25T15:04:07.401 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633460, 2024-01-25T15:04:07.401 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-11.c" 2024-01-25T15:04:07.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.401 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.401 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2544477007, 2024-01-25T15:04:07.401 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633101, 2024-01-25T15:04:07.401 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-11.c" 2024-01-25T15:04:07.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.401 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.401 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2556411457, 2024-01-25T15:04:07.401 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633182, 2024-01-25T15:04:07.401 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/10-1.c" 2024-01-25T15:04:07.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2571041425, 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633389, 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-12.c" 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2571569560, 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632687, 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/13-1.c" 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2573340603, 2024-01-25T15:04:07.402 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633126, 2024-01-25T15:04:07.403 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c" 2024-01-25T15:04:07.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.403 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.403 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2584315388, 2024-01-25T15:04:07.403 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633470, 2024-01-25T15:04:07.403 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-9.c" 2024-01-25T15:04:07.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.403 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.403 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2592766702, 2024-01-25T15:04:07.403 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633541, 2024-01-25T15:04:07.403 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-20.c" 2024-01-25T15:04:07.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.404 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.404 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2599373714, 2024-01-25T15:04:07.404 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633386, 2024-01-25T15:04:07.404 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-26.c" 2024-01-25T15:04:07.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.404 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.404 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2611428536, 2024-01-25T15:04:07.404 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632690, 2024-01-25T15:04:07.404 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/11-1.c" 2024-01-25T15:04:07.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.404 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.405 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2625918341, 2024-01-25T15:04:07.405 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633143, 2024-01-25T15:04:07.405 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c" 2024-01-25T15:04:07.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.405 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.405 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2631099771, 2024-01-25T15:04:07.405 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632733, 2024-01-25T15:04:07.407 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/1-1.c" 2024-01-25T15:04:07.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.407 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.408 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2661354960, 2024-01-25T15:04:07.408 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633490, 2024-01-25T15:04:07.408 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-12.c" 2024-01-25T15:04:07.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.408 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.408 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2668205134, 2024-01-25T15:04:07.408 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633134, 2024-01-25T15:04:07.408 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c" 2024-01-25T15:04:07.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.408 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.408 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2674654691, 2024-01-25T15:04:07.409 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633127, 2024-01-25T15:04:07.409 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-22.c" 2024-01-25T15:04:07.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.409 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.409 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2689586889, 2024-01-25T15:04:07.409 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633213, 2024-01-25T15:04:07.409 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-16.c" 2024-01-25T15:04:07.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.409 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.409 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2689748784, 2024-01-25T15:04:07.409 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633352, 2024-01-25T15:04:07.409 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-13.c" 2024-01-25T15:04:07.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.410 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.410 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2699329866, 2024-01-25T15:04:07.410 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633327, 2024-01-25T15:04:07.410 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-2.c" 2024-01-25T15:04:07.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.410 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.410 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2700262486, 2024-01-25T15:04:07.410 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633516, 2024-01-25T15:04:07.410 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-23.c" 2024-01-25T15:04:07.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.410 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2704604042, 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633371, 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-2.c" 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2726531873, 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633584, 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates" 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2727291553, 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633431, 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-36.c" 2024-01-25T15:04:07.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.412 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.412 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2776120939, 2024-01-25T15:04:07.412 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633218, 2024-01-25T15:04:07.412 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-24.c" 2024-01-25T15:04:07.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.412 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.412 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2789527348, 2024-01-25T15:04:07.412 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633508, 2024-01-25T15:04:07.412 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-17.c" 2024-01-25T15:04:07.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.412 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.412 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2792215290, 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633171, 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-2.c" 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2793660686, 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633216, 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c" 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2796952112, 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633174, 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c" 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.414 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.414 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2817789576, 2024-01-25T15:04:07.414 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629665, 2024-01-25T15:04:07.414 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend09" 2024-01-25T15:04:07.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.414 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.414 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.414 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2831196032, 2024-01-25T15:04:07.414 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633520, 2024-01-25T15:04:07.414 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-13.c" 2024-01-25T15:04:07.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.414 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.414 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.414 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2836249882, 2024-01-25T15:04:07.414 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633451, 2024-01-25T15:04:07.415 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-26.c" 2024-01-25T15:04:07.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.415 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.415 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2864393982, 2024-01-25T15:04:07.415 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633168, 2024-01-25T15:04:07.415 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-21.c" 2024-01-25T15:04:07.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.415 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.415 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2882340081, 2024-01-25T15:04:07.415 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633139, 2024-01-25T15:04:07.415 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c" 2024-01-25T15:04:07.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2883114248, 2024-01-25T15:04:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633097, 2024-01-25T15:04:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-39.c" 2024-01-25T15:04:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2884488956, 2024-01-25T15:04:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632678, 2024-01-25T15:04:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/10-1.c" 2024-01-25T15:04:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2892349077, 2024-01-25T15:04:07.416 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633111, 2024-01-25T15:04:07.417 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_13-1.in" 2024-01-25T15:04:07.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.417 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.417 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2898729112, 2024-01-25T15:04:07.417 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633150, 2024-01-25T15:04:07.417 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c" 2024-01-25T15:04:07.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.417 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.417 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2908383912, 2024-01-25T15:04:07.417 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633499, 2024-01-25T15:04:07.417 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/assertions.xml" 2024-01-25T15:04:07.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.418 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.418 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2926264322, 2024-01-25T15:04:07.418 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633374, 2024-01-25T15:04:07.418 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.c" 2024-01-25T15:04:07.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.418 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.418 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.418 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2926315469, 2024-01-25T15:04:07.418 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633535, 2024-01-25T15:04:07.418 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-7.c" 2024-01-25T15:04:07.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.418 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.418 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.418 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2928923254, 2024-01-25T15:04:07.418 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633399, 2024-01-25T15:04:07.419 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-17.c" 2024-01-25T15:04:07.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.419 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.419 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.419 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2938336825, 2024-01-25T15:04:07.419 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633109, 2024-01-25T15:04:07.419 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_16-1.in" 2024-01-25T15:04:07.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.419 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.419 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.419 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2951510994, 2024-01-25T15:04:07.419 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633524, 2024-01-25T15:04:07.419 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-26.c" 2024-01-25T15:04:07.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.420 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.420 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2956504769, 2024-01-25T15:04:07.420 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633203, 2024-01-25T15:04:07.420 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-36.c" 2024-01-25T15:04:07.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.420 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.420 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2962843916, 2024-01-25T15:04:07.420 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633343, 2024-01-25T15:04:07.420 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-2.c" 2024-01-25T15:04:07.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.420 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2976976046, 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633465, 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-11.c" 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2983222433, 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633494, 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-18.c" 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2984108916, 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633112, 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_3-1.in" 2024-01-25T15:04:07.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.422 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.422 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2984427843, 2024-01-25T15:04:07.422 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633332, 2024-01-25T15:04:07.422 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-22.c" 2024-01-25T15:04:07.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.422 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.422 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3031667472, 2024-01-25T15:04:07.422 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633104, 2024-01-25T15:04:07.422 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-6.c" 2024-01-25T15:04:07.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.422 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.422 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3032225990, 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633419, 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-8.c" 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3037441571, 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632683, 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/8-1.c" 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3038256765, 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633464, 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-92.c" 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.423 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.424 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.424 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3041752453, 2024-01-25T15:04:07.424 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633378, 2024-01-25T15:04:07.424 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-20.c" 2024-01-25T15:04:07.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.424 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.424 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3042049159, 2024-01-25T15:04:07.424 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633339, 2024-01-25T15:04:07.424 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-25.c" 2024-01-25T15:04:07.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.424 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.425 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3050483260, 2024-01-25T15:04:07.425 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633189, 2024-01-25T15:04:07.425 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-12.c" 2024-01-25T15:04:07.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.425 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.425 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3069644485, 2024-01-25T15:04:07.425 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633539, 2024-01-25T15:04:07.425 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-37.c" 2024-01-25T15:04:07.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.425 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.425 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3079978631, 2024-01-25T15:04:07.425 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633121, 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-1.in" 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3086267621, 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633188, 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c" 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3088374064, 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633445, 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-9.c" 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.426 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3092419935, 2024-01-25T15:04:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633377, 2024-01-25T15:04:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-23.c" 2024-01-25T15:04:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3097290369, 2024-01-25T15:04:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633170, 2024-01-25T15:04:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-24.c" 2024-01-25T15:04:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3101188046, 2024-01-25T15:04:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632732, 2024-01-25T15:04:07.427 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/2-1.c" 2024-01-25T15:04:07.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.428 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.428 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3101678067, 2024-01-25T15:04:07.428 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633422, 2024-01-25T15:04:07.428 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-12.c" 2024-01-25T15:04:07.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.428 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.428 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3111181630, 2024-01-25T15:04:07.428 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633448, 2024-01-25T15:04:07.428 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-80.c" 2024-01-25T15:04:07.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.429 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.429 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3112656771, 2024-01-25T15:04:07.429 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633242, 2024-01-25T15:04:07.429 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/coverage.txt" 2024-01-25T15:04:07.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.429 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.429 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.429 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3126712744, 2024-01-25T15:04:07.429 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633403, 2024-01-25T15:04:07.429 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-23.c" 2024-01-25T15:04:07.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.429 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.429 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.429 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3134383212, 2024-01-25T15:04:07.430 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633454, 2024-01-25T15:04:07.430 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-16.c" 2024-01-25T15:04:07.430 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.430 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.430 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.430 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3140028689, 2024-01-25T15:04:07.430 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633480, 2024-01-25T15:04:07.430 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-5.c" 2024-01-25T15:04:07.430 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.430 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.430 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.430 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3144920516, 2024-01-25T15:04:07.430 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633421, 2024-01-25T15:04:07.430 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-2.c" 2024-01-25T15:04:07.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.431 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.431 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3161784732, 2024-01-25T15:04:07.431 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633215, 2024-01-25T15:04:07.431 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-5.c" 2024-01-25T15:04:07.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.431 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.431 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3163560605, 2024-01-25T15:04:07.431 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633388, 2024-01-25T15:04:07.431 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-10.c" 2024-01-25T15:04:07.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.431 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.432 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3167578604, 2024-01-25T15:04:07.432 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630796, 2024-01-25T15:04:07.432 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/cases.sh" 2024-01-25T15:04:07.432 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.432 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.432 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.432 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3174369831, 2024-01-25T15:04:07.432 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633370, 2024-01-25T15:04:07.432 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-98.c" 2024-01-25T15:04:07.432 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.432 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.432 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.432 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3188104163, 2024-01-25T15:04:07.432 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633479, 2024-01-25T15:04:07.433 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-19.c" 2024-01-25T15:04:07.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.433 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.433 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3202339149, 2024-01-25T15:04:07.433 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633396, 2024-01-25T15:04:07.433 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-14.c" 2024-01-25T15:04:07.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.433 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.433 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3203290516, 2024-01-25T15:04:07.433 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633530, 2024-01-25T15:04:07.433 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-6.c" 2024-01-25T15:04:07.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.434 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.434 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3211017219, 2024-01-25T15:04:07.434 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633335, 2024-01-25T15:04:07.434 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-8.c" 2024-01-25T15:04:07.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.434 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.434 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3212710981, 2024-01-25T15:04:07.434 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633153, 2024-01-25T15:04:07.434 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-26.c" 2024-01-25T15:04:07.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.434 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.434 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3237382264, 2024-01-25T15:04:07.435 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633124, 2024-01-25T15:04:07.435 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-2.in" 2024-01-25T15:04:07.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.435 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.435 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3251932577, 2024-01-25T15:04:07.435 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633196, 2024-01-25T15:04:07.435 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-19.c" 2024-01-25T15:04:07.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.435 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.435 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3270208492, 2024-01-25T15:04:07.435 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633449, 2024-01-25T15:04:07.435 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-20.c" 2024-01-25T15:04:07.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.436 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.436 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3276025688, 2024-01-25T15:04:07.436 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633367, 2024-01-25T15:04:07.436 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-1.c" 2024-01-25T15:04:07.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.436 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.436 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3282195804, 2024-01-25T15:04:07.436 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633206, 2024-01-25T15:04:07.436 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/gentests.pl" 2024-01-25T15:04:07.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.436 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.437 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3288451007, 2024-01-25T15:04:07.437 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633447, 2024-01-25T15:04:07.437 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-17.c" 2024-01-25T15:04:07.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.437 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.437 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3304283300, 2024-01-25T15:04:07.437 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633147, 2024-01-25T15:04:07.437 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c" 2024-01-25T15:04:07.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.437 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.437 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3305490382, 2024-01-25T15:04:07.437 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633194, 2024-01-25T15:04:07.437 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-22.c" 2024-01-25T15:04:07.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.438 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.438 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.438 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3309196990, 2024-01-25T15:04:07.438 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629651, 2024-01-25T15:04:07.438 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend14" 2024-01-25T15:04:07.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.438 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.438 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.438 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3321570025, 2024-01-25T15:04:07.438 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633208, 2024-01-25T15:04:07.438 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-7.c" 2024-01-25T15:04:07.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.438 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.438 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3328501644, 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633119, 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_6-1.in" 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3346362031, 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633312, 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-94.c" 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3347948103, 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632552, 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/2-1.sh" 2024-01-25T15:04:07.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.440 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.440 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3373446444, 2024-01-25T15:04:07.440 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632927, 2024-01-25T15:04:07.440 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/coverage.txt" 2024-01-25T15:04:07.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.440 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.440 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3378286016, 2024-01-25T15:04:07.440 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633298, 2024-01-25T15:04:07.440 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-25.c" 2024-01-25T15:04:07.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.440 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.441 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3394351490, 2024-01-25T15:04:07.441 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633532, 2024-01-25T15:04:07.441 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-5.c" 2024-01-25T15:04:07.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.441 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.441 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3406145894, 2024-01-25T15:04:07.441 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633416, 2024-01-25T15:04:07.441 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-19.c" 2024-01-25T15:04:07.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.441 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.441 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3413992534, 2024-01-25T15:04:07.441 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633440, 2024-01-25T15:04:07.441 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-12.c" 2024-01-25T15:04:07.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.442 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.442 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3423099762, 2024-01-25T15:04:07.442 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633117, 2024-01-25T15:04:07.442 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_8-1.in" 2024-01-25T15:04:07.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.442 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.442 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3423723313, 2024-01-25T15:04:07.442 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633549, 2024-01-25T15:04:07.442 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/3-1.c" 2024-01-25T15:04:07.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.443 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.443 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3435282521, 2024-01-25T15:04:07.443 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633122, 2024-01-25T15:04:07.443 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_18-1.in" 2024-01-25T15:04:07.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.443 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.443 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3442102438, 2024-01-25T15:04:07.443 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631400, 2024-01-25T15:04:07.443 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/sensor_factors_000.cpp" 2024-01-25T15:04:07.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.443 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.443 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3490143994, 2024-01-25T15:04:07.444 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633169, 2024-01-25T15:04:07.444 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c" 2024-01-25T15:04:07.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.444 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.444 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3518580596, 2024-01-25T15:04:07.444 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633369, 2024-01-25T15:04:07.444 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-22.c" 2024-01-25T15:04:07.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.444 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.444 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3520670548, 2024-01-25T15:04:07.444 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633314, 2024-01-25T15:04:07.445 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c" 2024-01-25T15:04:07.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.445 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.445 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3532848726, 2024-01-25T15:04:07.445 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633405, 2024-01-25T15:04:07.445 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-49.c" 2024-01-25T15:04:07.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.445 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.445 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3547939441, 2024-01-25T15:04:07.445 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633506, 2024-01-25T15:04:07.445 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-15.c" 2024-01-25T15:04:07.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3552328927, 2024-01-25T15:04:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633180, 2024-01-25T15:04:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c" 2024-01-25T15:04:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3566470566, 2024-01-25T15:04:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633192, 2024-01-25T15:04:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-8.c" 2024-01-25T15:04:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3568044015, 2024-01-25T15:04:07.446 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633354, 2024-01-25T15:04:07.447 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-26.c" 2024-01-25T15:04:07.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.447 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.447 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3593763071, 2024-01-25T15:04:07.447 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632087, 2024-01-25T15:04:07.447 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/cmdlib.sh" 2024-01-25T15:04:07.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.447 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.447 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3606199885, 2024-01-25T15:04:07.447 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633325, 2024-01-25T15:04:07.447 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c" 2024-01-25T15:04:07.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.448 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.448 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3613760022, 2024-01-25T15:04:07.448 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633487, 2024-01-25T15:04:07.448 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-16.c" 2024-01-25T15:04:07.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.448 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.448 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3632451484, 2024-01-25T15:04:07.448 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633363, 2024-01-25T15:04:07.448 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-23.c" 2024-01-25T15:04:07.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.449 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.449 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3636319117, 2024-01-25T15:04:07.449 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633204, 2024-01-25T15:04:07.449 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-20.c" 2024-01-25T15:04:07.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.449 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.449 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3644238808, 2024-01-25T15:04:07.449 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633366, 2024-01-25T15:04:07.449 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-4.c" 2024-01-25T15:04:07.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.449 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.449 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3698087167, 2024-01-25T15:04:07.450 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633118, 2024-01-25T15:04:07.450 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_17-1.in" 2024-01-25T15:04:07.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.450 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.450 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3724018435, 2024-01-25T15:04:07.450 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633144, 2024-01-25T15:04:07.450 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-15.c" 2024-01-25T15:04:07.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.450 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.450 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3732575776, 2024-01-25T15:04:07.450 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633443, 2024-01-25T15:04:07.451 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-40.c" 2024-01-25T15:04:07.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.451 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.451 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3742559131, 2024-01-25T15:04:07.451 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633485, 2024-01-25T15:04:07.451 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-25.c" 2024-01-25T15:04:07.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.451 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.451 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3775402154, 2024-01-25T15:04:07.451 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633436, 2024-01-25T15:04:07.451 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-101.c" 2024-01-25T15:04:07.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.452 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.452 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3784450872, 2024-01-25T15:04:07.452 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633477, 2024-01-25T15:04:07.452 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-12.c" 2024-01-25T15:04:07.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.452 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.452 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3785506343, 2024-01-25T15:04:07.452 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633211, 2024-01-25T15:04:07.452 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-24.c" 2024-01-25T15:04:07.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.452 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.453 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3792425915, 2024-01-25T15:04:07.453 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633372, 2024-01-25T15:04:07.453 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-2.c" 2024-01-25T15:04:07.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.453 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.453 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3794221866, 2024-01-25T15:04:07.453 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633504, 2024-01-25T15:04:07.453 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-8.c" 2024-01-25T15:04:07.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.453 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.453 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3796072709, 2024-01-25T15:04:07.453 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629652, 2024-01-25T15:04:07.454 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend13" 2024-01-25T15:04:07.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.454 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.454 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3812476747, 2024-01-25T15:04:07.454 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633408, 2024-01-25T15:04:07.454 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-100.c" 2024-01-25T15:04:07.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.454 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.454 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3813786271, 2024-01-25T15:04:07.454 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633102, 2024-01-25T15:04:07.454 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-44.c" 2024-01-25T15:04:07.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.455 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.455 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3815936911, 2024-01-25T15:04:07.455 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633486, 2024-01-25T15:04:07.455 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-31.c" 2024-01-25T15:04:07.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.455 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.455 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3824746270, 2024-01-25T15:04:07.455 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629649, 2024-01-25T15:04:07.455 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/00_Descriptions.txt" 2024-01-25T15:04:07.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.455 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.455 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3839058402, 2024-01-25T15:04:07.456 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633517, 2024-01-25T15:04:07.456 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-51.c" 2024-01-25T15:04:07.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.456 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.456 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3861427370, 2024-01-25T15:04:07.456 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633350, 2024-01-25T15:04:07.456 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-25.c" 2024-01-25T15:04:07.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.456 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.456 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3889185977, 2024-01-25T15:04:07.456 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629642, 2024-01-25T15:04:07.456 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend07" 2024-01-25T15:04:07.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.457 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.457 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3905962413, 2024-01-25T15:04:07.457 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633410, 2024-01-25T15:04:07.457 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-9.c" 2024-01-25T15:04:07.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.457 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.457 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3910276750, 2024-01-25T15:04:07.457 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633415, 2024-01-25T15:04:07.457 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-25.c" 2024-01-25T15:04:07.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.457 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.458 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3919727727, 2024-01-25T15:04:07.458 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633323, 2024-01-25T15:04:07.458 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-15.c" 2024-01-25T15:04:07.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.458 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.458 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3936082566, 2024-01-25T15:04:07.458 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633427, 2024-01-25T15:04:07.458 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-22.c" 2024-01-25T15:04:07.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.458 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.458 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3951665802, 2024-01-25T15:04:07.458 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633355, 2024-01-25T15:04:07.458 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-2.c" 2024-01-25T15:04:07.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.459 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.459 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3997812895, 2024-01-25T15:04:07.459 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632682, 2024-01-25T15:04:07.459 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/1-1.c" 2024-01-25T15:04:07.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.459 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.459 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4012591090, 2024-01-25T15:04:07.459 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633525, 2024-01-25T15:04:07.459 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-86.c" 2024-01-25T15:04:07.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.459 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.460 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4019514503, 2024-01-25T15:04:07.460 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633095, 2024-01-25T15:04:07.460 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c" 2024-01-25T15:04:07.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.460 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.460 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4022102389, 2024-01-25T15:04:07.460 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632686, 2024-01-25T15:04:07.460 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/7-1.c" 2024-01-25T15:04:07.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.460 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.460 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4028565626, 2024-01-25T15:04:07.461 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633453, 2024-01-25T15:04:07.461 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-21.c" 2024-01-25T15:04:07.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.461 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.461 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4028949317, 2024-01-25T15:04:07.461 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629577, 2024-01-25T15:04:07.461 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_err_svcerr_progvers/1-basic.c" 2024-01-25T15:04:07.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.461 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.461 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4040713143, 2024-01-25T15:04:07.461 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632679, 2024-01-25T15:04:07.461 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/coverage.txt" 2024-01-25T15:04:07.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.462 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.462 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4041061634, 2024-01-25T15:04:07.462 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633424, 2024-01-25T15:04:07.462 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-69.c" 2024-01-25T15:04:07.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.462 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.462 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4045785199, 2024-01-25T15:04:07.462 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633319, 2024-01-25T15:04:07.462 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-71.c" 2024-01-25T15:04:07.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.462 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4057573661, 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633317, 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-9.c" 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4075056154, 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633133, 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-46.c" 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4076203695, 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633172, 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-46.c" 2024-01-25T15:04:07.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.464 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.464 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4077102898, 2024-01-25T15:04:07.464 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633430, 2024-01-25T15:04:07.464 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-62.c" 2024-01-25T15:04:07.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.464 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.464 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4081731860, 2024-01-25T15:04:07.464 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633161, 2024-01-25T15:04:07.464 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-12.c" 2024-01-25T15:04:07.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.465 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.465 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4082468538, 2024-01-25T15:04:07.465 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633337, 2024-01-25T15:04:07.465 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-19.c" 2024-01-25T15:04:07.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.465 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.465 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4083818262, 2024-01-25T15:04:07.465 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633166, 2024-01-25T15:04:07.465 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c" 2024-01-25T15:04:07.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.465 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.465 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4086036678, 2024-01-25T15:04:07.465 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633459, 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-7.c" 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4109155981, 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633515, 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-7.c" 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4111661333, 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633108, 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_23-1.in" 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.466 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.467 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4112169000, 2024-01-25T15:04:07.467 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633162, 2024-01-25T15:04:07.467 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c" 2024-01-25T15:04:07.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.467 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.467 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4124540435, 2024-01-25T15:04:07.467 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633136, 2024-01-25T15:04:07.467 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-5.c" 2024-01-25T15:04:07.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.467 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.467 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4132199362, 2024-01-25T15:04:07.467 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630794, 2024-01-25T15:04:07.468 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data" 2024-01-25T15:04:07.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.468 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.468 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4157717340, 2024-01-25T15:04:07.468 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633364, 2024-01-25T15:04:07.468 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-33.c" 2024-01-25T15:04:07.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.468 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.468 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4160853021, 2024-01-25T15:04:07.468 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633120, 2024-01-25T15:04:07.468 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-1.in" 2024-01-25T15:04:07.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.469 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.469 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4166024680, 2024-01-25T15:04:07.469 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633379, 2024-01-25T15:04:07.469 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-31.c" 2024-01-25T15:04:07.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.469 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.469 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4169299889, 2024-01-25T15:04:07.469 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629660, 2024-01-25T15:04:07.469 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend03" 2024-01-25T15:04:07.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.469 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.469 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4170815250, 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633468, 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-18.c" 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4173586791, 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633407, 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-13.c" 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4182084396, 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631398, 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_000.cpp" 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.471 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.471 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4182173127, 2024-01-25T15:04:07.471 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633543, 2024-01-25T15:04:07.471 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-3.c" 2024-01-25T15:04:07.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.471 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.471 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4186062142, 2024-01-25T15:04:07.471 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633190, 2024-01-25T15:04:07.471 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c" 2024-01-25T15:04:07.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.471 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.471 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4188618891, 2024-01-25T15:04:07.471 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633420, 2024-01-25T15:04:07.472 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-21.c" 2024-01-25T15:04:07.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.472 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.472 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4197497846, 2024-01-25T15:04:07.472 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633380, 2024-01-25T15:04:07.472 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-25.c" 2024-01-25T15:04:07.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.472 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.472 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4197861130, 2024-01-25T15:04:07.472 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629648, 2024-01-25T15:04:07.472 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend02" 2024-01-25T15:04:07.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.473 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.473 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4213144756, 2024-01-25T15:04:07.473 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633006, 2024-01-25T15:04:07.473 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/4-1.c" 2024-01-25T15:04:07.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.473 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.473 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4243840664, 2024-01-25T15:04:07.473 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633140, 2024-01-25T15:04:07.473 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c" 2024-01-25T15:04:07.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.473 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.474 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4250222305, 2024-01-25T15:04:07.474 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633129, 2024-01-25T15:04:07.474 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c" 2024-01-25T15:04:07.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.474 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.474 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4265907456, 2024-01-25T15:04:07.474 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633179, 2024-01-25T15:04:07.474 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c" 2024-01-25T15:04:07.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.474 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.474 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4273073955, 2024-01-25T15:04:07.474 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633328, 2024-01-25T15:04:07.475 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c" 2024-01-25T15:04:07.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.475 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.475 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4278693174, 2024-01-25T15:04:07.475 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633404, 2024-01-25T15:04:07.475 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-10.c" 2024-01-25T15:04:07.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.475 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.475 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4279298174, 2024-01-25T15:04:07.475 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629650, 2024-01-25T15:04:07.475 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend04" 2024-01-25T15:04:07.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.476 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.476 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4282020885, 2024-01-25T15:04:07.476 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633219, 2024-01-25T15:04:07.476 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c" 2024-01-25T15:04:07.476 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:07.476 INFO:teuthology.orchestra.run.smithi170.stdout:] 2024-01-25T15:04:07.477 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a3389640 1 -- 172.21.15.170:0/1272023591 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f60880a12e0 msgr2=0x7f60880a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a3389640 1 --2- 172.21.15.170:0/1272023591 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f60880a12e0 0x7f60880a37a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f60940098b0 tx=0x7f6094009e20 comp rx=0 tx=0).stop 2024-01-25T15:04:07.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a3389640 1 -- 172.21.15.170:0/1272023591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f609c0fefb0 msgr2=0x7f609c196d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a3389640 1 --2- 172.21.15.170:0/1272023591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f609c0fefb0 0x7f609c196d30 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6098009230 tx=0x7f6098004ed0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a3389640 1 -- 172.21.15.170:0/1272023591 shutdown_connections 2024-01-25T15:04:07.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a3389640 1 --2- 172.21.15.170:0/1272023591 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f60880a12e0 0x7f60880a37a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a3389640 1 --2- 172.21.15.170:0/1272023591 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f609c101f80 0x7f609c197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a3389640 1 --2- 172.21.15.170:0/1272023591 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f609c102940 0x7f609c19e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.274+0000 7f60a3389640 1 --2- 172.21.15.170:0/1272023591 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f609c0fefb0 0x7f609c196d30 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.275+0000 7f60a3389640 1 -- 172.21.15.170:0/1272023591 >> 172.21.15.170:0/1272023591 conn(0x7f609c0fa8e0 msgr2=0x7f609c1053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.275+0000 7f60a3389640 1 -- 172.21.15.170:0/1272023591 shutdown_connections 2024-01-25T15:04:07.478 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.275+0000 7f60a3389640 1 -- 172.21.15.170:0/1272023591 wait complete. 2024-01-25T15:04:07.480 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-01-25T15:04:07.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:07 smithi170 ceph-mon[31899]: pgmap v412: 97 pgs: 97 active+clean; 117 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.7 MiB/s wr, 445 op/s 2024-01-25T15:04:07.480 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:07 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3975515627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:04:07.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.598+0000 7f779335a640 1 -- 172.21.15.170:0/644900249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f778c100e00 msgr2=0x7f778c101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.598+0000 7f779335a640 1 --2- 172.21.15.170:0/644900249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f778c100e00 0x7f778c101280 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f777c009900 tx=0x7f777c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:04:07.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.598+0000 7f779335a640 1 -- 172.21.15.170:0/644900249 shutdown_connections 2024-01-25T15:04:07.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.598+0000 7f779335a640 1 --2- 172.21.15.170:0/644900249 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f778c1017c0 0x7f778c108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.599 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.598+0000 7f779335a640 1 --2- 172.21.15.170:0/644900249 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f778c100e00 0x7f778c101280 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.598+0000 7f779335a640 1 --2- 172.21.15.170:0/644900249 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f778c0ffc10 0x7f778c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.600 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.598+0000 7f779335a640 1 -- 172.21.15.170:0/644900249 >> 172.21.15.170:0/644900249 conn(0x7f778c0fb180 msgr2=0x7f778c0fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.599+0000 7f779335a640 1 -- 172.21.15.170:0/644900249 shutdown_connections 2024-01-25T15:04:07.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.599+0000 7f779335a640 1 -- 172.21.15.170:0/644900249 wait complete. 2024-01-25T15:04:07.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f779335a640 1 Processor -- start 2024-01-25T15:04:07.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f779335a640 1 -- start start 2024-01-25T15:04:07.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f779335a640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f778c0ffc10 0x7f778c198ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.602 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f779335a640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f778c100e00 0x7f778c199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f779335a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f778c1017c0 0x7f778c1a04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f779335a640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c1a09e0 con 0x7f778c100e00 2024-01-25T15:04:07.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f779335a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c1a0b50 con 0x7f778c1017c0 2024-01-25T15:04:07.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f779335a640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c1a0d10 con 0x7f778c0ffc10 2024-01-25T15:04:07.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f77908f5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f778c100e00 0x7f778c199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f77908f5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f778c100e00 0x7f778c199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56290/0 (socket says 172.21.15.170:56290) 2024-01-25T15:04:07.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f77908f5640 1 -- 172.21.15.170:0/3449788539 learned_addr learned my addr 172.21.15.170:0/3449788539 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f77918f7640 1 --2- 172.21.15.170:0/3449788539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f778c1017c0 0x7f778c1a04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f77910f6640 1 --2- 172.21.15.170:0/3449788539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f778c0ffc10 0x7f778c198ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f77908f5640 1 -- 172.21.15.170:0/3449788539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f778c0ffc10 msgr2=0x7f778c198ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f77908f5640 1 --2- 172.21.15.170:0/3449788539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f778c0ffc10 0x7f778c198ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f77908f5640 1 -- 172.21.15.170:0/3449788539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f778c1017c0 msgr2=0x7f778c1a04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.600+0000 7f77908f5640 1 --2- 172.21.15.170:0/3449788539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f778c1017c0 0x7f778c1a04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.603 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.601+0000 7f77908f5640 1 -- 172.21.15.170:0/3449788539 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777c009560 con 0x7f778c100e00 2024-01-25T15:04:07.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.601+0000 7f77908f5640 1 --2- 172.21.15.170:0/3449788539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f778c100e00 0x7f778c199430 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f777c000c00 tx=0x7f777c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.601+0000 7f77827fc640 1 -- 172.21.15.170:0/3449788539 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c0044c0 con 0x7f778c100e00 2024-01-25T15:04:07.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.601+0000 7f77827fc640 1 -- 172.21.15.170:0/3449788539 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f777c003ab0 con 0x7f778c100e00 2024-01-25T15:04:07.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.601+0000 7f77827fc640 1 -- 172.21.15.170:0/3449788539 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c005630 con 0x7f778c100e00 2024-01-25T15:04:07.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.601+0000 7f779335a640 1 -- 172.21.15.170:0/3449788539 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778c1a0f90 con 0x7f778c100e00 2024-01-25T15:04:07.604 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.601+0000 7f779335a640 1 -- 172.21.15.170:0/3449788539 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778c1a1410 con 0x7f778c100e00 2024-01-25T15:04:07.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:07 smithi186 ceph-mon[35697]: pgmap v412: 97 pgs: 97 active+clean; 117 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.7 MiB/s wr, 445 op/s 2024-01-25T15:04:07.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:07 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3975515627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:04:07.605 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.604+0000 7f77827fc640 1 -- 172.21.15.170:0/3449788539 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f777c003c20 con 0x7f778c100e00 2024-01-25T15:04:07.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.604+0000 7f7795ff9740 1 Processor -- start 2024-01-25T15:04:07.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f77827fc640 1 --2- 172.21.15.170:0/3449788539 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f77780a1360 0x7f77780a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f7795ff9740 1 -- start start 2024-01-25T15:04:07.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f77918f7640 1 --2- 172.21.15.170:0/3449788539 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f77780a1360 0x7f77780a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f77827fc640 1 -- 172.21.15.170:0/3449788539 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f777c0ef270 con 0x7f778c100e00 2024-01-25T15:04:07.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f7795ff9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac8286360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f7795ff9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac8286930 0x55eac828b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f7795ff9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac828baa0 0x55eac828df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f7795ff9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac81f4270 con 0x55eac828baa0 2024-01-25T15:04:07.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f7795ff9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac81f1960 con 0x55eac8285f40 2024-01-25T15:04:07.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f7795ff9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac81ed250 con 0x55eac8286930 2024-01-25T15:04:07.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f77910f6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac8286360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f77910f6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac8286360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:43816/0 (socket says 172.21.15.170:43816) 2024-01-25T15:04:07.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f77910f6640 1 -- 172.21.15.170:0/2684173713 learned_addr learned my addr 172.21.15.170:0/2684173713 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f77908f5640 1 --2- 172.21.15.170:0/2684173713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac8286930 0x55eac828b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f77918f7640 1 --2- 172.21.15.170:0/2684173713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac828baa0 0x55eac828df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f77918f7640 1 --2- 172.21.15.170:0/3449788539 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f77780a1360 0x7f77780a3820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7784005fd0 tx=0x7f7784011810 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f77910f6640 1 -- 172.21.15.170:0/2684173713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac8286930 msgr2=0x55eac828b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f77910f6640 1 --2- 172.21.15.170:0/2684173713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac8286930 0x55eac828b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f77910f6640 1 -- 172.21.15.170:0/2684173713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac828baa0 msgr2=0x55eac828df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f77910f6640 1 --2- 172.21.15.170:0/2684173713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac828baa0 0x55eac828df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.605+0000 7f77910f6640 1 -- 172.21.15.170:0/2684173713 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eac81af7f0 con 0x55eac8285f40 2024-01-25T15:04:07.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.606+0000 7f77910f6640 1 --2- 172.21.15.170:0/2684173713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac8286360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7788009ca0 tx=0x7f7788011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a5f61402e56dd52 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.606+0000 7f77777fe640 1 -- 172.21.15.170:0/2684173713 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788004220 con 0x55eac8285f40 2024-01-25T15:04:07.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.606+0000 7f77777fe640 1 -- 172.21.15.170:0/2684173713 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7788009e50 con 0x55eac8285f40 2024-01-25T15:04:07.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.606+0000 7f77777fe640 1 -- 172.21.15.170:0/2684173713 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788019690 con 0x55eac8285f40 2024-01-25T15:04:07.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.607+0000 7f7795ff9740 1 -- 172.21.15.170:0/2684173713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 msgr2=0x55eac8286360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.607+0000 7f7795ff9740 1 --2- 172.21.15.170:0/2684173713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac8286360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7788009ca0 tx=0x7f7788011810 comp rx=0 tx=0).stop 2024-01-25T15:04:07.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.607+0000 7f7795ff9740 1 -- 172.21.15.170:0/2684173713 shutdown_connections 2024-01-25T15:04:07.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.607+0000 7f7795ff9740 1 --2- 172.21.15.170:0/2684173713 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac828baa0 0x55eac828df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.607+0000 7f7795ff9740 1 --2- 172.21.15.170:0/2684173713 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac8286930 0x55eac828b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.607+0000 7f7795ff9740 1 --2- 172.21.15.170:0/2684173713 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac8286360 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.607+0000 7f7795ff9740 1 -- 172.21.15.170:0/2684173713 >> 172.21.15.170:0/2684173713 conn(0x55eac82814b0 msgr2=0x55eac82818b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.607+0000 7f7795ff9740 1 -- 172.21.15.170:0/2684173713 shutdown_connections 2024-01-25T15:04:07.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.607+0000 7f7795ff9740 1 -- 172.21.15.170:0/2684173713 wait complete. 2024-01-25T15:04:07.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.607+0000 7f7795ff9740 1 -- start start 2024-01-25T15:04:07.610 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.607+0000 7f7795ff9740 1 Processor -- start 2024-01-25T15:04:07.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f7795ff9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac8285f40 0x55eac8290120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f7795ff9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac8290660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f7795ff9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac828baa0 0x55eac8297630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f7795ff9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac81a6610 con 0x55eac8286930 2024-01-25T15:04:07.613 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f7795ff9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac81a62b0 con 0x55eac828baa0 2024-01-25T15:04:07.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f7795ff9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac816b400 con 0x55eac8285f40 2024-01-25T15:04:07.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f77910f6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac8285f40 0x55eac8290120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f77910f6640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac8285f40 0x55eac8290120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:55220/0 (socket says 172.21.15.170:55220) 2024-01-25T15:04:07.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f77910f6640 1 -- 172.21.15.170:0/4186661954 learned_addr learned my addr 172.21.15.170:0/4186661954 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f7795ff9740 10 client.0 _ll_register_callbacks cb 0x55eac81e3ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:07.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f77908f5640 1 --2- 172.21.15.170:0/4186661954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac8290660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f77918f7640 1 --2- 172.21.15.170:0/4186661954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac828baa0 0x55eac8297630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f77910f6640 1 -- 172.21.15.170:0/4186661954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac828baa0 msgr2=0x55eac8297630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f77910f6640 1 --2- 172.21.15.170:0/4186661954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac828baa0 0x55eac8297630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f77910f6640 1 -- 172.21.15.170:0/4186661954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 msgr2=0x55eac8290660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f77910f6640 1 --2- 172.21.15.170:0/4186661954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac8290660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f77910f6640 1 -- 172.21.15.170:0/4186661954 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77880098d0 con 0x55eac8285f40 2024-01-25T15:04:07.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.608+0000 7f77908f5640 1 --2- 172.21.15.170:0/4186661954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac8290660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:07.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.609+0000 7f77910f6640 1 --2- 172.21.15.170:0/4186661954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac8285f40 0x55eac8290120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7788011d10 tx=0x7f7788004250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad45d50252329926 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.614 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.609+0000 7f7774ff9640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-01-25T15:04:07.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.609+0000 7f7774ff9640 1 -- 172.21.15.170:0/4186661954 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788003bc0 con 0x55eac8285f40 2024-01-25T15:04:07.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.609+0000 7f7774ff9640 1 -- 172.21.15.170:0/4186661954 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f7788005040 con 0x55eac8285f40 2024-01-25T15:04:07.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.610+0000 7f7795ff9740 1 -- 172.21.15.170:0/4186661954 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eac81e60e0 con 0x55eac8285f40 2024-01-25T15:04:07.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.610+0000 7f7774ff9640 1 -- 172.21.15.170:0/4186661954 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7788005240 con 0x55eac8285f40 2024-01-25T15:04:07.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.610+0000 7f7795ff9740 10 client.25480 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:07.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.610+0000 7f7795ff9740 1 -- 172.21.15.170:0/4186661954 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55eac81eb8d0 con 0x55eac8285f40 2024-01-25T15:04:07.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.610+0000 7f7774ff9640 1 -- 172.21.15.170:0/4186661954 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77880053a0 con 0x55eac8285f40 2024-01-25T15:04:07.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.610+0000 7f7774ff9640 1 -- 172.21.15.170:0/4186661954 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f7788024580 con 0x55eac8285f40 2024-01-25T15:04:07.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.611+0000 7f7795ff9740 10 client.25480 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:07.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.611+0000 7f7795ff9740 10 client.25480 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-01-25T15:04:07.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.611+0000 7f7795ff9740 20 client.25480 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:07.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.611+0000 7f7795ff9740 1 --2- 172.21.15.170:0/4186661954 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55eac829be70 0x55eac829e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.611+0000 7f7795ff9740 4 client.25480 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:04:07.615 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.611+0000 7f7795ff9740 1 -- 172.21.15.170:0/4186661954 --> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eac81e60e0 con 0x55eac829be70 2024-01-25T15:04:07.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.611+0000 7f77908f5640 1 --2- 172.21.15.170:0/4186661954 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55eac829be70 0x55eac829e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.612+0000 7f7774ff9640 10 client.25480 ms_handle_connect on v2:172.21.15.186:6838/2132502182 2024-01-25T15:04:07.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.612+0000 7f77908f5640 1 --2- 172.21.15.170:0/4186661954 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55eac829be70 0x55eac829e2f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f85c471e8314fb35 server_cookie=8cfe5269e5b26ccf in_seq=0 out_seq=0 2024-01-25T15:04:07.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.613+0000 7f7774ff9640 1 -- 172.21.15.170:0/4186661954 <== mds.1 v2:172.21.15.186:6838/2132502182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55eac81e60e0 con 0x55eac829be70 2024-01-25T15:04:07.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.613+0000 7f7774ff9640 10 client.25480 handle_command_reply: tid=0 2024-01-25T15:04:07.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.613+0000 7f7795ff9740 1 client.25480 shutdown 2024-01-25T15:04:07.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.613+0000 7f7795ff9740 1 -- 172.21.15.170:0/4186661954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac8285f40 msgr2=0x55eac8290120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.616 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.613+0000 7f7795ff9740 1 --2- 172.21.15.170:0/4186661954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac8285f40 0x55eac8290120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7788011d10 tx=0x7f7788004250 comp rx=0 tx=0).stop 2024-01-25T15:04:07.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.613+0000 7f7795ff9740 1 -- 172.21.15.170:0/4186661954 shutdown_connections 2024-01-25T15:04:07.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.613+0000 7f7795ff9740 1 --2- 172.21.15.170:0/4186661954 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55eac829be70 0x55eac829e2f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.613+0000 7f7795ff9740 1 --2- 172.21.15.170:0/4186661954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac828baa0 0x55eac8297630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.613+0000 7f7795ff9740 1 --2- 172.21.15.170:0/4186661954 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac8290660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.613+0000 7f7795ff9740 1 --2- 172.21.15.170:0/4186661954 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac8285f40 0x55eac8290120 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.613+0000 7f7795ff9740 1 -- 172.21.15.170:0/4186661954 >> 172.21.15.170:0/4186661954 conn(0x55eac82814b0 msgr2=0x55eac82807f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.613+0000 7f7774ff9640 0 client.25480 ms_handle_reset on v2:172.21.15.186:6838/2132502182 2024-01-25T15:04:07.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.613+0000 7f7795ff9740 1 -- 172.21.15.170:0/4186661954 shutdown_connections 2024-01-25T15:04:07.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.613+0000 7f7795ff9740 1 -- 172.21.15.170:0/4186661954 wait complete. 2024-01-25T15:04:07.617 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.613+0000 7f7795ff9740 20 client.25480 trim_cache size 0 max 16384 2024-01-25T15:04:07.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.633+0000 7f7795ff9740 1 Processor -- start 2024-01-25T15:04:07.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.633+0000 7f7795ff9740 1 -- start start 2024-01-25T15:04:07.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.633+0000 7f7795ff9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac8287e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.633+0000 7f7795ff9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac82883c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.633+0000 7f7795ff9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac828baa0 0x55eac82975f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.633+0000 7f7795ff9740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac81e60e0 con 0x55eac8286930 2024-01-25T15:04:07.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.633+0000 7f7795ff9740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac8286d10 con 0x55eac8285f40 2024-01-25T15:04:07.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.633+0000 7f7795ff9740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac8298120 con 0x55eac828baa0 2024-01-25T15:04:07.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.633+0000 7f77908f5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac82883c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.633+0000 7f77908f5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac82883c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56328/0 (socket says 172.21.15.170:56328) 2024-01-25T15:04:07.634 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.633+0000 7f77908f5640 1 -- 172.21.15.170:0/2038126036 learned_addr learned my addr 172.21.15.170:0/2038126036 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.633+0000 7f77918f7640 1 --2- 172.21.15.170:0/2038126036 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac828baa0 0x55eac82975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.634+0000 7f77910f6640 1 --2- 172.21.15.170:0/2038126036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac8287e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.634+0000 7f77908f5640 1 -- 172.21.15.170:0/2038126036 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac828baa0 msgr2=0x55eac82975f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.634+0000 7f77908f5640 1 --2- 172.21.15.170:0/2038126036 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac828baa0 0x55eac82975f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.634+0000 7f77908f5640 1 -- 172.21.15.170:0/2038126036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 msgr2=0x55eac8287e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.634+0000 7f77908f5640 1 --2- 172.21.15.170:0/2038126036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac8287e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.636 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.634+0000 7f77908f5640 1 -- 172.21.15.170:0/2038126036 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eac8188500 con 0x55eac8286930 2024-01-25T15:04:07.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.634+0000 7f77910f6640 1 --2- 172.21.15.170:0/2038126036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac8287e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:07.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.634+0000 7f77908f5640 1 --2- 172.21.15.170:0/2038126036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac82883c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f777c0ecda0 tx=0x7f777c0ecc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de5b88351d352e4 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.634+0000 7f7776ffd640 1 -- 172.21.15.170:0/2038126036 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c0c0530 con 0x55eac8286930 2024-01-25T15:04:07.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.634+0000 7f7776ffd640 1 -- 172.21.15.170:0/2038126036 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f777c0a4070 con 0x55eac8286930 2024-01-25T15:04:07.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.634+0000 7f7776ffd640 1 -- 172.21.15.170:0/2038126036 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c0c0120 con 0x55eac8286930 2024-01-25T15:04:07.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.635+0000 7f7795ff9740 1 -- 172.21.15.170:0/2038126036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 msgr2=0x55eac82883c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.635+0000 7f7795ff9740 1 --2- 172.21.15.170:0/2038126036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac82883c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f777c0ecda0 tx=0x7f777c0ecc70 comp rx=0 tx=0).stop 2024-01-25T15:04:07.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.635+0000 7f7795ff9740 1 -- 172.21.15.170:0/2038126036 shutdown_connections 2024-01-25T15:04:07.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.635+0000 7f7795ff9740 1 --2- 172.21.15.170:0/2038126036 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac828baa0 0x55eac82975f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.635+0000 7f7795ff9740 1 --2- 172.21.15.170:0/2038126036 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac82883c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.635+0000 7f7795ff9740 1 --2- 172.21.15.170:0/2038126036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac8287e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.635+0000 7f7795ff9740 1 -- 172.21.15.170:0/2038126036 >> 172.21.15.170:0/2038126036 conn(0x55eac82814b0 msgr2=0x55eac82a2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.635+0000 7f7795ff9740 1 -- 172.21.15.170:0/2038126036 shutdown_connections 2024-01-25T15:04:07.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.635+0000 7f7795ff9740 1 -- 172.21.15.170:0/2038126036 wait complete. 2024-01-25T15:04:07.637 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.635+0000 7f7795ff9740 1 -- start start 2024-01-25T15:04:07.638 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.636+0000 7f7795ff9740 1 Processor -- start 2024-01-25T15:04:07.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.636+0000 7f7795ff9740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac82955f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.636+0000 7f7795ff9740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac8295b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.636+0000 7f7795ff9740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac828baa0 0x55eac8296b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.636+0000 7f77910f6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac82955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.636+0000 7f77908f5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac8295b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.636+0000 7f77910f6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac82955f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:43838/0 (socket says 172.21.15.170:43838) 2024-01-25T15:04:07.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.636+0000 7f77908f5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac8295b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56342/0 (socket says 172.21.15.170:56342) 2024-01-25T15:04:07.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.636+0000 7f7795ff9740 1 -- 172.21.15.170:0/3424496074 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac8297080 con 0x55eac8286930 2024-01-25T15:04:07.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.636+0000 7f77910f6640 1 -- 172.21.15.170:0/3424496074 learned_addr learned my addr 172.21.15.170:0/3424496074 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.636+0000 7f7795ff9740 1 -- 172.21.15.170:0/3424496074 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac82971f0 con 0x55eac8285f40 2024-01-25T15:04:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.636+0000 7f7795ff9740 1 -- 172.21.15.170:0/3424496074 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eac82973b0 con 0x55eac828baa0 2024-01-25T15:04:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.636+0000 7f7795ff9740 10 client.0 _ll_register_callbacks cb 0x7f77880097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.636+0000 7f77918f7640 1 --2- 172.21.15.170:0/3424496074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac828baa0 0x55eac8296b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.637+0000 7f77908f5640 1 -- 172.21.15.170:0/3424496074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac828baa0 msgr2=0x55eac8296b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.637+0000 7f77908f5640 1 --2- 172.21.15.170:0/3424496074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac828baa0 0x55eac8296b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.637+0000 7f77908f5640 1 -- 172.21.15.170:0/3424496074 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 msgr2=0x55eac82955f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.637+0000 7f77908f5640 1 --2- 172.21.15.170:0/3424496074 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac82955f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.637+0000 7f77908f5640 1 -- 172.21.15.170:0/3424496074 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778c1a1410 con 0x55eac8286930 2024-01-25T15:04:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.637+0000 7f77908f5640 1 --2- 172.21.15.170:0/3424496074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac8295b30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x55eac81e6220 tx=0x7f777c0bc560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c0b213e4d61aef server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.637+0000 7f7774ff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.637+0000 7f7774ff9640 1 -- 172.21.15.170:0/3424496074 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c0c0360 con 0x55eac8286930 2024-01-25T15:04:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.637+0000 7f7774ff9640 1 -- 172.21.15.170:0/3424496074 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f777c0c0530 con 0x55eac8286930 2024-01-25T15:04:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.637+0000 7f7795ff9740 1 -- 172.21.15.170:0/3424496074 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7788009e50 con 0x55eac8286930 2024-01-25T15:04:07.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.637+0000 7f7774ff9640 1 -- 172.21.15.170:0/3424496074 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f777c0bb8d0 con 0x55eac8286930 2024-01-25T15:04:07.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.637+0000 7f7795ff9740 10 client.16185 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:07.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.637+0000 7f7795ff9740 1 -- 172.21.15.170:0/3424496074 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55eac81ae050 con 0x55eac8286930 2024-01-25T15:04:07.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.638+0000 7f7774ff9640 1 -- 172.21.15.170:0/3424496074 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f777c0bba30 con 0x55eac8286930 2024-01-25T15:04:07.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.638+0000 7f7774ff9640 1 -- 172.21.15.170:0/3424496074 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f777c03c070 con 0x55eac8286930 2024-01-25T15:04:07.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.638+0000 7f7795ff9740 10 client.16185 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:07.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.638+0000 7f7795ff9740 10 client.16185 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.b 2024-01-25T15:04:07.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.638+0000 7f7795ff9740 20 client.16185 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:07.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.638+0000 7f7795ff9740 1 --2- 172.21.15.170:0/3424496074 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55eac82f2f80 0x55eac82f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.638+0000 7f7795ff9740 4 client.16185 mds_command: new command op to 24479 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:04:07.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.638+0000 7f7795ff9740 1 -- 172.21.15.170:0/3424496074 --> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f7788009e50 con 0x55eac82f2f80 2024-01-25T15:04:07.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.638+0000 7f77910f6640 1 --2- 172.21.15.170:0/3424496074 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55eac82f2f80 0x55eac82f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.639+0000 7f77910f6640 1 --2- 172.21.15.170:0/3424496074 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55eac82f2f80 0x55eac82f53a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=300d841bce8338af server_cookie=c9c5009ca245a231 in_seq=0 out_seq=0 2024-01-25T15:04:07.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.639+0000 7f7774ff9640 10 client.16185 ms_handle_connect on v2:172.21.15.186:6838/2132502182 2024-01-25T15:04:07.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.641+0000 7f7774ff9640 1 -- 172.21.15.170:0/3424496074 <== mds.1 v2:172.21.15.186:6838/2132502182 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+92478 (crc 0 0 0) 0x7f7788009e50 con 0x55eac82f2f80 2024-01-25T15:04:07.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.641+0000 7f7774ff9640 10 client.16185 handle_command_reply: tid=0 2024-01-25T15:04:07.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.641+0000 7f7795ff9740 1 client.16185 shutdown 2024-01-25T15:04:07.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.642+0000 7f7795ff9740 1 -- 172.21.15.170:0/3424496074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 msgr2=0x55eac8295b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.642+0000 7f7795ff9740 1 --2- 172.21.15.170:0/3424496074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac8295b30 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x55eac81e6220 tx=0x7f777c0bc560 comp rx=0 tx=0).stop 2024-01-25T15:04:07.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.642+0000 7f7795ff9740 1 -- 172.21.15.170:0/3424496074 shutdown_connections 2024-01-25T15:04:07.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.642+0000 7f7795ff9740 1 --2- 172.21.15.170:0/3424496074 >> [v2:172.21.15.186:6838/2132502182,v1:172.21.15.186:6839/2132502182] conn(0x55eac82f2f80 0x55eac82f53a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.642+0000 7f7795ff9740 1 --2- 172.21.15.170:0/3424496074 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55eac828baa0 0x55eac8296b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.642+0000 7f7795ff9740 1 --2- 172.21.15.170:0/3424496074 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55eac8286930 0x55eac8295b30 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.642+0000 7f7795ff9740 1 --2- 172.21.15.170:0/3424496074 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55eac8285f40 0x55eac82955f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.642+0000 7f7795ff9740 1 -- 172.21.15.170:0/3424496074 >> 172.21.15.170:0/3424496074 conn(0x55eac82814b0 msgr2=0x55eac8287e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.642+0000 7f7774ff9640 0 client.16185 ms_handle_reset on v2:172.21.15.186:6838/2132502182 2024-01-25T15:04:07.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.642+0000 7f7795ff9740 1 -- 172.21.15.170:0/3424496074 shutdown_connections 2024-01-25T15:04:07.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.642+0000 7f7795ff9740 1 -- 172.21.15.170:0/3424496074 wait complete. 2024-01-25T15:04:07.645 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.642+0000 7f7795ff9740 20 client.16185 trim_cache size 0 max 16384 2024-01-25T15:04:07.646 INFO:teuthology.orchestra.run.smithi170.stdout:[ 2024-01-25T15:04:07.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.646 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.646 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 5273434, 2024-01-25T15:04:07.647 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628933, 2024-01-25T15:04:07.647 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_svc_create.sh" 2024-01-25T15:04:07.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.647 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.647 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 7550098, 2024-01-25T15:04:07.647 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629479, 2024-01-25T15:04:07.647 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff07" 2024-01-25T15:04:07.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.647 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.647 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 27010612, 2024-01-25T15:04:07.647 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629732, 2024-01-25T15:04:07.647 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff11" 2024-01-25T15:04:07.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.648 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.648 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 44357674, 2024-01-25T15:04:07.648 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632669, 2024-01-25T15:04:07.648 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/testfrmw.h" 2024-01-25T15:04:07.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.648 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.648 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 44491231, 2024-01-25T15:04:07.648 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629106, 2024-01-25T15:04:07.648 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getaddr.limits.sh" 2024-01-25T15:04:07.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 45052796, 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631199, 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_003.c" 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 47296528, 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628954, 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.complex.sh" 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 51573869, 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629751, 2024-01-25T15:04:07.649 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff12" 2024-01-25T15:04:07.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.650 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.650 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 135062174, 2024-01-25T15:04:07.650 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632724, 2024-01-25T15:04:07.650 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/coverage.txt" 2024-01-25T15:04:07.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.650 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.650 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 146060236, 2024-01-25T15:04:07.650 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629461, 2024-01-25T15:04:07.650 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff06" 2024-01-25T15:04:07.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.650 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.651 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 148381277, 2024-01-25T15:04:07.651 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629467, 2024-01-25T15:04:07.651 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff03" 2024-01-25T15:04:07.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.651 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.651 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 150540033, 2024-01-25T15:04:07.651 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629434, 2024-01-25T15:04:07.651 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld01" 2024-01-25T15:04:07.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.651 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.651 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 172163220, 2024-01-25T15:04:07.651 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629742, 2024-01-25T15:04:07.652 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff14" 2024-01-25T15:04:07.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.652 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.652 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 184913300, 2024-01-25T15:04:07.652 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629748, 2024-01-25T15:04:07.652 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff03" 2024-01-25T15:04:07.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.652 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.652 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 213367624, 2024-01-25T15:04:07.652 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629436, 2024-01-25T15:04:07.652 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/Makefile" 2024-01-25T15:04:07.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 227663278, 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629112, 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.performance.sh" 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 228836157, 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629046, 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.sh" 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 236172206, 2024-01-25T15:04:07.653 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629477, 2024-01-25T15:04:07.654 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff05" 2024-01-25T15:04:07.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.654 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.654 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 253456766, 2024-01-25T15:04:07.654 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629042, 2024-01-25T15:04:07.654 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.mt.sh" 2024-01-25T15:04:07.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.654 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.654 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 254987797, 2024-01-25T15:04:07.654 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628943, 2024-01-25T15:04:07.654 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_control.limits.sh" 2024-01-25T15:04:07.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.655 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.655 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 269084156, 2024-01-25T15:04:07.655 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629001, 2024-01-25T15:04:07.655 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.performance.sh" 2024-01-25T15:04:07.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.655 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.655 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 271771845, 2024-01-25T15:04:07.655 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631197, 2024-01-25T15:04:07.655 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_010.c" 2024-01-25T15:04:07.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.655 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.655 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 289214094, 2024-01-25T15:04:07.656 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628995, 2024-01-25T15:04:07.656 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.performance.sh" 2024-01-25T15:04:07.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.656 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.656 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 328460906, 2024-01-25T15:04:07.656 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629068, 2024-01-25T15:04:07.656 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_sendreply.sh" 2024-01-25T15:04:07.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.656 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.656 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 332627722, 2024-01-25T15:04:07.656 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629028, 2024-01-25T15:04:07.656 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.complex.sh" 2024-01-25T15:04:07.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 352225302, 2024-01-25T15:04:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628942, 2024-01-25T15:04:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_create.sh" 2024-01-25T15:04:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 361561204, 2024-01-25T15:04:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511639987, 2024-01-25T15:04:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/d41/c45" 2024-01-25T15:04:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.657 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 388607905, 2024-01-25T15:04:07.658 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629091, 2024-01-25T15:04:07.658 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.stress.sh" 2024-01-25T15:04:07.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.658 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.658 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 410157234, 2024-01-25T15:04:07.658 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632727, 2024-01-25T15:04:07.658 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/2-1.c" 2024-01-25T15:04:07.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.658 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.658 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 411393094, 2024-01-25T15:04:07.658 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629073, 2024-01-25T15:04:07.658 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_vc_create.limits.sh" 2024-01-25T15:04:07.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 412573637, 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628906, 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_stdcall_svc_getcaller/assertions.xml" 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 451733142, 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628959, 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.stress.sh" 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 459485190, 2024-01-25T15:04:07.659 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629746, 2024-01-25T15:04:07.660 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff04" 2024-01-25T15:04:07.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.660 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.660 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 467345034, 2024-01-25T15:04:07.660 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629480, 2024-01-25T15:04:07.660 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff11" 2024-01-25T15:04:07.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.660 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.660 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 480389684, 2024-01-25T15:04:07.660 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629089, 2024-01-25T15:04:07.660 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.performance.sh" 2024-01-25T15:04:07.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 531794901, 2024-01-25T15:04:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628973, 2024-01-25T15:04:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.sh" 2024-01-25T15:04:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 533238117, 2024-01-25T15:04:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629009, 2024-01-25T15:04:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.sh" 2024-01-25T15:04:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.661 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 534818901, 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629587, 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_stdcall_svc_getcaller/1-basic.c" 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 536973695, 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631207, 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/Makefile.am" 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 547371054, 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629729, 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff08" 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 554924317, 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628978, 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.stress.sh" 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 569880408, 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629093, 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_sperrno.sh" 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 584849250, 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629076, 2024-01-25T15:04:07.663 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_registerrpc.sh" 2024-01-25T15:04:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 589458577, 2024-01-25T15:04:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629749, 2024-01-25T15:04:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff07" 2024-01-25T15:04:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 595830683, 2024-01-25T15:04:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631194, 2024-01-25T15:04:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_009.c" 2024-01-25T15:04:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 597063425, 2024-01-25T15:04:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629484, 2024-01-25T15:04:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff14" 2024-01-25T15:04:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 603850565, 2024-01-25T15:04:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631206, 2024-01-25T15:04:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_004.c" 2024-01-25T15:04:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.665 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 603959906, 2024-01-25T15:04:07.666 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628975, 2024-01-25T15:04:07.666 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_tli_create.limits.sh" 2024-01-25T15:04:07.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.666 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.666 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 617552688, 2024-01-25T15:04:07.666 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631204, 2024-01-25T15:04:07.666 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_011.c" 2024-01-25T15:04:07.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.666 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.666 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 629096775, 2024-01-25T15:04:07.666 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629283, 2024-01-25T15:04:07.666 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.mt.sh" 2024-01-25T15:04:07.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.667 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.667 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 631673950, 2024-01-25T15:04:07.667 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628997, 2024-01-25T15:04:07.667 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.complex.sh" 2024-01-25T15:04:07.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.667 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.667 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 640302809, 2024-01-25T15:04:07.667 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631201, 2024-01-25T15:04:07.667 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_000.c" 2024-01-25T15:04:07.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.667 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.667 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 655018214, 2024-01-25T15:04:07.668 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629113, 2024-01-25T15:04:07.668 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_pcreateerror.sh" 2024-01-25T15:04:07.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.668 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.668 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 681600339, 2024-01-25T15:04:07.668 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628958, 2024-01-25T15:04:07.668 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.performance.sh" 2024-01-25T15:04:07.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.668 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.668 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 691116750, 2024-01-25T15:04:07.668 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632672, 2024-01-25T15:04:07.668 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/1-1.c" 2024-01-25T15:04:07.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.669 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.669 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 693040069, 2024-01-25T15:04:07.669 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629488, 2024-01-25T15:04:07.669 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff06" 2024-01-25T15:04:07.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.669 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.669 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 701421885, 2024-01-25T15:04:07.669 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629033, 2024-01-25T15:04:07.669 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authdes_seccreate.sh" 2024-01-25T15:04:07.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.669 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 707062570, 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629431, 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld05" 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 717985126, 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629473, 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/00_Descriptions.txt" 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 718313205, 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629440, 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld04" 2024-01-25T15:04:07.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.671 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.671 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 758910798, 2024-01-25T15:04:07.671 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628965, 2024-01-25T15:04:07.671 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.dataint.sh" 2024-01-25T15:04:07.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.671 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.671 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 761160666, 2024-01-25T15:04:07.671 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629442, 2024-01-25T15:04:07.671 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld04" 2024-01-25T15:04:07.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.671 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.671 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 776460275, 2024-01-25T15:04:07.672 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629018, 2024-01-25T15:04:07.672 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.limits.sh" 2024-01-25T15:04:07.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.672 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.672 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 778800068, 2024-01-25T15:04:07.672 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629021, 2024-01-25T15:04:07.672 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getmaps.sh" 2024-01-25T15:04:07.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.672 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.672 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 789875593, 2024-01-25T15:04:07.672 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629110, 2024-01-25T15:04:07.673 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_destroy.sh" 2024-01-25T15:04:07.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.673 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.673 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 792966984, 2024-01-25T15:04:07.673 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631202, 2024-01-25T15:04:07.673 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/Makefile.in" 2024-01-25T15:04:07.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.673 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.673 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 808688682, 2024-01-25T15:04:07.673 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629034, 2024-01-25T15:04:07.673 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_noprog.sh" 2024-01-25T15:04:07.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 819518401, 2024-01-25T15:04:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632726, 2024-01-25T15:04:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/testfrmw.h" 2024-01-25T15:04:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 835030563, 2024-01-25T15:04:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629008, 2024-01-25T15:04:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.performance.sh" 2024-01-25T15:04:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 871718638, 2024-01-25T15:04:07.674 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628925, 2024-01-25T15:04:07.675 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_weakauth.sh" 2024-01-25T15:04:07.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.675 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.675 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 892582091, 2024-01-25T15:04:07.675 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629074, 2024-01-25T15:04:07.675 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.sh" 2024-01-25T15:04:07.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.675 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.675 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 903018204, 2024-01-25T15:04:07.675 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628937, 2024-01-25T15:04:07.675 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create_timed.limits.sh" 2024-01-25T15:04:07.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.676 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.676 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 937166647, 2024-01-25T15:04:07.676 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628924, 2024-01-25T15:04:07.676 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_vc_create.limits.sh" 2024-01-25T15:04:07.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.676 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.676 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 964014685, 2024-01-25T15:04:07.676 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629741, 2024-01-25T15:04:07.676 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff01" 2024-01-25T15:04:07.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.676 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 964438672, 2024-01-25T15:04:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628970, 2024-01-25T15:04:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_create.stress.sh" 2024-01-25T15:04:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 979232968, 2024-01-25T15:04:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629115, 2024-01-25T15:04:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.stress.sh" 2024-01-25T15:04:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 980698704, 2024-01-25T15:04:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632675, 2024-01-25T15:04:07.677 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/2-2.c" 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1012884565, 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629047, 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authunix_create.sh" 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1015762512, 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628928, 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getargs.sh" 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.678 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1022279898, 2024-01-25T15:04:07.679 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628966, 2024-01-25T15:04:07.679 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_progvers.sh" 2024-01-25T15:04:07.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.679 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.679 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1026663286, 2024-01-25T15:04:07.679 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629114, 2024-01-25T15:04:07.679 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getargs.dataint.sh" 2024-01-25T15:04:07.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.679 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.679 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1035098394, 2024-01-25T15:04:07.679 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628938, 2024-01-25T15:04:07.679 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.dataint.sh" 2024-01-25T15:04:07.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.680 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.680 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1036841289, 2024-01-25T15:04:07.680 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633240, 2024-01-25T15:04:07.680 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/3-1.c" 2024-01-25T15:04:07.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.680 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.680 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1046646881, 2024-01-25T15:04:07.680 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628961, 2024-01-25T15:04:07.680 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.stress.sh" 2024-01-25T15:04:07.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.681 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.681 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1053485658, 2024-01-25T15:04:07.681 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632673, 2024-01-25T15:04:07.681 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/coverage.c" 2024-01-25T15:04:07.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.681 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.681 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1059533856, 2024-01-25T15:04:07.681 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629724, 2024-01-25T15:04:07.681 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff02" 2024-01-25T15:04:07.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.681 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.682 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1076814076, 2024-01-25T15:04:07.682 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632674, 2024-01-25T15:04:07.682 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/assertions.xml" 2024-01-25T15:04:07.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.682 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.682 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1083591907, 2024-01-25T15:04:07.682 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628957, 2024-01-25T15:04:07.682 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.dataint.sh" 2024-01-25T15:04:07.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.682 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.682 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1086590064, 2024-01-25T15:04:07.682 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629044, 2024-01-25T15:04:07.683 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.performance.sh" 2024-01-25T15:04:07.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.683 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.683 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1096605332, 2024-01-25T15:04:07.683 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629482, 2024-01-25T15:04:07.683 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff13" 2024-01-25T15:04:07.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.683 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.683 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1113178526, 2024-01-25T15:04:07.683 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631195, 2024-01-25T15:04:07.683 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_012.c" 2024-01-25T15:04:07.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.684 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.684 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1128009397, 2024-01-25T15:04:07.684 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629472, 2024-01-25T15:04:07.684 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/Makefile" 2024-01-25T15:04:07.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.684 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.684 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1140326165, 2024-01-25T15:04:07.684 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629029, 2024-01-25T15:04:07.684 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_noprog.sh" 2024-01-25T15:04:07.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.685 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.685 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1176594707, 2024-01-25T15:04:07.685 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628929, 2024-01-25T15:04:07.685 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.scalability.sh" 2024-01-25T15:04:07.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.685 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.685 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1185703102, 2024-01-25T15:04:07.685 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629750, 2024-01-25T15:04:07.685 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff08" 2024-01-25T15:04:07.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.685 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.685 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1199921752, 2024-01-25T15:04:07.685 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629439, 2024-01-25T15:04:07.686 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld03" 2024-01-25T15:04:07.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.686 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.686 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1241772590, 2024-01-25T15:04:07.686 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629013, 2024-01-25T15:04:07.686 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.sh" 2024-01-25T15:04:07.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.686 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.686 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1277651523, 2024-01-25T15:04:07.686 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629066, 2024-01-25T15:04:07.686 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.performance.sh" 2024-01-25T15:04:07.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1278492967, 2024-01-25T15:04:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628934, 2024-01-25T15:04:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_bufcreate.limits.sh" 2024-01-25T15:04:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1284351783, 2024-01-25T15:04:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629466, 2024-01-25T15:04:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff09" 2024-01-25T15:04:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.687 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1296063005, 2024-01-25T15:04:07.688 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629048, 2024-01-25T15:04:07.688 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.stress.sh" 2024-01-25T15:04:07.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.688 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.688 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1302699082, 2024-01-25T15:04:07.688 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628969, 2024-01-25T15:04:07.688 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_perrno.sh" 2024-01-25T15:04:07.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.688 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.688 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1309758652, 2024-01-25T15:04:07.688 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629004, 2024-01-25T15:04:07.689 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.mt.sh" 2024-01-25T15:04:07.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.689 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.689 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1312092555, 2024-01-25T15:04:07.689 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629733, 2024-01-25T15:04:07.689 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff09" 2024-01-25T15:04:07.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.689 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.689 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1313812306, 2024-01-25T15:04:07.689 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629743, 2024-01-25T15:04:07.689 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff01" 2024-01-25T15:04:07.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1316392825, 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629739, 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff07" 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1334534272, 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629019, 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.performance.sh" 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1347296143, 2024-01-25T15:04:07.690 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629483, 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff08" 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1355372238, 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628993, 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.performance.sh" 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1359069905, 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629085, 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create.sh" 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.691 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.692 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1378778043, 2024-01-25T15:04:07.692 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632671, 2024-01-25T15:04:07.692 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/5-1.c" 2024-01-25T15:04:07.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.692 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.692 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1392326778, 2024-01-25T15:04:07.692 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629069, 2024-01-25T15:04:07.692 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.scalability.sh" 2024-01-25T15:04:07.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.692 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.692 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1398635194, 2024-01-25T15:04:07.693 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629077, 2024-01-25T15:04:07.693 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_systemerr.sh" 2024-01-25T15:04:07.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.693 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.693 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1413538426, 2024-01-25T15:04:07.693 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629282, 2024-01-25T15:04:07.693 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.dataint.sh" 2024-01-25T15:04:07.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.693 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.693 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1415104397, 2024-01-25T15:04:07.693 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628931, 2024-01-25T15:04:07.693 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_getport.sh" 2024-01-25T15:04:07.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.694 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.694 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1436350294, 2024-01-25T15:04:07.694 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628967, 2024-01-25T15:04:07.694 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_tli_create.sh" 2024-01-25T15:04:07.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.694 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.694 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1460481770, 2024-01-25T15:04:07.694 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628960, 2024-01-25T15:04:07.694 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_vc_create.sh" 2024-01-25T15:04:07.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.694 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.694 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1466736151, 2024-01-25T15:04:07.695 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629020, 2024-01-25T15:04:07.695 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_vc_create.sh" 2024-01-25T15:04:07.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.695 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.695 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1484866213, 2024-01-25T15:04:07.695 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629012, 2024-01-25T15:04:07.695 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_systemerr.sh" 2024-01-25T15:04:07.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.695 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.695 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1502227557, 2024-01-25T15:04:07.695 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628964, 2024-01-25T15:04:07.695 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.complex.sh" 2024-01-25T15:04:07.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.696 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.696 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1503032093, 2024-01-25T15:04:07.696 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628980, 2024-01-25T15:04:07.696 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.performance.sh" 2024-01-25T15:04:07.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.696 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.696 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1509578033, 2024-01-25T15:04:07.696 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632676, 2024-01-25T15:04:07.696 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/4-1.c" 2024-01-25T15:04:07.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.696 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.697 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1521879303, 2024-01-25T15:04:07.697 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629734, 2024-01-25T15:04:07.697 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff10" 2024-01-25T15:04:07.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.697 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.697 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1538676541, 2024-01-25T15:04:07.697 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629058, 2024-01-25T15:04:07.697 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create.sh" 2024-01-25T15:04:07.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.697 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.697 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1551400206, 2024-01-25T15:04:07.697 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629080, 2024-01-25T15:04:07.698 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create_timed.limits.sh" 2024-01-25T15:04:07.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.698 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.698 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1564551872, 2024-01-25T15:04:07.698 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629736, 2024-01-25T15:04:07.698 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/00_Descriptions.txt" 2024-01-25T15:04:07.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.698 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.698 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1574230051, 2024-01-25T15:04:07.698 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629096, 2024-01-25T15:04:07.698 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.sh" 2024-01-25T15:04:07.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.699 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.699 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1587971301, 2024-01-25T15:04:07.699 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628948, 2024-01-25T15:04:07.699 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcfd_create.sh" 2024-01-25T15:04:07.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.699 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.699 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1634890561, 2024-01-25T15:04:07.699 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632730, 2024-01-25T15:04:07.699 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/5-2.c" 2024-01-25T15:04:07.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.699 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.700 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1650210693, 2024-01-25T15:04:07.700 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629059, 2024-01-25T15:04:07.700 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_xprt_unregister.sh" 2024-01-25T15:04:07.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.700 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.700 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1659843002, 2024-01-25T15:04:07.700 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631200, 2024-01-25T15:04:07.700 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_001.c" 2024-01-25T15:04:07.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.700 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.700 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1661626994, 2024-01-25T15:04:07.700 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632677, 2024-01-25T15:04:07.701 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/cln.sh" 2024-01-25T15:04:07.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.701 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.701 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1669624865, 2024-01-25T15:04:07.701 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629053, 2024-01-25T15:04:07.701 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.sh" 2024-01-25T15:04:07.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.701 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.701 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1673564394, 2024-01-25T15:04:07.701 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629100, 2024-01-25T15:04:07.701 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_get_myaddress.sh" 2024-01-25T15:04:07.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.702 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.702 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1676656951, 2024-01-25T15:04:07.702 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629087, 2024-01-25T15:04:07.702 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perror.complex.sh" 2024-01-25T15:04:07.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.702 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.702 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1742702560, 2024-01-25T15:04:07.702 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628977, 2024-01-25T15:04:07.702 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_svc_unregister.sh" 2024-01-25T15:04:07.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.702 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.702 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1775594370, 2024-01-25T15:04:07.702 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629613, 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.performance.sh" 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1817094113, 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629016, 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_weakauth.sh" 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1819669694, 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629043, 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.stress.sh" 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.703 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.704 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1855646128, 2024-01-25T15:04:07.704 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629064, 2024-01-25T15:04:07.704 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perror.sh" 2024-01-25T15:04:07.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.704 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.704 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1866352254, 2024-01-25T15:04:07.704 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629023, 2024-01-25T15:04:07.704 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_dg_create.limits.sh" 2024-01-25T15:04:07.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.704 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.704 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1876315426, 2024-01-25T15:04:07.704 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629052, 2024-01-25T15:04:07.704 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create_timed.sh" 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1930480309, 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629476, 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff12" 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1936207882, 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629022, 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.stress.sh" 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.705 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1938040266, 2024-01-25T15:04:07.706 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629025, 2024-01-25T15:04:07.706 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.stress.sh" 2024-01-25T15:04:07.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.706 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.706 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1939894177, 2024-01-25T15:04:07.706 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629105, 2024-01-25T15:04:07.706 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.stress.sh" 2024-01-25T15:04:07.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.706 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.706 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 1993232404, 2024-01-25T15:04:07.706 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629745, 2024-01-25T15:04:07.706 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff03" 2024-01-25T15:04:07.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.707 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.707 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2004450430, 2024-01-25T15:04:07.707 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628998, 2024-01-25T15:04:07.707 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_control.sh" 2024-01-25T15:04:07.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.707 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.707 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2012850499, 2024-01-25T15:04:07.707 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629051, 2024-01-25T15:04:07.707 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.basic.sh" 2024-01-25T15:04:07.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.707 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2018146463, 2024-01-25T15:04:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628985, 2024-01-25T15:04:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authsys_create_default.sh" 2024-01-25T15:04:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2020659385, 2024-01-25T15:04:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628982, 2024-01-25T15:04:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_perror.sh" 2024-01-25T15:04:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2025553784, 2024-01-25T15:04:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629474, 2024-01-25T15:04:07.708 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff07" 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2033786479, 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629062, 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcraw_create.performance.sh" 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2034687157, 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628996, 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.mt.sh" 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.709 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2045541899, 2024-01-25T15:04:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629728, 2024-01-25T15:04:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff09" 2024-01-25T15:04:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2049650084, 2024-01-25T15:04:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629010, 2024-01-25T15:04:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_dg_create.sh" 2024-01-25T15:04:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2058401268, 2024-01-25T15:04:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628927, 2024-01-25T15:04:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_tli_create.sh" 2024-01-25T15:04:07.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.711 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.711 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2058913777, 2024-01-25T15:04:07.711 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629104, 2024-01-25T15:04:07.711 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.complex.sh" 2024-01-25T15:04:07.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.711 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.711 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2066235365, 2024-01-25T15:04:07.711 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628976, 2024-01-25T15:04:07.711 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create_timed.sh" 2024-01-25T15:04:07.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.711 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.711 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2070606340, 2024-01-25T15:04:07.712 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629082, 2024-01-25T15:04:07.712 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.sh" 2024-01-25T15:04:07.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.712 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.712 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2079733720, 2024-01-25T15:04:07.712 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629441, 2024-01-25T15:04:07.712 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld06" 2024-01-25T15:04:07.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.712 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.712 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2081282013, 2024-01-25T15:04:07.712 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628952, 2024-01-25T15:04:07.712 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_set.sh" 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2081955341, 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628962, 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.performance.sh" 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2084716621, 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629026, 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perrno.sh" 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.713 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2095550529, 2024-01-25T15:04:07.714 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628987, 2024-01-25T15:04:07.714 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svc_destroy.stress.sh" 2024-01-25T15:04:07.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.714 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.714 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2195619469, 2024-01-25T15:04:07.714 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628968, 2024-01-25T15:04:07.714 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.limits.sh" 2024-01-25T15:04:07.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.714 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.714 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2206879674, 2024-01-25T15:04:07.714 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629079, 2024-01-25T15:04:07.714 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_unset.sh" 2024-01-25T15:04:07.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.715 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.715 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2214772665, 2024-01-25T15:04:07.715 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629489, 2024-01-25T15:04:07.715 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff01" 2024-01-25T15:04:07.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.715 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.715 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2222207557, 2024-01-25T15:04:07.715 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629075, 2024-01-25T15:04:07.715 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_unset.sh" 2024-01-25T15:04:07.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.715 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.715 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2226412416, 2024-01-25T15:04:07.716 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629070, 2024-01-25T15:04:07.716 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.stress.sh" 2024-01-25T15:04:07.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.716 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.716 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2243330763, 2024-01-25T15:04:07.716 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629071, 2024-01-25T15:04:07.716 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_auth.sh" 2024-01-25T15:04:07.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.716 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.716 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2294761460, 2024-01-25T15:04:07.716 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628983, 2024-01-25T15:04:07.717 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_destroy.stress.sh" 2024-01-25T15:04:07.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.717 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.717 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2296876930, 2024-01-25T15:04:07.717 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628972, 2024-01-25T15:04:07.717 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.stress.sh" 2024-01-25T15:04:07.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.717 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.717 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2312625345, 2024-01-25T15:04:07.717 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629567, 2024-01-25T15:04:07.717 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_regunreg_registerrpc/1-basic.c" 2024-01-25T15:04:07.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2348059595, 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629730, 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff11" 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2355008337, 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629083, 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.mt.sh" 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2363895821, 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629430, 2024-01-25T15:04:07.718 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld03" 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2365596260, 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629486, 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff02" 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2369583272, 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628941, 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_tli_create.limits.sh" 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.719 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2371434437, 2024-01-25T15:04:07.720 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629485, 2024-01-25T15:04:07.720 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff03" 2024-01-25T15:04:07.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.720 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.720 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2393331752, 2024-01-25T15:04:07.720 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629432, 2024-01-25T15:04:07.720 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld02" 2024-01-25T15:04:07.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.720 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.720 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2407823258, 2024-01-25T15:04:07.720 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629057, 2024-01-25T15:04:07.720 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_progvers.sh" 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2432040003, 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628990, 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_pcreateerror.sh" 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2440306492, 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629284, 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.stress.sh" 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.721 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2459757251, 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629005, 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.sh" 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2466843555, 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629032, 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.dataint.sh" 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2470989102, 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628935, 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authnone_create.sh" 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2485142462, 2024-01-25T15:04:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629031, 2024-01-25T15:04:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_freeres.sh" 2024-01-25T15:04:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2506378870, 2024-01-25T15:04:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629035, 2024-01-25T15:04:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_xprt_register.sh" 2024-01-25T15:04:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2507654112, 2024-01-25T15:04:07.723 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629470, 2024-01-25T15:04:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff05" 2024-01-25T15:04:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2540474523, 2024-01-25T15:04:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628950, 2024-01-25T15:04:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_bufcreate.sh" 2024-01-25T15:04:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2557144936, 2024-01-25T15:04:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629011, 2024-01-25T15:04:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.stress.sh" 2024-01-25T15:04:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.725 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.725 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2565351571, 2024-01-25T15:04:07.725 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628936, 2024-01-25T15:04:07.725 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.scalability.sh" 2024-01-25T15:04:07.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.725 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.725 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2565832129, 2024-01-25T15:04:07.725 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628926, 2024-01-25T15:04:07.725 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.mt.sh" 2024-01-25T15:04:07.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.725 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.725 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2570243279, 2024-01-25T15:04:07.725 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628992, 2024-01-25T15:04:07.726 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.scalability.sh" 2024-01-25T15:04:07.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.726 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.726 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2573282901, 2024-01-25T15:04:07.726 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629007, 2024-01-25T15:04:07.726 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.sh" 2024-01-25T15:04:07.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.726 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.726 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2578690892, 2024-01-25T15:04:07.726 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629027, 2024-01-25T15:04:07.726 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_set.sh" 2024-01-25T15:04:07.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.727 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.727 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2584691156, 2024-01-25T15:04:07.727 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629465, 2024-01-25T15:04:07.727 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff01" 2024-01-25T15:04:07.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.727 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.727 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2613472110, 2024-01-25T15:04:07.727 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629095, 2024-01-25T15:04:07.727 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.stress.sh" 2024-01-25T15:04:07.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.727 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.727 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2625794475, 2024-01-25T15:04:07.727 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628951, 2024-01-25T15:04:07.728 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authunix_create_default.sh" 2024-01-25T15:04:07.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.728 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.728 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2631029057, 2024-01-25T15:04:07.728 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629107, 2024-01-25T15:04:07.728 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_control.sh" 2024-01-25T15:04:07.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.728 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.728 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2639703242, 2024-01-25T15:04:07.728 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629437, 2024-01-25T15:04:07.728 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/00_Descriptions.txt" 2024-01-25T15:04:07.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.729 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.729 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2645067886, 2024-01-25T15:04:07.729 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629078, 2024-01-25T15:04:07.729 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authsys_create.sh" 2024-01-25T15:04:07.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.729 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.729 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2671532864, 2024-01-25T15:04:07.729 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628984, 2024-01-25T15:04:07.729 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.mt.sh" 2024-01-25T15:04:07.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.729 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.729 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2694241296, 2024-01-25T15:04:07.730 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632729, 2024-01-25T15:04:07.730 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/1-1.c" 2024-01-25T15:04:07.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.730 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.730 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2712059145, 2024-01-25T15:04:07.730 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631198, 2024-01-25T15:04:07.730 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_007.c" 2024-01-25T15:04:07.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.730 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.730 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2720954283, 2024-01-25T15:04:07.730 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631193, 2024-01-25T15:04:07.730 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_002.c" 2024-01-25T15:04:07.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.731 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.731 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2733925891, 2024-01-25T15:04:07.731 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511630173, 2024-01-25T15:04:07.731 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff14" 2024-01-25T15:04:07.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.731 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.731 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2736981677, 2024-01-25T15:04:07.731 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628981, 2024-01-25T15:04:07.731 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.complex.sh" 2024-01-25T15:04:07.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.731 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.731 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2743979644, 2024-01-25T15:04:07.732 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629084, 2024-01-25T15:04:07.732 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcraw_create.sh" 2024-01-25T15:04:07.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.732 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.732 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2747281891, 2024-01-25T15:04:07.732 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629740, 2024-01-25T15:04:07.732 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff13" 2024-01-25T15:04:07.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.732 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.732 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2747771573, 2024-01-25T15:04:07.732 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631205, 2024-01-25T15:04:07.732 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_013.c" 2024-01-25T15:04:07.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.733 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.733 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2758821853, 2024-01-25T15:04:07.733 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628945, 2024-01-25T15:04:07.733 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_dg_create.limits.sh" 2024-01-25T15:04:07.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.733 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.733 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2770131731, 2024-01-25T15:04:07.733 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629735, 2024-01-25T15:04:07.733 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/Makefile" 2024-01-25T15:04:07.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.733 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.734 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2770329711, 2024-01-25T15:04:07.734 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628944, 2024-01-25T15:04:07.734 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.complex.sh" 2024-01-25T15:04:07.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.734 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.734 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2771136630, 2024-01-25T15:04:07.734 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629738, 2024-01-25T15:04:07.734 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff05" 2024-01-25T15:04:07.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.734 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.734 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2781336961, 2024-01-25T15:04:07.735 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629471, 2024-01-25T15:04:07.735 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff04" 2024-01-25T15:04:07.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.735 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.735 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2808870432, 2024-01-25T15:04:07.735 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629469, 2024-01-25T15:04:07.735 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff10" 2024-01-25T15:04:07.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.735 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.735 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2824332718, 2024-01-25T15:04:07.735 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629109, 2024-01-25T15:04:07.735 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.sh" 2024-01-25T15:04:07.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.736 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.736 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2850238665, 2024-01-25T15:04:07.736 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629015, 2024-01-25T15:04:07.736 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_svc_destroy.sh" 2024-01-25T15:04:07.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.736 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.736 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2874862691, 2024-01-25T15:04:07.736 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629094, 2024-01-25T15:04:07.736 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.dataint.sh" 2024-01-25T15:04:07.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.737 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.737 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2875268863, 2024-01-25T15:04:07.737 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629045, 2024-01-25T15:04:07.737 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.complex.sh" 2024-01-25T15:04:07.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.737 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.737 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2887739088, 2024-01-25T15:04:07.737 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629036, 2024-01-25T15:04:07.737 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_control.dataint.sh" 2024-01-25T15:04:07.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.737 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.737 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2912261746, 2024-01-25T15:04:07.737 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629090, 2024-01-25T15:04:07.738 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.dataint.sh" 2024-01-25T15:04:07.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.738 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.738 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 2935998536, 2024-01-25T15:04:07.738 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629039, 2024-01-25T15:04:07.738 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_svc_tp_create.sh" 2024-01-25T15:04:07.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.738 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.738 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3019904648, 2024-01-25T15:04:07.738 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628955, 2024-01-25T15:04:07.738 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_sperror.sh" 2024-01-25T15:04:07.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3020972632, 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628939, 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svc_destroy.sh" 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3028354511, 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629108, 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_geterr.sh" 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3068133254, 2024-01-25T15:04:07.739 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629040, 2024-01-25T15:04:07.740 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.mt.sh" 2024-01-25T15:04:07.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.740 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.740 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3073638682, 2024-01-25T15:04:07.740 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629081, 2024-01-25T15:04:07.740 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perrno.complex.sh" 2024-01-25T15:04:07.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.740 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.740 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3077802864, 2024-01-25T15:04:07.740 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629463, 2024-01-25T15:04:07.740 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff02" 2024-01-25T15:04:07.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.741 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.741 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3091620758, 2024-01-25T15:04:07.741 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628940, 2024-01-25T15:04:07.741 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.complex.sh" 2024-01-25T15:04:07.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.741 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.741 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3098898163, 2024-01-25T15:04:07.741 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628994, 2024-01-25T15:04:07.741 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.stress.sh" 2024-01-25T15:04:07.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.741 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.741 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3137861486, 2024-01-25T15:04:07.741 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629060, 2024-01-25T15:04:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.performance.sh" 2024-01-25T15:04:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3160383780, 2024-01-25T15:04:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629030, 2024-01-25T15:04:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_spcreateerror.sh" 2024-01-25T15:04:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3163409365, 2024-01-25T15:04:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631691, 2024-01-25T15:04:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_006.c" 2024-01-25T15:04:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.743 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.743 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3165863478, 2024-01-25T15:04:07.743 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629063, 2024-01-25T15:04:07.743 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.sh" 2024-01-25T15:04:07.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.743 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.743 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3188380736, 2024-01-25T15:04:07.743 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629067, 2024-01-25T15:04:07.743 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.scalability.sh" 2024-01-25T15:04:07.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.743 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.743 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3208310346, 2024-01-25T15:04:07.744 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628963, 2024-01-25T15:04:07.744 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.scalability.sh" 2024-01-25T15:04:07.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.744 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.744 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3226156248, 2024-01-25T15:04:07.744 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629433, 2024-01-25T15:04:07.744 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld05" 2024-01-25T15:04:07.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.744 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.744 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3235327691, 2024-01-25T15:04:07.744 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629065, 2024-01-25T15:04:07.744 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.sh" 2024-01-25T15:04:07.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.745 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.745 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3236996800, 2024-01-25T15:04:07.745 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629725, 2024-01-25T15:04:07.745 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff06" 2024-01-25T15:04:07.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.745 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.745 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3242318381, 2024-01-25T15:04:07.745 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629435, 2024-01-25T15:04:07.745 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld02" 2024-01-25T15:04:07.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.745 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.745 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3266532754, 2024-01-25T15:04:07.746 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629024, 2024-01-25T15:04:07.746 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.complex.sh" 2024-01-25T15:04:07.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.746 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.746 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3287761453, 2024-01-25T15:04:07.746 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628991, 2024-01-25T15:04:07.746 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.scalability.sh" 2024-01-25T15:04:07.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.746 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.746 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3293674112, 2024-01-25T15:04:07.746 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629475, 2024-01-25T15:04:07.746 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff11" 2024-01-25T15:04:07.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.747 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.747 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3299778315, 2024-01-25T15:04:07.747 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629099, 2024-01-25T15:04:07.747 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.mt.sh" 2024-01-25T15:04:07.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.747 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.747 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3305064117, 2024-01-25T15:04:07.747 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628953, 2024-01-25T15:04:07.747 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_bufcreate.sh" 2024-01-25T15:04:07.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.747 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.748 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3324321067, 2024-01-25T15:04:07.748 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629054, 2024-01-25T15:04:07.748 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.mt.sh" 2024-01-25T15:04:07.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.748 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.748 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3329833266, 2024-01-25T15:04:07.748 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629101, 2024-01-25T15:04:07.748 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authdes_create.sh" 2024-01-25T15:04:07.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.748 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.748 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3340941976, 2024-01-25T15:04:07.749 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629438, 2024-01-25T15:04:07.749 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld06" 2024-01-25T15:04:07.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.749 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.749 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3407686353, 2024-01-25T15:04:07.749 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629744, 2024-01-25T15:04:07.749 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff12" 2024-01-25T15:04:07.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.749 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.749 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3412354507, 2024-01-25T15:04:07.749 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629003, 2024-01-25T15:04:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.dataint.sh" 2024-01-25T15:04:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3482938026, 2024-01-25T15:04:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632670, 2024-01-25T15:04:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/2-1.c" 2024-01-25T15:04:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3485627959, 2024-01-25T15:04:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628988, 2024-01-25T15:04:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authnone_create.sh" 2024-01-25T15:04:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.751 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.751 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3506091047, 2024-01-25T15:04:07.751 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629111, 2024-01-25T15:04:07.751 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.sh" 2024-01-25T15:04:07.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.751 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.751 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3507183691, 2024-01-25T15:04:07.751 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629102, 2024-01-25T15:04:07.751 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.dataint.sh" 2024-01-25T15:04:07.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.751 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.751 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3516326272, 2024-01-25T15:04:07.752 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629014, 2024-01-25T15:04:07.752 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.dataint.sh" 2024-01-25T15:04:07.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.752 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.752 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3524613267, 2024-01-25T15:04:07.752 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511633222, 2024-01-25T15:04:07.752 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/testfrmw.c" 2024-01-25T15:04:07.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.752 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.752 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3535235416, 2024-01-25T15:04:07.752 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628956, 2024-01-25T15:04:07.752 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_destroy.sh" 2024-01-25T15:04:07.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.753 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.753 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3558876929, 2024-01-25T15:04:07.753 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628979, 2024-01-25T15:04:07.753 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_bufcreate.limits.sh" 2024-01-25T15:04:07.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.753 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.753 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3561472208, 2024-01-25T15:04:07.753 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629056, 2024-01-25T15:04:07.753 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.basic.sh" 2024-01-25T15:04:07.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.753 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.754 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3563903519, 2024-01-25T15:04:07.754 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629737, 2024-01-25T15:04:07.754 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff13" 2024-01-25T15:04:07.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.754 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.754 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3602008048, 2024-01-25T15:04:07.754 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632725, 2024-01-25T15:04:07.754 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/testfrmw.c" 2024-01-25T15:04:07.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.754 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.754 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3610990899, 2024-01-25T15:04:07.754 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628947, 2024-01-25T15:04:07.755 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.sh" 2024-01-25T15:04:07.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.755 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.755 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3624365912, 2024-01-25T15:04:07.755 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628999, 2024-01-25T15:04:07.755 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getaddr.sh" 2024-01-25T15:04:07.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.755 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.755 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3638386631, 2024-01-25T15:04:07.755 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629898, 2024-01-25T15:04:07.755 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld01" 2024-01-25T15:04:07.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.756 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.756 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3668529205, 2024-01-25T15:04:07.756 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629464, 2024-01-25T15:04:07.756 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff13" 2024-01-25T15:04:07.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.756 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.756 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3697993185, 2024-01-25T15:04:07.756 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629103, 2024-01-25T15:04:07.756 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.complex.sh" 2024-01-25T15:04:07.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.756 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.757 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3714438045, 2024-01-25T15:04:07.757 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629462, 2024-01-25T15:04:07.757 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff09" 2024-01-25T15:04:07.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.757 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.757 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3756045706, 2024-01-25T15:04:07.757 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628949, 2024-01-25T15:04:07.757 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_freeargs.sh" 2024-01-25T15:04:07.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.757 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.757 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3770072463, 2024-01-25T15:04:07.757 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629487, 2024-01-25T15:04:07.758 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff08" 2024-01-25T15:04:07.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.758 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.758 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3775167846, 2024-01-25T15:04:07.758 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631196, 2024-01-25T15:04:07.758 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_008.c" 2024-01-25T15:04:07.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.758 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.758 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3802934458, 2024-01-25T15:04:07.758 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632731, 2024-01-25T15:04:07.758 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/assertions.xml" 2024-01-25T15:04:07.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3807987969, 2024-01-25T15:04:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511632728, 2024-01-25T15:04:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/5-1.c" 2024-01-25T15:04:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3834940211, 2024-01-25T15:04:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629747, 2024-01-25T15:04:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff05" 2024-01-25T15:04:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3850861549, 2024-01-25T15:04:07.759 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629037, 2024-01-25T15:04:07.760 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.sh" 2024-01-25T15:04:07.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.760 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.760 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3872094120, 2024-01-25T15:04:07.760 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629088, 2024-01-25T15:04:07.760 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcfd_create.limits.sh" 2024-01-25T15:04:07.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.760 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.760 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3908340302, 2024-01-25T15:04:07.760 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629468, 2024-01-25T15:04:07.760 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff04" 2024-01-25T15:04:07.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.761 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.761 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3919633358, 2024-01-25T15:04:07.761 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629041, 2024-01-25T15:04:07.761 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_noproc.sh" 2024-01-25T15:04:07.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.761 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.761 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3921028101, 2024-01-25T15:04:07.761 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629002, 2024-01-25T15:04:07.761 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_auth_destroy.sh" 2024-01-25T15:04:07.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.761 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.762 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3925929283, 2024-01-25T15:04:07.762 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629049, 2024-01-25T15:04:07.762 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.performance.sh" 2024-01-25T15:04:07.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.762 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.762 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3933008778, 2024-01-25T15:04:07.762 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629006, 2024-01-25T15:04:07.762 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.sh" 2024-01-25T15:04:07.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.762 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.762 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3978754535, 2024-01-25T15:04:07.762 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629098, 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.scalability.sh" 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3988137569, 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629907, 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff14" 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 3994465370, 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629061, 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.stress.sh" 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.763 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.764 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4013434807, 2024-01-25T15:04:07.764 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629097, 2024-01-25T15:04:07.764 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.stress.sh" 2024-01-25T15:04:07.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.764 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.764 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4027203008, 2024-01-25T15:04:07.764 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628989, 2024-01-25T15:04:07.764 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.performance.sh" 2024-01-25T15:04:07.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.764 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.764 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4039936047, 2024-01-25T15:04:07.764 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629050, 2024-01-25T15:04:07.765 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_getmaps.sh" 2024-01-25T15:04:07.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.765 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.765 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4047152795, 2024-01-25T15:04:07.765 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628930, 2024-01-25T15:04:07.765 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_dg_create.sh" 2024-01-25T15:04:07.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.765 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.765 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4074210640, 2024-01-25T15:04:07.765 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629481, 2024-01-25T15:04:07.765 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff12" 2024-01-25T15:04:07.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.766 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.766 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4076032380, 2024-01-25T15:04:07.766 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629731, 2024-01-25T15:04:07.766 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff10" 2024-01-25T15:04:07.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.766 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.766 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4076832387, 2024-01-25T15:04:07.766 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628986, 2024-01-25T15:04:07.766 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.scalability.sh" 2024-01-25T15:04:07.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.766 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.767 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4077443044, 2024-01-25T15:04:07.767 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629055, 2024-01-25T15:04:07.767 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_svc_register.sh" 2024-01-25T15:04:07.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.767 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.767 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4080218106, 2024-01-25T15:04:07.767 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629478, 2024-01-25T15:04:07.767 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff10" 2024-01-25T15:04:07.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.767 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.767 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4091333812, 2024-01-25T15:04:07.767 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629752, 2024-01-25T15:04:07.767 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff04" 2024-01-25T15:04:07.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.768 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.768 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4093123450, 2024-01-25T15:04:07.768 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629092, 2024-01-25T15:04:07.768 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.limits.sh" 2024-01-25T15:04:07.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.768 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.768 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4101785119, 2024-01-25T15:04:07.768 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629727, 2024-01-25T15:04:07.768 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff06" 2024-01-25T15:04:07.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.769 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.769 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4114181431, 2024-01-25T15:04:07.769 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628974, 2024-01-25T15:04:07.769 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.mt.sh" 2024-01-25T15:04:07.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.769 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.769 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4140780662, 2024-01-25T15:04:07.769 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629726, 2024-01-25T15:04:07.769 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff02" 2024-01-25T15:04:07.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.769 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.769 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4144654391, 2024-01-25T15:04:07.769 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511631203, 2024-01-25T15:04:07.770 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_005.c" 2024-01-25T15:04:07.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.770 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.770 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4155849307, 2024-01-25T15:04:07.770 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629017, 2024-01-25T15:04:07.770 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_noproc.sh" 2024-01-25T15:04:07.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.770 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.770 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4183732614, 2024-01-25T15:04:07.770 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628889, 2024-01-25T15:04:07.770 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_regunreg_registerrpc/assertions.xml" 2024-01-25T15:04:07.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.771 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.771 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4192782437, 2024-01-25T15:04:07.771 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628971, 2024-01-25T15:04:07.771 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.performance.sh" 2024-01-25T15:04:07.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.771 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.771 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4205311783, 2024-01-25T15:04:07.771 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628946, 2024-01-25T15:04:07.771 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.sh" 2024-01-25T15:04:07.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.771 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.772 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4211765262, 2024-01-25T15:04:07.772 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511628932, 2024-01-25T15:04:07.772 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.scalability.sh" 2024-01-25T15:04:07.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.772 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.772 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4228009329, 2024-01-25T15:04:07.772 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629072, 2024-01-25T15:04:07.772 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.stress.sh" 2024-01-25T15:04:07.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.772 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.772 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4281977027, 2024-01-25T15:04:07.772 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629000, 2024-01-25T15:04:07.773 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getcaller.sh" 2024-01-25T15:04:07.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.773 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.773 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4288414511, 2024-01-25T15:04:07.773 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629038, 2024-01-25T15:04:07.773 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.scalability.sh" 2024-01-25T15:04:07.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:07.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:07.773 INFO:teuthology.orchestra.run.smithi170.stdout: "damage_type": "backtrace", 2024-01-25T15:04:07.773 INFO:teuthology.orchestra.run.smithi170.stdout: "id": 4293818928, 2024-01-25T15:04:07.773 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 1099511629086, 2024-01-25T15:04:07.773 INFO:teuthology.orchestra.run.smithi170.stdout: "path": "/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.dataint.sh" 2024-01-25T15:04:07.773 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:07.773 INFO:teuthology.orchestra.run.smithi170.stdout:] 2024-01-25T15:04:07.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:07 smithi191 ceph-mon[36347]: pgmap v412: 97 pgs: 97 active+clean; 117 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.7 MiB/s wr, 445 op/s 2024-01-25T15:04:07.775 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:07 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3975515627' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:04:07.775 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.643+0000 7f779335a640 1 -- 172.21.15.170:0/3449788539 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f77780a1360 msgr2=0x7f77780a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.643+0000 7f779335a640 1 --2- 172.21.15.170:0/3449788539 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f77780a1360 0x7f77780a3820 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7784005fd0 tx=0x7f7784011810 comp rx=0 tx=0).stop 2024-01-25T15:04:07.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.643+0000 7f779335a640 1 -- 172.21.15.170:0/3449788539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f778c100e00 msgr2=0x7f778c199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.643+0000 7f779335a640 1 --2- 172.21.15.170:0/3449788539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f778c100e00 0x7f778c199430 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f777c000c00 tx=0x7f777c0040c0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.643+0000 7f779335a640 1 -- 172.21.15.170:0/3449788539 shutdown_connections 2024-01-25T15:04:07.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.643+0000 7f779335a640 1 --2- 172.21.15.170:0/3449788539 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f77780a1360 0x7f77780a3820 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.643+0000 7f779335a640 1 --2- 172.21.15.170:0/3449788539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f778c1017c0 0x7f778c1a04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.643+0000 7f779335a640 1 --2- 172.21.15.170:0/3449788539 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f778c100e00 0x7f778c199430 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.643+0000 7f779335a640 1 --2- 172.21.15.170:0/3449788539 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f778c0ffc10 0x7f778c198ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.643+0000 7f779335a640 1 -- 172.21.15.170:0/3449788539 >> 172.21.15.170:0/3449788539 conn(0x7f778c0fb180 msgr2=0x7f778c0fbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.643+0000 7f779335a640 1 -- 172.21.15.170:0/3449788539 shutdown_connections 2024-01-25T15:04:07.776 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.643+0000 7f779335a640 1 -- 172.21.15.170:0/3449788539 wait complete. 2024-01-25T15:04:07.777 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-01-25T15:04:07.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.886+0000 7fece1105640 1 -- 172.21.15.170:0/3831255924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecdc1069d0 msgr2=0x7fecdc108e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.886+0000 7fece1105640 1 --2- 172.21.15.170:0/3831255924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecdc1069d0 0x7fecdc108e20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7feccc009900 tx=0x7feccc02bc30 comp rx=0 tx=0).stop 2024-01-25T15:04:07.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.886+0000 7fece1105640 1 -- 172.21.15.170:0/3831255924 shutdown_connections 2024-01-25T15:04:07.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.886+0000 7fece1105640 1 --2- 172.21.15.170:0/3831255924 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecdc1040a0 0x7fecdc106490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.886+0000 7fece1105640 1 --2- 172.21.15.170:0/3831255924 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecdc1069d0 0x7fecdc108e20 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.886+0000 7fece1105640 1 --2- 172.21.15.170:0/3831255924 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecdc101770 0x7fecdc103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.886+0000 7fece1105640 1 -- 172.21.15.170:0/3831255924 >> 172.21.15.170:0/3831255924 conn(0x7fecdc0fb180 msgr2=0x7fecdc0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.886+0000 7fece1105640 1 -- 172.21.15.170:0/3831255924 shutdown_connections 2024-01-25T15:04:07.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.886+0000 7fece1105640 1 -- 172.21.15.170:0/3831255924 wait complete. 2024-01-25T15:04:07.887 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.886+0000 7fece1105640 1 Processor -- start 2024-01-25T15:04:07.889 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fece1105640 1 -- start start 2024-01-25T15:04:07.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fece1105640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecdc101770 0x7fecdc1010e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fece1105640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecdc1040a0 0x7fecdc0ff720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fece1105640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecdc1069d0 0x7fecdc0ffc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fece1105640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc1003c0 con 0x7fecdc1069d0 2024-01-25T15:04:07.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fece1105640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc100530 con 0x7fecdc101770 2024-01-25T15:04:07.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fece1105640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc1a0d20 con 0x7fecdc1040a0 2024-01-25T15:04:07.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fecdb59e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecdc1069d0 0x7fecdc0ffc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fecdb59e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecdc1069d0 0x7fecdc0ffc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56356/0 (socket says 172.21.15.170:56356) 2024-01-25T15:04:07.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fecdb59e640 1 -- 172.21.15.170:0/2266198494 learned_addr learned my addr 172.21.15.170:0/2266198494 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fecda59c640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecdc1040a0 0x7fecdc0ff720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fecdad9d640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecdc101770 0x7fecdc1010e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fecda59c640 1 -- 172.21.15.170:0/2266198494 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecdc101770 msgr2=0x7fecdc1010e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fecda59c640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecdc101770 0x7fecdc1010e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.890 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fecda59c640 1 -- 172.21.15.170:0/2266198494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecdc1069d0 msgr2=0x7fecdc0ffc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fecda59c640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecdc1069d0 0x7fecdc0ffc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fecda59c640 1 -- 172.21.15.170:0/2266198494 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc009560 con 0x7fecdc1040a0 2024-01-25T15:04:07.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fecdb59e640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecdc1069d0 0x7fecdc0ffc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:07.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fecdad9d640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecdc101770 0x7fecdc1010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:07.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.887+0000 7fecda59c640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecdc1040a0 0x7fecdc0ff720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fecc400e9c0 tx=0x7fecc400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.888+0000 7fecd3fff640 1 -- 172.21.15.170:0/2266198494 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc400ccc0 con 0x7fecdc1040a0 2024-01-25T15:04:07.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.888+0000 7fecd3fff640 1 -- 172.21.15.170:0/2266198494 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecc400ce20 con 0x7fecdc1040a0 2024-01-25T15:04:07.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.888+0000 7fece1105640 1 -- 172.21.15.170:0/2266198494 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc1a0fd0 con 0x7fecdc1040a0 2024-01-25T15:04:07.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.888+0000 7fecd3fff640 1 -- 172.21.15.170:0/2266198494 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40187a0 con 0x7fecdc1040a0 2024-01-25T15:04:07.891 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.888+0000 7fece1105640 1 -- 172.21.15.170:0/2266198494 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc1a1450 con 0x7fecdc1040a0 2024-01-25T15:04:07.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.890+0000 7fecd3fff640 1 -- 172.21.15.170:0/2266198494 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fecc40109f0 con 0x7fecdc1040a0 2024-01-25T15:04:07.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.890+0000 7fecd3fff640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecc80a12e0 0x7fecc80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.890+0000 7fece3da1740 1 Processor -- start 2024-01-25T15:04:07.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.890+0000 7fece3da1740 1 -- start start 2024-01-25T15:04:07.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.890+0000 7fecdad9d640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecc80a12e0 0x7fecc80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.890+0000 7fecd3fff640 1 -- 172.21.15.170:0/2266198494 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fecc4014070 con 0x7fecdc1040a0 2024-01-25T15:04:07.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fece3da1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 0x558804a86360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.898 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fece3da1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a86930 0x558804a8b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fece3da1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a8baa0 0x558804a8df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fece3da1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588049f4270 con 0x558804a8baa0 2024-01-25T15:04:07.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fece3da1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588049f1960 con 0x558804a86930 2024-01-25T15:04:07.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fece3da1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588049ed250 con 0x558804a85f40 2024-01-25T15:04:07.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fecdad9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 0x558804a86360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fecdb59e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a8baa0 0x558804a8df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fecdad9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 0x558804a86360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:55262/0 (socket says 172.21.15.170:55262) 2024-01-25T15:04:07.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fecdad9d640 1 -- 172.21.15.170:0/1646088131 learned_addr learned my addr 172.21.15.170:0/1646088131 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fecda59c640 1 --2- 172.21.15.170:0/1646088131 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a86930 0x558804a8b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fecdb59e640 1 -- 172.21.15.170:0/1646088131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 msgr2=0x558804a86360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fecdb59e640 1 --2- 172.21.15.170:0/1646088131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 0x558804a86360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fecdb59e640 1 -- 172.21.15.170:0/1646088131 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a86930 msgr2=0x558804a8b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fecdb59e640 1 --2- 172.21.15.170:0/1646088131 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a86930 0x558804a8b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.899 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fecdb59e640 1 -- 172.21.15.170:0/1646088131 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5588049af7f0 con 0x558804a8baa0 2024-01-25T15:04:07.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fecdad9d640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecc80a12e0 0x7fecc80a37a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fecd400fc80 tx=0x7fecd4011810 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.891+0000 7fecdb59e640 1 --2- 172.21.15.170:0/1646088131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a8baa0 0x558804a8df30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7feccc005ab0 tx=0x7feccc02ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d798290f2f023a9e server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.892+0000 7fecd17fa640 1 -- 172.21.15.170:0/1646088131 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc0046c0 con 0x558804a8baa0 2024-01-25T15:04:07.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.892+0000 7fecd17fa640 1 -- 172.21.15.170:0/1646088131 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feccc004500 con 0x558804a8baa0 2024-01-25T15:04:07.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.892+0000 7fecd17fa640 1 -- 172.21.15.170:0/1646088131 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feccc005530 con 0x558804a8baa0 2024-01-25T15:04:07.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.892+0000 7fece3da1740 1 -- 172.21.15.170:0/1646088131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a8baa0 msgr2=0x558804a8df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.892+0000 7fece3da1740 1 --2- 172.21.15.170:0/1646088131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a8baa0 0x558804a8df30 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7feccc005ab0 tx=0x7feccc02ccc0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.892+0000 7fece3da1740 1 -- 172.21.15.170:0/1646088131 shutdown_connections 2024-01-25T15:04:07.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.892+0000 7fece3da1740 1 --2- 172.21.15.170:0/1646088131 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a86930 0x558804a8b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.892+0000 7fece3da1740 1 --2- 172.21.15.170:0/1646088131 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a8baa0 0x558804a8df30 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.892+0000 7fece3da1740 1 --2- 172.21.15.170:0/1646088131 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 0x558804a86360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.892+0000 7fece3da1740 1 -- 172.21.15.170:0/1646088131 >> 172.21.15.170:0/1646088131 conn(0x558804a814b0 msgr2=0x558804a818b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.900 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.892+0000 7fece3da1740 1 -- 172.21.15.170:0/1646088131 shutdown_connections 2024-01-25T15:04:07.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.892+0000 7fece3da1740 1 -- 172.21.15.170:0/1646088131 wait complete. 2024-01-25T15:04:07.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fece3da1740 1 -- start start 2024-01-25T15:04:07.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fece3da1740 1 Processor -- start 2024-01-25T15:04:07.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fece3da1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 0x558804a90030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fece3da1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a90570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fece3da1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a8baa0 0x558804a975b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fece3da1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588049a6610 con 0x558804a86930 2024-01-25T15:04:07.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fece3da1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588049a62b0 con 0x558804a8baa0 2024-01-25T15:04:07.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fece3da1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55880496b400 con 0x558804a85f40 2024-01-25T15:04:07.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fece3da1740 10 client.0 _ll_register_callbacks cb 0x5588049e3ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:07.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fecda59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a90570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fecdad9d640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 0x558804a90030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fecda59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a90570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56382/0 (socket says 172.21.15.170:56382) 2024-01-25T15:04:07.901 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fecda59c640 1 -- 172.21.15.170:0/3785596802 learned_addr learned my addr 172.21.15.170:0/3785596802 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fecdb59e640 1 --2- 172.21.15.170:0/3785596802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a8baa0 0x558804a975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fecda59c640 1 -- 172.21.15.170:0/3785596802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 msgr2=0x558804a90030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fecda59c640 1 --2- 172.21.15.170:0/3785596802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 0x558804a90030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fecda59c640 1 -- 172.21.15.170:0/3785596802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a8baa0 msgr2=0x558804a975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fecda59c640 1 --2- 172.21.15.170:0/3785596802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a8baa0 0x558804a975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.893+0000 7fecda59c640 1 -- 172.21.15.170:0/3785596802 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc109a00 con 0x558804a86930 2024-01-25T15:04:07.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fecda59c640 1 --2- 172.21.15.170:0/3785596802 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a90570 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fecc40cac00 tx=0x7fecc409a0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8a99d656cb983c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fecc27fc640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:07.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fecc27fc640 1 -- 172.21.15.170:0/3785596802 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40b1070 con 0x558804a86930 2024-01-25T15:04:07.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fecc27fc640 1 -- 172.21.15.170:0/3785596802 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fecc40a1fe0 con 0x558804a86930 2024-01-25T15:04:07.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fece3da1740 1 -- 172.21.15.170:0/3785596802 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588049e5e00 con 0x558804a86930 2024-01-25T15:04:07.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fecc27fc640 1 -- 172.21.15.170:0/3785596802 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecc4094b90 con 0x558804a86930 2024-01-25T15:04:07.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fece3da1740 10 client.16197 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:07.902 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fece3da1740 1 -- 172.21.15.170:0/3785596802 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x5588049eb8d0 con 0x558804a86930 2024-01-25T15:04:07.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fecc27fc640 1 -- 172.21.15.170:0/3785596802 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecc407c080 con 0x558804a86930 2024-01-25T15:04:07.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fecc27fc640 1 -- 172.21.15.170:0/3785596802 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fecc40b2260 con 0x558804a86930 2024-01-25T15:04:07.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fece3da1740 10 client.16197 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:07.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fece3da1740 10 client.16197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:04:07.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fece3da1740 20 client.16197 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:07.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fece3da1740 1 --2- 172.21.15.170:0/3785596802 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558804a9bf90 0x558804a9e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fece3da1740 4 client.16197 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:04:07.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fece3da1740 1 -- 172.21.15.170:0/3785596802 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5588046ec7e0 con 0x558804a9bf90 2024-01-25T15:04:07.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.894+0000 7fecdad9d640 1 --2- 172.21.15.170:0/3785596802 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558804a9bf90 0x558804a9e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.895+0000 7fecdad9d640 1 --2- 172.21.15.170:0/3785596802 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558804a9bf90 0x558804a9e3b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb98221b33710e21 server_cookie=f27ccc78f4b8d0d8 in_seq=0 out_seq=0 2024-01-25T15:04:07.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.895+0000 7fecc27fc640 10 client.16197 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:07.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.896+0000 7fecc27fc640 1 -- 172.21.15.170:0/3785596802 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5588046ec7e0 con 0x558804a9bf90 2024-01-25T15:04:07.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.896+0000 7fecc27fc640 10 client.16197 handle_command_reply: tid=0 2024-01-25T15:04:07.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.896+0000 7fece3da1740 1 client.16197 shutdown 2024-01-25T15:04:07.903 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.897+0000 7fece3da1740 1 -- 172.21.15.170:0/3785596802 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 msgr2=0x558804a90570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.897+0000 7fece3da1740 1 --2- 172.21.15.170:0/3785596802 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a90570 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fecc40cac00 tx=0x7fecc409a0f0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.897+0000 7fece3da1740 1 -- 172.21.15.170:0/3785596802 shutdown_connections 2024-01-25T15:04:07.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.897+0000 7fece3da1740 1 --2- 172.21.15.170:0/3785596802 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558804a9bf90 0x558804a9e3b0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.897+0000 7fece3da1740 1 --2- 172.21.15.170:0/3785596802 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a8baa0 0x558804a975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.897+0000 7fece3da1740 1 --2- 172.21.15.170:0/3785596802 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a90570 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.897+0000 7fece3da1740 1 --2- 172.21.15.170:0/3785596802 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 0x558804a90030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.897+0000 7fecc27fc640 0 client.16197 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:07.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.897+0000 7fece3da1740 1 -- 172.21.15.170:0/3785596802 >> 172.21.15.170:0/3785596802 conn(0x558804a814b0 msgr2=0x558804a807f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.897+0000 7fece3da1740 1 -- 172.21.15.170:0/3785596802 shutdown_connections 2024-01-25T15:04:07.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.897+0000 7fece3da1740 1 -- 172.21.15.170:0/3785596802 wait complete. 2024-01-25T15:04:07.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.897+0000 7fece3da1740 20 client.16197 trim_cache size 0 max 16384 2024-01-25T15:04:07.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.908+0000 7fece3da1740 1 Processor -- start 2024-01-25T15:04:07.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.908+0000 7fece3da1740 1 -- start start 2024-01-25T15:04:07.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fece3da1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a85f40 0x558804a87df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fece3da1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a88330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fece3da1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a8baa0 0x558804a97570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.910 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fece3da1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558804a81370 con 0x558804a86930 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fece3da1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558804a86d40 con 0x558804a85f40 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fece3da1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x558804a9a450 con 0x558804a8baa0 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fecda59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a88330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fecda59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a88330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56398/0 (socket says 172.21.15.170:56398) 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fecda59c640 1 -- 172.21.15.170:0/4169591988 learned_addr learned my addr 172.21.15.170:0/4169591988 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fecdb59e640 1 --2- 172.21.15.170:0/4169591988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a8baa0 0x558804a97570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fecdad9d640 1 --2- 172.21.15.170:0/4169591988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a85f40 0x558804a87df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fecda59c640 1 -- 172.21.15.170:0/4169591988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a8baa0 msgr2=0x558804a97570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fecda59c640 1 --2- 172.21.15.170:0/4169591988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a8baa0 0x558804a97570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fecda59c640 1 -- 172.21.15.170:0/4169591988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a85f40 msgr2=0x558804a87df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fecda59c640 1 --2- 172.21.15.170:0/4169591988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a85f40 0x558804a87df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fecda59c640 1 -- 172.21.15.170:0/4169591988 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558804988500 con 0x558804a86930 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fecda59c640 1 --2- 172.21.15.170:0/4169591988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a88330 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fecc400c6a0 tx=0x7fecc400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb05b4a89b1bd2f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fecd0ff9640 1 -- 172.21.15.170:0/4169591988 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40b1030 con 0x558804a86930 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fecd0ff9640 1 -- 172.21.15.170:0/4169591988 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5588049e5e00 con 0x558804a86930 2024-01-25T15:04:07.911 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.909+0000 7fecd0ff9640 1 -- 172.21.15.170:0/4169591988 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4095d70 con 0x558804a86930 2024-01-25T15:04:07.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.910+0000 7fece3da1740 1 -- 172.21.15.170:0/4169591988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 msgr2=0x558804a88330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.910+0000 7fece3da1740 1 --2- 172.21.15.170:0/4169591988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a88330 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fecc400c6a0 tx=0x7fecc400cf90 comp rx=0 tx=0).stop 2024-01-25T15:04:07.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.910+0000 7fece3da1740 1 -- 172.21.15.170:0/4169591988 shutdown_connections 2024-01-25T15:04:07.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.910+0000 7fece3da1740 1 --2- 172.21.15.170:0/4169591988 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a8baa0 0x558804a97570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.910+0000 7fece3da1740 1 --2- 172.21.15.170:0/4169591988 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a88330 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.910+0000 7fece3da1740 1 --2- 172.21.15.170:0/4169591988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a85f40 0x558804a87df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.910+0000 7fece3da1740 1 -- 172.21.15.170:0/4169591988 >> 172.21.15.170:0/4169591988 conn(0x558804a814b0 msgr2=0x558804aa2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.910+0000 7fece3da1740 1 -- 172.21.15.170:0/4169591988 shutdown_connections 2024-01-25T15:04:07.916 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.910+0000 7fece3da1740 1 -- 172.21.15.170:0/4169591988 wait complete. 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.910+0000 7fece3da1740 1 -- start start 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.910+0000 7fece3da1740 1 Processor -- start 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fece3da1740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 0x558804a96130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fece3da1740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a96670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fece3da1740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a8baa0 0x558804af2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fece3da1740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x558804a96df0 con 0x558804a86930 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fece3da1740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558804a96f60 con 0x558804a8baa0 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fece3da1740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x558804af29c0 con 0x558804a85f40 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fece3da1740 10 client.0 _ll_register_callbacks cb 0x7fecd40093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fecda59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a96670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fecda59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a96670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56406/0 (socket says 172.21.15.170:56406) 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fecda59c640 1 -- 172.21.15.170:0/2113924758 learned_addr learned my addr 172.21.15.170:0/2113924758 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fecdad9d640 1 --2- 172.21.15.170:0/2113924758 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 0x558804a96130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fecdb59e640 1 --2- 172.21.15.170:0/2113924758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a8baa0 0x558804af2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fecdad9d640 1 -- 172.21.15.170:0/2113924758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a8baa0 msgr2=0x558804af2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.917 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fecdad9d640 1 --2- 172.21.15.170:0/2113924758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a8baa0 0x558804af2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fecdad9d640 1 -- 172.21.15.170:0/2113924758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 msgr2=0x558804a96670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fecdad9d640 1 --2- 172.21.15.170:0/2113924758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a96670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fecdad9d640 1 -- 172.21.15.170:0/2113924758 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5588049eb8d0 con 0x558804a85f40 2024-01-25T15:04:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fecda59c640 1 --2- 172.21.15.170:0/2113924758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a96670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fecdad9d640 1 --2- 172.21.15.170:0/2113924758 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 0x558804a96130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fecd4005fd0 tx=0x7fecd4004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5c1d3449926dd1c server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fecc27fc640 10 client.0 ms_handle_connect on v2:172.21.15.191:3300/0 2024-01-25T15:04:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fecc27fc640 1 -- 172.21.15.170:0/2113924758 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4004d20 con 0x558804a85f40 2024-01-25T15:04:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fece3da1740 1 -- 172.21.15.170:0/2113924758 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5588049e60e0 con 0x558804a85f40 2024-01-25T15:04:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.911+0000 7fecc27fc640 1 -- 172.21.15.170:0/2113924758 <== mon.1 v2:172.21.15.191:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fecd4020aa0 con 0x558804a85f40 2024-01-25T15:04:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.912+0000 7fecc27fc640 1 -- 172.21.15.170:0/2113924758 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecd4004e80 con 0x558804a85f40 2024-01-25T15:04:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.912+0000 7fece3da1740 10 client.25504 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.912+0000 7fece3da1740 1 -- 172.21.15.170:0/2113924758 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x5588049ae050 con 0x558804a85f40 2024-01-25T15:04:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.912+0000 7fecc27fc640 1 -- 172.21.15.170:0/2113924758 <== mon.1 v2:172.21.15.191:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5588049e60e0 con 0x558804a85f40 2024-01-25T15:04:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.912+0000 7fecc27fc640 1 -- 172.21.15.170:0/2113924758 <== mon.1 v2:172.21.15.191:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fecd4028040 con 0x558804a85f40 2024-01-25T15:04:07.918 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.912+0000 7fece3da1740 10 client.25504 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:07.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.912+0000 7fece3da1740 10 client.25504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-01-25T15:04:07.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.912+0000 7fece3da1740 20 client.25504 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:07.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.912+0000 7fece3da1740 1 --2- 172.21.15.170:0/2113924758 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558804af44d0 0x558804af68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:07.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.912+0000 7fece3da1740 4 client.25504 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-01-25T15:04:07.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.912+0000 7fece3da1740 1 -- 172.21.15.170:0/2113924758 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55880473fe30 con 0x558804af44d0 2024-01-25T15:04:07.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.912+0000 7fecda59c640 1 --2- 172.21.15.170:0/2113924758 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558804af44d0 0x558804af68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:07.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.913+0000 7fecc27fc640 10 client.25504 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:07.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.913+0000 7fecda59c640 1 --2- 172.21.15.170:0/2113924758 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558804af44d0 0x558804af68f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ad60558c69a73e8 server_cookie=3ad56478341973fb in_seq=0 out_seq=0 2024-01-25T15:04:07.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.914+0000 7fecc27fc640 1 -- 172.21.15.170:0/2113924758 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55880473fe30 con 0x558804af44d0 2024-01-25T15:04:07.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.914+0000 7fecc27fc640 10 client.25504 handle_command_reply: tid=0 2024-01-25T15:04:07.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece3da1740 1 client.25504 shutdown 2024-01-25T15:04:07.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece3da1740 1 -- 172.21.15.170:0/2113924758 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 msgr2=0x558804a96130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece3da1740 1 --2- 172.21.15.170:0/2113924758 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 0x558804a96130 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fecd4005fd0 tx=0x7fecd4004ab0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece3da1740 1 -- 172.21.15.170:0/2113924758 shutdown_connections 2024-01-25T15:04:07.919 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece3da1740 1 --2- 172.21.15.170:0/2113924758 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x558804af44d0 0x558804af68f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece3da1740 1 --2- 172.21.15.170:0/2113924758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558804a8baa0 0x558804af2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fecc27fc640 0 client.25504 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:07.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece3da1740 1 --2- 172.21.15.170:0/2113924758 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x558804a86930 0x558804a96670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece3da1740 1 --2- 172.21.15.170:0/2113924758 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x558804a85f40 0x558804a96130 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece3da1740 1 -- 172.21.15.170:0/2113924758 >> 172.21.15.170:0/2113924758 conn(0x558804a814b0 msgr2=0x558804a87df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece3da1740 1 -- 172.21.15.170:0/2113924758 shutdown_connections 2024-01-25T15:04:07.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece3da1740 1 -- 172.21.15.170:0/2113924758 wait complete. 2024-01-25T15:04:07.920 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece3da1740 20 client.25504 trim_cache size 0 max 16384 2024-01-25T15:04:07.920 INFO:teuthology.orchestra.run.smithi170.stdout:[] 2024-01-25T15:04:07.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece1105640 1 -- 172.21.15.170:0/2266198494 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecc80a12e0 msgr2=0x7fecc80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece1105640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecc80a12e0 0x7fecc80a37a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fecd400fc80 tx=0x7fecd4011810 comp rx=0 tx=0).stop 2024-01-25T15:04:07.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece1105640 1 -- 172.21.15.170:0/2266198494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecdc1040a0 msgr2=0x7fecdc0ff720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:07.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece1105640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecdc1040a0 0x7fecdc0ff720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fecc400e9c0 tx=0x7fecc400ee80 comp rx=0 tx=0).stop 2024-01-25T15:04:07.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece1105640 1 -- 172.21.15.170:0/2266198494 shutdown_connections 2024-01-25T15:04:07.921 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece1105640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fecc80a12e0 0x7fecc80a37a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece1105640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fecdc1069d0 0x7fecdc0ffc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece1105640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fecdc1040a0 0x7fecdc0ff720 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece1105640 1 --2- 172.21.15.170:0/2266198494 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fecdc101770 0x7fecdc1010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:07.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece1105640 1 -- 172.21.15.170:0/2266198494 >> 172.21.15.170:0/2266198494 conn(0x7fecdc0fb180 msgr2=0x7fecdc1020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:07.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece1105640 1 -- 172.21.15.170:0/2266198494 shutdown_connections 2024-01-25T15:04:07.922 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:07.915+0000 7fece1105640 1 -- 172.21.15.170:0/2266198494 wait complete. 2024-01-25T15:04:07.928 ERROR:tasks.fwd_scrub:rank 4 damaged: [{'damage_type': 'backtrace', 'id': 122588077, 'ino': 1099511633290, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/3-1.c'}, {'damage_type': 'backtrace', 'id': 204652443, 'ino': 1099511632569, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/16-1.c'}, {'damage_type': 'backtrace', 'id': 257933295, 'ino': 1099511631778, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_026.c'}, {'damage_type': 'backtrace', 'id': 269164118, 'ino': 1099511629781, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip05'}, {'damage_type': 'backtrace', 'id': 292974284, 'ino': 1099511630212, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_unknown'}, {'damage_type': 'backtrace', 'id': 315555737, 'ino': 1099511632949, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/coverage.txt'}, {'damage_type': 'backtrace', 'id': 320611712, 'ino': 1099511631768, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_030.c'}, {'damage_type': 'backtrace', 'id': 329238298, 'ino': 1099511632953, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/4-1.c'}, {'damage_type': 'backtrace', 'id': 347940513, 'ino': 1099511630175, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip09'}, {'damage_type': 'backtrace', 'id': 377037131, 'ino': 1099511632236, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/Makefile.in'}, {'damage_type': 'backtrace', 'id': 510779187, 'ino': 1099511631774, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/openhpi.conf'}, {'damage_type': 'backtrace', 'id': 551844540, 'ino': 1099511630186, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_unkown'}, {'damage_type': 'backtrace', 'id': 645691179, 'ino': 1099511631761, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/init.c'}, {'damage_type': 'backtrace', 'id': 652998091, 'ino': 1099511631762, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/safhpi.c'}, {'damage_type': 'backtrace', 'id': 756096066, 'ino': 1099511629776, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip05'}, {'damage_type': 'backtrace', 'id': 773205195, 'ino': 1099511631772, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_025.c'}, {'damage_type': 'backtrace', 'id': 778943836, 'ino': 1099511630214, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_over'}, {'damage_type': 'backtrace', 'id': 798328025, 'ino': 1099511632565, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/12-1.c'}, {'damage_type': 'backtrace', 'id': 823906393, 'ino': 1099511631794, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/Makefile.am'}, {'damage_type': 'backtrace', 'id': 835075689, 'ino': 1099511629770, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip12'}, {'damage_type': 'backtrace', 'id': 841866254, 'ino': 1099511631793, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/domain.c'}, {'damage_type': 'backtrace', 'id': 873448209, 'ino': 1099511630811, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_mem_scrub'}, {'damage_type': 'backtrace', 'id': 951521769, 'ino': 1099511632559, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/14-1.c'}, {'damage_type': 'backtrace', 'id': 964659351, 'ino': 1099511629775, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip13'}, {'damage_type': 'backtrace', 'id': 994992282, 'ino': 1099511629759, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip03'}, {'damage_type': 'backtrace', 'id': 999499511, 'ino': 1099511630215, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_corrected'}, {'damage_type': 'backtrace', 'id': 1031460494, 'ino': 1099511631779, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_008.c'}, {'damage_type': 'backtrace', 'id': 1041437835, 'ino': 1099511629761, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip13'}, {'damage_type': 'backtrace', 'id': 1066267486, 'ino': 1099511631775, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_039.c'}, {'damage_type': 'backtrace', 'id': 1092266624, 'ino': 1099511633286, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative/5-1.c'}, {'damage_type': 'backtrace', 'id': 1139156548, 'ino': 1099511631784, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_031.c'}, {'damage_type': 'backtrace', 'id': 1140067540, 'ino': 1099511630532, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/s0_ar1'}, {'damage_type': 'backtrace', 'id': 1241749664, 'ino': 1099511631769, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_028.c'}, {'damage_type': 'backtrace', 'id': 1247283451, 'ino': 1099511631787, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/hpiinjector.c'}, {'damage_type': 'backtrace', 'id': 1324903710, 'ino': 1099511629767, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/00_Descriptions.txt'}, {'damage_type': 'backtrace', 'id': 1325396817, 'ino': 1099511632940, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/1-1.c'}, {'damage_type': 'backtrace', 'id': 1327778563, 'ino': 1099511632557, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 1370517182, 'ino': 1099511631767, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi_tests.txt'}, {'damage_type': 'backtrace', 'id': 1390737797, 'ino': 1099511629778, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip07'}, {'damage_type': 'backtrace', 'id': 1399795792, 'ino': 1099511629764, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip02'}, {'damage_type': 'backtrace', 'id': 1429833747, 'ino': 1099511632562, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/15-1.c'}, {'damage_type': 'backtrace', 'id': 1443312560, 'ino': 1099511629755, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip02'}, {'damage_type': 'backtrace', 'id': 1511338977, 'ino': 1099511632234, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/plugin_static.c.in'}, {'damage_type': 'backtrace', 'id': 1586331860, 'ino': 1099511630188, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srao_ewb_noripv'}, {'damage_type': 'backtrace', 'id': 1616497079, 'ino': 1099511632555, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/coverage.txt'}, {'damage_type': 'backtrace', 'id': 1623435487, 'ino': 1099511632941, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/assertions.xml'}, {'damage_type': 'backtrace', 'id': 1684563458, 'ino': 1099511631763, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/lock.c'}, {'damage_type': 'backtrace', 'id': 1713053921, 'ino': 1099511630187, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_over'}, {'damage_type': 'backtrace', 'id': 1737211760, 'ino': 1099511631783, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_007.c'}, {'damage_type': 'backtrace', 'id': 1784816719, 'ino': 1099511633285, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative'}, {'damage_type': 'backtrace', 'id': 1810375284, 'ino': 1099511629779, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip01'}, {'damage_type': 'backtrace', 'id': 1829034726, 'ino': 1099511632942, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/3-1.sh'}, {'damage_type': 'backtrace', 'id': 1853066643, 'ino': 1099511632939, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/1-2.c'}, {'damage_type': 'backtrace', 'id': 1855475260, 'ino': 1099511631770, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_032.c'}, {'damage_type': 'backtrace', 'id': 1881949765, 'ino': 1099511629769, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip10'}, {'damage_type': 'backtrace', 'id': 1891523465, 'ino': 1099511631757, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/session.c'}, {'damage_type': 'backtrace', 'id': 1908699871, 'ino': 1099511631759, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/alarm.c'}, {'damage_type': 'backtrace', 'id': 1930654617, 'ino': 1099511631785, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_029.c'}, {'damage_type': 'backtrace', 'id': 1949356767, 'ino': 1099511631764, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/Makefile.in'}, {'damage_type': 'backtrace', 'id': 2224469364, 'ino': 1099511631766, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/config.c'}, {'damage_type': 'backtrace', 'id': 2267719328, 'ino': 1099511630163, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srao_mem_scrub_noripv'}, {'damage_type': 'backtrace', 'id': 2273442248, 'ino': 1099511630213, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_ewb'}, {'damage_type': 'backtrace', 'id': 2296423196, 'ino': 1099511631786, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/Makefile.in'}, {'damage_type': 'backtrace', 'id': 2310162672, 'ino': 1099511629773, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip07'}, {'damage_type': 'backtrace', 'id': 2322057807, 'ino': 1099511630216, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_no_en'}, {'damage_type': 'backtrace', 'id': 2374207031, 'ino': 1099511631781, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_027.c'}, {'damage_type': 'backtrace', 'id': 2389566714, 'ino': 1099511632556, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/18-1.c'}, {'damage_type': 'backtrace', 'id': 2479101817, 'ino': 1099511632560, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/5-1.c'}, {'damage_type': 'backtrace', 'id': 2565659632, 'ino': 1099511629754, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip06'}, {'damage_type': 'backtrace', 'id': 2568114119, 'ino': 1099511632237, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi'}, {'damage_type': 'backtrace', 'id': 2600270775, 'ino': 1099511631760, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/ohpi.c'}, {'damage_type': 'backtrace', 'id': 2659328852, 'ino': 1099511631777, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_010.c'}, {'damage_type': 'backtrace', 'id': 2711505902, 'ino': 1099511631776, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_036.c'}, {'damage_type': 'backtrace', 'id': 2730694613, 'ino': 1099511631269, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/Makefile.am'}, {'damage_type': 'backtrace', 'id': 2742180340, 'ino': 1099511629753, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip08'}, {'damage_type': 'backtrace', 'id': 2758747046, 'ino': 1099511632945, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/speculative/5-2.c'}, {'damage_type': 'backtrace', 'id': 2783572814, 'ino': 1099511629765, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip11'}, {'damage_type': 'backtrace', 'id': 2796029466, 'ino': 1099511631771, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_033.c'}, {'damage_type': 'backtrace', 'id': 2860102391, 'ino': 1099511631792, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/Makefile.am'}, {'damage_type': 'backtrace', 'id': 2874479810, 'ino': 1099511632558, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 2924051642, 'ino': 1099511631268, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/Makefile.in'}, {'damage_type': 'backtrace', 'id': 3033111400, 'ino': 1099511631267, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/snmp_utils.c'}, {'damage_type': 'backtrace', 'id': 3045184271, 'ino': 1099511631782, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_024.c'}, {'damage_type': 'backtrace', 'id': 3099182889, 'ino': 1099511632553, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/9-1.c'}, {'damage_type': 'backtrace', 'id': 3176382279, 'ino': 1099511629780, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip11'}, {'damage_type': 'backtrace', 'id': 3289120500, 'ino': 1099511632561, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/6-1.c'}, {'damage_type': 'backtrace', 'id': 3292701190, 'ino': 1099511632568, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-2.c'}, {'damage_type': 'backtrace', 'id': 3306878161, 'ino': 1099511629777, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip10'}, {'damage_type': 'backtrace', 'id': 3315130746, 'ino': 1099511632564, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/assertions.xml'}, {'damage_type': 'backtrace', 'id': 3360020058, 'ino': 1099511631765, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/threaded.c'}, {'damage_type': 'backtrace', 'id': 3397244105, 'ino': 1099511633284, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/coverage.txt'}, {'damage_type': 'backtrace', 'id': 3413942504, 'ino': 1099511632943, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/4-1.sh'}, {'damage_type': 'backtrace', 'id': 3446214354, 'ino': 1099511629758, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip12'}, {'damage_type': 'backtrace', 'id': 3476953149, 'ino': 1099511631790, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/Makefile.am'}, {'damage_type': 'backtrace', 'id': 3488315201, 'ino': 1099511632566, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/7-1.c'}, {'damage_type': 'backtrace', 'id': 3506501359, 'ino': 1099511632952, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/assertions.xml'}, {'damage_type': 'backtrace', 'id': 3511516611, 'ino': 1099511631788, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_037.c'}, {'damage_type': 'backtrace', 'id': 3523485982, 'ino': 1099511631758, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/event.c'}, {'damage_type': 'backtrace', 'id': 3534328749, 'ino': 1099511629768, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip06'}, {'damage_type': 'backtrace', 'id': 3601240940, 'ino': 1099511630217, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/recoverable_ucr/data/srao_ucna'}, {'damage_type': 'backtrace', 'id': 3615047725, 'ino': 1099511631756, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/plugin.c'}, {'damage_type': 'backtrace', 'id': 3646328890, 'ino': 1099511629774, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip08'}, {'damage_type': 'backtrace', 'id': 3682439035, 'ino': 1099511631773, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_009.c'}, {'damage_type': 'backtrace', 'id': 3682795314, 'ino': 1099511631780, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_034.c'}, {'damage_type': 'backtrace', 'id': 3687398400, 'ino': 1099511632929, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-3.c'}, {'damage_type': 'backtrace', 'id': 3722756177, 'ino': 1099511632944, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/timer_delete/2-1.sh'}, {'damage_type': 'backtrace', 'id': 3761435517, 'ino': 1099511631698, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/snmp/snmp_utils.h'}, {'damage_type': 'backtrace', 'id': 3762481789, 'ino': 1099511632567, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/4-1.c'}, {'damage_type': 'backtrace', 'id': 3836058817, 'ino': 1099511632238, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_035.c'}, {'damage_type': 'backtrace', 'id': 3874623942, 'ino': 1099511631791, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_version.c'}, {'damage_type': 'backtrace', 'id': 3877786868, 'ino': 1099511631789, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t/ohpi/ohpi_038.c'}, {'damage_type': 'backtrace', 'id': 3892108966, 'ino': 1099511632950, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/2-1.c'}, {'damage_type': 'backtrace', 'id': 3942817616, 'ino': 1099511629760, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip03'}, {'damage_type': 'backtrace', 'id': 3953801913, 'ino': 1099511632235, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/t'}, {'damage_type': 'backtrace', 'id': 3979201433, 'ino': 1099511632554, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/10-1.c'}, {'damage_type': 'backtrace', 'id': 3984583078, 'ino': 1099511629772, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip14'}, {'damage_type': 'backtrace', 'id': 3987039884, 'ino': 1099511629771, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip09'}, {'damage_type': 'backtrace', 'id': 3995960232, 'ino': 1099511629762, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip14'}, {'damage_type': 'backtrace', 'id': 4009726381, 'ino': 1099511629766, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip04'}, {'damage_type': 'backtrace', 'id': 4018954533, 'ino': 1099511629757, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp4-multi-diffip04'}, {'damage_type': 'backtrace', 'id': 4074343305, 'ino': 1099511630164, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_ucr/data/srar_no_en'}, {'damage_type': 'backtrace', 'id': 4076171959, 'ino': 1099511631755, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/src/hotswap.c'}, {'damage_type': 'backtrace', 'id': 4095229294, 'ino': 1099511629763, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/Makefile'}, {'damage_type': 'backtrace', 'id': 4112648525, 'ino': 1099511629756, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/multi-diffip/tcp6-multi-diffip01'}, {'damage_type': 'backtrace', 'id': 4262951973, 'ino': 1099511632563, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_sigmask/8-1.c'}, {'damage_type': 'backtrace', 'id': 4289212542, 'ino': 1099511632951, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_condattr_destroy/1-1.c'}] 2024-01-25T15:04:07.928 ERROR:tasks.fwd_scrub:rank 3 damaged: [{'damage_type': 'backtrace', 'id': 40817110, 'ino': 1099511633264, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/3-1.c'}, {'damage_type': 'backtrace', 'id': 54517123, 'ino': 1099511630203, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_no_en'}, {'damage_type': 'backtrace', 'id': 60738302, 'ino': 1099511632401, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/2-1.c'}, {'damage_type': 'backtrace', 'id': 97902692, 'ino': 1099511632660, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/21-1.c'}, {'damage_type': 'backtrace', 'id': 100186235, 'ino': 1099511629863, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-addr-addlarge'}, {'damage_type': 'backtrace', 'id': 129388462, 'ino': 1099511629862, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-alias-addlarge'}, {'damage_type': 'backtrace', 'id': 147675462, 'ino': 1099511631295, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.h'}, {'damage_type': 'backtrace', 'id': 161987513, 'ino': 1099511631313, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.in'}, {'damage_type': 'backtrace', 'id': 171051099, 'ino': 1099511639954, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e'}, {'damage_type': 'backtrace', 'id': 214062119, 'ino': 1099511631289, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_close.c'}, {'damage_type': 'backtrace', 'id': 246288549, 'ino': 1099511630207, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_ripv'}, {'damage_type': 'backtrace', 'id': 346360765, 'ino': 1099511632833, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-1.c'}, {'damage_type': 'backtrace', 'id': 362651921, 'ino': 1099511630208, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal'}, {'damage_type': 'backtrace', 'id': 366945984, 'ino': 1099511631287, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_vshm_rdrs.c'}, {'damage_type': 'backtrace', 'id': 390007368, 'ino': 1099511629932, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport07'}, {'damage_type': 'backtrace', 'id': 413792472, 'ino': 1099511630204, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_over'}, {'damage_type': 'backtrace', 'id': 425334181, 'ino': 1099511631310, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_rdrs.c'}, {'damage_type': 'backtrace', 'id': 457395575, 'ino': 1099511631309, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_shelf_fru.c'}, {'damage_type': 'backtrace', 'id': 459248751, 'ino': 1099511632637, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-1.c'}, {'damage_type': 'backtrace', 'id': 559956669, 'ino': 1099511631314, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/Makefile.am'}, {'damage_type': 'backtrace', 'id': 563157570, 'ino': 1099511632639, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-3.c'}, {'damage_type': 'backtrace', 'id': 602712220, 'ino': 1099511632647, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/14-1.c'}, {'damage_type': 'backtrace', 'id': 617093959, 'ino': 1099511632638, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/22-2.c'}, {'damage_type': 'backtrace', 'id': 618678563, 'ino': 1099511629931, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport01'}, {'damage_type': 'backtrace', 'id': 679040851, 'ino': 1099511631298, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/sync.c'}, {'damage_type': 'backtrace', 'id': 740632906, 'ino': 1099511632831, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/assertions.xml'}, {'damage_type': 'backtrace', 'id': 769473077, 'ino': 1099511629858, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-updown'}, {'damage_type': 'backtrace', 'id': 793665142, 'ino': 1099511632636, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-3.c'}, {'damage_type': 'backtrace', 'id': 876697081, 'ino': 1099511631300, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory_event.c'}, {'damage_type': 'backtrace', 'id': 880754053, 'ino': 1099511632828, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 897663047, 'ino': 1099511631312, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_slot_rdrs.c'}, {'damage_type': 'backtrace', 'id': 921335001, 'ino': 1099511631306, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_mc_event.c'}, {'damage_type': 'backtrace', 'id': 938869524, 'ino': 1099511632651, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/1-1.c'}, {'damage_type': 'backtrace', 'id': 1025588230, 'ino': 1099511629927, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport06'}, {'damage_type': 'backtrace', 'id': 1034546294, 'ino': 1099511629915, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-addr-adddel'}, {'damage_type': 'backtrace', 'id': 1043746019, 'ino': 1099511631301, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/posix_vlog.c'}, {'damage_type': 'backtrace', 'id': 1078890945, 'ino': 1099511632402, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/1-1.c'}, {'damage_type': 'backtrace', 'id': 1087632359, 'ino': 1099511632644, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-4.c'}, {'damage_type': 'backtrace', 'id': 1118116930, 'ino': 1099511632657, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/3-1.sh'}, {'damage_type': 'backtrace', 'id': 1121026454, 'ino': 1099511632650, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/6-1.c'}, {'damage_type': 'backtrace', 'id': 1122125394, 'ino': 1099511629921, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/Makefile'}, {'damage_type': 'backtrace', 'id': 1159626659, 'ino': 1099511632666, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/16-1.c'}, {'damage_type': 'backtrace', 'id': 1217441459, 'ino': 1099511630185, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-updown'}, {'damage_type': 'backtrace', 'id': 1240844466, 'ino': 1099511631290, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/hotswap.c'}, {'damage_type': 'backtrace', 'id': 1260301265, 'ino': 1099511631305, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sel.c'}, {'damage_type': 'backtrace', 'id': 1269053039, 'ino': 1099511632668, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-1.c'}, {'damage_type': 'backtrace', 'id': 1318002477, 'ino': 1099511632825, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/coverage.txt'}, {'damage_type': 'backtrace', 'id': 1329004690, 'ino': 1099511631297, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.sym'}, {'damage_type': 'backtrace', 'id': 1340722008, 'ino': 1099511629916, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-route-adddel'}, {'damage_type': 'backtrace', 'id': 1452172427, 'ino': 1099511629929, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport04'}, {'damage_type': 'backtrace', 'id': 1452825976, 'ino': 1099511639980, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/c44'}, {'damage_type': 'backtrace', 'id': 1468355763, 'ino': 1099511630795, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_eripv_timeout'}, {'damage_type': 'backtrace', 'id': 1472632720, 'ino': 1099511630205, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout'}, {'damage_type': 'backtrace', 'id': 1482793315, 'ino': 1099511632643, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-2.c'}, {'damage_type': 'backtrace', 'id': 1493744806, 'ino': 1099511629923, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport07'}, {'damage_type': 'backtrace', 'id': 1537241879, 'ino': 1099511629856, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/Makefile'}, {'damage_type': 'backtrace', 'id': 1553343911, 'ino': 1099511632826, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/1-2.c'}, {'damage_type': 'backtrace', 'id': 1578404930, 'ino': 1099511631311, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_util.c'}, {'damage_type': 'backtrace', 'id': 1581068907, 'ino': 1099511629914, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-mtu-change'}, {'damage_type': 'backtrace', 'id': 1696591600, 'ino': 1099511631288, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor_event.c'}, {'damage_type': 'backtrace', 'id': 1697622961, 'ino': 1099511629924, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/00_Descriptions.txt'}, {'damage_type': 'backtrace', 'id': 1718487072, 'ino': 1099511632663, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/22-1.c'}, {'damage_type': 'backtrace', 'id': 1808582807, 'ino': 1099511629864, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-mtu-change'}, {'damage_type': 'backtrace', 'id': 1839353533, 'ino': 1099511630069, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/xfscompat.h'}, {'damage_type': 'backtrace', 'id': 1866500803, 'ino': 1099511630196, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_mcip_timeout'}, {'damage_type': 'backtrace', 'id': 1890108412, 'ino': 1099511629920, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport05'}, {'damage_type': 'backtrace', 'id': 1902303838, 'ino': 1099511629857, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/00_Descriptions.txt'}, {'damage_type': 'backtrace', 'id': 1931117030, 'ino': 1099511632662, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/13-1.c'}, {'damage_type': 'backtrace', 'id': 1963208400, 'ino': 1099511631294, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_controls.c'}, {'damage_type': 'backtrace', 'id': 1971306396, 'ino': 1099511632655, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/assertions.xml'}, {'damage_type': 'backtrace', 'id': 1987818603, 'ino': 1099511631293, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ekeyfru.h'}, {'damage_type': 'backtrace', 'id': 2034379801, 'ino': 1099511632969, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/9-1.c'}, {'damage_type': 'backtrace', 'id': 2144496124, 'ino': 1099511632832, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-3.c'}, {'damage_type': 'backtrace', 'id': 2175109089, 'ino': 1099511639968, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/d41'}, {'damage_type': 'backtrace', 'id': 2180390188, 'ino': 1099511630200, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uncorrected_timeout'}, {'damage_type': 'backtrace', 'id': 2207118636, 'ino': 1099511632661, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-6.c'}, {'damage_type': 'backtrace', 'id': 2216609938, 'ino': 1099511632889, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/coverage.txt'}, {'damage_type': 'backtrace', 'id': 2228761698, 'ino': 1099511631705, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity_event.c'}, {'damage_type': 'backtrace', 'id': 2231039598, 'ino': 1099511629917, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-route-adddel'}, {'damage_type': 'backtrace', 'id': 2296848463, 'ino': 1099511630198, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/unknown'}, {'damage_type': 'backtrace', 'id': 2352533229, 'ino': 1099511630195, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/fatal_severity'}, {'damage_type': 'backtrace', 'id': 2375209234, 'ino': 1099511632658, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/12-1.c'}, {'damage_type': 'backtrace', 'id': 2387731079, 'ino': 1099511631316, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_sensor.c'}, {'damage_type': 'backtrace', 'id': 2407668433, 'ino': 1099511632648, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/2-1.c'}, {'damage_type': 'backtrace', 'id': 2471814256, 'ino': 1099511631302, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi.c'}, {'damage_type': 'backtrace', 'id': 2497875103, 'ino': 1099511632667, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/11-1.c'}, {'damage_type': 'backtrace', 'id': 2530163701, 'ino': 1099511633272, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_join/speculative/6-1.c'}, {'damage_type': 'backtrace', 'id': 2539094781, 'ino': 1099511629930, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport04'}, {'damage_type': 'backtrace', 'id': 2553555280, 'ino': 1099511629926, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport02'}, {'damage_type': 'backtrace', 'id': 2618005928, 'ino': 1099511631292, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_connection.c'}, {'damage_type': 'backtrace', 'id': 2618687944, 'ino': 1099511632659, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/7-1.c'}, {'damage_type': 'backtrace', 'id': 2650561548, 'ino': 1099511629860, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-alias-adddel'}, {'damage_type': 'backtrace', 'id': 2656137780, 'ino': 1099511632652, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-4.c'}, {'damage_type': 'backtrace', 'id': 2658749483, 'ino': 1099511629861, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-addr-change'}, {'damage_type': 'backtrace', 'id': 2680704102, 'ino': 1099511632642, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-2.c'}, {'damage_type': 'backtrace', 'id': 2717464677, 'ino': 1099511632640, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/coverage.txt'}, {'damage_type': 'backtrace', 'id': 2732421072, 'ino': 1099511631706, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t'}, {'damage_type': 'backtrace', 'id': 2735039626, 'ino': 1099511631304, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_entity.c'}, {'damage_type': 'backtrace', 'id': 2760040219, 'ino': 1099511630067, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/nfs_fsstress.sh'}, {'damage_type': 'backtrace', 'id': 2792849645, 'ino': 1099511629865, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if6-route-addlarge'}, {'damage_type': 'backtrace', 'id': 2879076960, 'ino': 1099511632649, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/5-1.c'}, {'damage_type': 'backtrace', 'id': 2899707843, 'ino': 1099511630201, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_irq'}, {'damage_type': 'backtrace', 'id': 2959002492, 'ino': 1099511631308, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.in'}, {'damage_type': 'backtrace', 'id': 2980719304, 'ino': 1099511631307, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/atca_fru_rdrs.c'}, {'damage_type': 'backtrace', 'id': 3006469527, 'ino': 1099511631291, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_control_event.c'}, {'damage_type': 'backtrace', 'id': 3034015030, 'ino': 1099511632827, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 3073954346, 'ino': 1099511632664, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/4-1.c'}, {'damage_type': 'backtrace', 'id': 3084967073, 'ino': 1099511632665, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/19-5.c'}, {'damage_type': 'backtrace', 'id': 3090365525, 'ino': 1099511632641, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-5.c'}, {'damage_type': 'backtrace', 'id': 3116863435, 'ino': 1099511629925, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport06'}, {'damage_type': 'backtrace', 'id': 3168990346, 'ino': 1099511639914, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/f38'}, {'damage_type': 'backtrace', 'id': 3179182018, 'ino': 1099511630194, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uncorrected'}, {'damage_type': 'backtrace', 'id': 3186183588, 'ino': 1099511629859, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/interface/if4-route-addlarge'}, {'damage_type': 'backtrace', 'id': 3198470111, 'ino': 1099511632654, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/15-1.c'}, {'damage_type': 'backtrace', 'id': 3219795460, 'ino': 1099511632829, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/2-1.c'}, {'damage_type': 'backtrace', 'id': 3296481586, 'ino': 1099511632656, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/15-2.c'}, {'damage_type': 'backtrace', 'id': 3366020769, 'ino': 1099511629922, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport01'}, {'damage_type': 'backtrace', 'id': 3374801713, 'ino': 1099511640004, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/f46'}, {'damage_type': 'backtrace', 'id': 3382088107, 'ino': 1099511632646, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/8-1.sh'}, {'damage_type': 'backtrace', 'id': 3394422422, 'ino': 1099511639242, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/f47'}, {'damage_type': 'backtrace', 'id': 3410381821, 'ino': 1099511632403, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/clock_getcpuclockid/assertions.xml'}, {'damage_type': 'backtrace', 'id': 3523109685, 'ino': 1099511632830, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/1-1.c'}, {'damage_type': 'backtrace', 'id': 3526905536, 'ino': 1099511630493, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/global.h'}, {'damage_type': 'backtrace', 'id': 3540579560, 'ino': 1099511630202, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_eipv'}, {'damage_type': 'backtrace', 'id': 3603038744, 'ino': 1099511629928, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport03'}, {'damage_type': 'backtrace', 'id': 3613497037, 'ino': 1099511630068, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/Makefile'}, {'damage_type': 'backtrace', 'id': 3620340435, 'ino': 1099511631315, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/Makefile.am'}, {'damage_type': 'backtrace', 'id': 3717146236, 'ino': 1099511631296, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_inventory.c'}, {'damage_type': 'backtrace', 'id': 3737034345, 'ino': 1099511632634, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/20-1.c'}, {'damage_type': 'backtrace', 'id': 3782659486, 'ino': 1099511630801, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_userspace'}, {'damage_type': 'backtrace', 'id': 3793837154, 'ino': 1099511630197, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_mcip'}, {'damage_type': 'backtrace', 'id': 3925198208, 'ino': 1099511631707, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/t/ipmi_thres_test.c'}, {'damage_type': 'backtrace', 'id': 3933702280, 'ino': 1099511631299, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_drv.c'}, {'damage_type': 'backtrace', 'id': 4010624224, 'ino': 1099511630206, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic/data/fatal_timeout_ripv'}, {'damage_type': 'backtrace', 'id': 4040829761, 'ino': 1099511629919, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp4-multi-diffport02'}, {'damage_type': 'backtrace', 'id': 4087387650, 'ino': 1099511632653, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/18-1.sh'}, {'damage_type': 'backtrace', 'id': 4131054599, 'ino': 1099511631303, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmi/ipmi_event.c'}, {'damage_type': 'backtrace', 'id': 4140879910, 'ino': 1099511632645, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/17-7.c'}, {'damage_type': 'backtrace', 'id': 4215769699, 'ino': 1099511630439, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport03'}, {'damage_type': 'backtrace', 'id': 4217853198, 'ino': 1099511632824, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_trylock/4-2.c'}, {'damage_type': 'backtrace', 'id': 4234710027, 'ino': 1099511630070, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs_fsstress/fsstress.c'}, {'damage_type': 'backtrace', 'id': 4234991015, 'ino': 1099511629918, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/udp/multi-diffport/udp6-multi-diffport05'}, {'damage_type': 'backtrace', 'id': 4242290153, 'ino': 1099511632635, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sched_setscheduler/10-1.c'}, {'damage_type': 'backtrace', 'id': 4273114844, 'ino': 1099511630199, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data/uc_no_eripv'}] 2024-01-25T15:04:07.929 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 3493753, 'ino': 1099511632086, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/Makefile'}, {'damage_type': 'backtrace', 'id': 3513889, 'ino': 1099511633202, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-57.c'}, {'damage_type': 'backtrace', 'id': 4423226, 'ino': 1099511633157, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-21.c'}, {'damage_type': 'backtrace', 'id': 7096140, 'ino': 1099511633531, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-3.c'}, {'damage_type': 'backtrace', 'id': 8224273, 'ino': 1099511629657, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend02'}, {'damage_type': 'backtrace', 'id': 9477112, 'ino': 1099511633458, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-25.c'}, {'damage_type': 'backtrace', 'id': 22305393, 'ino': 1099511633349, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-2.c'}, {'damage_type': 'backtrace', 'id': 34007004, 'ino': 1099511633191, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-22.c'}, {'damage_type': 'backtrace', 'id': 34948289, 'ino': 1099511633198, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-29.c'}, {'damage_type': 'backtrace', 'id': 43904579, 'ino': 1099511633501, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-15.c'}, {'damage_type': 'backtrace', 'id': 47397518, 'ino': 1099511633177, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-6.c'}, {'damage_type': 'backtrace', 'id': 71461998, 'ino': 1099511633513, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-5.c'}, {'damage_type': 'backtrace', 'id': 89880926, 'ino': 1099511633148, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-47.c'}, {'damage_type': 'backtrace', 'id': 91972567, 'ino': 1099511629659, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend08'}, {'damage_type': 'backtrace', 'id': 107960561, 'ino': 1099511629645, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend01'}, {'damage_type': 'backtrace', 'id': 110017050, 'ino': 1099511633365, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-14.c'}, {'damage_type': 'backtrace', 'id': 130383642, 'ino': 1099511633193, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-15.c'}, {'damage_type': 'backtrace', 'id': 134918217, 'ino': 1099511633472, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-11.c'}, {'damage_type': 'backtrace', 'id': 136300655, 'ino': 1099511629655, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend05'}, {'damage_type': 'backtrace', 'id': 148108484, 'ino': 1099511633382, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 148796610, 'ino': 1099511633007, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-4.sh'}, {'damage_type': 'backtrace', 'id': 149615979, 'ino': 1099511633483, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-20.c'}, {'damage_type': 'backtrace', 'id': 166393426, 'ino': 1099511633409, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-18.c'}, {'damage_type': 'backtrace', 'id': 175170010, 'ino': 1099511633155, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-5.c'}, {'damage_type': 'backtrace', 'id': 207673407, 'ino': 1099511633181, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-11.c'}, {'damage_type': 'backtrace', 'id': 210769291, 'ino': 1099511633373, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-9.c'}, {'damage_type': 'backtrace', 'id': 215938282, 'ino': 1099511633320, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-2.c'}, {'damage_type': 'backtrace', 'id': 218291538, 'ino': 1099511633205, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-14.c'}, {'damage_type': 'backtrace', 'id': 227040412, 'ino': 1099511633383, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-54.c'}, {'damage_type': 'backtrace', 'id': 235730696, 'ino': 1099511633507, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-9.c'}, {'damage_type': 'backtrace', 'id': 254959196, 'ino': 1099511633318, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-1.c'}, {'damage_type': 'backtrace', 'id': 260388998, 'ino': 1099511633461, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/README'}, {'damage_type': 'backtrace', 'id': 264677015, 'ino': 1099511633178, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-22.c'}, {'damage_type': 'backtrace', 'id': 271698814, 'ino': 1099511632680, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/2-1.c'}, {'damage_type': 'backtrace', 'id': 274241040, 'ino': 1099511633295, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-1.c'}, {'damage_type': 'backtrace', 'id': 296133907, 'ino': 1099511633340, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-8.c'}, {'damage_type': 'backtrace', 'id': 309785897, 'ino': 1099511633348, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-4.c'}, {'damage_type': 'backtrace', 'id': 323309250, 'ino': 1099511633130, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-11.c'}, {'damage_type': 'backtrace', 'id': 347885459, 'ino': 1099511633406, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-1.c'}, {'damage_type': 'backtrace', 'id': 386006307, 'ino': 1099511633401, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-99.c'}, {'damage_type': 'backtrace', 'id': 400528341, 'ino': 1099511633538, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-13.c'}, {'damage_type': 'backtrace', 'id': 401549911, 'ino': 1099511633476, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-6.c'}, {'damage_type': 'backtrace', 'id': 408082690, 'ino': 1099511633528, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-25.c'}, {'damage_type': 'backtrace', 'id': 409477822, 'ino': 1099511633393, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-91.c'}, {'damage_type': 'backtrace', 'id': 415778845, 'ino': 1099511633167, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-5.c'}, {'damage_type': 'backtrace', 'id': 417063233, 'ino': 1099511633310, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-6.c'}, {'damage_type': 'backtrace', 'id': 429554033, 'ino': 1099511631401, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_001.c'}, {'damage_type': 'backtrace', 'id': 442047100, 'ino': 1099511633384, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-30.c'}, {'damage_type': 'backtrace', 'id': 456036393, 'ino': 1099511633217, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-3.c'}, {'damage_type': 'backtrace', 'id': 458525684, 'ino': 1099511633158, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-5.c'}, {'damage_type': 'backtrace', 'id': 464936135, 'ino': 1099511633321, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-77.c'}, {'damage_type': 'backtrace', 'id': 467367426, 'ino': 1099511629643, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend04'}, {'damage_type': 'backtrace', 'id': 470456962, 'ino': 1099511633414, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-23.c'}, {'damage_type': 'backtrace', 'id': 486449821, 'ino': 1099511629656, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend14'}, {'damage_type': 'backtrace', 'id': 490095782, 'ino': 1099511633187, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-49.c'}, {'damage_type': 'backtrace', 'id': 502760094, 'ino': 1099511633360, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-22.c'}, {'damage_type': 'backtrace', 'id': 505620771, 'ino': 1099511629664, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend13'}, {'damage_type': 'backtrace', 'id': 515229585, 'ino': 1099511633128, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-14.c'}, {'damage_type': 'backtrace', 'id': 519198853, 'ino': 1099511632685, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/12-1.c'}, {'damage_type': 'backtrace', 'id': 521093504, 'ino': 1099511629641, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend06'}, {'damage_type': 'backtrace', 'id': 524858185, 'ino': 1099511629644, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend11'}, {'damage_type': 'backtrace', 'id': 525585516, 'ino': 1099511633502, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-10.c'}, {'damage_type': 'backtrace', 'id': 540000276, 'ino': 1099511633195, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-27.c'}, {'damage_type': 'backtrace', 'id': 557558853, 'ino': 1099511633209, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-9.c'}, {'damage_type': 'backtrace', 'id': 561145630, 'ino': 1099511633175, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-19.c'}, {'damage_type': 'backtrace', 'id': 568894542, 'ino': 1099511633003, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-1.sh'}, {'damage_type': 'backtrace', 'id': 581801549, 'ino': 1099511633526, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-7.c'}, {'damage_type': 'backtrace', 'id': 595833620, 'ino': 1099511633387, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-22.c'}, {'damage_type': 'backtrace', 'id': 611494159, 'ino': 1099511633542, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-18.c'}, {'damage_type': 'backtrace', 'id': 632477742, 'ino': 1099511633301, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-26.c'}, {'damage_type': 'backtrace', 'id': 655060223, 'ino': 1099511633326, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-15.c'}, {'damage_type': 'backtrace', 'id': 670085663, 'ino': 1099511633345, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-10.c'}, {'damage_type': 'backtrace', 'id': 679025240, 'ino': 1099511633438, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-25.c'}, {'damage_type': 'backtrace', 'id': 684131546, 'ino': 1099511633473, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-21.c'}, {'damage_type': 'backtrace', 'id': 687232469, 'ino': 1099511630489, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/Makefile'}, {'damage_type': 'backtrace', 'id': 691453857, 'ino': 1099511633505, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-95.c'}, {'damage_type': 'backtrace', 'id': 700192925, 'ino': 1099511633137, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-19.c'}, {'damage_type': 'backtrace', 'id': 700528940, 'ino': 1099511633359, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-50.c'}, {'damage_type': 'backtrace', 'id': 703279921, 'ino': 1099511633159, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-21.c'}, {'damage_type': 'backtrace', 'id': 718599954, 'ino': 1099511633008, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-2.sh'}, {'damage_type': 'backtrace', 'id': 719347346, 'ino': 1099511629661, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend05'}, {'damage_type': 'backtrace', 'id': 728311982, 'ino': 1099511633207, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-24.c'}, {'damage_type': 'backtrace', 'id': 742445485, 'ino': 1099511633115, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_1-1.in'}, {'damage_type': 'backtrace', 'id': 749775441, 'ino': 1099511633481, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-26.c'}, {'damage_type': 'backtrace', 'id': 762516883, 'ino': 1099511630167, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend12'}, {'damage_type': 'backtrace', 'id': 769904462, 'ino': 1099511633395, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-20.c'}, {'damage_type': 'backtrace', 'id': 778140313, 'ino': 1099511631402, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.in'}, {'damage_type': 'backtrace', 'id': 781688225, 'ino': 1099511633151, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-18.c'}, {'damage_type': 'backtrace', 'id': 782784999, 'ino': 1099511633452, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-8.c'}, {'damage_type': 'backtrace', 'id': 794018368, 'ino': 1099511633368, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-16.c'}, {'damage_type': 'backtrace', 'id': 804770831, 'ino': 1099511633131, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-48.c'}, {'damage_type': 'backtrace', 'id': 810357181, 'ino': 1099511633400, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-24.c'}, {'damage_type': 'backtrace', 'id': 819849583, 'ino': 1099511633305, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-2.c'}, {'damage_type': 'backtrace', 'id': 826622717, 'ino': 1099511633432, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-17.c'}, {'damage_type': 'backtrace', 'id': 827593982, 'ino': 1099511633165, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-81.c'}, {'damage_type': 'backtrace', 'id': 832225486, 'ino': 1099511633113, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_25-1.in'}, {'damage_type': 'backtrace', 'id': 852709335, 'ino': 1099511633199, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-4.c'}, {'damage_type': 'backtrace', 'id': 864591582, 'ino': 1099511633106, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_22-1.in'}, {'damage_type': 'backtrace', 'id': 871571599, 'ino': 1099511633200, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-20.c'}, {'damage_type': 'backtrace', 'id': 878414512, 'ino': 1099511633315, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-26.c'}, {'damage_type': 'backtrace', 'id': 903640203, 'ino': 1099511633533, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-93.c'}, {'damage_type': 'backtrace', 'id': 931881817, 'ino': 1099511633184, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-25.c'}, {'damage_type': 'backtrace', 'id': 952823653, 'ino': 1099511633334, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-1.c'}, {'damage_type': 'backtrace', 'id': 953871823, 'ino': 1099511633385, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-1.c'}, {'damage_type': 'backtrace', 'id': 966245799, 'ino': 1099511632734, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/assertions.xml'}, {'damage_type': 'backtrace', 'id': 980168810, 'ino': 1099511633450, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-42.c'}, {'damage_type': 'backtrace', 'id': 985064382, 'ino': 1099511632688, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/4-1.sh'}, {'damage_type': 'backtrace', 'id': 1008162973, 'ino': 1099511633463, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-3.c'}, {'damage_type': 'backtrace', 'id': 1014472199, 'ino': 1099511633309, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-11.c'}, {'damage_type': 'backtrace', 'id': 1035093230, 'ino': 1099511633313, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-18.c'}, {'damage_type': 'backtrace', 'id': 1051337602, 'ino': 1099511633353, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-23.c'}, {'damage_type': 'backtrace', 'id': 1055150152, 'ino': 1099511633537, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-17.c'}, {'damage_type': 'backtrace', 'id': 1061842932, 'ino': 1099511633096, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-21.c'}, {'damage_type': 'backtrace', 'id': 1063410775, 'ino': 1099511633425, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-30.c'}, {'damage_type': 'backtrace', 'id': 1078919924, 'ino': 1099511633138, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-4.c'}, {'damage_type': 'backtrace', 'id': 1111746378, 'ino': 1099511633306, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-21.c'}, {'damage_type': 'backtrace', 'id': 1112591544, 'ino': 1099511633322, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-3.c'}, {'damage_type': 'backtrace', 'id': 1116252532, 'ino': 1099511631399, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/thread_000.cpp'}, {'damage_type': 'backtrace', 'id': 1121277050, 'ino': 1099511633336, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-4.c'}, {'damage_type': 'backtrace', 'id': 1133530668, 'ino': 1099511629658, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend07'}, {'damage_type': 'backtrace', 'id': 1134034948, 'ino': 1099511633423, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-53.c'}, {'damage_type': 'backtrace', 'id': 1144360225, 'ino': 1099511633358, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-3.c'}, {'damage_type': 'backtrace', 'id': 1148885816, 'ino': 1099511633503, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-14.c'}, {'damage_type': 'backtrace', 'id': 1159292342, 'ino': 1099511633511, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-22.c'}, {'damage_type': 'backtrace', 'id': 1166053145, 'ino': 1099511629653, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend12'}, {'damage_type': 'backtrace', 'id': 1173477981, 'ino': 1099511633583, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-16.c'}, {'damage_type': 'backtrace', 'id': 1173758545, 'ino': 1099511633308, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-8.c'}, {'damage_type': 'backtrace', 'id': 1179056033, 'ino': 1099511633482, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-43.c'}, {'damage_type': 'backtrace', 'id': 1180697008, 'ino': 1099511632550, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/1-1.c'}, {'damage_type': 'backtrace', 'id': 1183081759, 'ino': 1099511633154, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-24.c'}, {'damage_type': 'backtrace', 'id': 1198584460, 'ino': 1099511633302, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-26.c'}, {'damage_type': 'backtrace', 'id': 1211122375, 'ino': 1099511629638, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend03'}, {'damage_type': 'backtrace', 'id': 1220062767, 'ino': 1099511633462, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-25.c'}, {'damage_type': 'backtrace', 'id': 1223263351, 'ino': 1099511633518, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-8.c'}, {'damage_type': 'backtrace', 'id': 1226149705, 'ino': 1099511633413, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-20.c'}, {'damage_type': 'backtrace', 'id': 1244564459, 'ino': 1099511633341, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-14.c'}, {'damage_type': 'backtrace', 'id': 1248320304, 'ino': 1099511633324, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-17.c'}, {'damage_type': 'backtrace', 'id': 1257044513, 'ino': 1099511633197, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-10.c'}, {'damage_type': 'backtrace', 'id': 1260900636, 'ino': 1099511633186, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-10.c'}, {'damage_type': 'backtrace', 'id': 1280106715, 'ino': 1099511633212, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-9.c'}, {'damage_type': 'backtrace', 'id': 1287942533, 'ino': 1099511633356, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-5.c'}, {'damage_type': 'backtrace', 'id': 1297458465, 'ino': 1099511633959, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-25.c'}, {'damage_type': 'backtrace', 'id': 1303271313, 'ino': 1099511633394, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-18.c'}, {'damage_type': 'backtrace', 'id': 1304969136, 'ino': 1099511633346, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-74.c'}, {'damage_type': 'backtrace', 'id': 1307224177, 'ino': 1099511633299, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-7.c'}, {'damage_type': 'backtrace', 'id': 1308953156, 'ino': 1099511633330, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-20.c'}, {'damage_type': 'backtrace', 'id': 1319235661, 'ino': 1099511632689, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/11-2.c'}, {'damage_type': 'backtrace', 'id': 1337556411, 'ino': 1099511633392, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-4.c'}, {'damage_type': 'backtrace', 'id': 1349729826, 'ino': 1099511629646, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/Makefile'}, {'damage_type': 'backtrace', 'id': 1359937115, 'ino': 1099511633333, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-11.c'}, {'damage_type': 'backtrace', 'id': 1360375194, 'ino': 1099511633534, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-14.c'}, {'damage_type': 'backtrace', 'id': 1375417738, 'ino': 1099511633002, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/coverage.txt'}, {'damage_type': 'backtrace', 'id': 1379402805, 'ino': 1099511633475, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-40.c'}, {'damage_type': 'backtrace', 'id': 1395320047, 'ino': 1099511633160, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-48.c'}, {'damage_type': 'backtrace', 'id': 1420818597, 'ino': 1099511633433, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-24.c'}, {'damage_type': 'backtrace', 'id': 1466031575, 'ino': 1099511629662, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend10'}, {'damage_type': 'backtrace', 'id': 1474069698, 'ino': 1099511633456, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-76.c'}, {'damage_type': 'backtrace', 'id': 1474409130, 'ino': 1099511633411, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-15.c'}, {'damage_type': 'backtrace', 'id': 1477031556, 'ino': 1099511633498, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-38.c'}, {'damage_type': 'backtrace', 'id': 1479425538, 'ino': 1099511633173, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-16.c'}, {'damage_type': 'backtrace', 'id': 1488684096, 'ino': 1099511633092, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-3.c'}, {'damage_type': 'backtrace', 'id': 1497457388, 'ino': 1099511633132, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-18.c'}, {'damage_type': 'backtrace', 'id': 1505853283, 'ino': 1099511633094, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-9.c'}, {'damage_type': 'backtrace', 'id': 1527718844, 'ino': 1099511633214, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-14.c'}, {'damage_type': 'backtrace', 'id': 1530262176, 'ino': 1099511633491, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-19.c'}, {'damage_type': 'backtrace', 'id': 1539249866, 'ino': 1099511633303, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-52.c'}, {'damage_type': 'backtrace', 'id': 1541848358, 'ino': 1099511633105, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-50.c'}, {'damage_type': 'backtrace', 'id': 1546664142, 'ino': 1099511633357, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-88.c'}, {'damage_type': 'backtrace', 'id': 1550560602, 'ino': 1099511633351, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-3.c'}, {'damage_type': 'backtrace', 'id': 1574122861, 'ino': 1099511630063, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/open_files.c'}, {'damage_type': 'backtrace', 'id': 1581282982, 'ino': 1099511629647, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend10'}, {'damage_type': 'backtrace', 'id': 1598744291, 'ino': 1099511633471, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-1.c'}, {'damage_type': 'backtrace', 'id': 1599873821, 'ino': 1099511633183, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-18.c'}, {'damage_type': 'backtrace', 'id': 1604787174, 'ino': 1099511633099, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-7.c'}, {'damage_type': 'backtrace', 'id': 1612379404, 'ino': 1099511633544, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/29-1.c'}, {'damage_type': 'backtrace', 'id': 1631138690, 'ino': 1099511633304, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-8.c'}, {'damage_type': 'backtrace', 'id': 1635838368, 'ino': 1099511633163, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-2.c'}, {'damage_type': 'backtrace', 'id': 1650532000, 'ino': 1099511631403, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/Makefile.am'}, {'damage_type': 'backtrace', 'id': 1657687256, 'ino': 1099511633488, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-7.c'}, {'damage_type': 'backtrace', 'id': 1680325110, 'ino': 1099511632684, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/assertions.xml'}, {'damage_type': 'backtrace', 'id': 1705365624, 'ino': 1099511633521, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-15.c'}, {'damage_type': 'backtrace', 'id': 1707315056, 'ino': 1099511633529, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-78.c'}, {'damage_type': 'backtrace', 'id': 1710147209, 'ino': 1099511633110, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-3.in'}, {'damage_type': 'backtrace', 'id': 1717685143, 'ino': 1099511633484, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-55.c'}, {'damage_type': 'backtrace', 'id': 1720541506, 'ino': 1099511633418, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-68.c'}, {'damage_type': 'backtrace', 'id': 1745028852, 'ino': 1099511633149, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-24.c'}, {'damage_type': 'backtrace', 'id': 1769055445, 'ino': 1099511633201, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-37.c'}, {'damage_type': 'backtrace', 'id': 1771889132, 'ino': 1099511633444, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-24.c'}, {'damage_type': 'backtrace', 'id': 1783677474, 'ino': 1099511629639, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend06'}, {'damage_type': 'backtrace', 'id': 1784224274, 'ino': 1099511633390, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-16.c'}, {'damage_type': 'backtrace', 'id': 1798130113, 'ino': 1099511632604, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/net_cmdlib.sh'}, {'damage_type': 'backtrace', 'id': 1806205043, 'ino': 1099511633145, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-10.c'}, {'damage_type': 'backtrace', 'id': 1817640198, 'ino': 1099511633398, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-17.c'}, {'damage_type': 'backtrace', 'id': 1828586864, 'ino': 1099511633381, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-41.c'}, {'damage_type': 'backtrace', 'id': 1834023316, 'ino': 1099511633331, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-5.c'}, {'damage_type': 'backtrace', 'id': 1837500136, 'ino': 1099511629637, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend09'}, {'damage_type': 'backtrace', 'id': 1837823245, 'ino': 1099511633540, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-104.c'}, {'damage_type': 'backtrace', 'id': 1844656278, 'ino': 1099511633152, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-8.c'}, {'damage_type': 'backtrace', 'id': 1845309852, 'ino': 1099511633495, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-7.c'}, {'damage_type': 'backtrace', 'id': 1858988750, 'ino': 1099511633342, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-26.c'}, {'damage_type': 'backtrace', 'id': 1859155087, 'ino': 1099511633522, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-13.c'}, {'damage_type': 'backtrace', 'id': 1873674541, 'ino': 1099511633467, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-6.c'}, {'damage_type': 'backtrace', 'id': 1881359921, 'ino': 1099511633338, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-4.c'}, {'damage_type': 'backtrace', 'id': 1898231780, 'ino': 1099511633376, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-18.c'}, {'damage_type': 'backtrace', 'id': 1912029712, 'ino': 1099511633496, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-11.c'}, {'damage_type': 'backtrace', 'id': 1924074299, 'ino': 1099511633176, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-17.c'}, {'damage_type': 'backtrace', 'id': 1930742324, 'ino': 1099511633391, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-17.c'}, {'damage_type': 'backtrace', 'id': 1936240834, 'ino': 1099511633316, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-16.c'}, {'damage_type': 'backtrace', 'id': 1939015060, 'ino': 1099511633457, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-10.c'}, {'damage_type': 'backtrace', 'id': 1939411761, 'ino': 1099511633375, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-7.c'}, {'damage_type': 'backtrace', 'id': 1953840413, 'ino': 1099511633103, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-16.c'}, {'damage_type': 'backtrace', 'id': 1956143567, 'ino': 1099511632735, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/3-1.sh'}, {'damage_type': 'backtrace', 'id': 1960722944, 'ino': 1099511633585, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_28-1.in'}, {'damage_type': 'backtrace', 'id': 1977762577, 'ino': 1099511633142, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-3.c'}, {'damage_type': 'backtrace', 'id': 1981523641, 'ino': 1099511633220, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-14.c'}, {'damage_type': 'backtrace', 'id': 1992402197, 'ino': 1099511633135, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-20.c'}, {'damage_type': 'backtrace', 'id': 2013587040, 'ino': 1099511633441, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-8.c'}, {'damage_type': 'backtrace', 'id': 2026352113, 'ino': 1099511633442, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-61.c'}, {'damage_type': 'backtrace', 'id': 2042664070, 'ino': 1099511633344, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-9.c'}, {'damage_type': 'backtrace', 'id': 2042728035, 'ino': 1099511633362, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-11.c'}, {'damage_type': 'backtrace', 'id': 2050503369, 'ino': 1099511633536, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-5.c'}, {'damage_type': 'backtrace', 'id': 2050801459, 'ino': 1099511633527, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-6.c'}, {'damage_type': 'backtrace', 'id': 2066257023, 'ino': 1099511628898, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_err_svcerr_progvers/assertions.xml'}, {'damage_type': 'backtrace', 'id': 2069379186, 'ino': 1099511633489, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-18.c'}, {'damage_type': 'backtrace', 'id': 2071574575, 'ino': 1099511633093, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-14.c'}, {'damage_type': 'backtrace', 'id': 2076732309, 'ino': 1099511633519, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-16.c'}, {'damage_type': 'backtrace', 'id': 2081043447, 'ino': 1099511633434, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-4.c'}, {'damage_type': 'backtrace', 'id': 2081289650, 'ino': 1099511633439, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-18.c'}, {'damage_type': 'backtrace', 'id': 2081877437, 'ino': 1099511633412, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-23.c'}, {'damage_type': 'backtrace', 'id': 2116826609, 'ino': 1099511633492, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-9.c'}, {'damage_type': 'backtrace', 'id': 2119351349, 'ino': 1099511633466, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-24.c'}, {'damage_type': 'backtrace', 'id': 2121971888, 'ino': 1099511629663, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend08'}, {'damage_type': 'backtrace', 'id': 2131724851, 'ino': 1099511633004, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-core-buildonly.c'}, {'damage_type': 'backtrace', 'id': 2138133212, 'ino': 1099511633478, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-58.c'}, {'damage_type': 'backtrace', 'id': 2151483382, 'ino': 1099511633474, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-19.c'}, {'damage_type': 'backtrace', 'id': 2152905463, 'ino': 1099511631713, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/test.h'}, {'damage_type': 'backtrace', 'id': 2168641247, 'ino': 1099511633435, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-97.c'}, {'damage_type': 'backtrace', 'id': 2169534480, 'ino': 1099511633347, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-20.c'}, {'damage_type': 'backtrace', 'id': 2179675705, 'ino': 1099511633300, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-102.c'}, {'damage_type': 'backtrace', 'id': 2201741412, 'ino': 1099511633446, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-84.c'}, {'damage_type': 'backtrace', 'id': 2214296255, 'ino': 1099511632551, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/assertions.xml'}, {'damage_type': 'backtrace', 'id': 2221439596, 'ino': 1099511629640, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend11'}, {'damage_type': 'backtrace', 'id': 2221512717, 'ino': 1099511633296, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-19.c'}, {'damage_type': 'backtrace', 'id': 2223875508, 'ino': 1099511629654, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend01'}, {'damage_type': 'backtrace', 'id': 2237090324, 'ino': 1099511633156, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-16.c'}, {'damage_type': 'backtrace', 'id': 2240231999, 'ino': 1099511633114, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_19-1.in'}, {'damage_type': 'backtrace', 'id': 2241897442, 'ino': 1099511630062, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/nfs/nfs01/nfs01'}, {'damage_type': 'backtrace', 'id': 2244803520, 'ino': 1099511633116, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-4.in'}, {'damage_type': 'backtrace', 'id': 2265154197, 'ino': 1099511633297, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-21.c'}, {'damage_type': 'backtrace', 'id': 2276220756, 'ino': 1099511633210, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-16.c'}, {'damage_type': 'backtrace', 'id': 2281937414, 'ino': 1099511633311, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-12.c'}, {'damage_type': 'backtrace', 'id': 2283004789, 'ino': 1099511633141, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-1.c'}, {'damage_type': 'backtrace', 'id': 2300423344, 'ino': 1099511633098, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-24.c'}, {'damage_type': 'backtrace', 'id': 2300893861, 'ino': 1099511633497, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-7.c'}, {'damage_type': 'backtrace', 'id': 2311819854, 'ino': 1099511633100, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-79.c'}, {'damage_type': 'backtrace', 'id': 2323061879, 'ino': 1099511633429, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-17.c'}, {'damage_type': 'backtrace', 'id': 2328686070, 'ino': 1099511633523, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/21-1.c'}, {'damage_type': 'backtrace', 'id': 2342117801, 'ino': 1099511633514, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-1.c'}, {'damage_type': 'backtrace', 'id': 2349505133, 'ino': 1099511633545, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-12.c'}, {'damage_type': 'backtrace', 'id': 2349645865, 'ino': 1099511633005, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/assertions.xml'}, {'damage_type': 'backtrace', 'id': 2361951593, 'ino': 1099511633123, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-2.in'}, {'damage_type': 'backtrace', 'id': 2381569839, 'ino': 1099511633329, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/coverage.txt'}, {'damage_type': 'backtrace', 'id': 2389396501, 'ino': 1099511633307, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-16.c'}, {'damage_type': 'backtrace', 'id': 2399147752, 'ino': 1099511633437, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-15.c'}, {'damage_type': 'backtrace', 'id': 2401816082, 'ino': 1099511633224, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/9-1.sh'}, {'damage_type': 'backtrace', 'id': 2403544808, 'ino': 1099511633185, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-23.c'}, {'damage_type': 'backtrace', 'id': 2410703995, 'ino': 1099511633426, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-28.c'}, {'damage_type': 'backtrace', 'id': 2410942576, 'ino': 1099511633469, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-63.c'}, {'damage_type': 'backtrace', 'id': 2416154645, 'ino': 1099511633107, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_2-1.in'}, {'damage_type': 'backtrace', 'id': 2423133039, 'ino': 1099511633417, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-1.c'}, {'damage_type': 'backtrace', 'id': 2424340606, 'ino': 1099511633509, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-17.c'}, {'damage_type': 'backtrace', 'id': 2434003144, 'ino': 1099511633402, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-23.c'}, {'damage_type': 'backtrace', 'id': 2450328802, 'ino': 1099511633428, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-16.c'}, {'damage_type': 'backtrace', 'id': 2457950022, 'ino': 1099511633146, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-44.c'}, {'damage_type': 'backtrace', 'id': 2461294499, 'ino': 1099511633125, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-28.c'}, {'damage_type': 'backtrace', 'id': 2481211711, 'ino': 1099511633164, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-15.c'}, {'damage_type': 'backtrace', 'id': 2487533669, 'ino': 1099511633512, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-22.c'}, {'damage_type': 'backtrace', 'id': 2489010017, 'ino': 1099511633361, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-4.c'}, {'damage_type': 'backtrace', 'id': 2491032378, 'ino': 1099511633510, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-15.c'}, {'damage_type': 'backtrace', 'id': 2491344686, 'ino': 1099511633493, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-25.c'}, {'damage_type': 'backtrace', 'id': 2493088327, 'ino': 1099511633001, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/5-3.sh'}, {'damage_type': 'backtrace', 'id': 2497072524, 'ino': 1099511633500, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-82.c'}, {'damage_type': 'backtrace', 'id': 2504436913, 'ino': 1099511632681, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/5-1.c'}, {'damage_type': 'backtrace', 'id': 2511468015, 'ino': 1099511633397, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-7.c'}, {'damage_type': 'backtrace', 'id': 2518115251, 'ino': 1099511633455, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-70.c'}, {'damage_type': 'backtrace', 'id': 2543119303, 'ino': 1099511633460, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-11.c'}, {'damage_type': 'backtrace', 'id': 2544477007, 'ino': 1099511633101, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-11.c'}, {'damage_type': 'backtrace', 'id': 2556411457, 'ino': 1099511633182, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/10-1.c'}, {'damage_type': 'backtrace', 'id': 2571041425, 'ino': 1099511633389, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-12.c'}, {'damage_type': 'backtrace', 'id': 2571569560, 'ino': 1099511632687, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/13-1.c'}, {'damage_type': 'backtrace', 'id': 2573340603, 'ino': 1099511633126, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-6.c'}, {'damage_type': 'backtrace', 'id': 2584315388, 'ino': 1099511633470, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-9.c'}, {'damage_type': 'backtrace', 'id': 2592766702, 'ino': 1099511633541, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-20.c'}, {'damage_type': 'backtrace', 'id': 2599373714, 'ino': 1099511633386, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-26.c'}, {'damage_type': 'backtrace', 'id': 2611428536, 'ino': 1099511632690, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/11-1.c'}, {'damage_type': 'backtrace', 'id': 2625918341, 'ino': 1099511633143, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-45.c'}, {'damage_type': 'backtrace', 'id': 2631099771, 'ino': 1099511632733, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/1-1.c'}, {'damage_type': 'backtrace', 'id': 2661354960, 'ino': 1099511633490, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-12.c'}, {'damage_type': 'backtrace', 'id': 2668205134, 'ino': 1099511633134, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-20.c'}, {'damage_type': 'backtrace', 'id': 2674654691, 'ino': 1099511633127, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-22.c'}, {'damage_type': 'backtrace', 'id': 2689586889, 'ino': 1099511633213, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-16.c'}, {'damage_type': 'backtrace', 'id': 2689748784, 'ino': 1099511633352, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-13.c'}, {'damage_type': 'backtrace', 'id': 2699329866, 'ino': 1099511633327, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-2.c'}, {'damage_type': 'backtrace', 'id': 2700262486, 'ino': 1099511633516, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-23.c'}, {'damage_type': 'backtrace', 'id': 2704604042, 'ino': 1099511633371, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-2.c'}, {'damage_type': 'backtrace', 'id': 2726531873, 'ino': 1099511633584, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates'}, {'damage_type': 'backtrace', 'id': 2727291553, 'ino': 1099511633431, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-36.c'}, {'damage_type': 'backtrace', 'id': 2776120939, 'ino': 1099511633218, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-24.c'}, {'damage_type': 'backtrace', 'id': 2789527348, 'ino': 1099511633508, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-17.c'}, {'damage_type': 'backtrace', 'id': 2792215290, 'ino': 1099511633171, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-2.c'}, {'damage_type': 'backtrace', 'id': 2793660686, 'ino': 1099511633216, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-27.c'}, {'damage_type': 'backtrace', 'id': 2796952112, 'ino': 1099511633174, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-23.c'}, {'damage_type': 'backtrace', 'id': 2817789576, 'ino': 1099511629665, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend09'}, {'damage_type': 'backtrace', 'id': 2831196032, 'ino': 1099511633520, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-13.c'}, {'damage_type': 'backtrace', 'id': 2836249882, 'ino': 1099511633451, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-26.c'}, {'damage_type': 'backtrace', 'id': 2864393982, 'ino': 1099511633168, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-21.c'}, {'damage_type': 'backtrace', 'id': 2882340081, 'ino': 1099511633139, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-15.c'}, {'damage_type': 'backtrace', 'id': 2883114248, 'ino': 1099511633097, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-39.c'}, {'damage_type': 'backtrace', 'id': 2884488956, 'ino': 1099511632678, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/10-1.c'}, {'damage_type': 'backtrace', 'id': 2892349077, 'ino': 1099511633111, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_13-1.in'}, {'damage_type': 'backtrace', 'id': 2898729112, 'ino': 1099511633150, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-103.c'}, {'damage_type': 'backtrace', 'id': 2908383912, 'ino': 1099511633499, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/assertions.xml'}, {'damage_type': 'backtrace', 'id': 2926264322, 'ino': 1099511633374, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 2926315469, 'ino': 1099511633535, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-7.c'}, {'damage_type': 'backtrace', 'id': 2928923254, 'ino': 1099511633399, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-17.c'}, {'damage_type': 'backtrace', 'id': 2938336825, 'ino': 1099511633109, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_16-1.in'}, {'damage_type': 'backtrace', 'id': 2951510994, 'ino': 1099511633524, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-26.c'}, {'damage_type': 'backtrace', 'id': 2956504769, 'ino': 1099511633203, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-36.c'}, {'damage_type': 'backtrace', 'id': 2962843916, 'ino': 1099511633343, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-2.c'}, {'damage_type': 'backtrace', 'id': 2976976046, 'ino': 1099511633465, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-11.c'}, {'damage_type': 'backtrace', 'id': 2983222433, 'ino': 1099511633494, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-18.c'}, {'damage_type': 'backtrace', 'id': 2984108916, 'ino': 1099511633112, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_3-1.in'}, {'damage_type': 'backtrace', 'id': 2984427843, 'ino': 1099511633332, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-22.c'}, {'damage_type': 'backtrace', 'id': 3031667472, 'ino': 1099511633104, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-6.c'}, {'damage_type': 'backtrace', 'id': 3032225990, 'ino': 1099511633419, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-8.c'}, {'damage_type': 'backtrace', 'id': 3037441571, 'ino': 1099511632683, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/8-1.c'}, {'damage_type': 'backtrace', 'id': 3038256765, 'ino': 1099511633464, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-92.c'}, {'damage_type': 'backtrace', 'id': 3041752453, 'ino': 1099511633378, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-20.c'}, {'damage_type': 'backtrace', 'id': 3042049159, 'ino': 1099511633339, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-25.c'}, {'damage_type': 'backtrace', 'id': 3050483260, 'ino': 1099511633189, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-12.c'}, {'damage_type': 'backtrace', 'id': 3069644485, 'ino': 1099511633539, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-37.c'}, {'damage_type': 'backtrace', 'id': 3079978631, 'ino': 1099511633121, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-1.in'}, {'damage_type': 'backtrace', 'id': 3086267621, 'ino': 1099511633188, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-11.c'}, {'damage_type': 'backtrace', 'id': 3088374064, 'ino': 1099511633445, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-9.c'}, {'damage_type': 'backtrace', 'id': 3092419935, 'ino': 1099511633377, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-23.c'}, {'damage_type': 'backtrace', 'id': 3097290369, 'ino': 1099511633170, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-24.c'}, {'damage_type': 'backtrace', 'id': 3101188046, 'ino': 1099511632732, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/2-1.c'}, {'damage_type': 'backtrace', 'id': 3101678067, 'ino': 1099511633422, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-12.c'}, {'damage_type': 'backtrace', 'id': 3111181630, 'ino': 1099511633448, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-80.c'}, {'damage_type': 'backtrace', 'id': 3112656771, 'ino': 1099511633242, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_destroy/coverage.txt'}, {'damage_type': 'backtrace', 'id': 3126712744, 'ino': 1099511633403, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-23.c'}, {'damage_type': 'backtrace', 'id': 3134383212, 'ino': 1099511633454, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-16.c'}, {'damage_type': 'backtrace', 'id': 3140028689, 'ino': 1099511633480, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-5.c'}, {'damage_type': 'backtrace', 'id': 3144920516, 'ino': 1099511633421, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-2.c'}, {'damage_type': 'backtrace', 'id': 3161784732, 'ino': 1099511633215, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-5.c'}, {'damage_type': 'backtrace', 'id': 3163560605, 'ino': 1099511633388, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-10.c'}, {'damage_type': 'backtrace', 'id': 3167578604, 'ino': 1099511630796, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/cases.sh'}, {'damage_type': 'backtrace', 'id': 3174369831, 'ino': 1099511633370, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-98.c'}, {'damage_type': 'backtrace', 'id': 3188104163, 'ino': 1099511633479, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-19.c'}, {'damage_type': 'backtrace', 'id': 3202339149, 'ino': 1099511633396, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-14.c'}, {'damage_type': 'backtrace', 'id': 3203290516, 'ino': 1099511633530, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/23-6.c'}, {'damage_type': 'backtrace', 'id': 3211017219, 'ino': 1099511633335, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-8.c'}, {'damage_type': 'backtrace', 'id': 3212710981, 'ino': 1099511633153, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-26.c'}, {'damage_type': 'backtrace', 'id': 3237382264, 'ino': 1099511633124, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_12-2.in'}, {'damage_type': 'backtrace', 'id': 3251932577, 'ino': 1099511633196, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-19.c'}, {'damage_type': 'backtrace', 'id': 3270208492, 'ino': 1099511633449, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-20.c'}, {'damage_type': 'backtrace', 'id': 3276025688, 'ino': 1099511633367, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-1.c'}, {'damage_type': 'backtrace', 'id': 3282195804, 'ino': 1099511633206, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/gentests.pl'}, {'damage_type': 'backtrace', 'id': 3288451007, 'ino': 1099511633447, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-17.c'}, {'damage_type': 'backtrace', 'id': 3304283300, 'ino': 1099511633147, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/9-1.c'}, {'damage_type': 'backtrace', 'id': 3305490382, 'ino': 1099511633194, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-22.c'}, {'damage_type': 'backtrace', 'id': 3309196990, 'ino': 1099511629651, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend14'}, {'damage_type': 'backtrace', 'id': 3321570025, 'ino': 1099511633208, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-7.c'}, {'damage_type': 'backtrace', 'id': 3328501644, 'ino': 1099511633119, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_6-1.in'}, {'damage_type': 'backtrace', 'id': 3346362031, 'ino': 1099511633312, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-94.c'}, {'damage_type': 'backtrace', 'id': 3347948103, 'ino': 1099511632552, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/2-1.sh'}, {'damage_type': 'backtrace', 'id': 3373446444, 'ino': 1099511632927, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_rwlockattr_setpshared/coverage.txt'}, {'damage_type': 'backtrace', 'id': 3378286016, 'ino': 1099511633298, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-25.c'}, {'damage_type': 'backtrace', 'id': 3394351490, 'ino': 1099511633532, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-5.c'}, {'damage_type': 'backtrace', 'id': 3406145894, 'ino': 1099511633416, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-19.c'}, {'damage_type': 'backtrace', 'id': 3413992534, 'ino': 1099511633440, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-12.c'}, {'damage_type': 'backtrace', 'id': 3423099762, 'ino': 1099511633117, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_8-1.in'}, {'damage_type': 'backtrace', 'id': 3423723313, 'ino': 1099511633549, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/3-1.c'}, {'damage_type': 'backtrace', 'id': 3435282521, 'ino': 1099511633122, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_18-1.in'}, {'damage_type': 'backtrace', 'id': 3442102438, 'ino': 1099511631400, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/sensor_factors_000.cpp'}, {'damage_type': 'backtrace', 'id': 3490143994, 'ino': 1099511633169, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-7.c'}, {'damage_type': 'backtrace', 'id': 3518580596, 'ino': 1099511633369, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-22.c'}, {'damage_type': 'backtrace', 'id': 3520670548, 'ino': 1099511633314, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-17.c'}, {'damage_type': 'backtrace', 'id': 3532848726, 'ino': 1099511633405, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-49.c'}, {'damage_type': 'backtrace', 'id': 3547939441, 'ino': 1099511633506, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-15.c'}, {'damage_type': 'backtrace', 'id': 3552328927, 'ino': 1099511633180, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-26.c'}, {'damage_type': 'backtrace', 'id': 3566470566, 'ino': 1099511633192, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-8.c'}, {'damage_type': 'backtrace', 'id': 3568044015, 'ino': 1099511633354, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-26.c'}, {'damage_type': 'backtrace', 'id': 3593763071, 'ino': 1099511632087, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/lib/cmdlib.sh'}, {'damage_type': 'backtrace', 'id': 3606199885, 'ino': 1099511633325, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-87.c'}, {'damage_type': 'backtrace', 'id': 3613760022, 'ino': 1099511633487, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-16.c'}, {'damage_type': 'backtrace', 'id': 3632451484, 'ino': 1099511633363, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-23.c'}, {'damage_type': 'backtrace', 'id': 3636319117, 'ino': 1099511633204, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-20.c'}, {'damage_type': 'backtrace', 'id': 3644238808, 'ino': 1099511633366, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-4.c'}, {'damage_type': 'backtrace', 'id': 3698087167, 'ino': 1099511633118, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_17-1.in'}, {'damage_type': 'backtrace', 'id': 3724018435, 'ino': 1099511633144, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-15.c'}, {'damage_type': 'backtrace', 'id': 3732575776, 'ino': 1099511633443, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-40.c'}, {'damage_type': 'backtrace', 'id': 3742559131, 'ino': 1099511633485, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/1-25.c'}, {'damage_type': 'backtrace', 'id': 3775402154, 'ino': 1099511633436, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-101.c'}, {'damage_type': 'backtrace', 'id': 3784450872, 'ino': 1099511633477, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-12.c'}, {'damage_type': 'backtrace', 'id': 3785506343, 'ino': 1099511633211, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-24.c'}, {'damage_type': 'backtrace', 'id': 3792425915, 'ino': 1099511633372, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-2.c'}, {'damage_type': 'backtrace', 'id': 3794221866, 'ino': 1099511633504, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-8.c'}, {'damage_type': 'backtrace', 'id': 3796072709, 'ino': 1099511629652, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend13'}, {'damage_type': 'backtrace', 'id': 3812476747, 'ino': 1099511633408, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-100.c'}, {'damage_type': 'backtrace', 'id': 3813786271, 'ino': 1099511633102, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-44.c'}, {'damage_type': 'backtrace', 'id': 3815936911, 'ino': 1099511633486, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-31.c'}, {'damage_type': 'backtrace', 'id': 3824746270, 'ino': 1099511629649, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/00_Descriptions.txt'}, {'damage_type': 'backtrace', 'id': 3839058402, 'ino': 1099511633517, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-51.c'}, {'damage_type': 'backtrace', 'id': 3861427370, 'ino': 1099511633350, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-25.c'}, {'damage_type': 'backtrace', 'id': 3889185977, 'ino': 1099511629642, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend07'}, {'damage_type': 'backtrace', 'id': 3905962413, 'ino': 1099511633410, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-9.c'}, {'damage_type': 'backtrace', 'id': 3910276750, 'ino': 1099511633415, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/22-25.c'}, {'damage_type': 'backtrace', 'id': 3919727727, 'ino': 1099511633323, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/28-15.c'}, {'damage_type': 'backtrace', 'id': 3936082566, 'ino': 1099511633427, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/3-22.c'}, {'damage_type': 'backtrace', 'id': 3951665802, 'ino': 1099511633355, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-2.c'}, {'damage_type': 'backtrace', 'id': 3997812895, 'ino': 1099511632682, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/1-1.c'}, {'damage_type': 'backtrace', 'id': 4012591090, 'ino': 1099511633525, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-86.c'}, {'damage_type': 'backtrace', 'id': 4019514503, 'ino': 1099511633095, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-25.c'}, {'damage_type': 'backtrace', 'id': 4022102389, 'ino': 1099511632686, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/7-1.c'}, {'damage_type': 'backtrace', 'id': 4028565626, 'ino': 1099511633453, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/17-21.c'}, {'damage_type': 'backtrace', 'id': 4028949317, 'ino': 1099511629577, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_err_svcerr_progvers/1-basic.c'}, {'damage_type': 'backtrace', 'id': 4040713143, 'ino': 1099511632679, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/mq_receive/coverage.txt'}, {'damage_type': 'backtrace', 'id': 4041061634, 'ino': 1099511633424, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-69.c'}, {'damage_type': 'backtrace', 'id': 4045785199, 'ino': 1099511633319, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-71.c'}, {'damage_type': 'backtrace', 'id': 4057573661, 'ino': 1099511633317, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-9.c'}, {'damage_type': 'backtrace', 'id': 4075056154, 'ino': 1099511633133, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-46.c'}, {'damage_type': 'backtrace', 'id': 4076203695, 'ino': 1099511633172, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-46.c'}, {'damage_type': 'backtrace', 'id': 4077102898, 'ino': 1099511633430, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-62.c'}, {'damage_type': 'backtrace', 'id': 4081731860, 'ino': 1099511633161, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-12.c'}, {'damage_type': 'backtrace', 'id': 4082468538, 'ino': 1099511633337, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/12-19.c'}, {'damage_type': 'backtrace', 'id': 4083818262, 'ino': 1099511633166, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-22.c'}, {'damage_type': 'backtrace', 'id': 4086036678, 'ino': 1099511633459, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-7.c'}, {'damage_type': 'backtrace', 'id': 4109155981, 'ino': 1099511633515, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-7.c'}, {'damage_type': 'backtrace', 'id': 4111661333, 'ino': 1099511633108, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_23-1.in'}, {'damage_type': 'backtrace', 'id': 4112169000, 'ino': 1099511633162, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-60.c'}, {'damage_type': 'backtrace', 'id': 4124540435, 'ino': 1099511633136, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/16-5.c'}, {'damage_type': 'backtrace', 'id': 4132199362, 'ino': 1099511630794, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/mce-test/cases/soft-inj/panic_npcc/data'}, {'damage_type': 'backtrace', 'id': 4157717340, 'ino': 1099511633364, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-33.c'}, {'damage_type': 'backtrace', 'id': 4160853021, 'ino': 1099511633120, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/templates/template_4-1.in'}, {'damage_type': 'backtrace', 'id': 4166024680, 'ino': 1099511633379, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-31.c'}, {'damage_type': 'backtrace', 'id': 4169299889, 'ino': 1099511629660, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend03'}, {'damage_type': 'backtrace', 'id': 4170815250, 'ino': 1099511633468, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/2-18.c'}, {'damage_type': 'backtrace', 'id': 4173586791, 'ino': 1099511633407, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-13.c'}, {'damage_type': 'backtrace', 'id': 4182084396, 'ino': 1099511631398, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/plugins/ipmidirect/t/con_000.cpp'}, {'damage_type': 'backtrace', 'id': 4182173127, 'ino': 1099511633543, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/13-3.c'}, {'damage_type': 'backtrace', 'id': 4186062142, 'ino': 1099511633190, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/25-13.c'}, {'damage_type': 'backtrace', 'id': 4188618891, 'ino': 1099511633420, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-21.c'}, {'damage_type': 'backtrace', 'id': 4197497846, 'ino': 1099511633380, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-25.c'}, {'damage_type': 'backtrace', 'id': 4197861130, 'ino': 1099511629648, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp4-uni-smallsend02'}, {'damage_type': 'backtrace', 'id': 4213144756, 'ino': 1099511633006, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigismember/4-1.c'}, {'damage_type': 'backtrace', 'id': 4243840664, 'ino': 1099511633140, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/19-7.c'}, {'damage_type': 'backtrace', 'id': 4250222305, 'ino': 1099511633129, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-89.c'}, {'damage_type': 'backtrace', 'id': 4265907456, 'ino': 1099511633179, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/4-67.c'}, {'damage_type': 'backtrace', 'id': 4273073955, 'ino': 1099511633328, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/18-18.c'}, {'damage_type': 'backtrace', 'id': 4278693174, 'ino': 1099511633404, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/6-10.c'}, {'damage_type': 'backtrace', 'id': 4279298174, 'ino': 1099511629650, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-smallsend/tcp6-uni-smallsend04'}, {'damage_type': 'backtrace', 'id': 4282020885, 'ino': 1099511633219, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sigaction/8-13.c'}] 2024-01-25T15:04:07.930 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 5273434, 'ino': 1099511628933, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_svc_create.sh'}, {'damage_type': 'backtrace', 'id': 7550098, 'ino': 1099511629479, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff07'}, {'damage_type': 'backtrace', 'id': 27010612, 'ino': 1099511629732, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff11'}, {'damage_type': 'backtrace', 'id': 44357674, 'ino': 1099511632669, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 44491231, 'ino': 1099511629106, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getaddr.limits.sh'}, {'damage_type': 'backtrace', 'id': 45052796, 'ino': 1099511631199, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_003.c'}, {'damage_type': 'backtrace', 'id': 47296528, 'ino': 1099511628954, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.complex.sh'}, {'damage_type': 'backtrace', 'id': 51573869, 'ino': 1099511629751, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff12'}, {'damage_type': 'backtrace', 'id': 135062174, 'ino': 1099511632724, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/coverage.txt'}, {'damage_type': 'backtrace', 'id': 146060236, 'ino': 1099511629461, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff06'}, {'damage_type': 'backtrace', 'id': 148381277, 'ino': 1099511629467, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff03'}, {'damage_type': 'backtrace', 'id': 150540033, 'ino': 1099511629434, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld01'}, {'damage_type': 'backtrace', 'id': 172163220, 'ino': 1099511629742, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff14'}, {'damage_type': 'backtrace', 'id': 184913300, 'ino': 1099511629748, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff03'}, {'damage_type': 'backtrace', 'id': 213367624, 'ino': 1099511629436, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/Makefile'}, {'damage_type': 'backtrace', 'id': 227663278, 'ino': 1099511629112, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.performance.sh'}, {'damage_type': 'backtrace', 'id': 228836157, 'ino': 1099511629046, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.sh'}, {'damage_type': 'backtrace', 'id': 236172206, 'ino': 1099511629477, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff05'}, {'damage_type': 'backtrace', 'id': 253456766, 'ino': 1099511629042, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.mt.sh'}, {'damage_type': 'backtrace', 'id': 254987797, 'ino': 1099511628943, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_control.limits.sh'}, {'damage_type': 'backtrace', 'id': 269084156, 'ino': 1099511629001, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.performance.sh'}, {'damage_type': 'backtrace', 'id': 271771845, 'ino': 1099511631197, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_010.c'}, {'damage_type': 'backtrace', 'id': 289214094, 'ino': 1099511628995, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.performance.sh'}, {'damage_type': 'backtrace', 'id': 328460906, 'ino': 1099511629068, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_sendreply.sh'}, {'damage_type': 'backtrace', 'id': 332627722, 'ino': 1099511629028, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.complex.sh'}, {'damage_type': 'backtrace', 'id': 352225302, 'ino': 1099511628942, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_create.sh'}, {'damage_type': 'backtrace', 'id': 361561204, 'ino': 1099511639987, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/tmp.rygrP0nesr/p2/d10/d1e/d32/d3e/d41/c45'}, {'damage_type': 'backtrace', 'id': 388607905, 'ino': 1099511629091, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.stress.sh'}, {'damage_type': 'backtrace', 'id': 410157234, 'ino': 1099511632727, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/2-1.c'}, {'damage_type': 'backtrace', 'id': 411393094, 'ino': 1099511629073, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_vc_create.limits.sh'}, {'damage_type': 'backtrace', 'id': 412573637, 'ino': 1099511628906, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_stdcall_svc_getcaller/assertions.xml'}, {'damage_type': 'backtrace', 'id': 451733142, 'ino': 1099511628959, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.stress.sh'}, {'damage_type': 'backtrace', 'id': 459485190, 'ino': 1099511629746, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff04'}, {'damage_type': 'backtrace', 'id': 467345034, 'ino': 1099511629480, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff11'}, {'damage_type': 'backtrace', 'id': 480389684, 'ino': 1099511629089, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.performance.sh'}, {'damage_type': 'backtrace', 'id': 531794901, 'ino': 1099511628973, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.sh'}, {'damage_type': 'backtrace', 'id': 533238117, 'ino': 1099511629009, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.sh'}, {'damage_type': 'backtrace', 'id': 534818901, 'ino': 1099511629587, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_stdcall_svc_getcaller/1-basic.c'}, {'damage_type': 'backtrace', 'id': 536973695, 'ino': 1099511631207, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/Makefile.am'}, {'damage_type': 'backtrace', 'id': 547371054, 'ino': 1099511629729, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff08'}, {'damage_type': 'backtrace', 'id': 554924317, 'ino': 1099511628978, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.stress.sh'}, {'damage_type': 'backtrace', 'id': 569880408, 'ino': 1099511629093, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_sperrno.sh'}, {'damage_type': 'backtrace', 'id': 584849250, 'ino': 1099511629076, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_registerrpc.sh'}, {'damage_type': 'backtrace', 'id': 589458577, 'ino': 1099511629749, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff07'}, {'damage_type': 'backtrace', 'id': 595830683, 'ino': 1099511631194, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_009.c'}, {'damage_type': 'backtrace', 'id': 597063425, 'ino': 1099511629484, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff14'}, {'damage_type': 'backtrace', 'id': 603850565, 'ino': 1099511631206, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_004.c'}, {'damage_type': 'backtrace', 'id': 603959906, 'ino': 1099511628975, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_tli_create.limits.sh'}, {'damage_type': 'backtrace', 'id': 617552688, 'ino': 1099511631204, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_011.c'}, {'damage_type': 'backtrace', 'id': 629096775, 'ino': 1099511629283, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.mt.sh'}, {'damage_type': 'backtrace', 'id': 631673950, 'ino': 1099511628997, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.complex.sh'}, {'damage_type': 'backtrace', 'id': 640302809, 'ino': 1099511631201, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_000.c'}, {'damage_type': 'backtrace', 'id': 655018214, 'ino': 1099511629113, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_pcreateerror.sh'}, {'damage_type': 'backtrace', 'id': 681600339, 'ino': 1099511628958, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.performance.sh'}, {'damage_type': 'backtrace', 'id': 691116750, 'ino': 1099511632672, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/1-1.c'}, {'damage_type': 'backtrace', 'id': 693040069, 'ino': 1099511629488, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff06'}, {'damage_type': 'backtrace', 'id': 701421885, 'ino': 1099511629033, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authdes_seccreate.sh'}, {'damage_type': 'backtrace', 'id': 707062570, 'ino': 1099511629431, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld05'}, {'damage_type': 'backtrace', 'id': 717985126, 'ino': 1099511629473, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/00_Descriptions.txt'}, {'damage_type': 'backtrace', 'id': 718313205, 'ino': 1099511629440, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld04'}, {'damage_type': 'backtrace', 'id': 758910798, 'ino': 1099511628965, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.dataint.sh'}, {'damage_type': 'backtrace', 'id': 761160666, 'ino': 1099511629442, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld04'}, {'damage_type': 'backtrace', 'id': 776460275, 'ino': 1099511629018, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.limits.sh'}, {'damage_type': 'backtrace', 'id': 778800068, 'ino': 1099511629021, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getmaps.sh'}, {'damage_type': 'backtrace', 'id': 789875593, 'ino': 1099511629110, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_destroy.sh'}, {'damage_type': 'backtrace', 'id': 792966984, 'ino': 1099511631202, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/Makefile.in'}, {'damage_type': 'backtrace', 'id': 808688682, 'ino': 1099511629034, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_noprog.sh'}, {'damage_type': 'backtrace', 'id': 819518401, 'ino': 1099511632726, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/testfrmw.h'}, {'damage_type': 'backtrace', 'id': 835030563, 'ino': 1099511629008, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.performance.sh'}, {'damage_type': 'backtrace', 'id': 871718638, 'ino': 1099511628925, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_weakauth.sh'}, {'damage_type': 'backtrace', 'id': 892582091, 'ino': 1099511629074, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.sh'}, {'damage_type': 'backtrace', 'id': 903018204, 'ino': 1099511628937, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create_timed.limits.sh'}, {'damage_type': 'backtrace', 'id': 937166647, 'ino': 1099511628924, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_vc_create.limits.sh'}, {'damage_type': 'backtrace', 'id': 964014685, 'ino': 1099511629741, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff01'}, {'damage_type': 'backtrace', 'id': 964438672, 'ino': 1099511628970, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_create.stress.sh'}, {'damage_type': 'backtrace', 'id': 979232968, 'ino': 1099511629115, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.stress.sh'}, {'damage_type': 'backtrace', 'id': 980698704, 'ino': 1099511632675, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/2-2.c'}, {'damage_type': 'backtrace', 'id': 1012884565, 'ino': 1099511629047, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authunix_create.sh'}, {'damage_type': 'backtrace', 'id': 1015762512, 'ino': 1099511628928, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getargs.sh'}, {'damage_type': 'backtrace', 'id': 1022279898, 'ino': 1099511628966, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_progvers.sh'}, {'damage_type': 'backtrace', 'id': 1026663286, 'ino': 1099511629114, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getargs.dataint.sh'}, {'damage_type': 'backtrace', 'id': 1035098394, 'ino': 1099511628938, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.dataint.sh'}, {'damage_type': 'backtrace', 'id': 1036841289, 'ino': 1099511633240, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/3-1.c'}, {'damage_type': 'backtrace', 'id': 1046646881, 'ino': 1099511628961, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.stress.sh'}, {'damage_type': 'backtrace', 'id': 1053485658, 'ino': 1099511632673, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/coverage.c'}, {'damage_type': 'backtrace', 'id': 1059533856, 'ino': 1099511629724, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff02'}, {'damage_type': 'backtrace', 'id': 1076814076, 'ino': 1099511632674, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/assertions.xml'}, {'damage_type': 'backtrace', 'id': 1083591907, 'ino': 1099511628957, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.dataint.sh'}, {'damage_type': 'backtrace', 'id': 1086590064, 'ino': 1099511629044, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.performance.sh'}, {'damage_type': 'backtrace', 'id': 1096605332, 'ino': 1099511629482, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff13'}, {'damage_type': 'backtrace', 'id': 1113178526, 'ino': 1099511631195, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_012.c'}, {'damage_type': 'backtrace', 'id': 1128009397, 'ino': 1099511629472, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/Makefile'}, {'damage_type': 'backtrace', 'id': 1140326165, 'ino': 1099511629029, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_noprog.sh'}, {'damage_type': 'backtrace', 'id': 1176594707, 'ino': 1099511628929, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.scalability.sh'}, {'damage_type': 'backtrace', 'id': 1185703102, 'ino': 1099511629750, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff08'}, {'damage_type': 'backtrace', 'id': 1199921752, 'ino': 1099511629439, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld03'}, {'damage_type': 'backtrace', 'id': 1241772590, 'ino': 1099511629013, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.sh'}, {'damage_type': 'backtrace', 'id': 1277651523, 'ino': 1099511629066, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.performance.sh'}, {'damage_type': 'backtrace', 'id': 1278492967, 'ino': 1099511628934, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_bufcreate.limits.sh'}, {'damage_type': 'backtrace', 'id': 1284351783, 'ino': 1099511629466, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff09'}, {'damage_type': 'backtrace', 'id': 1296063005, 'ino': 1099511629048, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.stress.sh'}, {'damage_type': 'backtrace', 'id': 1302699082, 'ino': 1099511628969, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_perrno.sh'}, {'damage_type': 'backtrace', 'id': 1309758652, 'ino': 1099511629004, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.mt.sh'}, {'damage_type': 'backtrace', 'id': 1312092555, 'ino': 1099511629733, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff09'}, {'damage_type': 'backtrace', 'id': 1313812306, 'ino': 1099511629743, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff01'}, {'damage_type': 'backtrace', 'id': 1316392825, 'ino': 1099511629739, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff07'}, {'damage_type': 'backtrace', 'id': 1334534272, 'ino': 1099511629019, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.performance.sh'}, {'damage_type': 'backtrace', 'id': 1347296143, 'ino': 1099511629483, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff08'}, {'damage_type': 'backtrace', 'id': 1355372238, 'ino': 1099511628993, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.performance.sh'}, {'damage_type': 'backtrace', 'id': 1359069905, 'ino': 1099511629085, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create.sh'}, {'damage_type': 'backtrace', 'id': 1378778043, 'ino': 1099511632671, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/5-1.c'}, {'damage_type': 'backtrace', 'id': 1392326778, 'ino': 1099511629069, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.scalability.sh'}, {'damage_type': 'backtrace', 'id': 1398635194, 'ino': 1099511629077, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_systemerr.sh'}, {'damage_type': 'backtrace', 'id': 1413538426, 'ino': 1099511629282, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.dataint.sh'}, {'damage_type': 'backtrace', 'id': 1415104397, 'ino': 1099511628931, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_getport.sh'}, {'damage_type': 'backtrace', 'id': 1436350294, 'ino': 1099511628967, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_tli_create.sh'}, {'damage_type': 'backtrace', 'id': 1460481770, 'ino': 1099511628960, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_vc_create.sh'}, {'damage_type': 'backtrace', 'id': 1466736151, 'ino': 1099511629020, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_vc_create.sh'}, {'damage_type': 'backtrace', 'id': 1484866213, 'ino': 1099511629012, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_systemerr.sh'}, {'damage_type': 'backtrace', 'id': 1502227557, 'ino': 1099511628964, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.complex.sh'}, {'damage_type': 'backtrace', 'id': 1503032093, 'ino': 1099511628980, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.performance.sh'}, {'damage_type': 'backtrace', 'id': 1509578033, 'ino': 1099511632676, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/4-1.c'}, {'damage_type': 'backtrace', 'id': 1521879303, 'ino': 1099511629734, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff10'}, {'damage_type': 'backtrace', 'id': 1538676541, 'ino': 1099511629058, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create.sh'}, {'damage_type': 'backtrace', 'id': 1551400206, 'ino': 1099511629080, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create_timed.limits.sh'}, {'damage_type': 'backtrace', 'id': 1564551872, 'ino': 1099511629736, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/00_Descriptions.txt'}, {'damage_type': 'backtrace', 'id': 1574230051, 'ino': 1099511629096, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.sh'}, {'damage_type': 'backtrace', 'id': 1587971301, 'ino': 1099511628948, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcfd_create.sh'}, {'damage_type': 'backtrace', 'id': 1634890561, 'ino': 1099511632730, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/5-2.c'}, {'damage_type': 'backtrace', 'id': 1650210693, 'ino': 1099511629059, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_xprt_unregister.sh'}, {'damage_type': 'backtrace', 'id': 1659843002, 'ino': 1099511631200, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_001.c'}, {'damage_type': 'backtrace', 'id': 1661626994, 'ino': 1099511632677, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/cln.sh'}, {'damage_type': 'backtrace', 'id': 1669624865, 'ino': 1099511629053, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.sh'}, {'damage_type': 'backtrace', 'id': 1673564394, 'ino': 1099511629100, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_get_myaddress.sh'}, {'damage_type': 'backtrace', 'id': 1676656951, 'ino': 1099511629087, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perror.complex.sh'}, {'damage_type': 'backtrace', 'id': 1742702560, 'ino': 1099511628977, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_svc_unregister.sh'}, {'damage_type': 'backtrace', 'id': 1775594370, 'ino': 1099511629613, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.performance.sh'}, {'damage_type': 'backtrace', 'id': 1817094113, 'ino': 1099511629016, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_weakauth.sh'}, {'damage_type': 'backtrace', 'id': 1819669694, 'ino': 1099511629043, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.stress.sh'}, {'damage_type': 'backtrace', 'id': 1855646128, 'ino': 1099511629064, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perror.sh'}, {'damage_type': 'backtrace', 'id': 1866352254, 'ino': 1099511629023, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_dg_create.limits.sh'}, {'damage_type': 'backtrace', 'id': 1876315426, 'ino': 1099511629052, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_create_timed.sh'}, {'damage_type': 'backtrace', 'id': 1930480309, 'ino': 1099511629476, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff12'}, {'damage_type': 'backtrace', 'id': 1936207882, 'ino': 1099511629022, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.stress.sh'}, {'damage_type': 'backtrace', 'id': 1938040266, 'ino': 1099511629025, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.stress.sh'}, {'damage_type': 'backtrace', 'id': 1939894177, 'ino': 1099511629105, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_rmtcall.stress.sh'}, {'damage_type': 'backtrace', 'id': 1993232404, 'ino': 1099511629745, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff03'}, {'damage_type': 'backtrace', 'id': 2004450430, 'ino': 1099511628998, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_control.sh'}, {'damage_type': 'backtrace', 'id': 2012850499, 'ino': 1099511629051, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.basic.sh'}, {'damage_type': 'backtrace', 'id': 2018146463, 'ino': 1099511628985, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authsys_create_default.sh'}, {'damage_type': 'backtrace', 'id': 2020659385, 'ino': 1099511628982, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_perror.sh'}, {'damage_type': 'backtrace', 'id': 2025553784, 'ino': 1099511629474, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff07'}, {'damage_type': 'backtrace', 'id': 2033786479, 'ino': 1099511629062, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcraw_create.performance.sh'}, {'damage_type': 'backtrace', 'id': 2034687157, 'ino': 1099511628996, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.mt.sh'}, {'damage_type': 'backtrace', 'id': 2045541899, 'ino': 1099511629728, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff09'}, {'damage_type': 'backtrace', 'id': 2049650084, 'ino': 1099511629010, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_dg_create.sh'}, {'damage_type': 'backtrace', 'id': 2058401268, 'ino': 1099511628927, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_tli_create.sh'}, {'damage_type': 'backtrace', 'id': 2058913777, 'ino': 1099511629104, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.complex.sh'}, {'damage_type': 'backtrace', 'id': 2066235365, 'ino': 1099511628976, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_tp_create_timed.sh'}, {'damage_type': 'backtrace', 'id': 2070606340, 'ino': 1099511629082, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svctcp_create.sh'}, {'damage_type': 'backtrace', 'id': 2079733720, 'ino': 1099511629441, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld06'}, {'damage_type': 'backtrace', 'id': 2081282013, 'ino': 1099511628952, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_set.sh'}, {'damage_type': 'backtrace', 'id': 2081955341, 'ino': 1099511628962, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.performance.sh'}, {'damage_type': 'backtrace', 'id': 2084716621, 'ino': 1099511629026, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perrno.sh'}, {'damage_type': 'backtrace', 'id': 2095550529, 'ino': 1099511628987, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svc_destroy.stress.sh'}, {'damage_type': 'backtrace', 'id': 2195619469, 'ino': 1099511628968, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.limits.sh'}, {'damage_type': 'backtrace', 'id': 2206879674, 'ino': 1099511629079, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_unset.sh'}, {'damage_type': 'backtrace', 'id': 2214772665, 'ino': 1099511629489, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff01'}, {'damage_type': 'backtrace', 'id': 2222207557, 'ino': 1099511629075, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_unset.sh'}, {'damage_type': 'backtrace', 'id': 2226412416, 'ino': 1099511629070, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.stress.sh'}, {'damage_type': 'backtrace', 'id': 2243330763, 'ino': 1099511629071, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_auth.sh'}, {'damage_type': 'backtrace', 'id': 2294761460, 'ino': 1099511628983, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_destroy.stress.sh'}, {'damage_type': 'backtrace', 'id': 2296876930, 'ino': 1099511628972, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.stress.sh'}, {'damage_type': 'backtrace', 'id': 2312625345, 'ino': 1099511629567, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_regunreg_registerrpc/1-basic.c'}, {'damage_type': 'backtrace', 'id': 2348059595, 'ino': 1099511629730, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff11'}, {'damage_type': 'backtrace', 'id': 2355008337, 'ino': 1099511629083, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.mt.sh'}, {'damage_type': 'backtrace', 'id': 2363895821, 'ino': 1099511629430, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld03'}, {'damage_type': 'backtrace', 'id': 2365596260, 'ino': 1099511629486, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff02'}, {'damage_type': 'backtrace', 'id': 2369583272, 'ino': 1099511628941, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_tli_create.limits.sh'}, {'damage_type': 'backtrace', 'id': 2371434437, 'ino': 1099511629485, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff03'}, {'damage_type': 'backtrace', 'id': 2393331752, 'ino': 1099511629432, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld02'}, {'damage_type': 'backtrace', 'id': 2407823258, 'ino': 1099511629057, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_progvers.sh'}, {'damage_type': 'backtrace', 'id': 2432040003, 'ino': 1099511628990, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_pcreateerror.sh'}, {'damage_type': 'backtrace', 'id': 2440306492, 'ino': 1099511629284, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.stress.sh'}, {'damage_type': 'backtrace', 'id': 2459757251, 'ino': 1099511629005, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.sh'}, {'damage_type': 'backtrace', 'id': 2466843555, 'ino': 1099511629032, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.dataint.sh'}, {'damage_type': 'backtrace', 'id': 2470989102, 'ino': 1099511628935, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authnone_create.sh'}, {'damage_type': 'backtrace', 'id': 2485142462, 'ino': 1099511629031, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_freeres.sh'}, {'damage_type': 'backtrace', 'id': 2506378870, 'ino': 1099511629035, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_xprt_register.sh'}, {'damage_type': 'backtrace', 'id': 2507654112, 'ino': 1099511629470, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff05'}, {'damage_type': 'backtrace', 'id': 2540474523, 'ino': 1099511628950, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_bufcreate.sh'}, {'damage_type': 'backtrace', 'id': 2557144936, 'ino': 1099511629011, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.stress.sh'}, {'damage_type': 'backtrace', 'id': 2565351571, 'ino': 1099511628936, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.scalability.sh'}, {'damage_type': 'backtrace', 'id': 2565832129, 'ino': 1099511628926, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.mt.sh'}, {'damage_type': 'backtrace', 'id': 2570243279, 'ino': 1099511628992, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.scalability.sh'}, {'damage_type': 'backtrace', 'id': 2573282901, 'ino': 1099511629007, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.sh'}, {'damage_type': 'backtrace', 'id': 2578690892, 'ino': 1099511629027, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_set.sh'}, {'damage_type': 'backtrace', 'id': 2584691156, 'ino': 1099511629465, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff01'}, {'damage_type': 'backtrace', 'id': 2613472110, 'ino': 1099511629095, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.stress.sh'}, {'damage_type': 'backtrace', 'id': 2625794475, 'ino': 1099511628951, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_authunix_create_default.sh'}, {'damage_type': 'backtrace', 'id': 2631029057, 'ino': 1099511629107, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_control.sh'}, {'damage_type': 'backtrace', 'id': 2639703242, 'ino': 1099511629437, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/00_Descriptions.txt'}, {'damage_type': 'backtrace', 'id': 2645067886, 'ino': 1099511629078, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authsys_create.sh'}, {'damage_type': 'backtrace', 'id': 2671532864, 'ino': 1099511628984, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_reg.mt.sh'}, {'damage_type': 'backtrace', 'id': 2694241296, 'ino': 1099511632729, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/1-1.c'}, {'damage_type': 'backtrace', 'id': 2712059145, 'ino': 1099511631198, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_007.c'}, {'damage_type': 'backtrace', 'id': 2720954283, 'ino': 1099511631193, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_002.c'}, {'damage_type': 'backtrace', 'id': 2733925891, 'ino': 1099511630173, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff14'}, {'damage_type': 'backtrace', 'id': 2736981677, 'ino': 1099511628981, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.complex.sh'}, {'damage_type': 'backtrace', 'id': 2743979644, 'ino': 1099511629084, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcraw_create.sh'}, {'damage_type': 'backtrace', 'id': 2747281891, 'ino': 1099511629740, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff13'}, {'damage_type': 'backtrace', 'id': 2747771573, 'ino': 1099511631205, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_013.c'}, {'damage_type': 'backtrace', 'id': 2758821853, 'ino': 1099511628945, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_dg_create.limits.sh'}, {'damage_type': 'backtrace', 'id': 2770131731, 'ino': 1099511629735, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/Makefile'}, {'damage_type': 'backtrace', 'id': 2770329711, 'ino': 1099511628944, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.complex.sh'}, {'damage_type': 'backtrace', 'id': 2771136630, 'ino': 1099511629738, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff05'}, {'damage_type': 'backtrace', 'id': 2781336961, 'ino': 1099511629471, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff04'}, {'damage_type': 'backtrace', 'id': 2808870432, 'ino': 1099511629469, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff10'}, {'damage_type': 'backtrace', 'id': 2824332718, 'ino': 1099511629109, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_create.sh'}, {'damage_type': 'backtrace', 'id': 2850238665, 'ino': 1099511629015, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_svc_destroy.sh'}, {'damage_type': 'backtrace', 'id': 2874862691, 'ino': 1099511629094, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.dataint.sh'}, {'damage_type': 'backtrace', 'id': 2875268863, 'ino': 1099511629045, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntraw_create.complex.sh'}, {'damage_type': 'backtrace', 'id': 2887739088, 'ino': 1099511629036, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_control.dataint.sh'}, {'damage_type': 'backtrace', 'id': 2912261746, 'ino': 1099511629090, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.dataint.sh'}, {'damage_type': 'backtrace', 'id': 2935998536, 'ino': 1099511629039, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_svc_tp_create.sh'}, {'damage_type': 'backtrace', 'id': 3019904648, 'ino': 1099511628955, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_sperror.sh'}, {'damage_type': 'backtrace', 'id': 3020972632, 'ino': 1099511628939, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svc_destroy.sh'}, {'damage_type': 'backtrace', 'id': 3028354511, 'ino': 1099511629108, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_geterr.sh'}, {'damage_type': 'backtrace', 'id': 3068133254, 'ino': 1099511629040, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.mt.sh'}, {'damage_type': 'backtrace', 'id': 3073638682, 'ino': 1099511629081, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_clnt_perrno.complex.sh'}, {'damage_type': 'backtrace', 'id': 3077802864, 'ino': 1099511629463, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff02'}, {'damage_type': 'backtrace', 'id': 3091620758, 'ino': 1099511628940, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.complex.sh'}, {'damage_type': 'backtrace', 'id': 3098898163, 'ino': 1099511628994, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.stress.sh'}, {'damage_type': 'backtrace', 'id': 3137861486, 'ino': 1099511629060, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.performance.sh'}, {'damage_type': 'backtrace', 'id': 3160383780, 'ino': 1099511629030, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_clnt_spcreateerror.sh'}, {'damage_type': 'backtrace', 'id': 3163409365, 'ino': 1099511631691, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_006.c'}, {'damage_type': 'backtrace', 'id': 3165863478, 'ino': 1099511629063, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.sh'}, {'damage_type': 'backtrace', 'id': 3188380736, 'ino': 1099511629067, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.scalability.sh'}, {'damage_type': 'backtrace', 'id': 3208310346, 'ino': 1099511628963, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_clnt_call.scalability.sh'}, {'damage_type': 'backtrace', 'id': 3226156248, 'ino': 1099511629433, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld05'}, {'damage_type': 'backtrace', 'id': 3235327691, 'ino': 1099511629065, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_clnt_call.sh'}, {'damage_type': 'backtrace', 'id': 3236996800, 'ino': 1099511629725, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff06'}, {'damage_type': 'backtrace', 'id': 3242318381, 'ino': 1099511629435, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld02'}, {'damage_type': 'backtrace', 'id': 3266532754, 'ino': 1099511629024, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.complex.sh'}, {'damage_type': 'backtrace', 'id': 3287761453, 'ino': 1099511628991, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.scalability.sh'}, {'damage_type': 'backtrace', 'id': 3293674112, 'ino': 1099511629475, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff11'}, {'damage_type': 'backtrace', 'id': 3299778315, 'ino': 1099511629099, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_svc_unreg.mt.sh'}, {'damage_type': 'backtrace', 'id': 3305064117, 'ino': 1099511628953, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_bufcreate.sh'}, {'damage_type': 'backtrace', 'id': 3324321067, 'ino': 1099511629054, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.mt.sh'}, {'damage_type': 'backtrace', 'id': 3329833266, 'ino': 1099511629101, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authdes_create.sh'}, {'damage_type': 'backtrace', 'id': 3340941976, 'ino': 1099511629438, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast6-queryfld06'}, {'damage_type': 'backtrace', 'id': 3407686353, 'ino': 1099511629744, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff12'}, {'damage_type': 'backtrace', 'id': 3412354507, 'ino': 1099511629003, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.dataint.sh'}, {'damage_type': 'backtrace', 'id': 3482938026, 'ino': 1099511632670, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/2-1.c'}, {'damage_type': 'backtrace', 'id': 3485627959, 'ino': 1099511628988, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_auth_authnone_create.sh'}, {'damage_type': 'backtrace', 'id': 3506091047, 'ino': 1099511629111, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_interlevel_clnt_call.sh'}, {'damage_type': 'backtrace', 'id': 3507183691, 'ino': 1099511629102, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.dataint.sh'}, {'damage_type': 'backtrace', 'id': 3516326272, 'ino': 1099511629014, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.dataint.sh'}, {'damage_type': 'backtrace', 'id': 3524613267, 'ino': 1099511633222, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/sem_getvalue/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 3535235416, 'ino': 1099511628956, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnt_destroy.sh'}, {'damage_type': 'backtrace', 'id': 3558876929, 'ino': 1099511628979, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clntudp_bufcreate.limits.sh'}, {'damage_type': 'backtrace', 'id': 3561472208, 'ino': 1099511629056, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.basic.sh'}, {'damage_type': 'backtrace', 'id': 3563903519, 'ino': 1099511629737, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff13'}, {'damage_type': 'backtrace', 'id': 3602008048, 'ino': 1099511632725, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/testfrmw.c'}, {'damage_type': 'backtrace', 'id': 3610990899, 'ino': 1099511628947, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.sh'}, {'damage_type': 'backtrace', 'id': 3624365912, 'ino': 1099511628999, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_addrmanagmt_rpcb_getaddr.sh'}, {'damage_type': 'backtrace', 'id': 3638386631, 'ino': 1099511629898, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/multicast/query-flood/mcast4-queryfld01'}, {'damage_type': 'backtrace', 'id': 3668529205, 'ino': 1099511629464, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff13'}, {'damage_type': 'backtrace', 'id': 3697993185, 'ino': 1099511629103, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.complex.sh'}, {'damage_type': 'backtrace', 'id': 3714438045, 'ino': 1099511629462, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff09'}, {'damage_type': 'backtrace', 'id': 3756045706, 'ino': 1099511628949, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_freeargs.sh'}, {'damage_type': 'backtrace', 'id': 3770072463, 'ino': 1099511629487, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff08'}, {'damage_type': 'backtrace', 'id': 3775167846, 'ino': 1099511631196, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_008.c'}, {'damage_type': 'backtrace', 'id': 3802934458, 'ino': 1099511632731, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/assertions.xml'}, {'damage_type': 'backtrace', 'id': 3807987969, 'ino': 1099511632728, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_posix_testsuite/conformance/interfaces/pthread_mutex_unlock/5-1.c'}, {'damage_type': 'backtrace', 'id': 3834940211, 'ino': 1099511629747, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff05'}, {'damage_type': 'backtrace', 'id': 3850861549, 'ino': 1099511629037, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.sh'}, {'damage_type': 'backtrace', 'id': 3872094120, 'ino': 1099511629088, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcfd_create.limits.sh'}, {'damage_type': 'backtrace', 'id': 3908340302, 'ino': 1099511629468, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff04'}, {'damage_type': 'backtrace', 'id': 3919633358, 'ino': 1099511629041, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_err_svcerr_noproc.sh'}, {'damage_type': 'backtrace', 'id': 3921028101, 'ino': 1099511629002, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_auth_auth_destroy.sh'}, {'damage_type': 'backtrace', 'id': 3925929283, 'ino': 1099511629049, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.performance.sh'}, {'damage_type': 'backtrace', 'id': 3933008778, 'ino': 1099511629006, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.sh'}, {'damage_type': 'backtrace', 'id': 3978754535, 'ino': 1099511629098, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_broadc_clnt_broadcast.scalability.sh'}, {'damage_type': 'backtrace', 'id': 3988137569, 'ino': 1099511629907, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp4-uni-dsackoff14'}, {'damage_type': 'backtrace', 'id': 3994465370, 'ino': 1099511629061, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_svcudp_create.stress.sh'}, {'damage_type': 'backtrace', 'id': 4013434807, 'ino': 1099511629097, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_clnt_call.stress.sh'}, {'damage_type': 'backtrace', 'id': 4027203008, 'ino': 1099511628989, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.performance.sh'}, {'damage_type': 'backtrace', 'id': 4039936047, 'ino': 1099511629050, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_addrmanagmt_pmap_getmaps.sh'}, {'damage_type': 'backtrace', 'id': 4047152795, 'ino': 1099511628930, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_bottomlevel_svc_dg_create.sh'}, {'damage_type': 'backtrace', 'id': 4074210640, 'ino': 1099511629481, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff12'}, {'damage_type': 'backtrace', 'id': 4076032380, 'ino': 1099511629731, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff10'}, {'damage_type': 'backtrace', 'id': 4076832387, 'ino': 1099511628986, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_expertlevel_rpcb_rmtcall.scalability.sh'}, {'damage_type': 'backtrace', 'id': 4077443044, 'ino': 1099511629055, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_regunreg_svc_register.sh'}, {'damage_type': 'backtrace', 'id': 4080218106, 'ino': 1099511629478, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-dsackoff/tcp6-uni-dsackoff10'}, {'damage_type': 'backtrace', 'id': 4091333812, 'ino': 1099511629752, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp4-uni-sackoff04'}, {'damage_type': 'backtrace', 'id': 4093123450, 'ino': 1099511629092, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast_exp.limits.sh'}, {'damage_type': 'backtrace', 'id': 4101785119, 'ino': 1099511629727, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff06'}, {'damage_type': 'backtrace', 'id': 4114181431, 'ino': 1099511628974, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_reg.mt.sh'}, {'damage_type': 'backtrace', 'id': 4140780662, 'ino': 1099511629726, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/stress/tcp/uni-sackoff/tcp6-uni-sackoff02'}, {'damage_type': 'backtrace', 'id': 4144654391, 'ino': 1099511631203, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/open_hpi_testsuite/utils/t/uid/uid_utils_005.c'}, {'damage_type': 'backtrace', 'id': 4155849307, 'ino': 1099511629017, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_err_svcerr_noproc.sh'}, {'damage_type': 'backtrace', 'id': 4183732614, 'ino': 1099511628889, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/tests_pack/rpc_suite/rpc/rpc_regunreg_registerrpc/assertions.xml'}, {'damage_type': 'backtrace', 'id': 4192782437, 'ino': 1099511628971, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.performance.sh'}, {'damage_type': 'backtrace', 'id': 4205311783, 'ino': 1099511628946, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_createdestroy_clnttcp_create.sh'}, {'damage_type': 'backtrace', 'id': 4211765262, 'ino': 1099511628932, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_toplevel_clnt_call.scalability.sh'}, {'damage_type': 'backtrace', 'id': 4228009329, 'ino': 1099511629072, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_call.stress.sh'}, {'damage_type': 'backtrace', 'id': 4281977027, 'ino': 1099511629000, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_svc_getcaller.sh'}, {'damage_type': 'backtrace', 'id': 4288414511, 'ino': 1099511629038, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/tirpc_simple_rpc_broadcast.scalability.sh'}, {'damage_type': 'backtrace', 'id': 4293818928, 'ino': 1099511629086, 'path': '/volumes/qa/sv_1/6466e999-81d6-425e-9907-3f0f6edb37e6/client.0/tmp/fsstress/ltp-full-20091231/testcases/network/rpc/rpc-tirpc-full-test-suite/scripts/rpc_stdcall_callrpc.dataint.sh'}] 2024-01-25T15:04:07.930 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-01-25T15:04:09.354 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:09 smithi186 ceph-mon[35697]: pgmap v413: 97 pgs: 97 active+clean; 97 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 435 op/s 2024-01-25T15:04:09.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:09 smithi170 ceph-mon[31899]: pgmap v413: 97 pgs: 97 active+clean; 97 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 435 op/s 2024-01-25T15:04:09.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:09 smithi191 ceph-mon[36347]: pgmap v413: 97 pgs: 97 active+clean; 97 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 435 op/s 2024-01-25T15:04:11.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:11 smithi186 ceph-mon[35697]: pgmap v414: 97 pgs: 97 active+clean; 96 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 490 op/s 2024-01-25T15:04:11.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:11 smithi170 ceph-mon[31899]: pgmap v414: 97 pgs: 97 active+clean; 96 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 490 op/s 2024-01-25T15:04:11.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:11 smithi191 ceph-mon[36347]: pgmap v414: 97 pgs: 97 active+clean; 96 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 490 op/s 2024-01-25T15:04:13.433 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.430+0000 7fcd5bec9640 1 -- 172.21.15.170:0/4004042666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd540ffc60 msgr2=0x7fcd54100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:13.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.430+0000 7fcd5bec9640 1 --2- 172.21.15.170:0/4004042666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd540ffc60 0x7fcd54100080 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009900 tx=0x7fcd5002bc30 comp rx=0 tx=0).stop 2024-01-25T15:04:13.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.430+0000 7fcd5bec9640 1 -- 172.21.15.170:0/4004042666 shutdown_connections 2024-01-25T15:04:13.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.430+0000 7fcd5bec9640 1 --2- 172.21.15.170:0/4004042666 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd54100e50 0x7fcd541012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.430+0000 7fcd5bec9640 1 --2- 172.21.15.170:0/4004042666 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd54101810 0x7fcd541080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.430+0000 7fcd5bec9640 1 --2- 172.21.15.170:0/4004042666 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd540ffc60 0x7fcd54100080 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.430+0000 7fcd5bec9640 1 -- 172.21.15.170:0/4004042666 >> 172.21.15.170:0/4004042666 conn(0x7fcd540fb1d0 msgr2=0x7fcd540fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:13.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.430+0000 7fcd5bec9640 1 -- 172.21.15.170:0/4004042666 shutdown_connections 2024-01-25T15:04:13.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.430+0000 7fcd5bec9640 1 -- 172.21.15.170:0/4004042666 wait complete. 2024-01-25T15:04:13.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd5bec9640 1 Processor -- start 2024-01-25T15:04:13.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd5bec9640 1 -- start start 2024-01-25T15:04:13.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd5bec9640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd540ffc60 0x7fcd5406a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd5bec9640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd54100e50 0x7fcd5419b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.434 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd5bec9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd54101810 0x7fcd5419dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd5bec9640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5419e7b0 con 0x7fcd54100e50 2024-01-25T15:04:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd5bec9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5419e920 con 0x7fcd54101810 2024-01-25T15:04:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd5bec9640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5419eae0 con 0x7fcd540ffc60 2024-01-25T15:04:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd59464640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd54100e50 0x7fcd5419b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd59464640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd54100e50 0x7fcd5419b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56416/0 (socket says 172.21.15.170:56416) 2024-01-25T15:04:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd59464640 1 -- 172.21.15.170:0/888910645 learned_addr learned my addr 172.21.15.170:0/888910645 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd5a466640 1 --2- 172.21.15.170:0/888910645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd54101810 0x7fcd5419dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd59c65640 1 --2- 172.21.15.170:0/888910645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd540ffc60 0x7fcd5406a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd59464640 1 -- 172.21.15.170:0/888910645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd540ffc60 msgr2=0x7fcd5406a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd59464640 1 --2- 172.21.15.170:0/888910645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd540ffc60 0x7fcd5406a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd59464640 1 -- 172.21.15.170:0/888910645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd54101810 msgr2=0x7fcd5419dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.431+0000 7fcd59464640 1 --2- 172.21.15.170:0/888910645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd54101810 0x7fcd5419dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.432+0000 7fcd59464640 1 -- 172.21.15.170:0/888910645 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd50009560 con 0x7fcd54100e50 2024-01-25T15:04:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.432+0000 7fcd59464640 1 --2- 172.21.15.170:0/888910645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd54100e50 0x7fcd5419b9b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400e9f0 tx=0x7fcd4400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.432+0000 7fcd4affd640 1 -- 172.21.15.170:0/888910645 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44009700 con 0x7fcd54100e50 2024-01-25T15:04:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.432+0000 7fcd4affd640 1 -- 172.21.15.170:0/888910645 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd4400cd80 con 0x7fcd54100e50 2024-01-25T15:04:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.432+0000 7fcd5bec9640 1 -- 172.21.15.170:0/888910645 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5419ed60 con 0x7fcd54100e50 2024-01-25T15:04:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.432+0000 7fcd4affd640 1 -- 172.21.15.170:0/888910645 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44018860 con 0x7fcd54100e50 2024-01-25T15:04:13.436 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.432+0000 7fcd5bec9640 1 -- 172.21.15.170:0/888910645 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5419f210 con 0x7fcd54100e50 2024-01-25T15:04:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.434+0000 7fcd4affd640 1 -- 172.21.15.170:0/888910645 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fcd440189c0 con 0x7fcd54100e50 2024-01-25T15:04:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.435+0000 7fcd5eb63740 1 Processor -- start 2024-01-25T15:04:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.435+0000 7fcd5eb63740 1 -- start start 2024-01-25T15:04:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.435+0000 7fcd5eb63740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558874262a0 0x5558874266c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.435+0000 7fcd5eb63740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555887426c90 0x55588742b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.442 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.435+0000 7fcd5eb63740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55588742be00 0x55588742e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.435+0000 7fcd5eb63740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x555887396070 con 0x5558874262a0 2024-01-25T15:04:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.435+0000 7fcd5eb63740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x555887393760 con 0x55588742be00 2024-01-25T15:04:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.435+0000 7fcd5eb63740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55588738f050 con 0x555887426c90 2024-01-25T15:04:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.435+0000 7fcd4affd640 1 --2- 172.21.15.170:0/888910645 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fcd400a1380 0x7fcd400a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.435+0000 7fcd5a466640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558874262a0 0x5558874266c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.435+0000 7fcd59c65640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555887426c90 0x55588742b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.435+0000 7fcd59464640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55588742be00 0x55588742e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.435+0000 7fcd5a466640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558874262a0 0x5558874266c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56430/0 (socket says 172.21.15.170:56430) 2024-01-25T15:04:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.435+0000 7fcd5a466640 1 -- 172.21.15.170:0/1002813409 learned_addr learned my addr 172.21.15.170:0/1002813409 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.435+0000 7fcd5a466640 1 --2- 172.21.15.170:0/888910645 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fcd400a1380 0x7fcd400a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.436+0000 7fcd4affd640 1 -- 172.21.15.170:0/888910645 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fcd44014070 con 0x7fcd54100e50 2024-01-25T15:04:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.436+0000 7fcd59464640 1 -- 172.21.15.170:0/1002813409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555887426c90 msgr2=0x55588742b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.436+0000 7fcd59464640 1 --2- 172.21.15.170:0/1002813409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555887426c90 0x55588742b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.436+0000 7fcd59464640 1 -- 172.21.15.170:0/1002813409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558874262a0 msgr2=0x5558874266c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.436+0000 7fcd59464640 1 --2- 172.21.15.170:0/1002813409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558874262a0 0x5558874266c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.436+0000 7fcd59464640 1 -- 172.21.15.170:0/1002813409 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555887386e70 con 0x55588742be00 2024-01-25T15:04:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.436+0000 7fcd5a466640 1 --2- 172.21.15.170:0/1002813409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558874262a0 0x5558874266c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.436+0000 7fcd59464640 1 --2- 172.21.15.170:0/1002813409 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55588742be00 0x55588742e290 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd440a1dc0 tx=0x7fcd4406d230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee920982b1184e12 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.436+0000 7fcd5a466640 1 --2- 172.21.15.170:0/888910645 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fcd400a1380 0x7fcd400a3840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x5558874274f0 tx=0x7fcd4c009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.436+0000 7fcd3ffff640 1 -- 172.21.15.170:0/1002813409 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4409a010 con 0x55588742be00 2024-01-25T15:04:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.436+0000 7fcd3ffff640 1 -- 172.21.15.170:0/1002813409 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd4409e0b0 con 0x55588742be00 2024-01-25T15:04:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.436+0000 7fcd3ffff640 1 -- 172.21.15.170:0/1002813409 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd44096720 con 0x55588742be00 2024-01-25T15:04:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.437+0000 7fcd5eb63740 1 -- 172.21.15.170:0/1002813409 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55588742be00 msgr2=0x55588742e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.437+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/1002813409 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55588742be00 0x55588742e290 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcd440a1dc0 tx=0x7fcd4406d230 comp rx=0 tx=0).stop 2024-01-25T15:04:13.444 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.437+0000 7fcd5eb63740 1 -- 172.21.15.170:0/1002813409 shutdown_connections 2024-01-25T15:04:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.437+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/1002813409 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55588742be00 0x55588742e290 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.437+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/1002813409 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555887426c90 0x55588742b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.437+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/1002813409 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x5558874262a0 0x5558874266c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.437+0000 7fcd5eb63740 1 -- 172.21.15.170:0/1002813409 >> 172.21.15.170:0/1002813409 conn(0x555887421810 msgr2=0x555887421c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.437+0000 7fcd5eb63740 1 -- 172.21.15.170:0/1002813409 shutdown_connections 2024-01-25T15:04:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.437+0000 7fcd5eb63740 1 -- 172.21.15.170:0/1002813409 wait complete. 2024-01-25T15:04:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.437+0000 7fcd5eb63740 1 -- start start 2024-01-25T15:04:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.437+0000 7fcd5eb63740 1 Processor -- start 2024-01-25T15:04:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd5eb63740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558874262a0 0x5558874344c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd5eb63740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555887426c90 0x555887434a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.445 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd5eb63740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55588742be00 0x55588743ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd5eb63740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558873481e0 con 0x555887426c90 2024-01-25T15:04:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd5eb63740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x555887347e80 con 0x5558874262a0 2024-01-25T15:04:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd5eb63740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55588730d0c0 con 0x55588742be00 2024-01-25T15:04:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd5eb63740 10 client.0 _ll_register_callbacks cb 0x555887332ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd59464640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555887426c90 0x555887434a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd59c65640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558874262a0 0x5558874344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd59464640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555887426c90 0x555887434a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56434/0 (socket says 172.21.15.170:56434) 2024-01-25T15:04:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd59464640 1 -- 172.21.15.170:0/3168209913 learned_addr learned my addr 172.21.15.170:0/3168209913 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd5a466640 1 --2- 172.21.15.170:0/3168209913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55588742be00 0x55588743ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd59464640 1 -- 172.21.15.170:0/3168209913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55588742be00 msgr2=0x55588743ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd59464640 1 --2- 172.21.15.170:0/3168209913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55588742be00 0x55588743ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd59464640 1 -- 172.21.15.170:0/3168209913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558874262a0 msgr2=0x5558874344c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd59464640 1 --2- 172.21.15.170:0/3168209913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558874262a0 0x5558874344c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd59464640 1 -- 172.21.15.170:0/3168209913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5419f210 con 0x555887426c90 2024-01-25T15:04:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd59c65640 1 --2- 172.21.15.170:0/3168209913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558874262a0 0x5558874344c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd59464640 1 --2- 172.21.15.170:0/3168209913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555887426c90 0x555887434a00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcd440ca970 tx=0x7fcd440a2370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3075e0b2570444 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd3d7fa640 1 -- 172.21.15.170:0/3168209913 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4409a090 con 0x555887426c90 2024-01-25T15:04:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd3d7fa640 1 -- 172.21.15.170:0/3168209913 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fcd4409a270 con 0x555887426c90 2024-01-25T15:04:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.438+0000 7fcd5eb63740 1 -- 172.21.15.170:0/3168209913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555887388040 con 0x555887426c90 2024-01-25T15:04:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.439+0000 7fcd3d7fa640 1 -- 172.21.15.170:0/3168209913 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd4409a430 con 0x555887426c90 2024-01-25T15:04:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.439+0000 7fcd5eb63740 10 client.16215 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.439+0000 7fcd5eb63740 1 -- 172.21.15.170:0/3168209913 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55588738d6d0 con 0x555887426c90 2024-01-25T15:04:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.439+0000 7fcd3d7fa640 1 -- 172.21.15.170:0/3168209913 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd440b8030 con 0x555887426c90 2024-01-25T15:04:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.439+0000 7fcd3d7fa640 1 -- 172.21.15.170:0/3168209913 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fcd440adba0 con 0x555887426c90 2024-01-25T15:04:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.439+0000 7fcd5eb63740 10 client.16215 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.439+0000 7fcd5eb63740 10 client.16215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:04:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.439+0000 7fcd5eb63740 20 client.16215 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.439+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/3168209913 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x555887440110 0x555887442530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.439+0000 7fcd5eb63740 4 client.16215 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:04:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.439+0000 7fcd5eb63740 1 -- 172.21.15.170:0/3168209913 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555887387d60 con 0x555887440110 2024-01-25T15:04:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.439+0000 7fcd59c65640 1 --2- 172.21.15.170:0/3168209913 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x555887440110 0x555887442530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.440+0000 7fcd3d7fa640 10 client.16215 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:13.448 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.440+0000 7fcd59c65640 1 --2- 172.21.15.170:0/3168209913 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x555887440110 0x555887442530 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6e349374c2dab65 server_cookie=4db2c4de706c1a1d in_seq=0 out_seq=0 2024-01-25T15:04:13.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.442+0000 7fcd3d7fa640 1 -- 172.21.15.170:0/3168209913 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555887387d60 con 0x555887440110 2024-01-25T15:04:13.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.442+0000 7fcd3d7fa640 10 client.16215 handle_command_reply: tid=0 2024-01-25T15:04:13.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.442+0000 7fcd5eb63740 1 client.16215 shutdown 2024-01-25T15:04:13.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.442+0000 7fcd5eb63740 1 -- 172.21.15.170:0/3168209913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555887426c90 msgr2=0x555887434a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:13.449 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.442+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/3168209913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555887426c90 0x555887434a00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcd440ca970 tx=0x7fcd440a2370 comp rx=0 tx=0).stop 2024-01-25T15:04:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.442+0000 7fcd5eb63740 1 -- 172.21.15.170:0/3168209913 shutdown_connections 2024-01-25T15:04:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.442+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/3168209913 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x555887440110 0x555887442530 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.442+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/3168209913 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55588742be00 0x55588743ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.442+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/3168209913 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555887426c90 0x555887434a00 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.442+0000 7fcd3d7fa640 0 client.16215 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.442+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/3168209913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558874262a0 0x5558874344c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.442+0000 7fcd5eb63740 1 -- 172.21.15.170:0/3168209913 >> 172.21.15.170:0/3168209913 conn(0x555887421810 msgr2=0x555887420a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.442+0000 7fcd5eb63740 1 -- 172.21.15.170:0/3168209913 shutdown_connections 2024-01-25T15:04:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.442+0000 7fcd5eb63740 1 -- 172.21.15.170:0/3168209913 wait complete. 2024-01-25T15:04:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.442+0000 7fcd5eb63740 20 client.16215 trim_cache size 0 max 16384 2024-01-25T15:04:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.456+0000 7fcd5eb63740 1 Processor -- start 2024-01-25T15:04:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.456+0000 7fcd5eb63740 1 -- start start 2024-01-25T15:04:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.456+0000 7fcd5eb63740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558874262a0 0x555887446e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.456+0000 7fcd5eb63740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555887426c90 0x55588743ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.456+0000 7fcd5eb63740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55588742be00 0x555887427e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.456+0000 7fcd5eb63740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55588742e420 con 0x55588742be00 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.456+0000 7fcd5eb63740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x555887427750 con 0x5558874262a0 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.456+0000 7fcd5eb63740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x555887422300 con 0x555887426c90 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd5a466640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55588742be00 0x555887427e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd59c65640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558874262a0 0x555887446e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd59c65640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558874262a0 0x555887446e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:43940/0 (socket says 172.21.15.170:43940) 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd5a466640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55588742be00 0x555887427e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56440/0 (socket says 172.21.15.170:56440) 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd59c65640 1 -- 172.21.15.170:0/1631622339 learned_addr learned my addr 172.21.15.170:0/1631622339 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd59464640 1 --2- 172.21.15.170:0/1631622339 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555887426c90 0x55588743ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd59c65640 1 -- 172.21.15.170:0/1631622339 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555887426c90 msgr2=0x55588743ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd59c65640 1 --2- 172.21.15.170:0/1631622339 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555887426c90 0x55588743ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd59c65640 1 -- 172.21.15.170:0/1631622339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55588742be00 msgr2=0x555887427e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd59c65640 1 --2- 172.21.15.170:0/1631622339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55588742be00 0x555887427e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd59c65640 1 -- 172.21.15.170:0/1631622339 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55588732a060 con 0x5558874262a0 2024-01-25T15:04:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd5a466640 1 --2- 172.21.15.170:0/1631622339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55588742be00 0x555887427e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd59c65640 1 --2- 172.21.15.170:0/1631622339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558874262a0 0x555887446e90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcd5002c6b0 tx=0x7fcd5002c5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60e2ad7b804e03d3 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd3f7fe640 1 -- 172.21.15.170:0/1631622339 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd50045040 con 0x5558874262a0 2024-01-25T15:04:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd3f7fe640 1 -- 172.21.15.170:0/1631622339 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd50047040 con 0x5558874262a0 2024-01-25T15:04:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.457+0000 7fcd3f7fe640 1 -- 172.21.15.170:0/1631622339 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5004c7f0 con 0x5558874262a0 2024-01-25T15:04:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.458+0000 7fcd5eb63740 1 -- 172.21.15.170:0/1631622339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558874262a0 msgr2=0x555887446e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.458+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/1631622339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558874262a0 0x555887446e90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcd5002c6b0 tx=0x7fcd5002c5d0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.458+0000 7fcd5eb63740 1 -- 172.21.15.170:0/1631622339 shutdown_connections 2024-01-25T15:04:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.458+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/1631622339 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55588742be00 0x555887427e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.458+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/1631622339 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x555887426c90 0x55588743ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.458+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/1631622339 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5558874262a0 0x555887446e90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.458+0000 7fcd5eb63740 1 -- 172.21.15.170:0/1631622339 >> 172.21.15.170:0/1631622339 conn(0x555887421810 msgr2=0x555887421bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.458+0000 7fcd5eb63740 1 -- 172.21.15.170:0/1631622339 shutdown_connections 2024-01-25T15:04:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.458+0000 7fcd5eb63740 1 -- 172.21.15.170:0/1631622339 wait complete. 2024-01-25T15:04:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.458+0000 7fcd5eb63740 1 -- start start 2024-01-25T15:04:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.458+0000 7fcd5eb63740 1 Processor -- start 2024-01-25T15:04:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.458+0000 7fcd5eb63740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558874262a0 0x55588743a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.458+0000 7fcd5eb63740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555887426c90 0x55588743a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd5eb63740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55588742be00 0x55588743ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd5eb63740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558874966f0 con 0x555887426c90 2024-01-25T15:04:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd5eb63740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x555887496860 con 0x55588742be00 2024-01-25T15:04:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd5eb63740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x555887496a20 con 0x5558874262a0 2024-01-25T15:04:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd5eb63740 10 client.0 _ll_register_callbacks cb 0x7fcd440963d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd59c65640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558874262a0 0x55588743a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd59464640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555887426c90 0x55588743a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd59c65640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558874262a0 0x55588743a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:55332/0 (socket says 172.21.15.170:55332) 2024-01-25T15:04:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd59464640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555887426c90 0x55588743a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:56446/0 (socket says 172.21.15.170:56446) 2024-01-25T15:04:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd59c65640 1 -- 172.21.15.170:0/2969287243 learned_addr learned my addr 172.21.15.170:0/2969287243 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd5a466640 1 --2- 172.21.15.170:0/2969287243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55588742be00 0x55588743ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd59464640 1 -- 172.21.15.170:0/2969287243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558874262a0 msgr2=0x55588743a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd59464640 1 --2- 172.21.15.170:0/2969287243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558874262a0 0x55588743a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd59464640 1 -- 172.21.15.170:0/2969287243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55588742be00 msgr2=0x55588743ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd59464640 1 --2- 172.21.15.170:0/2969287243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55588742be00 0x55588743ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd59464640 1 -- 172.21.15.170:0/2969287243 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c019040 con 0x555887426c90 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd59c65640 1 --2- 172.21.15.170:0/2969287243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558874262a0 0x55588743a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd5a466640 1 --2- 172.21.15.170:0/2969287243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55588742be00 0x55588743ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd59464640 1 --2- 172.21.15.170:0/2969287243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555887426c90 0x55588743a910 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcd44099d10 tx=0x7fcd44000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fbdc73649f3d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd3d7fa640 1 -- 172.21.15.170:0/2969287243 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4409a480 con 0x555887426c90 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd3d7fa640 1 -- 172.21.15.170:0/2969287243 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fcd44062070 con 0x555887426c90 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd5eb63740 1 -- 172.21.15.170:0/2969287243 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd4409e0b0 con 0x555887426c90 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd3d7fa640 1 -- 172.21.15.170:0/2969287243 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd44099500 con 0x555887426c90 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd5eb63740 10 client.16221 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.459+0000 7fcd5eb63740 1 -- 172.21.15.170:0/2969287243 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x7fcd541089a0 con 0x555887426c90 2024-01-25T15:04:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.460+0000 7fcd3d7fa640 1 -- 172.21.15.170:0/2969287243 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd440a6020 con 0x555887426c90 2024-01-25T15:04:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.460+0000 7fcd3d7fa640 1 -- 172.21.15.170:0/2969287243 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7fcd44099000 con 0x555887426c90 2024-01-25T15:04:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.460+0000 7fcd5eb63740 10 client.16221 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.460+0000 7fcd5eb63740 10 client.16221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:04:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.460+0000 7fcd5eb63740 20 client.16221 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.460+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/2969287243 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x555887498200 0x55588749a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.460+0000 7fcd5eb63740 4 client.16221 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-25T15:04:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.460+0000 7fcd5eb63740 1 -- 172.21.15.170:0/2969287243 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55588708e600 con 0x555887498200 2024-01-25T15:04:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.460+0000 7fcd59c65640 1 --2- 172.21.15.170:0/2969287243 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x555887498200 0x55588749a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.460+0000 7fcd3d7fa640 10 client.16221 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.460+0000 7fcd59c65640 1 --2- 172.21.15.170:0/2969287243 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x555887498200 0x55588749a620 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6ff9c981307c46d server_cookie=2000ca75a7d54a97 in_seq=0 out_seq=0 2024-01-25T15:04:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.556+0000 7fcd3d7fa640 1 -- 172.21.15.170:0/2969287243 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55588708e600 con 0x555887498200 2024-01-25T15:04:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.556+0000 7fcd3d7fa640 10 client.16221 handle_command_reply: tid=0 2024-01-25T15:04:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.556+0000 7fcd5eb63740 1 client.16221 shutdown 2024-01-25T15:04:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.556+0000 7fcd5eb63740 1 -- 172.21.15.170:0/2969287243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555887426c90 msgr2=0x55588743a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.556+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/2969287243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555887426c90 0x55588743a910 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fcd44099d10 tx=0x7fcd44000bc0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.556+0000 7fcd5eb63740 1 -- 172.21.15.170:0/2969287243 shutdown_connections 2024-01-25T15:04:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.556+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/2969287243 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x555887498200 0x55588749a620 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.556+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/2969287243 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55588742be00 0x55588743ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.556+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/2969287243 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x555887426c90 0x55588743a910 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.556+0000 7fcd3d7fa640 0 client.16221 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:13.558 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.556+0000 7fcd5eb63740 1 --2- 172.21.15.170:0/2969287243 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x5558874262a0 0x55588743a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.556+0000 7fcd5eb63740 1 -- 172.21.15.170:0/2969287243 >> 172.21.15.170:0/2969287243 conn(0x555887421810 msgr2=0x555887446e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.557+0000 7fcd5eb63740 1 -- 172.21.15.170:0/2969287243 shutdown_connections 2024-01-25T15:04:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.557+0000 7fcd5eb63740 1 -- 172.21.15.170:0/2969287243 wait complete. 2024-01-25T15:04:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.557+0000 7fcd5eb63740 20 client.16221 trim_cache size 0 max 16384 2024-01-25T15:04:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:{ 2024-01-25T15:04:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "message": "", 2024-01-25T15:04:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "return_code": 0 2024-01-25T15:04:13.559 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:} 2024-01-25T15:04:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.557+0000 7fcd5bec9640 1 -- 172.21.15.170:0/888910645 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fcd400a1380 msgr2=0x7fcd400a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.557+0000 7fcd5bec9640 1 --2- 172.21.15.170:0/888910645 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fcd400a1380 0x7fcd400a3840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x5558874274f0 tx=0x7fcd4c009500 comp rx=0 tx=0).stop 2024-01-25T15:04:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.557+0000 7fcd5bec9640 1 -- 172.21.15.170:0/888910645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd54100e50 msgr2=0x7fcd5419b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.557+0000 7fcd5bec9640 1 --2- 172.21.15.170:0/888910645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd54100e50 0x7fcd5419b9b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fcd4400e9f0 tx=0x7fcd4400eeb0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.557+0000 7fcd5bec9640 1 -- 172.21.15.170:0/888910645 shutdown_connections 2024-01-25T15:04:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.557+0000 7fcd5bec9640 1 --2- 172.21.15.170:0/888910645 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fcd400a1380 0x7fcd400a3840 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.557+0000 7fcd5bec9640 1 --2- 172.21.15.170:0/888910645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcd54101810 0x7fcd5419dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.557+0000 7fcd5bec9640 1 --2- 172.21.15.170:0/888910645 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fcd54100e50 0x7fcd5419b9b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.557+0000 7fcd5bec9640 1 --2- 172.21.15.170:0/888910645 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fcd540ffc60 0x7fcd5406a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.557+0000 7fcd5bec9640 1 -- 172.21.15.170:0/888910645 >> 172.21.15.170:0/888910645 conn(0x7fcd540fb1d0 msgr2=0x7fcd54104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.558+0000 7fcd5bec9640 1 -- 172.21.15.170:0/888910645 shutdown_connections 2024-01-25T15:04:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:13.558+0000 7fcd5bec9640 1 -- 172.21.15.170:0/888910645 wait complete. 2024-01-25T15:04:13.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:13 smithi186 ceph-mon[35697]: pgmap v415: 97 pgs: 97 active+clean; 96 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.0 MiB/s wr, 425 op/s 2024-01-25T15:04:13.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:13 smithi170 ceph-mon[31899]: pgmap v415: 97 pgs: 97 active+clean; 96 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.0 MiB/s wr, 425 op/s 2024-01-25T15:04:13.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:13 smithi191 ceph-mon[36347]: pgmap v415: 97 pgs: 97 active+clean; 96 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.0 MiB/s wr, 425 op/s 2024-01-25T15:04:14.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:14 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T15:04:14.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:14 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T15:04:14.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:14 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T15:04:15.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:15 smithi186 ceph-mon[35697]: pgmap v416: 97 pgs: 97 active+clean; 90 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 508 op/s 2024-01-25T15:04:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:04:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:04:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:04:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:04:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T15:04:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T15:04:15.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:04:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:15 smithi170 ceph-mon[31899]: pgmap v416: 97 pgs: 97 active+clean; 90 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 508 op/s 2024-01-25T15:04:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:04:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:04:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:04:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:04:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T15:04:15.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T15:04:15.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:04:15.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:15 smithi191 ceph-mon[36347]: pgmap v416: 97 pgs: 97 active+clean; 90 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 508 op/s 2024-01-25T15:04:15.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:04:15.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:04:15.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:04:15.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:04:15.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T15:04:15.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T15:04:15.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:04:17.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:17 smithi186 ceph-mon[35697]: pgmap v417: 97 pgs: 97 active+clean; 91 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 419 op/s 2024-01-25T15:04:17.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:17 smithi170 ceph-mon[31899]: pgmap v417: 97 pgs: 97 active+clean; 91 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 419 op/s 2024-01-25T15:04:17.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:17 smithi191 ceph-mon[36347]: pgmap v417: 97 pgs: 97 active+clean; 91 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 419 op/s 2024-01-25T15:04:19.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:19 smithi170 ceph-mon[31899]: pgmap v418: 97 pgs: 97 active+clean; 78 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 450 op/s 2024-01-25T15:04:19.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:19 smithi191 ceph-mon[36347]: pgmap v418: 97 pgs: 97 active+clean; 78 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 450 op/s 2024-01-25T15:04:19.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:19 smithi186 ceph-mon[35697]: pgmap v418: 97 pgs: 97 active+clean; 78 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 450 op/s 2024-01-25T15:04:21.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:21 smithi186 ceph-mon[35697]: pgmap v419: 97 pgs: 97 active+clean; 62 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 506 op/s 2024-01-25T15:04:21.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:21 smithi170 ceph-mon[31899]: pgmap v419: 97 pgs: 97 active+clean; 62 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 506 op/s 2024-01-25T15:04:21.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:21 smithi191 ceph-mon[36347]: pgmap v419: 97 pgs: 97 active+clean; 62 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 506 op/s 2024-01-25T15:04:23.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:23 smithi186 ceph-mon[35697]: pgmap v420: 97 pgs: 97 active+clean; 62 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 458 op/s 2024-01-25T15:04:23.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:23 smithi170 ceph-mon[31899]: pgmap v420: 97 pgs: 97 active+clean; 62 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 458 op/s 2024-01-25T15:04:23.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:23 smithi191 ceph-mon[36347]: pgmap v420: 97 pgs: 97 active+clean; 62 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 458 op/s 2024-01-25T15:04:25.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:25 smithi186 ceph-mon[35697]: pgmap v421: 97 pgs: 97 active+clean; 62 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 549 op/s 2024-01-25T15:04:25.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:25 smithi170 ceph-mon[31899]: pgmap v421: 97 pgs: 97 active+clean; 62 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 549 op/s 2024-01-25T15:04:25.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:25 smithi191 ceph-mon[36347]: pgmap v421: 97 pgs: 97 active+clean; 62 MiB data, 841 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 549 op/s 2024-01-25T15:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.649+0000 7f054fa61640 1 -- 172.21.15.170:0/2503375223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0548100d40 msgr2=0x7f0548101160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.649+0000 7f054fa61640 1 --2- 172.21.15.170:0/2503375223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0548100d40 0x7f0548101160 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0538009ca0 tx=0x7f053802c0f0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054fa61640 1 -- 172.21.15.170:0/2503375223 shutdown_connections 2024-01-25T15:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054fa61640 1 --2- 172.21.15.170:0/2503375223 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f05481028f0 0x7f0548109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054fa61640 1 --2- 172.21.15.170:0/2503375223 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0548101f30 0x7f05481023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054fa61640 1 --2- 172.21.15.170:0/2503375223 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f0548100d40 0x7f0548101160 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.663 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054fa61640 1 -- 172.21.15.170:0/2503375223 >> 172.21.15.170:0/2503375223 conn(0x7f05480fc2b0 msgr2=0x7f05480fe6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054fa61640 1 -- 172.21.15.170:0/2503375223 shutdown_connections 2024-01-25T15:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054fa61640 1 -- 172.21.15.170:0/2503375223 wait complete. 2024-01-25T15:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054fa61640 1 Processor -- start 2024-01-25T15:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054fa61640 1 -- start start 2024-01-25T15:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054fa61640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0548100d40 0x7f0548074aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054fa61640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0548101f30 0x7f05480730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054fa61640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05481028f0 0x7f0548073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054fa61640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0548073d80 con 0x7f05481028f0 2024-01-25T15:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054fa61640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0548073ef0 con 0x7f0548100d40 2024-01-25T15:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054fa61640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05481a0cd0 con 0x7f0548101f30 2024-01-25T15:04:26.664 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054d7fd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0548100d40 0x7f0548074aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.650+0000 7f054dffe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05481028f0 0x7f0548073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.651+0000 7f054cffc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0548101f30 0x7f05480730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.651+0000 7f054d7fd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0548100d40 0x7f0548074aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:55904/0 (socket says 172.21.15.170:55904) 2024-01-25T15:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.651+0000 7f054d7fd640 1 -- 172.21.15.170:0/1370780934 learned_addr learned my addr 172.21.15.170:0/1370780934 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.651+0000 7f054cffc640 1 -- 172.21.15.170:0/1370780934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0548100d40 msgr2=0x7f0548074aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.651+0000 7f054cffc640 1 --2- 172.21.15.170:0/1370780934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0548100d40 0x7f0548074aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.651+0000 7f054cffc640 1 -- 172.21.15.170:0/1370780934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05481028f0 msgr2=0x7f0548073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.651+0000 7f054cffc640 1 --2- 172.21.15.170:0/1370780934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05481028f0 0x7f0548073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.651+0000 7f054cffc640 1 -- 172.21.15.170:0/1370780934 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0538009900 con 0x7f0548101f30 2024-01-25T15:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.651+0000 7f054dffe640 1 --2- 172.21.15.170:0/1370780934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05481028f0 0x7f0548073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.651+0000 7f054cffc640 1 --2- 172.21.15.170:0/1370780934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0548101f30 0x7f05480730e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f053c00e9f0 tx=0x7f053c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.651+0000 7f05467fc640 1 -- 172.21.15.170:0/1370780934 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c00ccc0 con 0x7f0548101f30 2024-01-25T15:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.651+0000 7f05467fc640 1 -- 172.21.15.170:0/1370780934 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f053c00ce20 con 0x7f0548101f30 2024-01-25T15:04:26.665 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.651+0000 7f054fa61640 1 -- 172.21.15.170:0/1370780934 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05481a0f80 con 0x7f0548101f30 2024-01-25T15:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.651+0000 7f05467fc640 1 -- 172.21.15.170:0/1370780934 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c004a00 con 0x7f0548101f30 2024-01-25T15:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.651+0000 7f054fa61640 1 -- 172.21.15.170:0/1370780934 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05481a13b0 con 0x7f0548101f30 2024-01-25T15:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.653+0000 7f05467fc640 1 -- 172.21.15.170:0/1370780934 <== mon.1 v2:172.21.15.191:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f053c005020 con 0x7f0548101f30 2024-01-25T15:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f055261f740 1 Processor -- start 2024-01-25T15:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f055261f740 1 -- start start 2024-01-25T15:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f055261f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f802a0 0x55b2e4f806c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f055261f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f80c90 0x55b2e4f85790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f055261f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f85e00 0x55b2e4f88290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f055261f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2e4ef0070 con 0x55b2e4f802a0 2024-01-25T15:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f055261f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2e4eed760 con 0x55b2e4f80c90 2024-01-25T15:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f055261f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2e4ee9050 con 0x55b2e4f85e00 2024-01-25T15:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f054dffe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f802a0 0x55b2e4f806c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f05467fc640 1 --2- 172.21.15.170:0/1370780934 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f05300a1380 0x7f05300a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.666 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f054d7fd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f80c90 0x55b2e4f85790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f054cffc640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f85e00 0x55b2e4f88290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f054d7fd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f80c90 0x55b2e4f85790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.170:55916/0 (socket says 172.21.15.170:55916) 2024-01-25T15:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f054d7fd640 1 -- 172.21.15.170:0/289200726 learned_addr learned my addr 172.21.15.170:0/289200726 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f054dffe640 1 --2- 172.21.15.170:0/1370780934 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f05300a1380 0x7f05300a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f054d7fd640 1 -- 172.21.15.170:0/289200726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f85e00 msgr2=0x55b2e4f88290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f05467fc640 1 -- 172.21.15.170:0/1370780934 <== mon.1 v2:172.21.15.191:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f053c014070 con 0x7f0548101f30 2024-01-25T15:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f054d7fd640 1 --2- 172.21.15.170:0/289200726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f85e00 0x55b2e4f88290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f054d7fd640 1 -- 172.21.15.170:0/289200726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f802a0 msgr2=0x55b2e4f806c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f054d7fd640 1 --2- 172.21.15.170:0/289200726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f802a0 0x55b2e4f806c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.654+0000 7f054d7fd640 1 -- 172.21.15.170:0/289200726 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2e4ee0e70 con 0x55b2e4f80c90 2024-01-25T15:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.655+0000 7f054d7fd640 1 --2- 172.21.15.170:0/289200726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f80c90 0x55b2e4f85790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0538037040 tx=0x7f05380093f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4799942c4938a8c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.655+0000 7f054dffe640 1 --2- 172.21.15.170:0/1370780934 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f05300a1380 0x7f05300a3840 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55b2e4f814f0 tx=0x7f0540004730 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.655+0000 7f052f7fe640 1 -- 172.21.15.170:0/289200726 <== mon.2 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538032d50 con 0x55b2e4f80c90 2024-01-25T15:04:26.667 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.655+0000 7f052f7fe640 1 -- 172.21.15.170:0/289200726 <== mon.2 v2:172.21.15.186:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0538032eb0 con 0x55b2e4f80c90 2024-01-25T15:04:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.655+0000 7f052f7fe640 1 -- 172.21.15.170:0/289200726 <== mon.2 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538003970 con 0x55b2e4f80c90 2024-01-25T15:04:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.655+0000 7f055261f740 1 -- 172.21.15.170:0/289200726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f80c90 msgr2=0x55b2e4f85790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.655+0000 7f055261f740 1 --2- 172.21.15.170:0/289200726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f80c90 0x55b2e4f85790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0538037040 tx=0x7f05380093f0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.655+0000 7f055261f740 1 -- 172.21.15.170:0/289200726 shutdown_connections 2024-01-25T15:04:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.655+0000 7f055261f740 1 --2- 172.21.15.170:0/289200726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f80c90 0x55b2e4f85790 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.655+0000 7f055261f740 1 --2- 172.21.15.170:0/289200726 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f85e00 0x55b2e4f88290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.655+0000 7f055261f740 1 --2- 172.21.15.170:0/289200726 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f802a0 0x55b2e4f806c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.655+0000 7f055261f740 1 -- 172.21.15.170:0/289200726 >> 172.21.15.170:0/289200726 conn(0x55b2e4f7b810 msgr2=0x55b2e4f7bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f055261f740 1 -- 172.21.15.170:0/289200726 shutdown_connections 2024-01-25T15:04:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f055261f740 1 -- 172.21.15.170:0/289200726 wait complete. 2024-01-25T15:04:26.668 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f055261f740 1 -- start start 2024-01-25T15:04:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f055261f740 1 Processor -- start 2024-01-25T15:04:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f055261f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f802a0 0x55b2e4f8a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f055261f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f80c90 0x55b2e4f8a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f055261f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f85e00 0x55b2e4f91680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f055261f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2e4ea21e0 con 0x55b2e4f80c90 2024-01-25T15:04:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f055261f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2e4ea1e80 con 0x55b2e4f802a0 2024-01-25T15:04:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f055261f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2e4e670c0 con 0x55b2e4f85e00 2024-01-25T15:04:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f054cffc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f80c90 0x55b2e4f8a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f054cffc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f80c90 0x55b2e4f8a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35408/0 (socket says 172.21.15.170:35408) 2024-01-25T15:04:26.669 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f054d7fd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f802a0 0x55b2e4f8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f054cffc640 1 -- 172.21.15.170:0/2656559420 learned_addr learned my addr 172.21.15.170:0/2656559420 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f055261f740 10 client.0 _ll_register_callbacks cb 0x55b2e4e8cac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.656+0000 7f054dffe640 1 --2- 172.21.15.170:0/2656559420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f85e00 0x55b2e4f91680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f054cffc640 1 -- 172.21.15.170:0/2656559420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f85e00 msgr2=0x55b2e4f91680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f054cffc640 1 --2- 172.21.15.170:0/2656559420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f85e00 0x55b2e4f91680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f054cffc640 1 -- 172.21.15.170:0/2656559420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f802a0 msgr2=0x55b2e4f8a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f054cffc640 1 --2- 172.21.15.170:0/2656559420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f802a0 0x55b2e4f8a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f054cffc640 1 -- 172.21.15.170:0/2656559420 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0548109a80 con 0x55b2e4f80c90 2024-01-25T15:04:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f054d7fd640 1 --2- 172.21.15.170:0/2656559420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f802a0 0x55b2e4f8a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f054cffc640 1 --2- 172.21.15.170:0/2656559420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f80c90 0x55b2e4f8a640 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f053c099b60 tx=0x7f053c099710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd7f2ab759bb374 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f052cff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:26.670 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f052cff9640 1 -- 172.21.15.170:0/2656559420 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c0992c0 con 0x55b2e4f80c90 2024-01-25T15:04:26.671 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f052cff9640 1 -- 172.21.15.170:0/2656559420 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f053c099bd0 con 0x55b2e4f80c90 2024-01-25T15:04:26.671 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f055261f740 1 -- 172.21.15.170:0/2656559420 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2e4ee1d60 con 0x55b2e4f80c90 2024-01-25T15:04:26.671 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f052cff9640 1 -- 172.21.15.170:0/2656559420 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f053c09dd20 con 0x55b2e4f80c90 2024-01-25T15:04:26.671 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f055261f740 10 client.16233 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:26.671 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f055261f740 1 -- 172.21.15.170:0/2656559420 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55b2e4ee76d0 con 0x55b2e4f80c90 2024-01-25T15:04:26.671 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f052cff9640 1 -- 172.21.15.170:0/2656559420 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b2e4ee1d60 con 0x55b2e4f80c90 2024-01-25T15:04:26.671 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f052cff9640 1 -- 172.21.15.170:0/2656559420 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f053c004b60 con 0x55b2e4f80c90 2024-01-25T15:04:26.671 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f055261f740 10 client.16233 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:26.671 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f055261f740 10 client.16233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:04:26.671 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f055261f740 20 client.16233 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:26.671 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f055261f740 1 --2- 172.21.15.170:0/2656559420 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2e4f96040 0x55b2e4f98480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.671 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f055261f740 4 client.16233 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:04:26.672 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.657+0000 7f055261f740 1 -- 172.21.15.170:0/2656559420 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2e4be8600 con 0x55b2e4f96040 2024-01-25T15:04:26.672 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.658+0000 7f054d7fd640 1 --2- 172.21.15.170:0/2656559420 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2e4f96040 0x55b2e4f98480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.672 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.658+0000 7f054d7fd640 1 --2- 172.21.15.170:0/2656559420 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2e4f96040 0x55b2e4f98480 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6257f18a6e071d02 server_cookie=5cdcdf685e2c738f in_seq=0 out_seq=0 2024-01-25T15:04:26.672 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.658+0000 7f052cff9640 10 client.16233 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:26.672 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.659+0000 7f052cff9640 1 -- 172.21.15.170:0/2656559420 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b2e4be8600 con 0x55b2e4f96040 2024-01-25T15:04:26.672 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.659+0000 7f052cff9640 10 client.16233 handle_command_reply: tid=0 2024-01-25T15:04:26.672 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.659+0000 7f055261f740 1 client.16233 shutdown 2024-01-25T15:04:26.672 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.659+0000 7f055261f740 1 -- 172.21.15.170:0/2656559420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f80c90 msgr2=0x55b2e4f8a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:26.672 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.659+0000 7f055261f740 1 --2- 172.21.15.170:0/2656559420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f80c90 0x55b2e4f8a640 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f053c099b60 tx=0x7f053c099710 comp rx=0 tx=0).stop 2024-01-25T15:04:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.659+0000 7f055261f740 1 -- 172.21.15.170:0/2656559420 shutdown_connections 2024-01-25T15:04:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.659+0000 7f055261f740 1 --2- 172.21.15.170:0/2656559420 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2e4f96040 0x55b2e4f98480 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.659+0000 7f055261f740 1 --2- 172.21.15.170:0/2656559420 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f85e00 0x55b2e4f91680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.659+0000 7f052cff9640 0 client.16233 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.659+0000 7f055261f740 1 --2- 172.21.15.170:0/2656559420 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f80c90 0x55b2e4f8a640 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.659+0000 7f055261f740 1 --2- 172.21.15.170:0/2656559420 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f802a0 0x55b2e4f8a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.659+0000 7f055261f740 1 -- 172.21.15.170:0/2656559420 >> 172.21.15.170:0/2656559420 conn(0x55b2e4f7b810 msgr2=0x55b2e4f7aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.659+0000 7f055261f740 1 -- 172.21.15.170:0/2656559420 shutdown_connections 2024-01-25T15:04:26.673 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.659+0000 7f055261f740 1 -- 172.21.15.170:0/2656559420 wait complete. 2024-01-25T15:04:26.674 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.659+0000 7f055261f740 20 client.16233 trim_cache size 0 max 16384 2024-01-25T15:04:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.673+0000 7f055261f740 1 Processor -- start 2024-01-25T15:04:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.673+0000 7f055261f740 1 -- start start 2024-01-25T15:04:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.673+0000 7f055261f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f802a0 0x55b2e4f8a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.673+0000 7f055261f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f80c90 0x55b2e4f91640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.679 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.673+0000 7f055261f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f85e00 0x55b2e4f8a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.673+0000 7f055261f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2e4be8600 con 0x55b2e4f802a0 2024-01-25T15:04:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.673+0000 7f055261f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2e4ee1d60 con 0x55b2e4f85e00 2024-01-25T15:04:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.673+0000 7f055261f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2e4f81380 con 0x55b2e4f80c90 2024-01-25T15:04:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.673+0000 7f054d7fd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f802a0 0x55b2e4f8a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.673+0000 7f054d7fd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f802a0 0x55b2e4f8a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35424/0 (socket says 172.21.15.170:35424) 2024-01-25T15:04:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.673+0000 7f054d7fd640 1 -- 172.21.15.170:0/456414648 learned_addr learned my addr 172.21.15.170:0/456414648 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.673+0000 7f054cffc640 1 --2- 172.21.15.170:0/456414648 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f80c90 0x55b2e4f91640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.673+0000 7f054dffe640 1 --2- 172.21.15.170:0/456414648 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f85e00 0x55b2e4f8a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.674+0000 7f054d7fd640 1 -- 172.21.15.170:0/456414648 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f80c90 msgr2=0x55b2e4f91640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.674+0000 7f054d7fd640 1 --2- 172.21.15.170:0/456414648 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f80c90 0x55b2e4f91640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.674+0000 7f054d7fd640 1 -- 172.21.15.170:0/456414648 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f85e00 msgr2=0x55b2e4f8a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:26.680 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.674+0000 7f054d7fd640 1 --2- 172.21.15.170:0/456414648 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f85e00 0x55b2e4f8a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.674+0000 7f054d7fd640 1 -- 172.21.15.170:0/456414648 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2e4e84060 con 0x55b2e4f802a0 2024-01-25T15:04:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.674+0000 7f054d7fd640 1 --2- 172.21.15.170:0/456414648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f802a0 0x55b2e4f8a0e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f053802e010 tx=0x7f0538032690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5539dbcebe35d4db server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.674+0000 7f052effd640 1 -- 172.21.15.170:0/456414648 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053804e040 con 0x55b2e4f802a0 2024-01-25T15:04:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.674+0000 7f052effd640 1 -- 172.21.15.170:0/456414648 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0538032aa0 con 0x55b2e4f802a0 2024-01-25T15:04:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.674+0000 7f052effd640 1 -- 172.21.15.170:0/456414648 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538003bd0 con 0x55b2e4f802a0 2024-01-25T15:04:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.674+0000 7f055261f740 1 -- 172.21.15.170:0/456414648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f802a0 msgr2=0x55b2e4f8a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.674+0000 7f055261f740 1 --2- 172.21.15.170:0/456414648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f802a0 0x55b2e4f8a0e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f053802e010 tx=0x7f0538032690 comp rx=0 tx=0).stop 2024-01-25T15:04:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 1 -- 172.21.15.170:0/456414648 shutdown_connections 2024-01-25T15:04:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 1 --2- 172.21.15.170:0/456414648 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f85e00 0x55b2e4f8a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 1 --2- 172.21.15.170:0/456414648 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f80c90 0x55b2e4f91640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 1 --2- 172.21.15.170:0/456414648 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f802a0 0x55b2e4f8a0e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 1 -- 172.21.15.170:0/456414648 >> 172.21.15.170:0/456414648 conn(0x55b2e4f7b810 msgr2=0x55b2e4f81df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 1 -- 172.21.15.170:0/456414648 shutdown_connections 2024-01-25T15:04:26.681 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 1 -- 172.21.15.170:0/456414648 wait complete. 2024-01-25T15:04:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 1 -- start start 2024-01-25T15:04:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 1 Processor -- start 2024-01-25T15:04:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f802a0 0x55b2e4f91190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f80c90 0x55b2e4f8f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f85e00 0x55b2e4f8fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2e4f91980 con 0x55b2e4f80c90 2024-01-25T15:04:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2e4f90220 con 0x55b2e4f85e00 2024-01-25T15:04:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2e4f903e0 con 0x55b2e4f802a0 2024-01-25T15:04:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f055261f740 10 client.0 _ll_register_callbacks cb 0x7f0540005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:26.682 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f054cffc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f80c90 0x55b2e4f8f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f054cffc640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f80c90 0x55b2e4f8f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:35440/0 (socket says 172.21.15.170:35440) 2024-01-25T15:04:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f054cffc640 1 -- 172.21.15.170:0/812921498 learned_addr learned my addr 172.21.15.170:0/812921498 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f054d7fd640 1 --2- 172.21.15.170:0/812921498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f802a0 0x55b2e4f91190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.675+0000 7f054dffe640 1 --2- 172.21.15.170:0/812921498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f85e00 0x55b2e4f8fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f054cffc640 1 -- 172.21.15.170:0/812921498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f802a0 msgr2=0x55b2e4f91190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f054cffc640 1 --2- 172.21.15.170:0/812921498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f802a0 0x55b2e4f91190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f054cffc640 1 -- 172.21.15.170:0/812921498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f85e00 msgr2=0x55b2e4f8fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f054cffc640 1 --2- 172.21.15.170:0/812921498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f85e00 0x55b2e4f8fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f054cffc640 1 -- 172.21.15.170:0/812921498 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b2e4ee0e70 con 0x55b2e4f80c90 2024-01-25T15:04:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f054cffc640 1 --2- 172.21.15.170:0/812921498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f80c90 0x55b2e4f8f7a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f053c00e9c0 tx=0x7f053c098180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc0477e1e2ce3d6 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f052cff9640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:26.683 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f052cff9640 1 -- 172.21.15.170:0/812921498 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c0a1cd0 con 0x55b2e4f80c90 2024-01-25T15:04:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f052cff9640 1 -- 172.21.15.170:0/812921498 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f053c09dd20 con 0x55b2e4f80c90 2024-01-25T15:04:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f055261f740 1 -- 172.21.15.170:0/812921498 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2e4ee2040 con 0x55b2e4f80c90 2024-01-25T15:04:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f052cff9640 1 -- 172.21.15.170:0/812921498 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f053c099530 con 0x55b2e4f80c90 2024-01-25T15:04:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f055261f740 10 client.16239 fetch_fsmap learned FSMap version 40 2024-01-25T15:04:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f055261f740 1 -- 172.21.15.170:0/812921498 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x55b2e4ea9a80 con 0x55b2e4f80c90 2024-01-25T15:04:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f052cff9640 1 -- 172.21.15.170:0/812921498 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b2e4ee2040 con 0x55b2e4f80c90 2024-01-25T15:04:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f052cff9640 1 -- 172.21.15.170:0/812921498 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 40) v1 ==== 7954+0+0 (secure 0 0 0) 0x7f053c098b30 con 0x55b2e4f80c90 2024-01-25T15:04:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f055261f740 10 client.16239 fetch_fsmap finished waiting for FSMap version 40 2024-01-25T15:04:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f055261f740 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:04:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f055261f740 20 client.16239 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:26.684 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f055261f740 1 --2- 172.21.15.170:0/812921498 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2e4fed880 0x55b2e4fefca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f055261f740 4 client.16239 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-25T15:04:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.676+0000 7f055261f740 1 -- 172.21.15.170:0/812921498 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b2e4c3bc50 con 0x55b2e4fed880 2024-01-25T15:04:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.677+0000 7f054d7fd640 1 --2- 172.21.15.170:0/812921498 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2e4fed880 0x55b2e4fefca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.677+0000 7f052cff9640 10 client.16239 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:26.685 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.677+0000 7f054d7fd640 1 --2- 172.21.15.170:0/812921498 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2e4fed880 0x55b2e4fefca0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eff2edb8abe1e918 server_cookie=c8a157fe0eadc7b5 in_seq=0 out_seq=0 2024-01-25T15:04:26.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.748+0000 7f052cff9640 1 -- 172.21.15.170:0/812921498 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b2e4c3bc50 con 0x55b2e4fed880 2024-01-25T15:04:26.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.748+0000 7f052cff9640 10 client.16239 handle_command_reply: tid=0 2024-01-25T15:04:26.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.748+0000 7f055261f740 1 client.16239 shutdown 2024-01-25T15:04:26.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.748+0000 7f055261f740 1 -- 172.21.15.170:0/812921498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f80c90 msgr2=0x55b2e4f8f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:26.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.748+0000 7f055261f740 1 --2- 172.21.15.170:0/812921498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f80c90 0x55b2e4f8f7a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f053c00e9c0 tx=0x7f053c098180 comp rx=0 tx=0).stop 2024-01-25T15:04:26.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.748+0000 7f055261f740 1 -- 172.21.15.170:0/812921498 shutdown_connections 2024-01-25T15:04:26.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.748+0000 7f055261f740 1 --2- 172.21.15.170:0/812921498 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x55b2e4fed880 0x55b2e4fefca0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.748+0000 7f055261f740 1 --2- 172.21.15.170:0/812921498 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55b2e4f85e00 0x55b2e4f8fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.748+0000 7f055261f740 1 --2- 172.21.15.170:0/812921498 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x55b2e4f80c90 0x55b2e4f8f7a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.748+0000 7f055261f740 1 --2- 172.21.15.170:0/812921498 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x55b2e4f802a0 0x55b2e4f91190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.748+0000 7f055261f740 1 -- 172.21.15.170:0/812921498 >> 172.21.15.170:0/812921498 conn(0x55b2e4f7b810 msgr2=0x55b2e4f81df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:26.750 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.748+0000 7f052cff9640 0 client.16239 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.748+0000 7f055261f740 1 -- 172.21.15.170:0/812921498 shutdown_connections 2024-01-25T15:04:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.748+0000 7f055261f740 1 -- 172.21.15.170:0/812921498 wait complete. 2024-01-25T15:04:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.748+0000 7f055261f740 20 client.16239 trim_cache size 0 max 16384 2024-01-25T15:04:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:{ 2024-01-25T15:04:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "message": "", 2024-01-25T15:04:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "return_code": 0 2024-01-25T15:04:26.751 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:} 2024-01-25T15:04:26.752 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.749+0000 7f054fa61640 1 -- 172.21.15.170:0/1370780934 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f05300a1380 msgr2=0x7f05300a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:26.752 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.749+0000 7f054fa61640 1 --2- 172.21.15.170:0/1370780934 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f05300a1380 0x7f05300a3840 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55b2e4f814f0 tx=0x7f0540004730 comp rx=0 tx=0).stop 2024-01-25T15:04:26.752 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.749+0000 7f054fa61640 1 -- 172.21.15.170:0/1370780934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0548101f30 msgr2=0x7f05480730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.749+0000 7f054fa61640 1 --2- 172.21.15.170:0/1370780934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0548101f30 0x7f05480730e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f053c00e9f0 tx=0x7f053c00eeb0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.749+0000 7f054fa61640 1 -- 172.21.15.170:0/1370780934 shutdown_connections 2024-01-25T15:04:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.749+0000 7f054fa61640 1 --2- 172.21.15.170:0/1370780934 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f05300a1380 0x7f05300a3840 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.749+0000 7f054fa61640 1 --2- 172.21.15.170:0/1370780934 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f05481028f0 0x7f0548073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.749+0000 7f054fa61640 1 --2- 172.21.15.170:0/1370780934 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f0548101f30 0x7f05480730e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.749+0000 7f054fa61640 1 --2- 172.21.15.170:0/1370780934 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0548100d40 0x7f0548074aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.749+0000 7f054fa61640 1 -- 172.21.15.170:0/1370780934 >> 172.21.15.170:0/1370780934 conn(0x7f05480fc2b0 msgr2=0x7f0548105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.749+0000 7f054fa61640 1 -- 172.21.15.170:0/1370780934 shutdown_connections 2024-01-25T15:04:26.753 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:26.749+0000 7f054fa61640 1 -- 172.21.15.170:0/1370780934 wait complete. 2024-01-25T15:04:27.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:27 smithi186 ceph-mon[35697]: pgmap v422: 97 pgs: 97 active+clean; 59 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 451 op/s 2024-01-25T15:04:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:27 smithi170 ceph-mon[31899]: pgmap v422: 97 pgs: 97 active+clean; 59 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 451 op/s 2024-01-25T15:04:27.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:27 smithi191 ceph-mon[36347]: pgmap v422: 97 pgs: 97 active+clean; 59 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 451 op/s 2024-01-25T15:04:29.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:29 smithi170 ceph-mon[31899]: pgmap v423: 97 pgs: 97 active+clean; 54 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 470 op/s 2024-01-25T15:04:29.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:29 smithi191 ceph-mon[36347]: pgmap v423: 97 pgs: 97 active+clean; 54 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 470 op/s 2024-01-25T15:04:29.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:29 smithi186 ceph-mon[35697]: pgmap v423: 97 pgs: 97 active+clean; 54 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 470 op/s 2024-01-25T15:04:31.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:31 smithi186 ceph-mon[35697]: pgmap v424: 97 pgs: 97 active+clean; 50 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 494 op/s 2024-01-25T15:04:31.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:31 smithi170 ceph-mon[31899]: pgmap v424: 97 pgs: 97 active+clean; 50 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 494 op/s 2024-01-25T15:04:31.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:31 smithi191 ceph-mon[36347]: pgmap v424: 97 pgs: 97 active+clean; 50 MiB data, 866 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 494 op/s 2024-01-25T15:04:33.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:33 smithi186 ceph-mon[35697]: pgmap v425: 97 pgs: 97 active+clean; 49 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 418 op/s 2024-01-25T15:04:33.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:33 smithi170 ceph-mon[31899]: pgmap v425: 97 pgs: 97 active+clean; 49 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 418 op/s 2024-01-25T15:04:33.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:33 smithi191 ceph-mon[36347]: pgmap v425: 97 pgs: 97 active+clean; 49 MiB data, 850 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 418 op/s 2024-01-25T15:04:35.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:35 smithi186 ceph-mon[35697]: pgmap v426: 97 pgs: 97 active+clean; 55 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 474 op/s 2024-01-25T15:04:35.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:35 smithi170 ceph-mon[31899]: pgmap v426: 97 pgs: 97 active+clean; 55 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 474 op/s 2024-01-25T15:04:35.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:35 smithi191 ceph-mon[36347]: pgmap v426: 97 pgs: 97 active+clean; 55 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 474 op/s 2024-01-25T15:04:37.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:37 smithi186 ceph-mon[35697]: pgmap v427: 97 pgs: 97 active+clean; 57 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 403 op/s 2024-01-25T15:04:37.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:37 smithi170 ceph-mon[31899]: pgmap v427: 97 pgs: 97 active+clean; 57 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 403 op/s 2024-01-25T15:04:37.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:37 smithi191 ceph-mon[36347]: pgmap v427: 97 pgs: 97 active+clean; 57 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 403 op/s 2024-01-25T15:04:39.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:39 smithi170 ceph-mon[31899]: pgmap v428: 97 pgs: 97 active+clean; 58 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 418 op/s 2024-01-25T15:04:39.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:39 smithi191 ceph-mon[36347]: pgmap v428: 97 pgs: 97 active+clean; 58 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 418 op/s 2024-01-25T15:04:39.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:39 smithi186 ceph-mon[35697]: pgmap v428: 97 pgs: 97 active+clean; 58 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 418 op/s 2024-01-25T15:04:39.844 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.841+0000 7ff718333640 1 -- 172.21.15.170:0/3761433928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff710100e00 msgr2=0x7ff710101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.844 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.841+0000 7ff718333640 1 --2- 172.21.15.170:0/3761433928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff710100e00 0x7ff710101280 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff700009900 tx=0x7ff70002bc30 comp rx=0 tx=0).stop 2024-01-25T15:04:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.841+0000 7ff718333640 1 -- 172.21.15.170:0/3761433928 shutdown_connections 2024-01-25T15:04:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.841+0000 7ff718333640 1 --2- 172.21.15.170:0/3761433928 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7101017c0 0x7ff710108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.841+0000 7ff718333640 1 --2- 172.21.15.170:0/3761433928 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff710100e00 0x7ff710101280 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.841+0000 7ff718333640 1 --2- 172.21.15.170:0/3761433928 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7100ffc10 0x7ff710100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.841+0000 7ff718333640 1 -- 172.21.15.170:0/3761433928 >> 172.21.15.170:0/3761433928 conn(0x7ff7100fb180 msgr2=0x7ff7100fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.841+0000 7ff718333640 1 -- 172.21.15.170:0/3761433928 shutdown_connections 2024-01-25T15:04:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.841+0000 7ff718333640 1 -- 172.21.15.170:0/3761433928 wait complete. 2024-01-25T15:04:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff718333640 1 Processor -- start 2024-01-25T15:04:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff718333640 1 -- start start 2024-01-25T15:04:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff718333640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7100ffc10 0x7ff710103c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff718333640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff710100e00 0x7ff710102250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff718333640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7101017c0 0x7ff710102790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff718333640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff710102ef0 con 0x7ff710100e00 2024-01-25T15:04:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff718333640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff710103060 con 0x7ff7100ffc10 2024-01-25T15:04:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff718333640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7101a0bf0 con 0x7ff7101017c0 2024-01-25T15:04:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff7158ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff710100e00 0x7ff710102250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff7160cf640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7100ffc10 0x7ff710103c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff7158ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff710100e00 0x7ff710102250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49670/0 (socket says 172.21.15.170:49670) 2024-01-25T15:04:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff7158ce640 1 -- 172.21.15.170:0/3801284153 learned_addr learned my addr 172.21.15.170:0/3801284153 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff7168d0640 1 --2- 172.21.15.170:0/3801284153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7101017c0 0x7ff710102790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff7158ce640 1 -- 172.21.15.170:0/3801284153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7101017c0 msgr2=0x7ff710102790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff7158ce640 1 --2- 172.21.15.170:0/3801284153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7101017c0 0x7ff710102790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff7158ce640 1 -- 172.21.15.170:0/3801284153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7100ffc10 msgr2=0x7ff710103c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff7158ce640 1 --2- 172.21.15.170:0/3801284153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7100ffc10 0x7ff710103c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff7158ce640 1 -- 172.21.15.170:0/3801284153 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff700009560 con 0x7ff710100e00 2024-01-25T15:04:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.842+0000 7ff7158ce640 1 --2- 172.21.15.170:0/3801284153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff710100e00 0x7ff710102250 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff700009430 tx=0x7ff700004ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.843+0000 7ff7077fe640 1 -- 172.21.15.170:0/3801284153 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700004350 con 0x7ff710100e00 2024-01-25T15:04:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.843+0000 7ff718333640 1 -- 172.21.15.170:0/3801284153 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7101a0e40 con 0x7ff710100e00 2024-01-25T15:04:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.843+0000 7ff7077fe640 1 -- 172.21.15.170:0/3801284153 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7000044b0 con 0x7ff710100e00 2024-01-25T15:04:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.843+0000 7ff7077fe640 1 -- 172.21.15.170:0/3801284153 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff700003e80 con 0x7ff710100e00 2024-01-25T15:04:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.843+0000 7ff718333640 1 -- 172.21.15.170:0/3801284153 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7101a12c0 con 0x7ff710100e00 2024-01-25T15:04:39.853 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.845+0000 7ff7077fe640 1 -- 172.21.15.170:0/3801284153 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7ff7000035f0 con 0x7ff710100e00 2024-01-25T15:04:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.846+0000 7ff71afce740 1 Processor -- start 2024-01-25T15:04:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.846+0000 7ff7077fe640 1 --2- 172.21.15.170:0/3801284153 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6fc0a1380 0x7ff6fc0a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.846+0000 7ff7168d0640 1 --2- 172.21.15.170:0/3801284153 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6fc0a1380 0x7ff6fc0a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.846+0000 7ff7077fe640 1 -- 172.21.15.170:0/3801284153 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7ff7000eedf0 con 0x7ff710100e00 2024-01-25T15:04:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.846+0000 7ff71afce740 1 -- start start 2024-01-25T15:04:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.846+0000 7ff71afce740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f45d2a0 0x56181f45d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.846+0000 7ff71afce740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45dc90 0x56181f462790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.846+0000 7ff71afce740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f462e00 0x56181f465290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.846+0000 7ff71afce740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f3cd070 con 0x56181f462e00 2024-01-25T15:04:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.846+0000 7ff71afce740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f3ca760 con 0x56181f45d2a0 2024-01-25T15:04:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.846+0000 7ff71afce740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f3c6050 con 0x56181f45dc90 2024-01-25T15:04:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff7158ce640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45dc90 0x56181f462790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff7168d0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f462e00 0x56181f465290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.854 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff7158ce640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45dc90 0x56181f462790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:34808/0 (socket says 172.21.15.170:34808) 2024-01-25T15:04:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff7158ce640 1 -- 172.21.15.170:0/1944951690 learned_addr learned my addr 172.21.15.170:0/1944951690 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff7168d0640 1 --2- 172.21.15.170:0/3801284153 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6fc0a1380 0x7ff6fc0a3840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff708005fd0 tx=0x7ff708009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff7160cf640 1 --2- 172.21.15.170:0/1944951690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f45d2a0 0x56181f45d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff7158ce640 1 -- 172.21.15.170:0/1944951690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f45d2a0 msgr2=0x56181f45d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff7158ce640 1 --2- 172.21.15.170:0/1944951690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f45d2a0 0x56181f45d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff7158ce640 1 -- 172.21.15.170:0/1944951690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f462e00 msgr2=0x56181f465290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff7158ce640 1 --2- 172.21.15.170:0/1944951690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f462e00 0x56181f465290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff7158ce640 1 -- 172.21.15.170:0/1944951690 --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56181f3bde70 con 0x56181f45dc90 2024-01-25T15:04:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff7168d0640 1 --2- 172.21.15.170:0/1944951690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f462e00 0x56181f465290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff7158ce640 1 --2- 172.21.15.170:0/1944951690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45dc90 0x56181f462790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7000c3dc0 tx=0x7ff700003920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56297a5da19c9681 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff704bfe640 1 -- 172.21.15.170:0/1944951690 <== mon.1 v2:172.21.15.191:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7000bbf60 con 0x56181f45dc90 2024-01-25T15:04:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff704bfe640 1 -- 172.21.15.170:0/1944951690 <== mon.1 v2:172.21.15.191:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7000c00b0 con 0x56181f45dc90 2024-01-25T15:04:39.855 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.847+0000 7ff704bfe640 1 -- 172.21.15.170:0/1944951690 <== mon.1 v2:172.21.15.191:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7000bb6b0 con 0x56181f45dc90 2024-01-25T15:04:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.848+0000 7ff71afce740 1 -- 172.21.15.170:0/1944951690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45dc90 msgr2=0x56181f462790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.848+0000 7ff71afce740 1 --2- 172.21.15.170:0/1944951690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45dc90 0x56181f462790 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff7000c3dc0 tx=0x7ff700003920 comp rx=0 tx=0).stop 2024-01-25T15:04:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.848+0000 7ff71afce740 1 -- 172.21.15.170:0/1944951690 shutdown_connections 2024-01-25T15:04:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.848+0000 7ff71afce740 1 --2- 172.21.15.170:0/1944951690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f462e00 0x56181f465290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.848+0000 7ff71afce740 1 --2- 172.21.15.170:0/1944951690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45dc90 0x56181f462790 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.848+0000 7ff71afce740 1 --2- 172.21.15.170:0/1944951690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f45d2a0 0x56181f45d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.848+0000 7ff71afce740 1 -- 172.21.15.170:0/1944951690 >> 172.21.15.170:0/1944951690 conn(0x56181f458810 msgr2=0x56181f458c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.848+0000 7ff71afce740 1 -- 172.21.15.170:0/1944951690 shutdown_connections 2024-01-25T15:04:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.848+0000 7ff71afce740 1 -- 172.21.15.170:0/1944951690 wait complete. 2024-01-25T15:04:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.848+0000 7ff71afce740 1 -- start start 2024-01-25T15:04:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.848+0000 7ff71afce740 1 Processor -- start 2024-01-25T15:04:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff71afce740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45d2a0 0x56181f466fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.856 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff71afce740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f4674e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff71afce740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 0x56181f46e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff71afce740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f37f1e0 con 0x56181f45dc90 2024-01-25T15:04:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff71afce740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f37ee80 con 0x56181f462e00 2024-01-25T15:04:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff71afce740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f3440c0 con 0x56181f45d2a0 2024-01-25T15:04:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff71afce740 10 client.0 _ll_register_callbacks cb 0x56181f369ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff7158ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f4674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff7160cf640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45d2a0 0x56181f466fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff7158ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f4674e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49688/0 (socket says 172.21.15.170:49688) 2024-01-25T15:04:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff7158ce640 1 -- 172.21.15.170:0/2334287088 learned_addr learned my addr 172.21.15.170:0/2334287088 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff7168d0640 1 --2- 172.21.15.170:0/2334287088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 0x56181f46e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff7158ce640 1 -- 172.21.15.170:0/2334287088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45d2a0 msgr2=0x56181f466fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff7158ce640 1 --2- 172.21.15.170:0/2334287088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45d2a0 0x56181f466fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff7158ce640 1 -- 172.21.15.170:0/2334287088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 msgr2=0x56181f46e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff7158ce640 1 --2- 172.21.15.170:0/2334287088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 0x56181f46e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.857 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff7158ce640 1 -- 172.21.15.170:0/2334287088 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7101a12c0 con 0x56181f45dc90 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff7168d0640 1 --2- 172.21.15.170:0/2334287088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 0x56181f46e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff7158ce640 1 --2- 172.21.15.170:0/2334287088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f4674e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff7000ecc90 tx=0x7ff7000b83d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b79d939cb85bd7 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff6f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff6f9ffb640 1 -- 172.21.15.170:0/2334287088 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7000bbf60 con 0x56181f45dc90 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff6f9ffb640 1 -- 172.21.15.170:0/2334287088 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7ff7000c4070 con 0x56181f45dc90 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff71afce740 1 -- 172.21.15.170:0/2334287088 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56181f3bf040 con 0x56181f45dc90 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff6f9ffb640 1 -- 172.21.15.170:0/2334287088 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7000cfba0 con 0x56181f45dc90 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff71afce740 10 client.16251 fetch_fsmap learned FSMap version 41 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.849+0000 7ff71afce740 1 -- 172.21.15.170:0/2334287088 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x56181f3c46d0 con 0x56181f45dc90 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.850+0000 7ff6f9ffb640 1 -- 172.21.15.170:0/2334287088 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56181f3bf040 con 0x56181f45dc90 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.850+0000 7ff6f9ffb640 1 -- 172.21.15.170:0/2334287088 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 41) v1 ==== 7958+0+0 (secure 0 0 0) 0x7ff70003c070 con 0x56181f45dc90 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.850+0000 7ff71afce740 10 client.16251 fetch_fsmap finished waiting for FSMap version 41 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.850+0000 7ff71afce740 10 client.16251 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.850+0000 7ff71afce740 20 client.16251 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.850+0000 7ff71afce740 1 --2- 172.21.15.170:0/2334287088 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56181f472930 0x56181f474d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.858 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.850+0000 7ff71afce740 4 client.16251 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-25T15:04:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.850+0000 7ff71afce740 1 -- 172.21.15.170:0/2334287088 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56181f3bed60 con 0x56181f472930 2024-01-25T15:04:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.850+0000 7ff7160cf640 1 --2- 172.21.15.170:0/2334287088 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56181f472930 0x56181f474d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.850+0000 7ff7160cf640 1 --2- 172.21.15.170:0/2334287088 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56181f472930 0x56181f474d50 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14f9c9e66285a74c server_cookie=19a3862696ead694 in_seq=0 out_seq=0 2024-01-25T15:04:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.850+0000 7ff6f9ffb640 10 client.16251 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.852+0000 7ff6f9ffb640 1 -- 172.21.15.170:0/2334287088 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56181f3bed60 con 0x56181f472930 2024-01-25T15:04:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.852+0000 7ff6f9ffb640 10 client.16251 handle_command_reply: tid=0 2024-01-25T15:04:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.852+0000 7ff71afce740 1 client.16251 shutdown 2024-01-25T15:04:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.852+0000 7ff71afce740 1 -- 172.21.15.170:0/2334287088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 msgr2=0x56181f4674e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.852+0000 7ff71afce740 1 --2- 172.21.15.170:0/2334287088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f4674e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff7000ecc90 tx=0x7ff7000b83d0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.852+0000 7ff71afce740 1 -- 172.21.15.170:0/2334287088 shutdown_connections 2024-01-25T15:04:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.852+0000 7ff71afce740 1 --2- 172.21.15.170:0/2334287088 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56181f472930 0x56181f474d50 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.852+0000 7ff71afce740 1 --2- 172.21.15.170:0/2334287088 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 0x56181f46e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.852+0000 7ff71afce740 1 --2- 172.21.15.170:0/2334287088 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f4674e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.859 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.852+0000 7ff6f9ffb640 0 client.16251 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.852+0000 7ff71afce740 1 --2- 172.21.15.170:0/2334287088 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45d2a0 0x56181f466fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.852+0000 7ff71afce740 1 -- 172.21.15.170:0/2334287088 >> 172.21.15.170:0/2334287088 conn(0x56181f458810 msgr2=0x56181f457a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.852+0000 7ff71afce740 1 -- 172.21.15.170:0/2334287088 shutdown_connections 2024-01-25T15:04:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.852+0000 7ff71afce740 1 -- 172.21.15.170:0/2334287088 wait complete. 2024-01-25T15:04:39.860 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.852+0000 7ff71afce740 20 client.16251 trim_cache size 0 max 16384 2024-01-25T15:04:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff71afce740 1 Processor -- start 2024-01-25T15:04:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff71afce740 1 -- start start 2024-01-25T15:04:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff71afce740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45d2a0 0x56181f4665c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff71afce740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f46e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.869 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff71afce740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 0x56181f45ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff71afce740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f3bed60 con 0x56181f45dc90 2024-01-25T15:04:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff71afce740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f3bf040 con 0x56181f462e00 2024-01-25T15:04:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff71afce740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f45e520 con 0x56181f45d2a0 2024-01-25T15:04:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff7158ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f46e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff7158ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f46e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49692/0 (socket says 172.21.15.170:49692) 2024-01-25T15:04:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff7158ce640 1 -- 172.21.15.170:0/2055420848 learned_addr learned my addr 172.21.15.170:0/2055420848 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff7168d0640 1 --2- 172.21.15.170:0/2055420848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 0x56181f45ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff7158ce640 1 -- 172.21.15.170:0/2055420848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45d2a0 msgr2=0x56181f4665c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff7158ce640 1 --2- 172.21.15.170:0/2055420848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45d2a0 0x56181f4665c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff7158ce640 1 -- 172.21.15.170:0/2055420848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 msgr2=0x56181f45ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.868+0000 7ff7158ce640 1 --2- 172.21.15.170:0/2055420848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 0x56181f45ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.870 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.869+0000 7ff7158ce640 1 -- 172.21.15.170:0/2055420848 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56181f361060 con 0x56181f45dc90 2024-01-25T15:04:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.869+0000 7ff7158ce640 1 --2- 172.21.15.170:0/2055420848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f46e4e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff70002c6b0 tx=0x7ff700005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d924da10a058c2d server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.869+0000 7ff6fbfff640 1 -- 172.21.15.170:0/2055420848 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7000bafb0 con 0x56181f45dc90 2024-01-25T15:04:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.869+0000 7ff6fbfff640 1 -- 172.21.15.170:0/2055420848 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7000bbf60 con 0x56181f45dc90 2024-01-25T15:04:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.869+0000 7ff6fbfff640 1 -- 172.21.15.170:0/2055420848 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7000b6c50 con 0x56181f45dc90 2024-01-25T15:04:39.874 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.870+0000 7ff71afce740 1 -- 172.21.15.170:0/2055420848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 msgr2=0x56181f46e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.870+0000 7ff71afce740 1 --2- 172.21.15.170:0/2055420848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f46e4e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7ff70002c6b0 tx=0x7ff700005fd0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.870+0000 7ff71afce740 1 -- 172.21.15.170:0/2055420848 shutdown_connections 2024-01-25T15:04:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.870+0000 7ff71afce740 1 --2- 172.21.15.170:0/2055420848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 0x56181f45ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.870+0000 7ff71afce740 1 --2- 172.21.15.170:0/2055420848 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f46e4e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.870+0000 7ff71afce740 1 --2- 172.21.15.170:0/2055420848 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45d2a0 0x56181f4665c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.870+0000 7ff71afce740 1 -- 172.21.15.170:0/2055420848 >> 172.21.15.170:0/2055420848 conn(0x56181f458810 msgr2=0x56181f4624b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.870+0000 7ff71afce740 1 -- 172.21.15.170:0/2055420848 shutdown_connections 2024-01-25T15:04:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.870+0000 7ff71afce740 1 -- 172.21.15.170:0/2055420848 wait complete. 2024-01-25T15:04:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff71afce740 1 -- start start 2024-01-25T15:04:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff71afce740 1 Processor -- start 2024-01-25T15:04:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff71afce740 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45d2a0 0x56181f46c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff71afce740 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f46c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff71afce740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 0x56181f46d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.875 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff71afce740 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f46dbe0 con 0x56181f45dc90 2024-01-25T15:04:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff71afce740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f46dd50 con 0x56181f462e00 2024-01-25T15:04:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff71afce740 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x56181f46df10 con 0x56181f45d2a0 2024-01-25T15:04:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff71afce740 10 client.0 _ll_register_callbacks cb 0x7ff700005730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-25T15:04:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff7158ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f46c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff7158ce640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f46c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49696/0 (socket says 172.21.15.170:49696) 2024-01-25T15:04:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff7158ce640 1 -- 172.21.15.170:0/3839206573 learned_addr learned my addr 172.21.15.170:0/3839206573 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff7168d0640 1 --2- 172.21.15.170:0/3839206573 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 0x56181f46d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff7160cf640 1 --2- 172.21.15.170:0/3839206573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45d2a0 0x56181f46c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff7158ce640 1 -- 172.21.15.170:0/3839206573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45d2a0 msgr2=0x56181f46c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.871+0000 7ff7158ce640 1 --2- 172.21.15.170:0/3839206573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45d2a0 0x56181f46c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.872+0000 7ff7158ce640 1 -- 172.21.15.170:0/3839206573 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 msgr2=0x56181f46d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-25T15:04:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.872+0000 7ff7158ce640 1 --2- 172.21.15.170:0/3839206573 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 0x56181f46d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.872+0000 7ff7158ce640 1 -- 172.21.15.170:0/3839206573 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7101a12c0 con 0x56181f45dc90 2024-01-25T15:04:39.876 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.872+0000 7ff7158ce640 1 --2- 172.21.15.170:0/3839206573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f46c6e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff7000c44b0 tx=0x7ff7000b83d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e1e2afd44d0701 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.872+0000 7ff6f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.170:3300/0 2024-01-25T15:04:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.872+0000 7ff6f9ffb640 1 -- 172.21.15.170:0/3839206573 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7000bafb0 con 0x56181f45dc90 2024-01-25T15:04:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.872+0000 7ff6f9ffb640 1 -- 172.21.15.170:0/3839206573 <== mon.0 v2:172.21.15.170:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7ff7000b6c50 con 0x56181f45dc90 2024-01-25T15:04:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.872+0000 7ff71afce740 1 -- 172.21.15.170:0/3839206573 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7000c00b0 con 0x56181f45dc90 2024-01-25T15:04:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.872+0000 7ff6f9ffb640 1 -- 172.21.15.170:0/3839206573 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7000cfba0 con 0x56181f45dc90 2024-01-25T15:04:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.872+0000 7ff71afce740 10 client.16257 fetch_fsmap learned FSMap version 41 2024-01-25T15:04:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.872+0000 7ff71afce740 1 -- 172.21.15.170:0/3839206573 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x56181f386a80 con 0x56181f45dc90 2024-01-25T15:04:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.872+0000 7ff6f9ffb640 1 -- 172.21.15.170:0/3839206573 <== mon.0 v2:172.21.15.170:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7000aa070 con 0x56181f45dc90 2024-01-25T15:04:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.873+0000 7ff6f9ffb640 1 -- 172.21.15.170:0/3839206573 <== mon.0 v2:172.21.15.170:3300/0 5 ==== fsmap(e 41) v1 ==== 7958+0+0 (secure 0 0 0) 0x7ff70003c070 con 0x56181f45dc90 2024-01-25T15:04:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.873+0000 7ff71afce740 10 client.16257 fetch_fsmap finished waiting for FSMap version 41 2024-01-25T15:04:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.873+0000 7ff71afce740 10 client.16257 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-01-25T15:04:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.873+0000 7ff71afce740 20 client.16257 populate_metadata read hostname 'smithi170' 2024-01-25T15:04:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.873+0000 7ff71afce740 1 --2- 172.21.15.170:0/3839206573 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56181f4c97d0 0x56181f4cbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:39.877 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.873+0000 7ff71afce740 4 client.16257 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-01-25T15:04:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.873+0000 7ff71afce740 1 -- 172.21.15.170:0/3839206573 --> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56181f0c5600 con 0x56181f4c97d0 2024-01-25T15:04:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.873+0000 7ff7160cf640 1 --2- 172.21.15.170:0/3839206573 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56181f4c97d0 0x56181f4cbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.874+0000 7ff7160cf640 1 --2- 172.21.15.170:0/3839206573 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56181f4c97d0 0x56181f4cbbf0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d16363146275e4c server_cookie=32ff5a13e8e8fd64 in_seq=0 out_seq=0 2024-01-25T15:04:39.878 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:39.874+0000 7ff6f9ffb640 10 client.16257 ms_handle_connect on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.136+0000 7ff6f9ffb640 1 -- 172.21.15.170:0/3839206573 <== mds.0 v2:172.21.15.191:6838/2461767313 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56181f0c5600 con 0x56181f4c97d0 2024-01-25T15:04:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.136+0000 7ff6f9ffb640 10 client.16257 handle_command_reply: tid=0 2024-01-25T15:04:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.136+0000 7ff71afce740 1 client.16257 shutdown 2024-01-25T15:04:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.136+0000 7ff71afce740 1 -- 172.21.15.170:0/3839206573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 msgr2=0x56181f46c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.136+0000 7ff71afce740 1 --2- 172.21.15.170:0/3839206573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f46c6e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7ff7000c44b0 tx=0x7ff7000b83d0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.136+0000 7ff71afce740 1 -- 172.21.15.170:0/3839206573 shutdown_connections 2024-01-25T15:04:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.136+0000 7ff71afce740 1 --2- 172.21.15.170:0/3839206573 >> [v2:172.21.15.191:6838/2461767313,v1:172.21.15.191:6839/2461767313] conn(0x56181f4c97d0 0x56181f4cbbf0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.136+0000 7ff71afce740 1 --2- 172.21.15.170:0/3839206573 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x56181f462e00 0x56181f46d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.136+0000 7ff71afce740 1 --2- 172.21.15.170:0/3839206573 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x56181f45dc90 0x56181f46c6e0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.136+0000 7ff71afce740 1 --2- 172.21.15.170:0/3839206573 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x56181f45d2a0 0x56181f46c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.136+0000 7ff71afce740 1 -- 172.21.15.170:0/3839206573 >> 172.21.15.170:0/3839206573 conn(0x56181f458810 msgr2=0x56181f466de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.136+0000 7ff6f9ffb640 0 client.16257 ms_handle_reset on v2:172.21.15.191:6838/2461767313 2024-01-25T15:04:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.136+0000 7ff71afce740 1 -- 172.21.15.170:0/3839206573 shutdown_connections 2024-01-25T15:04:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.137+0000 7ff71afce740 1 -- 172.21.15.170:0/3839206573 wait complete. 2024-01-25T15:04:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.137+0000 7ff71afce740 20 client.16257 trim_cache size 0 max 16384 2024-01-25T15:04:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:{ 2024-01-25T15:04:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "message": "", 2024-01-25T15:04:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout: "return_code": 0 2024-01-25T15:04:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stdout:} 2024-01-25T15:04:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.137+0000 7ff718333640 1 -- 172.21.15.170:0/3801284153 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6fc0a1380 msgr2=0x7ff6fc0a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.137+0000 7ff718333640 1 --2- 172.21.15.170:0/3801284153 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6fc0a1380 0x7ff6fc0a3840 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff708005fd0 tx=0x7ff708009500 comp rx=0 tx=0).stop 2024-01-25T15:04:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.137+0000 7ff718333640 1 -- 172.21.15.170:0/3801284153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff710100e00 msgr2=0x7ff710102250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.137+0000 7ff718333640 1 --2- 172.21.15.170:0/3801284153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff710100e00 0x7ff710102250 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ff700009430 tx=0x7ff700004ec0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.137+0000 7ff718333640 1 -- 172.21.15.170:0/3801284153 shutdown_connections 2024-01-25T15:04:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.137+0000 7ff718333640 1 --2- 172.21.15.170:0/3801284153 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff6fc0a1380 0x7ff6fc0a3840 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.137+0000 7ff718333640 1 --2- 172.21.15.170:0/3801284153 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff7101017c0 0x7ff710102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.137+0000 7ff718333640 1 --2- 172.21.15.170:0/3801284153 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff710100e00 0x7ff710102250 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.137+0000 7ff718333640 1 --2- 172.21.15.170:0/3801284153 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff7100ffc10 0x7ff710103c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.137+0000 7ff718333640 1 -- 172.21.15.170:0/3801284153 >> 172.21.15.170:0/3801284153 conn(0x7ff7100fb180 msgr2=0x7ff710068370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.138+0000 7ff718333640 1 -- 172.21.15.170:0/3801284153 shutdown_connections 2024-01-25T15:04:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi170.front.sepia.ceph.com.smithi170.stderr:2024-01-25T15:04:40.138+0000 7ff718333640 1 -- 172.21.15.170:0/3801284153 wait complete. 2024-01-25T15:04:40.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:40 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:04:40.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:40 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:04:40.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:40 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:04:41.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:41 smithi170 ceph-mon[31899]: pgmap v429: 97 pgs: 97 active+clean; 53 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 426 op/s 2024-01-25T15:04:41.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:41 smithi191 ceph-mon[36347]: pgmap v429: 97 pgs: 97 active+clean; 53 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 426 op/s 2024-01-25T15:04:41.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:41 smithi186 ceph-mon[35697]: pgmap v429: 97 pgs: 97 active+clean; 53 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 426 op/s 2024-01-25T15:04:43.365 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-01-25T15:04:43.366 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-01-25T15:04:43.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:43 smithi186 ceph-mon[35697]: pgmap v430: 97 pgs: 97 active+clean; 51 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 371 op/s 2024-01-25T15:04:43.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:43 smithi170 ceph-mon[31899]: pgmap v430: 97 pgs: 97 active+clean; 51 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 371 op/s 2024-01-25T15:04:43.702 DEBUG:teuthology.parallel:result is None 2024-01-25T15:04:43.703 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-01-25T15:04:43.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:43 smithi191 ceph-mon[36347]: pgmap v430: 97 pgs: 97 active+clean; 51 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 371 op/s 2024-01-25T15:04:43.739 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-01-25T15:04:43.739 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-01-25T15:04:43.751 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi170.front.sepia.ceph.com 2024-01-25T15:04:43.788 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-01-25T15:04:43.799 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-01-25T15:04:43.800 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_661946e7044723130c03627323f6a879a9848cb5/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-01-25T15:04:43.800 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-01-25T15:04:43.810 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:04:43.936 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.934+0000 7f83a4bf0640 1 -- 172.21.15.170:0/995160425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a0100d10 msgr2=0x7f83a0101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:43.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.934+0000 7f83a4bf0640 1 --2- 172.21.15.170:0/995160425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a0100d10 0x7f83a0101130 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8398009ca0 tx=0x7f839802c0f0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.934+0000 7f83a4bf0640 1 -- 172.21.15.170:0/995160425 shutdown_connections 2024-01-25T15:04:43.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.934+0000 7f83a4bf0640 1 --2- 172.21.15.170:0/995160425 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83a0101f00 0x7f83a0102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.934+0000 7f83a4bf0640 1 --2- 172.21.15.170:0/995160425 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83a01028c0 0x7f83a0109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.934+0000 7f83a4bf0640 1 --2- 172.21.15.170:0/995160425 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a0100d10 0x7f83a0101130 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.934+0000 7f83a4bf0640 1 -- 172.21.15.170:0/995160425 >> 172.21.15.170:0/995160425 conn(0x7f83a00fc2a0 msgr2=0x7f83a00fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:43.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.934+0000 7f83a4bf0640 1 -- 172.21.15.170:0/995160425 shutdown_connections 2024-01-25T15:04:43.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.934+0000 7f83a4bf0640 1 -- 172.21.15.170:0/995160425 wait complete. 2024-01-25T15:04:43.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.934+0000 7f83a4bf0640 1 Processor -- start 2024-01-25T15:04:43.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.934+0000 7f83a4bf0640 1 -- start start 2024-01-25T15:04:43.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f83a4bf0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83a0100d10 0x7f83a0196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:43.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f83a4bf0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a0101f00 0x7f83a0197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:43.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f83a4bf0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83a01028c0 0x7f83a019e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:43.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f83a4bf0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a019e7d0 con 0x7f83a0101f00 2024-01-25T15:04:43.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f83a4bf0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a019e940 con 0x7f83a0100d10 2024-01-25T15:04:43.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f83a4bf0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a019eb00 con 0x7f83a01028c0 2024-01-25T15:04:43.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f839dd9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a0101f00 0x7f83a0197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:43.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f839dd9b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a0101f00 0x7f83a0197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49716/0 (socket says 172.21.15.170:49716) 2024-01-25T15:04:43.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f839dd9b640 1 -- 172.21.15.170:0/2269161277 learned_addr learned my addr 172.21.15.170:0/2269161277 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:43.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f839e59c640 1 --2- 172.21.15.170:0/2269161277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83a0100d10 0x7f83a0196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:43.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f839dd9b640 1 -- 172.21.15.170:0/2269161277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83a01028c0 msgr2=0x7f83a019e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:43.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f839dd9b640 1 --2- 172.21.15.170:0/2269161277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83a01028c0 0x7f83a019e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f839dd9b640 1 -- 172.21.15.170:0/2269161277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83a0100d10 msgr2=0x7f83a0196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:43.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f839dd9b640 1 --2- 172.21.15.170:0/2269161277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83a0100d10 0x7f83a0196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:43.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f839dd9b640 1 -- 172.21.15.170:0/2269161277 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8398009900 con 0x7f83a0101f00 2024-01-25T15:04:43.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f839dd9b640 1 --2- 172.21.15.170:0/2269161277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a0101f00 0x7f83a0197230 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f838800e9f0 tx=0x7f838800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:43.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f83977fe640 1 -- 172.21.15.170:0/2269161277 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388009700 con 0x7f83a0101f00 2024-01-25T15:04:43.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f83977fe640 1 -- 172.21.15.170:0/2269161277 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f838800cd80 con 0x7f83a0101f00 2024-01-25T15:04:43.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f83977fe640 1 -- 172.21.15.170:0/2269161277 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388018860 con 0x7f83a0101f00 2024-01-25T15:04:43.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f83a4bf0640 1 -- 172.21.15.170:0/2269161277 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a019ede0 con 0x7f83a0101f00 2024-01-25T15:04:43.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.935+0000 7f83a4bf0640 1 -- 172.21.15.170:0/2269161277 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a019f260 con 0x7f83a0101f00 2024-01-25T15:04:43.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.936+0000 7f83a4bf0640 1 -- 172.21.15.170:0/2269161277 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a01080d0 con 0x7f83a0101f00 2024-01-25T15:04:43.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.937+0000 7f83977fe640 1 -- 172.21.15.170:0/2269161277 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f83880189c0 con 0x7f83a0101f00 2024-01-25T15:04:43.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.938+0000 7f83977fe640 1 --2- 172.21.15.170:0/2269161277 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f838c0a12e0 0x7f838c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:43.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.938+0000 7f839e59c640 1 --2- 172.21.15.170:0/2269161277 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f838c0a12e0 0x7f838c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:43.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.938+0000 7f83977fe640 1 -- 172.21.15.170:0/2269161277 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f8388014070 con 0x7f83a0101f00 2024-01-25T15:04:43.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.938+0000 7f839e59c640 1 --2- 172.21.15.170:0/2269161277 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f838c0a12e0 0x7f838c0a37a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f83a01981c0 tx=0x7f8398032690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:43.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:43.942+0000 7f83977fe640 1 -- 172.21.15.170:0/2269161277 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f8388052600 con 0x7f83a0101f00 2024-01-25T15:04:44.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.116+0000 7f83a4bf0640 1 -- 172.21.15.170:0/2269161277 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83a002cce0 con 0x7f83a0101f00 2024-01-25T15:04:44.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.118+0000 7f83977fe640 1 -- 172.21.15.170:0/2269161277 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22550 (secure 0 0 0) 0x7f83880963a0 con 0x7f83a0101f00 2024-01-25T15:04:44.119 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:04:44.119 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":87,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T15:00:57.274280+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:04:44.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.120+0000 7f83a4bf0640 1 -- 172.21.15.170:0/2269161277 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f838c0a12e0 msgr2=0x7f838c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.120+0000 7f83a4bf0640 1 --2- 172.21.15.170:0/2269161277 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f838c0a12e0 0x7f838c0a37a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f83a01981c0 tx=0x7f8398032690 comp rx=0 tx=0).stop 2024-01-25T15:04:44.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.120+0000 7f83a4bf0640 1 -- 172.21.15.170:0/2269161277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a0101f00 msgr2=0x7f83a0197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.120+0000 7f83a4bf0640 1 --2- 172.21.15.170:0/2269161277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a0101f00 0x7f83a0197230 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f838800e9f0 tx=0x7f838800eeb0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.120+0000 7f83a4bf0640 1 -- 172.21.15.170:0/2269161277 shutdown_connections 2024-01-25T15:04:44.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.120+0000 7f83a4bf0640 1 --2- 172.21.15.170:0/2269161277 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f838c0a12e0 0x7f838c0a37a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.120+0000 7f83a4bf0640 1 --2- 172.21.15.170:0/2269161277 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f83a01028c0 0x7f83a019e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.120+0000 7f83a4bf0640 1 --2- 172.21.15.170:0/2269161277 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f83a0101f00 0x7f83a0197230 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.120+0000 7f83a4bf0640 1 --2- 172.21.15.170:0/2269161277 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83a0100d10 0x7f83a0196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.120+0000 7f83a4bf0640 1 -- 172.21.15.170:0/2269161277 >> 172.21.15.170:0/2269161277 conn(0x7f83a00fc2a0 msgr2=0x7f83a01052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:44.121 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.120+0000 7f83a4bf0640 1 -- 172.21.15.170:0/2269161277 shutdown_connections 2024-01-25T15:04:44.122 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.120+0000 7f83a4bf0640 1 -- 172.21.15.170:0/2269161277 wait complete. 2024-01-25T15:04:44.132 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T14:55:22.432727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T14:59:51.465304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T14:59:52.749298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:04:44.133 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:04:44.240 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.238+0000 7ff1f4d6e640 1 -- 172.21.15.170:0/1802977511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1f0100de0 msgr2=0x7ff1f0101260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.238+0000 7ff1f4d6e640 1 --2- 172.21.15.170:0/1802977511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1f0100de0 0x7ff1f0101260 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0009900 tx=0x7ff1e002bc30 comp rx=0 tx=0).stop 2024-01-25T15:04:44.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.238+0000 7ff1f4d6e640 1 -- 172.21.15.170:0/1802977511 shutdown_connections 2024-01-25T15:04:44.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.238+0000 7ff1f4d6e640 1 --2- 172.21.15.170:0/1802977511 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1f01017a0 0x7ff1f0108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.238+0000 7ff1f4d6e640 1 --2- 172.21.15.170:0/1802977511 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1f0100de0 0x7ff1f0101260 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.238+0000 7ff1f4d6e640 1 --2- 172.21.15.170:0/1802977511 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1f00ffbf0 0x7ff1f0100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.238+0000 7ff1f4d6e640 1 -- 172.21.15.170:0/1802977511 >> 172.21.15.170:0/1802977511 conn(0x7ff1f00fb180 msgr2=0x7ff1f00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:44.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.238+0000 7ff1f4d6e640 1 -- 172.21.15.170:0/1802977511 shutdown_connections 2024-01-25T15:04:44.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.238+0000 7ff1f4d6e640 1 -- 172.21.15.170:0/1802977511 wait complete. 2024-01-25T15:04:44.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.238+0000 7ff1f4d6e640 1 Processor -- start 2024-01-25T15:04:44.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.238+0000 7ff1f4d6e640 1 -- start start 2024-01-25T15:04:44.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1f4d6e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1f00ffbf0 0x7ff1f0196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1f4d6e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1f0100de0 0x7ff1f0197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1f4d6e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1f01017a0 0x7ff1f019e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1f4d6e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f019e7d0 con 0x7ff1f00ffbf0 2024-01-25T15:04:44.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1f4d6e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f019e940 con 0x7ff1f01017a0 2024-01-25T15:04:44.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1f4d6e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f019eb00 con 0x7ff1f0100de0 2024-01-25T15:04:44.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1ee59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1f00ffbf0 0x7ff1f0196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1ee59c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1f00ffbf0 0x7ff1f0196cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49724/0 (socket says 172.21.15.170:49724) 2024-01-25T15:04:44.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1ee59c640 1 -- 172.21.15.170:0/1140484664 learned_addr learned my addr 172.21.15.170:0/1140484664 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:44.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1eed9d640 1 --2- 172.21.15.170:0/1140484664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1f01017a0 0x7ff1f019e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1edd9b640 1 --2- 172.21.15.170:0/1140484664 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1f0100de0 0x7ff1f0197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1ee59c640 1 -- 172.21.15.170:0/1140484664 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1f0100de0 msgr2=0x7ff1f0197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1ee59c640 1 --2- 172.21.15.170:0/1140484664 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1f0100de0 0x7ff1f0197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1ee59c640 1 -- 172.21.15.170:0/1140484664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1f01017a0 msgr2=0x7ff1f019e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1ee59c640 1 --2- 172.21.15.170:0/1140484664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1f01017a0 0x7ff1f019e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1ee59c640 1 -- 172.21.15.170:0/1140484664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e0009560 con 0x7ff1f00ffbf0 2024-01-25T15:04:44.242 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1ee59c640 1 --2- 172.21.15.170:0/1140484664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1f00ffbf0 0x7ff1f0196cf0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800c970 tx=0x7ff1d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:44.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1e77fe640 1 -- 172.21.15.170:0/1140484664 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8004220 con 0x7ff1f00ffbf0 2024-01-25T15:04:44.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1e77fe640 1 -- 172.21.15.170:0/1140484664 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1d8007e70 con 0x7ff1f00ffbf0 2024-01-25T15:04:44.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1f4d6e640 1 -- 172.21.15.170:0/1140484664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f019ede0 con 0x7ff1f00ffbf0 2024-01-25T15:04:44.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1e77fe640 1 -- 172.21.15.170:0/1140484664 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8004a00 con 0x7ff1f00ffbf0 2024-01-25T15:04:44.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.239+0000 7ff1f4d6e640 1 -- 172.21.15.170:0/1140484664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f019f1b0 con 0x7ff1f00ffbf0 2024-01-25T15:04:44.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.240+0000 7ff1f4d6e640 1 -- 172.21.15.170:0/1140484664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f01070d0 con 0x7ff1f00ffbf0 2024-01-25T15:04:44.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.241+0000 7ff1e77fe640 1 -- 172.21.15.170:0/1140484664 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7ff1d80079b0 con 0x7ff1f00ffbf0 2024-01-25T15:04:44.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.242+0000 7ff1e77fe640 1 --2- 172.21.15.170:0/1140484664 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff1dc0a12e0 0x7ff1dc0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.242+0000 7ff1edd9b640 1 --2- 172.21.15.170:0/1140484664 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff1dc0a12e0 0x7ff1dc0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.242+0000 7ff1e77fe640 1 -- 172.21.15.170:0/1140484664 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7ff1d80cccb0 con 0x7ff1f00ffbf0 2024-01-25T15:04:44.244 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.242+0000 7ff1edd9b640 1 --2- 172.21.15.170:0/1140484664 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff1dc0a12e0 0x7ff1dc0a37a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0006010 tx=0x7ff1e002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:44.246 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.245+0000 7ff1e77fe640 1 -- 172.21.15.170:0/1140484664 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ff1d80960d0 con 0x7ff1f00ffbf0 2024-01-25T15:04:44.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.422+0000 7ff1f4d6e640 1 -- 172.21.15.170:0/1140484664 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1f010c5e0 con 0x7ff1f00ffbf0 2024-01-25T15:04:44.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.422+0000 7ff1e77fe640 1 -- 172.21.15.170:0/1140484664 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1d801d020 con 0x7ff1f00ffbf0 2024-01-25T15:04:44.423 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 1 2024-01-25T15:04:44.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.424+0000 7ff1f4d6e640 1 -- 172.21.15.170:0/1140484664 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff1dc0a12e0 msgr2=0x7ff1dc0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.424+0000 7ff1f4d6e640 1 --2- 172.21.15.170:0/1140484664 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff1dc0a12e0 0x7ff1dc0a37a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0006010 tx=0x7ff1e002c5d0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.424+0000 7ff1f4d6e640 1 -- 172.21.15.170:0/1140484664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1f00ffbf0 msgr2=0x7ff1f0196cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.424+0000 7ff1f4d6e640 1 --2- 172.21.15.170:0/1140484664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1f00ffbf0 0x7ff1f0196cf0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800c970 tx=0x7ff1d800ce30 comp rx=0 tx=0).stop 2024-01-25T15:04:44.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.424+0000 7ff1f4d6e640 1 -- 172.21.15.170:0/1140484664 shutdown_connections 2024-01-25T15:04:44.425 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.424+0000 7ff1f4d6e640 1 --2- 172.21.15.170:0/1140484664 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff1dc0a12e0 0x7ff1dc0a37a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.424+0000 7ff1f4d6e640 1 --2- 172.21.15.170:0/1140484664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff1f01017a0 0x7ff1f019e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.424+0000 7ff1f4d6e640 1 --2- 172.21.15.170:0/1140484664 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff1f0100de0 0x7ff1f0197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.424+0000 7ff1f4d6e640 1 --2- 172.21.15.170:0/1140484664 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff1f00ffbf0 0x7ff1f0196cf0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.424+0000 7ff1f4d6e640 1 -- 172.21.15.170:0/1140484664 >> 172.21.15.170:0/1140484664 conn(0x7ff1f00fb180 msgr2=0x7ff1f01042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:44.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.424+0000 7ff1f4d6e640 1 -- 172.21.15.170:0/1140484664 shutdown_connections 2024-01-25T15:04:44.426 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.424+0000 7ff1f4d6e640 1 -- 172.21.15.170:0/1140484664 wait complete. 2024-01-25T15:04:44.435 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:44 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2269161277' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:04:44.436 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:04:44.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 -- 172.21.15.170:0/2202832720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9394106a70 msgr2=0x7f9394108e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 --2- 172.21.15.170:0/2202832720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9394106a70 0x7f9394108e60 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f938c009ca0 tx=0x7f938c02c0f0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 -- 172.21.15.170:0/2202832720 shutdown_connections 2024-01-25T15:04:44.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 --2- 172.21.15.170:0/2202832720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9394104140 0x7f9394106530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 --2- 172.21.15.170:0/2202832720 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9394106a70 0x7f9394108e60 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 --2- 172.21.15.170:0/2202832720 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9394101810 0x7f9394103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 -- 172.21.15.170:0/2202832720 >> 172.21.15.170:0/2202832720 conn(0x7f93940fb180 msgr2=0x7f93940fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:44.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 -- 172.21.15.170:0/2202832720 shutdown_connections 2024-01-25T15:04:44.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 -- 172.21.15.170:0/2202832720 wait complete. 2024-01-25T15:04:44.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 Processor -- start 2024-01-25T15:04:44.544 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 -- start start 2024-01-25T15:04:44.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9394101810 0x7f9394196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9394104140 0x7f93941971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9394106a70 0x7f939419e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939419e7c0 con 0x7f9394101810 2024-01-25T15:04:44.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939419e930 con 0x7f9394104140 2024-01-25T15:04:44.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f939b91f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939419eaf0 con 0x7f9394106a70 2024-01-25T15:04:44.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.541+0000 7f93996bb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9394101810 0x7f9394196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f93996bb640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9394101810 0x7f9394196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49744/0 (socket says 172.21.15.170:49744) 2024-01-25T15:04:44.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f93996bb640 1 -- 172.21.15.170:0/3492132189 learned_addr learned my addr 172.21.15.170:0/3492132189 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:44.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f9398eba640 1 --2- 172.21.15.170:0/3492132189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9394104140 0x7f93941971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f93996bb640 1 -- 172.21.15.170:0/3492132189 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9394106a70 msgr2=0x7f939419e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f9399ebc640 1 --2- 172.21.15.170:0/3492132189 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9394106a70 0x7f939419e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f93996bb640 1 --2- 172.21.15.170:0/3492132189 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9394106a70 0x7f939419e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.545 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f93996bb640 1 -- 172.21.15.170:0/3492132189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9394104140 msgr2=0x7f93941971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f93996bb640 1 --2- 172.21.15.170:0/3492132189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9394104140 0x7f93941971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f93996bb640 1 -- 172.21.15.170:0/3492132189 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c009900 con 0x7f9394101810 2024-01-25T15:04:44.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f9398eba640 1 --2- 172.21.15.170:0/3492132189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9394104140 0x7f93941971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:04:44.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f93996bb640 1 --2- 172.21.15.170:0/3492132189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9394101810 0x7f9394196cb0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f938400e9f0 tx=0x7f938400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:44.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f93927fc640 1 -- 172.21.15.170:0/3492132189 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384009720 con 0x7f9394101810 2024-01-25T15:04:44.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f93927fc640 1 -- 172.21.15.170:0/3492132189 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f938400cd80 con 0x7f9394101810 2024-01-25T15:04:44.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f93927fc640 1 -- 172.21.15.170:0/3492132189 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384010430 con 0x7f9394101810 2024-01-25T15:04:44.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f939b91f640 1 -- 172.21.15.170:0/3492132189 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939419edd0 con 0x7f9394101810 2024-01-25T15:04:44.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.542+0000 7f939b91f640 1 -- 172.21.15.170:0/3492132189 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f939419f1d0 con 0x7f9394101810 2024-01-25T15:04:44.546 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.543+0000 7f939b91f640 1 -- 172.21.15.170:0/3492132189 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93940fcc70 con 0x7f9394101810 2024-01-25T15:04:44.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.545+0000 7f93927fc640 1 -- 172.21.15.170:0/3492132189 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f9384005000 con 0x7f9394101810 2024-01-25T15:04:44.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.545+0000 7f93927fc640 1 --2- 172.21.15.170:0/3492132189 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f937c0a12e0 0x7f937c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.546+0000 7f9398eba640 1 --2- 172.21.15.170:0/3492132189 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f937c0a12e0 0x7f937c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.546+0000 7f93927fc640 1 -- 172.21.15.170:0/3492132189 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f9384014070 con 0x7f9394101810 2024-01-25T15:04:44.547 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.546+0000 7f9398eba640 1 --2- 172.21.15.170:0/3492132189 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f937c0a12e0 0x7f937c0a37a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f93941981b0 tx=0x7f9388005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:44.550 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.549+0000 7f93927fc640 1 -- 172.21.15.170:0/3492132189 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f93840966b0 con 0x7f9394101810 2024-01-25T15:04:44.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:44 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2269161277' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:04:44.723 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.722+0000 7f939b91f640 1 -- 172.21.15.170:0/3492132189 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f939410c760 con 0x7f9394101810 2024-01-25T15:04:44.724 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.723+0000 7f93927fc640 1 -- 172.21.15.170:0/3492132189 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9384099cd0 con 0x7f9394101810 2024-01-25T15:04:44.724 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 32 2024-01-25T15:04:44.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.725+0000 7f939b91f640 1 -- 172.21.15.170:0/3492132189 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f937c0a12e0 msgr2=0x7f937c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.725+0000 7f939b91f640 1 --2- 172.21.15.170:0/3492132189 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f937c0a12e0 0x7f937c0a37a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f93941981b0 tx=0x7f9388005f90 comp rx=0 tx=0).stop 2024-01-25T15:04:44.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.725+0000 7f939b91f640 1 -- 172.21.15.170:0/3492132189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9394101810 msgr2=0x7f9394196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.725+0000 7f939b91f640 1 --2- 172.21.15.170:0/3492132189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9394101810 0x7f9394196cb0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f938400e9f0 tx=0x7f938400edf0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.725+0000 7f939b91f640 1 -- 172.21.15.170:0/3492132189 shutdown_connections 2024-01-25T15:04:44.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.725+0000 7f939b91f640 1 --2- 172.21.15.170:0/3492132189 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f937c0a12e0 0x7f937c0a37a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.725+0000 7f939b91f640 1 --2- 172.21.15.170:0/3492132189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9394104140 0x7f93941971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.725+0000 7f939b91f640 1 --2- 172.21.15.170:0/3492132189 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9394106a70 0x7f939419e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.725+0000 7f939b91f640 1 --2- 172.21.15.170:0/3492132189 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9394101810 0x7f9394196cb0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.725+0000 7f939b91f640 1 -- 172.21.15.170:0/3492132189 >> 172.21.15.170:0/3492132189 conn(0x7f93940fb180 msgr2=0x7f93941020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:44.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.725+0000 7f939b91f640 1 -- 172.21.15.170:0/3492132189 shutdown_connections 2024-01-25T15:04:44.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.725+0000 7f939b91f640 1 -- 172.21.15.170:0/3492132189 wait complete. 2024-01-25T15:04:44.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:44 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2269161277' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:04:44.737 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:04:44.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.841+0000 7fdc6137c640 1 -- 172.21.15.170:0/1392043264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc5c101ef0 msgr2=0x7fdc5c102370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.841+0000 7fdc6137c640 1 --2- 172.21.15.170:0/1392043264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc5c101ef0 0x7fdc5c102370 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009900 tx=0x7fdc4402bc30 comp rx=0 tx=0).stop 2024-01-25T15:04:44.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.841+0000 7fdc6137c640 1 -- 172.21.15.170:0/1392043264 shutdown_connections 2024-01-25T15:04:44.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.841+0000 7fdc6137c640 1 --2- 172.21.15.170:0/1392043264 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc5c1028b0 0x7fdc5c109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.845 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.841+0000 7fdc6137c640 1 --2- 172.21.15.170:0/1392043264 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc5c101ef0 0x7fdc5c102370 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.841+0000 7fdc6137c640 1 --2- 172.21.15.170:0/1392043264 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc5c100d00 0x7fdc5c101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.841+0000 7fdc6137c640 1 -- 172.21.15.170:0/1392043264 >> 172.21.15.170:0/1392043264 conn(0x7fdc5c0fc290 msgr2=0x7fdc5c0fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.841+0000 7fdc6137c640 1 -- 172.21.15.170:0/1392043264 shutdown_connections 2024-01-25T15:04:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.841+0000 7fdc6137c640 1 -- 172.21.15.170:0/1392043264 wait complete. 2024-01-25T15:04:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.842+0000 7fdc6137c640 1 Processor -- start 2024-01-25T15:04:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.842+0000 7fdc6137c640 1 -- start start 2024-01-25T15:04:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.842+0000 7fdc6137c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc5c100d00 0x7fdc5c196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.842+0000 7fdc6137c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc5c101ef0 0x7fdc5c197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.842+0000 7fdc6137c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc5c1028b0 0x7fdc5c19e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.842+0000 7fdc6137c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c19e7f0 con 0x7fdc5c1028b0 2024-01-25T15:04:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.842+0000 7fdc6137c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c19e960 con 0x7fdc5c101ef0 2024-01-25T15:04:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.842+0000 7fdc6137c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5c19eb20 con 0x7fdc5c100d00 2024-01-25T15:04:44.846 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.842+0000 7fdc5b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc5c1028b0 0x7fdc5c19e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.842+0000 7fdc5b7fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc5c1028b0 0x7fdc5c19e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49762/0 (socket says 172.21.15.170:49762) 2024-01-25T15:04:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.842+0000 7fdc5b7fe640 1 -- 172.21.15.170:0/1010420617 learned_addr learned my addr 172.21.15.170:0/1010420617 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.843+0000 7fdc5affd640 1 --2- 172.21.15.170:0/1010420617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc5c100d00 0x7fdc5c196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.843+0000 7fdc5a7fc640 1 --2- 172.21.15.170:0/1010420617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc5c101ef0 0x7fdc5c197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.843+0000 7fdc5b7fe640 1 -- 172.21.15.170:0/1010420617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc5c100d00 msgr2=0x7fdc5c196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.843+0000 7fdc5b7fe640 1 --2- 172.21.15.170:0/1010420617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc5c100d00 0x7fdc5c196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.843+0000 7fdc5b7fe640 1 -- 172.21.15.170:0/1010420617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc5c101ef0 msgr2=0x7fdc5c197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.843+0000 7fdc5b7fe640 1 --2- 172.21.15.170:0/1010420617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc5c101ef0 0x7fdc5c197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.843+0000 7fdc5b7fe640 1 -- 172.21.15.170:0/1010420617 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc44009560 con 0x7fdc5c1028b0 2024-01-25T15:04:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.843+0000 7fdc5affd640 1 --2- 172.21.15.170:0/1010420617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc5c100d00 0x7fdc5c196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:04:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.843+0000 7fdc5b7fe640 1 --2- 172.21.15.170:0/1010420617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc5c1028b0 0x7fdc5c19e280 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00c970 tx=0x7fdc4c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.843+0000 7fdc53fff640 1 -- 172.21.15.170:0/1010420617 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c007bb0 con 0x7fdc5c1028b0 2024-01-25T15:04:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.843+0000 7fdc53fff640 1 -- 172.21.15.170:0/1010420617 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc4c007d10 con 0x7fdc5c1028b0 2024-01-25T15:04:44.847 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.843+0000 7fdc6137c640 1 -- 172.21.15.170:0/1010420617 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5c19ee00 con 0x7fdc5c1028b0 2024-01-25T15:04:44.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.843+0000 7fdc53fff640 1 -- 172.21.15.170:0/1010420617 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0186c0 con 0x7fdc5c1028b0 2024-01-25T15:04:44.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.843+0000 7fdc6137c640 1 -- 172.21.15.170:0/1010420617 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5c19f300 con 0x7fdc5c1028b0 2024-01-25T15:04:44.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.844+0000 7fdc6137c640 1 -- 172.21.15.170:0/1010420617 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc5c1080a0 con 0x7fdc5c1028b0 2024-01-25T15:04:44.848 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.845+0000 7fdc53fff640 1 -- 172.21.15.170:0/1010420617 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fdc4c00f450 con 0x7fdc5c1028b0 2024-01-25T15:04:44.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.846+0000 7fdc53fff640 1 --2- 172.21.15.170:0/1010420617 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdc480a1360 0x7fdc480a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:44.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.846+0000 7fdc5affd640 1 --2- 172.21.15.170:0/1010420617 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdc480a1360 0x7fdc480a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:44.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.846+0000 7fdc53fff640 1 -- 172.21.15.170:0/1010420617 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fdc4c0ccca0 con 0x7fdc5c1028b0 2024-01-25T15:04:44.849 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.846+0000 7fdc5affd640 1 --2- 172.21.15.170:0/1010420617 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdc480a1360 0x7fdc480a3820 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c1981e0 tx=0x7fdc54009570 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:44.850 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:44.850+0000 7fdc53fff640 1 -- 172.21.15.170:0/1010420617 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fdc4c0960c0 con 0x7fdc5c1028b0 2024-01-25T15:04:45.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.026+0000 7fdc6137c640 1 -- 172.21.15.170:0/1010420617 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc5c02cbb0 con 0x7fdc5c1028b0 2024-01-25T15:04:45.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.027+0000 7fdc53fff640 1 -- 172.21.15.170:0/1010420617 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc4c0b9070 con 0x7fdc5c1028b0 2024-01-25T15:04:45.028 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 64 2024-01-25T15:04:45.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.029+0000 7fdc6137c640 1 -- 172.21.15.170:0/1010420617 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdc480a1360 msgr2=0x7fdc480a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.029+0000 7fdc6137c640 1 --2- 172.21.15.170:0/1010420617 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdc480a1360 0x7fdc480a3820 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c1981e0 tx=0x7fdc54009570 comp rx=0 tx=0).stop 2024-01-25T15:04:45.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.029+0000 7fdc6137c640 1 -- 172.21.15.170:0/1010420617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc5c1028b0 msgr2=0x7fdc5c19e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.029+0000 7fdc6137c640 1 --2- 172.21.15.170:0/1010420617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc5c1028b0 0x7fdc5c19e280 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c00c970 tx=0x7fdc4c00ce30 comp rx=0 tx=0).stop 2024-01-25T15:04:45.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.029+0000 7fdc6137c640 1 -- 172.21.15.170:0/1010420617 shutdown_connections 2024-01-25T15:04:45.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.029+0000 7fdc6137c640 1 --2- 172.21.15.170:0/1010420617 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdc480a1360 0x7fdc480a3820 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.029+0000 7fdc6137c640 1 --2- 172.21.15.170:0/1010420617 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc5c101ef0 0x7fdc5c197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.030 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.029+0000 7fdc6137c640 1 --2- 172.21.15.170:0/1010420617 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdc5c1028b0 0x7fdc5c19e280 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.029+0000 7fdc6137c640 1 --2- 172.21.15.170:0/1010420617 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdc5c100d00 0x7fdc5c196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.029+0000 7fdc6137c640 1 -- 172.21.15.170:0/1010420617 >> 172.21.15.170:0/1010420617 conn(0x7fdc5c0fc290 msgr2=0x7fdc5c105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:45.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.029+0000 7fdc6137c640 1 -- 172.21.15.170:0/1010420617 shutdown_connections 2024-01-25T15:04:45.031 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.029+0000 7fdc6137c640 1 -- 172.21.15.170:0/1010420617 wait complete. 2024-01-25T15:04:45.041 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-01-25T15:04:45.145 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.142+0000 7f1eb965c640 1 -- 172.21.15.170:0/1013965165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb4100d10 msgr2=0x7f1eb4101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.142+0000 7f1eb965c640 1 --2- 172.21.15.170:0/1013965165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb4100d10 0x7f1eb4101130 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1eac009900 tx=0x7f1eac02bc30 comp rx=0 tx=0).stop 2024-01-25T15:04:45.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.142+0000 7f1eb965c640 1 -- 172.21.15.170:0/1013965165 shutdown_connections 2024-01-25T15:04:45.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.142+0000 7f1eb965c640 1 --2- 172.21.15.170:0/1013965165 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1eb4101f00 0x7f1eb4102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.142+0000 7f1eb965c640 1 --2- 172.21.15.170:0/1013965165 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb41028c0 0x7f1eb4109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.142+0000 7f1eb965c640 1 --2- 172.21.15.170:0/1013965165 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb4100d10 0x7f1eb4101130 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.142+0000 7f1eb965c640 1 -- 172.21.15.170:0/1013965165 >> 172.21.15.170:0/1013965165 conn(0x7f1eb40fc2a0 msgr2=0x7f1eb40fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:45.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.142+0000 7f1eb965c640 1 -- 172.21.15.170:0/1013965165 shutdown_connections 2024-01-25T15:04:45.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.142+0000 7f1eb965c640 1 -- 172.21.15.170:0/1013965165 wait complete. 2024-01-25T15:04:45.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.142+0000 7f1eb965c640 1 Processor -- start 2024-01-25T15:04:45.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.142+0000 7f1eb965c640 1 -- start start 2024-01-25T15:04:45.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb965c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb4100d10 0x7f1eb4196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.146 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb965c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1eb4101f00 0x7f1eb4197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb965c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb41028c0 0x7f1eb419e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb965c640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb419e820 con 0x7f1eb41028c0 2024-01-25T15:04:45.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb965c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb419e990 con 0x7f1eb4101f00 2024-01-25T15:04:45.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb965c640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb419eb50 con 0x7f1eb4100d10 2024-01-25T15:04:45.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb41028c0 0x7f1eb419e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb37fe640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb41028c0 0x7f1eb419e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:49772/0 (socket says 172.21.15.170:49772) 2024-01-25T15:04:45.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb37fe640 1 -- 172.21.15.170:0/550737436 learned_addr learned my addr 172.21.15.170:0/550737436 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:04:45.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb27fc640 1 --2- 172.21.15.170:0/550737436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1eb4101f00 0x7f1eb4197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb2ffd640 1 --2- 172.21.15.170:0/550737436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb4100d10 0x7f1eb4196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb37fe640 1 -- 172.21.15.170:0/550737436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb4100d10 msgr2=0x7f1eb4196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb37fe640 1 --2- 172.21.15.170:0/550737436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb4100d10 0x7f1eb4196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb37fe640 1 -- 172.21.15.170:0/550737436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1eb4101f00 msgr2=0x7f1eb4197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:45.147 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb37fe640 1 --2- 172.21.15.170:0/550737436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1eb4101f00 0x7f1eb4197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:45.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb37fe640 1 -- 172.21.15.170:0/550737436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac009560 con 0x7f1eb41028c0 2024-01-25T15:04:45.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb37fe640 1 --2- 172.21.15.170:0/550737436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb41028c0 0x7f1eb419e2b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400b970 tx=0x7f1ea400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:45.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eabfff640 1 -- 172.21.15.170:0/550737436 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea400cb40 con 0x7f1eb41028c0 2024-01-25T15:04:45.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb965c640 1 -- 172.21.15.170:0/550737436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb419ee30 con 0x7f1eb41028c0 2024-01-25T15:04:45.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eabfff640 1 -- 172.21.15.170:0/550737436 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ea400cca0 con 0x7f1eb41028c0 2024-01-25T15:04:45.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eabfff640 1 -- 172.21.15.170:0/550737436 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4007770 con 0x7f1eb41028c0 2024-01-25T15:04:45.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.143+0000 7f1eb965c640 1 -- 172.21.15.170:0/550737436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb419f2e0 con 0x7f1eb41028c0 2024-01-25T15:04:45.148 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.145+0000 7f1eb965c640 1 -- 172.21.15.170:0/550737436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb4108080 con 0x7f1eb41028c0 2024-01-25T15:04:45.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.146+0000 7f1eabfff640 1 -- 172.21.15.170:0/550737436 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f1ea4014440 con 0x7f1eb41028c0 2024-01-25T15:04:45.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.146+0000 7f1eabfff640 1 --2- 172.21.15.170:0/550737436 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1ea00a12e0 0x7f1ea00a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:04:45.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.146+0000 7f1eb2ffd640 1 --2- 172.21.15.170:0/550737436 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1ea00a12e0 0x7f1ea00a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:04:45.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.146+0000 7f1eabfff640 1 -- 172.21.15.170:0/550737436 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f1ea40ccc30 con 0x7f1eb41028c0 2024-01-25T15:04:45.149 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.147+0000 7f1eb2ffd640 1 --2- 172.21.15.170:0/550737436 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1ea00a12e0 0x7f1ea00a37a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1eac036040 tx=0x7f1eac005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:04:45.150 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.149+0000 7f1eabfff640 1 -- 172.21.15.170:0/550737436 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1ea4096050 con 0x7f1eb41028c0 2024-01-25T15:04:45.369 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.369+0000 7f1eb965c640 1 -- 172.21.15.170:0/550737436 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f1eb410c670 con 0x7f1eb41028c0 2024-01-25T15:04:45.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.376+0000 7f1eabfff640 1 -- 172.21.15.170:0/550737436 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) v1 ==== 81+0+732473 (secure 0 0 0) 0x7f1ea4097f80 con 0x7f1eb41028c0 2024-01-25T15:04:45.388 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:04:45.388 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:04:45.388 INFO:teuthology.orchestra.run.smithi170.stdout: "epoch": 20, 2024-01-25T15:04:45.388 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.388 INFO:teuthology.orchestra.run.smithi170.stdout: "active_gid": 14152, 2024-01-25T15:04:45.388 INFO:teuthology.orchestra.run.smithi170.stdout: "active_name": "x", 2024-01-25T15:04:45.388 INFO:teuthology.orchestra.run.smithi170.stdout: "active_addrs": { 2024-01-25T15:04:45.388 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2024-01-25T15:04:45.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.389 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v2", 2024-01-25T15:04:45.389 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6800", 2024-01-25T15:04:45.389 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 3767785684 2024-01-25T15:04:45.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.389 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v1", 2024-01-25T15:04:45.389 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:6801", 2024-01-25T15:04:45.389 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 3767785684 2024-01-25T15:04:45.389 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.389 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-01-25T15:04:45.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.389 INFO:teuthology.orchestra.run.smithi170.stdout: "active_addr": "172.21.15.170:6801/3767785684", 2024-01-25T15:04:45.390 INFO:teuthology.orchestra.run.smithi170.stdout: "active_change": "2024-01-25T14:52:56.093158+0000", 2024-01-25T15:04:45.390 INFO:teuthology.orchestra.run.smithi170.stdout: "active_mgr_features": 4540701272860131327, 2024-01-25T15:04:45.390 INFO:teuthology.orchestra.run.smithi170.stdout: "available": true, 2024-01-25T15:04:45.390 INFO:teuthology.orchestra.run.smithi170.stdout: "standbys": [ 2024-01-25T15:04:45.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.390 INFO:teuthology.orchestra.run.smithi170.stdout: "gid": 24106, 2024-01-25T15:04:45.390 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "z", 2024-01-25T15:04:45.390 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr_features": 4540701272860131327, 2024-01-25T15:04:45.390 INFO:teuthology.orchestra.run.smithi170.stdout: "available_modules": [ 2024-01-25T15:04:45.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.390 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "alerts", 2024-01-25T15:04:45.390 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.390 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.390 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.390 INFO:teuthology.orchestra.run.smithi170.stdout: "interval": { 2024-01-25T15:04:45.391 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "interval", 2024-01-25T15:04:45.391 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.391 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.391 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.391 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "60", 2024-01-25T15:04:45.391 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.391 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.391 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.391 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "How frequently to reexamine health status", 2024-01-25T15:04:45.391 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.391 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.391 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.391 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.392 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.392 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.392 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.392 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.392 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.392 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.392 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.392 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.392 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.392 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.392 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.392 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.392 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.392 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.393 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.393 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.393 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.393 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.393 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.393 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.393 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.393 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.393 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.393 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.393 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.393 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.393 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.394 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.394 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.394 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.394 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.394 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.394 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.394 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.394 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.394 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.394 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.394 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.394 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.394 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.395 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.395 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.395 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.395 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.395 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.395 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.395 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.395 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.395 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.396 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.396 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.396 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.396 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.396 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.396 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.396 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.396 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.396 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.396 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.396 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.396 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.396 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.397 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.397 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.397 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.397 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_destination": { 2024-01-25T15:04:45.397 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_destination", 2024-01-25T15:04:45.397 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.397 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.397 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.397 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.397 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.397 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.397 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.397 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Email address to send alerts to", 2024-01-25T15:04:45.398 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.398 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.398 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.398 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_from_name": { 2024-01-25T15:04:45.398 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_from_name", 2024-01-25T15:04:45.398 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.398 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.398 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.398 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "Ceph", 2024-01-25T15:04:45.398 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.398 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.398 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.398 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Email From: name", 2024-01-25T15:04:45.398 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.399 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.399 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.399 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_host": { 2024-01-25T15:04:45.399 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_host", 2024-01-25T15:04:45.399 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.399 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.399 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.399 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.399 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.399 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.399 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.399 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "SMTP server", 2024-01-25T15:04:45.399 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.400 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.400 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.400 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_password": { 2024-01-25T15:04:45.400 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_password", 2024-01-25T15:04:45.400 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.400 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.400 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.400 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.400 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.400 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.400 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.400 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Password to authenticate with", 2024-01-25T15:04:45.400 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.400 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.401 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.401 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_port": { 2024-01-25T15:04:45.401 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_port", 2024-01-25T15:04:45.401 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.401 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.401 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.401 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "465", 2024-01-25T15:04:45.401 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.401 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.401 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.401 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "SMTP port", 2024-01-25T15:04:45.401 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.401 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.401 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.402 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_sender": { 2024-01-25T15:04:45.402 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_sender", 2024-01-25T15:04:45.402 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.402 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.402 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.402 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.402 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.402 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.402 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.402 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "SMTP envelope sender", 2024-01-25T15:04:45.402 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.402 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.403 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.403 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_ssl": { 2024-01-25T15:04:45.403 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_ssl", 2024-01-25T15:04:45.403 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.403 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.403 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.403 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.403 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.403 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.403 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.403 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Use SSL to connect to SMTP server", 2024-01-25T15:04:45.403 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.403 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.404 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.404 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_user": { 2024-01-25T15:04:45.404 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_user", 2024-01-25T15:04:45.404 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.404 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.404 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.404 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.404 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.404 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.404 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.404 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "User to authenticate as", 2024-01-25T15:04:45.404 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.404 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.405 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.405 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.405 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.405 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "balancer", 2024-01-25T15:04:45.405 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.405 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.405 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.405 INFO:teuthology.orchestra.run.smithi170.stdout: "active": { 2024-01-25T15:04:45.405 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "active", 2024-01-25T15:04:45.405 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.405 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.405 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.406 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.406 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.406 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.406 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.406 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "automatically balance PGs across cluster", 2024-01-25T15:04:45.406 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.406 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.406 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.406 INFO:teuthology.orchestra.run.smithi170.stdout: "begin_time": { 2024-01-25T15:04:45.406 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "begin_time", 2024-01-25T15:04:45.406 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.406 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.406 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.407 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0000", 2024-01-25T15:04:45.407 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.407 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.407 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.407 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "beginning time of day to automatically balance", 2024-01-25T15:04:45.407 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-01-25T15:04:45.407 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.407 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.407 INFO:teuthology.orchestra.run.smithi170.stdout: "begin_weekday": { 2024-01-25T15:04:45.407 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "begin_weekday", 2024-01-25T15:04:45.407 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "uint", 2024-01-25T15:04:45.407 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.407 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.407 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0", 2024-01-25T15:04:45.408 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "0", 2024-01-25T15:04:45.408 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "6", 2024-01-25T15:04:45.408 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.408 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-01-25T15:04:45.408 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-01-25T15:04:45.408 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.408 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.408 INFO:teuthology.orchestra.run.smithi170.stdout: "crush_compat_max_iterations": { 2024-01-25T15:04:45.408 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "crush_compat_max_iterations", 2024-01-25T15:04:45.408 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "uint", 2024-01-25T15:04:45.408 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.408 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.408 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "25", 2024-01-25T15:04:45.409 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "1", 2024-01-25T15:04:45.409 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "250", 2024-01-25T15:04:45.409 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.409 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-01-25T15:04:45.409 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.409 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.409 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.409 INFO:teuthology.orchestra.run.smithi170.stdout: "crush_compat_metrics": { 2024-01-25T15:04:45.409 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "crush_compat_metrics", 2024-01-25T15:04:45.409 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.409 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.409 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.409 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "pgs,objects,bytes", 2024-01-25T15:04:45.410 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.410 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.410 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.410 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-01-25T15:04:45.410 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-01-25T15:04:45.410 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.410 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.410 INFO:teuthology.orchestra.run.smithi170.stdout: "crush_compat_step": { 2024-01-25T15:04:45.410 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "crush_compat_step", 2024-01-25T15:04:45.410 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:45.410 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.410 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.410 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0.5", 2024-01-25T15:04:45.410 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "0.001", 2024-01-25T15:04:45.411 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "0.999", 2024-01-25T15:04:45.411 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.411 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "aggressiveness of optimization", 2024-01-25T15:04:45.411 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-01-25T15:04:45.411 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.411 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.411 INFO:teuthology.orchestra.run.smithi170.stdout: "end_time": { 2024-01-25T15:04:45.411 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "end_time", 2024-01-25T15:04:45.411 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.411 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.411 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.411 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "2359", 2024-01-25T15:04:45.411 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.411 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.412 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.412 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "ending time of day to automatically balance", 2024-01-25T15:04:45.412 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-01-25T15:04:45.412 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.412 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.412 INFO:teuthology.orchestra.run.smithi170.stdout: "end_weekday": { 2024-01-25T15:04:45.412 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "end_weekday", 2024-01-25T15:04:45.412 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "uint", 2024-01-25T15:04:45.412 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.412 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.412 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0", 2024-01-25T15:04:45.412 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "0", 2024-01-25T15:04:45.412 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "6", 2024-01-25T15:04:45.413 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.413 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-01-25T15:04:45.413 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-01-25T15:04:45.413 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.413 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.413 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.413 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.413 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.413 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.413 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.413 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.413 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.413 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.413 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.414 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.414 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.414 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.414 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.414 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.414 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.414 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.414 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.414 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.414 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.414 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.414 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.414 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.414 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.415 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.415 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.415 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.415 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.415 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.415 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.415 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.415 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.415 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.415 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.415 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.415 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.416 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.416 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.416 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.416 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.416 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.416 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.416 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.416 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.416 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.416 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.416 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.416 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.416 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.416 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.417 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.417 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.417 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.417 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.417 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.417 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.417 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.417 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.417 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.417 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.417 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.417 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.417 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.417 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.418 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.418 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.418 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.418 INFO:teuthology.orchestra.run.smithi170.stdout: "min_score": { 2024-01-25T15:04:45.418 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "min_score", 2024-01-25T15:04:45.418 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:45.418 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.418 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.418 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0", 2024-01-25T15:04:45.418 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.418 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.418 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.418 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-01-25T15:04:45.419 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.419 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.419 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.419 INFO:teuthology.orchestra.run.smithi170.stdout: "mode": { 2024-01-25T15:04:45.419 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mode", 2024-01-25T15:04:45.419 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.419 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.419 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.419 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "upmap", 2024-01-25T15:04:45.419 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.419 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.419 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.419 INFO:teuthology.orchestra.run.smithi170.stdout: "crush-compat", 2024-01-25T15:04:45.419 INFO:teuthology.orchestra.run.smithi170.stdout: "none", 2024-01-25T15:04:45.420 INFO:teuthology.orchestra.run.smithi170.stdout: "upmap" 2024-01-25T15:04:45.420 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.420 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Balancer mode", 2024-01-25T15:04:45.420 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.420 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.420 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.420 INFO:teuthology.orchestra.run.smithi170.stdout: "pool_ids": { 2024-01-25T15:04:45.420 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "pool_ids", 2024-01-25T15:04:45.420 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.420 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.420 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.420 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.420 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.421 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.421 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.421 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-01-25T15:04:45.421 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.421 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.421 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.421 INFO:teuthology.orchestra.run.smithi170.stdout: "sleep_interval": { 2024-01-25T15:04:45.421 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "sleep_interval", 2024-01-25T15:04:45.421 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.421 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.421 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.421 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "60", 2024-01-25T15:04:45.421 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.421 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.422 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.422 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-01-25T15:04:45.422 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.422 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.422 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.422 INFO:teuthology.orchestra.run.smithi170.stdout: "upmap_max_deviation": { 2024-01-25T15:04:45.422 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "upmap_max_deviation", 2024-01-25T15:04:45.422 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.422 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.422 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.422 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "5", 2024-01-25T15:04:45.422 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "1", 2024-01-25T15:04:45.422 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.423 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.423 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "deviation below which no optimization is attempted", 2024-01-25T15:04:45.423 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-01-25T15:04:45.423 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.423 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.423 INFO:teuthology.orchestra.run.smithi170.stdout: "upmap_max_optimizations": { 2024-01-25T15:04:45.423 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "upmap_max_optimizations", 2024-01-25T15:04:45.423 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "uint", 2024-01-25T15:04:45.423 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.423 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.423 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:45.423 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.423 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.423 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.424 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-01-25T15:04:45.424 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.424 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.424 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.424 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.424 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.424 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "cephadm", 2024-01-25T15:04:45.424 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.424 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.424 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.424 INFO:teuthology.orchestra.run.smithi170.stdout: "agent_down_multiplier": { 2024-01-25T15:04:45.424 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "agent_down_multiplier", 2024-01-25T15:04:45.425 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:45.425 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.425 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.425 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "3.0", 2024-01-25T15:04:45.425 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.425 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.425 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.425 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-01-25T15:04:45.425 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.425 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.425 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.425 INFO:teuthology.orchestra.run.smithi170.stdout: "agent_refresh_rate": { 2024-01-25T15:04:45.425 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "agent_refresh_rate", 2024-01-25T15:04:45.425 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.426 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.426 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.426 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "20", 2024-01-25T15:04:45.426 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.426 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.426 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.426 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-01-25T15:04:45.426 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.426 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.426 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.426 INFO:teuthology.orchestra.run.smithi170.stdout: "agent_starting_port": { 2024-01-25T15:04:45.426 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "agent_starting_port", 2024-01-25T15:04:45.426 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.427 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.427 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.427 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "4721", 2024-01-25T15:04:45.427 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.427 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.427 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.427 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-01-25T15:04:45.427 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.427 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.427 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.427 INFO:teuthology.orchestra.run.smithi170.stdout: "allow_ptrace": { 2024-01-25T15:04:45.427 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "allow_ptrace", 2024-01-25T15:04:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-01-25T15:04:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-01-25T15:04:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.428 INFO:teuthology.orchestra.run.smithi170.stdout: "autotune_interval": { 2024-01-25T15:04:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "autotune_interval", 2024-01-25T15:04:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "600", 2024-01-25T15:04:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how frequently to autotune daemon memory", 2024-01-25T15:04:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.429 INFO:teuthology.orchestra.run.smithi170.stdout: "autotune_memory_target_ratio": { 2024-01-25T15:04:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "autotune_memory_target_ratio", 2024-01-25T15:04:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0.7", 2024-01-25T15:04:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-01-25T15:04:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: "cephadm_log_destination": { 2024-01-25T15:04:45.430 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "cephadm_log_destination", 2024-01-25T15:04:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: "file", 2024-01-25T15:04:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: "file,syslog", 2024-01-25T15:04:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: "syslog" 2024-01-25T15:04:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-01-25T15:04:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.431 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: "cgroups_split": { 2024-01-25T15:04:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "cgroups_split", 2024-01-25T15:04:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-01-25T15:04:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.432 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: "config_checks_enabled": { 2024-01-25T15:04:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "config_checks_enabled", 2024-01-25T15:04:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-01-25T15:04:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.433 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: "config_dashboard": { 2024-01-25T15:04:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "config_dashboard", 2024-01-25T15:04:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-01-25T15:04:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.434 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_alertmanager": { 2024-01-25T15:04:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_alertmanager", 2024-01-25T15:04:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-01-25T15:04:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Prometheus container image", 2024-01-25T15:04:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_base": { 2024-01-25T15:04:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_base", 2024-01-25T15:04:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/ceph/ceph", 2024-01-25T15:04:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Container image name, without the tag", 2024-01-25T15:04:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_elasticsearch": { 2024-01-25T15:04:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_elasticsearch", 2024-01-25T15:04:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-01-25T15:04:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "elasticsearch container image", 2024-01-25T15:04:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.437 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_grafana": { 2024-01-25T15:04:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_grafana", 2024-01-25T15:04:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-01-25T15:04:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Prometheus container image", 2024-01-25T15:04:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.438 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_haproxy": { 2024-01-25T15:04:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_haproxy", 2024-01-25T15:04:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-01-25T15:04:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "HAproxy container image", 2024-01-25T15:04:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_jaeger_agent": { 2024-01-25T15:04:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_jaeger_agent", 2024-01-25T15:04:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-01-25T15:04:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Jaeger agent container image", 2024-01-25T15:04:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_jaeger_collector": { 2024-01-25T15:04:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_jaeger_collector", 2024-01-25T15:04:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-01-25T15:04:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Jaeger collector container image", 2024-01-25T15:04:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.441 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_jaeger_query": { 2024-01-25T15:04:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_jaeger_query", 2024-01-25T15:04:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-01-25T15:04:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Jaeger query container image", 2024-01-25T15:04:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.442 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_keepalived": { 2024-01-25T15:04:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_keepalived", 2024-01-25T15:04:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-01-25T15:04:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Keepalived container image", 2024-01-25T15:04:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_loki": { 2024-01-25T15:04:45.443 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_loki", 2024-01-25T15:04:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-01-25T15:04:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Loki container image", 2024-01-25T15:04:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_node_exporter": { 2024-01-25T15:04:45.444 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_node_exporter", 2024-01-25T15:04:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-01-25T15:04:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Prometheus container image", 2024-01-25T15:04:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_nvmeof": { 2024-01-25T15:04:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_nvmeof", 2024-01-25T15:04:45.445 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-01-25T15:04:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Nvme-of container image", 2024-01-25T15:04:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_prometheus": { 2024-01-25T15:04:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_prometheus", 2024-01-25T15:04:45.446 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Prometheus container image", 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_promtail": { 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_promtail", 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.447 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Promtail container image", 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_snmp_gateway": { 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_snmp_gateway", 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.448 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "SNMP Gateway container image", 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: "container_init": { 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_init", 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.449 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Run podman/docker with `--init`", 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: "daemon_cache_timeout": { 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "daemon_cache_timeout", 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.450 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "600", 2024-01-25T15:04:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-01-25T15:04:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: "default_cephadm_command_timeout": { 2024-01-25T15:04:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "default_cephadm_command_timeout", 2024-01-25T15:04:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.451 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "900", 2024-01-25T15:04:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-01-25T15:04:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: "default_registry": { 2024-01-25T15:04:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "default_registry", 2024-01-25T15:04:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.452 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "docker.io", 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: "device_cache_timeout": { 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "device_cache_timeout", 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.453 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "1800", 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "seconds to cache device inventory", 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: "device_enhanced_scan": { 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "device_enhanced_scan", 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.454 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Use libstoragemgmt during device scans", 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: "facts_cache_timeout": { 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "facts_cache_timeout", 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.455 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "60", 2024-01-25T15:04:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "seconds to cache host facts data", 2024-01-25T15:04:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: "host_check_interval": { 2024-01-25T15:04:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "host_check_interval", 2024-01-25T15:04:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.456 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "600", 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how frequently to perform a host check", 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: "inventory_list_all": { 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "inventory_list_all", 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.457 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-01-25T15:04:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.458 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: "log_refresh_metadata": { 2024-01-25T15:04:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_refresh_metadata", 2024-01-25T15:04:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-01-25T15:04:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.460 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-01-25T15:04:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.461 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.462 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.463 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.463 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.463 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.463 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.463 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.463 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.463 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.463 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.463 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.463 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.463 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.464 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.464 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.464 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.464 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.464 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.464 INFO:teuthology.orchestra.run.smithi170.stdout: "manage_etc_ceph_ceph_conf": { 2024-01-25T15:04:45.464 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-01-25T15:04:45.464 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.464 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.464 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.464 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.464 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.464 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.465 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.465 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-01-25T15:04:45.465 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.465 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.465 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.465 INFO:teuthology.orchestra.run.smithi170.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-01-25T15:04:45.465 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-01-25T15:04:45.465 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.465 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.465 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.465 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "*", 2024-01-25T15:04:45.465 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.465 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.465 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.466 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-01-25T15:04:45.466 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.466 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.466 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.466 INFO:teuthology.orchestra.run.smithi170.stdout: "max_count_per_host": { 2024-01-25T15:04:45.466 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "max_count_per_host", 2024-01-25T15:04:45.466 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.466 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.466 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.466 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:45.466 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.466 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.466 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.467 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "max number of daemons per service per host", 2024-01-25T15:04:45.467 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.467 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.467 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.467 INFO:teuthology.orchestra.run.smithi170.stdout: "max_osd_draining_count": { 2024-01-25T15:04:45.467 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "max_osd_draining_count", 2024-01-25T15:04:45.467 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.467 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.467 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.467 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:45.467 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.467 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.467 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.467 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-01-25T15:04:45.468 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.468 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.468 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.468 INFO:teuthology.orchestra.run.smithi170.stdout: "migration_current": { 2024-01-25T15:04:45.468 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "migration_current", 2024-01-25T15:04:45.468 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.468 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.468 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.468 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.468 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.468 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.468 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.468 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "internal - do not modify", 2024-01-25T15:04:45.469 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.469 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.469 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.469 INFO:teuthology.orchestra.run.smithi170.stdout: "mode": { 2024-01-25T15:04:45.469 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mode", 2024-01-25T15:04:45.469 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.469 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.469 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.469 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "root", 2024-01-25T15:04:45.469 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.469 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.469 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.469 INFO:teuthology.orchestra.run.smithi170.stdout: "cephadm-package", 2024-01-25T15:04:45.469 INFO:teuthology.orchestra.run.smithi170.stdout: "root" 2024-01-25T15:04:45.470 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.470 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "mode for remote execution of cephadm", 2024-01-25T15:04:45.470 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.470 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.470 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.470 INFO:teuthology.orchestra.run.smithi170.stdout: "prometheus_alerts_path": { 2024-01-25T15:04:45.470 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "prometheus_alerts_path", 2024-01-25T15:04:45.470 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.470 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.470 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.470 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-01-25T15:04:45.470 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.470 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.470 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.471 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-01-25T15:04:45.471 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.471 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.471 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.471 INFO:teuthology.orchestra.run.smithi170.stdout: "registry_insecure": { 2024-01-25T15:04:45.471 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "registry_insecure", 2024-01-25T15:04:45.471 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.471 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.471 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.471 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.471 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.471 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.471 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.472 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-01-25T15:04:45.472 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.472 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.472 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.472 INFO:teuthology.orchestra.run.smithi170.stdout: "registry_password": { 2024-01-25T15:04:45.472 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "registry_password", 2024-01-25T15:04:45.472 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.472 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.472 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.472 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.472 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.472 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.472 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.472 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-01-25T15:04:45.473 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.473 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.473 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.473 INFO:teuthology.orchestra.run.smithi170.stdout: "registry_url": { 2024-01-25T15:04:45.473 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "registry_url", 2024-01-25T15:04:45.473 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.473 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.473 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.473 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.473 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.473 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.473 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.473 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-01-25T15:04:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: "registry_username": { 2024-01-25T15:04:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "registry_username", 2024-01-25T15:04:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-01-25T15:04:45.474 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.475 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.475 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.475 INFO:teuthology.orchestra.run.smithi170.stdout: "secure_monitoring_stack": { 2024-01-25T15:04:45.475 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "secure_monitoring_stack", 2024-01-25T15:04:45.475 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.475 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.475 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.475 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.475 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.475 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.475 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.476 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-01-25T15:04:45.476 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.476 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.476 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.476 INFO:teuthology.orchestra.run.smithi170.stdout: "service_discovery_port": { 2024-01-25T15:04:45.476 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "service_discovery_port", 2024-01-25T15:04:45.476 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.476 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.476 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.476 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "8765", 2024-01-25T15:04:45.476 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.476 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.476 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.477 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "cephadm service discovery port", 2024-01-25T15:04:45.477 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.477 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.477 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.477 INFO:teuthology.orchestra.run.smithi170.stdout: "ssh_config_file": { 2024-01-25T15:04:45.477 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ssh_config_file", 2024-01-25T15:04:45.477 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.477 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.477 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.477 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.477 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.477 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.477 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.477 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-01-25T15:04:45.478 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.478 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.478 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.478 INFO:teuthology.orchestra.run.smithi170.stdout: "use_agent": { 2024-01-25T15:04:45.478 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "use_agent", 2024-01-25T15:04:45.478 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.478 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.478 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.478 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.478 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.478 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.478 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.478 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-01-25T15:04:45.479 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.479 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.479 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.479 INFO:teuthology.orchestra.run.smithi170.stdout: "use_repo_digest": { 2024-01-25T15:04:45.479 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "use_repo_digest", 2024-01-25T15:04:45.479 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.479 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.479 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.479 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.479 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.479 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.479 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.479 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-01-25T15:04:45.480 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.480 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.480 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.480 INFO:teuthology.orchestra.run.smithi170.stdout: "warn_on_failed_host_check": { 2024-01-25T15:04:45.480 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "warn_on_failed_host_check", 2024-01-25T15:04:45.480 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.480 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.480 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.480 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.480 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.480 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.480 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.480 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "raise a health warning if the host check fails", 2024-01-25T15:04:45.481 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.481 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.481 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.481 INFO:teuthology.orchestra.run.smithi170.stdout: "warn_on_stray_daemons": { 2024-01-25T15:04:45.481 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "warn_on_stray_daemons", 2024-01-25T15:04:45.481 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.481 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.481 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.481 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.481 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.481 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.481 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.481 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-01-25T15:04:45.482 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.482 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.482 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.482 INFO:teuthology.orchestra.run.smithi170.stdout: "warn_on_stray_hosts": { 2024-01-25T15:04:45.482 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "warn_on_stray_hosts", 2024-01-25T15:04:45.482 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.482 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.482 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.482 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.482 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.482 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.482 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.482 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-01-25T15:04:45.482 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.483 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.483 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.483 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.483 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.483 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "crash", 2024-01-25T15:04:45.483 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.483 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.483 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.483 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.483 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.483 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.484 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.484 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.484 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.484 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.484 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.484 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.484 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.484 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.484 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.484 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.484 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.484 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.484 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.484 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.485 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.485 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.485 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.485 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.485 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.485 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.485 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.485 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.485 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.485 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.485 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.485 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.485 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.485 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.486 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.486 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.486 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.486 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.486 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.486 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.486 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.486 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.486 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.486 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.486 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.486 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.486 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.487 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.487 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.487 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.487 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.487 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.487 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.487 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.487 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.487 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.487 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.487 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.487 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.487 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.487 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.488 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.488 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.488 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.488 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.488 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.488 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.488 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.488 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.488 INFO:teuthology.orchestra.run.smithi170.stdout: "retain_interval": { 2024-01-25T15:04:45.488 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "retain_interval", 2024-01-25T15:04:45.488 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.489 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.489 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.489 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "31536000", 2024-01-25T15:04:45.489 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.489 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.489 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.489 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how long to retain crashes before pruning them", 2024-01-25T15:04:45.489 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.489 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.489 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.489 INFO:teuthology.orchestra.run.smithi170.stdout: "warn_recent_interval": { 2024-01-25T15:04:45.489 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "warn_recent_interval", 2024-01-25T15:04:45.489 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.490 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.490 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.490 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "1209600", 2024-01-25T15:04:45.490 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.490 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.490 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.490 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "time interval in which to warn about recent crashes", 2024-01-25T15:04:45.490 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.490 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.490 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.490 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.490 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.491 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "dashboard", 2024-01-25T15:04:45.491 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.491 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.491 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.491 INFO:teuthology.orchestra.run.smithi170.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-01-25T15:04:45.491 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-01-25T15:04:45.491 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.491 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.491 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.491 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:45.491 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.491 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.491 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.492 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.492 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.492 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.492 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.492 INFO:teuthology.orchestra.run.smithi170.stdout: "ALERTMANAGER_API_HOST": { 2024-01-25T15:04:45.492 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ALERTMANAGER_API_HOST", 2024-01-25T15:04:45.492 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.492 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.492 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.492 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.492 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.492 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.492 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.493 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.493 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.493 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.493 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.493 INFO:teuthology.orchestra.run.smithi170.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-01-25T15:04:45.493 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-01-25T15:04:45.493 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.493 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.493 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.493 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.493 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.495 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.495 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.495 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.495 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.495 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.495 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.495 INFO:teuthology.orchestra.run.smithi170.stdout: "AUDIT_API_ENABLED": { 2024-01-25T15:04:45.495 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "AUDIT_API_ENABLED", 2024-01-25T15:04:45.495 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.495 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.495 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.495 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.495 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.496 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.496 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.496 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.496 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.496 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.496 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.496 INFO:teuthology.orchestra.run.smithi170.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-01-25T15:04:45.496 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-01-25T15:04:45.496 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.496 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.496 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.496 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.496 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.497 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.497 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.497 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.497 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.497 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.497 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.497 INFO:teuthology.orchestra.run.smithi170.stdout: "ENABLE_BROWSABLE_API": { 2024-01-25T15:04:45.497 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ENABLE_BROWSABLE_API", 2024-01-25T15:04:45.497 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.497 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.497 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.497 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.497 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.497 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.498 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.498 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.498 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.498 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.498 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.498 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.498 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-01-25T15:04:45.498 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-01-25T15:04:45.498 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.498 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.498 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.498 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.498 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.498 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.499 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.499 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.499 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.499 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.499 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.499 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-01-25T15:04:45.499 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-01-25T15:04:45.499 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.499 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.499 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.499 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.499 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.499 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.499 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.500 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.500 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.500 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.500 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.500 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-01-25T15:04:45.500 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-01-25T15:04:45.500 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.500 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.500 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.500 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.500 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.500 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.500 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.501 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.501 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.501 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.501 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.501 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-01-25T15:04:45.501 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-01-25T15:04:45.501 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.501 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.501 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.501 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.501 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.501 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.501 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.502 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.502 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.502 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.502 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.502 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.502 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_NFS": { 2024-01-25T15:04:45.502 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-01-25T15:04:45.502 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.502 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.502 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.502 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.502 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.502 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.503 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.503 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.503 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.503 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.503 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.503 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_RBD": { 2024-01-25T15:04:45.503 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-01-25T15:04:45.503 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.503 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.503 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.503 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.503 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.503 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.504 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.504 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.504 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.504 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.504 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.504 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_RGW": { 2024-01-25T15:04:45.504 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-01-25T15:04:45.504 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.504 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.504 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.504 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.504 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.504 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.505 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.505 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.505 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.505 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.505 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.505 INFO:teuthology.orchestra.run.smithi170.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-01-25T15:04:45.505 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-01-25T15:04:45.505 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.505 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.505 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.505 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.505 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.505 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.506 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.506 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.506 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.506 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.506 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.506 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_API_PASSWORD": { 2024-01-25T15:04:45.506 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_API_PASSWORD", 2024-01-25T15:04:45.506 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.506 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.506 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.506 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "admin", 2024-01-25T15:04:45.506 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.506 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.506 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.507 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.507 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.507 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.507 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.507 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-01-25T15:04:45.507 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-01-25T15:04:45.507 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.507 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.507 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.507 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.507 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.507 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.507 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_API_URL": { 2024-01-25T15:04:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_API_URL", 2024-01-25T15:04:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.508 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.509 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.509 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.509 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.509 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.509 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_API_USERNAME": { 2024-01-25T15:04:45.509 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_API_USERNAME", 2024-01-25T15:04:45.509 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.509 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.509 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.509 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "admin", 2024-01-25T15:04:45.509 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.509 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.509 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.509 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.510 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.510 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.510 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.510 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-01-25T15:04:45.510 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-01-25T15:04:45.510 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.510 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.510 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.510 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.510 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.510 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.510 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.510 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.510 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.511 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.511 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.511 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-01-25T15:04:45.511 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-01-25T15:04:45.511 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.511 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.511 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.511 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.511 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.511 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.511 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.511 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.511 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.512 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.512 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.512 INFO:teuthology.orchestra.run.smithi170.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-01-25T15:04:45.512 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-01-25T15:04:45.512 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.512 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.512 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.512 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.512 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.512 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.512 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.512 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.512 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.513 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.513 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.513 INFO:teuthology.orchestra.run.smithi170.stdout: "ISSUE_TRACKER_API_KEY": { 2024-01-25T15:04:45.513 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-01-25T15:04:45.513 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.513 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.513 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.513 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.513 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.513 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.513 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.513 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.513 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.514 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.514 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.514 INFO:teuthology.orchestra.run.smithi170.stdout: "PROMETHEUS_API_HOST": { 2024-01-25T15:04:45.514 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PROMETHEUS_API_HOST", 2024-01-25T15:04:45.514 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.514 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.514 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.514 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.514 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.514 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.514 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.514 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.514 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.514 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.515 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.515 INFO:teuthology.orchestra.run.smithi170.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-01-25T15:04:45.515 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-01-25T15:04:45.515 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.515 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.515 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.515 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.515 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.515 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.515 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.515 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.515 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.516 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.516 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.516 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-01-25T15:04:45.516 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-01-25T15:04:45.516 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.516 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.516 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.516 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.516 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.516 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.516 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.516 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.516 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.517 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.517 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.517 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-01-25T15:04:45.517 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-01-25T15:04:45.517 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.517 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.517 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.517 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.517 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.517 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.517 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.517 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.517 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.518 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.518 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.518 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-01-25T15:04:45.518 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-01-25T15:04:45.518 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.518 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.518 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.518 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.518 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.518 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.518 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.518 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.518 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.519 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.519 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.519 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-01-25T15:04:45.519 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-01-25T15:04:45.519 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.519 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.519 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.519 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.519 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.519 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.519 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.519 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.519 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.520 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.520 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.520 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-01-25T15:04:45.520 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-01-25T15:04:45.520 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.520 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.520 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.520 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.520 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.520 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.520 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.520 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.520 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.521 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.521 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.521 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-01-25T15:04:45.521 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-01-25T15:04:45.521 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.521 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.521 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.521 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.521 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.521 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.521 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.521 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.521 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.522 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.522 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.522 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-01-25T15:04:45.522 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-01-25T15:04:45.522 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.522 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.522 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.522 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.522 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.522 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.522 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.522 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.522 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.522 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.523 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.523 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_ENABLED": { 2024-01-25T15:04:45.523 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_ENABLED", 2024-01-25T15:04:45.523 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.523 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.523 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.523 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.523 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.523 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.523 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.523 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.523 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.523 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.523 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.524 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-01-25T15:04:45.524 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-01-25T15:04:45.524 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.524 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.524 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.524 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-01-25T15:04:45.524 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.524 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.524 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.524 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.524 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.524 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.525 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.525 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-01-25T15:04:45.525 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-01-25T15:04:45.525 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.525 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.525 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.525 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:45.525 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.525 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.525 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.525 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.525 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.525 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.526 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.526 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-01-25T15:04:45.526 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-01-25T15:04:45.526 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.526 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.526 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.526 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "8", 2024-01-25T15:04:45.526 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.526 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.526 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.526 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.526 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.526 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.526 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.527 INFO:teuthology.orchestra.run.smithi170.stdout: "REST_REQUESTS_TIMEOUT": { 2024-01-25T15:04:45.527 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-01-25T15:04:45.527 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.527 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.527 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.527 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "45", 2024-01-25T15:04:45.527 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.527 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.527 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.527 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.527 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.527 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.527 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.528 INFO:teuthology.orchestra.run.smithi170.stdout: "RGW_API_ACCESS_KEY": { 2024-01-25T15:04:45.528 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "RGW_API_ACCESS_KEY", 2024-01-25T15:04:45.528 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.528 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.528 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.528 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.528 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.528 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.528 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.528 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.528 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.528 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.529 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.529 INFO:teuthology.orchestra.run.smithi170.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-01-25T15:04:45.529 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-01-25T15:04:45.529 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.529 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.529 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.529 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "admin", 2024-01-25T15:04:45.529 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.529 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.529 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.529 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.529 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.529 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.530 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.530 INFO:teuthology.orchestra.run.smithi170.stdout: "RGW_API_SECRET_KEY": { 2024-01-25T15:04:45.530 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "RGW_API_SECRET_KEY", 2024-01-25T15:04:45.530 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.530 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.530 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.530 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.530 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.530 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.530 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.530 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.530 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.530 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.530 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.531 INFO:teuthology.orchestra.run.smithi170.stdout: "RGW_API_SSL_VERIFY": { 2024-01-25T15:04:45.531 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "RGW_API_SSL_VERIFY", 2024-01-25T15:04:45.531 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.531 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.531 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.531 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.531 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.531 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.531 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.531 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.531 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.531 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.531 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.532 INFO:teuthology.orchestra.run.smithi170.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-01-25T15:04:45.532 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-01-25T15:04:45.532 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.532 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.532 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.532 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0", 2024-01-25T15:04:45.532 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.532 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.532 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.532 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.532 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.532 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.532 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.533 INFO:teuthology.orchestra.run.smithi170.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-01-25T15:04:45.533 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-01-25T15:04:45.533 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.533 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.533 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.533 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:45.533 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.533 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.533 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.533 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.533 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.533 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.533 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.534 INFO:teuthology.orchestra.run.smithi170.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-01-25T15:04:45.534 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-01-25T15:04:45.534 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.534 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.534 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.534 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "5", 2024-01-25T15:04:45.534 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.534 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.534 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.534 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.534 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.534 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.534 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.535 INFO:teuthology.orchestra.run.smithi170.stdout: "cross_origin_url": { 2024-01-25T15:04:45.535 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "cross_origin_url", 2024-01-25T15:04:45.535 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.535 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.535 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.535 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.535 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.535 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.535 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.535 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.535 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.535 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.535 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.536 INFO:teuthology.orchestra.run.smithi170.stdout: "crt_file": { 2024-01-25T15:04:45.536 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "crt_file", 2024-01-25T15:04:45.536 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.536 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.536 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.536 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.536 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.536 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.536 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.536 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.536 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.536 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.536 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.536 INFO:teuthology.orchestra.run.smithi170.stdout: "debug": { 2024-01-25T15:04:45.537 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "debug", 2024-01-25T15:04:45.537 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.537 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.537 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.537 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.537 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.537 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.537 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.537 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Enable/disable debug options", 2024-01-25T15:04:45.537 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.537 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.537 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.537 INFO:teuthology.orchestra.run.smithi170.stdout: "jwt_token_ttl": { 2024-01-25T15:04:45.538 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "jwt_token_ttl", 2024-01-25T15:04:45.538 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.538 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.538 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.538 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "28800", 2024-01-25T15:04:45.538 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.538 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.538 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.538 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.538 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.538 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.538 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.538 INFO:teuthology.orchestra.run.smithi170.stdout: "key_file": { 2024-01-25T15:04:45.538 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "key_file", 2024-01-25T15:04:45.539 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.539 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.539 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.539 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.539 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.539 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.539 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.539 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.539 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.539 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.539 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.539 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.539 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.539 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.540 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.540 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.540 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.540 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.540 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.540 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.540 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.540 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.540 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.540 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.540 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.540 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.540 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.540 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.541 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.541 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.541 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.541 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.541 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.541 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.541 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.541 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.541 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.541 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.541 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.541 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.542 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.542 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.542 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.542 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.542 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.542 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.542 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.542 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.542 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.542 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.542 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.542 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.542 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.543 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.543 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.543 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.543 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.543 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.543 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.543 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.543 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.543 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.543 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.543 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.543 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.543 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.544 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.544 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.544 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.544 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.544 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.544 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.544 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.544 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.544 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.544 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.544 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.544 INFO:teuthology.orchestra.run.smithi170.stdout: "motd": { 2024-01-25T15:04:45.544 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "motd", 2024-01-25T15:04:45.545 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.545 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.545 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.545 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.545 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.545 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.545 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.545 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "The message of the day", 2024-01-25T15:04:45.545 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.545 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.545 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.545 INFO:teuthology.orchestra.run.smithi170.stdout: "redirect_resolve_ip_addr": { 2024-01-25T15:04:45.545 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "redirect_resolve_ip_addr", 2024-01-25T15:04:45.546 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.546 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.546 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.546 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.546 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.546 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.546 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.546 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.546 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.546 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.546 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.546 INFO:teuthology.orchestra.run.smithi170.stdout: "server_addr": { 2024-01-25T15:04:45.546 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_addr", 2024-01-25T15:04:45.546 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.547 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.547 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.547 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "::", 2024-01-25T15:04:45.547 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.547 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.547 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.547 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.547 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.547 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.547 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.547 INFO:teuthology.orchestra.run.smithi170.stdout: "server_port": { 2024-01-25T15:04:45.547 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_port", 2024-01-25T15:04:45.547 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.548 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.548 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.548 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "8080", 2024-01-25T15:04:45.548 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.548 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.548 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.548 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.548 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.548 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.548 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.548 INFO:teuthology.orchestra.run.smithi170.stdout: "ssl": { 2024-01-25T15:04:45.548 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ssl", 2024-01-25T15:04:45.548 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.549 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.549 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.549 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.549 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.549 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.549 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.549 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.549 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.549 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.549 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.549 INFO:teuthology.orchestra.run.smithi170.stdout: "ssl_server_port": { 2024-01-25T15:04:45.549 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ssl_server_port", 2024-01-25T15:04:45.549 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.550 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.550 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.550 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "8443", 2024-01-25T15:04:45.550 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.550 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.550 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.550 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.550 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.550 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.550 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.550 INFO:teuthology.orchestra.run.smithi170.stdout: "standby_behaviour": { 2024-01-25T15:04:45.550 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "standby_behaviour", 2024-01-25T15:04:45.550 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.551 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.551 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.551 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "redirect", 2024-01-25T15:04:45.551 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.551 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.551 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.551 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.551 INFO:teuthology.orchestra.run.smithi170.stdout: "redirect" 2024-01-25T15:04:45.551 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.551 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.551 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.551 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.551 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.551 INFO:teuthology.orchestra.run.smithi170.stdout: "standby_error_status_code": { 2024-01-25T15:04:45.552 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "standby_error_status_code", 2024-01-25T15:04:45.552 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.552 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.552 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.552 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "500", 2024-01-25T15:04:45.552 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "400", 2024-01-25T15:04:45.552 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "599", 2024-01-25T15:04:45.552 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.552 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.552 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.552 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.552 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.552 INFO:teuthology.orchestra.run.smithi170.stdout: "url_prefix": { 2024-01-25T15:04:45.553 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "url_prefix", 2024-01-25T15:04:45.553 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.553 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.553 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.553 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.553 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.553 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.553 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.553 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.553 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.553 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.553 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.553 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.553 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.554 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "devicehealth", 2024-01-25T15:04:45.554 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.554 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.554 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.554 INFO:teuthology.orchestra.run.smithi170.stdout: "enable_monitoring": { 2024-01-25T15:04:45.554 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "enable_monitoring", 2024-01-25T15:04:45.554 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.554 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.554 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.554 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.554 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.554 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.554 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.555 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "monitor device health metrics", 2024-01-25T15:04:45.555 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.555 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.555 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.555 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.555 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.555 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.555 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.555 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.555 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.556 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.556 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.556 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.556 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.556 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.556 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.556 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.556 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.556 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.556 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.556 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.556 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.556 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.556 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.557 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.557 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.557 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.557 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.557 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.557 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.557 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.557 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.557 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.557 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.557 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.557 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.557 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.558 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.558 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.558 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.558 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.558 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.558 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.558 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.558 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.558 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.558 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.558 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.558 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.558 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.559 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.559 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.559 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.559 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.559 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.559 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.559 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.559 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.559 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.559 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.559 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.559 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.559 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.559 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.560 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.560 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.560 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.560 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.560 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.560 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.560 INFO:teuthology.orchestra.run.smithi170.stdout: "mark_out_threshold": { 2024-01-25T15:04:45.560 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mark_out_threshold", 2024-01-25T15:04:45.560 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.560 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.560 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.560 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "2419200", 2024-01-25T15:04:45.560 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.561 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.561 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.561 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-01-25T15:04:45.561 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.561 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.561 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.561 INFO:teuthology.orchestra.run.smithi170.stdout: "pool_name": { 2024-01-25T15:04:45.561 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "pool_name", 2024-01-25T15:04:45.561 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.561 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.561 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.561 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "device_health_metrics", 2024-01-25T15:04:45.562 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.562 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.562 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.562 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "name of pool in which to store device health metrics", 2024-01-25T15:04:45.562 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.562 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.562 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.562 INFO:teuthology.orchestra.run.smithi170.stdout: "retention_period": { 2024-01-25T15:04:45.562 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "retention_period", 2024-01-25T15:04:45.562 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.562 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.562 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.562 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "15552000", 2024-01-25T15:04:45.562 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.563 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.563 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.563 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how long to retain device health metrics", 2024-01-25T15:04:45.563 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.563 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.563 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.563 INFO:teuthology.orchestra.run.smithi170.stdout: "scrape_frequency": { 2024-01-25T15:04:45.563 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "scrape_frequency", 2024-01-25T15:04:45.563 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.563 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.563 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.563 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "86400", 2024-01-25T15:04:45.564 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.564 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.564 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.564 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how frequently to scrape device health metrics", 2024-01-25T15:04:45.564 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.564 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.564 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.564 INFO:teuthology.orchestra.run.smithi170.stdout: "self_heal": { 2024-01-25T15:04:45.564 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "self_heal", 2024-01-25T15:04:45.564 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.564 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.564 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.564 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.565 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.565 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.565 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.565 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-01-25T15:04:45.565 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.565 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.565 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.565 INFO:teuthology.orchestra.run.smithi170.stdout: "sleep_interval": { 2024-01-25T15:04:45.565 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "sleep_interval", 2024-01-25T15:04:45.565 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.565 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.565 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.565 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "600", 2024-01-25T15:04:45.566 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.566 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.566 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.566 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how frequently to wake up and check device health", 2024-01-25T15:04:45.566 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.566 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.566 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.566 INFO:teuthology.orchestra.run.smithi170.stdout: "warn_threshold": { 2024-01-25T15:04:45.566 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "warn_threshold", 2024-01-25T15:04:45.566 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.566 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.566 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.566 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "7257600", 2024-01-25T15:04:45.566 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.567 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.567 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.567 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-01-25T15:04:45.567 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.567 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.567 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.567 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.567 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.567 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "diskprediction_local", 2024-01-25T15:04:45.567 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.567 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.567 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.568 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.568 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.568 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.568 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.568 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.568 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.568 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.568 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.568 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.568 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.568 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.568 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.569 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.569 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.569 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.569 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.569 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.569 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.569 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.569 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.569 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.569 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.569 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.569 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.569 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.569 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.570 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.570 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.570 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.570 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.570 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.570 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.570 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.570 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.570 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.570 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.570 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.570 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.570 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.571 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.571 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.571 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.571 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.571 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.571 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.571 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.571 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.571 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.571 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.571 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.571 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.571 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.571 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.572 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.572 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.572 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.572 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.572 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.572 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.572 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.572 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.572 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.572 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.572 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.572 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.573 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.573 INFO:teuthology.orchestra.run.smithi170.stdout: "predict_interval": { 2024-01-25T15:04:45.573 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "predict_interval", 2024-01-25T15:04:45.573 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.573 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.573 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.573 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "86400", 2024-01-25T15:04:45.573 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.573 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.573 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.573 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.573 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.573 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.574 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.574 INFO:teuthology.orchestra.run.smithi170.stdout: "predictor_model": { 2024-01-25T15:04:45.574 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "predictor_model", 2024-01-25T15:04:45.574 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.574 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.574 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.574 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "prophetstor", 2024-01-25T15:04:45.574 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.574 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.574 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.574 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.574 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.574 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.575 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.575 INFO:teuthology.orchestra.run.smithi170.stdout: "sleep_interval": { 2024-01-25T15:04:45.575 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "sleep_interval", 2024-01-25T15:04:45.575 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.575 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.575 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.575 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "600", 2024-01-25T15:04:45.575 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.575 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.575 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.575 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.575 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.575 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.576 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.576 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.576 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.576 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "influx", 2024-01-25T15:04:45.576 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": false, 2024-01-25T15:04:45.576 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "influxdb python module not found", 2024-01-25T15:04:45.576 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.576 INFO:teuthology.orchestra.run.smithi170.stdout: "batch_size": { 2024-01-25T15:04:45.576 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "batch_size", 2024-01-25T15:04:45.576 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.576 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.577 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.577 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "5000", 2024-01-25T15:04:45.577 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.577 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.577 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.577 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-01-25T15:04:45.577 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.577 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.577 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.577 INFO:teuthology.orchestra.run.smithi170.stdout: "database": { 2024-01-25T15:04:45.577 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "database", 2024-01-25T15:04:45.577 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.577 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.578 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.578 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "ceph", 2024-01-25T15:04:45.578 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.578 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.578 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.578 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-01-25T15:04:45.578 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.578 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.578 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.578 INFO:teuthology.orchestra.run.smithi170.stdout: "hostname": { 2024-01-25T15:04:45.578 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "hostname", 2024-01-25T15:04:45.578 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.578 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.578 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.579 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.579 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.579 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.579 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.579 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "InfluxDB server hostname", 2024-01-25T15:04:45.579 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.579 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.579 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.579 INFO:teuthology.orchestra.run.smithi170.stdout: "interval": { 2024-01-25T15:04:45.579 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "interval", 2024-01-25T15:04:45.579 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.579 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.579 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.579 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "30", 2024-01-25T15:04:45.580 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "5", 2024-01-25T15:04:45.580 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.580 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.580 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-01-25T15:04:45.580 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.580 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.580 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.580 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.580 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.580 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.580 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.580 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.580 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.581 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.581 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.581 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.581 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.581 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.581 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.581 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.581 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.581 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.581 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.581 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.581 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.581 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.582 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.582 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.582 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.582 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.582 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.582 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.582 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.582 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.582 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.582 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.582 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.582 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.582 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.583 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.583 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.583 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.583 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.583 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.583 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.583 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.583 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.583 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.583 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.583 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.583 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.583 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.583 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.584 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.584 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.584 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.584 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.584 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.584 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.584 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.584 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.584 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.584 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.584 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.584 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.584 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.585 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.585 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.585 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.585 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.585 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.585 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.585 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.585 INFO:teuthology.orchestra.run.smithi170.stdout: "password": { 2024-01-25T15:04:45.585 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "password", 2024-01-25T15:04:45.585 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.585 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.585 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.585 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.585 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.586 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.586 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.586 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "password of InfluxDB server user", 2024-01-25T15:04:45.586 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.586 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.586 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.586 INFO:teuthology.orchestra.run.smithi170.stdout: "port": { 2024-01-25T15:04:45.586 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "port", 2024-01-25T15:04:45.586 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.586 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.586 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.586 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "8086", 2024-01-25T15:04:45.586 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.587 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.587 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.587 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "InfluxDB server port", 2024-01-25T15:04:45.587 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.587 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.587 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.587 INFO:teuthology.orchestra.run.smithi170.stdout: "ssl": { 2024-01-25T15:04:45.587 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ssl", 2024-01-25T15:04:45.587 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.587 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.587 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.587 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "false", 2024-01-25T15:04:45.587 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.587 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.588 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.588 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-01-25T15:04:45.588 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.588 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.588 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.588 INFO:teuthology.orchestra.run.smithi170.stdout: "threads": { 2024-01-25T15:04:45.588 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "threads", 2024-01-25T15:04:45.588 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.588 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.588 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.588 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "5", 2024-01-25T15:04:45.588 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "1", 2024-01-25T15:04:45.588 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "32", 2024-01-25T15:04:45.589 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.589 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-01-25T15:04:45.589 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.589 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.589 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.589 INFO:teuthology.orchestra.run.smithi170.stdout: "username": { 2024-01-25T15:04:45.589 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "username", 2024-01-25T15:04:45.589 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.589 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.589 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.589 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.589 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.589 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.589 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.590 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "username of InfluxDB server user", 2024-01-25T15:04:45.590 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.590 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.590 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.590 INFO:teuthology.orchestra.run.smithi170.stdout: "verify_ssl": { 2024-01-25T15:04:45.590 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "verify_ssl", 2024-01-25T15:04:45.590 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.590 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.590 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.590 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "true", 2024-01-25T15:04:45.590 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.590 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.590 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.590 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-01-25T15:04:45.591 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.591 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.591 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.591 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.591 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.591 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "insights", 2024-01-25T15:04:45.591 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.591 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.591 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.591 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.591 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.591 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.592 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.592 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.592 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.592 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.592 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.592 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.592 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.592 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.592 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.592 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.592 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.592 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.592 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.592 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.592 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.593 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.593 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.593 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.593 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.593 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.593 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.593 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.593 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.593 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.593 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.593 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.593 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.593 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.594 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.594 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.594 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.594 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.594 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.594 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.594 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.594 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.594 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.594 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.594 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.594 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.594 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.595 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.595 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.595 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.595 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.595 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.595 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.595 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.595 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.595 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.595 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.595 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.595 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.596 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.596 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.596 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.596 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.596 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.596 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.596 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.596 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.596 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.596 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.596 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.596 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.597 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "iostat", 2024-01-25T15:04:45.597 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.597 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.597 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.597 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.597 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.597 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.597 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.597 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.597 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.597 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.597 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.597 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.597 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.598 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.598 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.598 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.598 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.598 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.598 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.598 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.598 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.598 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.598 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.598 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.598 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.599 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.599 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.599 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.599 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.599 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.599 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.599 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.599 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.599 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.599 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.599 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.599 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.599 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.599 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.600 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.600 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.600 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.600 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.600 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.600 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.600 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.600 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.600 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.600 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.600 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.600 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.600 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.601 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.601 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.601 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.601 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.601 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.601 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.601 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.601 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.601 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.601 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.601 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.601 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.601 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.601 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.602 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.602 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.602 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.602 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.602 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.602 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "k8sevents", 2024-01-25T15:04:45.602 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.602 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.602 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.602 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_event_retention_days": { 2024-01-25T15:04:45.602 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ceph_event_retention_days", 2024-01-25T15:04:45.602 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.603 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.603 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.603 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "7", 2024-01-25T15:04:45.603 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.603 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.603 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.603 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Days to hold ceph event information within local cache", 2024-01-25T15:04:45.603 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.603 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.603 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.603 INFO:teuthology.orchestra.run.smithi170.stdout: "config_check_secs": { 2024-01-25T15:04:45.603 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "config_check_secs", 2024-01-25T15:04:45.603 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.603 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.604 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.604 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:45.604 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "10", 2024-01-25T15:04:45.604 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.604 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.604 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-01-25T15:04:45.604 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.604 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.604 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.604 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.604 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.604 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.604 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.605 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.605 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.605 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.605 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.605 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.605 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.605 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.605 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.605 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.605 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.605 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.605 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.605 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.605 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.606 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.606 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.606 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.606 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.606 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.606 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.606 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.606 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.606 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.606 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.606 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.606 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.606 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.606 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.607 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.607 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.607 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.607 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.607 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.607 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.607 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.607 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.607 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.607 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.607 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.607 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.607 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.608 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.608 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.608 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.608 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.608 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.608 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.608 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.608 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.608 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.608 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.608 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.608 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.609 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.609 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.609 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.609 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.609 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.609 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.609 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.609 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.609 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.609 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.609 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.609 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "localpool", 2024-01-25T15:04:45.610 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.610 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.610 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.610 INFO:teuthology.orchestra.run.smithi170.stdout: "failure_domain": { 2024-01-25T15:04:45.610 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "failure_domain", 2024-01-25T15:04:45.610 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.610 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.610 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.610 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "host", 2024-01-25T15:04:45.610 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.610 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.610 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.610 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "failure domain for any created local pool", 2024-01-25T15:04:45.610 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-01-25T15:04:45.611 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.611 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.611 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.611 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.611 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.611 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.611 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.611 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.611 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.611 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.611 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.611 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.611 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.612 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.612 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.612 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.612 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.612 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.612 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.612 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.612 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.612 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.612 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.612 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.612 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.612 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.613 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.613 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.613 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.613 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.613 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.613 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.613 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.613 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.613 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.613 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.613 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.613 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.613 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.613 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.614 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.614 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.614 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.614 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.614 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.614 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.614 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.614 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.614 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.614 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.614 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.614 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.614 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.614 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.615 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.615 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.615 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.615 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.615 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.615 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.615 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.615 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.615 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.615 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.615 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.615 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.615 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.615 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.616 INFO:teuthology.orchestra.run.smithi170.stdout: "min_size": { 2024-01-25T15:04:45.616 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "min_size", 2024-01-25T15:04:45.616 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.616 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.616 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.616 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.616 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.616 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.616 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.616 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "default min_size for any created local pool", 2024-01-25T15:04:45.616 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-01-25T15:04:45.616 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.616 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.617 INFO:teuthology.orchestra.run.smithi170.stdout: "num_rep": { 2024-01-25T15:04:45.617 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "num_rep", 2024-01-25T15:04:45.617 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.617 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.617 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.617 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "3", 2024-01-25T15:04:45.617 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.617 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.617 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.617 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "default replica count for any created local pool", 2024-01-25T15:04:45.617 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.617 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.617 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.618 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_num": { 2024-01-25T15:04:45.618 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "pg_num", 2024-01-25T15:04:45.618 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.618 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.618 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.618 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "128", 2024-01-25T15:04:45.618 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.618 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.618 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.618 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "default pg_num for any created local pool", 2024-01-25T15:04:45.618 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.618 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.618 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.619 INFO:teuthology.orchestra.run.smithi170.stdout: "prefix": { 2024-01-25T15:04:45.619 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "prefix", 2024-01-25T15:04:45.619 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.619 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.619 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.619 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.619 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.619 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.619 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.619 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "name prefix for any created local pool", 2024-01-25T15:04:45.619 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.619 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.619 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.619 INFO:teuthology.orchestra.run.smithi170.stdout: "subtree": { 2024-01-25T15:04:45.620 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "subtree", 2024-01-25T15:04:45.620 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.620 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.620 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.620 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "rack", 2024-01-25T15:04:45.620 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.620 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.620 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.620 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "CRUSH level for which to create a local pool", 2024-01-25T15:04:45.620 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-01-25T15:04:45.620 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.620 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.620 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.620 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.621 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mds_autoscaler", 2024-01-25T15:04:45.621 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.621 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.621 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.621 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.621 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.621 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.621 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.621 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.621 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.621 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.622 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.622 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.622 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.622 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.622 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.622 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.622 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.622 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.622 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.622 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.622 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.622 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.622 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.622 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.623 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.623 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.623 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.623 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.623 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.623 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.623 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.623 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.623 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.623 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.623 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.623 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.623 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.624 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.624 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.624 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.624 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.624 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.624 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.624 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.624 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.624 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.624 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.624 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.624 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.624 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.624 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.625 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.625 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.625 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.625 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.625 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.625 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.625 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.625 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.625 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.625 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.625 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.625 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.626 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.626 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.626 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.626 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.626 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.626 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.626 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.626 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.626 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mirroring", 2024-01-25T15:04:45.626 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.626 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.626 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.626 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.627 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.627 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.627 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.627 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.627 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.627 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.627 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.627 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.627 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.627 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.627 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.627 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.627 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.627 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.628 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.628 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.628 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.628 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.628 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.628 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.628 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.628 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.628 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.628 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.628 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.628 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.628 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.629 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.629 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.629 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.629 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.629 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.629 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.629 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.629 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.629 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.629 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.629 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.629 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.629 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.630 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.630 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.630 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.630 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.630 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.630 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.630 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.630 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.630 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.630 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.630 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.630 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.630 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.630 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.631 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.631 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.631 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.631 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.631 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.631 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.631 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.631 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.631 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.631 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.631 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.631 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.631 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.632 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "nfs", 2024-01-25T15:04:45.632 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.632 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.632 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.632 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.632 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.632 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.632 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.632 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.632 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.632 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.632 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.633 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.633 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.633 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.633 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.633 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.633 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.633 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.633 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.633 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.633 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.633 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.633 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.633 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.634 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.634 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.634 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.634 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.634 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.634 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.634 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.634 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.634 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.634 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.634 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.634 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.634 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.635 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.635 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.635 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.635 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.635 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.635 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.635 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.635 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.635 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.635 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.635 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.635 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.635 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.635 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.635 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.636 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.636 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.636 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.636 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.636 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.636 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.636 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.636 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.636 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.636 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.636 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.637 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.637 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.637 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.637 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.637 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.637 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.637 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.637 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.637 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "orchestrator", 2024-01-25T15:04:45.637 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.637 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.637 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "fail_fs": { 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "fail_fs", 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.638 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.639 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.640 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.641 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.642 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "orchestrator": { 2024-01-25T15:04:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "orchestrator", 2024-01-25T15:04:45.643 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "cephadm", 2024-01-25T15:04:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "rook", 2024-01-25T15:04:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "test_orchestrator" 2024-01-25T15:04:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Orchestrator backend", 2024-01-25T15:04:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.644 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "osd_perf_query", 2024-01-25T15:04:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.645 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.647 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.648 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.649 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.649 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.649 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.649 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.649 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.649 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.649 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.649 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.649 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.649 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.649 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.649 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.649 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.650 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.650 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.650 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.650 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.650 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.650 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.650 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.650 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "osd_support", 2024-01-25T15:04:45.650 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.650 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.650 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.650 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.651 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.652 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.652 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.652 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.652 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.652 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.652 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.652 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.652 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.652 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.652 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.652 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.652 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.652 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.653 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.653 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.653 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.653 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.653 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.653 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.653 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.653 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.653 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.653 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.653 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.653 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.653 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.654 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.654 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.654 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.654 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.654 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.654 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.654 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.654 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.654 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.654 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.654 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.654 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.654 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.655 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.655 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.655 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.655 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.655 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.655 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.655 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.655 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.655 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.655 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.655 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.655 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.655 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.655 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.656 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "pg_autoscaler", 2024-01-25T15:04:45.656 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.656 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.656 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.656 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.656 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.656 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.656 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.656 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.656 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.656 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.656 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.656 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.657 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.657 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.657 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.657 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.657 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.657 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.657 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.657 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.657 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.657 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.657 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.657 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.657 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.658 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.658 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.658 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.658 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.658 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.658 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.658 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.658 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.658 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.658 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.658 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.658 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.658 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.659 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.659 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.659 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.659 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.659 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.659 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.659 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.659 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.659 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.659 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.659 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.659 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.659 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.659 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.659 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.660 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.660 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.660 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.660 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.660 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.660 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.660 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.660 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.660 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.660 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.660 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.660 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.661 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.661 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.661 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.661 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.661 INFO:teuthology.orchestra.run.smithi170.stdout: "sleep_interval": { 2024-01-25T15:04:45.661 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "sleep_interval", 2024-01-25T15:04:45.661 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.661 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.661 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.661 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "60", 2024-01-25T15:04:45.661 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.661 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.661 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.661 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: "threshold": { 2024-01-25T15:04:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "threshold", 2024-01-25T15:04:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "3.0", 2024-01-25T15:04:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "1.0", 2024-01-25T15:04:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "scaling threshold", 2024-01-25T15:04:45.662 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-01-25T15:04:45.663 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.663 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.663 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.663 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.663 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "progress", 2024-01-25T15:04:45.663 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.663 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.663 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.663 INFO:teuthology.orchestra.run.smithi170.stdout: "allow_pg_recovery_event": { 2024-01-25T15:04:45.663 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "allow_pg_recovery_event", 2024-01-25T15:04:45.663 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.664 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.664 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.664 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.664 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.664 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.664 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.664 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "allow the module to show pg recovery progress", 2024-01-25T15:04:45.664 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.664 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.664 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.664 INFO:teuthology.orchestra.run.smithi170.stdout: "enabled": { 2024-01-25T15:04:45.664 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "enabled", 2024-01-25T15:04:45.664 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.665 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.665 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.665 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.665 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.665 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.665 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.665 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.665 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.665 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.665 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.665 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.665 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.665 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.666 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.666 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.666 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.666 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.666 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.666 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.666 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.666 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.666 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.666 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.666 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.666 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.666 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.666 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.666 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.667 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.667 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.667 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.667 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.667 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.667 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.667 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.667 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.667 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.667 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.667 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.667 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.667 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.668 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.668 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.668 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.668 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.668 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.668 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.668 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.668 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.668 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.668 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.668 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.668 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.668 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.669 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.669 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.669 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.669 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.669 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.669 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.669 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.669 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.669 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.669 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.669 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.669 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.669 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.669 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: "max_completed_events": { 2024-01-25T15:04:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "max_completed_events", 2024-01-25T15:04:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.670 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "50", 2024-01-25T15:04:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "number of past completed events to remember", 2024-01-25T15:04:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: "sleep_interval": { 2024-01-25T15:04:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "sleep_interval", 2024-01-25T15:04:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "5", 2024-01-25T15:04:45.671 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.672 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.672 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.672 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how long the module is going to sleep", 2024-01-25T15:04:45.672 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.672 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.672 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.672 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.672 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.672 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "prometheus", 2024-01-25T15:04:45.672 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.672 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.672 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.673 INFO:teuthology.orchestra.run.smithi170.stdout: "cache": { 2024-01-25T15:04:45.673 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "cache", 2024-01-25T15:04:45.673 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.673 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.673 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.673 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.673 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.673 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.673 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.673 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.673 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.673 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.673 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.673 INFO:teuthology.orchestra.run.smithi170.stdout: "exclude_perf_counters": { 2024-01-25T15:04:45.674 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "exclude_perf_counters", 2024-01-25T15:04:45.674 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.674 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.674 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.674 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.674 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.674 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.674 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.674 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-01-25T15:04:45.674 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-01-25T15:04:45.674 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.674 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.674 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.674 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.675 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.675 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.675 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.675 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.675 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.675 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.675 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.675 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.675 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.675 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.675 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.675 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.675 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.675 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.676 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.676 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.676 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.676 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.676 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.676 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.676 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.676 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.676 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.676 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.676 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.676 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.677 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.677 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.677 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.677 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.677 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.677 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.677 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.677 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.677 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.677 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.677 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.677 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.677 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.678 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.678 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.678 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.678 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.678 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.678 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.678 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.678 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.678 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.678 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.678 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.678 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.678 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.679 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.679 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.679 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.679 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.679 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.679 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.679 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.679 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.679 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.679 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.679 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.679 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.679 INFO:teuthology.orchestra.run.smithi170.stdout: "rbd_stats_pools": { 2024-01-25T15:04:45.679 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rbd_stats_pools", 2024-01-25T15:04:45.680 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.680 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.680 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.680 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.680 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.680 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.680 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.680 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.680 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.680 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.680 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.680 INFO:teuthology.orchestra.run.smithi170.stdout: "rbd_stats_pools_refresh_interval": { 2024-01-25T15:04:45.680 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-01-25T15:04:45.681 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.681 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.681 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.681 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "300", 2024-01-25T15:04:45.681 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.681 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.681 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.681 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.681 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.681 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.681 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.681 INFO:teuthology.orchestra.run.smithi170.stdout: "scrape_interval": { 2024-01-25T15:04:45.681 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "scrape_interval", 2024-01-25T15:04:45.682 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:45.682 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.682 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.682 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "15.0", 2024-01-25T15:04:45.682 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.682 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.682 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.682 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.682 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.682 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.682 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.682 INFO:teuthology.orchestra.run.smithi170.stdout: "server_addr": { 2024-01-25T15:04:45.682 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_addr", 2024-01-25T15:04:45.682 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.683 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.683 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.683 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "::", 2024-01-25T15:04:45.683 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.683 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.683 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.683 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-01-25T15:04:45.683 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.683 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.683 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.683 INFO:teuthology.orchestra.run.smithi170.stdout: "server_port": { 2024-01-25T15:04:45.683 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_port", 2024-01-25T15:04:45.683 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.684 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.684 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.684 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "9283", 2024-01-25T15:04:45.684 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.684 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.684 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.684 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-01-25T15:04:45.684 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.684 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.684 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.684 INFO:teuthology.orchestra.run.smithi170.stdout: "stale_cache_strategy": { 2024-01-25T15:04:45.684 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "stale_cache_strategy", 2024-01-25T15:04:45.684 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.685 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.685 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.685 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "log", 2024-01-25T15:04:45.685 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.685 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.685 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.685 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.685 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.685 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.685 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.685 INFO:teuthology.orchestra.run.smithi170.stdout: "standby_behaviour": { 2024-01-25T15:04:45.685 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "standby_behaviour", 2024-01-25T15:04:45.685 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.685 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.686 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.686 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "default", 2024-01-25T15:04:45.686 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.686 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.686 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.686 INFO:teuthology.orchestra.run.smithi170.stdout: "default", 2024-01-25T15:04:45.686 INFO:teuthology.orchestra.run.smithi170.stdout: "error" 2024-01-25T15:04:45.686 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.686 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.686 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.686 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.686 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.686 INFO:teuthology.orchestra.run.smithi170.stdout: "standby_error_status_code": { 2024-01-25T15:04:45.686 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "standby_error_status_code", 2024-01-25T15:04:45.687 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.687 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.687 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.687 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "500", 2024-01-25T15:04:45.687 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "400", 2024-01-25T15:04:45.687 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "599", 2024-01-25T15:04:45.687 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.687 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.687 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.687 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.687 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.687 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.687 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.688 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rbd_support", 2024-01-25T15:04:45.688 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.688 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.688 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.688 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.688 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.688 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.688 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.688 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.688 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.688 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.688 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.688 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.689 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.689 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.689 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.689 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.689 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.689 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.689 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.689 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.689 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.689 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.689 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.689 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.689 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.690 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.690 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.690 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.690 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.690 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.690 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.690 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.690 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.690 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.690 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.690 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.690 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.690 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.691 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.691 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.691 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.691 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.691 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.691 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.691 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.691 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.691 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.691 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.691 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.691 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.691 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.691 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.691 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.692 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "max_concurrent_snap_create": { 2024-01-25T15:04:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "max_concurrent_snap_create", 2024-01-25T15:04:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.693 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "mirror_snapshot_schedule": { 2024-01-25T15:04:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mirror_snapshot_schedule", 2024-01-25T15:04:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.694 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "trash_purge_schedule": { 2024-01-25T15:04:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "trash_purge_schedule", 2024-01-25T15:04:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.695 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.696 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.696 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.696 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.696 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.696 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "restful", 2024-01-25T15:04:45.696 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.696 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.696 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.696 INFO:teuthology.orchestra.run.smithi170.stdout: "enable_auth": { 2024-01-25T15:04:45.696 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "enable_auth", 2024-01-25T15:04:45.696 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.696 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.697 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.697 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.697 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.697 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.697 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.697 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.697 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.697 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.697 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.697 INFO:teuthology.orchestra.run.smithi170.stdout: "key_file": { 2024-01-25T15:04:45.697 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "key_file", 2024-01-25T15:04:45.697 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.697 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.698 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.698 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.698 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.698 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.698 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.698 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.698 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.698 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.698 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.698 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.698 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.698 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.698 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.698 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.699 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.699 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.699 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.699 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.699 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.699 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.699 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.699 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.699 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.699 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.699 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.699 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.699 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.699 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.700 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.700 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.700 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.700 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.700 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.700 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.700 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.700 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.700 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.700 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.700 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.700 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.700 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.701 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.702 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.702 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.702 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.702 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.702 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.702 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.702 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.702 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.702 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.702 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.702 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.702 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.702 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.702 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.703 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.703 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.703 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.703 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.703 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.703 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.703 INFO:teuthology.orchestra.run.smithi170.stdout: "server_addr": { 2024-01-25T15:04:45.703 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_addr", 2024-01-25T15:04:45.703 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.704 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.704 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.704 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.704 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.704 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.704 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.704 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.704 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.704 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.704 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.704 INFO:teuthology.orchestra.run.smithi170.stdout: "server_port": { 2024-01-25T15:04:45.704 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_port", 2024-01-25T15:04:45.704 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.705 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.705 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.705 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.705 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.705 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.705 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.705 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.705 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.705 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.705 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.705 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.705 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.706 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rgw", 2024-01-25T15:04:45.706 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.706 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.706 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.706 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.706 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.706 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.706 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.706 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.706 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.706 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.706 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.706 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.706 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.706 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.707 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.707 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.707 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.707 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.707 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.707 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.707 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.707 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.707 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.707 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.707 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.707 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.707 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.707 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.708 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.708 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.708 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.708 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.708 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.708 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.708 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.708 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.708 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.708 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.708 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.708 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.709 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.709 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.709 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.709 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.709 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.709 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.709 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.709 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.709 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.709 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.709 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.709 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.709 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.709 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.709 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.710 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.710 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.710 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.710 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.710 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.710 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.710 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.710 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.710 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.710 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.710 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.710 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.710 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.711 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.711 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.711 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.711 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rook", 2024-01-25T15:04:45.711 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.711 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.711 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.711 INFO:teuthology.orchestra.run.smithi170.stdout: "drive_group_interval": { 2024-01-25T15:04:45.711 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "drive_group_interval", 2024-01-25T15:04:45.711 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:45.711 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.711 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.711 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "300.0", 2024-01-25T15:04:45.712 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.712 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.712 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.712 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2024-01-25T15:04:45.712 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.712 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.712 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.712 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.712 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.712 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.712 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.712 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.712 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.713 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.713 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.713 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.713 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.713 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.713 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.713 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.713 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.713 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.713 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.713 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.713 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.713 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.713 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.714 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.714 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.714 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.714 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.714 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.714 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.714 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.714 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.714 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.714 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.714 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.714 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.714 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.715 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.715 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.715 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.715 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.715 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.715 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.715 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.715 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.715 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.715 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.715 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.715 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.715 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.715 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.716 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.716 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.716 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.716 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.716 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.716 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.716 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.716 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.716 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.716 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.716 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.716 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.716 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.717 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.717 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.717 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.717 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.717 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.717 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.717 INFO:teuthology.orchestra.run.smithi170.stdout: "storage_class": { 2024-01-25T15:04:45.717 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "storage_class", 2024-01-25T15:04:45.717 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.717 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.717 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.718 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "local", 2024-01-25T15:04:45.718 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.718 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.718 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.718 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-01-25T15:04:45.718 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.718 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.718 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.718 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.718 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.718 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "selftest", 2024-01-25T15:04:45.718 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.719 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.719 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.719 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.719 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.719 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.719 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.719 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.719 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.719 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.719 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.719 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.719 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.719 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.719 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.720 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.720 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.720 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.720 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.720 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.720 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.720 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.720 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.720 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.720 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.720 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.720 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.720 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.721 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.721 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.721 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.721 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.721 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.721 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.721 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.721 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.721 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.721 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.721 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.721 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.721 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.722 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.722 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.722 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.722 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.722 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.722 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.722 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.722 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.722 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.722 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.722 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.722 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.722 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.722 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.723 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.723 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.723 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.723 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.723 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.723 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.723 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.723 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.723 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.723 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.723 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.723 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.723 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.724 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.724 INFO:teuthology.orchestra.run.smithi170.stdout: "roption1": { 2024-01-25T15:04:45.724 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "roption1", 2024-01-25T15:04:45.724 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.724 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.724 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.724 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.724 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.724 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.724 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.724 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.724 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.724 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.725 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.725 INFO:teuthology.orchestra.run.smithi170.stdout: "roption2": { 2024-01-25T15:04:45.725 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "roption2", 2024-01-25T15:04:45.725 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.725 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.725 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.725 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "xyz", 2024-01-25T15:04:45.725 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.725 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.725 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.725 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.725 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.725 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.725 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.726 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption1": { 2024-01-25T15:04:45.726 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption1", 2024-01-25T15:04:45.726 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.726 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.726 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.726 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.726 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.726 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.726 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.726 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.726 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.726 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.726 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.727 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption2": { 2024-01-25T15:04:45.727 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption2", 2024-01-25T15:04:45.727 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.727 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.727 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.727 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.727 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.727 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.727 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.727 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.727 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.727 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.727 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.728 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption3": { 2024-01-25T15:04:45.728 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption3", 2024-01-25T15:04:45.728 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:45.728 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.728 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.728 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.728 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.728 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.728 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.728 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.728 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.728 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.728 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.729 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption4": { 2024-01-25T15:04:45.729 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption4", 2024-01-25T15:04:45.729 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.729 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.729 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.729 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.729 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.729 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.729 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.729 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.729 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.729 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.729 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.729 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption5": { 2024-01-25T15:04:45.730 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption5", 2024-01-25T15:04:45.730 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.730 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.730 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.730 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.730 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.730 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.730 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.730 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.730 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.730 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.730 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.731 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption6": { 2024-01-25T15:04:45.731 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption6", 2024-01-25T15:04:45.731 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.731 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.731 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.731 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.731 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.731 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.731 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.731 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.731 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.731 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.731 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.732 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption7": { 2024-01-25T15:04:45.732 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption7", 2024-01-25T15:04:45.732 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.732 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.732 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.732 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.732 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "1", 2024-01-25T15:04:45.732 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "42", 2024-01-25T15:04:45.732 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.732 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.732 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.732 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.732 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.733 INFO:teuthology.orchestra.run.smithi170.stdout: "testkey": { 2024-01-25T15:04:45.733 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "testkey", 2024-01-25T15:04:45.733 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.733 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.733 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.733 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.733 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.733 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.733 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.733 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.733 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.733 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.733 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.733 INFO:teuthology.orchestra.run.smithi170.stdout: "testlkey": { 2024-01-25T15:04:45.734 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "testlkey", 2024-01-25T15:04:45.734 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.734 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.734 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.734 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.734 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.734 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.734 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.734 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.734 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.734 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.734 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.734 INFO:teuthology.orchestra.run.smithi170.stdout: "testnewline": { 2024-01-25T15:04:45.735 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "testnewline", 2024-01-25T15:04:45.735 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.735 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.735 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.735 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.735 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.735 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.735 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.735 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.735 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.735 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.735 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.735 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.735 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.736 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "snap_schedule", 2024-01-25T15:04:45.736 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.736 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.736 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.736 INFO:teuthology.orchestra.run.smithi170.stdout: "allow_m_granularity": { 2024-01-25T15:04:45.736 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "allow_m_granularity", 2024-01-25T15:04:45.736 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.736 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.736 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.736 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.736 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.736 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.736 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.737 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "allow minute scheduled snapshots", 2024-01-25T15:04:45.737 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.737 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.737 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.737 INFO:teuthology.orchestra.run.smithi170.stdout: "dump_on_update": { 2024-01-25T15:04:45.737 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "dump_on_update", 2024-01-25T15:04:45.737 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.737 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.737 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.737 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.737 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.737 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.737 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.738 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "dump database to debug log on update", 2024-01-25T15:04:45.738 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.738 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.738 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.738 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.738 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.738 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.738 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.738 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.738 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.738 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.738 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.738 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.738 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.739 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.739 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.739 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.739 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.739 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.739 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.739 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.739 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.739 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.739 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.739 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.739 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.739 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.740 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.740 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.740 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.740 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.740 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.740 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.740 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.740 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.740 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.740 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.740 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.740 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.740 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.741 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.741 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.741 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.741 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.741 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.741 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.741 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.741 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.741 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.741 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.741 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.741 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.741 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.741 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.742 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.742 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.742 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.742 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.742 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.742 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.742 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.742 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.742 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.742 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.742 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.742 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.742 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.742 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.743 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.743 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.743 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.743 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.743 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "stats", 2024-01-25T15:04:45.743 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.743 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.743 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.743 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.743 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.743 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.743 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.743 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.744 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.744 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.744 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.744 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.744 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.744 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.744 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.744 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.744 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.744 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.744 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.744 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.745 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.745 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.745 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.745 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.745 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.745 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.745 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.745 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.745 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.745 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.745 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.745 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.745 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.746 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.746 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.746 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.746 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.746 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.746 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.746 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.746 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.746 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.746 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.746 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.746 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.746 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.747 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.747 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.747 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.747 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.747 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.747 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.747 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.747 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.747 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.747 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.747 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.747 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.747 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.747 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.748 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.748 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.748 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.748 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.748 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.748 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.748 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.748 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.748 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.748 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.748 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.749 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "status", 2024-01-25T15:04:45.749 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.749 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.749 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.749 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.749 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.749 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.749 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.749 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.749 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.749 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.749 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.749 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.749 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.750 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.750 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.750 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.750 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.750 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.750 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.750 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.750 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.750 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.750 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.750 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.750 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.750 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.750 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.751 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.751 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.751 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.751 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.751 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.751 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.751 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.751 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.751 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.751 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.751 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.751 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.751 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.752 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.752 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.752 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.752 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.752 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.752 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.752 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.752 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.752 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.752 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.752 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.752 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.752 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.752 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.753 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.754 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.754 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.754 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.754 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.754 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "telegraf", 2024-01-25T15:04:45.754 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.754 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.754 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.754 INFO:teuthology.orchestra.run.smithi170.stdout: "address": { 2024-01-25T15:04:45.754 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "address", 2024-01-25T15:04:45.754 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.754 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi170.stdout: "interval": { 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "interval", 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.755 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.756 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "15", 2024-01-25T15:04:45.756 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.756 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.756 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.756 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.756 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.756 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.756 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.756 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.756 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.756 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.756 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.757 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.758 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.759 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.759 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.759 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.759 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.759 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.759 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.759 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.759 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.759 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.759 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.759 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.759 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.759 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.759 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.760 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "telemetry", 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.761 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi170.stdout: "channel_basic": { 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "channel_basic", 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Share basic cluster information (size, version)", 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.762 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi170.stdout: "channel_crash": { 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "channel_crash", 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.763 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.764 INFO:teuthology.orchestra.run.smithi170.stdout: "channel_device": { 2024-01-25T15:04:45.764 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "channel_device", 2024-01-25T15:04:45.764 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.764 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.764 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.764 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.764 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.764 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.764 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.764 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-01-25T15:04:45.764 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.764 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.764 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi170.stdout: "channel_ident": { 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "channel_ident", 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.766 INFO:teuthology.orchestra.run.smithi170.stdout: "channel_perf": { 2024-01-25T15:04:45.766 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "channel_perf", 2024-01-25T15:04:45.766 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.766 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.766 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.766 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.766 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.766 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.766 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.766 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Share various performance metrics of a cluster", 2024-01-25T15:04:45.766 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.766 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.766 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.767 INFO:teuthology.orchestra.run.smithi170.stdout: "contact": { 2024-01-25T15:04:45.767 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "contact", 2024-01-25T15:04:45.767 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.767 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.767 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.767 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.767 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.767 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.767 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.767 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.767 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.767 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.767 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.767 INFO:teuthology.orchestra.run.smithi170.stdout: "description": { 2024-01-25T15:04:45.768 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "description", 2024-01-25T15:04:45.768 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.768 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.768 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.768 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.768 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.768 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.768 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.768 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.768 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.768 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.768 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.768 INFO:teuthology.orchestra.run.smithi170.stdout: "device_url": { 2024-01-25T15:04:45.769 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "device_url", 2024-01-25T15:04:45.769 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.769 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.769 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.769 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-01-25T15:04:45.769 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.769 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.769 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.769 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.769 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.769 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.769 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.769 INFO:teuthology.orchestra.run.smithi170.stdout: "enabled": { 2024-01-25T15:04:45.770 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "enabled", 2024-01-25T15:04:45.770 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.770 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.770 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.770 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.770 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.770 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.770 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.770 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.770 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.770 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.770 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.770 INFO:teuthology.orchestra.run.smithi170.stdout: "interval": { 2024-01-25T15:04:45.770 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "interval", 2024-01-25T15:04:45.771 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.771 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.771 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.771 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "24", 2024-01-25T15:04:45.771 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "8", 2024-01-25T15:04:45.771 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.771 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.771 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.771 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.771 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.771 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.771 INFO:teuthology.orchestra.run.smithi170.stdout: "last_opt_revision": { 2024-01-25T15:04:45.771 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "last_opt_revision", 2024-01-25T15:04:45.772 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.772 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.772 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.772 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "1", 2024-01-25T15:04:45.772 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.772 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.772 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.772 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.772 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.772 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.772 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.772 INFO:teuthology.orchestra.run.smithi170.stdout: "leaderboard": { 2024-01-25T15:04:45.773 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "leaderboard", 2024-01-25T15:04:45.773 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.773 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.773 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.773 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.773 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.773 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.773 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.773 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.773 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.773 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.773 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.773 INFO:teuthology.orchestra.run.smithi170.stdout: "leaderboard_description": { 2024-01-25T15:04:45.774 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "leaderboard_description", 2024-01-25T15:04:45.774 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.774 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.774 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.774 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.774 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.774 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.774 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.774 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.774 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.774 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.774 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.775 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.775 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.775 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.775 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.775 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.775 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.775 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.775 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.775 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.775 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.775 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.775 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.775 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.775 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.776 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.776 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.776 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.776 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.776 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.776 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.776 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.776 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.776 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.776 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.776 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.776 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.776 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.777 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.777 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.777 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.777 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.777 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.777 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.777 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.777 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.777 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.777 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.777 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.777 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.777 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.778 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.778 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.778 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.778 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.778 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.778 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.778 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.778 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.778 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.778 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.778 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.778 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.778 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.779 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.779 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.779 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.779 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.779 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.779 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.779 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.779 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.779 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.779 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.779 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.779 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.779 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.779 INFO:teuthology.orchestra.run.smithi170.stdout: "organization": { 2024-01-25T15:04:45.780 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "organization", 2024-01-25T15:04:45.780 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.780 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.780 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.780 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.780 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.780 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.780 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.780 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.780 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.780 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.780 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.781 INFO:teuthology.orchestra.run.smithi170.stdout: "proxy": { 2024-01-25T15:04:45.781 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "proxy", 2024-01-25T15:04:45.781 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.781 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.781 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.781 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.781 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.781 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.781 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.781 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.781 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.781 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.781 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.781 INFO:teuthology.orchestra.run.smithi170.stdout: "url": { 2024-01-25T15:04:45.782 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "url", 2024-01-25T15:04:45.782 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.782 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.782 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.782 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-01-25T15:04:45.782 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.782 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.782 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.782 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.782 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.782 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.782 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.782 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.782 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.783 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "test_orchestrator", 2024-01-25T15:04:45.783 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.783 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.783 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.783 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.783 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.783 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.783 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.783 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.783 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.783 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.783 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.784 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.784 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.784 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.784 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.784 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.784 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.784 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.784 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.784 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.784 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.784 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.784 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.784 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.785 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.785 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.785 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.785 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.785 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.785 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.785 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.785 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.785 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.785 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.785 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.785 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.785 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.786 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.786 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.786 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.786 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.786 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.786 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.786 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.786 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.786 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.786 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.786 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.786 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.786 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.786 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.787 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.787 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.787 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.787 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.787 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.787 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.787 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.787 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.787 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.787 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.787 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.787 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.787 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.787 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.788 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.788 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.788 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.788 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.788 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.788 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.788 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "volumes", 2024-01-25T15:04:45.788 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.788 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.788 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.788 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.788 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.789 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.789 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.789 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.789 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.789 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.789 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.789 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.789 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.789 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.789 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.789 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.789 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.789 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.789 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.790 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.790 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.790 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.790 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.790 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.790 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.790 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.790 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.790 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.790 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.790 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.790 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.790 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.790 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.791 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.791 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.791 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.791 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.791 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.791 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.791 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.791 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.791 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.791 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.791 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.791 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.791 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.792 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.792 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.792 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.792 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.792 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.792 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.792 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.792 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.792 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.795 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.795 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.795 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.795 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.795 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.795 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.795 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.795 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.795 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.795 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.795 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.795 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.795 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.796 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.796 INFO:teuthology.orchestra.run.smithi170.stdout: "max_concurrent_clones": { 2024-01-25T15:04:45.796 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "max_concurrent_clones", 2024-01-25T15:04:45.796 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.796 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.796 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.796 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "4", 2024-01-25T15:04:45.796 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.796 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.796 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.796 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Number of asynchronous cloner threads", 2024-01-25T15:04:45.796 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.796 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.797 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.797 INFO:teuthology.orchestra.run.smithi170.stdout: "periodic_async_work": { 2024-01-25T15:04:45.797 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "periodic_async_work", 2024-01-25T15:04:45.797 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.797 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.797 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.797 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.797 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.797 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.797 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.797 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Periodically check for async work", 2024-01-25T15:04:45.797 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.797 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.798 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.798 INFO:teuthology.orchestra.run.smithi170.stdout: "snapshot_clone_delay": { 2024-01-25T15:04:45.798 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "snapshot_clone_delay", 2024-01-25T15:04:45.798 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.798 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.798 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.798 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0", 2024-01-25T15:04:45.798 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.798 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.798 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.798 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-01-25T15:04:45.798 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.798 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.798 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.799 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.799 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.799 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "zabbix", 2024-01-25T15:04:45.799 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.799 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.799 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.799 INFO:teuthology.orchestra.run.smithi170.stdout: "discovery_interval": { 2024-01-25T15:04:45.799 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "discovery_interval", 2024-01-25T15:04:45.799 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "uint", 2024-01-25T15:04:45.799 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.799 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.799 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "100", 2024-01-25T15:04:45.800 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.800 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.800 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.800 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.800 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.800 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.800 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.800 INFO:teuthology.orchestra.run.smithi170.stdout: "identifier": { 2024-01-25T15:04:45.800 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "identifier", 2024-01-25T15:04:45.800 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.800 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.800 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.800 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.801 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.801 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.801 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.801 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.801 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.801 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.801 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.801 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.801 INFO:teuthology.orchestra.run.smithi170.stdout: "interval": { 2024-01-25T15:04:45.801 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "interval", 2024-01-25T15:04:45.801 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.801 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.801 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.801 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "60", 2024-01-25T15:04:45.802 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.802 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.802 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.802 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.802 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.802 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.802 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.802 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.802 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.802 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.802 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.802 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.802 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.803 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.803 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.803 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.803 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.803 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.803 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.803 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.803 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.803 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.803 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.803 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.803 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.803 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.803 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.804 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.804 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.804 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.804 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.804 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.804 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.804 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.804 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.804 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.804 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.804 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.804 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.805 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.805 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.805 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.805 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.805 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.805 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.805 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.805 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.805 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.805 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.805 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.805 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.805 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.805 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.806 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.806 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.806 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.806 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.806 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.806 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.806 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.806 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.806 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.806 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.806 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.806 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.806 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.806 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.807 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.807 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.807 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.807 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.807 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.807 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.807 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.807 INFO:teuthology.orchestra.run.smithi170.stdout: "zabbix_host": { 2024-01-25T15:04:45.807 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "zabbix_host", 2024-01-25T15:04:45.807 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.807 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.807 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.807 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.808 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.808 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.808 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.808 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.808 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.808 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.808 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.808 INFO:teuthology.orchestra.run.smithi170.stdout: "zabbix_port": { 2024-01-25T15:04:45.808 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "zabbix_port", 2024-01-25T15:04:45.808 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.808 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.808 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.808 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10051", 2024-01-25T15:04:45.809 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.809 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.809 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.809 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.809 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.809 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.809 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.809 INFO:teuthology.orchestra.run.smithi170.stdout: "zabbix_sender": { 2024-01-25T15:04:45.809 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "zabbix_sender", 2024-01-25T15:04:45.809 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.809 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.809 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.809 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-01-25T15:04:45.809 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.810 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.810 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.810 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.810 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.810 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.810 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.810 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.810 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.810 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.810 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-01-25T15:04:45.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.810 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.810 INFO:teuthology.orchestra.run.smithi170.stdout: "gid": 24110, 2024-01-25T15:04:45.810 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "y", 2024-01-25T15:04:45.810 INFO:teuthology.orchestra.run.smithi170.stdout: "mgr_features": 4540701272860131327, 2024-01-25T15:04:45.811 INFO:teuthology.orchestra.run.smithi170.stdout: "available_modules": [ 2024-01-25T15:04:45.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.811 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "alerts", 2024-01-25T15:04:45.811 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.811 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.811 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.811 INFO:teuthology.orchestra.run.smithi170.stdout: "interval": { 2024-01-25T15:04:45.811 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "interval", 2024-01-25T15:04:45.811 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.811 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.811 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.811 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "60", 2024-01-25T15:04:45.811 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.811 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.811 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.812 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "How frequently to reexamine health status", 2024-01-25T15:04:45.812 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.812 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.812 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.812 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.812 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.812 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.812 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.812 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.812 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.812 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.812 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.812 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.813 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.813 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.813 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.813 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.813 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.813 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.813 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.813 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.813 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.813 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.813 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.813 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.814 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.814 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.814 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.814 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.814 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.814 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.814 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.814 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.814 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.814 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.814 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.814 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.814 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.815 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.815 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.815 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.815 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.815 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.815 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.815 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.815 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.815 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.815 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.815 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.815 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.816 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.816 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.816 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.816 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.816 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.816 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.816 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.816 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.816 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.816 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.816 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.816 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.816 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.817 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.817 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.817 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.817 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.817 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.817 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.817 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.817 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_destination": { 2024-01-25T15:04:45.817 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_destination", 2024-01-25T15:04:45.817 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.817 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.818 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.818 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.818 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.818 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.818 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.818 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Email address to send alerts to", 2024-01-25T15:04:45.818 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.818 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.818 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.818 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_from_name": { 2024-01-25T15:04:45.818 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_from_name", 2024-01-25T15:04:45.818 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.818 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.819 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.819 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "Ceph", 2024-01-25T15:04:45.819 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.819 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.819 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.819 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Email From: name", 2024-01-25T15:04:45.819 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.819 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.819 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.819 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_host": { 2024-01-25T15:04:45.819 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_host", 2024-01-25T15:04:45.819 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.820 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.820 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.820 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.820 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.820 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.820 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.820 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "SMTP server", 2024-01-25T15:04:45.820 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.820 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.820 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.820 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_password": { 2024-01-25T15:04:45.820 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_password", 2024-01-25T15:04:45.820 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.821 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.821 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.821 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.821 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.821 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.821 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.821 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Password to authenticate with", 2024-01-25T15:04:45.821 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.821 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.821 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.821 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_port": { 2024-01-25T15:04:45.821 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_port", 2024-01-25T15:04:45.821 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.822 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.822 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.822 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "465", 2024-01-25T15:04:45.822 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.822 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.822 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.822 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "SMTP port", 2024-01-25T15:04:45.822 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.822 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.822 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.822 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_sender": { 2024-01-25T15:04:45.822 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_sender", 2024-01-25T15:04:45.822 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.822 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.823 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.823 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.823 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.823 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.823 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.823 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "SMTP envelope sender", 2024-01-25T15:04:45.823 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.823 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.823 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.823 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_ssl": { 2024-01-25T15:04:45.823 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_ssl", 2024-01-25T15:04:45.823 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.823 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.824 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.824 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.824 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.824 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.824 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.824 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Use SSL to connect to SMTP server", 2024-01-25T15:04:45.824 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.824 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.824 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.824 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.824 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_user": { 2024-01-25T15:04:45.824 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_user", 2024-01-25T15:04:45.824 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.824 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.825 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.825 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.825 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.825 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.825 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.825 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "User to authenticate as", 2024-01-25T15:04:45.825 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.825 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.825 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.825 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.825 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.825 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "balancer", 2024-01-25T15:04:45.826 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.826 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.826 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.826 INFO:teuthology.orchestra.run.smithi170.stdout: "active": { 2024-01-25T15:04:45.826 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "active", 2024-01-25T15:04:45.826 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.826 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.826 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.826 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.826 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.826 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.826 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.826 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "automatically balance PGs across cluster", 2024-01-25T15:04:45.826 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.827 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.827 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.827 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.827 INFO:teuthology.orchestra.run.smithi170.stdout: "begin_time": { 2024-01-25T15:04:45.827 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "begin_time", 2024-01-25T15:04:45.827 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.827 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.827 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.827 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0000", 2024-01-25T15:04:45.827 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.827 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.827 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.827 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "beginning time of day to automatically balance", 2024-01-25T15:04:45.827 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-01-25T15:04:45.827 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.828 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.828 INFO:teuthology.orchestra.run.smithi170.stdout: "begin_weekday": { 2024-01-25T15:04:45.828 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "begin_weekday", 2024-01-25T15:04:45.828 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "uint", 2024-01-25T15:04:45.828 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.828 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.828 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0", 2024-01-25T15:04:45.828 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "0", 2024-01-25T15:04:45.828 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "6", 2024-01-25T15:04:45.828 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.828 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-01-25T15:04:45.828 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-01-25T15:04:45.829 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.829 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.829 INFO:teuthology.orchestra.run.smithi170.stdout: "crush_compat_max_iterations": { 2024-01-25T15:04:45.829 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "crush_compat_max_iterations", 2024-01-25T15:04:45.829 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "uint", 2024-01-25T15:04:45.829 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.829 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.829 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "25", 2024-01-25T15:04:45.829 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "1", 2024-01-25T15:04:45.829 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "250", 2024-01-25T15:04:45.829 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.829 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-01-25T15:04:45.829 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.830 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.830 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.830 INFO:teuthology.orchestra.run.smithi170.stdout: "crush_compat_metrics": { 2024-01-25T15:04:45.830 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "crush_compat_metrics", 2024-01-25T15:04:45.830 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.830 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.830 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.830 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "pgs,objects,bytes", 2024-01-25T15:04:45.830 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.830 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.830 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.830 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-01-25T15:04:45.830 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-01-25T15:04:45.831 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.831 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.831 INFO:teuthology.orchestra.run.smithi170.stdout: "crush_compat_step": { 2024-01-25T15:04:45.831 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "crush_compat_step", 2024-01-25T15:04:45.831 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:45.831 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.831 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.831 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0.5", 2024-01-25T15:04:45.831 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "0.001", 2024-01-25T15:04:45.831 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "0.999", 2024-01-25T15:04:45.831 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.831 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "aggressiveness of optimization", 2024-01-25T15:04:45.831 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-01-25T15:04:45.832 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.832 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.832 INFO:teuthology.orchestra.run.smithi170.stdout: "end_time": { 2024-01-25T15:04:45.832 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "end_time", 2024-01-25T15:04:45.832 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.832 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.832 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.832 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "2359", 2024-01-25T15:04:45.832 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.832 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.832 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.832 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "ending time of day to automatically balance", 2024-01-25T15:04:45.833 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-01-25T15:04:45.833 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.833 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.833 INFO:teuthology.orchestra.run.smithi170.stdout: "end_weekday": { 2024-01-25T15:04:45.833 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "end_weekday", 2024-01-25T15:04:45.833 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "uint", 2024-01-25T15:04:45.833 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.833 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.833 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0", 2024-01-25T15:04:45.833 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "0", 2024-01-25T15:04:45.833 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "6", 2024-01-25T15:04:45.833 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.833 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-01-25T15:04:45.834 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-01-25T15:04:45.834 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.834 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.834 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.834 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.834 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.834 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.834 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.834 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.834 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.834 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.834 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.835 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.835 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.835 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.835 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.835 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.835 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.835 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.835 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.835 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.835 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.835 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.835 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.835 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.836 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.836 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.836 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.836 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.836 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.836 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.836 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.836 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.836 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.836 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.836 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.836 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.836 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.837 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.837 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.837 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.837 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.837 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.837 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.837 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.837 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.837 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.837 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.837 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.837 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.837 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.837 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.838 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.838 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.838 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.838 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.838 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.838 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.838 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.838 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.838 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.838 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.838 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.838 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.838 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.839 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.839 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.839 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.839 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.839 INFO:teuthology.orchestra.run.smithi170.stdout: "min_score": { 2024-01-25T15:04:45.839 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "min_score", 2024-01-25T15:04:45.839 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:45.839 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.839 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.839 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0", 2024-01-25T15:04:45.839 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.839 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.839 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.840 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-01-25T15:04:45.840 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.840 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.840 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.840 INFO:teuthology.orchestra.run.smithi170.stdout: "mode": { 2024-01-25T15:04:45.840 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mode", 2024-01-25T15:04:45.840 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.840 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.840 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.840 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "upmap", 2024-01-25T15:04:45.840 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.840 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.841 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.841 INFO:teuthology.orchestra.run.smithi170.stdout: "crush-compat", 2024-01-25T15:04:45.841 INFO:teuthology.orchestra.run.smithi170.stdout: "none", 2024-01-25T15:04:45.841 INFO:teuthology.orchestra.run.smithi170.stdout: "upmap" 2024-01-25T15:04:45.841 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.841 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Balancer mode", 2024-01-25T15:04:45.841 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.841 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.841 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.841 INFO:teuthology.orchestra.run.smithi170.stdout: "pool_ids": { 2024-01-25T15:04:45.841 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "pool_ids", 2024-01-25T15:04:45.841 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.842 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.842 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.842 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.842 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.842 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.842 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.842 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-01-25T15:04:45.842 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.842 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.842 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.842 INFO:teuthology.orchestra.run.smithi170.stdout: "sleep_interval": { 2024-01-25T15:04:45.842 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "sleep_interval", 2024-01-25T15:04:45.842 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.842 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.843 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.843 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "60", 2024-01-25T15:04:45.843 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.843 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.843 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.843 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-01-25T15:04:45.843 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.843 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.843 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.843 INFO:teuthology.orchestra.run.smithi170.stdout: "upmap_max_deviation": { 2024-01-25T15:04:45.843 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "upmap_max_deviation", 2024-01-25T15:04:45.843 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.844 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.844 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.844 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "5", 2024-01-25T15:04:45.844 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "1", 2024-01-25T15:04:45.844 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.844 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.844 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "deviation below which no optimization is attempted", 2024-01-25T15:04:45.844 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-01-25T15:04:45.844 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.844 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.844 INFO:teuthology.orchestra.run.smithi170.stdout: "upmap_max_optimizations": { 2024-01-25T15:04:45.844 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "upmap_max_optimizations", 2024-01-25T15:04:45.845 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "uint", 2024-01-25T15:04:45.845 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.845 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.845 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:45.845 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.845 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.845 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.845 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-01-25T15:04:45.845 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.845 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.845 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.845 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.845 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.846 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "cephadm", 2024-01-25T15:04:45.846 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.846 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.846 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.846 INFO:teuthology.orchestra.run.smithi170.stdout: "agent_down_multiplier": { 2024-01-25T15:04:45.846 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "agent_down_multiplier", 2024-01-25T15:04:45.846 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:45.846 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.846 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.846 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "3.0", 2024-01-25T15:04:45.846 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.846 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.846 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.846 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-01-25T15:04:45.847 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.847 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.847 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.847 INFO:teuthology.orchestra.run.smithi170.stdout: "agent_refresh_rate": { 2024-01-25T15:04:45.847 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "agent_refresh_rate", 2024-01-25T15:04:45.847 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.847 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.847 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.847 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "20", 2024-01-25T15:04:45.847 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.847 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.847 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.847 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-01-25T15:04:45.847 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.848 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.848 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.848 INFO:teuthology.orchestra.run.smithi170.stdout: "agent_starting_port": { 2024-01-25T15:04:45.848 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "agent_starting_port", 2024-01-25T15:04:45.848 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.848 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.848 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.848 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "4721", 2024-01-25T15:04:45.848 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.848 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.848 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.848 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-01-25T15:04:45.849 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.849 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.849 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.849 INFO:teuthology.orchestra.run.smithi170.stdout: "allow_ptrace": { 2024-01-25T15:04:45.849 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "allow_ptrace", 2024-01-25T15:04:45.849 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.849 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.849 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.849 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.849 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.849 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.849 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.849 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-01-25T15:04:45.849 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-01-25T15:04:45.850 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.850 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.850 INFO:teuthology.orchestra.run.smithi170.stdout: "autotune_interval": { 2024-01-25T15:04:45.850 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "autotune_interval", 2024-01-25T15:04:45.850 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.850 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.850 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.850 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "600", 2024-01-25T15:04:45.850 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.850 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.850 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.850 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how frequently to autotune daemon memory", 2024-01-25T15:04:45.850 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.850 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.851 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.851 INFO:teuthology.orchestra.run.smithi170.stdout: "autotune_memory_target_ratio": { 2024-01-25T15:04:45.851 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "autotune_memory_target_ratio", 2024-01-25T15:04:45.851 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:45.851 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.851 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.851 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0.7", 2024-01-25T15:04:45.851 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.851 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.851 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.851 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-01-25T15:04:45.851 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.851 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.852 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.852 INFO:teuthology.orchestra.run.smithi170.stdout: "cephadm_log_destination": { 2024-01-25T15:04:45.852 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "cephadm_log_destination", 2024-01-25T15:04:45.852 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.852 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.852 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.852 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.852 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.852 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.852 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.852 INFO:teuthology.orchestra.run.smithi170.stdout: "file", 2024-01-25T15:04:45.852 INFO:teuthology.orchestra.run.smithi170.stdout: "file,syslog", 2024-01-25T15:04:45.852 INFO:teuthology.orchestra.run.smithi170.stdout: "syslog" 2024-01-25T15:04:45.853 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.853 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-01-25T15:04:45.853 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.853 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.853 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.853 INFO:teuthology.orchestra.run.smithi170.stdout: "cgroups_split": { 2024-01-25T15:04:45.853 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "cgroups_split", 2024-01-25T15:04:45.853 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.853 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.853 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.853 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.853 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.854 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.854 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.854 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-01-25T15:04:45.854 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.854 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.854 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.854 INFO:teuthology.orchestra.run.smithi170.stdout: "config_checks_enabled": { 2024-01-25T15:04:45.854 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "config_checks_enabled", 2024-01-25T15:04:45.854 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.854 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.854 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.854 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.854 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.855 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.855 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.855 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-01-25T15:04:45.855 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.855 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.855 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.855 INFO:teuthology.orchestra.run.smithi170.stdout: "config_dashboard": { 2024-01-25T15:04:45.855 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "config_dashboard", 2024-01-25T15:04:45.855 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.855 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.855 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.855 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.856 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.856 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.856 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.856 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-01-25T15:04:45.856 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.856 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.856 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.856 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_alertmanager": { 2024-01-25T15:04:45.856 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_alertmanager", 2024-01-25T15:04:45.856 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.856 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.856 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.856 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-01-25T15:04:45.857 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.857 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.857 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.857 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Prometheus container image", 2024-01-25T15:04:45.857 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.857 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.857 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.857 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_base": { 2024-01-25T15:04:45.857 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_base", 2024-01-25T15:04:45.857 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.857 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.857 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.857 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/ceph/ceph", 2024-01-25T15:04:45.857 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.858 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.858 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.858 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Container image name, without the tag", 2024-01-25T15:04:45.858 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.858 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.858 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.858 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_elasticsearch": { 2024-01-25T15:04:45.858 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_elasticsearch", 2024-01-25T15:04:45.858 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.858 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.858 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.858 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-01-25T15:04:45.858 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.859 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.859 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.859 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "elasticsearch container image", 2024-01-25T15:04:45.859 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.859 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.859 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.859 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_grafana": { 2024-01-25T15:04:45.859 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_grafana", 2024-01-25T15:04:45.859 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.859 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.859 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.859 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-01-25T15:04:45.859 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.859 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.860 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.860 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Prometheus container image", 2024-01-25T15:04:45.860 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.860 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.860 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.860 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_haproxy": { 2024-01-25T15:04:45.860 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_haproxy", 2024-01-25T15:04:45.860 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.860 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.860 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.860 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-01-25T15:04:45.860 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.860 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.861 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.861 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "HAproxy container image", 2024-01-25T15:04:45.861 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.861 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.861 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.861 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_jaeger_agent": { 2024-01-25T15:04:45.861 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_jaeger_agent", 2024-01-25T15:04:45.861 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.861 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.861 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.861 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-01-25T15:04:45.861 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.861 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.862 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.862 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Jaeger agent container image", 2024-01-25T15:04:45.862 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.862 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.862 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.862 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_jaeger_collector": { 2024-01-25T15:04:45.862 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_jaeger_collector", 2024-01-25T15:04:45.862 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.862 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.862 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.862 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-01-25T15:04:45.862 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.862 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.862 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.863 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Jaeger collector container image", 2024-01-25T15:04:45.863 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.863 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.863 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.863 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_jaeger_query": { 2024-01-25T15:04:45.863 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_jaeger_query", 2024-01-25T15:04:45.863 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.863 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.863 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.863 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-01-25T15:04:45.863 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.863 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.863 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.863 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Jaeger query container image", 2024-01-25T15:04:45.864 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.864 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.864 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.864 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_keepalived": { 2024-01-25T15:04:45.864 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_keepalived", 2024-01-25T15:04:45.864 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.864 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.864 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.864 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-01-25T15:04:45.864 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.864 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.864 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.864 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Keepalived container image", 2024-01-25T15:04:45.865 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.865 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.865 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.865 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_loki": { 2024-01-25T15:04:45.865 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_loki", 2024-01-25T15:04:45.865 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.865 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.865 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.865 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-01-25T15:04:45.865 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.865 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.865 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.866 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Loki container image", 2024-01-25T15:04:45.866 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.866 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.866 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.866 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_node_exporter": { 2024-01-25T15:04:45.866 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_node_exporter", 2024-01-25T15:04:45.866 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.866 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.866 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.866 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-01-25T15:04:45.866 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.866 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.866 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.866 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Prometheus container image", 2024-01-25T15:04:45.867 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.867 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.867 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.867 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_nvmeof": { 2024-01-25T15:04:45.867 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_nvmeof", 2024-01-25T15:04:45.867 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.867 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.867 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.867 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-01-25T15:04:45.867 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.867 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.867 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.867 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Nvme-of container image", 2024-01-25T15:04:45.868 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.868 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.868 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.868 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_prometheus": { 2024-01-25T15:04:45.868 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_prometheus", 2024-01-25T15:04:45.868 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.868 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.868 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.868 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-01-25T15:04:45.868 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.868 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.868 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.868 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Prometheus container image", 2024-01-25T15:04:45.869 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.869 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.869 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.869 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_promtail": { 2024-01-25T15:04:45.869 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_promtail", 2024-01-25T15:04:45.869 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.869 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.869 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.869 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-01-25T15:04:45.869 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.869 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.869 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.869 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Promtail container image", 2024-01-25T15:04:45.870 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.870 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.870 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.870 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_snmp_gateway": { 2024-01-25T15:04:45.870 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_snmp_gateway", 2024-01-25T15:04:45.870 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.870 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.870 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.870 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-01-25T15:04:45.870 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.870 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.870 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.870 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "SNMP Gateway container image", 2024-01-25T15:04:45.871 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.871 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.871 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.871 INFO:teuthology.orchestra.run.smithi170.stdout: "container_init": { 2024-01-25T15:04:45.871 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_init", 2024-01-25T15:04:45.871 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.871 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.871 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.871 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.871 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.871 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.871 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.871 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Run podman/docker with `--init`", 2024-01-25T15:04:45.872 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.872 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.872 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.872 INFO:teuthology.orchestra.run.smithi170.stdout: "daemon_cache_timeout": { 2024-01-25T15:04:45.872 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "daemon_cache_timeout", 2024-01-25T15:04:45.872 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.872 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.872 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.872 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "600", 2024-01-25T15:04:45.872 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.872 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.872 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.872 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-01-25T15:04:45.873 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.873 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.873 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.873 INFO:teuthology.orchestra.run.smithi170.stdout: "default_cephadm_command_timeout": { 2024-01-25T15:04:45.873 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "default_cephadm_command_timeout", 2024-01-25T15:04:45.873 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.873 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.873 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.873 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "900", 2024-01-25T15:04:45.873 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.873 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.873 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.874 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-01-25T15:04:45.874 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.874 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.874 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.874 INFO:teuthology.orchestra.run.smithi170.stdout: "default_registry": { 2024-01-25T15:04:45.874 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "default_registry", 2024-01-25T15:04:45.874 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.874 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.874 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.874 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "docker.io", 2024-01-25T15:04:45.874 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.874 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.874 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.875 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-01-25T15:04:45.875 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.875 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.875 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.875 INFO:teuthology.orchestra.run.smithi170.stdout: "device_cache_timeout": { 2024-01-25T15:04:45.875 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "device_cache_timeout", 2024-01-25T15:04:45.875 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.875 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.875 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.875 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "1800", 2024-01-25T15:04:45.875 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.875 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.875 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.876 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "seconds to cache device inventory", 2024-01-25T15:04:45.876 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.876 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.876 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.876 INFO:teuthology.orchestra.run.smithi170.stdout: "device_enhanced_scan": { 2024-01-25T15:04:45.876 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "device_enhanced_scan", 2024-01-25T15:04:45.876 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.876 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.876 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.876 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.876 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.876 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.877 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.877 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Use libstoragemgmt during device scans", 2024-01-25T15:04:45.877 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.877 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.877 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.877 INFO:teuthology.orchestra.run.smithi170.stdout: "facts_cache_timeout": { 2024-01-25T15:04:45.877 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "facts_cache_timeout", 2024-01-25T15:04:45.877 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.877 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.877 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.877 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "60", 2024-01-25T15:04:45.877 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.877 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.878 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.878 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "seconds to cache host facts data", 2024-01-25T15:04:45.878 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.878 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.878 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.878 INFO:teuthology.orchestra.run.smithi170.stdout: "host_check_interval": { 2024-01-25T15:04:45.878 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "host_check_interval", 2024-01-25T15:04:45.878 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.878 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.878 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.878 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "600", 2024-01-25T15:04:45.878 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.879 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.879 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.879 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how frequently to perform a host check", 2024-01-25T15:04:45.879 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.879 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.879 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.879 INFO:teuthology.orchestra.run.smithi170.stdout: "inventory_list_all": { 2024-01-25T15:04:45.879 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "inventory_list_all", 2024-01-25T15:04:45.879 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.879 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.879 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.879 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.879 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.880 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.880 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.880 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-01-25T15:04:45.880 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.880 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.880 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.880 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.880 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.880 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.880 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.880 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.880 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.880 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.882 INFO:teuthology.orchestra.run.smithi170.stdout: "log_refresh_metadata": { 2024-01-25T15:04:45.882 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_refresh_metadata", 2024-01-25T15:04:45.882 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.882 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.882 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.882 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.882 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.882 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.882 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.882 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-01-25T15:04:45.882 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.882 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.882 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.883 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.883 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.883 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.883 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.883 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.883 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.883 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.883 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.883 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.883 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-01-25T15:04:45.883 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.883 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.883 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.883 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.884 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.884 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.884 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.884 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.884 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.884 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.884 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.884 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.884 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.884 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.884 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.884 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.884 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.884 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.885 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.885 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.885 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.885 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.885 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.885 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.885 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.885 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.885 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.885 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.885 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.885 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.885 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.886 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.886 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.886 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.886 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.886 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.886 INFO:teuthology.orchestra.run.smithi170.stdout: "manage_etc_ceph_ceph_conf": { 2024-01-25T15:04:45.886 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-01-25T15:04:45.886 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.886 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.886 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.886 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.886 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.886 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.886 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.887 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-01-25T15:04:45.887 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.887 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.887 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.887 INFO:teuthology.orchestra.run.smithi170.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-01-25T15:04:45.887 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-01-25T15:04:45.887 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.887 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.887 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.887 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "*", 2024-01-25T15:04:45.887 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.887 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.887 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.888 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-01-25T15:04:45.888 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.888 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.888 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.888 INFO:teuthology.orchestra.run.smithi170.stdout: "max_count_per_host": { 2024-01-25T15:04:45.888 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "max_count_per_host", 2024-01-25T15:04:45.888 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.888 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.888 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.888 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:45.888 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.888 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.889 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.889 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "max number of daemons per service per host", 2024-01-25T15:04:45.889 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.889 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.889 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.889 INFO:teuthology.orchestra.run.smithi170.stdout: "max_osd_draining_count": { 2024-01-25T15:04:45.889 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "max_osd_draining_count", 2024-01-25T15:04:45.889 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.889 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.889 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.889 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:45.889 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.890 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.890 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.890 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-01-25T15:04:45.890 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.890 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.890 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.890 INFO:teuthology.orchestra.run.smithi170.stdout: "migration_current": { 2024-01-25T15:04:45.890 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "migration_current", 2024-01-25T15:04:45.890 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.890 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.890 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.890 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.890 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.891 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.891 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.891 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "internal - do not modify", 2024-01-25T15:04:45.891 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.891 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.891 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.891 INFO:teuthology.orchestra.run.smithi170.stdout: "mode": { 2024-01-25T15:04:45.891 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mode", 2024-01-25T15:04:45.891 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.891 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.891 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.891 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "root", 2024-01-25T15:04:45.891 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.891 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.892 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.892 INFO:teuthology.orchestra.run.smithi170.stdout: "cephadm-package", 2024-01-25T15:04:45.892 INFO:teuthology.orchestra.run.smithi170.stdout: "root" 2024-01-25T15:04:45.892 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.892 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "mode for remote execution of cephadm", 2024-01-25T15:04:45.892 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.892 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.892 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.892 INFO:teuthology.orchestra.run.smithi170.stdout: "prometheus_alerts_path": { 2024-01-25T15:04:45.892 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "prometheus_alerts_path", 2024-01-25T15:04:45.892 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.892 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.893 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.893 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-01-25T15:04:45.893 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.893 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.893 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.893 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-01-25T15:04:45.893 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.893 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.893 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.893 INFO:teuthology.orchestra.run.smithi170.stdout: "registry_insecure": { 2024-01-25T15:04:45.893 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "registry_insecure", 2024-01-25T15:04:45.893 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.893 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.894 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.894 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.894 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.894 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.894 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.894 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-01-25T15:04:45.894 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.894 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.894 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.894 INFO:teuthology.orchestra.run.smithi170.stdout: "registry_password": { 2024-01-25T15:04:45.894 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "registry_password", 2024-01-25T15:04:45.894 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.894 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-01-25T15:04:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: "registry_url": { 2024-01-25T15:04:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "registry_url", 2024-01-25T15:04:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-01-25T15:04:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: "registry_username": { 2024-01-25T15:04:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "registry_username", 2024-01-25T15:04:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-01-25T15:04:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: "secure_monitoring_stack": { 2024-01-25T15:04:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "secure_monitoring_stack", 2024-01-25T15:04:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.898 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.898 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.898 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.898 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.898 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.898 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-01-25T15:04:45.898 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.898 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.898 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.898 INFO:teuthology.orchestra.run.smithi170.stdout: "service_discovery_port": { 2024-01-25T15:04:45.898 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "service_discovery_port", 2024-01-25T15:04:45.898 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.898 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.898 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.899 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "8765", 2024-01-25T15:04:45.899 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.899 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.899 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.899 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "cephadm service discovery port", 2024-01-25T15:04:45.899 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.899 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.899 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.899 INFO:teuthology.orchestra.run.smithi170.stdout: "ssh_config_file": { 2024-01-25T15:04:45.899 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ssh_config_file", 2024-01-25T15:04:45.899 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.899 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.899 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.900 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.900 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.900 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.900 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.900 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-01-25T15:04:45.900 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.900 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.900 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.900 INFO:teuthology.orchestra.run.smithi170.stdout: "use_agent": { 2024-01-25T15:04:45.900 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "use_agent", 2024-01-25T15:04:45.900 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.900 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.901 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.901 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.901 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.901 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.901 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.901 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-01-25T15:04:45.901 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.901 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.901 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.901 INFO:teuthology.orchestra.run.smithi170.stdout: "use_repo_digest": { 2024-01-25T15:04:45.901 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "use_repo_digest", 2024-01-25T15:04:45.901 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.901 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.901 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.902 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.902 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.902 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.902 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.902 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-01-25T15:04:45.902 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.902 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.902 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.902 INFO:teuthology.orchestra.run.smithi170.stdout: "warn_on_failed_host_check": { 2024-01-25T15:04:45.902 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "warn_on_failed_host_check", 2024-01-25T15:04:45.902 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.902 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.903 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.903 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.903 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.903 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.903 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.903 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "raise a health warning if the host check fails", 2024-01-25T15:04:45.903 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.903 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.903 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.903 INFO:teuthology.orchestra.run.smithi170.stdout: "warn_on_stray_daemons": { 2024-01-25T15:04:45.903 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "warn_on_stray_daemons", 2024-01-25T15:04:45.903 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.903 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.903 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.904 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.904 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.904 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.904 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.904 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-01-25T15:04:45.904 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.904 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.904 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.904 INFO:teuthology.orchestra.run.smithi170.stdout: "warn_on_stray_hosts": { 2024-01-25T15:04:45.904 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "warn_on_stray_hosts", 2024-01-25T15:04:45.904 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.904 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.904 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.905 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.905 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.905 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.905 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.905 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-01-25T15:04:45.905 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.905 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.905 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.905 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.905 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.905 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "crash", 2024-01-25T15:04:45.905 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.906 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.906 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.906 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.906 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.906 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.906 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.906 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.906 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.906 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.906 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.906 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.906 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.906 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.906 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.906 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.907 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.907 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.907 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.907 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.907 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.907 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.907 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.907 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.907 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.907 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.907 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.907 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.907 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.908 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.908 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.908 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.908 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.908 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.908 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.908 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.908 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.908 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.908 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.908 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.908 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.908 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.909 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.909 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.909 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.909 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.909 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.909 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.909 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.909 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.909 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.909 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.909 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.909 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.909 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.909 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.911 INFO:teuthology.orchestra.run.smithi170.stdout: "retain_interval": { 2024-01-25T15:04:45.911 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "retain_interval", 2024-01-25T15:04:45.911 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.911 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.911 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.911 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "31536000", 2024-01-25T15:04:45.911 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.911 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.911 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.911 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how long to retain crashes before pruning them", 2024-01-25T15:04:45.911 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.911 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.911 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.912 INFO:teuthology.orchestra.run.smithi170.stdout: "warn_recent_interval": { 2024-01-25T15:04:45.912 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "warn_recent_interval", 2024-01-25T15:04:45.912 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.912 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.912 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.912 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "1209600", 2024-01-25T15:04:45.912 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.912 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.912 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.912 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "time interval in which to warn about recent crashes", 2024-01-25T15:04:45.912 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.912 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.912 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.912 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.912 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.913 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "dashboard", 2024-01-25T15:04:45.913 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.913 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.913 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.913 INFO:teuthology.orchestra.run.smithi170.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-01-25T15:04:45.913 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-01-25T15:04:45.913 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.913 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.913 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.913 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:45.913 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.913 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.914 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.914 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.914 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.914 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.914 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.914 INFO:teuthology.orchestra.run.smithi170.stdout: "ALERTMANAGER_API_HOST": { 2024-01-25T15:04:45.914 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ALERTMANAGER_API_HOST", 2024-01-25T15:04:45.914 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.914 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.914 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.914 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.914 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.914 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.914 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.915 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.915 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.915 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.915 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.915 INFO:teuthology.orchestra.run.smithi170.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-01-25T15:04:45.915 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-01-25T15:04:45.915 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.915 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.915 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.915 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.915 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.915 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.916 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.916 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.916 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.916 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.916 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.916 INFO:teuthology.orchestra.run.smithi170.stdout: "AUDIT_API_ENABLED": { 2024-01-25T15:04:45.916 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "AUDIT_API_ENABLED", 2024-01-25T15:04:45.916 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.916 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.916 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.916 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.916 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.917 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.917 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.917 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.917 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.917 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.917 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.917 INFO:teuthology.orchestra.run.smithi170.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-01-25T15:04:45.917 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-01-25T15:04:45.917 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.917 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.917 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.917 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.917 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.917 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.918 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.918 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.918 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.918 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.918 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.918 INFO:teuthology.orchestra.run.smithi170.stdout: "ENABLE_BROWSABLE_API": { 2024-01-25T15:04:45.918 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ENABLE_BROWSABLE_API", 2024-01-25T15:04:45.918 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.918 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.918 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.918 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.918 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.918 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.919 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.919 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.919 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.919 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.919 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.919 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-01-25T15:04:45.919 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-01-25T15:04:45.919 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.919 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.919 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.919 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.919 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.919 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.920 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.920 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.920 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.920 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.920 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.920 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-01-25T15:04:45.920 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-01-25T15:04:45.920 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.920 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.920 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.920 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.920 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.921 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.921 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.921 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.921 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.921 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.921 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.921 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-01-25T15:04:45.921 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-01-25T15:04:45.921 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.921 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.921 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.921 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.921 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.922 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.922 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.922 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.922 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.922 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.922 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.922 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-01-25T15:04:45.922 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-01-25T15:04:45.922 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.922 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.922 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.922 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.922 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.922 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.923 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.923 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.923 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.923 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.923 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.923 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_NFS": { 2024-01-25T15:04:45.923 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-01-25T15:04:45.923 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.923 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.923 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.923 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.923 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.923 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.924 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.924 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.924 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.924 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.924 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.924 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_RBD": { 2024-01-25T15:04:45.924 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-01-25T15:04:45.924 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.924 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.924 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.924 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.924 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.924 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.924 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.925 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.925 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.925 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.925 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.925 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_RGW": { 2024-01-25T15:04:45.925 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-01-25T15:04:45.925 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.925 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.925 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.925 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.925 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.925 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.925 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.926 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.926 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.926 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.926 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.926 INFO:teuthology.orchestra.run.smithi170.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-01-25T15:04:45.926 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-01-25T15:04:45.926 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.926 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.926 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.926 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.926 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.926 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.926 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.927 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.927 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.927 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.927 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.927 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_API_PASSWORD": { 2024-01-25T15:04:45.927 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_API_PASSWORD", 2024-01-25T15:04:45.927 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.927 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.927 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.927 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "admin", 2024-01-25T15:04:45.927 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.927 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.927 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.927 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.928 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.928 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.928 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.928 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-01-25T15:04:45.928 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-01-25T15:04:45.928 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.928 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.928 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.928 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.928 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.928 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.928 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.929 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.929 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.929 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.929 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.929 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_API_URL": { 2024-01-25T15:04:45.929 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_API_URL", 2024-01-25T15:04:45.929 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.929 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.929 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.929 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.929 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.929 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.929 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.930 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.930 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.930 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.930 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.930 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_API_USERNAME": { 2024-01-25T15:04:45.930 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_API_USERNAME", 2024-01-25T15:04:45.930 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.930 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.930 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.930 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "admin", 2024-01-25T15:04:45.930 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.930 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.930 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.930 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.931 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.931 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.931 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.931 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-01-25T15:04:45.931 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-01-25T15:04:45.931 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.931 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.931 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.931 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.931 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.931 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.931 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.931 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.932 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.932 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.932 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.932 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-01-25T15:04:45.932 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-01-25T15:04:45.932 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.932 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.932 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.932 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.932 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.932 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.932 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.932 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.933 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.933 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.933 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.933 INFO:teuthology.orchestra.run.smithi170.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-01-25T15:04:45.933 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-01-25T15:04:45.933 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.933 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.933 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.933 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.933 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.933 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.933 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.933 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.934 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.934 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.934 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.934 INFO:teuthology.orchestra.run.smithi170.stdout: "ISSUE_TRACKER_API_KEY": { 2024-01-25T15:04:45.934 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-01-25T15:04:45.934 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.934 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.934 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.934 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.934 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.934 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.934 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.934 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "PROMETHEUS_API_HOST": { 2024-01-25T15:04:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PROMETHEUS_API_HOST", 2024-01-25T15:04:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.935 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.936 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.936 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.936 INFO:teuthology.orchestra.run.smithi170.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-01-25T15:04:45.936 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-01-25T15:04:45.936 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.936 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.936 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.936 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.936 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.936 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.936 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.936 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.937 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.937 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.937 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.937 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-01-25T15:04:45.937 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-01-25T15:04:45.937 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.937 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.937 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.937 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.937 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.937 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.937 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.937 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.938 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.938 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.938 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.938 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-01-25T15:04:45.938 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-01-25T15:04:45.938 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.938 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.938 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.938 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.938 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.938 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.938 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.938 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.938 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.939 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.939 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.939 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-01-25T15:04:45.939 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-01-25T15:04:45.939 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.939 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.939 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.939 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.939 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.939 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.939 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.939 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.939 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.940 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.940 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.940 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-01-25T15:04:45.940 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-01-25T15:04:45.940 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.940 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.940 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.940 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.940 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.940 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.940 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.940 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.941 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.941 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.941 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.941 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-01-25T15:04:45.941 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-01-25T15:04:45.941 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.941 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.941 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.941 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.941 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.941 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.941 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.942 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.942 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.942 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.942 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.942 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-01-25T15:04:45.942 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-01-25T15:04:45.942 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.942 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.942 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.942 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.942 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.942 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.942 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.943 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.943 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.943 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.943 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.943 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-01-25T15:04:45.943 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-01-25T15:04:45.943 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.943 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.943 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.943 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.943 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.943 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.943 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.944 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.944 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.944 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.944 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.944 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_ENABLED": { 2024-01-25T15:04:45.944 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_ENABLED", 2024-01-25T15:04:45.944 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.944 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.944 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.944 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.944 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.944 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.944 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.945 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.945 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.945 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.945 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.945 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-01-25T15:04:45.945 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-01-25T15:04:45.945 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.945 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.945 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.945 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-01-25T15:04:45.945 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.945 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.946 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "8", 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.947 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.948 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.948 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.948 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.948 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.948 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.948 INFO:teuthology.orchestra.run.smithi170.stdout: "REST_REQUESTS_TIMEOUT": { 2024-01-25T15:04:45.948 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-01-25T15:04:45.948 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.948 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.948 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.948 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "45", 2024-01-25T15:04:45.948 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi170.stdout: "RGW_API_ACCESS_KEY": { 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "RGW_API_ACCESS_KEY", 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.949 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi170.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "admin", 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.950 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.951 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.951 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.951 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.951 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.951 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.951 INFO:teuthology.orchestra.run.smithi170.stdout: "RGW_API_SECRET_KEY": { 2024-01-25T15:04:45.951 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "RGW_API_SECRET_KEY", 2024-01-25T15:04:45.951 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.951 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.951 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.951 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.951 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.951 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.951 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.952 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.952 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.952 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.952 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.952 INFO:teuthology.orchestra.run.smithi170.stdout: "RGW_API_SSL_VERIFY": { 2024-01-25T15:04:45.952 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "RGW_API_SSL_VERIFY", 2024-01-25T15:04:45.952 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.952 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.952 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.952 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.952 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.952 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.952 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-01-25T15:04:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-01-25T15:04:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0", 2024-01-25T15:04:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.953 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-01-25T15:04:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-01-25T15:04:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.954 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-01-25T15:04:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-01-25T15:04:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "5", 2024-01-25T15:04:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.955 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: "cross_origin_url": { 2024-01-25T15:04:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "cross_origin_url", 2024-01-25T15:04:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.956 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.957 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.957 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.957 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.957 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.957 INFO:teuthology.orchestra.run.smithi170.stdout: "crt_file": { 2024-01-25T15:04:45.957 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "crt_file", 2024-01-25T15:04:45.957 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.957 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.957 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.957 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.957 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.957 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.958 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.958 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.958 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.958 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.958 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.958 INFO:teuthology.orchestra.run.smithi170.stdout: "debug": { 2024-01-25T15:04:45.958 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "debug", 2024-01-25T15:04:45.958 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.958 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.958 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.958 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.958 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.958 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.959 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.959 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Enable/disable debug options", 2024-01-25T15:04:45.959 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.959 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.959 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.959 INFO:teuthology.orchestra.run.smithi170.stdout: "jwt_token_ttl": { 2024-01-25T15:04:45.959 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "jwt_token_ttl", 2024-01-25T15:04:45.959 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.959 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.959 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.959 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "28800", 2024-01-25T15:04:45.959 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.959 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.960 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.960 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.960 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.960 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.960 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.960 INFO:teuthology.orchestra.run.smithi170.stdout: "key_file": { 2024-01-25T15:04:45.960 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "key_file", 2024-01-25T15:04:45.960 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.960 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.960 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.960 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.960 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.960 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.961 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.961 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.961 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.961 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.961 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.961 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.961 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.961 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.961 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.961 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.961 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.961 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.961 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.961 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.961 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.962 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.962 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.962 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.962 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.962 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.962 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.962 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.962 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.962 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.962 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.962 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.962 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.962 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.962 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.962 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.963 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.963 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.963 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.963 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.963 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.963 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.963 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.963 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.963 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.963 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.963 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.963 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.963 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.963 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.964 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.964 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.964 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.964 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.964 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.964 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.964 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.964 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.964 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.964 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.964 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.964 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.964 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.964 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.965 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.965 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.965 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.965 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.965 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.965 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.965 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.965 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.965 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.965 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.965 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.965 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.965 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.965 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.966 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.966 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.966 INFO:teuthology.orchestra.run.smithi170.stdout: "motd": { 2024-01-25T15:04:45.966 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "motd", 2024-01-25T15:04:45.966 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.966 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.966 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.966 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.966 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.966 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.966 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.966 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "The message of the day", 2024-01-25T15:04:45.966 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.966 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.967 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.967 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.967 INFO:teuthology.orchestra.run.smithi170.stdout: "redirect_resolve_ip_addr": { 2024-01-25T15:04:45.967 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "redirect_resolve_ip_addr", 2024-01-25T15:04:45.967 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.967 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.967 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.967 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.967 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.967 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.967 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.967 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.967 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.967 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.968 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.968 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.968 INFO:teuthology.orchestra.run.smithi170.stdout: "server_addr": { 2024-01-25T15:04:45.968 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_addr", 2024-01-25T15:04:45.968 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.968 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.968 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.968 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "::", 2024-01-25T15:04:45.968 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.968 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.968 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.968 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.968 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.969 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.969 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.969 INFO:teuthology.orchestra.run.smithi170.stdout: "server_port": { 2024-01-25T15:04:45.969 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_port", 2024-01-25T15:04:45.969 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.969 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.969 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.969 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "8080", 2024-01-25T15:04:45.969 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.969 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.969 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.969 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.969 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.969 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.970 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.970 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.970 INFO:teuthology.orchestra.run.smithi170.stdout: "ssl": { 2024-01-25T15:04:45.970 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ssl", 2024-01-25T15:04:45.970 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.970 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.970 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.970 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.970 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.970 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.970 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.970 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.970 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.970 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.971 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.971 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.971 INFO:teuthology.orchestra.run.smithi170.stdout: "ssl_server_port": { 2024-01-25T15:04:45.971 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ssl_server_port", 2024-01-25T15:04:45.971 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.971 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.971 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.971 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "8443", 2024-01-25T15:04:45.971 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.971 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.971 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.971 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.971 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.971 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.972 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.972 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.972 INFO:teuthology.orchestra.run.smithi170.stdout: "standby_behaviour": { 2024-01-25T15:04:45.972 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "standby_behaviour", 2024-01-25T15:04:45.972 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.972 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.972 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.972 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "redirect", 2024-01-25T15:04:45.972 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.972 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.972 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.972 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.972 INFO:teuthology.orchestra.run.smithi170.stdout: "redirect" 2024-01-25T15:04:45.973 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.973 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.973 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.973 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.973 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.973 INFO:teuthology.orchestra.run.smithi170.stdout: "standby_error_status_code": { 2024-01-25T15:04:45.973 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "standby_error_status_code", 2024-01-25T15:04:45.973 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.973 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.973 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.973 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "500", 2024-01-25T15:04:45.973 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "400", 2024-01-25T15:04:45.973 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "599", 2024-01-25T15:04:45.973 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.974 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.974 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.974 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.974 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.974 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.974 INFO:teuthology.orchestra.run.smithi170.stdout: "url_prefix": { 2024-01-25T15:04:45.974 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "url_prefix", 2024-01-25T15:04:45.974 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.974 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.974 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.974 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.974 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.974 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.974 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.975 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.975 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.975 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.975 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.975 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.975 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.975 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.975 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.975 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "devicehealth", 2024-01-25T15:04:45.975 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.975 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.975 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.975 INFO:teuthology.orchestra.run.smithi170.stdout: "enable_monitoring": { 2024-01-25T15:04:45.975 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "enable_monitoring", 2024-01-25T15:04:45.975 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.976 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.976 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.976 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.976 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.976 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.976 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.976 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "monitor device health metrics", 2024-01-25T15:04:45.976 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.976 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.976 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.976 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.976 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.976 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.976 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.977 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.977 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.977 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.977 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.977 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.977 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.977 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.977 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.977 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.977 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.977 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.977 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.977 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.977 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.978 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.978 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.978 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.978 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.978 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.978 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.978 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.978 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.978 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.978 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.978 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.978 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.978 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.978 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.978 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.979 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.979 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.979 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.979 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.979 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.979 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.979 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.979 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.979 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.979 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.979 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.979 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.979 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.979 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.980 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.980 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.980 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.980 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.980 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.980 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.980 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.980 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.980 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.980 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.980 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.980 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.980 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.980 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.981 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.981 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.981 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.981 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.981 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.981 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.981 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.981 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.981 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.981 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.981 INFO:teuthology.orchestra.run.smithi170.stdout: "mark_out_threshold": { 2024-01-25T15:04:45.981 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mark_out_threshold", 2024-01-25T15:04:45.981 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.981 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.982 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.982 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "2419200", 2024-01-25T15:04:45.982 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.982 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.982 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.982 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-01-25T15:04:45.982 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.982 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.982 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.982 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.982 INFO:teuthology.orchestra.run.smithi170.stdout: "pool_name": { 2024-01-25T15:04:45.982 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "pool_name", 2024-01-25T15:04:45.982 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.982 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.983 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.983 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "device_health_metrics", 2024-01-25T15:04:45.983 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.983 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.983 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.983 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "name of pool in which to store device health metrics", 2024-01-25T15:04:45.983 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.983 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.983 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.983 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.983 INFO:teuthology.orchestra.run.smithi170.stdout: "retention_period": { 2024-01-25T15:04:45.983 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "retention_period", 2024-01-25T15:04:45.983 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.983 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.983 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.984 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "15552000", 2024-01-25T15:04:45.984 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.984 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.984 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.984 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how long to retain device health metrics", 2024-01-25T15:04:45.984 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.984 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.984 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.984 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.984 INFO:teuthology.orchestra.run.smithi170.stdout: "scrape_frequency": { 2024-01-25T15:04:45.984 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "scrape_frequency", 2024-01-25T15:04:45.984 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.984 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.985 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.985 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "86400", 2024-01-25T15:04:45.985 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.985 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.985 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.985 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how frequently to scrape device health metrics", 2024-01-25T15:04:45.985 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.985 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.985 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.985 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.985 INFO:teuthology.orchestra.run.smithi170.stdout: "self_heal": { 2024-01-25T15:04:45.985 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "self_heal", 2024-01-25T15:04:45.985 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.985 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.985 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.986 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:45.986 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.986 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.986 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.986 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-01-25T15:04:45.986 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.986 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.986 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.986 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.986 INFO:teuthology.orchestra.run.smithi170.stdout: "sleep_interval": { 2024-01-25T15:04:45.986 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "sleep_interval", 2024-01-25T15:04:45.986 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.986 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.986 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.987 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "600", 2024-01-25T15:04:45.987 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.987 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.987 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.987 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how frequently to wake up and check device health", 2024-01-25T15:04:45.987 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.987 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.987 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.987 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.987 INFO:teuthology.orchestra.run.smithi170.stdout: "warn_threshold": { 2024-01-25T15:04:45.987 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "warn_threshold", 2024-01-25T15:04:45.987 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:45.987 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.987 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.988 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "7257600", 2024-01-25T15:04:45.988 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.988 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.988 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.988 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-01-25T15:04:45.988 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.988 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.988 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.988 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.988 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.988 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "diskprediction_local", 2024-01-25T15:04:45.988 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:45.989 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:45.989 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.989 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:45.989 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:45.989 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.989 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.989 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.989 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:45.989 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.989 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.989 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.989 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.989 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.989 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.990 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.990 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.990 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.990 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.990 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.990 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.990 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.990 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.990 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.990 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:45.990 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:45.990 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.990 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.990 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.990 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.991 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.991 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.991 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.991 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.991 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.991 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.991 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.991 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.991 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:45.991 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:45.991 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.991 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.991 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.991 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:45.992 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.992 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.992 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:45.992 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:45.992 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:45.992 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:45.992 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:45.992 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:45.992 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:45.992 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:45.992 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.992 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.992 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.992 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.994 INFO:teuthology.orchestra.run.smithi170.stdout: "predict_interval": { 2024-01-25T15:04:45.994 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "predict_interval", 2024-01-25T15:04:45.994 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.994 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.994 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.994 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "86400", 2024-01-25T15:04:45.994 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.994 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.994 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.994 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.994 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.994 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.994 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.994 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.995 INFO:teuthology.orchestra.run.smithi170.stdout: "predictor_model": { 2024-01-25T15:04:45.995 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "predictor_model", 2024-01-25T15:04:45.995 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.995 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.995 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.995 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "prophetstor", 2024-01-25T15:04:45.995 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.995 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.995 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.995 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.995 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.995 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.995 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.996 INFO:teuthology.orchestra.run.smithi170.stdout: "sleep_interval": { 2024-01-25T15:04:45.996 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "sleep_interval", 2024-01-25T15:04:45.996 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.996 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.996 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.996 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "600", 2024-01-25T15:04:45.996 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.996 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.996 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.996 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:45.996 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.996 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.996 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.997 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.997 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:45.997 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.997 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:45.997 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "influx", 2024-01-25T15:04:45.997 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": false, 2024-01-25T15:04:45.997 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "influxdb python module not found", 2024-01-25T15:04:45.997 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:45.997 INFO:teuthology.orchestra.run.smithi170.stdout: "batch_size": { 2024-01-25T15:04:45.997 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "batch_size", 2024-01-25T15:04:45.997 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:45.997 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.997 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.997 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "5000", 2024-01-25T15:04:45.997 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.998 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.998 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.998 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-01-25T15:04:45.998 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.998 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.998 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.998 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.998 INFO:teuthology.orchestra.run.smithi170.stdout: "database": { 2024-01-25T15:04:45.998 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "database", 2024-01-25T15:04:45.998 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.998 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.998 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.998 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "ceph", 2024-01-25T15:04:45.998 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:45.999 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:45.999 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:45.999 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-01-25T15:04:45.999 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:45.999 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:45.999 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:45.999 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:45.999 INFO:teuthology.orchestra.run.smithi170.stdout: "hostname": { 2024-01-25T15:04:45.999 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "hostname", 2024-01-25T15:04:45.999 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:45.999 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:45.999 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:45.999 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.000 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.000 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.000 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.000 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "InfluxDB server hostname", 2024-01-25T15:04:46.000 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.000 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.000 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.000 INFO:teuthology.orchestra.run.smithi170.stdout: "interval": { 2024-01-25T15:04:46.000 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "interval", 2024-01-25T15:04:46.000 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.000 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.001 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.001 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "30", 2024-01-25T15:04:46.001 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "5", 2024-01-25T15:04:46.001 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.001 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.001 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-01-25T15:04:46.001 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.001 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.001 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.001 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.001 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.001 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.001 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.001 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.002 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.002 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.002 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.002 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.002 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.002 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.002 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.002 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.002 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.002 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.002 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.002 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.002 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.002 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.003 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.003 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.003 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.003 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.003 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.003 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.003 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.003 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.003 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.003 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.003 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.003 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.003 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.003 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.004 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.004 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.004 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.004 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.004 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.004 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.004 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.004 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.004 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.004 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.004 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.004 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.004 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.004 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.004 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.005 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.005 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.005 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.005 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.005 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.005 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.005 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.005 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.005 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.005 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.005 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.005 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.005 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.005 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.006 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.006 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.006 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.006 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.006 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.006 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.006 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.006 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.006 INFO:teuthology.orchestra.run.smithi170.stdout: "password": { 2024-01-25T15:04:46.006 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "password", 2024-01-25T15:04:46.006 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.006 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.006 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.006 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.006 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.007 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.007 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.007 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "password of InfluxDB server user", 2024-01-25T15:04:46.007 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.007 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.007 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.007 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.007 INFO:teuthology.orchestra.run.smithi170.stdout: "port": { 2024-01-25T15:04:46.007 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "port", 2024-01-25T15:04:46.007 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.007 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.007 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.007 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "8086", 2024-01-25T15:04:46.007 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.007 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.008 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.008 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "InfluxDB server port", 2024-01-25T15:04:46.008 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.008 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.008 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.008 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.008 INFO:teuthology.orchestra.run.smithi170.stdout: "ssl": { 2024-01-25T15:04:46.008 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ssl", 2024-01-25T15:04:46.008 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.008 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.008 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.008 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "false", 2024-01-25T15:04:46.008 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.009 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.009 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.009 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-01-25T15:04:46.009 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.009 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.009 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.009 INFO:teuthology.orchestra.run.smithi170.stdout: "threads": { 2024-01-25T15:04:46.009 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "threads", 2024-01-25T15:04:46.009 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.009 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.009 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.009 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "5", 2024-01-25T15:04:46.009 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "1", 2024-01-25T15:04:46.010 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "32", 2024-01-25T15:04:46.010 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.010 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-01-25T15:04:46.010 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.010 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.010 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.010 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.010 INFO:teuthology.orchestra.run.smithi170.stdout: "username": { 2024-01-25T15:04:46.010 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "username", 2024-01-25T15:04:46.010 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.010 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.010 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.010 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.010 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.011 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.011 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.011 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "username of InfluxDB server user", 2024-01-25T15:04:46.011 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.011 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.011 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.011 INFO:teuthology.orchestra.run.smithi170.stdout: "verify_ssl": { 2024-01-25T15:04:46.011 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "verify_ssl", 2024-01-25T15:04:46.011 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.011 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.011 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.011 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "true", 2024-01-25T15:04:46.012 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.012 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.012 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.012 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-01-25T15:04:46.012 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.012 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.012 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.012 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.012 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.012 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "insights", 2024-01-25T15:04:46.012 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.013 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.013 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.013 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.013 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.013 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.013 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.013 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.013 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.013 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.013 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.013 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.013 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.013 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.013 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.014 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.014 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.014 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.014 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.014 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.014 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.014 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.014 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.014 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.014 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.014 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.014 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.014 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.014 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.015 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.015 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.015 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.015 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.015 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.015 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.015 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.015 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.015 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.015 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.015 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.015 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.015 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.015 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.016 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.016 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.016 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.016 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.016 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.016 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.016 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.016 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.016 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.016 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.016 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.016 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.016 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.016 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.017 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.017 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.017 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.017 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.017 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.017 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.017 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.017 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.017 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.017 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.017 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.017 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.018 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.018 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.018 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.018 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "iostat", 2024-01-25T15:04:46.018 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.018 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.018 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.018 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.018 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.018 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.018 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.018 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.018 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.019 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.019 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.019 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.019 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.019 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.019 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.019 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.019 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.019 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.019 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.019 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.019 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.019 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.019 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.020 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.020 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.020 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.020 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.020 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.020 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.020 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.020 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.020 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.020 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.020 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.020 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.020 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.020 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.021 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.021 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.021 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.021 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.021 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.021 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.021 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.021 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.021 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.021 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.021 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.021 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.021 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.021 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.022 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.022 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.022 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.022 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.022 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.022 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.022 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.022 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.022 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.022 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.022 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.023 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.023 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.023 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.023 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.023 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.023 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.023 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.023 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.023 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.023 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.023 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.023 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "k8sevents", 2024-01-25T15:04:46.023 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.024 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.024 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.024 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_event_retention_days": { 2024-01-25T15:04:46.024 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ceph_event_retention_days", 2024-01-25T15:04:46.024 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.024 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.024 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.024 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "7", 2024-01-25T15:04:46.024 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.024 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.024 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.024 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Days to hold ceph event information within local cache", 2024-01-25T15:04:46.024 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.025 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.025 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.025 INFO:teuthology.orchestra.run.smithi170.stdout: "config_check_secs": { 2024-01-25T15:04:46.025 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "config_check_secs", 2024-01-25T15:04:46.025 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.025 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.025 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.025 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:46.025 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "10", 2024-01-25T15:04:46.025 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.025 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.025 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-01-25T15:04:46.026 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.026 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.026 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.026 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.026 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.026 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.026 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.026 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.026 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.026 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.026 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.026 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.026 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.026 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.027 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.028 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.028 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.028 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.028 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.028 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.028 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.028 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.028 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.028 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.028 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.028 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.028 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.029 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.029 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.029 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.029 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.029 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.029 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.029 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.029 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.029 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.029 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.029 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.029 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.029 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.029 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.030 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.030 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.030 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.030 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.030 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.030 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.030 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.030 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.030 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.030 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.030 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.030 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.030 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.031 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.031 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.031 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.031 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "localpool", 2024-01-25T15:04:46.031 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.031 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.031 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.031 INFO:teuthology.orchestra.run.smithi170.stdout: "failure_domain": { 2024-01-25T15:04:46.031 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "failure_domain", 2024-01-25T15:04:46.031 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.031 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.032 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.032 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "host", 2024-01-25T15:04:46.032 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.032 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.032 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.032 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "failure domain for any created local pool", 2024-01-25T15:04:46.032 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-01-25T15:04:46.032 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.032 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.032 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.032 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.032 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.032 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.034 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.034 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.034 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.034 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.034 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.034 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.034 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.034 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.034 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.034 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.034 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.034 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.034 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.034 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.035 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.035 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.035 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.035 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.035 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.035 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.035 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.035 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.035 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.035 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.035 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.035 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.035 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.035 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.036 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.036 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.036 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.036 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.036 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.036 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.036 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.036 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.036 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.036 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.036 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.036 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.036 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.036 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.037 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.037 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.037 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.037 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.037 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.037 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.037 INFO:teuthology.orchestra.run.smithi170.stdout: "min_size": { 2024-01-25T15:04:46.037 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "min_size", 2024-01-25T15:04:46.037 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.037 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.037 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.037 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.037 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.038 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.038 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.038 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "default min_size for any created local pool", 2024-01-25T15:04:46.038 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-01-25T15:04:46.038 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.038 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.038 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.038 INFO:teuthology.orchestra.run.smithi170.stdout: "num_rep": { 2024-01-25T15:04:46.038 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "num_rep", 2024-01-25T15:04:46.038 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.038 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.038 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.038 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "3", 2024-01-25T15:04:46.038 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.039 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.039 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.039 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "default replica count for any created local pool", 2024-01-25T15:04:46.039 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.039 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.039 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.039 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.039 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_num": { 2024-01-25T15:04:46.039 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "pg_num", 2024-01-25T15:04:46.039 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.039 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.039 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.039 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "128", 2024-01-25T15:04:46.039 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.040 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.040 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.040 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "default pg_num for any created local pool", 2024-01-25T15:04:46.040 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.040 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.040 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.040 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.040 INFO:teuthology.orchestra.run.smithi170.stdout: "prefix": { 2024-01-25T15:04:46.040 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "prefix", 2024-01-25T15:04:46.040 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.040 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.040 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.040 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.041 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.041 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.041 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.041 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "name prefix for any created local pool", 2024-01-25T15:04:46.041 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.041 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.041 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.041 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.041 INFO:teuthology.orchestra.run.smithi170.stdout: "subtree": { 2024-01-25T15:04:46.041 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "subtree", 2024-01-25T15:04:46.041 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.041 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.041 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.041 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "rack", 2024-01-25T15:04:46.041 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.042 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.042 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.042 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "CRUSH level for which to create a local pool", 2024-01-25T15:04:46.042 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-01-25T15:04:46.042 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.042 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.042 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.042 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.042 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mds_autoscaler", 2024-01-25T15:04:46.042 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.042 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.043 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.043 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.043 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.043 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.043 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.043 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.043 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.043 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.043 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.043 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.043 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.043 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.043 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.043 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.044 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.044 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.044 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.044 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.044 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.044 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.044 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.044 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.044 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.044 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.044 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.044 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.045 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.046 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.046 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.046 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.046 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.046 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.046 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.046 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.046 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.046 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.046 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.046 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.046 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.046 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.047 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.047 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.047 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.047 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.047 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.047 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.047 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.047 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.047 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.047 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.047 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.047 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.047 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.048 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.048 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.048 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.048 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mirroring", 2024-01-25T15:04:46.048 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.048 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.048 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.048 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.048 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.048 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.048 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.048 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.049 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.049 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.049 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.049 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.049 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.049 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.049 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.049 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.049 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.049 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.049 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.050 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.050 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.050 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.050 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.050 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.050 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.050 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.050 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.050 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.050 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.050 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.050 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.050 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.051 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.051 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.051 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.051 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.051 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.051 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.051 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.051 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.051 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.051 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.051 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.051 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.051 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.052 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.052 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.052 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.052 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.052 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.052 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.052 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.052 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.052 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.052 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.052 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.052 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.052 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.053 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.053 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.053 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.053 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.053 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.053 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.053 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.053 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.053 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.053 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.053 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.053 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.053 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.054 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "nfs", 2024-01-25T15:04:46.054 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.054 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.054 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.054 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.054 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.054 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.054 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.054 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.054 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.054 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.054 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.054 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.055 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.055 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.055 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.055 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.055 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.055 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.055 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.055 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.055 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.055 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.055 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.055 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.055 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.056 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.056 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.056 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.056 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.056 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.056 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.056 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.056 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.056 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.056 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.056 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.056 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.056 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.057 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.057 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.057 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.057 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.057 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.057 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.057 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.057 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.057 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.057 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.057 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.057 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.057 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.057 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.058 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.058 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.058 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.058 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.058 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.058 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.058 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.058 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.058 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.058 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.058 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.058 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.058 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.058 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.058 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.059 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.059 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.059 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.059 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.059 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.059 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "orchestrator", 2024-01-25T15:04:46.059 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.059 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.059 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.059 INFO:teuthology.orchestra.run.smithi170.stdout: "fail_fs": { 2024-01-25T15:04:46.059 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "fail_fs", 2024-01-25T15:04:46.059 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.060 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.060 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.060 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.060 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.060 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.060 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.060 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-01-25T15:04:46.060 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.060 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.060 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.060 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.060 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.060 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.061 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.061 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.061 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.061 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.061 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.061 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.061 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.061 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.061 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.061 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.061 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.061 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.061 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.061 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.061 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.062 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.062 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.062 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.062 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.062 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.062 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.062 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.062 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.062 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.062 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.062 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.062 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.062 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.063 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.063 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.063 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.063 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.063 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.063 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.063 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.063 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.063 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.063 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.063 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.063 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.064 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.064 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.064 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.064 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.064 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.064 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.064 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.064 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.064 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.064 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.064 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.064 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.065 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.065 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.065 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.065 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.065 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.065 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.065 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.065 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.065 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.065 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.065 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.065 INFO:teuthology.orchestra.run.smithi170.stdout: "orchestrator": { 2024-01-25T15:04:46.065 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "orchestrator", 2024-01-25T15:04:46.066 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.066 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.066 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.066 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.066 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.066 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.066 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.066 INFO:teuthology.orchestra.run.smithi170.stdout: "cephadm", 2024-01-25T15:04:46.066 INFO:teuthology.orchestra.run.smithi170.stdout: "rook", 2024-01-25T15:04:46.066 INFO:teuthology.orchestra.run.smithi170.stdout: "test_orchestrator" 2024-01-25T15:04:46.066 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.066 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Orchestrator backend", 2024-01-25T15:04:46.066 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.067 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.067 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.067 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.067 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.067 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "osd_perf_query", 2024-01-25T15:04:46.067 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.067 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.067 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.067 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.067 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.067 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.067 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.068 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.068 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.068 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.068 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.068 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.068 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.068 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.068 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.068 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.068 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.068 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.068 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.068 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.068 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.069 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.069 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.069 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.069 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.069 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.069 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.069 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.069 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.069 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.069 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.069 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.069 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.069 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.070 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.070 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.070 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.070 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.070 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.070 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.070 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.070 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.070 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.070 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.070 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.070 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.070 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.071 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.071 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.071 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.071 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.071 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.071 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.071 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.071 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.071 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.071 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.071 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.071 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.071 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.072 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.072 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.072 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.072 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.072 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.072 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.072 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.072 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.072 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.072 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.072 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.073 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "osd_support", 2024-01-25T15:04:46.073 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.073 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.073 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.073 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.073 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.073 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.073 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.073 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.073 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.073 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.073 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.073 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.073 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.073 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.074 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.074 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.074 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.074 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.074 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.074 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.074 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.074 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.074 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.074 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.074 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.074 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.074 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.075 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.075 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.075 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.075 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.075 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.075 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.075 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.075 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.075 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.075 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.075 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.075 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.076 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.076 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.076 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.076 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.076 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.076 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.076 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.076 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.076 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.076 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.076 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.076 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.076 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.076 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.077 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.077 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.077 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.077 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.077 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.077 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.077 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.077 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.077 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.077 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.077 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.077 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.077 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "pg_autoscaler", 2024-01-25T15:04:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.078 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.079 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.080 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.080 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.080 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.080 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.080 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.080 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.080 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.080 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.080 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.080 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.080 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.080 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.080 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.081 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.081 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.081 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.081 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.081 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.081 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.081 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.081 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.081 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.081 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.081 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.081 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.081 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.082 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.082 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.082 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.082 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.082 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.082 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.082 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.082 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.082 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.082 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.082 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.082 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.082 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.083 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.083 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.083 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.083 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.083 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.083 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.083 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.083 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.083 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.083 INFO:teuthology.orchestra.run.smithi170.stdout: "sleep_interval": { 2024-01-25T15:04:46.083 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "sleep_interval", 2024-01-25T15:04:46.083 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.083 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.084 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.084 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "60", 2024-01-25T15:04:46.084 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.084 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.084 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.084 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.084 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.084 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.084 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.084 INFO:teuthology.orchestra.run.smithi170.stdout: "threshold": { 2024-01-25T15:04:46.084 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "threshold", 2024-01-25T15:04:46.084 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:46.084 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.085 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.085 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "3.0", 2024-01-25T15:04:46.085 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "1.0", 2024-01-25T15:04:46.085 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.085 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.085 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "scaling threshold", 2024-01-25T15:04:46.085 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-01-25T15:04:46.085 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.085 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.085 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.085 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.085 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "progress", 2024-01-25T15:04:46.086 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.086 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.086 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.086 INFO:teuthology.orchestra.run.smithi170.stdout: "allow_pg_recovery_event": { 2024-01-25T15:04:46.086 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "allow_pg_recovery_event", 2024-01-25T15:04:46.086 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.086 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.086 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.086 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.086 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.086 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.086 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.086 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "allow the module to show pg recovery progress", 2024-01-25T15:04:46.086 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.087 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.087 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.087 INFO:teuthology.orchestra.run.smithi170.stdout: "enabled": { 2024-01-25T15:04:46.087 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "enabled", 2024-01-25T15:04:46.087 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.087 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.087 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.087 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.087 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.087 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.087 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.087 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.087 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.088 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.088 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.088 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.088 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.088 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.088 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.088 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.088 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.088 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.088 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.088 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.088 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.089 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.089 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.089 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.089 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.089 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.089 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.089 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.089 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.089 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.089 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.089 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.089 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.089 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.090 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.090 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.090 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.090 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.090 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.090 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.090 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.090 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.090 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.090 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.090 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.090 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.090 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.091 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.091 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.091 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.091 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.091 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.091 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.091 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.091 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.091 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.091 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.091 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.091 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.091 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.092 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.092 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.092 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.092 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.092 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.092 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.092 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.092 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.092 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.092 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.092 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.092 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.092 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.093 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.093 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.093 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.093 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.093 INFO:teuthology.orchestra.run.smithi170.stdout: "max_completed_events": { 2024-01-25T15:04:46.093 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "max_completed_events", 2024-01-25T15:04:46.093 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.093 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.093 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.093 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "50", 2024-01-25T15:04:46.093 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.093 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.093 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.094 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "number of past completed events to remember", 2024-01-25T15:04:46.094 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.094 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.094 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.094 INFO:teuthology.orchestra.run.smithi170.stdout: "sleep_interval": { 2024-01-25T15:04:46.094 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "sleep_interval", 2024-01-25T15:04:46.094 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.094 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.094 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.094 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "5", 2024-01-25T15:04:46.094 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.094 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.094 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how long the module is going to sleep", 2024-01-25T15:04:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "prometheus", 2024-01-25T15:04:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: "cache": { 2024-01-25T15:04:46.095 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "cache", 2024-01-25T15:04:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.096 INFO:teuthology.orchestra.run.smithi170.stdout: "exclude_perf_counters": { 2024-01-25T15:04:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "exclude_perf_counters", 2024-01-25T15:04:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-01-25T15:04:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-01-25T15:04:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.097 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.098 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.098 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.098 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.098 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.098 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.098 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.098 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.098 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.098 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.098 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.098 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.098 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.098 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.098 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.099 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.099 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.099 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.099 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.099 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.099 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.099 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.099 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.099 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.099 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.099 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.099 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.099 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.100 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.100 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.100 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.100 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.100 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.100 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.100 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.100 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.100 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.100 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.100 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.100 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.101 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.101 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.101 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.101 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.101 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.101 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.101 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.101 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.101 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.101 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.101 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.101 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.101 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.102 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.102 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.102 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.102 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.102 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.102 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.102 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.102 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.102 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.102 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.102 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.102 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.102 INFO:teuthology.orchestra.run.smithi170.stdout: "rbd_stats_pools": { 2024-01-25T15:04:46.103 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rbd_stats_pools", 2024-01-25T15:04:46.103 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.103 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.103 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.103 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.103 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.103 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.103 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.103 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.103 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.103 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.103 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.103 INFO:teuthology.orchestra.run.smithi170.stdout: "rbd_stats_pools_refresh_interval": { 2024-01-25T15:04:46.103 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-01-25T15:04:46.104 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.104 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.104 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.104 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "300", 2024-01-25T15:04:46.104 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.104 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.104 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.104 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.104 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.104 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.104 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.104 INFO:teuthology.orchestra.run.smithi170.stdout: "scrape_interval": { 2024-01-25T15:04:46.105 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "scrape_interval", 2024-01-25T15:04:46.105 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:46.105 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.105 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.105 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "15.0", 2024-01-25T15:04:46.105 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.105 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.105 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.105 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.105 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.105 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.105 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.105 INFO:teuthology.orchestra.run.smithi170.stdout: "server_addr": { 2024-01-25T15:04:46.106 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_addr", 2024-01-25T15:04:46.106 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.106 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.106 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.106 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "::", 2024-01-25T15:04:46.106 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.106 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.106 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.106 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-01-25T15:04:46.106 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.106 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.106 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.107 INFO:teuthology.orchestra.run.smithi170.stdout: "server_port": { 2024-01-25T15:04:46.107 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_port", 2024-01-25T15:04:46.107 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.107 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.107 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.107 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "9283", 2024-01-25T15:04:46.107 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.107 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.107 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.107 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-01-25T15:04:46.107 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.107 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.107 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.108 INFO:teuthology.orchestra.run.smithi170.stdout: "stale_cache_strategy": { 2024-01-25T15:04:46.108 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "stale_cache_strategy", 2024-01-25T15:04:46.108 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.108 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.108 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.108 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "log", 2024-01-25T15:04:46.108 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.108 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.108 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.108 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.108 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.108 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.108 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.109 INFO:teuthology.orchestra.run.smithi170.stdout: "standby_behaviour": { 2024-01-25T15:04:46.109 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "standby_behaviour", 2024-01-25T15:04:46.109 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.109 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.109 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.109 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "default", 2024-01-25T15:04:46.109 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.111 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.111 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.111 INFO:teuthology.orchestra.run.smithi170.stdout: "default", 2024-01-25T15:04:46.111 INFO:teuthology.orchestra.run.smithi170.stdout: "error" 2024-01-25T15:04:46.111 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.111 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.111 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.111 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.111 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.111 INFO:teuthology.orchestra.run.smithi170.stdout: "standby_error_status_code": { 2024-01-25T15:04:46.111 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "standby_error_status_code", 2024-01-25T15:04:46.111 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.112 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.112 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.112 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "500", 2024-01-25T15:04:46.112 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "400", 2024-01-25T15:04:46.112 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "599", 2024-01-25T15:04:46.112 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.112 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.112 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.112 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.112 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.112 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.112 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.112 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rbd_support", 2024-01-25T15:04:46.113 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.113 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.113 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.113 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.113 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.113 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.113 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.113 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.113 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.113 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.113 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.113 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.113 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.114 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.114 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.114 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.114 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.114 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.114 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.114 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.114 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.114 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.114 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.114 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.114 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.114 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.114 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.115 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.115 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.115 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.115 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.115 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.115 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.115 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.115 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.115 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.115 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.115 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.115 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.115 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.116 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.116 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.116 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.116 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.116 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.116 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.116 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.116 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.116 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.116 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.116 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.116 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.116 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.117 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.118 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.118 INFO:teuthology.orchestra.run.smithi170.stdout: "max_concurrent_snap_create": { 2024-01-25T15:04:46.118 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "max_concurrent_snap_create", 2024-01-25T15:04:46.118 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.118 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.118 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.118 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:46.118 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.118 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.118 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.118 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.118 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.118 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.119 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.119 INFO:teuthology.orchestra.run.smithi170.stdout: "mirror_snapshot_schedule": { 2024-01-25T15:04:46.119 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mirror_snapshot_schedule", 2024-01-25T15:04:46.119 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.119 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.119 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.119 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.119 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.119 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.119 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.119 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.119 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.120 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.120 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.120 INFO:teuthology.orchestra.run.smithi170.stdout: "trash_purge_schedule": { 2024-01-25T15:04:46.120 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "trash_purge_schedule", 2024-01-25T15:04:46.120 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.120 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.120 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.120 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.120 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.120 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.120 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.120 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.121 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.121 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.121 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.121 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.121 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.121 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "restful", 2024-01-25T15:04:46.121 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.121 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.121 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.121 INFO:teuthology.orchestra.run.smithi170.stdout: "enable_auth": { 2024-01-25T15:04:46.121 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "enable_auth", 2024-01-25T15:04:46.121 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.122 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.122 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.122 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.122 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.122 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.122 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.122 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.122 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.122 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.122 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.122 INFO:teuthology.orchestra.run.smithi170.stdout: "key_file": { 2024-01-25T15:04:46.122 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "key_file", 2024-01-25T15:04:46.122 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.123 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.123 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.123 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.123 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.123 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.123 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.123 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.123 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.123 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.123 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.123 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.123 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.123 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.124 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.124 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.124 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.124 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.124 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.124 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.124 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.124 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.124 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.124 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.124 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.124 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.124 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.125 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.125 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.125 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.125 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.125 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.125 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.125 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.125 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.125 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.125 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.125 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.125 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.125 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.126 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.126 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.126 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.126 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.126 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.126 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.126 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.126 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.126 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.126 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.126 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.126 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.126 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.127 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.128 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.128 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.128 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.128 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.128 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.128 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.128 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.128 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.128 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.128 INFO:teuthology.orchestra.run.smithi170.stdout: "server_addr": { 2024-01-25T15:04:46.128 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_addr", 2024-01-25T15:04:46.128 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.129 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.129 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.129 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.129 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.129 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.129 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.129 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.129 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.129 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.129 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.129 INFO:teuthology.orchestra.run.smithi170.stdout: "server_port": { 2024-01-25T15:04:46.129 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_port", 2024-01-25T15:04:46.129 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.130 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.130 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.130 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.130 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.130 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.130 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.130 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.130 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.130 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.130 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.130 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.130 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rgw", 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.131 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.132 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.132 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.132 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.132 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.132 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.132 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.132 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.132 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.132 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.132 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.132 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.132 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.132 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.133 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.133 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.133 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.133 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.133 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.133 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.133 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.133 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.133 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.133 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.133 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.133 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.134 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.134 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.134 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.134 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.134 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.134 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.134 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.134 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.134 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.134 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.134 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.134 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.134 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.134 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.135 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.135 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.135 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.135 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.135 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.135 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.135 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.135 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.135 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.135 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.135 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.135 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.135 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rook", 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: "drive_group_interval": { 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "drive_group_interval", 2024-01-25T15:04:46.136 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "300.0", 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.137 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.138 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.139 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.140 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.141 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi170.stdout: "storage_class": { 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "storage_class", 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.142 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "local", 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "selftest", 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.143 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.144 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.145 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.146 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.147 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.148 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi170.stdout: "roption1": { 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "roption1", 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.149 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi170.stdout: "roption2": { 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "roption2", 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "xyz", 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.150 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption1": { 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption1", 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.151 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption2": { 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption2", 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.152 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption3": { 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption3", 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.153 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption4": { 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption4", 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.154 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption5": { 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption5", 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.155 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption6": { 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption6", 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.156 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption7": { 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption7", 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "1", 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "42", 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.157 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi170.stdout: "testkey": { 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "testkey", 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.158 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi170.stdout: "testlkey": { 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "testlkey", 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.159 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi170.stdout: "testnewline": { 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "testnewline", 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.160 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "snap_schedule", 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi170.stdout: "allow_m_granularity": { 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "allow_m_granularity", 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.161 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "allow minute scheduled snapshots", 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi170.stdout: "dump_on_update": { 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "dump_on_update", 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.162 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "dump database to debug log on update", 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.163 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.164 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.165 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.166 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "stats", 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "status", 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "telegraf", 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "address": { 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "address", 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "interval": { 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "interval", 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "15", 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "telemetry", 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "channel_basic": { 2024-01-25T15:04:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "channel_basic", 2024-01-25T15:04:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Share basic cluster information (size, version)", 2024-01-25T15:04:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "channel_crash": { 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "channel_crash", 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "channel_device": { 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "channel_device", 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "channel_ident": { 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "channel_ident", 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "channel_perf": { 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "channel_perf", 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Share various performance metrics of a cluster", 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "contact": { 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "contact", 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "description": { 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "description", 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "device_url": { 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "device_url", 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "enabled": { 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "enabled", 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "interval": { 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "interval", 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "24", 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "8", 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "last_opt_revision": { 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "last_opt_revision", 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "1", 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "leaderboard": { 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "leaderboard", 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "leaderboard_description": { 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "leaderboard_description", 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "organization": { 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "organization", 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "proxy": { 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "proxy", 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "url": { 2024-01-25T15:04:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "url", 2024-01-25T15:04:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-01-25T15:04:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "test_orchestrator", 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "volumes", 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "max_concurrent_clones": { 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "max_concurrent_clones", 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "4", 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Number of asynchronous cloner threads", 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "periodic_async_work": { 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "periodic_async_work", 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Periodically check for async work", 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "snapshot_clone_delay": { 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "snapshot_clone_delay", 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0", 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "zabbix", 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "discovery_interval": { 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "discovery_interval", 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "uint", 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "100", 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "identifier": { 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "identifier", 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "interval": { 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "interval", 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "60", 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "zabbix_host": { 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "zabbix_host", 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi170.stdout: "zabbix_port": { 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "zabbix_port", 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.231 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10051", 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi170.stdout: "zabbix_sender": { 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "zabbix_sender", 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.232 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "modules": [ 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "cephadm", 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "dashboard", 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "iostat", 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "nfs", 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "restful" 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "available_modules": [ 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "alerts", 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "interval": { 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "interval", 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "60", 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "How frequently to reexamine health status", 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_destination": { 2024-01-25T15:04:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_destination", 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Email address to send alerts to", 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_from_name": { 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_from_name", 2024-01-25T15:04:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "Ceph", 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Email From: name", 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_host": { 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_host", 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "SMTP server", 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_password": { 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_password", 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Password to authenticate with", 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_port": { 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_port", 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "465", 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "SMTP port", 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_sender": { 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_sender", 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "SMTP envelope sender", 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_ssl": { 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_ssl", 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Use SSL to connect to SMTP server", 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "smtp_user": { 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "smtp_user", 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "User to authenticate as", 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "balancer", 2024-01-25T15:04:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "active": { 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "active", 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "automatically balance PGs across cluster", 2024-01-25T15:04:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "begin_time": { 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "begin_time", 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0000", 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "beginning time of day to automatically balance", 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-01-25T15:04:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "begin_weekday": { 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "begin_weekday", 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "uint", 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0", 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "0", 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "6", 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "crush_compat_max_iterations": { 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "crush_compat_max_iterations", 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "uint", 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "25", 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "1", 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "250", 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "crush_compat_metrics": { 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "crush_compat_metrics", 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "pgs,objects,bytes", 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "crush_compat_step": { 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "crush_compat_step", 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0.5", 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "0.001", 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "0.999", 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "aggressiveness of optimization", 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "end_time": { 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "end_time", 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "2359", 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "ending time of day to automatically balance", 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-01-25T15:04:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "end_weekday": { 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "end_weekday", 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "uint", 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0", 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "0", 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "6", 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-01-25T15:04:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.259 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.260 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.261 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.262 INFO:teuthology.orchestra.run.smithi170.stdout: "min_score": { 2024-01-25T15:04:46.262 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "min_score", 2024-01-25T15:04:46.262 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:46.262 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.262 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.262 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0", 2024-01-25T15:04:46.262 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.262 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.262 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.262 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-01-25T15:04:46.262 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.262 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.262 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: "mode": { 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mode", 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "upmap", 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: "crush-compat", 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: "none", 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: "upmap" 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.263 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Balancer mode", 2024-01-25T15:04:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: "pool_ids": { 2024-01-25T15:04:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "pool_ids", 2024-01-25T15:04:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.264 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: "sleep_interval": { 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "sleep_interval", 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "60", 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-01-25T15:04:46.265 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: "upmap_max_deviation": { 2024-01-25T15:04:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "upmap_max_deviation", 2024-01-25T15:04:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "5", 2024-01-25T15:04:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "1", 2024-01-25T15:04:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "deviation below which no optimization is attempted", 2024-01-25T15:04:46.266 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-01-25T15:04:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: "upmap_max_optimizations": { 2024-01-25T15:04:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "upmap_max_optimizations", 2024-01-25T15:04:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "uint", 2024-01-25T15:04:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-01-25T15:04:46.267 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "cephadm", 2024-01-25T15:04:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: "agent_down_multiplier": { 2024-01-25T15:04:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "agent_down_multiplier", 2024-01-25T15:04:46.268 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "3.0", 2024-01-25T15:04:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-01-25T15:04:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: "agent_refresh_rate": { 2024-01-25T15:04:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "agent_refresh_rate", 2024-01-25T15:04:46.269 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "20", 2024-01-25T15:04:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-01-25T15:04:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: "agent_starting_port": { 2024-01-25T15:04:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "agent_starting_port", 2024-01-25T15:04:46.270 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "4721", 2024-01-25T15:04:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-01-25T15:04:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: "allow_ptrace": { 2024-01-25T15:04:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "allow_ptrace", 2024-01-25T15:04:46.271 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-01-25T15:04:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-01-25T15:04:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: "autotune_interval": { 2024-01-25T15:04:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "autotune_interval", 2024-01-25T15:04:46.272 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "600", 2024-01-25T15:04:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how frequently to autotune daemon memory", 2024-01-25T15:04:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: "autotune_memory_target_ratio": { 2024-01-25T15:04:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "autotune_memory_target_ratio", 2024-01-25T15:04:46.273 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0.7", 2024-01-25T15:04:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-01-25T15:04:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: "cephadm_log_destination": { 2024-01-25T15:04:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "cephadm_log_destination", 2024-01-25T15:04:46.274 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.275 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.275 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.275 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.275 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.275 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.275 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.275 INFO:teuthology.orchestra.run.smithi170.stdout: "file", 2024-01-25T15:04:46.275 INFO:teuthology.orchestra.run.smithi170.stdout: "file,syslog", 2024-01-25T15:04:46.275 INFO:teuthology.orchestra.run.smithi170.stdout: "syslog" 2024-01-25T15:04:46.275 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.275 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-01-25T15:04:46.275 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.275 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.275 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.276 INFO:teuthology.orchestra.run.smithi170.stdout: "cgroups_split": { 2024-01-25T15:04:46.276 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "cgroups_split", 2024-01-25T15:04:46.276 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.276 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.276 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.276 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.276 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.276 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.276 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.276 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-01-25T15:04:46.276 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: "config_checks_enabled": { 2024-01-25T15:04:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "config_checks_enabled", 2024-01-25T15:04:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-01-25T15:04:46.277 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.278 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.278 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.278 INFO:teuthology.orchestra.run.smithi170.stdout: "config_dashboard": { 2024-01-25T15:04:46.278 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "config_dashboard", 2024-01-25T15:04:46.278 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.278 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.278 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.278 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.278 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.278 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.278 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.278 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-01-25T15:04:46.279 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.279 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.279 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.279 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_alertmanager": { 2024-01-25T15:04:46.279 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_alertmanager", 2024-01-25T15:04:46.279 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.279 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.279 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.279 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-01-25T15:04:46.279 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.279 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.279 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.279 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Prometheus container image", 2024-01-25T15:04:46.279 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.280 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.280 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.280 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_base": { 2024-01-25T15:04:46.280 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_base", 2024-01-25T15:04:46.280 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.280 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.280 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.280 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/ceph/ceph", 2024-01-25T15:04:46.280 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.280 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.280 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.281 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Container image name, without the tag", 2024-01-25T15:04:46.281 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.281 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.281 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.281 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_elasticsearch": { 2024-01-25T15:04:46.281 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_elasticsearch", 2024-01-25T15:04:46.281 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.281 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.281 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.281 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-01-25T15:04:46.281 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.281 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.282 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.282 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "elasticsearch container image", 2024-01-25T15:04:46.282 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.282 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.282 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.282 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_grafana": { 2024-01-25T15:04:46.282 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_grafana", 2024-01-25T15:04:46.282 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.282 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.282 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.282 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.12", 2024-01-25T15:04:46.282 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.283 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.283 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.283 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Prometheus container image", 2024-01-25T15:04:46.283 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.283 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.283 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.283 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_haproxy": { 2024-01-25T15:04:46.283 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_haproxy", 2024-01-25T15:04:46.283 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.283 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.283 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.283 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-01-25T15:04:46.284 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.284 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.284 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.284 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "HAproxy container image", 2024-01-25T15:04:46.284 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.284 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.284 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.284 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_jaeger_agent": { 2024-01-25T15:04:46.284 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_jaeger_agent", 2024-01-25T15:04:46.284 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.284 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.284 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.284 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-01-25T15:04:46.285 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.285 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.285 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.285 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Jaeger agent container image", 2024-01-25T15:04:46.285 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.285 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.285 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.285 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_jaeger_collector": { 2024-01-25T15:04:46.285 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_jaeger_collector", 2024-01-25T15:04:46.285 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.285 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.285 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.285 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-01-25T15:04:46.286 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.286 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.286 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.286 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Jaeger collector container image", 2024-01-25T15:04:46.286 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.286 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.286 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.286 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_jaeger_query": { 2024-01-25T15:04:46.286 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_jaeger_query", 2024-01-25T15:04:46.286 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.286 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.286 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.286 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Jaeger query container image", 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_keepalived": { 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_keepalived", 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.287 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.288 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.288 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Keepalived container image", 2024-01-25T15:04:46.288 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.288 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.288 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.288 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_loki": { 2024-01-25T15:04:46.288 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_loki", 2024-01-25T15:04:46.288 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.288 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.288 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.288 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-01-25T15:04:46.288 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.289 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.289 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.289 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Loki container image", 2024-01-25T15:04:46.289 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.289 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.289 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.289 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_node_exporter": { 2024-01-25T15:04:46.289 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_node_exporter", 2024-01-25T15:04:46.289 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.289 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.289 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.289 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-01-25T15:04:46.289 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.290 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.290 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.290 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Prometheus container image", 2024-01-25T15:04:46.290 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.290 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.290 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.290 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_nvmeof": { 2024-01-25T15:04:46.290 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_nvmeof", 2024-01-25T15:04:46.290 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.290 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.290 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.290 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2024-01-25T15:04:46.290 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.291 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.291 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.291 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Nvme-of container image", 2024-01-25T15:04:46.291 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.291 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.291 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.291 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_prometheus": { 2024-01-25T15:04:46.291 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_prometheus", 2024-01-25T15:04:46.291 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.291 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.291 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.291 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-01-25T15:04:46.291 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.292 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.292 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.292 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Prometheus container image", 2024-01-25T15:04:46.292 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.292 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.292 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.292 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_promtail": { 2024-01-25T15:04:46.292 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_promtail", 2024-01-25T15:04:46.292 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.292 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.292 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.292 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-01-25T15:04:46.293 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.293 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.293 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.293 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Promtail container image", 2024-01-25T15:04:46.293 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.293 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.293 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.293 INFO:teuthology.orchestra.run.smithi170.stdout: "container_image_snmp_gateway": { 2024-01-25T15:04:46.293 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_image_snmp_gateway", 2024-01-25T15:04:46.293 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.293 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.293 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.293 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-01-25T15:04:46.294 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.294 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.294 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.294 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "SNMP Gateway container image", 2024-01-25T15:04:46.294 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.294 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.294 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.294 INFO:teuthology.orchestra.run.smithi170.stdout: "container_init": { 2024-01-25T15:04:46.294 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "container_init", 2024-01-25T15:04:46.294 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.294 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.294 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.295 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.295 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.295 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.295 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.295 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Run podman/docker with `--init`", 2024-01-25T15:04:46.295 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.295 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.295 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.295 INFO:teuthology.orchestra.run.smithi170.stdout: "daemon_cache_timeout": { 2024-01-25T15:04:46.295 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "daemon_cache_timeout", 2024-01-25T15:04:46.295 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.295 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.295 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.296 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "600", 2024-01-25T15:04:46.296 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.296 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.296 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.296 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-01-25T15:04:46.296 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.296 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.296 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.296 INFO:teuthology.orchestra.run.smithi170.stdout: "default_cephadm_command_timeout": { 2024-01-25T15:04:46.296 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "default_cephadm_command_timeout", 2024-01-25T15:04:46.296 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.296 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.297 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.297 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "900", 2024-01-25T15:04:46.297 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.297 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.297 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.297 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-01-25T15:04:46.297 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.297 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.297 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.297 INFO:teuthology.orchestra.run.smithi170.stdout: "default_registry": { 2024-01-25T15:04:46.297 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "default_registry", 2024-01-25T15:04:46.297 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.297 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.298 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.298 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "docker.io", 2024-01-25T15:04:46.298 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.298 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.298 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.298 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-01-25T15:04:46.298 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.298 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.298 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.298 INFO:teuthology.orchestra.run.smithi170.stdout: "device_cache_timeout": { 2024-01-25T15:04:46.298 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "device_cache_timeout", 2024-01-25T15:04:46.298 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.298 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.299 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.299 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "1800", 2024-01-25T15:04:46.299 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.299 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.299 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.299 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "seconds to cache device inventory", 2024-01-25T15:04:46.299 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.299 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.299 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.299 INFO:teuthology.orchestra.run.smithi170.stdout: "device_enhanced_scan": { 2024-01-25T15:04:46.299 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "device_enhanced_scan", 2024-01-25T15:04:46.299 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.299 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.299 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.300 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.300 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.300 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.300 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.300 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Use libstoragemgmt during device scans", 2024-01-25T15:04:46.300 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.300 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.300 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.300 INFO:teuthology.orchestra.run.smithi170.stdout: "facts_cache_timeout": { 2024-01-25T15:04:46.300 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "facts_cache_timeout", 2024-01-25T15:04:46.300 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.300 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.300 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.301 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "60", 2024-01-25T15:04:46.301 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.301 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.301 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.301 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "seconds to cache host facts data", 2024-01-25T15:04:46.301 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.301 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.301 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.301 INFO:teuthology.orchestra.run.smithi170.stdout: "host_check_interval": { 2024-01-25T15:04:46.301 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "host_check_interval", 2024-01-25T15:04:46.301 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.301 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.301 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.301 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "600", 2024-01-25T15:04:46.302 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.302 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.302 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.302 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how frequently to perform a host check", 2024-01-25T15:04:46.302 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.302 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.302 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.302 INFO:teuthology.orchestra.run.smithi170.stdout: "inventory_list_all": { 2024-01-25T15:04:46.302 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "inventory_list_all", 2024-01-25T15:04:46.302 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.302 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.302 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.302 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.303 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.303 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.303 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.303 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-01-25T15:04:46.303 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.303 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.303 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.303 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.303 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.303 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.303 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.303 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.303 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.304 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.304 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.304 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.304 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.304 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.304 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.304 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.304 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.304 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.304 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.304 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.304 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.304 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.304 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.305 INFO:teuthology.orchestra.run.smithi170.stdout: "log_refresh_metadata": { 2024-01-25T15:04:46.305 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_refresh_metadata", 2024-01-25T15:04:46.305 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.305 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.305 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.305 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.305 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.305 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.305 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.305 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-01-25T15:04:46.305 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.305 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.306 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.306 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.306 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.306 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.306 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.306 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.306 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.306 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.306 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.306 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.306 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-01-25T15:04:46.306 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.306 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.307 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.307 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.307 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.307 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.307 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.307 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.307 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.307 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.307 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.307 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.307 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.307 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.307 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.307 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.308 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.308 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.308 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.308 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.308 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.308 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.308 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.308 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.308 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.308 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.308 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.308 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.308 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.309 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.309 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.309 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.309 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.309 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.309 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.309 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.309 INFO:teuthology.orchestra.run.smithi170.stdout: "manage_etc_ceph_ceph_conf": { 2024-01-25T15:04:46.309 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-01-25T15:04:46.309 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.309 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.309 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.309 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.310 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.310 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.310 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.310 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-01-25T15:04:46.310 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.310 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.310 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.310 INFO:teuthology.orchestra.run.smithi170.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-01-25T15:04:46.310 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-01-25T15:04:46.310 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.310 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.310 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.310 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "*", 2024-01-25T15:04:46.311 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.311 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.311 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.311 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-01-25T15:04:46.311 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.311 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.311 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.311 INFO:teuthology.orchestra.run.smithi170.stdout: "max_count_per_host": { 2024-01-25T15:04:46.311 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "max_count_per_host", 2024-01-25T15:04:46.311 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.311 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.311 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.311 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:46.312 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.312 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.312 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.312 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "max number of daemons per service per host", 2024-01-25T15:04:46.312 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.312 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.312 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.312 INFO:teuthology.orchestra.run.smithi170.stdout: "max_osd_draining_count": { 2024-01-25T15:04:46.312 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "max_osd_draining_count", 2024-01-25T15:04:46.312 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.312 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.312 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.312 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:46.312 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.313 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.313 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.313 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-01-25T15:04:46.313 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.313 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.313 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.313 INFO:teuthology.orchestra.run.smithi170.stdout: "migration_current": { 2024-01-25T15:04:46.313 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "migration_current", 2024-01-25T15:04:46.313 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.313 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.313 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.313 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.313 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.314 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.314 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.314 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "internal - do not modify", 2024-01-25T15:04:46.314 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.314 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.314 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.314 INFO:teuthology.orchestra.run.smithi170.stdout: "mode": { 2024-01-25T15:04:46.314 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mode", 2024-01-25T15:04:46.314 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.314 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.314 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.314 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "root", 2024-01-25T15:04:46.314 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.315 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.315 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.315 INFO:teuthology.orchestra.run.smithi170.stdout: "cephadm-package", 2024-01-25T15:04:46.315 INFO:teuthology.orchestra.run.smithi170.stdout: "root" 2024-01-25T15:04:46.315 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.315 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "mode for remote execution of cephadm", 2024-01-25T15:04:46.315 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.315 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.315 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.315 INFO:teuthology.orchestra.run.smithi170.stdout: "prometheus_alerts_path": { 2024-01-25T15:04:46.315 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "prometheus_alerts_path", 2024-01-25T15:04:46.315 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.315 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.315 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.316 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-01-25T15:04:46.316 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.316 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.316 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.316 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-01-25T15:04:46.316 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.316 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.316 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.316 INFO:teuthology.orchestra.run.smithi170.stdout: "registry_insecure": { 2024-01-25T15:04:46.316 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "registry_insecure", 2024-01-25T15:04:46.316 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.316 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.317 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.317 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.317 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.317 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.317 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.317 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-01-25T15:04:46.317 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.317 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.317 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.317 INFO:teuthology.orchestra.run.smithi170.stdout: "registry_password": { 2024-01-25T15:04:46.317 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "registry_password", 2024-01-25T15:04:46.317 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.317 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.317 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.318 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.318 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.318 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.318 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.318 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-01-25T15:04:46.318 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.318 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.318 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.318 INFO:teuthology.orchestra.run.smithi170.stdout: "registry_url": { 2024-01-25T15:04:46.318 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "registry_url", 2024-01-25T15:04:46.318 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.318 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.318 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.318 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.319 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.319 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.319 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.319 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-01-25T15:04:46.319 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.319 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.319 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.319 INFO:teuthology.orchestra.run.smithi170.stdout: "registry_username": { 2024-01-25T15:04:46.319 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "registry_username", 2024-01-25T15:04:46.319 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.319 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.319 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.319 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.319 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.320 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.320 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.320 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-01-25T15:04:46.320 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.320 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.320 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.320 INFO:teuthology.orchestra.run.smithi170.stdout: "secure_monitoring_stack": { 2024-01-25T15:04:46.320 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "secure_monitoring_stack", 2024-01-25T15:04:46.320 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.320 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.320 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.321 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.321 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.321 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.321 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.321 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-01-25T15:04:46.321 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.321 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.321 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.321 INFO:teuthology.orchestra.run.smithi170.stdout: "service_discovery_port": { 2024-01-25T15:04:46.321 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "service_discovery_port", 2024-01-25T15:04:46.321 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.321 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.321 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.322 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "8765", 2024-01-25T15:04:46.322 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.322 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.322 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.322 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "cephadm service discovery port", 2024-01-25T15:04:46.322 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.322 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.322 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.322 INFO:teuthology.orchestra.run.smithi170.stdout: "ssh_config_file": { 2024-01-25T15:04:46.322 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ssh_config_file", 2024-01-25T15:04:46.322 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.322 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.322 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.322 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.323 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.323 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.323 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.323 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-01-25T15:04:46.323 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.323 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.323 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.323 INFO:teuthology.orchestra.run.smithi170.stdout: "use_agent": { 2024-01-25T15:04:46.323 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "use_agent", 2024-01-25T15:04:46.323 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.323 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.323 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.323 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.324 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.324 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.324 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.324 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-01-25T15:04:46.324 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.324 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.324 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.324 INFO:teuthology.orchestra.run.smithi170.stdout: "use_repo_digest": { 2024-01-25T15:04:46.324 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "use_repo_digest", 2024-01-25T15:04:46.324 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.324 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.324 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.324 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.325 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.325 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.325 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.325 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-01-25T15:04:46.325 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.325 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.325 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.325 INFO:teuthology.orchestra.run.smithi170.stdout: "warn_on_failed_host_check": { 2024-01-25T15:04:46.325 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "warn_on_failed_host_check", 2024-01-25T15:04:46.325 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.325 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.325 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.325 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.326 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.326 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.326 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.326 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "raise a health warning if the host check fails", 2024-01-25T15:04:46.326 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.326 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.326 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.326 INFO:teuthology.orchestra.run.smithi170.stdout: "warn_on_stray_daemons": { 2024-01-25T15:04:46.326 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "warn_on_stray_daemons", 2024-01-25T15:04:46.326 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.326 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.326 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.326 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.327 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.327 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.327 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.327 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-01-25T15:04:46.327 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.327 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.327 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.327 INFO:teuthology.orchestra.run.smithi170.stdout: "warn_on_stray_hosts": { 2024-01-25T15:04:46.327 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "warn_on_stray_hosts", 2024-01-25T15:04:46.327 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.327 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.327 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.327 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.327 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.328 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.328 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.328 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-01-25T15:04:46.328 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.328 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.328 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.328 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.328 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.328 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "crash", 2024-01-25T15:04:46.328 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.328 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.329 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.329 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.329 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.329 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.329 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.329 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.329 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.329 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.329 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.329 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.329 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.329 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.329 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.329 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.329 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.330 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.330 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.330 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.330 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.330 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.330 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.330 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.330 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.330 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.330 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.330 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.330 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.330 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.331 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.331 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.331 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.331 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.331 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.331 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.331 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.331 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.331 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.331 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.331 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.331 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.331 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.331 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.332 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.332 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.332 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.332 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.332 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.332 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.332 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.332 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.332 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.332 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.332 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.332 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.333 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.333 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.333 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.333 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.333 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.333 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.333 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.333 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.333 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.333 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.333 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.333 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.333 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.333 INFO:teuthology.orchestra.run.smithi170.stdout: "retain_interval": { 2024-01-25T15:04:46.334 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "retain_interval", 2024-01-25T15:04:46.334 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.334 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.334 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.334 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "31536000", 2024-01-25T15:04:46.334 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.334 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.334 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.334 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how long to retain crashes before pruning them", 2024-01-25T15:04:46.334 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.334 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.334 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.334 INFO:teuthology.orchestra.run.smithi170.stdout: "warn_recent_interval": { 2024-01-25T15:04:46.334 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "warn_recent_interval", 2024-01-25T15:04:46.335 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.335 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.335 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.335 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "1209600", 2024-01-25T15:04:46.335 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.335 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.335 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.335 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "time interval in which to warn about recent crashes", 2024-01-25T15:04:46.335 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.335 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.335 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.335 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.335 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.336 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "dashboard", 2024-01-25T15:04:46.336 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.336 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.336 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.336 INFO:teuthology.orchestra.run.smithi170.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-01-25T15:04:46.336 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-01-25T15:04:46.336 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.336 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.336 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.336 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:46.336 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.336 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.336 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.337 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.337 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.337 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.337 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.337 INFO:teuthology.orchestra.run.smithi170.stdout: "ALERTMANAGER_API_HOST": { 2024-01-25T15:04:46.337 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ALERTMANAGER_API_HOST", 2024-01-25T15:04:46.337 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.337 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.337 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.337 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.337 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.337 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.337 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.338 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.338 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.338 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.338 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.338 INFO:teuthology.orchestra.run.smithi170.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-01-25T15:04:46.338 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-01-25T15:04:46.338 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.338 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.338 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.338 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.338 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.338 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.338 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.339 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.339 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.339 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.339 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.339 INFO:teuthology.orchestra.run.smithi170.stdout: "AUDIT_API_ENABLED": { 2024-01-25T15:04:46.339 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "AUDIT_API_ENABLED", 2024-01-25T15:04:46.339 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.339 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.339 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.339 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.339 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.339 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.339 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.339 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.340 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.340 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.340 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.340 INFO:teuthology.orchestra.run.smithi170.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-01-25T15:04:46.340 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-01-25T15:04:46.340 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.340 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.340 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.340 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.340 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.340 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.340 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: "ENABLE_BROWSABLE_API": { 2024-01-25T15:04:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ENABLE_BROWSABLE_API", 2024-01-25T15:04:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.341 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.342 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.342 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.342 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.342 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-01-25T15:04:46.342 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-01-25T15:04:46.342 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.342 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.342 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.342 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.342 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.342 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.342 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.342 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.343 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.343 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.343 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.343 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-01-25T15:04:46.343 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-01-25T15:04:46.343 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.343 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.343 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.343 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.343 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.343 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.343 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.343 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.344 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.344 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.344 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.344 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-01-25T15:04:46.344 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-01-25T15:04:46.344 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.344 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.344 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.344 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.344 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.344 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.344 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.345 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.345 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.345 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.345 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.345 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-01-25T15:04:46.345 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-01-25T15:04:46.345 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.345 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.345 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.345 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.345 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.345 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.345 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.346 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.346 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.346 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.346 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.346 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_NFS": { 2024-01-25T15:04:46.346 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-01-25T15:04:46.346 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.346 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.346 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.346 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.346 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.346 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.346 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.346 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.347 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.347 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.347 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.347 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_RBD": { 2024-01-25T15:04:46.347 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-01-25T15:04:46.347 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.347 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.347 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.347 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.347 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.347 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.347 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.347 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.348 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.348 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.348 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.348 INFO:teuthology.orchestra.run.smithi170.stdout: "FEATURE_TOGGLE_RGW": { 2024-01-25T15:04:46.348 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-01-25T15:04:46.348 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.348 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.348 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.348 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.348 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.348 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.348 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.348 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.349 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.349 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.349 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.349 INFO:teuthology.orchestra.run.smithi170.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-01-25T15:04:46.349 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-01-25T15:04:46.349 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.349 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.349 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.349 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.349 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.349 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.349 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.349 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.349 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.350 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.350 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.350 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_API_PASSWORD": { 2024-01-25T15:04:46.350 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_API_PASSWORD", 2024-01-25T15:04:46.350 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.350 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.350 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.350 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "admin", 2024-01-25T15:04:46.350 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.350 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.350 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.350 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.350 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.350 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.351 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.351 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-01-25T15:04:46.351 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-01-25T15:04:46.351 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.351 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.351 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.351 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.351 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.351 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.351 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.351 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.351 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.351 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.352 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.352 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_API_URL": { 2024-01-25T15:04:46.352 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_API_URL", 2024-01-25T15:04:46.352 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.352 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.352 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.352 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.352 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.352 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.352 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.352 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.352 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.352 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.353 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.353 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_API_USERNAME": { 2024-01-25T15:04:46.353 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_API_USERNAME", 2024-01-25T15:04:46.353 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.353 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.353 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.353 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "admin", 2024-01-25T15:04:46.353 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.353 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.353 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.353 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.353 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.353 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.354 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.354 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-01-25T15:04:46.354 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-01-25T15:04:46.354 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.354 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.354 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.354 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.354 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.354 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.354 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.354 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.354 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.354 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.354 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.355 INFO:teuthology.orchestra.run.smithi170.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-01-25T15:04:46.355 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-01-25T15:04:46.355 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.355 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.355 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.355 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.355 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.355 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.355 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.355 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.355 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.355 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.355 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.356 INFO:teuthology.orchestra.run.smithi170.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-01-25T15:04:46.356 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-01-25T15:04:46.356 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.356 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.356 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.356 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.356 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.356 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.356 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.356 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.356 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.356 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.356 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.357 INFO:teuthology.orchestra.run.smithi170.stdout: "ISSUE_TRACKER_API_KEY": { 2024-01-25T15:04:46.357 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-01-25T15:04:46.357 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.357 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.357 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.357 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.357 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.357 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.357 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.357 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.357 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.357 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.357 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.358 INFO:teuthology.orchestra.run.smithi170.stdout: "PROMETHEUS_API_HOST": { 2024-01-25T15:04:46.358 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PROMETHEUS_API_HOST", 2024-01-25T15:04:46.358 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.358 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.358 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.358 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.358 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.358 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.358 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.358 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.358 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.358 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.358 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.359 INFO:teuthology.orchestra.run.smithi170.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-01-25T15:04:46.359 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-01-25T15:04:46.359 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.359 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.359 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.359 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.359 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.359 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.359 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.359 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.359 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.359 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.359 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.359 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-01-25T15:04:46.360 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-01-25T15:04:46.360 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.360 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.360 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.360 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.360 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.360 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.360 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.360 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.360 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.360 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.360 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.360 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-01-25T15:04:46.361 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-01-25T15:04:46.361 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.361 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.361 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.361 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.361 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.361 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.361 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.361 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.361 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.361 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.361 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.361 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-01-25T15:04:46.362 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-01-25T15:04:46.362 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.362 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.362 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.362 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.362 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.362 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.362 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.362 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.362 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.362 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.362 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.362 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-01-25T15:04:46.362 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-01-25T15:04:46.363 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.363 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.363 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.363 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.363 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.363 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.363 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.363 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.363 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.363 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.363 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.363 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-01-25T15:04:46.363 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-01-25T15:04:46.363 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-01-25T15:04:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-01-25T15:04:46.365 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.365 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.365 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.365 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.365 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.365 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.365 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.365 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.365 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.365 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.365 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.365 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-01-25T15:04:46.365 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-01-25T15:04:46.365 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.366 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.366 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.366 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.366 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.366 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.366 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.366 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.366 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.366 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.366 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.366 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_ENABLED": { 2024-01-25T15:04:46.366 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_ENABLED", 2024-01-25T15:04:46.366 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.366 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.367 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.367 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.367 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.367 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.367 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.367 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.367 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.367 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.367 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.367 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-01-25T15:04:46.367 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-01-25T15:04:46.367 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.368 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.368 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.368 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-01-25T15:04:46.368 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.368 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.368 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.368 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.368 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.368 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.368 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.368 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-01-25T15:04:46.368 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-01-25T15:04:46.368 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.369 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.369 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.369 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:46.369 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.369 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.369 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.369 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.369 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.369 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.369 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.369 INFO:teuthology.orchestra.run.smithi170.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-01-25T15:04:46.369 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-01-25T15:04:46.369 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.369 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.370 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.370 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "8", 2024-01-25T15:04:46.370 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.370 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.370 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.370 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.370 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.370 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.370 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.370 INFO:teuthology.orchestra.run.smithi170.stdout: "REST_REQUESTS_TIMEOUT": { 2024-01-25T15:04:46.370 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-01-25T15:04:46.370 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.370 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.371 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.371 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "45", 2024-01-25T15:04:46.371 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.371 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.371 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.371 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.371 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.371 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.371 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.371 INFO:teuthology.orchestra.run.smithi170.stdout: "RGW_API_ACCESS_KEY": { 2024-01-25T15:04:46.371 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "RGW_API_ACCESS_KEY", 2024-01-25T15:04:46.371 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.371 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.372 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.372 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.372 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.372 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.372 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.372 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.372 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.372 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.372 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.372 INFO:teuthology.orchestra.run.smithi170.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-01-25T15:04:46.372 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-01-25T15:04:46.372 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.372 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.373 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.373 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "admin", 2024-01-25T15:04:46.373 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.373 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.373 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.373 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.373 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.373 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.373 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.373 INFO:teuthology.orchestra.run.smithi170.stdout: "RGW_API_SECRET_KEY": { 2024-01-25T15:04:46.373 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "RGW_API_SECRET_KEY", 2024-01-25T15:04:46.373 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.373 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.374 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.374 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.374 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.374 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.374 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.374 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.374 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.374 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.374 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.374 INFO:teuthology.orchestra.run.smithi170.stdout: "RGW_API_SSL_VERIFY": { 2024-01-25T15:04:46.374 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "RGW_API_SSL_VERIFY", 2024-01-25T15:04:46.374 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.374 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.375 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.375 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.375 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.375 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.375 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.375 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.375 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.375 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.375 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.375 INFO:teuthology.orchestra.run.smithi170.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-01-25T15:04:46.375 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-01-25T15:04:46.375 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.375 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.375 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.376 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0", 2024-01-25T15:04:46.376 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.376 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.376 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.376 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.376 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.376 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.376 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.376 INFO:teuthology.orchestra.run.smithi170.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-01-25T15:04:46.376 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-01-25T15:04:46.376 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.376 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.376 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.377 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:46.377 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.377 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.377 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.377 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.377 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.377 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.377 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.378 INFO:teuthology.orchestra.run.smithi170.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-01-25T15:04:46.378 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-01-25T15:04:46.378 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.378 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.378 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.378 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "5", 2024-01-25T15:04:46.378 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.378 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.378 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.379 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.379 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.379 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.379 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.379 INFO:teuthology.orchestra.run.smithi170.stdout: "cross_origin_url": { 2024-01-25T15:04:46.379 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "cross_origin_url", 2024-01-25T15:04:46.379 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.379 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.379 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.379 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.379 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.379 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.379 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.379 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.380 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.380 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.380 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.380 INFO:teuthology.orchestra.run.smithi170.stdout: "crt_file": { 2024-01-25T15:04:46.380 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "crt_file", 2024-01-25T15:04:46.380 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.380 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.380 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.380 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.380 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.380 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.380 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.381 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.381 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.381 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.381 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.381 INFO:teuthology.orchestra.run.smithi170.stdout: "debug": { 2024-01-25T15:04:46.381 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "debug", 2024-01-25T15:04:46.381 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.381 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.381 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.381 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.381 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.381 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.381 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.382 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Enable/disable debug options", 2024-01-25T15:04:46.382 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.382 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.382 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.382 INFO:teuthology.orchestra.run.smithi170.stdout: "jwt_token_ttl": { 2024-01-25T15:04:46.382 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "jwt_token_ttl", 2024-01-25T15:04:46.382 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.382 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.382 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.382 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "28800", 2024-01-25T15:04:46.382 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.382 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.382 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.382 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.383 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.383 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.383 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.383 INFO:teuthology.orchestra.run.smithi170.stdout: "key_file": { 2024-01-25T15:04:46.383 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "key_file", 2024-01-25T15:04:46.383 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.383 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.383 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.383 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.383 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.383 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.383 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.383 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.384 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.384 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.384 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.384 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.384 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.384 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.384 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.384 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.384 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.384 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.384 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.384 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.385 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.385 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.385 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.385 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.385 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.385 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.385 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.385 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.385 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.385 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.385 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.385 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.385 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.386 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.386 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.386 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.386 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.386 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.386 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.386 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.386 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.386 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.386 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.386 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.386 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.386 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.386 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.387 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.387 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.387 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.387 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.387 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.387 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.387 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.387 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.387 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.387 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.387 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.387 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.387 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.387 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.388 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.388 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.388 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.388 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.388 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.388 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.388 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.388 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.388 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.388 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.388 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.388 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.388 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.389 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.389 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.389 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.389 INFO:teuthology.orchestra.run.smithi170.stdout: "motd": { 2024-01-25T15:04:46.389 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "motd", 2024-01-25T15:04:46.389 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.389 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.389 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.389 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.389 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.389 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.389 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.389 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "The message of the day", 2024-01-25T15:04:46.390 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.390 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.390 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.390 INFO:teuthology.orchestra.run.smithi170.stdout: "redirect_resolve_ip_addr": { 2024-01-25T15:04:46.390 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "redirect_resolve_ip_addr", 2024-01-25T15:04:46.390 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.390 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.390 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.390 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.390 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.390 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.390 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.390 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.391 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.391 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.391 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.391 INFO:teuthology.orchestra.run.smithi170.stdout: "server_addr": { 2024-01-25T15:04:46.391 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_addr", 2024-01-25T15:04:46.391 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.391 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.391 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.391 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "::", 2024-01-25T15:04:46.391 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.391 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.391 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.391 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.391 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.392 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.392 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.392 INFO:teuthology.orchestra.run.smithi170.stdout: "server_port": { 2024-01-25T15:04:46.392 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_port", 2024-01-25T15:04:46.392 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.392 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.392 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.392 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "8080", 2024-01-25T15:04:46.392 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.392 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.392 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.392 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.393 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.393 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.393 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.393 INFO:teuthology.orchestra.run.smithi170.stdout: "ssl": { 2024-01-25T15:04:46.393 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ssl", 2024-01-25T15:04:46.393 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.393 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.393 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.393 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.393 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.393 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.393 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.393 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.394 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.394 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.394 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.394 INFO:teuthology.orchestra.run.smithi170.stdout: "ssl_server_port": { 2024-01-25T15:04:46.394 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ssl_server_port", 2024-01-25T15:04:46.394 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.394 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.394 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.394 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "8443", 2024-01-25T15:04:46.394 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.394 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.394 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.395 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.395 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.395 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.395 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.395 INFO:teuthology.orchestra.run.smithi170.stdout: "standby_behaviour": { 2024-01-25T15:04:46.395 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "standby_behaviour", 2024-01-25T15:04:46.395 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.395 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.395 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.395 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "redirect", 2024-01-25T15:04:46.395 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.395 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.395 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.396 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.396 INFO:teuthology.orchestra.run.smithi170.stdout: "redirect" 2024-01-25T15:04:46.396 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.396 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.396 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.396 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.396 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.396 INFO:teuthology.orchestra.run.smithi170.stdout: "standby_error_status_code": { 2024-01-25T15:04:46.396 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "standby_error_status_code", 2024-01-25T15:04:46.396 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.396 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.396 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.396 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "500", 2024-01-25T15:04:46.397 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "400", 2024-01-25T15:04:46.397 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "599", 2024-01-25T15:04:46.397 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.397 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.397 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.397 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.397 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.397 INFO:teuthology.orchestra.run.smithi170.stdout: "url_prefix": { 2024-01-25T15:04:46.397 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "url_prefix", 2024-01-25T15:04:46.397 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.397 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.397 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.397 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.398 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.398 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.398 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.398 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.398 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.398 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.398 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.398 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.398 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.398 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "devicehealth", 2024-01-25T15:04:46.398 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.398 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.398 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.399 INFO:teuthology.orchestra.run.smithi170.stdout: "enable_monitoring": { 2024-01-25T15:04:46.399 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "enable_monitoring", 2024-01-25T15:04:46.399 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.399 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.399 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.399 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.399 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.399 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.399 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.399 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "monitor device health metrics", 2024-01-25T15:04:46.399 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.399 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.399 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.400 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.400 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.400 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.400 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.400 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.400 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.400 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.400 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.400 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.400 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.400 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.400 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.400 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.401 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.401 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.401 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.401 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.401 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.401 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.401 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.401 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.401 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.401 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.401 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.401 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.401 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.401 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.402 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.402 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.402 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.402 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.402 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.402 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.402 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.402 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.402 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.402 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.402 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.402 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.402 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.402 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.403 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.403 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.403 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.403 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.403 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.403 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.403 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.403 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.403 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.403 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.403 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.403 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.403 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.404 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.404 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.404 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.404 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.404 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.404 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.404 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.404 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.404 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.404 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.404 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.404 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.404 INFO:teuthology.orchestra.run.smithi170.stdout: "mark_out_threshold": { 2024-01-25T15:04:46.405 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mark_out_threshold", 2024-01-25T15:04:46.405 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.405 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.405 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.405 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "2419200", 2024-01-25T15:04:46.405 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.405 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.405 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.405 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-01-25T15:04:46.405 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.405 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.405 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.405 INFO:teuthology.orchestra.run.smithi170.stdout: "pool_name": { 2024-01-25T15:04:46.406 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "pool_name", 2024-01-25T15:04:46.406 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.406 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.406 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.406 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "device_health_metrics", 2024-01-25T15:04:46.406 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.406 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.406 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.406 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "name of pool in which to store device health metrics", 2024-01-25T15:04:46.406 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.406 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.406 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.406 INFO:teuthology.orchestra.run.smithi170.stdout: "retention_period": { 2024-01-25T15:04:46.407 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "retention_period", 2024-01-25T15:04:46.407 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.407 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.407 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.407 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "15552000", 2024-01-25T15:04:46.407 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.407 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.407 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.407 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how long to retain device health metrics", 2024-01-25T15:04:46.407 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.407 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.407 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.407 INFO:teuthology.orchestra.run.smithi170.stdout: "scrape_frequency": { 2024-01-25T15:04:46.408 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "scrape_frequency", 2024-01-25T15:04:46.408 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.408 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.408 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.408 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "86400", 2024-01-25T15:04:46.408 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.408 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.408 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.408 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how frequently to scrape device health metrics", 2024-01-25T15:04:46.408 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.408 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.408 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.409 INFO:teuthology.orchestra.run.smithi170.stdout: "self_heal": { 2024-01-25T15:04:46.409 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "self_heal", 2024-01-25T15:04:46.409 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.409 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.409 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.409 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.409 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.409 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.409 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.409 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-01-25T15:04:46.409 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.409 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.409 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.409 INFO:teuthology.orchestra.run.smithi170.stdout: "sleep_interval": { 2024-01-25T15:04:46.410 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "sleep_interval", 2024-01-25T15:04:46.410 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.410 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.410 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.410 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "600", 2024-01-25T15:04:46.410 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.410 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.410 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.410 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how frequently to wake up and check device health", 2024-01-25T15:04:46.410 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.410 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.410 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.410 INFO:teuthology.orchestra.run.smithi170.stdout: "warn_threshold": { 2024-01-25T15:04:46.410 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "warn_threshold", 2024-01-25T15:04:46.411 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.411 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.411 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.411 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "7257600", 2024-01-25T15:04:46.411 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.411 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.411 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.411 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-01-25T15:04:46.411 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.411 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.411 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.411 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.411 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.412 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "diskprediction_local", 2024-01-25T15:04:46.412 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.412 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.412 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.412 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.412 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.412 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.412 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.412 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.412 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.412 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.412 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.412 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.413 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.413 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.413 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.413 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.413 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.413 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.413 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.413 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.413 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.413 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.413 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.413 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.413 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.413 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.414 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.414 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.414 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.414 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.414 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.414 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.414 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.414 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.414 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.414 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.414 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.414 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.414 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.415 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.415 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.415 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.415 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.415 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.415 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.415 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.415 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.415 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.415 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.415 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.415 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.415 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.415 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.415 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.416 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.416 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.416 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.416 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.416 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.416 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.416 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.416 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.416 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.416 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.416 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.416 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.416 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.417 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.417 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.417 INFO:teuthology.orchestra.run.smithi170.stdout: "predict_interval": { 2024-01-25T15:04:46.417 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "predict_interval", 2024-01-25T15:04:46.417 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.417 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.417 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.417 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "86400", 2024-01-25T15:04:46.417 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.417 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.417 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.417 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.417 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: "predictor_model": { 2024-01-25T15:04:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "predictor_model", 2024-01-25T15:04:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "prophetstor", 2024-01-25T15:04:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.418 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.419 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.419 INFO:teuthology.orchestra.run.smithi170.stdout: "sleep_interval": { 2024-01-25T15:04:46.419 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "sleep_interval", 2024-01-25T15:04:46.419 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.419 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.419 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.419 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "600", 2024-01-25T15:04:46.419 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.419 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.419 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.419 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.419 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.419 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.420 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.420 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.420 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.420 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "influx", 2024-01-25T15:04:46.420 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": false, 2024-01-25T15:04:46.420 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "influxdb python module not found", 2024-01-25T15:04:46.420 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.420 INFO:teuthology.orchestra.run.smithi170.stdout: "batch_size": { 2024-01-25T15:04:46.420 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "batch_size", 2024-01-25T15:04:46.420 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.420 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.420 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.421 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "5000", 2024-01-25T15:04:46.421 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.421 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.421 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.421 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-01-25T15:04:46.421 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.421 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.421 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.421 INFO:teuthology.orchestra.run.smithi170.stdout: "database": { 2024-01-25T15:04:46.421 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "database", 2024-01-25T15:04:46.421 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.421 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.421 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.422 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "ceph", 2024-01-25T15:04:46.422 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.422 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.422 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.422 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-01-25T15:04:46.422 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.422 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.422 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.422 INFO:teuthology.orchestra.run.smithi170.stdout: "hostname": { 2024-01-25T15:04:46.422 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "hostname", 2024-01-25T15:04:46.422 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.422 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.422 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.423 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.423 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.423 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.423 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.423 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "InfluxDB server hostname", 2024-01-25T15:04:46.423 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.423 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.423 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.423 INFO:teuthology.orchestra.run.smithi170.stdout: "interval": { 2024-01-25T15:04:46.423 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "interval", 2024-01-25T15:04:46.423 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.423 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.423 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.423 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "30", 2024-01-25T15:04:46.424 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "5", 2024-01-25T15:04:46.424 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.424 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.424 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-01-25T15:04:46.424 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.424 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.424 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.424 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.424 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.424 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.424 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.424 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.424 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.425 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.425 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.425 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.425 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.425 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.425 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.425 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.425 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.425 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.425 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.425 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.425 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.425 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.425 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.426 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.426 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.426 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.426 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.426 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.426 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.426 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.426 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.426 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.426 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.426 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.426 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.426 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.427 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.427 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.427 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.427 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.427 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.427 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.427 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.427 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.427 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.427 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.427 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.427 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.427 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.427 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.428 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.428 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.428 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.428 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.428 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.428 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.428 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.428 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.428 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.428 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.428 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.428 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.429 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.429 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.429 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.429 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.429 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.429 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.429 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.429 INFO:teuthology.orchestra.run.smithi170.stdout: "password": { 2024-01-25T15:04:46.429 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "password", 2024-01-25T15:04:46.429 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.429 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.429 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.429 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.429 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.430 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.430 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.430 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "password of InfluxDB server user", 2024-01-25T15:04:46.430 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.430 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.430 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.430 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.430 INFO:teuthology.orchestra.run.smithi170.stdout: "port": { 2024-01-25T15:04:46.430 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "port", 2024-01-25T15:04:46.430 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.430 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.430 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.430 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "8086", 2024-01-25T15:04:46.430 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.430 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.431 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.431 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "InfluxDB server port", 2024-01-25T15:04:46.431 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.431 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.431 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.431 INFO:teuthology.orchestra.run.smithi170.stdout: "ssl": { 2024-01-25T15:04:46.431 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ssl", 2024-01-25T15:04:46.431 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.431 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.431 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.431 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "false", 2024-01-25T15:04:46.431 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.431 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.432 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.432 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-01-25T15:04:46.432 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.432 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.432 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.432 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.432 INFO:teuthology.orchestra.run.smithi170.stdout: "threads": { 2024-01-25T15:04:46.432 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "threads", 2024-01-25T15:04:46.432 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.432 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.432 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.432 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "5", 2024-01-25T15:04:46.432 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "1", 2024-01-25T15:04:46.433 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "32", 2024-01-25T15:04:46.433 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.433 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-01-25T15:04:46.433 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.433 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.433 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.433 INFO:teuthology.orchestra.run.smithi170.stdout: "username": { 2024-01-25T15:04:46.433 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "username", 2024-01-25T15:04:46.433 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.433 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.434 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.434 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.434 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.434 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.434 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.434 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "username of InfluxDB server user", 2024-01-25T15:04:46.434 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.434 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.434 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.434 INFO:teuthology.orchestra.run.smithi170.stdout: "verify_ssl": { 2024-01-25T15:04:46.434 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "verify_ssl", 2024-01-25T15:04:46.434 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.435 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.435 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.435 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "true", 2024-01-25T15:04:46.435 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.435 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.435 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.435 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-01-25T15:04:46.435 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.435 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.435 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.435 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.435 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.435 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "insights", 2024-01-25T15:04:46.436 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.436 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.436 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.436 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.436 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.436 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.436 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.436 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.436 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.436 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.436 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.436 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.436 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.437 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.437 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.437 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.437 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.437 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.437 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.437 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.437 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.437 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.437 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.437 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.437 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.437 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.438 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.438 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.438 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.438 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.438 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.438 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.438 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.438 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.438 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.438 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.438 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.438 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.438 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.439 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.439 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.439 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.439 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.439 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.439 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.439 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.439 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.439 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.439 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.439 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.439 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.439 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.439 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.440 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.440 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.440 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.440 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.440 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.440 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.440 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.440 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.440 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.440 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.440 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.440 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.440 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.441 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.441 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.441 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.441 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.441 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.441 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "iostat", 2024-01-25T15:04:46.441 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.441 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.441 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.441 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.441 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.441 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.442 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.442 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.442 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.442 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.442 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.442 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.442 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.442 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.442 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.442 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.442 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.442 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.442 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.442 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.442 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.443 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.443 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.443 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.443 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.443 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.443 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.443 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.443 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.443 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.443 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.443 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.443 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.443 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.444 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.444 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.444 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.444 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.444 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.444 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.444 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.444 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.444 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.444 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.444 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.444 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.444 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.445 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.445 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.445 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.445 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.445 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.445 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.445 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.445 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.445 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.445 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.445 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.445 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.446 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.446 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.446 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.446 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.446 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.446 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.446 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.446 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.446 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.446 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.446 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.446 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.446 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "k8sevents", 2024-01-25T15:04:46.447 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.447 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.447 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.447 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_event_retention_days": { 2024-01-25T15:04:46.447 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "ceph_event_retention_days", 2024-01-25T15:04:46.447 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.447 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.447 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.447 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "7", 2024-01-25T15:04:46.447 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.447 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.447 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.447 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Days to hold ceph event information within local cache", 2024-01-25T15:04:46.447 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.447 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.448 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.448 INFO:teuthology.orchestra.run.smithi170.stdout: "config_check_secs": { 2024-01-25T15:04:46.448 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "config_check_secs", 2024-01-25T15:04:46.448 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.448 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.448 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.448 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:46.448 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "10", 2024-01-25T15:04:46.448 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.448 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.448 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-01-25T15:04:46.448 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.449 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.449 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.449 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.449 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.449 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.449 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.449 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.449 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.449 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.449 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.449 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.449 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.449 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.449 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.450 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.450 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.450 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.450 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.450 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.450 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.450 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.450 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.450 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.450 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.450 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.450 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.450 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.451 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.451 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.451 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.451 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.451 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.451 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.451 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.451 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.451 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.451 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.451 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.451 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.451 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.452 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.452 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.452 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.452 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.452 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.452 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.452 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.452 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.452 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.452 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.452 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.452 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.452 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.453 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.453 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.453 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.453 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.453 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.453 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.453 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.453 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.453 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.453 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.453 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.453 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.453 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.454 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.454 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.454 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.454 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.454 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "localpool", 2024-01-25T15:04:46.454 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.454 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.454 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.454 INFO:teuthology.orchestra.run.smithi170.stdout: "failure_domain": { 2024-01-25T15:04:46.454 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "failure_domain", 2024-01-25T15:04:46.454 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.454 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.454 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.455 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "host", 2024-01-25T15:04:46.455 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.455 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.455 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.455 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "failure domain for any created local pool", 2024-01-25T15:04:46.455 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-01-25T15:04:46.455 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.455 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.455 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.455 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.455 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.455 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.455 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.456 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.456 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.456 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.456 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.456 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.456 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.456 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.456 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.456 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.456 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.456 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.456 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.456 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.457 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.457 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.457 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.457 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.457 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.457 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.457 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.457 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.457 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.457 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.457 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.457 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.457 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.458 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.458 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.458 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.458 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.458 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.458 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.458 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.458 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.458 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.458 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.458 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.458 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.458 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.458 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.459 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.459 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.459 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.459 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.459 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.459 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.459 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.459 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.459 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.459 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.459 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.459 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.459 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.459 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.460 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.460 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.460 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.460 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.460 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.460 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.460 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.460 INFO:teuthology.orchestra.run.smithi170.stdout: "min_size": { 2024-01-25T15:04:46.460 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "min_size", 2024-01-25T15:04:46.460 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.460 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.460 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.460 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.461 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.461 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.461 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.461 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "default min_size for any created local pool", 2024-01-25T15:04:46.461 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-01-25T15:04:46.461 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.461 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.461 INFO:teuthology.orchestra.run.smithi170.stdout: "num_rep": { 2024-01-25T15:04:46.461 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "num_rep", 2024-01-25T15:04:46.461 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.461 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.461 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.461 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "3", 2024-01-25T15:04:46.461 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.462 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.462 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.462 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "default replica count for any created local pool", 2024-01-25T15:04:46.462 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.462 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.462 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.462 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_num": { 2024-01-25T15:04:46.462 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "pg_num", 2024-01-25T15:04:46.462 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.462 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.462 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.462 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "128", 2024-01-25T15:04:46.462 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.462 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.463 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.463 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "default pg_num for any created local pool", 2024-01-25T15:04:46.463 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.463 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.463 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.463 INFO:teuthology.orchestra.run.smithi170.stdout: "prefix": { 2024-01-25T15:04:46.463 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "prefix", 2024-01-25T15:04:46.463 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.463 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.463 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.463 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.463 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.463 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.464 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.464 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "name prefix for any created local pool", 2024-01-25T15:04:46.464 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.464 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.464 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.464 INFO:teuthology.orchestra.run.smithi170.stdout: "subtree": { 2024-01-25T15:04:46.464 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "subtree", 2024-01-25T15:04:46.464 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.464 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.464 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.464 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "rack", 2024-01-25T15:04:46.464 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "CRUSH level for which to create a local pool", 2024-01-25T15:04:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-01-25T15:04:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mds_autoscaler", 2024-01-25T15:04:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mirroring", 2024-01-25T15:04:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "nfs", 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "orchestrator", 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "fail_fs": { 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "fail_fs", 2024-01-25T15:04:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "orchestrator": { 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "orchestrator", 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "cephadm", 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "rook", 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "test_orchestrator" 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Orchestrator backend", 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "osd_perf_query", 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "osd_support", 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "pg_autoscaler", 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "sleep_interval": { 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "sleep_interval", 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "60", 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "threshold": { 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "threshold", 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "3.0", 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "1.0", 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "scaling threshold", 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "progress", 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "allow_pg_recovery_event": { 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "allow_pg_recovery_event", 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "allow the module to show pg recovery progress", 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "enabled": { 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "enabled", 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "max_completed_events": { 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "max_completed_events", 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "50", 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "number of past completed events to remember", 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "sleep_interval": { 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "sleep_interval", 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "5", 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "how long the module is going to sleep", 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "prometheus", 2024-01-25T15:04:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "cache": { 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "cache", 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "exclude_perf_counters": { 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "exclude_perf_counters", 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-01-25T15:04:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "rbd_stats_pools": { 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rbd_stats_pools", 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "rbd_stats_pools_refresh_interval": { 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "300", 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "scrape_interval": { 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "scrape_interval", 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "15.0", 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "server_addr": { 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_addr", 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "::", 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "server_port": { 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_port", 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "9283", 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "stale_cache_strategy": { 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "stale_cache_strategy", 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "log", 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "standby_behaviour": { 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "standby_behaviour", 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "default", 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "default", 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "error" 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "standby_error_status_code": { 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "standby_error_status_code", 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "500", 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "400", 2024-01-25T15:04:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "599", 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rbd_support", 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "max_concurrent_snap_create": { 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "max_concurrent_snap_create", 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10", 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "mirror_snapshot_schedule": { 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "mirror_snapshot_schedule", 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "trash_purge_schedule": { 2024-01-25T15:04:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "trash_purge_schedule", 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "restful", 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "enable_auth": { 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "enable_auth", 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "key_file": { 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "key_file", 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.547 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.548 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: "server_addr": { 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_addr", 2024-01-25T15:04:46.549 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: "server_port": { 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "server_port", 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.550 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rgw", 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.551 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.552 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.553 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.554 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.554 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.554 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.554 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.554 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.554 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.554 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.554 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.554 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.554 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.554 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.554 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.555 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.556 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rook", 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi170.stdout: "drive_group_interval": { 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "drive_group_interval", 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.557 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "300.0", 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.558 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.559 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.560 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.561 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.562 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi170.stdout: "storage_class": { 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "storage_class", 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.563 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "local", 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "selftest", 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.564 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.565 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.566 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.567 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.568 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.569 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.569 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.569 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.569 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.569 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.569 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.569 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.569 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.569 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.569 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.569 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.569 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.569 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.570 INFO:teuthology.orchestra.run.smithi170.stdout: "roption1": { 2024-01-25T15:04:46.570 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "roption1", 2024-01-25T15:04:46.570 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.570 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.570 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.570 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.570 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.570 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.570 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.570 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.570 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.570 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.570 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.571 INFO:teuthology.orchestra.run.smithi170.stdout: "roption2": { 2024-01-25T15:04:46.571 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "roption2", 2024-01-25T15:04:46.571 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.571 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.571 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.571 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "xyz", 2024-01-25T15:04:46.571 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.571 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.571 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.571 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.571 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.571 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.571 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.572 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption1": { 2024-01-25T15:04:46.572 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption1", 2024-01-25T15:04:46.572 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.572 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.572 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.572 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.572 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.572 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.572 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.572 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.572 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.572 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.572 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption2": { 2024-01-25T15:04:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption2", 2024-01-25T15:04:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.573 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption3": { 2024-01-25T15:04:46.574 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption3", 2024-01-25T15:04:46.574 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "float", 2024-01-25T15:04:46.574 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.574 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.574 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.574 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.574 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.574 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.574 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.574 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.574 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.575 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.575 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption4": { 2024-01-25T15:04:46.575 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption4", 2024-01-25T15:04:46.575 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.575 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.575 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.575 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.575 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.575 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.575 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.575 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.576 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.576 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.576 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.576 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption5": { 2024-01-25T15:04:46.576 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption5", 2024-01-25T15:04:46.576 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.576 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.576 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.576 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.576 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.576 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.576 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.576 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.577 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.577 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.577 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.577 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption6": { 2024-01-25T15:04:46.577 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption6", 2024-01-25T15:04:46.577 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.577 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.577 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.577 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.577 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.577 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.577 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.577 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.577 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.578 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.578 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.578 INFO:teuthology.orchestra.run.smithi170.stdout: "rwoption7": { 2024-01-25T15:04:46.578 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rwoption7", 2024-01-25T15:04:46.578 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.578 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.578 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.578 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.578 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "1", 2024-01-25T15:04:46.578 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "42", 2024-01-25T15:04:46.578 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.578 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.578 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.578 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.579 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.579 INFO:teuthology.orchestra.run.smithi170.stdout: "testkey": { 2024-01-25T15:04:46.579 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "testkey", 2024-01-25T15:04:46.579 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.579 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.579 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.579 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.579 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.579 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.579 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.579 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.579 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.579 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.580 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.580 INFO:teuthology.orchestra.run.smithi170.stdout: "testlkey": { 2024-01-25T15:04:46.580 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "testlkey", 2024-01-25T15:04:46.580 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.580 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.580 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.580 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.580 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.580 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.580 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.580 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.580 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.580 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.581 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.581 INFO:teuthology.orchestra.run.smithi170.stdout: "testnewline": { 2024-01-25T15:04:46.581 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "testnewline", 2024-01-25T15:04:46.581 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.581 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.581 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.581 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.581 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.581 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.581 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.581 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.581 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.581 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.582 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.582 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.582 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.582 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "snap_schedule", 2024-01-25T15:04:46.582 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.582 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.582 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.582 INFO:teuthology.orchestra.run.smithi170.stdout: "allow_m_granularity": { 2024-01-25T15:04:46.582 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "allow_m_granularity", 2024-01-25T15:04:46.582 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.582 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.582 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.582 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.583 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.583 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.583 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.583 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "allow minute scheduled snapshots", 2024-01-25T15:04:46.583 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.583 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.583 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.583 INFO:teuthology.orchestra.run.smithi170.stdout: "dump_on_update": { 2024-01-25T15:04:46.583 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "dump_on_update", 2024-01-25T15:04:46.583 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.583 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.583 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.583 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.584 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.584 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.584 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.584 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "dump database to debug log on update", 2024-01-25T15:04:46.584 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.584 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.584 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.584 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.584 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.584 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.584 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.584 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.585 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.585 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.585 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.585 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.585 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.585 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.585 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.585 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.585 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.585 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.585 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.585 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.585 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.585 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.585 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.586 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.586 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.586 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.586 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.586 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.586 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.586 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.586 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.586 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.586 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.586 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.586 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.586 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.587 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.587 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.587 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.587 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.587 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.587 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.587 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.587 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.587 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.587 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.587 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.587 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.587 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.587 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.588 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.588 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.588 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.588 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.588 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.588 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.588 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.588 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.588 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.588 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.588 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.588 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.589 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.589 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.589 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.589 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.589 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.589 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.589 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.589 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.589 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.589 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "stats", 2024-01-25T15:04:46.589 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.589 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.590 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.590 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.590 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.590 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.590 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.590 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.590 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.590 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.590 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.590 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.590 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.590 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.590 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.590 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.591 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.591 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.591 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.591 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.591 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.591 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.591 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.591 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.591 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.591 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.591 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.591 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.592 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.592 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.592 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.592 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.592 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.592 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.592 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.592 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.592 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.592 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.592 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.592 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.592 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.593 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.593 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.593 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.593 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.593 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.593 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.593 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.593 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.593 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.593 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.593 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.593 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.593 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.593 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.594 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.594 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.594 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.594 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.594 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.594 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.594 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.594 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.594 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.594 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.594 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.594 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.595 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.595 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.595 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.595 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.595 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "status", 2024-01-25T15:04:46.595 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.595 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.595 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.595 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.595 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.595 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.595 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.595 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.596 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.596 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.596 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.596 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.596 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.596 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.596 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.596 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.596 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.596 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.596 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.596 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.596 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.596 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.596 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.597 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.598 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.599 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.600 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.600 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.600 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.600 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "telegraf", 2024-01-25T15:04:46.600 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.600 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.600 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.600 INFO:teuthology.orchestra.run.smithi170.stdout: "address": { 2024-01-25T15:04:46.600 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "address", 2024-01-25T15:04:46.600 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.600 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.600 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.600 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: "interval": { 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "interval", 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "15", 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.601 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.602 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.602 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.602 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.602 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.602 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.602 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.602 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.602 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.602 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.602 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.602 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.602 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.602 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.603 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.603 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.603 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.603 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.603 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.603 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.603 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.603 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.603 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.603 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.603 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.603 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.603 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.604 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.604 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.604 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.604 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.604 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.604 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.604 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.604 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.604 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.604 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.604 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.604 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.605 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.605 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.605 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.605 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.605 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.605 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.605 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.605 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.605 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.605 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.605 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.605 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.605 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.606 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.606 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.606 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.606 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.606 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.606 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.606 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.606 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.606 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.606 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.606 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.606 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.606 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.606 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.607 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.607 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.607 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.607 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.607 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.607 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.607 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.607 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.607 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "telemetry", 2024-01-25T15:04:46.607 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.607 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.607 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.608 INFO:teuthology.orchestra.run.smithi170.stdout: "channel_basic": { 2024-01-25T15:04:46.608 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "channel_basic", 2024-01-25T15:04:46.608 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.608 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.608 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.608 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.608 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.608 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.608 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.608 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Share basic cluster information (size, version)", 2024-01-25T15:04:46.608 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.608 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.608 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.609 INFO:teuthology.orchestra.run.smithi170.stdout: "channel_crash": { 2024-01-25T15:04:46.609 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "channel_crash", 2024-01-25T15:04:46.609 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.609 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.609 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.609 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.609 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.609 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.609 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.609 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-01-25T15:04:46.609 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.609 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.609 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.610 INFO:teuthology.orchestra.run.smithi170.stdout: "channel_device": { 2024-01-25T15:04:46.610 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "channel_device", 2024-01-25T15:04:46.610 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.610 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.610 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.610 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "True", 2024-01-25T15:04:46.610 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.610 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.610 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.610 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-01-25T15:04:46.610 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.610 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.610 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.611 INFO:teuthology.orchestra.run.smithi170.stdout: "channel_ident": { 2024-01-25T15:04:46.611 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "channel_ident", 2024-01-25T15:04:46.611 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.611 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.611 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.611 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.611 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.611 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.611 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.611 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-01-25T15:04:46.611 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.611 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.611 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.611 INFO:teuthology.orchestra.run.smithi170.stdout: "channel_perf": { 2024-01-25T15:04:46.612 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "channel_perf", 2024-01-25T15:04:46.612 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.612 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.612 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.612 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.612 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.612 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.612 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.612 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Share various performance metrics of a cluster", 2024-01-25T15:04:46.612 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.612 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.612 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.612 INFO:teuthology.orchestra.run.smithi170.stdout: "contact": { 2024-01-25T15:04:46.613 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "contact", 2024-01-25T15:04:46.613 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.613 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.613 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.613 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.613 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.613 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.613 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.613 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.613 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.613 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.613 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.613 INFO:teuthology.orchestra.run.smithi170.stdout: "description": { 2024-01-25T15:04:46.613 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "description", 2024-01-25T15:04:46.614 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.614 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.614 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.614 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.614 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.614 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.614 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.614 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.614 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.614 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.614 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.614 INFO:teuthology.orchestra.run.smithi170.stdout: "device_url": { 2024-01-25T15:04:46.614 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "device_url", 2024-01-25T15:04:46.614 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.615 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.615 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.615 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-01-25T15:04:46.615 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.615 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.615 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.615 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.615 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.615 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.615 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.615 INFO:teuthology.orchestra.run.smithi170.stdout: "enabled": { 2024-01-25T15:04:46.615 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "enabled", 2024-01-25T15:04:46.615 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.616 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.616 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.616 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.616 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.616 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.616 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.616 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.616 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.616 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.616 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.616 INFO:teuthology.orchestra.run.smithi170.stdout: "interval": { 2024-01-25T15:04:46.616 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "interval", 2024-01-25T15:04:46.616 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.617 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.617 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.617 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "24", 2024-01-25T15:04:46.617 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "8", 2024-01-25T15:04:46.617 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.617 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.617 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.617 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.617 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.617 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.617 INFO:teuthology.orchestra.run.smithi170.stdout: "last_opt_revision": { 2024-01-25T15:04:46.617 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "last_opt_revision", 2024-01-25T15:04:46.617 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.618 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.618 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.618 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "1", 2024-01-25T15:04:46.618 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.618 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.618 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.618 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.618 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.618 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.618 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.618 INFO:teuthology.orchestra.run.smithi170.stdout: "leaderboard": { 2024-01-25T15:04:46.618 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "leaderboard", 2024-01-25T15:04:46.618 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.618 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.619 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.619 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.619 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.619 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.619 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.619 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.619 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.619 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.619 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.619 INFO:teuthology.orchestra.run.smithi170.stdout: "leaderboard_description": { 2024-01-25T15:04:46.619 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "leaderboard_description", 2024-01-25T15:04:46.619 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.619 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.620 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.620 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.620 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.620 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.620 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.620 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.620 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.620 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.620 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.620 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.620 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.620 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.620 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.621 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.621 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.621 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.621 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.621 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.621 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.621 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.621 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.621 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.621 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.621 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.621 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.621 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.621 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.622 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.623 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.623 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.623 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.623 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.623 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.623 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.623 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.623 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.623 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.623 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.623 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.623 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.623 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.624 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.624 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.624 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.624 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.624 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.624 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.624 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.624 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.624 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.624 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.624 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.624 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.624 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: "organization": { 2024-01-25T15:04:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "organization", 2024-01-25T15:04:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.625 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: "proxy": { 2024-01-25T15:04:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "proxy", 2024-01-25T15:04:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.626 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.627 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.627 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.627 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.627 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.627 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.627 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.627 INFO:teuthology.orchestra.run.smithi170.stdout: "url": { 2024-01-25T15:04:46.627 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "url", 2024-01-25T15:04:46.627 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.627 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.627 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.627 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-01-25T15:04:46.627 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.627 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.628 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.628 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.628 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.628 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.628 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.628 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.628 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.628 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "test_orchestrator", 2024-01-25T15:04:46.628 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.628 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.628 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.629 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.629 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.629 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.629 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.629 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.629 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.629 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.629 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.629 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.629 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.629 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.629 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.629 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.629 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.629 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.630 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.630 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.630 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.630 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.630 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.630 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.630 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.630 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.630 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.630 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.630 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.630 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.630 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.631 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.631 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.631 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.631 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.631 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.631 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.631 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.631 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.631 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.631 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.631 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.631 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.631 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.632 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.632 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.632 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.632 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.632 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.632 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.632 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.632 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.632 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.632 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.632 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.632 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.632 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.633 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.633 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.633 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.633 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.633 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.633 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.633 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.633 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.633 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.633 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.633 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.633 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.633 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.633 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.634 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "volumes", 2024-01-25T15:04:46.634 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.634 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.634 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.634 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.634 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.634 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.634 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.634 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.634 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.634 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.634 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.634 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.635 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.635 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.635 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.635 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.635 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.635 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.635 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.635 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.635 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.635 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.635 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.635 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.636 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.636 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.636 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.636 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.636 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.636 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.636 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.636 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.636 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.636 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.636 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.636 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.636 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.637 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.637 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.637 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.637 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.637 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.637 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.637 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.637 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.637 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.637 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.637 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.637 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.637 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.637 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.638 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.639 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.639 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.639 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.639 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.639 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.639 INFO:teuthology.orchestra.run.smithi170.stdout: "max_concurrent_clones": { 2024-01-25T15:04:46.639 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "max_concurrent_clones", 2024-01-25T15:04:46.639 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.639 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.639 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.639 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "4", 2024-01-25T15:04:46.639 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.639 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.640 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.640 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Number of asynchronous cloner threads", 2024-01-25T15:04:46.640 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.640 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.640 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.640 INFO:teuthology.orchestra.run.smithi170.stdout: "periodic_async_work": { 2024-01-25T15:04:46.640 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "periodic_async_work", 2024-01-25T15:04:46.640 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.640 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.640 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.640 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.640 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.640 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.641 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.641 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Periodically check for async work", 2024-01-25T15:04:46.641 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.641 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.641 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.641 INFO:teuthology.orchestra.run.smithi170.stdout: "snapshot_clone_delay": { 2024-01-25T15:04:46.641 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "snapshot_clone_delay", 2024-01-25T15:04:46.641 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.641 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.641 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.641 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "0", 2024-01-25T15:04:46.641 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.642 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.642 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.642 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-01-25T15:04:46.642 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.642 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.642 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.642 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.642 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.642 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "zabbix", 2024-01-25T15:04:46.642 INFO:teuthology.orchestra.run.smithi170.stdout: "can_run": true, 2024-01-25T15:04:46.642 INFO:teuthology.orchestra.run.smithi170.stdout: "error_string": "", 2024-01-25T15:04:46.642 INFO:teuthology.orchestra.run.smithi170.stdout: "module_options": { 2024-01-25T15:04:46.643 INFO:teuthology.orchestra.run.smithi170.stdout: "discovery_interval": { 2024-01-25T15:04:46.643 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "discovery_interval", 2024-01-25T15:04:46.643 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "uint", 2024-01-25T15:04:46.643 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.643 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.643 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "100", 2024-01-25T15:04:46.643 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.643 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.643 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.643 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.643 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.643 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.643 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.643 INFO:teuthology.orchestra.run.smithi170.stdout: "identifier": { 2024-01-25T15:04:46.644 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "identifier", 2024-01-25T15:04:46.644 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.644 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.644 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.644 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.644 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.644 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.644 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.644 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.644 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.644 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.644 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.645 INFO:teuthology.orchestra.run.smithi170.stdout: "interval": { 2024-01-25T15:04:46.645 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "interval", 2024-01-25T15:04:46.645 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "secs", 2024-01-25T15:04:46.645 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.645 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.645 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "60", 2024-01-25T15:04:46.645 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.645 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.645 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.645 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.645 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.645 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.645 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.645 INFO:teuthology.orchestra.run.smithi170.stdout: "log_level": { 2024-01-25T15:04:46.646 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_level", 2024-01-25T15:04:46.646 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.646 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.646 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.646 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.646 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.646 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.646 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.646 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.646 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.646 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.646 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.646 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.646 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.647 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.647 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.647 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.647 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.647 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.647 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster": { 2024-01-25T15:04:46.647 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster", 2024-01-25T15:04:46.647 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.647 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.647 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.647 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.647 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.647 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.647 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.648 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.648 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.648 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.648 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.648 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_cluster_level": { 2024-01-25T15:04:46.648 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_cluster_level", 2024-01-25T15:04:46.648 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.648 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.648 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.648 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "info", 2024-01-25T15:04:46.648 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.648 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.648 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [ 2024-01-25T15:04:46.649 INFO:teuthology.orchestra.run.smithi170.stdout: "", 2024-01-25T15:04:46.649 INFO:teuthology.orchestra.run.smithi170.stdout: "critical", 2024-01-25T15:04:46.649 INFO:teuthology.orchestra.run.smithi170.stdout: "debug", 2024-01-25T15:04:46.649 INFO:teuthology.orchestra.run.smithi170.stdout: "error", 2024-01-25T15:04:46.649 INFO:teuthology.orchestra.run.smithi170.stdout: "info", 2024-01-25T15:04:46.649 INFO:teuthology.orchestra.run.smithi170.stdout: "warning" 2024-01-25T15:04:46.649 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.649 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.649 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.649 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.649 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.649 INFO:teuthology.orchestra.run.smithi170.stdout: "log_to_file": { 2024-01-25T15:04:46.649 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "log_to_file", 2024-01-25T15:04:46.650 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "bool", 2024-01-25T15:04:46.650 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.650 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 1, 2024-01-25T15:04:46.650 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "False", 2024-01-25T15:04:46.650 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.650 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.650 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.650 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.650 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.650 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.650 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.650 INFO:teuthology.orchestra.run.smithi170.stdout: "zabbix_host": { 2024-01-25T15:04:46.650 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "zabbix_host", 2024-01-25T15:04:46.650 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.651 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.651 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.651 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "", 2024-01-25T15:04:46.651 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.651 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.651 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.651 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.651 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.651 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.651 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.651 INFO:teuthology.orchestra.run.smithi170.stdout: "zabbix_port": { 2024-01-25T15:04:46.651 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "zabbix_port", 2024-01-25T15:04:46.651 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "int", 2024-01-25T15:04:46.652 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.652 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.652 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "10051", 2024-01-25T15:04:46.652 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.652 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.652 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.652 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.652 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.652 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.652 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.652 INFO:teuthology.orchestra.run.smithi170.stdout: "zabbix_sender": { 2024-01-25T15:04:46.652 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "zabbix_sender", 2024-01-25T15:04:46.653 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "str", 2024-01-25T15:04:46.653 INFO:teuthology.orchestra.run.smithi170.stdout: "level": "advanced", 2024-01-25T15:04:46.653 INFO:teuthology.orchestra.run.smithi170.stdout: "flags": 0, 2024-01-25T15:04:46.653 INFO:teuthology.orchestra.run.smithi170.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-01-25T15:04:46.653 INFO:teuthology.orchestra.run.smithi170.stdout: "min": "", 2024-01-25T15:04:46.653 INFO:teuthology.orchestra.run.smithi170.stdout: "max": "", 2024-01-25T15:04:46.653 INFO:teuthology.orchestra.run.smithi170.stdout: "enum_allowed": [], 2024-01-25T15:04:46.653 INFO:teuthology.orchestra.run.smithi170.stdout: "desc": "", 2024-01-25T15:04:46.653 INFO:teuthology.orchestra.run.smithi170.stdout: "long_desc": "", 2024-01-25T15:04:46.653 INFO:teuthology.orchestra.run.smithi170.stdout: "tags": [], 2024-01-25T15:04:46.653 INFO:teuthology.orchestra.run.smithi170.stdout: "see_also": [] 2024-01-25T15:04:46.653 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.653 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.653 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.653 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.654 INFO:teuthology.orchestra.run.smithi170.stdout: "services": { 2024-01-25T15:04:46.654 INFO:teuthology.orchestra.run.smithi170.stdout: "dashboard": "https://172.21.15.170:8443/" 2024-01-25T15:04:46.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.654 INFO:teuthology.orchestra.run.smithi170.stdout: "always_on_modules": { 2024-01-25T15:04:46.654 INFO:teuthology.orchestra.run.smithi170.stdout: "octopus": [ 2024-01-25T15:04:46.654 INFO:teuthology.orchestra.run.smithi170.stdout: "balancer", 2024-01-25T15:04:46.654 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-01-25T15:04:46.654 INFO:teuthology.orchestra.run.smithi170.stdout: "devicehealth", 2024-01-25T15:04:46.654 INFO:teuthology.orchestra.run.smithi170.stdout: "orchestrator", 2024-01-25T15:04:46.654 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_autoscaler", 2024-01-25T15:04:46.654 INFO:teuthology.orchestra.run.smithi170.stdout: "progress", 2024-01-25T15:04:46.654 INFO:teuthology.orchestra.run.smithi170.stdout: "rbd_support", 2024-01-25T15:04:46.654 INFO:teuthology.orchestra.run.smithi170.stdout: "status", 2024-01-25T15:04:46.654 INFO:teuthology.orchestra.run.smithi170.stdout: "telemetry", 2024-01-25T15:04:46.655 INFO:teuthology.orchestra.run.smithi170.stdout: "volumes" 2024-01-25T15:04:46.655 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.655 INFO:teuthology.orchestra.run.smithi170.stdout: "pacific": [ 2024-01-25T15:04:46.655 INFO:teuthology.orchestra.run.smithi170.stdout: "balancer", 2024-01-25T15:04:46.655 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-01-25T15:04:46.655 INFO:teuthology.orchestra.run.smithi170.stdout: "devicehealth", 2024-01-25T15:04:46.655 INFO:teuthology.orchestra.run.smithi170.stdout: "orchestrator", 2024-01-25T15:04:46.655 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_autoscaler", 2024-01-25T15:04:46.655 INFO:teuthology.orchestra.run.smithi170.stdout: "progress", 2024-01-25T15:04:46.655 INFO:teuthology.orchestra.run.smithi170.stdout: "rbd_support", 2024-01-25T15:04:46.655 INFO:teuthology.orchestra.run.smithi170.stdout: "status", 2024-01-25T15:04:46.655 INFO:teuthology.orchestra.run.smithi170.stdout: "telemetry", 2024-01-25T15:04:46.655 INFO:teuthology.orchestra.run.smithi170.stdout: "volumes" 2024-01-25T15:04:46.655 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.655 INFO:teuthology.orchestra.run.smithi170.stdout: "quincy": [ 2024-01-25T15:04:46.656 INFO:teuthology.orchestra.run.smithi170.stdout: "balancer", 2024-01-25T15:04:46.656 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-01-25T15:04:46.656 INFO:teuthology.orchestra.run.smithi170.stdout: "devicehealth", 2024-01-25T15:04:46.656 INFO:teuthology.orchestra.run.smithi170.stdout: "orchestrator", 2024-01-25T15:04:46.656 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_autoscaler", 2024-01-25T15:04:46.656 INFO:teuthology.orchestra.run.smithi170.stdout: "progress", 2024-01-25T15:04:46.656 INFO:teuthology.orchestra.run.smithi170.stdout: "rbd_support", 2024-01-25T15:04:46.656 INFO:teuthology.orchestra.run.smithi170.stdout: "status", 2024-01-25T15:04:46.656 INFO:teuthology.orchestra.run.smithi170.stdout: "telemetry", 2024-01-25T15:04:46.656 INFO:teuthology.orchestra.run.smithi170.stdout: "volumes" 2024-01-25T15:04:46.656 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.656 INFO:teuthology.orchestra.run.smithi170.stdout: "reef": [ 2024-01-25T15:04:46.656 INFO:teuthology.orchestra.run.smithi170.stdout: "balancer", 2024-01-25T15:04:46.657 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-01-25T15:04:46.657 INFO:teuthology.orchestra.run.smithi170.stdout: "devicehealth", 2024-01-25T15:04:46.657 INFO:teuthology.orchestra.run.smithi170.stdout: "orchestrator", 2024-01-25T15:04:46.657 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_autoscaler", 2024-01-25T15:04:46.657 INFO:teuthology.orchestra.run.smithi170.stdout: "progress", 2024-01-25T15:04:46.657 INFO:teuthology.orchestra.run.smithi170.stdout: "rbd_support", 2024-01-25T15:04:46.657 INFO:teuthology.orchestra.run.smithi170.stdout: "status", 2024-01-25T15:04:46.657 INFO:teuthology.orchestra.run.smithi170.stdout: "telemetry", 2024-01-25T15:04:46.657 INFO:teuthology.orchestra.run.smithi170.stdout: "volumes" 2024-01-25T15:04:46.657 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-01-25T15:04:46.657 INFO:teuthology.orchestra.run.smithi170.stdout: "squid": [ 2024-01-25T15:04:46.657 INFO:teuthology.orchestra.run.smithi170.stdout: "balancer", 2024-01-25T15:04:46.657 INFO:teuthology.orchestra.run.smithi170.stdout: "crash", 2024-01-25T15:04:46.657 INFO:teuthology.orchestra.run.smithi170.stdout: "devicehealth", 2024-01-25T15:04:46.657 INFO:teuthology.orchestra.run.smithi170.stdout: "orchestrator", 2024-01-25T15:04:46.658 INFO:teuthology.orchestra.run.smithi170.stdout: "pg_autoscaler", 2024-01-25T15:04:46.658 INFO:teuthology.orchestra.run.smithi170.stdout: "progress", 2024-01-25T15:04:46.658 INFO:teuthology.orchestra.run.smithi170.stdout: "rbd_support", 2024-01-25T15:04:46.658 INFO:teuthology.orchestra.run.smithi170.stdout: "status", 2024-01-25T15:04:46.658 INFO:teuthology.orchestra.run.smithi170.stdout: "telemetry", 2024-01-25T15:04:46.658 INFO:teuthology.orchestra.run.smithi170.stdout: "volumes" 2024-01-25T15:04:46.658 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-01-25T15:04:46.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.658 INFO:teuthology.orchestra.run.smithi170.stdout: "last_failure_osd_epoch": 3, 2024-01-25T15:04:46.658 INFO:teuthology.orchestra.run.smithi170.stdout: "active_clients": [ 2024-01-25T15:04:46.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.658 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "devicehealth", 2024-01-25T15:04:46.658 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2024-01-25T15:04:46.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.659 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v2", 2024-01-25T15:04:46.659 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:0", 2024-01-25T15:04:46.659 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 3192391279 2024-01-25T15:04:46.659 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.659 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-01-25T15:04:46.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.659 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "libcephsqlite", 2024-01-25T15:04:46.659 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2024-01-25T15:04:46.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.659 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v2", 2024-01-25T15:04:46.659 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:0", 2024-01-25T15:04:46.659 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 1561929268 2024-01-25T15:04:46.659 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.660 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-01-25T15:04:46.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.660 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "rbd_support", 2024-01-25T15:04:46.660 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2024-01-25T15:04:46.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.660 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v2", 2024-01-25T15:04:46.660 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:0", 2024-01-25T15:04:46.660 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 1198040672 2024-01-25T15:04:46.660 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.660 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-01-25T15:04:46.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:46.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.661 INFO:teuthology.orchestra.run.smithi170.stdout: "name": "volumes", 2024-01-25T15:04:46.661 INFO:teuthology.orchestra.run.smithi170.stdout: "addrvec": [ 2024-01-25T15:04:46.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-01-25T15:04:46.661 INFO:teuthology.orchestra.run.smithi170.stdout: "type": "v2", 2024-01-25T15:04:46.661 INFO:teuthology.orchestra.run.smithi170.stdout: "addr": "172.21.15.170:0", 2024-01-25T15:04:46.661 INFO:teuthology.orchestra.run.smithi170.stdout: "nonce": 3306022550 2024-01-25T15:04:46.661 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.661 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-01-25T15:04:46.661 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:46.661 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-01-25T15:04:46.661 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:04:46.663 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:45 smithi191 ceph-mon[36347]: pgmap v431: 97 pgs: 97 active+clean; 36 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 507 op/s 2024-01-25T15:04:46.663 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:45 smithi191 ceph-mon[36347]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:04:46.663 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:45 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1140484664' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:04:46.663 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:45 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3492132189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:04:46.663 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:45 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1010420617' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:04:46.663 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:45 smithi186 ceph-mon[35697]: pgmap v431: 97 pgs: 97 active+clean; 36 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 507 op/s 2024-01-25T15:04:46.663 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:45 smithi186 ceph-mon[35697]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:04:46.664 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:45 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1140484664' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:04:46.664 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:45 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3492132189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:04:46.664 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:45 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1010420617' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:04:46.664 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:46 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/550737436' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-01-25T15:04:46.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.381+0000 7f1eb965c640 1 -- 172.21.15.170:0/550737436 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1ea00a12e0 msgr2=0x7f1ea00a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.381+0000 7f1eb965c640 1 --2- 172.21.15.170:0/550737436 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1ea00a12e0 0x7f1ea00a37a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1eac036040 tx=0x7f1eac005fd0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.381+0000 7f1eb965c640 1 -- 172.21.15.170:0/550737436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb41028c0 msgr2=0x7f1eb419e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:04:46.664 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.381+0000 7f1eb965c640 1 --2- 172.21.15.170:0/550737436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb41028c0 0x7f1eb419e2b0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400b970 tx=0x7f1ea400be30 comp rx=0 tx=0).stop 2024-01-25T15:04:46.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.382+0000 7f1eb965c640 1 -- 172.21.15.170:0/550737436 shutdown_connections 2024-01-25T15:04:46.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.382+0000 7f1eb965c640 1 --2- 172.21.15.170:0/550737436 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f1ea00a12e0 0x7f1ea00a37a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.382+0000 7f1eb965c640 1 --2- 172.21.15.170:0/550737436 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1eb4101f00 0x7f1eb4197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.382+0000 7f1eb965c640 1 --2- 172.21.15.170:0/550737436 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f1eb41028c0 0x7f1eb419e2b0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.382+0000 7f1eb965c640 1 --2- 172.21.15.170:0/550737436 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f1eb4100d10 0x7f1eb4196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:04:46.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.382+0000 7f1eb965c640 1 -- 172.21.15.170:0/550737436 >> 172.21.15.170:0/550737436 conn(0x7f1eb40fc2a0 msgr2=0x7f1eb4105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:04:46.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.382+0000 7f1eb965c640 1 -- 172.21.15.170:0/550737436 shutdown_connections 2024-01-25T15:04:46.665 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:04:45.382+0000 7f1eb965c640 1 -- 172.21.15.170:0/550737436 wait complete. 2024-01-25T15:04:46.701 DEBUG:tasks.check_counter:Getting stats from a 2024-01-25T15:04:46.701 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph daemon mds.a perf dump 2024-01-25T15:04:46.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:45 smithi170 ceph-mon[31899]: pgmap v431: 97 pgs: 97 active+clean; 36 MiB data, 827 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 507 op/s 2024-01-25T15:04:46.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:45 smithi170 ceph-mon[31899]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-01-25T15:04:46.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:45 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1140484664' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:04:46.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:45 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3492132189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:04:46.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:45 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1010420617' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:04:46.702 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:46 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/550737436' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-01-25T15:04:46.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:46 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/550737436' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-01-25T15:04:46.952 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:04:47.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:47 smithi186 ceph-mon[35697]: pgmap v432: 97 pgs: 97 active+clean; 31 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 448 op/s 2024-01-25T15:04:47.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:47 smithi170 ceph-mon[31899]: pgmap v432: 97 pgs: 97 active+clean; 31 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 448 op/s 2024-01-25T15:04:47.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:47 smithi191 ceph-mon[36347]: pgmap v432: 97 pgs: 97 active+clean; 31 MiB data, 807 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 448 op/s 2024-01-25T15:04:49.068 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:04:49.068 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-0": { 2024-01-25T15:04:49.068 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 586, 2024-01-25T15:04:49.068 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 588, 2024-01-25T15:04:49.068 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 4368431, 2024-01-25T15:04:49.068 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 182247, 2024-01-25T15:04:49.069 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 6, 2024-01-25T15:04:49.069 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 2, 2024-01-25T15:04:49.069 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.047985338, 2024-01-25T15:04:49.069 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.013261725, 2024-01-25T15:04:49.069 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.015974384, 2024-01-25T15:04:49.069 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.014294076, 2024-01-25T15:04:49.069 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:04:49.069 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 586, 2024-01-25T15:04:49.069 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.015829820, 2024-01-25T15:04:49.069 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000027013 2024-01-25T15:04:49.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.069 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:04:49.069 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.069 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.070 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.070 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 0, 2024-01-25T15:04:49.070 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 0 2024-01-25T15:04:49.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.070 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-1": { 2024-01-25T15:04:49.070 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 323, 2024-01-25T15:04:49.070 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 301, 2024-01-25T15:04:49.070 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 2096114, 2024-01-25T15:04:49.070 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 115931, 2024-01-25T15:04:49.070 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 4, 2024-01-25T15:04:49.070 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 3, 2024-01-25T15:04:49.070 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.034204390, 2024-01-25T15:04:49.071 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.009621455, 2024-01-25T15:04:49.071 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.020816228, 2024-01-25T15:04:49.071 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.007248669, 2024-01-25T15:04:49.071 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:04:49.071 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 300, 2024-01-25T15:04:49.071 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.011123018, 2024-01-25T15:04:49.071 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000037076 2024-01-25T15:04:49.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.071 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:04:49.071 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.071 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.071 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.071 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 831536, 2024-01-25T15:04:49.071 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 50864 2024-01-25T15:04:49.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.072 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-2": { 2024-01-25T15:04:49.072 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 43, 2024-01-25T15:04:49.072 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 104, 2024-01-25T15:04:49.072 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 12522, 2024-01-25T15:04:49.072 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 202426, 2024-01-25T15:04:49.072 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 5, 2024-01-25T15:04:49.072 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 4, 2024-01-25T15:04:49.072 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.008576174, 2024-01-25T15:04:49.072 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.004260099, 2024-01-25T15:04:49.072 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.002617978, 2024-01-25T15:04:49.072 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.000962083, 2024-01-25T15:04:49.073 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:04:49.073 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 103, 2024-01-25T15:04:49.073 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.005569589, 2024-01-25T15:04:49.073 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000054073 2024-01-25T15:04:49.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.073 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:04:49.073 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.073 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.073 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.073 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-01-25T15:04:49.073 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 190608 2024-01-25T15:04:49.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.073 INFO:teuthology.orchestra.run.smithi170.stdout: "cct": { 2024-01-25T15:04:49.074 INFO:teuthology.orchestra.run.smithi170.stdout: "total_workers": 1, 2024-01-25T15:04:49.074 INFO:teuthology.orchestra.run.smithi170.stdout: "unhealthy_workers": 0 2024-01-25T15:04:49.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.074 INFO:teuthology.orchestra.run.smithi170.stdout: "finisher-MDSRank": { 2024-01-25T15:04:49.074 INFO:teuthology.orchestra.run.smithi170.stdout: "queue_len": 0, 2024-01-25T15:04:49.074 INFO:teuthology.orchestra.run.smithi170.stdout: "complete_latency": { 2024-01-25T15:04:49.074 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 1453, 2024-01-25T15:04:49.074 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.032934183, 2024-01-25T15:04:49.074 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000022666 2024-01-25T15:04:49.074 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:49.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.074 INFO:teuthology.orchestra.run.smithi170.stdout: "finisher-PurgeQueue": { 2024-01-25T15:04:49.074 INFO:teuthology.orchestra.run.smithi170.stdout: "queue_len": 0, 2024-01-25T15:04:49.074 INFO:teuthology.orchestra.run.smithi170.stdout: "complete_latency": { 2024-01-25T15:04:49.075 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.075 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.075 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.075 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:49.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.075 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-01-25T15:04:49.075 INFO:teuthology.orchestra.run.smithi170.stdout: "request": 0, 2024-01-25T15:04:49.075 INFO:teuthology.orchestra.run.smithi170.stdout: "reply": 0, 2024-01-25T15:04:49.075 INFO:teuthology.orchestra.run.smithi170.stdout: "reply_latency": { 2024-01-25T15:04:49.075 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.075 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.075 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.076 INFO:teuthology.orchestra.run.smithi170.stdout: "slow_reply": 0, 2024-01-25T15:04:49.076 INFO:teuthology.orchestra.run.smithi170.stdout: "forward": 0, 2024-01-25T15:04:49.076 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_fetch_complete": 0, 2024-01-25T15:04:49.076 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_fetch_keys": 0, 2024-01-25T15:04:49.076 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_commit": 0, 2024-01-25T15:04:49.076 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_split": 0, 2024-01-25T15:04:49.076 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_merge": 0, 2024-01-25T15:04:49.076 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes": 771, 2024-01-25T15:04:49.076 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_top": 3, 2024-01-25T15:04:49.076 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_bottom": 768, 2024-01-25T15:04:49.076 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_pin_tail": 0, 2024-01-25T15:04:49.076 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_pinned": 766, 2024-01-25T15:04:49.076 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_expired": 0, 2024-01-25T15:04:49.076 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_with_caps": 0, 2024-01-25T15:04:49.077 INFO:teuthology.orchestra.run.smithi170.stdout: "caps": 0, 2024-01-25T15:04:49.077 INFO:teuthology.orchestra.run.smithi170.stdout: "subtrees": 1, 2024-01-25T15:04:49.077 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse": 0, 2024-01-25T15:04:49.077 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_hit": 0, 2024-01-25T15:04:49.077 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_forward": 0, 2024-01-25T15:04:49.077 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_discover": 0, 2024-01-25T15:04:49.077 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_dir_fetch": 0, 2024-01-25T15:04:49.077 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_remote_ino": 0, 2024-01-25T15:04:49.077 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_lock": 0, 2024-01-25T15:04:49.077 INFO:teuthology.orchestra.run.smithi170.stdout: "load_cent": 0, 2024-01-25T15:04:49.077 INFO:teuthology.orchestra.run.smithi170.stdout: "q": 0, 2024-01-25T15:04:49.077 INFO:teuthology.orchestra.run.smithi170.stdout: "exported": 0, 2024-01-25T15:04:49.077 INFO:teuthology.orchestra.run.smithi170.stdout: "exported_inodes": 0, 2024-01-25T15:04:49.077 INFO:teuthology.orchestra.run.smithi170.stdout: "imported": 0, 2024-01-25T15:04:49.078 INFO:teuthology.orchestra.run.smithi170.stdout: "imported_inodes": 0, 2024-01-25T15:04:49.078 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_dir_fetch": 0, 2024-01-25T15:04:49.078 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_backtrace_fetch": 0, 2024-01-25T15:04:49.078 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_peer_discover": 0, 2024-01-25T15:04:49.078 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rfiles": 0, 2024-01-25T15:04:49.078 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rbytes": 0, 2024-01-25T15:04:49.078 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rsnaps": 0, 2024-01-25T15:04:49.078 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_backtrace_fetch": 0, 2024-01-25T15:04:49.078 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_set_tag": 0, 2024-01-25T15:04:49.078 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_backtrace_repaired": 0, 2024-01-25T15:04:49.078 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_inotable_repaired": 0, 2024-01-25T15:04:49.078 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dir_inodes": 0, 2024-01-25T15:04:49.079 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dir_base_inodes": 0, 2024-01-25T15:04:49.079 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dirfrag_rstats": 0, 2024-01-25T15:04:49.079 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_file_inodes": 0, 2024-01-25T15:04:49.079 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_inode_file_caps": 0, 2024-01-25T15:04:49.079 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_revoke": 0, 2024-01-25T15:04:49.079 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_grant": 0, 2024-01-25T15:04:49.079 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_trunc": 0, 2024-01-25T15:04:49.079 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-25T15:04:49.079 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-25T15:04:49.079 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_caps": 0, 2024-01-25T15:04:49.079 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_caps_dirty": 0, 2024-01-25T15:04:49.079 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_cap_release": 0, 2024-01-25T15:04:49.079 INFO:teuthology.orchestra.run.smithi170.stdout: "process_request_cap_release": 0 2024-01-25T15:04:49.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.080 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_cache": { 2024-01-25T15:04:49.080 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_update": 0, 2024-01-25T15:04:49.080 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_update_receipt": 0, 2024-01-25T15:04:49.080 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_try_discover": 0, 2024-01-25T15:04:49.080 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_send_discover": 0, 2024-01-25T15:04:49.080 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_handle_discover": 0, 2024-01-25T15:04:49.080 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays": 0, 2024-01-25T15:04:49.080 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays_delayed": 0, 2024-01-25T15:04:49.080 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays_enqueuing": 0, 2024-01-25T15:04:49.080 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_created": 0, 2024-01-25T15:04:49.080 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_enqueued": 0, 2024-01-25T15:04:49.080 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_reintegrated": 0, 2024-01-25T15:04:49.080 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_migrated": 0, 2024-01-25T15:04:49.081 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_processing": 0, 2024-01-25T15:04:49.081 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_enqueued": 0, 2024-01-25T15:04:49.081 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_prioritized": 0, 2024-01-25T15:04:49.081 INFO:teuthology.orchestra.run.smithi170.stdout: "recovery_started": 0, 2024-01-25T15:04:49.081 INFO:teuthology.orchestra.run.smithi170.stdout: "recovery_completed": 0, 2024-01-25T15:04:49.081 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_enqueue_scrub": 0, 2024-01-25T15:04:49.081 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_exportdir": 0, 2024-01-25T15:04:49.081 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_flush": 0, 2024-01-25T15:04:49.081 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_fragmentdir": 0, 2024-01-25T15:04:49.081 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_fragstats": 0, 2024-01-25T15:04:49.081 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_inodestats": 0 2024-01-25T15:04:49.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.081 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_log": { 2024-01-25T15:04:49.081 INFO:teuthology.orchestra.run.smithi170.stdout: "evlrg": 0, 2024-01-25T15:04:49.082 INFO:teuthology.orchestra.run.smithi170.stdout: "evadd": 0, 2024-01-25T15:04:49.082 INFO:teuthology.orchestra.run.smithi170.stdout: "evex": 0, 2024-01-25T15:04:49.082 INFO:teuthology.orchestra.run.smithi170.stdout: "evtrm": 0, 2024-01-25T15:04:49.082 INFO:teuthology.orchestra.run.smithi170.stdout: "ev": 2698, 2024-01-25T15:04:49.082 INFO:teuthology.orchestra.run.smithi170.stdout: "evexg": 0, 2024-01-25T15:04:49.082 INFO:teuthology.orchestra.run.smithi170.stdout: "evexd": 0, 2024-01-25T15:04:49.082 INFO:teuthology.orchestra.run.smithi170.stdout: "segadd": 0, 2024-01-25T15:04:49.082 INFO:teuthology.orchestra.run.smithi170.stdout: "segex": 0, 2024-01-25T15:04:49.082 INFO:teuthology.orchestra.run.smithi170.stdout: "segtrm": 0, 2024-01-25T15:04:49.082 INFO:teuthology.orchestra.run.smithi170.stdout: "seg": 4, 2024-01-25T15:04:49.082 INFO:teuthology.orchestra.run.smithi170.stdout: "segmjr": 2, 2024-01-25T15:04:49.082 INFO:teuthology.orchestra.run.smithi170.stdout: "segexg": 0, 2024-01-25T15:04:49.082 INFO:teuthology.orchestra.run.smithi170.stdout: "segexd": 0, 2024-01-25T15:04:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: "expos": 4194304, 2024-01-25T15:04:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: "wrpos": 9600480, 2024-01-25T15:04:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: "rdpos": 9599881, 2024-01-25T15:04:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: "jlat": { 2024-01-25T15:04:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: "replayed": 2698 2024-01-25T15:04:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_mem": { 2024-01-25T15:04:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 58, 2024-01-25T15:04:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: "ino+": 865, 2024-01-25T15:04:49.083 INFO:teuthology.orchestra.run.smithi170.stdout: "ino-": 807, 2024-01-25T15:04:49.084 INFO:teuthology.orchestra.run.smithi170.stdout: "dir": 29, 2024-01-25T15:04:49.084 INFO:teuthology.orchestra.run.smithi170.stdout: "dir+": 316, 2024-01-25T15:04:49.084 INFO:teuthology.orchestra.run.smithi170.stdout: "dir-": 287, 2024-01-25T15:04:49.084 INFO:teuthology.orchestra.run.smithi170.stdout: "dn": 771, 2024-01-25T15:04:49.084 INFO:teuthology.orchestra.run.smithi170.stdout: "dn+": 1559, 2024-01-25T15:04:49.084 INFO:teuthology.orchestra.run.smithi170.stdout: "dn-": 788, 2024-01-25T15:04:49.084 INFO:teuthology.orchestra.run.smithi170.stdout: "cap": 0, 2024-01-25T15:04:49.084 INFO:teuthology.orchestra.run.smithi170.stdout: "cap+": 0, 2024-01-25T15:04:49.084 INFO:teuthology.orchestra.run.smithi170.stdout: "cap-": 0, 2024-01-25T15:04:49.084 INFO:teuthology.orchestra.run.smithi170.stdout: "rss": 53452, 2024-01-25T15:04:49.084 INFO:teuthology.orchestra.run.smithi170.stdout: "heap": 207228 2024-01-25T15:04:49.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.084 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_server": { 2024-01-25T15:04:49.085 INFO:teuthology.orchestra.run.smithi170.stdout: "dispatch_client_request": 0, 2024-01-25T15:04:49.085 INFO:teuthology.orchestra.run.smithi170.stdout: "dispatch_server_request": 0, 2024-01-25T15:04:49.085 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_request": 0, 2024-01-25T15:04:49.085 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_session": 0, 2024-01-25T15:04:49.085 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_peer_request": 0, 2024-01-25T15:04:49.085 INFO:teuthology.orchestra.run.smithi170.stdout: "req_create_latency": { 2024-01-25T15:04:49.085 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.085 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.085 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.085 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getattr_latency": { 2024-01-25T15:04:49.085 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.085 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.086 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.086 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getfilelock_latency": { 2024-01-25T15:04:49.086 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.086 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.086 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.086 INFO:teuthology.orchestra.run.smithi170.stdout: "req_link_latency": { 2024-01-25T15:04:49.086 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.086 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.086 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.086 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookup_latency": { 2024-01-25T15:04:49.086 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.087 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.087 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.087 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookuphash_latency": { 2024-01-25T15:04:49.087 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.087 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.087 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.087 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupino_latency": { 2024-01-25T15:04:49.087 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.087 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.087 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.088 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupname_latency": { 2024-01-25T15:04:49.088 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.088 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.088 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.088 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupparent_latency": { 2024-01-25T15:04:49.088 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.088 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.088 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.088 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupsnap_latency": { 2024-01-25T15:04:49.088 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.089 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.089 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.089 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lssnap_latency": { 2024-01-25T15:04:49.089 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.089 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.089 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.089 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mkdir_latency": { 2024-01-25T15:04:49.089 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.089 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.089 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.089 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mknod_latency": { 2024-01-25T15:04:49.090 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.090 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.090 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.090 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mksnap_latency": { 2024-01-25T15:04:49.090 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.090 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.090 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.090 INFO:teuthology.orchestra.run.smithi170.stdout: "req_open_latency": { 2024-01-25T15:04:49.090 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.090 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.090 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.091 INFO:teuthology.orchestra.run.smithi170.stdout: "req_readdir_latency": { 2024-01-25T15:04:49.091 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.091 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.091 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.091 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rename_latency": { 2024-01-25T15:04:49.091 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.091 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.091 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.091 INFO:teuthology.orchestra.run.smithi170.stdout: "req_renamesnap_latency": { 2024-01-25T15:04:49.091 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.092 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.092 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.092 INFO:teuthology.orchestra.run.smithi170.stdout: "req_snapdiff_latency": { 2024-01-25T15:04:49.092 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.092 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.092 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.092 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmdir_latency": { 2024-01-25T15:04:49.092 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.092 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.092 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.093 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmsnap_latency": { 2024-01-25T15:04:49.093 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.093 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.093 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.093 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmxattr_latency": { 2024-01-25T15:04:49.093 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.093 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.093 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.093 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setattr_latency": { 2024-01-25T15:04:49.093 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.093 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.093 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.094 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setdirlayout_latency": { 2024-01-25T15:04:49.094 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.094 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.094 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.094 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setfilelock_latency": { 2024-01-25T15:04:49.094 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.094 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.094 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.094 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setlayout_latency": { 2024-01-25T15:04:49.094 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.094 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.094 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setxattr_latency": { 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: "req_symlink_latency": { 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: "req_unlink_latency": { 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.096 INFO:teuthology.orchestra.run.smithi170.stdout: "cap_revoke_eviction": 0, 2024-01-25T15:04:49.096 INFO:teuthology.orchestra.run.smithi170.stdout: "cap_acquisition_throttle": 0, 2024-01-25T15:04:49.096 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getvxattr_latency": { 2024-01-25T15:04:49.096 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.096 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.096 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.096 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:49.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.096 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_sessions": { 2024-01-25T15:04:49.096 INFO:teuthology.orchestra.run.smithi170.stdout: "session_count": 1, 2024-01-25T15:04:49.096 INFO:teuthology.orchestra.run.smithi170.stdout: "session_add": 1, 2024-01-25T15:04:49.096 INFO:teuthology.orchestra.run.smithi170.stdout: "session_remove": 0, 2024-01-25T15:04:49.096 INFO:teuthology.orchestra.run.smithi170.stdout: "sessions_open": 1, 2024-01-25T15:04:49.096 INFO:teuthology.orchestra.run.smithi170.stdout: "sessions_stale": 0, 2024-01-25T15:04:49.097 INFO:teuthology.orchestra.run.smithi170.stdout: "total_load": 0, 2024-01-25T15:04:49.097 INFO:teuthology.orchestra.run.smithi170.stdout: "average_load": 0, 2024-01-25T15:04:49.097 INFO:teuthology.orchestra.run.smithi170.stdout: "avg_session_uptime": 1233, 2024-01-25T15:04:49.097 INFO:teuthology.orchestra.run.smithi170.stdout: "mdthresh_evicted": 0 2024-01-25T15:04:49.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.097 INFO:teuthology.orchestra.run.smithi170.stdout: "mempool": { 2024-01-25T15:04:49.097 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_bytes": 0, 2024-01-25T15:04:49.097 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_items": 0, 2024-01-25T15:04:49.097 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_bytes": 0, 2024-01-25T15:04:49.097 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_items": 0, 2024-01-25T15:04:49.097 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_bytes": 0, 2024-01-25T15:04:49.097 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_items": 0, 2024-01-25T15:04:49.097 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-25T15:04:49.097 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_items": 0, 2024-01-25T15:04:49.097 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_items": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_bytes": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_items": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_items": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_bytes": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_items": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_bytes": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_items": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_items": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_items": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_bytes": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_items": 0, 2024-01-25T15:04:49.098 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_bytes": 0, 2024-01-25T15:04:49.099 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_items": 0, 2024-01-25T15:04:49.099 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-25T15:04:49.099 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_items": 0, 2024-01-25T15:04:49.099 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_bytes": 0, 2024-01-25T15:04:49.099 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_items": 0, 2024-01-25T15:04:49.099 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_bytes": 0, 2024-01-25T15:04:49.099 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_items": 0, 2024-01-25T15:04:49.099 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_bytes": 0, 2024-01-25T15:04:49.099 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_items": 0, 2024-01-25T15:04:49.099 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_bytes": 0, 2024-01-25T15:04:49.099 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_items": 0, 2024-01-25T15:04:49.099 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_bytes": 199286, 2024-01-25T15:04:49.099 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_items": 105, 2024-01-25T15:04:49.100 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_bytes": 0, 2024-01-25T15:04:49.100 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_items": 0, 2024-01-25T15:04:49.100 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_bytes": 0, 2024-01-25T15:04:49.100 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_items": 0, 2024-01-25T15:04:49.100 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_bytes": 0, 2024-01-25T15:04:49.100 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_items": 0, 2024-01-25T15:04:49.100 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_bytes": 0, 2024-01-25T15:04:49.100 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_items": 0, 2024-01-25T15:04:49.100 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_bytes": 7432, 2024-01-25T15:04:49.100 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_items": 156, 2024-01-25T15:04:49.100 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_bytes": 0, 2024-01-25T15:04:49.100 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_items": 0, 2024-01-25T15:04:49.100 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_bytes": 0, 2024-01-25T15:04:49.100 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_items": 0, 2024-01-25T15:04:49.100 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_bytes": 718021, 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_items": 10393, 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_bytes": 0, 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_items": 0, 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_bytes": 0, 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_items": 0 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: "objecter": { 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: "op_active": 0, 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: "op_laggy": 0, 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: "op_send": 833, 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: "op_send_bytes": 21, 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: "op_resend": 3, 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: "op_reply": 833, 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: "op_latency": { 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 833, 2024-01-25T15:04:49.101 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.952977635, 2024-01-25T15:04:49.102 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.001144030 2024-01-25T15:04:49.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.102 INFO:teuthology.orchestra.run.smithi170.stdout: "op_inflight": 0, 2024-01-25T15:04:49.102 INFO:teuthology.orchestra.run.smithi170.stdout: "oplen_avg": { 2024-01-25T15:04:49.102 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 833, 2024-01-25T15:04:49.102 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 834 2024-01-25T15:04:49.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.102 INFO:teuthology.orchestra.run.smithi170.stdout: "op": 833, 2024-01-25T15:04:49.102 INFO:teuthology.orchestra.run.smithi170.stdout: "op_r": 833, 2024-01-25T15:04:49.102 INFO:teuthology.orchestra.run.smithi170.stdout: "op_w": 0, 2024-01-25T15:04:49.102 INFO:teuthology.orchestra.run.smithi170.stdout: "op_rmw": 0, 2024-01-25T15:04:49.102 INFO:teuthology.orchestra.run.smithi170.stdout: "op_pg": 0, 2024-01-25T15:04:49.102 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_stat": 467, 2024-01-25T15:04:49.102 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_create": 0, 2024-01-25T15:04:49.102 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_read": 364, 2024-01-25T15:04:49.103 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_write": 0, 2024-01-25T15:04:49.103 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_writefull": 0, 2024-01-25T15:04:49.103 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_writesame": 0, 2024-01-25T15:04:49.103 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_append": 0, 2024-01-25T15:04:49.103 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_zero": 0, 2024-01-25T15:04:49.103 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_truncate": 0, 2024-01-25T15:04:49.103 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_delete": 0, 2024-01-25T15:04:49.103 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_mapext": 0, 2024-01-25T15:04:49.103 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_sparse_read": 0, 2024-01-25T15:04:49.103 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_clonerange": 0, 2024-01-25T15:04:49.103 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_getxattr": 1, 2024-01-25T15:04:49.103 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_setxattr": 0, 2024-01-25T15:04:49.103 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_cmpxattr": 0, 2024-01-25T15:04:49.103 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_rmxattr": 0, 2024-01-25T15:04:49.103 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_resetxattrs": 0, 2024-01-25T15:04:49.104 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_call": 0, 2024-01-25T15:04:49.104 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_watch": 0, 2024-01-25T15:04:49.104 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_notify": 0, 2024-01-25T15:04:49.104 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_src_cmpxattr": 0, 2024-01-25T15:04:49.104 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_pgls": 0, 2024-01-25T15:04:49.104 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_pgls_filter": 0, 2024-01-25T15:04:49.104 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_other": 0, 2024-01-25T15:04:49.104 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_active": 0, 2024-01-25T15:04:49.104 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_send": 0, 2024-01-25T15:04:49.104 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_resend": 0, 2024-01-25T15:04:49.104 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_ping": 0, 2024-01-25T15:04:49.104 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_active": 0, 2024-01-25T15:04:49.104 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_send": 0, 2024-01-25T15:04:49.104 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_resend": 0, 2024-01-25T15:04:49.105 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_active": 0, 2024-01-25T15:04:49.105 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_send": 0, 2024-01-25T15:04:49.105 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_resend": 0, 2024-01-25T15:04:49.105 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_active": 0, 2024-01-25T15:04:49.105 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_send": 0, 2024-01-25T15:04:49.105 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_resend": 0, 2024-01-25T15:04:49.105 INFO:teuthology.orchestra.run.smithi170.stdout: "command_active": 0, 2024-01-25T15:04:49.105 INFO:teuthology.orchestra.run.smithi170.stdout: "command_send": 0, 2024-01-25T15:04:49.105 INFO:teuthology.orchestra.run.smithi170.stdout: "command_resend": 0, 2024-01-25T15:04:49.105 INFO:teuthology.orchestra.run.smithi170.stdout: "map_epoch": 87, 2024-01-25T15:04:49.105 INFO:teuthology.orchestra.run.smithi170.stdout: "map_full": 0, 2024-01-25T15:04:49.105 INFO:teuthology.orchestra.run.smithi170.stdout: "map_inc": 2, 2024-01-25T15:04:49.105 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_sessions": 6, 2024-01-25T15:04:49.105 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_session_open": 6, 2024-01-25T15:04:49.105 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_session_close": 0, 2024-01-25T15:04:49.106 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_laggy": 0, 2024-01-25T15:04:49.106 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_wr": 0, 2024-01-25T15:04:49.106 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_rd": 2, 2024-01-25T15:04:49.106 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_del": 0 2024-01-25T15:04:49.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.106 INFO:teuthology.orchestra.run.smithi170.stdout: "oft": { 2024-01-25T15:04:49.106 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_objs": 0, 2024-01-25T15:04:49.106 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_kv_pairs": 0, 2024-01-25T15:04:49.106 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_updates": 0, 2024-01-25T15:04:49.106 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_removes": 0 2024-01-25T15:04:49.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.106 INFO:teuthology.orchestra.run.smithi170.stdout: "osd-slow-ops": { 2024-01-25T15:04:49.106 INFO:teuthology.orchestra.run.smithi170.stdout: "slow_ops_count": 0 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: "purge_queue": { 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_ops": 0, 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_ops_high_water": 0, 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing": 0, 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_high_water": 0, 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executed_ops": 0, 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executed": 0, 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_item_in_journal": 0 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 948, 2024-01-25T15:04:49.107 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 6383047, 2024-01-25T15:04:49.108 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-01-25T15:04:49.108 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 948, 2024-01-25T15:04:49.108 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-01-25T15:04:49.108 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-01-25T15:04:49.108 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 948, 2024-01-25T15:04:49.108 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 6383047, 2024-01-25T15:04:49.108 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-01-25T15:04:49.108 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.108 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.108 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.108 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:49.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.108 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-objecter_bytes": { 2024-01-25T15:04:49.108 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-01-25T15:04:49.108 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-01-25T15:04:49.109 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-01-25T15:04:49.109 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-01-25T15:04:49.109 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-01-25T15:04:49.109 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-01-25T15:04:49.109 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-01-25T15:04:49.109 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 833, 2024-01-25T15:04:49.109 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 5406181, 2024-01-25T15:04:49.109 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 833, 2024-01-25T15:04:49.109 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 5406181, 2024-01-25T15:04:49.109 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-01-25T15:04:49.109 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.109 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.109 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.109 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:49.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.110 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-objecter_ops": { 2024-01-25T15:04:49.110 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-01-25T15:04:49.110 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 1024, 2024-01-25T15:04:49.110 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-01-25T15:04:49.110 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-01-25T15:04:49.110 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-01-25T15:04:49.110 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-01-25T15:04:49.110 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-01-25T15:04:49.110 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 833, 2024-01-25T15:04:49.110 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 833, 2024-01-25T15:04:49.110 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 833, 2024-01-25T15:04:49.110 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 833, 2024-01-25T15:04:49.111 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-01-25T15:04:49.111 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.111 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.111 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.111 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:49.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.111 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-write_buf_throttle": { 2024-01-25T15:04:49.111 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-01-25T15:04:49.111 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 3758096384, 2024-01-25T15:04:49.111 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-01-25T15:04:49.111 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-01-25T15:04:49.111 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-01-25T15:04:49.111 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-01-25T15:04:49.111 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-01-25T15:04:49.111 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-01-25T15:04:49.112 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-01-25T15:04:49.112 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 0, 2024-01-25T15:04:49.112 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 0, 2024-01-25T15:04:49.112 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-01-25T15:04:49.112 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.112 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.112 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.112 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:49.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:49.112 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-write_buf_throttle-0x557debe76960": { 2024-01-25T15:04:49.112 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-01-25T15:04:49.112 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 3758096384, 2024-01-25T15:04:49.112 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-01-25T15:04:49.113 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-01-25T15:04:49.113 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-01-25T15:04:49.113 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-01-25T15:04:49.113 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-01-25T15:04:49.113 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-01-25T15:04:49.113 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-01-25T15:04:49.113 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 0, 2024-01-25T15:04:49.113 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 0, 2024-01-25T15:04:49.113 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-01-25T15:04:49.113 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:49.113 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:49.113 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:49.113 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:49.113 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:49.113 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:04:49.307 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:49 smithi170 ceph-mon[31899]: pgmap v433: 97 pgs: 97 active+clean; 31 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 410 op/s 2024-01-25T15:04:49.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:49 smithi191 ceph-mon[36347]: pgmap v433: 97 pgs: 97 active+clean; 31 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 410 op/s 2024-01-25T15:04:49.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:49 smithi186 ceph-mon[35697]: pgmap v433: 97 pgs: 97 active+clean; 31 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 410 op/s 2024-01-25T15:04:49.908 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-01-25T15:04:49.908 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-01-25T15:04:49.908 DEBUG:tasks.check_counter:Getting stats from d 2024-01-25T15:04:49.909 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph daemon mds.d perf dump 2024-01-25T15:04:50.154 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:04:51.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:51 smithi186 ceph-mon[35697]: pgmap v434: 97 pgs: 97 active+clean; 30 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 878 KiB/s wr, 362 op/s 2024-01-25T15:04:51.611 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:51 smithi170 ceph-mon[31899]: pgmap v434: 97 pgs: 97 active+clean; 30 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 878 KiB/s wr, 362 op/s 2024-01-25T15:04:51.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:51 smithi191 ceph-mon[36347]: pgmap v434: 97 pgs: 97 active+clean; 30 MiB data, 800 MiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 878 KiB/s wr, 362 op/s 2024-01-25T15:04:51.879 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:04:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-0": { 2024-01-25T15:04:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 0, 2024-01-25T15:04:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 2, 2024-01-25T15:04:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 0, 2024-01-25T15:04:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 0, 2024-01-25T15:04:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 4, 2024-01-25T15:04:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 0, 2024-01-25T15:04:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.000976033, 2024-01-25T15:04:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.000000000, 2024-01-25T15:04:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.000105792, 2024-01-25T15:04:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-01-25T15:04:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:04:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:04:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 0, 2024-01-25T15:04:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 0 2024-01-25T15:04:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-1": { 2024-01-25T15:04:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 1, 2024-01-25T15:04:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 68, 2024-01-25T15:04:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 160, 2024-01-25T15:04:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 88960, 2024-01-25T15:04:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 3, 2024-01-25T15:04:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 2, 2024-01-25T15:04:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.005138951, 2024-01-25T15:04:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.003466748, 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.001042178, 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 66, 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.003045393, 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000046142 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 160, 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 88960 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-2": { 2024-01-25T15:04:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 100, 2024-01-25T15:04:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 93, 2024-01-25T15:04:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 711392, 2024-01-25T15:04:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 53872, 2024-01-25T15:04:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 2, 2024-01-25T15:04:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 1, 2024-01-25T15:04:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.019110668, 2024-01-25T15:04:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.005442037, 2024-01-25T15:04:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.016763691, 2024-01-25T15:04:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.001682056, 2024-01-25T15:04:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:04:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 93, 2024-01-25T15:04:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.004669265, 2024-01-25T15:04:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000050207 2024-01-25T15:04:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:04:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 711392, 2024-01-25T15:04:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 53872 2024-01-25T15:04:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "cct": { 2024-01-25T15:04:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "total_workers": 0, 2024-01-25T15:04:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "unhealthy_workers": 0 2024-01-25T15:04:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "mempool": { 2024-01-25T15:04:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_bytes": 0, 2024-01-25T15:04:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_items": 0, 2024-01-25T15:04:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_bytes": 0, 2024-01-25T15:04:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_items": 0, 2024-01-25T15:04:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_bytes": 0, 2024-01-25T15:04:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_items": 0, 2024-01-25T15:04:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-25T15:04:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_items": 0, 2024-01-25T15:04:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-25T15:04:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_items": 0, 2024-01-25T15:04:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_bytes": 0, 2024-01-25T15:04:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_items": 0, 2024-01-25T15:04:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-25T15:04:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_items": 0, 2024-01-25T15:04:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_bytes": 0, 2024-01-25T15:04:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_items": 0, 2024-01-25T15:04:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_bytes": 0, 2024-01-25T15:04:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_items": 0, 2024-01-25T15:04:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-25T15:04:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_items": 0, 2024-01-25T15:04:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-25T15:04:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_items": 0, 2024-01-25T15:04:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_bytes": 0, 2024-01-25T15:04:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_items": 0, 2024-01-25T15:04:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_bytes": 0, 2024-01-25T15:04:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_items": 0, 2024-01-25T15:04:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-25T15:04:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_items": 0, 2024-01-25T15:04:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_bytes": 0, 2024-01-25T15:04:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_items": 0, 2024-01-25T15:04:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_bytes": 0, 2024-01-25T15:04:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_items": 0, 2024-01-25T15:04:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_bytes": 0, 2024-01-25T15:04:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_items": 0, 2024-01-25T15:04:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_bytes": 0, 2024-01-25T15:04:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_items": 0, 2024-01-25T15:04:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_bytes": 148841, 2024-01-25T15:04:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_items": 28, 2024-01-25T15:04:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_bytes": 0, 2024-01-25T15:04:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_items": 0, 2024-01-25T15:04:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_bytes": 0, 2024-01-25T15:04:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_items": 0, 2024-01-25T15:04:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_bytes": 0, 2024-01-25T15:04:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_items": 0, 2024-01-25T15:04:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_bytes": 0, 2024-01-25T15:04:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_items": 0, 2024-01-25T15:04:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_bytes": 0, 2024-01-25T15:04:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_items": 0, 2024-01-25T15:04:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_bytes": 0, 2024-01-25T15:04:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_items": 0, 2024-01-25T15:04:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_bytes": 0, 2024-01-25T15:04:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_items": 0, 2024-01-25T15:04:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_bytes": 928, 2024-01-25T15:04:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_items": 2, 2024-01-25T15:04:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_bytes": 0, 2024-01-25T15:04:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_items": 0, 2024-01-25T15:04:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_bytes": 0, 2024-01-25T15:04:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_items": 0 2024-01-25T15:04:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-25T15:04:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-01-25T15:04:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-01-25T15:04:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-01-25T15:04:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 97, 2024-01-25T15:04:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 694886, 2024-01-25T15:04:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-01-25T15:04:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 97, 2024-01-25T15:04:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-01-25T15:04:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-01-25T15:04:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 97, 2024-01-25T15:04:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 694886, 2024-01-25T15:04:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-01-25T15:04:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:51.891 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:04:52.601 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-01-25T15:04:52.601 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-01-25T15:04:52.601 DEBUG:tasks.check_counter:Getting stats from g 2024-01-25T15:04:52.601 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph daemon mds.g perf dump 2024-01-25T15:04:52.843 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:04:53.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:53 smithi186 ceph-mon[35697]: pgmap v435: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 770 KiB/s wr, 274 op/s 2024-01-25T15:04:53.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:53 smithi170 ceph-mon[31899]: pgmap v435: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 770 KiB/s wr, 274 op/s 2024-01-25T15:04:53.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:53 smithi191 ceph-mon[36347]: pgmap v435: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 801 KiB/s rd, 770 KiB/s wr, 274 op/s 2024-01-25T15:04:54.696 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:04:54.697 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-0": { 2024-01-25T15:04:54.697 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 299, 2024-01-25T15:04:54.697 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 299, 2024-01-25T15:04:54.697 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 102057, 2024-01-25T15:04:54.697 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 92194, 2024-01-25T15:04:54.697 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 6, 2024-01-25T15:04:54.697 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 2, 2024-01-25T15:04:54.697 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.030558242, 2024-01-25T15:04:54.697 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.011843464, 2024-01-25T15:04:54.697 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.007121146, 2024-01-25T15:04:54.697 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.008114837, 2024-01-25T15:04:54.697 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:04:54.697 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 298, 2024-01-25T15:04:54.698 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.013691522, 2024-01-25T15:04:54.698 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000045944 2024-01-25T15:04:54.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.698 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:04:54.698 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.698 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.698 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.698 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-01-25T15:04:54.698 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 448 2024-01-25T15:04:54.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.698 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-1": { 2024-01-25T15:04:54.698 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 548, 2024-01-25T15:04:54.698 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 613, 2024-01-25T15:04:54.699 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 3695544, 2024-01-25T15:04:54.699 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 362286, 2024-01-25T15:04:54.699 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 5, 2024-01-25T15:04:54.699 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 4, 2024-01-25T15:04:54.699 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.039803410, 2024-01-25T15:04:54.699 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.011809662, 2024-01-25T15:04:54.699 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.013322364, 2024-01-25T15:04:54.699 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.011796396, 2024-01-25T15:04:54.699 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:04:54.699 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 611, 2024-01-25T15:04:54.699 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.015543662, 2024-01-25T15:04:54.699 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000025439 2024-01-25T15:04:54.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.699 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 160, 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 192112 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-2": { 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 119, 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 97, 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 833428, 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 53056, 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 4, 2024-01-25T15:04:54.700 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 3, 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.018984511, 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.005275259, 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.017630342, 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.001595397, 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 96, 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.005056810, 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000052675 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 832080, 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 52112 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi170.stdout: "cct": { 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi170.stdout: "total_workers": 1, 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi170.stdout: "unhealthy_workers": 0 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi170.stdout: "finisher-MDSRank": { 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi170.stdout: "queue_len": 0, 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi170.stdout: "complete_latency": { 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 1493, 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.032762303, 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000021943 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:54.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi170.stdout: "finisher-PurgeQueue": { 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi170.stdout: "queue_len": 0, 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi170.stdout: "complete_latency": { 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi170.stdout: "mds": { 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi170.stdout: "request": 0, 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi170.stdout: "reply": 0, 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi170.stdout: "reply_latency": { 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.703 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi170.stdout: "slow_reply": 0, 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi170.stdout: "forward": 0, 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_fetch_complete": 0, 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_fetch_keys": 0, 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_commit": 0, 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_split": 0, 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_merge": 0, 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes": 446, 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_top": 0, 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_bottom": 446, 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_pin_tail": 0, 2024-01-25T15:04:54.704 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_pinned": 446, 2024-01-25T15:04:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_expired": 0, 2024-01-25T15:04:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: "inodes_with_caps": 0, 2024-01-25T15:04:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: "caps": 0, 2024-01-25T15:04:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: "subtrees": 1, 2024-01-25T15:04:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse": 0, 2024-01-25T15:04:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_hit": 0, 2024-01-25T15:04:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_forward": 0, 2024-01-25T15:04:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_discover": 0, 2024-01-25T15:04:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_dir_fetch": 0, 2024-01-25T15:04:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_remote_ino": 0, 2024-01-25T15:04:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: "traverse_lock": 0, 2024-01-25T15:04:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: "load_cent": 0, 2024-01-25T15:04:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: "q": 0, 2024-01-25T15:04:54.705 INFO:teuthology.orchestra.run.smithi170.stdout: "exported": 0, 2024-01-25T15:04:54.706 INFO:teuthology.orchestra.run.smithi170.stdout: "exported_inodes": 0, 2024-01-25T15:04:54.706 INFO:teuthology.orchestra.run.smithi170.stdout: "imported": 0, 2024-01-25T15:04:54.706 INFO:teuthology.orchestra.run.smithi170.stdout: "imported_inodes": 0, 2024-01-25T15:04:54.706 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_dir_fetch": 0, 2024-01-25T15:04:54.706 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_backtrace_fetch": 0, 2024-01-25T15:04:54.706 INFO:teuthology.orchestra.run.smithi170.stdout: "openino_peer_discover": 0, 2024-01-25T15:04:54.706 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rfiles": 0, 2024-01-25T15:04:54.706 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rbytes": 0, 2024-01-25T15:04:54.706 INFO:teuthology.orchestra.run.smithi170.stdout: "root_rsnaps": 0, 2024-01-25T15:04:54.706 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_backtrace_fetch": 0, 2024-01-25T15:04:54.707 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_set_tag": 0, 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_backtrace_repaired": 0, 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_inotable_repaired": 0, 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dir_inodes": 0, 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dir_base_inodes": 0, 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_dirfrag_rstats": 0, 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi170.stdout: "scrub_file_inodes": 0, 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_inode_file_caps": 0, 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_revoke": 0, 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_grant": 0, 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_trunc": 0, 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi170.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-25T15:04:54.708 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_caps": 0, 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_caps_dirty": 0, 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_cap_release": 0, 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi170.stdout: "process_request_cap_release": 0 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_cache": { 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_update": 0, 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_update_receipt": 0, 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_try_discover": 0, 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_send_discover": 0, 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi170.stdout: "dir_handle_discover": 0, 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays": 0, 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays_delayed": 0, 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi170.stdout: "num_strays_enqueuing": 0, 2024-01-25T15:04:54.709 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_created": 0, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_enqueued": 0, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_reintegrated": 0, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi170.stdout: "strays_migrated": 0, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_processing": 0, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_enqueued": 0, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi170.stdout: "num_recovering_prioritized": 0, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi170.stdout: "recovery_started": 0, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi170.stdout: "recovery_completed": 0, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_enqueue_scrub": 0, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_exportdir": 0, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_flush": 0, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_fragmentdir": 0, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_fragstats": 0, 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi170.stdout: "ireq_inodestats": 0 2024-01-25T15:04:54.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_log": { 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi170.stdout: "evlrg": 0, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi170.stdout: "evadd": 0, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi170.stdout: "evex": 0, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi170.stdout: "evtrm": 0, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi170.stdout: "ev": 1813, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi170.stdout: "evexg": 0, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi170.stdout: "evexd": 0, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi170.stdout: "segadd": 0, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi170.stdout: "segex": 0, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi170.stdout: "segtrm": 0, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi170.stdout: "seg": 3, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi170.stdout: "segmjr": 2, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi170.stdout: "segexg": 0, 2024-01-25T15:04:54.711 INFO:teuthology.orchestra.run.smithi170.stdout: "segexd": 0, 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi170.stdout: "expos": 4194304, 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi170.stdout: "wrpos": 7750358, 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi170.stdout: "rdpos": 7749220, 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi170.stdout: "jlat": { 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi170.stdout: "replayed": 1813 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_mem": { 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi170.stdout: "ino": 9, 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi170.stdout: "ino+": 633, 2024-01-25T15:04:54.712 INFO:teuthology.orchestra.run.smithi170.stdout: "ino-": 624, 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi170.stdout: "dir": 7, 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi170.stdout: "dir+": 235, 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi170.stdout: "dir-": 228, 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi170.stdout: "dn": 446, 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi170.stdout: "dn+": 1077, 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi170.stdout: "dn-": 631, 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi170.stdout: "cap": 0, 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi170.stdout: "cap+": 0, 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi170.stdout: "cap-": 0, 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi170.stdout: "rss": 51276, 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi170.stdout: "heap": 207228 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_server": { 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi170.stdout: "dispatch_client_request": 0, 2024-01-25T15:04:54.713 INFO:teuthology.orchestra.run.smithi170.stdout: "dispatch_server_request": 0, 2024-01-25T15:04:54.714 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_request": 0, 2024-01-25T15:04:54.714 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_client_session": 0, 2024-01-25T15:04:54.714 INFO:teuthology.orchestra.run.smithi170.stdout: "handle_peer_request": 0, 2024-01-25T15:04:54.714 INFO:teuthology.orchestra.run.smithi170.stdout: "req_create_latency": { 2024-01-25T15:04:54.714 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.714 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.714 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.714 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getattr_latency": { 2024-01-25T15:04:54.714 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.714 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.714 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.714 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getfilelock_latency": { 2024-01-25T15:04:54.715 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.715 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.715 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.715 INFO:teuthology.orchestra.run.smithi170.stdout: "req_link_latency": { 2024-01-25T15:04:54.715 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.715 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.715 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.715 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookup_latency": { 2024-01-25T15:04:54.715 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.715 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.715 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.715 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookuphash_latency": { 2024-01-25T15:04:54.716 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.716 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.716 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.716 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupino_latency": { 2024-01-25T15:04:54.716 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.716 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.716 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.716 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupname_latency": { 2024-01-25T15:04:54.716 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.716 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.716 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupparent_latency": { 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lookupsnap_latency": { 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: "req_lssnap_latency": { 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.718 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mkdir_latency": { 2024-01-25T15:04:54.718 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.718 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.718 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.719 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mknod_latency": { 2024-01-25T15:04:54.719 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.719 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.719 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.719 INFO:teuthology.orchestra.run.smithi170.stdout: "req_mksnap_latency": { 2024-01-25T15:04:54.719 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.719 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.719 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.719 INFO:teuthology.orchestra.run.smithi170.stdout: "req_open_latency": { 2024-01-25T15:04:54.719 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.720 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.720 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.720 INFO:teuthology.orchestra.run.smithi170.stdout: "req_readdir_latency": { 2024-01-25T15:04:54.720 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.720 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.720 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.720 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rename_latency": { 2024-01-25T15:04:54.720 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.720 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.720 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.720 INFO:teuthology.orchestra.run.smithi170.stdout: "req_renamesnap_latency": { 2024-01-25T15:04:54.721 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.721 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.721 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.721 INFO:teuthology.orchestra.run.smithi170.stdout: "req_snapdiff_latency": { 2024-01-25T15:04:54.721 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.721 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.721 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.721 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmdir_latency": { 2024-01-25T15:04:54.721 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.721 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.721 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.722 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmsnap_latency": { 2024-01-25T15:04:54.722 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.722 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.722 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.722 INFO:teuthology.orchestra.run.smithi170.stdout: "req_rmxattr_latency": { 2024-01-25T15:04:54.722 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.722 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.722 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.722 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setattr_latency": { 2024-01-25T15:04:54.722 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.722 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.722 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.723 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setdirlayout_latency": { 2024-01-25T15:04:54.723 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.723 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.723 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.723 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setfilelock_latency": { 2024-01-25T15:04:54.723 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.723 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.723 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.723 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setlayout_latency": { 2024-01-25T15:04:54.723 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.723 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.723 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.724 INFO:teuthology.orchestra.run.smithi170.stdout: "req_setxattr_latency": { 2024-01-25T15:04:54.724 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.724 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.724 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.724 INFO:teuthology.orchestra.run.smithi170.stdout: "req_symlink_latency": { 2024-01-25T15:04:54.724 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.724 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.724 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.724 INFO:teuthology.orchestra.run.smithi170.stdout: "req_unlink_latency": { 2024-01-25T15:04:54.724 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.725 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.725 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.725 INFO:teuthology.orchestra.run.smithi170.stdout: "cap_revoke_eviction": 0, 2024-01-25T15:04:54.725 INFO:teuthology.orchestra.run.smithi170.stdout: "cap_acquisition_throttle": 0, 2024-01-25T15:04:54.725 INFO:teuthology.orchestra.run.smithi170.stdout: "req_getvxattr_latency": { 2024-01-25T15:04:54.725 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.725 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.725 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.725 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:54.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.725 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_sessions": { 2024-01-25T15:04:54.725 INFO:teuthology.orchestra.run.smithi170.stdout: "session_count": 1, 2024-01-25T15:04:54.725 INFO:teuthology.orchestra.run.smithi170.stdout: "session_add": 2, 2024-01-25T15:04:54.725 INFO:teuthology.orchestra.run.smithi170.stdout: "session_remove": 1, 2024-01-25T15:04:54.726 INFO:teuthology.orchestra.run.smithi170.stdout: "sessions_open": 1, 2024-01-25T15:04:54.726 INFO:teuthology.orchestra.run.smithi170.stdout: "sessions_stale": 0, 2024-01-25T15:04:54.726 INFO:teuthology.orchestra.run.smithi170.stdout: "total_load": 0, 2024-01-25T15:04:54.726 INFO:teuthology.orchestra.run.smithi170.stdout: "average_load": 0, 2024-01-25T15:04:54.726 INFO:teuthology.orchestra.run.smithi170.stdout: "avg_session_uptime": 1240, 2024-01-25T15:04:54.726 INFO:teuthology.orchestra.run.smithi170.stdout: "mdthresh_evicted": 0 2024-01-25T15:04:54.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.726 INFO:teuthology.orchestra.run.smithi170.stdout: "mempool": { 2024-01-25T15:04:54.726 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_bytes": 0, 2024-01-25T15:04:54.726 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_items": 0, 2024-01-25T15:04:54.726 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_bytes": 0, 2024-01-25T15:04:54.726 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_items": 0, 2024-01-25T15:04:54.726 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_bytes": 0, 2024-01-25T15:04:54.726 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_items": 0, 2024-01-25T15:04:54.727 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-25T15:04:54.727 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_items": 0, 2024-01-25T15:04:54.727 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-25T15:04:54.727 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_items": 0, 2024-01-25T15:04:54.727 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_bytes": 0, 2024-01-25T15:04:54.727 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_items": 0, 2024-01-25T15:04:54.727 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-25T15:04:54.727 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_items": 0, 2024-01-25T15:04:54.727 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_bytes": 0, 2024-01-25T15:04:54.727 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_items": 0, 2024-01-25T15:04:54.727 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_bytes": 0, 2024-01-25T15:04:54.727 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_items": 0, 2024-01-25T15:04:54.727 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-25T15:04:54.727 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_items": 0, 2024-01-25T15:04:54.728 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-25T15:04:54.728 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_items": 0, 2024-01-25T15:04:54.728 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_bytes": 0, 2024-01-25T15:04:54.728 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_items": 0, 2024-01-25T15:04:54.728 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_bytes": 0, 2024-01-25T15:04:54.728 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_items": 0, 2024-01-25T15:04:54.728 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-25T15:04:54.728 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_items": 0, 2024-01-25T15:04:54.728 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_bytes": 0, 2024-01-25T15:04:54.728 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_items": 0, 2024-01-25T15:04:54.728 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_bytes": 0, 2024-01-25T15:04:54.728 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_items": 0, 2024-01-25T15:04:54.728 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_bytes": 0, 2024-01-25T15:04:54.728 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_items": 0, 2024-01-25T15:04:54.729 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_bytes": 0, 2024-01-25T15:04:54.729 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_items": 0, 2024-01-25T15:04:54.729 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_bytes": 197484, 2024-01-25T15:04:54.729 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_items": 57, 2024-01-25T15:04:54.729 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_bytes": 0, 2024-01-25T15:04:54.729 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_items": 0, 2024-01-25T15:04:54.729 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_bytes": 0, 2024-01-25T15:04:54.729 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_items": 0, 2024-01-25T15:04:54.729 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_bytes": 0, 2024-01-25T15:04:54.729 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_items": 0, 2024-01-25T15:04:54.729 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_bytes": 0, 2024-01-25T15:04:54.729 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_items": 0, 2024-01-25T15:04:54.729 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_bytes": 7432, 2024-01-25T15:04:54.729 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_items": 156, 2024-01-25T15:04:54.730 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_bytes": 0, 2024-01-25T15:04:54.730 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_items": 0, 2024-01-25T15:04:54.730 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_bytes": 0, 2024-01-25T15:04:54.730 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_items": 0, 2024-01-25T15:04:54.730 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_bytes": 344180, 2024-01-25T15:04:54.730 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_items": 2339, 2024-01-25T15:04:54.730 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_bytes": 0, 2024-01-25T15:04:54.730 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_items": 0, 2024-01-25T15:04:54.730 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_bytes": 0, 2024-01-25T15:04:54.730 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_items": 0 2024-01-25T15:04:54.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.730 INFO:teuthology.orchestra.run.smithi170.stdout: "objecter": { 2024-01-25T15:04:54.730 INFO:teuthology.orchestra.run.smithi170.stdout: "op_active": 0, 2024-01-25T15:04:54.730 INFO:teuthology.orchestra.run.smithi170.stdout: "op_laggy": 0, 2024-01-25T15:04:54.731 INFO:teuthology.orchestra.run.smithi170.stdout: "op_send": 845, 2024-01-25T15:04:54.731 INFO:teuthology.orchestra.run.smithi170.stdout: "op_send_bytes": 21, 2024-01-25T15:04:54.731 INFO:teuthology.orchestra.run.smithi170.stdout: "op_resend": 3, 2024-01-25T15:04:54.731 INFO:teuthology.orchestra.run.smithi170.stdout: "op_reply": 845, 2024-01-25T15:04:54.731 INFO:teuthology.orchestra.run.smithi170.stdout: "op_latency": { 2024-01-25T15:04:54.731 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 845, 2024-01-25T15:04:54.731 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 1.294969661, 2024-01-25T15:04:54.731 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.001532508 2024-01-25T15:04:54.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.731 INFO:teuthology.orchestra.run.smithi170.stdout: "op_inflight": 0, 2024-01-25T15:04:54.731 INFO:teuthology.orchestra.run.smithi170.stdout: "oplen_avg": { 2024-01-25T15:04:54.731 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 845, 2024-01-25T15:04:54.731 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 846 2024-01-25T15:04:54.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.731 INFO:teuthology.orchestra.run.smithi170.stdout: "op": 845, 2024-01-25T15:04:54.732 INFO:teuthology.orchestra.run.smithi170.stdout: "op_r": 845, 2024-01-25T15:04:54.732 INFO:teuthology.orchestra.run.smithi170.stdout: "op_w": 0, 2024-01-25T15:04:54.732 INFO:teuthology.orchestra.run.smithi170.stdout: "op_rmw": 0, 2024-01-25T15:04:54.732 INFO:teuthology.orchestra.run.smithi170.stdout: "op_pg": 0, 2024-01-25T15:04:54.732 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_stat": 477, 2024-01-25T15:04:54.732 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_create": 0, 2024-01-25T15:04:54.732 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_read": 366, 2024-01-25T15:04:54.732 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_write": 0, 2024-01-25T15:04:54.732 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_writefull": 0, 2024-01-25T15:04:54.732 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_writesame": 0, 2024-01-25T15:04:54.732 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_append": 0, 2024-01-25T15:04:54.732 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_zero": 0, 2024-01-25T15:04:54.733 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_truncate": 0, 2024-01-25T15:04:54.733 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_delete": 0, 2024-01-25T15:04:54.733 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_mapext": 0, 2024-01-25T15:04:54.733 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_sparse_read": 0, 2024-01-25T15:04:54.733 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_clonerange": 0, 2024-01-25T15:04:54.733 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_getxattr": 1, 2024-01-25T15:04:54.733 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_setxattr": 0, 2024-01-25T15:04:54.733 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_cmpxattr": 0, 2024-01-25T15:04:54.733 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_rmxattr": 0, 2024-01-25T15:04:54.733 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_resetxattrs": 0, 2024-01-25T15:04:54.733 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_call": 0, 2024-01-25T15:04:54.733 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_watch": 0, 2024-01-25T15:04:54.733 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_notify": 0, 2024-01-25T15:04:54.733 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_src_cmpxattr": 0, 2024-01-25T15:04:54.734 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_pgls": 0, 2024-01-25T15:04:54.734 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_pgls_filter": 0, 2024-01-25T15:04:54.734 INFO:teuthology.orchestra.run.smithi170.stdout: "osdop_other": 0, 2024-01-25T15:04:54.734 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_active": 0, 2024-01-25T15:04:54.734 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_send": 0, 2024-01-25T15:04:54.734 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_resend": 0, 2024-01-25T15:04:54.734 INFO:teuthology.orchestra.run.smithi170.stdout: "linger_ping": 0, 2024-01-25T15:04:54.734 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_active": 0, 2024-01-25T15:04:54.734 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_send": 0, 2024-01-25T15:04:54.734 INFO:teuthology.orchestra.run.smithi170.stdout: "poolop_resend": 0, 2024-01-25T15:04:54.734 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_active": 0, 2024-01-25T15:04:54.734 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_send": 0, 2024-01-25T15:04:54.734 INFO:teuthology.orchestra.run.smithi170.stdout: "poolstat_resend": 0, 2024-01-25T15:04:54.734 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_active": 0, 2024-01-25T15:04:54.735 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_send": 0, 2024-01-25T15:04:54.735 INFO:teuthology.orchestra.run.smithi170.stdout: "statfs_resend": 0, 2024-01-25T15:04:54.735 INFO:teuthology.orchestra.run.smithi170.stdout: "command_active": 0, 2024-01-25T15:04:54.735 INFO:teuthology.orchestra.run.smithi170.stdout: "command_send": 0, 2024-01-25T15:04:54.735 INFO:teuthology.orchestra.run.smithi170.stdout: "command_resend": 0, 2024-01-25T15:04:54.735 INFO:teuthology.orchestra.run.smithi170.stdout: "map_epoch": 87, 2024-01-25T15:04:54.735 INFO:teuthology.orchestra.run.smithi170.stdout: "map_full": 0, 2024-01-25T15:04:54.735 INFO:teuthology.orchestra.run.smithi170.stdout: "map_inc": 2, 2024-01-25T15:04:54.735 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_sessions": 6, 2024-01-25T15:04:54.735 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_session_open": 6, 2024-01-25T15:04:54.735 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_session_close": 0, 2024-01-25T15:04:54.735 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_laggy": 0, 2024-01-25T15:04:54.735 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_wr": 0, 2024-01-25T15:04:54.735 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_rd": 2, 2024-01-25T15:04:54.736 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_del": 0 2024-01-25T15:04:54.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.736 INFO:teuthology.orchestra.run.smithi170.stdout: "oft": { 2024-01-25T15:04:54.736 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_objs": 0, 2024-01-25T15:04:54.736 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_kv_pairs": 0, 2024-01-25T15:04:54.736 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_updates": 0, 2024-01-25T15:04:54.736 INFO:teuthology.orchestra.run.smithi170.stdout: "omap_total_removes": 0 2024-01-25T15:04:54.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.736 INFO:teuthology.orchestra.run.smithi170.stdout: "osd-slow-ops": { 2024-01-25T15:04:54.736 INFO:teuthology.orchestra.run.smithi170.stdout: "slow_ops_count": 0 2024-01-25T15:04:54.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.736 INFO:teuthology.orchestra.run.smithi170.stdout: "purge_queue": { 2024-01-25T15:04:54.736 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_ops": 0, 2024-01-25T15:04:54.737 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_ops_high_water": 0, 2024-01-25T15:04:54.737 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing": 0, 2024-01-25T15:04:54.737 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executing_high_water": 0, 2024-01-25T15:04:54.737 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executed_ops": 0, 2024-01-25T15:04:54.737 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_executed": 0, 2024-01-25T15:04:54.737 INFO:teuthology.orchestra.run.smithi170.stdout: "pq_item_in_journal": 0 2024-01-25T15:04:54.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.737 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-25T15:04:54.737 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-01-25T15:04:54.737 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-01-25T15:04:54.737 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-01-25T15:04:54.737 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 962, 2024-01-25T15:04:54.737 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 4535645, 2024-01-25T15:04:54.737 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-01-25T15:04:54.738 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 962, 2024-01-25T15:04:54.738 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-01-25T15:04:54.738 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-01-25T15:04:54.738 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 962, 2024-01-25T15:04:54.738 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 4535645, 2024-01-25T15:04:54.738 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-01-25T15:04:54.738 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.738 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.738 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.738 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:54.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.738 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-objecter_bytes": { 2024-01-25T15:04:54.738 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-01-25T15:04:54.738 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-01-25T15:04:54.738 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-01-25T15:04:54.739 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-01-25T15:04:54.739 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-01-25T15:04:54.739 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-01-25T15:04:54.739 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-01-25T15:04:54.739 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 845, 2024-01-25T15:04:54.739 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 3556059, 2024-01-25T15:04:54.739 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 845, 2024-01-25T15:04:54.739 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 3556059, 2024-01-25T15:04:54.739 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-01-25T15:04:54.739 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.739 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.739 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.739 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:54.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.740 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-objecter_ops": { 2024-01-25T15:04:54.740 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-01-25T15:04:54.740 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 1024, 2024-01-25T15:04:54.740 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-01-25T15:04:54.740 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-01-25T15:04:54.740 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-01-25T15:04:54.740 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-01-25T15:04:54.740 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-01-25T15:04:54.740 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 845, 2024-01-25T15:04:54.740 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 845, 2024-01-25T15:04:54.740 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 845, 2024-01-25T15:04:54.740 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 845, 2024-01-25T15:04:54.740 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-01-25T15:04:54.741 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.741 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.741 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.741 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:54.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.741 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-write_buf_throttle": { 2024-01-25T15:04:54.741 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-01-25T15:04:54.741 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 3758096384, 2024-01-25T15:04:54.741 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-01-25T15:04:54.741 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-01-25T15:04:54.741 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-01-25T15:04:54.741 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-01-25T15:04:54.741 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-01-25T15:04:54.741 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-01-25T15:04:54.742 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-01-25T15:04:54.742 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 0, 2024-01-25T15:04:54.742 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 0, 2024-01-25T15:04:54.742 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-01-25T15:04:54.742 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.742 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.742 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.742 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:54.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:54.742 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-write_buf_throttle-0x55c334276960": { 2024-01-25T15:04:54.742 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-01-25T15:04:54.742 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 3758096384, 2024-01-25T15:04:54.742 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-01-25T15:04:54.742 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 0, 2024-01-25T15:04:54.743 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 0, 2024-01-25T15:04:54.743 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-01-25T15:04:54.743 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 0, 2024-01-25T15:04:54.743 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-01-25T15:04:54.743 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-01-25T15:04:54.743 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 0, 2024-01-25T15:04:54.743 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 0, 2024-01-25T15:04:54.743 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-01-25T15:04:54.743 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:54.743 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:54.743 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:54.743 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:54.743 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:54.743 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:04:55.477 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-01-25T15:04:55.477 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-01-25T15:04:55.477 DEBUG:tasks.check_counter:Getting stats from j 2024-01-25T15:04:55.477 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph daemon mds.j perf dump 2024-01-25T15:04:55.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:55 smithi186 ceph-mon[35697]: pgmap v436: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 740 KiB/s wr, 234 op/s 2024-01-25T15:04:55.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:55 smithi170 ceph-mon[31899]: pgmap v436: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 740 KiB/s wr, 234 op/s 2024-01-25T15:04:55.719 INFO:teuthology.orchestra.run.smithi170.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.a/config 2024-01-25T15:04:55.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:55 smithi191 ceph-mon[36347]: pgmap v436: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 793 KiB/s rd, 740 KiB/s wr, 234 op/s 2024-01-25T15:04:57.401 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:57 smithi170 ceph-mon[31899]: pgmap v437: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 163 KiB/s wr, 69 op/s 2024-01-25T15:04:57.401 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-01-25T15:04:57.402 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-0": { 2024-01-25T15:04:57.402 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 0, 2024-01-25T15:04:57.402 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 2, 2024-01-25T15:04:57.402 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 0, 2024-01-25T15:04:57.402 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 0, 2024-01-25T15:04:57.402 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 4, 2024-01-25T15:04:57.402 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 0, 2024-01-25T15:04:57.402 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.001011319, 2024-01-25T15:04:57.402 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.000000000, 2024-01-25T15:04:57.402 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.000187817, 2024-01-25T15:04:57.403 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-01-25T15:04:57.403 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:04:57.403 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:57.403 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:57.403 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:57.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:57.403 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:04:57.403 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:57.403 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:57.403 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:57.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:57.403 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 0, 2024-01-25T15:04:57.403 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 0 2024-01-25T15:04:57.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:57.404 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-1": { 2024-01-25T15:04:57.404 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 1, 2024-01-25T15:04:57.404 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 70, 2024-01-25T15:04:57.404 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 160, 2024-01-25T15:04:57.404 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 89312, 2024-01-25T15:04:57.404 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 3, 2024-01-25T15:04:57.404 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 2, 2024-01-25T15:04:57.404 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.005453445, 2024-01-25T15:04:57.404 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.003730898, 2024-01-25T15:04:57.404 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.001092161, 2024-01-25T15:04:57.404 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-01-25T15:04:57.404 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:04:57.404 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 68, 2024-01-25T15:04:57.405 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.002790288, 2024-01-25T15:04:57.405 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000041033 2024-01-25T15:04:57.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:57.405 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:04:57.405 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:57.405 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:57.405 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:57.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:57.405 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 160, 2024-01-25T15:04:57.405 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 89312 2024-01-25T15:04:57.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:57.405 INFO:teuthology.orchestra.run.smithi170.stdout: "AsyncMessenger::Worker-2": { 2024-01-25T15:04:57.405 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_messages": 102, 2024-01-25T15:04:57.406 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages": 95, 2024-01-25T15:04:57.406 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_bytes": 711936, 2024-01-25T15:04:57.406 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_bytes": 55120, 2024-01-25T15:04:57.406 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_created_connections": 2, 2024-01-25T15:04:57.406 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_active_connections": 1, 2024-01-25T15:04:57.406 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_total_time": 0.018195546, 2024-01-25T15:04:57.406 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_send_time": 0.005500710, 2024-01-25T15:04:57.406 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_recv_time": 0.015608555, 2024-01-25T15:04:57.406 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_running_fast_dispatch_time": 0.001677202, 2024-01-25T15:04:57.406 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:04:57.406 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 95, 2024-01-25T15:04:57.406 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.005284416, 2024-01-25T15:04:57.406 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000055625 2024-01-25T15:04:57.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:57.407 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:04:57.407 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:57.407 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:57.407 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:57.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:57.407 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_recv_encrypted_bytes": 711936, 2024-01-25T15:04:57.407 INFO:teuthology.orchestra.run.smithi170.stdout: "msgr_send_encrypted_bytes": 55120 2024-01-25T15:04:57.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:57.407 INFO:teuthology.orchestra.run.smithi170.stdout: "cct": { 2024-01-25T15:04:57.407 INFO:teuthology.orchestra.run.smithi170.stdout: "total_workers": 0, 2024-01-25T15:04:57.407 INFO:teuthology.orchestra.run.smithi170.stdout: "unhealthy_workers": 0 2024-01-25T15:04:57.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:57.407 INFO:teuthology.orchestra.run.smithi170.stdout: "mempool": { 2024-01-25T15:04:57.408 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_bytes": 0, 2024-01-25T15:04:57.408 INFO:teuthology.orchestra.run.smithi170.stdout: "bloom_filter_items": 0, 2024-01-25T15:04:57.408 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_bytes": 0, 2024-01-25T15:04:57.408 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_alloc_items": 0, 2024-01-25T15:04:57.408 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_bytes": 0, 2024-01-25T15:04:57.408 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_data_items": 0, 2024-01-25T15:04:57.408 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-25T15:04:57.408 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_onode_items": 0, 2024-01-25T15:04:57.408 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-25T15:04:57.408 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_meta_items": 0, 2024-01-25T15:04:57.408 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_bytes": 0, 2024-01-25T15:04:57.408 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_other_items": 0, 2024-01-25T15:04:57.408 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-25T15:04:57.408 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_cache_buffer_items": 0, 2024-01-25T15:04:57.409 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_bytes": 0, 2024-01-25T15:04:57.409 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_extent_items": 0, 2024-01-25T15:04:57.409 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_bytes": 0, 2024-01-25T15:04:57.409 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_blob_items": 0, 2024-01-25T15:04:57.409 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-25T15:04:57.409 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_shared_blob_items": 0, 2024-01-25T15:04:57.409 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-25T15:04:57.409 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_inline_bl_items": 0, 2024-01-25T15:04:57.409 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_bytes": 0, 2024-01-25T15:04:57.409 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_fsck_items": 0, 2024-01-25T15:04:57.409 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_bytes": 0, 2024-01-25T15:04:57.409 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_txc_items": 0, 2024-01-25T15:04:57.409 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-25T15:04:57.410 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_deferred_items": 0, 2024-01-25T15:04:57.410 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_bytes": 0, 2024-01-25T15:04:57.410 INFO:teuthology.orchestra.run.smithi170.stdout: "bluestore_writing_items": 0, 2024-01-25T15:04:57.410 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_bytes": 0, 2024-01-25T15:04:57.410 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_items": 0, 2024-01-25T15:04:57.410 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_bytes": 0, 2024-01-25T15:04:57.410 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_reader_items": 0, 2024-01-25T15:04:57.410 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_bytes": 0, 2024-01-25T15:04:57.410 INFO:teuthology.orchestra.run.smithi170.stdout: "bluefs_file_writer_items": 0, 2024-01-25T15:04:57.410 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_bytes": 148823, 2024-01-25T15:04:57.410 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_anon_items": 27, 2024-01-25T15:04:57.410 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_bytes": 0, 2024-01-25T15:04:57.410 INFO:teuthology.orchestra.run.smithi170.stdout: "buffer_meta_items": 0, 2024-01-25T15:04:57.410 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_bytes": 0, 2024-01-25T15:04:57.411 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_items": 0, 2024-01-25T15:04:57.411 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_bytes": 0, 2024-01-25T15:04:57.411 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_mapbl_items": 0, 2024-01-25T15:04:57.411 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_bytes": 0, 2024-01-25T15:04:57.411 INFO:teuthology.orchestra.run.smithi170.stdout: "osd_pglog_items": 0, 2024-01-25T15:04:57.411 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_bytes": 0, 2024-01-25T15:04:57.411 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_items": 0, 2024-01-25T15:04:57.411 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_bytes": 0, 2024-01-25T15:04:57.411 INFO:teuthology.orchestra.run.smithi170.stdout: "osdmap_mapping_items": 0, 2024-01-25T15:04:57.411 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_bytes": 0, 2024-01-25T15:04:57.411 INFO:teuthology.orchestra.run.smithi170.stdout: "pgmap_items": 0, 2024-01-25T15:04:57.411 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_bytes": 928, 2024-01-25T15:04:57.411 INFO:teuthology.orchestra.run.smithi170.stdout: "mds_co_items": 2, 2024-01-25T15:04:57.411 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_bytes": 0, 2024-01-25T15:04:57.412 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_1_items": 0, 2024-01-25T15:04:57.412 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_bytes": 0, 2024-01-25T15:04:57.412 INFO:teuthology.orchestra.run.smithi170.stdout: "unittest_2_items": 0 2024-01-25T15:04:57.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-01-25T15:04:57.412 INFO:teuthology.orchestra.run.smithi170.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-25T15:04:57.412 INFO:teuthology.orchestra.run.smithi170.stdout: "val": 0, 2024-01-25T15:04:57.412 INFO:teuthology.orchestra.run.smithi170.stdout: "max": 104857600, 2024-01-25T15:04:57.412 INFO:teuthology.orchestra.run.smithi170.stdout: "get_started": 0, 2024-01-25T15:04:57.412 INFO:teuthology.orchestra.run.smithi170.stdout: "get": 99, 2024-01-25T15:04:57.412 INFO:teuthology.orchestra.run.smithi170.stdout: "get_sum": 695146, 2024-01-25T15:04:57.412 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_fail": 0, 2024-01-25T15:04:57.412 INFO:teuthology.orchestra.run.smithi170.stdout: "get_or_fail_success": 99, 2024-01-25T15:04:57.412 INFO:teuthology.orchestra.run.smithi170.stdout: "take": 0, 2024-01-25T15:04:57.413 INFO:teuthology.orchestra.run.smithi170.stdout: "take_sum": 0, 2024-01-25T15:04:57.413 INFO:teuthology.orchestra.run.smithi170.stdout: "put": 99, 2024-01-25T15:04:57.413 INFO:teuthology.orchestra.run.smithi170.stdout: "put_sum": 695146, 2024-01-25T15:04:57.413 INFO:teuthology.orchestra.run.smithi170.stdout: "wait": { 2024-01-25T15:04:57.413 INFO:teuthology.orchestra.run.smithi170.stdout: "avgcount": 0, 2024-01-25T15:04:57.413 INFO:teuthology.orchestra.run.smithi170.stdout: "sum": 0.000000000, 2024-01-25T15:04:57.413 INFO:teuthology.orchestra.run.smithi170.stdout: "avgtime": 0.000000000 2024-01-25T15:04:57.413 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:57.413 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-01-25T15:04:57.413 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-01-25T15:04:57.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:57 smithi186 ceph-mon[35697]: pgmap v437: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 163 KiB/s wr, 69 op/s 2024-01-25T15:04:57.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:57 smithi191 ceph-mon[36347]: pgmap v437: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 163 KiB/s wr, 69 op/s 2024-01-25T15:04:58.119 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-01-25T15:04:58.119 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-01-25T15:04:58.119 DEBUG:tasks.check_counter:Getting stats from b 2024-01-25T15:04:58.120 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph daemon mds.b perf dump 2024-01-25T15:04:58.372 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.b/config 2024-01-25T15:04:59.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:04:59 smithi170 ceph-mon[31899]: pgmap v438: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 19 KiB/s wr, 32 op/s 2024-01-25T15:04:59.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:04:59 smithi191 ceph-mon[36347]: pgmap v438: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 19 KiB/s wr, 32 op/s 2024-01-25T15:04:59.546 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:04:59 smithi186 ceph-mon[35697]: pgmap v438: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 19 KiB/s wr, 32 op/s 2024-01-25T15:05:00.181 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-01-25T15:05:00.181 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-0": { 2024-01-25T15:05:00.181 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 9538, 2024-01-25T15:05:00.181 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 6717, 2024-01-25T15:05:00.181 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 4658433, 2024-01-25T15:05:00.181 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 7750041, 2024-01-25T15:05:00.181 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 9, 2024-01-25T15:05:00.181 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 4, 2024-01-25T15:05:00.181 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.500475694, 2024-01-25T15:05:00.182 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.191546432, 2024-01-25T15:05:00.182 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.373907093, 2024-01-25T15:05:00.182 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.028590088, 2024-01-25T15:05:00.182 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:00.182 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 6718, 2024-01-25T15:05:00.182 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.134281459, 2024-01-25T15:05:00.182 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000019988 2024-01-25T15:05:00.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.182 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:00.182 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 13660, 2024-01-25T15:05:00.182 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.001924160, 2024-01-25T15:05:00.182 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000140 2024-01-25T15:05:00.182 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.182 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 866848, 2024-01-25T15:05:00.183 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 189968 2024-01-25T15:05:00.183 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.183 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-1": { 2024-01-25T15:05:00.183 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 3786, 2024-01-25T15:05:00.183 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 6229, 2024-01-25T15:05:00.183 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 1389982, 2024-01-25T15:05:00.183 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 3756176, 2024-01-25T15:05:00.183 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 19, 2024-01-25T15:05:00.183 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 8, 2024-01-25T15:05:00.183 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.252579225, 2024-01-25T15:05:00.183 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.114633625, 2024-01-25T15:05:00.183 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.157772220, 2024-01-25T15:05:00.183 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.010290628, 2024-01-25T15:05:00.184 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:00.184 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 6226, 2024-01-25T15:05:00.184 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.123745468, 2024-01-25T15:05:00.184 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000019875 2024-01-25T15:05:00.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.184 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:00.184 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 7672, 2024-01-25T15:05:00.184 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.001079816, 2024-01-25T15:05:00.184 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000140 2024-01-25T15:05:00.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.184 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 878800, 2024-01-25T15:05:00.184 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 3205104 2024-01-25T15:05:00.184 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.185 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-2": { 2024-01-25T15:05:00.185 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 1028, 2024-01-25T15:05:00.185 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 935, 2024-01-25T15:05:00.185 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 482699, 2024-01-25T15:05:00.185 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 641175, 2024-01-25T15:05:00.185 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 12, 2024-01-25T15:05:00.185 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 7, 2024-01-25T15:05:00.185 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.060707832, 2024-01-25T15:05:00.185 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.019881336, 2024-01-25T15:05:00.185 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.026633171, 2024-01-25T15:05:00.185 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.013911205, 2024-01-25T15:05:00.185 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:00.185 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 933, 2024-01-25T15:05:00.186 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.037903917, 2024-01-25T15:05:00.186 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000040625 2024-01-25T15:05:00.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.186 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:00.186 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 556, 2024-01-25T15:05:00.186 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000077323, 2024-01-25T15:05:00.186 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000139 2024-01-25T15:05:00.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.186 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 0, 2024-01-25T15:05:00.186 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 0 2024-01-25T15:05:00.186 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.186 INFO:teuthology.orchestra.run.smithi186.stdout: "cct": { 2024-01-25T15:05:00.186 INFO:teuthology.orchestra.run.smithi186.stdout: "total_workers": 1, 2024-01-25T15:05:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: "unhealthy_workers": 0 2024-01-25T15:05:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-MDSRank": { 2024-01-25T15:05:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-01-25T15:05:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-01-25T15:05:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1515, 2024-01-25T15:05:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 1.021665925, 2024-01-25T15:05:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000674366 2024-01-25T15:05:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-PurgeQueue": { 2024-01-25T15:05:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-01-25T15:05:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-01-25T15:05:00.187 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1613, 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.082303392, 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000051025 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi186.stdout: "mds": { 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi186.stdout: "request": 1627, 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi186.stdout: "reply": 1602, 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi186.stdout: "reply_latency": { 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1602, 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 2.557836113, 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.001596651 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.188 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_reply": 0, 2024-01-25T15:05:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: "forward": 25, 2024-01-25T15:05:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_complete": 0, 2024-01-25T15:05:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_keys": 0, 2024-01-25T15:05:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_commit": 11, 2024-01-25T15:05:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_split": 0, 2024-01-25T15:05:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_merge": 0, 2024-01-25T15:05:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes": 53, 2024-01-25T15:05:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_top": 20, 2024-01-25T15:05:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_bottom": 12, 2024-01-25T15:05:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pin_tail": 21, 2024-01-25T15:05:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pinned": 23, 2024-01-25T15:05:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_expired": 348, 2024-01-25T15:05:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_with_caps": 0, 2024-01-25T15:05:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: "caps": 0, 2024-01-25T15:05:00.189 INFO:teuthology.orchestra.run.smithi186.stdout: "subtrees": 6, 2024-01-25T15:05:00.190 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse": 2895, 2024-01-25T15:05:00.190 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_hit": 2492, 2024-01-25T15:05:00.190 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_forward": 21, 2024-01-25T15:05:00.190 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_discover": 122, 2024-01-25T15:05:00.190 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_dir_fetch": 0, 2024-01-25T15:05:00.190 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_remote_ino": 2, 2024-01-25T15:05:00.190 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_lock": 4, 2024-01-25T15:05:00.190 INFO:teuthology.orchestra.run.smithi186.stdout: "load_cent": 0, 2024-01-25T15:05:00.190 INFO:teuthology.orchestra.run.smithi186.stdout: "q": 0, 2024-01-25T15:05:00.190 INFO:teuthology.orchestra.run.smithi186.stdout: "exported": 47, 2024-01-25T15:05:00.190 INFO:teuthology.orchestra.run.smithi186.stdout: "exported_inodes": 18, 2024-01-25T15:05:00.190 INFO:teuthology.orchestra.run.smithi186.stdout: "imported": 67, 2024-01-25T15:05:00.190 INFO:teuthology.orchestra.run.smithi186.stdout: "imported_inodes": 707, 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_dir_fetch": 0, 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_backtrace_fetch": 643, 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_peer_discover": 7, 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rfiles": 1924, 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rbytes": 15512990, 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rsnaps": 0, 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_fetch": 643, 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_set_tag": 0, 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_repaired": 0, 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_inotable_repaired": 0, 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_inodes": 42, 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_base_inodes": 0, 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dirfrag_rstats": 42, 2024-01-25T15:05:00.191 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_file_inodes": 601, 2024-01-25T15:05:00.192 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_inode_file_caps": 17, 2024-01-25T15:05:00.192 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_revoke": 290, 2024-01-25T15:05:00.192 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_grant": 997, 2024-01-25T15:05:00.192 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_trunc": 8, 2024-01-25T15:05:00.192 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-25T15:05:00.192 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-25T15:05:00.192 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps": 630, 2024-01-25T15:05:00.192 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps_dirty": 312, 2024-01-25T15:05:00.192 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_cap_release": 54, 2024-01-25T15:05:00.192 INFO:teuthology.orchestra.run.smithi186.stdout: "process_request_cap_release": 1414 2024-01-25T15:05:00.192 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.192 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_cache": { 2024-01-25T15:05:00.192 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update": 0, 2024-01-25T15:05:00.193 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update_receipt": 0, 2024-01-25T15:05:00.193 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_try_discover": 0, 2024-01-25T15:05:00.193 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_send_discover": 127, 2024-01-25T15:05:00.193 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_handle_discover": 59, 2024-01-25T15:05:00.193 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays": 8, 2024-01-25T15:05:00.193 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_delayed": 0, 2024-01-25T15:05:00.193 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_enqueuing": 0, 2024-01-25T15:05:00.193 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_created": 752, 2024-01-25T15:05:00.193 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_enqueued": 740, 2024-01-25T15:05:00.193 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_reintegrated": 4, 2024-01-25T15:05:00.193 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_migrated": 2, 2024-01-25T15:05:00.193 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_processing": 0, 2024-01-25T15:05:00.193 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_enqueued": 0, 2024-01-25T15:05:00.193 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_prioritized": 0, 2024-01-25T15:05:00.194 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_started": 0, 2024-01-25T15:05:00.194 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_completed": 0, 2024-01-25T15:05:00.194 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_enqueue_scrub": 0, 2024-01-25T15:05:00.194 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_exportdir": 47, 2024-01-25T15:05:00.194 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_flush": 0, 2024-01-25T15:05:00.194 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragmentdir": 0, 2024-01-25T15:05:00.194 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragstats": 0, 2024-01-25T15:05:00.194 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_inodestats": 0 2024-01-25T15:05:00.194 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.194 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_log": { 2024-01-25T15:05:00.194 INFO:teuthology.orchestra.run.smithi186.stdout: "evlrg": 0, 2024-01-25T15:05:00.194 INFO:teuthology.orchestra.run.smithi186.stdout: "evadd": 2899, 2024-01-25T15:05:00.194 INFO:teuthology.orchestra.run.smithi186.stdout: "evex": 0, 2024-01-25T15:05:00.194 INFO:teuthology.orchestra.run.smithi186.stdout: "evtrm": 0, 2024-01-25T15:05:00.195 INFO:teuthology.orchestra.run.smithi186.stdout: "ev": 2899, 2024-01-25T15:05:00.195 INFO:teuthology.orchestra.run.smithi186.stdout: "evexg": 0, 2024-01-25T15:05:00.195 INFO:teuthology.orchestra.run.smithi186.stdout: "evexd": 0, 2024-01-25T15:05:00.195 INFO:teuthology.orchestra.run.smithi186.stdout: "segadd": 5, 2024-01-25T15:05:00.195 INFO:teuthology.orchestra.run.smithi186.stdout: "segex": 0, 2024-01-25T15:05:00.195 INFO:teuthology.orchestra.run.smithi186.stdout: "segtrm": 0, 2024-01-25T15:05:00.195 INFO:teuthology.orchestra.run.smithi186.stdout: "seg": 5, 2024-01-25T15:05:00.195 INFO:teuthology.orchestra.run.smithi186.stdout: "segmjr": 2, 2024-01-25T15:05:00.195 INFO:teuthology.orchestra.run.smithi186.stdout: "segexg": 0, 2024-01-25T15:05:00.195 INFO:teuthology.orchestra.run.smithi186.stdout: "segexd": 0, 2024-01-25T15:05:00.195 INFO:teuthology.orchestra.run.smithi186.stdout: "expos": 4194304, 2024-01-25T15:05:00.195 INFO:teuthology.orchestra.run.smithi186.stdout: "wrpos": 10204944, 2024-01-25T15:05:00.196 INFO:teuthology.orchestra.run.smithi186.stdout: "rdpos": 0, 2024-01-25T15:05:00.196 INFO:teuthology.orchestra.run.smithi186.stdout: "jlat": { 2024-01-25T15:05:00.196 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 524, 2024-01-25T15:05:00.196 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 1.656292750, 2024-01-25T15:05:00.196 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.003160864 2024-01-25T15:05:00.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.196 INFO:teuthology.orchestra.run.smithi186.stdout: "replayed": 0 2024-01-25T15:05:00.196 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.196 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_mem": { 2024-01-25T15:05:00.196 INFO:teuthology.orchestra.run.smithi186.stdout: "ino": 44, 2024-01-25T15:05:00.196 INFO:teuthology.orchestra.run.smithi186.stdout: "ino+": 948, 2024-01-25T15:05:00.196 INFO:teuthology.orchestra.run.smithi186.stdout: "ino-": 904, 2024-01-25T15:05:00.196 INFO:teuthology.orchestra.run.smithi186.stdout: "dir": 43, 2024-01-25T15:05:00.196 INFO:teuthology.orchestra.run.smithi186.stdout: "dir+": 258, 2024-01-25T15:05:00.197 INFO:teuthology.orchestra.run.smithi186.stdout: "dir-": 215, 2024-01-25T15:05:00.197 INFO:teuthology.orchestra.run.smithi186.stdout: "dn": 53, 2024-01-25T15:05:00.197 INFO:teuthology.orchestra.run.smithi186.stdout: "dn+": 1892, 2024-01-25T15:05:00.197 INFO:teuthology.orchestra.run.smithi186.stdout: "dn-": 1839, 2024-01-25T15:05:00.197 INFO:teuthology.orchestra.run.smithi186.stdout: "cap": 0, 2024-01-25T15:05:00.197 INFO:teuthology.orchestra.run.smithi186.stdout: "cap+": 1263, 2024-01-25T15:05:00.197 INFO:teuthology.orchestra.run.smithi186.stdout: "cap-": 1263, 2024-01-25T15:05:00.197 INFO:teuthology.orchestra.run.smithi186.stdout: "rss": 73640, 2024-01-25T15:05:00.197 INFO:teuthology.orchestra.run.smithi186.stdout: "heap": 199036 2024-01-25T15:05:00.197 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.197 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_server": { 2024-01-25T15:05:00.197 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_client_request": 2361, 2024-01-25T15:05:00.197 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_server_request": 302, 2024-01-25T15:05:00.197 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_request": 1627, 2024-01-25T15:05:00.198 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_session": 70, 2024-01-25T15:05:00.198 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_peer_request": 580, 2024-01-25T15:05:00.198 INFO:teuthology.orchestra.run.smithi186.stdout: "req_create_latency": { 2024-01-25T15:05:00.198 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 25, 2024-01-25T15:05:00.198 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.037585333, 2024-01-25T15:05:00.198 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.001503413 2024-01-25T15:05:00.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.198 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getattr_latency": { 2024-01-25T15:05:00.198 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 9, 2024-01-25T15:05:00.198 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.011938118, 2024-01-25T15:05:00.198 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.001326457 2024-01-25T15:05:00.198 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.198 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getfilelock_latency": { 2024-01-25T15:05:00.198 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.198 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.199 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.199 INFO:teuthology.orchestra.run.smithi186.stdout: "req_link_latency": { 2024-01-25T15:05:00.199 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 7, 2024-01-25T15:05:00.199 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.110379236, 2024-01-25T15:05:00.199 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.015768462 2024-01-25T15:05:00.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.199 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookup_latency": { 2024-01-25T15:05:00.199 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 634, 2024-01-25T15:05:00.199 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.242320379, 2024-01-25T15:05:00.199 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000382208 2024-01-25T15:05:00.199 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.199 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookuphash_latency": { 2024-01-25T15:05:00.199 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.200 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.200 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.200 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupino_latency": { 2024-01-25T15:05:00.200 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.200 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.200 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.200 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.200 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupname_latency": { 2024-01-25T15:05:00.200 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.200 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.200 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.201 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupparent_latency": { 2024-01-25T15:05:00.201 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.201 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.201 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.201 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupsnap_latency": { 2024-01-25T15:05:00.201 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.201 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.201 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.201 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.201 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lssnap_latency": { 2024-01-25T15:05:00.201 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.201 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.202 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.202 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.202 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mkdir_latency": { 2024-01-25T15:05:00.203 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 6, 2024-01-25T15:05:00.203 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.005289358, 2024-01-25T15:05:00.203 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000881559 2024-01-25T15:05:00.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.203 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mknod_latency": { 2024-01-25T15:05:00.203 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 13, 2024-01-25T15:05:00.203 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.010385601, 2024-01-25T15:05:00.203 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000798892 2024-01-25T15:05:00.203 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.203 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mksnap_latency": { 2024-01-25T15:05:00.203 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.203 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.204 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.204 INFO:teuthology.orchestra.run.smithi186.stdout: "req_open_latency": { 2024-01-25T15:05:00.204 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.204 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.204 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.204 INFO:teuthology.orchestra.run.smithi186.stdout: "req_readdir_latency": { 2024-01-25T15:05:00.204 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 108, 2024-01-25T15:05:00.204 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.072824353, 2024-01-25T15:05:00.204 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000674299 2024-01-25T15:05:00.204 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.204 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rename_latency": { 2024-01-25T15:05:00.205 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 19, 2024-01-25T15:05:00.205 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.496766599, 2024-01-25T15:05:00.205 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.026145610 2024-01-25T15:05:00.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.205 INFO:teuthology.orchestra.run.smithi186.stdout: "req_renamesnap_latency": { 2024-01-25T15:05:00.205 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.205 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.205 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.205 INFO:teuthology.orchestra.run.smithi186.stdout: "req_snapdiff_latency": { 2024-01-25T15:05:00.205 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.205 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.205 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.205 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.206 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmdir_latency": { 2024-01-25T15:05:00.206 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 56, 2024-01-25T15:05:00.206 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.540788523, 2024-01-25T15:05:00.206 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.009656937 2024-01-25T15:05:00.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.206 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmsnap_latency": { 2024-01-25T15:05:00.206 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.206 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.206 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.206 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.206 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmxattr_latency": { 2024-01-25T15:05:00.206 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.206 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.207 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.207 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setattr_latency": { 2024-01-25T15:05:00.207 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 8, 2024-01-25T15:05:00.207 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.011425645, 2024-01-25T15:05:00.207 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.001428205 2024-01-25T15:05:00.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.207 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setdirlayout_latency": { 2024-01-25T15:05:00.207 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.207 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.207 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.207 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.207 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setfilelock_latency": { 2024-01-25T15:05:00.208 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.208 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.208 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.208 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setlayout_latency": { 2024-01-25T15:05:00.208 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.208 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.208 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.208 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.208 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setxattr_latency": { 2024-01-25T15:05:00.208 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.208 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.209 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.209 INFO:teuthology.orchestra.run.smithi186.stdout: "req_symlink_latency": { 2024-01-25T15:05:00.209 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 14, 2024-01-25T15:05:00.209 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.021872716, 2024-01-25T15:05:00.209 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.001562336 2024-01-25T15:05:00.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.209 INFO:teuthology.orchestra.run.smithi186.stdout: "req_unlink_latency": { 2024-01-25T15:05:00.209 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 703, 2024-01-25T15:05:00.209 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.996260252, 2024-01-25T15:05:00.209 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.001417155 2024-01-25T15:05:00.209 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.210 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_revoke_eviction": 0, 2024-01-25T15:05:00.210 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_acquisition_throttle": 0, 2024-01-25T15:05:00.210 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getvxattr_latency": { 2024-01-25T15:05:00.210 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.210 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.210 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.210 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:00.210 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.210 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_sessions": { 2024-01-25T15:05:00.210 INFO:teuthology.orchestra.run.smithi186.stdout: "session_count": 1, 2024-01-25T15:05:00.210 INFO:teuthology.orchestra.run.smithi186.stdout: "session_add": 2, 2024-01-25T15:05:00.210 INFO:teuthology.orchestra.run.smithi186.stdout: "session_remove": 1, 2024-01-25T15:05:00.210 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_open": 1, 2024-01-25T15:05:00.211 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_stale": 0, 2024-01-25T15:05:00.211 INFO:teuthology.orchestra.run.smithi186.stdout: "total_load": 1219, 2024-01-25T15:05:00.211 INFO:teuthology.orchestra.run.smithi186.stdout: "average_load": 1219, 2024-01-25T15:05:00.211 INFO:teuthology.orchestra.run.smithi186.stdout: "avg_session_uptime": 1454, 2024-01-25T15:05:00.211 INFO:teuthology.orchestra.run.smithi186.stdout: "mdthresh_evicted": 0 2024-01-25T15:05:00.211 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.211 INFO:teuthology.orchestra.run.smithi186.stdout: "mempool": { 2024-01-25T15:05:00.211 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_bytes": 0, 2024-01-25T15:05:00.211 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_items": 0, 2024-01-25T15:05:00.211 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_bytes": 0, 2024-01-25T15:05:00.211 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_items": 0, 2024-01-25T15:05:00.211 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_bytes": 0, 2024-01-25T15:05:00.211 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_items": 0, 2024-01-25T15:05:00.212 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-25T15:05:00.212 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_items": 0, 2024-01-25T15:05:00.212 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-25T15:05:00.212 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_items": 0, 2024-01-25T15:05:00.212 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_bytes": 0, 2024-01-25T15:05:00.212 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_items": 0, 2024-01-25T15:05:00.212 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-25T15:05:00.212 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_items": 0, 2024-01-25T15:05:00.212 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_bytes": 0, 2024-01-25T15:05:00.212 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_items": 0, 2024-01-25T15:05:00.212 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_bytes": 0, 2024-01-25T15:05:00.212 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_items": 0, 2024-01-25T15:05:00.212 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-25T15:05:00.213 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_items": 0, 2024-01-25T15:05:00.213 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-25T15:05:00.213 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_items": 0, 2024-01-25T15:05:00.213 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_bytes": 0, 2024-01-25T15:05:00.213 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_items": 0, 2024-01-25T15:05:00.213 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_bytes": 0, 2024-01-25T15:05:00.213 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_items": 0, 2024-01-25T15:05:00.213 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-25T15:05:00.213 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_items": 0, 2024-01-25T15:05:00.213 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_bytes": 0, 2024-01-25T15:05:00.213 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_items": 0, 2024-01-25T15:05:00.213 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_bytes": 0, 2024-01-25T15:05:00.213 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_items": 0, 2024-01-25T15:05:00.213 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_bytes": 0, 2024-01-25T15:05:00.214 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_items": 0, 2024-01-25T15:05:00.214 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_bytes": 0, 2024-01-25T15:05:00.214 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_items": 0, 2024-01-25T15:05:00.214 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_bytes": 300943, 2024-01-25T15:05:00.214 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_items": 125, 2024-01-25T15:05:00.214 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_bytes": 88, 2024-01-25T15:05:00.214 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_items": 1, 2024-01-25T15:05:00.214 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_bytes": 0, 2024-01-25T15:05:00.214 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_items": 0, 2024-01-25T15:05:00.214 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_bytes": 0, 2024-01-25T15:05:00.214 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_items": 0, 2024-01-25T15:05:00.214 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_bytes": 0, 2024-01-25T15:05:00.214 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_items": 0, 2024-01-25T15:05:00.214 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_bytes": 7432, 2024-01-25T15:05:00.215 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_items": 156, 2024-01-25T15:05:00.215 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_bytes": 0, 2024-01-25T15:05:00.215 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_items": 0, 2024-01-25T15:05:00.215 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_bytes": 0, 2024-01-25T15:05:00.215 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_items": 0, 2024-01-25T15:05:00.215 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_bytes": 194025, 2024-01-25T15:05:00.215 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_items": 2093, 2024-01-25T15:05:00.215 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_bytes": 0, 2024-01-25T15:05:00.215 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_items": 0, 2024-01-25T15:05:00.215 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_bytes": 0, 2024-01-25T15:05:00.215 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_items": 0 2024-01-25T15:05:00.215 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.215 INFO:teuthology.orchestra.run.smithi186.stdout: "objecter": { 2024-01-25T15:05:00.215 INFO:teuthology.orchestra.run.smithi186.stdout: "op_active": 0, 2024-01-25T15:05:00.216 INFO:teuthology.orchestra.run.smithi186.stdout: "op_laggy": 0, 2024-01-25T15:05:00.216 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send": 2236, 2024-01-25T15:05:00.216 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send_bytes": 6182984, 2024-01-25T15:05:00.216 INFO:teuthology.orchestra.run.smithi186.stdout: "op_resend": 27, 2024-01-25T15:05:00.216 INFO:teuthology.orchestra.run.smithi186.stdout: "op_reply": 2236, 2024-01-25T15:05:00.216 INFO:teuthology.orchestra.run.smithi186.stdout: "op_latency": { 2024-01-25T15:05:00.216 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 2236, 2024-01-25T15:05:00.216 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 4.283923419, 2024-01-25T15:05:00.216 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.001915887 2024-01-25T15:05:00.216 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.216 INFO:teuthology.orchestra.run.smithi186.stdout: "op_inflight": 0, 2024-01-25T15:05:00.216 INFO:teuthology.orchestra.run.smithi186.stdout: "oplen_avg": { 2024-01-25T15:05:00.216 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 2236, 2024-01-25T15:05:00.216 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 2285 2024-01-25T15:05:00.217 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.217 INFO:teuthology.orchestra.run.smithi186.stdout: "op": 2236, 2024-01-25T15:05:00.217 INFO:teuthology.orchestra.run.smithi186.stdout: "op_r": 724, 2024-01-25T15:05:00.217 INFO:teuthology.orchestra.run.smithi186.stdout: "op_w": 1512, 2024-01-25T15:05:00.217 INFO:teuthology.orchestra.run.smithi186.stdout: "op_rmw": 0, 2024-01-25T15:05:00.217 INFO:teuthology.orchestra.run.smithi186.stdout: "op_pg": 0, 2024-01-25T15:05:00.217 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_stat": 0, 2024-01-25T15:05:00.217 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_create": 10, 2024-01-25T15:05:00.217 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_read": 81, 2024-01-25T15:05:00.217 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_write": 605, 2024-01-25T15:05:00.217 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writefull": 57, 2024-01-25T15:05:00.217 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writesame": 0, 2024-01-25T15:05:00.218 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_append": 0, 2024-01-25T15:05:00.218 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_zero": 0, 2024-01-25T15:05:00.218 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_truncate": 0, 2024-01-25T15:05:00.218 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_delete": 801, 2024-01-25T15:05:00.218 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_mapext": 0, 2024-01-25T15:05:00.218 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_sparse_read": 0, 2024-01-25T15:05:00.218 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_clonerange": 0, 2024-01-25T15:05:00.218 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_getxattr": 643, 2024-01-25T15:05:00.218 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_setxattr": 20, 2024-01-25T15:05:00.218 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_cmpxattr": 0, 2024-01-25T15:05:00.218 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_rmxattr": 0, 2024-01-25T15:05:00.218 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_resetxattrs": 0, 2024-01-25T15:05:00.219 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_call": 0, 2024-01-25T15:05:00.219 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_watch": 0, 2024-01-25T15:05:00.219 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_notify": 0, 2024-01-25T15:05:00.219 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_src_cmpxattr": 0, 2024-01-25T15:05:00.219 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls": 0, 2024-01-25T15:05:00.219 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls_filter": 0, 2024-01-25T15:05:00.219 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_other": 8, 2024-01-25T15:05:00.219 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_active": 0, 2024-01-25T15:05:00.219 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_send": 0, 2024-01-25T15:05:00.219 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_resend": 0, 2024-01-25T15:05:00.220 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_ping": 0, 2024-01-25T15:05:00.220 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_active": 0, 2024-01-25T15:05:00.220 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_send": 0, 2024-01-25T15:05:00.220 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_resend": 0, 2024-01-25T15:05:00.220 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_active": 0, 2024-01-25T15:05:00.220 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_send": 0, 2024-01-25T15:05:00.220 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_resend": 0, 2024-01-25T15:05:00.220 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_active": 0, 2024-01-25T15:05:00.220 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_send": 0, 2024-01-25T15:05:00.220 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_resend": 0, 2024-01-25T15:05:00.220 INFO:teuthology.orchestra.run.smithi186.stdout: "command_active": 0, 2024-01-25T15:05:00.220 INFO:teuthology.orchestra.run.smithi186.stdout: "command_send": 0, 2024-01-25T15:05:00.221 INFO:teuthology.orchestra.run.smithi186.stdout: "command_resend": 0, 2024-01-25T15:05:00.221 INFO:teuthology.orchestra.run.smithi186.stdout: "map_epoch": 87, 2024-01-25T15:05:00.221 INFO:teuthology.orchestra.run.smithi186.stdout: "map_full": 0, 2024-01-25T15:05:00.221 INFO:teuthology.orchestra.run.smithi186.stdout: "map_inc": 2, 2024-01-25T15:05:00.221 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_sessions": 12, 2024-01-25T15:05:00.221 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_open": 12, 2024-01-25T15:05:00.221 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_close": 0, 2024-01-25T15:05:00.221 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_laggy": 0, 2024-01-25T15:05:00.221 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_wr": 47, 2024-01-25T15:05:00.221 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_rd": 0, 2024-01-25T15:05:00.221 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_del": 13 2024-01-25T15:05:00.221 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.221 INFO:teuthology.orchestra.run.smithi186.stdout: "oft": { 2024-01-25T15:05:00.222 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_objs": 1, 2024-01-25T15:05:00.222 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_kv_pairs": 0, 2024-01-25T15:05:00.222 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_updates": 0, 2024-01-25T15:05:00.222 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_removes": 0 2024-01-25T15:05:00.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.222 INFO:teuthology.orchestra.run.smithi186.stdout: "osd-slow-ops": { 2024-01-25T15:05:00.222 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_ops_count": 0 2024-01-25T15:05:00.222 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.222 INFO:teuthology.orchestra.run.smithi186.stdout: "purge_queue": { 2024-01-25T15:05:00.222 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops": 0, 2024-01-25T15:05:00.222 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops_high_water": 8, 2024-01-25T15:05:00.222 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing": 0, 2024-01-25T15:05:00.222 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_high_water": 6, 2024-01-25T15:05:00.223 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed_ops": 788, 2024-01-25T15:05:00.223 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed": 740, 2024-01-25T15:05:00.223 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_item_in_journal": 0 2024-01-25T15:05:00.223 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.223 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-25T15:05:00.223 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:00.223 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-01-25T15:05:00.223 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:00.223 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 14348, 2024-01-25T15:05:00.223 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 5122826, 2024-01-25T15:05:00.223 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:00.223 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 14348, 2024-01-25T15:05:00.223 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-01-25T15:05:00.224 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-01-25T15:05:00.224 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 14348, 2024-01-25T15:05:00.224 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 5122826, 2024-01-25T15:05:00.224 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:00.224 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.224 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.224 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.224 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:00.224 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.224 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_bytes": { 2024-01-25T15:05:00.224 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:00.224 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-01-25T15:05:00.224 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:00.225 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-01-25T15:05:00.225 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-01-25T15:05:00.225 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:00.225 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:00.225 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 2236, 2024-01-25T15:05:00.225 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 6257724, 2024-01-25T15:05:00.225 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 2236, 2024-01-25T15:05:00.225 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 6257724, 2024-01-25T15:05:00.225 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:00.225 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.225 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.225 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.225 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:00.226 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.226 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_ops": { 2024-01-25T15:05:00.226 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:00.226 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 1024, 2024-01-25T15:05:00.226 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:00.226 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-01-25T15:05:00.226 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-01-25T15:05:00.226 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:00.226 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:00.226 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 2236, 2024-01-25T15:05:00.226 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 2236, 2024-01-25T15:05:00.226 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 2236, 2024-01-25T15:05:00.226 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 2236, 2024-01-25T15:05:00.226 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:00.227 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.227 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.227 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.227 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:00.227 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.227 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle": { 2024-01-25T15:05:00.227 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:00.227 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-01-25T15:05:00.227 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:00.227 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 740, 2024-01-25T15:05:00.227 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 74740, 2024-01-25T15:05:00.227 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:00.227 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 740, 2024-01-25T15:05:00.228 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-01-25T15:05:00.228 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-01-25T15:05:00.228 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 81, 2024-01-25T15:05:00.228 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 74740, 2024-01-25T15:05:00.228 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:00.228 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.228 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.228 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.228 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:00.228 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:00.228 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle-0x555ad435e6e0": { 2024-01-25T15:05:00.228 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:00.228 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-01-25T15:05:00.228 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:00.229 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 2899, 2024-01-25T15:05:00.229 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 6010640, 2024-01-25T15:05:00.229 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:00.229 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 2899, 2024-01-25T15:05:00.229 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-01-25T15:05:00.229 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-01-25T15:05:00.229 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 524, 2024-01-25T15:05:00.229 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 6010640, 2024-01-25T15:05:00.229 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:00.229 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:00.229 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:00.229 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:00.229 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:00.230 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:00.230 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-01-25T15:05:00.939 INFO:tasks.check_counter:Daemon mds.b mds.exported=47 2024-01-25T15:05:00.940 INFO:tasks.check_counter:Daemon mds.b mds.imported=67 2024-01-25T15:05:00.940 DEBUG:tasks.check_counter:Getting stats from e 2024-01-25T15:05:00.940 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph daemon mds.e perf dump 2024-01-25T15:05:01.187 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.b/config 2024-01-25T15:05:01.566 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:01 smithi186 ceph-mon[35697]: pgmap v439: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.7 KiB/s wr, 18 op/s 2024-01-25T15:05:01.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:01 smithi170 ceph-mon[31899]: pgmap v439: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.7 KiB/s wr, 18 op/s 2024-01-25T15:05:01.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:01 smithi191 ceph-mon[36347]: pgmap v439: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.7 KiB/s wr, 18 op/s 2024-01-25T15:05:02.839 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-01-25T15:05:02.839 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-0": { 2024-01-25T15:05:02.839 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 300, 2024-01-25T15:05:02.839 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 300, 2024-01-25T15:05:02.839 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 4274847, 2024-01-25T15:05:02.839 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 92568, 2024-01-25T15:05:02.839 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 6, 2024-01-25T15:05:02.840 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 2, 2024-01-25T15:05:02.840 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.027206503, 2024-01-25T15:05:02.840 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.009176480, 2024-01-25T15:05:02.840 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.008842754, 2024-01-25T15:05:02.840 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.006333848, 2024-01-25T15:05:02.840 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:02.840 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 299, 2024-01-25T15:05:02.840 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.011131220, 2024-01-25T15:05:02.840 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000037228 2024-01-25T15:05:02.840 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.840 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:02.840 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.840 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.840 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.841 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.841 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-01-25T15:05:02.841 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 448 2024-01-25T15:05:02.841 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.841 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-1": { 2024-01-25T15:05:02.841 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 347, 2024-01-25T15:05:02.841 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 320, 2024-01-25T15:05:02.841 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 5107071, 2024-01-25T15:05:02.841 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 124281, 2024-01-25T15:05:02.841 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 4, 2024-01-25T15:05:02.841 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 3, 2024-01-25T15:05:02.841 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.039783608, 2024-01-25T15:05:02.841 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.010508591, 2024-01-25T15:05:02.841 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.025490380, 2024-01-25T15:05:02.842 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.007783386, 2024-01-25T15:05:02.842 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:02.842 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 319, 2024-01-25T15:05:02.842 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.012318565, 2024-01-25T15:05:02.842 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000038616 2024-01-25T15:05:02.842 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.842 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:02.842 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.842 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.842 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.842 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.842 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 857648, 2024-01-25T15:05:02.842 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 55856 2024-01-25T15:05:02.842 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.843 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-2": { 2024-01-25T15:05:02.843 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 360, 2024-01-25T15:05:02.843 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 429, 2024-01-25T15:05:02.843 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 1537982, 2024-01-25T15:05:02.843 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 307665, 2024-01-25T15:05:02.843 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 5, 2024-01-25T15:05:02.843 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 4, 2024-01-25T15:05:02.843 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.042519367, 2024-01-25T15:05:02.843 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.014992095, 2024-01-25T15:05:02.843 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.011014183, 2024-01-25T15:05:02.843 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.012037437, 2024-01-25T15:05:02.843 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:02.843 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 427, 2024-01-25T15:05:02.843 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.022556510, 2024-01-25T15:05:02.843 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000052825 2024-01-25T15:05:02.844 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.844 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:02.844 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.844 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.844 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.844 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.844 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 160, 2024-01-25T15:05:02.844 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 196016 2024-01-25T15:05:02.844 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.844 INFO:teuthology.orchestra.run.smithi186.stdout: "cct": { 2024-01-25T15:05:02.844 INFO:teuthology.orchestra.run.smithi186.stdout: "total_workers": 1, 2024-01-25T15:05:02.844 INFO:teuthology.orchestra.run.smithi186.stdout: "unhealthy_workers": 0 2024-01-25T15:05:02.844 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.845 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-MDSRank": { 2024-01-25T15:05:02.845 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-01-25T15:05:02.845 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-01-25T15:05:02.845 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1536, 2024-01-25T15:05:02.845 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.039699629, 2024-01-25T15:05:02.845 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000025846 2024-01-25T15:05:02.845 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:02.845 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.845 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-PurgeQueue": { 2024-01-25T15:05:02.845 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-01-25T15:05:02.845 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-01-25T15:05:02.845 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.845 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: "mds": { 2024-01-25T15:05:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: "request": 0, 2024-01-25T15:05:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: "reply": 0, 2024-01-25T15:05:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: "reply_latency": { 2024-01-25T15:05:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_reply": 0, 2024-01-25T15:05:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: "forward": 0, 2024-01-25T15:05:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_complete": 0, 2024-01-25T15:05:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_keys": 0, 2024-01-25T15:05:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_commit": 0, 2024-01-25T15:05:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_split": 0, 2024-01-25T15:05:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_merge": 0, 2024-01-25T15:05:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes": 1252, 2024-01-25T15:05:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_top": 0, 2024-01-25T15:05:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_bottom": 1252, 2024-01-25T15:05:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pin_tail": 0, 2024-01-25T15:05:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pinned": 1252, 2024-01-25T15:05:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_expired": 0, 2024-01-25T15:05:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_with_caps": 0, 2024-01-25T15:05:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: "caps": 0, 2024-01-25T15:05:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: "subtrees": 1, 2024-01-25T15:05:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse": 0, 2024-01-25T15:05:02.847 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_hit": 0, 2024-01-25T15:05:02.848 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_forward": 0, 2024-01-25T15:05:02.848 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_discover": 0, 2024-01-25T15:05:02.848 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_dir_fetch": 0, 2024-01-25T15:05:02.848 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_remote_ino": 0, 2024-01-25T15:05:02.848 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_lock": 0, 2024-01-25T15:05:02.848 INFO:teuthology.orchestra.run.smithi186.stdout: "load_cent": 0, 2024-01-25T15:05:02.848 INFO:teuthology.orchestra.run.smithi186.stdout: "q": 0, 2024-01-25T15:05:02.848 INFO:teuthology.orchestra.run.smithi186.stdout: "exported": 0, 2024-01-25T15:05:02.848 INFO:teuthology.orchestra.run.smithi186.stdout: "exported_inodes": 0, 2024-01-25T15:05:02.848 INFO:teuthology.orchestra.run.smithi186.stdout: "imported": 0, 2024-01-25T15:05:02.848 INFO:teuthology.orchestra.run.smithi186.stdout: "imported_inodes": 0, 2024-01-25T15:05:02.848 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_dir_fetch": 0, 2024-01-25T15:05:02.848 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_backtrace_fetch": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_peer_discover": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rfiles": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rbytes": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rsnaps": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_fetch": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_set_tag": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_repaired": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_inotable_repaired": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_inodes": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_base_inodes": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dirfrag_rstats": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_file_inodes": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_inode_file_caps": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_revoke": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_grant": 0, 2024-01-25T15:05:02.849 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_trunc": 0, 2024-01-25T15:05:02.850 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-25T15:05:02.850 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-25T15:05:02.850 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps": 0, 2024-01-25T15:05:02.850 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps_dirty": 0, 2024-01-25T15:05:02.850 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_cap_release": 0, 2024-01-25T15:05:02.850 INFO:teuthology.orchestra.run.smithi186.stdout: "process_request_cap_release": 0 2024-01-25T15:05:02.850 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.850 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_cache": { 2024-01-25T15:05:02.850 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update": 0, 2024-01-25T15:05:02.850 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update_receipt": 0, 2024-01-25T15:05:02.850 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_try_discover": 0, 2024-01-25T15:05:02.850 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_send_discover": 0, 2024-01-25T15:05:02.850 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_handle_discover": 0, 2024-01-25T15:05:02.850 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays": 0, 2024-01-25T15:05:02.850 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_delayed": 0, 2024-01-25T15:05:02.851 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_enqueuing": 0, 2024-01-25T15:05:02.851 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_created": 0, 2024-01-25T15:05:02.851 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_enqueued": 0, 2024-01-25T15:05:02.851 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_reintegrated": 0, 2024-01-25T15:05:02.851 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_migrated": 0, 2024-01-25T15:05:02.851 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_processing": 0, 2024-01-25T15:05:02.851 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_enqueued": 0, 2024-01-25T15:05:02.851 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_prioritized": 0, 2024-01-25T15:05:02.851 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_started": 0, 2024-01-25T15:05:02.851 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_completed": 0, 2024-01-25T15:05:02.851 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_enqueue_scrub": 0, 2024-01-25T15:05:02.851 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_exportdir": 0, 2024-01-25T15:05:02.851 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_flush": 0, 2024-01-25T15:05:02.851 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragmentdir": 0, 2024-01-25T15:05:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragstats": 0, 2024-01-25T15:05:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_inodestats": 0 2024-01-25T15:05:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_log": { 2024-01-25T15:05:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "evlrg": 0, 2024-01-25T15:05:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "evadd": 0, 2024-01-25T15:05:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "evex": 0, 2024-01-25T15:05:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "evtrm": 0, 2024-01-25T15:05:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "ev": 5679, 2024-01-25T15:05:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "evexg": 0, 2024-01-25T15:05:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "evexd": 0, 2024-01-25T15:05:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "segadd": 0, 2024-01-25T15:05:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "segex": 0, 2024-01-25T15:05:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "segtrm": 0, 2024-01-25T15:05:02.852 INFO:teuthology.orchestra.run.smithi186.stdout: "seg": 8, 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "segmjr": 2, 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "segexg": 0, 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "segexd": 0, 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "expos": 4194304, 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "wrpos": 14004740, 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "rdpos": 14004141, 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "jlat": { 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "replayed": 5679 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_mem": { 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "ino": 16, 2024-01-25T15:05:02.853 INFO:teuthology.orchestra.run.smithi186.stdout: "ino+": 1481, 2024-01-25T15:05:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "ino-": 1465, 2024-01-25T15:05:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "dir": 14, 2024-01-25T15:05:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "dir+": 263, 2024-01-25T15:05:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "dir-": 249, 2024-01-25T15:05:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "dn": 1252, 2024-01-25T15:05:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "dn+": 2685, 2024-01-25T15:05:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "dn-": 1433, 2024-01-25T15:05:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "cap": 0, 2024-01-25T15:05:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "cap+": 0, 2024-01-25T15:05:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "cap-": 0, 2024-01-25T15:05:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "rss": 53156, 2024-01-25T15:05:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "heap": 207228 2024-01-25T15:05:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_server": { 2024-01-25T15:05:02.854 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_client_request": 0, 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_server_request": 0, 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_request": 0, 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_session": 0, 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_peer_request": 0, 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "req_create_latency": { 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getattr_latency": { 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getfilelock_latency": { 2024-01-25T15:05:02.855 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "req_link_latency": { 2024-01-25T15:05:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookup_latency": { 2024-01-25T15:05:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.856 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookuphash_latency": { 2024-01-25T15:05:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupino_latency": { 2024-01-25T15:05:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupname_latency": { 2024-01-25T15:05:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.857 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupparent_latency": { 2024-01-25T15:05:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupsnap_latency": { 2024-01-25T15:05:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lssnap_latency": { 2024-01-25T15:05:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.858 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mkdir_latency": { 2024-01-25T15:05:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mknod_latency": { 2024-01-25T15:05:02.859 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mksnap_latency": { 2024-01-25T15:05:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "req_open_latency": { 2024-01-25T15:05:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.860 INFO:teuthology.orchestra.run.smithi186.stdout: "req_readdir_latency": { 2024-01-25T15:05:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rename_latency": { 2024-01-25T15:05:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "req_renamesnap_latency": { 2024-01-25T15:05:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.861 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: "req_snapdiff_latency": { 2024-01-25T15:05:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmdir_latency": { 2024-01-25T15:05:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmsnap_latency": { 2024-01-25T15:05:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.862 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmxattr_latency": { 2024-01-25T15:05:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setattr_latency": { 2024-01-25T15:05:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setdirlayout_latency": { 2024-01-25T15:05:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.863 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setfilelock_latency": { 2024-01-25T15:05:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setlayout_latency": { 2024-01-25T15:05:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setxattr_latency": { 2024-01-25T15:05:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.864 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "req_symlink_latency": { 2024-01-25T15:05:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "req_unlink_latency": { 2024-01-25T15:05:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_revoke_eviction": 0, 2024-01-25T15:05:02.865 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_acquisition_throttle": 0, 2024-01-25T15:05:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getvxattr_latency": { 2024-01-25T15:05:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_sessions": { 2024-01-25T15:05:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "session_count": 1, 2024-01-25T15:05:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "session_add": 1, 2024-01-25T15:05:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "session_remove": 0, 2024-01-25T15:05:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_open": 1, 2024-01-25T15:05:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_stale": 0, 2024-01-25T15:05:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "total_load": 0, 2024-01-25T15:05:02.866 INFO:teuthology.orchestra.run.smithi186.stdout: "average_load": 0, 2024-01-25T15:05:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "avg_session_uptime": 1455, 2024-01-25T15:05:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "mdthresh_evicted": 0 2024-01-25T15:05:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "mempool": { 2024-01-25T15:05:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_bytes": 0, 2024-01-25T15:05:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_items": 0, 2024-01-25T15:05:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_bytes": 0, 2024-01-25T15:05:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_items": 0, 2024-01-25T15:05:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_bytes": 0, 2024-01-25T15:05:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_items": 0, 2024-01-25T15:05:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-25T15:05:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_items": 0, 2024-01-25T15:05:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-25T15:05:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_items": 0, 2024-01-25T15:05:02.867 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_bytes": 0, 2024-01-25T15:05:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_items": 0, 2024-01-25T15:05:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-25T15:05:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_items": 0, 2024-01-25T15:05:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_bytes": 0, 2024-01-25T15:05:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_items": 0, 2024-01-25T15:05:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_bytes": 0, 2024-01-25T15:05:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_items": 0, 2024-01-25T15:05:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-25T15:05:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_items": 0, 2024-01-25T15:05:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-25T15:05:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_items": 0, 2024-01-25T15:05:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_bytes": 0, 2024-01-25T15:05:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_items": 0, 2024-01-25T15:05:02.868 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_bytes": 0, 2024-01-25T15:05:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_items": 0, 2024-01-25T15:05:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-25T15:05:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_items": 0, 2024-01-25T15:05:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_bytes": 0, 2024-01-25T15:05:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_items": 0, 2024-01-25T15:05:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_bytes": 0, 2024-01-25T15:05:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_items": 0, 2024-01-25T15:05:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_bytes": 0, 2024-01-25T15:05:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_items": 0, 2024-01-25T15:05:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_bytes": 0, 2024-01-25T15:05:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_items": 0, 2024-01-25T15:05:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_bytes": 197618, 2024-01-25T15:05:02.869 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_items": 60, 2024-01-25T15:05:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_bytes": 0, 2024-01-25T15:05:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_items": 0, 2024-01-25T15:05:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_bytes": 0, 2024-01-25T15:05:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_items": 0, 2024-01-25T15:05:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_bytes": 0, 2024-01-25T15:05:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_items": 0, 2024-01-25T15:05:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_bytes": 0, 2024-01-25T15:05:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_items": 0, 2024-01-25T15:05:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_bytes": 7432, 2024-01-25T15:05:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_items": 156, 2024-01-25T15:05:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_bytes": 0, 2024-01-25T15:05:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_items": 0, 2024-01-25T15:05:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_bytes": 0, 2024-01-25T15:05:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_items": 0, 2024-01-25T15:05:02.870 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_bytes": 936805, 2024-01-25T15:05:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_items": 6191, 2024-01-25T15:05:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_bytes": 0, 2024-01-25T15:05:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_items": 0, 2024-01-25T15:05:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_bytes": 0, 2024-01-25T15:05:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_items": 0 2024-01-25T15:05:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "objecter": { 2024-01-25T15:05:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "op_active": 0, 2024-01-25T15:05:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "op_laggy": 0, 2024-01-25T15:05:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send": 875, 2024-01-25T15:05:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send_bytes": 21, 2024-01-25T15:05:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "op_resend": 3, 2024-01-25T15:05:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "op_reply": 875, 2024-01-25T15:05:02.871 INFO:teuthology.orchestra.run.smithi186.stdout: "op_latency": { 2024-01-25T15:05:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 875, 2024-01-25T15:05:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.786985959, 2024-01-25T15:05:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000899412 2024-01-25T15:05:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "op_inflight": 0, 2024-01-25T15:05:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "oplen_avg": { 2024-01-25T15:05:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 875, 2024-01-25T15:05:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 876 2024-01-25T15:05:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "op": 875, 2024-01-25T15:05:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "op_r": 875, 2024-01-25T15:05:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "op_w": 0, 2024-01-25T15:05:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "op_rmw": 0, 2024-01-25T15:05:02.872 INFO:teuthology.orchestra.run.smithi186.stdout: "op_pg": 0, 2024-01-25T15:05:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_stat": 489, 2024-01-25T15:05:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_create": 0, 2024-01-25T15:05:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_read": 384, 2024-01-25T15:05:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_write": 0, 2024-01-25T15:05:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writefull": 0, 2024-01-25T15:05:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writesame": 0, 2024-01-25T15:05:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_append": 0, 2024-01-25T15:05:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_zero": 0, 2024-01-25T15:05:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_truncate": 0, 2024-01-25T15:05:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_delete": 0, 2024-01-25T15:05:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_mapext": 0, 2024-01-25T15:05:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_sparse_read": 0, 2024-01-25T15:05:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_clonerange": 0, 2024-01-25T15:05:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_getxattr": 1, 2024-01-25T15:05:02.873 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_setxattr": 0, 2024-01-25T15:05:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_cmpxattr": 0, 2024-01-25T15:05:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_rmxattr": 0, 2024-01-25T15:05:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_resetxattrs": 0, 2024-01-25T15:05:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_call": 0, 2024-01-25T15:05:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_watch": 0, 2024-01-25T15:05:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_notify": 0, 2024-01-25T15:05:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_src_cmpxattr": 0, 2024-01-25T15:05:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls": 0, 2024-01-25T15:05:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls_filter": 0, 2024-01-25T15:05:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_other": 0, 2024-01-25T15:05:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_active": 0, 2024-01-25T15:05:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_send": 0, 2024-01-25T15:05:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_resend": 0, 2024-01-25T15:05:02.874 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_ping": 0, 2024-01-25T15:05:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_active": 0, 2024-01-25T15:05:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_send": 0, 2024-01-25T15:05:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_resend": 0, 2024-01-25T15:05:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_active": 0, 2024-01-25T15:05:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_send": 0, 2024-01-25T15:05:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_resend": 0, 2024-01-25T15:05:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_active": 0, 2024-01-25T15:05:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_send": 0, 2024-01-25T15:05:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_resend": 0, 2024-01-25T15:05:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "command_active": 0, 2024-01-25T15:05:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "command_send": 0, 2024-01-25T15:05:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "command_resend": 0, 2024-01-25T15:05:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "map_epoch": 87, 2024-01-25T15:05:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "map_full": 0, 2024-01-25T15:05:02.875 INFO:teuthology.orchestra.run.smithi186.stdout: "map_inc": 2, 2024-01-25T15:05:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_sessions": 6, 2024-01-25T15:05:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_open": 6, 2024-01-25T15:05:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_close": 0, 2024-01-25T15:05:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_laggy": 0, 2024-01-25T15:05:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_wr": 0, 2024-01-25T15:05:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_rd": 2, 2024-01-25T15:05:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_del": 0 2024-01-25T15:05:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "oft": { 2024-01-25T15:05:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_objs": 0, 2024-01-25T15:05:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_kv_pairs": 0, 2024-01-25T15:05:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_updates": 0, 2024-01-25T15:05:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_removes": 0 2024-01-25T15:05:02.876 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "osd-slow-ops": { 2024-01-25T15:05:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_ops_count": 0 2024-01-25T15:05:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "purge_queue": { 2024-01-25T15:05:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops": 0, 2024-01-25T15:05:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops_high_water": 0, 2024-01-25T15:05:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing": 0, 2024-01-25T15:05:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_high_water": 0, 2024-01-25T15:05:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed_ops": 0, 2024-01-25T15:05:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed": 0, 2024-01-25T15:05:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_item_in_journal": 0 2024-01-25T15:05:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-25T15:05:02.877 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-01-25T15:05:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 1003, 2024-01-25T15:05:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 10820293, 2024-01-25T15:05:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 1003, 2024-01-25T15:05:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-01-25T15:05:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-01-25T15:05:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 1003, 2024-01-25T15:05:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 10820293, 2024-01-25T15:05:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.878 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_bytes": { 2024-01-25T15:05:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-01-25T15:05:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-01-25T15:05:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-01-25T15:05:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 875, 2024-01-25T15:05:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 9810458, 2024-01-25T15:05:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 875, 2024-01-25T15:05:02.879 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 9810458, 2024-01-25T15:05:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_ops": { 2024-01-25T15:05:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 1024, 2024-01-25T15:05:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-01-25T15:05:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-01-25T15:05:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:02.880 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 875, 2024-01-25T15:05:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 875, 2024-01-25T15:05:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 875, 2024-01-25T15:05:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 875, 2024-01-25T15:05:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle": { 2024-01-25T15:05:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-01-25T15:05:02.881 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-01-25T15:05:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-01-25T15:05:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-01-25T15:05:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-01-25T15:05:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 0, 2024-01-25T15:05:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 0, 2024-01-25T15:05:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:02.882 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle-0x55b44a72a960": { 2024-01-25T15:05:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-01-25T15:05:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-01-25T15:05:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-01-25T15:05:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-01-25T15:05:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-01-25T15:05:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 0, 2024-01-25T15:05:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 0, 2024-01-25T15:05:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:02.883 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:02.884 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:02.884 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-01-25T15:05:03.596 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:03 smithi186 ceph-mon[35697]: pgmap v440: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-01-25T15:05:03.623 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-01-25T15:05:03.623 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-01-25T15:05:03.623 DEBUG:tasks.check_counter:Getting stats from h 2024-01-25T15:05:03.624 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph daemon mds.h perf dump 2024-01-25T15:05:03.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:03 smithi170 ceph-mon[31899]: pgmap v440: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-01-25T15:05:03.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:03 smithi191 ceph-mon[36347]: pgmap v440: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.0 KiB/s wr, 11 op/s 2024-01-25T15:05:03.861 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.b/config 2024-01-25T15:05:05.354 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-01-25T15:05:05.354 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-0": { 2024-01-25T15:05:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 903, 2024-01-25T15:05:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 905, 2024-01-25T15:05:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 6268123, 2024-01-25T15:05:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 280840, 2024-01-25T15:05:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 6, 2024-01-25T15:05:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 2, 2024-01-25T15:05:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.070970217, 2024-01-25T15:05:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.021167991, 2024-01-25T15:05:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.021499552, 2024-01-25T15:05:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.022217147, 2024-01-25T15:05:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:05.355 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 903, 2024-01-25T15:05:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.025926269, 2024-01-25T15:05:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000028711 2024-01-25T15:05:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 0, 2024-01-25T15:05:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 0 2024-01-25T15:05:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.356 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-1": { 2024-01-25T15:05:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 3, 2024-01-25T15:05:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 71, 2024-01-25T15:05:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 716, 2024-01-25T15:05:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 198124, 2024-01-25T15:05:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 4, 2024-01-25T15:05:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 3, 2024-01-25T15:05:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.004861161, 2024-01-25T15:05:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.002690414, 2024-01-25T15:05:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.001372969, 2024-01-25T15:05:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.000066507, 2024-01-25T15:05:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:05.357 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 69, 2024-01-25T15:05:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.003929557, 2024-01-25T15:05:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000056950 2024-01-25T15:05:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 160, 2024-01-25T15:05:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 197440 2024-01-25T15:05:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-2": { 2024-01-25T15:05:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 130, 2024-01-25T15:05:05.358 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 101, 2024-01-25T15:05:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 860364, 2024-01-25T15:05:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 55367, 2024-01-25T15:05:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 3, 2024-01-25T15:05:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 2, 2024-01-25T15:05:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.020650085, 2024-01-25T15:05:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.005970906, 2024-01-25T15:05:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.017593513, 2024-01-25T15:05:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.002070762, 2024-01-25T15:05:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 101, 2024-01-25T15:05:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.006567279, 2024-01-25T15:05:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000065022 2024-01-25T15:05:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.359 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 860096, 2024-01-25T15:05:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 55056 2024-01-25T15:05:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: "cct": { 2024-01-25T15:05:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: "total_workers": 1, 2024-01-25T15:05:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: "unhealthy_workers": 0 2024-01-25T15:05:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-MDSRank": { 2024-01-25T15:05:05.360 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-01-25T15:05:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-01-25T15:05:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1575, 2024-01-25T15:05:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.033903065, 2024-01-25T15:05:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000021525 2024-01-25T15:05:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-PurgeQueue": { 2024-01-25T15:05:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-01-25T15:05:05.363 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-01-25T15:05:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: "mds": { 2024-01-25T15:05:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: "request": 0, 2024-01-25T15:05:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: "reply": 0, 2024-01-25T15:05:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: "reply_latency": { 2024-01-25T15:05:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.364 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_reply": 0, 2024-01-25T15:05:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: "forward": 0, 2024-01-25T15:05:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_complete": 0, 2024-01-25T15:05:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_keys": 0, 2024-01-25T15:05:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_commit": 0, 2024-01-25T15:05:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_split": 0, 2024-01-25T15:05:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_merge": 0, 2024-01-25T15:05:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes": 834, 2024-01-25T15:05:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_top": 0, 2024-01-25T15:05:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_bottom": 834, 2024-01-25T15:05:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pin_tail": 0, 2024-01-25T15:05:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pinned": 833, 2024-01-25T15:05:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_expired": 0, 2024-01-25T15:05:05.365 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_with_caps": 0, 2024-01-25T15:05:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: "caps": 0, 2024-01-25T15:05:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: "subtrees": 1, 2024-01-25T15:05:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse": 0, 2024-01-25T15:05:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_hit": 0, 2024-01-25T15:05:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_forward": 0, 2024-01-25T15:05:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_discover": 0, 2024-01-25T15:05:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_dir_fetch": 0, 2024-01-25T15:05:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_remote_ino": 0, 2024-01-25T15:05:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_lock": 0, 2024-01-25T15:05:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: "load_cent": 0, 2024-01-25T15:05:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: "q": 0, 2024-01-25T15:05:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: "exported": 0, 2024-01-25T15:05:05.366 INFO:teuthology.orchestra.run.smithi186.stdout: "exported_inodes": 0, 2024-01-25T15:05:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: "imported": 0, 2024-01-25T15:05:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: "imported_inodes": 0, 2024-01-25T15:05:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_dir_fetch": 0, 2024-01-25T15:05:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_backtrace_fetch": 0, 2024-01-25T15:05:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_peer_discover": 0, 2024-01-25T15:05:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rfiles": 0, 2024-01-25T15:05:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rbytes": 0, 2024-01-25T15:05:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rsnaps": 0, 2024-01-25T15:05:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_fetch": 0, 2024-01-25T15:05:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_set_tag": 0, 2024-01-25T15:05:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_repaired": 0, 2024-01-25T15:05:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_inotable_repaired": 0, 2024-01-25T15:05:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_inodes": 0, 2024-01-25T15:05:05.367 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_base_inodes": 0, 2024-01-25T15:05:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dirfrag_rstats": 0, 2024-01-25T15:05:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_file_inodes": 0, 2024-01-25T15:05:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_inode_file_caps": 0, 2024-01-25T15:05:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_revoke": 0, 2024-01-25T15:05:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_grant": 0, 2024-01-25T15:05:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_trunc": 0, 2024-01-25T15:05:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-25T15:05:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-25T15:05:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps": 0, 2024-01-25T15:05:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps_dirty": 0, 2024-01-25T15:05:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_cap_release": 0, 2024-01-25T15:05:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: "process_request_cap_release": 0 2024-01-25T15:05:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_cache": { 2024-01-25T15:05:05.368 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update": 0, 2024-01-25T15:05:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update_receipt": 0, 2024-01-25T15:05:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_try_discover": 0, 2024-01-25T15:05:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_send_discover": 0, 2024-01-25T15:05:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_handle_discover": 0, 2024-01-25T15:05:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays": 0, 2024-01-25T15:05:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_delayed": 0, 2024-01-25T15:05:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_enqueuing": 0, 2024-01-25T15:05:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_created": 0, 2024-01-25T15:05:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_enqueued": 0, 2024-01-25T15:05:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_reintegrated": 0, 2024-01-25T15:05:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_migrated": 0, 2024-01-25T15:05:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_processing": 0, 2024-01-25T15:05:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_enqueued": 0, 2024-01-25T15:05:05.369 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_prioritized": 0, 2024-01-25T15:05:05.370 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_started": 0, 2024-01-25T15:05:05.370 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_completed": 0, 2024-01-25T15:05:05.370 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_enqueue_scrub": 0, 2024-01-25T15:05:05.370 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_exportdir": 0, 2024-01-25T15:05:05.370 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_flush": 0, 2024-01-25T15:05:05.370 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragmentdir": 0, 2024-01-25T15:05:05.370 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragstats": 0, 2024-01-25T15:05:05.370 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_inodestats": 0 2024-01-25T15:05:05.370 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.370 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_log": { 2024-01-25T15:05:05.370 INFO:teuthology.orchestra.run.smithi186.stdout: "evlrg": 0, 2024-01-25T15:05:05.370 INFO:teuthology.orchestra.run.smithi186.stdout: "evadd": 0, 2024-01-25T15:05:05.370 INFO:teuthology.orchestra.run.smithi186.stdout: "evex": 0, 2024-01-25T15:05:05.370 INFO:teuthology.orchestra.run.smithi186.stdout: "evtrm": 0, 2024-01-25T15:05:05.371 INFO:teuthology.orchestra.run.smithi186.stdout: "ev": 2899, 2024-01-25T15:05:05.371 INFO:teuthology.orchestra.run.smithi186.stdout: "evexg": 0, 2024-01-25T15:05:05.371 INFO:teuthology.orchestra.run.smithi186.stdout: "evexd": 0, 2024-01-25T15:05:05.371 INFO:teuthology.orchestra.run.smithi186.stdout: "segadd": 0, 2024-01-25T15:05:05.371 INFO:teuthology.orchestra.run.smithi186.stdout: "segex": 0, 2024-01-25T15:05:05.371 INFO:teuthology.orchestra.run.smithi186.stdout: "segtrm": 0, 2024-01-25T15:05:05.371 INFO:teuthology.orchestra.run.smithi186.stdout: "seg": 5, 2024-01-25T15:05:05.371 INFO:teuthology.orchestra.run.smithi186.stdout: "segmjr": 2, 2024-01-25T15:05:05.371 INFO:teuthology.orchestra.run.smithi186.stdout: "segexg": 0, 2024-01-25T15:05:05.371 INFO:teuthology.orchestra.run.smithi186.stdout: "segexd": 0, 2024-01-25T15:05:05.371 INFO:teuthology.orchestra.run.smithi186.stdout: "expos": 4194304, 2024-01-25T15:05:05.371 INFO:teuthology.orchestra.run.smithi186.stdout: "wrpos": 10204944, 2024-01-25T15:05:05.371 INFO:teuthology.orchestra.run.smithi186.stdout: "rdpos": 10203806, 2024-01-25T15:05:05.371 INFO:teuthology.orchestra.run.smithi186.stdout: "jlat": { 2024-01-25T15:05:05.372 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.372 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.372 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.372 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.372 INFO:teuthology.orchestra.run.smithi186.stdout: "replayed": 2899 2024-01-25T15:05:05.372 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.372 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_mem": { 2024-01-25T15:05:05.372 INFO:teuthology.orchestra.run.smithi186.stdout: "ino": 17, 2024-01-25T15:05:05.372 INFO:teuthology.orchestra.run.smithi186.stdout: "ino+": 946, 2024-01-25T15:05:05.372 INFO:teuthology.orchestra.run.smithi186.stdout: "ino-": 929, 2024-01-25T15:05:05.372 INFO:teuthology.orchestra.run.smithi186.stdout: "dir": 15, 2024-01-25T15:05:05.372 INFO:teuthology.orchestra.run.smithi186.stdout: "dir+": 258, 2024-01-25T15:05:05.372 INFO:teuthology.orchestra.run.smithi186.stdout: "dir-": 243, 2024-01-25T15:05:05.372 INFO:teuthology.orchestra.run.smithi186.stdout: "dn": 834, 2024-01-25T15:05:05.373 INFO:teuthology.orchestra.run.smithi186.stdout: "dn+": 1728, 2024-01-25T15:05:05.373 INFO:teuthology.orchestra.run.smithi186.stdout: "dn-": 894, 2024-01-25T15:05:05.373 INFO:teuthology.orchestra.run.smithi186.stdout: "cap": 0, 2024-01-25T15:05:05.373 INFO:teuthology.orchestra.run.smithi186.stdout: "cap+": 0, 2024-01-25T15:05:05.373 INFO:teuthology.orchestra.run.smithi186.stdout: "cap-": 0, 2024-01-25T15:05:05.373 INFO:teuthology.orchestra.run.smithi186.stdout: "rss": 52848, 2024-01-25T15:05:05.373 INFO:teuthology.orchestra.run.smithi186.stdout: "heap": 207228 2024-01-25T15:05:05.373 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.373 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_server": { 2024-01-25T15:05:05.373 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_client_request": 0, 2024-01-25T15:05:05.373 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_server_request": 0, 2024-01-25T15:05:05.373 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_request": 0, 2024-01-25T15:05:05.373 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_session": 0, 2024-01-25T15:05:05.373 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_peer_request": 0, 2024-01-25T15:05:05.373 INFO:teuthology.orchestra.run.smithi186.stdout: "req_create_latency": { 2024-01-25T15:05:05.374 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.374 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.374 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.374 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.374 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getattr_latency": { 2024-01-25T15:05:05.374 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.374 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.374 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.374 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.374 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getfilelock_latency": { 2024-01-25T15:05:05.374 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.374 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.374 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: "req_link_latency": { 2024-01-25T15:05:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookup_latency": { 2024-01-25T15:05:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookuphash_latency": { 2024-01-25T15:05:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.375 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.376 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.376 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.376 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupino_latency": { 2024-01-25T15:05:05.376 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.376 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.376 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.376 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.376 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupname_latency": { 2024-01-25T15:05:05.376 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.376 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.376 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.376 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.376 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupparent_latency": { 2024-01-25T15:05:05.376 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.377 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.377 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.377 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.377 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupsnap_latency": { 2024-01-25T15:05:05.377 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.377 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.377 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.377 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.377 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lssnap_latency": { 2024-01-25T15:05:05.377 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.377 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.377 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.377 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.377 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mkdir_latency": { 2024-01-25T15:05:05.378 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.378 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.378 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.378 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:05 smithi186 ceph-mon[35697]: pgmap v441: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-01-25T15:05:05.379 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.379 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mknod_latency": { 2024-01-25T15:05:05.379 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.379 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.379 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.379 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.379 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mksnap_latency": { 2024-01-25T15:05:05.379 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.379 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.379 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.379 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.379 INFO:teuthology.orchestra.run.smithi186.stdout: "req_open_latency": { 2024-01-25T15:05:05.380 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.380 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.380 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.380 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.380 INFO:teuthology.orchestra.run.smithi186.stdout: "req_readdir_latency": { 2024-01-25T15:05:05.380 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.380 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.380 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.380 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.380 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rename_latency": { 2024-01-25T15:05:05.380 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.380 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.380 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.381 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.381 INFO:teuthology.orchestra.run.smithi186.stdout: "req_renamesnap_latency": { 2024-01-25T15:05:05.381 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.381 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.381 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.381 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.381 INFO:teuthology.orchestra.run.smithi186.stdout: "req_snapdiff_latency": { 2024-01-25T15:05:05.381 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.381 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.381 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.381 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.381 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmdir_latency": { 2024-01-25T15:05:05.381 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.381 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.382 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.382 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.382 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmsnap_latency": { 2024-01-25T15:05:05.382 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.382 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.382 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.382 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.382 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmxattr_latency": { 2024-01-25T15:05:05.382 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.382 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.382 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.382 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.382 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setattr_latency": { 2024-01-25T15:05:05.382 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.383 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.383 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.383 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.383 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setdirlayout_latency": { 2024-01-25T15:05:05.383 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.383 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.383 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.383 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.383 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setfilelock_latency": { 2024-01-25T15:05:05.383 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.383 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.383 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.383 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.383 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setlayout_latency": { 2024-01-25T15:05:05.383 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.384 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.384 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.384 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.384 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setxattr_latency": { 2024-01-25T15:05:05.384 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.384 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.384 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.384 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.384 INFO:teuthology.orchestra.run.smithi186.stdout: "req_symlink_latency": { 2024-01-25T15:05:05.384 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.384 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.384 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.384 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.384 INFO:teuthology.orchestra.run.smithi186.stdout: "req_unlink_latency": { 2024-01-25T15:05:05.385 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.385 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.385 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.385 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.385 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_revoke_eviction": 0, 2024-01-25T15:05:05.385 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_acquisition_throttle": 0, 2024-01-25T15:05:05.385 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getvxattr_latency": { 2024-01-25T15:05:05.385 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.385 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.385 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.385 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:05.385 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.385 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_sessions": { 2024-01-25T15:05:05.385 INFO:teuthology.orchestra.run.smithi186.stdout: "session_count": 1, 2024-01-25T15:05:05.386 INFO:teuthology.orchestra.run.smithi186.stdout: "session_add": 2, 2024-01-25T15:05:05.386 INFO:teuthology.orchestra.run.smithi186.stdout: "session_remove": 1, 2024-01-25T15:05:05.386 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_open": 1, 2024-01-25T15:05:05.386 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_stale": 0, 2024-01-25T15:05:05.386 INFO:teuthology.orchestra.run.smithi186.stdout: "total_load": 0, 2024-01-25T15:05:05.386 INFO:teuthology.orchestra.run.smithi186.stdout: "average_load": 0, 2024-01-25T15:05:05.386 INFO:teuthology.orchestra.run.smithi186.stdout: "avg_session_uptime": 1458, 2024-01-25T15:05:05.386 INFO:teuthology.orchestra.run.smithi186.stdout: "mdthresh_evicted": 0 2024-01-25T15:05:05.386 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.386 INFO:teuthology.orchestra.run.smithi186.stdout: "mempool": { 2024-01-25T15:05:05.386 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_bytes": 0, 2024-01-25T15:05:05.386 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_items": 0, 2024-01-25T15:05:05.386 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_bytes": 0, 2024-01-25T15:05:05.387 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_items": 0, 2024-01-25T15:05:05.387 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_bytes": 0, 2024-01-25T15:05:05.387 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_items": 0, 2024-01-25T15:05:05.387 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-25T15:05:05.387 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_items": 0, 2024-01-25T15:05:05.387 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-25T15:05:05.387 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_items": 0, 2024-01-25T15:05:05.387 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_bytes": 0, 2024-01-25T15:05:05.387 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_items": 0, 2024-01-25T15:05:05.387 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-25T15:05:05.387 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_items": 0, 2024-01-25T15:05:05.387 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_bytes": 0, 2024-01-25T15:05:05.387 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_items": 0, 2024-01-25T15:05:05.387 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_bytes": 0, 2024-01-25T15:05:05.388 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_items": 0, 2024-01-25T15:05:05.388 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-25T15:05:05.388 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_items": 0, 2024-01-25T15:05:05.388 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-25T15:05:05.388 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_items": 0, 2024-01-25T15:05:05.388 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_bytes": 0, 2024-01-25T15:05:05.388 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_items": 0, 2024-01-25T15:05:05.388 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_bytes": 0, 2024-01-25T15:05:05.388 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_items": 0, 2024-01-25T15:05:05.388 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-25T15:05:05.388 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_items": 0, 2024-01-25T15:05:05.388 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_bytes": 0, 2024-01-25T15:05:05.388 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_items": 0, 2024-01-25T15:05:05.388 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_bytes": 0, 2024-01-25T15:05:05.389 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_items": 0, 2024-01-25T15:05:05.389 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_bytes": 0, 2024-01-25T15:05:05.389 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_items": 0, 2024-01-25T15:05:05.389 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_bytes": 0, 2024-01-25T15:05:05.389 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_items": 0, 2024-01-25T15:05:05.389 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_bytes": 181450, 2024-01-25T15:05:05.389 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_items": 53, 2024-01-25T15:05:05.389 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_bytes": 0, 2024-01-25T15:05:05.389 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_items": 0, 2024-01-25T15:05:05.389 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_bytes": 0, 2024-01-25T15:05:05.389 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_items": 0, 2024-01-25T15:05:05.389 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_bytes": 0, 2024-01-25T15:05:05.390 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_items": 0, 2024-01-25T15:05:05.390 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_bytes": 0, 2024-01-25T15:05:05.390 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_items": 0, 2024-01-25T15:05:05.390 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_bytes": 7432, 2024-01-25T15:05:05.390 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_items": 156, 2024-01-25T15:05:05.390 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_bytes": 0, 2024-01-25T15:05:05.390 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_items": 0, 2024-01-25T15:05:05.390 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_bytes": 0, 2024-01-25T15:05:05.390 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_items": 0, 2024-01-25T15:05:05.390 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_bytes": 646097, 2024-01-25T15:05:05.390 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_items": 4583, 2024-01-25T15:05:05.390 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_bytes": 0, 2024-01-25T15:05:05.390 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_items": 0, 2024-01-25T15:05:05.390 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_bytes": 0, 2024-01-25T15:05:05.391 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_items": 0 2024-01-25T15:05:05.391 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.391 INFO:teuthology.orchestra.run.smithi186.stdout: "objecter": { 2024-01-25T15:05:05.391 INFO:teuthology.orchestra.run.smithi186.stdout: "op_active": 0, 2024-01-25T15:05:05.391 INFO:teuthology.orchestra.run.smithi186.stdout: "op_laggy": 0, 2024-01-25T15:05:05.391 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send": 906, 2024-01-25T15:05:05.391 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send_bytes": 21, 2024-01-25T15:05:05.391 INFO:teuthology.orchestra.run.smithi186.stdout: "op_resend": 3, 2024-01-25T15:05:05.391 INFO:teuthology.orchestra.run.smithi186.stdout: "op_reply": 906, 2024-01-25T15:05:05.391 INFO:teuthology.orchestra.run.smithi186.stdout: "op_latency": { 2024-01-25T15:05:05.391 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 906, 2024-01-25T15:05:05.391 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.750986567, 2024-01-25T15:05:05.391 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000828903 2024-01-25T15:05:05.391 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.391 INFO:teuthology.orchestra.run.smithi186.stdout: "op_inflight": 0, 2024-01-25T15:05:05.392 INFO:teuthology.orchestra.run.smithi186.stdout: "oplen_avg": { 2024-01-25T15:05:05.392 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 906, 2024-01-25T15:05:05.392 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 907 2024-01-25T15:05:05.392 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.392 INFO:teuthology.orchestra.run.smithi186.stdout: "op": 906, 2024-01-25T15:05:05.392 INFO:teuthology.orchestra.run.smithi186.stdout: "op_r": 906, 2024-01-25T15:05:05.392 INFO:teuthology.orchestra.run.smithi186.stdout: "op_w": 0, 2024-01-25T15:05:05.392 INFO:teuthology.orchestra.run.smithi186.stdout: "op_rmw": 0, 2024-01-25T15:05:05.392 INFO:teuthology.orchestra.run.smithi186.stdout: "op_pg": 0, 2024-01-25T15:05:05.392 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_stat": 525, 2024-01-25T15:05:05.392 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_create": 0, 2024-01-25T15:05:05.392 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_read": 379, 2024-01-25T15:05:05.393 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_write": 0, 2024-01-25T15:05:05.393 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writefull": 0, 2024-01-25T15:05:05.393 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writesame": 0, 2024-01-25T15:05:05.393 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_append": 0, 2024-01-25T15:05:05.393 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_zero": 0, 2024-01-25T15:05:05.393 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_truncate": 0, 2024-01-25T15:05:05.393 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_delete": 0, 2024-01-25T15:05:05.393 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_mapext": 0, 2024-01-25T15:05:05.393 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_sparse_read": 0, 2024-01-25T15:05:05.393 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_clonerange": 0, 2024-01-25T15:05:05.393 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_getxattr": 1, 2024-01-25T15:05:05.393 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_setxattr": 0, 2024-01-25T15:05:05.393 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_cmpxattr": 0, 2024-01-25T15:05:05.393 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_rmxattr": 0, 2024-01-25T15:05:05.393 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_resetxattrs": 0, 2024-01-25T15:05:05.394 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_call": 0, 2024-01-25T15:05:05.394 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_watch": 0, 2024-01-25T15:05:05.394 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_notify": 0, 2024-01-25T15:05:05.394 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_src_cmpxattr": 0, 2024-01-25T15:05:05.394 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls": 0, 2024-01-25T15:05:05.394 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls_filter": 0, 2024-01-25T15:05:05.394 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_other": 0, 2024-01-25T15:05:05.394 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_active": 0, 2024-01-25T15:05:05.394 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_send": 0, 2024-01-25T15:05:05.394 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_resend": 0, 2024-01-25T15:05:05.394 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_ping": 0, 2024-01-25T15:05:05.394 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_active": 0, 2024-01-25T15:05:05.394 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_send": 0, 2024-01-25T15:05:05.395 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_resend": 0, 2024-01-25T15:05:05.395 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_active": 0, 2024-01-25T15:05:05.395 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_send": 0, 2024-01-25T15:05:05.395 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_resend": 0, 2024-01-25T15:05:05.395 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_active": 0, 2024-01-25T15:05:05.395 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_send": 0, 2024-01-25T15:05:05.395 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_resend": 0, 2024-01-25T15:05:05.395 INFO:teuthology.orchestra.run.smithi186.stdout: "command_active": 0, 2024-01-25T15:05:05.395 INFO:teuthology.orchestra.run.smithi186.stdout: "command_send": 0, 2024-01-25T15:05:05.395 INFO:teuthology.orchestra.run.smithi186.stdout: "command_resend": 0, 2024-01-25T15:05:05.395 INFO:teuthology.orchestra.run.smithi186.stdout: "map_epoch": 87, 2024-01-25T15:05:05.395 INFO:teuthology.orchestra.run.smithi186.stdout: "map_full": 0, 2024-01-25T15:05:05.395 INFO:teuthology.orchestra.run.smithi186.stdout: "map_inc": 2, 2024-01-25T15:05:05.395 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_sessions": 4, 2024-01-25T15:05:05.396 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_open": 4, 2024-01-25T15:05:05.396 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_close": 0, 2024-01-25T15:05:05.396 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_laggy": 0, 2024-01-25T15:05:05.396 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_wr": 0, 2024-01-25T15:05:05.396 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_rd": 2, 2024-01-25T15:05:05.396 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_del": 0 2024-01-25T15:05:05.396 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.396 INFO:teuthology.orchestra.run.smithi186.stdout: "oft": { 2024-01-25T15:05:05.396 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_objs": 0, 2024-01-25T15:05:05.396 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_kv_pairs": 0, 2024-01-25T15:05:05.396 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_updates": 0, 2024-01-25T15:05:05.396 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_removes": 0 2024-01-25T15:05:05.396 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.397 INFO:teuthology.orchestra.run.smithi186.stdout: "osd-slow-ops": { 2024-01-25T15:05:05.397 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_ops_count": 0 2024-01-25T15:05:05.397 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.397 INFO:teuthology.orchestra.run.smithi186.stdout: "purge_queue": { 2024-01-25T15:05:05.397 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops": 0, 2024-01-25T15:05:05.397 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops_high_water": 0, 2024-01-25T15:05:05.397 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing": 0, 2024-01-25T15:05:05.397 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_high_water": 0, 2024-01-25T15:05:05.397 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed_ops": 0, 2024-01-25T15:05:05.397 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed": 0, 2024-01-25T15:05:05.397 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_item_in_journal": 0 2024-01-25T15:05:05.397 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.397 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-25T15:05:05.397 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:05.397 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 1032, 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 7027090, 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 1032, 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 1032, 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 7027090, 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.398 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_bytes": { 2024-01-25T15:05:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-01-25T15:05:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-01-25T15:05:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-01-25T15:05:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 906, 2024-01-25T15:05:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 6012761, 2024-01-25T15:05:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 906, 2024-01-25T15:05:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 6012761, 2024-01-25T15:05:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.399 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.400 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:05.400 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.400 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_ops": { 2024-01-25T15:05:05.400 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:05.400 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 1024, 2024-01-25T15:05:05.400 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:05.400 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-01-25T15:05:05.400 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-01-25T15:05:05.400 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:05.400 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:05.400 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 906, 2024-01-25T15:05:05.400 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 906, 2024-01-25T15:05:05.400 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 906, 2024-01-25T15:05:05.400 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 906, 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle": { 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-01-25T15:05:05.401 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 0, 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 0, 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle-0x55ffc9d86960": { 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:05.402 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:05.403 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-01-25T15:05:05.403 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-01-25T15:05:05.403 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 0, 2024-01-25T15:05:05.403 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 0, 2024-01-25T15:05:05.403 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:05.403 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:05.403 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:05.403 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:05.403 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:05.403 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:05.403 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-01-25T15:05:05.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:05 smithi170 ceph-mon[31899]: pgmap v441: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-01-25T15:05:05.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:05 smithi191 ceph-mon[36347]: pgmap v441: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.0 KiB/s wr, 14 op/s 2024-01-25T15:05:06.129 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-01-25T15:05:06.129 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-01-25T15:05:06.129 DEBUG:tasks.check_counter:Getting stats from k 2024-01-25T15:05:06.129 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph daemon mds.k perf dump 2024-01-25T15:05:06.374 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.b/config 2024-01-25T15:05:07.442 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:07 smithi186 ceph-mon[35697]: pgmap v442: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 11 op/s 2024-01-25T15:05:07.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:07 smithi170 ceph-mon[31899]: pgmap v442: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 11 op/s 2024-01-25T15:05:07.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:07 smithi191 ceph-mon[36347]: pgmap v442: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 11 op/s 2024-01-25T15:05:07.992 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-01-25T15:05:07.992 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-0": { 2024-01-25T15:05:07.992 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 2834, 2024-01-25T15:05:07.992 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 4194, 2024-01-25T15:05:07.992 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 1012238, 2024-01-25T15:05:07.992 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 5876414, 2024-01-25T15:05:07.992 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 18, 2024-01-25T15:05:07.993 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 6, 2024-01-25T15:05:07.993 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.212556324, 2024-01-25T15:05:07.993 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.091637554, 2024-01-25T15:05:07.993 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.117628865, 2024-01-25T15:05:07.993 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.023338785, 2024-01-25T15:05:07.993 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:07.993 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 4190, 2024-01-25T15:05:07.993 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.095382260, 2024-01-25T15:05:07.993 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000022764 2024-01-25T15:05:07.993 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:07.993 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:07.993 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 4484, 2024-01-25T15:05:07.993 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000695850, 2024-01-25T15:05:07.994 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000155 2024-01-25T15:05:07.994 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:07.994 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 560192, 2024-01-25T15:05:07.994 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 1790464 2024-01-25T15:05:07.994 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:07.994 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-1": { 2024-01-25T15:05:07.994 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 8737, 2024-01-25T15:05:07.994 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 5792, 2024-01-25T15:05:07.994 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 3254825, 2024-01-25T15:05:07.994 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 1713819, 2024-01-25T15:05:07.994 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 11, 2024-01-25T15:05:07.994 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 6, 2024-01-25T15:05:07.994 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.426760564, 2024-01-25T15:05:07.994 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.161448449, 2024-01-25T15:05:07.995 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.349200026, 2024-01-25T15:05:07.995 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.008622963, 2024-01-25T15:05:07.995 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:07.995 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 5793, 2024-01-25T15:05:07.995 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.117852327, 2024-01-25T15:05:07.995 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000020343 2024-01-25T15:05:07.995 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:07.995 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:07.995 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 13636, 2024-01-25T15:05:07.995 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.001834794, 2024-01-25T15:05:07.995 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000134 2024-01-25T15:05:07.995 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:07.995 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-01-25T15:05:07.995 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 198656 2024-01-25T15:05:07.996 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:07.996 INFO:teuthology.orchestra.run.smithi186.stdout: "AsyncMessenger::Worker-2": { 2024-01-25T15:05:07.996 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_messages": 892, 2024-01-25T15:05:07.996 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages": 734, 2024-01-25T15:05:07.996 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_bytes": 1155688, 2024-01-25T15:05:07.996 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_bytes": 477592, 2024-01-25T15:05:07.996 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_created_connections": 11, 2024-01-25T15:05:07.996 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_active_connections": 7, 2024-01-25T15:05:07.996 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_total_time": 0.063847798, 2024-01-25T15:05:07.996 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_send_time": 0.020648602, 2024-01-25T15:05:07.996 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_recv_time": 0.043673302, 2024-01-25T15:05:07.996 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_running_fast_dispatch_time": 0.008985169, 2024-01-25T15:05:07.996 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:07.997 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 733, 2024-01-25T15:05:07.997 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.034208365, 2024-01-25T15:05:07.997 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000046668 2024-01-25T15:05:07.997 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:07.997 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:07.997 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 705, 2024-01-25T15:05:07.997 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000096121, 2024-01-25T15:05:07.997 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000136 2024-01-25T15:05:07.997 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:07.997 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_recv_encrypted_bytes": 850896, 2024-01-25T15:05:07.997 INFO:teuthology.orchestra.run.smithi186.stdout: "msgr_send_encrypted_bytes": 121456 2024-01-25T15:05:07.997 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:07.997 INFO:teuthology.orchestra.run.smithi186.stdout: "cct": { 2024-01-25T15:05:07.997 INFO:teuthology.orchestra.run.smithi186.stdout: "total_workers": 1, 2024-01-25T15:05:07.997 INFO:teuthology.orchestra.run.smithi186.stdout: "unhealthy_workers": 0 2024-01-25T15:05:07.998 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:07.998 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-MDSRank": { 2024-01-25T15:05:07.998 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-01-25T15:05:07.998 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-01-25T15:05:07.998 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1202, 2024-01-25T15:05:07.998 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.608806986, 2024-01-25T15:05:07.998 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000506494 2024-01-25T15:05:07.998 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:07.998 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:07.998 INFO:teuthology.orchestra.run.smithi186.stdout: "finisher-PurgeQueue": { 2024-01-25T15:05:07.998 INFO:teuthology.orchestra.run.smithi186.stdout: "queue_len": 0, 2024-01-25T15:05:07.998 INFO:teuthology.orchestra.run.smithi186.stdout: "complete_latency": { 2024-01-25T15:05:07.998 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1028, 2024-01-25T15:05:07.999 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.053969745, 2024-01-25T15:05:07.999 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000052499 2024-01-25T15:05:07.999 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:07.999 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:07.999 INFO:teuthology.orchestra.run.smithi186.stdout: "mds": { 2024-01-25T15:05:07.999 INFO:teuthology.orchestra.run.smithi186.stdout: "request": 971, 2024-01-25T15:05:07.999 INFO:teuthology.orchestra.run.smithi186.stdout: "reply": 958, 2024-01-25T15:05:07.999 INFO:teuthology.orchestra.run.smithi186.stdout: "reply_latency": { 2024-01-25T15:05:07.999 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 958, 2024-01-25T15:05:07.999 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 2.152549026, 2024-01-25T15:05:07.999 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.002246919 2024-01-25T15:05:07.999 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:07.999 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_reply": 0, 2024-01-25T15:05:07.999 INFO:teuthology.orchestra.run.smithi186.stdout: "forward": 13, 2024-01-25T15:05:08.000 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_complete": 0, 2024-01-25T15:05:08.000 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_fetch_keys": 0, 2024-01-25T15:05:08.000 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_commit": 11, 2024-01-25T15:05:08.000 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_split": 0, 2024-01-25T15:05:08.000 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_merge": 0, 2024-01-25T15:05:08.000 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes": 42, 2024-01-25T15:05:08.000 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_top": 16, 2024-01-25T15:05:08.000 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_bottom": 9, 2024-01-25T15:05:08.000 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pin_tail": 17, 2024-01-25T15:05:08.000 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_pinned": 19, 2024-01-25T15:05:08.000 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_expired": 409, 2024-01-25T15:05:08.000 INFO:teuthology.orchestra.run.smithi186.stdout: "inodes_with_caps": 0, 2024-01-25T15:05:08.000 INFO:teuthology.orchestra.run.smithi186.stdout: "caps": 0, 2024-01-25T15:05:08.001 INFO:teuthology.orchestra.run.smithi186.stdout: "subtrees": 5, 2024-01-25T15:05:08.001 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse": 1958, 2024-01-25T15:05:08.001 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_hit": 1611, 2024-01-25T15:05:08.001 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_forward": 7, 2024-01-25T15:05:08.001 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_discover": 109, 2024-01-25T15:05:08.001 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_dir_fetch": 0, 2024-01-25T15:05:08.001 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_remote_ino": 0, 2024-01-25T15:05:08.001 INFO:teuthology.orchestra.run.smithi186.stdout: "traverse_lock": 3, 2024-01-25T15:05:08.001 INFO:teuthology.orchestra.run.smithi186.stdout: "load_cent": 0, 2024-01-25T15:05:08.001 INFO:teuthology.orchestra.run.smithi186.stdout: "q": 0, 2024-01-25T15:05:08.001 INFO:teuthology.orchestra.run.smithi186.stdout: "exported": 39, 2024-01-25T15:05:08.001 INFO:teuthology.orchestra.run.smithi186.stdout: "exported_inodes": 43, 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi186.stdout: "imported": 45, 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi186.stdout: "imported_inodes": 365, 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_dir_fetch": 0, 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_backtrace_fetch": 333, 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi186.stdout: "openino_peer_discover": 3, 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rfiles": 1924, 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rbytes": 15512990, 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi186.stdout: "root_rsnaps": 0, 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_fetch": 333, 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_set_tag": 0, 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_backtrace_repaired": 0, 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_inotable_repaired": 0, 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_inodes": 24, 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dir_base_inodes": 0, 2024-01-25T15:05:08.002 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_dirfrag_rstats": 24, 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: "scrub_file_inodes": 309, 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_inode_file_caps": 14, 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_revoke": 209, 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_grant": 602, 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_trunc": 4, 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps": 461, 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_caps_dirty": 210, 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_cap_release": 45, 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: "process_request_cap_release": 808 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_cache": { 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update": 0, 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_update_receipt": 0, 2024-01-25T15:05:08.003 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_try_discover": 0, 2024-01-25T15:05:08.004 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_send_discover": 119, 2024-01-25T15:05:08.004 INFO:teuthology.orchestra.run.smithi186.stdout: "dir_handle_discover": 47, 2024-01-25T15:05:08.004 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays": 4, 2024-01-25T15:05:08.004 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_delayed": 0, 2024-01-25T15:05:08.004 INFO:teuthology.orchestra.run.smithi186.stdout: "num_strays_enqueuing": 0, 2024-01-25T15:05:08.004 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_created": 417, 2024-01-25T15:05:08.004 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_enqueued": 411, 2024-01-25T15:05:08.004 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_reintegrated": 3, 2024-01-25T15:05:08.004 INFO:teuthology.orchestra.run.smithi186.stdout: "strays_migrated": 1, 2024-01-25T15:05:08.004 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_processing": 0, 2024-01-25T15:05:08.004 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_enqueued": 0, 2024-01-25T15:05:08.004 INFO:teuthology.orchestra.run.smithi186.stdout: "num_recovering_prioritized": 0, 2024-01-25T15:05:08.004 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_started": 0, 2024-01-25T15:05:08.004 INFO:teuthology.orchestra.run.smithi186.stdout: "recovery_completed": 0, 2024-01-25T15:05:08.005 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_enqueue_scrub": 0, 2024-01-25T15:05:08.005 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_exportdir": 39, 2024-01-25T15:05:08.005 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_flush": 0, 2024-01-25T15:05:08.005 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragmentdir": 0, 2024-01-25T15:05:08.005 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_fragstats": 0, 2024-01-25T15:05:08.005 INFO:teuthology.orchestra.run.smithi186.stdout: "ireq_inodestats": 0 2024-01-25T15:05:08.005 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.005 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_log": { 2024-01-25T15:05:08.005 INFO:teuthology.orchestra.run.smithi186.stdout: "evlrg": 0, 2024-01-25T15:05:08.005 INFO:teuthology.orchestra.run.smithi186.stdout: "evadd": 1813, 2024-01-25T15:05:08.005 INFO:teuthology.orchestra.run.smithi186.stdout: "evex": 0, 2024-01-25T15:05:08.005 INFO:teuthology.orchestra.run.smithi186.stdout: "evtrm": 0, 2024-01-25T15:05:08.005 INFO:teuthology.orchestra.run.smithi186.stdout: "ev": 1813, 2024-01-25T15:05:08.006 INFO:teuthology.orchestra.run.smithi186.stdout: "evexg": 0, 2024-01-25T15:05:08.006 INFO:teuthology.orchestra.run.smithi186.stdout: "evexd": 0, 2024-01-25T15:05:08.006 INFO:teuthology.orchestra.run.smithi186.stdout: "segadd": 3, 2024-01-25T15:05:08.006 INFO:teuthology.orchestra.run.smithi186.stdout: "segex": 0, 2024-01-25T15:05:08.006 INFO:teuthology.orchestra.run.smithi186.stdout: "segtrm": 0, 2024-01-25T15:05:08.006 INFO:teuthology.orchestra.run.smithi186.stdout: "seg": 3, 2024-01-25T15:05:08.006 INFO:teuthology.orchestra.run.smithi186.stdout: "segmjr": 2, 2024-01-25T15:05:08.006 INFO:teuthology.orchestra.run.smithi186.stdout: "segexg": 0, 2024-01-25T15:05:08.006 INFO:teuthology.orchestra.run.smithi186.stdout: "segexd": 0, 2024-01-25T15:05:08.006 INFO:teuthology.orchestra.run.smithi186.stdout: "expos": 4194304, 2024-01-25T15:05:08.006 INFO:teuthology.orchestra.run.smithi186.stdout: "wrpos": 7750358, 2024-01-25T15:05:08.006 INFO:teuthology.orchestra.run.smithi186.stdout: "rdpos": 0, 2024-01-25T15:05:08.006 INFO:teuthology.orchestra.run.smithi186.stdout: "jlat": { 2024-01-25T15:05:08.006 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 453, 2024-01-25T15:05:08.007 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 1.617893936, 2024-01-25T15:05:08.007 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.003571509 2024-01-25T15:05:08.007 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.007 INFO:teuthology.orchestra.run.smithi186.stdout: "replayed": 0 2024-01-25T15:05:08.007 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.007 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_mem": { 2024-01-25T15:05:08.007 INFO:teuthology.orchestra.run.smithi186.stdout: "ino": 39, 2024-01-25T15:05:08.007 INFO:teuthology.orchestra.run.smithi186.stdout: "ino+": 647, 2024-01-25T15:05:08.007 INFO:teuthology.orchestra.run.smithi186.stdout: "ino-": 608, 2024-01-25T15:05:08.007 INFO:teuthology.orchestra.run.smithi186.stdout: "dir": 37, 2024-01-25T15:05:08.007 INFO:teuthology.orchestra.run.smithi186.stdout: "dir+": 253, 2024-01-25T15:05:08.007 INFO:teuthology.orchestra.run.smithi186.stdout: "dir-": 216, 2024-01-25T15:05:08.007 INFO:teuthology.orchestra.run.smithi186.stdout: "dn": 42, 2024-01-25T15:05:08.007 INFO:teuthology.orchestra.run.smithi186.stdout: "dn+": 1279, 2024-01-25T15:05:08.007 INFO:teuthology.orchestra.run.smithi186.stdout: "dn-": 1237, 2024-01-25T15:05:08.008 INFO:teuthology.orchestra.run.smithi186.stdout: "cap": 0, 2024-01-25T15:05:08.008 INFO:teuthology.orchestra.run.smithi186.stdout: "cap+": 615, 2024-01-25T15:05:08.008 INFO:teuthology.orchestra.run.smithi186.stdout: "cap-": 615, 2024-01-25T15:05:08.008 INFO:teuthology.orchestra.run.smithi186.stdout: "rss": 65892, 2024-01-25T15:05:08.008 INFO:teuthology.orchestra.run.smithi186.stdout: "heap": 199036 2024-01-25T15:05:08.008 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.008 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_server": { 2024-01-25T15:05:08.008 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_client_request": 1606, 2024-01-25T15:05:08.008 INFO:teuthology.orchestra.run.smithi186.stdout: "dispatch_server_request": 258, 2024-01-25T15:05:08.008 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_request": 971, 2024-01-25T15:05:08.008 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_client_session": 83, 2024-01-25T15:05:08.008 INFO:teuthology.orchestra.run.smithi186.stdout: "handle_peer_request": 584, 2024-01-25T15:05:08.008 INFO:teuthology.orchestra.run.smithi186.stdout: "req_create_latency": { 2024-01-25T15:05:08.009 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 35, 2024-01-25T15:05:08.009 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.074571826, 2024-01-25T15:05:08.009 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.002130623 2024-01-25T15:05:08.009 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.009 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getattr_latency": { 2024-01-25T15:05:08.009 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 4, 2024-01-25T15:05:08.009 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.014425348, 2024-01-25T15:05:08.009 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.003606337 2024-01-25T15:05:08.009 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.009 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getfilelock_latency": { 2024-01-25T15:05:08.009 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.009 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.009 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.009 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.010 INFO:teuthology.orchestra.run.smithi186.stdout: "req_link_latency": { 2024-01-25T15:05:08.010 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 9, 2024-01-25T15:05:08.010 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.127417190, 2024-01-25T15:05:08.010 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.014157465 2024-01-25T15:05:08.010 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.010 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookup_latency": { 2024-01-25T15:05:08.010 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 334, 2024-01-25T15:05:08.010 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.127942089, 2024-01-25T15:05:08.010 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000383060 2024-01-25T15:05:08.010 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.010 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookuphash_latency": { 2024-01-25T15:05:08.010 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.010 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.010 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.011 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.011 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupino_latency": { 2024-01-25T15:05:08.011 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.011 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.011 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.011 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.011 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupname_latency": { 2024-01-25T15:05:08.011 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.011 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.011 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.011 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.012 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupparent_latency": { 2024-01-25T15:05:08.012 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.012 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.012 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.012 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.012 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lookupsnap_latency": { 2024-01-25T15:05:08.012 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.012 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.012 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.012 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.012 INFO:teuthology.orchestra.run.smithi186.stdout: "req_lssnap_latency": { 2024-01-25T15:05:08.012 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.012 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.013 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.013 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.013 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mkdir_latency": { 2024-01-25T15:05:08.013 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 16, 2024-01-25T15:05:08.013 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.017556557, 2024-01-25T15:05:08.013 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.001097284 2024-01-25T15:05:08.014 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.014 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mknod_latency": { 2024-01-25T15:05:08.014 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 14, 2024-01-25T15:05:08.014 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.028274539, 2024-01-25T15:05:08.014 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.002019609 2024-01-25T15:05:08.014 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.014 INFO:teuthology.orchestra.run.smithi186.stdout: "req_mksnap_latency": { 2024-01-25T15:05:08.014 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.014 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.014 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.014 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.014 INFO:teuthology.orchestra.run.smithi186.stdout: "req_open_latency": { 2024-01-25T15:05:08.015 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.015 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.015 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.015 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.015 INFO:teuthology.orchestra.run.smithi186.stdout: "req_readdir_latency": { 2024-01-25T15:05:08.015 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 75, 2024-01-25T15:05:08.015 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.049634770, 2024-01-25T15:05:08.015 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000661796 2024-01-25T15:05:08.015 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.015 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rename_latency": { 2024-01-25T15:05:08.015 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 23, 2024-01-25T15:05:08.015 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.578936142, 2024-01-25T15:05:08.015 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.025171136 2024-01-25T15:05:08.015 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.015 INFO:teuthology.orchestra.run.smithi186.stdout: "req_renamesnap_latency": { 2024-01-25T15:05:08.016 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.016 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.016 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.016 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.016 INFO:teuthology.orchestra.run.smithi186.stdout: "req_snapdiff_latency": { 2024-01-25T15:05:08.016 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.016 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.016 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.016 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.016 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmdir_latency": { 2024-01-25T15:05:08.016 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 46, 2024-01-25T15:05:08.016 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.400760468, 2024-01-25T15:05:08.016 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.008712184 2024-01-25T15:05:08.017 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.017 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmsnap_latency": { 2024-01-25T15:05:08.017 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.017 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.017 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.017 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.017 INFO:teuthology.orchestra.run.smithi186.stdout: "req_rmxattr_latency": { 2024-01-25T15:05:08.017 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.017 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.017 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.017 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.017 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setattr_latency": { 2024-01-25T15:05:08.017 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 4, 2024-01-25T15:05:08.018 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.002423641, 2024-01-25T15:05:08.018 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000605910 2024-01-25T15:05:08.018 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.018 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setdirlayout_latency": { 2024-01-25T15:05:08.018 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.018 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.018 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.018 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.018 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setfilelock_latency": { 2024-01-25T15:05:08.018 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.018 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.018 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.019 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.019 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setlayout_latency": { 2024-01-25T15:05:08.019 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.019 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.019 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.019 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.019 INFO:teuthology.orchestra.run.smithi186.stdout: "req_setxattr_latency": { 2024-01-25T15:05:08.019 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.019 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.019 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.019 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.019 INFO:teuthology.orchestra.run.smithi186.stdout: "req_symlink_latency": { 2024-01-25T15:05:08.019 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 11, 2024-01-25T15:05:08.019 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.012586875, 2024-01-25T15:05:08.020 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.001144261 2024-01-25T15:05:08.020 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.020 INFO:teuthology.orchestra.run.smithi186.stdout: "req_unlink_latency": { 2024-01-25T15:05:08.020 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 387, 2024-01-25T15:05:08.020 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.718019581, 2024-01-25T15:05:08.020 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.001855347 2024-01-25T15:05:08.020 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.020 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_revoke_eviction": 0, 2024-01-25T15:05:08.020 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_acquisition_throttle": 0, 2024-01-25T15:05:08.020 INFO:teuthology.orchestra.run.smithi186.stdout: "req_getvxattr_latency": { 2024-01-25T15:05:08.020 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.020 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.020 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.020 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:08.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.021 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_sessions": { 2024-01-25T15:05:08.021 INFO:teuthology.orchestra.run.smithi186.stdout: "session_count": 1, 2024-01-25T15:05:08.021 INFO:teuthology.orchestra.run.smithi186.stdout: "session_add": 2, 2024-01-25T15:05:08.021 INFO:teuthology.orchestra.run.smithi186.stdout: "session_remove": 1, 2024-01-25T15:05:08.021 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_open": 1, 2024-01-25T15:05:08.021 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions_stale": 0, 2024-01-25T15:05:08.021 INFO:teuthology.orchestra.run.smithi186.stdout: "total_load": 687, 2024-01-25T15:05:08.021 INFO:teuthology.orchestra.run.smithi186.stdout: "average_load": 687, 2024-01-25T15:05:08.021 INFO:teuthology.orchestra.run.smithi186.stdout: "avg_session_uptime": 1462, 2024-01-25T15:05:08.021 INFO:teuthology.orchestra.run.smithi186.stdout: "mdthresh_evicted": 0 2024-01-25T15:05:08.021 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.021 INFO:teuthology.orchestra.run.smithi186.stdout: "mempool": { 2024-01-25T15:05:08.021 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_bytes": 0, 2024-01-25T15:05:08.022 INFO:teuthology.orchestra.run.smithi186.stdout: "bloom_filter_items": 0, 2024-01-25T15:05:08.022 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_bytes": 0, 2024-01-25T15:05:08.022 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_alloc_items": 0, 2024-01-25T15:05:08.022 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_bytes": 0, 2024-01-25T15:05:08.022 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_data_items": 0, 2024-01-25T15:05:08.022 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-25T15:05:08.022 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_onode_items": 0, 2024-01-25T15:05:08.022 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-25T15:05:08.022 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_meta_items": 0, 2024-01-25T15:05:08.022 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_bytes": 0, 2024-01-25T15:05:08.022 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_other_items": 0, 2024-01-25T15:05:08.022 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-25T15:05:08.022 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_cache_buffer_items": 0, 2024-01-25T15:05:08.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_bytes": 0, 2024-01-25T15:05:08.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_extent_items": 0, 2024-01-25T15:05:08.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_bytes": 0, 2024-01-25T15:05:08.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_blob_items": 0, 2024-01-25T15:05:08.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-25T15:05:08.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_shared_blob_items": 0, 2024-01-25T15:05:08.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-25T15:05:08.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_inline_bl_items": 0, 2024-01-25T15:05:08.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_bytes": 0, 2024-01-25T15:05:08.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_fsck_items": 0, 2024-01-25T15:05:08.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_bytes": 0, 2024-01-25T15:05:08.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_txc_items": 0, 2024-01-25T15:05:08.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-25T15:05:08.023 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_deferred_items": 0, 2024-01-25T15:05:08.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_bytes": 0, 2024-01-25T15:05:08.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluestore_writing_items": 0, 2024-01-25T15:05:08.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_bytes": 0, 2024-01-25T15:05:08.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_items": 0, 2024-01-25T15:05:08.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_bytes": 0, 2024-01-25T15:05:08.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_reader_items": 0, 2024-01-25T15:05:08.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_bytes": 0, 2024-01-25T15:05:08.024 INFO:teuthology.orchestra.run.smithi186.stdout: "bluefs_file_writer_items": 0, 2024-01-25T15:05:08.024 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_bytes": 309307, 2024-01-25T15:05:08.024 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_anon_items": 129, 2024-01-25T15:05:08.024 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_bytes": 792, 2024-01-25T15:05:08.024 INFO:teuthology.orchestra.run.smithi186.stdout: "buffer_meta_items": 9, 2024-01-25T15:05:08.024 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_bytes": 0, 2024-01-25T15:05:08.024 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_items": 0, 2024-01-25T15:05:08.025 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_bytes": 0, 2024-01-25T15:05:08.025 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_mapbl_items": 0, 2024-01-25T15:05:08.025 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_bytes": 0, 2024-01-25T15:05:08.025 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_pglog_items": 0, 2024-01-25T15:05:08.025 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_bytes": 7432, 2024-01-25T15:05:08.025 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_items": 156, 2024-01-25T15:05:08.025 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_bytes": 0, 2024-01-25T15:05:08.025 INFO:teuthology.orchestra.run.smithi186.stdout: "osdmap_mapping_items": 0, 2024-01-25T15:05:08.025 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_bytes": 0, 2024-01-25T15:05:08.025 INFO:teuthology.orchestra.run.smithi186.stdout: "pgmap_items": 0, 2024-01-25T15:05:08.025 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_bytes": 164993, 2024-01-25T15:05:08.025 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_co_items": 1247, 2024-01-25T15:05:08.025 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_bytes": 0, 2024-01-25T15:05:08.025 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_1_items": 0, 2024-01-25T15:05:08.026 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_bytes": 0, 2024-01-25T15:05:08.026 INFO:teuthology.orchestra.run.smithi186.stdout: "unittest_2_items": 0 2024-01-25T15:05:08.026 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.026 INFO:teuthology.orchestra.run.smithi186.stdout: "objecter": { 2024-01-25T15:05:08.026 INFO:teuthology.orchestra.run.smithi186.stdout: "op_active": 0, 2024-01-25T15:05:08.026 INFO:teuthology.orchestra.run.smithi186.stdout: "op_laggy": 0, 2024-01-25T15:05:08.026 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send": 1492, 2024-01-25T15:05:08.026 INFO:teuthology.orchestra.run.smithi186.stdout: "op_send_bytes": 3662448, 2024-01-25T15:05:08.026 INFO:teuthology.orchestra.run.smithi186.stdout: "op_resend": 33, 2024-01-25T15:05:08.026 INFO:teuthology.orchestra.run.smithi186.stdout: "op_reply": 1492, 2024-01-25T15:05:08.026 INFO:teuthology.orchestra.run.smithi186.stdout: "op_latency": { 2024-01-25T15:05:08.026 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1492, 2024-01-25T15:05:08.026 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 3.695934023, 2024-01-25T15:05:08.026 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.002477167 2024-01-25T15:05:08.027 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.027 INFO:teuthology.orchestra.run.smithi186.stdout: "op_inflight": 0, 2024-01-25T15:05:08.027 INFO:teuthology.orchestra.run.smithi186.stdout: "oplen_avg": { 2024-01-25T15:05:08.027 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 1492, 2024-01-25T15:05:08.027 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 1545 2024-01-25T15:05:08.027 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.027 INFO:teuthology.orchestra.run.smithi186.stdout: "op": 1492, 2024-01-25T15:05:08.027 INFO:teuthology.orchestra.run.smithi186.stdout: "op_r": 410, 2024-01-25T15:05:08.027 INFO:teuthology.orchestra.run.smithi186.stdout: "op_w": 1082, 2024-01-25T15:05:08.027 INFO:teuthology.orchestra.run.smithi186.stdout: "op_rmw": 0, 2024-01-25T15:05:08.027 INFO:teuthology.orchestra.run.smithi186.stdout: "op_pg": 0, 2024-01-25T15:05:08.027 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_stat": 0, 2024-01-25T15:05:08.027 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_create": 10, 2024-01-25T15:05:08.028 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_read": 77, 2024-01-25T15:05:08.028 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_write": 530, 2024-01-25T15:05:08.028 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writefull": 57, 2024-01-25T15:05:08.028 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_writesame": 0, 2024-01-25T15:05:08.028 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_append": 0, 2024-01-25T15:05:08.028 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_zero": 0, 2024-01-25T15:05:08.028 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_truncate": 0, 2024-01-25T15:05:08.028 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_delete": 448, 2024-01-25T15:05:08.028 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_mapext": 0, 2024-01-25T15:05:08.028 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_sparse_read": 0, 2024-01-25T15:05:08.028 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_clonerange": 0, 2024-01-25T15:05:08.028 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_getxattr": 333, 2024-01-25T15:05:08.028 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_setxattr": 20, 2024-01-25T15:05:08.028 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_cmpxattr": 0, 2024-01-25T15:05:08.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_rmxattr": 0, 2024-01-25T15:05:08.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_resetxattrs": 0, 2024-01-25T15:05:08.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_call": 0, 2024-01-25T15:05:08.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_watch": 0, 2024-01-25T15:05:08.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_notify": 0, 2024-01-25T15:05:08.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_src_cmpxattr": 0, 2024-01-25T15:05:08.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls": 0, 2024-01-25T15:05:08.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_pgls_filter": 0, 2024-01-25T15:05:08.029 INFO:teuthology.orchestra.run.smithi186.stdout: "osdop_other": 4, 2024-01-25T15:05:08.029 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_active": 0, 2024-01-25T15:05:08.029 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_send": 0, 2024-01-25T15:05:08.029 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_resend": 0, 2024-01-25T15:05:08.029 INFO:teuthology.orchestra.run.smithi186.stdout: "linger_ping": 0, 2024-01-25T15:05:08.030 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_active": 0, 2024-01-25T15:05:08.030 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_send": 0, 2024-01-25T15:05:08.030 INFO:teuthology.orchestra.run.smithi186.stdout: "poolop_resend": 0, 2024-01-25T15:05:08.030 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_active": 0, 2024-01-25T15:05:08.030 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_send": 0, 2024-01-25T15:05:08.030 INFO:teuthology.orchestra.run.smithi186.stdout: "poolstat_resend": 0, 2024-01-25T15:05:08.030 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_active": 0, 2024-01-25T15:05:08.030 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_send": 0, 2024-01-25T15:05:08.030 INFO:teuthology.orchestra.run.smithi186.stdout: "statfs_resend": 0, 2024-01-25T15:05:08.030 INFO:teuthology.orchestra.run.smithi186.stdout: "command_active": 0, 2024-01-25T15:05:08.030 INFO:teuthology.orchestra.run.smithi186.stdout: "command_send": 0, 2024-01-25T15:05:08.030 INFO:teuthology.orchestra.run.smithi186.stdout: "command_resend": 0, 2024-01-25T15:05:08.030 INFO:teuthology.orchestra.run.smithi186.stdout: "map_epoch": 87, 2024-01-25T15:05:08.030 INFO:teuthology.orchestra.run.smithi186.stdout: "map_full": 0, 2024-01-25T15:05:08.031 INFO:teuthology.orchestra.run.smithi186.stdout: "map_inc": 2, 2024-01-25T15:05:08.031 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_sessions": 12, 2024-01-25T15:05:08.031 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_open": 12, 2024-01-25T15:05:08.031 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_session_close": 0, 2024-01-25T15:05:08.031 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_laggy": 0, 2024-01-25T15:05:08.031 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_wr": 51, 2024-01-25T15:05:08.031 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_rd": 0, 2024-01-25T15:05:08.031 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_del": 15 2024-01-25T15:05:08.031 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.031 INFO:teuthology.orchestra.run.smithi186.stdout: "oft": { 2024-01-25T15:05:08.031 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_objs": 1, 2024-01-25T15:05:08.031 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_kv_pairs": 0, 2024-01-25T15:05:08.031 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_updates": 0, 2024-01-25T15:05:08.031 INFO:teuthology.orchestra.run.smithi186.stdout: "omap_total_removes": 0 2024-01-25T15:05:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: "osd-slow-ops": { 2024-01-25T15:05:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: "slow_ops_count": 0 2024-01-25T15:05:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: "purge_queue": { 2024-01-25T15:05:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops": 0, 2024-01-25T15:05:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_ops_high_water": 8, 2024-01-25T15:05:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing": 0, 2024-01-25T15:05:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executing_high_water": 6, 2024-01-25T15:05:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed_ops": 436, 2024-01-25T15:05:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_executed": 411, 2024-01-25T15:05:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: "pq_item_in_journal": 0 2024-01-25T15:05:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-25T15:05:08.033 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:08.033 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-01-25T15:05:08.033 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:08.033 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 12459, 2024-01-25T15:05:08.033 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 4220093, 2024-01-25T15:05:08.033 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:08.033 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 12459, 2024-01-25T15:05:08.033 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-01-25T15:05:08.033 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-01-25T15:05:08.033 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 12459, 2024-01-25T15:05:08.033 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 4220093, 2024-01-25T15:05:08.033 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:08.033 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.033 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.034 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.034 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:08.034 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.034 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_bytes": { 2024-01-25T15:05:08.034 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:08.034 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 104857600, 2024-01-25T15:05:08.034 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:08.034 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-01-25T15:05:08.034 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-01-25T15:05:08.034 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:08.034 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:08.034 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 1492, 2024-01-25T15:05:08.034 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 3703959, 2024-01-25T15:05:08.034 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 1492, 2024-01-25T15:05:08.035 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 3703959, 2024-01-25T15:05:08.035 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:08.035 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.035 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.035 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.035 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:08.035 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.035 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-objecter_ops": { 2024-01-25T15:05:08.035 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:08.035 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 1024, 2024-01-25T15:05:08.035 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:08.036 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 0, 2024-01-25T15:05:08.036 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 0, 2024-01-25T15:05:08.036 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:08.036 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:08.036 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 1492, 2024-01-25T15:05:08.036 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 1492, 2024-01-25T15:05:08.036 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 1492, 2024-01-25T15:05:08.036 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 1492, 2024-01-25T15:05:08.036 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:08.036 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.036 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.036 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.036 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:08.037 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.037 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle": { 2024-01-25T15:05:08.037 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:08.037 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-01-25T15:05:08.037 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:08.037 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 411, 2024-01-25T15:05:08.037 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 41511, 2024-01-25T15:05:08.037 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:08.037 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 411, 2024-01-25T15:05:08.037 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-01-25T15:05:08.037 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-01-25T15:05:08.037 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 77, 2024-01-25T15:05:08.037 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 41511, 2024-01-25T15:05:08.037 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:08.037 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.038 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.038 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.038 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:08.038 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-01-25T15:05:08.038 INFO:teuthology.orchestra.run.smithi186.stdout: "throttle-write_buf_throttle-0x561be9f3c6e0": { 2024-01-25T15:05:08.038 INFO:teuthology.orchestra.run.smithi186.stdout: "val": 0, 2024-01-25T15:05:08.038 INFO:teuthology.orchestra.run.smithi186.stdout: "max": 3758096384, 2024-01-25T15:05:08.038 INFO:teuthology.orchestra.run.smithi186.stdout: "get_started": 0, 2024-01-25T15:05:08.038 INFO:teuthology.orchestra.run.smithi186.stdout: "get": 1813, 2024-01-25T15:05:08.038 INFO:teuthology.orchestra.run.smithi186.stdout: "get_sum": 3556054, 2024-01-25T15:05:08.038 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:08.038 INFO:teuthology.orchestra.run.smithi186.stdout: "get_or_fail_success": 1813, 2024-01-25T15:05:08.038 INFO:teuthology.orchestra.run.smithi186.stdout: "take": 0, 2024-01-25T15:05:08.038 INFO:teuthology.orchestra.run.smithi186.stdout: "take_sum": 0, 2024-01-25T15:05:08.038 INFO:teuthology.orchestra.run.smithi186.stdout: "put": 453, 2024-01-25T15:05:08.039 INFO:teuthology.orchestra.run.smithi186.stdout: "put_sum": 3556054, 2024-01-25T15:05:08.039 INFO:teuthology.orchestra.run.smithi186.stdout: "wait": { 2024-01-25T15:05:08.039 INFO:teuthology.orchestra.run.smithi186.stdout: "avgcount": 0, 2024-01-25T15:05:08.039 INFO:teuthology.orchestra.run.smithi186.stdout: "sum": 0.000000000, 2024-01-25T15:05:08.039 INFO:teuthology.orchestra.run.smithi186.stdout: "avgtime": 0.000000000 2024-01-25T15:05:08.039 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:08.039 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-01-25T15:05:08.039 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-01-25T15:05:08.727 INFO:tasks.check_counter:Daemon mds.k mds.exported=39 2024-01-25T15:05:08.740 INFO:tasks.check_counter:Daemon mds.k mds.imported=45 2024-01-25T15:05:08.741 DEBUG:tasks.check_counter:Getting stats from c 2024-01-25T15:05:08.741 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph daemon mds.c perf dump 2024-01-25T15:05:08.988 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T15:05:09.374 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:09 smithi170 ceph-mon[31899]: pgmap v443: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-01-25T15:05:09.472 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:09 smithi191 ceph-mon[36347]: pgmap v443: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-01-25T15:05:09.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:09 smithi186 ceph-mon[35697]: pgmap v443: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 12 op/s 2024-01-25T15:05:10.796 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-01-25T15:05:10.796 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2024-01-25T15:05:10.796 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 8656, 2024-01-25T15:05:10.796 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 6030, 2024-01-25T15:05:10.796 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 3743716, 2024-01-25T15:05:10.796 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 5713471, 2024-01-25T15:05:10.796 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 10, 2024-01-25T15:05:10.796 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 4, 2024-01-25T15:05:10.797 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.466459169, 2024-01-25T15:05:10.797 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.198885985, 2024-01-25T15:05:10.797 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.315121301, 2024-01-25T15:05:10.797 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.024149917, 2024-01-25T15:05:10.797 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:10.797 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 6031, 2024-01-25T15:05:10.797 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.156140211, 2024-01-25T15:05:10.797 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000025889 2024-01-25T15:05:10.797 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.797 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:10.797 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 12793, 2024-01-25T15:05:10.797 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.001939134, 2024-01-25T15:05:10.798 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000151 2024-01-25T15:05:10.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.798 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-01-25T15:05:10.798 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 448 2024-01-25T15:05:10.798 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.798 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2024-01-25T15:05:10.798 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 1592, 2024-01-25T15:05:10.798 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 1757, 2024-01-25T15:05:10.798 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 581378, 2024-01-25T15:05:10.798 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 3304916, 2024-01-25T15:05:10.798 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 13, 2024-01-25T15:05:10.798 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 7, 2024-01-25T15:05:10.798 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.128465385, 2024-01-25T15:05:10.798 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.054256452, 2024-01-25T15:05:10.799 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.036182655, 2024-01-25T15:05:10.799 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.031960625, 2024-01-25T15:05:10.799 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:10.799 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1755, 2024-01-25T15:05:10.799 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.090782840, 2024-01-25T15:05:10.799 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000051728 2024-01-25T15:05:10.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.799 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:10.799 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 549, 2024-01-25T15:05:10.799 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000094456, 2024-01-25T15:05:10.799 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000172 2024-01-25T15:05:10.799 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.799 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 160, 2024-01-25T15:05:10.800 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 199488 2024-01-25T15:05:10.800 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.800 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2024-01-25T15:05:10.800 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 6227, 2024-01-25T15:05:10.800 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 10147, 2024-01-25T15:05:10.800 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 3155830, 2024-01-25T15:05:10.800 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 7369327, 2024-01-25T15:05:10.800 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 16, 2024-01-25T15:05:10.800 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 7, 2024-01-25T15:05:10.800 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.415762872, 2024-01-25T15:05:10.800 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.186833252, 2024-01-25T15:05:10.800 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.600828969, 2024-01-25T15:05:10.800 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.022471106, 2024-01-25T15:05:10.801 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:10.801 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 10144, 2024-01-25T15:05:10.801 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.239368247, 2024-01-25T15:05:10.801 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000023597 2024-01-25T15:05:10.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.801 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:10.801 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 12807, 2024-01-25T15:05:10.801 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.001835863, 2024-01-25T15:05:10.801 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000143 2024-01-25T15:05:10.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.801 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 2512352, 2024-01-25T15:05:10.801 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 5206544 2024-01-25T15:05:10.801 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.802 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2024-01-25T15:05:10.802 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2024-01-25T15:05:10.802 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2024-01-25T15:05:10.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.802 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2024-01-25T15:05:10.802 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-01-25T15:05:10.802 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-01-25T15:05:10.802 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1757, 2024-01-25T15:05:10.802 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.917805959, 2024-01-25T15:05:10.802 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001091523 2024-01-25T15:05:10.802 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:10.802 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.802 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2024-01-25T15:05:10.803 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-01-25T15:05:10.803 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-01-25T15:05:10.803 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2340, 2024-01-25T15:05:10.803 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.187274671, 2024-01-25T15:05:10.803 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000080031 2024-01-25T15:05:10.803 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:10.803 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.803 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2024-01-25T15:05:10.803 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 2786, 2024-01-25T15:05:10.803 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 2774, 2024-01-25T15:05:10.803 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2024-01-25T15:05:10.803 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2774, 2024-01-25T15:05:10.804 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 7.813889899, 2024-01-25T15:05:10.804 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002816831 2024-01-25T15:05:10.804 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.804 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2024-01-25T15:05:10.804 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 12, 2024-01-25T15:05:10.804 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 0, 2024-01-25T15:05:10.804 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 0, 2024-01-25T15:05:10.804 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 11, 2024-01-25T15:05:10.804 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 0, 2024-01-25T15:05:10.804 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 0, 2024-01-25T15:05:10.804 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 41, 2024-01-25T15:05:10.804 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 14, 2024-01-25T15:05:10.804 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 10, 2024-01-25T15:05:10.805 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 17, 2024-01-25T15:05:10.805 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 20, 2024-01-25T15:05:10.805 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 445, 2024-01-25T15:05:10.805 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 1, 2024-01-25T15:05:10.805 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 1, 2024-01-25T15:05:10.805 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 6, 2024-01-25T15:05:10.805 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 4179, 2024-01-25T15:05:10.805 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 3846, 2024-01-25T15:05:10.805 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 5, 2024-01-25T15:05:10.805 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 78, 2024-01-25T15:05:10.805 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 0, 2024-01-25T15:05:10.805 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 2, 2024-01-25T15:05:10.805 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 1, 2024-01-25T15:05:10.805 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 0, 2024-01-25T15:05:10.806 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 0, 2024-01-25T15:05:10.806 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 57, 2024-01-25T15:05:10.806 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 137, 2024-01-25T15:05:10.806 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 61, 2024-01-25T15:05:10.806 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 837, 2024-01-25T15:05:10.806 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2024-01-25T15:05:10.806 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 1097, 2024-01-25T15:05:10.806 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 7, 2024-01-25T15:05:10.806 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 1924, 2024-01-25T15:05:10.806 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 15512990, 2024-01-25T15:05:10.806 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 0, 2024-01-25T15:05:10.806 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 1097, 2024-01-25T15:05:10.807 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2024-01-25T15:05:10.807 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2024-01-25T15:05:10.807 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2024-01-25T15:05:10.807 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 35, 2024-01-25T15:05:10.807 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 0, 2024-01-25T15:05:10.807 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 35, 2024-01-25T15:05:10.807 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 1062, 2024-01-25T15:05:10.807 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 22, 2024-01-25T15:05:10.807 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 276, 2024-01-25T15:05:10.807 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 1777, 2024-01-25T15:05:10.807 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 0, 2024-01-25T15:05:10.807 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-25T15:05:10.807 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-25T15:05:10.807 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 1714, 2024-01-25T15:05:10.807 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 1136, 2024-01-25T15:05:10.808 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 43, 2024-01-25T15:05:10.808 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 2135 2024-01-25T15:05:10.808 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.808 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2024-01-25T15:05:10.808 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 0, 2024-01-25T15:05:10.808 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 0, 2024-01-25T15:05:10.808 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 0, 2024-01-25T15:05:10.808 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 93, 2024-01-25T15:05:10.808 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 30, 2024-01-25T15:05:10.808 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 7, 2024-01-25T15:05:10.808 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2024-01-25T15:05:10.808 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2024-01-25T15:05:10.808 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 1175, 2024-01-25T15:05:10.809 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 1167, 2024-01-25T15:05:10.809 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 2, 2024-01-25T15:05:10.809 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 0, 2024-01-25T15:05:10.809 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2024-01-25T15:05:10.809 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2024-01-25T15:05:10.809 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2024-01-25T15:05:10.809 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2024-01-25T15:05:10.809 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2024-01-25T15:05:10.809 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 0, 2024-01-25T15:05:10.809 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 57, 2024-01-25T15:05:10.809 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2024-01-25T15:05:10.809 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 0, 2024-01-25T15:05:10.809 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2024-01-25T15:05:10.809 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0 2024-01-25T15:05:10.810 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.810 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2024-01-25T15:05:10.810 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 0, 2024-01-25T15:05:10.810 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 5679, 2024-01-25T15:05:10.810 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 0, 2024-01-25T15:05:10.810 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 0, 2024-01-25T15:05:10.810 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 5679, 2024-01-25T15:05:10.810 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2024-01-25T15:05:10.810 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 0, 2024-01-25T15:05:10.810 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 8, 2024-01-25T15:05:10.810 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 0, 2024-01-25T15:05:10.810 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 0, 2024-01-25T15:05:10.810 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 8, 2024-01-25T15:05:10.810 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 2, 2024-01-25T15:05:10.811 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2024-01-25T15:05:10.811 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 0, 2024-01-25T15:05:10.811 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 4194304, 2024-01-25T15:05:10.811 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 14004740, 2024-01-25T15:05:10.811 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 0, 2024-01-25T15:05:10.811 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2024-01-25T15:05:10.811 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 504, 2024-01-25T15:05:10.811 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.847815203, 2024-01-25T15:05:10.811 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.003666300 2024-01-25T15:05:10.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.811 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 0 2024-01-25T15:05:10.811 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.811 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2024-01-25T15:05:10.811 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 40, 2024-01-25T15:05:10.812 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 1471, 2024-01-25T15:05:10.812 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 1431, 2024-01-25T15:05:10.812 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 39, 2024-01-25T15:05:10.812 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 247, 2024-01-25T15:05:10.812 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 208, 2024-01-25T15:05:10.812 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 41, 2024-01-25T15:05:10.812 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 2831, 2024-01-25T15:05:10.812 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 2790, 2024-01-25T15:05:10.812 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 1, 2024-01-25T15:05:10.812 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 1468, 2024-01-25T15:05:10.812 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 1467, 2024-01-25T15:05:10.812 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 76724, 2024-01-25T15:05:10.812 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 199036 2024-01-25T15:05:10.812 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 3380, 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 130, 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 2786, 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 45, 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 431, 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 419, 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 3.728497323, 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.008898561 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 9, 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.019476689, 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002164076 2024-01-25T15:05:10.813 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.814 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2024-01-25T15:05:10.814 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.814 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.814 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.814 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2024-01-25T15:05:10.814 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 5, 2024-01-25T15:05:10.814 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.578535003, 2024-01-25T15:05:10.814 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.115707000 2024-01-25T15:05:10.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.814 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2024-01-25T15:05:10.814 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 975, 2024-01-25T15:05:10.814 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.458826186, 2024-01-25T15:05:10.814 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000470590 2024-01-25T15:05:10.814 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.815 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2024-01-25T15:05:10.815 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.815 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.815 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.815 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2024-01-25T15:05:10.815 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1, 2024-01-25T15:05:10.815 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000119019, 2024-01-25T15:05:10.815 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000119019 2024-01-25T15:05:10.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.815 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2024-01-25T15:05:10.815 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.815 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.815 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.815 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.816 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2024-01-25T15:05:10.816 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.816 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.816 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.816 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2024-01-25T15:05:10.816 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.816 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.816 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.816 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.816 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2024-01-25T15:05:10.816 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.816 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.817 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.817 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.817 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2024-01-25T15:05:10.817 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 30, 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.130953330, 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.004365111 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 8, 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.007315353, 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000914419 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 24, 2024-01-25T15:05:10.818 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.006361467, 2024-01-25T15:05:10.819 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000265061 2024-01-25T15:05:10.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.819 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2024-01-25T15:05:10.819 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 99, 2024-01-25T15:05:10.819 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.107004596, 2024-01-25T15:05:10.819 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001080854 2024-01-25T15:05:10.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.819 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2024-01-25T15:05:10.819 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 8, 2024-01-25T15:05:10.819 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.205080251, 2024-01-25T15:05:10.819 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.025635031 2024-01-25T15:05:10.819 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.819 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2024-01-25T15:05:10.819 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.819 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.820 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.820 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2024-01-25T15:05:10.820 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.820 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.820 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.820 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2024-01-25T15:05:10.820 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 58, 2024-01-25T15:05:10.820 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.992125925, 2024-01-25T15:05:10.820 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.017105619 2024-01-25T15:05:10.820 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.820 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2024-01-25T15:05:10.821 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.821 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.821 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.821 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2024-01-25T15:05:10.821 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.821 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.821 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.821 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.821 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2024-01-25T15:05:10.821 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1, 2024-01-25T15:05:10.821 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.113411641, 2024-01-25T15:05:10.821 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.113411641 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.822 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.823 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2024-01-25T15:05:10.823 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.823 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.823 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.823 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2024-01-25T15:05:10.823 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 9, 2024-01-25T15:05:10.823 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.009281537, 2024-01-25T15:05:10.823 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001031281 2024-01-25T15:05:10.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.823 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2024-01-25T15:05:10.823 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1128, 2024-01-25T15:05:10.823 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.456901579, 2024-01-25T15:05:10.823 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001291579 2024-01-25T15:05:10.823 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.824 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2024-01-25T15:05:10.824 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2024-01-25T15:05:10.824 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2024-01-25T15:05:10.824 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.824 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.824 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.824 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:10.824 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.824 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2024-01-25T15:05:10.824 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 1, 2024-01-25T15:05:10.824 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 1, 2024-01-25T15:05:10.824 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 0, 2024-01-25T15:05:10.824 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 1, 2024-01-25T15:05:10.824 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2024-01-25T15:05:10.825 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 1941, 2024-01-25T15:05:10.825 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 1941, 2024-01-25T15:05:10.825 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 193, 2024-01-25T15:05:10.825 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2024-01-25T15:05:10.825 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.825 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2024-01-25T15:05:10.825 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2024-01-25T15:05:10.825 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2024-01-25T15:05:10.825 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2024-01-25T15:05:10.825 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2024-01-25T15:05:10.825 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2024-01-25T15:05:10.825 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2024-01-25T15:05:10.825 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-25T15:05:10.825 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2024-01-25T15:05:10.825 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2024-01-25T15:05:10.826 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2024-01-25T15:05:10.827 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2024-01-25T15:05:10.827 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-25T15:05:10.827 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2024-01-25T15:05:10.827 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2024-01-25T15:05:10.827 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2024-01-25T15:05:10.827 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2024-01-25T15:05:10.827 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2024-01-25T15:05:10.827 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2024-01-25T15:05:10.827 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2024-01-25T15:05:10.827 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2024-01-25T15:05:10.827 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2024-01-25T15:05:10.827 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 311583, 2024-01-25T15:05:10.828 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 126, 2024-01-25T15:05:10.828 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 0, 2024-01-25T15:05:10.828 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 0, 2024-01-25T15:05:10.828 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2024-01-25T15:05:10.828 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2024-01-25T15:05:10.828 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2024-01-25T15:05:10.828 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2024-01-25T15:05:10.828 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2024-01-25T15:05:10.828 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2024-01-25T15:05:10.828 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 7432, 2024-01-25T15:05:10.828 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 156, 2024-01-25T15:05:10.828 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2024-01-25T15:05:10.828 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2024-01-25T15:05:10.829 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2024-01-25T15:05:10.829 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2024-01-25T15:05:10.829 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 171974, 2024-01-25T15:05:10.829 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 1761, 2024-01-25T15:05:10.829 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2024-01-25T15:05:10.829 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2024-01-25T15:05:10.829 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2024-01-25T15:05:10.829 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2024-01-25T15:05:10.829 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.829 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2024-01-25T15:05:10.829 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2024-01-25T15:05:10.829 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2024-01-25T15:05:10.829 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 3049, 2024-01-25T15:05:10.829 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 10059308, 2024-01-25T15:05:10.830 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 29, 2024-01-25T15:05:10.830 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 3049, 2024-01-25T15:05:10.830 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2024-01-25T15:05:10.830 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 3049, 2024-01-25T15:05:10.830 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 5.091911434, 2024-01-25T15:05:10.830 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001670026 2024-01-25T15:05:10.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.830 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2024-01-25T15:05:10.830 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2024-01-25T15:05:10.830 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 3049, 2024-01-25T15:05:10.830 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 3098 2024-01-25T15:05:10.830 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 3049, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 1172, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 1877, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 0, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 10, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 75, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 579, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 55, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 0, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 0, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 1202, 2024-01-25T15:05:10.831 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2024-01-25T15:05:10.832 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2024-01-25T15:05:10.832 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2024-01-25T15:05:10.832 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 1097, 2024-01-25T15:05:10.832 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 20, 2024-01-25T15:05:10.832 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2024-01-25T15:05:10.832 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2024-01-25T15:05:10.832 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2024-01-25T15:05:10.832 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2024-01-25T15:05:10.832 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2024-01-25T15:05:10.832 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2024-01-25T15:05:10.832 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2024-01-25T15:05:10.832 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2024-01-25T15:05:10.832 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2024-01-25T15:05:10.833 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 0, 2024-01-25T15:05:10.833 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2024-01-25T15:05:10.833 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2024-01-25T15:05:10.833 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2024-01-25T15:05:10.833 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2024-01-25T15:05:10.833 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2024-01-25T15:05:10.833 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2024-01-25T15:05:10.833 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2024-01-25T15:05:10.833 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2024-01-25T15:05:10.833 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2024-01-25T15:05:10.833 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2024-01-25T15:05:10.833 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2024-01-25T15:05:10.833 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2024-01-25T15:05:10.833 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2024-01-25T15:05:10.834 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2024-01-25T15:05:10.834 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2024-01-25T15:05:10.834 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2024-01-25T15:05:10.834 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 87, 2024-01-25T15:05:10.834 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2024-01-25T15:05:10.834 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 2, 2024-01-25T15:05:10.834 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 12, 2024-01-25T15:05:10.834 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 12, 2024-01-25T15:05:10.834 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2024-01-25T15:05:10.834 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2024-01-25T15:05:10.834 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 45, 2024-01-25T15:05:10.834 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 0, 2024-01-25T15:05:10.834 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 15 2024-01-25T15:05:10.834 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.834 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2024-01-25T15:05:10.835 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 1, 2024-01-25T15:05:10.835 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 0, 2024-01-25T15:05:10.835 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 0, 2024-01-25T15:05:10.835 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2024-01-25T15:05:10.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.835 INFO:teuthology.orchestra.run.smithi191.stdout: "osd-slow-ops": { 2024-01-25T15:05:10.835 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 0 2024-01-25T15:05:10.835 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.835 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2024-01-25T15:05:10.835 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2024-01-25T15:05:10.835 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 8, 2024-01-25T15:05:10.835 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2024-01-25T15:05:10.835 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 6, 2024-01-25T15:05:10.835 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed_ops": 1188, 2024-01-25T15:05:10.835 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 1167, 2024-01-25T15:05:10.836 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2024-01-25T15:05:10.836 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.836 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-25T15:05:10.836 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:10.836 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-01-25T15:05:10.836 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:10.836 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 16471, 2024-01-25T15:05:10.836 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 5775487, 2024-01-25T15:05:10.836 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:10.836 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 16471, 2024-01-25T15:05:10.836 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-01-25T15:05:10.836 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-01-25T15:05:10.836 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 16471, 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 5775487, 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:10.837 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 3049, 2024-01-25T15:05:10.838 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 10177175, 2024-01-25T15:05:10.838 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 3049, 2024-01-25T15:05:10.838 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 10177175, 2024-01-25T15:05:10.838 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:10.838 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.838 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.838 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.838 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:10.838 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.838 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2024-01-25T15:05:10.838 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:10.838 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2024-01-25T15:05:10.838 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:10.838 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-01-25T15:05:10.839 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-01-25T15:05:10.839 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:10.839 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:10.839 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 3049, 2024-01-25T15:05:10.839 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 3049, 2024-01-25T15:05:10.839 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 3049, 2024-01-25T15:05:10.839 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 3049, 2024-01-25T15:05:10.839 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:10.839 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.839 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.839 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.839 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:10.839 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.840 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2024-01-25T15:05:10.840 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:10.840 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-01-25T15:05:10.840 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:10.840 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 1167, 2024-01-25T15:05:10.840 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 117867, 2024-01-25T15:05:10.840 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:10.840 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 1167, 2024-01-25T15:05:10.840 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-01-25T15:05:10.840 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-01-25T15:05:10.840 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 75, 2024-01-25T15:05:10.840 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 117867, 2024-01-25T15:05:10.840 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:10.840 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.841 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.841 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.841 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:10.841 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:10.841 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x5655442ac6e0": { 2024-01-25T15:05:10.841 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:10.841 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-01-25T15:05:10.841 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:10.841 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 5679, 2024-01-25T15:05:10.841 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 9810436, 2024-01-25T15:05:10.841 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:10.841 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 5679, 2024-01-25T15:05:10.841 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-01-25T15:05:10.841 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-01-25T15:05:10.841 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 504, 2024-01-25T15:05:10.842 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 9810436, 2024-01-25T15:05:10.842 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:10.842 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:10.842 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:10.842 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:10.842 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:10.842 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:10.842 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-01-25T15:05:11.586 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:11 smithi191 ceph-mon[36347]: pgmap v444: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-01-25T15:05:11.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:11 smithi186 ceph-mon[35697]: pgmap v444: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-01-25T15:05:11.611 INFO:tasks.check_counter:Daemon mds.c mds.exported=57 2024-01-25T15:05:11.611 INFO:tasks.check_counter:Daemon mds.c mds.imported=61 2024-01-25T15:05:11.611 DEBUG:tasks.check_counter:Getting stats from f 2024-01-25T15:05:11.612 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph daemon mds.f perf dump 2024-01-25T15:05:11.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:11 smithi170 ceph-mon[31899]: pgmap v444: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 11 op/s 2024-01-25T15:05:11.854 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T15:05:13.470 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-01-25T15:05:13.471 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2024-01-25T15:05:13.471 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 761, 2024-01-25T15:05:13.471 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 762, 2024-01-25T15:05:13.471 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 59664317, 2024-01-25T15:05:13.471 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 236370, 2024-01-25T15:05:13.471 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 8, 2024-01-25T15:05:13.471 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 4, 2024-01-25T15:05:13.471 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.094393354, 2024-01-25T15:05:13.471 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.020074791, 2024-01-25T15:05:13.471 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.046330736, 2024-01-25T15:05:13.472 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.021572355, 2024-01-25T15:05:13.472 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:13.472 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 760, 2024-01-25T15:05:13.472 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.027846468, 2024-01-25T15:05:13.472 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000036640 2024-01-25T15:05:13.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.472 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:13.472 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.472 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.472 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.472 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.472 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 0, 2024-01-25T15:05:13.473 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 0 2024-01-25T15:05:13.473 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.473 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2024-01-25T15:05:13.473 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 235, 2024-01-25T15:05:13.473 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 206, 2024-01-25T15:05:13.473 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 38637872, 2024-01-25T15:05:13.473 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 89189, 2024-01-25T15:05:13.473 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 5, 2024-01-25T15:05:13.473 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 4, 2024-01-25T15:05:13.473 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.043315690, 2024-01-25T15:05:13.473 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.007921125, 2024-01-25T15:05:13.473 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.035847761, 2024-01-25T15:05:13.474 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.004375302, 2024-01-25T15:05:13.474 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:13.474 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 206, 2024-01-25T15:05:13.474 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.011731195, 2024-01-25T15:05:13.474 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000056947 2024-01-25T15:05:13.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.474 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:13.474 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.474 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.474 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.474 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.474 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 861344, 2024-01-25T15:05:13.474 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 57712 2024-01-25T15:05:13.475 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.475 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2024-01-25T15:05:13.475 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 292, 2024-01-25T15:05:13.475 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 363, 2024-01-25T15:05:13.475 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 29434902, 2024-01-25T15:05:13.475 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 290070, 2024-01-25T15:05:13.475 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 6, 2024-01-25T15:05:13.475 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 5, 2024-01-25T15:05:13.475 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.043566265, 2024-01-25T15:05:13.475 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.011724201, 2024-01-25T15:05:13.475 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.019978954, 2024-01-25T15:05:13.475 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.008583374, 2024-01-25T15:05:13.475 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:13.475 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 361, 2024-01-25T15:05:13.476 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.126197578, 2024-01-25T15:05:13.476 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000349577 2024-01-25T15:05:13.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.476 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:13.476 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.476 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.476 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.476 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 160, 2024-01-25T15:05:13.476 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 199568 2024-01-25T15:05:13.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.476 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2024-01-25T15:05:13.476 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2024-01-25T15:05:13.476 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2024-01-25T15:05:13.476 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.477 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2024-01-25T15:05:13.477 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-01-25T15:05:13.477 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-01-25T15:05:13.477 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1835, 2024-01-25T15:05:13.477 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.231140985, 2024-01-25T15:05:13.477 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000125962 2024-01-25T15:05:13.477 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:13.477 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.477 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2024-01-25T15:05:13.477 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-01-25T15:05:13.477 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-01-25T15:05:13.477 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.477 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.477 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.477 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:13.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.478 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2024-01-25T15:05:13.478 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 0, 2024-01-25T15:05:13.478 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 0, 2024-01-25T15:05:13.478 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2024-01-25T15:05:13.478 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.478 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.478 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.478 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.478 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2024-01-25T15:05:13.478 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 0, 2024-01-25T15:05:13.478 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 0, 2024-01-25T15:05:13.478 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 0, 2024-01-25T15:05:13.478 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 0, 2024-01-25T15:05:13.479 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 0, 2024-01-25T15:05:13.479 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 0, 2024-01-25T15:05:13.479 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 11856, 2024-01-25T15:05:13.479 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 7751, 2024-01-25T15:05:13.479 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 4105, 2024-01-25T15:05:13.479 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 0, 2024-01-25T15:05:13.479 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 782, 2024-01-25T15:05:13.479 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 0, 2024-01-25T15:05:13.479 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 0, 2024-01-25T15:05:13.479 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 0, 2024-01-25T15:05:13.479 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 2, 2024-01-25T15:05:13.479 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 0, 2024-01-25T15:05:13.479 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 0, 2024-01-25T15:05:13.479 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 0, 2024-01-25T15:05:13.479 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 0, 2024-01-25T15:05:13.480 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 0, 2024-01-25T15:05:13.480 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 0, 2024-01-25T15:05:13.480 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 0, 2024-01-25T15:05:13.480 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 0, 2024-01-25T15:05:13.480 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 0, 2024-01-25T15:05:13.480 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 0, 2024-01-25T15:05:13.480 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 0, 2024-01-25T15:05:13.480 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 0, 2024-01-25T15:05:13.480 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 0, 2024-01-25T15:05:13.480 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2024-01-25T15:05:13.480 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 0, 2024-01-25T15:05:13.480 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 0, 2024-01-25T15:05:13.480 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 4, 2024-01-25T15:05:13.480 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 234, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 0, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 0, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 0, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 0, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 0, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 0, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 0, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 0, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 0, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 0, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-25T15:05:13.481 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 0, 2024-01-25T15:05:13.482 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 0, 2024-01-25T15:05:13.482 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 0, 2024-01-25T15:05:13.482 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 0 2024-01-25T15:05:13.482 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.482 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2024-01-25T15:05:13.482 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 0, 2024-01-25T15:05:13.482 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 0, 2024-01-25T15:05:13.482 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 0, 2024-01-25T15:05:13.482 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 0, 2024-01-25T15:05:13.482 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 0, 2024-01-25T15:05:13.482 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 0, 2024-01-25T15:05:13.482 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2024-01-25T15:05:13.482 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2024-01-25T15:05:13.482 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 0, 2024-01-25T15:05:13.482 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 0, 2024-01-25T15:05:13.483 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 0, 2024-01-25T15:05:13.483 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 0, 2024-01-25T15:05:13.483 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2024-01-25T15:05:13.483 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2024-01-25T15:05:13.483 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2024-01-25T15:05:13.483 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2024-01-25T15:05:13.483 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2024-01-25T15:05:13.483 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 0, 2024-01-25T15:05:13.483 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 0, 2024-01-25T15:05:13.483 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2024-01-25T15:05:13.483 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 0, 2024-01-25T15:05:13.483 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2024-01-25T15:05:13.483 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0 2024-01-25T15:05:13.483 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.484 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2024-01-25T15:05:13.484 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 0, 2024-01-25T15:05:13.484 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 0, 2024-01-25T15:05:13.484 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 0, 2024-01-25T15:05:13.484 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 0, 2024-01-25T15:05:13.484 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 59900, 2024-01-25T15:05:13.484 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2024-01-25T15:05:13.484 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 0, 2024-01-25T15:05:13.484 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 0, 2024-01-25T15:05:13.484 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 0, 2024-01-25T15:05:13.484 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 0, 2024-01-25T15:05:13.484 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 3, 2024-01-25T15:05:13.484 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 15, 2024-01-25T15:05:13.484 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2024-01-25T15:05:13.485 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 0, 2024-01-25T15:05:13.485 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 127512161, 2024-01-25T15:05:13.485 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 130745928, 2024-01-25T15:05:13.485 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 130741627, 2024-01-25T15:05:13.485 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2024-01-25T15:05:13.485 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.485 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.485 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.485 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 59900 2024-01-25T15:05:13.485 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.485 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2024-01-25T15:05:13.485 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 30, 2024-01-25T15:05:13.485 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 13955, 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 13925, 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 25, 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 1883, 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 1858, 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 11856, 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 26323, 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 14467, 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 0, 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 0, 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 0, 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 86876, 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 207228 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 0, 2024-01-25T15:05:13.486 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 0, 2024-01-25T15:05:13.487 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 0, 2024-01-25T15:05:13.487 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 0, 2024-01-25T15:05:13.487 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 0, 2024-01-25T15:05:13.487 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2024-01-25T15:05:13.487 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.487 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.487 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.487 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2024-01-25T15:05:13.487 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.487 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.487 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.487 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.487 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2024-01-25T15:05:13.488 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.488 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.488 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.488 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2024-01-25T15:05:13.488 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.488 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.488 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.488 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.488 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2024-01-25T15:05:13.488 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.488 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.488 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.489 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2024-01-25T15:05:13.489 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.489 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.489 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.489 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2024-01-25T15:05:13.489 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.489 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.489 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.489 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.489 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2024-01-25T15:05:13.489 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.489 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.489 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.490 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2024-01-25T15:05:13.490 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.490 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.490 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.490 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2024-01-25T15:05:13.490 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.490 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.490 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.490 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.490 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2024-01-25T15:05:13.490 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.490 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.491 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.491 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2024-01-25T15:05:13.491 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.491 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.491 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.491 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.492 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2024-01-25T15:05:13.492 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.492 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.492 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.492 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2024-01-25T15:05:13.492 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.492 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.492 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.492 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.492 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2024-01-25T15:05:13.492 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.492 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.493 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.493 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2024-01-25T15:05:13.493 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.493 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.493 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.493 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2024-01-25T15:05:13.493 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.493 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.493 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.493 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.493 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2024-01-25T15:05:13.493 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.494 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.494 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.494 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2024-01-25T15:05:13.494 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.494 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.494 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.494 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2024-01-25T15:05:13.494 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.494 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.494 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.494 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.494 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2024-01-25T15:05:13.495 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.495 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.495 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.495 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2024-01-25T15:05:13.495 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.495 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.495 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.495 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.495 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2024-01-25T15:05:13.495 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.495 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.495 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.496 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2024-01-25T15:05:13.496 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.496 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.496 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.496 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2024-01-25T15:05:13.496 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.496 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.496 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.496 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.496 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2024-01-25T15:05:13.496 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.496 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.497 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.497 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2024-01-25T15:05:13.497 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.497 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.497 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.497 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2024-01-25T15:05:13.497 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.497 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.497 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.497 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.497 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2024-01-25T15:05:13.497 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.498 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.498 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.498 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2024-01-25T15:05:13.498 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2024-01-25T15:05:13.498 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2024-01-25T15:05:13.498 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.498 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.498 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.498 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:13.498 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.498 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2024-01-25T15:05:13.498 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 1, 2024-01-25T15:05:13.498 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 3, 2024-01-25T15:05:13.498 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 2, 2024-01-25T15:05:13.499 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 2, 2024-01-25T15:05:13.499 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2024-01-25T15:05:13.499 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 0, 2024-01-25T15:05:13.499 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 0, 2024-01-25T15:05:13.499 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 2761, 2024-01-25T15:05:13.499 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2024-01-25T15:05:13.499 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.499 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2024-01-25T15:05:13.499 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2024-01-25T15:05:13.499 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2024-01-25T15:05:13.499 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2024-01-25T15:05:13.499 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2024-01-25T15:05:13.499 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2024-01-25T15:05:13.499 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2024-01-25T15:05:13.500 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-25T15:05:13.500 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2024-01-25T15:05:13.500 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-25T15:05:13.500 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2024-01-25T15:05:13.500 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2024-01-25T15:05:13.500 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2024-01-25T15:05:13.500 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-25T15:05:13.500 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2024-01-25T15:05:13.500 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2024-01-25T15:05:13.500 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2024-01-25T15:05:13.500 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2024-01-25T15:05:13.500 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2024-01-25T15:05:13.500 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-25T15:05:13.500 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2024-01-25T15:05:13.501 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-25T15:05:13.501 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2024-01-25T15:05:13.501 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2024-01-25T15:05:13.501 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2024-01-25T15:05:13.501 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2024-01-25T15:05:13.501 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2024-01-25T15:05:13.501 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-25T15:05:13.501 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2024-01-25T15:05:13.501 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2024-01-25T15:05:13.501 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2024-01-25T15:05:13.501 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2024-01-25T15:05:13.501 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2024-01-25T15:05:13.501 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2024-01-25T15:05:13.501 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2024-01-25T15:05:13.501 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 229854, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 75, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 0, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 0, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 7432, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 156, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2024-01-25T15:05:13.502 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2024-01-25T15:05:13.503 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2024-01-25T15:05:13.503 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 8448357, 2024-01-25T15:05:13.503 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 51191, 2024-01-25T15:05:13.503 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2024-01-25T15:05:13.503 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2024-01-25T15:05:13.503 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2024-01-25T15:05:13.503 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2024-01-25T15:05:13.503 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.503 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2024-01-25T15:05:13.503 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2024-01-25T15:05:13.503 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2024-01-25T15:05:13.503 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 1152, 2024-01-25T15:05:13.503 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 26, 2024-01-25T15:05:13.503 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 4, 2024-01-25T15:05:13.504 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 1152, 2024-01-25T15:05:13.504 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2024-01-25T15:05:13.504 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1152, 2024-01-25T15:05:13.504 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.957966013, 2024-01-25T15:05:13.504 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001699623 2024-01-25T15:05:13.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.504 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2024-01-25T15:05:13.504 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2024-01-25T15:05:13.504 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1152, 2024-01-25T15:05:13.504 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1153 2024-01-25T15:05:13.504 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.504 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 1152, 2024-01-25T15:05:13.504 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 1152, 2024-01-25T15:05:13.504 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 0, 2024-01-25T15:05:13.505 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2024-01-25T15:05:13.505 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2024-01-25T15:05:13.505 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 699, 2024-01-25T15:05:13.505 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 0, 2024-01-25T15:05:13.505 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 450, 2024-01-25T15:05:13.505 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 0, 2024-01-25T15:05:13.505 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 0, 2024-01-25T15:05:13.505 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2024-01-25T15:05:13.505 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2024-01-25T15:05:13.505 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 0, 2024-01-25T15:05:13.505 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 0, 2024-01-25T15:05:13.505 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 0, 2024-01-25T15:05:13.505 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2024-01-25T15:05:13.505 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2024-01-25T15:05:13.506 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2024-01-25T15:05:13.506 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 2, 2024-01-25T15:05:13.506 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 0, 2024-01-25T15:05:13.506 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2024-01-25T15:05:13.506 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2024-01-25T15:05:13.506 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2024-01-25T15:05:13.506 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2024-01-25T15:05:13.506 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2024-01-25T15:05:13.506 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2024-01-25T15:05:13.506 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2024-01-25T15:05:13.506 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2024-01-25T15:05:13.506 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2024-01-25T15:05:13.506 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 0, 2024-01-25T15:05:13.506 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2024-01-25T15:05:13.507 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2024-01-25T15:05:13.507 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2024-01-25T15:05:13.507 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2024-01-25T15:05:13.507 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2024-01-25T15:05:13.507 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2024-01-25T15:05:13.507 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2024-01-25T15:05:13.507 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2024-01-25T15:05:13.507 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2024-01-25T15:05:13.507 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2024-01-25T15:05:13.507 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2024-01-25T15:05:13.507 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2024-01-25T15:05:13.507 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2024-01-25T15:05:13.507 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2024-01-25T15:05:13.507 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2024-01-25T15:05:13.507 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2024-01-25T15:05:13.508 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 87, 2024-01-25T15:05:13.508 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2024-01-25T15:05:13.508 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 2, 2024-01-25T15:05:13.508 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 10, 2024-01-25T15:05:13.508 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 10, 2024-01-25T15:05:13.508 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2024-01-25T15:05:13.508 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2024-01-25T15:05:13.508 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 0, 2024-01-25T15:05:13.508 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 2, 2024-01-25T15:05:13.508 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 0 2024-01-25T15:05:13.508 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.508 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2024-01-25T15:05:13.508 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 0, 2024-01-25T15:05:13.508 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 0, 2024-01-25T15:05:13.509 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 0, 2024-01-25T15:05:13.509 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2024-01-25T15:05:13.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.509 INFO:teuthology.orchestra.run.smithi191.stdout: "osd-slow-ops": { 2024-01-25T15:05:13.509 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 0 2024-01-25T15:05:13.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.509 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2024-01-25T15:05:13.509 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2024-01-25T15:05:13.509 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 0, 2024-01-25T15:05:13.509 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2024-01-25T15:05:13.509 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 0, 2024-01-25T15:05:13.509 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed_ops": 0, 2024-01-25T15:05:13.509 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 0, 2024-01-25T15:05:13.509 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2024-01-25T15:05:13.509 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.510 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-25T15:05:13.510 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:13.510 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-01-25T15:05:13.510 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:13.510 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 1284, 2024-01-25T15:05:13.510 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 127612044, 2024-01-25T15:05:13.510 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:13.510 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 1284, 2024-01-25T15:05:13.510 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-01-25T15:05:13.510 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-01-25T15:05:13.510 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 1284, 2024-01-25T15:05:13.510 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 127612044, 2024-01-25T15:05:13.510 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:13.510 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.511 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.511 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.511 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:13.511 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.511 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2024-01-25T15:05:13.511 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:13.511 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-01-25T15:05:13.511 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:13.511 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-01-25T15:05:13.511 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-01-25T15:05:13.511 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:13.511 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:13.511 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 1152, 2024-01-25T15:05:13.511 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 126554737, 2024-01-25T15:05:13.511 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 1152, 2024-01-25T15:05:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 126554737, 2024-01-25T15:05:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2024-01-25T15:05:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2024-01-25T15:05:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-01-25T15:05:13.512 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-01-25T15:05:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 1152, 2024-01-25T15:05:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 1152, 2024-01-25T15:05:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 1152, 2024-01-25T15:05:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 1152, 2024-01-25T15:05:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2024-01-25T15:05:13.513 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-01-25T15:05:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-01-25T15:05:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-01-25T15:05:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-01-25T15:05:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-01-25T15:05:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 0, 2024-01-25T15:05:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 0, 2024-01-25T15:05:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.514 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x5642cfebc960": { 2024-01-25T15:05:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-01-25T15:05:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-01-25T15:05:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-01-25T15:05:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-01-25T15:05:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-01-25T15:05:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 0, 2024-01-25T15:05:13.515 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 0, 2024-01-25T15:05:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:13.516 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:13.516 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-01-25T15:05:13.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:13 smithi186 ceph-mon[35697]: pgmap v445: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-01-25T15:05:13.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:13 smithi170 ceph-mon[31899]: pgmap v445: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-01-25T15:05:13.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:13 smithi191 ceph-mon[36347]: pgmap v445: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-01-25T15:05:14.227 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-01-25T15:05:14.227 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-01-25T15:05:14.228 DEBUG:tasks.check_counter:Getting stats from i 2024-01-25T15:05:14.228 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph daemon mds.i perf dump 2024-01-25T15:05:14.468 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T15:05:15.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:15 smithi186 ceph-mon[35697]: pgmap v446: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-01-25T15:05:15.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:15 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T15:05:15.611 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:15 smithi191 ceph-mon[36347]: pgmap v446: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-01-25T15:05:15.611 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:15 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T15:05:15.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:15 smithi170 ceph-mon[31899]: pgmap v446: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 13 op/s 2024-01-25T15:05:15.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:15 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-01-25T15:05:16.273 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-01-25T15:05:16.273 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2024-01-25T15:05:16.273 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 26307, 2024-01-25T15:05:16.273 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 32006, 2024-01-25T15:05:16.273 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 8800553, 2024-01-25T15:05:16.273 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 67642631, 2024-01-25T15:05:16.274 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 32, 2024-01-25T15:05:16.274 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 4, 2024-01-25T15:05:16.274 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 2.104987003, 2024-01-25T15:05:16.274 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.888026792, 2024-01-25T15:05:16.274 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.664479913, 2024-01-25T15:05:16.274 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.535126647, 2024-01-25T15:05:16.274 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:16.274 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 32005, 2024-01-25T15:05:16.274 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 12.346439643, 2024-01-25T15:05:16.274 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000385765 2024-01-25T15:05:16.274 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.274 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:16.274 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 24824, 2024-01-25T15:05:16.274 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.004425096, 2024-01-25T15:05:16.275 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000178 2024-01-25T15:05:16.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.275 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-01-25T15:05:16.275 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 448 2024-01-25T15:05:16.275 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.275 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2024-01-25T15:05:16.275 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 29489, 2024-01-25T15:05:16.275 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 32676, 2024-01-25T15:05:16.275 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 12501904, 2024-01-25T15:05:16.275 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 70180618, 2024-01-25T15:05:16.275 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 12, 2024-01-25T15:05:16.275 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 5, 2024-01-25T15:05:16.276 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 2.305475764, 2024-01-25T15:05:16.276 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.972119861, 2024-01-25T15:05:16.276 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.666635014, 2024-01-25T15:05:16.276 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.629684840, 2024-01-25T15:05:16.276 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:16.276 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 32675, 2024-01-25T15:05:16.276 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 19.298632481, 2024-01-25T15:05:16.276 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000590623 2024-01-25T15:05:16.276 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.276 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:16.276 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 19013, 2024-01-25T15:05:16.276 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.004039409, 2024-01-25T15:05:16.276 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000212 2024-01-25T15:05:16.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.277 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 875696, 2024-01-25T15:05:16.277 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 67040 2024-01-25T15:05:16.277 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.277 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2024-01-25T15:05:16.277 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 72458, 2024-01-25T15:05:16.277 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 128352, 2024-01-25T15:05:16.277 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 26912400, 2024-01-25T15:05:16.277 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 97862328, 2024-01-25T15:05:16.277 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 48, 2024-01-25T15:05:16.277 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 8, 2024-01-25T15:05:16.277 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 4.875012278, 2024-01-25T15:05:16.277 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 2.206945064, 2024-01-25T15:05:16.277 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 23.306800104, 2024-01-25T15:05:16.278 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.464942151, 2024-01-25T15:05:16.278 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:16.278 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 128350, 2024-01-25T15:05:16.278 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 9.214074549, 2024-01-25T15:05:16.278 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000071788 2024-01-25T15:05:16.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.278 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:16.278 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 161567, 2024-01-25T15:05:16.278 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.024253887, 2024-01-25T15:05:16.278 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000150 2024-01-25T15:05:16.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.278 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 21986320, 2024-01-25T15:05:16.278 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 62838240 2024-01-25T15:05:16.278 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.279 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2024-01-25T15:05:16.279 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2024-01-25T15:05:16.279 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2024-01-25T15:05:16.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.279 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2024-01-25T15:05:16.279 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-01-25T15:05:16.279 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-01-25T15:05:16.279 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 15555, 2024-01-25T15:05:16.279 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 36.395292959, 2024-01-25T15:05:16.279 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002339780 2024-01-25T15:05:16.279 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:16.279 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.279 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2024-01-25T15:05:16.279 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-01-25T15:05:16.279 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-01-25T15:05:16.280 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 22028, 2024-01-25T15:05:16.280 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 3.806244084, 2024-01-25T15:05:16.280 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000172791 2024-01-25T15:05:16.280 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:16.280 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.280 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2024-01-25T15:05:16.280 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 35803, 2024-01-25T15:05:16.280 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 35549, 2024-01-25T15:05:16.280 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2024-01-25T15:05:16.280 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 35549, 2024-01-25T15:05:16.280 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 359.424148657, 2024-01-25T15:05:16.281 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.010110668 2024-01-25T15:05:16.281 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.281 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2024-01-25T15:05:16.281 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 254, 2024-01-25T15:05:16.281 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 7, 2024-01-25T15:05:16.281 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 2, 2024-01-25T15:05:16.281 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 2237, 2024-01-25T15:05:16.281 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 8, 2024-01-25T15:05:16.281 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 2, 2024-01-25T15:05:16.281 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 270, 2024-01-25T15:05:16.281 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 81, 2024-01-25T15:05:16.281 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 42, 2024-01-25T15:05:16.282 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 147, 2024-01-25T15:05:16.282 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 154, 2024-01-25T15:05:16.282 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 2552, 2024-01-25T15:05:16.282 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 1, 2024-01-25T15:05:16.282 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 1, 2024-01-25T15:05:16.282 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 6, 2024-01-25T15:05:16.282 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 45496, 2024-01-25T15:05:16.282 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 44207, 2024-01-25T15:05:16.282 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 117, 2024-01-25T15:05:16.283 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 143, 2024-01-25T15:05:16.283 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 0, 2024-01-25T15:05:16.283 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 4, 2024-01-25T15:05:16.283 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 8, 2024-01-25T15:05:16.283 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 0, 2024-01-25T15:05:16.283 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 0, 2024-01-25T15:05:16.283 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 206, 2024-01-25T15:05:16.284 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 2237, 2024-01-25T15:05:16.284 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 167, 2024-01-25T15:05:16.284 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 142, 2024-01-25T15:05:16.284 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2024-01-25T15:05:16.284 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 10554, 2024-01-25T15:05:16.284 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 12, 2024-01-25T15:05:16.284 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 4, 2024-01-25T15:05:16.285 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 234, 2024-01-25T15:05:16.285 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 0, 2024-01-25T15:05:16.285 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 10554, 2024-01-25T15:05:16.285 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2024-01-25T15:05:16.285 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2024-01-25T15:05:16.285 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2024-01-25T15:05:16.285 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 1428, 2024-01-25T15:05:16.285 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 4, 2024-01-25T15:05:16.285 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 1424, 2024-01-25T15:05:16.286 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 9126, 2024-01-25T15:05:16.286 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 341, 2024-01-25T15:05:16.286 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 6678, 2024-01-25T15:05:16.286 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 27151, 2024-01-25T15:05:16.286 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 226, 2024-01-25T15:05:16.286 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-25T15:05:16.286 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-25T15:05:16.287 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 21357, 2024-01-25T15:05:16.287 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 12417, 2024-01-25T15:05:16.287 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 188, 2024-01-25T15:05:16.287 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 17671 2024-01-25T15:05:16.287 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.287 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2024-01-25T15:05:16.288 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 0, 2024-01-25T15:05:16.288 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 0, 2024-01-25T15:05:16.288 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 0, 2024-01-25T15:05:16.288 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 154, 2024-01-25T15:05:16.288 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 463, 2024-01-25T15:05:16.288 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 7, 2024-01-25T15:05:16.288 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2024-01-25T15:05:16.289 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2024-01-25T15:05:16.289 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 11735, 2024-01-25T15:05:16.289 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 11646, 2024-01-25T15:05:16.289 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 79, 2024-01-25T15:05:16.289 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 8, 2024-01-25T15:05:16.289 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2024-01-25T15:05:16.289 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2024-01-25T15:05:16.289 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2024-01-25T15:05:16.290 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2024-01-25T15:05:16.290 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2024-01-25T15:05:16.290 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 4, 2024-01-25T15:05:16.290 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 206, 2024-01-25T15:05:16.290 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2024-01-25T15:05:16.290 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 10, 2024-01-25T15:05:16.290 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2024-01-25T15:05:16.290 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0 2024-01-25T15:05:16.290 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.291 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2024-01-25T15:05:16.291 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 0, 2024-01-25T15:05:16.291 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 59900, 2024-01-25T15:05:16.291 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 58000, 2024-01-25T15:05:16.291 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 58000, 2024-01-25T15:05:16.291 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 1900, 2024-01-25T15:05:16.292 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2024-01-25T15:05:16.292 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 10340, 2024-01-25T15:05:16.292 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 83, 2024-01-25T15:05:16.292 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 80, 2024-01-25T15:05:16.292 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 80, 2024-01-25T15:05:16.292 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 3, 2024-01-25T15:05:16.293 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 1, 2024-01-25T15:05:16.293 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2024-01-25T15:05:16.293 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 15, 2024-01-25T15:05:16.293 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 127512161, 2024-01-25T15:05:16.293 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 130745928, 2024-01-25T15:05:16.293 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 0, 2024-01-25T15:05:16.293 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2024-01-25T15:05:16.293 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 6262, 2024-01-25T15:05:16.293 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 186.521253619, 2024-01-25T15:05:16.293 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.029786211 2024-01-25T15:05:16.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.294 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 0 2024-01-25T15:05:16.294 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.294 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2024-01-25T15:05:16.294 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 46, 2024-01-25T15:05:16.294 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 13998, 2024-01-25T15:05:16.294 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 13952, 2024-01-25T15:05:16.294 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 41, 2024-01-25T15:05:16.294 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 1916, 2024-01-25T15:05:16.294 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 1875, 2024-01-25T15:05:16.294 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 270, 2024-01-25T15:05:16.294 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 26691, 2024-01-25T15:05:16.294 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 26421, 2024-01-25T15:05:16.294 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 1, 2024-01-25T15:05:16.295 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 14006, 2024-01-25T15:05:16.295 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 14005, 2024-01-25T15:05:16.295 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 152404, 2024-01-25T15:05:16.295 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 207228 2024-01-25T15:05:16.295 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.295 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2024-01-25T15:05:16.295 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 45553, 2024-01-25T15:05:16.295 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 1687, 2024-01-25T15:05:16.295 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 35803, 2024-01-25T15:05:16.295 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 499, 2024-01-25T15:05:16.295 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 2598, 2024-01-25T15:05:16.295 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2024-01-25T15:05:16.295 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 11119, 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 262.251100562, 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.023585853 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 279, 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.021165812, 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.003660092 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.296 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 214, 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 3.129158934, 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.014622238 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 6828, 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 5.780183116, 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000846541 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.297 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.298 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2024-01-25T15:05:16.298 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.298 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.298 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.298 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2024-01-25T15:05:16.298 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.298 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.298 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.298 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.298 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2024-01-25T15:05:16.298 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.298 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.299 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.299 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2024-01-25T15:05:16.299 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.299 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.299 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.299 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1761, 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 15.512743921, 2024-01-25T15:05:16.300 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.008809053 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 469, 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 5.056681438, 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.010781836 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.301 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 21, 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.006612708, 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000314890 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1613, 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 5.653351554, 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.003504867 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 509, 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 9.865837778, 2024-01-25T15:05:16.302 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.019382785 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2024-01-25T15:05:16.303 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1822, 2024-01-25T15:05:16.304 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 22.245154439, 2024-01-25T15:05:16.304 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.012209195 2024-01-25T15:05:16.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.304 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2024-01-25T15:05:16.304 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.304 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.304 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.304 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.304 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2024-01-25T15:05:16.304 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.304 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.304 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.305 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2024-01-25T15:05:16.305 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 234, 2024-01-25T15:05:16.305 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 2.335874123, 2024-01-25T15:05:16.305 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.009982368 2024-01-25T15:05:16.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.305 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2024-01-25T15:05:16.305 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.305 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.305 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.305 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.305 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2024-01-25T15:05:16.305 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.305 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 8, 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.020870092, 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002608761 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 452, 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 7.847808886, 2024-01-25T15:05:16.306 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.017362409 2024-01-25T15:05:16.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.307 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2024-01-25T15:05:16.307 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 10220, 2024-01-25T15:05:16.307 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 18.697605294, 2024-01-25T15:05:16.307 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001829511 2024-01-25T15:05:16.307 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.307 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2024-01-25T15:05:16.307 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2024-01-25T15:05:16.307 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2024-01-25T15:05:16.307 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.307 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.307 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.308 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:16.308 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.308 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2024-01-25T15:05:16.308 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 1, 2024-01-25T15:05:16.308 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 3, 2024-01-25T15:05:16.308 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 2, 2024-01-25T15:05:16.308 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 1, 2024-01-25T15:05:16.308 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2024-01-25T15:05:16.308 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 20920, 2024-01-25T15:05:16.308 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 20920, 2024-01-25T15:05:16.308 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 206, 2024-01-25T15:05:16.309 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2024-01-25T15:05:16.309 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.309 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2024-01-25T15:05:16.309 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2024-01-25T15:05:16.309 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2024-01-25T15:05:16.309 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2024-01-25T15:05:16.309 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2024-01-25T15:05:16.309 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2024-01-25T15:05:16.309 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2024-01-25T15:05:16.309 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-25T15:05:16.309 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2024-01-25T15:05:16.309 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-25T15:05:16.309 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2024-01-25T15:05:16.310 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2024-01-25T15:05:16.310 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2024-01-25T15:05:16.310 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-25T15:05:16.310 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2024-01-25T15:05:16.310 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2024-01-25T15:05:16.310 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2024-01-25T15:05:16.310 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2024-01-25T15:05:16.310 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2024-01-25T15:05:16.310 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-25T15:05:16.310 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2024-01-25T15:05:16.310 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-25T15:05:16.310 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2024-01-25T15:05:16.311 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2024-01-25T15:05:16.311 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2024-01-25T15:05:16.311 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2024-01-25T15:05:16.311 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2024-01-25T15:05:16.311 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-25T15:05:16.311 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2024-01-25T15:05:16.311 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2024-01-25T15:05:16.311 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2024-01-25T15:05:16.311 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2024-01-25T15:05:16.311 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2024-01-25T15:05:16.311 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2024-01-25T15:05:16.311 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2024-01-25T15:05:16.311 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2024-01-25T15:05:16.312 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2024-01-25T15:05:16.312 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 348266, 2024-01-25T15:05:16.312 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 146, 2024-01-25T15:05:16.312 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 704, 2024-01-25T15:05:16.312 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 8, 2024-01-25T15:05:16.312 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2024-01-25T15:05:16.312 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2024-01-25T15:05:16.312 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2024-01-25T15:05:16.312 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2024-01-25T15:05:16.312 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2024-01-25T15:05:16.312 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2024-01-25T15:05:16.312 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 7432, 2024-01-25T15:05:16.313 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 156, 2024-01-25T15:05:16.313 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2024-01-25T15:05:16.313 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2024-01-25T15:05:16.313 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2024-01-25T15:05:16.313 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2024-01-25T15:05:16.313 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 359790, 2024-01-25T15:05:16.313 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 3884, 2024-01-25T15:05:16.313 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2024-01-25T15:05:16.313 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2024-01-25T15:05:16.313 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2024-01-25T15:05:16.313 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2024-01-25T15:05:16.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.314 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2024-01-25T15:05:16.314 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2024-01-25T15:05:16.314 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2024-01-25T15:05:16.314 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 46983, 2024-01-25T15:05:16.314 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 149203728, 2024-01-25T15:05:16.314 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 37, 2024-01-25T15:05:16.314 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 46983, 2024-01-25T15:05:16.314 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2024-01-25T15:05:16.314 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 46983, 2024-01-25T15:05:16.314 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 3128.171834603, 2024-01-25T15:05:16.314 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.066580930 2024-01-25T15:05:16.314 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.314 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2024-01-25T15:05:16.315 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2024-01-25T15:05:16.315 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 46983, 2024-01-25T15:05:16.315 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 77569 2024-01-25T15:05:16.315 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.315 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 46983, 2024-01-25T15:05:16.315 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 10928, 2024-01-25T15:05:16.315 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 36055, 2024-01-25T15:05:16.315 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2024-01-25T15:05:16.315 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2024-01-25T15:05:16.315 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 682, 2024-01-25T15:05:16.315 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 13515, 2024-01-25T15:05:16.315 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 361, 2024-01-25T15:05:16.316 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 6619, 2024-01-25T15:05:16.316 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 262, 2024-01-25T15:05:16.316 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2024-01-25T15:05:16.316 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2024-01-25T15:05:16.316 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 0, 2024-01-25T15:05:16.316 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 8, 2024-01-25T15:05:16.316 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 13088, 2024-01-25T15:05:16.316 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2024-01-25T15:05:16.316 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2024-01-25T15:05:16.316 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2024-01-25T15:05:16.316 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 10567, 2024-01-25T15:05:16.316 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 27438, 2024-01-25T15:05:16.316 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 274, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2024-01-25T15:05:16.317 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 87, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 3, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 12, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 12, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2024-01-25T15:05:16.318 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2024-01-25T15:05:16.319 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 4435, 2024-01-25T15:05:16.319 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 18, 2024-01-25T15:05:16.319 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 302 2024-01-25T15:05:16.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.319 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2024-01-25T15:05:16.319 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 1, 2024-01-25T15:05:16.319 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 7, 2024-01-25T15:05:16.319 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 7, 2024-01-25T15:05:16.319 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2024-01-25T15:05:16.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.319 INFO:teuthology.orchestra.run.smithi191.stdout: "osd-slow-ops": { 2024-01-25T15:05:16.319 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 0 2024-01-25T15:05:16.319 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.320 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2024-01-25T15:05:16.320 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2024-01-25T15:05:16.320 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 14, 2024-01-25T15:05:16.320 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2024-01-25T15:05:16.320 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 6, 2024-01-25T15:05:16.320 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed_ops": 12509, 2024-01-25T15:05:16.320 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 11646, 2024-01-25T15:05:16.320 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2024-01-25T15:05:16.320 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.320 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-25T15:05:16.320 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:16.320 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-01-25T15:05:16.320 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:16.321 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 128250, 2024-01-25T15:05:16.321 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 33897213, 2024-01-25T15:05:16.321 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:16.321 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 128250, 2024-01-25T15:05:16.321 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-01-25T15:05:16.321 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-01-25T15:05:16.321 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 128250, 2024-01-25T15:05:16.321 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 33897213, 2024-01-25T15:05:16.321 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:16.321 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.322 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.322 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.322 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:16.322 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.322 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2024-01-25T15:05:16.322 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:16.322 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-01-25T15:05:16.322 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:16.322 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-01-25T15:05:16.322 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-01-25T15:05:16.322 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:16.322 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:16.322 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 46983, 2024-01-25T15:05:16.322 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 150379934, 2024-01-25T15:05:16.322 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 46983, 2024-01-25T15:05:16.323 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 150379934, 2024-01-25T15:05:16.323 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:16.323 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.323 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.323 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.323 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:16.323 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.323 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2024-01-25T15:05:16.323 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:16.323 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2024-01-25T15:05:16.323 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:16.323 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-01-25T15:05:16.323 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-01-25T15:05:16.323 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:16.324 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:16.324 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 46983, 2024-01-25T15:05:16.324 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 46983, 2024-01-25T15:05:16.324 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 46983, 2024-01-25T15:05:16.324 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 46983, 2024-01-25T15:05:16.324 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:16.324 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.324 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.324 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.324 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:16.324 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.324 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2024-01-25T15:05:16.324 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:16.324 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 11646, 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 1176326, 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 11646, 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 357, 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 1176326, 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:16.325 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x561022bce6e0": { 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 59900, 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 126551624, 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 59900, 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 6262, 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 126551624, 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:16.326 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:16.327 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:16.327 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-01-25T15:05:16.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:16 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T15:05:16.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:16 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T15:05:16.484 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:16 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:05:16.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:16 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T15:05:16.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:16 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T15:05:16.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:16 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:05:16.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:16 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-01-25T15:05:16.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:16 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-01-25T15:05:16.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:16 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' 2024-01-25T15:05:17.132 INFO:tasks.check_counter:Daemon mds.i mds.exported=206 2024-01-25T15:05:17.132 INFO:tasks.check_counter:Daemon mds.i mds.imported=167 2024-01-25T15:05:17.132 DEBUG:tasks.check_counter:Getting stats from l 2024-01-25T15:05:17.132 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5 shell --fsid 267213a8-bb91-11ee-95b2-87774f69a715 -- ceph daemon mds.l perf dump 2024-01-25T15:05:17.371 INFO:teuthology.orchestra.run.smithi191.stderr:Inferring config /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/mon.c/config 2024-01-25T15:05:17.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:17 smithi191 ceph-mon[36347]: pgmap v447: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-01-25T15:05:17.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:17 smithi186 ceph-mon[35697]: pgmap v447: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-01-25T15:05:17.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:17 smithi170 ceph-mon[31899]: pgmap v447: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 11 op/s 2024-01-25T15:05:19.026 INFO:teuthology.orchestra.run.smithi191.stdout:{ 2024-01-25T15:05:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-0": { 2024-01-25T15:05:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 12612, 2024-01-25T15:05:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 9392, 2024-01-25T15:05:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 4425188, 2024-01-25T15:05:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 6854253, 2024-01-25T15:05:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 10, 2024-01-25T15:05:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 4, 2024-01-25T15:05:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.710698379, 2024-01-25T15:05:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.311184382, 2024-01-25T15:05:19.026 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.463578943, 2024-01-25T15:05:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.041820189, 2024-01-25T15:05:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 9393, 2024-01-25T15:05:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.244750465, 2024-01-25T15:05:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000026056 2024-01-25T15:05:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 18954, 2024-01-25T15:05:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.002884433, 2024-01-25T15:05:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000152 2024-01-25T15:05:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-01-25T15:05:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 448 2024-01-25T15:05:19.027 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-1": { 2024-01-25T15:05:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 1663, 2024-01-25T15:05:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 1760, 2024-01-25T15:05:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 1409746, 2024-01-25T15:05:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 1979142, 2024-01-25T15:05:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 12, 2024-01-25T15:05:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 7, 2024-01-25T15:05:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.122632749, 2024-01-25T15:05:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.048080671, 2024-01-25T15:05:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.074483753, 2024-01-25T15:05:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.013725195, 2024-01-25T15:05:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1759, 2024-01-25T15:05:19.028 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.073387657, 2024-01-25T15:05:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000041721 2024-01-25T15:05:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2098, 2024-01-25T15:05:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000323935, 2024-01-25T15:05:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000154 2024-01-25T15:05:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 862112, 2024-01-25T15:05:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 132688 2024-01-25T15:05:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "AsyncMessenger::Worker-2": { 2024-01-25T15:05:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_messages": 4020, 2024-01-25T15:05:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages": 6384, 2024-01-25T15:05:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_bytes": 1492340, 2024-01-25T15:05:19.029 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_bytes": 3939772, 2024-01-25T15:05:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_created_connections": 17, 2024-01-25T15:05:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_active_connections": 7, 2024-01-25T15:05:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_total_time": 0.294001964, 2024-01-25T15:05:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_send_time": 0.132101322, 2024-01-25T15:05:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_recv_time": 0.183101165, 2024-01-25T15:05:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_running_fast_dispatch_time": 0.010514211, 2024-01-25T15:05:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_messages_queue_lat": { 2024-01-25T15:05:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 6380, 2024-01-25T15:05:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.146612488, 2024-01-25T15:05:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000022980 2024-01-25T15:05:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.030 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_handle_ack_lat": { 2024-01-25T15:05:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 8217, 2024-01-25T15:05:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.001442672, 2024-01-25T15:05:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000175 2024-01-25T15:05:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_recv_encrypted_bytes": 1052976, 2024-01-25T15:05:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "msgr_send_encrypted_bytes": 3354016 2024-01-25T15:05:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "cct": { 2024-01-25T15:05:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "total_workers": 1, 2024-01-25T15:05:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: "unhealthy_workers": 0 2024-01-25T15:05:19.031 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-MDSRank": { 2024-01-25T15:05:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-01-25T15:05:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-01-25T15:05:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1953, 2024-01-25T15:05:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.163576367, 2024-01-25T15:05:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000595789 2024-01-25T15:05:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "finisher-PurgeQueue": { 2024-01-25T15:05:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "queue_len": 0, 2024-01-25T15:05:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "complete_latency": { 2024-01-25T15:05:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1472, 2024-01-25T15:05:19.032 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.119994617, 2024-01-25T15:05:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000081518 2024-01-25T15:05:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "mds": { 2024-01-25T15:05:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "request": 1673, 2024-01-25T15:05:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "reply": 1638, 2024-01-25T15:05:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "reply_latency": { 2024-01-25T15:05:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1638, 2024-01-25T15:05:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 5.214722931, 2024-01-25T15:05:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.003183591 2024-01-25T15:05:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_reply": 0, 2024-01-25T15:05:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "forward": 35, 2024-01-25T15:05:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_complete": 1, 2024-01-25T15:05:19.033 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_fetch_keys": 0, 2024-01-25T15:05:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_commit": 11, 2024-01-25T15:05:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_split": 0, 2024-01-25T15:05:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_merge": 0, 2024-01-25T15:05:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes": 105, 2024-01-25T15:05:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_top": 44, 2024-01-25T15:05:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_bottom": 22, 2024-01-25T15:05:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pin_tail": 39, 2024-01-25T15:05:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_pinned": 42, 2024-01-25T15:05:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_expired": 590, 2024-01-25T15:05:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "inodes_with_caps": 2, 2024-01-25T15:05:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "caps": 2, 2024-01-25T15:05:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "subtrees": 7, 2024-01-25T15:05:19.034 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse": 3489, 2024-01-25T15:05:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_hit": 2838, 2024-01-25T15:05:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_forward": 31, 2024-01-25T15:05:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_discover": 172, 2024-01-25T15:05:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_dir_fetch": 0, 2024-01-25T15:05:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_remote_ino": 7, 2024-01-25T15:05:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "traverse_lock": 4, 2024-01-25T15:05:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "load_cent": 0, 2024-01-25T15:05:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "q": 0, 2024-01-25T15:05:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "exported": 47, 2024-01-25T15:05:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "exported_inodes": 56, 2024-01-25T15:05:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "imported": 56, 2024-01-25T15:05:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "imported_inodes": 440, 2024-01-25T15:05:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_dir_fetch": 0, 2024-01-25T15:05:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_backtrace_fetch": 375, 2024-01-25T15:05:19.035 INFO:teuthology.orchestra.run.smithi191.stdout: "openino_peer_discover": 13, 2024-01-25T15:05:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rfiles": 1924, 2024-01-25T15:05:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rbytes": 15512990, 2024-01-25T15:05:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "root_rsnaps": 0, 2024-01-25T15:05:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_fetch": 375, 2024-01-25T15:05:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_set_tag": 0, 2024-01-25T15:05:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_backtrace_repaired": 0, 2024-01-25T15:05:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_inotable_repaired": 0, 2024-01-25T15:05:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_inodes": 30, 2024-01-25T15:05:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dir_base_inodes": 0, 2024-01-25T15:05:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_dirfrag_rstats": 30, 2024-01-25T15:05:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "scrub_file_inodes": 345, 2024-01-25T15:05:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_inode_file_caps": 58, 2024-01-25T15:05:19.036 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_revoke": 538, 2024-01-25T15:05:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_grant": 1094, 2024-01-25T15:05:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_trunc": 12, 2024-01-25T15:05:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-01-25T15:05:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "ceph_cap_op_flush_ack": 0, 2024-01-25T15:05:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps": 881, 2024-01-25T15:05:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_caps_dirty": 278, 2024-01-25T15:05:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_cap_release": 70, 2024-01-25T15:05:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "process_request_cap_release": 1280 2024-01-25T15:05:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_cache": { 2024-01-25T15:05:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update": 0, 2024-01-25T15:05:19.037 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_update_receipt": 0, 2024-01-25T15:05:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_try_discover": 0, 2024-01-25T15:05:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_send_discover": 216, 2024-01-25T15:05:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "dir_handle_discover": 114, 2024-01-25T15:05:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays": 24, 2024-01-25T15:05:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_delayed": 0, 2024-01-25T15:05:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "num_strays_enqueuing": 0, 2024-01-25T15:05:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_created": 616, 2024-01-25T15:05:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_enqueued": 583, 2024-01-25T15:05:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_reintegrated": 11, 2024-01-25T15:05:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "strays_migrated": 2, 2024-01-25T15:05:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_processing": 0, 2024-01-25T15:05:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_enqueued": 0, 2024-01-25T15:05:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "num_recovering_prioritized": 0, 2024-01-25T15:05:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_started": 0, 2024-01-25T15:05:19.038 INFO:teuthology.orchestra.run.smithi191.stdout: "recovery_completed": 0, 2024-01-25T15:05:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_enqueue_scrub": 0, 2024-01-25T15:05:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_exportdir": 47, 2024-01-25T15:05:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_flush": 0, 2024-01-25T15:05:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragmentdir": 0, 2024-01-25T15:05:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_fragstats": 0, 2024-01-25T15:05:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "ireq_inodestats": 0 2024-01-25T15:05:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_log": { 2024-01-25T15:05:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "evlrg": 0, 2024-01-25T15:05:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "evadd": 2698, 2024-01-25T15:05:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "evex": 0, 2024-01-25T15:05:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "evtrm": 0, 2024-01-25T15:05:19.039 INFO:teuthology.orchestra.run.smithi191.stdout: "ev": 2698, 2024-01-25T15:05:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "evexg": 0, 2024-01-25T15:05:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "evexd": 0, 2024-01-25T15:05:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "segadd": 4, 2024-01-25T15:05:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "segex": 0, 2024-01-25T15:05:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "segtrm": 0, 2024-01-25T15:05:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "seg": 4, 2024-01-25T15:05:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "segmjr": 2, 2024-01-25T15:05:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "segexg": 0, 2024-01-25T15:05:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "segexd": 0, 2024-01-25T15:05:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "expos": 4194304, 2024-01-25T15:05:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "wrpos": 9600480, 2024-01-25T15:05:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "rdpos": 0, 2024-01-25T15:05:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "jlat": { 2024-01-25T15:05:19.040 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 839, 2024-01-25T15:05:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 2.801692706, 2024-01-25T15:05:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.003339323 2024-01-25T15:05:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "replayed": 0 2024-01-25T15:05:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_mem": { 2024-01-25T15:05:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "ino": 60, 2024-01-25T15:05:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "ino+": 906, 2024-01-25T15:05:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "ino-": 846, 2024-01-25T15:05:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "dir": 59, 2024-01-25T15:05:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "dir+": 338, 2024-01-25T15:05:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "dir-": 279, 2024-01-25T15:05:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "dn": 105, 2024-01-25T15:05:19.041 INFO:teuthology.orchestra.run.smithi191.stdout: "dn+": 1888, 2024-01-25T15:05:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "dn-": 1783, 2024-01-25T15:05:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "cap": 2, 2024-01-25T15:05:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "cap+": 823, 2024-01-25T15:05:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "cap-": 821, 2024-01-25T15:05:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "rss": 75620, 2024-01-25T15:05:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "heap": 199036 2024-01-25T15:05:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_server": { 2024-01-25T15:05:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_client_request": 3136, 2024-01-25T15:05:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "dispatch_server_request": 627, 2024-01-25T15:05:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_request": 1673, 2024-01-25T15:05:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_client_session": 114, 2024-01-25T15:05:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "handle_peer_request": 1245, 2024-01-25T15:05:19.042 INFO:teuthology.orchestra.run.smithi191.stdout: "req_create_latency": { 2024-01-25T15:05:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 90, 2024-01-25T15:05:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.123327514, 2024-01-25T15:05:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001370305 2024-01-25T15:05:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getattr_latency": { 2024-01-25T15:05:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 28, 2024-01-25T15:05:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.057784117, 2024-01-25T15:05:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002063718 2024-01-25T15:05:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getfilelock_latency": { 2024-01-25T15:05:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.043 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "req_link_latency": { 2024-01-25T15:05:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 20, 2024-01-25T15:05:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.937757583, 2024-01-25T15:05:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.046887879 2024-01-25T15:05:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookup_latency": { 2024-01-25T15:05:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 526, 2024-01-25T15:05:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.251135319, 2024-01-25T15:05:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000477443 2024-01-25T15:05:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookuphash_latency": { 2024-01-25T15:05:19.044 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupino_latency": { 2024-01-25T15:05:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 1, 2024-01-25T15:05:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000287546, 2024-01-25T15:05:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000287546 2024-01-25T15:05:19.045 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupname_latency": { 2024-01-25T15:05:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupparent_latency": { 2024-01-25T15:05:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lookupsnap_latency": { 2024-01-25T15:05:19.046 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: "req_lssnap_latency": { 2024-01-25T15:05:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.047 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mkdir_latency": { 2024-01-25T15:05:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 52, 2024-01-25T15:05:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.065687294, 2024-01-25T15:05:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001263217 2024-01-25T15:05:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mknod_latency": { 2024-01-25T15:05:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 25, 2024-01-25T15:05:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.038139192, 2024-01-25T15:05:19.048 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001525567 2024-01-25T15:05:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "req_mksnap_latency": { 2024-01-25T15:05:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "req_open_latency": { 2024-01-25T15:05:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "req_readdir_latency": { 2024-01-25T15:05:19.049 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 126, 2024-01-25T15:05:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.154942992, 2024-01-25T15:05:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001229706 2024-01-25T15:05:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rename_latency": { 2024-01-25T15:05:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 64, 2024-01-25T15:05:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.607840001, 2024-01-25T15:05:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.025122500 2024-01-25T15:05:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "req_renamesnap_latency": { 2024-01-25T15:05:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.050 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "req_snapdiff_latency": { 2024-01-25T15:05:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmdir_latency": { 2024-01-25T15:05:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 100, 2024-01-25T15:05:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.765297879, 2024-01-25T15:05:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.007652978 2024-01-25T15:05:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmsnap_latency": { 2024-01-25T15:05:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.051 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "req_rmxattr_latency": { 2024-01-25T15:05:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setattr_latency": { 2024-01-25T15:05:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 12, 2024-01-25T15:05:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.020040246, 2024-01-25T15:05:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001670020 2024-01-25T15:05:19.052 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setdirlayout_latency": { 2024-01-25T15:05:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setfilelock_latency": { 2024-01-25T15:05:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setlayout_latency": { 2024-01-25T15:05:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.053 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "req_setxattr_latency": { 2024-01-25T15:05:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "req_symlink_latency": { 2024-01-25T15:05:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 39, 2024-01-25T15:05:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.062648916, 2024-01-25T15:05:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.001606382 2024-01-25T15:05:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "req_unlink_latency": { 2024-01-25T15:05:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 555, 2024-01-25T15:05:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 1.129834332, 2024-01-25T15:05:19.054 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002035737 2024-01-25T15:05:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_revoke_eviction": 0, 2024-01-25T15:05:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "cap_acquisition_throttle": 0, 2024-01-25T15:05:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "req_getvxattr_latency": { 2024-01-25T15:05:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_sessions": { 2024-01-25T15:05:19.055 INFO:teuthology.orchestra.run.smithi191.stdout: "session_count": 1, 2024-01-25T15:05:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "session_add": 1, 2024-01-25T15:05:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "session_remove": 0, 2024-01-25T15:05:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_open": 1, 2024-01-25T15:05:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "sessions_stale": 0, 2024-01-25T15:05:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "total_load": 1034, 2024-01-25T15:05:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "average_load": 1034, 2024-01-25T15:05:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "avg_session_uptime": 209, 2024-01-25T15:05:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "mdthresh_evicted": 0 2024-01-25T15:05:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "mempool": { 2024-01-25T15:05:19.056 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_bytes": 0, 2024-01-25T15:05:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "bloom_filter_items": 0, 2024-01-25T15:05:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_bytes": 0, 2024-01-25T15:05:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_alloc_items": 0, 2024-01-25T15:05:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_bytes": 0, 2024-01-25T15:05:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_data_items": 0, 2024-01-25T15:05:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_bytes": 0, 2024-01-25T15:05:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_onode_items": 0, 2024-01-25T15:05:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_bytes": 0, 2024-01-25T15:05:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_meta_items": 0, 2024-01-25T15:05:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_bytes": 0, 2024-01-25T15:05:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_other_items": 0, 2024-01-25T15:05:19.057 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_bytes": 0, 2024-01-25T15:05:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_cache_buffer_items": 0, 2024-01-25T15:05:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_bytes": 0, 2024-01-25T15:05:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_extent_items": 0, 2024-01-25T15:05:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_bytes": 0, 2024-01-25T15:05:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_blob_items": 0, 2024-01-25T15:05:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_bytes": 0, 2024-01-25T15:05:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_shared_blob_items": 0, 2024-01-25T15:05:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_bytes": 0, 2024-01-25T15:05:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_inline_bl_items": 0, 2024-01-25T15:05:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_bytes": 0, 2024-01-25T15:05:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_fsck_items": 0, 2024-01-25T15:05:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_bytes": 0, 2024-01-25T15:05:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_txc_items": 0, 2024-01-25T15:05:19.058 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_bytes": 0, 2024-01-25T15:05:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_deferred_items": 0, 2024-01-25T15:05:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_bytes": 0, 2024-01-25T15:05:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluestore_writing_items": 0, 2024-01-25T15:05:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_bytes": 0, 2024-01-25T15:05:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_items": 0, 2024-01-25T15:05:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_bytes": 0, 2024-01-25T15:05:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_reader_items": 0, 2024-01-25T15:05:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_bytes": 0, 2024-01-25T15:05:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "bluefs_file_writer_items": 0, 2024-01-25T15:05:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_bytes": 312255, 2024-01-25T15:05:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_anon_items": 141, 2024-01-25T15:05:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_bytes": 528, 2024-01-25T15:05:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "buffer_meta_items": 6, 2024-01-25T15:05:19.059 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_bytes": 0, 2024-01-25T15:05:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_items": 0, 2024-01-25T15:05:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_bytes": 0, 2024-01-25T15:05:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_mapbl_items": 0, 2024-01-25T15:05:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_bytes": 0, 2024-01-25T15:05:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_pglog_items": 0, 2024-01-25T15:05:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_bytes": 7432, 2024-01-25T15:05:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_items": 156, 2024-01-25T15:05:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_bytes": 0, 2024-01-25T15:05:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "osdmap_mapping_items": 0, 2024-01-25T15:05:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_bytes": 0, 2024-01-25T15:05:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "pgmap_items": 0, 2024-01-25T15:05:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_bytes": 295530, 2024-01-25T15:05:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "mds_co_items": 4992, 2024-01-25T15:05:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_bytes": 0, 2024-01-25T15:05:19.060 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_1_items": 0, 2024-01-25T15:05:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_bytes": 0, 2024-01-25T15:05:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "unittest_2_items": 0 2024-01-25T15:05:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "objecter": { 2024-01-25T15:05:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "op_active": 0, 2024-01-25T15:05:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "op_laggy": 0, 2024-01-25T15:05:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send": 2218, 2024-01-25T15:05:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "op_send_bytes": 5543237, 2024-01-25T15:05:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "op_resend": 33, 2024-01-25T15:05:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "op_reply": 2218, 2024-01-25T15:05:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "op_latency": { 2024-01-25T15:05:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2218, 2024-01-25T15:05:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 5.283908450, 2024-01-25T15:05:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.002382285 2024-01-25T15:05:19.061 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "op_inflight": 0, 2024-01-25T15:05:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "oplen_avg": { 2024-01-25T15:05:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 2218, 2024-01-25T15:05:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 2272 2024-01-25T15:05:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "op": 2218, 2024-01-25T15:05:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "op_r": 482, 2024-01-25T15:05:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "op_w": 1736, 2024-01-25T15:05:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "op_rmw": 0, 2024-01-25T15:05:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "op_pg": 0, 2024-01-25T15:05:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_stat": 0, 2024-01-25T15:05:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_create": 10, 2024-01-25T15:05:19.062 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_read": 106, 2024-01-25T15:05:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_write": 945, 2024-01-25T15:05:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writefull": 73, 2024-01-25T15:05:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_writesame": 0, 2024-01-25T15:05:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_append": 0, 2024-01-25T15:05:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_zero": 0, 2024-01-25T15:05:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_truncate": 0, 2024-01-25T15:05:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_delete": 662, 2024-01-25T15:05:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_mapext": 0, 2024-01-25T15:05:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_sparse_read": 0, 2024-01-25T15:05:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_clonerange": 0, 2024-01-25T15:05:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_getxattr": 376, 2024-01-25T15:05:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_setxattr": 20, 2024-01-25T15:05:19.063 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_cmpxattr": 0, 2024-01-25T15:05:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_rmxattr": 0, 2024-01-25T15:05:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_resetxattrs": 0, 2024-01-25T15:05:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_call": 0, 2024-01-25T15:05:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_watch": 0, 2024-01-25T15:05:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_notify": 0, 2024-01-25T15:05:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_src_cmpxattr": 0, 2024-01-25T15:05:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls": 0, 2024-01-25T15:05:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_pgls_filter": 0, 2024-01-25T15:05:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "osdop_other": 12, 2024-01-25T15:05:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_active": 0, 2024-01-25T15:05:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_send": 0, 2024-01-25T15:05:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_resend": 0, 2024-01-25T15:05:19.064 INFO:teuthology.orchestra.run.smithi191.stdout: "linger_ping": 0, 2024-01-25T15:05:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_active": 0, 2024-01-25T15:05:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_send": 0, 2024-01-25T15:05:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "poolop_resend": 0, 2024-01-25T15:05:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_active": 0, 2024-01-25T15:05:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_send": 0, 2024-01-25T15:05:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "poolstat_resend": 0, 2024-01-25T15:05:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_active": 0, 2024-01-25T15:05:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_send": 0, 2024-01-25T15:05:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "statfs_resend": 0, 2024-01-25T15:05:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "command_active": 0, 2024-01-25T15:05:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "command_send": 0, 2024-01-25T15:05:19.065 INFO:teuthology.orchestra.run.smithi191.stdout: "command_resend": 0, 2024-01-25T15:05:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "map_epoch": 87, 2024-01-25T15:05:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "map_full": 0, 2024-01-25T15:05:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "map_inc": 2, 2024-01-25T15:05:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_sessions": 12, 2024-01-25T15:05:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_open": 12, 2024-01-25T15:05:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_session_close": 0, 2024-01-25T15:05:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "osd_laggy": 0, 2024-01-25T15:05:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_wr": 51, 2024-01-25T15:05:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_rd": 2, 2024-01-25T15:05:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_del": 15 2024-01-25T15:05:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "oft": { 2024-01-25T15:05:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_objs": 1, 2024-01-25T15:05:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_kv_pairs": 0, 2024-01-25T15:05:19.066 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_updates": 0, 2024-01-25T15:05:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "omap_total_removes": 0 2024-01-25T15:05:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "osd-slow-ops": { 2024-01-25T15:05:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "slow_ops_count": 0 2024-01-25T15:05:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "purge_queue": { 2024-01-25T15:05:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops": 0, 2024-01-25T15:05:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_ops_high_water": 10, 2024-01-25T15:05:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing": 0, 2024-01-25T15:05:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executing_high_water": 6, 2024-01-25T15:05:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed_ops": 649, 2024-01-25T15:05:19.067 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_executed": 583, 2024-01-25T15:05:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "pq_item_in_journal": 0 2024-01-25T15:05:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-01-25T15:05:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-01-25T15:05:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 18291, 2024-01-25T15:05:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 5544269, 2024-01-25T15:05:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 18291, 2024-01-25T15:05:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-01-25T15:05:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-01-25T15:05:19.068 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 18291, 2024-01-25T15:05:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 5544269, 2024-01-25T15:05:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_bytes": { 2024-01-25T15:05:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 104857600, 2024-01-25T15:05:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-01-25T15:05:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-01-25T15:05:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:19.069 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 2218, 2024-01-25T15:05:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 5602104, 2024-01-25T15:05:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 2218, 2024-01-25T15:05:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 5602104, 2024-01-25T15:05:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-objecter_ops": { 2024-01-25T15:05:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 1024, 2024-01-25T15:05:19.070 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 0, 2024-01-25T15:05:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 0, 2024-01-25T15:05:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 0, 2024-01-25T15:05:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 2218, 2024-01-25T15:05:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 2218, 2024-01-25T15:05:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 2218, 2024-01-25T15:05:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 2218, 2024-01-25T15:05:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:19.071 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle": { 2024-01-25T15:05:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-01-25T15:05:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 583, 2024-01-25T15:05:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 58883, 2024-01-25T15:05:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 583, 2024-01-25T15:05:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-01-25T15:05:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-01-25T15:05:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 106, 2024-01-25T15:05:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 58883, 2024-01-25T15:05:19.072 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: }, 2024-01-25T15:05:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "throttle-write_buf_throttle-0x5612722206e0": { 2024-01-25T15:05:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "val": 0, 2024-01-25T15:05:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "max": 3758096384, 2024-01-25T15:05:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "get_started": 0, 2024-01-25T15:05:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "get": 2698, 2024-01-25T15:05:19.073 INFO:teuthology.orchestra.run.smithi191.stdout: "get_sum": 5406176, 2024-01-25T15:05:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_fail": 0, 2024-01-25T15:05:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "get_or_fail_success": 2698, 2024-01-25T15:05:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "take": 0, 2024-01-25T15:05:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "take_sum": 0, 2024-01-25T15:05:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "put": 839, 2024-01-25T15:05:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "put_sum": 5406176, 2024-01-25T15:05:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "wait": { 2024-01-25T15:05:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "avgcount": 0, 2024-01-25T15:05:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "sum": 0.000000000, 2024-01-25T15:05:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: "avgtime": 0.000000000 2024-01-25T15:05:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:19.074 INFO:teuthology.orchestra.run.smithi191.stdout: } 2024-01-25T15:05:19.074 INFO:teuthology.orchestra.run.smithi191.stdout:} 2024-01-25T15:05:19.373 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:19 smithi170 ceph-mon[31899]: pgmap v448: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-25T15:05:19.483 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:19 smithi191 ceph-mon[36347]: pgmap v448: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-25T15:05:19.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:19 smithi186 ceph-mon[35697]: pgmap v448: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-01-25T15:05:19.802 INFO:tasks.check_counter:Daemon mds.l mds.exported=47 2024-01-25T15:05:19.803 INFO:tasks.check_counter:Daemon mds.l mds.imported=56 2024-01-25T15:05:19.803 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-01-25T15:05:19.813 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-25T15:05:19.813 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T15:05:19.813 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:19.830 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T15:05:19.830 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:19.886 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:20.033 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.030+0000 7f18a4f0f640 1 -- 172.21.15.170:0/2020103405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18a00ffc10 msgr2=0x7f18a0100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.030+0000 7f18a4f0f640 1 --2- 172.21.15.170:0/2020103405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18a00ffc10 0x7f18a0100030 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f1890009900 tx=0x7f189002bc30 comp rx=0 tx=0).stop 2024-01-25T15:05:20.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.030+0000 7f18a4f0f640 1 -- 172.21.15.170:0/2020103405 shutdown_connections 2024-01-25T15:05:20.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.031+0000 7f18a4f0f640 1 --2- 172.21.15.170:0/2020103405 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18a0100e00 0x7f18a0101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.031+0000 7f18a4f0f640 1 --2- 172.21.15.170:0/2020103405 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18a01017c0 0x7f18a0108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.031+0000 7f18a4f0f640 1 --2- 172.21.15.170:0/2020103405 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18a00ffc10 0x7f18a0100030 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.031+0000 7f18a4f0f640 1 -- 172.21.15.170:0/2020103405 >> 172.21.15.170:0/2020103405 conn(0x7f18a00fb180 msgr2=0x7f18a00fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:20.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.031+0000 7f18a4f0f640 1 -- 172.21.15.170:0/2020103405 shutdown_connections 2024-01-25T15:05:20.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.031+0000 7f18a4f0f640 1 -- 172.21.15.170:0/2020103405 wait complete. 2024-01-25T15:05:20.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.031+0000 7f18a4f0f640 1 Processor -- start 2024-01-25T15:05:20.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.031+0000 7f18a4f0f640 1 -- start start 2024-01-25T15:05:20.034 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.031+0000 7f18a4f0f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18a00ffc10 0x7f18a00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.031+0000 7f18a4f0f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18a0100e00 0x7f18a019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.031+0000 7f18a4f0f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18a01017c0 0x7f18a019dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.031+0000 7f18a4f0f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a019e7d0 con 0x7f18a01017c0 2024-01-25T15:05:20.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.031+0000 7f18a4f0f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a019e940 con 0x7f18a0100e00 2024-01-25T15:05:20.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.031+0000 7f18a4f0f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a019eb00 con 0x7f18a00ffc10 2024-01-25T15:05:20.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f189ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18a01017c0 0x7f18a019dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f189e59c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18a00ffc10 0x7f18a00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f189ed9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18a01017c0 0x7f18a019dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55398/0 (socket says 172.21.15.170:55398) 2024-01-25T15:05:20.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f189e59c640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18a00ffc10 0x7f18a00689c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.191:3300/0 says I am v2:172.21.15.170:41296/0 (socket says 172.21.15.170:41296) 2024-01-25T15:05:20.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f189ed9d640 1 -- 172.21.15.170:0/4011990949 learned_addr learned my addr 172.21.15.170:0/4011990949 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:05:20.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f189dd9b640 1 --2- 172.21.15.170:0/4011990949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18a0100e00 0x7f18a019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f189ed9d640 1 -- 172.21.15.170:0/4011990949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18a00ffc10 msgr2=0x7f18a00689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f189ed9d640 1 --2- 172.21.15.170:0/4011990949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18a00ffc10 0x7f18a00689c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f189ed9d640 1 -- 172.21.15.170:0/4011990949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18a0100e00 msgr2=0x7f18a019b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.035 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f189ed9d640 1 --2- 172.21.15.170:0/4011990949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18a0100e00 0x7f18a019b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f189ed9d640 1 -- 172.21.15.170:0/4011990949 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1890009560 con 0x7f18a01017c0 2024-01-25T15:05:20.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f189e59c640 1 --2- 172.21.15.170:0/4011990949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18a00ffc10 0x7f18a00689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:20.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f189ed9d640 1 --2- 172.21.15.170:0/4011990949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18a01017c0 0x7f18a019dff0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f189800eb10 tx=0x7f189800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:20.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f188f7fe640 1 -- 172.21.15.170:0/4011990949 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898004b20 con 0x7f18a01017c0 2024-01-25T15:05:20.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f188f7fe640 1 -- 172.21.15.170:0/4011990949 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1898004c80 con 0x7f18a01017c0 2024-01-25T15:05:20.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f18a4f0f640 1 -- 172.21.15.170:0/4011990949 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a019ed80 con 0x7f18a01017c0 2024-01-25T15:05:20.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f188f7fe640 1 -- 172.21.15.170:0/4011990949 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898010690 con 0x7f18a01017c0 2024-01-25T15:05:20.036 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.032+0000 7f18a4f0f640 1 -- 172.21.15.170:0/4011990949 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a019f230 con 0x7f18a01017c0 2024-01-25T15:05:20.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.033+0000 7f18a4f0f640 1 -- 172.21.15.170:0/4011990949 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a0106f50 con 0x7f18a01017c0 2024-01-25T15:05:20.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.034+0000 7f188f7fe640 1 -- 172.21.15.170:0/4011990949 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f1898004fd0 con 0x7f18a01017c0 2024-01-25T15:05:20.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.035+0000 7f188f7fe640 1 --2- 172.21.15.170:0/4011990949 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f18880a12e0 0x7f18880a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.035+0000 7f188f7fe640 1 -- 172.21.15.170:0/4011990949 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f1898014070 con 0x7f18a01017c0 2024-01-25T15:05:20.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.035+0000 7f189e59c640 1 --2- 172.21.15.170:0/4011990949 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f18880a12e0 0x7f18880a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.037 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.036+0000 7f189e59c640 1 --2- 172.21.15.170:0/4011990949 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f18880a12e0 0x7f18880a37a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1890000c00 tx=0x7f189002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:20.039 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.039+0000 7f188f7fe640 1 -- 172.21.15.170:0/4011990949 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f1898096790 con 0x7f18a01017c0 2024-01-25T15:05:20.215 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.214+0000 7f18a4f0f640 1 -- 172.21.15.170:0/4011990949 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18a010b720 con 0x7f18a01017c0 2024-01-25T15:05:20.216 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.215+0000 7f188f7fe640 1 -- 172.21.15.170:0/4011990949 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22550 (secure 0 0 0) 0x7f1898099db0 con 0x7f18a01017c0 2024-01-25T15:05:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:05:20.217 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":87,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T15:00:57.274280+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:20.218 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.217+0000 7f18a4f0f640 1 -- 172.21.15.170:0/4011990949 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f18880a12e0 msgr2=0x7f18880a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.217+0000 7f18a4f0f640 1 --2- 172.21.15.170:0/4011990949 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f18880a12e0 0x7f18880a37a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1890000c00 tx=0x7f189002c5d0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.217+0000 7f18a4f0f640 1 -- 172.21.15.170:0/4011990949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18a01017c0 msgr2=0x7f18a019dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.217+0000 7f18a4f0f640 1 --2- 172.21.15.170:0/4011990949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18a01017c0 0x7f18a019dff0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f189800eb10 tx=0x7f189800c2d0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.218+0000 7f18a4f0f640 1 -- 172.21.15.170:0/4011990949 shutdown_connections 2024-01-25T15:05:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.218+0000 7f18a4f0f640 1 --2- 172.21.15.170:0/4011990949 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f18880a12e0 0x7f18880a37a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.218+0000 7f18a4f0f640 1 --2- 172.21.15.170:0/4011990949 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18a0100e00 0x7f18a019b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.218+0000 7f18a4f0f640 1 --2- 172.21.15.170:0/4011990949 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f18a01017c0 0x7f18a019dff0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.218+0000 7f18a4f0f640 1 --2- 172.21.15.170:0/4011990949 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f18a00ffc10 0x7f18a00689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.218+0000 7f18a4f0f640 1 -- 172.21.15.170:0/4011990949 >> 172.21.15.170:0/4011990949 conn(0x7f18a00fb180 msgr2=0x7f18a0104120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.218+0000 7f18a4f0f640 1 -- 172.21.15.170:0/4011990949 shutdown_connections 2024-01-25T15:05:20.219 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.218+0000 7f18a4f0f640 1 -- 172.21.15.170:0/4011990949 wait complete. 2024-01-25T15:05:20.230 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-25T14:55:22.432727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-25T14:59:51.465304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-25T14:59:52.749298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-25T15:05:20.230 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-25T15:05:20.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 -- 172.21.15.170:0/2000741545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd6c1040a0 msgr2=0x7fdd6c106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 --2- 172.21.15.170:0/2000741545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd6c1040a0 0x7fdd6c106490 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009900 tx=0x7fdd5c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:05:20.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 -- 172.21.15.170:0/2000741545 shutdown_connections 2024-01-25T15:05:20.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 --2- 172.21.15.170:0/2000741545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd6c1069d0 0x7fdd6c108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 --2- 172.21.15.170:0/2000741545 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd6c1040a0 0x7fdd6c106490 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 --2- 172.21.15.170:0/2000741545 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd6c101770 0x7fdd6c103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 -- 172.21.15.170:0/2000741545 >> 172.21.15.170:0/2000741545 conn(0x7fdd6c0fb180 msgr2=0x7fdd6c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:20.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 -- 172.21.15.170:0/2000741545 shutdown_connections 2024-01-25T15:05:20.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 -- 172.21.15.170:0/2000741545 wait complete. 2024-01-25T15:05:20.338 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 Processor -- start 2024-01-25T15:05:20.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 -- start start 2024-01-25T15:05:20.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd6c101770 0x7fdd6c196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd6c1040a0 0x7fdd6c1972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd6c1069d0 0x7fdd6c19e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c19e7f0 con 0x7fdd6c101770 2024-01-25T15:05:20.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c19e960 con 0x7fdd6c1069d0 2024-01-25T15:05:20.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd743f5640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6c19eb20 con 0x7fdd6c1040a0 2024-01-25T15:05:20.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd72191640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd6c101770 0x7fdd6c196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd72191640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd6c101770 0x7fdd6c196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55424/0 (socket says 172.21.15.170:55424) 2024-01-25T15:05:20.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.335+0000 7fdd72191640 1 -- 172.21.15.170:0/3112726690 learned_addr learned my addr 172.21.15.170:0/3112726690 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:05:20.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.336+0000 7fdd71990640 1 --2- 172.21.15.170:0/3112726690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd6c1040a0 0x7fdd6c1972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.336+0000 7fdd72992640 1 --2- 172.21.15.170:0/3112726690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd6c1069d0 0x7fdd6c19e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.336+0000 7fdd72191640 1 -- 172.21.15.170:0/3112726690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd6c1040a0 msgr2=0x7fdd6c1972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.339 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.336+0000 7fdd72191640 1 --2- 172.21.15.170:0/3112726690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd6c1040a0 0x7fdd6c1972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.336+0000 7fdd72191640 1 -- 172.21.15.170:0/3112726690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd6c1069d0 msgr2=0x7fdd6c19e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.336+0000 7fdd72191640 1 --2- 172.21.15.170:0/3112726690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd6c1069d0 0x7fdd6c19e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.336+0000 7fdd72191640 1 -- 172.21.15.170:0/3112726690 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c009560 con 0x7fdd6c101770 2024-01-25T15:05:20.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.336+0000 7fdd71990640 1 --2- 172.21.15.170:0/3112726690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd6c1040a0 0x7fdd6c1972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:20.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.336+0000 7fdd72191640 1 --2- 172.21.15.170:0/3112726690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd6c101770 0x7fdd6c196d60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800d950 tx=0x7fdd6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:20.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.336+0000 7fdd637fe640 1 -- 172.21.15.170:0/3112726690 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68009c30 con 0x7fdd6c101770 2024-01-25T15:05:20.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.336+0000 7fdd637fe640 1 -- 172.21.15.170:0/3112726690 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd68009d90 con 0x7fdd6c101770 2024-01-25T15:05:20.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.336+0000 7fdd743f5640 1 -- 172.21.15.170:0/3112726690 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd6c19ee00 con 0x7fdd6c101770 2024-01-25T15:05:20.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.336+0000 7fdd637fe640 1 -- 172.21.15.170:0/3112726690 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6800f740 con 0x7fdd6c101770 2024-01-25T15:05:20.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.336+0000 7fdd743f5640 1 -- 172.21.15.170:0/3112726690 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd6c19f220 con 0x7fdd6c101770 2024-01-25T15:05:20.340 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.337+0000 7fdd743f5640 1 -- 172.21.15.170:0/3112726690 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd6c0fcc70 con 0x7fdd6c101770 2024-01-25T15:05:20.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.338+0000 7fdd637fe640 1 -- 172.21.15.170:0/3112726690 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fdd68010a20 con 0x7fdd6c101770 2024-01-25T15:05:20.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.338+0000 7fdd637fe640 1 --2- 172.21.15.170:0/3112726690 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdd580a12e0 0x7fdd580a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.339+0000 7fdd637fe640 1 -- 172.21.15.170:0/3112726690 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fdd680cc840 con 0x7fdd6c101770 2024-01-25T15:05:20.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.339+0000 7fdd71990640 1 --2- 172.21.15.170:0/3112726690 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdd580a12e0 0x7fdd580a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.341 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.339+0000 7fdd71990640 1 --2- 172.21.15.170:0/3112726690 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdd580a12e0 0x7fdd580a37a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c02c6b0 tx=0x7fdd5c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:20.343 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.342+0000 7fdd637fe640 1 -- 172.21.15.170:0/3112726690 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fdd68095c60 con 0x7fdd6c101770 2024-01-25T15:05:20.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.517+0000 7fdd743f5640 1 -- 172.21.15.170:0/3112726690 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdd6c10c800 con 0x7fdd6c101770 2024-01-25T15:05:20.518 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.518+0000 7fdd637fe640 1 -- 172.21.15.170:0/3112726690 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdd680200a0 con 0x7fdd6c101770 2024-01-25T15:05:20.518 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 1 2024-01-25T15:05:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.520+0000 7fdd743f5640 1 -- 172.21.15.170:0/3112726690 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdd580a12e0 msgr2=0x7fdd580a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.520+0000 7fdd743f5640 1 --2- 172.21.15.170:0/3112726690 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdd580a12e0 0x7fdd580a37a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c02c6b0 tx=0x7fdd5c005fd0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.520+0000 7fdd743f5640 1 -- 172.21.15.170:0/3112726690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd6c101770 msgr2=0x7fdd6c196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.520+0000 7fdd743f5640 1 --2- 172.21.15.170:0/3112726690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd6c101770 0x7fdd6c196d60 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800d950 tx=0x7fdd6800de10 comp rx=0 tx=0).stop 2024-01-25T15:05:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.520+0000 7fdd743f5640 1 -- 172.21.15.170:0/3112726690 shutdown_connections 2024-01-25T15:05:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.520+0000 7fdd743f5640 1 --2- 172.21.15.170:0/3112726690 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fdd580a12e0 0x7fdd580a37a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.520+0000 7fdd743f5640 1 --2- 172.21.15.170:0/3112726690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdd6c1069d0 0x7fdd6c19e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.520+0000 7fdd743f5640 1 --2- 172.21.15.170:0/3112726690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fdd6c1040a0 0x7fdd6c1972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.520+0000 7fdd743f5640 1 --2- 172.21.15.170:0/3112726690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fdd6c101770 0x7fdd6c196d60 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.520+0000 7fdd743f5640 1 -- 172.21.15.170:0/3112726690 >> 172.21.15.170:0/3112726690 conn(0x7fdd6c0fb180 msgr2=0x7fdd6c1035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:20.521 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.520+0000 7fdd743f5640 1 -- 172.21.15.170:0/3112726690 shutdown_connections 2024-01-25T15:05:20.522 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.520+0000 7fdd743f5640 1 -- 172.21.15.170:0/3112726690 wait complete. 2024-01-25T15:05:20.530 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:20 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/4011990949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:05:20.531 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-25T15:05:20.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:20 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/4011990949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:05:20.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.636+0000 7f6cc7490640 1 -- 172.21.15.170:0/1549871495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cc0101770 msgr2=0x7f6cc0103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.639 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.636+0000 7f6cc7490640 1 --2- 172.21.15.170:0/1549871495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cc0101770 0x7f6cc0103b60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0009ca0 tx=0x7f6cb002c0f0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.636+0000 7f6cc7490640 1 -- 172.21.15.170:0/1549871495 shutdown_connections 2024-01-25T15:05:20.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.636+0000 7f6cc7490640 1 --2- 172.21.15.170:0/1549871495 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cc01069d0 0x7f6cc0108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.636+0000 7f6cc7490640 1 --2- 172.21.15.170:0/1549871495 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cc01040a0 0x7f6cc0106490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.636+0000 7f6cc7490640 1 --2- 172.21.15.170:0/1549871495 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cc0101770 0x7f6cc0103b60 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.636+0000 7f6cc7490640 1 -- 172.21.15.170:0/1549871495 >> 172.21.15.170:0/1549871495 conn(0x7f6cc00fb180 msgr2=0x7f6cc00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:20.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.637+0000 7f6cc7490640 1 -- 172.21.15.170:0/1549871495 shutdown_connections 2024-01-25T15:05:20.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.637+0000 7f6cc7490640 1 -- 172.21.15.170:0/1549871495 wait complete. 2024-01-25T15:05:20.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.637+0000 7f6cc7490640 1 Processor -- start 2024-01-25T15:05:20.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.637+0000 7f6cc7490640 1 -- start start 2024-01-25T15:05:20.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.637+0000 7f6cc7490640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cc0101770 0x7f6cc0196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.637+0000 7f6cc7490640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cc01040a0 0x7f6cc0197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.640 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.637+0000 7f6cc7490640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cc01069d0 0x7f6cc019e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.637+0000 7f6cc7490640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc019e810 con 0x7f6cc01069d0 2024-01-25T15:05:20.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.637+0000 7f6cc7490640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc019e980 con 0x7f6cc0101770 2024-01-25T15:05:20.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.637+0000 7f6cc7490640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc019eb40 con 0x7f6cc01040a0 2024-01-25T15:05:20.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.637+0000 7f6cc5a2d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cc01069d0 0x7f6cc019e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.637+0000 7f6cc5a2d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cc01069d0 0x7f6cc019e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55434/0 (socket says 172.21.15.170:55434) 2024-01-25T15:05:20.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.637+0000 7f6cc5a2d640 1 -- 172.21.15.170:0/1780612247 learned_addr learned my addr 172.21.15.170:0/1780612247 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:05:20.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.637+0000 7f6cc4a2b640 1 --2- 172.21.15.170:0/1780612247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cc01040a0 0x7f6cc0197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.637+0000 7f6cc522c640 1 --2- 172.21.15.170:0/1780612247 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cc0101770 0x7f6cc0196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.638+0000 7f6cc5a2d640 1 -- 172.21.15.170:0/1780612247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cc01040a0 msgr2=0x7f6cc0197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.638+0000 7f6cc5a2d640 1 --2- 172.21.15.170:0/1780612247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cc01040a0 0x7f6cc0197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.638+0000 7f6cc5a2d640 1 -- 172.21.15.170:0/1780612247 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cc0101770 msgr2=0x7f6cc0196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.638+0000 7f6cc5a2d640 1 --2- 172.21.15.170:0/1780612247 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cc0101770 0x7f6cc0196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.641 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.638+0000 7f6cc5a2d640 1 -- 172.21.15.170:0/1780612247 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb0009900 con 0x7f6cc01069d0 2024-01-25T15:05:20.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.638+0000 7f6cc5a2d640 1 --2- 172.21.15.170:0/1780612247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cc01069d0 0x7f6cc019e2a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800e970 tx=0x7f6cb800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:20.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.638+0000 7f6cbe7fc640 1 -- 172.21.15.170:0/1780612247 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8009720 con 0x7f6cc01069d0 2024-01-25T15:05:20.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.638+0000 7f6cbe7fc640 1 -- 172.21.15.170:0/1780612247 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6cb80054e0 con 0x7f6cc01069d0 2024-01-25T15:05:20.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.638+0000 7f6cbe7fc640 1 -- 172.21.15.170:0/1780612247 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8010430 con 0x7f6cc01069d0 2024-01-25T15:05:20.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.638+0000 7f6cc7490640 1 -- 172.21.15.170:0/1780612247 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc019ee20 con 0x7f6cc01069d0 2024-01-25T15:05:20.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.638+0000 7f6cc7490640 1 -- 172.21.15.170:0/1780612247 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc019f1f0 con 0x7f6cc01069d0 2024-01-25T15:05:20.642 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.639+0000 7f6cc7490640 1 -- 172.21.15.170:0/1780612247 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc00fcc70 con 0x7f6cc01069d0 2024-01-25T15:05:20.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.640+0000 7f6cbe7fc640 1 -- 172.21.15.170:0/1780612247 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f6cb800ccc0 con 0x7f6cc01069d0 2024-01-25T15:05:20.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.640+0000 7f6cbe7fc640 1 --2- 172.21.15.170:0/1780612247 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6ca80a12e0 0x7f6ca80a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.641+0000 7f6cc522c640 1 --2- 172.21.15.170:0/1780612247 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6ca80a12e0 0x7f6ca80a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.643 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.641+0000 7f6cbe7fc640 1 -- 172.21.15.170:0/1780612247 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f6cb8014070 con 0x7f6cc01069d0 2024-01-25T15:05:20.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.641+0000 7f6cc522c640 1 --2- 172.21.15.170:0/1780612247 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6ca80a12e0 0x7f6ca80a37a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6cb002c700 tx=0x7f6cb0032690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:20.644 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.644+0000 7f6cbe7fc640 1 -- 172.21.15.170:0/1780612247 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f6cb8096550 con 0x7f6cc01069d0 2024-01-25T15:05:20.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:20 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/4011990949' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:05:20.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.816+0000 7f6cc7490640 1 -- 172.21.15.170:0/1780612247 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6cc010c5b0 con 0x7f6cc01069d0 2024-01-25T15:05:20.817 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.816+0000 7f6cbe7fc640 1 -- 172.21.15.170:0/1780612247 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6cb8098480 con 0x7f6cc01069d0 2024-01-25T15:05:20.817 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 32 2024-01-25T15:05:20.819 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.818+0000 7f6cc7490640 1 -- 172.21.15.170:0/1780612247 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6ca80a12e0 msgr2=0x7f6ca80a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.818+0000 7f6cc7490640 1 --2- 172.21.15.170:0/1780612247 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6ca80a12e0 0x7f6ca80a37a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6cb002c700 tx=0x7f6cb0032690 comp rx=0 tx=0).stop 2024-01-25T15:05:20.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.818+0000 7f6cc7490640 1 -- 172.21.15.170:0/1780612247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cc01069d0 msgr2=0x7f6cc019e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.818+0000 7f6cc7490640 1 --2- 172.21.15.170:0/1780612247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cc01069d0 0x7f6cc019e2a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f6cb800e970 tx=0x7f6cb800ed70 comp rx=0 tx=0).stop 2024-01-25T15:05:20.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.819+0000 7f6cc7490640 1 -- 172.21.15.170:0/1780612247 shutdown_connections 2024-01-25T15:05:20.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.819+0000 7f6cc7490640 1 --2- 172.21.15.170:0/1780612247 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f6ca80a12e0 0x7f6ca80a37a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.819+0000 7f6cc7490640 1 --2- 172.21.15.170:0/1780612247 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6cc01069d0 0x7f6cc019e2a0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.819+0000 7f6cc7490640 1 --2- 172.21.15.170:0/1780612247 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6cc01040a0 0x7f6cc0197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.819+0000 7f6cc7490640 1 --2- 172.21.15.170:0/1780612247 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6cc0101770 0x7f6cc0196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.819+0000 7f6cc7490640 1 -- 172.21.15.170:0/1780612247 >> 172.21.15.170:0/1780612247 conn(0x7f6cc00fb180 msgr2=0x7f6cc01021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:20.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.819+0000 7f6cc7490640 1 -- 172.21.15.170:0/1780612247 shutdown_connections 2024-01-25T15:05:20.820 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.819+0000 7f6cc7490640 1 -- 172.21.15.170:0/1780612247 wait complete. 2024-01-25T15:05:20.830 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-25T15:05:20.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.934+0000 7f656cd8b640 1 -- 172.21.15.170:0/412479917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65681069e0 msgr2=0x7f6568108e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.934+0000 7f656cd8b640 1 --2- 172.21.15.170:0/412479917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65681069e0 0x7f6568108e30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6560009ca0 tx=0x7f656002c0f0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.934+0000 7f656cd8b640 1 -- 172.21.15.170:0/412479917 shutdown_connections 2024-01-25T15:05:20.937 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.934+0000 7f656cd8b640 1 --2- 172.21.15.170:0/412479917 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65681040b0 0x7f65681064a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.934+0000 7f656cd8b640 1 --2- 172.21.15.170:0/412479917 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f65681069e0 0x7f6568108e30 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.934+0000 7f656cd8b640 1 --2- 172.21.15.170:0/412479917 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f6568101780 0x7f6568103b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.934+0000 7f656cd8b640 1 -- 172.21.15.170:0/412479917 >> 172.21.15.170:0/412479917 conn(0x7f65680fb190 msgr2=0x7f65680fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:20.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.934+0000 7f656cd8b640 1 -- 172.21.15.170:0/412479917 shutdown_connections 2024-01-25T15:05:20.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.934+0000 7f656cd8b640 1 -- 172.21.15.170:0/412479917 wait complete. 2024-01-25T15:05:20.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656cd8b640 1 Processor -- start 2024-01-25T15:05:20.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656cd8b640 1 -- start start 2024-01-25T15:05:20.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656cd8b640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6568101780 0x7f6568196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656cd8b640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65681040b0 0x7f65681971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656cd8b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65681069e0 0x7f656819e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656cd8b640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656819e740 con 0x7f6568101780 2024-01-25T15:05:20.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656cd8b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656819e8b0 con 0x7f65681069e0 2024-01-25T15:05:20.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656cd8b640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656819ea70 con 0x7f65681040b0 2024-01-25T15:05:20.938 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6568101780 0x7f6568196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656659c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6568101780 0x7f6568196c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55462/0 (socket says 172.21.15.170:55462) 2024-01-25T15:05:20.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656659c640 1 -- 172.21.15.170:0/680644086 learned_addr learned my addr 172.21.15.170:0/680644086 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:05:20.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f6566d9d640 1 --2- 172.21.15.170:0/680644086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65681069e0 0x7f656819e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f6565d9b640 1 --2- 172.21.15.170:0/680644086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65681040b0 0x7f65681971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656659c640 1 -- 172.21.15.170:0/680644086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65681040b0 msgr2=0x7f65681971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656659c640 1 --2- 172.21.15.170:0/680644086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65681040b0 0x7f65681971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656659c640 1 -- 172.21.15.170:0/680644086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65681069e0 msgr2=0x7f656819e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:20.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656659c640 1 --2- 172.21.15.170:0/680644086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65681069e0 0x7f656819e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:20.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656659c640 1 -- 172.21.15.170:0/680644086 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6560009900 con 0x7f6568101780 2024-01-25T15:05:20.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f6565d9b640 1 --2- 172.21.15.170:0/680644086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65681040b0 0x7f65681971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:20.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f656659c640 1 --2- 172.21.15.170:0/680644086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6568101780 0x7f6568196c60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f655800c920 tx=0x7f655800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:20.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.935+0000 7f65577fe640 1 -- 172.21.15.170:0/680644086 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558007c70 con 0x7f6568101780 2024-01-25T15:05:20.939 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.936+0000 7f656cd8b640 1 -- 172.21.15.170:0/680644086 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656819ed50 con 0x7f6568101780 2024-01-25T15:05:20.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.936+0000 7f65577fe640 1 -- 172.21.15.170:0/680644086 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6558007dd0 con 0x7f6568101780 2024-01-25T15:05:20.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.936+0000 7f65577fe640 1 -- 172.21.15.170:0/680644086 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65580187c0 con 0x7f6568101780 2024-01-25T15:05:20.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.936+0000 7f656cd8b640 1 -- 172.21.15.170:0/680644086 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656819f1f0 con 0x7f6568101780 2024-01-25T15:05:20.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.937+0000 7f656cd8b640 1 -- 172.21.15.170:0/680644086 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65680fcc80 con 0x7f6568101780 2024-01-25T15:05:20.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.937+0000 7f65577fe640 1 -- 172.21.15.170:0/680644086 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f655800f450 con 0x7f6568101780 2024-01-25T15:05:20.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.938+0000 7f65577fe640 1 --2- 172.21.15.170:0/680644086 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65500a12e0 0x7f65500a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:20.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.938+0000 7f6565d9b640 1 --2- 172.21.15.170:0/680644086 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65500a12e0 0x7f65500a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:20.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.938+0000 7f65577fe640 1 -- 172.21.15.170:0/680644086 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f65580ccdc0 con 0x7f6568101780 2024-01-25T15:05:20.941 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.938+0000 7f6565d9b640 1 --2- 172.21.15.170:0/680644086 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65500a12e0 0x7f65500a37a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f655c005d00 tx=0x7f655c009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:20.943 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:20.942+0000 7f65577fe640 1 -- 172.21.15.170:0/680644086 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f65580961e0 con 0x7f6568101780 2024-01-25T15:05:21.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.113+0000 7f656cd8b640 1 -- 172.21.15.170:0/680644086 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f656810c5c0 con 0x7f6568101780 2024-01-25T15:05:21.115 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.113+0000 7f65577fe640 1 -- 172.21.15.170:0/680644086 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6558098110 con 0x7f6568101780 2024-01-25T15:05:21.116 INFO:teuthology.orchestra.run.smithi170.stdout:pg_num: 64 2024-01-25T15:05:21.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.115+0000 7f656cd8b640 1 -- 172.21.15.170:0/680644086 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65500a12e0 msgr2=0x7f65500a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.115+0000 7f656cd8b640 1 --2- 172.21.15.170:0/680644086 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65500a12e0 0x7f65500a37a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f655c005d00 tx=0x7f655c009550 comp rx=0 tx=0).stop 2024-01-25T15:05:21.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.115+0000 7f656cd8b640 1 -- 172.21.15.170:0/680644086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6568101780 msgr2=0x7f6568196c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.115+0000 7f656cd8b640 1 --2- 172.21.15.170:0/680644086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6568101780 0x7f6568196c60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f655800c920 tx=0x7f655800cde0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.116+0000 7f656cd8b640 1 -- 172.21.15.170:0/680644086 shutdown_connections 2024-01-25T15:05:21.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.116+0000 7f656cd8b640 1 --2- 172.21.15.170:0/680644086 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f65500a12e0 0x7f65500a37a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.116+0000 7f656cd8b640 1 --2- 172.21.15.170:0/680644086 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65681069e0 0x7f656819e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.116+0000 7f656cd8b640 1 --2- 172.21.15.170:0/680644086 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f65681040b0 0x7f65681971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.116+0000 7f656cd8b640 1 --2- 172.21.15.170:0/680644086 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f6568101780 0x7f6568196c60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.117 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.116+0000 7f656cd8b640 1 -- 172.21.15.170:0/680644086 >> 172.21.15.170:0/680644086 conn(0x7f65680fb190 msgr2=0x7f65681020c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:21.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.116+0000 7f656cd8b640 1 -- 172.21.15.170:0/680644086 shutdown_connections 2024-01-25T15:05:21.118 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.116+0000 7f656cd8b640 1 -- 172.21.15.170:0/680644086 wait complete. 2024-01-25T15:05:21.128 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-25T15:05:21.235 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.232+0000 7fbd8610f640 1 -- 172.21.15.170:0/2884585775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd800ff390 msgr2=0x7fbd800ff7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.232+0000 7fbd8610f640 1 --2- 172.21.15.170:0/2884585775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd800ff390 0x7fbd800ff7b0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbd70009900 tx=0x7fbd7002bc30 comp rx=0 tx=0).stop 2024-01-25T15:05:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.232+0000 7fbd8610f640 1 -- 172.21.15.170:0/2884585775 shutdown_connections 2024-01-25T15:05:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.232+0000 7fbd8610f640 1 --2- 172.21.15.170:0/2884585775 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd80100f40 0x7fbd801077d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.232+0000 7fbd8610f640 1 --2- 172.21.15.170:0/2884585775 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd80100580 0x7fbd80100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.232+0000 7fbd8610f640 1 --2- 172.21.15.170:0/2884585775 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd800ff390 0x7fbd800ff7b0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.232+0000 7fbd8610f640 1 -- 172.21.15.170:0/2884585775 >> 172.21.15.170:0/2884585775 conn(0x7fbd800fa920 msgr2=0x7fbd800fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.232+0000 7fbd8610f640 1 -- 172.21.15.170:0/2884585775 shutdown_connections 2024-01-25T15:05:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.232+0000 7fbd8610f640 1 -- 172.21.15.170:0/2884585775 wait complete. 2024-01-25T15:05:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.233+0000 7fbd8610f640 1 Processor -- start 2024-01-25T15:05:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.233+0000 7fbd8610f640 1 -- start start 2024-01-25T15:05:21.236 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.233+0000 7fbd8610f640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd800ff390 0x7fbd80195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.233+0000 7fbd8610f640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd80100580 0x7fbd80196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.233+0000 7fbd8610f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd80100f40 0x7fbd8019d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.233+0000 7fbd8610f640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8019d720 con 0x7fbd80100580 2024-01-25T15:05:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.233+0000 7fbd8610f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8019d890 con 0x7fbd80100f40 2024-01-25T15:05:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.233+0000 7fbd8610f640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8019da50 con 0x7fbd800ff390 2024-01-25T15:05:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.233+0000 7fbd7effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd80100580 0x7fbd80196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.233+0000 7fbd7effd640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd80100580 0x7fbd80196180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55484/0 (socket says 172.21.15.170:55484) 2024-01-25T15:05:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.233+0000 7fbd7effd640 1 -- 172.21.15.170:0/3021238865 learned_addr learned my addr 172.21.15.170:0/3021238865 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:05:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.233+0000 7fbd7f7fe640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd800ff390 0x7fbd80195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.234+0000 7fbd7ffff640 1 --2- 172.21.15.170:0/3021238865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd80100f40 0x7fbd8019d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.234+0000 7fbd7effd640 1 -- 172.21.15.170:0/3021238865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd800ff390 msgr2=0x7fbd80195c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.234+0000 7fbd7effd640 1 --2- 172.21.15.170:0/3021238865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd800ff390 0x7fbd80195c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.237 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.234+0000 7fbd7effd640 1 -- 172.21.15.170:0/3021238865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd80100f40 msgr2=0x7fbd8019d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.234+0000 7fbd7effd640 1 --2- 172.21.15.170:0/3021238865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd80100f40 0x7fbd8019d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.234+0000 7fbd7effd640 1 -- 172.21.15.170:0/3021238865 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd70009560 con 0x7fbd80100580 2024-01-25T15:05:21.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.234+0000 7fbd7f7fe640 1 --2- 172.21.15.170:0/3021238865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd800ff390 0x7fbd80195c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-25T15:05:21.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.234+0000 7fbd7ffff640 1 --2- 172.21.15.170:0/3021238865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd80100f40 0x7fbd8019d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:21.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.234+0000 7fbd7effd640 1 --2- 172.21.15.170:0/3021238865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd80100580 0x7fbd80196180 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400e9f0 tx=0x7fbd7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:21.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.234+0000 7fbd7cff9640 1 -- 172.21.15.170:0/3021238865 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74009700 con 0x7fbd80100580 2024-01-25T15:05:21.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.234+0000 7fbd8610f640 1 -- 172.21.15.170:0/3021238865 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8019dd30 con 0x7fbd80100580 2024-01-25T15:05:21.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.234+0000 7fbd7cff9640 1 -- 172.21.15.170:0/3021238865 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd7400cd80 con 0x7fbd80100580 2024-01-25T15:05:21.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.234+0000 7fbd7cff9640 1 -- 172.21.15.170:0/3021238865 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74018860 con 0x7fbd80100580 2024-01-25T15:05:21.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.234+0000 7fbd8610f640 1 -- 172.21.15.170:0/3021238865 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8019e1b0 con 0x7fbd80100580 2024-01-25T15:05:21.238 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.235+0000 7fbd8610f640 1 -- 172.21.15.170:0/3021238865 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd80106f50 con 0x7fbd80100580 2024-01-25T15:05:21.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.236+0000 7fbd7cff9640 1 -- 172.21.15.170:0/3021238865 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fbd740189c0 con 0x7fbd80100580 2024-01-25T15:05:21.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.237+0000 7fbd7cff9640 1 --2- 172.21.15.170:0/3021238865 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fbd680a12e0 0x7fbd680a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:21.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.237+0000 7fbd7f7fe640 1 --2- 172.21.15.170:0/3021238865 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fbd680a12e0 0x7fbd680a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:21.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.237+0000 7fbd7cff9640 1 -- 172.21.15.170:0/3021238865 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fbd74014070 con 0x7fbd80100580 2024-01-25T15:05:21.239 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.237+0000 7fbd7f7fe640 1 --2- 172.21.15.170:0/3021238865 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fbd680a12e0 0x7fbd680a37a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbd70000c00 tx=0x7fbd7002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:21.241 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.240+0000 7fbd7cff9640 1 -- 172.21.15.170:0/3021238865 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fbd740967e0 con 0x7fbd80100580 2024-01-25T15:05:21.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.431+0000 7fbd8610f640 1 -- 172.21.15.170:0/3021238865 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbd8010ae00 con 0x7fbd80100580 2024-01-25T15:05:21.433 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.432+0000 7fbd7cff9640 1 -- 172.21.15.170:0/3021238865 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) v1 ==== 81+0+597 (secure 0 0 0) 0x7fbd74026270 con 0x7fbd80100580 2024-01-25T15:05:21.433 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/781425854 2024-01-26T14:52:56.092999+0000 2024-01-25T15:05:21.433 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6800/358194066 2024-01-26T14:52:56.092999+0000 2024-01-25T15:05:21.433 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6800/622367049 2024-01-26T14:52:29.612886+0000 2024-01-25T15:05:21.433 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/1314470118 2024-01-26T14:52:56.092999+0000 2024-01-25T15:05:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/3177304860 2024-01-26T14:52:29.612886+0000 2024-01-25T15:05:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/2154892792 2024-01-26T14:52:29.612886+0000 2024-01-25T15:05:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6801/622367049 2024-01-26T14:52:29.612886+0000 2024-01-25T15:05:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/3790162374 2024-01-26T14:52:29.612886+0000 2024-01-25T15:05:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:6801/358194066 2024-01-26T14:52:56.092999+0000 2024-01-25T15:05:21.434 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170:0/1116986212 2024-01-26T14:52:56.092999+0000 2024-01-25T15:05:21.435 INFO:teuthology.orchestra.run.smithi170.stderr:listed 10 entries 2024-01-25T15:05:21.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.434+0000 7fbd8610f640 1 -- 172.21.15.170:0/3021238865 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fbd680a12e0 msgr2=0x7fbd680a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.434+0000 7fbd8610f640 1 --2- 172.21.15.170:0/3021238865 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fbd680a12e0 0x7fbd680a37a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fbd70000c00 tx=0x7fbd7002c5d0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.434+0000 7fbd8610f640 1 -- 172.21.15.170:0/3021238865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd80100580 msgr2=0x7fbd80196180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:21.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.434+0000 7fbd8610f640 1 --2- 172.21.15.170:0/3021238865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd80100580 0x7fbd80196180 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400e9f0 tx=0x7fbd7400eeb0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.434+0000 7fbd8610f640 1 -- 172.21.15.170:0/3021238865 shutdown_connections 2024-01-25T15:05:21.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.434+0000 7fbd8610f640 1 --2- 172.21.15.170:0/3021238865 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fbd680a12e0 0x7fbd680a37a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.434+0000 7fbd8610f640 1 --2- 172.21.15.170:0/3021238865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbd80100f40 0x7fbd8019d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.434+0000 7fbd8610f640 1 --2- 172.21.15.170:0/3021238865 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fbd80100580 0x7fbd80196180 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.434+0000 7fbd8610f640 1 --2- 172.21.15.170:0/3021238865 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fbd800ff390 0x7fbd80195c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:21.435 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.434+0000 7fbd8610f640 1 -- 172.21.15.170:0/3021238865 >> 172.21.15.170:0/3021238865 conn(0x7fbd800fa920 msgr2=0x7fbd80101d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:21.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.434+0000 7fbd8610f640 1 -- 172.21.15.170:0/3021238865 shutdown_connections 2024-01-25T15:05:21.436 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:21.434+0000 7fbd8610f640 1 -- 172.21.15.170:0/3021238865 wait complete. 2024-01-25T15:05:21.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:21 smithi170 ceph-mon[31899]: pgmap v449: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-01-25T15:05:21.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:21 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3112726690' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:05:21.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:21 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1780612247' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:05:21.445 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:21 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/680644086' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:05:21.446 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-25T15:05:21.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:21.446 DEBUG:teuthology.orchestra.run.smithi170:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-25T15:05:21.534 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi170.front.sepia.ceph.com 2024-01-25T15:05:21.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:21.534 DEBUG:teuthology.orchestra.run.smithi170:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-25T15:05:21.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:21.582 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-01-25T15:05:21.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:21 smithi186 ceph-mon[35697]: pgmap v449: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-01-25T15:05:21.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:21 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3112726690' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:05:21.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:21 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1780612247' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:05:21.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:21 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/680644086' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:05:21.610 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-25T15:05:21.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:21.610 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-25T15:05:21.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:21.698 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2024-01-25T15:05:21.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:21 smithi191 ceph-mon[36347]: pgmap v449: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 11 op/s 2024-01-25T15:05:21.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:21 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3112726690' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-01-25T15:05:21.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:21 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1780612247' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-01-25T15:05:21.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:21 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/680644086' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-01-25T15:05:21.770 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-25T15:05:21.770 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-01-25T15:05:21.770 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-25T15:05:21.787 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056380,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18861 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/f70d7e920f3968c938ca9ce19e615dcef993e46cecb0af0b928f9e8685799dea/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/VRZZ3CFULJIB6S5GHSVFYE6DLN:/var/lib/containers/storage/overlay/l/GGNCPNAUQDZFGNZGOSMZKHV6RM,upperdir=/var/lib/containers/storage/overlay/f70d7e920f3968c938ca9ce19e615dcef993e46cecb0af0b928f9e8685799dea/diff,workdir=/var/lib/containers/storage/overlay/f70d7e920f3968c938ca9ce19e615dcef993e46cecb0af0b928f9e8685799dea/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/637d248ef7c6f9bf4b3ce2b2cd838924be3b62c316401ea58321330c7c767b50/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VRZZ3CFULJIB6S5GHSVFYE6DLN:/var/lib/containers/storage/overlay/l/GGNCPNAUQDZFGNZGOSMZKHV6RM,upperdir=/var/lib/containers/storage/overlay/637d248ef7c6f9bf4b3ce2b2cd838924be3b62c316401ea58321330c7c767b50/diff,workdir=/var/lib/containers/storage/overlay/637d248ef7c6f9bf4b3ce2b2cd838924be3b62c316401ea58321330c7c767b50/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/2c9e680fffc17ab3c7d2e868cb1561488932385d40cda045377e9ce9b9ae812c/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/VRZZ3CFULJIB6S5GHSVFYE6DLN:/var/lib/containers/storage/overlay/l/GGNCPNAUQDZFGNZGOSMZKHV6RM,upperdir=/var/lib/containers/storage/overlay/2c9e680fffc17ab3c7d2e868cb1561488932385d40cda045377e9ce9b9ae812c/diff,workdir=/var/lib/containers/storage/overlay/2c9e680fffc17ab3c7d2e868cb1561488932385d40cda045377e9ce9b9ae812c/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/1f01f8ad653a87c0e5186bfb7ff9c1fdf3a9f3e5db6dc98dd8c8a0f6861bd623/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/VRZZ3CFULJIB6S5GHSVFYE6DLN:/var/lib/containers/storage/overlay/l/GGNCPNAUQDZFGNZGOSMZKHV6RM,upperdir=/var/lib/containers/storage/overlay/1f01f8ad653a87c0e5186bfb7ff9c1fdf3a9f3e5db6dc98dd8c8a0f6861bd623/diff,workdir=/var/lib/containers/storage/overlay/1f01f8ad653a87c0e5186bfb7ff9c1fdf3a9f3e5db6dc98dd8c8a0f6861bd623/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/43a96c08a176e0890cec24caacb7143ee99374ed0a21770d290a4f8dfa347db5/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/VRZZ3CFULJIB6S5GHSVFYE6DLN:/var/lib/containers/storage/overlay/l/GGNCPNAUQDZFGNZGOSMZKHV6RM,upperdir=/var/lib/containers/storage/overlay/43a96c08a176e0890cec24caacb7143ee99374ed0a21770d290a4f8dfa347db5/diff,workdir=/var/lib/containers/storage/overlay/43a96c08a176e0890cec24caacb7143ee99374ed0a21770d290a4f8dfa347db5/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/5a50f26d8f34da9e6095691dd16ff7b88748352f24ffe56020f1a55d6c1fd1f6/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/VRZZ3CFULJIB6S5GHSVFYE6DLN:/var/lib/containers/storage/overlay/l/GGNCPNAUQDZFGNZGOSMZKHV6RM,upperdir=/var/lib/containers/storage/overlay/5a50f26d8f34da9e6095691dd16ff7b88748352f24ffe56020f1a55d6c1fd1f6/diff,workdir=/var/lib/containers/storage/overlay/5a50f26d8f34da9e6095691dd16ff7b88748352f24ffe56020f1a55d6c1fd1f6/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/30fec7d537fc6b8e7a3d434e53a2da6036d3a8fb797a39281f1f31459e70f482/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VRZZ3CFULJIB6S5GHSVFYE6DLN:/var/lib/containers/storage/overlay/l/GGNCPNAUQDZFGNZGOSMZKHV6RM,upperdir=/var/lib/containers/storage/overlay/30fec7d537fc6b8e7a3d434e53a2da6036d3a8fb797a39281f1f31459e70f482/diff,workdir=/var/lib/containers/storage/overlay/30fec7d537fc6b8e7a3d434e53a2da6036d3a8fb797a39281f1f31459e70f482/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/4089fb605cbb790688b19a713ea10634e3ac095ecac9f487a9e937b08c591d7d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VRZZ3CFULJIB6S5GHSVFYE6DLN:/var/lib/containers/storage/overlay/l/GGNCPNAUQDZFGNZGOSMZKHV6RM,upperdir=/var/lib/containers/storage/overlay/4089fb605cbb790688b19a713ea10634e3ac095ecac9f487a9e937b08c591d7d/diff,workdir=/var/lib/containers/storage/overlay/4089fb605cbb790688b19a713ea10634e3ac095ecac9f487a9e937b08c591d7d/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/6c1f690c19665e1377f2cd5968710b4db741283bd457550297b1be9ba5e0f07b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VRZZ3CFULJIB6S5GHSVFYE6DLN:/var/lib/containers/storage/overlay/l/GGNCPNAUQDZFGNZGOSMZKHV6RM,upperdir=/var/lib/containers/storage/overlay/6c1f690c19665e1377f2cd5968710b4db741283bd457550297b1be9ba5e0f07b/diff,workdir=/var/lib/containers/storage/overlay/6c1f690c19665e1377f2cd5968710b4db741283bd457550297b1be9ba5e0f07b/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/877c2780726bc3fd18d13ba1a5441bb4c9701f7638f6c4bbc1c95fdeb0b6a058/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VRZZ3CFULJIB6S5GHSVFYE6DLN:/var/lib/containers/storage/overlay/l/GGNCPNAUQDZFGNZGOSMZKHV6RM,upperdir=/var/lib/containers/storage/overlay/877c2780726bc3fd18d13ba1a5441bb4c9701f7638f6c4bbc1c95fdeb0b6a058/diff,workdir=/var/lib/containers/storage/overlay/877c2780726bc3fd18d13ba1a5441bb4c9701f7638f6c4bbc1c95fdeb0b6a058/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 2024-01-25T15:05:21.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:21.787 DEBUG:teuthology.orchestra.run.smithi170:> ip netns list 2024-01-25T15:05:21.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-25T15:05:21.843 DEBUG:teuthology.orchestra.run.smithi170:> sudo ip link delete ceph-brx 2024-01-25T15:05:21.911 INFO:teuthology.orchestra.run.smithi170.stderr:Cannot find device "ceph-brx" 2024-01-25T15:05:21.912 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T15:05:21.913 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-01-25T15:05:21.923 INFO:tasks.cephadm:Teardown begin 2024-01-25T15:05:21.923 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-25T15:05:21.923 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:05:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.055+0000 7f9ed9f9e640 1 -- 172.21.15.170:0/3672572892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ed41026e0 msgr2=0x7f9ed4108f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.055+0000 7f9ed9f9e640 1 --2- 172.21.15.170:0/3672572892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ed41026e0 0x7f9ed4108f70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc009ca0 tx=0x7f9ecc02c0f0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.055+0000 7f9ed9f9e640 1 -- 172.21.15.170:0/3672572892 shutdown_connections 2024-01-25T15:05:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.055+0000 7f9ed9f9e640 1 --2- 172.21.15.170:0/3672572892 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ed4101d20 0x7f9ed41021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.055+0000 7f9ed9f9e640 1 --2- 172.21.15.170:0/3672572892 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ed41026e0 0x7f9ed4108f70 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.055+0000 7f9ed9f9e640 1 --2- 172.21.15.170:0/3672572892 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ed4100b30 0x7f9ed4100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.055+0000 7f9ed9f9e640 1 -- 172.21.15.170:0/3672572892 >> 172.21.15.170:0/3672572892 conn(0x7f9ed40fc080 msgr2=0x7f9ed40fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:22.058 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.055+0000 7f9ed9f9e640 1 -- 172.21.15.170:0/3672572892 shutdown_connections 2024-01-25T15:05:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.055+0000 7f9ed9f9e640 1 -- 172.21.15.170:0/3672572892 wait complete. 2024-01-25T15:05:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed9f9e640 1 Processor -- start 2024-01-25T15:05:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed9f9e640 1 -- start start 2024-01-25T15:05:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed9f9e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ed4100b30 0x7f9ed4198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed9f9e640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ed4101d20 0x7f9ed41992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed9f9e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ed41026e0 0x7f9ed41a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed9f9e640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed41a0810 con 0x7f9ed4100b30 2024-01-25T15:05:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed9f9e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed41a0980 con 0x7f9ed41026e0 2024-01-25T15:05:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed9f9e640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed41a0b40 con 0x7f9ed4101d20 2024-01-25T15:05:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed8f9c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ed4100b30 0x7f9ed4198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed8f9c640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ed4100b30 0x7f9ed4198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55508/0 (socket says 172.21.15.170:55508) 2024-01-25T15:05:22.059 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed8f9c640 1 -- 172.21.15.170:0/2265955413 learned_addr learned my addr 172.21.15.170:0/2265955413 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:05:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed3fff640 1 --2- 172.21.15.170:0/2265955413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ed4101d20 0x7f9ed41992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed979d640 1 --2- 172.21.15.170:0/2265955413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ed41026e0 0x7f9ed41a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed8f9c640 1 -- 172.21.15.170:0/2265955413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ed4101d20 msgr2=0x7f9ed41992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed8f9c640 1 --2- 172.21.15.170:0/2265955413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ed4101d20 0x7f9ed41992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed8f9c640 1 -- 172.21.15.170:0/2265955413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ed41026e0 msgr2=0x7f9ed41a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed8f9c640 1 --2- 172.21.15.170:0/2265955413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ed41026e0 0x7f9ed41a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed8f9c640 1 -- 172.21.15.170:0/2265955413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc009900 con 0x7f9ed4100b30 2024-01-25T15:05:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed8f9c640 1 --2- 172.21.15.170:0/2265955413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ed4100b30 0x7f9ed4198d80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800e9c0 tx=0x7f9ec800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.056+0000 7f9ed1ffb640 1 -- 172.21.15.170:0/2265955413 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec80096e0 con 0x7f9ed4100b30 2024-01-25T15:05:22.060 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.057+0000 7f9ed9f9e640 1 -- 172.21.15.170:0/2265955413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed41a0e20 con 0x7f9ed4100b30 2024-01-25T15:05:22.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.057+0000 7f9ed1ffb640 1 -- 172.21.15.170:0/2265955413 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ec80044f0 con 0x7f9ed4100b30 2024-01-25T15:05:22.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.057+0000 7f9ed1ffb640 1 -- 172.21.15.170:0/2265955413 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8010430 con 0x7f9ed4100b30 2024-01-25T15:05:22.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.057+0000 7f9ed9f9e640 1 -- 172.21.15.170:0/2265955413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed41a11f0 con 0x7f9ed4100b30 2024-01-25T15:05:22.061 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.058+0000 7f9ed9f9e640 1 -- 172.21.15.170:0/2265955413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed410c3f0 con 0x7f9ed4100b30 2024-01-25T15:05:22.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.059+0000 7f9ed1ffb640 1 -- 172.21.15.170:0/2265955413 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f9ec80035f0 con 0x7f9ed4100b30 2024-01-25T15:05:22.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.059+0000 7f9ed1ffb640 1 --2- 172.21.15.170:0/2265955413 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9ec40a12e0 0x7f9ec40a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.059+0000 7f9ed3fff640 1 --2- 172.21.15.170:0/2265955413 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9ec40a12e0 0x7f9ec40a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.059+0000 7f9ed1ffb640 1 -- 172.21.15.170:0/2265955413 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f9ec8014070 con 0x7f9ed4100b30 2024-01-25T15:05:22.062 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.060+0000 7f9ed3fff640 1 --2- 172.21.15.170:0/2265955413 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9ec40a12e0 0x7f9ec40a37a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009bd0 tx=0x7f9ec0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:22.063 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.063+0000 7f9ed1ffb640 1 -- 172.21.15.170:0/2265955413 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f9ec80963e0 con 0x7f9ed4100b30 2024-01-25T15:05:22.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.278+0000 7f9ed9f9e640 1 -- 172.21.15.170:0/2265955413 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ed41a1440 con 0x7f9ed4100b30 2024-01-25T15:05:22.279 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.278+0000 7f9ed1ffb640 1 -- 172.21.15.170:0/2265955413 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+11448 (secure 0 0 0) 0x7f9ec8098310 con 0x7f9ed4100b30 2024-01-25T15:05:22.279 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:05:22.280 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-25T14:59:53.534085+0000","modified":"2024-01-25T15:04:43.475775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24484,"mds_1":24479,"mds_2":24466,"mds_3":24418,"mds_4":24398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":4,"incarnation":23,"state":"up:active","state_seq":67,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":21,"state":"up:active","state_seq":67,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":19,"state":"up:active","state_seq":63,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24479":{"gid":24479,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":59,"addr":"172.21.15.186:6839/2132502182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":2132502182},{"type":"v1","addr":"172.21.15.186:6839","nonce":2132502182}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:05:22.280 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 42 2024-01-25T15:05:22.281 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.280+0000 7f9ed9f9e640 1 -- 172.21.15.170:0/2265955413 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9ec40a12e0 msgr2=0x7f9ec40a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.280+0000 7f9ed9f9e640 1 --2- 172.21.15.170:0/2265955413 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9ec40a12e0 0x7f9ec40a37a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009bd0 tx=0x7f9ec0005f90 comp rx=0 tx=0).stop 2024-01-25T15:05:22.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.280+0000 7f9ed9f9e640 1 -- 172.21.15.170:0/2265955413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ed4100b30 msgr2=0x7f9ed4198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.280+0000 7f9ed9f9e640 1 --2- 172.21.15.170:0/2265955413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ed4100b30 0x7f9ed4198d80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800e9c0 tx=0x7f9ec800ee80 comp rx=0 tx=0).stop 2024-01-25T15:05:22.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.280+0000 7f9ed9f9e640 1 -- 172.21.15.170:0/2265955413 shutdown_connections 2024-01-25T15:05:22.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.280+0000 7f9ed9f9e640 1 --2- 172.21.15.170:0/2265955413 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f9ec40a12e0 0x7f9ec40a37a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.280+0000 7f9ed9f9e640 1 --2- 172.21.15.170:0/2265955413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ed41026e0 0x7f9ed41a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.280+0000 7f9ed9f9e640 1 --2- 172.21.15.170:0/2265955413 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f9ed4101d20 0x7f9ed41992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.280+0000 7f9ed9f9e640 1 --2- 172.21.15.170:0/2265955413 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f9ed4100b30 0x7f9ed4198d80 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.281+0000 7f9ed9f9e640 1 -- 172.21.15.170:0/2265955413 >> 172.21.15.170:0/2265955413 conn(0x7f9ed40fc080 msgr2=0x7f9ed4072f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:22.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.281+0000 7f9ed9f9e640 1 -- 172.21.15.170:0/2265955413 shutdown_connections 2024-01-25T15:05:22.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.281+0000 7f9ed9f9e640 1 -- 172.21.15.170:0/2265955413 wait complete. 2024-01-25T15:05:22.293 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-25T15:05:22.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.394+0000 7fe17c215640 1 -- 172.21.15.170:0/3433695359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1740ffc30 msgr2=0x7fe174100050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.394+0000 7fe17c215640 1 --2- 172.21.15.170:0/3433695359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1740ffc30 0x7fe174100050 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe170009900 tx=0x7fe17002bc30 comp rx=0 tx=0).stop 2024-01-25T15:05:22.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.394+0000 7fe17c215640 1 -- 172.21.15.170:0/3433695359 shutdown_connections 2024-01-25T15:05:22.397 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.394+0000 7fe17c215640 1 --2- 172.21.15.170:0/3433695359 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe174100e20 0x7fe1741012a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.394+0000 7fe17c215640 1 --2- 172.21.15.170:0/3433695359 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1741017e0 0x7fe174108070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.394+0000 7fe17c215640 1 --2- 172.21.15.170:0/3433695359 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe1740ffc30 0x7fe174100050 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.394+0000 7fe17c215640 1 -- 172.21.15.170:0/3433695359 >> 172.21.15.170:0/3433695359 conn(0x7fe1740fb1a0 msgr2=0x7fe1740fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:22.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.394+0000 7fe17c215640 1 -- 172.21.15.170:0/3433695359 shutdown_connections 2024-01-25T15:05:22.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.394+0000 7fe17c215640 1 -- 172.21.15.170:0/3433695359 wait complete. 2024-01-25T15:05:22.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.394+0000 7fe17c215640 1 Processor -- start 2024-01-25T15:05:22.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.394+0000 7fe17c215640 1 -- start start 2024-01-25T15:05:22.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.394+0000 7fe17c215640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1740ffc30 0x7fe17410a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe17c215640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe174100e20 0x7fe1741089f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe17c215640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1741017e0 0x7fe174108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe17c215640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe174109690 con 0x7fe174100e20 2024-01-25T15:05:22.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe17c215640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe174109800 con 0x7fe1741017e0 2024-01-25T15:05:22.398 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe17c215640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1741a0d30 con 0x7fe1740ffc30 2024-01-25T15:05:22.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe1797b0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe174100e20 0x7fe1741089f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe1797b0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe174100e20 0x7fe1741089f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55526/0 (socket says 172.21.15.170:55526) 2024-01-25T15:05:22.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe1797b0640 1 -- 172.21.15.170:0/1171612622 learned_addr learned my addr 172.21.15.170:0/1171612622 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:05:22.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe17a7b2640 1 --2- 172.21.15.170:0/1171612622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1741017e0 0x7fe174108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe179fb1640 1 --2- 172.21.15.170:0/1171612622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1740ffc30 0x7fe17410a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe1797b0640 1 -- 172.21.15.170:0/1171612622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1740ffc30 msgr2=0x7fe17410a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe1797b0640 1 --2- 172.21.15.170:0/1171612622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1740ffc30 0x7fe17410a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe1797b0640 1 -- 172.21.15.170:0/1171612622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1741017e0 msgr2=0x7fe174108f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe1797b0640 1 --2- 172.21.15.170:0/1171612622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1741017e0 0x7fe174108f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe1797b0640 1 -- 172.21.15.170:0/1171612622 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe170009560 con 0x7fe174100e20 2024-01-25T15:05:22.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe1797b0640 1 --2- 172.21.15.170:0/1171612622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe174100e20 0x7fe1741089f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe16400d980 tx=0x7fe16400de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:22.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe16affd640 1 -- 172.21.15.170:0/1171612622 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164009c30 con 0x7fe174100e20 2024-01-25T15:05:22.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe16affd640 1 -- 172.21.15.170:0/1171612622 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe16400b660 con 0x7fe174100e20 2024-01-25T15:05:22.399 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe17c215640 1 -- 172.21.15.170:0/1171612622 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1741a0fe0 con 0x7fe174100e20 2024-01-25T15:05:22.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe16affd640 1 -- 172.21.15.170:0/1171612622 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16400f620 con 0x7fe174100e20 2024-01-25T15:05:22.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.395+0000 7fe17c215640 1 -- 172.21.15.170:0/1171612622 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1741a1460 con 0x7fe174100e20 2024-01-25T15:05:22.400 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.396+0000 7fe17c215640 1 -- 172.21.15.170:0/1171612622 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe174106fa0 con 0x7fe174100e20 2024-01-25T15:05:22.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.397+0000 7fe16affd640 1 -- 172.21.15.170:0/1171612622 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7fe164005030 con 0x7fe174100e20 2024-01-25T15:05:22.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.398+0000 7fe16affd640 1 --2- 172.21.15.170:0/1171612622 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe1600a12e0 0x7fe1600a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.398+0000 7fe179fb1640 1 --2- 172.21.15.170:0/1171612622 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe1600a12e0 0x7fe1600a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.398+0000 7fe16affd640 1 -- 172.21.15.170:0/1171612622 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7fe1640cc630 con 0x7fe174100e20 2024-01-25T15:05:22.401 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.398+0000 7fe179fb1640 1 --2- 172.21.15.170:0/1171612622 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe1600a12e0 0x7fe1600a37a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe170000c00 tx=0x7fe17002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:22.402 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.402+0000 7fe16affd640 1 -- 172.21.15.170:0/1171612622 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7fe164095b90 con 0x7fe174100e20 2024-01-25T15:05:22.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:22 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3021238865' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-01-25T15:05:22.608 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.608+0000 7fe17c215640 1 -- 172.21.15.170:0/1171612622 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe17410c620 con 0x7fe174100e20 2024-01-25T15:05:22.609 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.608+0000 7fe16affd640 1 -- 172.21.15.170:0/1171612622 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+11448 (secure 0 0 0) 0x7fe164020090 con 0x7fe174100e20 2024-01-25T15:05:22.609 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:05:22.610 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6835/1911625476","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6834","nonce":1911625476},{"type":"v1","addr":"172.21.15.170:6835","nonce":1911625476}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.170:6837/4204528099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6836","nonce":4204528099},{"type":"v1","addr":"172.21.15.170:6837","nonce":4204528099}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-01-25T14:59:53.534085+0000","modified":"2024-01-25T15:04:43.475775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24484,"mds_1":24479,"mds_2":24466,"mds_3":24418,"mds_4":24398},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14616":{"gid":14616,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6839/3528948477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6838","nonce":3528948477},{"type":"v1","addr":"172.21.15.170:6839","nonce":3528948477}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14628":{"gid":14628,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.170:6841/2918388059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6840","nonce":2918388059},{"type":"v1","addr":"172.21.15.170:6841","nonce":2918388059}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24398":{"gid":24398,"name":"k","rank":4,"incarnation":23,"state":"up:active","state_seq":67,"addr":"172.21.15.186:6833/1347511259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":1347511259},{"type":"v1","addr":"172.21.15.186:6833","nonce":1347511259}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":21,"state":"up:active","state_seq":67,"addr":"172.21.15.191:6833/274874056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6832","nonce":274874056},{"type":"v1","addr":"172.21.15.191:6833","nonce":274874056}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2663522449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2663522449},{"type":"v1","addr":"172.21.15.186:6835","nonce":2663522449}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24449":{"gid":24449,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/2382645540","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":2382645540},{"type":"v1","addr":"172.21.15.186:6837","nonce":2382645540}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24457":{"gid":24457,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.191:6835/1870775954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6834","nonce":1870775954},{"type":"v1","addr":"172.21.15.191:6835","nonce":1870775954}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":2,"incarnation":19,"state":"up:active","state_seq":63,"addr":"172.21.15.191:6837/719224494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6836","nonce":719224494},{"type":"v1","addr":"172.21.15.191:6837","nonce":719224494}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24479":{"gid":24479,"name":"b","rank":1,"incarnation":17,"state":"up:active","state_seq":59,"addr":"172.21.15.186:6839/2132502182","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":2132502182},{"type":"v1","addr":"172.21.15.186:6839","nonce":2132502182}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.191:6839/2461767313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6838","nonce":2461767313},{"type":"v1","addr":"172.21.15.191:6839","nonce":2461767313}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-25T15:05:22.610 INFO:teuthology.orchestra.run.smithi170.stderr:dumped fsmap epoch 42 2024-01-25T15:05:22.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.610+0000 7fe17c215640 1 -- 172.21.15.170:0/1171612622 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe1600a12e0 msgr2=0x7fe1600a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.610+0000 7fe17c215640 1 --2- 172.21.15.170:0/1171612622 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe1600a12e0 0x7fe1600a37a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe170000c00 tx=0x7fe17002c5d0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.611 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.610+0000 7fe17c215640 1 -- 172.21.15.170:0/1171612622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe174100e20 msgr2=0x7fe1741089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.610+0000 7fe17c215640 1 --2- 172.21.15.170:0/1171612622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe174100e20 0x7fe1741089f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe16400d980 tx=0x7fe16400de40 comp rx=0 tx=0).stop 2024-01-25T15:05:22.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.610+0000 7fe17c215640 1 -- 172.21.15.170:0/1171612622 shutdown_connections 2024-01-25T15:05:22.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.610+0000 7fe17c215640 1 --2- 172.21.15.170:0/1171612622 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7fe1600a12e0 0x7fe1600a37a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.610+0000 7fe17c215640 1 --2- 172.21.15.170:0/1171612622 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe1741017e0 0x7fe174108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.610+0000 7fe17c215640 1 --2- 172.21.15.170:0/1171612622 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7fe174100e20 0x7fe1741089f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.610+0000 7fe17c215640 1 --2- 172.21.15.170:0/1171612622 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7fe1740ffc30 0x7fe17410a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.610+0000 7fe17c215640 1 -- 172.21.15.170:0/1171612622 >> 172.21.15.170:0/1171612622 conn(0x7fe1740fb1a0 msgr2=0x7fe174104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:22.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.611+0000 7fe17c215640 1 -- 172.21.15.170:0/1171612622 shutdown_connections 2024-01-25T15:05:22.612 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.611+0000 7fe17c215640 1 -- 172.21.15.170:0/1171612622 wait complete. 2024-01-25T15:05:22.621 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:22 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3021238865' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-01-25T15:05:22.623 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-25T15:05:22.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.723+0000 7ff62b7c4640 1 -- 172.21.15.170:0/2409078986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6241017c0 msgr2=0x7ff624108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.726 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.723+0000 7ff62b7c4640 1 --2- 172.21.15.170:0/2409078986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6241017c0 0x7ff624108050 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009900 tx=0x7ff61c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:05:22.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.723+0000 7ff62b7c4640 1 -- 172.21.15.170:0/2409078986 shutdown_connections 2024-01-25T15:05:22.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.723+0000 7ff62b7c4640 1 --2- 172.21.15.170:0/2409078986 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff624100e00 0x7ff624101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.723+0000 7ff62b7c4640 1 --2- 172.21.15.170:0/2409078986 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6241017c0 0x7ff624108050 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.723+0000 7ff62b7c4640 1 --2- 172.21.15.170:0/2409078986 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff6240ffc10 0x7ff624100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.723+0000 7ff62b7c4640 1 -- 172.21.15.170:0/2409078986 >> 172.21.15.170:0/2409078986 conn(0x7ff6240fb180 msgr2=0x7ff6240fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:22.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.724+0000 7ff62b7c4640 1 -- 172.21.15.170:0/2409078986 shutdown_connections 2024-01-25T15:05:22.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.724+0000 7ff62b7c4640 1 -- 172.21.15.170:0/2409078986 wait complete. 2024-01-25T15:05:22.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.724+0000 7ff62b7c4640 1 Processor -- start 2024-01-25T15:05:22.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.724+0000 7ff62b7c4640 1 -- start start 2024-01-25T15:05:22.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.724+0000 7ff62b7c4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6240ffc10 0x7ff624196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.724+0000 7ff62b7c4640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff624100e00 0x7ff6241971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.724+0000 7ff62b7c4640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6241017c0 0x7ff62419e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.724+0000 7ff62b7c4640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62419e720 con 0x7ff6241017c0 2024-01-25T15:05:22.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.724+0000 7ff62b7c4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62419e890 con 0x7ff6240ffc10 2024-01-25T15:05:22.727 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.724+0000 7ff62b7c4640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62419ea50 con 0x7ff624100e00 2024-01-25T15:05:22.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.724+0000 7ff629d61640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6241017c0 0x7ff62419e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.724+0000 7ff629d61640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6241017c0 0x7ff62419e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55540/0 (socket says 172.21.15.170:55540) 2024-01-25T15:05:22.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.724+0000 7ff629d61640 1 -- 172.21.15.170:0/2931253690 learned_addr learned my addr 172.21.15.170:0/2931253690 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:05:22.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.725+0000 7ff628d5f640 1 --2- 172.21.15.170:0/2931253690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff624100e00 0x7ff6241971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.725+0000 7ff629d61640 1 -- 172.21.15.170:0/2931253690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff624100e00 msgr2=0x7ff6241971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.725+0000 7ff629d61640 1 --2- 172.21.15.170:0/2931253690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff624100e00 0x7ff6241971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.725+0000 7ff629d61640 1 -- 172.21.15.170:0/2931253690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6240ffc10 msgr2=0x7ff624196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.725+0000 7ff629d61640 1 --2- 172.21.15.170:0/2931253690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6240ffc10 0x7ff624196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.725+0000 7ff629d61640 1 -- 172.21.15.170:0/2931253690 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c009560 con 0x7ff6241017c0 2024-01-25T15:05:22.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.725+0000 7ff628d5f640 1 --2- 172.21.15.170:0/2931253690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff624100e00 0x7ff6241971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-25T15:05:22.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.725+0000 7ff629d61640 1 --2- 172.21.15.170:0/2931253690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6241017c0 0x7ff62419e1b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff61c02c7e0 tx=0x7ff61c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:22.728 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.725+0000 7ff6227fc640 1 -- 172.21.15.170:0/2931253690 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c005000 con 0x7ff6241017c0 2024-01-25T15:05:22.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.725+0000 7ff62b7c4640 1 -- 172.21.15.170:0/2931253690 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62419ecd0 con 0x7ff6241017c0 2024-01-25T15:05:22.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.725+0000 7ff6227fc640 1 -- 172.21.15.170:0/2931253690 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff61c005620 con 0x7ff6241017c0 2024-01-25T15:05:22.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.725+0000 7ff6227fc640 1 -- 172.21.15.170:0/2931253690 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c03e6b0 con 0x7ff6241017c0 2024-01-25T15:05:22.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.725+0000 7ff62b7c4640 1 -- 172.21.15.170:0/2931253690 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62419f190 con 0x7ff6241017c0 2024-01-25T15:05:22.729 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.726+0000 7ff62b7c4640 1 -- 172.21.15.170:0/2931253690 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62410b4b0 con 0x7ff6241017c0 2024-01-25T15:05:22.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.727+0000 7ff6227fc640 1 -- 172.21.15.170:0/2931253690 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7ff61c005160 con 0x7ff6241017c0 2024-01-25T15:05:22.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.727+0000 7ff6227fc640 1 --2- 172.21.15.170:0/2931253690 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff60c0a12e0 0x7ff60c0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:22.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.728+0000 7ff629560640 1 --2- 172.21.15.170:0/2931253690 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff60c0a12e0 0x7ff60c0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:22.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.728+0000 7ff6227fc640 1 -- 172.21.15.170:0/2931253690 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7ff61c0efe20 con 0x7ff6241017c0 2024-01-25T15:05:22.730 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.728+0000 7ff629560640 1 --2- 172.21.15.170:0/2931253690 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff60c0a12e0 0x7ff60c0a37a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff624198110 tx=0x7ff6140071e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:22.731 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.731+0000 7ff6227fc640 1 -- 172.21.15.170:0/2931253690 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7ff61c0b9240 con 0x7ff6241017c0 2024-01-25T15:05:22.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:22 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3021238865' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-01-25T15:05:22.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.903+0000 7ff62b7c4640 1 -- 172.21.15.170:0/2931253690 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff62419f320 con 0x7ff6241017c0 2024-01-25T15:05:22.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.905+0000 7ff6227fc640 1 -- 172.21.15.170:0/2931253690 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22550 (secure 0 0 0) 0x7ff61c0bb170 con 0x7ff6241017c0 2024-01-25T15:05:22.906 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-01-25T15:05:22.906 INFO:teuthology.orchestra.run.smithi170.stdout:{"epoch":87,"fsid":"267213a8-bb91-11ee-95b2-87774f69a715","created":"2024-01-25T14:51:53.335110+0000","modified":"2024-01-25T15:00:57.274280+0000","last_up_change":"2024-01-25T14:59:03.597761+0000","last_in_change":"2024-01-25T14:58:42.777224+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-25T14:55:22.432727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-25T14:59:51.465304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-25T14:59:52.749298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8b3a88cc-9c73-40fc-8c14-5e146fe81c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6803","nonce":3114059675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6805","nonce":3114059675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6809","nonce":3114059675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":3114059675},{"type":"v1","addr":"172.21.15.170:6807","nonce":3114059675}]},"public_addr":"172.21.15.170:6803/3114059675","cluster_addr":"172.21.15.170:6805/3114059675","heartbeat_back_addr":"172.21.15.170:6809/3114059675","heartbeat_front_addr":"172.21.15.170:6807/3114059675","state":["exists","up"]},{"osd":1,"uuid":"98a73f57-0d6f-4c4a-a576-bb8de76c7350","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6801","nonce":694515632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6803","nonce":694515632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6807","nonce":694515632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":694515632},{"type":"v1","addr":"172.21.15.186:6805","nonce":694515632}]},"public_addr":"172.21.15.186:6801/694515632","cluster_addr":"172.21.15.186:6803/694515632","heartbeat_back_addr":"172.21.15.186:6807/694515632","heartbeat_front_addr":"172.21.15.186:6805/694515632","state":["exists","up"]},{"osd":2,"uuid":"0379e70c-8d2d-4014-b174-f5f39f243368","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6800","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6801","nonce":872180441}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6802","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6803","nonce":872180441}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6806","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6807","nonce":872180441}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6804","nonce":872180441},{"type":"v1","addr":"172.21.15.191:6805","nonce":872180441}]},"public_addr":"172.21.15.191:6801/872180441","cluster_addr":"172.21.15.191:6803/872180441","heartbeat_back_addr":"172.21.15.191:6807/872180441","heartbeat_front_addr":"172.21.15.191:6805/872180441","state":["exists","up"]},{"osd":3,"uuid":"2faea223-522c-4369-a25c-bdca49890e1b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6811","nonce":1814173188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6813","nonce":1814173188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6817","nonce":1814173188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":1814173188},{"type":"v1","addr":"172.21.15.170:6815","nonce":1814173188}]},"public_addr":"172.21.15.170:6811/1814173188","cluster_addr":"172.21.15.170:6813/1814173188","heartbeat_back_addr":"172.21.15.170:6817/1814173188","heartbeat_front_addr":"172.21.15.170:6815/1814173188","state":["exists","up"]},{"osd":4,"uuid":"60e47fb9-7166-4be7-8e9f-0881b771b116","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6809","nonce":3679177883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6811","nonce":3679177883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6815","nonce":3679177883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":3679177883},{"type":"v1","addr":"172.21.15.186:6813","nonce":3679177883}]},"public_addr":"172.21.15.186:6809/3679177883","cluster_addr":"172.21.15.186:6811/3679177883","heartbeat_back_addr":"172.21.15.186:6815/3679177883","heartbeat_front_addr":"172.21.15.186:6813/3679177883","state":["exists","up"]},{"osd":5,"uuid":"945d8742-1594-45a5-8130-7aaa94abeaad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6808","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6809","nonce":1800857213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6810","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6811","nonce":1800857213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6814","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6815","nonce":1800857213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6812","nonce":1800857213},{"type":"v1","addr":"172.21.15.191:6813","nonce":1800857213}]},"public_addr":"172.21.15.191:6809/1800857213","cluster_addr":"172.21.15.191:6811/1800857213","heartbeat_back_addr":"172.21.15.191:6815/1800857213","heartbeat_front_addr":"172.21.15.191:6813/1800857213","state":["exists","up"]},{"osd":6,"uuid":"a1e8e90e-5bac-4ba8-a44b-3a96beaf0525","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6819","nonce":1982694876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6821","nonce":1982694876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6825","nonce":1982694876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1982694876},{"type":"v1","addr":"172.21.15.170:6823","nonce":1982694876}]},"public_addr":"172.21.15.170:6819/1982694876","cluster_addr":"172.21.15.170:6821/1982694876","heartbeat_back_addr":"172.21.15.170:6825/1982694876","heartbeat_front_addr":"172.21.15.170:6823/1982694876","state":["exists","up"]},{"osd":7,"uuid":"3cc3b25d-83d5-46e4-a365-3fd8bebd6587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6817","nonce":2767449638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6819","nonce":2767449638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6823","nonce":2767449638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2767449638},{"type":"v1","addr":"172.21.15.186:6821","nonce":2767449638}]},"public_addr":"172.21.15.186:6817/2767449638","cluster_addr":"172.21.15.186:6819/2767449638","heartbeat_back_addr":"172.21.15.186:6823/2767449638","heartbeat_front_addr":"172.21.15.186:6821/2767449638","state":["exists","up"]},{"osd":8,"uuid":"8100e99a-c2d3-4222-abb0-5c6840703cc6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6816","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6817","nonce":454890286}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6818","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6819","nonce":454890286}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6822","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6823","nonce":454890286}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6820","nonce":454890286},{"type":"v1","addr":"172.21.15.191:6821","nonce":454890286}]},"public_addr":"172.21.15.191:6817/454890286","cluster_addr":"172.21.15.191:6819/454890286","heartbeat_back_addr":"172.21.15.191:6823/454890286","heartbeat_front_addr":"172.21.15.191:6821/454890286","state":["exists","up"]},{"osd":9,"uuid":"3d335ab7-8f9d-4636-a436-724f2be1e20b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6827","nonce":2766984083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6829","nonce":2766984083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6833","nonce":2766984083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":2766984083},{"type":"v1","addr":"172.21.15.170:6831","nonce":2766984083}]},"public_addr":"172.21.15.170:6827/2766984083","cluster_addr":"172.21.15.170:6829/2766984083","heartbeat_back_addr":"172.21.15.170:6833/2766984083","heartbeat_front_addr":"172.21.15.170:6831/2766984083","state":["exists","up"]},{"osd":10,"uuid":"5d831d49-5068-4086-8d30-0a572d252432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6825","nonce":795318767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6827","nonce":795318767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6831","nonce":795318767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":795318767},{"type":"v1","addr":"172.21.15.186:6829","nonce":795318767}]},"public_addr":"172.21.15.186:6825/795318767","cluster_addr":"172.21.15.186:6827/795318767","heartbeat_back_addr":"172.21.15.186:6831/795318767","heartbeat_front_addr":"172.21.15.186:6829/795318767","state":["exists","up"]},{"osd":11,"uuid":"228841f5-d3d2-4481-a47c-c6c86c90925c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6824","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6825","nonce":2951008135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6826","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6827","nonce":2951008135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6830","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6831","nonce":2951008135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:6828","nonce":2951008135},{"type":"v1","addr":"172.21.15.191:6829","nonce":2951008135}]},"public_addr":"172.21.15.191:6825/2951008135","cluster_addr":"172.21.15.191:6827/2951008135","heartbeat_back_addr":"172.21.15.191:6831/2951008135","heartbeat_front_addr":"172.21.15.191:6829/2951008135","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:31.488277+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:54:55.685857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:19.178690+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:55:44.103909+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:08.255092+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:32.057792+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:56:55.922098+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:21.373639+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:57:45.570797+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:10.629241+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:58:35.734513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-25T14:59:00.874946+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.170:0/781425854":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:6800/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/1314470118":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/3177304860":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/2154892792":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/622367049":"2024-01-26T14:52:29.612886+0000","172.21.15.170:0/3790162374":"2024-01-26T14:52:29.612886+0000","172.21.15.170:6801/358194066":"2024-01-26T14:52:56.092999+0000","172.21.15.170:0/1116986212":"2024-01-26T14:52:56.092999+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-25T15:05:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.907+0000 7ff62b7c4640 1 -- 172.21.15.170:0/2931253690 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff60c0a12e0 msgr2=0x7ff60c0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.907+0000 7ff62b7c4640 1 --2- 172.21.15.170:0/2931253690 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff60c0a12e0 0x7ff60c0a37a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff624198110 tx=0x7ff6140071e0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.907+0000 7ff62b7c4640 1 -- 172.21.15.170:0/2931253690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6241017c0 msgr2=0x7ff62419e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.907+0000 7ff62b7c4640 1 --2- 172.21.15.170:0/2931253690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6241017c0 0x7ff62419e1b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff61c02c7e0 tx=0x7ff61c004270 comp rx=0 tx=0).stop 2024-01-25T15:05:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.907+0000 7ff62b7c4640 1 -- 172.21.15.170:0/2931253690 shutdown_connections 2024-01-25T15:05:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.907+0000 7ff62b7c4640 1 --2- 172.21.15.170:0/2931253690 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7ff60c0a12e0 0x7ff60c0a37a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.907+0000 7ff62b7c4640 1 --2- 172.21.15.170:0/2931253690 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7ff6241017c0 0x7ff62419e1b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.907+0000 7ff62b7c4640 1 --2- 172.21.15.170:0/2931253690 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7ff624100e00 0x7ff6241971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.907+0000 7ff62b7c4640 1 --2- 172.21.15.170:0/2931253690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6240ffc10 0x7ff624196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:22.908 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.907+0000 7ff62b7c4640 1 -- 172.21.15.170:0/2931253690 >> 172.21.15.170:0/2931253690 conn(0x7ff6240fb180 msgr2=0x7ff6240fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:22.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.907+0000 7ff62b7c4640 1 -- 172.21.15.170:0/2931253690 shutdown_connections 2024-01-25T15:05:22.909 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:22.907+0000 7ff62b7c4640 1 -- 172.21.15.170:0/2931253690 wait complete. 2024-01-25T15:05:22.919 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-25T15:05:23.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.021+0000 7f88bbad3640 1 -- 172.21.15.170:0/1661317945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88b40fefe0 msgr2=0x7f88b40ff400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.021+0000 7f88bbad3640 1 --2- 172.21.15.170:0/1661317945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88b40fefe0 0x7f88b40ff400 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f88ac009ca0 tx=0x7f88ac02c0f0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.024 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.021+0000 7f88bbad3640 1 -- 172.21.15.170:0/1661317945 shutdown_connections 2024-01-25T15:05:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.021+0000 7f88bbad3640 1 --2- 172.21.15.170:0/1661317945 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88b4102970 0x7f88b4109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.021+0000 7f88bbad3640 1 --2- 172.21.15.170:0/1661317945 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88b4101fb0 0x7f88b4102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.021+0000 7f88bbad3640 1 --2- 172.21.15.170:0/1661317945 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88b40fefe0 0x7f88b40ff400 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.021+0000 7f88bbad3640 1 -- 172.21.15.170:0/1661317945 >> 172.21.15.170:0/1661317945 conn(0x7f88b40fa8f0 msgr2=0x7f88b40fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.021+0000 7f88bbad3640 1 -- 172.21.15.170:0/1661317945 shutdown_connections 2024-01-25T15:05:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.021+0000 7f88bbad3640 1 -- 172.21.15.170:0/1661317945 wait complete. 2024-01-25T15:05:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.021+0000 7f88bbad3640 1 Processor -- start 2024-01-25T15:05:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.021+0000 7f88bbad3640 1 -- start start 2024-01-25T15:05:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.021+0000 7f88bbad3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88b40fefe0 0x7f88b4196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.021+0000 7f88bbad3640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88b4101fb0 0x7f88b4197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88bbad3640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88b4102970 0x7f88b419e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88bbad3640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b419e7e0 con 0x7f88b4101fb0 2024-01-25T15:05:23.025 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88bbad3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b419e950 con 0x7f88b40fefe0 2024-01-25T15:05:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88bbad3640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b419eb10 con 0x7f88b4102970 2024-01-25T15:05:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88b906e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88b4101fb0 0x7f88b4197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88b906e640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88b4101fb0 0x7f88b4197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55554/0 (socket says 172.21.15.170:55554) 2024-01-25T15:05:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88b906e640 1 -- 172.21.15.170:0/1264663528 learned_addr learned my addr 172.21.15.170:0/1264663528 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:05:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88b986f640 1 --2- 172.21.15.170:0/1264663528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88b40fefe0 0x7f88b4196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88ba070640 1 --2- 172.21.15.170:0/1264663528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88b4102970 0x7f88b419e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88b906e640 1 -- 172.21.15.170:0/1264663528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88b4102970 msgr2=0x7f88b419e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88b906e640 1 --2- 172.21.15.170:0/1264663528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88b4102970 0x7f88b419e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88b906e640 1 -- 172.21.15.170:0/1264663528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88b40fefe0 msgr2=0x7f88b4196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88b906e640 1 --2- 172.21.15.170:0/1264663528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88b40fefe0 0x7f88b4196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88b906e640 1 -- 172.21.15.170:0/1264663528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac009900 con 0x7f88b4101fb0 2024-01-25T15:05:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88b906e640 1 --2- 172.21.15.170:0/1264663528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88b4101fb0 0x7f88b4197240 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f88a800e9f0 tx=0x7f88a800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88b2ffd640 1 -- 172.21.15.170:0/1264663528 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8009720 con 0x7f88b4101fb0 2024-01-25T15:05:23.026 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88b2ffd640 1 -- 172.21.15.170:0/1264663528 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f88a800cd80 con 0x7f88b4101fb0 2024-01-25T15:05:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88bbad3640 1 -- 172.21.15.170:0/1264663528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b419edf0 con 0x7f88b4101fb0 2024-01-25T15:05:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88b2ffd640 1 -- 172.21.15.170:0/1264663528 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8010430 con 0x7f88b4101fb0 2024-01-25T15:05:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.022+0000 7f88bbad3640 1 -- 172.21.15.170:0/1264663528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b419f220 con 0x7f88b4101fb0 2024-01-25T15:05:23.027 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.023+0000 7f88bbad3640 1 -- 172.21.15.170:0/1264663528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b4108180 con 0x7f88b4101fb0 2024-01-25T15:05:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.024+0000 7f88b2ffd640 1 -- 172.21.15.170:0/1264663528 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f88a8005000 con 0x7f88b4101fb0 2024-01-25T15:05:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.025+0000 7f88b2ffd640 1 --2- 172.21.15.170:0/1264663528 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f889c0a1360 0x7f889c0a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.025+0000 7f88b986f640 1 --2- 172.21.15.170:0/1264663528 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f889c0a1360 0x7f889c0a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.025+0000 7f88b2ffd640 1 -- 172.21.15.170:0/1264663528 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f88a8014070 con 0x7f88b4101fb0 2024-01-25T15:05:23.028 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.025+0000 7f88b986f640 1 --2- 172.21.15.170:0/1264663528 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f889c0a1360 0x7f889c0a3820 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f88b41981d0 tx=0x7f88ac032690 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:23.029 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.028+0000 7f88b2ffd640 1 -- 172.21.15.170:0/1264663528 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f88a8096530 con 0x7f88b4101fb0 2024-01-25T15:05:23.243 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.242+0000 7f88bbad3640 1 -- 172.21.15.170:0/1264663528 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f88b410c7e0 con 0x7f88b4101fb0 2024-01-25T15:05:23.245 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.244+0000 7f88b2ffd640 1 -- 172.21.15.170:0/1264663528 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) v1 ==== 161+0+0 (secure 0 0 0) 0x7f88a8098460 con 0x7f88b4101fb0 2024-01-25T15:05:23.245 INFO:teuthology.orchestra.run.smithi170.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-25T15:05:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.247+0000 7f88bbad3640 1 -- 172.21.15.170:0/1264663528 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f889c0a1360 msgr2=0x7f889c0a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.247+0000 7f88bbad3640 1 --2- 172.21.15.170:0/1264663528 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f889c0a1360 0x7f889c0a3820 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f88b41981d0 tx=0x7f88ac032690 comp rx=0 tx=0).stop 2024-01-25T15:05:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.247+0000 7f88bbad3640 1 -- 172.21.15.170:0/1264663528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88b4101fb0 msgr2=0x7f88b4197240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.247+0000 7f88bbad3640 1 --2- 172.21.15.170:0/1264663528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88b4101fb0 0x7f88b4197240 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f88a800e9f0 tx=0x7f88a800edf0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.248+0000 7f88bbad3640 1 -- 172.21.15.170:0/1264663528 shutdown_connections 2024-01-25T15:05:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.248+0000 7f88bbad3640 1 --2- 172.21.15.170:0/1264663528 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f889c0a1360 0x7f889c0a3820 secure :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f88b41981d0 tx=0x7f88ac032690 comp rx=0 tx=0).stop 2024-01-25T15:05:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.248+0000 7f88bbad3640 1 --2- 172.21.15.170:0/1264663528 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f88b4102970 0x7f88b419e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.248+0000 7f88bbad3640 1 --2- 172.21.15.170:0/1264663528 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f88b4101fb0 0x7f88b4197240 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.248+0000 7f88bbad3640 1 --2- 172.21.15.170:0/1264663528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88b40fefe0 0x7f88b4196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.248+0000 7f88bbad3640 1 -- 172.21.15.170:0/1264663528 >> 172.21.15.170:0/1264663528 conn(0x7f88b40fa8f0 msgr2=0x7f88b4105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.248+0000 7f88bbad3640 1 -- 172.21.15.170:0/1264663528 shutdown_connections 2024-01-25T15:05:23.249 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.248+0000 7f88bbad3640 1 -- 172.21.15.170:0/1264663528 wait complete. 2024-01-25T15:05:23.264 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-25T15:05:23.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.374+0000 7f64acdb0640 1 -- 172.21.15.170:0/674707534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a80ffbf0 msgr2=0x7f64a8100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.377 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.374+0000 7f64acdb0640 1 --2- 172.21.15.170:0/674707534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a80ffbf0 0x7f64a8100010 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f649c009900 tx=0x7f649c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:05:23.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.374+0000 7f64acdb0640 1 -- 172.21.15.170:0/674707534 shutdown_connections 2024-01-25T15:05:23.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.374+0000 7f64acdb0640 1 --2- 172.21.15.170:0/674707534 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64a81017a0 0x7f64a8108030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.374+0000 7f64acdb0640 1 --2- 172.21.15.170:0/674707534 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64a8100de0 0x7f64a8101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.374+0000 7f64acdb0640 1 --2- 172.21.15.170:0/674707534 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a80ffbf0 0x7f64a8100010 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.374+0000 7f64acdb0640 1 -- 172.21.15.170:0/674707534 >> 172.21.15.170:0/674707534 conn(0x7f64a80fb180 msgr2=0x7f64a80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:23.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.374+0000 7f64acdb0640 1 -- 172.21.15.170:0/674707534 shutdown_connections 2024-01-25T15:05:23.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.374+0000 7f64acdb0640 1 -- 172.21.15.170:0/674707534 wait complete. 2024-01-25T15:05:23.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64acdb0640 1 Processor -- start 2024-01-25T15:05:23.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64acdb0640 1 -- start start 2024-01-25T15:05:23.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64acdb0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64a80ffbf0 0x7f64a8196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64acdb0640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64a8100de0 0x7f64a8197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.378 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64acdb0640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a81017a0 0x7f64a819e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64acdb0640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a819e7d0 con 0x7f64a81017a0 2024-01-25T15:05:23.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64acdb0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a819e940 con 0x7f64a80ffbf0 2024-01-25T15:05:23.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64acdb0640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a819eb00 con 0x7f64a8100de0 2024-01-25T15:05:23.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64a6d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a81017a0 0x7f64a819e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64a6d9d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a81017a0 0x7f64a819e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55602/0 (socket says 172.21.15.170:55602) 2024-01-25T15:05:23.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64a6d9d640 1 -- 172.21.15.170:0/3484689213 learned_addr learned my addr 172.21.15.170:0/3484689213 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:05:23.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64a659c640 1 --2- 172.21.15.170:0/3484689213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64a80ffbf0 0x7f64a8196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64a5d9b640 1 --2- 172.21.15.170:0/3484689213 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64a8100de0 0x7f64a8197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64a6d9d640 1 -- 172.21.15.170:0/3484689213 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64a8100de0 msgr2=0x7f64a8197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64a6d9d640 1 --2- 172.21.15.170:0/3484689213 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64a8100de0 0x7f64a8197230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64a6d9d640 1 -- 172.21.15.170:0/3484689213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64a80ffbf0 msgr2=0x7f64a8196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:23.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64a6d9d640 1 --2- 172.21.15.170:0/3484689213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64a80ffbf0 0x7f64a8196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:23.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64a6d9d640 1 -- 172.21.15.170:0/3484689213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649c009560 con 0x7f64a81017a0 2024-01-25T15:05:23.379 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.375+0000 7f64a6d9d640 1 --2- 172.21.15.170:0/3484689213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a81017a0 0x7f64a819e260 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009fd0 tx=0x7f64a000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:23.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.376+0000 7f64977fe640 1 -- 172.21.15.170:0/3484689213 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a000bea0 con 0x7f64a81017a0 2024-01-25T15:05:23.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.376+0000 7f64977fe640 1 -- 172.21.15.170:0/3484689213 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64a0009940 con 0x7f64a81017a0 2024-01-25T15:05:23.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.376+0000 7f64977fe640 1 -- 172.21.15.170:0/3484689213 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a00106c0 con 0x7f64a81017a0 2024-01-25T15:05:23.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.376+0000 7f64acdb0640 1 -- 172.21.15.170:0/3484689213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64a819ede0 con 0x7f64a81017a0 2024-01-25T15:05:23.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.376+0000 7f64acdb0640 1 -- 172.21.15.170:0/3484689213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a819f1b0 con 0x7f64a81017a0 2024-01-25T15:05:23.380 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.376+0000 7f64acdb0640 1 -- 172.21.15.170:0/3484689213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a810b480 con 0x7f64a81017a0 2024-01-25T15:05:23.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.378+0000 7f64977fe640 1 -- 172.21.15.170:0/3484689213 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f64a00041b0 con 0x7f64a81017a0 2024-01-25T15:05:23.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.378+0000 7f64977fe640 1 --2- 172.21.15.170:0/3484689213 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f64900a12e0 0x7f64900a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:23.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.378+0000 7f64977fe640 1 -- 172.21.15.170:0/3484689213 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8612+0+0 (secure 0 0 0) 0x7f64a00cca20 con 0x7f64a81017a0 2024-01-25T15:05:23.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.378+0000 7f64a659c640 1 --2- 172.21.15.170:0/3484689213 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f64900a12e0 0x7f64900a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:23.381 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.379+0000 7f64a659c640 1 --2- 172.21.15.170:0/3484689213 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f64900a12e0 0x7f64900a37a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f649c000c00 tx=0x7f649c02c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:23.383 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.382+0000 7f64977fe640 1 -- 172.21.15.170:0/3484689213 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f64a0095c90 con 0x7f64a81017a0 2024-01-25T15:05:23.597 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:23.596+0000 7f64acdb0640 1 -- 172.21.15.170:0/3484689213 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f64a819f780 con 0x7f64a81017a0 2024-01-25T15:05:23.605 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: ignoring --setuser ceph since I am not root 2024-01-25T15:05:23.605 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: ignoring --setgroup ceph since I am not root 2024-01-25T15:05:23.605 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mds[66088]: -- 172.21.15.186:0/1313998808 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5618b60c7520 con 0x5618b609d000 2024-01-25T15:05:23.605 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: starting mds.k at 2024-01-25T15:05:23.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mon[35697]: pgmap v450: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-01-25T15:05:23.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2265955413' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:05:23.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1171612622' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:05:23.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/2931253690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:05:23.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1264663528' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-01-25T15:05:23.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mon[35697]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-01-25T15:05:23.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mon[35697]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-25T15:05:23.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mon[35697]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2024-01-25T15:05:23.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/1264663528' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-01-25T15:05:23.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mon[35697]: osdmap e88: 12 total, 12 up, 12 in 2024-01-25T15:05:23.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mon[35697]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-01-25T15:05:23.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-25T15:05:23.606 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: ignoring --setuser ceph since I am not root 2024-01-25T15:05:23.606 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: ignoring --setgroup ceph since I am not root 2024-01-25T15:05:23.606 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mds[67036]: -- 172.21.15.186:0/1450990366 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560e2da05520 con 0x560e2d9da800 2024-01-25T15:05:23.606 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: starting mds.b at 2024-01-25T15:05:23.607 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-e[66402]: ignoring --setuser ceph since I am not root 2024-01-25T15:05:23.607 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-e[66402]: ignoring --setgroup ceph since I am not root 2024-01-25T15:05:23.607 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mds[66406]: -- 172.21.15.186:0/3345314265 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5636d8745520 con 0x5636d871a800 2024-01-25T15:05:23.607 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-e[66402]: starting mds.e at 2024-01-25T15:05:23.607 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-h[66710]: ignoring --setuser ceph since I am not root 2024-01-25T15:05:23.607 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-h[66710]: ignoring --setgroup ceph since I am not root 2024-01-25T15:05:23.607 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-mds[66714]: -- 172.21.15.186:0/1117647834 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561bef5bd520 con 0x561bef593000 2024-01-25T15:05:23.607 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 15:05:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-h[66710]: starting mds.h at 2024-01-25T15:05:23.623 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-g[73280]: ignoring --setuser ceph since I am not root 2024-01-25T15:05:23.624 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-g[73280]: ignoring --setgroup ceph since I am not root 2024-01-25T15:05:23.624 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-mds[73286]: -- 172.21.15.170:0/1421321018 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5574cde81520 con 0x5574cde56c00 2024-01-25T15:05:23.624 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-g[73280]: starting mds.g at 2024-01-25T15:05:23.624 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-a[73635]: ignoring --setuser ceph since I am not root 2024-01-25T15:05:23.624 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-a[73635]: ignoring --setgroup ceph since I am not root 2024-01-25T15:05:23.624 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-mds[73641]: -- 172.21.15.170:0/3562092395 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5649260a3520 con 0x564926078800 2024-01-25T15:05:23.624 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-a[73635]: starting mds.a at 2024-01-25T15:05:23.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a[31895]: 2024-01-25T15:05:23.243+0000 7f06bf899700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-25T15:05:23.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-mon[31899]: pgmap v450: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-01-25T15:05:23.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2265955413' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:05:23.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1171612622' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:05:23.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/2931253690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:05:23.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1264663528' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-01-25T15:05:23.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-mon[31899]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-01-25T15:05:23.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-mon[31899]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-25T15:05:23.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-mon[31899]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2024-01-25T15:05:23.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/1264663528' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-01-25T15:05:23.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-mon[31899]: osdmap e88: 12 total, 12 up, 12 in 2024-01-25T15:05:23.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-mon[31899]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-01-25T15:05:23.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:23 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-25T15:05:23.733 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-f[67205]: ignoring --setuser ceph since I am not root 2024-01-25T15:05:23.734 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-f[67205]: ignoring --setgroup ceph since I am not root 2024-01-25T15:05:23.734 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-mds[67209]: -- 172.21.15.191:0/1002836854 <== mon.0 v2:172.21.15.170:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563859f8f520 con 0x563859f64800 2024-01-25T15:05:23.734 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-f[67205]: starting mds.f at 2024-01-25T15:05:23.734 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: ignoring --setuser ceph since I am not root 2024-01-25T15:05:23.734 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: ignoring --setgroup ceph since I am not root 2024-01-25T15:05:23.734 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-mds[66897]: -- 172.21.15.191:0/3637779732 <== mon.2 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5644ad0e1520 con 0x5644ad0b7000 2024-01-25T15:05:23.734 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: starting mds.l at 2024-01-25T15:05:23.735 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: ignoring --setuser ceph since I am not root 2024-01-25T15:05:23.735 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: ignoring --setgroup ceph since I am not root 2024-01-25T15:05:23.735 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: starting mds.c at 2024-01-25T15:05:23.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-mon[36347]: pgmap v450: 97 pgs: 97 active+clean; 30 MiB data, 801 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 10 op/s 2024-01-25T15:05:23.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2265955413' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:05:23.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1171612622' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-01-25T15:05:23.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/2931253690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-01-25T15:05:23.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1264663528' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-01-25T15:05:23.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-mon[36347]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-01-25T15:05:23.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-mon[36347]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-25T15:05:23.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-mon[36347]: Health check cleared: MDS_DAMAGE (was: 4 MDSs report damaged metadata) 2024-01-25T15:05:23.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/1264663528' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-01-25T15:05:23.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-mon[36347]: osdmap e88: 12 total, 12 up, 12 in 2024-01-25T15:05:23.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-mon[36347]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-01-25T15:05:23.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-25T15:05:23.736 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i[67820]: ignoring --setuser ceph since I am not root 2024-01-25T15:05:23.736 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i[67820]: ignoring --setgroup ceph since I am not root 2024-01-25T15:05:23.736 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-mds[67824]: -- 172.21.15.191:0/4148177042 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d9f48b1520 con 0x55d9f4886800 2024-01-25T15:05:23.736 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:05:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i[67820]: starting mds.i at 2024-01-25T15:05:24.282 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.281+0000 7f64977fe640 1 -- 172.21.15.170:0/3484689213 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7f64a0097bc0 con 0x7f64a81017a0 2024-01-25T15:05:24.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.284+0000 7f64acdb0640 1 -- 172.21.15.170:0/3484689213 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f64900a12e0 msgr2=0x7f64900a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.284+0000 7f64acdb0640 1 --2- 172.21.15.170:0/3484689213 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f64900a12e0 0x7f64900a37a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f649c000c00 tx=0x7f649c02c5d0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.284+0000 7f64acdb0640 1 -- 172.21.15.170:0/3484689213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a81017a0 msgr2=0x7f64a819e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.284+0000 7f64acdb0640 1 --2- 172.21.15.170:0/3484689213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a81017a0 0x7f64a819e260 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009fd0 tx=0x7f64a000b260 comp rx=0 tx=0).stop 2024-01-25T15:05:24.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.284+0000 7f64acdb0640 1 -- 172.21.15.170:0/3484689213 shutdown_connections 2024-01-25T15:05:24.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.284+0000 7f64acdb0640 1 --2- 172.21.15.170:0/3484689213 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f64900a12e0 0x7f64900a37a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.284+0000 7f64acdb0640 1 --2- 172.21.15.170:0/3484689213 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f64a81017a0 0x7f64a819e260 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.284+0000 7f64acdb0640 1 --2- 172.21.15.170:0/3484689213 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f64a8100de0 0x7f64a8197230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.284+0000 7f64acdb0640 1 --2- 172.21.15.170:0/3484689213 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64a80ffbf0 0x7f64a8196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.284+0000 7f64acdb0640 1 -- 172.21.15.170:0/3484689213 >> 172.21.15.170:0/3484689213 conn(0x7f64a80fb180 msgr2=0x7f64a8067ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:24.285 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.284+0000 7f64acdb0640 1 -- 172.21.15.170:0/3484689213 shutdown_connections 2024-01-25T15:05:24.286 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.284+0000 7f64acdb0640 1 -- 172.21.15.170:0/3484689213 wait complete. 2024-01-25T15:05:24.300 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-25T15:05:24.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.406+0000 7f266e890640 1 -- 172.21.15.170:0/864670637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2668100e00 msgr2=0x7f2668101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.407 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.406+0000 7f266e890640 1 --2- 172.21.15.170:0/864670637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2668100e00 0x7f2668101280 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f265c009900 tx=0x7f265c02bc30 comp rx=0 tx=0).stop 2024-01-25T15:05:24.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.406+0000 7f266e890640 1 -- 172.21.15.170:0/864670637 shutdown_connections 2024-01-25T15:05:24.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.406+0000 7f266e890640 1 --2- 172.21.15.170:0/864670637 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f26681017c0 0x7f2668108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.406+0000 7f266e890640 1 --2- 172.21.15.170:0/864670637 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f2668100e00 0x7f2668101280 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.406+0000 7f266e890640 1 --2- 172.21.15.170:0/864670637 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26680ffc10 0x7f2668100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.406+0000 7f266e890640 1 -- 172.21.15.170:0/864670637 >> 172.21.15.170:0/864670637 conn(0x7f26680fb1a0 msgr2=0x7f26680fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:24.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.406+0000 7f266e890640 1 -- 172.21.15.170:0/864670637 shutdown_connections 2024-01-25T15:05:24.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.406+0000 7f266e890640 1 -- 172.21.15.170:0/864670637 wait complete. 2024-01-25T15:05:24.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.407+0000 7f266e890640 1 Processor -- start 2024-01-25T15:05:24.408 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.407+0000 7f266e890640 1 -- start start 2024-01-25T15:05:24.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.407+0000 7f266e890640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26680ffc10 0x7f2668069e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.407+0000 7f266e890640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2668100e00 0x7f266819bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.407+0000 7f266e890640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26681017c0 0x7f266819e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.407+0000 7f266e890640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266819e960 con 0x7f26681017c0 2024-01-25T15:05:24.410 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.407+0000 7f266e890640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266819ead0 con 0x7f2668100e00 2024-01-25T15:05:24.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.407+0000 7f266e890640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266819ec90 con 0x7f26680ffc10 2024-01-25T15:05:24.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.407+0000 7f266ce2d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26681017c0 0x7f266819e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.407+0000 7f266ce2d640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26681017c0 0x7f266819e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55612/0 (socket says 172.21.15.170:55612) 2024-01-25T15:05:24.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.407+0000 7f266ce2d640 1 -- 172.21.15.170:0/3617425706 learned_addr learned my addr 172.21.15.170:0/3617425706 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:05:24.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.407+0000 7f2667fff640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26680ffc10 0x7f2668069e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.407+0000 7f26677fe640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2668100e00 0x7f266819bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.408+0000 7f266ce2d640 1 -- 172.21.15.170:0/3617425706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26680ffc10 msgr2=0x7f2668069e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.408+0000 7f266ce2d640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26680ffc10 0x7f2668069e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.408+0000 7f266ce2d640 1 -- 172.21.15.170:0/3617425706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2668100e00 msgr2=0x7f266819bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:24.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.408+0000 7f266ce2d640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2668100e00 0x7f266819bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:24.411 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.408+0000 7f266ce2d640 1 -- 172.21.15.170:0/3617425706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c009560 con 0x7f26681017c0 2024-01-25T15:05:24.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.408+0000 7f26677fe640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2668100e00 0x7f266819bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:24.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.408+0000 7f2667fff640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26680ffc10 0x7f2668069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-25T15:05:24.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.408+0000 7f266ce2d640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26681017c0 0x7f266819e1d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f266000b970 tx=0x7f266000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:24.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.408+0000 7f26657fa640 1 -- 172.21.15.170:0/3617425706 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266000cb40 con 0x7f26681017c0 2024-01-25T15:05:24.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.408+0000 7f26657fa640 1 -- 172.21.15.170:0/3617425706 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f266000cca0 con 0x7f26681017c0 2024-01-25T15:05:24.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.408+0000 7f266e890640 1 -- 172.21.15.170:0/3617425706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266819ef70 con 0x7f26681017c0 2024-01-25T15:05:24.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.408+0000 7f26657fa640 1 -- 172.21.15.170:0/3617425706 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660007770 con 0x7f26681017c0 2024-01-25T15:05:24.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.408+0000 7f266e890640 1 -- 172.21.15.170:0/3617425706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266819f480 con 0x7f26681017c0 2024-01-25T15:05:24.412 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.409+0000 7f266e890640 1 -- 172.21.15.170:0/3617425706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2668107070 con 0x7f26681017c0 2024-01-25T15:05:24.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.410+0000 7f26657fa640 1 -- 172.21.15.170:0/3617425706 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f2660014440 con 0x7f26681017c0 2024-01-25T15:05:24.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.410+0000 7f26657fa640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f26500a1360 0x7f26500a3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:24.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.411+0000 7f2667fff640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f26500a1360 0x7f26500a3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:24.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.411+0000 7f26657fa640 1 -- 172.21.15.170:0/3617425706 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8612+0+0 (secure 0 0 0) 0x7f26600ccb10 con 0x7f26681017c0 2024-01-25T15:05:24.413 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.411+0000 7f2667fff640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f26500a1360 0x7f26500a3820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2668100c60 tx=0x7f2658008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:24.415 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.414+0000 7f26657fa640 1 -- 172.21.15.170:0/3617425706 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f2660095db0 con 0x7f26681017c0 2024-01-25T15:05:24.586 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:24.585+0000 7f266e890640 1 -- 172.21.15.170:0/3617425706 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f266810b5c0 con 0x7f26681017c0 2024-01-25T15:05:24.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:24 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3484689213' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-01-25T15:05:24.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:24 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3484689213' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-01-25T15:05:24.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:24 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3484689213' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-01-25T15:05:25.289 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.288+0000 7f26657fa640 1 -- 172.21.15.170:0/3617425706 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v89) v1 ==== 181+0+0 (secure 0 0 0) 0x7f26600993d0 con 0x7f26681017c0 2024-01-25T15:05:25.289 INFO:teuthology.orchestra.run.smithi170.stderr:pool 'cephfs_metadata' removed 2024-01-25T15:05:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.292+0000 7f266e890640 1 -- 172.21.15.170:0/3617425706 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f26500a1360 msgr2=0x7f26500a3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.293+0000 7f266e890640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f26500a1360 0x7f26500a3820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2668100c60 tx=0x7f2658008040 comp rx=0 tx=0).stop 2024-01-25T15:05:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.293+0000 7f266e890640 1 -- 172.21.15.170:0/3617425706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26681017c0 msgr2=0x7f266819e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.293+0000 7f266e890640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26681017c0 0x7f266819e1d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f266000b970 tx=0x7f266000be30 comp rx=0 tx=0).stop 2024-01-25T15:05:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.293+0000 7f266e890640 1 -- 172.21.15.170:0/3617425706 shutdown_connections 2024-01-25T15:05:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.293+0000 7f266e890640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f26500a1360 0x7f26500a3820 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.293+0000 7f266e890640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2668100e00 0x7f266819bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.293+0000 7f266e890640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f26681017c0 0x7f266819e1d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.293+0000 7f266e890640 1 --2- 172.21.15.170:0/3617425706 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f26680ffc10 0x7f2668069e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.293+0000 7f266e890640 1 -- 172.21.15.170:0/3617425706 >> 172.21.15.170:0/3617425706 conn(0x7f26680fb1a0 msgr2=0x7f2668104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.293+0000 7f266e890640 1 -- 172.21.15.170:0/3617425706 shutdown_connections 2024-01-25T15:05:25.294 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.293+0000 7f266e890640 1 -- 172.21.15.170:0/3617425706 wait complete. 2024-01-25T15:05:25.307 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-25T15:05:25.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.414+0000 7f62f7e99640 1 -- 172.21.15.170:0/972199028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62f0104140 msgr2=0x7f62f0106530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:25.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.414+0000 7f62f7e99640 1 --2- 172.21.15.170:0/972199028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62f0104140 0x7f62f0106530 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f62e0009900 tx=0x7f62e002bc30 comp rx=0 tx=0).stop 2024-01-25T15:05:25.417 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.414+0000 7f62f7e99640 1 -- 172.21.15.170:0/972199028 shutdown_connections 2024-01-25T15:05:25.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.414+0000 7f62f7e99640 1 --2- 172.21.15.170:0/972199028 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f0106a70 0x7f62f0108e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.414+0000 7f62f7e99640 1 --2- 172.21.15.170:0/972199028 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62f0104140 0x7f62f0106530 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.414+0000 7f62f7e99640 1 --2- 172.21.15.170:0/972199028 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f62f0101810 0x7f62f0103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.414+0000 7f62f7e99640 1 -- 172.21.15.170:0/972199028 >> 172.21.15.170:0/972199028 conn(0x7f62f00fb180 msgr2=0x7f62f00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:25.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.415+0000 7f62f7e99640 1 -- 172.21.15.170:0/972199028 shutdown_connections 2024-01-25T15:05:25.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.415+0000 7f62f7e99640 1 -- 172.21.15.170:0/972199028 wait complete. 2024-01-25T15:05:25.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.415+0000 7f62f7e99640 1 Processor -- start 2024-01-25T15:05:25.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.415+0000 7f62f7e99640 1 -- start start 2024-01-25T15:05:25.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.415+0000 7f62f7e99640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62f0101810 0x7f62f0196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:25.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.415+0000 7f62f7e99640 1 --2- >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f0104140 0x7f62f0197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:25.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.415+0000 7f62f7e99640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f62f0106a70 0x7f62f019e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:25.418 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.415+0000 7f62f7e99640 1 -- --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f019e7e0 con 0x7f62f0101810 2024-01-25T15:05:25.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.415+0000 7f62f7e99640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f019e950 con 0x7f62f0106a70 2024-01-25T15:05:25.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.415+0000 7f62f7e99640 1 -- --> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f019eb10 con 0x7f62f0104140 2024-01-25T15:05:25.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.415+0000 7f62f5c35640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62f0101810 0x7f62f0196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:25.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.415+0000 7f62f5c35640 1 --2- >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62f0101810 0x7f62f0196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.170:3300/0 says I am v2:172.21.15.170:55628/0 (socket says 172.21.15.170:55628) 2024-01-25T15:05:25.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.415+0000 7f62f5c35640 1 -- 172.21.15.170:0/4223604142 learned_addr learned my addr 172.21.15.170:0/4223604142 (peer_addr_for_me v2:172.21.15.170:0/0) 2024-01-25T15:05:25.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.415+0000 7f62f5434640 1 --2- 172.21.15.170:0/4223604142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f0104140 0x7f62f0197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:25.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.416+0000 7f62f5c35640 1 -- 172.21.15.170:0/4223604142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f0104140 msgr2=0x7f62f0197240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:25.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.416+0000 7f62f5c35640 1 --2- 172.21.15.170:0/4223604142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f0104140 0x7f62f0197240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.416+0000 7f62f5c35640 1 -- 172.21.15.170:0/4223604142 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f62f0106a70 msgr2=0x7f62f019e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:25.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.416+0000 7f62f5c35640 1 --2- 172.21.15.170:0/4223604142 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f62f0106a70 0x7f62f019e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:25.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.416+0000 7f62f5c35640 1 -- 172.21.15.170:0/4223604142 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e0009560 con 0x7f62f0101810 2024-01-25T15:05:25.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.416+0000 7f62f5c35640 1 --2- 172.21.15.170:0/4223604142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62f0101810 0x7f62f0196d00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00cce0 tx=0x7f62ec00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:25.419 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.416+0000 7f62e6ffd640 1 -- 172.21.15.170:0/4223604142 <== mon.0 v2:172.21.15.170:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec00f650 con 0x7f62f0101810 2024-01-25T15:05:25.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.416+0000 7f62e6ffd640 1 -- 172.21.15.170:0/4223604142 <== mon.0 v2:172.21.15.170:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62ec00ce90 con 0x7f62f0101810 2024-01-25T15:05:25.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.416+0000 7f62f7e99640 1 -- 172.21.15.170:0/4223604142 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f019edf0 con 0x7f62f0101810 2024-01-25T15:05:25.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.416+0000 7f62e6ffd640 1 -- 172.21.15.170:0/4223604142 <== mon.0 v2:172.21.15.170:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec018b80 con 0x7f62f0101810 2024-01-25T15:05:25.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.416+0000 7f62f7e99640 1 -- 172.21.15.170:0/4223604142 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f019f2f0 con 0x7f62f0101810 2024-01-25T15:05:25.420 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.417+0000 7f62f7e99640 1 -- 172.21.15.170:0/4223604142 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f00fcc70 con 0x7f62f0101810 2024-01-25T15:05:25.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.418+0000 7f62e6ffd640 1 -- 172.21.15.170:0/4223604142 <== mon.0 v2:172.21.15.170:3300/0 4 ==== mgrmap(e 20) v1 ==== 135896+0+0 (secure 0 0 0) 0x7f62ec018ce0 con 0x7f62f0101810 2024-01-25T15:05:25.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.419+0000 7f62e6ffd640 1 --2- 172.21.15.170:0/4223604142 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f62dc0a12e0 0x7f62dc0a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-25T15:05:25.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.419+0000 7f62f5434640 1 --2- 172.21.15.170:0/4223604142 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f62dc0a12e0 0x7f62dc0a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-25T15:05:25.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.419+0000 7f62e6ffd640 1 -- 172.21.15.170:0/4223604142 <== mon.0 v2:172.21.15.170:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8058+0+0 (secure 0 0 0) 0x7f62ec0cd350 con 0x7f62f0101810 2024-01-25T15:05:25.421 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.419+0000 7f62f5434640 1 --2- 172.21.15.170:0/4223604142 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f62dc0a12e0 0x7f62dc0a37a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f62e002c6b0 tx=0x7f62e002c5d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-25T15:05:25.423 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.422+0000 7f62e6ffd640 1 -- 172.21.15.170:0/4223604142 <== mon.0 v2:172.21.15.170:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181732 (secure 0 0 0) 0x7f62ec0968b0 con 0x7f62f0101810 2024-01-25T15:05:25.596 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:25.595+0000 7f62f7e99640 1 -- 172.21.15.170:0/4223604142 --> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f62f010c600 con 0x7f62f0101810 2024-01-25T15:05:25.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: pgmap v452: 97 pgs: 97 active+clean; 30 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-01-25T15:05:25.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-01-25T15:05:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-01-25T15:05:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: Cluster is now healthy 2024-01-25T15:05:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3484689213' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-01-25T15:05:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.191:6834/2786590463,v1:172.21.15.191:6835/2786590463] up:boot 2024-01-25T15:05:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.186:6836/1102962427,v1:172.21.15.186:6838/1102962427] up:boot 2024-01-25T15:05:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.170:6838/3174781271,v1:172.21.15.170:6839/3174781271] up:boot 2024-01-25T15:05:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.186:6837/2156338136,v1:172.21.15.186:6839/2156338136] up:boot 2024-01-25T15:05:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.191:6837/1273157899,v1:172.21.15.191:6839/1273157899] up:boot 2024-01-25T15:05:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.191:6836/1845526415,v1:172.21.15.191:6838/1845526415] up:boot 2024-01-25T15:05:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.186:6832/2451687863,v1:172.21.15.186:6834/2451687863] up:boot 2024-01-25T15:05:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.186:6833/2992502042,v1:172.21.15.186:6835/2992502042] up:boot 2024-01-25T15:05:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.191:6832/441534795,v1:172.21.15.191:6833/441534795] up:boot 2024-01-25T15:05:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: mds.? [v2:172.21.15.170:6840/2953375071,v1:172.21.15.170:6841/2953375071] up:boot 2024-01-25T15:05:25.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: fsmap 12 up:standby 2024-01-25T15:05:25.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-01-25T15:05:25.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-25T15:05:25.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-25T15:05:25.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-25T15:05:25.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-01-25T15:05:25.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-01-25T15:05:25.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-01-25T15:05:25.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-01-25T15:05:25.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-01-25T15:05:25.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-01-25T15:05:25.606 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:25 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3617425706' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-25T15:05:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: pgmap v452: 97 pgs: 97 active+clean; 30 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-01-25T15:05:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-01-25T15:05:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-01-25T15:05:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: Cluster is now healthy 2024-01-25T15:05:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3484689213' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-01-25T15:05:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.191:6834/2786590463,v1:172.21.15.191:6835/2786590463] up:boot 2024-01-25T15:05:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.186:6836/1102962427,v1:172.21.15.186:6838/1102962427] up:boot 2024-01-25T15:05:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.170:6838/3174781271,v1:172.21.15.170:6839/3174781271] up:boot 2024-01-25T15:05:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.186:6837/2156338136,v1:172.21.15.186:6839/2156338136] up:boot 2024-01-25T15:05:25.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.191:6837/1273157899,v1:172.21.15.191:6839/1273157899] up:boot 2024-01-25T15:05:25.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.191:6836/1845526415,v1:172.21.15.191:6838/1845526415] up:boot 2024-01-25T15:05:25.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.186:6832/2451687863,v1:172.21.15.186:6834/2451687863] up:boot 2024-01-25T15:05:25.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.186:6833/2992502042,v1:172.21.15.186:6835/2992502042] up:boot 2024-01-25T15:05:25.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.191:6832/441534795,v1:172.21.15.191:6833/441534795] up:boot 2024-01-25T15:05:25.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: mds.? [v2:172.21.15.170:6840/2953375071,v1:172.21.15.170:6841/2953375071] up:boot 2024-01-25T15:05:25.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: fsmap 12 up:standby 2024-01-25T15:05:25.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-01-25T15:05:25.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-25T15:05:25.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-25T15:05:25.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-25T15:05:25.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-01-25T15:05:25.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-01-25T15:05:25.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-01-25T15:05:25.625 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-01-25T15:05:25.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-01-25T15:05:25.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-01-25T15:05:25.626 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:25 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3617425706' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-25T15:05:25.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: pgmap v452: 97 pgs: 97 active+clean; 30 MiB data, 822 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.1 KiB/s wr, 13 op/s 2024-01-25T15:05:25.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-01-25T15:05:25.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-01-25T15:05:25.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: Cluster is now healthy 2024-01-25T15:05:25.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3484689213' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-01-25T15:05:25.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.191:6834/2786590463,v1:172.21.15.191:6835/2786590463] up:boot 2024-01-25T15:05:25.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.186:6836/1102962427,v1:172.21.15.186:6838/1102962427] up:boot 2024-01-25T15:05:25.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.170:6838/3174781271,v1:172.21.15.170:6839/3174781271] up:boot 2024-01-25T15:05:25.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.186:6837/2156338136,v1:172.21.15.186:6839/2156338136] up:boot 2024-01-25T15:05:25.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.191:6837/1273157899,v1:172.21.15.191:6839/1273157899] up:boot 2024-01-25T15:05:25.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.191:6836/1845526415,v1:172.21.15.191:6838/1845526415] up:boot 2024-01-25T15:05:25.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.186:6832/2451687863,v1:172.21.15.186:6834/2451687863] up:boot 2024-01-25T15:05:25.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.186:6833/2992502042,v1:172.21.15.186:6835/2992502042] up:boot 2024-01-25T15:05:25.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.191:6832/441534795,v1:172.21.15.191:6833/441534795] up:boot 2024-01-25T15:05:25.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: mds.? [v2:172.21.15.170:6840/2953375071,v1:172.21.15.170:6841/2953375071] up:boot 2024-01-25T15:05:25.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: fsmap 12 up:standby 2024-01-25T15:05:25.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-01-25T15:05:25.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-01-25T15:05:25.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-01-25T15:05:25.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-01-25T15:05:25.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-01-25T15:05:25.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-01-25T15:05:25.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-01-25T15:05:25.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-01-25T15:05:25.735 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-01-25T15:05:25.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: from='mgr.14152 172.21.15.170:0/803956787' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-01-25T15:05:25.736 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:25 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3617425706' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-25T15:05:26.295 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:26.294+0000 7f62e6ffd640 1 -- 172.21.15.170:0/4223604142 <== mon.0 v2:172.21.15.170:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v90) v1 ==== 169+0+0 (secure 0 0 0) 0x7f62ec099ed0 con 0x7f62f0101810 2024-01-25T15:05:26.295 INFO:teuthology.orchestra.run.smithi170.stderr:pool 'cephfs_data' removed 2024-01-25T15:05:26.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:26.298+0000 7f62f7e99640 1 -- 172.21.15.170:0/4223604142 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f62dc0a12e0 msgr2=0x7f62dc0a37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:26.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:26.298+0000 7f62f7e99640 1 --2- 172.21.15.170:0/4223604142 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f62dc0a12e0 0x7f62dc0a37a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f62e002c6b0 tx=0x7f62e002c5d0 comp rx=0 tx=0).stop 2024-01-25T15:05:26.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:26.298+0000 7f62f7e99640 1 -- 172.21.15.170:0/4223604142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62f0101810 msgr2=0x7f62f0196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-25T15:05:26.299 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:26.298+0000 7f62f7e99640 1 --2- 172.21.15.170:0/4223604142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62f0101810 0x7f62f0196d00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00cce0 tx=0x7f62ec00a620 comp rx=0 tx=0).stop 2024-01-25T15:05:26.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:26.299+0000 7f62f7e99640 1 -- 172.21.15.170:0/4223604142 shutdown_connections 2024-01-25T15:05:26.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:26.299+0000 7f62f7e99640 1 --2- 172.21.15.170:0/4223604142 >> [v2:172.21.15.170:6800/3767785684,v1:172.21.15.170:6801/3767785684] conn(0x7f62dc0a12e0 0x7f62dc0a37a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:26.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:26.299+0000 7f62f7e99640 1 --2- 172.21.15.170:0/4223604142 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f62f0106a70 0x7f62f019e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:26.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:26.299+0000 7f62f7e99640 1 --2- 172.21.15.170:0/4223604142 >> [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] conn(0x7f62f0104140 0x7f62f0197240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:26.301 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:26.299+0000 7f62f7e99640 1 --2- 172.21.15.170:0/4223604142 >> [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] conn(0x7f62f0101810 0x7f62f0196d00 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-25T15:05:26.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:26.299+0000 7f62f7e99640 1 -- 172.21.15.170:0/4223604142 >> 172.21.15.170:0/4223604142 conn(0x7f62f00fb180 msgr2=0x7f62f0102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-25T15:05:26.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:26.300+0000 7f62f7e99640 1 -- 172.21.15.170:0/4223604142 shutdown_connections 2024-01-25T15:05:26.302 INFO:teuthology.orchestra.run.smithi170.stderr:2024-01-25T15:05:26.300+0000 7f62f7e99640 1 -- 172.21.15.170:0/4223604142 wait complete. 2024-01-25T15:05:26.318 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-25T15:05:26.347 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-25T15:05:26.378 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-25T15:05:26.410 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-01-25T15:05:26.410 DEBUG:teuthology.orchestra.run.smithi170:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-01-25T15:05:26.425 DEBUG:teuthology.orchestra.run.smithi186:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-01-25T15:05:26.441 DEBUG:teuthology.orchestra.run.smithi191:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-01-25T15:05:26.466 INFO:tasks.cephadm:Stopping all daemons... 2024-01-25T15:05:26.466 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-01-25T15:05:26.467 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mon.a 2024-01-25T15:05:26.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:26 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/3617425706' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-01-25T15:05:26.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:26 smithi186 ceph-mon[35697]: osdmap e89: 12 total, 12 up, 12 in 2024-01-25T15:05:26.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:26 smithi186 ceph-mon[35697]: from='client.? 172.21.15.170:0/4223604142' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-25T15:05:26.623 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:26 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/3617425706' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-01-25T15:05:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:26 smithi170 ceph-mon[31899]: osdmap e89: 12 total, 12 up, 12 in 2024-01-25T15:05:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:26 smithi170 ceph-mon[31899]: from='client.? 172.21.15.170:0/4223604142' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-25T15:05:26.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:26 smithi170 systemd[1]: Stopping Ceph mon.a for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:05:26.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:26 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/3617425706' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-01-25T15:05:26.733 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:26 smithi191 ceph-mon[36347]: osdmap e89: 12 total, 12 up, 12 in 2024-01-25T15:05:26.734 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:26 smithi191 ceph-mon[36347]: from='client.? 172.21.15.170:0/4223604142' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-01-25T15:05:27.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:26 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a[31895]: 2024-01-25T15:05:26.776+0000 7f06c50a4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:05:27.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:26 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a[31895]: 2024-01-25T15:05:26.776+0000 7f06c50a4700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-01-25T15:05:27.124 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:27 smithi170 podman[90685]: 2024-01-25 15:05:27.012602657 +0000 UTC m=+0.350625236 container died a97f19dae568adbb1350344f267d9d7d47d72bb8b94335571e4f4ec6cae9eb90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T15:05:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:27 smithi170 podman[90685]: 2024-01-25 15:05:27.519326714 +0000 UTC m=+0.857349296 container cleanup a97f19dae568adbb1350344f267d9d7d47d72bb8b94335571e4f4ec6cae9eb90 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, org.label-schema.license=GPLv2) 2024-01-25T15:05:27.624 INFO:journalctl@ceph.mon.a.smithi170.stdout:Jan 25 15:05:27 smithi170 bash[90685]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-a 2024-01-25T15:05:27.857 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mon.a.service' 2024-01-25T15:05:27.903 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:05:27.904 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-01-25T15:05:27.904 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-01-25T15:05:27.904 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mon.b 2024-01-25T15:05:28.246 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:27 smithi186 systemd[1]: Stopping Ceph mon.b for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:05:28.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:28 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-b[35692]: 2024-01-25T15:05:28.244+0000 7f2968933700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:05:28.604 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:28 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-b[35692]: 2024-01-25T15:05:28.244+0000 7f2968933700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-01-25T15:05:28.605 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:28 smithi186 podman[70225]: 2024-01-25 15:05:28.439831081 +0000 UTC m=+0.331163710 container died 59459cc2b14154a573a1178bfb180435f87adccacd9eb27b57515f7589de6bf6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-01-25T15:05:29.063 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:28 smithi186 podman[70225]: 2024-01-25 15:05:28.812004505 +0000 UTC m=+0.703337137 container cleanup 59459cc2b14154a573a1178bfb180435f87adccacd9eb27b57515f7589de6bf6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T15:05:29.063 INFO:journalctl@ceph.mon.b.smithi186.stdout:Jan 25 15:05:28 smithi186 bash[70225]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-b 2024-01-25T15:05:29.190 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mon.b.service' 2024-01-25T15:05:29.241 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:05:29.241 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-01-25T15:05:29.241 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-01-25T15:05:29.241 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mon.c 2024-01-25T15:05:29.548 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:29 smithi191 systemd[1]: Stopping Ceph mon.c for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:05:29.924 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:29 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-c[36343]: 2024-01-25T15:05:29.546+0000 7f518378c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:05:29.924 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:29 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-c[36343]: 2024-01-25T15:05:29.546+0000 7f518378c700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-01-25T15:05:29.924 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:29 smithi191 podman[71067]: 2024-01-25 15:05:29.649585289 +0000 UTC m=+0.216733359 container died 64aefc2b8f6c2bda8ab34db7de3294a51e23f46482be24d9d20d7e35d7c58499 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-c, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0) 2024-01-25T15:05:30.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:30 smithi191 podman[71067]: 2024-01-25 15:05:30.015066781 +0000 UTC m=+0.582214891 container cleanup 64aefc2b8f6c2bda8ab34db7de3294a51e23f46482be24d9d20d7e35d7c58499 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-c, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T15:05:30.233 INFO:journalctl@ceph.mon.c.smithi191.stdout:Jan 25 15:05:30 smithi191 bash[71067]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mon-c 2024-01-25T15:05:30.440 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mon.c.service' 2024-01-25T15:05:30.489 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:05:30.489 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-01-25T15:05:30.490 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-01-25T15:05:30.490 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mgr.x 2024-01-25T15:05:30.816 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 15:05:30 smithi170 systemd[1]: Stopping Ceph mgr.x for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:05:31.092 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 15:05:30 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T15:05:30.815+0000 7f65f5888700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:05:31.092 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 15:05:30 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x[32124]: 2024-01-25T15:05:30.815+0000 7f65f5888700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-01-25T15:05:31.092 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 15:05:30 smithi170 podman[90807]: 2024-01-25 15:05:30.846671516 +0000 UTC m=+0.153597779 container died 2dfaab9a732b9afdd8f27b091a178579dd5cdf4fb3ef029bf2568a204e4a8935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-01-25T15:05:31.374 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 15:05:31 smithi170 podman[90807]: 2024-01-25 15:05:31.258250958 +0000 UTC m=+0.565177213 container cleanup 2dfaab9a732b9afdd8f27b091a178579dd5cdf4fb3ef029bf2568a204e4a8935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3) 2024-01-25T15:05:31.374 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 15:05:31 smithi170 bash[90807]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x 2024-01-25T15:05:31.673 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mgr.x.service' 2024-01-25T15:05:31.697 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 15:05:31 smithi170 podman[90822]: 2024-01-25 15:05:31.443213587 +0000 UTC m=+0.593892076 container remove 2dfaab9a732b9afdd8f27b091a178579dd5cdf4fb3ef029bf2568a204e4a8935 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:661946e7044723130c03627323f6a879a9848cb5, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-x, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240123, ceph=True, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T15:05:31.698 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 15:05:31 smithi170 systemd[1]: ceph-267213a8-bb91-11ee-95b2-87774f69a715@mgr.x.service: Deactivated successfully. 2024-01-25T15:05:31.698 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 15:05:31 smithi170 systemd[1]: Stopped Ceph mgr.x for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T15:05:31.698 INFO:journalctl@ceph.mgr.x.smithi170.stdout:Jan 25 15:05:31 smithi170 systemd[1]: ceph-267213a8-bb91-11ee-95b2-87774f69a715@mgr.x.service: Consumed 57.598s CPU time. 2024-01-25T15:05:31.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:05:31.711 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-01-25T15:05:31.712 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-01-25T15:05:31.712 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mgr.y 2024-01-25T15:05:32.037 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 15:05:31 smithi186 systemd[1]: Stopping Ceph mgr.y for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:05:32.325 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 15:05:32 smithi186 podman[70349]: 2024-01-25 15:05:32.03716872 +0000 UTC m=+0.134332048 container died 12182a542c3e3def288cf6e5ddc12400d2c86f633039c1c4eabccaafd8efa6e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-01-25T15:05:32.604 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 15:05:32 smithi186 podman[70349]: 2024-01-25 15:05:32.424571932 +0000 UTC m=+0.521735307 container cleanup 12182a542c3e3def288cf6e5ddc12400d2c86f633039c1c4eabccaafd8efa6e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-01-25T15:05:32.604 INFO:journalctl@ceph.mgr.y.smithi186.stdout:Jan 25 15:05:32 smithi186 bash[70349]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-y 2024-01-25T15:05:32.805 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mgr.y.service' 2024-01-25T15:05:32.842 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:05:32.842 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-01-25T15:05:32.842 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-01-25T15:05:32.842 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mgr.z 2024-01-25T15:05:33.150 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 15:05:32 smithi191 systemd[1]: Stopping Ceph mgr.z for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:05:33.406 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 15:05:33 smithi191 podman[71190]: 2024-01-25 15:05:33.150428477 +0000 UTC m=+0.108049221 container died d0dadc34146bbe7a19b6b1cb58dabd2f21b8a52b956712bb732052459497cc4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T15:05:33.733 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 15:05:33 smithi191 podman[71190]: 2024-01-25 15:05:33.513642847 +0000 UTC m=+0.471263572 container cleanup d0dadc34146bbe7a19b6b1cb58dabd2f21b8a52b956712bb732052459497cc4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-01-25T15:05:33.733 INFO:journalctl@ceph.mgr.z.smithi191.stdout:Jan 25 15:05:33 smithi191 bash[71190]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mgr-z 2024-01-25T15:05:33.948 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mgr.z.service' 2024-01-25T15:05:33.986 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:05:33.986 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-01-25T15:05:33.986 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-01-25T15:05:33.986 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.0 2024-01-25T15:05:34.296 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 15:05:34 smithi170 systemd[1]: Stopping Ceph osd.0 for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:05:34.624 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 15:05:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-0[46420]: 2024-01-25T15:05:34.295+0000 7f3307f6d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:05:34.624 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 15:05:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-0[46420]: 2024-01-25T15:05:34.295+0000 7f3307f6d700 -1 osd.0 90 *** Got signal Terminated *** 2024-01-25T15:05:34.624 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 15:05:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-0[46420]: 2024-01-25T15:05:34.295+0000 7f3307f6d700 -1 osd.0 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-25T15:05:40.047 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 15:05:39 smithi170 podman[90932]: 2024-01-25 15:05:39.789699157 +0000 UTC m=+5.610579583 container died 4a808e0575da4a2f71a3cb4a5d3c5e04158a568d8d3e763c1c36de55bd13eacc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, io.buildah.version=1.31.3, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-01-25T15:05:40.374 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 15:05:40 smithi170 podman[90932]: 2024-01-25 15:05:40.204806671 +0000 UTC m=+6.025687142 container cleanup 4a808e0575da4a2f71a3cb4a5d3c5e04158a568d8d3e763c1c36de55bd13eacc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-0, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-01-25T15:05:40.374 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 15:05:40 smithi170 bash[90932]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-0 2024-01-25T15:05:40.827 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 15:05:40 smithi170 podman[90948]: 2024-01-25 15:05:40.406109734 +0000 UTC m=+0.613673854 container remove 4a808e0575da4a2f71a3cb4a5d3c5e04158a568d8d3e763c1c36de55bd13eacc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-0, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-25T15:05:41.079 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 15:05:40 smithi170 podman[91034]: 2024-01-25 15:05:40.730174781 +0000 UTC m=+0.018330469 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T15:05:41.079 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 15:05:40 smithi170 podman[91034]: 2024-01-25 15:05:40.840158788 +0000 UTC m=+0.128314510 container create ad6f9475614bb031d47fd6821877359cc2b6b6a0b14ffb879768e03fa04e28c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, ceph=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.31.3) 2024-01-25T15:05:41.079 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 15:05:41 smithi170 podman[91034]: 2024-01-25 15:05:41.075937971 +0000 UTC m=+0.364093651 container init ad6f9475614bb031d47fd6821877359cc2b6b6a0b14ffb879768e03fa04e28c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, GIT_CLEAN=True, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True) 2024-01-25T15:05:41.079 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 15:05:41 smithi170 podman[91034]: 2024-01-25 15:05:41.078961801 +0000 UTC m=+0.367117483 container start ad6f9475614bb031d47fd6821877359cc2b6b6a0b14ffb879768e03fa04e28c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, ceph=True, io.buildah.version=1.31.3) 2024-01-25T15:05:41.359 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 15:05:41 smithi170 podman[91034]: 2024-01-25 15:05:41.176064665 +0000 UTC m=+0.464220364 container attach ad6f9475614bb031d47fd6821877359cc2b6b6a0b14ffb879768e03fa04e28c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T15:05:41.624 INFO:journalctl@ceph.osd.0.smithi170.stdout:Jan 25 15:05:41 smithi170 podman[91034]: 2024-01-25 15:05:41.359890348 +0000 UTC m=+0.648046045 container died ad6f9475614bb031d47fd6821877359cc2b6b6a0b14ffb879768e03fa04e28c3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-0-deactivate, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.31.3) 2024-01-25T15:05:42.003 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.0.service' 2024-01-25T15:05:42.044 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:05:42.045 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-01-25T15:05:42.045 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-01-25T15:05:42.045 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.1 2024-01-25T15:05:42.346 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 15:05:42 smithi186 systemd[1]: Stopping Ceph osd.1 for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:05:42.604 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 15:05:42 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-1[40320]: 2024-01-25T15:05:42.344+0000 7fc37f46a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:05:42.604 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 15:05:42 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-1[40320]: 2024-01-25T15:05:42.344+0000 7fc37f46a700 -1 osd.1 90 *** Got signal Terminated *** 2024-01-25T15:05:42.605 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 15:05:42 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-1[40320]: 2024-01-25T15:05:42.344+0000 7fc37f46a700 -1 osd.1 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-25T15:05:48.129 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 15:05:47 smithi186 podman[70484]: 2024-01-25 15:05:47.855854209 +0000 UTC m=+5.600565058 container died d6d8b78fe6f4ca407eee1dbd63dd9b902605896cc653902532df0f6482d5b66f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-1, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-01-25T15:05:48.396 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 15:05:48 smithi186 podman[70484]: 2024-01-25 15:05:48.203439854 +0000 UTC m=+5.948150694 container cleanup d6d8b78fe6f4ca407eee1dbd63dd9b902605896cc653902532df0f6482d5b66f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0) 2024-01-25T15:05:48.396 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 15:05:48 smithi186 bash[70484]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-1 2024-01-25T15:05:48.813 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 15:05:48 smithi186 podman[70504]: 2024-01-25 15:05:48.396198812 +0000 UTC m=+0.537691755 container remove d6d8b78fe6f4ca407eee1dbd63dd9b902605896cc653902532df0f6482d5b66f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-1, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-01-25T15:05:49.083 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 15:05:48 smithi186 podman[70598]: 2024-01-25 15:05:48.7164537 +0000 UTC m=+0.017363678 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T15:05:49.083 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 15:05:48 smithi186 podman[70598]: 2024-01-25 15:05:48.847087213 +0000 UTC m=+0.147997188 container create 0ad879c7807fc02c420f6aefccff17bff825f2b88dd3fef2f63a81d543383c0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3) 2024-01-25T15:05:49.355 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 15:05:49 smithi186 podman[70598]: 2024-01-25 15:05:49.082958405 +0000 UTC m=+0.383868379 container init 0ad879c7807fc02c420f6aefccff17bff825f2b88dd3fef2f63a81d543383c0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-1-deactivate, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, io.buildah.version=1.31.3) 2024-01-25T15:05:49.355 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 15:05:49 smithi186 podman[70598]: 2024-01-25 15:05:49.086501673 +0000 UTC m=+0.387411652 container start 0ad879c7807fc02c420f6aefccff17bff825f2b88dd3fef2f63a81d543383c0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-25T15:05:49.355 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 15:05:49 smithi186 podman[70598]: 2024-01-25 15:05:49.17481003 +0000 UTC m=+0.475720004 container attach 0ad879c7807fc02c420f6aefccff17bff825f2b88dd3fef2f63a81d543383c0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3) 2024-01-25T15:05:49.669 INFO:journalctl@ceph.osd.1.smithi186.stdout:Jan 25 15:05:49 smithi186 podman[70598]: 2024-01-25 15:05:49.365508299 +0000 UTC m=+0.666418264 container died 0ad879c7807fc02c420f6aefccff17bff825f2b88dd3fef2f63a81d543383c0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-01-25T15:05:49.963 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.1.service' 2024-01-25T15:05:50.004 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:05:50.004 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-01-25T15:05:50.004 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-01-25T15:05:50.004 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.2 2024-01-25T15:05:50.310 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:50 smithi191 systemd[1]: Stopping Ceph osd.2 for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:05:50.733 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:50 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-2[41508]: 2024-01-25T15:05:50.309+0000 7f3966eb9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:05:50.734 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:50 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-2[41508]: 2024-01-25T15:05:50.309+0000 7f3966eb9700 -1 osd.2 90 *** Got signal Terminated *** 2024-01-25T15:05:50.734 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:50 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-2[41508]: 2024-01-25T15:05:50.309+0000 7f3966eb9700 -1 osd.2 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-25T15:05:56.145 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:55 smithi191 podman[71329]: 2024-01-25 15:05:55.840587436 +0000 UTC m=+5.632686571 container died f08add379509638b66e7112b8b8431576e59cbb7784ff457f114b7c0261328b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T15:05:56.421 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:56 smithi191 podman[71329]: 2024-01-25 15:05:56.23609339 +0000 UTC m=+6.028192534 container cleanup f08add379509638b66e7112b8b8431576e59cbb7784ff457f114b7c0261328b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.build-date=20240123, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T15:05:56.421 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:56 smithi191 bash[71329]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-2 2024-01-25T15:05:56.733 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:56 smithi191 podman[71348]: 2024-01-25 15:05:56.421411751 +0000 UTC m=+0.572439322 container remove f08add379509638b66e7112b8b8431576e59cbb7784ff457f114b7c0261328b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T15:05:57.151 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:56 smithi191 podman[71437]: 2024-01-25 15:05:56.839269574 +0000 UTC m=+0.112509389 container create 0ee898d02975f62cfb79e72fea60ad28c30a534ead1d32cba65b7c8ce7e48988 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-01-25T15:05:57.151 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:56 smithi191 podman[71437]: 2024-01-25 15:05:56.744841399 +0000 UTC m=+0.018081208 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T15:05:57.151 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:57 smithi191 podman[71437]: 2024-01-25 15:05:57.068053048 +0000 UTC m=+0.341292860 container init 0ee898d02975f62cfb79e72fea60ad28c30a534ead1d32cba65b7c8ce7e48988 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20240123, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3) 2024-01-25T15:05:57.151 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:57 smithi191 podman[71437]: 2024-01-25 15:05:57.071441865 +0000 UTC m=+0.344681669 container start 0ee898d02975f62cfb79e72fea60ad28c30a534ead1d32cba65b7c8ce7e48988 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-01-25T15:05:57.151 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:57 smithi191 podman[71437]: 2024-01-25 15:05:57.150817505 +0000 UTC m=+0.424057324 container attach 0ee898d02975f62cfb79e72fea60ad28c30a534ead1d32cba65b7c8ce7e48988 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, GIT_CLEAN=True) 2024-01-25T15:05:57.484 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:57 smithi191 podman[71437]: 2024-01-25 15:05:57.352212505 +0000 UTC m=+0.625452292 container died 0ee898d02975f62cfb79e72fea60ad28c30a534ead1d32cba65b7c8ce7e48988 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-01-25T15:05:57.883 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.2.service' 2024-01-25T15:05:57.908 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:57 smithi191 podman[71463]: 2024-01-25 15:05:57.864202507 +0000 UTC m=+0.506770848 container remove 0ee898d02975f62cfb79e72fea60ad28c30a534ead1d32cba65b7c8ce7e48988 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T15:05:57.908 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:57 smithi191 systemd[1]: ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.2.service: Deactivated successfully. 2024-01-25T15:05:57.908 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:57 smithi191 systemd[1]: Stopped Ceph osd.2 for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T15:05:57.908 INFO:journalctl@ceph.osd.2.smithi191.stdout:Jan 25 15:05:57 smithi191 systemd[1]: ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.2.service: Consumed 28.510s CPU time. 2024-01-25T15:05:57.924 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:05:57.924 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-01-25T15:05:57.924 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-01-25T15:05:57.924 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.3 2024-01-25T15:05:58.224 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 15:05:57 smithi170 systemd[1]: Stopping Ceph osd.3 for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:05:58.493 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 15:05:58 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-3[53398]: 2024-01-25T15:05:58.223+0000 7f5130142700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:05:58.494 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 15:05:58 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-3[53398]: 2024-01-25T15:05:58.223+0000 7f5130142700 -1 osd.3 90 *** Got signal Terminated *** 2024-01-25T15:05:58.494 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 15:05:58 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-3[53398]: 2024-01-25T15:05:58.223+0000 7f5130142700 -1 osd.3 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-25T15:06:01.984 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:01 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:01.486+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:02.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:02 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:02.122+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:02.523 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:02 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:02.266+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:02.854 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:02 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:02.559+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:02.983 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:02 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:02.523+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:03.489 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:03 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:03.238+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:03.623 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:03 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:03.124+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:03.854 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:03 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:03.565+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:03.974 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 15:06:03 smithi170 podman[91140]: 2024-01-25 15:06:03.718197587 +0000 UTC m=+5.599024372 container died dbfb28138440f77b528908bf474599cd73ce12dd5672ce0eba44aadc90e6530b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T15:06:03.983 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:03 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:03.489+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:04.327 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:04 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:04.034+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:04.328 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:04 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:04.108+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:04.328 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 15:06:04 smithi170 podman[91140]: 2024-01-25 15:06:04.157425598 +0000 UTC m=+6.038252381 container cleanup dbfb28138440f77b528908bf474599cd73ce12dd5672ce0eba44aadc90e6530b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T15:06:04.328 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 15:06:04 smithi170 bash[91140]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-3 2024-01-25T15:06:04.483 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:04 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:04.225+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:04.624 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 15:06:04 smithi170 podman[91169]: 2024-01-25 15:06:04.325550961 +0000 UTC m=+0.604898264 container remove dbfb28138440f77b528908bf474599cd73ce12dd5672ce0eba44aadc90e6530b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS) 2024-01-25T15:06:04.854 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:04 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:04.578+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:04.983 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:04 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:04.528+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:05.006 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 15:06:04 smithi170 podman[91258]: 2024-01-25 15:06:04.628550687 +0000 UTC m=+0.017655304 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T15:06:05.006 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 15:06:04 smithi170 podman[91258]: 2024-01-25 15:06:04.751462463 +0000 UTC m=+0.140567075 container create 0bfe1b5dcd373c25613897edcb6374ec783172fffea984d0cf37bc4d142ffe9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123) 2024-01-25T15:06:05.299 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:05 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:05.078+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:05.299 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:05 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:05.005+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:05.299 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 15:06:05 smithi170 podman[91258]: 2024-01-25 15:06:05.010247331 +0000 UTC m=+0.399351944 container init 0bfe1b5dcd373c25613897edcb6374ec783172fffea984d0cf37bc4d142ffe9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-01-25T15:06:05.299 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 15:06:05 smithi170 podman[91258]: 2024-01-25 15:06:05.013531644 +0000 UTC m=+0.402636263 container start 0bfe1b5dcd373c25613897edcb6374ec783172fffea984d0cf37bc4d142ffe9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, ceph=True) 2024-01-25T15:06:05.299 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 15:06:05 smithi170 podman[91258]: 2024-01-25 15:06:05.103823981 +0000 UTC m=+0.492928610 container attach 0bfe1b5dcd373c25613897edcb6374ec783172fffea984d0cf37bc4d142ffe9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T15:06:05.483 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:05 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:05.195+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:05.598 INFO:journalctl@ceph.osd.3.smithi170.stdout:Jan 25 15:06:05 smithi170 podman[91258]: 2024-01-25 15:06:05.299786569 +0000 UTC m=+0.688891190 container died 0bfe1b5dcd373c25613897edcb6374ec783172fffea984d0cf37bc4d142ffe9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-3-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-01-25T15:06:05.854 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:05 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:05.598+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:05.948 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.3.service' 2024-01-25T15:06:05.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:05 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:05.600+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:05.984 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:05 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:05.563+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:05.993 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:06:05.993 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-01-25T15:06:05.993 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-01-25T15:06:05.993 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.4 2024-01-25T15:06:06.297 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:06 smithi186 systemd[1]: Stopping Ceph osd.4 for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:06:06.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:06 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:06.038+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:06.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:06 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:06.096+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:06.525 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:06 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:06.237+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:06.598 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:06 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4[47323]: 2024-01-25T15:06:06.296+0000 7f7a7a8f0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:06:06.598 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:06 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4[47323]: 2024-01-25T15:06:06.296+0000 7f7a7a8f0700 -1 osd.4 90 *** Got signal Terminated *** 2024-01-25T15:06:06.598 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:06 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4[47323]: 2024-01-25T15:06:06.296+0000 7f7a7a8f0700 -1 osd.4 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-25T15:06:06.854 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:06 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:06.597+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:06.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:06 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:06.620+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:06.983 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:06 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:06.525+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:07.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:07 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:07.060+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:07.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:07 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:07.066+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:07.483 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:07 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:07.196+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:07.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:07 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:07.641+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:07.984 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:07 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:07.551+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:08.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:07 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:07.627+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:08.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:08 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:08.029+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:08.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:08 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:08.071+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:08.483 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:08 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:08.224+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:08.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:08 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:08.624+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:08.983 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:08 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:08.545+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:08.984 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:08 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:08.545+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:09.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:08 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:08.654+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:09.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:09 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:09.053+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:09.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:09 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:09.082+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:09.604 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:09 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4[47323]: 2024-01-25T15:06:09.353+0000 7f7a776ec700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.373382+0000 front 2024-01-25T15:05:43.373369+0000 (oldest deadline 2024-01-25T15:06:08.673414+0000) 2024-01-25T15:06:09.605 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:09 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:09.252+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:09.605 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:09 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:09.270+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:09.605 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:09 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:09.514+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:09.606 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:09 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:09.514+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:09.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:09 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:09.605+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:10.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:09 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:09.699+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:10.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:10 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:10.067+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:10.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:10 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:10.067+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:10.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:10 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:10.080+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:10.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:10 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:10.080+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:10.483 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:10 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:10.291+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:10.604 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:10 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4[47323]: 2024-01-25T15:06:10.387+0000 7f7a776ec700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.373382+0000 front 2024-01-25T15:05:43.373369+0000 (oldest deadline 2024-01-25T15:06:08.673414+0000) 2024-01-25T15:06:10.605 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:10 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:10.236+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:10.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:10 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:10.643+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:10.984 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:10 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:10.643+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:10.984 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:10 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:10.519+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:10.984 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:10 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:10.519+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:11.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:10 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:10.695+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:11.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:11 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:11.102+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:11.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:11 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:11.102+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:11.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:11 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:11.037+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:11.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:11 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:11.037+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:11.504 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:11 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:11.242+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:11.504 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:11 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:11.242+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.752510+0000 front 2024-01-25T15:05:45.752411+0000 (oldest deadline 2024-01-25T15:06:10.452477+0000) 2024-01-25T15:06:11.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:11 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:11.272+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:11.779 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:11 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:11.660+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:11.779 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:11 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:11.660+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:11.779 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:11 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:11.502+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:11.780 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:11 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:11.502+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:11.981 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:11 smithi186 podman[70704]: 2024-01-25 15:06:11.703888341 +0000 UTC m=+5.514373319 container died 29e732d33db4235239967f1d21251c3dcd5fd80aef2b2afb0fada1732d3fde77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, ceph=True, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T15:06:11.981 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:11 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:11.732+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:11.981 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:11 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:11.732+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:12.306 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:12 smithi186 podman[70704]: 2024-01-25 15:06:12.071974554 +0000 UTC m=+5.882459524 container cleanup 29e732d33db4235239967f1d21251c3dcd5fd80aef2b2afb0fada1732d3fde77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4, GIT_CLEAN=True, ceph=True, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2) 2024-01-25T15:06:12.306 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:12 smithi186 bash[70704]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4 2024-01-25T15:06:12.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:12 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:12.123+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:12.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:12 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:12.123+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:12.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:12 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:12.057+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:12.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:12 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:12.057+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:12.604 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:12 smithi186 podman[70722]: 2024-01-25 15:06:12.32304625 +0000 UTC m=+0.613899486 container remove 29e732d33db4235239967f1d21251c3dcd5fd80aef2b2afb0fada1732d3fde77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-01-25T15:06:12.605 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:12 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:12.305+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:12.632 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:12 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:12.274+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:12.632 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:12 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:12.274+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.752510+0000 front 2024-01-25T15:05:45.752411+0000 (oldest deadline 2024-01-25T15:06:10.452477+0000) 2024-01-25T15:06:12.633 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:12 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:12.481+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:12.633 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:12 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:12.481+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:12.926 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:12 smithi186 podman[70813]: 2024-01-25 15:06:12.578567151 +0000 UTC m=+0.017768558 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T15:06:12.926 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:12 smithi186 podman[70813]: 2024-01-25 15:06:12.690805037 +0000 UTC m=+0.130006432 container create fed703d018ad2c132eb78a797f95dd1b5e573c4fd1c8bfe931531766709f19be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-01-25T15:06:12.926 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:12 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:12.720+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:12.926 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:12 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:12.720+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:12.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:12 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:12.631+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:12.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:12 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:12.631+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:13.210 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:12 smithi186 podman[70813]: 2024-01-25 15:06:12.926476102 +0000 UTC m=+0.365677502 container init fed703d018ad2c132eb78a797f95dd1b5e573c4fd1c8bfe931531766709f19be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4-deactivate, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T15:06:13.210 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:12 smithi186 podman[70813]: 2024-01-25 15:06:12.929647686 +0000 UTC m=+0.368849072 container start fed703d018ad2c132eb78a797f95dd1b5e573c4fd1c8bfe931531766709f19be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4-deactivate, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T15:06:13.210 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:13 smithi186 podman[70813]: 2024-01-25 15:06:13.034836852 +0000 UTC m=+0.474038257 container attach fed703d018ad2c132eb78a797f95dd1b5e573c4fd1c8bfe931531766709f19be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True) 2024-01-25T15:06:13.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:13 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:13.095+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:13.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:13 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:13.095+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:13.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:13 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:13.098+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:13.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:13 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:13.098+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:13.582 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:13 smithi186 podman[70813]: 2024-01-25 15:06:13.21022112 +0000 UTC m=+0.649422523 container died fed703d018ad2c132eb78a797f95dd1b5e573c4fd1c8bfe931531766709f19be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4-deactivate, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-01-25T15:06:13.582 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:13 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:13.312+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:13.584 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:13 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:13.494+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:13.584 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:13 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:13.494+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:13.584 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:13 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:13.294+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:13.585 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:13 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:13.294+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.752510+0000 front 2024-01-25T15:05:45.752411+0000 (oldest deadline 2024-01-25T15:06:10.452477+0000) 2024-01-25T15:06:13.832 INFO:journalctl@ceph.osd.4.smithi186.stdout:Jan 25 15:06:13 smithi186 podman[70839]: 2024-01-25 15:06:13.830003692 +0000 UTC m=+0.614751844 container remove fed703d018ad2c132eb78a797f95dd1b5e573c4fd1c8bfe931531766709f19be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-4-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-01-25T15:06:13.832 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:13 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:13.732+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:13.832 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:13 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:13.732+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:13.849 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.4.service' 2024-01-25T15:06:13.894 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:06:13.894 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-01-25T15:06:13.894 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-01-25T15:06:13.894 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.5 2024-01-25T15:06:13.924 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:13 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:13.584+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:13.924 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:13 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:13.584+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:14.193 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:13 smithi191 systemd[1]: Stopping Ceph osd.5 for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:06:14.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:14 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:14.052+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:14.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:14 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:14.052+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:14.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:14 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:14.135+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:14.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:14 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:14.135+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:14.483 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:14 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:14.192+0000 7fefbc008700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:06:14.483 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:14 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:14.192+0000 7fefbc008700 -1 osd.5 90 *** Got signal Terminated *** 2024-01-25T15:06:14.483 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:14 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:14.192+0000 7fefbc008700 -1 osd.5 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-25T15:06:14.483 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:14 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:14.252+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:14.484 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:14 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:14.252+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.752510+0000 front 2024-01-25T15:05:45.752411+0000 (oldest deadline 2024-01-25T15:06:10.452477+0000) 2024-01-25T15:06:14.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:14 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:14.305+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:14.983 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:14 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:14.537+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:14.983 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:14 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:14.537+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:14.984 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:14 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:14.540+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:14.984 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:14 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:14.540+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:15.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:14 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:14.684+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:15.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:14 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:14.684+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:15.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:15 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:15.103+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:15.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:15 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:15.103+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:15.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:15 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:15.064+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:15.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:15 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:15.064+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:15.483 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:15 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:15.206+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:15.483 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:15 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:15.206+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.752510+0000 front 2024-01-25T15:05:45.752411+0000 (oldest deadline 2024-01-25T15:06:10.452477+0000) 2024-01-25T15:06:15.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:15 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:15.330+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:15.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:15 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:15.584+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:15.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:15 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:15.584+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:15.984 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:15 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:15.489+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:15.984 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:15 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:15.489+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:16.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:15 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:15.680+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:16.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:15 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:15.680+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:16.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:16 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:16.112+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:16.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:16 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:16.112+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:16.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:16 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:16.112+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:16.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:16 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:16.112+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:16.456 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:16 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:16.188+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:16.456 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:16 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:16.188+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.752510+0000 front 2024-01-25T15:05:45.752411+0000 (oldest deadline 2024-01-25T15:06:10.452477+0000) 2024-01-25T15:06:16.659 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:16 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:16.380+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:16.659 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:16 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:16.380+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:16.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:16 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:16.455+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:16.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:16 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:16.455+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:16.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:16 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:16.579+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:16.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:16 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:16.579+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:17.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:16 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:16.659+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:17.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:16 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:16.659+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:17.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:17 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:17.081+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:17.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:17 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:17.081+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:17.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:17 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:17.150+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:17.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:17 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:17.150+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:17.483 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:17 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:17.231+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:17.483 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:17 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:17.231+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.752510+0000 front 2024-01-25T15:05:45.752411+0000 (oldest deadline 2024-01-25T15:06:10.452477+0000) 2024-01-25T15:06:17.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:17 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:17.464+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:17.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:17 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:17.464+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:17.684 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:17 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:17.368+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:17.685 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:17 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:17.368+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:17.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:17 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:17.597+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:17.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:17 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:17.597+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:18.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:17 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:17.684+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:18.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:17 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:17.684+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:18.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:18 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:18.130+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:18.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:18 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:18.130+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:18.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:18 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:18.036+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:18.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:18 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:18.036+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:18.578 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:18 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:18.263+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.950983+0000 front 2024-01-25T15:05:36.951009+0000 (oldest deadline 2024-01-25T15:06:01.651196+0000) 2024-01-25T15:06:18.579 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:18 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5[48198]: 2024-01-25T15:06:18.263+0000 7fefb4dfc700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.752510+0000 front 2024-01-25T15:05:45.752411+0000 (oldest deadline 2024-01-25T15:06:10.452477+0000) 2024-01-25T15:06:18.579 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:18 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:18.489+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:18.579 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:18 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:18.489+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:18.579 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:18 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:18.489+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:18.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:18 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:18.330+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:18.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:18 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:18.330+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:18.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:18 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:18.577+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:18.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:18 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:18.577+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:19.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:18 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:18.656+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:19.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:18 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:18.656+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:19.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:19 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:19.006+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:19.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:19 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:19.006+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:19.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:19 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:19.148+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:19.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:19 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:19.148+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:19.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:19 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:19.148+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.541721+0000 front 2024-01-25T15:05:53.541684+0000 (oldest deadline 2024-01-25T15:06:18.241842+0000) 2024-01-25T15:06:19.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:19 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:19.283+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:19.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:19 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:19.283+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:19.935 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:19 smithi191 podman[71566]: 2024-01-25 15:06:19.656897444 +0000 UTC m=+5.570352837 container died 31b1667a819eb7f303733177a774bf8f30d8f3ce5c1a0365a70b7dfc56abeb65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-01-25T15:06:19.936 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:19 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:19.579+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:19.936 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:19 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:19.579+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:19.936 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:19 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:19.496+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:19.936 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:19 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:19.496+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:19.936 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:19 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:19.496+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:20.107 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:19 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:19.641+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:20.107 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:19 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:19.641+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:20.107 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:19 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:19.641+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:20.233 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:20 smithi191 podman[71566]: 2024-01-25 15:06:20.038297085 +0000 UTC m=+5.951752520 container cleanup 31b1667a819eb7f303733177a774bf8f30d8f3ce5c1a0365a70b7dfc56abeb65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5, io.buildah.version=1.31.3, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=) 2024-01-25T15:06:20.233 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:20 smithi191 bash[71566]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5 2024-01-25T15:06:20.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:19 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:19.994+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:20.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:19 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:19.994+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:20.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:20 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:20.144+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:20.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:20 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:20.144+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:20.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:20 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:20.144+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.541721+0000 front 2024-01-25T15:05:53.541684+0000 (oldest deadline 2024-01-25T15:06:18.241842+0000) 2024-01-25T15:06:20.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:20 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:20.234+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:20.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:20 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:20.234+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:20.628 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:20 smithi191 podman[71583]: 2024-01-25 15:06:20.295841018 +0000 UTC m=+0.637263208 container remove 31b1667a819eb7f303733177a774bf8f30d8f3ce5c1a0365a70b7dfc56abeb65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T15:06:20.629 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:20 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:20.490+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:20.629 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:20 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:20.490+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:20.629 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:20 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:20.490+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:20.900 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:20 smithi191 podman[71671]: 2024-01-25 15:06:20.54275255 +0000 UTC m=+0.016979007 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T15:06:20.900 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:20 smithi191 podman[71671]: 2024-01-25 15:06:20.674360689 +0000 UTC m=+0.148587155 container create 6d31cbb30fba37f241f178c4a78edab9985e7421162835b970f40d1589093a49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, io.buildah.version=1.31.3) 2024-01-25T15:06:20.900 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:20 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:20.627+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:20.900 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:20 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:20.627+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:20.901 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:20 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:20.627+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:21.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:20 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:20.657+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:21.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:20 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:20.657+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:21.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:20 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:20.657+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:21.184 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:20 smithi191 podman[71671]: 2024-01-25 15:06:20.900267527 +0000 UTC m=+0.374493944 container init 6d31cbb30fba37f241f178c4a78edab9985e7421162835b970f40d1589093a49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5-deactivate, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-01-25T15:06:21.184 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:20 smithi191 podman[71671]: 2024-01-25 15:06:20.903368826 +0000 UTC m=+0.377595241 container start 6d31cbb30fba37f241f178c4a78edab9985e7421162835b970f40d1589093a49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5-deactivate, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T15:06:21.185 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:20 smithi191 podman[71671]: 2024-01-25 15:06:20.975448041 +0000 UTC m=+0.449674468 container attach 6d31cbb30fba37f241f178c4a78edab9985e7421162835b970f40d1589093a49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T15:06:21.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:21 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:21.021+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:21.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:21 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:21.021+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:21.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:21 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:21.096+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:21.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:21 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:21.096+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:21.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:21 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:21.096+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.541721+0000 front 2024-01-25T15:05:53.541684+0000 (oldest deadline 2024-01-25T15:06:18.241842+0000) 2024-01-25T15:06:21.455 INFO:journalctl@ceph.osd.5.smithi191.stdout:Jan 25 15:06:21 smithi191 podman[71671]: 2024-01-25 15:06:21.184560864 +0000 UTC m=+0.658787292 container died 6d31cbb30fba37f241f178c4a78edab9985e7421162835b970f40d1589093a49 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T15:06:21.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:21 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:21.200+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:21.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:21 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:21.200+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:21.713 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:21 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:21.598+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:21.713 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:21 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:21.598+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:21.713 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:21 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:21.598+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:21.713 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:21 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:21.453+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:21.714 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:21 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:21.453+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:21.714 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:21 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:21.453+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:21.735 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.5.service' 2024-01-25T15:06:21.817 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:06:21.817 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-01-25T15:06:21.817 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-01-25T15:06:21.817 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.6 2024-01-25T15:06:22.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:21 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:21.695+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:22.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:21 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:21.695+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:22.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:21 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:21.695+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:22.118 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:21 smithi170 systemd[1]: Stopping Ceph osd.6 for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:06:22.118 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:21 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:21.986+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:22.119 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:21 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:21.986+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:22.119 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:21 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:21.986+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:22.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:22 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:22.117+0000 7fb92155d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:06:22.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:22 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:22.117+0000 7fb92155d700 -1 osd.6 90 *** Got signal Terminated *** 2024-01-25T15:06:22.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:22 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:22.117+0000 7fb92155d700 -1 osd.6 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-25T15:06:22.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:22 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:22.122+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:22.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:22 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:22.122+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:22.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:22 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:22.122+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.541721+0000 front 2024-01-25T15:05:53.541684+0000 (oldest deadline 2024-01-25T15:06:18.241842+0000) 2024-01-25T15:06:22.483 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:22 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:22.406+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:22.483 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:22 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:22.406+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:22.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:22 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:22.406+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:22.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:22 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:22.155+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:22.605 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:22 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:22.155+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:22.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:22 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:22.590+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:22.984 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:22 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:22.590+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:22.984 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:22 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:22.590+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:23.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:22 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:22.657+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:23.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:22 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:22.657+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:23.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:22 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:22.657+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:23.375 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:23.122+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:23.376 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:23.122+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:23.376 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:23.122+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.541721+0000 front 2024-01-25T15:05:53.541684+0000 (oldest deadline 2024-01-25T15:06:18.241842+0000) 2024-01-25T15:06:23.376 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:22 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:22.962+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:23.376 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:22 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:22.962+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:23.376 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:22 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:22.962+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:23.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:23.151+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:23.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:23.151+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:23.733 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:23.560+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:23.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:23.560+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:23.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:23.560+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:23.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:23.412+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:23.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:23.412+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:23.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:23 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:23.412+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:24.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:23.674+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:24.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:23.674+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:24.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:23 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:23.674+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:24.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:24 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:24.142+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:24.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:24 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:24.142+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:24.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:24 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:24.142+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.541721+0000 front 2024-01-25T15:05:53.541684+0000 (oldest deadline 2024-01-25T15:06:18.241842+0000) 2024-01-25T15:06:24.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:23.957+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:24.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:23.957+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:24.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:23.957+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:24.375 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:23 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:23.957+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:24.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:24 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:24.151+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:24.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:24 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:24.151+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:24.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:24 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:24.389+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:24.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:24 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:24.389+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:24.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:24 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:24.389+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:24.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:24 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:24.595+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:24.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:24 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:24.595+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:24.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:24 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:24.595+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:24.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:24 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:24.595+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:25.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:24 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:24.646+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:25.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:24 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:24.646+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:25.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:24 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:24.646+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:25.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:25 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:25.182+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:25.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:25 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:25.182+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:25.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:25 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:25.182+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.541721+0000 front 2024-01-25T15:05:53.541684+0000 (oldest deadline 2024-01-25T15:06:18.241842+0000) 2024-01-25T15:06:25.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:24 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:24.942+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:25.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:24 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:24.942+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:25.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:24 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:24.942+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:25.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:24 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:24.942+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:25.605 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:25 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:25.156+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:25.644 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:25 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:25.156+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:25.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:25 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:25.406+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:25.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:25 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:25.406+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:25.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:25 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:25.406+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:25.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:25 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:25.568+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:25.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:25 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:25.568+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:25.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:25 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:25.568+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:25.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:25 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:25.568+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:26.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:25 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:25.688+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:26.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:25 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:25.688+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:26.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:25 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:25.688+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:26.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:25 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:25.688+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:26.227 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:25 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:25.965+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:26.227 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:25 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:25.965+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:26.228 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:25 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:25.965+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:26.228 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:25 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:25.965+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:26.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:26 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:26.168+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:26.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:26 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:26.168+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:26.624 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:26 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:26.226+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:37.739472+0000 front 2024-01-25T15:05:37.739253+0000 (oldest deadline 2024-01-25T15:06:03.639408+0000) 2024-01-25T15:06:26.624 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:26 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:26.226+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:47.140697+0000 front 2024-01-25T15:05:47.140747+0000 (oldest deadline 2024-01-25T15:06:09.440620+0000) 2024-01-25T15:06:26.624 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:26 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6[60161]: 2024-01-25T15:06:26.226+0000 7fb91a351700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.541721+0000 front 2024-01-25T15:05:53.541684+0000 (oldest deadline 2024-01-25T15:06:18.241842+0000) 2024-01-25T15:06:26.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:26 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:26.449+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:26.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:26 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:26.449+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:26.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:26 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:26.449+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:26.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:26 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:26.599+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:26.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:26 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:26.599+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:26.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:26 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:26.599+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:26.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:26 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:26.599+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:27.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:26 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:26.732+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:27.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:26 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:26.732+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:27.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:26 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:26.732+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:27.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:26 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:26.732+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:27.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:26 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:26.991+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:27.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:26 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:26.991+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:27.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:26 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:26.991+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:27.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:26 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:26.991+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:27.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:27 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:27.153+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:27.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:27 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:27.153+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:27.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:27 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:27.153+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.156576+0000 front 2024-01-25T15:06:02.156598+0000 (oldest deadline 2024-01-25T15:06:26.256718+0000) 2024-01-25T15:06:27.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:27 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:27.428+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:27.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:27 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:27.428+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:27.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:27 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:27.428+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:27.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:27 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:27.647+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:27.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:27 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:27.647+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:27.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:27 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:27.647+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:27.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:27 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:27.647+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:27.743 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:27 smithi170 podman[91363]: 2024-01-25 15:06:27.459631809 +0000 UTC m=+5.442982716 container died 5847b060a0b6eb636540f4102d016ead48f45c0ec4104f6d2a420a941dd2f213 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6, org.label-schema.build-date=20240123, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-01-25T15:06:28.007 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:27 smithi170 podman[91363]: 2024-01-25 15:06:27.943328031 +0000 UTC m=+5.926678972 container cleanup 5847b060a0b6eb636540f4102d016ead48f45c0ec4104f6d2a420a941dd2f213 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True) 2024-01-25T15:06:28.007 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:27 smithi170 bash[91363]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6 2024-01-25T15:06:28.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:27 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:27.775+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:28.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:27 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:27.775+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:28.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:27 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:27.775+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:28.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:27 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:27.775+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:28.374 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:28 smithi170 podman[91379]: 2024-01-25 15:06:28.161329558 +0000 UTC m=+0.700986402 container remove 5847b060a0b6eb636540f4102d016ead48f45c0ec4104f6d2a420a941dd2f213 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-01-25T15:06:28.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:28 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:28.006+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:28.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:28 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:28.006+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:28.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:28 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:28.006+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:28.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:28 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:28.006+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:28.607 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:28 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:28.187+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:28.607 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:28 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:28.187+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:28.608 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:28 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:28.187+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.156576+0000 front 2024-01-25T15:06:02.156598+0000 (oldest deadline 2024-01-25T15:06:26.256718+0000) 2024-01-25T15:06:28.732 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:28 smithi170 podman[91476]: 2024-01-25 15:06:28.380370396 +0000 UTC m=+0.019678930 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T15:06:28.732 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:28 smithi170 podman[91476]: 2024-01-25 15:06:28.479260231 +0000 UTC m=+0.118568765 container create 37c7cc0d2bee624b83f8d7100f608348ea96287437f0c0801af54d164eecb53a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.31.3, GIT_CLEAN=True, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T15:06:28.732 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:28 smithi170 podman[91476]: 2024-01-25 15:06:28.673147652 +0000 UTC m=+0.312456189 container init 37c7cc0d2bee624b83f8d7100f608348ea96287437f0c0801af54d164eecb53a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6-deactivate, org.label-schema.build-date=20240123, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-01-25T15:06:28.732 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:28 smithi170 podman[91476]: 2024-01-25 15:06:28.676177522 +0000 UTC m=+0.315486059 container start 37c7cc0d2bee624b83f8d7100f608348ea96287437f0c0801af54d164eecb53a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6-deactivate, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-01-25T15:06:28.732 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:28 smithi170 podman[91476]: 2024-01-25 15:06:28.731480298 +0000 UTC m=+0.370788847 container attach 37c7cc0d2bee624b83f8d7100f608348ea96287437f0c0801af54d164eecb53a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6-deactivate, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T15:06:28.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:28 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:28.418+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:28.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:28 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:28.418+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:28.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:28 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:28.418+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:28.733 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:28 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:28.638+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:28.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:28 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:28.638+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:28.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:28 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:28.638+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:28.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:28 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:28.638+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:28.988 INFO:journalctl@ceph.osd.6.smithi170.stdout:Jan 25 15:06:28 smithi170 podman[91476]: 2024-01-25 15:06:28.957520132 +0000 UTC m=+0.596828667 container died 37c7cc0d2bee624b83f8d7100f608348ea96287437f0c0801af54d164eecb53a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-6-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-01-25T15:06:28.989 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:28 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:28.987+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:28.989 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:28 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:28.987+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:28.989 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:28 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:28.987+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:28.989 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:28 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:28.987+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:29.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:28 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:28.739+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:29.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:28 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:28.739+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:29.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:28 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:28.739+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:29.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:28 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:28.739+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:29.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:29 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:29.233+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:29.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:29 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:29.233+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:29.605 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:29 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:29.233+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.156576+0000 front 2024-01-25T15:06:02.156598+0000 (oldest deadline 2024-01-25T15:06:26.256718+0000) 2024-01-25T15:06:29.609 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.6.service' 2024-01-25T15:06:29.651 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:06:29.651 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-01-25T15:06:29.651 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-01-25T15:06:29.652 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.7 2024-01-25T15:06:29.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:29 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:29.421+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:29.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:29 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:29.421+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:29.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:29 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:29.421+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:29.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:29 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:29.620+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:29.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:29 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:29.620+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:29.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:29 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:29.620+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:29.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:29 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:29.620+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:29.940 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:29 smithi186 systemd[1]: Stopping Ceph osd.7 for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:06:29.941 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:29 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:29.737+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:29.941 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:29 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:29.737+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:29.941 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:29 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:29.737+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:29.941 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:29 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:29.737+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:30.124 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:29 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:29.955+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:30.124 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:29 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:29.955+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:30.124 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:29 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:29.955+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:30.124 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:29 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:29.955+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:30.216 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:29 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:29.939+0000 7f5376cf0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:06:30.216 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:29 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:29.939+0000 7f5376cf0700 -1 osd.7 90 *** Got signal Terminated *** 2024-01-25T15:06:30.216 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:29 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:29.939+0000 7f5376cf0700 -1 osd.7 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-25T15:06:30.216 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:30 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:30.215+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:30.216 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:30 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:30.215+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:30.216 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:30 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:30.215+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.156576+0000 front 2024-01-25T15:06:02.156598+0000 (oldest deadline 2024-01-25T15:06:26.256718+0000) 2024-01-25T15:06:30.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:30 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:30.408+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:30.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:30 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:30.408+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:30.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:30 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:30.408+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:30.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:30 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:30.625+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:30.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:30 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:30.625+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:30.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:30 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:30.625+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:30.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:30 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:30.625+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:31.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:30 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:30.764+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:31.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:30 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:30.764+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:31.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:30 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:30.764+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:31.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:30 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:30.764+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:31.124 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:30 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:30.946+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:31.124 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:30 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:30.946+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:31.124 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:30 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:30.946+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:31.124 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:30 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:30.946+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:31.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:31 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:31.204+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:31.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:31 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:31.204+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:31.605 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:31 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:31.204+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.156576+0000 front 2024-01-25T15:06:02.156598+0000 (oldest deadline 2024-01-25T15:06:26.256718+0000) 2024-01-25T15:06:31.657 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:31 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:31.390+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:31.657 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:31 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:31.390+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:31.657 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:31 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:31.390+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:31.984 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:31 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:31.656+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:31.984 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:31 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:31.656+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:31.984 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:31 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:31.656+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:31.984 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:31 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:31.656+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:32.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:31 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:31.778+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:32.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:31 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:31.778+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:32.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:31 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:31.778+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:32.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:31 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:31.778+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:32.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:31 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:31.992+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:32.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:31 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:31.992+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:32.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:31 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:31.992+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:32.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:31 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:31.992+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:32.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:32 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:32.201+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:32.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:32 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:32.201+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:32.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:32 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:32.201+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.156576+0000 front 2024-01-25T15:06:02.156598+0000 (oldest deadline 2024-01-25T15:06:26.256718+0000) 2024-01-25T15:06:32.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:32 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:32.384+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:32.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:32 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:32.384+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:32.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:32 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:32.384+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:32.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:32 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:32.612+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:32.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:32 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:32.612+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:32.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:32 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:32.612+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:32.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:32 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:32.612+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:33.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:32 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:32.825+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:33.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:32 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:32.825+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:33.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:32 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:32.825+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:33.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:32 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:32.825+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:33.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:32 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:32.825+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:33.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:32 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:32.956+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:33.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:32 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:32.956+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:33.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:32 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:32.956+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:33.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:32 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:32.956+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:33.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:33 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:33.161+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:33.605 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:33 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:33.161+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:33.605 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:33 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:33.161+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.156576+0000 front 2024-01-25T15:06:02.156598+0000 (oldest deadline 2024-01-25T15:06:26.256718+0000) 2024-01-25T15:06:33.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:33 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:33.563+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:33.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:33 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:33.563+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:33.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:33 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:33.563+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:33.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:33 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:33.563+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:33.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:33 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:33.396+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:33.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:33 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:33.396+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:33.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:33 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:33.396+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:33.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:33 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:33.396+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:34.163 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:33 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:33.873+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:34.163 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:33 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:33.873+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:34.163 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:33 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:33.873+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:34.163 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:33 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:33.873+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:34.163 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:33 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:33.873+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:34.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:33 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:33.930+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:34.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:33 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:33.930+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:34.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:33 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:33.930+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:34.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:33 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:33.930+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:34.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:34 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:34.163+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:43.151859+0000 front 2024-01-25T15:05:43.151882+0000 (oldest deadline 2024-01-25T15:06:08.452021+0000) 2024-01-25T15:06:34.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:34 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:34.163+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:53.753133+0000 front 2024-01-25T15:05:53.753222+0000 (oldest deadline 2024-01-25T15:06:15.953814+0000) 2024-01-25T15:06:34.605 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:34 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7[54228]: 2024-01-25T15:06:34.163+0000 7f536fae4700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.156576+0000 front 2024-01-25T15:06:02.156598+0000 (oldest deadline 2024-01-25T15:06:26.256718+0000) 2024-01-25T15:06:34.733 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:34 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:34.545+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:34.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:34 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:34.545+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:34.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:34 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:34.545+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:34.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:34 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:34.545+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:34.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:34 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:34.433+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:34.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:34 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:34.433+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:34.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:34 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:34.433+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:34.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:34 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:34.433+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:35.326 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:34 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:34.865+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:35.327 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:34 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:34.865+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:35.327 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:34 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:34.865+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:35.327 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:34 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:34.865+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:35.327 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:34 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:34.865+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:35.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:34.957+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:35.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:34.957+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:35.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:34.957+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:35.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:34 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:34.957+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:35.604 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:35 smithi186 podman[70917]: 2024-01-25 15:06:35.326860687 +0000 UTC m=+5.481566706 container died 3e48d5a47682cd44840da4e904de7a841565f9ecfcc1a08da82f61fceda75dff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-01-25T15:06:35.733 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:35 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:35.583+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:35.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:35 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:35.583+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:35.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:35 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:35.583+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:35.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:35 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:35.583+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:35.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:35 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:35.413+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:35.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:35 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:35.413+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:35.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:35 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:35.413+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:35.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:35 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:35.413+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:35.912 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:35 smithi186 podman[70917]: 2024-01-25 15:06:35.714905882 +0000 UTC m=+5.869611891 container cleanup 3e48d5a47682cd44840da4e904de7a841565f9ecfcc1a08da82f61fceda75dff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T15:06:35.912 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:35 smithi186 bash[70917]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7 2024-01-25T15:06:36.266 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:35 smithi186 podman[70934]: 2024-01-25 15:06:35.95773262 +0000 UTC m=+0.629379656 container remove 3e48d5a47682cd44840da4e904de7a841565f9ecfcc1a08da82f61fceda75dff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T15:06:36.267 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:35 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:35.911+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:36.267 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:35 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:35.911+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:36.267 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:35 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:35.911+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:36.267 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:35 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:35.911+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:36.267 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:35 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:35.911+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:36.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:35 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:35.966+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:36.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:35 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:35.966+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:36.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:35 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:35.966+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:36.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:35 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:35.966+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:36.544 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:36 smithi186 podman[71025]: 2024-01-25 15:06:36.266815205 +0000 UTC m=+0.110403043 container create cc36b33ef202a4c23fdef07c5e95bef39e7bc46eb7fb63c5996e92bdedebf7ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS) 2024-01-25T15:06:36.544 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:36 smithi186 podman[71025]: 2024-01-25 15:06:36.174241583 +0000 UTC m=+0.017829437 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T15:06:36.544 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:36 smithi186 podman[71025]: 2024-01-25 15:06:36.461464241 +0000 UTC m=+0.305052092 container init cc36b33ef202a4c23fdef07c5e95bef39e7bc46eb7fb63c5996e92bdedebf7ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-01-25T15:06:36.544 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:36 smithi186 podman[71025]: 2024-01-25 15:06:36.464747074 +0000 UTC m=+0.308334926 container start cc36b33ef202a4c23fdef07c5e95bef39e7bc46eb7fb63c5996e92bdedebf7ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7-deactivate, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-01-25T15:06:36.545 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:36 smithi186 podman[71025]: 2024-01-25 15:06:36.544476599 +0000 UTC m=+0.388064454 container attach cc36b33ef202a4c23fdef07c5e95bef39e7bc46eb7fb63c5996e92bdedebf7ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-25T15:06:36.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:36.629+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:36.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:36.629+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:36.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:36.629+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:36.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:36.629+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:36.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:36.436+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:36.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:36.436+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:36.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:36.436+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:36.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:36 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:36.436+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:36.854 INFO:journalctl@ceph.osd.7.smithi186.stdout:Jan 25 15:06:36 smithi186 podman[71025]: 2024-01-25 15:06:36.757446581 +0000 UTC m=+0.601034427 container died cc36b33ef202a4c23fdef07c5e95bef39e7bc46eb7fb63c5996e92bdedebf7ee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-7-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.31.3) 2024-01-25T15:06:37.198 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:36.870+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:37.198 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:36.870+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:37.198 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:36.870+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:37.198 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:36.870+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:37.198 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:36.870+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:37.228 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.7.service' 2024-01-25T15:06:37.269 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:06:37.269 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-01-25T15:06:37.269 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-01-25T15:06:37.270 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.8 2024-01-25T15:06:37.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:36 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:36.974+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:37.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:36 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:36.974+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:37.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:36 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:36.974+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:37.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:36 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:36.974+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:37.558 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:37 smithi191 systemd[1]: Stopping Ceph osd.8 for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:06:37.558 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:37.424+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:37.558 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:37.424+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:37.558 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:37.424+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:37.558 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:37.424+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:37.983 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:37.557+0000 7f5b6efe4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:06:37.984 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:37.557+0000 7f5b6efe4700 -1 osd.8 90 *** Got signal Terminated *** 2024-01-25T15:06:37.984 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:37.557+0000 7f5b6efe4700 -1 osd.8 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-25T15:06:37.984 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:37.600+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:37.984 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:37.600+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:37.984 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:37.600+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:37.984 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:37 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:37.600+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:38.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:37.829+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:38.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:37.829+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:38.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:37.829+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:38.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:37.829+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:38.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:37 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:37.829+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:38.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:38 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:38.022+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:38.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:38 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:38.022+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:38.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:38 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:38.022+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:38.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:38 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:38.022+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:38.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:38.420+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:38.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:38.420+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:38.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:38.420+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:38.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:38.420+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:38.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:38.595+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:38.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:38.595+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:38.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:38.595+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:38.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:38 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:38.595+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:39.354 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:38.878+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:39.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:38.878+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:39.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:38.878+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:39.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:38.878+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:39.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:38 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:38.878+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:39.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:39 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:39.021+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:39.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:39 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:39.021+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:39.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:39 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:39.021+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:39.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:39 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:39.021+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:39.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:39 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:39.460+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:39.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:39 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:39.460+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:39.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:39 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:39.460+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:39.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:39 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:39.460+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:39.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:39 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:39.596+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:39.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:39 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:39.596+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:39.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:39 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:39.596+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:39.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:39 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:39.596+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:40.294 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:40 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:40.034+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:40.294 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:40 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:40.034+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:40.294 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:40 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:40.034+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:40.294 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:40 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:40.034+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:40.354 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:39 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:39.873+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:40.354 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:39 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:39.873+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:40.354 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:39 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:39.873+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:40.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:39 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:39.873+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:40.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:39 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:39.873+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:40.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:40 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:40.612+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:40.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:40 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:40.612+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:40.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:40 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:40.612+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:40.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:40 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:40.612+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:40.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:40 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:40.612+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.141007+0000 front 2024-01-25T15:06:14.140954+0000 (oldest deadline 2024-01-25T15:06:39.941619+0000) 2024-01-25T15:06:40.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:40 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:40.435+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:40.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:40 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:40.435+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:40.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:40 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:40.435+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:40.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:40 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:40.435+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:41.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:40 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:40.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:41.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:40 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:40.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:41.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:40 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:40.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:41.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:40 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:40.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:41.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:40 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:40.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:41.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:40 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:40.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:41.124 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:41 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:41.004+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:41.124 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:41 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:41.004+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:41.124 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:41 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:41.004+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:41.124 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:41 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:41.004+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:41.733 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:41 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:41.636+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:39.235357+0000 front 2024-01-25T15:05:39.235374+0000 (oldest deadline 2024-01-25T15:06:05.135228+0000) 2024-01-25T15:06:41.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:41 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:41.636+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.135695+0000 front 2024-01-25T15:05:45.135875+0000 (oldest deadline 2024-01-25T15:06:10.435678+0000) 2024-01-25T15:06:41.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:41 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:41.636+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.536816+0000 front 2024-01-25T15:05:54.536651+0000 (oldest deadline 2024-01-25T15:06:20.337513+0000) 2024-01-25T15:06:41.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:41 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:41.636+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:00.838567+0000 front 2024-01-25T15:06:00.838458+0000 (oldest deadline 2024-01-25T15:06:24.338454+0000) 2024-01-25T15:06:41.734 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:41 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8[55071]: 2024-01-25T15:06:41.636+0000 7f5b67dd8700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.141007+0000 front 2024-01-25T15:06:14.140954+0000 (oldest deadline 2024-01-25T15:06:39.941619+0000) 2024-01-25T15:06:41.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:41 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:41.443+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:41.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:41 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:41.443+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:41.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:41 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:41.443+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:41.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:41 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:41.443+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:41.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:41 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:41.443+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:42.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:41 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:41.833+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:42.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:41 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:41.833+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:42.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:41 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:41.833+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:42.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:41 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:41.833+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:42.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:41 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:41.833+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:42.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:41 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:41.833+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:42.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:41 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:41.964+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:42.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:41 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:41.964+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:42.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:41 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:41.964+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:42.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:41 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:41.964+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:42.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:42 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:42.403+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:42.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:42 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:42.403+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:42.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:42 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:42.403+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:42.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:42 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:42.403+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:42.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:42 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:42.403+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:43.192 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:42 smithi191 podman[71775]: 2024-01-25 15:06:42.914751558 +0000 UTC m=+5.453747759 container died 583ac581863788126fc98355ee0c270e4588f302e5c300bddd513793f9971ca4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3) 2024-01-25T15:06:43.354 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:42 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:42.858+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:43.354 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:42 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:42.858+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:43.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:42 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:42.858+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:43.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:42 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:42.858+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:43.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:42 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:42.858+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:43.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:42 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:42.858+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:43.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:43 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:43.006+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:43.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:43 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:43.006+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:43.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:43 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:43.006+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:43.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:43 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:43.006+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:43.484 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:43 smithi191 podman[71775]: 2024-01-25 15:06:43.283285309 +0000 UTC m=+5.822281504 container cleanup 583ac581863788126fc98355ee0c270e4588f302e5c300bddd513793f9971ca4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123) 2024-01-25T15:06:43.484 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:43 smithi191 bash[71775]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8 2024-01-25T15:06:43.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:43 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:43.413+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:43.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:43 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:43.413+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:43.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:43 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:43.413+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:43.485 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:43 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:43.413+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:43.485 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:43 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:43.413+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:43.888 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:43 smithi191 podman[71805]: 2024-01-25 15:06:43.560377824 +0000 UTC m=+0.640647686 container remove 583ac581863788126fc98355ee0c270e4588f302e5c300bddd513793f9971ca4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3) 2024-01-25T15:06:44.156 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:43 smithi191 podman[71898]: 2024-01-25 15:06:43.791737656 +0000 UTC m=+0.018177031 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T15:06:44.156 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:43 smithi191 podman[71898]: 2024-01-25 15:06:43.894832297 +0000 UTC m=+0.121271690 container create 9f0f56df680afe10839ad035b57b73abbe481efd25432d0e32a30da9207fd46b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.license=GPLv2) 2024-01-25T15:06:44.157 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:44 smithi191 podman[71898]: 2024-01-25 15:06:44.081469528 +0000 UTC m=+0.307908902 container init 9f0f56df680afe10839ad035b57b73abbe481efd25432d0e32a30da9207fd46b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0) 2024-01-25T15:06:44.157 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:44 smithi191 podman[71898]: 2024-01-25 15:06:44.084552198 +0000 UTC m=+0.310991573 container start 9f0f56df680afe10839ad035b57b73abbe481efd25432d0e32a30da9207fd46b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T15:06:44.157 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:44 smithi191 podman[71898]: 2024-01-25 15:06:44.15631461 +0000 UTC m=+0.382753996 container attach 9f0f56df680afe10839ad035b57b73abbe481efd25432d0e32a30da9207fd46b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240123, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-01-25T15:06:44.354 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:43 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:43.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:44.354 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:43 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:43.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:44.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:43 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:43.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:44.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:43 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:43.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:44.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:43 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:43.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:44.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:43 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:43.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:44.373 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:44 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:44.000+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:44.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:44 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:44.000+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:44.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:44 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:44.000+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:44.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:44 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:44.000+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:44.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:44 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:44.000+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:18.354866+0000 front 2024-01-25T15:06:18.354792+0000 (oldest deadline 2024-01-25T15:06:43.054696+0000) 2024-01-25T15:06:44.459 INFO:journalctl@ceph.osd.8.smithi191.stdout:Jan 25 15:06:44 smithi191 podman[71898]: 2024-01-25 15:06:44.370685421 +0000 UTC m=+0.597124789 container died 9f0f56df680afe10839ad035b57b73abbe481efd25432d0e32a30da9207fd46b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-8-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240123, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-01-25T15:06:44.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:44 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:44.459+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:44.735 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:44 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:44.459+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:44.735 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:44 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:44.459+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:44.735 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:44 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:44.459+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:44.735 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:44 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:44.459+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:44.936 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.8.service' 2024-01-25T15:06:44.976 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:06:44.976 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-01-25T15:06:44.976 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-01-25T15:06:44.977 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.9 2024-01-25T15:06:45.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:44 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:44.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:45.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:44 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:44.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:45.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:44 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:44.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:45.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:44 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:44.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:45.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:44 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:44.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:45.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:44 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:44.853+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:45.279 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:45 smithi170 systemd[1]: Stopping Ceph osd.9 for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:06:45.279 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:45 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:45.043+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:45.279 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:45 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:45.043+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:45.279 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:45 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:45.043+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:45.280 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:45 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:45.043+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:45.280 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:45 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:45.043+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:18.354866+0000 front 2024-01-25T15:06:18.354792+0000 (oldest deadline 2024-01-25T15:06:43.054696+0000) 2024-01-25T15:06:45.280 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:45 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:45.278+0000 7f4e352de700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:06:45.280 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:45 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:45.278+0000 7f4e352de700 -1 osd.9 90 *** Got signal Terminated *** 2024-01-25T15:06:45.280 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:45 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:45.278+0000 7f4e352de700 -1 osd.9 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-25T15:06:45.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:45 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:45.419+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:45.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:45 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:45.419+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:45.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:45 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:45.419+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:45.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:45 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:45.419+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:45.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:45 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:45.419+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:46.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:45 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:45.852+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:46.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:45 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:45.852+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:46.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:45 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:45.852+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:46.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:45 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:45.852+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:46.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:45 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:45.852+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:46.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:45 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:45.852+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:46.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:46 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:46.010+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:46.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:46 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:46.010+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:46.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:46 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:46.010+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:46.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:46 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:46.010+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:46.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:46 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:46.010+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:18.354866+0000 front 2024-01-25T15:06:18.354792+0000 (oldest deadline 2024-01-25T15:06:43.054696+0000) 2024-01-25T15:06:46.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:46 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:46.439+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:46.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:46 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:46.439+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:46.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:46 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:46.439+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:46.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:46 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:46.439+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:46.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:46 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:46.439+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:47.354 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:46 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:46.868+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:47.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:46 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:46.868+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:47.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:46 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:46.868+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:47.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:46 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:46.868+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:47.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:46 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:46.868+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:47.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:46 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:46.868+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:47.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:47 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:47.042+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:47.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:47 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:47.042+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:47.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:47 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:47.042+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:47.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:47 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:47.042+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:47.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:47 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:47.042+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:18.354866+0000 front 2024-01-25T15:06:18.354792+0000 (oldest deadline 2024-01-25T15:06:43.054696+0000) 2024-01-25T15:06:47.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:47 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:47.441+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:47.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:47 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:47.441+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:47.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:47 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:47.441+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:47.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:47 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:47.441+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:47.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:47 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:47.441+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:48.354 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:47 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:47.864+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:48.354 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:47 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:47.864+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:48.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:47 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:47.864+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:48.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:47 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:47.864+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:48.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:47 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:47.864+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:48.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:47 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:47.864+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:48.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:47 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:47.864+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:23.708371+0000 front 2024-01-25T15:06:23.708410+0000 (oldest deadline 2024-01-25T15:06:47.808118+0000) 2024-01-25T15:06:48.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:48 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:48.010+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:48.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:48 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:48.010+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:48.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:48 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:48.010+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:48.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:48 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:48.010+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:48.375 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:48 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:48.010+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:18.354866+0000 front 2024-01-25T15:06:18.354792+0000 (oldest deadline 2024-01-25T15:06:43.054696+0000) 2024-01-25T15:06:48.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:48 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:48.399+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:48.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:48 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:48.399+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:48.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:48 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:48.399+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:48.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:48 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:48.399+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:48.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:48 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:48.399+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:49.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:48 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:48.898+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:49.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:48 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:48.898+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:49.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:48 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:48.898+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:49.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:48 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:48.898+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:49.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:48 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:48.898+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:49.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:48 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:48.898+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:49.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:48 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:48.898+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:23.708371+0000 front 2024-01-25T15:06:23.708410+0000 (oldest deadline 2024-01-25T15:06:47.808118+0000) 2024-01-25T15:06:49.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:48 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:48.991+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:49.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:48 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:48.991+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:49.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:48 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:48.991+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:49.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:48 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:48.991+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:49.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:48 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:48.991+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:18.354866+0000 front 2024-01-25T15:06:18.354792+0000 (oldest deadline 2024-01-25T15:06:43.054696+0000) 2024-01-25T15:06:49.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:48 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:48.991+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:23.055068+0000 front 2024-01-25T15:06:23.055094+0000 (oldest deadline 2024-01-25T15:06:48.955149+0000) 2024-01-25T15:06:49.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:49 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:49.434+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:49.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:49 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:49.434+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:49.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:49 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:49.434+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:49.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:49 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:49.434+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:49.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:49 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:49.434+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:50.354 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:49 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:49.860+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:50.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:49 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:49.860+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:50.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:49 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:49.860+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:50.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:49 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:49.860+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:50.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:49 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:49.860+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:50.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:49 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:49.860+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:50.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:49 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:49.860+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:23.708371+0000 front 2024-01-25T15:06:23.708410+0000 (oldest deadline 2024-01-25T15:06:47.808118+0000) 2024-01-25T15:06:50.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:50.005+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.848169+0000 front 2024-01-25T15:05:38.848327+0000 (oldest deadline 2024-01-25T15:06:01.747767+0000) 2024-01-25T15:06:50.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:50.005+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:45.149379+0000 front 2024-01-25T15:05:45.149523+0000 (oldest deadline 2024-01-25T15:06:09.249581+0000) 2024-01-25T15:06:50.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:50.005+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:51.451564+0000 front 2024-01-25T15:05:51.451358+0000 (oldest deadline 2024-01-25T15:06:21.451856+0000) 2024-01-25T15:06:50.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:50.005+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:01.452191+0000 front 2024-01-25T15:06:01.452241+0000 (oldest deadline 2024-01-25T15:06:23.752258+0000) 2024-01-25T15:06:50.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:50.005+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:18.354866+0000 front 2024-01-25T15:06:18.354792+0000 (oldest deadline 2024-01-25T15:06:43.054696+0000) 2024-01-25T15:06:50.374 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:50 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9[66928]: 2024-01-25T15:06:50.005+0000 7f4e320da700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:23.055068+0000 front 2024-01-25T15:06:23.055094+0000 (oldest deadline 2024-01-25T15:06:48.955149+0000) 2024-01-25T15:06:50.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:50 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:50.455+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:50.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:50 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:50.455+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:50.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:50 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:50.455+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:50.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:50 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:50.455+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:50.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:50 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:50.455+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:51.124 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:50 smithi170 podman[91593]: 2024-01-25 15:06:50.823865725 +0000 UTC m=+5.640834878 container died c3156772aff3f5480aba431146789cb0afb71298a446666978f380f1d7c31edc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9, ceph=True, org.label-schema.build-date=20240123, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-01-25T15:06:51.354 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:50 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:50.905+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:51.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:50 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:50.905+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:51.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:50 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:50.905+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:51.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:50 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:50.905+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:51.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:50 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:50.905+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:51.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:50 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:50.905+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:51.355 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:50 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:50.905+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:23.708371+0000 front 2024-01-25T15:06:23.708410+0000 (oldest deadline 2024-01-25T15:06:47.808118+0000) 2024-01-25T15:06:51.463 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:51 smithi170 podman[91593]: 2024-01-25 15:06:51.203870578 +0000 UTC m=+6.020839725 container cleanup c3156772aff3f5480aba431146789cb0afb71298a446666978f380f1d7c31edc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD) 2024-01-25T15:06:51.463 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:51 smithi170 bash[91593]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9 2024-01-25T15:06:51.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:51 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:51.427+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:51.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:51 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:51.427+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:51.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:51 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:51.427+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:51.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:51 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:51.427+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:51.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:51 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:51.427+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:51.764 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:51 smithi170 podman[91612]: 2024-01-25 15:06:51.463587328 +0000 UTC m=+0.639998173 container remove c3156772aff3f5480aba431146789cb0afb71298a446666978f380f1d7c31edc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-01-25T15:06:52.066 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:51 smithi170 podman[91702]: 2024-01-25 15:06:51.764247908 +0000 UTC m=+0.105118583 container create 6805f89a178257c2bdb757d34f684c2d5640d3e37b97e29fdfcb69635bfdd157 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD) 2024-01-25T15:06:52.067 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:51 smithi170 podman[91702]: 2024-01-25 15:06:51.677332734 +0000 UTC m=+0.018203406 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T15:06:52.067 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:51 smithi170 podman[91702]: 2024-01-25 15:06:51.983170373 +0000 UTC m=+0.324041045 container init 6805f89a178257c2bdb757d34f684c2d5640d3e37b97e29fdfcb69635bfdd157 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-01-25T15:06:52.067 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:51 smithi170 podman[91702]: 2024-01-25 15:06:51.986348181 +0000 UTC m=+0.327218862 container start 6805f89a178257c2bdb757d34f684c2d5640d3e37b97e29fdfcb69635bfdd157 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T15:06:52.067 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:52 smithi170 podman[91702]: 2024-01-25 15:06:52.06687546 +0000 UTC m=+0.407746143 container attach 6805f89a178257c2bdb757d34f684c2d5640d3e37b97e29fdfcb69635bfdd157 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9-deactivate, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, ceph=True) 2024-01-25T15:06:52.159 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:51 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:51.860+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:52.160 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:51 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:51.860+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:52.160 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:51 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:51.860+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:52.160 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:51 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:51.860+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:52.160 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:51 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:51.860+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:52.160 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:51 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:51.860+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:52.160 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:51 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:51.860+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:23.708371+0000 front 2024-01-25T15:06:23.708410+0000 (oldest deadline 2024-01-25T15:06:47.808118+0000) 2024-01-25T15:06:52.339 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:52 smithi170 podman[91702]: 2024-01-25 15:06:52.277853775 +0000 UTC m=+0.618724450 container died 6805f89a178257c2bdb757d34f684c2d5640d3e37b97e29fdfcb69635bfdd157 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9-deactivate, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, CEPH_POINT_RELEASE=) 2024-01-25T15:06:52.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:52 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:52.411+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:52.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:52 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:52.412+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:52.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:52 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:52.412+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:52.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:52 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:52.412+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:52.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:52 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:52.412+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:52.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:52 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:52.412+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:25.656602+0000 front 2024-01-25T15:06:25.656588+0000 (oldest deadline 2024-01-25T15:06:51.556360+0000) 2024-01-25T15:06:52.835 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.9.service' 2024-01-25T15:06:52.862 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:52 smithi170 podman[91729]: 2024-01-25 15:06:52.811989519 +0000 UTC m=+0.528710480 container remove 6805f89a178257c2bdb757d34f684c2d5640d3e37b97e29fdfcb69635bfdd157 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-9-deactivate, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T15:06:52.862 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:52 smithi170 systemd[1]: ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.9.service: Deactivated successfully. 2024-01-25T15:06:52.862 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:52 smithi170 systemd[1]: Stopped Ceph osd.9 for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T15:06:52.862 INFO:journalctl@ceph.osd.9.smithi170.stdout:Jan 25 15:06:52 smithi170 systemd[1]: ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.9.service: Consumed 15.812s CPU time. 2024-01-25T15:06:52.878 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:06:52.878 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-01-25T15:06:52.878 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-01-25T15:06:52.878 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.10 2024-01-25T15:06:53.175 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:52 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:52.874+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:53.176 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:52 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:52.874+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:53.176 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:52 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:52.874+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:53.176 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:52 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:52.874+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:53.176 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:52 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:52.874+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:53.176 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:52 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:52.874+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:53.176 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:52 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:52.874+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:23.708371+0000 front 2024-01-25T15:06:23.708410+0000 (oldest deadline 2024-01-25T15:06:47.808118+0000) 2024-01-25T15:06:53.176 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:52 smithi186 systemd[1]: Stopping Ceph osd.10 for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:06:53.176 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:53 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:53.174+0000 7fa2b044f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:06:53.176 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:53 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:53.174+0000 7fa2b044f700 -1 osd.10 90 *** Got signal Terminated *** 2024-01-25T15:06:53.176 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:53 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:53.174+0000 7fa2b044f700 -1 osd.10 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-25T15:06:53.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:53 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:53.363+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:53.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:53 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:53.363+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:53.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:53 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:53.363+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:53.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:53 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:53.363+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:53.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:53 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:53.363+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:53.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:53 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:53.363+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:25.656602+0000 front 2024-01-25T15:06:25.656588+0000 (oldest deadline 2024-01-25T15:06:51.556360+0000) 2024-01-25T15:06:54.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:53 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:53.847+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:54.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:53 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:53.847+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:54.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:53 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:53.847+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:54.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:53 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:53.847+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:54.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:53 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:53.847+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:54.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:53 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:53.847+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:54.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:53 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:53.847+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:23.708371+0000 front 2024-01-25T15:06:23.708410+0000 (oldest deadline 2024-01-25T15:06:47.808118+0000) 2024-01-25T15:06:54.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:54 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:54.328+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:54.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:54 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:54.328+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:54.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:54 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:54.328+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:54.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:54 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:54.328+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:54.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:54 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:54.328+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:54.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:54 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:54.328+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:25.656602+0000 front 2024-01-25T15:06:25.656588+0000 (oldest deadline 2024-01-25T15:06:51.556360+0000) 2024-01-25T15:06:55.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:54 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:54.811+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:55.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:54 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:54.811+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:55.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:54 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:54.811+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:55.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:54 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:54.811+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:55.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:54 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:54.811+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:55.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:54 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:54.811+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:55.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:54 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:54.811+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:23.708371+0000 front 2024-01-25T15:06:23.708410+0000 (oldest deadline 2024-01-25T15:06:47.808118+0000) 2024-01-25T15:06:55.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:55 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:55.323+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:55.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:55 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:55.323+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:55.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:55 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:55.323+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:55.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:55 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:55.323+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:55.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:55 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:55.323+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:55.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:55 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:55.323+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:25.656602+0000 front 2024-01-25T15:06:25.656588+0000 (oldest deadline 2024-01-25T15:06:51.556360+0000) 2024-01-25T15:06:56.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:55 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:55.798+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:56.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:55 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:55.798+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:56.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:55 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:55.798+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:56.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:55 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:55.798+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:56.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:55 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:55.798+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:56.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:55 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:55.798+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:56.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:55 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:55.798+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:23.708371+0000 front 2024-01-25T15:06:23.708410+0000 (oldest deadline 2024-01-25T15:06:47.808118+0000) 2024-01-25T15:06:56.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:56 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:56.305+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:56.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:56 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:56.305+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:56.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:56 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:56.305+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:56.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:56 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:56.305+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:56.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:56 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:56.305+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:56.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:56 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:56.305+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:25.656602+0000 front 2024-01-25T15:06:25.656588+0000 (oldest deadline 2024-01-25T15:06:51.556360+0000) 2024-01-25T15:06:57.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:56 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:56.799+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:57.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:56 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:56.799+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:57.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:56 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:56.799+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:57.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:56 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:56.799+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:57.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:56 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:56.799+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:57.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:56 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:56.799+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:57.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:56 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:56.799+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:23.708371+0000 front 2024-01-25T15:06:23.708410+0000 (oldest deadline 2024-01-25T15:06:47.808118+0000) 2024-01-25T15:06:57.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:57 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:57.291+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:57.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:57 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:57.291+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:57.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:57 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:57.291+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:57.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:57 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:57.291+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:57.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:57 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:57.291+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:57.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:57 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:57.291+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:25.656602+0000 front 2024-01-25T15:06:25.656588+0000 (oldest deadline 2024-01-25T15:06:51.556360+0000) 2024-01-25T15:06:58.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:57 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:57.832+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:38.801458+0000 front 2024-01-25T15:05:38.801408+0000 (oldest deadline 2024-01-25T15:06:02.301377+0000) 2024-01-25T15:06:58.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:57 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:57.832+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:44.602302+0000 front 2024-01-25T15:05:44.602326+0000 (oldest deadline 2024-01-25T15:06:11.603165+0000) 2024-01-25T15:06:58.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:57 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:57.832+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:55.104422+0000 front 2024-01-25T15:05:55.104283+0000 (oldest deadline 2024-01-25T15:06:19.204191+0000) 2024-01-25T15:06:58.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:57 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:57.832+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6814 osd.3 since back 2024-01-25T15:06:02.705471+0000 front 2024-01-25T15:06:02.705247+0000 (oldest deadline 2024-01-25T15:06:25.605227+0000) 2024-01-25T15:06:58.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:57 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:57.832+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:07.306084+0000 front 2024-01-25T15:06:07.306137+0000 (oldest deadline 2024-01-25T15:06:32.606134+0000) 2024-01-25T15:06:58.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:57 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:57.832+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.907116+0000 front 2024-01-25T15:06:14.907210+0000 (oldest deadline 2024-01-25T15:06:40.807031+0000) 2024-01-25T15:06:58.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:57 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10[61305]: 2024-01-25T15:06:57.832+0000 7fa2ad24b700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:23.708371+0000 front 2024-01-25T15:06:23.708410+0000 (oldest deadline 2024-01-25T15:06:47.808118+0000) 2024-01-25T15:06:58.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:58 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:58.273+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:58.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:58 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:58.273+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:58.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:58 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:58.273+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:58.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:58 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:58.273+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:58.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:58 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:58.273+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:58.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:58 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:58.273+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:25.656602+0000 front 2024-01-25T15:06:25.656588+0000 (oldest deadline 2024-01-25T15:06:51.556360+0000) 2024-01-25T15:06:58.807 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:58 smithi186 podman[71142]: 2024-01-25 15:06:58.509283719 +0000 UTC m=+5.436558246 container died 07c46c2749eb1701183b44a3be9fe8516e870945c8377eee3a0ee6a82ad06d84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-01-25T15:06:59.104 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:58 smithi186 podman[71142]: 2024-01-25 15:06:58.80787095 +0000 UTC m=+5.735145462 container cleanup 07c46c2749eb1701183b44a3be9fe8516e870945c8377eee3a0ee6a82ad06d84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-01-25T15:06:59.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:58 smithi186 bash[71142]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10 2024-01-25T15:06:59.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:59 smithi186 podman[71160]: 2024-01-25 15:06:59.017226701 +0000 UTC m=+0.502578059 container remove 07c46c2749eb1701183b44a3be9fe8516e870945c8377eee3a0ee6a82ad06d84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3) 2024-01-25T15:06:59.604 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:59 smithi186 podman[71254]: 2024-01-25 15:06:59.225316499 +0000 UTC m=+0.017836283 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T15:06:59.605 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:59 smithi186 podman[71254]: 2024-01-25 15:06:59.326288043 +0000 UTC m=+0.118807813 container create 8eea5ceacad535868f759d9fc238f404c522541d489f8ff37582ec5f20c62356 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-01-25T15:06:59.605 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:59 smithi186 podman[71254]: 2024-01-25 15:06:59.536887128 +0000 UTC m=+0.329406902 container init 8eea5ceacad535868f759d9fc238f404c522541d489f8ff37582ec5f20c62356 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-25T15:06:59.605 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:59 smithi186 podman[71254]: 2024-01-25 15:06:59.540027836 +0000 UTC m=+0.332547598 container start 8eea5ceacad535868f759d9fc238f404c522541d489f8ff37582ec5f20c62356 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T15:06:59.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:59 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:59.304+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:06:59.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:59 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:59.304+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:06:59.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:59 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:59.304+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:06:59.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:59 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:59.304+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:06:59.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:59 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:59.304+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:06:59.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:59 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:59.304+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:25.656602+0000 front 2024-01-25T15:06:25.656588+0000 (oldest deadline 2024-01-25T15:06:51.556360+0000) 2024-01-25T15:06:59.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:06:59 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:06:59.304+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6820 osd.7 since back 2024-01-25T15:06:33.257251+0000 front 2024-01-25T15:06:33.257193+0000 (oldest deadline 2024-01-25T15:06:58.557148+0000) 2024-01-25T15:07:00.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:59 smithi186 podman[71254]: 2024-01-25 15:06:59.628526648 +0000 UTC m=+0.421046434 container attach 8eea5ceacad535868f759d9fc238f404c522541d489f8ff37582ec5f20c62356 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T15:07:00.105 INFO:journalctl@ceph.osd.10.smithi186.stdout:Jan 25 15:06:59 smithi186 podman[71254]: 2024-01-25 15:06:59.819799764 +0000 UTC m=+0.612319557 container died 8eea5ceacad535868f759d9fc238f404c522541d489f8ff37582ec5f20c62356 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-01-25T15:07:00.407 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.10.service' 2024-01-25T15:07:00.451 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:07:00.451 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-01-25T15:07:00.451 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-01-25T15:07:00.451 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.11 2024-01-25T15:07:00.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:00 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:00.271+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:07:00.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:00 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:00.271+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:07:00.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:00 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:00.271+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:07:00.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:00 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:00.271+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:07:00.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:00 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:00.271+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:07:00.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:00 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:00.271+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:25.656602+0000 front 2024-01-25T15:06:25.656588+0000 (oldest deadline 2024-01-25T15:06:51.556360+0000) 2024-01-25T15:07:00.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:00 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:00.271+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6820 osd.7 since back 2024-01-25T15:06:33.257251+0000 front 2024-01-25T15:06:33.257193+0000 (oldest deadline 2024-01-25T15:06:58.557148+0000) 2024-01-25T15:07:00.735 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:00 smithi191 systemd[1]: Stopping Ceph osd.11 for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:07:01.229 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:00 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:00.746+0000 7fa52ca98700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:07:01.229 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:00 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:00.746+0000 7fa52ca98700 -1 osd.11 90 *** Got signal Terminated *** 2024-01-25T15:07:01.229 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:00 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:00.746+0000 7fa52ca98700 -1 osd.11 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-01-25T15:07:01.230 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:01 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:01.228+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:07:01.230 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:01 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:01.228+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:07:01.230 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:01 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:01.228+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:07:01.230 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:01 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:01.228+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:07:01.230 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:01 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:01.228+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:07:01.230 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:01 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:01.228+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:25.656602+0000 front 2024-01-25T15:06:25.656588+0000 (oldest deadline 2024-01-25T15:06:51.556360+0000) 2024-01-25T15:07:01.230 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:01 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:01.228+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6820 osd.7 since back 2024-01-25T15:06:33.257251+0000 front 2024-01-25T15:06:33.257193+0000 (oldest deadline 2024-01-25T15:06:58.557148+0000) 2024-01-25T15:07:02.483 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:02 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:02.215+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:07:02.483 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:02 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:02.215+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:07:02.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:02 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:02.215+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:07:02.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:02 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:02.215+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:07:02.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:02 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:02.215+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:07:02.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:02 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:02.215+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:25.656602+0000 front 2024-01-25T15:06:25.656588+0000 (oldest deadline 2024-01-25T15:06:51.556360+0000) 2024-01-25T15:07:02.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:02 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:02.215+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6820 osd.7 since back 2024-01-25T15:06:33.257251+0000 front 2024-01-25T15:06:33.257193+0000 (oldest deadline 2024-01-25T15:06:58.557148+0000) 2024-01-25T15:07:03.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:03 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:03.243+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:07:03.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:03 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:03.243+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:07:03.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:03 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:03.243+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:07:03.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:03 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:03.243+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:07:03.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:03 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:03.243+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:07:03.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:03 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:03.243+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:25.656602+0000 front 2024-01-25T15:06:25.656588+0000 (oldest deadline 2024-01-25T15:06:51.556360+0000) 2024-01-25T15:07:03.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:03 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:03.243+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6820 osd.7 since back 2024-01-25T15:06:33.257251+0000 front 2024-01-25T15:06:33.257193+0000 (oldest deadline 2024-01-25T15:06:58.557148+0000) 2024-01-25T15:07:04.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:04 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:04.232+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:07:04.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:04 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:04.232+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:07:04.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:04 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:04.232+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:07:04.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:04 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:04.232+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:07:04.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:04 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:04.232+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:07:04.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:04 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:04.232+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:25.656602+0000 front 2024-01-25T15:06:25.656588+0000 (oldest deadline 2024-01-25T15:06:51.556360+0000) 2024-01-25T15:07:04.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:04 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:04.232+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6820 osd.7 since back 2024-01-25T15:06:33.257251+0000 front 2024-01-25T15:06:33.257193+0000 (oldest deadline 2024-01-25T15:06:58.557148+0000) 2024-01-25T15:07:04.484 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:04 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:04.232+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6820 osd.8 since back 2024-01-25T15:06:38.557630+0000 front 2024-01-25T15:06:38.557647+0000 (oldest deadline 2024-01-25T15:07:03.257823+0000) 2024-01-25T15:07:05.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:05 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:05.233+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6806 osd.0 since back 2024-01-25T15:05:36.947241+0000 front 2024-01-25T15:05:36.947214+0000 (oldest deadline 2024-01-25T15:06:00.447191+0000) 2024-01-25T15:07:05.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:05 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:05.233+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6804 osd.1 since back 2024-01-25T15:05:42.148465+0000 front 2024-01-25T15:05:42.148556+0000 (oldest deadline 2024-01-25T15:06:08.048558+0000) 2024-01-25T15:07:05.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:05 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:05.233+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6804 osd.2 since back 2024-01-25T15:05:54.450330+0000 front 2024-01-25T15:05:54.450406+0000 (oldest deadline 2024-01-25T15:06:17.850911+0000) 2024-01-25T15:07:05.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:05 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:05.233+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6812 osd.4 since back 2024-01-25T15:06:08.253696+0000 front 2024-01-25T15:06:08.253675+0000 (oldest deadline 2024-01-25T15:06:32.953757+0000) 2024-01-25T15:07:05.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:05 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:05.233+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6812 osd.5 since back 2024-01-25T15:06:14.654560+0000 front 2024-01-25T15:06:14.654621+0000 (oldest deadline 2024-01-25T15:06:40.554630+0000) 2024-01-25T15:07:05.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:05 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:05.233+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.170:6822 osd.6 since back 2024-01-25T15:06:25.656602+0000 front 2024-01-25T15:06:25.656588+0000 (oldest deadline 2024-01-25T15:06:51.556360+0000) 2024-01-25T15:07:05.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:05 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:05.233+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.186:6820 osd.7 since back 2024-01-25T15:06:33.257251+0000 front 2024-01-25T15:06:33.257193+0000 (oldest deadline 2024-01-25T15:06:58.557148+0000) 2024-01-25T15:07:05.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:05 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11[62148]: 2024-01-25T15:07:05.233+0000 7fa52588c700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.191:6820 osd.8 since back 2024-01-25T15:06:38.557630+0000 front 2024-01-25T15:06:38.557647+0000 (oldest deadline 2024-01-25T15:07:03.257823+0000) 2024-01-25T15:07:06.399 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:06 smithi191 podman[72005]: 2024-01-25 15:07:06.109011078 +0000 UTC m=+5.470499440 container died f984fb38bf52adc870269c80f0f999561a57fcec4eccdc0393e51fff96f1742a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240123, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T15:07:06.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:06 smithi191 podman[72005]: 2024-01-25 15:07:06.497893253 +0000 UTC m=+5.859381603 container cleanup f984fb38bf52adc870269c80f0f999561a57fcec4eccdc0393e51fff96f1742a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T15:07:06.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:06 smithi191 bash[72005]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11 2024-01-25T15:07:07.057 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:06 smithi191 podman[72021]: 2024-01-25 15:07:06.740936651 +0000 UTC m=+0.633153967 container remove f984fb38bf52adc870269c80f0f999561a57fcec4eccdc0393e51fff96f1742a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-01-25T15:07:07.346 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:07 smithi191 podman[72111]: 2024-01-25 15:07:06.960555444 +0000 UTC m=+0.017654364 image pull 0b5dc47a38d7bdf336755caaa9af4764ad427a7d8ff345169ca31ad704c9d775 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06 2024-01-25T15:07:07.346 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:07 smithi191 podman[72111]: 2024-01-25 15:07:07.058688582 +0000 UTC m=+0.115787492 container create e622effc1cf3c65e12c7d11a821ebc7aecc421cfa15d10e3527f4a892f43c5be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS) 2024-01-25T15:07:07.346 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:07 smithi191 podman[72111]: 2024-01-25 15:07:07.270135715 +0000 UTC m=+0.327234636 container init e622effc1cf3c65e12c7d11a821ebc7aecc421cfa15d10e3527f4a892f43c5be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-01-25T15:07:07.346 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:07 smithi191 podman[72111]: 2024-01-25 15:07:07.273559076 +0000 UTC m=+0.330657980 container start e622effc1cf3c65e12c7d11a821ebc7aecc421cfa15d10e3527f4a892f43c5be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-01-25T15:07:07.733 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:07 smithi191 podman[72111]: 2024-01-25 15:07:07.345360246 +0000 UTC m=+0.402459175 container attach e622effc1cf3c65e12c7d11a821ebc7aecc421cfa15d10e3527f4a892f43c5be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS) 2024-01-25T15:07:07.734 INFO:journalctl@ceph.osd.11.smithi191.stdout:Jan 25 15:07:07 smithi191 podman[72111]: 2024-01-25 15:07:07.5488228 +0000 UTC m=+0.605921725 container died e622effc1cf3c65e12c7d11a821ebc7aecc421cfa15d10e3527f4a892f43c5be (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-osd-11-deactivate, org.label-schema.build-date=20240123, GIT_CLEAN=True, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T15:07:08.156 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@osd.11.service' 2024-01-25T15:07:08.197 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:07:08.198 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-01-25T15:07:08.198 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-01-25T15:07:08.198 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.a 2024-01-25T15:07:08.506 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 15:07:08 smithi170 systemd[1]: Stopping Ceph mds.a for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:07:08.874 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 15:07:08 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-a[73635]: 2024-01-25T15:07:08.505+0000 7fabdf662700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:07:08.874 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 15:07:08 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-a[73635]: 2024-01-25T15:07:08.505+0000 7fabdf662700 -1 mds.a *** got signal Terminated *** 2024-01-25T15:07:11.624 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 15:07:11 smithi170 podman[91823]: 2024-01-25 15:07:11.311790779 +0000 UTC m=+2.907792059 container died 7357d6d22f957d193d601a5dcebc6e663e4bf92ee967529ac714ae0aef45c75e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3) 2024-01-25T15:07:11.947 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 15:07:11 smithi170 podman[91823]: 2024-01-25 15:07:11.713328115 +0000 UTC m=+3.309329393 container cleanup 7357d6d22f957d193d601a5dcebc6e663e4bf92ee967529ac714ae0aef45c75e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123) 2024-01-25T15:07:11.948 INFO:journalctl@ceph.mds.a.smithi170.stdout:Jan 25 15:07:11 smithi170 bash[91823]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-a 2024-01-25T15:07:12.092 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.a.service' 2024-01-25T15:07:12.132 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:07:12.132 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-01-25T15:07:12.132 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-01-25T15:07:12.132 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.d 2024-01-25T15:07:12.624 INFO:journalctl@ceph.mds.d.smithi170.stdout:Jan 25 15:07:12 smithi170 systemd[1]: Stopping Ceph mds.d for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:07:12.624 INFO:journalctl@ceph.mds.d.smithi170.stdout:Jan 25 15:07:12 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-d[72689]: 2024-01-25T15:07:12.466+0000 7f97ead37700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:07:12.624 INFO:journalctl@ceph.mds.d.smithi170.stdout:Jan 25 15:07:12 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-d[72689]: 2024-01-25T15:07:12.466+0000 7f97ead37700 -1 mds.d *** got signal Terminated *** 2024-01-25T15:07:14.827 INFO:journalctl@ceph.mds.d.smithi170.stdout:Jan 25 15:07:14 smithi170 podman[91946]: 2024-01-25 15:07:14.567333594 +0000 UTC m=+2.212137045 container died 2305340b89c446f531d1e5a44cfc6d3e8972790bf62059bd3545ecae048b5553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-d, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240123, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T15:07:15.124 INFO:journalctl@ceph.mds.d.smithi170.stdout:Jan 25 15:07:14 smithi170 podman[91946]: 2024-01-25 15:07:14.925439373 +0000 UTC m=+2.570242822 container cleanup 2305340b89c446f531d1e5a44cfc6d3e8972790bf62059bd3545ecae048b5553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-d, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.31.3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-01-25T15:07:15.124 INFO:journalctl@ceph.mds.d.smithi170.stdout:Jan 25 15:07:14 smithi170 bash[91946]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-d 2024-01-25T15:07:15.347 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.d.service' 2024-01-25T15:07:15.383 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:07:15.383 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-01-25T15:07:15.384 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-01-25T15:07:15.384 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.g 2024-01-25T15:07:15.874 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 15:07:15 smithi170 systemd[1]: Stopping Ceph mds.g for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:07:15.874 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 15:07:15 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-g[73280]: 2024-01-25T15:07:15.695+0000 7f001c561700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:07:15.874 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 15:07:15 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-g[73280]: 2024-01-25T15:07:15.695+0000 7f001c561700 -1 mds.g *** got signal Terminated *** 2024-01-25T15:07:19.597 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 15:07:19 smithi170 podman[92067]: 2024-01-25 15:07:19.32491804 +0000 UTC m=+3.731208223 container died 4ba03dbf60228c37bf67067922ad0dd884048c02574566d30a0d3a2ba41121bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-g, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, org.label-schema.license=GPLv2) 2024-01-25T15:07:19.874 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 15:07:19 smithi170 podman[92067]: 2024-01-25 15:07:19.670671412 +0000 UTC m=+4.076961594 container cleanup 4ba03dbf60228c37bf67067922ad0dd884048c02574566d30a0d3a2ba41121bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T15:07:19.874 INFO:journalctl@ceph.mds.g.smithi170.stdout:Jan 25 15:07:19 smithi170 bash[92067]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-g 2024-01-25T15:07:20.236 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.g.service' 2024-01-25T15:07:20.270 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:07:20.270 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-01-25T15:07:20.270 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-01-25T15:07:20.270 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.j 2024-01-25T15:07:20.591 INFO:journalctl@ceph.mds.j.smithi170.stdout:Jan 25 15:07:20 smithi170 systemd[1]: Stopping Ceph mds.j for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:07:20.873 INFO:journalctl@ceph.mds.j.smithi170.stdout:Jan 25 15:07:20 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-j[72340]: 2024-01-25T15:07:20.590+0000 7fec9a3eb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:07:20.874 INFO:journalctl@ceph.mds.j.smithi170.stdout:Jan 25 15:07:20 smithi170 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-j[72340]: 2024-01-25T15:07:20.590+0000 7fec9a3eb700 -1 mds.j *** got signal Terminated *** 2024-01-25T15:07:24.124 INFO:journalctl@ceph.mds.j.smithi170.stdout:Jan 25 15:07:23 smithi170 podman[92187]: 2024-01-25 15:07:23.869272627 +0000 UTC m=+3.390576338 container died 2becd56945cc8004f0d7f94adb88916a3a21e097445b7728d37f18c798f59c18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-j, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD) 2024-01-25T15:07:24.500 INFO:journalctl@ceph.mds.j.smithi170.stdout:Jan 25 15:07:24 smithi170 podman[92187]: 2024-01-25 15:07:24.232730753 +0000 UTC m=+3.754034506 container cleanup 2becd56945cc8004f0d7f94adb88916a3a21e097445b7728d37f18c798f59c18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-j, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240123, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.31.3, org.label-schema.license=GPLv2) 2024-01-25T15:07:24.500 INFO:journalctl@ceph.mds.j.smithi170.stdout:Jan 25 15:07:24 smithi170 bash[92187]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-j 2024-01-25T15:07:24.654 DEBUG:teuthology.orchestra.run.smithi170:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.j.service' 2024-01-25T15:07:24.688 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:07:24.688 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-01-25T15:07:24.688 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-01-25T15:07:24.688 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.b 2024-01-25T15:07:24.982 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:07:24 smithi186 systemd[1]: Stopping Ceph mds.b for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:07:25.246 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:07:24 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:07:24.981+0000 7f118672e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:07:25.246 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:07:24 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b[67032]: 2024-01-25T15:07:24.982+0000 7f118672e700 -1 mds.b *** got signal Terminated *** 2024-01-25T15:07:27.574 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:07:27 smithi186 podman[71359]: 2024-01-25 15:07:27.314112601 +0000 UTC m=+2.433376302 container died 2d011732f152b4bb408c8ddd615e01e5060fef9dd101a69f89df2dcd7cb02b8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.31.3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2) 2024-01-25T15:07:27.854 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:07:27 smithi186 podman[71359]: 2024-01-25 15:07:27.65672821 +0000 UTC m=+2.775991904 container cleanup 2d011732f152b4bb408c8ddd615e01e5060fef9dd101a69f89df2dcd7cb02b8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-01-25T15:07:27.854 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:07:27 smithi186 bash[71359]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b 2024-01-25T15:07:27.855 INFO:journalctl@ceph.mds.b.smithi186.stdout:Jan 25 15:07:27 smithi186 podman[71386]: 2024-01-25 15:07:27.807842459 +0000 UTC m=+0.494581414 container remove 2d011732f152b4bb408c8ddd615e01e5060fef9dd101a69f89df2dcd7cb02b8d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-b, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-01-25T15:07:28.023 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.b.service' 2024-01-25T15:07:28.061 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:07:28.061 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-01-25T15:07:28.061 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-01-25T15:07:28.062 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.e 2024-01-25T15:07:28.354 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 15:07:28 smithi186 systemd[1]: Stopping Ceph mds.e for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:07:28.854 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 15:07:28 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-e[66402]: 2024-01-25T15:07:28.384+0000 7fdcfd590700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:07:28.855 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 15:07:28 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-e[66402]: 2024-01-25T15:07:28.384+0000 7fdcfd590700 -1 mds.e *** got signal Terminated *** 2024-01-25T15:07:31.604 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 15:07:31 smithi186 podman[71493]: 2024-01-25 15:07:31.317129882 +0000 UTC m=+3.041218506 container died 116e5f0aed5f2e6117455060b7e52010fa7988d10e2854838524211a9ef611aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-e, GIT_BRANCH=HEAD, org.label-schema.build-date=20240123, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-01-25T15:07:31.944 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 15:07:31 smithi186 podman[71493]: 2024-01-25 15:07:31.702145352 +0000 UTC m=+3.426233967 container cleanup 116e5f0aed5f2e6117455060b7e52010fa7988d10e2854838524211a9ef611aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-e, io.buildah.version=1.31.3, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240123, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-25T15:07:31.945 INFO:journalctl@ceph.mds.e.smithi186.stdout:Jan 25 15:07:31 smithi186 bash[71493]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-e 2024-01-25T15:07:32.076 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.e.service' 2024-01-25T15:07:32.167 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:07:32.167 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-01-25T15:07:32.167 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-01-25T15:07:32.168 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.h 2024-01-25T15:07:32.539 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 15:07:32 smithi186 systemd[1]: Stopping Ceph mds.h for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:07:32.854 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 15:07:32 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-h[66710]: 2024-01-25T15:07:32.539+0000 7f50da239700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:07:32.855 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 15:07:32 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-h[66710]: 2024-01-25T15:07:32.539+0000 7f50da239700 -1 mds.h *** got signal Terminated *** 2024-01-25T15:07:35.572 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 15:07:35 smithi186 podman[71614]: 2024-01-25 15:07:35.318062553 +0000 UTC m=+2.939293703 container died 0b3ecf66302fb660d88fcb5a8e67fde5d04f5aeba44dc36eea9b439d2535f549 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.license=GPLv2, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux ) 2024-01-25T15:07:35.854 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 15:07:35 smithi186 podman[71614]: 2024-01-25 15:07:35.655584496 +0000 UTC m=+3.276815642 container cleanup 0b3ecf66302fb660d88fcb5a8e67fde5d04f5aeba44dc36eea9b439d2535f549 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-h, io.buildah.version=1.31.3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240123, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T15:07:35.854 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 15:07:35 smithi186 bash[71614]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-h 2024-01-25T15:07:36.116 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.h.service' 2024-01-25T15:07:36.140 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 15:07:35 smithi186 podman[71628]: 2024-01-25 15:07:35.873547627 +0000 UTC m=+0.551120379 container remove 0b3ecf66302fb660d88fcb5a8e67fde5d04f5aeba44dc36eea9b439d2535f549 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-h, org.label-schema.build-date=20240123, RELEASE=wip-vshankar-testing-20240125.044502-661946e, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.31.3, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-01-25T15:07:36.140 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 15:07:36 smithi186 systemd[1]: ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.h.service: Deactivated successfully. 2024-01-25T15:07:36.140 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 15:07:36 smithi186 systemd[1]: Stopped Ceph mds.h for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T15:07:36.140 INFO:journalctl@ceph.mds.h.smithi186.stdout:Jan 25 15:07:36 smithi186 systemd[1]: ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.h.service: Consumed 1.989s CPU time. 2024-01-25T15:07:36.151 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:07:36.151 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-01-25T15:07:36.151 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-01-25T15:07:36.151 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.k 2024-01-25T15:07:36.467 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:07:36 smithi186 systemd[1]: Stopping Ceph mds.k for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:07:36.854 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:07:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:07:36.466+0000 7f13defb0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:07:36.854 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:07:36 smithi186 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k[66084]: 2024-01-25T15:07:36.467+0000 7f13defb0700 -1 mds.k *** got signal Terminated *** 2024-01-25T15:07:39.592 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:07:39 smithi186 podman[71734]: 2024-01-25 15:07:39.315163872 +0000 UTC m=+2.943878202 container died 79db010c01ceff8b1d4c7397f136345c4ef98e19b7229c3f7d340193875ae2fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240123) 2024-01-25T15:07:39.854 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:07:39 smithi186 podman[71734]: 2024-01-25 15:07:39.667101229 +0000 UTC m=+3.295815569 container cleanup 79db010c01ceff8b1d4c7397f136345c4ef98e19b7229c3f7d340193875ae2fd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T15:07:39.854 INFO:journalctl@ceph.mds.k.smithi186.stdout:Jan 25 15:07:39 smithi186 bash[71734]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-k 2024-01-25T15:07:40.083 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.k.service' 2024-01-25T15:07:40.118 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:07:40.118 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-01-25T15:07:40.118 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-01-25T15:07:40.118 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.c 2024-01-25T15:07:40.475 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:07:40 smithi191 systemd[1]: Stopping Ceph mds.c for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:07:40.733 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:07:40 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:07:40.474+0000 7fb3bc2f0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:07:40.733 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:07:40 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c[67516]: 2024-01-25T15:07:40.474+0000 7fb3bc2f0700 -1 mds.c *** got signal Terminated *** 2024-01-25T15:07:43.643 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:07:43 smithi191 podman[72215]: 2024-01-25 15:07:43.321632768 +0000 UTC m=+3.013660992 container died 08a2e92cf9f4015e962892e6e650ac5574d513c0564c8f434be5f3977db13fde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240123, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-01-25T15:07:43.643 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:07:43 smithi191 podman[72215]: 2024-01-25 15:07:43.6426094 +0000 UTC m=+3.334637627 container cleanup 08a2e92cf9f4015e962892e6e650ac5574d513c0564c8f434be5f3977db13fde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.31.3, ceph=True, org.label-schema.build-date=20240123, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-01-25T15:07:43.984 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:07:43 smithi191 bash[72215]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c 2024-01-25T15:07:43.984 INFO:journalctl@ceph.mds.c.smithi191.stdout:Jan 25 15:07:43 smithi191 podman[72241]: 2024-01-25 15:07:43.827566389 +0000 UTC m=+0.499447856 container remove 08a2e92cf9f4015e962892e6e650ac5574d513c0564c8f434be5f3977db13fde (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240123, GIT_BRANCH=HEAD, io.buildah.version=1.31.3, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240125.044502-661946e) 2024-01-25T15:07:44.057 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.c.service' 2024-01-25T15:07:44.096 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:07:44.097 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-01-25T15:07:44.097 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-01-25T15:07:44.097 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.f 2024-01-25T15:07:44.406 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 15:07:44 smithi191 systemd[1]: Stopping Ceph mds.f for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:07:44.733 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 15:07:44 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-f[67205]: 2024-01-25T15:07:44.405+0000 7faf1536a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:07:44.734 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 15:07:44 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-f[67205]: 2024-01-25T15:07:44.405+0000 7faf1536a700 -1 mds.f *** got signal Terminated *** 2024-01-25T15:07:47.656 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 15:07:47 smithi191 podman[72347]: 2024-01-25 15:07:47.32729089 +0000 UTC m=+3.019239296 container died fb08058e39a48b4bc97df85ffa6ffbc1452b1a68618ac8b86691299baeebe57d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-f, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.31.3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-01-25T15:07:47.983 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 15:07:47 smithi191 podman[72347]: 2024-01-25 15:07:47.655711057 +0000 UTC m=+3.347659448 container cleanup fb08058e39a48b4bc97df85ffa6ffbc1452b1a68618ac8b86691299baeebe57d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240125.044502-661946e, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.31.3, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183) 2024-01-25T15:07:47.983 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 15:07:47 smithi191 bash[72347]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-f 2024-01-25T15:07:47.984 INFO:journalctl@ceph.mds.f.smithi191.stdout:Jan 25 15:07:47 smithi191 podman[72361]: 2024-01-25 15:07:47.882973328 +0000 UTC m=+0.555048603 container remove fb08058e39a48b4bc97df85ffa6ffbc1452b1a68618ac8b86691299baeebe57d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-f, io.buildah.version=1.31.3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240125.044502-661946e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240123) 2024-01-25T15:07:48.128 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.f.service' 2024-01-25T15:07:48.164 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:07:48.164 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-01-25T15:07:48.164 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-01-25T15:07:48.164 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.i 2024-01-25T15:07:48.477 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:07:48 smithi191 systemd[1]: Stopping Ceph mds.i for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:07:48.733 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:07:48 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i[67820]: 2024-01-25T15:07:48.476+0000 7f56d6b2d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:07:48.733 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:07:48 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i[67820]: 2024-01-25T15:07:48.476+0000 7f56d6b2d700 -1 mds.i *** got signal Terminated *** 2024-01-25T15:07:51.570 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:07:51 smithi191 podman[72471]: 2024-01-25 15:07:51.315559841 +0000 UTC m=+2.939653370 container died 51ab556666d7d11bc742c9b7c6ca49a42fe911d2429eb9dd2f5b1bdd8bf3cf74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, io.buildah.version=1.31.3) 2024-01-25T15:07:51.829 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:07:51 smithi191 podman[72471]: 2024-01-25 15:07:51.652442684 +0000 UTC m=+3.276536208 container cleanup 51ab556666d7d11bc742c9b7c6ca49a42fe911d2429eb9dd2f5b1bdd8bf3cf74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i, org.label-schema.build-date=20240123, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.31.3) 2024-01-25T15:07:51.829 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:07:51 smithi191 bash[72471]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i 2024-01-25T15:07:52.064 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.i.service' 2024-01-25T15:07:52.087 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:07:51 smithi191 podman[72485]: 2024-01-25 15:07:51.829098792 +0000 UTC m=+0.510377924 container remove 51ab556666d7d11bc742c9b7c6ca49a42fe911d2429eb9dd2f5b1bdd8bf3cf74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-i, org.label-schema.vendor=CentOS, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, io.buildah.version=1.31.3, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.build-date=20240123, CEPH_POINT_RELEASE=) 2024-01-25T15:07:52.087 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:07:52 smithi191 systemd[1]: ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.i.service: Deactivated successfully. 2024-01-25T15:07:52.088 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:07:52 smithi191 systemd[1]: Stopped Ceph mds.i for 267213a8-bb91-11ee-95b2-87774f69a715. 2024-01-25T15:07:52.088 INFO:journalctl@ceph.mds.i.smithi191.stdout:Jan 25 15:07:52 smithi191 systemd[1]: ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.i.service: Consumed 2min 7.566s CPU time. 2024-01-25T15:07:52.098 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:07:52.098 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-01-25T15:07:52.098 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-01-25T15:07:52.099 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.l 2024-01-25T15:07:52.423 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:07:52 smithi191 systemd[1]: Stopping Ceph mds.l for 267213a8-bb91-11ee-95b2-87774f69a715... 2024-01-25T15:07:52.722 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:07:52 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:07:52.423+0000 7f8a8ac3a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-01-25T15:07:52.723 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:07:52 smithi191 ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l[66893]: 2024-01-25T15:07:52.423+0000 7f8a8ac3a700 -1 mds.l *** got signal Terminated *** 2024-01-25T15:07:55.591 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:07:55 smithi191 podman[72594]: 2024-01-25 15:07:55.314679475 +0000 UTC m=+2.996020213 container died 1375f367e3b29396c02971de5091d6a3fc6a7c0034bee65d0a8cc6304d039132 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240123) 2024-01-25T15:07:55.591 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:07:55 smithi191 podman[72594]: 2024-01-25 15:07:55.59117266 +0000 UTC m=+3.272513400 container cleanup 1375f367e3b29396c02971de5091d6a3fc6a7c0034bee65d0a8cc6304d039132 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5605ea5d84bbf2ac5d8e2f7c50aa193735a361c5be4d9635ebaf6df822105f06, name=ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.31.3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240125.044502-661946e, org.label-schema.schema-version=1.0, GIT_COMMIT=60f64185d6ee4a1620a4e475ec29fb91e0b44183, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240123) 2024-01-25T15:07:55.867 INFO:journalctl@ceph.mds.l.smithi191.stdout:Jan 25 15:07:55 smithi191 bash[72594]: ceph-267213a8-bb91-11ee-95b2-87774f69a715-mds-l 2024-01-25T15:07:56.013 DEBUG:teuthology.orchestra.run.smithi191:> sudo pkill -f 'journalctl -f -n 0 -u ceph-267213a8-bb91-11ee-95b2-87774f69a715@mds.l.service' 2024-01-25T15:07:56.047 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-01-25T15:07:56.047 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-01-25T15:07:56.047 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 267213a8-bb91-11ee-95b2-87774f69a715 --force --keep-logs 2024-01-25T15:07:56.236 INFO:teuthology.orchestra.run.smithi170.stdout:Deleting cluster with fsid: 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T15:07:58.728 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 267213a8-bb91-11ee-95b2-87774f69a715 --force --keep-logs 2024-01-25T15:07:58.916 INFO:teuthology.orchestra.run.smithi186.stdout:Deleting cluster with fsid: 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T15:08:01.463 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 267213a8-bb91-11ee-95b2-87774f69a715 --force --keep-logs 2024-01-25T15:08:01.652 INFO:teuthology.orchestra.run.smithi191.stdout:Deleting cluster with fsid: 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T15:08:04.069 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-25T15:08:04.105 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-25T15:08:04.140 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-01-25T15:08:04.168 INFO:tasks.cephadm:Archiving crash dumps... 2024-01-25T15:08:04.170 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478/remote/smithi170/crash 2024-01-25T15:08:04.171 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/crash -- . 2024-01-25T15:08:04.202 INFO:teuthology.orchestra.run.smithi170.stderr:tar: /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/crash: Cannot open: No such file or directory 2024-01-25T15:08:04.202 INFO:teuthology.orchestra.run.smithi170.stderr:tar: Error is not recoverable: exiting now 2024-01-25T15:08:04.204 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478/remote/smithi186/crash 2024-01-25T15:08:04.205 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/crash -- . 2024-01-25T15:08:04.249 INFO:teuthology.orchestra.run.smithi186.stderr:tar: /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/crash: Cannot open: No such file or directory 2024-01-25T15:08:04.249 INFO:teuthology.orchestra.run.smithi186.stderr:tar: Error is not recoverable: exiting now 2024-01-25T15:08:04.251 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478/remote/smithi191/crash 2024-01-25T15:08:04.252 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/crash -- . 2024-01-25T15:08:04.285 INFO:teuthology.orchestra.run.smithi191.stderr:tar: /var/lib/ceph/267213a8-bb91-11ee-95b2-87774f69a715/crash: Cannot open: No such file or directory 2024-01-25T15:08:04.285 INFO:teuthology.orchestra.run.smithi191.stderr:tar: Error is not recoverable: exiting now 2024-01-25T15:08:04.286 INFO:tasks.cephadm:Checking cluster log for badness... 2024-01-25T15:08:04.286 DEBUG:teuthology.orchestra.run.smithi170:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-01-25T15:08:04.322 INFO:teuthology.orchestra.run.smithi170.stderr:grep: /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph.log: No such file or directory 2024-01-25T15:08:04.325 INFO:tasks.cephadm:Compressing logs... 2024-01-25T15:08:04.325 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-25T15:08:04.368 DEBUG:teuthology.orchestra.run.smithi186:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-25T15:08:04.371 DEBUG:teuthology.orchestra.run.smithi191:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-25T15:08:04.395 INFO:teuthology.orchestra.run.smithi170.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-01-25T15:08:04.395 INFO:teuthology.orchestra.run.smithi170.stderr:: No such file or directory 2024-01-25T15:08:04.395 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.6.log 2024-01-25T15:08:04.395 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mon.a.log 2024-01-25T15:08:04.395 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.g.log 2024-01-25T15:08:04.397 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.j.log 2024-01-25T15:08:04.397 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.3.log 2024-01-25T15:08:04.397 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.g.log: /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mgr.x.log 2024-01-25T15:08:04.398 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.0.log 2024-01-25T15:08:04.398 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-volume.log 2024-01-25T15:08:04.402 INFO:teuthology.orchestra.run.smithi191.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-01-25T15:08:04.402 INFO:teuthology.orchestra.run.smithi191.stderr:: No such file or directory 2024-01-25T15:08:04.402 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.l.log 2024-01-25T15:08:04.402 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.i.log 2024-01-25T15:08:04.402 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.11.log 2024-01-25T15:08:04.402 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mgr.z.log 2024-01-25T15:08:04.402 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.8.log 2024-01-25T15:08:04.402 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.11.log: /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.5.log 2024-01-25T15:08:04.402 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.8.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-01-25T15:08:04.402 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.f.log 2024-01-25T15:08:04.403 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.2.log 2024-01-25T15:08:04.403 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.c.log 2024-01-25T15:08:04.406 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.2.log: 92.2% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mgr.z.log.gz 2024-01-25T15:08:04.407 INFO:teuthology.orchestra.run.smithi191.stderr:gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-volume.log 2024-01-25T15:08:04.409 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.0.log: 94.6% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.j.log.gz 2024-01-25T15:08:04.409 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.9.log 2024-01-25T15:08:04.409 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-volume.log: 93.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-01-25T15:08:04.409 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.d.log 2024-01-25T15:08:04.410 INFO:teuthology.orchestra.run.smithi186.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose: No such file or directory -- 2024-01-25T15:08:04.410 INFO:teuthology.orchestra.run.smithi186.stderr: /var/log/ceph/cephadm.log 2024-01-25T15:08:04.410 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.10.log 2024-01-25T15:08:04.410 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.b.log 2024-01-25T15:08:04.410 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.4.log 2024-01-25T15:08:04.410 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.1.log 2024-01-25T15:08:04.410 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.4.log: gzip -5 92.2% --verbose -- -- replaced with /var/log/ceph/cephadm.log.gz 2024-01-25T15:08:04.410 INFO:teuthology.orchestra.run.smithi186.stderr: /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.k.log 2024-01-25T15:08:04.410 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.h.log 2024-01-25T15:08:04.410 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.1.log: /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.7.log 2024-01-25T15:08:04.410 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.e.log 2024-01-25T15:08:04.411 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mgr.y.log 2024-01-25T15:08:04.412 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.a.log 2024-01-25T15:08:04.414 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-volume.log 2024-01-25T15:08:04.416 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mon.c.log 2024-01-25T15:08:04.418 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.d.log: 94.6% 91.1% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-volume.log.gz 2024-01-25T15:08:04.418 INFO:teuthology.orchestra.run.smithi170.stderr: -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.d.log.gz 2024-01-25T15:08:04.426 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mgr.y.log: 92.1% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mgr.y.log.gz 2024-01-25T15:08:04.439 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mon.b.log 2024-01-25T15:08:04.443 INFO:teuthology.orchestra.run.smithi191.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-volume.log: /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mon.c.log: 91.0% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-volume.log.gz 2024-01-25T15:08:04.462 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-volume.log: /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mon.b.log: 90.9% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-volume.log.gz 2024-01-25T15:08:04.596 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.a.log: 90.0% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mgr.x.log.gz 2024-01-25T15:08:04.639 INFO:teuthology.orchestra.run.smithi170.stderr: 93.6% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.g.log.gz 2024-01-25T15:08:04.743 INFO:teuthology.orchestra.run.smithi186.stderr: 94.1% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.h.log.gz 2024-01-25T15:08:04.772 INFO:teuthology.orchestra.run.smithi170.stderr: 93.7% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.a.log.gz 2024-01-25T15:08:04.807 INFO:teuthology.orchestra.run.smithi191.stderr: 92.0% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mon.c.log.gz 2024-01-25T15:08:04.861 INFO:teuthology.orchestra.run.smithi186.stderr: 92.0% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mon.b.log.gz 2024-01-25T15:08:04.995 INFO:teuthology.orchestra.run.smithi186.stderr: 94.9% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.e.log.gz 2024-01-25T15:08:05.025 INFO:teuthology.orchestra.run.smithi170.stderr: 90.8% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mon.a.log.gz 2024-01-25T15:08:05.915 INFO:teuthology.orchestra.run.smithi170.stderr: 93.8% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.9.log.gz 2024-01-25T15:08:05.918 INFO:teuthology.orchestra.run.smithi186.stderr: 93.7% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.k.log.gz 2024-01-25T15:08:06.508 INFO:teuthology.orchestra.run.smithi170.stderr: 93.8% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.6.log.gz 2024-01-25T15:08:06.583 INFO:teuthology.orchestra.run.smithi186.stderr: 93.7% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.10.log.gz 2024-01-25T15:08:06.687 INFO:teuthology.orchestra.run.smithi186.stderr: 93.7% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.4.log.gz 2024-01-25T15:08:06.725 INFO:teuthology.orchestra.run.smithi170.stderr: 93.7% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.0.log.gz 2024-01-25T15:08:06.985 INFO:teuthology.orchestra.run.smithi186.stderr: 93.9% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.b.log.gz 2024-01-25T15:08:07.071 INFO:teuthology.orchestra.run.smithi170.stderr: 93.7% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.3.log.gz 2024-01-25T15:08:07.072 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-01-25T15:08:07.073 INFO:teuthology.orchestra.run.smithi170.stderr:real 0m2.691s 2024-01-25T15:08:07.073 INFO:teuthology.orchestra.run.smithi170.stderr:user 0m9.738s 2024-01-25T15:08:07.073 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m0.351s 2024-01-25T15:08:07.253 INFO:teuthology.orchestra.run.smithi186.stderr: 93.8% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.1.log.gz 2024-01-25T15:08:07.286 INFO:teuthology.orchestra.run.smithi191.stderr: 93.9% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.11.log.gz 2024-01-25T15:08:07.304 INFO:teuthology.orchestra.run.smithi191.stderr: 94.0% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.8.log.gz 2024-01-25T15:08:07.533 INFO:teuthology.orchestra.run.smithi186.stderr: 93.8% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.7.log.gz 2024-01-25T15:08:07.535 INFO:teuthology.orchestra.run.smithi186.stderr: 2024-01-25T15:08:07.535 INFO:teuthology.orchestra.run.smithi186.stderr:real 0m3.150s 2024-01-25T15:08:07.535 INFO:teuthology.orchestra.run.smithi186.stderr:user 0m15.118s 2024-01-25T15:08:07.535 INFO:teuthology.orchestra.run.smithi186.stderr:sys 0m0.492s 2024-01-25T15:08:07.697 INFO:teuthology.orchestra.run.smithi191.stderr: 93.8% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.2.log.gz 2024-01-25T15:08:07.780 INFO:teuthology.orchestra.run.smithi191.stderr: 93.6% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.l.log.gz 2024-01-25T15:08:08.126 INFO:teuthology.orchestra.run.smithi191.stderr: 93.9% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-osd.5.log.gz 2024-01-25T15:08:08.764 INFO:teuthology.orchestra.run.smithi191.stderr: 95.1% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.f.log.gz 2024-01-25T15:08:08.836 INFO:teuthology.orchestra.run.smithi191.stderr: 93.8% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.c.log.gz 2024-01-25T15:08:46.963 INFO:teuthology.orchestra.run.smithi191.stderr: 93.2% -- replaced with /var/log/ceph/267213a8-bb91-11ee-95b2-87774f69a715/ceph-mds.i.log.gz 2024-01-25T15:08:46.964 INFO:teuthology.orchestra.run.smithi191.stderr: 2024-01-25T15:08:46.964 INFO:teuthology.orchestra.run.smithi191.stderr:real 0m42.580s 2024-01-25T15:08:46.964 INFO:teuthology.orchestra.run.smithi191.stderr:user 1m5.395s 2024-01-25T15:08:46.964 INFO:teuthology.orchestra.run.smithi191.stderr:sys 0m2.074s 2024-01-25T15:08:46.965 INFO:tasks.cephadm:Archiving logs... 2024-01-25T15:08:46.965 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478/remote/smithi170/log 2024-01-25T15:08:46.966 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-25T15:08:48.315 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478/remote/smithi186/log 2024-01-25T15:08:48.316 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-25T15:08:50.090 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478/remote/smithi191/log 2024-01-25T15:08:50.091 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-25T15:08:58.923 INFO:tasks.cephadm:Removing cluster... 2024-01-25T15:08:58.923 DEBUG:teuthology.orchestra.run.smithi170:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 267213a8-bb91-11ee-95b2-87774f69a715 --force 2024-01-25T15:08:59.111 INFO:teuthology.orchestra.run.smithi170.stdout:Deleting cluster with fsid: 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T15:08:59.374 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 267213a8-bb91-11ee-95b2-87774f69a715 --force 2024-01-25T15:08:59.566 INFO:teuthology.orchestra.run.smithi186.stdout:Deleting cluster with fsid: 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T15:08:59.849 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 267213a8-bb91-11ee-95b2-87774f69a715 --force 2024-01-25T15:09:00.032 INFO:teuthology.orchestra.run.smithi191.stdout:Deleting cluster with fsid: 267213a8-bb91-11ee-95b2-87774f69a715 2024-01-25T15:09:00.363 INFO:tasks.cephadm:Removing cephadm ... 2024-01-25T15:09:00.363 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf /home/ubuntu/cephtest/cephadm 2024-01-25T15:09:00.382 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf /home/ubuntu/cephtest/cephadm 2024-01-25T15:09:00.399 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf /home/ubuntu/cephtest/cephadm 2024-01-25T15:09:00.414 INFO:tasks.cephadm:Teardown complete 2024-01-25T15:09:00.414 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-25T15:09:00.425 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-25T15:09:00.425 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-25T15:09:00.428 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-25T15:09:00.441 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-25T15:09:00.555 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-25T15:09:00.565 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-25T15:09:00.565 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-25T15:09:00.568 DEBUG:teuthology.orchestra.run.smithi186:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-25T15:09:00.571 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-25T15:09:00.583 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-01-25T15:09:00.583 INFO:teuthology.orchestra.run.smithi186.stderr:bash: line 1: ntpq: command not found 2024-01-25T15:09:00.584 INFO:teuthology.orchestra.run.smithi191.stderr:bash: line 1: ntpq: command not found 2024-01-25T15:09:00.588 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-25T15:09:00.588 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-01-25T15:09:00.589 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 20 -82us[ -92us] +/- 85ms 2024-01-25T15:09:00.589 INFO:teuthology.orchestra.run.smithi186.stdout:^* hv02.front.sepia.ceph.com 3 6 377 19 +94us[ +84us] +/- 71ms 2024-01-25T15:09:00.589 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 -19us[ -29us] +/- 92ms 2024-01-25T15:09:00.589 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T15:09:00.589 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-25T15:09:00.589 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-01-25T15:09:00.589 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 16 -66us[ -66us] +/- 85ms 2024-01-25T15:09:00.589 INFO:teuthology.orchestra.run.smithi170.stdout:^* hv02.front.sepia.ceph.com 3 6 377 16 +94us[ +88us] +/- 71ms 2024-01-25T15:09:00.589 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 -17us[ -17us] +/- 92ms 2024-01-25T15:09:00.589 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T15:09:00.590 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-25T15:09:00.590 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2024-01-25T15:09:00.590 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 18 -80us[ -80us] +/- 85ms 2024-01-25T15:09:00.590 INFO:teuthology.orchestra.run.smithi191.stdout:^* hv02.front.sepia.ceph.com 3 6 377 19 +66us[ +46us] +/- 71ms 2024-01-25T15:09:00.590 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 -27us[ -27us] +/- 92ms 2024-01-25T15:09:00.591 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-01-25T15:09:00.591 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-25T15:09:00.600 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-25T15:09:00.601 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-25T15:09:00.610 DEBUG:teuthology.orchestra.run.smithi170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-25T15:09:00.714 DEBUG:teuthology.orchestra.run.smithi186:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-25T15:09:00.787 DEBUG:teuthology.orchestra.run.smithi191:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-25T15:09:00.856 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-25T15:09:00.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T15:09:00.889 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-25T15:09:00.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T15:09:00.920 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-25T15:09:00.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T15:09:00.950 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-25T15:09:00.961 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-25T15:09:00.971 INFO:teuthology.task.internal:Duration was 1460.795443 seconds 2024-01-25T15:09:00.971 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-25T15:09:00.981 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-25T15:09:00.981 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-25T15:09:00.984 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-25T15:09:00.986 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-25T15:09:01.026 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-25T15:09:01.028 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-25T15:09:01.032 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-25T15:09:01.412 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-25T15:09:01.412 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2024-01-25T15:09:01.412 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-25T15:09:01.433 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi186.front.sepia.ceph.com 2024-01-25T15:09:01.433 DEBUG:teuthology.orchestra.run.smithi186:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-25T15:09:01.455 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2024-01-25T15:09:01.455 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-25T15:09:01.480 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-25T15:09:01.480 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-25T15:09:01.483 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-25T15:09:01.497 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-25T15:09:01.548 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-25T15:09:01.549 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-25T15:09:01.553 DEBUG:teuthology.orchestra.run.smithi186:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-25T15:09:01.566 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-25T15:09:01.983 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-25T15:09:01.995 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-25T15:09:01.995 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-25T15:09:02.022 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-25T15:09:02.049 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-25T15:09:02.077 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-25T15:09:02.088 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-25T15:09:02.090 DEBUG:teuthology.orchestra.run.smithi186:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-25T15:09:02.093 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-25T15:09:02.114 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2024-01-25T15:09:02.116 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = core 2024-01-25T15:09:02.143 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2024-01-25T15:09:02.170 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-25T15:09:02.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T15:09:02.185 DEBUG:teuthology.orchestra.run.smithi186:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-25T15:09:02.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T15:09:02.200 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-25T15:09:02.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-25T15:09:02.224 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-25T15:09:02.236 INFO:teuthology.task.internal:Transferring archived files... 2024-01-25T15:09:02.236 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478/remote/smithi170 2024-01-25T15:09:02.237 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-25T15:09:02.281 DEBUG:teuthology.misc:Transferring archived files from smithi186:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478/remote/smithi186 2024-01-25T15:09:02.281 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-25T15:09:02.319 DEBUG:teuthology.misc:Transferring archived files from smithi191:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478/remote/smithi191 2024-01-25T15:09:02.320 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-25T15:09:02.359 INFO:teuthology.task.internal:Removing archive directory... 2024-01-25T15:09:02.359 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-25T15:09:02.361 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-25T15:09:02.364 DEBUG:teuthology.orchestra.run.smithi191:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-25T15:09:02.407 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-25T15:09:02.420 INFO:teuthology.task.internal:Not uploading archives. 2024-01-25T15:09:02.421 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-25T15:09:02.431 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-25T15:09:02.431 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-25T15:09:02.434 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-25T15:09:02.436 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-25T15:09:02.446 INFO:teuthology.orchestra.run.smithi170.stdout: 265773 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 25 15:09 /home/ubuntu/cephtest 2024-01-25T15:09:02.448 INFO:teuthology.orchestra.run.smithi186.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 25 15:09 /home/ubuntu/cephtest 2024-01-25T15:09:02.461 INFO:teuthology.orchestra.run.smithi191.stdout: 262162 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 25 15:09 /home/ubuntu/cephtest 2024-01-25T15:09:02.462 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-25T15:09:02.477 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-25T15:09:02.501 INFO:teuthology.nuke:Checking targets against current locks 2024-01-25T15:09:02.527 DEBUG:teuthology.nuke:shortname: smithi170 2024-01-25T15:09:02.528 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-25T15:09:02.550 DEBUG:teuthology.nuke:shortname: smithi186 2024-01-25T15:09:02.550 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-25T15:09:02.555 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 14:36:24.992793', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLgeh40enNcoRxcbQVe70Az2yvPF61rqI1k0qai7XZ06nIYSHLbPTvxv06/um59EPEzmqYeyVNXRl2FjiQfMe48='} 2024-01-25T15:09:02.572 DEBUG:teuthology.nuke:shortname: smithi191 2024-01-25T15:09:02.572 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-25T15:09:02.578 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 14:36:24.994165', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLASKxRgHg/eQx3Hs33fm+Uc9kXA9L474Kw+66JzbQisud44CcqlcAPMfBZRwCPtLaQtKivXckgt8G/OUJ8YEHs='} 2024-01-25T15:09:02.594 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-25_13:52:19-fs-wip-vshankar-testing-20240125.044502-testing-default-smithi/7531478', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-25 14:36:24.995408', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyu91bXCYsgoj4F65X6IvyknQhf/t9Q1uulA8gF9DRRnFOscW5OmwyLGNtnKgr7fvM/Klo76sa+FDbo+Nq2ZJs='} 2024-01-25T15:09:02.605 INFO:teuthology.orchestra.console.smithi170:Power off 2024-01-25T15:09:02.605 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T15:09:02.627 DEBUG:teuthology.orchestra.console.smithi170:power off output: Chassis Power Control: Down/Off 2024-01-25T15:09:02.628 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T15:09:02.643 INFO:teuthology.orchestra.console.smithi186:Power off 2024-01-25T15:09:02.643 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T15:09:02.659 INFO:teuthology.orchestra.console.smithi191:Power off 2024-01-25T15:09:02.660 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-25T15:09:02.668 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-01-25T15:09:02.669 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2024-01-25T15:09:02.669 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T15:09:02.683 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-01-25T15:09:02.684 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T15:09:02.694 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-01-25T15:09:02.708 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-01-25T15:09:06.671 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T15:09:06.695 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T15:09:06.709 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T15:09:06.782 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is on 2024-01-25T15:09:06.806 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-01-25T15:09:06.818 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-01-25T15:09:10.787 DEBUG:teuthology.orchestra.console.smithi170:pexpect command: ipmitool -H smithi170.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T15:09:10.807 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T15:09:10.819 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-25T15:09:10.898 DEBUG:teuthology.orchestra.console.smithi170:check power output: Chassis Power is off 2024-01-25T15:09:10.918 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2024-01-25T15:09:10.929 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-01-25T15:09:10.999 INFO:teuthology.orchestra.console.smithi170:Power off completed 2024-01-25T15:09:11.019 INFO:teuthology.orchestra.console.smithi186:Power off completed 2024-01-25T15:09:11.029 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-01-25T15:09:11.134 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/fsstress}} duration: 1460.7954425811768 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_vshankar@teuthology status: fail success: false 2024-01-25T15:09:11.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-25T15:09:11.220 INFO:teuthology.run:FAIL